2024-03-09T14:14:57.547 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-09T14:14:57.548 DEBUG:teuthology.run:Teuthology command: teuthology --name cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi --owner scheduled_cbodley@teuthology --verbose --archive /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588483 --description rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} -- /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588483/orig.config.yaml 2024-03-09T14:14:57.599 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-09T14:14:57.715 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588483 branch: wip-rgw-account-v3 description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7588483' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-rgw-account-v3 ceph: conf: client: debug rgw: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw d3n l1 datacache persistent path: /tmp/rgw_datacache/ rgw d3n l1 datacache size: 10737418240 rgw d3n l1 local datacache enabled: true rgw enable ops log: true rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 compression type: random datacache: true datacache_path: /tmp/rgw_datacache ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 force-branch: wip-iam-user-apis git_remote: https://github.com/cbodley/ slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rgw-account-v3 sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 owner: scheduled_cbodley@teuthology priority: 60 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 3347 sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 sleep_before_teardown: 0 suite: rgw suite_branch: wip-rgw-account-v3 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 targets: smithi099.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJvxb6Cx57k+Dk+mitefAnAU85CNp5VA/Ns5TtPcNylqPgdgH53lXV57Tp6MB+4UAAX5HtNWinI+yLWMEa45IKQ= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH5JVAmELeUh55pGkGtGa7EGX66r2w7RVpzb7HG3i0TSR9KbFAys0wgxHv/ahX5R6Yl49ACut6DEtH5SaYwLo4A= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-datacache.sh env: RGW_DATACACHE_PATH: /tmp/rgw_datacache - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-09_13:26:09 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-09T14:14:57.715 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa; will attempt to use it 2024-03-09T14:14:57.716 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks 2024-03-09T14:14:57.716 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-09T14:14:57.717 INFO:teuthology.task.internal:Checking packages... 2024-03-09T14:14:57.741 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'c00d9c609fb42a2a25f1c196bed064ca8bb02413' 2024-03-09T14:14:57.741 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-09T14:14:57.741 INFO:teuthology.packaging:ref: None 2024-03-09T14:14:57.741 INFO:teuthology.packaging:tag: None 2024-03-09T14:14:57.742 INFO:teuthology.packaging:branch: wip-rgw-account-v3 2024-03-09T14:14:57.742 INFO:teuthology.packaging:sha1: c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:14:57.742 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-rgw-account-v3 2024-03-09T14:14:57.976 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2079-gc00d9c60-1jammy 2024-03-09T14:14:57.977 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-09T14:14:57.984 INFO:teuthology.task.internal:no buildpackages task found 2024-03-09T14:14:57.984 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-09T14:14:57.990 INFO:teuthology.task.internal:Saving configuration 2024-03-09T14:14:58.018 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-09T14:14:58.025 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-09T14:14:58.050 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-09 14:09:18.060897', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILuky5Kk4B7bbjF/YvSOdcyyvLrcr+QYnVbm6lN8YBNY'} 2024-03-09T14:14:58.075 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-09 14:09:18.062315', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIEX70ewJH7Q2/2JKrY4fEtWeQ9aviG6yyzEBOmh5qeBM'} 2024-03-09T14:14:58.075 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-09T14:14:58.082 INFO:teuthology.task.internal:roles: ubuntu@smithi099.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-03-09T14:14:58.082 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-03-09T14:14:58.082 INFO:teuthology.run_tasks:Running task console_log... 2024-03-09T14:14:58.159 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff1a69b30d0>, signals=[15]) 2024-03-09T14:14:58.159 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-09T14:14:58.166 INFO:teuthology.task.internal:Opening connections... 2024-03-09T14:14:58.166 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi099.front.sepia.ceph.com 2024-03-09T14:14:58.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:14:58.292 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2024-03-09T14:14:58.294 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:14:58.405 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-09T14:14:58.412 DEBUG:teuthology.orchestra.run.smithi099:> uname -m 2024-03-09T14:14:58.417 INFO:teuthology.orchestra.run.smithi099.stdout:x86_64 2024-03-09T14:14:58.417 DEBUG:teuthology.orchestra.run.smithi099:> cat /etc/os-release 2024-03-09T14:14:58.463 INFO:teuthology.orchestra.run.smithi099.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-09T14:14:58.464 INFO:teuthology.orchestra.run.smithi099.stdout:NAME="Ubuntu" 2024-03-09T14:14:58.464 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_ID="22.04" 2024-03-09T14:14:58.464 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-09T14:14:58.464 INFO:teuthology.orchestra.run.smithi099.stdout:VERSION_CODENAME=jammy 2024-03-09T14:14:58.464 INFO:teuthology.orchestra.run.smithi099.stdout:ID=ubuntu 2024-03-09T14:14:58.464 INFO:teuthology.orchestra.run.smithi099.stdout:ID_LIKE=debian 2024-03-09T14:14:58.465 INFO:teuthology.orchestra.run.smithi099.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-09T14:14:58.465 INFO:teuthology.orchestra.run.smithi099.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-09T14:14:58.465 INFO:teuthology.orchestra.run.smithi099.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-09T14:14:58.465 INFO:teuthology.orchestra.run.smithi099.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-09T14:14:58.465 INFO:teuthology.orchestra.run.smithi099.stdout:UBUNTU_CODENAME=jammy 2024-03-09T14:14:58.465 INFO:teuthology.lock.ops:Updating smithi099.front.sepia.ceph.com on lock server 2024-03-09T14:14:58.482 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-03-09T14:14:58.487 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-03-09T14:14:58.488 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-03-09T14:14:58.534 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-03-09T14:14:58.534 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Ubuntu" 2024-03-09T14:14:58.534 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="22.04" 2024-03-09T14:14:58.534 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-03-09T14:14:58.534 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_CODENAME=jammy 2024-03-09T14:14:58.534 INFO:teuthology.orchestra.run.smithi179.stdout:ID=ubuntu 2024-03-09T14:14:58.534 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE=debian 2024-03-09T14:14:58.535 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.ubuntu.com/" 2024-03-09T14:14:58.535 INFO:teuthology.orchestra.run.smithi179.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-03-09T14:14:58.535 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-03-09T14:14:58.535 INFO:teuthology.orchestra.run.smithi179.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-03-09T14:14:58.535 INFO:teuthology.orchestra.run.smithi179.stdout:UBUNTU_CODENAME=jammy 2024-03-09T14:14:58.535 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-03-09T14:14:58.582 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-09T14:14:58.592 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-09T14:14:58.598 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-09T14:14:58.598 DEBUG:teuthology.orchestra.run.smithi099:> test '!' -e /home/ubuntu/cephtest 2024-03-09T14:14:58.600 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2024-03-09T14:14:58.606 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-09T14:14:58.611 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-09T14:14:58.612 DEBUG:teuthology.orchestra.run.smithi099:> test -z $(ls -A /var/lib/ceph) 2024-03-09T14:14:58.648 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2024-03-09T14:14:58.656 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-09T14:14:58.714 INFO:teuthology.run_tasks:Running task kernel... 2024-03-09T14:14:58.729 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-09T14:14:58.729 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-09T14:14:58.729 DEBUG:teuthology.orchestra.run.smithi099:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-09T14:14:58.730 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-09T14:14:58.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:14:58.734 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-03-09T14:14:58.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:14:58.735 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-03-09T14:14:58.782 INFO:teuthology.orchestra.run.smithi179.stdout:5.15.0-56-generic 2024-03-09T14:14:58.783 INFO:teuthology.task.kernel:Running kernel on smithi179: 5.15.0-56-generic 2024-03-09T14:14:58.783 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get clean 2024-03-09T14:14:58.784 INFO:teuthology.orchestra.run.smithi099.stdout:5.15.0-56-generic 2024-03-09T14:14:58.784 INFO:teuthology.task.kernel:Running kernel on smithi099: 5.15.0-56-generic 2024-03-09T14:14:58.784 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get clean 2024-03-09T14:14:58.912 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get update 2024-03-09T14:14:58.916 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-03-09T14:14:59.194 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-09T14:14:59.197 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-03-09T14:14:59.218 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-09T14:14:59.223 INFO:teuthology.orchestra.run.smithi179.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-03-09T14:14:59.248 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-03-09T14:14:59.270 INFO:teuthology.orchestra.run.smithi179.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-03-09T14:14:59.608 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [419 kB] 2024-03-09T14:14:59.613 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-03-09T14:14:59.627 INFO:teuthology.orchestra.run.smithi179.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-03-09T14:14:59.632 INFO:teuthology.orchestra.run.smithi179.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,239 kB] 2024-03-09T14:14:59.752 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,458 kB] 2024-03-09T14:14:59.764 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [585 kB] 2024-03-09T14:14:59.896 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,239 kB] 2024-03-09T14:14:59.961 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,458 kB] 2024-03-09T14:15:00.044 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [419 kB] 2024-03-09T14:15:00.053 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [585 kB] 2024-03-09T14:15:00.060 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [222 kB] 2024-03-09T14:15:00.063 INFO:teuthology.orchestra.run.smithi179.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [222 kB] 2024-03-09T14:15:00.072 INFO:teuthology.orchestra.run.smithi179.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-03-09T14:15:00.073 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-03-09T14:15:00.073 INFO:teuthology.orchestra.run.smithi179.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-03-09T14:15:00.074 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,523 kB] 2024-03-09T14:15:00.074 INFO:teuthology.orchestra.run.smithi179.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,523 kB] 2024-03-09T14:15:00.093 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [283 kB] 2024-03-09T14:15:00.108 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-03-09T14:15:00.108 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,557 kB] 2024-03-09T14:15:00.112 INFO:teuthology.orchestra.run.smithi179.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [283 kB] 2024-03-09T14:15:00.129 INFO:teuthology.orchestra.run.smithi179.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-03-09T14:15:00.129 INFO:teuthology.orchestra.run.smithi179.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-03-09T14:15:00.132 INFO:teuthology.orchestra.run.smithi179.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,557 kB] 2024-03-09T14:15:00.153 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [33.7 kB] 2024-03-09T14:15:00.154 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [253 kB] 2024-03-09T14:15:00.163 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-03-09T14:15:00.166 INFO:teuthology.orchestra.run.smithi179.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [253 kB] 2024-03-09T14:15:00.177 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [35.3 kB] 2024-03-09T14:15:00.177 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [597 kB] 2024-03-09T14:15:00.179 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [259 kB] 2024-03-09T14:15:00.187 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-03-09T14:15:00.192 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-03-09T14:15:00.205 INFO:teuthology.orchestra.run.smithi179.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [259 kB] 2024-03-09T14:15:00.205 INFO:teuthology.orchestra.run.smithi179.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-03-09T14:15:00.205 INFO:teuthology.orchestra.run.smithi179.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [597 kB] 2024-03-09T14:15:00.209 INFO:teuthology.orchestra.run.smithi179.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-03-09T14:15:00.211 INFO:teuthology.orchestra.run.smithi179.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-03-09T14:15:00.351 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,054 kB] 2024-03-09T14:15:00.370 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-03-09T14:15:00.373 INFO:teuthology.orchestra.run.smithi179.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,054 kB] 2024-03-09T14:15:00.385 INFO:teuthology.orchestra.run.smithi179.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-03-09T14:15:00.768 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-03-09T14:15:00.774 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-03-09T14:15:00.774 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-03-09T14:15:00.782 INFO:teuthology.orchestra.run.smithi179.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-03-09T14:15:00.788 INFO:teuthology.orchestra.run.smithi179.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.1 kB] 2024-03-09T14:15:00.788 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-03-09T14:15:00.791 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-03-09T14:15:00.802 INFO:teuthology.orchestra.run.smithi179.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-03-09T14:15:00.802 INFO:teuthology.orchestra.run.smithi179.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,476 B] 2024-03-09T14:15:00.805 INFO:teuthology.orchestra.run.smithi179.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-03-09T14:15:00.981 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [693 kB] 2024-03-09T14:15:01.004 INFO:teuthology.orchestra.run.smithi179.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [693 kB] 2024-03-09T14:15:01.019 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [238 kB] 2024-03-09T14:15:01.031 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-03-09T14:15:01.032 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,160 B] 2024-03-09T14:15:01.033 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-03-09T14:15:01.035 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-03-09T14:15:01.036 INFO:teuthology.orchestra.run.smithi099.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-03-09T14:15:01.036 INFO:teuthology.orchestra.run.smithi099.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-03-09T14:15:01.038 INFO:teuthology.orchestra.run.smithi099.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-03-09T14:15:01.042 INFO:teuthology.orchestra.run.smithi179.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [238 kB] 2024-03-09T14:15:01.054 INFO:teuthology.orchestra.run.smithi179.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-03-09T14:15:01.055 INFO:teuthology.orchestra.run.smithi179.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,160 B] 2024-03-09T14:15:01.056 INFO:teuthology.orchestra.run.smithi179.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.1 kB] 2024-03-09T14:15:01.058 INFO:teuthology.orchestra.run.smithi179.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.1 kB] 2024-03-09T14:15:01.059 INFO:teuthology.orchestra.run.smithi179.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-03-09T14:15:01.059 INFO:teuthology.orchestra.run.smithi179.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.9 kB] 2024-03-09T14:15:01.060 INFO:teuthology.orchestra.run.smithi179.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [41.7 kB] 2024-03-09T14:15:01.065 INFO:teuthology.orchestra.run.smithi099.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-03-09T14:15:01.086 INFO:teuthology.orchestra.run.smithi179.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.5 kB] 2024-03-09T14:15:01.228 INFO:teuthology.orchestra.run.smithi099.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-03-09T14:15:01.249 INFO:teuthology.orchestra.run.smithi179.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-03-09T14:15:01.311 INFO:teuthology.orchestra.run.smithi099.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2024-03-09T14:15:01.332 INFO:teuthology.orchestra.run.smithi179.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-03-09T14:15:01.337 INFO:teuthology.orchestra.run.smithi179.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [24.3 kB] 2024-03-09T14:15:01.416 INFO:teuthology.orchestra.run.smithi099.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.4 kB] 2024-03-09T14:15:01.444 INFO:teuthology.orchestra.run.smithi099.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-03-09T14:15:01.456 INFO:teuthology.orchestra.run.smithi179.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-03-09T14:15:01.494 INFO:teuthology.orchestra.run.smithi099.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-03-09T14:15:01.507 INFO:teuthology.orchestra.run.smithi179.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-03-09T14:15:05.771 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 12.1 MB in 3s (4,809 kB/s) 2024-03-09T14:15:05.810 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 12.1 MB in 3s (4,819 kB/s) 2024-03-09T14:15:07.040 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-03-09T14:15:07.057 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-09T14:15:07.117 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-03-09T14:15:07.146 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-03-09T14:15:07.164 DEBUG:teuthology.orchestra.run.smithi179:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-09T14:15:07.223 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-03-09T14:15:07.319 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-03-09T14:15:07.319 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-03-09T14:15:07.416 INFO:teuthology.orchestra.run.smithi179.stdout:Building dependency tree... 2024-03-09T14:15:07.417 INFO:teuthology.orchestra.run.smithi179.stdout:Reading state information... 2024-03-09T14:15:07.493 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-03-09T14:15:07.493 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-09T14:15:07.493 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-09T14:15:07.494 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-09T14:15:07.494 INFO:teuthology.orchestra.run.smithi099.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-03-09T14:15:07.494 INFO:teuthology.orchestra.run.smithi099.stdout: python2.7-minimal 2024-03-09T14:15:07.494 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-09T14:15:07.495 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-03-09T14:15:07.495 INFO:teuthology.orchestra.run.smithi099.stdout: linux-generic linux-headers-5.15.0-100 linux-headers-5.15.0-100-generic 2024-03-09T14:15:07.495 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-generic linux-image-5.15.0-100-generic 2024-03-09T14:15:07.496 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-5.15.0-100-generic linux-modules-extra-5.15.0-100-generic 2024-03-09T14:15:07.497 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-03-09T14:15:07.497 INFO:teuthology.orchestra.run.smithi099.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-03-09T14:15:07.497 INFO:teuthology.orchestra.run.smithi099.stdout:Recommended packages: 2024-03-09T14:15:07.497 INFO:teuthology.orchestra.run.smithi099.stdout: thermald 2024-03-09T14:15:07.546 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-03-09T14:15:07.546 INFO:teuthology.orchestra.run.smithi099.stdout: linux-headers-5.15.0-100 linux-headers-5.15.0-100-generic 2024-03-09T14:15:07.546 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.15.0-100-generic linux-modules-5.15.0-100-generic 2024-03-09T14:15:07.547 INFO:teuthology.orchestra.run.smithi099.stdout: linux-modules-extra-5.15.0-100-generic 2024-03-09T14:15:07.548 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages will be upgraded: 2024-03-09T14:15:07.548 INFO:teuthology.orchestra.run.smithi099.stdout: linux-generic linux-headers-generic linux-image-generic 2024-03-09T14:15:07.584 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages were automatically installed and are no longer required: 2024-03-09T14:15:07.584 INFO:teuthology.orchestra.run.smithi179.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-09T14:15:07.584 INFO:teuthology.orchestra.run.smithi179.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-09T14:15:07.585 INFO:teuthology.orchestra.run.smithi179.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-09T14:15:07.585 INFO:teuthology.orchestra.run.smithi179.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-03-09T14:15:07.585 INFO:teuthology.orchestra.run.smithi179.stdout: python2.7-minimal 2024-03-09T14:15:07.585 INFO:teuthology.orchestra.run.smithi179.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-09T14:15:07.586 INFO:teuthology.orchestra.run.smithi179.stdout:The following additional packages will be installed: 2024-03-09T14:15:07.586 INFO:teuthology.orchestra.run.smithi179.stdout: linux-generic linux-headers-5.15.0-100 linux-headers-5.15.0-100-generic 2024-03-09T14:15:07.586 INFO:teuthology.orchestra.run.smithi179.stdout: linux-headers-generic linux-image-5.15.0-100-generic 2024-03-09T14:15:07.587 INFO:teuthology.orchestra.run.smithi179.stdout: linux-modules-5.15.0-100-generic linux-modules-extra-5.15.0-100-generic 2024-03-09T14:15:07.588 INFO:teuthology.orchestra.run.smithi179.stdout:Suggested packages: 2024-03-09T14:15:07.588 INFO:teuthology.orchestra.run.smithi179.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-03-09T14:15:07.588 INFO:teuthology.orchestra.run.smithi179.stdout:Recommended packages: 2024-03-09T14:15:07.588 INFO:teuthology.orchestra.run.smithi179.stdout: thermald 2024-03-09T14:15:07.644 INFO:teuthology.orchestra.run.smithi179.stdout:The following NEW packages will be installed: 2024-03-09T14:15:07.644 INFO:teuthology.orchestra.run.smithi179.stdout: linux-headers-5.15.0-100 linux-headers-5.15.0-100-generic 2024-03-09T14:15:07.644 INFO:teuthology.orchestra.run.smithi179.stdout: linux-image-5.15.0-100-generic linux-modules-5.15.0-100-generic 2024-03-09T14:15:07.645 INFO:teuthology.orchestra.run.smithi179.stdout: linux-modules-extra-5.15.0-100-generic 2024-03-09T14:15:07.646 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages will be upgraded: 2024-03-09T14:15:07.646 INFO:teuthology.orchestra.run.smithi179.stdout: linux-generic linux-headers-generic linux-image-generic 2024-03-09T14:15:07.702 INFO:teuthology.orchestra.run.smithi179.stdout:3 upgraded, 5 newly installed, 0 to remove and 288 not upgraded. 2024-03-09T14:15:07.703 INFO:teuthology.orchestra.run.smithi179.stdout:Need to get 113 MB of archives. 2024-03-09T14:15:07.703 INFO:teuthology.orchestra.run.smithi179.stdout:After this operation, 582 MB of additional disk space will be used. 2024-03-09T14:15:07.703 INFO:teuthology.orchestra.run.smithi179.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-100-generic amd64 5.15.0-100.110 [22.6 MB] 2024-03-09T14:15:07.730 INFO:teuthology.orchestra.run.smithi099.stdout:3 upgraded, 5 newly installed, 0 to remove and 288 not upgraded. 2024-03-09T14:15:07.731 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 113 MB of archives. 2024-03-09T14:15:07.731 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 582 MB of additional disk space will be used. 2024-03-09T14:15:07.731 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-100-generic amd64 5.15.0-100.110 [22.6 MB] 2024-03-09T14:15:08.197 INFO:teuthology.orchestra.run.smithi179.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-100-generic amd64 5.15.0-100.110 [11.5 MB] 2024-03-09T14:15:08.332 INFO:teuthology.orchestra.run.smithi179.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-100-generic amd64 5.15.0-100.110 [63.8 MB] 2024-03-09T14:15:09.237 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-100-generic amd64 5.15.0-100.110 [11.5 MB] 2024-03-09T14:15:09.586 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-100-generic amd64 5.15.0-100.110 [63.8 MB] 2024-03-09T14:15:10.087 INFO:teuthology.orchestra.run.smithi179.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.100.97 [1,696 B] 2024-03-09T14:15:10.087 INFO:teuthology.orchestra.run.smithi179.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.100.97 [2,454 B] 2024-03-09T14:15:10.087 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-100 all 5.15.0-100.110 [12.3 MB] 2024-03-09T14:15:10.304 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-100-generic amd64 5.15.0-100.110 [2,858 kB] 2024-03-09T14:15:10.348 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.100.97 [2,292 B] 2024-03-09T14:15:10.743 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 113 MB in 3s (42.0 MB/s) 2024-03-09T14:15:10.923 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-modules-5.15.0-100-generic. 2024-03-09T14:15:11.938 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.100.97 [1,696 B] 2024-03-09T14:15:11.962 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.100.97 [2,454 B] 2024-03-09T14:15:11.987 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-100 all 5.15.0-100.110 [12.3 MB] 2024-03-09T14:15:12.410 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-100-generic amd64 5.15.0-100.110 [2,858 kB] 2024-03-09T14:15:12.490 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.100.97 [2,292 B] 2024-03-09T14:15:12.868 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 113 MB in 5s (22.9 MB/s) 2024-03-09T14:15:12.965 INFO:teuthology.orchestra.run.smithi179.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-03-09T14:15:12.970 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../0-linux-modules-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-09T14:15:13.053 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-modules-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:13.060 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-modules-5.15.0-100-generic. 2024-03-09T14:15:15.038 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-image-5.15.0-100-generic. 2024-03-09T14:15:15.047 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-03-09T14:15:15.051 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../0-linux-modules-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-09T14:15:15.059 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../1-linux-image-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-09T14:15:15.132 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-modules-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:15.139 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:15.624 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-100-generic. 2024-03-09T14:15:15.635 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-09T14:15:15.674 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-modules-extra-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:17.273 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-image-5.15.0-100-generic. 2024-03-09T14:15:17.297 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../1-linux-image-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-09T14:15:17.395 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:17.851 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-100-generic. 2024-03-09T14:15:17.872 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-09T14:15:17.910 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-modules-extra-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:22.090 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../3-linux-generic_5.15.0.100.97_amd64.deb ... 2024-03-09T14:15:22.209 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-09T14:15:22.525 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.100.97_amd64.deb ... 2024-03-09T14:15:22.654 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-image-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-09T14:15:22.957 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-headers-5.15.0-100. 2024-03-09T14:15:22.980 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../5-linux-headers-5.15.0-100_5.15.0-100.110_all.deb ... 2024-03-09T14:15:23.024 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-headers-5.15.0-100 (5.15.0-100.110) ... 2024-03-09T14:15:24.772 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../3-linux-generic_5.15.0.100.97_amd64.deb ... 2024-03-09T14:15:24.900 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-09T14:15:25.283 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.100.97_amd64.deb ... 2024-03-09T14:15:25.395 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-image-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-09T14:15:25.664 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-headers-5.15.0-100. 2024-03-09T14:15:25.687 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../5-linux-headers-5.15.0-100_5.15.0-100.110_all.deb ... 2024-03-09T14:15:25.731 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-5.15.0-100 (5.15.0-100.110) ... 2024-03-09T14:15:28.875 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-headers-5.15.0-100-generic. 2024-03-09T14:15:28.913 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../6-linux-headers-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-09T14:15:28.950 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-headers-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:31.200 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package linux-headers-5.15.0-100-generic. 2024-03-09T14:15:31.237 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../6-linux-headers-5.15.0-100-generic_5.15.0-100.110_amd64.deb ... 2024-03-09T14:15:31.274 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:31.442 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.100.97_amd64.deb ... 2024-03-09T14:15:31.570 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-headers-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-09T14:15:31.894 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-headers-5.15.0-100 (5.15.0-100.110) ... 2024-03-09T14:15:32.024 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-headers-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:32.150 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-headers-generic (5.15.0.100.97) ... 2024-03-09T14:15:32.279 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:33.627 INFO:teuthology.orchestra.run.smithi179.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-03-09T14:15:33.627 INFO:teuthology.orchestra.run.smithi179.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-03-09T14:15:33.627 INFO:teuthology.orchestra.run.smithi179.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-100-generic 2024-03-09T14:15:33.628 INFO:teuthology.orchestra.run.smithi179.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-100-generic 2024-03-09T14:15:33.798 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-modules-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:34.536 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.100.97_amd64.deb ... 2024-03-09T14:15:35.267 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking linux-headers-generic (5.15.0.100.97) over (5.15.0.56.54) ... 2024-03-09T14:15:35.626 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-5.15.0-100 (5.15.0-100.110) ... 2024-03-09T14:15:35.649 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-modules-extra-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:35.747 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:35.865 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-headers-generic (5.15.0.100.97) ... 2024-03-09T14:15:35.985 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:37.034 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-image-generic (5.15.0.100.97) ... 2024-03-09T14:15:37.160 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-generic (5.15.0.100.97) ... 2024-03-09T14:15:37.286 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:37.319 INFO:teuthology.orchestra.run.smithi099.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-03-09T14:15:37.319 INFO:teuthology.orchestra.run.smithi099.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-03-09T14:15:37.319 INFO:teuthology.orchestra.run.smithi099.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-100-generic 2024-03-09T14:15:37.319 INFO:teuthology.orchestra.run.smithi099.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-100-generic 2024-03-09T14:15:37.354 INFO:teuthology.orchestra.run.smithi179.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-03-09T14:15:37.355 INFO:teuthology.orchestra.run.smithi179.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-100-generic 2024-03-09T14:15:37.478 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-modules-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:38.921 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-modules-extra-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:40.289 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-image-generic (5.15.0.100.97) ... 2024-03-09T14:15:41.131 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up linux-generic (5.15.0.100.97) ... 2024-03-09T14:15:41.266 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for linux-image-5.15.0-100-generic (5.15.0-100.110) ... 2024-03-09T14:15:41.323 INFO:teuthology.orchestra.run.smithi099.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-03-09T14:15:41.323 INFO:teuthology.orchestra.run.smithi099.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-100-generic 2024-03-09T14:15:51.446 INFO:teuthology.orchestra.run.smithi179.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-03-09T14:15:51.446 INFO:teuthology.orchestra.run.smithi179.stdout:Sourcing file `/etc/default/grub' 2024-03-09T14:15:51.460 INFO:teuthology.orchestra.run.smithi179.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-09T14:15:51.474 INFO:teuthology.orchestra.run.smithi179.stdout:Generating grub configuration file ... 2024-03-09T14:15:51.706 INFO:teuthology.orchestra.run.smithi179.stdout:Found linux image: /boot/vmlinuz-5.15.0-100-generic 2024-03-09T14:15:51.731 INFO:teuthology.orchestra.run.smithi179.stdout:Found initrd image: /boot/initrd.img-5.15.0-100-generic 2024-03-09T14:15:52.087 INFO:teuthology.orchestra.run.smithi179.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-09T14:15:52.093 INFO:teuthology.orchestra.run.smithi179.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-09T14:15:52.165 INFO:teuthology.orchestra.run.smithi179.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-09T14:15:52.170 INFO:teuthology.orchestra.run.smithi179.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-09T14:15:52.317 INFO:teuthology.orchestra.run.smithi179.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-09T14:15:52.317 INFO:teuthology.orchestra.run.smithi179.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-03-09T14:15:52.317 INFO:teuthology.orchestra.run.smithi179.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-09T14:15:52.362 INFO:teuthology.orchestra.run.smithi179.stdout:done 2024-03-09T14:15:52.866 DEBUG:teuthology.orchestra.run.smithi179:> dpkg -s linux-image-generic 2024-03-09T14:15:52.885 INFO:teuthology.orchestra.run.smithi179.stdout:Package: linux-image-generic 2024-03-09T14:15:52.885 INFO:teuthology.orchestra.run.smithi179.stdout:Status: install ok installed 2024-03-09T14:15:52.885 INFO:teuthology.orchestra.run.smithi179.stdout:Priority: optional 2024-03-09T14:15:52.885 INFO:teuthology.orchestra.run.smithi179.stdout:Section: kernel 2024-03-09T14:15:52.886 INFO:teuthology.orchestra.run.smithi179.stdout:Installed-Size: 21 2024-03-09T14:15:52.886 INFO:teuthology.orchestra.run.smithi179.stdout:Maintainer: Ubuntu Kernel Team 2024-03-09T14:15:52.886 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: amd64 2024-03-09T14:15:52.886 INFO:teuthology.orchestra.run.smithi179.stdout:Source: linux-meta 2024-03-09T14:15:52.886 INFO:teuthology.orchestra.run.smithi179.stdout:Version: 5.15.0.100.97 2024-03-09T14:15:52.886 INFO:teuthology.orchestra.run.smithi179.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-100), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-03-09T14:15:52.886 INFO:teuthology.orchestra.run.smithi179.stdout:Depends: linux-image-5.15.0-100-generic, linux-modules-extra-5.15.0-100-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-09T14:15:52.886 INFO:teuthology.orchestra.run.smithi179.stdout:Recommends: thermald 2024-03-09T14:15:52.886 INFO:teuthology.orchestra.run.smithi179.stdout:Description: Generic Linux kernel image 2024-03-09T14:15:52.886 INFO:teuthology.orchestra.run.smithi179.stdout: This package will always depend on the latest generic kernel image 2024-03-09T14:15:52.886 INFO:teuthology.orchestra.run.smithi179.stdout: available. 2024-03-09T14:15:52.886 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-100-generic 2024-03-09T14:15:52.887 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-09T14:15:52.887 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-09T14:15:52.887 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-03-09T14:15:52.887 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi179.front.sepia.ceph.com, path=None, version=distro) 2024-03-09T14:15:52.887 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get clean 2024-03-09T14:15:53.029 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get update 2024-03-09T14:15:53.276 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-09T14:15:53.276 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-09T14:15:53.349 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-09T14:15:53.431 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-09T14:15:54.546 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-03-09T14:15:54.564 DEBUG:teuthology.orchestra.run.smithi179:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-09T14:15:54.625 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-03-09T14:15:54.819 INFO:teuthology.orchestra.run.smithi179.stdout:Building dependency tree... 2024-03-09T14:15:54.819 INFO:teuthology.orchestra.run.smithi179.stdout:Reading state information... 2024-03-09T14:15:54.990 INFO:teuthology.orchestra.run.smithi179.stdout:linux-image-generic is already the newest version (5.15.0.100.97). 2024-03-09T14:15:54.990 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages were automatically installed and are no longer required: 2024-03-09T14:15:54.990 INFO:teuthology.orchestra.run.smithi179.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-09T14:15:54.990 INFO:teuthology.orchestra.run.smithi179.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-09T14:15:54.990 INFO:teuthology.orchestra.run.smithi179.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-09T14:15:54.991 INFO:teuthology.orchestra.run.smithi179.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-09T14:15:54.991 INFO:teuthology.orchestra.run.smithi179.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-09T14:15:54.991 INFO:teuthology.orchestra.run.smithi179.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-09T14:15:55.030 INFO:teuthology.orchestra.run.smithi179.stdout:0 upgraded, 0 newly installed, 0 to remove and 288 not upgraded. 2024-03-09T14:15:55.032 DEBUG:teuthology.orchestra.run.smithi179:> dpkg -s linux-image-generic 2024-03-09T14:15:55.047 INFO:teuthology.orchestra.run.smithi179.stdout:Package: linux-image-generic 2024-03-09T14:15:55.048 INFO:teuthology.orchestra.run.smithi179.stdout:Status: install ok installed 2024-03-09T14:15:55.048 INFO:teuthology.orchestra.run.smithi179.stdout:Priority: optional 2024-03-09T14:15:55.048 INFO:teuthology.orchestra.run.smithi179.stdout:Section: kernel 2024-03-09T14:15:55.048 INFO:teuthology.orchestra.run.smithi179.stdout:Installed-Size: 21 2024-03-09T14:15:55.048 INFO:teuthology.orchestra.run.smithi179.stdout:Maintainer: Ubuntu Kernel Team 2024-03-09T14:15:55.048 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: amd64 2024-03-09T14:15:55.048 INFO:teuthology.orchestra.run.smithi179.stdout:Source: linux-meta 2024-03-09T14:15:55.048 INFO:teuthology.orchestra.run.smithi179.stdout:Version: 5.15.0.100.97 2024-03-09T14:15:55.048 INFO:teuthology.orchestra.run.smithi179.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-100), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-03-09T14:15:55.048 INFO:teuthology.orchestra.run.smithi179.stdout:Depends: linux-image-5.15.0-100-generic, linux-modules-extra-5.15.0-100-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-09T14:15:55.048 INFO:teuthology.orchestra.run.smithi179.stdout:Recommends: thermald 2024-03-09T14:15:55.049 INFO:teuthology.orchestra.run.smithi179.stdout:Description: Generic Linux kernel image 2024-03-09T14:15:55.049 INFO:teuthology.orchestra.run.smithi179.stdout: This package will always depend on the latest generic kernel image 2024-03-09T14:15:55.049 INFO:teuthology.orchestra.run.smithi179.stdout: available. 2024-03-09T14:15:55.049 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-03-09T14:15:55.093 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.qZJiAoxyYr 2024-03-09T14:15:55.093 DEBUG:teuthology.orchestra.run.smithi179:> sudo cp /boot/grub/grub.cfg /tmp/tmp.qZJiAoxyYr 2024-03-09T14:15:55.150 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.qZJiAoxyYr 2024-03-09T14:15:55.268 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.qZJiAoxyYr is 10KB 2024-03-09T14:15:55.281 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.qZJiAoxyYr 2024-03-09T14:15:55.286 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-03-09T14:15:55.337 INFO:teuthology.orchestra.run.smithi099.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-03-09T14:15:55.337 INFO:teuthology.orchestra.run.smithi099.stdout:Sourcing file `/etc/default/grub' 2024-03-09T14:15:55.341 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:15:55.341 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-03-09T14:15:55.341 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-03-09T14:15:55.350 INFO:teuthology.orchestra.run.smithi099.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-09T14:15:55.367 INFO:teuthology.orchestra.run.smithi099.stdout:Generating grub configuration file ... 2024-03-09T14:15:55.410 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-100-generic 2024-03-09T14:15:55.410 DEBUG:teuthology.orchestra.run.smithi179:> sudo update-grub 2024-03-09T14:15:55.639 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.15.0-100-generic 2024-03-09T14:15:55.662 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.15.0-100-generic 2024-03-09T14:15:55.948 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-09T14:15:55.953 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-09T14:15:56.024 INFO:teuthology.orchestra.run.smithi099.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-09T14:15:56.030 INFO:teuthology.orchestra.run.smithi099.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-09T14:15:56.191 INFO:teuthology.orchestra.run.smithi099.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-09T14:15:56.191 INFO:teuthology.orchestra.run.smithi099.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-03-09T14:15:56.191 INFO:teuthology.orchestra.run.smithi099.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-09T14:15:56.222 INFO:teuthology.orchestra.run.smithi099.stdout:done 2024-03-09T14:15:56.498 INFO:teuthology.orchestra.run.smithi179.stderr:Sourcing file `/etc/default/grub' 2024-03-09T14:15:56.499 INFO:teuthology.orchestra.run.smithi179.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-09T14:15:56.503 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2024-03-09T14:15:56.671 DEBUG:teuthology.orchestra.run.smithi099:> dpkg -s linux-image-generic 2024-03-09T14:15:56.691 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-5.15.0-100-generic 2024-03-09T14:15:56.695 INFO:teuthology.orchestra.run.smithi099.stdout:Package: linux-image-generic 2024-03-09T14:15:56.695 INFO:teuthology.orchestra.run.smithi099.stdout:Status: install ok installed 2024-03-09T14:15:56.695 INFO:teuthology.orchestra.run.smithi099.stdout:Priority: optional 2024-03-09T14:15:56.695 INFO:teuthology.orchestra.run.smithi099.stdout:Section: kernel 2024-03-09T14:15:56.696 INFO:teuthology.orchestra.run.smithi099.stdout:Installed-Size: 21 2024-03-09T14:15:56.696 INFO:teuthology.orchestra.run.smithi099.stdout:Maintainer: Ubuntu Kernel Team 2024-03-09T14:15:56.696 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: amd64 2024-03-09T14:15:56.696 INFO:teuthology.orchestra.run.smithi099.stdout:Source: linux-meta 2024-03-09T14:15:56.696 INFO:teuthology.orchestra.run.smithi099.stdout:Version: 5.15.0.100.97 2024-03-09T14:15:56.696 INFO:teuthology.orchestra.run.smithi099.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-100), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-03-09T14:15:56.696 INFO:teuthology.orchestra.run.smithi099.stdout:Depends: linux-image-5.15.0-100-generic, linux-modules-extra-5.15.0-100-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-09T14:15:56.696 INFO:teuthology.orchestra.run.smithi099.stdout:Recommends: thermald 2024-03-09T14:15:56.696 INFO:teuthology.orchestra.run.smithi099.stdout:Description: Generic Linux kernel image 2024-03-09T14:15:56.696 INFO:teuthology.orchestra.run.smithi099.stdout: This package will always depend on the latest generic kernel image 2024-03-09T14:15:56.696 INFO:teuthology.orchestra.run.smithi099.stdout: available. 2024-03-09T14:15:56.696 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-100-generic 2024-03-09T14:15:56.697 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-09T14:15:56.697 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-09T14:15:56.697 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-09T14:15:56.697 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi099.front.sepia.ceph.com, path=None, version=distro) 2024-03-09T14:15:56.697 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get clean 2024-03-09T14:15:56.698 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-5.15.0-100-generic 2024-03-09T14:15:56.861 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-03-09T14:15:56.940 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-09T14:15:56.945 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-09T14:15:56.984 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-09T14:15:56.984 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-09T14:15:56.985 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-09T14:15:56.990 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-09T14:15:56.996 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-09T14:15:57.016 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-09T14:15:57.123 INFO:teuthology.orchestra.run.smithi179.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-09T14:15:57.123 INFO:teuthology.orchestra.run.smithi179.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-09T14:15:57.123 INFO:teuthology.orchestra.run.smithi179.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-09T14:15:57.134 INFO:teuthology.orchestra.run.smithi179.stderr:done 2024-03-09T14:15:57.150 DEBUG:teuthology.orchestra.run.smithi179:> sudo shutdown -r now 2024-03-09T14:15:58.235 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-03-09T14:15:58.253 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-03-09T14:15:58.316 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-03-09T14:15:58.511 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-03-09T14:15:58.512 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-03-09T14:15:58.683 INFO:teuthology.orchestra.run.smithi099.stdout:linux-image-generic is already the newest version (5.15.0.100.97). 2024-03-09T14:15:58.683 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-03-09T14:15:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-09T14:15:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-09T14:15:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-09T14:15:58.683 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-09T14:15:58.684 INFO:teuthology.orchestra.run.smithi099.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-09T14:15:58.684 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-09T14:15:58.723 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 0 newly installed, 0 to remove and 288 not upgraded. 2024-03-09T14:15:58.724 DEBUG:teuthology.orchestra.run.smithi099:> dpkg -s linux-image-generic 2024-03-09T14:15:58.741 INFO:teuthology.orchestra.run.smithi099.stdout:Package: linux-image-generic 2024-03-09T14:15:58.741 INFO:teuthology.orchestra.run.smithi099.stdout:Status: install ok installed 2024-03-09T14:15:58.741 INFO:teuthology.orchestra.run.smithi099.stdout:Priority: optional 2024-03-09T14:15:58.741 INFO:teuthology.orchestra.run.smithi099.stdout:Section: kernel 2024-03-09T14:15:58.741 INFO:teuthology.orchestra.run.smithi099.stdout:Installed-Size: 21 2024-03-09T14:15:58.741 INFO:teuthology.orchestra.run.smithi099.stdout:Maintainer: Ubuntu Kernel Team 2024-03-09T14:15:58.742 INFO:teuthology.orchestra.run.smithi099.stdout:Architecture: amd64 2024-03-09T14:15:58.742 INFO:teuthology.orchestra.run.smithi099.stdout:Source: linux-meta 2024-03-09T14:15:58.742 INFO:teuthology.orchestra.run.smithi099.stdout:Version: 5.15.0.100.97 2024-03-09T14:15:58.742 INFO:teuthology.orchestra.run.smithi099.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.2), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-100), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.2) 2024-03-09T14:15:58.742 INFO:teuthology.orchestra.run.smithi099.stdout:Depends: linux-image-5.15.0-100-generic, linux-modules-extra-5.15.0-100-generic, linux-firmware, intel-microcode, amd64-microcode 2024-03-09T14:15:58.742 INFO:teuthology.orchestra.run.smithi099.stdout:Recommends: thermald 2024-03-09T14:15:58.742 INFO:teuthology.orchestra.run.smithi099.stdout:Description: Generic Linux kernel image 2024-03-09T14:15:58.742 INFO:teuthology.orchestra.run.smithi099.stdout: This package will always depend on the latest generic kernel image 2024-03-09T14:15:58.742 INFO:teuthology.orchestra.run.smithi099.stdout: available. 2024-03-09T14:15:58.742 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-03-09T14:15:58.785 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.Uv8eKDRG3y 2024-03-09T14:15:58.786 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Uv8eKDRG3y 2024-03-09T14:15:58.841 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.Uv8eKDRG3y 2024-03-09T14:15:58.957 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.Uv8eKDRG3y is 10KB 2024-03-09T14:15:58.969 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.Uv8eKDRG3y 2024-03-09T14:15:58.974 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-03-09T14:15:59.029 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:15:59.029 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-03-09T14:15:59.030 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-03-09T14:15:59.097 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-100-generic 2024-03-09T14:15:59.097 DEBUG:teuthology.orchestra.run.smithi099:> sudo update-grub 2024-03-09T14:16:00.262 INFO:teuthology.orchestra.run.smithi099.stderr:Sourcing file `/etc/default/grub' 2024-03-09T14:16:00.263 INFO:teuthology.orchestra.run.smithi099.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-03-09T14:16:00.265 INFO:teuthology.orchestra.run.smithi099.stderr:Generating grub configuration file ... 2024-03-09T14:16:00.443 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.15.0-100-generic 2024-03-09T14:16:00.449 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.15.0-100-generic 2024-03-09T14:16:00.717 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-03-09T14:16:00.721 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-03-09T14:16:00.759 INFO:teuthology.orchestra.run.smithi099.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-03-09T14:16:00.764 INFO:teuthology.orchestra.run.smithi099.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-03-09T14:16:00.873 INFO:teuthology.orchestra.run.smithi099.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-03-09T14:16:00.873 INFO:teuthology.orchestra.run.smithi099.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-03-09T14:16:00.873 INFO:teuthology.orchestra.run.smithi099.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-03-09T14:16:00.883 INFO:teuthology.orchestra.run.smithi099.stderr:done 2024-03-09T14:16:00.892 DEBUG:teuthology.orchestra.run.smithi099:> sudo shutdown -r now 2024-03-09T14:16:27.222 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-09T14:16:27.223 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-03-09T14:16:27.224 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:16:30.898 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-09T14:16:30.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-09T14:16:30.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:16:45.599 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-09T14:16:49.438 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-09T14:16:54.604 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-03-09T14:16:54.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:16:57.666 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-09T14:16:58.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-09T14:16:58.441 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:17:01.502 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-09T14:17:09.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-03-09T14:17:09.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:17:13.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-09T14:17:13.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:17:28.094 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-03-09T14:17:31.934 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-09T14:17:43.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-03-09T14:17:43.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:17:43.342 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-03-09T14:17:43.800 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-03-09T14:17:43.800 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-100-generic"... 2024-03-09T14:17:43.801 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-03-09T14:17:43.847 INFO:teuthology.orchestra.run.smithi179.stdout:5.15.0-100-generic 2024-03-09T14:17:43.848 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-100-generic vs 5.15.0-100-generic 2024-03-09T14:17:43.848 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-09T14:17:43.848 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-09T14:17:44.848 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-09T14:17:44.849 DEBUG:teuthology.orchestra.run.smithi179:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-09T14:17:44.932 INFO:teuthology.orchestra.run.smithi179.stdout:ttyS1 2024-03-09T14:17:44.957 DEBUG:teuthology.parallel:result is None 2024-03-09T14:17:46.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-09T14:17:46.936 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:17:46.938 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.99 2024-03-09T14:18:04.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-09T14:18:04.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:18:05.178 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-03-09T14:18:05.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-09T14:18:05.805 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-100-generic"... 2024-03-09T14:18:05.806 DEBUG:teuthology.orchestra.run.smithi099:> uname -r 2024-03-09T14:18:05.856 INFO:teuthology.orchestra.run.smithi099.stdout:5.15.0-100-generic 2024-03-09T14:18:05.856 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-100-generic vs 5.15.0-100-generic 2024-03-09T14:18:05.857 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-09T14:18:05.857 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-03-09T14:18:06.858 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-09T14:18:06.858 DEBUG:teuthology.orchestra.run.smithi099:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-09T14:18:06.923 INFO:teuthology.orchestra.run.smithi099.stdout:ttyS1 2024-03-09T14:18:06.947 DEBUG:teuthology.parallel:result is None 2024-03-09T14:18:06.947 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-09T14:18:06.955 INFO:teuthology.task.internal:Creating test directory... 2024-03-09T14:18:06.955 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-09T14:18:06.957 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-09T14:18:06.963 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-09T14:18:06.970 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-09T14:18:06.977 INFO:teuthology.task.internal:Creating archive directory... 2024-03-09T14:18:06.977 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-09T14:18:07.007 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-09T14:18:07.105 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-09T14:18:07.112 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-09T14:18:07.112 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-09T14:18:07.115 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-09T14:18:07.140 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-09T14:18:07.146 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-09T14:18:07.148 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-09T14:18:07.154 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-09T14:18:07.155 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-09T14:18:07.163 INFO:teuthology.task.internal:Configuring sudo... 2024-03-09T14:18:07.163 DEBUG:teuthology.orchestra.run.smithi099:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-09T14:18:07.199 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-09T14:18:07.223 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-09T14:18:07.232 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-09T14:18:07.233 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-09T14:18:07.267 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-09T14:18:07.272 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-09T14:18:07.318 DEBUG:teuthology.orchestra.run.smithi099:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-09T14:18:07.366 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:18:07.366 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-09T14:18:07.430 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-09T14:18:07.436 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-09T14:18:07.484 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:18:07.484 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-09T14:18:07.550 DEBUG:teuthology.orchestra.run.smithi099:> sudo service rsyslog restart 2024-03-09T14:18:07.553 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2024-03-09T14:18:07.623 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-09T14:18:07.631 INFO:teuthology.task.internal:Starting timer... 2024-03-09T14:18:07.631 INFO:teuthology.run_tasks:Running task pcp... 2024-03-09T14:18:07.641 INFO:teuthology.run_tasks:Running task selinux... 2024-03-09T14:18:07.651 DEBUG:teuthology.task.selinux:Excluding smithi099: OS 'ubuntu' does not support SELinux 2024-03-09T14:18:07.651 DEBUG:teuthology.task.selinux:Excluding smithi179: OS 'ubuntu' does not support SELinux 2024-03-09T14:18:07.652 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-09T14:18:07.652 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-03-09T14:18:07.652 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-09T14:18:07.652 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-09T14:18:07.661 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-09T14:18:07.679 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-09T14:18:07.680 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi099.front.sepia.ceph.com,smithi179.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-09T14:25:06.782 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi099.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com')] 2024-03-09T14:25:06.783 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-09T14:25:06.784 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi099.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:25:06.866 DEBUG:teuthology.orchestra.run.smithi099:> true 2024-03-09T14:25:06.942 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi099.front.sepia.ceph.com' 2024-03-09T14:25:06.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-03-09T14:25:06.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-09T14:25:07.026 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-03-09T14:25:07.098 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-03-09T14:25:07.098 INFO:teuthology.run_tasks:Running task clock... 2024-03-09T14:25:07.110 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-09T14:25:07.110 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-09T14:25:07.110 DEBUG:teuthology.orchestra.run.smithi099:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-09T14:25:07.113 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-09T14:25:07.113 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-09T14:25:07.135 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-09T14:25:07.136 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: Command line: ntpd -gq 2024-03-09T14:25:07.136 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: ---------------------------------------------------- 2024-03-09T14:25:07.136 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: ntp-4 is maintained by Network Time Foundation, 2024-03-09T14:25:07.136 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-09T14:25:07.136 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: corporation. Support and training for ntp-4 are 2024-03-09T14:25:07.136 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: available at https://www.nwtime.org/support 2024-03-09T14:25:07.136 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: ---------------------------------------------------- 2024-03-09T14:25:07.137 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: proto: precision = 0.045 usec (-24) 2024-03-09T14:25:07.137 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: basedate set to 2022-02-04 2024-03-09T14:25:07.137 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: gps base set to 2022-02-06 (week 2196) 2024-03-09T14:25:07.137 INFO:teuthology.orchestra.run.smithi099.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-09T14:25:07.137 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-09T14:25:07.138 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: restrict ::: KOD does nothing without LIMITED. 2024-03-09T14:25:07.138 INFO:teuthology.orchestra.run.smithi099.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-09T14:25:07.139 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: Listen and drop on 0 v6wildcard [::]:123 2024-03-09T14:25:07.139 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-09T14:25:07.139 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: Listen normally on 2 lo 127.0.0.1:123 2024-03-09T14:25:07.139 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: Listen normally on 3 enp3s0f1 172.21.15.99:123 2024-03-09T14:25:07.139 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: Listen normally on 4 lo [::1]:123 2024-03-09T14:25:07.139 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d803%5]:123 2024-03-09T14:25:07.139 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:07 ntpd[17186]: Listening on routing socket on fd #22 for interface updates 2024-03-09T14:25:07.168 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-03-09T14:25:07.168 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: Command line: ntpd -gq 2024-03-09T14:25:07.168 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: ---------------------------------------------------- 2024-03-09T14:25:07.169 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: ntp-4 is maintained by Network Time Foundation, 2024-03-09T14:25:07.169 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-03-09T14:25:07.169 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: corporation. Support and training for ntp-4 are 2024-03-09T14:25:07.169 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: available at https://www.nwtime.org/support 2024-03-09T14:25:07.169 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: ---------------------------------------------------- 2024-03-09T14:25:07.169 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: proto: precision = 0.054 usec (-24) 2024-03-09T14:25:07.170 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: basedate set to 2022-02-04 2024-03-09T14:25:07.170 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: gps base set to 2022-02-06 (week 2196) 2024-03-09T14:25:07.170 INFO:teuthology.orchestra.run.smithi179.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-09T14:25:07.170 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-03-09T14:25:07.170 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: restrict ::: KOD does nothing without LIMITED. 2024-03-09T14:25:07.171 INFO:teuthology.orchestra.run.smithi179.stderr:restrict ::: KOD does nothing without LIMITED. 2024-03-09T14:25:07.171 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: Listen and drop on 0 v6wildcard [::]:123 2024-03-09T14:25:07.171 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-03-09T14:25:07.172 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: Listen normally on 2 lo 127.0.0.1:123 2024-03-09T14:25:07.172 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: Listen normally on 3 enp3s0f1 172.21.15.179:123 2024-03-09T14:25:07.172 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: Listen normally on 4 lo [::1]:123 2024-03-09T14:25:07.172 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:725b%5]:123 2024-03-09T14:25:07.172 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:07 ntpd[17151]: Listening on routing socket on fd #22 for interface updates 2024-03-09T14:25:08.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:08 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:08.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:08 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:08.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:08 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:08.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:08 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:08.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:08 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:08.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:08 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:08.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:08 ntpd[17186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:08.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:08 ntpd[17186]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:08.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:08 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:08.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:08 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:08.138 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:08 ntpd[17186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:08.138 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:08 ntpd[17186]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:08.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:08 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:08.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:08 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:09.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:09 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:09.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:09 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:09.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:09 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:09.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:09 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:09.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:09 ntpd[17151]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:09.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:09 ntpd[17151]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:10.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:10 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:10.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:10 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:10.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:10 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:10.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:10 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:10.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:10 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:10.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:10 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:10.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:10 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:10.138 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:10 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:10.138 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:10 ntpd[17186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:10.138 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:10 ntpd[17186]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:10.138 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:10 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:10.138 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:10 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:10.138 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:10 ntpd[17186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:10.138 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:10 ntpd[17186]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:10.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:10 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:10.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:10 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:10.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:10 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:10.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:10 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:10.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:10 ntpd[17151]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:10.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:10 ntpd[17151]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:11.136 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:11 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:11.136 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:11 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:11.136 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:11 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:11.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:11 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:11.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:11 ntpd[17186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:11.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:11 ntpd[17186]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:11.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:11 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:11.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:11 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:11.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:11 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:11.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:11 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:11.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:11 ntpd[17151]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:11.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:11 ntpd[17151]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:12.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:12 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:12.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:12 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:12.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:12 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:12.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:12 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:12.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:12 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:12.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:12 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:12.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:12 ntpd[17186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:12.138 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:12 ntpd[17186]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:12.138 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:12 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:12.138 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:12 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:12.138 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:12 ntpd[17186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:12.138 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:12 ntpd[17186]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:12.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:12 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:12.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:12 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:12.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:12 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:12.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:12 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:12.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:12 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:12.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:12 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:12.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:12 ntpd[17151]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:12.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:12 ntpd[17151]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:12.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:12 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:12.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:12 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:12.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:12 ntpd[17151]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:12.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:12 ntpd[17151]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:13.136 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:13 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:13.136 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:13 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:13.136 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:13 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:13.136 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:13 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:13.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:13 ntpd[17186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:13.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:13 ntpd[17186]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:13.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:13 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:13.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:13 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:13.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:13 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:13.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:13 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:13.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:13 ntpd[17151]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:13.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:13 ntpd[17151]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:14.136 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:14 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:14.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:14 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:14.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:14 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:14.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:14 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:14.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:14 ntpd[17186]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:14.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:14 ntpd[17186]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:14.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:14 ntpd[17186]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:14.137 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:14 ntpd[17186]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:14.137 INFO:teuthology.orchestra.run.smithi099.stdout: 9 Mar 14:25:14 ntpd[17186]: ntpd: time slew -0.001364 s 2024-03-09T14:25:14.137 INFO:teuthology.orchestra.run.smithi099.stdout:ntpd: time slew -0.001364s 2024-03-09T14:25:14.138 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:14 ntpd[17186]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-09T14:25:14.138 INFO:teuthology.orchestra.run.smithi099.stderr: 9 Mar 14:25:14 ntpd[17186]: can't open /var/log/ntpstats/loopstats.20240309: Permission denied 2024-03-09T14:25:14.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:14 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:14.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:14 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:14.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:14 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:14.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:14 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:14.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:14 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:14.171 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:14 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:14.171 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:14 ntpd[17151]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:14.171 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:14 ntpd[17151]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:14.171 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:14 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:14.171 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:14 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:14.171 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:14 ntpd[17151]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:14.171 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:14 ntpd[17151]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:14.240 INFO:teuthology.orchestra.run.smithi099.stdout: remote refid st t when poll reach delay offset jitter 2024-03-09T14:25:14.240 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================== 2024-03-09T14:25:14.240 INFO:teuthology.orchestra.run.smithi099.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-09T14:25:14.240 INFO:teuthology.orchestra.run.smithi099.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-09T14:25:14.241 INFO:teuthology.orchestra.run.smithi099.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-09T14:25:14.241 INFO:teuthology.orchestra.run.smithi099.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-09T14:25:15.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:15 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:15.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:15 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:15.169 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:15 ntpd[17151]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-03-09T14:25:15.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:15 ntpd[17151]: can't open /var/log/ntpstats/rawstats.20240309: Permission denied 2024-03-09T14:25:15.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:15 ntpd[17151]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-03-09T14:25:15.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:15 ntpd[17151]: can't open /var/log/ntpstats/peerstats.20240309: Permission denied 2024-03-09T14:25:15.170 INFO:teuthology.orchestra.run.smithi179.stdout: 9 Mar 14:25:15 ntpd[17151]: ntpd: time slew -0.001629 s 2024-03-09T14:25:15.170 INFO:teuthology.orchestra.run.smithi179.stdout:ntpd: time slew -0.001629s 2024-03-09T14:25:15.170 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:15 ntpd[17151]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-03-09T14:25:15.171 INFO:teuthology.orchestra.run.smithi179.stderr: 9 Mar 14:25:15 ntpd[17151]: can't open /var/log/ntpstats/loopstats.20240309: Permission denied 2024-03-09T14:25:15.277 INFO:teuthology.orchestra.run.smithi179.stdout: remote refid st t when poll reach delay offset jitter 2024-03-09T14:25:15.277 INFO:teuthology.orchestra.run.smithi179.stdout:============================================================================== 2024-03-09T14:25:15.277 INFO:teuthology.orchestra.run.smithi179.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-09T14:25:15.277 INFO:teuthology.orchestra.run.smithi179.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-09T14:25:15.277 INFO:teuthology.orchestra.run.smithi179.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-09T14:25:15.277 INFO:teuthology.orchestra.run.smithi179.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-03-09T14:25:15.278 INFO:teuthology.run_tasks:Running task install... 2024-03-09T14:25:15.287 DEBUG:teuthology.task.install:project ceph 2024-03-09T14:25:15.287 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'}} 2024-03-09T14:25:15.287 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'} 2024-03-09T14:25:15.287 INFO:teuthology.task.install:Using flavor: default 2024-03-09T14:25:15.293 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-09T14:25:15.293 INFO:teuthology.task.install:extra packages: [] 2024-03-09T14:25:15.293 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-key list | grep Ceph 2024-03-09T14:25:15.294 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-key list | grep Ceph 2024-03-09T14:25:15.359 INFO:teuthology.orchestra.run.smithi099.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-09T14:25:15.378 INFO:teuthology.orchestra.run.smithi179.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-03-09T14:25:15.386 INFO:teuthology.orchestra.run.smithi099.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-09T14:25:15.386 INFO:teuthology.orchestra.run.smithi099.stdout:uid [ unknown] Ceph.com (release key) 2024-03-09T14:25:15.387 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-03-09T14:25:15.387 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-03-09T14:25:15.388 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:25:15.405 INFO:teuthology.orchestra.run.smithi179.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-03-09T14:25:15.405 INFO:teuthology.orchestra.run.smithi179.stdout:uid [ unknown] Ceph.com (release key) 2024-03-09T14:25:15.405 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-03-09T14:25:15.405 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-03-09T14:25:15.406 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:25:15.610 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default/ 2024-03-09T14:25:15.611 INFO:teuthology.task.install.deb:Package version is 19.0.0-2079-gc00d9c60-1jammy 2024-03-09T14:25:15.623 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default/ 2024-03-09T14:25:15.623 INFO:teuthology.task.install.deb:Package version is 19.0.0-2079-gc00d9c60-1jammy 2024-03-09T14:25:15.781 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:25:15.781 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-09T14:25:15.790 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:25:15.790 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-03-09T14:25:15.795 DEBUG:teuthology.orchestra.run.smithi099:> sudo apt-get update 2024-03-09T14:25:15.804 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get update 2024-03-09T14:25:15.973 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-09T14:25:15.987 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-09T14:25:16.008 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-09T14:25:16.014 INFO:teuthology.orchestra.run.smithi099.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy InRelease 2024-03-09T14:25:16.022 INFO:teuthology.orchestra.run.smithi179.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy InRelease 2024-03-09T14:25:16.035 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-09T14:25:16.043 INFO:teuthology.orchestra.run.smithi179.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-03-09T14:25:16.058 INFO:teuthology.orchestra.run.smithi099.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-09T14:25:16.065 INFO:teuthology.orchestra.run.smithi179.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy Release.gpg 2024-03-09T14:25:16.086 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-09T14:25:16.089 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-03-09T14:25:16.089 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-09T14:25:16.089 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-03-09T14:25:16.092 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-03-09T14:25:16.113 INFO:teuthology.orchestra.run.smithi179.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-03-09T14:25:16.117 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-03-09T14:25:16.160 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-03-09T14:25:16.242 INFO:teuthology.orchestra.run.smithi099.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-03-09T14:25:16.328 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 28.9 kB in 0s (82.3 kB/s) 2024-03-09T14:25:16.445 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 28.9 kB in 0s (60.8 kB/s) 2024-03-09T14:25:17.225 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-03-09T14:25:17.240 DEBUG:teuthology.orchestra.run.smithi179:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2079-gc00d9c60-1jammy cephadm=19.0.0-2079-gc00d9c60-1jammy ceph-mds=19.0.0-2079-gc00d9c60-1jammy ceph-mgr=19.0.0-2079-gc00d9c60-1jammy ceph-common=19.0.0-2079-gc00d9c60-1jammy ceph-fuse=19.0.0-2079-gc00d9c60-1jammy ceph-test=19.0.0-2079-gc00d9c60-1jammy ceph-volume=19.0.0-2079-gc00d9c60-1jammy radosgw=19.0.0-2079-gc00d9c60-1jammy python3-rados=19.0.0-2079-gc00d9c60-1jammy python3-rgw=19.0.0-2079-gc00d9c60-1jammy python3-cephfs=19.0.0-2079-gc00d9c60-1jammy python3-rbd=19.0.0-2079-gc00d9c60-1jammy libcephfs2=19.0.0-2079-gc00d9c60-1jammy libcephfs-dev=19.0.0-2079-gc00d9c60-1jammy librados2=19.0.0-2079-gc00d9c60-1jammy librbd1=19.0.0-2079-gc00d9c60-1jammy rbd-fuse=19.0.0-2079-gc00d9c60-1jammy 2024-03-09T14:25:17.300 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-03-09T14:25:17.374 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-03-09T14:25:17.390 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2079-gc00d9c60-1jammy cephadm=19.0.0-2079-gc00d9c60-1jammy ceph-mds=19.0.0-2079-gc00d9c60-1jammy ceph-mgr=19.0.0-2079-gc00d9c60-1jammy ceph-common=19.0.0-2079-gc00d9c60-1jammy ceph-fuse=19.0.0-2079-gc00d9c60-1jammy ceph-test=19.0.0-2079-gc00d9c60-1jammy ceph-volume=19.0.0-2079-gc00d9c60-1jammy radosgw=19.0.0-2079-gc00d9c60-1jammy python3-rados=19.0.0-2079-gc00d9c60-1jammy python3-rgw=19.0.0-2079-gc00d9c60-1jammy python3-cephfs=19.0.0-2079-gc00d9c60-1jammy python3-rbd=19.0.0-2079-gc00d9c60-1jammy libcephfs2=19.0.0-2079-gc00d9c60-1jammy libcephfs-dev=19.0.0-2079-gc00d9c60-1jammy librados2=19.0.0-2079-gc00d9c60-1jammy librbd1=19.0.0-2079-gc00d9c60-1jammy rbd-fuse=19.0.0-2079-gc00d9c60-1jammy 2024-03-09T14:25:17.447 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-03-09T14:25:17.493 INFO:teuthology.orchestra.run.smithi179.stdout:Building dependency tree... 2024-03-09T14:25:17.493 INFO:teuthology.orchestra.run.smithi179.stdout:Reading state information... 2024-03-09T14:25:17.643 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-03-09T14:25:17.644 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-03-09T14:25:17.671 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages were automatically installed and are no longer required: 2024-03-09T14:25:17.671 INFO:teuthology.orchestra.run.smithi179.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-09T14:25:17.671 INFO:teuthology.orchestra.run.smithi179.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-09T14:25:17.671 INFO:teuthology.orchestra.run.smithi179.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-09T14:25:17.672 INFO:teuthology.orchestra.run.smithi179.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-09T14:25:17.672 INFO:teuthology.orchestra.run.smithi179.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-09T14:25:17.672 INFO:teuthology.orchestra.run.smithi179.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-09T14:25:17.674 INFO:teuthology.orchestra.run.smithi179.stdout:The following additional packages will be installed: 2024-03-09T14:25:17.674 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-09T14:25:17.674 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-09T14:25:17.674 INFO:teuthology.orchestra.run.smithi179.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-09T14:25:17.674 INFO:teuthology.orchestra.run.smithi179.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-09T14:25:17.674 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-09T14:25:17.674 INFO:teuthology.orchestra.run.smithi179.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-09T14:25:17.674 INFO:teuthology.orchestra.run.smithi179.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-09T14:25:17.674 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-09T14:25:17.674 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-09T14:25:17.674 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-03-09T14:25:17.675 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-09T14:25:17.675 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-09T14:25:17.675 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-09T14:25:17.675 INFO:teuthology.orchestra.run.smithi179.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-09T14:25:17.675 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-09T14:25:17.675 INFO:teuthology.orchestra.run.smithi179.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-09T14:25:17.675 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-03-09T14:25:17.675 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-03-09T14:25:17.675 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-09T14:25:17.675 INFO:teuthology.orchestra.run.smithi179.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-09T14:25:17.675 INFO:teuthology.orchestra.run.smithi179.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-09T14:25:17.675 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-09T14:25:17.675 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-03-09T14:25:17.675 INFO:teuthology.orchestra.run.smithi179.stdout: xmlstarlet zip 2024-03-09T14:25:17.676 INFO:teuthology.orchestra.run.smithi179.stdout:Suggested packages: 2024-03-09T14:25:17.676 INFO:teuthology.orchestra.run.smithi179.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-09T14:25:17.676 INFO:teuthology.orchestra.run.smithi179.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-09T14:25:17.676 INFO:teuthology.orchestra.run.smithi179.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-09T14:25:17.676 INFO:teuthology.orchestra.run.smithi179.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-09T14:25:17.676 INFO:teuthology.orchestra.run.smithi179.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-09T14:25:17.676 INFO:teuthology.orchestra.run.smithi179.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-09T14:25:17.676 INFO:teuthology.orchestra.run.smithi179.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-09T14:25:17.676 INFO:teuthology.orchestra.run.smithi179.stdout:Recommended packages: 2024-03-09T14:25:17.676 INFO:teuthology.orchestra.run.smithi179.stdout: btrfs-tools 2024-03-09T14:25:17.780 INFO:teuthology.orchestra.run.smithi179.stdout:The following NEW packages will be installed: 2024-03-09T14:25:17.780 INFO:teuthology.orchestra.run.smithi179.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-09T14:25:17.780 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-09T14:25:17.780 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-03-09T14:25:17.780 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-03-09T14:25:17.780 INFO:teuthology.orchestra.run.smithi179.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-03-09T14:25:17.781 INFO:teuthology.orchestra.run.smithi179.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-03-09T14:25:17.782 INFO:teuthology.orchestra.run.smithi179.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-03-09T14:25:17.782 INFO:teuthology.orchestra.run.smithi179.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-03-09T14:25:17.782 INFO:teuthology.orchestra.run.smithi179.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-03-09T14:25:17.782 INFO:teuthology.orchestra.run.smithi179.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-03-09T14:25:17.782 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-03-09T14:25:17.782 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-03-09T14:25:17.782 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-09T14:25:17.782 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-09T14:25:17.782 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-09T14:25:17.782 INFO:teuthology.orchestra.run.smithi179.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-09T14:25:17.782 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-09T14:25:17.782 INFO:teuthology.orchestra.run.smithi179.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-09T14:25:17.783 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-03-09T14:25:17.783 INFO:teuthology.orchestra.run.smithi179.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-03-09T14:25:17.783 INFO:teuthology.orchestra.run.smithi179.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-03-09T14:25:17.783 INFO:teuthology.orchestra.run.smithi179.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-03-09T14:25:17.783 INFO:teuthology.orchestra.run.smithi179.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-03-09T14:25:17.783 INFO:teuthology.orchestra.run.smithi179.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-03-09T14:25:17.783 INFO:teuthology.orchestra.run.smithi179.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-03-09T14:25:17.783 INFO:teuthology.orchestra.run.smithi179.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-03-09T14:25:17.817 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-03-09T14:25:17.817 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-09T14:25:17.817 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-09T14:25:17.817 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-09T14:25:17.818 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-09T14:25:17.818 INFO:teuthology.orchestra.run.smithi099.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-09T14:25:17.818 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-09T14:25:17.818 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-03-09T14:25:17.818 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-03-09T14:25:17.820 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-03-09T14:25:17.820 INFO:teuthology.orchestra.run.smithi099.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-03-09T14:25:17.820 INFO:teuthology.orchestra.run.smithi099.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-03-09T14:25:17.820 INFO:teuthology.orchestra.run.smithi099.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-03-09T14:25:17.820 INFO:teuthology.orchestra.run.smithi099.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-03-09T14:25:17.820 INFO:teuthology.orchestra.run.smithi099.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-03-09T14:25:17.820 INFO:teuthology.orchestra.run.smithi099.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-03-09T14:25:17.820 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-03-09T14:25:17.820 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-03-09T14:25:17.820 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-09T14:25:17.821 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-09T14:25:17.821 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-09T14:25:17.821 INFO:teuthology.orchestra.run.smithi099.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-09T14:25:17.821 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-09T14:25:17.821 INFO:teuthology.orchestra.run.smithi099.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-09T14:25:17.821 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-03-09T14:25:17.821 INFO:teuthology.orchestra.run.smithi099.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-03-09T14:25:17.821 INFO:teuthology.orchestra.run.smithi099.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-03-09T14:25:17.821 INFO:teuthology.orchestra.run.smithi099.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-03-09T14:25:17.821 INFO:teuthology.orchestra.run.smithi099.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-03-09T14:25:17.821 INFO:teuthology.orchestra.run.smithi099.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-03-09T14:25:17.821 INFO:teuthology.orchestra.run.smithi099.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-03-09T14:25:17.821 INFO:teuthology.orchestra.run.smithi099.stdout: xmlstarlet zip 2024-03-09T14:25:17.822 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-03-09T14:25:17.822 INFO:teuthology.orchestra.run.smithi099.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-03-09T14:25:17.822 INFO:teuthology.orchestra.run.smithi099.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-03-09T14:25:17.822 INFO:teuthology.orchestra.run.smithi099.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-03-09T14:25:17.822 INFO:teuthology.orchestra.run.smithi099.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-03-09T14:25:17.822 INFO:teuthology.orchestra.run.smithi099.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-03-09T14:25:17.822 INFO:teuthology.orchestra.run.smithi099.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-03-09T14:25:17.822 INFO:teuthology.orchestra.run.smithi099.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-03-09T14:25:17.822 INFO:teuthology.orchestra.run.smithi099.stdout:Recommended packages: 2024-03-09T14:25:17.822 INFO:teuthology.orchestra.run.smithi099.stdout: btrfs-tools 2024-03-09T14:25:17.845 INFO:teuthology.orchestra.run.smithi179.stdout:0 upgraded, 118 newly installed, 0 to remove and 275 not upgraded. 2024-03-09T14:25:17.845 INFO:teuthology.orchestra.run.smithi179.stdout:Need to get 178 MB of archives. 2024-03-09T14:25:17.845 INFO:teuthology.orchestra.run.smithi179.stdout:After this operation, 736 MB of additional disk space will be used. 2024-03-09T14:25:17.845 INFO:teuthology.orchestra.run.smithi179.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-09T14:25:17.922 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-03-09T14:25:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-03-09T14:25:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-03-09T14:25:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-03-09T14:25:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-03-09T14:25:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-03-09T14:25:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-03-09T14:25:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-03-09T14:25:17.922 INFO:teuthology.orchestra.run.smithi099.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-03-09T14:25:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-03-09T14:25:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-03-09T14:25:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-03-09T14:25:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-03-09T14:25:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-03-09T14:25:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-03-09T14:25:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-03-09T14:25:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-03-09T14:25:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-03-09T14:25:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-03-09T14:25:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-03-09T14:25:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-03-09T14:25:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-03-09T14:25:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-03-09T14:25:17.923 INFO:teuthology.orchestra.run.smithi099.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-03-09T14:25:17.924 INFO:teuthology.orchestra.run.smithi099.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-03-09T14:25:17.924 INFO:teuthology.orchestra.run.smithi099.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-03-09T14:25:17.924 INFO:teuthology.orchestra.run.smithi099.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-03-09T14:25:17.951 INFO:teuthology.orchestra.run.smithi179.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-09T14:25:17.954 INFO:teuthology.orchestra.run.smithi179.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-09T14:25:17.974 INFO:teuthology.orchestra.run.smithi179.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-09T14:25:17.987 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 118 newly installed, 0 to remove and 275 not upgraded. 2024-03-09T14:25:17.988 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 178 MB of archives. 2024-03-09T14:25:17.988 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 736 MB of additional disk space will be used. 2024-03-09T14:25:17.988 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-03-09T14:25:18.034 INFO:teuthology.orchestra.run.smithi179.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-09T14:25:18.036 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-09T14:25:18.044 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-09T14:25:18.047 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-09T14:25:18.047 INFO:teuthology.orchestra.run.smithi179.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-09T14:25:18.048 INFO:teuthology.orchestra.run.smithi179.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-09T14:25:18.054 INFO:teuthology.orchestra.run.smithi179.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-09T14:25:18.055 INFO:teuthology.orchestra.run.smithi179.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-09T14:25:18.057 INFO:teuthology.orchestra.run.smithi179.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-09T14:25:18.059 INFO:teuthology.orchestra.run.smithi179.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-09T14:25:18.078 INFO:teuthology.orchestra.run.smithi179.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-09T14:25:18.080 INFO:teuthology.orchestra.run.smithi179.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-09T14:25:18.082 INFO:teuthology.orchestra.run.smithi179.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-09T14:25:18.084 INFO:teuthology.orchestra.run.smithi179.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-09T14:25:18.085 INFO:teuthology.orchestra.run.smithi179.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-09T14:25:18.085 INFO:teuthology.orchestra.run.smithi179.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-09T14:25:18.086 INFO:teuthology.orchestra.run.smithi179.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-09T14:25:18.093 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-03-09T14:25:18.095 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-03-09T14:25:18.099 INFO:teuthology.orchestra.run.smithi179.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-09T14:25:18.099 INFO:teuthology.orchestra.run.smithi179.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-09T14:25:18.099 INFO:teuthology.orchestra.run.smithi179.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-09T14:25:18.116 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-03-09T14:25:18.119 INFO:teuthology.orchestra.run.smithi179.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-09T14:25:18.119 INFO:teuthology.orchestra.run.smithi179.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-09T14:25:18.119 INFO:teuthology.orchestra.run.smithi179.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-09T14:25:18.122 INFO:teuthology.orchestra.run.smithi179.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-09T14:25:18.123 INFO:teuthology.orchestra.run.smithi179.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-09T14:25:18.123 INFO:teuthology.orchestra.run.smithi179.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-09T14:25:18.123 INFO:teuthology.orchestra.run.smithi179.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-09T14:25:18.140 INFO:teuthology.orchestra.run.smithi179.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-09T14:25:18.140 INFO:teuthology.orchestra.run.smithi179.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-09T14:25:18.140 INFO:teuthology.orchestra.run.smithi179.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-09T14:25:18.159 INFO:teuthology.orchestra.run.smithi179.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2079-gc00d9c60-1jammy [3,545 kB] 2024-03-09T14:25:18.160 INFO:teuthology.orchestra.run.smithi179.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-09T14:25:18.161 INFO:teuthology.orchestra.run.smithi179.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-09T14:25:18.161 INFO:teuthology.orchestra.run.smithi179.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-09T14:25:18.167 INFO:teuthology.orchestra.run.smithi179.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-09T14:25:18.167 INFO:teuthology.orchestra.run.smithi179.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-09T14:25:18.167 INFO:teuthology.orchestra.run.smithi179.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-09T14:25:18.168 INFO:teuthology.orchestra.run.smithi179.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-09T14:25:18.181 INFO:teuthology.orchestra.run.smithi179.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-09T14:25:18.183 INFO:teuthology.orchestra.run.smithi179.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-09T14:25:18.183 INFO:teuthology.orchestra.run.smithi179.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-09T14:25:18.188 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-03-09T14:25:18.194 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-03-09T14:25:18.208 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-03-09T14:25:18.209 INFO:teuthology.orchestra.run.smithi179.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-09T14:25:18.209 INFO:teuthology.orchestra.run.smithi179.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-09T14:25:18.212 INFO:teuthology.orchestra.run.smithi179.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-09T14:25:18.212 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-03-09T14:25:18.212 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-03-09T14:25:18.213 INFO:teuthology.orchestra.run.smithi179.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-09T14:25:18.213 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-03-09T14:25:18.214 INFO:teuthology.orchestra.run.smithi179.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-09T14:25:18.218 INFO:teuthology.orchestra.run.smithi179.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-09T14:25:18.221 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-03-09T14:25:18.224 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-03-09T14:25:18.226 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-03-09T14:25:18.237 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-03-09T14:25:18.253 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-03-09T14:25:18.255 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-03-09T14:25:18.257 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-03-09T14:25:18.259 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-03-09T14:25:18.260 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-03-09T14:25:18.260 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-03-09T14:25:18.262 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-03-09T14:25:18.262 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-03-09T14:25:18.264 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-03-09T14:25:18.283 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-03-09T14:25:18.283 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-03-09T14:25:18.284 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-03-09T14:25:18.284 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-03-09T14:25:18.287 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-03-09T14:25:18.288 INFO:teuthology.orchestra.run.smithi179.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-09T14:25:18.288 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-03-09T14:25:18.288 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-03-09T14:25:18.289 INFO:teuthology.orchestra.run.smithi179.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-09T14:25:18.289 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-03-09T14:25:18.290 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-03-09T14:25:18.290 INFO:teuthology.orchestra.run.smithi179.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-09T14:25:18.290 INFO:teuthology.orchestra.run.smithi179.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-09T14:25:18.291 INFO:teuthology.orchestra.run.smithi179.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-09T14:25:18.308 INFO:teuthology.orchestra.run.smithi179.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-09T14:25:18.310 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-03-09T14:25:18.310 INFO:teuthology.orchestra.run.smithi179.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-09T14:25:18.310 INFO:teuthology.orchestra.run.smithi179.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-09T14:25:18.311 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-03-09T14:25:18.312 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-03-09T14:25:18.313 INFO:teuthology.orchestra.run.smithi099.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-03-09T14:25:18.313 INFO:teuthology.orchestra.run.smithi099.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-03-09T14:25:18.325 INFO:teuthology.orchestra.run.smithi179.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-09T14:25:18.325 INFO:teuthology.orchestra.run.smithi179.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-09T14:25:18.330 INFO:teuthology.orchestra.run.smithi099.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-03-09T14:25:18.331 INFO:teuthology.orchestra.run.smithi099.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-03-09T14:25:18.331 INFO:teuthology.orchestra.run.smithi099.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-03-09T14:25:18.332 INFO:teuthology.orchestra.run.smithi099.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-03-09T14:25:18.333 INFO:teuthology.orchestra.run.smithi099.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-03-09T14:25:18.334 INFO:teuthology.orchestra.run.smithi179.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-09T14:25:18.334 INFO:teuthology.orchestra.run.smithi179.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-09T14:25:18.335 INFO:teuthology.orchestra.run.smithi179.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-09T14:25:18.335 INFO:teuthology.orchestra.run.smithi179.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-09T14:25:18.335 INFO:teuthology.orchestra.run.smithi179.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-09T14:25:18.336 INFO:teuthology.orchestra.run.smithi179.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-09T14:25:18.339 INFO:teuthology.orchestra.run.smithi179.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-09T14:25:18.351 INFO:teuthology.orchestra.run.smithi099.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-03-09T14:25:18.352 INFO:teuthology.orchestra.run.smithi099.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-03-09T14:25:18.353 INFO:teuthology.orchestra.run.smithi099.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-03-09T14:25:18.354 INFO:teuthology.orchestra.run.smithi099.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-03-09T14:25:18.355 INFO:teuthology.orchestra.run.smithi179.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-09T14:25:18.356 INFO:teuthology.orchestra.run.smithi179.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-09T14:25:18.356 INFO:teuthology.orchestra.run.smithi099.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-03-09T14:25:18.357 INFO:teuthology.orchestra.run.smithi179.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-09T14:25:18.371 INFO:teuthology.orchestra.run.smithi099.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-03-09T14:25:18.372 INFO:teuthology.orchestra.run.smithi099.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-03-09T14:25:18.374 INFO:teuthology.orchestra.run.smithi099.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-03-09T14:25:18.379 INFO:teuthology.orchestra.run.smithi179.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-09T14:25:18.386 INFO:teuthology.orchestra.run.smithi179.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-09T14:25:18.388 INFO:teuthology.orchestra.run.smithi179.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-09T14:25:18.389 INFO:teuthology.orchestra.run.smithi179.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-09T14:25:18.400 INFO:teuthology.orchestra.run.smithi179.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-09T14:25:18.402 INFO:teuthology.orchestra.run.smithi179.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-09T14:25:18.410 INFO:teuthology.orchestra.run.smithi179.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-09T14:25:18.418 INFO:teuthology.orchestra.run.smithi179.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-09T14:25:18.419 INFO:teuthology.orchestra.run.smithi179.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-09T14:25:18.419 INFO:teuthology.orchestra.run.smithi179.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-09T14:25:18.425 INFO:teuthology.orchestra.run.smithi099.stdout:Get:51 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2079-gc00d9c60-1jammy [3,545 kB] 2024-03-09T14:25:18.436 INFO:teuthology.orchestra.run.smithi099.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-03-09T14:25:18.437 INFO:teuthology.orchestra.run.smithi099.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-03-09T14:25:18.439 INFO:teuthology.orchestra.run.smithi099.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-03-09T14:25:18.439 INFO:teuthology.orchestra.run.smithi099.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-03-09T14:25:18.440 INFO:teuthology.orchestra.run.smithi099.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-03-09T14:25:18.449 INFO:teuthology.orchestra.run.smithi179.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-09T14:25:18.451 INFO:teuthology.orchestra.run.smithi179.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-09T14:25:18.465 INFO:teuthology.orchestra.run.smithi179.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-09T14:25:18.465 INFO:teuthology.orchestra.run.smithi179.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-09T14:25:18.466 INFO:teuthology.orchestra.run.smithi179.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-09T14:25:18.470 INFO:teuthology.orchestra.run.smithi099.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-03-09T14:25:18.470 INFO:teuthology.orchestra.run.smithi179.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-09T14:25:18.471 INFO:teuthology.orchestra.run.smithi179.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-09T14:25:18.474 INFO:teuthology.orchestra.run.smithi099.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-03-09T14:25:18.475 INFO:teuthology.orchestra.run.smithi099.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-03-09T14:25:18.506 INFO:teuthology.orchestra.run.smithi099.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-03-09T14:25:18.506 INFO:teuthology.orchestra.run.smithi099.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-03-09T14:25:18.507 INFO:teuthology.orchestra.run.smithi099.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-03-09T14:25:18.508 INFO:teuthology.orchestra.run.smithi099.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-03-09T14:25:18.508 INFO:teuthology.orchestra.run.smithi099.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-03-09T14:25:18.509 INFO:teuthology.orchestra.run.smithi099.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-03-09T14:25:18.520 INFO:teuthology.orchestra.run.smithi099.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-03-09T14:25:18.520 INFO:teuthology.orchestra.run.smithi099.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-03-09T14:25:18.524 INFO:teuthology.orchestra.run.smithi099.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-03-09T14:25:18.540 INFO:teuthology.orchestra.run.smithi099.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-03-09T14:25:18.542 INFO:teuthology.orchestra.run.smithi099.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-03-09T14:25:18.543 INFO:teuthology.orchestra.run.smithi099.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-03-09T14:25:18.547 INFO:teuthology.orchestra.run.smithi099.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-03-09T14:25:18.550 INFO:teuthology.orchestra.run.smithi099.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-03-09T14:25:18.551 INFO:teuthology.orchestra.run.smithi099.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-03-09T14:25:18.552 INFO:teuthology.orchestra.run.smithi099.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-03-09T14:25:18.560 INFO:teuthology.orchestra.run.smithi099.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-03-09T14:25:18.561 INFO:teuthology.orchestra.run.smithi099.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-03-09T14:25:18.566 INFO:teuthology.orchestra.run.smithi099.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-03-09T14:25:18.581 INFO:teuthology.orchestra.run.smithi099.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-03-09T14:25:18.582 INFO:teuthology.orchestra.run.smithi099.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-03-09T14:25:18.582 INFO:teuthology.orchestra.run.smithi099.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-03-09T14:25:18.585 INFO:teuthology.orchestra.run.smithi099.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-03-09T14:25:18.586 INFO:teuthology.orchestra.run.smithi099.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-03-09T14:25:18.595 INFO:teuthology.orchestra.run.smithi099.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-03-09T14:25:18.595 INFO:teuthology.orchestra.run.smithi099.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-03-09T14:25:18.602 INFO:teuthology.orchestra.run.smithi099.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-03-09T14:25:18.604 INFO:teuthology.orchestra.run.smithi099.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-03-09T14:25:18.605 INFO:teuthology.orchestra.run.smithi099.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-03-09T14:25:19.345 INFO:teuthology.orchestra.run.smithi099.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2079-gc00d9c60-1jammy [3,220 kB] 2024-03-09T14:25:19.760 INFO:teuthology.orchestra.run.smithi099.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2079-gc00d9c60-1jammy [711 kB] 2024-03-09T14:25:19.843 INFO:teuthology.orchestra.run.smithi099.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2079-gc00d9c60-1jammy [356 kB] 2024-03-09T14:25:19.862 INFO:teuthology.orchestra.run.smithi099.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2079-gc00d9c60-1jammy [32.8 kB] 2024-03-09T14:25:19.864 INFO:teuthology.orchestra.run.smithi099.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2079-gc00d9c60-1jammy [180 kB] 2024-03-09T14:25:19.872 INFO:teuthology.orchestra.run.smithi099.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2079-gc00d9c60-1jammy [64.6 kB] 2024-03-09T14:25:19.875 INFO:teuthology.orchestra.run.smithi099.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2079-gc00d9c60-1jammy [330 kB] 2024-03-09T14:25:19.939 INFO:teuthology.orchestra.run.smithi099.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2079-gc00d9c60-1jammy [6,744 kB] 2024-03-09T14:25:20.433 INFO:teuthology.orchestra.run.smithi179.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2079-gc00d9c60-1jammy [3,220 kB] 2024-03-09T14:25:20.653 INFO:teuthology.orchestra.run.smithi099.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2079-gc00d9c60-1jammy [112 kB] 2024-03-09T14:25:20.656 INFO:teuthology.orchestra.run.smithi099.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2079-gc00d9c60-1jammy [466 kB] 2024-03-09T14:25:20.665 INFO:teuthology.orchestra.run.smithi099.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2079-gc00d9c60-1jammy [24.5 MB] 2024-03-09T14:25:21.870 INFO:teuthology.orchestra.run.smithi179.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2079-gc00d9c60-1jammy [711 kB] 2024-03-09T14:25:22.200 INFO:teuthology.orchestra.run.smithi179.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2079-gc00d9c60-1jammy [356 kB] 2024-03-09T14:25:22.344 INFO:teuthology.orchestra.run.smithi179.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2079-gc00d9c60-1jammy [32.8 kB] 2024-03-09T14:25:22.346 INFO:teuthology.orchestra.run.smithi179.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2079-gc00d9c60-1jammy [180 kB] 2024-03-09T14:25:22.471 INFO:teuthology.orchestra.run.smithi179.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2079-gc00d9c60-1jammy [64.6 kB] 2024-03-09T14:25:22.478 INFO:teuthology.orchestra.run.smithi179.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2079-gc00d9c60-1jammy [330 kB] 2024-03-09T14:25:22.622 INFO:teuthology.orchestra.run.smithi179.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2079-gc00d9c60-1jammy [6,744 kB] 2024-03-09T14:25:23.060 INFO:teuthology.orchestra.run.smithi099.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2079-gc00d9c60-1jammy [5,088 kB] 2024-03-09T14:25:23.324 INFO:teuthology.orchestra.run.smithi099.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2079-gc00d9c60-1jammy [243 kB] 2024-03-09T14:25:23.366 INFO:teuthology.orchestra.run.smithi099.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2079-gc00d9c60-1jammy [124 kB] 2024-03-09T14:25:23.371 INFO:teuthology.orchestra.run.smithi099.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2079-gc00d9c60-1jammy [1,522 kB] 2024-03-09T14:25:23.493 INFO:teuthology.orchestra.run.smithi099.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2079-gc00d9c60-1jammy [6,249 kB] 2024-03-09T14:25:24.030 INFO:teuthology.orchestra.run.smithi099.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2079-gc00d9c60-1jammy [22.8 MB] 2024-03-09T14:25:25.736 INFO:teuthology.orchestra.run.smithi179.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2079-gc00d9c60-1jammy [112 kB] 2024-03-09T14:25:25.747 INFO:teuthology.orchestra.run.smithi179.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2079-gc00d9c60-1jammy [466 kB] 2024-03-09T14:25:25.942 INFO:teuthology.orchestra.run.smithi179.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2079-gc00d9c60-1jammy [24.5 MB] 2024-03-09T14:25:26.287 INFO:teuthology.orchestra.run.smithi099.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2079-gc00d9c60-1jammy [14.0 kB] 2024-03-09T14:25:26.288 INFO:teuthology.orchestra.run.smithi099.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2079-gc00d9c60-1jammy [867 kB] 2024-03-09T14:25:26.304 INFO:teuthology.orchestra.run.smithi099.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2079-gc00d9c60-1jammy [2,191 kB] 2024-03-09T14:25:26.509 INFO:teuthology.orchestra.run.smithi099.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2079-gc00d9c60-1jammy [777 kB] 2024-03-09T14:25:26.591 INFO:teuthology.orchestra.run.smithi099.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2079-gc00d9c60-1jammy [144 kB] 2024-03-09T14:25:26.597 INFO:teuthology.orchestra.run.smithi099.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2079-gc00d9c60-1jammy [1,934 kB] 2024-03-09T14:25:26.812 INFO:teuthology.orchestra.run.smithi099.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2079-gc00d9c60-1jammy [8,625 kB] 2024-03-09T14:25:27.591 INFO:teuthology.orchestra.run.smithi099.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2079-gc00d9c60-1jammy [14.2 kB] 2024-03-09T14:25:27.592 INFO:teuthology.orchestra.run.smithi099.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2079-gc00d9c60-1jammy [50.5 MB] 2024-03-09T14:25:31.953 INFO:teuthology.orchestra.run.smithi179.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2079-gc00d9c60-1jammy [5,088 kB] 2024-03-09T14:25:32.317 INFO:teuthology.orchestra.run.smithi099.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2079-gc00d9c60-1jammy [121 kB] 2024-03-09T14:25:32.320 INFO:teuthology.orchestra.run.smithi099.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2079-gc00d9c60-1jammy [38.4 kB] 2024-03-09T14:25:32.321 INFO:teuthology.orchestra.run.smithi099.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2079-gc00d9c60-1jammy [13.3 MB] 2024-03-09T14:25:32.706 INFO:teuthology.orchestra.run.smithi179.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2079-gc00d9c60-1jammy [243 kB] 2024-03-09T14:25:32.736 INFO:teuthology.orchestra.run.smithi179.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2079-gc00d9c60-1jammy [124 kB] 2024-03-09T14:25:32.767 INFO:teuthology.orchestra.run.smithi179.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2079-gc00d9c60-1jammy [1,522 kB] 2024-03-09T14:25:33.000 INFO:teuthology.orchestra.run.smithi179.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2079-gc00d9c60-1jammy [6,249 kB] 2024-03-09T14:25:33.723 INFO:teuthology.orchestra.run.smithi099.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2079-gc00d9c60-1jammy [91.5 kB] 2024-03-09T14:25:33.864 INFO:teuthology.orchestra.run.smithi179.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2079-gc00d9c60-1jammy [22.8 MB] 2024-03-09T14:25:34.274 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 178 MB in 16s (11.2 MB/s) 2024-03-09T14:25:34.394 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-09T14:25:34.488 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165997 files and directories currently installed.) 2024-03-09T14:25:34.494 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-09T14:25:34.593 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-09T14:25:34.913 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-09T14:25:34.939 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-09T14:25:34.979 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-09T14:25:35.672 INFO:teuthology.orchestra.run.smithi179.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2079-gc00d9c60-1jammy [14.0 kB] 2024-03-09T14:25:35.673 INFO:teuthology.orchestra.run.smithi179.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2079-gc00d9c60-1jammy [867 kB] 2024-03-09T14:25:35.690 INFO:teuthology.orchestra.run.smithi179.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2079-gc00d9c60-1jammy [2,191 kB] 2024-03-09T14:25:35.707 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-09T14:25:35.734 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-09T14:25:35.774 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-09T14:25:35.887 INFO:teuthology.orchestra.run.smithi179.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2079-gc00d9c60-1jammy [777 kB] 2024-03-09T14:25:35.962 INFO:teuthology.orchestra.run.smithi179.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2079-gc00d9c60-1jammy [144 kB] 2024-03-09T14:25:35.974 INFO:teuthology.orchestra.run.smithi179.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2079-gc00d9c60-1jammy [1,934 kB] 2024-03-09T14:25:36.186 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-09T14:25:36.187 INFO:teuthology.orchestra.run.smithi179.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2079-gc00d9c60-1jammy [8,625 kB] 2024-03-09T14:25:36.213 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-09T14:25:36.261 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-09T14:25:36.656 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-09T14:25:36.683 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-09T14:25:36.723 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-09T14:25:37.034 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-09T14:25:37.061 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-09T14:25:37.093 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-09T14:25:37.359 INFO:teuthology.orchestra.run.smithi179.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2079-gc00d9c60-1jammy [14.2 kB] 2024-03-09T14:25:37.360 INFO:teuthology.orchestra.run.smithi179.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2079-gc00d9c60-1jammy [50.5 MB] 2024-03-09T14:25:37.438 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-09T14:25:37.464 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-09T14:25:37.504 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-09T14:25:37.816 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librados2. 2024-03-09T14:25:37.842 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../007-librados2_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:37.882 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librados2 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:38.327 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librbd1. 2024-03-09T14:25:38.342 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../008-librbd1_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:38.377 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librbd1 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:38.796 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcephfs2. 2024-03-09T14:25:38.822 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:38.863 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcephfs2 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:39.149 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rados. 2024-03-09T14:25:39.175 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:39.216 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rados (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:39.535 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-09T14:25:39.561 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2079-gc00d9c60-1jammy_all.deb ... 2024-03-09T14:25:39.601 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-ceph-argparse (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:39.838 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cephfs. 2024-03-09T14:25:39.853 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:39.887 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cephfs (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:40.190 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-09T14:25:40.217 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2079-gc00d9c60-1jammy_all.deb ... 2024-03-09T14:25:40.257 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-ceph-common (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:40.593 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-09T14:25:40.620 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-09T14:25:40.660 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-09T14:25:41.105 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-prettytable. 2024-03-09T14:25:41.131 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-03-09T14:25:41.172 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-09T14:25:41.424 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rbd. 2024-03-09T14:25:41.439 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:41.482 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rbd (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:41.827 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-09T14:25:41.853 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-09T14:25:41.893 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-09T14:25:42.180 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-09T14:25:42.206 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-09T14:25:42.246 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-09T14:25:42.549 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-09T14:25:42.564 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-09T14:25:42.599 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-09T14:25:42.903 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua5.1. 2024-03-09T14:25:42.929 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-09T14:25:42.978 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-09T14:25:43.289 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua-any. 2024-03-09T14:25:43.315 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-03-09T14:25:43.356 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-09T14:25:43.592 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package zip. 2024-03-09T14:25:43.607 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-03-09T14:25:43.641 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking zip (3.0-12build2) ... 2024-03-09T14:25:43.928 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package unzip. 2024-03-09T14:25:43.954 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-09T14:25:43.995 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-09T14:25:44.366 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package luarocks. 2024-03-09T14:25:44.392 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-09T14:25:44.432 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-09T14:25:44.799 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package librgw2. 2024-03-09T14:25:44.814 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../025-librgw2_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:44.857 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking librgw2 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:45.401 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rgw. 2024-03-09T14:25:45.427 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:45.467 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rgw (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:45.550 INFO:teuthology.orchestra.run.smithi179.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2079-gc00d9c60-1jammy [121 kB] 2024-03-09T14:25:45.552 INFO:teuthology.orchestra.run.smithi179.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2079-gc00d9c60-1jammy [38.4 kB] 2024-03-09T14:25:45.553 INFO:teuthology.orchestra.run.smithi179.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2079-gc00d9c60-1jammy [13.3 MB] 2024-03-09T14:25:45.812 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-09T14:25:45.839 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-09T14:25:46.021 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-09T14:25:46.203 INFO:teuthology.orchestra.run.smithi179.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-rgw-account-v3/c00d9c609fb42a2a25f1c196bed064ca8bb02413/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2079-gc00d9c60-1jammy [91.5 kB] 2024-03-09T14:25:46.290 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libradosstriper1. 2024-03-09T14:25:46.306 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:46.340 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libradosstriper1 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:46.736 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-common. 2024-03-09T14:25:46.755 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 178 MB in 28s (6,247 kB/s) 2024-03-09T14:25:46.762 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:46.802 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-common (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:46.890 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-03-09T14:25:46.990 INFO:teuthology.orchestra.run.smithi179.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165997 files and directories currently installed.) 2024-03-09T14:25:46.995 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-03-09T14:25:47.072 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-09T14:25:47.384 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-03-09T14:25:47.411 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-03-09T14:25:47.451 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-09T14:25:47.787 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-03-09T14:25:47.814 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-03-09T14:25:47.854 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-09T14:25:48.124 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-base. 2024-03-09T14:25:48.151 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:48.200 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-base (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:48.332 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-03-09T14:25:48.359 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-09T14:25:48.407 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-09T14:25:48.746 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-09T14:25:48.760 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-03-09T14:25:48.772 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-09T14:25:48.776 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-09T14:25:48.810 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-09T14:25:48.812 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-09T14:25:49.065 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cheroot. 2024-03-09T14:25:49.092 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-09T14:25:49.131 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-09T14:25:49.138 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-03-09T14:25:49.165 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-03-09T14:25:49.205 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-09T14:25:49.451 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-09T14:25:49.478 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-09T14:25:49.518 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-09T14:25:49.558 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-03-09T14:25:49.585 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-03-09T14:25:49.625 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-09T14:25:49.830 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-09T14:25:49.856 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-09T14:25:49.896 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-09T14:25:49.927 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librados2. 2024-03-09T14:25:49.943 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../007-librados2_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:49.977 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librados2 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:50.174 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-09T14:25:50.201 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-09T14:25:50.380 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librbd1. 2024-03-09T14:25:50.407 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../008-librbd1_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:50.447 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librbd1 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:50.557 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-09T14:25:51.317 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libcephfs2. 2024-03-09T14:25:51.344 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:51.377 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-tempora. 2024-03-09T14:25:51.404 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-03-09T14:25:51.444 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-09T14:25:51.747 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-portend. 2024-03-09T14:25:51.774 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-03-09T14:25:51.814 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-09T14:25:51.875 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libcephfs2 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:52.075 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-09T14:25:52.102 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-09T14:25:52.133 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-09T14:25:52.178 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rados. 2024-03-09T14:25:52.193 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:52.227 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rados (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:52.428 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-09T14:25:52.455 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-09T14:25:52.495 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-09T14:25:52.497 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-03-09T14:25:52.520 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2079-gc00d9c60-1jammy_all.deb ... 2024-03-09T14:25:52.555 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-ceph-argparse (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:52.791 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cephfs. 2024-03-09T14:25:52.806 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:52.832 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-natsort. 2024-03-09T14:25:52.849 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cephfs (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:52.859 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-03-09T14:25:52.898 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-09T14:25:53.152 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-ceph-common. 2024-03-09T14:25:53.178 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2079-gc00d9c60-1jammy_all.deb ... 2024-03-09T14:25:53.210 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-logutils. 2024-03-09T14:25:53.219 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-ceph-common (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:53.237 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-03-09T14:25:53.276 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-09T14:25:53.547 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-wcwidth. 2024-03-09T14:25:53.573 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-03-09T14:25:53.588 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-09T14:25:53.613 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-09T14:25:53.614 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-09T14:25:53.654 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-09T14:25:53.908 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-prettytable. 2024-03-09T14:25:53.923 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-03-09T14:25:53.941 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-mako. 2024-03-09T14:25:53.958 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-03-09T14:25:53.967 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-09T14:25:54.007 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-09T14:25:54.202 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rbd. 2024-03-09T14:25:54.228 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:54.268 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rbd (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:54.294 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-09T14:25:54.320 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-09T14:25:54.352 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-09T14:25:54.613 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-03-09T14:25:54.640 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-03-09T14:25:54.680 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-09T14:25:54.680 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-09T14:25:54.707 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-09T14:25:54.747 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-09T14:25:54.974 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-03-09T14:25:54.989 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-03-09T14:25:55.032 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-03-09T14:25:55.050 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webob. 2024-03-09T14:25:55.076 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-09T14:25:55.116 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-09T14:25:55.319 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-03-09T14:25:55.334 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-03-09T14:25:55.369 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-09T14:25:55.461 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-waitress. 2024-03-09T14:25:55.487 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-09T14:25:55.539 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-09T14:25:55.672 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua5.1. 2024-03-09T14:25:55.698 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-03-09T14:25:55.738 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-03-09T14:25:55.831 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-tempita. 2024-03-09T14:25:55.858 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-09T14:25:55.889 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-09T14:25:56.083 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua-any. 2024-03-09T14:25:56.099 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-03-09T14:25:56.142 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua-any (27ubuntu1) ... 2024-03-09T14:25:56.169 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-paste. 2024-03-09T14:25:56.194 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-09T14:25:56.234 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-09T14:25:56.361 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package zip. 2024-03-09T14:25:56.376 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-03-09T14:25:56.411 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking zip (3.0-12build2) ... 2024-03-09T14:25:56.556 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-09T14:25:56.571 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-09T14:25:56.614 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-09T14:25:56.730 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package unzip. 2024-03-09T14:25:56.757 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-03-09T14:25:56.797 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-03-09T14:25:56.917 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-09T14:25:56.944 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-09T14:25:56.983 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-09T14:25:57.159 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package luarocks. 2024-03-09T14:25:57.186 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-03-09T14:25:57.226 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-03-09T14:25:57.286 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-webtest. 2024-03-09T14:25:57.313 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-03-09T14:25:57.353 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-09T14:25:57.600 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librgw2. 2024-03-09T14:25:57.627 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../025-librgw2_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:57.665 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pecan. 2024-03-09T14:25:57.667 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librgw2 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:57.691 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-09T14:25:57.731 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-09T14:25:58.111 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-certifi. 2024-03-09T14:25:58.138 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-03-09T14:25:58.177 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-09T14:25:58.211 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rgw. 2024-03-09T14:25:58.226 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:58.269 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rgw (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:58.506 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-idna. 2024-03-09T14:25:58.533 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-03-09T14:25:58.572 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-09T14:25:58.589 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package liboath0:amd64. 2024-03-09T14:25:58.615 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-03-09T14:25:58.647 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-03-09T14:25:58.835 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-urllib3. 2024-03-09T14:25:58.849 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-09T14:25:58.884 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-09T14:25:58.950 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libradosstriper1. 2024-03-09T14:25:58.977 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:59.018 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libradosstriper1 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:59.170 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-requests. 2024-03-09T14:25:59.188 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-09T14:25:59.220 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-09T14:25:59.446 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-common. 2024-03-09T14:25:59.472 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:25:59.499 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-09T14:25:59.512 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-common (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:25:59.526 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-09T14:25:59.565 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-09T14:25:59.827 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-09T14:25:59.854 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2079-gc00d9c60-1jammy_all.deb ... 2024-03-09T14:25:59.885 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:00.274 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-09T14:26:00.301 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:00.340 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:00.626 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-09T14:26:00.653 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-09T14:26:00.684 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-09T14:26:00.850 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-base. 2024-03-09T14:26:00.877 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:00.926 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-base (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:00.954 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-openssl. 2024-03-09T14:26:00.981 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-03-09T14:26:01.020 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-09T14:26:01.391 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr. 2024-03-09T14:26:01.418 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:01.610 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:01.688 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-03-09T14:26:01.714 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-03-09T14:26:01.754 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-03-09T14:26:01.977 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mon. 2024-03-09T14:26:02.004 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:02.040 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cheroot. 2024-03-09T14:26:02.043 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mon (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:02.067 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-03-09T14:26:02.115 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-09T14:26:02.427 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-03-09T14:26:02.453 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-03-09T14:26:02.493 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-03-09T14:26:02.647 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-osd. 2024-03-09T14:26:02.674 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:02.714 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-osd (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:02.796 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.text. 2024-03-09T14:26:02.822 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-03-09T14:26:02.862 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-03-09T14:26:03.165 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-03-09T14:26:03.192 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-03-09T14:26:03.240 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-03-09T14:26:03.518 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-tempora. 2024-03-09T14:26:03.545 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-03-09T14:26:03.585 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-03-09T14:26:03.734 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph. 2024-03-09T14:26:03.760 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../066-ceph_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:03.800 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:03.854 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-portend. 2024-03-09T14:26:03.880 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-03-09T14:26:03.921 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-03-09T14:26:04.103 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-fuse. 2024-03-09T14:26:04.130 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:04.169 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-fuse (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:04.232 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-03-09T14:26:04.258 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-03-09T14:26:04.298 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-03-09T14:26:04.540 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mds. 2024-03-09T14:26:04.566 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:04.601 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cherrypy3. 2024-03-09T14:26:04.606 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mds (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:04.628 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-03-09T14:26:04.668 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-03-09T14:26:04.993 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package cephadm. 2024-03-09T14:26:05.013 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-natsort. 2024-03-09T14:26:05.019 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../069-cephadm_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:05.039 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-03-09T14:26:05.059 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking cephadm (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:05.079 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-03-09T14:26:05.374 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-09T14:26:05.391 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-logutils. 2024-03-09T14:26:05.397 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-09T14:26:05.418 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-03-09T14:26:05.437 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-09T14:26:05.458 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-03-09T14:26:05.744 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-markupsafe. 2024-03-09T14:26:05.756 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-09T14:26:05.770 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-03-09T14:26:05.783 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-09T14:26:05.802 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-03-09T14:26:05.823 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-09T14:26:06.088 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-mako. 2024-03-09T14:26:06.115 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-03-09T14:26:06.155 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-09T14:26:06.492 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-simplegeneric. 2024-03-09T14:26:06.519 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-03-09T14:26:06.550 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-03-09T14:26:06.786 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-babel. 2024-03-09T14:26:06.802 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-09T14:26:06.836 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-singledispatch. 2024-03-09T14:26:06.845 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-09T14:26:06.862 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-03-09T14:26:06.902 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-03-09T14:26:07.148 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-jinja2. 2024-03-09T14:26:07.175 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-09T14:26:07.197 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-webob. 2024-03-09T14:26:07.214 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-09T14:26:07.223 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-03-09T14:26:07.263 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-03-09T14:26:07.568 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-09T14:26:07.594 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2079-gc00d9c60-1jammy_all.deb ... 2024-03-09T14:26:07.616 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-waitress. 2024-03-09T14:26:07.634 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:07.643 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-03-09T14:26:07.686 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-09T14:26:07.978 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-tempita. 2024-03-09T14:26:07.979 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-09T14:26:08.004 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-03-09T14:26:08.006 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-03-09T14:26:08.036 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-03-09T14:26:08.045 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-09T14:26:08.307 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-routes. 2024-03-09T14:26:08.322 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-paste. 2024-03-09T14:26:08.334 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-09T14:26:08.349 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-03-09T14:26:08.374 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-09T14:26:08.388 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-03-09T14:26:08.717 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-03-09T14:26:08.718 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-09T14:26:08.732 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-03-09T14:26:08.745 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2079-gc00d9c60-1jammy_all.deb ... 2024-03-09T14:26:08.775 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-03-09T14:26:08.785 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:09.078 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pastedeploy. 2024-03-09T14:26:09.105 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-03-09T14:26:09.145 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-03-09T14:26:09.214 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-09T14:26:09.229 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-09T14:26:09.264 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-09T14:26:09.447 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-webtest. 2024-03-09T14:26:09.463 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-03-09T14:26:09.506 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-03-09T14:26:09.701 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-joblib. 2024-03-09T14:26:09.727 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-09T14:26:09.759 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-09T14:26:09.783 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pecan. 2024-03-09T14:26:09.799 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-03-09T14:26:09.834 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-03-09T14:26:10.121 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-09T14:26:10.148 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-09T14:26:10.180 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-certifi. 2024-03-09T14:26:10.187 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-09T14:26:10.207 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-03-09T14:26:10.238 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-03-09T14:26:10.490 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-sklearn. 2024-03-09T14:26:10.517 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-09T14:26:10.557 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-09T14:26:10.558 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-idna. 2024-03-09T14:26:10.584 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-03-09T14:26:10.633 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-idna (3.3-1) ... 2024-03-09T14:26:10.944 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-urllib3. 2024-03-09T14:26:10.970 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-03-09T14:26:11.010 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-09T14:26:11.299 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-09T14:26:11.327 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2079-gc00d9c60-1jammy_all.deb ... 2024-03-09T14:26:11.339 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-requests. 2024-03-09T14:26:11.365 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-03-09T14:26:11.405 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-09T14:26:11.583 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:11.800 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-werkzeug. 2024-03-09T14:26:11.826 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-03-09T14:26:11.866 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-09T14:26:12.153 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-03-09T14:26:12.168 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2079-gc00d9c60-1jammy_all.deb ... 2024-03-09T14:26:12.211 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:12.616 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-03-09T14:26:12.642 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:12.682 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:12.721 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-cachetools. 2024-03-09T14:26:12.748 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-03-09T14:26:12.796 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-09T14:26:12.994 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-bcrypt. 2024-03-09T14:26:13.020 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-03-09T14:26:13.041 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-09T14:26:13.056 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-09T14:26:13.060 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-03-09T14:26:13.099 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-09T14:26:13.346 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-openssl. 2024-03-09T14:26:13.373 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-03-09T14:26:13.411 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-09T14:26:13.412 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-03-09T14:26:13.438 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-09T14:26:13.477 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-09T14:26:13.699 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr. 2024-03-09T14:26:13.714 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:13.749 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:13.781 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-rsa. 2024-03-09T14:26:13.808 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-03-09T14:26:13.847 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-09T14:26:14.118 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-google-auth. 2024-03-09T14:26:14.145 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-03-09T14:26:14.163 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mon. 2024-03-09T14:26:14.176 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-09T14:26:14.189 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:14.229 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mon (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:14.479 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-09T14:26:14.507 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-09T14:26:14.554 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-09T14:26:14.793 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-osd. 2024-03-09T14:26:14.818 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:14.850 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-osd (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:14.875 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-websocket. 2024-03-09T14:26:14.901 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-03-09T14:26:14.941 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-09T14:26:15.219 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-09T14:26:15.246 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-09T14:26:15.277 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-09T14:26:15.954 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph. 2024-03-09T14:26:15.966 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-09T14:26:15.969 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../066-ceph_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:15.994 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2079-gc00d9c60-1jammy_all.deb ... 2024-03-09T14:26:16.012 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:16.033 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:16.332 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-fuse. 2024-03-09T14:26:16.352 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-09T14:26:16.358 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:16.380 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-09T14:26:16.406 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-fuse (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:16.419 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-09T14:26:16.714 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-09T14:26:16.726 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mds. 2024-03-09T14:26:16.741 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-09T14:26:16.742 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:16.772 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-09T14:26:16.776 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mds (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:17.025 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package jq. 2024-03-09T14:26:17.040 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-09T14:26:17.083 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-09T14:26:17.353 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package socat. 2024-03-09T14:26:17.380 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-09T14:26:17.405 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package cephadm. 2024-03-09T14:26:17.419 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-09T14:26:17.432 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../069-cephadm_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:17.471 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking cephadm (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:17.731 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package xmlstarlet. 2024-03-09T14:26:17.747 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-09T14:26:17.766 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-asyncssh. 2024-03-09T14:26:17.789 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-09T14:26:17.793 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-03-09T14:26:17.833 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-03-09T14:26:18.161 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python-babel-localedata. 2024-03-09T14:26:18.185 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-test. 2024-03-09T14:26:18.187 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-03-09T14:26:18.201 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:18.227 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-09T14:26:18.244 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-test (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:19.200 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-babel. 2024-03-09T14:26:19.216 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-03-09T14:26:19.257 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-03-09T14:26:19.587 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jinja2. 2024-03-09T14:26:19.613 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-03-09T14:26:19.652 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-09T14:26:19.989 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-03-09T14:26:20.016 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2079-gc00d9c60-1jammy_all.deb ... 2024-03-09T14:26:20.056 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:20.393 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-repoze.lru. 2024-03-09T14:26:20.420 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-03-09T14:26:20.457 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package ceph-volume. 2024-03-09T14:26:20.484 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2079-gc00d9c60-1jammy_all.deb ... 2024-03-09T14:26:20.493 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-03-09T14:26:20.526 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking ceph-volume (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:20.779 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-routes. 2024-03-09T14:26:20.806 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-03-09T14:26:20.819 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-09T14:26:20.834 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:20.846 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-03-09T14:26:20.877 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcephfs-dev (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:21.166 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-03-09T14:26:21.193 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2079-gc00d9c60-1jammy_all.deb ... 2024-03-09T14:26:21.213 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-09T14:26:21.232 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:21.240 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-09T14:26:21.280 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-09T14:26:21.576 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-09T14:26:21.604 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-03-09T14:26:21.643 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-09T14:26:21.653 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-03-09T14:26:21.669 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-03-09T14:26:21.711 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-09T14:26:21.958 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package nvme-cli. 2024-03-09T14:26:21.983 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-09T14:26:22.022 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-09T14:26:22.207 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-joblib. 2024-03-09T14:26:22.234 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-03-09T14:26:22.282 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-03-09T14:26:22.562 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package pkg-config. 2024-03-09T14:26:22.590 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-09T14:26:22.611 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-03-09T14:26:22.637 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-03-09T14:26:22.677 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-03-09T14:26:22.702 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-09T14:26:22.963 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-09T14:26:22.980 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-sklearn. 2024-03-09T14:26:22.988 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-09T14:26:23.007 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-03-09T14:26:23.038 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-09T14:26:23.047 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-09T14:26:23.458 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-09T14:26:23.486 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-09T14:26:23.524 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-09T14:26:23.765 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-03-09T14:26:23.792 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2079-gc00d9c60-1jammy_all.deb ... 2024-03-09T14:26:23.794 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pastescript. 2024-03-09T14:26:23.810 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-03-09T14:26:23.844 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-09T14:26:23.909 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:24.148 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pluggy. 2024-03-09T14:26:24.175 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-09T14:26:24.214 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-09T14:26:24.551 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-psutil. 2024-03-09T14:26:24.578 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-09T14:26:24.617 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-09T14:26:24.897 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cachetools. 2024-03-09T14:26:24.924 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-03-09T14:26:24.945 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-py. 2024-03-09T14:26:24.963 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-03-09T14:26:24.972 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-03-09T14:26:25.011 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-09T14:26:25.267 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pyasn1. 2024-03-09T14:26:25.294 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-03-09T14:26:25.315 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pygments. 2024-03-09T14:26:25.333 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-03-09T14:26:25.342 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-09T14:26:25.382 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-09T14:26:25.670 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-03-09T14:26:25.698 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-03-09T14:26:25.737 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-03-09T14:26:25.828 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-09T14:26:25.855 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-09T14:26:25.894 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-09T14:26:26.023 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rsa. 2024-03-09T14:26:26.039 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-03-09T14:26:26.073 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rsa (4.8-1) ... 2024-03-09T14:26:26.214 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-toml. 2024-03-09T14:26:26.241 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-03-09T14:26:26.280 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-09T14:26:26.369 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-google-auth. 2024-03-09T14:26:26.396 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-03-09T14:26:26.435 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-03-09T14:26:26.566 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-pytest. 2024-03-09T14:26:26.590 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-09T14:26:26.624 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-09T14:26:26.756 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-03-09T14:26:26.783 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-03-09T14:26:26.822 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-09T14:26:26.962 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-simplejson. 2024-03-09T14:26:26.989 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-09T14:26:27.028 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-09T14:26:27.134 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-websocket. 2024-03-09T14:26:27.161 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-03-09T14:26:27.200 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-03-09T14:26:27.306 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-09T14:26:27.321 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-09T14:26:27.364 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-09T14:26:27.730 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-kubernetes. 2024-03-09T14:26:27.757 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-03-09T14:26:27.788 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-09T14:26:28.168 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package radosgw. 2024-03-09T14:26:28.196 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../116-radosgw_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:28.234 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking radosgw (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:28.452 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-03-09T14:26:28.480 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2079-gc00d9c60-1jammy_all.deb ... 2024-03-09T14:26:28.518 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:28.872 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libonig5:amd64. 2024-03-09T14:26:28.899 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-03-09T14:26:28.939 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-09T14:26:29.029 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package rbd-fuse. 2024-03-09T14:26:29.045 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:29.087 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking rbd-fuse (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:29.259 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libjq1:amd64. 2024-03-09T14:26:29.283 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-03-09T14:26:29.317 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-09T14:26:29.367 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-09T14:26:29.545 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package jq. 2024-03-09T14:26:29.562 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-03-09T14:26:29.612 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-03-09T14:26:29.626 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-09T14:26:29.736 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-09T14:26:29.848 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package socat. 2024-03-09T14:26:29.865 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-03-09T14:26:29.907 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-03-09T14:26:29.967 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-09T14:26:30.220 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package xmlstarlet. 2024-03-09T14:26:30.233 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-03-09T14:26:30.276 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-03-09T14:26:30.318 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-09T14:26:30.623 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-test. 2024-03-09T14:26:30.638 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:30.681 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-test (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:30.771 INFO:teuthology.orchestra.run.smithi099.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-09T14:26:30.837 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up cephadm (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:31.329 INFO:teuthology.orchestra.run.smithi099.stdout:Adding system user cephadm....done 2024-03-09T14:26:31.452 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-09T14:26:31.703 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-09T14:26:31.971 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-09T14:26:32.098 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-09T14:26:32.332 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-09T14:26:32.600 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-09T14:26:32.726 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-09T14:26:33.161 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-volume. 2024-03-09T14:26:33.178 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-09T14:26:33.188 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2079-gc00d9c60-1jammy_all.deb ... 2024-03-09T14:26:33.227 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-volume (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:33.532 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libcephfs-dev. 2024-03-09T14:26:33.539 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-09T14:26:33.559 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:33.598 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libcephfs-dev (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:33.781 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-09T14:26:33.893 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua-socket:amd64. 2024-03-09T14:26:33.909 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-03-09T14:26:33.951 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-09T14:26:34.058 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-09T14:26:34.265 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua-sec:amd64. 2024-03-09T14:26:34.292 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-03-09T14:26:34.309 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-09T14:26:34.331 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-03-09T14:26:34.552 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-09T14:26:34.694 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package nvme-cli. 2024-03-09T14:26:34.722 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-03-09T14:26:34.760 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-03-09T14:26:34.811 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-09T14:26:35.071 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-ceph-argparse (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:35.216 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package pkg-config. 2024-03-09T14:26:35.244 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-03-09T14:26:35.283 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-03-09T14:26:35.381 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-09T14:26:35.506 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-09T14:26:35.519 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-03-09T14:26:35.535 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-03-09T14:26:35.569 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-03-09T14:26:35.633 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-09T14:26:35.759 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-09T14:26:35.965 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-iniconfig. 2024-03-09T14:26:35.992 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-03-09T14:26:36.001 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-09T14:26:36.023 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-03-09T14:26:36.309 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pastescript. 2024-03-09T14:26:36.337 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-03-09T14:26:36.374 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-09T14:26:36.376 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-03-09T14:26:36.407 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-09T14:26:36.465 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-09T14:26:36.566 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-09T14:26:36.705 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pluggy. 2024-03-09T14:26:36.733 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-03-09T14:26:36.771 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-03-09T14:26:36.934 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-09T14:26:37.035 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-09T14:26:37.158 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-psutil. 2024-03-09T14:26:37.185 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-03-09T14:26:37.224 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-03-09T14:26:37.277 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-09T14:26:37.537 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-09T14:26:37.561 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-py. 2024-03-09T14:26:37.588 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-03-09T14:26:37.636 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-py (1.10.0-1) ... 2024-03-09T14:26:37.880 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up zip (3.0-12build2) ... 2024-03-09T14:26:37.956 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pygments. 2024-03-09T14:26:37.985 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-03-09T14:26:37.989 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-09T14:26:38.023 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-03-09T14:26:38.478 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pyinotify. 2024-03-09T14:26:38.506 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-03-09T14:26:38.544 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-03-09T14:26:38.616 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-09T14:26:38.822 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-toml. 2024-03-09T14:26:38.838 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-03-09T14:26:38.872 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-03-09T14:26:38.876 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-09T14:26:39.002 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-09T14:26:39.128 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-09T14:26:39.175 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pytest. 2024-03-09T14:26:39.203 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-03-09T14:26:39.241 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-03-09T14:26:39.421 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-09T14:26:39.554 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-simplejson. 2024-03-09T14:26:39.582 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-03-09T14:26:39.612 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-03-09T14:26:39.813 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-09T14:26:39.865 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-03-09T14:26:39.881 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-03-09T14:26:39.923 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-03-09T14:26:40.057 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-09T14:26:40.425 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-09T14:26:40.686 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package radosgw. 2024-03-09T14:26:40.701 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-09T14:26:40.715 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../116-radosgw_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:40.752 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking radosgw (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:41.036 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-09T14:26:41.320 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-09T14:26:41.446 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-ceph-common (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:41.572 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package rbd-fuse. 2024-03-09T14:26:41.589 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2079-gc00d9c60-1jammy_amd64.deb ... 2024-03-09T14:26:41.631 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking rbd-fuse (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:41.739 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-idna (3.3-1) ... 2024-03-09T14:26:41.919 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-03-09T14:26:42.040 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-09T14:26:42.169 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-03-09T14:26:42.296 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-03-09T14:26:42.563 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-03-09T14:26:42.880 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-03-09T14:26:43.300 INFO:teuthology.orchestra.run.smithi179.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-03-09T14:26:43.365 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up cephadm (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:43.429 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-09T14:26:43.689 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-09T14:26:43.824 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-09T14:26:43.856 INFO:teuthology.orchestra.run.smithi179.stdout:Adding system user cephadm....done 2024-03-09T14:26:43.997 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-03-09T14:26:44.092 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-09T14:26:44.217 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-09T14:26:44.291 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-03-09T14:26:44.344 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-09T14:26:44.533 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-03-09T14:26:44.637 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-09T14:26:44.684 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-03-09T14:26:44.888 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-09T14:26:44.935 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-03-09T14:26:45.131 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-09T14:26:45.170 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-03-09T14:26:45.257 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-09T14:26:45.296 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-py (1.10.0-1) ... 2024-03-09T14:26:45.550 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-09T14:26:45.606 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-03-09T14:26:45.809 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-09T14:26:45.984 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-03-09T14:26:46.068 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-09T14:26:46.235 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-03-09T14:26:46.311 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-09T14:26:46.486 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-03-09T14:26:46.562 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-09T14:26:46.764 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-03-09T14:26:46.830 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-09T14:26:46.931 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-09T14:26:47.014 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-03-09T14:26:47.199 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-09T14:26:47.274 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-03-09T14:26:47.325 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-09T14:26:47.542 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-ceph-argparse (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:47.618 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-09T14:26:47.785 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-03-09T14:26:47.902 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-09T14:26:47.961 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-03-09T14:26:48.087 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-03-09T14:26:48.153 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-09T14:26:48.213 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-03-09T14:26:48.296 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-09T14:26:48.405 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-09T14:26:48.479 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-09T14:26:48.690 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-03-09T14:26:48.724 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-09T14:26:48.850 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-09T14:26:49.063 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-03-09T14:26:49.096 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-03-09T14:26:49.193 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-03-09T14:26:49.235 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-09T14:26:49.319 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-03-09T14:26:49.486 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-09T14:26:49.604 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-09T14:26:49.679 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-03-09T14:26:49.805 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-03-09T14:26:49.863 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-09T14:26:49.972 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-09T14:26:50.082 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-03-09T14:26:50.282 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-09T14:26:50.350 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-03-09T14:26:50.591 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-09T14:26:50.660 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up zip (3.0-12build2) ... 2024-03-09T14:26:50.761 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-03-09T14:26:50.876 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-09T14:26:51.002 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-09T14:26:51.269 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-09T14:26:51.455 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-03-09T14:26:51.529 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-09T14:26:51.714 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-03-09T14:26:51.840 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-03-09T14:26:51.866 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-09T14:26:51.983 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-03-09T14:26:52.243 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-09T14:26:52.326 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-03-09T14:26:52.511 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-09T14:26:52.702 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-03-09T14:26:52.855 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-09T14:26:52.954 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-03-09T14:26:52.981 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librados2 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:53.107 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:53.233 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-09T14:26:53.339 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-03-09T14:26:53.528 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcephfs2 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:53.632 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-03-09T14:26:53.645 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libradosstriper1 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:53.780 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-09T14:26:53.984 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-03-09T14:26:54.057 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librbd1 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:54.183 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-modules-core (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:54.227 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-03-09T14:26:54.309 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-fuse (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:54.353 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-ceph-common (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:54.520 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-09T14:26:54.520 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-09T14:26:54.646 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-idna (3.3-1) ... 2024-03-09T14:26:54.964 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-03-09T14:26:54.977 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcephfs-dev (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:55.103 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rados (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:55.229 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up librgw2 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:55.330 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-09T14:26:56.156 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-03-09T14:26:56.416 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-09T14:26:56.517 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rbd (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:56.568 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-toml (0.10.2-1) ... 2024-03-09T14:26:56.618 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up rbd-fuse (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:56.719 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-rgw (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:56.827 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-03-09T14:26:56.828 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-cephfs (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:56.953 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-03-09T14:26:56.954 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-common (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:57.079 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-03-09T14:26:57.381 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-03-09T14:26:57.489 INFO:teuthology.orchestra.run.smithi099.stdout:Adding group ceph....done 2024-03-09T14:26:57.657 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-03-09T14:26:57.899 INFO:teuthology.orchestra.run.smithi099.stdout:Adding system user ceph....done 2024-03-09T14:26:57.908 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-09T14:26:58.010 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-03-09T14:26:58.059 INFO:teuthology.orchestra.run.smithi099.stdout:Setting system user ceph properties....done 2024-03-09T14:26:58.074 INFO:teuthology.orchestra.run.smithi099.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-09T14:26:58.213 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-09T14:26:58.295 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-03-09T14:26:58.550 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-09T14:26:58.554 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-03-09T14:26:58.814 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-03-09T14:26:59.006 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-test (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:59.065 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-03-09T14:26:59.132 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up radosgw (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:26:59.316 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-03-09T14:26:59.560 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-03-09T14:26:59.576 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-09T14:26:59.576 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-09T14:26:59.686 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-03-09T14:26:59.962 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-03-09T14:27:00.017 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-base (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:00.088 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-03-09T14:27:00.328 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-09T14:27:00.373 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-03-09T14:27:00.674 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-03-09T14:27:00.811 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mds (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:00.926 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-03-09T14:27:01.038 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-09T14:27:01.039 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-09T14:27:01.060 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-03-09T14:27:01.187 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-03-09T14:27:01.276 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-03-09T14:27:01.488 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:01.522 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-03-09T14:27:01.648 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-03-09T14:27:01.712 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-09T14:27:01.713 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-09T14:27:02.033 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-03-09T14:27:02.139 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-osd (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:02.293 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua-any (27ubuntu1) ... 2024-03-09T14:27:02.379 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-09T14:27:02.379 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-09T14:27:02.419 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-portend (3.0.0-1) ... 2024-03-09T14:27:02.670 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-03-09T14:27:02.813 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-03-09T14:27:02.823 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:02.966 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:03.109 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mon (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:03.156 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-03-09T14:27:03.320 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-09T14:27:03.320 INFO:teuthology.orchestra.run.smithi099.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-09T14:27:03.474 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-03-09T14:27:03.758 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-03-09T14:27:03.777 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-cephadm (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:03.901 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rsa (4.8-1) ... 2024-03-09T14:27:03.920 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:04.046 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-mgr-dashboard (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:04.169 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-03-09T14:27:04.172 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up ceph-volume (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:04.437 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-03-09T14:27:04.509 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-09T14:27:04.618 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-09T14:27:04.770 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-09T14:27:04.783 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-03-09T14:27:05.168 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-03-09T14:27:05.445 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-03-09T14:27:05.806 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-03-09T14:27:05.846 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-09T14:27:05.941 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librados2 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:06.075 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:06.218 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-03-09T14:27:06.488 INFO:teuthology.orchestra.run.smithi099.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-09T14:27:06.491 DEBUG:teuthology.orchestra.run.smithi099:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-03-09T14:27:06.544 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-03-09T14:27:06.554 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libcephfs2 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:06.681 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libradosstriper1 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:06.742 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-03-09T14:27:06.743 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-03-09T14:27:06.816 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-03-09T14:27:06.914 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-03-09T14:27:06.914 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-09T14:27:06.914 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-09T14:27:06.914 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-09T14:27:06.914 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-09T14:27:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-09T14:27:06.916 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-09T14:27:06.916 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-03-09T14:27:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-03-09T14:27:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-03-09T14:27:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-03-09T14:27:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-03-09T14:27:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-03-09T14:27:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-03-09T14:27:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-03-09T14:27:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-03-09T14:27:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-03-09T14:27:06.916 INFO:teuthology.orchestra.run.smithi099.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-03-09T14:27:06.917 INFO:teuthology.orchestra.run.smithi099.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-03-09T14:27:06.917 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-03-09T14:27:06.917 INFO:teuthology.orchestra.run.smithi099.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-03-09T14:27:06.918 INFO:teuthology.orchestra.run.smithi099.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-03-09T14:27:06.918 INFO:teuthology.orchestra.run.smithi099.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-03-09T14:27:06.918 INFO:teuthology.orchestra.run.smithi099.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-03-09T14:27:06.918 INFO:teuthology.orchestra.run.smithi099.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-03-09T14:27:06.956 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-03-09T14:27:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-03-09T14:27:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-03-09T14:27:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-03-09T14:27:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-03-09T14:27:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-03-09T14:27:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-03-09T14:27:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-03-09T14:27:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-03-09T14:27:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-03-09T14:27:06.956 INFO:teuthology.orchestra.run.smithi099.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-03-09T14:27:06.957 INFO:teuthology.orchestra.run.smithi099.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-03-09T14:27:06.957 INFO:teuthology.orchestra.run.smithi099.stdout: s3cmd 2024-03-09T14:27:07.092 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librbd1 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:07.140 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 35 newly installed, 0 to remove and 275 not upgraded. 2024-03-09T14:27:07.140 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 10.4 MB of archives. 2024-03-09T14:27:07.140 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-03-09T14:27:07.140 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-03-09T14:27:07.193 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-modules-core (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:07.222 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-03-09T14:27:07.223 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-03-09T14:27:07.240 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-03-09T14:27:07.320 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-fuse (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:07.402 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-03-09T14:27:07.476 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-03-09T14:27:07.483 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-03-09T14:27:07.533 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-09T14:27:07.533 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-03-09T14:27:07.621 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-03-09T14:27:07.715 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-03-09T14:27:07.716 INFO:teuthology.orchestra.run.smithi099.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-03-09T14:27:07.719 INFO:teuthology.orchestra.run.smithi099.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-03-09T14:27:08.027 INFO:teuthology.orchestra.run.smithi099.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-03-09T14:27:08.055 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libcephfs-dev (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:08.110 INFO:teuthology.orchestra.run.smithi099.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-03-09T14:27:08.181 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rados (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:08.316 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librgw2 (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:08.433 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-03-09T14:27:08.631 INFO:teuthology.orchestra.run.smithi099.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-03-09T14:27:08.632 INFO:teuthology.orchestra.run.smithi099.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-03-09T14:27:08.634 INFO:teuthology.orchestra.run.smithi099.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-03-09T14:27:08.639 INFO:teuthology.orchestra.run.smithi099.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-03-09T14:27:08.639 INFO:teuthology.orchestra.run.smithi099.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-03-09T14:27:08.656 INFO:teuthology.orchestra.run.smithi099.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-03-09T14:27:08.659 INFO:teuthology.orchestra.run.smithi099.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-03-09T14:27:08.691 INFO:teuthology.orchestra.run.smithi099.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-shared-utils-java all 3.3.0-1 [149 kB] 2024-03-09T14:27:08.698 INFO:teuthology.orchestra.run.smithi099.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-03-09T14:27:08.862 INFO:teuthology.orchestra.run.smithi099.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-03-09T14:27:09.125 INFO:teuthology.orchestra.run.smithi099.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-03-09T14:27:09.132 INFO:teuthology.orchestra.run.smithi099.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-03-09T14:27:09.228 INFO:teuthology.orchestra.run.smithi099.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-03-09T14:27:09.255 INFO:teuthology.orchestra.run.smithi099.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-03-09T14:27:09.336 INFO:teuthology.orchestra.run.smithi099.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-03-09T14:27:09.435 INFO:teuthology.orchestra.run.smithi099.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-03-09T14:27:09.464 INFO:teuthology.orchestra.run.smithi099.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-03-09T14:27:09.591 INFO:teuthology.orchestra.run.smithi099.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-03-09T14:27:09.591 INFO:teuthology.orchestra.run.smithi099.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-03-09T14:27:09.646 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rbd (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:09.661 INFO:teuthology.orchestra.run.smithi099.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-03-09T14:27:09.772 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up rbd-fuse (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:09.826 INFO:teuthology.orchestra.run.smithi099.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-03-09T14:27:09.898 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rgw (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:09.909 INFO:teuthology.orchestra.run.smithi099.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-03-09T14:27:10.025 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cephfs (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:10.168 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-common (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:10.557 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 10.4 MB in 3s (3,286 kB/s) 2024-03-09T14:27:10.634 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libapache-pom-java. 2024-03-09T14:27:10.710 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173568 files and directories currently installed.) 2024-03-09T14:27:10.715 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-03-09T14:27:10.719 INFO:teuthology.orchestra.run.smithi179.stdout:Adding group ceph....done 2024-03-09T14:27:10.750 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libapache-pom-java (18-1) ... 2024-03-09T14:27:10.978 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-03-09T14:27:11.005 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-03-09T14:27:11.053 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-03-09T14:27:11.081 INFO:teuthology.orchestra.run.smithi179.stdout:Adding system user ceph....done 2024-03-09T14:27:11.248 INFO:teuthology.orchestra.run.smithi179.stdout:Setting system user ceph properties....done 2024-03-09T14:27:11.265 INFO:teuthology.orchestra.run.smithi179.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-03-09T14:27:11.280 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-03-09T14:27:11.319 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-03-09T14:27:11.339 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-03-09T14:27:11.400 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-03-09T14:27:11.591 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcdi-api-java. 2024-03-09T14:27:11.607 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-03-09T14:27:11.650 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-03-09T14:27:11.750 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-03-09T14:27:11.911 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcommons-cli-java. 2024-03-09T14:27:11.938 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-03-09T14:27:11.977 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-03-09T14:27:12.221 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-test (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:12.221 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcommons-parent-java. 2024-03-09T14:27:12.237 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-03-09T14:27:12.271 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-03-09T14:27:12.347 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up radosgw (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:12.490 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcommons-io-java. 2024-03-09T14:27:12.506 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-03-09T14:27:12.549 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-03-09T14:27:12.801 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-03-09T14:27:12.818 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-03-09T14:27:12.856 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-09T14:27:12.857 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-03-09T14:27:12.859 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-03-09T14:27:13.162 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-03-09T14:27:13.179 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-03-09T14:27:13.220 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-03-09T14:27:13.350 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-base (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:13.456 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjsr305-java. 2024-03-09T14:27:13.472 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-03-09T14:27:13.506 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-03-09T14:27:13.714 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-03-09T14:27:13.734 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libguava-java. 2024-03-09T14:27:13.750 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-03-09T14:27:13.792 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libguava-java (29.0-6) ... 2024-03-09T14:27:14.278 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mds (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:14.588 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libaopalliance-java. 2024-03-09T14:27:14.604 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-03-09T14:27:14.647 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-03-09T14:27:14.784 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-09T14:27:14.784 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-03-09T14:27:14.874 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libguice-java. 2024-03-09T14:27:14.890 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-03-09T14:27:14.963 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-03-09T14:27:15.256 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:15.353 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-03-09T14:27:15.369 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-03-09T14:27:15.411 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-03-09T14:27:15.467 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-09T14:27:15.467 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-03-09T14:27:15.664 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjansi-native-java. 2024-03-09T14:27:15.680 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-03-09T14:27:15.739 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-03-09T14:27:15.941 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-osd (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:15.983 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libjansi-java. 2024-03-09T14:27:15.999 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-03-09T14:27:16.033 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libjansi-java (1.18-1) ... 2024-03-09T14:27:16.211 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-09T14:27:16.211 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-03-09T14:27:16.285 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libmaven-parent-java. 2024-03-09T14:27:16.299 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-03-09T14:27:16.335 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-03-09T14:27:16.588 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-03-09T14:27:16.616 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-03-09T14:27:16.655 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-03-09T14:27:16.709 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:16.811 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:16.937 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mon (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:16.940 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-03-09T14:27:16.957 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-03-09T14:27:16.990 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-03-09T14:27:17.148 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-09T14:27:17.148 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-03-09T14:27:17.210 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-03-09T14:27:17.226 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-03-09T14:27:17.268 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-03-09T14:27:17.589 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-03-09T14:27:17.605 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1_all.deb ... 2024-03-09T14:27:17.614 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-cephadm (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:17.647 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1) ... 2024-03-09T14:27:17.765 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:17.908 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-dashboard (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:17.941 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-03-09T14:27:17.957 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-03-09T14:27:18.000 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-03-09T14:27:18.084 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-volume (19.0.0-2079-gc00d9c60-1jammy) ... 2024-03-09T14:27:18.236 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-03-09T14:27:18.252 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-03-09T14:27:18.285 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-03-09T14:27:18.495 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-09T14:27:18.521 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-03-09T14:27:18.538 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-03-09T14:27:18.580 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-03-09T14:27:18.621 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-09T14:27:18.774 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-09T14:27:18.832 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-03-09T14:27:18.850 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-03-09T14:27:18.890 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-03-09T14:27:19.160 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-03-09T14:27:19.188 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-03-09T14:27:19.226 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-03-09T14:27:19.471 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libslf4j-java. 2024-03-09T14:27:19.487 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-03-09T14:27:19.529 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-03-09T14:27:19.783 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libsisu-inject-java. 2024-03-09T14:27:19.799 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-03-09T14:27:19.833 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-03-09T14:27:20.111 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-03-09T14:27:20.138 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-03-09T14:27:20.177 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-03-09T14:27:20.340 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-03-09T14:27:20.463 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libmaven3-core-java. 2024-03-09T14:27:20.479 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-03-09T14:27:20.521 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-03-09T14:27:20.952 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libwagon-file-java. 2024-03-09T14:27:20.968 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-03-09T14:27:20.978 INFO:teuthology.orchestra.run.smithi179.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-09T14:27:20.981 DEBUG:teuthology.orchestra.run.smithi179:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-03-09T14:27:21.010 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-03-09T14:27:21.036 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-03-09T14:27:21.229 INFO:teuthology.orchestra.run.smithi179.stdout:Building dependency tree... 2024-03-09T14:27:21.229 INFO:teuthology.orchestra.run.smithi179.stdout:Reading state information... 2024-03-09T14:27:21.262 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-03-09T14:27:21.278 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-03-09T14:27:21.321 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-03-09T14:27:21.398 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages were automatically installed and are no longer required: 2024-03-09T14:27:21.398 INFO:teuthology.orchestra.run.smithi179.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-09T14:27:21.398 INFO:teuthology.orchestra.run.smithi179.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-09T14:27:21.399 INFO:teuthology.orchestra.run.smithi179.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-09T14:27:21.399 INFO:teuthology.orchestra.run.smithi179.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-09T14:27:21.400 INFO:teuthology.orchestra.run.smithi179.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-09T14:27:21.400 INFO:teuthology.orchestra.run.smithi179.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-09T14:27:21.400 INFO:teuthology.orchestra.run.smithi179.stdout:The following additional packages will be installed: 2024-03-09T14:27:21.400 INFO:teuthology.orchestra.run.smithi179.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-03-09T14:27:21.400 INFO:teuthology.orchestra.run.smithi179.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-03-09T14:27:21.400 INFO:teuthology.orchestra.run.smithi179.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-03-09T14:27:21.400 INFO:teuthology.orchestra.run.smithi179.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-03-09T14:27:21.400 INFO:teuthology.orchestra.run.smithi179.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-03-09T14:27:21.400 INFO:teuthology.orchestra.run.smithi179.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-03-09T14:27:21.401 INFO:teuthology.orchestra.run.smithi179.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-03-09T14:27:21.401 INFO:teuthology.orchestra.run.smithi179.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-03-09T14:27:21.401 INFO:teuthology.orchestra.run.smithi179.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-03-09T14:27:21.401 INFO:teuthology.orchestra.run.smithi179.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-03-09T14:27:21.401 INFO:teuthology.orchestra.run.smithi179.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-03-09T14:27:21.401 INFO:teuthology.orchestra.run.smithi179.stdout:Suggested packages: 2024-03-09T14:27:21.402 INFO:teuthology.orchestra.run.smithi179.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-03-09T14:27:21.402 INFO:teuthology.orchestra.run.smithi179.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-03-09T14:27:21.402 INFO:teuthology.orchestra.run.smithi179.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-03-09T14:27:21.402 INFO:teuthology.orchestra.run.smithi179.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-03-09T14:27:21.402 INFO:teuthology.orchestra.run.smithi179.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-03-09T14:27:21.438 INFO:teuthology.orchestra.run.smithi179.stdout:The following NEW packages will be installed: 2024-03-09T14:27:21.439 INFO:teuthology.orchestra.run.smithi179.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-03-09T14:27:21.439 INFO:teuthology.orchestra.run.smithi179.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-03-09T14:27:21.439 INFO:teuthology.orchestra.run.smithi179.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-03-09T14:27:21.439 INFO:teuthology.orchestra.run.smithi179.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-03-09T14:27:21.439 INFO:teuthology.orchestra.run.smithi179.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-03-09T14:27:21.439 INFO:teuthology.orchestra.run.smithi179.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-03-09T14:27:21.439 INFO:teuthology.orchestra.run.smithi179.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-03-09T14:27:21.439 INFO:teuthology.orchestra.run.smithi179.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-03-09T14:27:21.439 INFO:teuthology.orchestra.run.smithi179.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-03-09T14:27:21.439 INFO:teuthology.orchestra.run.smithi179.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-03-09T14:27:21.439 INFO:teuthology.orchestra.run.smithi179.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-03-09T14:27:21.439 INFO:teuthology.orchestra.run.smithi179.stdout: s3cmd 2024-03-09T14:27:21.497 INFO:teuthology.orchestra.run.smithi179.stdout:0 upgraded, 35 newly installed, 0 to remove and 275 not upgraded. 2024-03-09T14:27:21.497 INFO:teuthology.orchestra.run.smithi179.stdout:Need to get 10.4 MB of archives. 2024-03-09T14:27:21.497 INFO:teuthology.orchestra.run.smithi179.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-03-09T14:27:21.497 INFO:teuthology.orchestra.run.smithi179.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-03-09T14:27:21.519 INFO:teuthology.orchestra.run.smithi179.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-03-09T14:27:21.519 INFO:teuthology.orchestra.run.smithi179.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-03-09T14:27:21.522 INFO:teuthology.orchestra.run.smithi179.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-03-09T14:27:21.564 INFO:teuthology.orchestra.run.smithi179.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-03-09T14:27:21.582 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-03-09T14:27:21.583 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-03-09T14:27:21.619 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-03-09T14:27:21.643 INFO:teuthology.orchestra.run.smithi179.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-03-09T14:27:21.644 INFO:teuthology.orchestra.run.smithi179.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-03-09T14:27:21.645 INFO:teuthology.orchestra.run.smithi179.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-03-09T14:27:21.697 INFO:teuthology.orchestra.run.smithi179.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-03-09T14:27:21.697 INFO:teuthology.orchestra.run.smithi179.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-03-09T14:27:21.714 INFO:teuthology.orchestra.run.smithi179.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-03-09T14:27:21.714 INFO:teuthology.orchestra.run.smithi179.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-03-09T14:27:21.715 INFO:teuthology.orchestra.run.smithi179.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-03-09T14:27:21.717 INFO:teuthology.orchestra.run.smithi179.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-03-09T14:27:21.718 INFO:teuthology.orchestra.run.smithi179.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-03-09T14:27:21.718 INFO:teuthology.orchestra.run.smithi179.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-03-09T14:27:21.719 INFO:teuthology.orchestra.run.smithi179.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-03-09T14:27:21.724 INFO:teuthology.orchestra.run.smithi179.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-shared-utils-java all 3.3.0-1 [149 kB] 2024-03-09T14:27:21.738 INFO:teuthology.orchestra.run.smithi179.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-03-09T14:27:21.738 INFO:teuthology.orchestra.run.smithi179.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-03-09T14:27:21.739 INFO:teuthology.orchestra.run.smithi179.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-03-09T14:27:21.739 INFO:teuthology.orchestra.run.smithi179.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-03-09T14:27:21.741 INFO:teuthology.orchestra.run.smithi179.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-03-09T14:27:21.741 INFO:teuthology.orchestra.run.smithi179.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-03-09T14:27:21.758 INFO:teuthology.orchestra.run.smithi179.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-03-09T14:27:21.761 INFO:teuthology.orchestra.run.smithi179.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-03-09T14:27:21.763 INFO:teuthology.orchestra.run.smithi179.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-03-09T14:27:21.774 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package maven. 2024-03-09T14:27:21.777 INFO:teuthology.orchestra.run.smithi179.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-03-09T14:27:21.777 INFO:teuthology.orchestra.run.smithi179.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-03-09T14:27:21.795 INFO:teuthology.orchestra.run.smithi179.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-03-09T14:27:21.795 INFO:teuthology.orchestra.run.smithi179.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-03-09T14:27:21.795 INFO:teuthology.orchestra.run.smithi179.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-03-09T14:27:21.801 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-03-09T14:27:21.840 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking maven (3.6.3-5) ... 2024-03-09T14:27:22.160 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package python3-magic. 2024-03-09T14:27:22.188 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-03-09T14:27:22.225 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 10.4 MB in 0s (29.6 MB/s) 2024-03-09T14:27:22.227 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-03-09T14:27:22.320 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libapache-pom-java. 2024-03-09T14:27:22.378 INFO:teuthology.orchestra.run.smithi179.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173568 files and directories currently installed.) 2024-03-09T14:27:22.382 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-03-09T14:27:22.436 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libapache-pom-java (18-1) ... 2024-03-09T14:27:22.496 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package s3cmd. 2024-03-09T14:27:22.524 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-03-09T14:27:22.554 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-03-09T14:27:22.706 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-03-09T14:27:22.722 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-03-09T14:27:22.764 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-03-09T14:27:22.900 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-03-09T14:27:23.010 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-03-09T14:27:23.017 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-03-09T14:27:23.045 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-03-09T14:27:23.084 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-03-09T14:27:23.136 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-03-09T14:27:23.270 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-03-09T14:27:23.337 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libcdi-api-java. 2024-03-09T14:27:23.353 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-03-09T14:27:23.396 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-03-09T14:27:23.396 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-03-09T14:27:23.522 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-03-09T14:27:23.656 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libcommons-cli-java. 2024-03-09T14:27:23.672 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-03-09T14:27:23.673 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-03-09T14:27:23.748 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-03-09T14:27:23.799 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-03-09T14:27:23.909 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-03-09T14:27:24.001 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libcommons-parent-java. 2024-03-09T14:27:24.009 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-03-09T14:27:24.028 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-03-09T14:27:24.068 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-03-09T14:27:24.119 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libapache-pom-java (18-1) ... 2024-03-09T14:27:24.245 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-03-09T14:27:24.320 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libcommons-io-java. 2024-03-09T14:27:24.336 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-03-09T14:27:24.373 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-03-09T14:27:24.379 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-03-09T14:27:24.516 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-03-09T14:27:24.642 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-03-09T14:27:24.673 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-03-09T14:27:24.701 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-03-09T14:27:24.740 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-03-09T14:27:24.759 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-03-09T14:27:25.010 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-03-09T14:27:25.051 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-03-09T14:27:25.079 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-03-09T14:27:25.118 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-03-09T14:27:25.128 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-03-09T14:27:25.237 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-03-09T14:27:25.338 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libmaven-parent-java (31-2) ... 2024-03-09T14:27:25.371 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libjsr305-java. 2024-03-09T14:27:25.387 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-03-09T14:27:25.429 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-03-09T14:27:25.473 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcommons-parent-java (43-1) ... 2024-03-09T14:27:25.598 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-03-09T14:27:25.699 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libguava-java. 2024-03-09T14:27:25.724 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up s3cmd (2.2.0-1) ... 2024-03-09T14:27:25.726 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-03-09T14:27:25.774 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libguava-java (29.0-6) ... 2024-03-09T14:27:26.052 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-03-09T14:27:26.185 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-03-09T14:27:26.236 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libaopalliance-java. 2024-03-09T14:27:26.263 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-03-09T14:27:26.295 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libguava-java (29.0-6) ... 2024-03-09T14:27:26.302 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-03-09T14:27:26.405 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-03-09T14:27:26.522 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-03-09T14:27:26.555 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libguice-java. 2024-03-09T14:27:26.583 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-03-09T14:27:26.621 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-03-09T14:27:26.648 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-03-09T14:27:26.774 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-03-09T14:27:26.900 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libguice-java (4.2.3-2) ... 2024-03-09T14:27:27.026 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libjansi-java (1.18-1) ... 2024-03-09T14:27:27.084 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-03-09T14:27:27.101 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-03-09T14:27:27.151 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-03-09T14:27:27.152 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libmaven-shared-utils-java (3.3.0-1) ... 2024-03-09T14:27:27.278 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-03-09T14:27:27.395 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up maven (3.6.3-5) ... 2024-03-09T14:27:27.404 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libjansi-native-java. 2024-03-09T14:27:27.420 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-03-09T14:27:27.462 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-03-09T14:27:27.627 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-03-09T14:27:27.691 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-09T14:27:27.698 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libjansi-java. 2024-03-09T14:27:27.714 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-03-09T14:27:27.757 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libjansi-java (1.18-1) ... 2024-03-09T14:27:28.018 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libmaven-parent-java. 2024-03-09T14:27:28.034 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-03-09T14:27:28.077 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-03-09T14:27:28.354 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-03-09T14:27:28.370 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-03-09T14:27:28.412 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-03-09T14:27:28.690 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-03-09T14:27:28.718 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-03-09T14:27:28.757 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-03-09T14:27:29.010 INFO:teuthology.orchestra.run.smithi099.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-09T14:27:29.014 DEBUG:teuthology.parallel:result is None 2024-03-09T14:27:29.035 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-03-09T14:27:29.051 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-03-09T14:27:29.094 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-03-09T14:27:29.423 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-03-09T14:27:29.451 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1_all.deb ... 2024-03-09T14:27:29.490 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1) ... 2024-03-09T14:27:29.743 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-03-09T14:27:29.759 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-03-09T14:27:29.793 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-03-09T14:27:30.046 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-03-09T14:27:30.074 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-03-09T14:27:30.121 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-03-09T14:27:30.373 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-03-09T14:27:30.389 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-03-09T14:27:30.432 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-03-09T14:27:30.659 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-03-09T14:27:30.676 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-03-09T14:27:30.709 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-03-09T14:27:30.962 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-03-09T14:27:30.978 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-03-09T14:27:31.020 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-03-09T14:27:31.273 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libslf4j-java. 2024-03-09T14:27:31.301 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-03-09T14:27:31.340 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-03-09T14:27:31.611 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libsisu-inject-java. 2024-03-09T14:27:31.627 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-03-09T14:27:31.661 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-03-09T14:27:31.914 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-03-09T14:27:31.931 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-03-09T14:27:31.981 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-03-09T14:27:32.259 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libmaven3-core-java. 2024-03-09T14:27:32.287 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-03-09T14:27:32.325 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-03-09T14:27:32.705 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libwagon-file-java. 2024-03-09T14:27:32.733 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-03-09T14:27:32.772 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-03-09T14:27:33.008 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-03-09T14:27:33.024 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-03-09T14:27:33.058 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-03-09T14:27:33.503 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package maven. 2024-03-09T14:27:33.531 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-03-09T14:27:33.569 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking maven (3.6.3-5) ... 2024-03-09T14:27:33.865 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-magic. 2024-03-09T14:27:33.893 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-03-09T14:27:33.931 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-03-09T14:27:34.218 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package s3cmd. 2024-03-09T14:27:34.246 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-03-09T14:27:34.276 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-03-09T14:27:34.606 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-03-09T14:27:34.732 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-03-09T14:27:34.867 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-03-09T14:27:35.001 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-03-09T14:27:35.128 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-03-09T14:27:35.254 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-03-09T14:27:35.380 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-03-09T14:27:35.506 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-03-09T14:27:35.632 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-03-09T14:27:35.758 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-03-09T14:27:35.918 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libapache-pom-java (18-1) ... 2024-03-09T14:27:36.044 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-03-09T14:27:36.170 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-03-09T14:27:36.296 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-03-09T14:27:36.422 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-03-09T14:27:36.565 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-03-09T14:27:36.826 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-03-09T14:27:36.952 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-03-09T14:27:37.078 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-03-09T14:27:37.204 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libmaven-parent-java (31-2) ... 2024-03-09T14:27:37.321 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libcommons-parent-java (43-1) ... 2024-03-09T14:27:37.498 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-03-09T14:27:37.599 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up s3cmd (2.2.0-1) ... 2024-03-09T14:27:37.901 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-03-09T14:27:38.044 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-03-09T14:27:38.170 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libguava-java (29.0-6) ... 2024-03-09T14:27:38.321 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-03-09T14:27:38.447 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-03-09T14:27:38.573 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-03-09T14:27:38.699 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-03-09T14:27:38.825 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libguice-java (4.2.3-2) ... 2024-03-09T14:27:38.954 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libjansi-java (1.18-1) ... 2024-03-09T14:27:39.080 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libmaven-shared-utils-java (3.3.0-1) ... 2024-03-09T14:27:39.181 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-03-09T14:27:39.281 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up maven (3.6.3-5) ... 2024-03-09T14:27:39.521 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-03-09T14:27:39.586 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-09T14:27:40.884 INFO:teuthology.orchestra.run.smithi179.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-03-09T14:27:40.889 DEBUG:teuthology.parallel:result is None 2024-03-09T14:27:40.890 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:27:41.106 DEBUG:teuthology.orchestra.run.smithi099:> dpkg-query -W -f '${Version}' ceph 2024-03-09T14:27:41.125 INFO:teuthology.orchestra.run.smithi099.stdout:19.0.0-2079-gc00d9c60-1jammy 2024-03-09T14:27:41.126 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2079-gc00d9c60-1jammy 2024-03-09T14:27:41.126 INFO:teuthology.task.install:The correct ceph version 19.0.0-2079-gc00d9c60-1jammy is installed. 2024-03-09T14:27:41.128 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:27:41.267 DEBUG:teuthology.orchestra.run.smithi179:> dpkg-query -W -f '${Version}' ceph 2024-03-09T14:27:41.286 INFO:teuthology.orchestra.run.smithi179.stdout:19.0.0-2079-gc00d9c60-1jammy 2024-03-09T14:27:41.286 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2079-gc00d9c60-1jammy 2024-03-09T14:27:41.287 INFO:teuthology.task.install:The correct ceph version 19.0.0-2079-gc00d9c60-1jammy is installed. 2024-03-09T14:27:41.288 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-09T14:27:41.289 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:27:41.289 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-09T14:27:41.302 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:27:41.302 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-09T14:27:41.343 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-09T14:27:41.344 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:27:41.344 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/daemon-helper 2024-03-09T14:27:41.357 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-09T14:27:41.411 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:27:41.411 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2024-03-09T14:27:41.425 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-09T14:27:41.478 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-09T14:27:41.478 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:27:41.478 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-09T14:27:41.490 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-09T14:27:41.544 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:27:41.544 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-09T14:27:41.558 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-09T14:27:41.614 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-09T14:27:41.615 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:27:41.615 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/usr/bin/stdin-killer 2024-03-09T14:27:41.627 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-09T14:27:41.679 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:27:41.679 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2024-03-09T14:27:41.692 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-09T14:27:41.746 INFO:teuthology.run_tasks:Running task ceph... 2024-03-09T14:27:41.834 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-09T14:27:41.834 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 777 /var/log/ceph 2024-03-09T14:27:41.837 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /var/log/ceph 2024-03-09T14:27:41.848 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-09T14:27:41.849 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-09T14:27:41.890 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-09T14:27:41.902 INFO:tasks.ceph:Creating extra log directories... 2024-03-09T14:27:41.902 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-09T14:27:41.946 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-09T14:27:41.971 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-09T14:27:41.971 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-09T14:27:41.971 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588483', 'branch': 'wip-rgw-account-v3', 'description': 'rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7588483', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-rgw-account-v3'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw enable ops log': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0'}, 'compression type': 'random', 'datacache': True, 'datacache_path': '/tmp/rgw_datacache', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'wip-iam-user-apis', 'git_remote': 'https://github.com/cbodley/', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rgw-account-v3', 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 60, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 3347, 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-rgw-account-v3', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413', 'targets': {'smithi099.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJvxb6Cx57k+Dk+mitefAnAU85CNp5VA/Ns5TtPcNylqPgdgH53lXV57Tp6MB+4UAAX5HtNWinI+yLWMEa45IKQ=', 'smithi179.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH5JVAmELeUh55pGkGtGa7EGX66r2w7RVpzb7HG3i0TSR9KbFAys0wgxHv/ahX5R6Yl49ACut6DEtH5SaYwLo4A='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-datacache.sh']}, 'env': {'RGW_DATACACHE_PATH': '/tmp/rgw_datacache'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-09_13:26:09', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-09T14:27:41.972 DEBUG:teuthology.orchestra.run.smithi099:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-09T14:27:41.998 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-09T14:27:42.003 DEBUG:teuthology.orchestra.run.smithi099:> sudo install -d -m0777 -- /var/run/ceph 2024-03-09T14:27:42.046 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/run/ceph 2024-03-09T14:27:42.059 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:27:42.059 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/scratch_devs of=/dev/stdout 2024-03-09T14:27:42.105 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-09T14:27:42.105 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_1 2024-03-09T14:27:42.153 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-09T14:27:42.153 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:27:42.153 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 869 Links: 1 2024-03-09T14:27:42.153 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:27:42.153 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-03-09 14:21:50.164278416 +0000 2024-03-09T14:27:42.153 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-03-09 14:21:49.908280702 +0000 2024-03-09T14:27:42.153 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-03-09 14:21:49.908280702 +0000 2024-03-09T14:27:42.153 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-03-09T14:27:42.153 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-09T14:27:42.206 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-03-09T14:27:42.206 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-03-09T14:27:42.207 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000388337 s, 1.3 MB/s 2024-03-09T14:27:42.208 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-09T14:27:42.258 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_2 2024-03-09T14:27:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-09T14:27:42.305 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:27:42.305 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-03-09T14:27:42.305 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:27:42.305 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-03-09 14:21:50.664273950 +0000 2024-03-09T14:27:42.305 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-03-09 14:21:50.392276379 +0000 2024-03-09T14:27:42.305 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-03-09 14:21:50.392276379 +0000 2024-03-09T14:27:42.306 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-03-09T14:27:42.306 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-09T14:27:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-03-09T14:27:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-03-09T14:27:42.359 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000315545 s, 1.6 MB/s 2024-03-09T14:27:42.361 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-09T14:27:42.411 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_3 2024-03-09T14:27:42.457 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-09T14:27:42.457 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:27:42.457 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 910 Links: 1 2024-03-09T14:27:42.457 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:27:42.457 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-03-09 14:21:51.212269055 +0000 2024-03-09T14:27:42.457 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-03-09 14:21:50.936271520 +0000 2024-03-09T14:27:42.457 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-03-09 14:21:50.936271520 +0000 2024-03-09T14:27:42.458 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-03-09T14:27:42.458 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-09T14:27:42.514 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-03-09T14:27:42.515 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-03-09T14:27:42.515 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000440183 s, 1.2 MB/s 2024-03-09T14:27:42.516 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-09T14:27:42.566 DEBUG:teuthology.orchestra.run.smithi099:> stat /dev/vg_nvme/lv_4 2024-03-09T14:27:42.613 INFO:teuthology.orchestra.run.smithi099.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-09T14:27:42.613 INFO:teuthology.orchestra.run.smithi099.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:27:42.613 INFO:teuthology.orchestra.run.smithi099.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-03-09T14:27:42.613 INFO:teuthology.orchestra.run.smithi099.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:27:42.613 INFO:teuthology.orchestra.run.smithi099.stdout:Access: 2024-03-09 14:21:51.452266911 +0000 2024-03-09T14:27:42.613 INFO:teuthology.orchestra.run.smithi099.stdout:Modify: 2024-03-09 14:21:51.448266947 +0000 2024-03-09T14:27:42.613 INFO:teuthology.orchestra.run.smithi099.stdout:Change: 2024-03-09 14:21:51.448266947 +0000 2024-03-09T14:27:42.614 INFO:teuthology.orchestra.run.smithi099.stdout: Birth: - 2024-03-09T14:27:42.614 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-09T14:27:42.667 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records in 2024-03-09T14:27:42.667 INFO:teuthology.orchestra.run.smithi099.stderr:1+0 records out 2024-03-09T14:27:42.667 INFO:teuthology.orchestra.run.smithi099.stderr:512 bytes copied, 0.000397977 s, 1.3 MB/s 2024-03-09T14:27:42.668 DEBUG:teuthology.orchestra.run.smithi099:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-09T14:27:42.718 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-09T14:27:42.718 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:27:42.719 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2024-03-09T14:27:42.724 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-09T14:27:42.724 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2024-03-09T14:27:42.771 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-09T14:27:42.771 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:27:42.772 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 877 Links: 1 2024-03-09T14:27:42.772 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:27:42.772 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-03-09 14:21:50.332333456 +0000 2024-03-09T14:27:42.772 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-03-09 14:21:50.100335515 +0000 2024-03-09T14:27:42.772 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-03-09 14:21:50.100335515 +0000 2024-03-09T14:27:42.772 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-03-09T14:27:42.772 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-09T14:27:42.826 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-03-09T14:27:42.826 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-03-09T14:27:42.826 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000439839 s, 1.2 MB/s 2024-03-09T14:27:42.827 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-09T14:27:42.876 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2024-03-09T14:27:42.923 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-09T14:27:42.923 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:27:42.923 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-03-09T14:27:42.923 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:27:42.923 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-03-09 14:21:50.832329016 +0000 2024-03-09T14:27:42.924 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-03-09 14:21:50.552331502 +0000 2024-03-09T14:27:42.924 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-03-09 14:21:50.552331502 +0000 2024-03-09T14:27:42.924 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-03-09T14:27:42.924 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-09T14:27:42.976 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-03-09T14:27:42.976 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-03-09T14:27:42.976 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.0003165 s, 1.6 MB/s 2024-03-09T14:27:42.978 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-09T14:27:43.024 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2024-03-09T14:27:43.071 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-09T14:27:43.071 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:27:43.071 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-03-09T14:27:43.072 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:27:43.072 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-03-09 14:21:51.072326885 +0000 2024-03-09T14:27:43.072 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-03-09 14:21:51.068326921 +0000 2024-03-09T14:27:43.072 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-03-09 14:21:51.068326921 +0000 2024-03-09T14:27:43.072 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-03-09T14:27:43.072 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-09T14:27:43.126 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-03-09T14:27:43.126 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-03-09T14:27:43.126 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000429726 s, 1.2 MB/s 2024-03-09T14:27:43.127 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-09T14:27:43.177 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2024-03-09T14:27:43.223 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-09T14:27:43.223 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-09T14:27:43.223 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 928 Links: 1 2024-03-09T14:27:43.223 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-09T14:27:43.223 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-03-09 14:21:51.840320068 +0000 2024-03-09T14:27:43.224 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-03-09 14:21:51.580322376 +0000 2024-03-09T14:27:43.224 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-03-09 14:21:51.580322376 +0000 2024-03-09T14:27:43.224 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-03-09T14:27:43.224 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-09T14:27:43.278 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-03-09T14:27:43.278 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-03-09T14:27:43.278 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000384264 s, 1.3 MB/s 2024-03-09T14:27:43.279 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-09T14:27:43.328 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-09T14:27:43.328 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-09T14:27:43.328 INFO:tasks.ceph:Generating config... 2024-03-09T14:27:43.329 INFO:tasks.ceph:[client] debug rgw = 20 2024-03-09T14:27:43.330 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-03-09T14:27:43.330 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-03-09T14:27:43.330 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-03-09T14:27:43.330 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-03-09T14:27:43.330 INFO:tasks.ceph:[client] rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-03-09T14:27:43.330 INFO:tasks.ceph:[client] rgw d3n l1 datacache size = 10737418240 2024-03-09T14:27:43.330 INFO:tasks.ceph:[client] rgw d3n l1 local datacache enabled = True 2024-03-09T14:27:43.330 INFO:tasks.ceph:[client] rgw enable ops log = True 2024-03-09T14:27:43.330 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-03-09T14:27:43.330 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-03-09T14:27:43.330 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-03-09T14:27:43.330 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-03-09T14:27:43.330 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-03-09T14:27:43.330 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-03-09T14:27:43.331 INFO:tasks.ceph:[client] setgroup = ceph 2024-03-09T14:27:43.331 INFO:tasks.ceph:[client] setuser = ceph 2024-03-09T14:27:43.331 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-03-09T14:27:43.331 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-03-09T14:27:43.331 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-03-09T14:27:43.331 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-03-09T14:27:43.331 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-09T14:27:43.331 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-09T14:27:43.331 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-09T14:27:43.331 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-09T14:27:43.331 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-09T14:27:43.331 INFO:tasks.ceph:[mon] lockdep = True 2024-03-09T14:27:43.331 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-09T14:27:43.332 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-09T14:27:43.332 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-09T14:27:43.332 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-09T14:27:43.332 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-09T14:27:43.332 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-09T14:27:43.332 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-09T14:27:43.332 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-09T14:27:43.332 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-09T14:27:43.332 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-09T14:27:43.332 INFO:tasks.ceph:[osd] lockdep = True 2024-03-09T14:27:43.332 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-09T14:27:43.332 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-09T14:27:43.332 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-09T14:27:43.332 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-09T14:27:43.332 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-09T14:27:43.332 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-03-09T14:27:43.333 INFO:tasks.ceph:Setting up mon.a... 2024-03-09T14:27:43.333 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-09T14:27:43.367 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.keyring 2024-03-09T14:27:43.387 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-09T14:27:43.465 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-09T14:27:43.521 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.99'), ('mon.c', '[v2:172.21.15.99:3301,v1:172.21.15.99:6790]'), ('mon.b', '172.21.15.179')] 2024-03-09T14:27:43.521 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790],172.21.15.179', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': True, 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw d3n l1 datacache persistent path': '/tmp/rgw_datacache/', 'rgw d3n l1 datacache size': 10737418240, 'rgw d3n l1 local datacache enabled': True, 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-03-09T14:27:43.522 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:27:43.522 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-09T14:27:43.569 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.99 --addv c '[v2:172.21.15.99:3301,v1:172.21.15.99:6790]' --add b 172.21.15.179 --print /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:27:43.658 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:27:43.659 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:27:43.659 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:27:43.659 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: generated fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:27:43.659 INFO:teuthology.orchestra.run.smithi099.stdout:setting min_mon_release = quincy 2024-03-09T14:27:43.659 INFO:teuthology.orchestra.run.smithi099.stdout:epoch 0 2024-03-09T14:27:43.659 INFO:teuthology.orchestra.run.smithi099.stdout:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:27:43.659 INFO:teuthology.orchestra.run.smithi099.stdout:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:27:43.659 INFO:teuthology.orchestra.run.smithi099.stdout:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:27:43.659 INFO:teuthology.orchestra.run.smithi099.stdout:min_mon_release 17 (quincy) 2024-03-09T14:27:43.660 INFO:teuthology.orchestra.run.smithi099.stdout:election_strategy: 1 2024-03-09T14:27:43.660 INFO:teuthology.orchestra.run.smithi099.stdout:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:27:43.660 INFO:teuthology.orchestra.run.smithi099.stdout:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:27:43.660 INFO:teuthology.orchestra.run.smithi099.stdout:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:27:43.660 INFO:teuthology.orchestra.run.smithi099.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-09T14:27:43.661 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-09T14:27:43.709 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e... 2024-03-09T14:27:43.710 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-09T14:27:43.754 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-09T14:27:43.782 INFO:teuthology.orchestra.run.smithi099.stdout:[global] 2024-03-09T14:27:43.782 INFO:teuthology.orchestra.run.smithi099.stdout: chdir = "" 2024-03-09T14:27:43.782 INFO:teuthology.orchestra.run.smithi099.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-09T14:27:43.782 INFO:teuthology.orchestra.run.smithi099.stdout: auth supported = cephx 2024-03-09T14:27:43.782 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.782 INFO:teuthology.orchestra.run.smithi099.stdout: filestore xattr use omap = true 2024-03-09T14:27:43.783 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.783 INFO:teuthology.orchestra.run.smithi099.stdout: mon clock drift allowed = 1.000 2024-03-09T14:27:43.783 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.783 INFO:teuthology.orchestra.run.smithi099.stdout: osd crush chooseleaf type = 0 2024-03-09T14:27:43.783 INFO:teuthology.orchestra.run.smithi099.stdout: auth debug = true 2024-03-09T14:27:43.783 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.783 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on old message = true 2024-03-09T14:27:43.783 INFO:teuthology.orchestra.run.smithi099.stdout: ms die on bug = true 2024-03-09T14:27:43.783 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.783 INFO:teuthology.orchestra.run.smithi099.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-09T14:27:43.783 INFO:teuthology.orchestra.run.smithi099.stdout: mon pg warn max object skew = 0 2024-03-09T14:27:43.783 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.783 INFO:teuthology.orchestra.run.smithi099.stdout: # disable pg_autoscaler by default for new pools 2024-03-09T14:27:43.783 INFO:teuthology.orchestra.run.smithi099.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-09T14:27:43.783 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.784 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default size = 2 2024-03-09T14:27:43.784 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.784 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow primary affinity = true 2024-03-09T14:27:43.784 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd allow pg remap = true 2024-03-09T14:27:43.784 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on legacy crush tunables = false 2024-03-09T14:27:43.784 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on crush straw calc version zero = false 2024-03-09T14:27:43.784 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on no sortbitwise = false 2024-03-09T14:27:43.784 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on osd down out interval zero = false 2024-03-09T14:27:43.784 INFO:teuthology.orchestra.run.smithi099.stdout: mon warn on too few osds = false 2024-03-09T14:27:43.784 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-09T14:27:43.784 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-09T14:27:43.784 INFO:teuthology.orchestra.run.smithi099.stdout: mon_allow_pool_size_one = true 2024-03-09T14:27:43.784 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.784 INFO:teuthology.orchestra.run.smithi099.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-09T14:27:43.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.785 INFO:teuthology.orchestra.run.smithi099.stdout: osd default data pool replay window = 5 2024-03-09T14:27:43.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.785 INFO:teuthology.orchestra.run.smithi099.stdout: mon allow pool delete = true 2024-03-09T14:27:43.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.785 INFO:teuthology.orchestra.run.smithi099.stdout: mon cluster log file level = debug 2024-03-09T14:27:43.785 INFO:teuthology.orchestra.run.smithi099.stdout: debug asserts on shutdown = true 2024-03-09T14:27:43.785 INFO:teuthology.orchestra.run.smithi099.stdout: mon health detail to clog = false 2024-03-09T14:27:43.785 INFO:teuthology.orchestra.run.smithi099.stdout: mon host = "172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790],172.21.15.179" 2024-03-09T14:27:43.785 INFO:teuthology.orchestra.run.smithi099.stdout: mon client directed command retry = 5 2024-03-09T14:27:43.785 INFO:teuthology.orchestra.run.smithi099.stdout: ms inject socket failures = 5000 2024-03-09T14:27:43.785 INFO:teuthology.orchestra.run.smithi099.stdout: osd_max_pg_log_entries = 10 2024-03-09T14:27:43.785 INFO:teuthology.orchestra.run.smithi099.stdout: osd_min_pg_log_entries = 10 2024-03-09T14:27:43.785 INFO:teuthology.orchestra.run.smithi099.stdout: fsid = c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:27:43.785 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.786 INFO:teuthology.orchestra.run.smithi099.stdout:[osd] 2024-03-09T14:27:43.786 INFO:teuthology.orchestra.run.smithi099.stdout: osd journal size = 100 2024-03-09T14:27:43.786 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.786 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub load threshold = 5.0 2024-03-09T14:27:43.786 INFO:teuthology.orchestra.run.smithi099.stdout: osd scrub max interval = 600 2024-03-09T14:27:43.786 INFO:teuthology.orchestra.run.smithi099.stdout: osd mclock profile = high_recovery_ops 2024-03-09T14:27:43.786 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.786 INFO:teuthology.orchestra.run.smithi099.stdout: osd recover clone overlap = true 2024-03-09T14:27:43.786 INFO:teuthology.orchestra.run.smithi099.stdout: osd recovery max chunk = 1048576 2024-03-09T14:27:43.786 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.786 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug shutdown = true 2024-03-09T14:27:43.786 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug op order = true 2024-03-09T14:27:43.786 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug verify stray on activate = true 2024-03-09T14:27:43.786 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug trim objects = true 2024-03-09T14:27:43.787 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.787 INFO:teuthology.orchestra.run.smithi099.stdout: osd open classes on start = true 2024-03-09T14:27:43.787 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug pg log writeout = true 2024-03-09T14:27:43.787 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.787 INFO:teuthology.orchestra.run.smithi099.stdout: osd deep scrub update digest min age = 30 2024-03-09T14:27:43.787 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.787 INFO:teuthology.orchestra.run.smithi099.stdout: osd map max advance = 10 2024-03-09T14:27:43.787 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.787 INFO:teuthology.orchestra.run.smithi099.stdout: journal zero on create = true 2024-03-09T14:27:43.787 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.787 INFO:teuthology.orchestra.run.smithi099.stdout: filestore ondisk finisher threads = 3 2024-03-09T14:27:43.787 INFO:teuthology.orchestra.run.smithi099.stdout: filestore apply finisher threads = 3 2024-03-09T14:27:43.787 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.787 INFO:teuthology.orchestra.run.smithi099.stdout: bdev debug aio = true 2024-03-09T14:27:43.787 INFO:teuthology.orchestra.run.smithi099.stdout: osd debug misdirected ops = true 2024-03-09T14:27:43.787 INFO:teuthology.orchestra.run.smithi099.stdout: bdev async discard = True 2024-03-09T14:27:43.788 INFO:teuthology.orchestra.run.smithi099.stdout: bdev enable discard = True 2024-03-09T14:27:43.788 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore allocator = bitmap 2024-03-09T14:27:43.788 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore block size = 96636764160 2024-03-09T14:27:43.788 INFO:teuthology.orchestra.run.smithi099.stdout: bluestore fsck on mount = True 2024-03-09T14:27:43.788 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluefs = 1/20 2024-03-09T14:27:43.788 INFO:teuthology.orchestra.run.smithi099.stdout: debug bluestore = 1/20 2024-03-09T14:27:43.788 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-03-09T14:27:43.788 INFO:teuthology.orchestra.run.smithi099.stdout: debug osd = 20 2024-03-09T14:27:43.788 INFO:teuthology.orchestra.run.smithi099.stdout: debug rocksdb = 4/10 2024-03-09T14:27:43.788 INFO:teuthology.orchestra.run.smithi099.stdout: lockdep = True 2024-03-09T14:27:43.788 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd backfillfull_ratio = 0.85 2024-03-09T14:27:43.788 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd full ratio = 0.9 2024-03-09T14:27:43.788 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd nearfull ratio = 0.8 2024-03-09T14:27:43.788 INFO:teuthology.orchestra.run.smithi099.stdout: osd failsafe full ratio = 0.95 2024-03-09T14:27:43.789 INFO:teuthology.orchestra.run.smithi099.stdout: osd objectstore = bluestore 2024-03-09T14:27:43.789 INFO:teuthology.orchestra.run.smithi099.stdout: osd shutdown pgref assert = True 2024-03-09T14:27:43.789 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.789 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr] 2024-03-09T14:27:43.789 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-03-09T14:27:43.789 INFO:teuthology.orchestra.run.smithi099.stdout: debug mgr = 20 2024-03-09T14:27:43.789 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-03-09T14:27:43.789 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-03-09T14:27:43.789 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-03-09T14:27:43.789 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-03-09T14:27:43.789 INFO:teuthology.orchestra.run.smithi099.stdout: mgr/telemetry/nag = false 2024-03-09T14:27:43.789 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.789 INFO:teuthology.orchestra.run.smithi099.stdout:[mon] 2024-03-09T14:27:43.789 INFO:teuthology.orchestra.run.smithi099.stdout: debug ms = 1 2024-03-09T14:27:43.789 INFO:teuthology.orchestra.run.smithi099.stdout: debug mon = 20 2024-03-09T14:27:43.790 INFO:teuthology.orchestra.run.smithi099.stdout: debug paxos = 20 2024-03-09T14:27:43.790 INFO:teuthology.orchestra.run.smithi099.stdout: debug auth = 20 2024-03-09T14:27:43.790 INFO:teuthology.orchestra.run.smithi099.stdout: mon data avail warn = 5 2024-03-09T14:27:43.790 INFO:teuthology.orchestra.run.smithi099.stdout: mon mgr mkfs grace = 240 2024-03-09T14:27:43.790 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min pgs per osd = 4 2024-03-09T14:27:43.790 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd reporter subtree level = osd 2024-03-09T14:27:43.790 INFO:teuthology.orchestra.run.smithi099.stdout: mon osd prime pg temp = true 2024-03-09T14:27:43.790 INFO:teuthology.orchestra.run.smithi099.stdout: mon reweight min bytes per osd = 10 2024-03-09T14:27:43.790 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.790 INFO:teuthology.orchestra.run.smithi099.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-09T14:27:43.790 INFO:teuthology.orchestra.run.smithi099.stdout: auth mon ticket ttl = 660 # 11m 2024-03-09T14:27:43.790 INFO:teuthology.orchestra.run.smithi099.stdout: auth service ticket ttl = 240 # 4m 2024-03-09T14:27:43.790 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.790 INFO:teuthology.orchestra.run.smithi099.stdout: # don't complain about insecure global_id in the test suite 2024-03-09T14:27:43.791 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-09T14:27:43.791 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-09T14:27:43.791 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.791 INFO:teuthology.orchestra.run.smithi099.stdout: # 1m isn't quite enough 2024-03-09T14:27:43.791 INFO:teuthology.orchestra.run.smithi099.stdout: mon_down_mkfs_grace = 2m 2024-03-09T14:27:43.791 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.791 INFO:teuthology.orchestra.run.smithi099.stdout: mon_warn_on_filestore_osds = false 2024-03-09T14:27:43.791 INFO:teuthology.orchestra.run.smithi099.stdout: lockdep = True 2024-03-09T14:27:43.791 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:27:43.791 INFO:teuthology.orchestra.run.smithi099.stdout:[client] 2024-03-09T14:27:43.791 INFO:teuthology.orchestra.run.smithi099.stdout: rgw cache enabled = true 2024-03-09T14:27:43.791 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable ops log = True 2024-03-09T14:27:43.791 INFO:teuthology.orchestra.run.smithi099.stdout: rgw enable usage log = true 2024-03-09T14:27:43.791 INFO:teuthology.orchestra.run.smithi099.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-09T14:27:43.791 INFO:teuthology.orchestra.run.smithi099.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-09T14:27:43.792 INFO:teuthology.orchestra.run.smithi099.stdout: debug rgw = 20 2024-03-09T14:27:43.792 INFO:teuthology.orchestra.run.smithi099.stdout: rgw bucket counters cache = True 2024-03-09T14:27:43.792 INFO:teuthology.orchestra.run.smithi099.stdout: rgw crypt require ssl = False 2024-03-09T14:27:43.792 INFO:teuthology.orchestra.run.smithi099.stdout: rgw crypt s3 kms backend = testing 2024-03-09T14:27:43.792 INFO:teuthology.orchestra.run.smithi099.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-03-09T14:27:43.792 INFO:teuthology.orchestra.run.smithi099.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-03-09T14:27:43.792 INFO:teuthology.orchestra.run.smithi099.stdout: rgw d3n l1 datacache size = 10737418240 2024-03-09T14:27:43.792 INFO:teuthology.orchestra.run.smithi099.stdout: rgw d3n l1 local datacache enabled = True 2024-03-09T14:27:43.792 INFO:teuthology.orchestra.run.smithi099.stdout: rgw max chunk size = 4194304 2024-03-09T14:27:43.792 INFO:teuthology.orchestra.run.smithi099.stdout: rgw obj stripe size = 6291456 2024-03-09T14:27:43.792 INFO:teuthology.orchestra.run.smithi099.stdout: rgw s3 auth use sts = True 2024-03-09T14:27:43.792 INFO:teuthology.orchestra.run.smithi099.stdout: rgw sts key = abcdefghijklmnop 2024-03-09T14:27:43.792 INFO:teuthology.orchestra.run.smithi099.stdout: rgw torrent flag = True 2024-03-09T14:27:43.792 INFO:teuthology.orchestra.run.smithi099.stdout: rgw user counters cache = True 2024-03-09T14:27:43.792 INFO:teuthology.orchestra.run.smithi099.stdout: setgroup = ceph 2024-03-09T14:27:43.792 INFO:teuthology.orchestra.run.smithi099.stdout: setuser = ceph 2024-03-09T14:27:43.792 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.a] 2024-03-09T14:27:43.793 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.c] 2024-03-09T14:27:43.793 INFO:teuthology.orchestra.run.smithi099.stdout:[mon.b] 2024-03-09T14:27:43.794 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-03-09T14:27:43.794 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-03-09T14:27:43.794 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-09T14:27:43.794 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-03-09T14:27:43.794 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.794 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-03-09T14:27:43.794 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.794 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-03-09T14:27:43.794 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.794 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-03-09T14:27:43.795 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-03-09T14:27:43.795 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.795 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-03-09T14:27:43.795 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-03-09T14:27:43.795 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.795 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-09T14:27:43.795 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-03-09T14:27:43.795 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.795 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-03-09T14:27:43.795 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-09T14:27:43.795 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.795 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-03-09T14:27:43.795 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.795 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-03-09T14:27:43.795 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-03-09T14:27:43.796 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-03-09T14:27:43.796 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-03-09T14:27:43.796 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-03-09T14:27:43.796 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-03-09T14:27:43.796 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-03-09T14:27:43.796 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-09T14:27:43.796 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-09T14:27:43.796 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-03-09T14:27:43.796 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.796 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-09T14:27:43.796 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.796 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-03-09T14:27:43.796 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.796 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-03-09T14:27:43.796 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.796 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-03-09T14:27:43.797 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-03-09T14:27:43.797 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-03-09T14:27:43.797 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.99,[v2:172.21.15.99:3301,v1:172.21.15.99:6790],172.21.15.179" 2024-03-09T14:27:43.797 INFO:teuthology.orchestra.run.smithi179.stdout: mon client directed command retry = 5 2024-03-09T14:27:43.797 INFO:teuthology.orchestra.run.smithi179.stdout: ms inject socket failures = 5000 2024-03-09T14:27:43.797 INFO:teuthology.orchestra.run.smithi179.stdout: osd_max_pg_log_entries = 10 2024-03-09T14:27:43.797 INFO:teuthology.orchestra.run.smithi179.stdout: osd_min_pg_log_entries = 10 2024-03-09T14:27:43.797 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:27:43.797 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.797 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-03-09T14:27:43.797 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-03-09T14:27:43.797 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.797 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-03-09T14:27:43.797 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-03-09T14:27:43.797 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-03-09T14:27:43.797 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.798 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-03-09T14:27:43.798 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-03-09T14:27:43.798 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.798 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-03-09T14:27:43.798 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-03-09T14:27:43.798 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-03-09T14:27:43.798 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug trim objects = true 2024-03-09T14:27:43.798 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.798 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-03-09T14:27:43.798 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-03-09T14:27:43.798 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.798 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-03-09T14:27:43.798 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.798 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-03-09T14:27:43.799 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.799 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-03-09T14:27:43.799 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.799 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-03-09T14:27:43.799 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-03-09T14:27:43.799 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.799 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-03-09T14:27:43.799 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-03-09T14:27:43.799 INFO:teuthology.orchestra.run.smithi179.stdout: bdev async discard = True 2024-03-09T14:27:43.799 INFO:teuthology.orchestra.run.smithi179.stdout: bdev enable discard = True 2024-03-09T14:27:43.799 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore allocator = bitmap 2024-03-09T14:27:43.799 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-03-09T14:27:43.799 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-03-09T14:27:43.799 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 1/20 2024-03-09T14:27:43.799 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 1/20 2024-03-09T14:27:43.799 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-03-09T14:27:43.800 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-03-09T14:27:43.800 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 4/10 2024-03-09T14:27:43.800 INFO:teuthology.orchestra.run.smithi179.stdout: lockdep = True 2024-03-09T14:27:43.800 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-03-09T14:27:43.800 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-03-09T14:27:43.800 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-03-09T14:27:43.800 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-03-09T14:27:43.800 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-03-09T14:27:43.800 INFO:teuthology.orchestra.run.smithi179.stdout: osd shutdown pgref assert = True 2024-03-09T14:27:43.800 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.800 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-03-09T14:27:43.800 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-03-09T14:27:43.800 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-03-09T14:27:43.800 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-03-09T14:27:43.800 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-03-09T14:27:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-03-09T14:27:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-03-09T14:27:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-03-09T14:27:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.801 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-03-09T14:27:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-03-09T14:27:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-03-09T14:27:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-03-09T14:27:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-03-09T14:27:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-03-09T14:27:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-03-09T14:27:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-03-09T14:27:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-03-09T14:27:43.801 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-03-09T14:27:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-03-09T14:27:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-09T14:27:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-03-09T14:27:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-03-09T14:27:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-03-09T14:27:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-09T14:27:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-09T14:27:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-03-09T14:27:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-03-09T14:27:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.802 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-03-09T14:27:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: lockdep = True 2024-03-09T14:27:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-03-09T14:27:43.803 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-03-09T14:27:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-03-09T14:27:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = True 2024-03-09T14:27:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-03-09T14:27:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-09T14:27:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-09T14:27:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: debug rgw = 20 2024-03-09T14:27:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: rgw bucket counters cache = True 2024-03-09T14:27:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: rgw crypt require ssl = False 2024-03-09T14:27:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: rgw crypt s3 kms backend = testing 2024-03-09T14:27:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-03-09T14:27:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: rgw d3n l1 datacache persistent path = /tmp/rgw_datacache/ 2024-03-09T14:27:43.803 INFO:teuthology.orchestra.run.smithi179.stdout: rgw d3n l1 datacache size = 10737418240 2024-03-09T14:27:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: rgw d3n l1 local datacache enabled = True 2024-03-09T14:27:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: rgw max chunk size = 4194304 2024-03-09T14:27:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: rgw obj stripe size = 6291456 2024-03-09T14:27:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: rgw s3 auth use sts = True 2024-03-09T14:27:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: rgw sts key = abcdefghijklmnop 2024-03-09T14:27:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: rgw torrent flag = True 2024-03-09T14:27:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: rgw user counters cache = True 2024-03-09T14:27:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: setgroup = ceph 2024-03-09T14:27:43.804 INFO:teuthology.orchestra.run.smithi179.stdout: setuser = ceph 2024-03-09T14:27:43.804 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-03-09T14:27:43.804 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-03-09T14:27:43.804 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-03-09T14:27:43.804 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-09T14:27:43.805 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-09T14:27:43.879 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-09T14:27:43.879 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:27:43.880 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-09T14:27:43.925 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:27:43.925 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-09T14:27:43.973 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi099.front.sepia.ceph.com 2024-03-09T14:27:43.973 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:27:43.973 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-09T14:27:43.973 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-09T14:27:44.038 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:27:44.038 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:27:44.085 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi179.front.sepia.ceph.com 2024-03-09T14:27:44.085 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:27:44.085 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-09T14:27:44.085 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-09T14:27:44.108 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:27:44.108 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:27:44.155 INFO:tasks.ceph:Setting up mon nodes... 2024-03-09T14:27:44.155 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-09T14:27:44.155 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-09T14:27:44.197 INFO:teuthology.orchestra.run.smithi099.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-09T14:27:44.200 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-09T14:27:44.243 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-09T14:27:44.260 INFO:tasks.ceph:Setting up mds nodes... 2024-03-09T14:27:44.260 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-09T14:27:44.260 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-09T14:27:44.297 INFO:teuthology.orchestra.run.smithi099.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-09T14:27:44.308 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-09T14:27:44.347 INFO:teuthology.orchestra.run.smithi179.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-09T14:27:44.357 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-09T14:27:44.357 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi099.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-09T14:27:44.357 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-09T14:27:44.370 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-09T14:27:44.370 INFO:tasks.ceph:role: osd.0 2024-03-09T14:27:44.370 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com 2024-03-09T14:27:44.370 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-09T14:27:44.432 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:27:44.432 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:27:44.432 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:27:44.432 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-09T14:27:44.432 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:27:44.432 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:27:44.432 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:27:44.432 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-09T14:27:44.433 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:27:44.433 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:27:44.885 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-03-09T14:27:44.887 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-03-09T14:27:44.887 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-09T14:27:44.983 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-09T14:27:44.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:27:44.992 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-03-09T14:27:44.993 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-09T14:27:45.046 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-09T14:27:45.046 INFO:tasks.ceph:role: osd.1 2024-03-09T14:27:45.046 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com 2024-03-09T14:27:45.046 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-09T14:27:45.108 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:27:45.109 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:27:45.109 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:27:45.109 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-09T14:27:45.109 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:27:45.109 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:27:45.109 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:27:45.109 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-09T14:27:45.109 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:27:45.109 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:27:45.571 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-03-09T14:27:45.573 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-03-09T14:27:45.573 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-09T14:27:45.702 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-09T14:27:45.713 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-03-09T14:27:45.713 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:27:45.714 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-09T14:27:45.768 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-09T14:27:45.768 INFO:tasks.ceph:role: osd.2 2024-03-09T14:27:45.768 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com 2024-03-09T14:27:45.768 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-09T14:27:45.831 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:27:45.831 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:27:45.832 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:27:45.832 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-09T14:27:45.832 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:27:45.832 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:27:45.832 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:27:45.832 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-09T14:27:45.832 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:27:45.832 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:27:46.328 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-03-09T14:27:46.330 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-03-09T14:27:46.330 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-09T14:27:46.468 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-09T14:27:46.479 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-03-09T14:27:46.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:27:46.480 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-09T14:27:46.536 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-09T14:27:46.536 INFO:tasks.ceph:role: osd.3 2024-03-09T14:27:46.536 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com 2024-03-09T14:27:46.537 DEBUG:teuthology.orchestra.run.smithi099:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-09T14:27:46.600 INFO:teuthology.orchestra.run.smithi099.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:27:46.600 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:27:46.600 INFO:teuthology.orchestra.run.smithi099.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:27:46.600 INFO:teuthology.orchestra.run.smithi099.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-09T14:27:46.601 INFO:teuthology.orchestra.run.smithi099.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:27:46.601 INFO:teuthology.orchestra.run.smithi099.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:27:46.601 INFO:teuthology.orchestra.run.smithi099.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:27:46.601 INFO:teuthology.orchestra.run.smithi099.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-09T14:27:46.601 INFO:teuthology.orchestra.run.smithi099.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:27:46.601 INFO:teuthology.orchestra.run.smithi099.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:27:47.027 INFO:teuthology.orchestra.run.smithi099.stdout:Discarding blocks...Done. 2024-03-09T14:27:47.029 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi099.front.sepia.ceph.com -o noatime 2024-03-09T14:27:47.029 DEBUG:teuthology.orchestra.run.smithi099:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-09T14:27:47.128 DEBUG:teuthology.orchestra.run.smithi099:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-09T14:27:47.139 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:27:47.140 INFO:teuthology.orchestra.run.smithi099.stderr:sudo: /sbin/restorecon: command not found 2024-03-09T14:27:47.140 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:27:47.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:47.253+0000 7f42782ac7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-09T14:27:47.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:47.257+0000 7f42782ac7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-09T14:27:47.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:47.257+0000 7f42782ac7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-09T14:27:47.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:47.257+0000 7f42782ac7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-09T14:27:47.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:47.257+0000 7f42782ac7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-09T14:27:47.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:47.257+0000 7f42782ac7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-09T14:27:50.233 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-09T14:27:50.248 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:27:50.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:50.333+0000 7f9c3f62f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-09T14:27:50.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:50.333+0000 7f9c3f62f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-09T14:27:50.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:50.333+0000 7f9c3f62f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-09T14:27:50.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:50.333+0000 7f9c3f62f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-09T14:27:50.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:50.333+0000 7f9c3f62f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-09T14:27:50.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:50.333+0000 7f9c3f62f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-09T14:27:53.328 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-09T14:27:53.386 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:27:53.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:53.465+0000 7fd03c76a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-09T14:27:53.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:53.465+0000 7fd03c76a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-09T14:27:53.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:53.465+0000 7fd03c76a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-09T14:27:53.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:53.465+0000 7fd03c76a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-09T14:27:53.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:53.465+0000 7fd03c76a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-09T14:27:53.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:53.465+0000 7fd03c76a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-09T14:27:56.445 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-09T14:27:56.501 DEBUG:teuthology.orchestra.run.smithi099:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:27:56.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:56.585+0000 7f911c1637c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-09T14:27:56.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:56.585+0000 7f911c1637c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-09T14:27:56.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:56.585+0000 7f911c1637c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-09T14:27:56.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:56.585+0000 7f911c1637c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-09T14:27:56.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:56.585+0000 7f911c1637c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-09T14:27:56.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:27:56.585+0000 7f911c1637c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-09T14:27:59.560 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-09T14:27:59.616 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-09T14:27:59.631 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-09T14:27:59.631 INFO:tasks.ceph:role: osd.4 2024-03-09T14:27:59.631 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com 2024-03-09T14:27:59.631 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-09T14:27:59.694 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:27:59.694 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:27:59.694 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:27:59.694 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-09T14:27:59.695 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:27:59.695 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:27:59.695 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:27:59.695 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-09T14:27:59.695 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:27:59.695 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:28:00.175 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-03-09T14:28:00.177 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-03-09T14:28:00.177 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-09T14:28:00.321 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-09T14:28:00.331 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: /sbin/restorecon: command not found 2024-03-09T14:28:00.331 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:28:00.332 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-09T14:28:00.385 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-09T14:28:00.385 INFO:tasks.ceph:role: osd.5 2024-03-09T14:28:00.385 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com 2024-03-09T14:28:00.385 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-09T14:28:00.447 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:28:00.447 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:28:00.447 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:28:00.447 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-09T14:28:00.447 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:28:00.447 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:28:00.448 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:28:00.448 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-09T14:28:00.448 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:28:00.448 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:28:00.898 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-03-09T14:28:00.900 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-03-09T14:28:00.900 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-09T14:28:00.983 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-09T14:28:01.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:28:01.036 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: /sbin/restorecon: command not found 2024-03-09T14:28:01.036 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-09T14:28:01.088 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-09T14:28:01.088 INFO:tasks.ceph:role: osd.6 2024-03-09T14:28:01.089 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com 2024-03-09T14:28:01.089 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-09T14:28:01.150 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:28:01.150 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:28:01.150 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:28:01.150 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-09T14:28:01.150 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:28:01.150 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:28:01.150 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:28:01.150 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-09T14:28:01.150 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:28:01.151 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:28:01.606 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-03-09T14:28:01.610 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-03-09T14:28:01.611 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-09T14:28:01.744 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-09T14:28:01.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:28:01.756 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: /sbin/restorecon: command not found 2024-03-09T14:28:01.757 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-09T14:28:01.810 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-09T14:28:01.811 INFO:tasks.ceph:role: osd.7 2024-03-09T14:28:01.811 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com 2024-03-09T14:28:01.811 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-09T14:28:01.875 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-09T14:28:01.876 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-09T14:28:01.876 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-09T14:28:01.876 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-03-09T14:28:01.876 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-09T14:28:01.876 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-03-09T14:28:01.876 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-09T14:28:01.876 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-03-09T14:28:01.876 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-09T14:28:01.876 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-09T14:28:02.365 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-03-09T14:28:02.367 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-03-09T14:28:02.367 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-09T14:28:02.515 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-09T14:28:02.526 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:28:02.527 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: /sbin/restorecon: command not found 2024-03-09T14:28:02.527 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:28:02.662 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:02.661+0000 7f5d5ecf57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-09T14:28:02.665 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:02.661+0000 7f5d5ecf57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-09T14:28:02.665 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:02.661+0000 7f5d5ecf57c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-09T14:28:02.665 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:02.661+0000 7f5d5ecf57c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-09T14:28:02.665 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:02.661+0000 7f5d5ecf57c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-09T14:28:02.665 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:02.661+0000 7f5d5ecf57c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-09T14:28:05.653 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-09T14:28:05.666 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:28:05.747 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:05.745+0000 7f8de2adc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-09T14:28:05.749 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:05.745+0000 7f8de2adc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-09T14:28:05.749 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:05.745+0000 7f8de2adc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-09T14:28:05.749 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:05.745+0000 7f8de2adc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-09T14:28:05.749 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:05.745+0000 7f8de2adc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-09T14:28:05.749 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:05.745+0000 7f8de2adc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-09T14:28:08.716 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-09T14:28:08.772 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:28:08.853 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:08.849+0000 7f00883977c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-09T14:28:08.854 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:08.849+0000 7f00883977c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-09T14:28:08.854 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:08.849+0000 7f00883977c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-09T14:28:08.854 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:08.849+0000 7f00883977c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-09T14:28:08.854 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:08.849+0000 7f00883977c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-09T14:28:08.854 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:08.849+0000 7f00883977c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-09T14:28:11.837 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-09T14:28:11.892 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:28:11.972 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:11.969+0000 7fcde43c47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-09T14:28:11.973 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:11.969+0000 7fcde43c47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-09T14:28:11.973 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:11.969+0000 7fcde43c47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-09T14:28:11.973 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:11.969+0000 7fcde43c47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-09T14:28:11.973 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:11.969+0000 7fcde43c47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-09T14:28:11.973 INFO:teuthology.orchestra.run.smithi179.stderr:2024-03-09T14:28:11.969+0000 7fcde43c47c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-09T14:28:14.961 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-09T14:28:15.015 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-09T14:28:15.015 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:28:15.015 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-09T14:28:15.029 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:28:15.029 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-09T14:28:15.084 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:28:15.084 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-09T14:28:15.143 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:28:15.143 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-09T14:28:15.195 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:28:15.195 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-09T14:28:15.248 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:28:15.248 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-09T14:28:15.261 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:28:15.262 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-09T14:28:15.314 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:28:15.314 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-09T14:28:15.370 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:28:15.370 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-09T14:28:15.425 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:28:15.426 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-09T14:28:15.478 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:28:15.478 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-09T14:28:15.484 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:28:15.484 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-09T14:28:15.527 INFO:tasks.ceph:Adding keys to all mons... 2024-03-09T14:28:15.527 DEBUG:teuthology.orchestra.run.smithi099:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-09T14:28:15.529 DEBUG:teuthology.orchestra.run.smithi179:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-09T14:28:15.572 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.y] 2024-03-09T14:28:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDgcexlmkrsCxAAtmoAZpWDDwGLR/0+KKHvSw== 2024-03-09T14:28:15.573 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.0] 2024-03-09T14:28:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDjcexlhPdlDxAASXkE93gAiICo7ZN2UytxwQ== 2024-03-09T14:28:15.573 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.1] 2024-03-09T14:28:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDmcexlgVEJFBAAJ5wU/1K4evAyHOvRDEUpJw== 2024-03-09T14:28:15.573 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.2] 2024-03-09T14:28:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDpcexlowz5GxAAE5UYOEvlI/3tkgeh/bVJeA== 2024-03-09T14:28:15.573 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.3] 2024-03-09T14:28:15.573 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDscexlrRAVIxAAFmydrPVj1k/w8Um2AQxz2A== 2024-03-09T14:28:15.573 INFO:teuthology.orchestra.run.smithi099.stdout:[mgr.x] 2024-03-09T14:28:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDgcexlVgeeDhAAvkNHyYct6jH/BVdYmkY4kQ== 2024-03-09T14:28:15.574 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.4] 2024-03-09T14:28:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDycexlBCimJxAAjHEeu9qrfFV0dP28hl20SA== 2024-03-09T14:28:15.574 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.5] 2024-03-09T14:28:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQD1cexlqxK8LBAAicKLSTkD75IOSOp4uUc+aw== 2024-03-09T14:28:15.574 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.6] 2024-03-09T14:28:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQD4cexlrjQBMxAAoycgmQF45C0Sn238G6H6Pg== 2024-03-09T14:28:15.574 INFO:teuthology.orchestra.run.smithi099.stdout:[osd.7] 2024-03-09T14:28:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQD7cexlwMcdOhAAU2UxETcuqGZgZtZIFX0U4g== 2024-03-09T14:28:15.574 INFO:teuthology.orchestra.run.smithi099.stdout:[client.0] 2024-03-09T14:28:15.574 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDgcexlpYPaERAA3GxsIIgOvSL0EQVancRg5g== 2024-03-09T14:28:15.574 INFO:teuthology.orchestra.run.smithi099.stdout:[client.1] 2024-03-09T14:28:15.575 INFO:teuthology.orchestra.run.smithi099.stdout: key = AQDgcexl9IHTFBAATWtbCPmhdFxz0ZhOLyLmVg== 2024-03-09T14:28:15.580 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.y] 2024-03-09T14:28:15.580 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDgcexlmkrsCxAAtmoAZpWDDwGLR/0+KKHvSw== 2024-03-09T14:28:15.580 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.0] 2024-03-09T14:28:15.581 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDjcexlhPdlDxAASXkE93gAiICo7ZN2UytxwQ== 2024-03-09T14:28:15.581 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.1] 2024-03-09T14:28:15.581 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDmcexlgVEJFBAAJ5wU/1K4evAyHOvRDEUpJw== 2024-03-09T14:28:15.581 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.2] 2024-03-09T14:28:15.581 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDpcexlowz5GxAAE5UYOEvlI/3tkgeh/bVJeA== 2024-03-09T14:28:15.581 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.3] 2024-03-09T14:28:15.581 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDscexlrRAVIxAAFmydrPVj1k/w8Um2AQxz2A== 2024-03-09T14:28:15.581 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.x] 2024-03-09T14:28:15.581 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDgcexlVgeeDhAAvkNHyYct6jH/BVdYmkY4kQ== 2024-03-09T14:28:15.581 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.4] 2024-03-09T14:28:15.581 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDycexlBCimJxAAjHEeu9qrfFV0dP28hl20SA== 2024-03-09T14:28:15.582 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.5] 2024-03-09T14:28:15.582 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQD1cexlqxK8LBAAicKLSTkD75IOSOp4uUc+aw== 2024-03-09T14:28:15.582 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.6] 2024-03-09T14:28:15.582 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQD4cexlrjQBMxAAoycgmQF45C0Sn238G6H6Pg== 2024-03-09T14:28:15.582 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.7] 2024-03-09T14:28:15.582 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQD7cexlwMcdOhAAU2UxETcuqGZgZtZIFX0U4g== 2024-03-09T14:28:15.582 INFO:teuthology.orchestra.run.smithi179.stdout:[client.0] 2024-03-09T14:28:15.582 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDgcexlpYPaERAA3GxsIIgOvSL0EQVancRg5g== 2024-03-09T14:28:15.582 INFO:teuthology.orchestra.run.smithi179.stdout:[client.1] 2024-03-09T14:28:15.582 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQDgcexl9IHTFBAATWtbCPmhdFxz0ZhOLyLmVg== 2024-03-09T14:28:15.583 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-09T14:28:15.621 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-09T14:28:15.670 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:28:15.706 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:28:15.758 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:28:15.789 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:28:15.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:28:15.873 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:28:15.917 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:28:15.957 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:28:16.002 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-09T14:28:16.045 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-09T14:28:16.087 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:28:16.133 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:28:16.178 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:28:16.222 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:28:16.263 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:28:16.301 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:28:16.347 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:28:16.385 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-09T14:28:16.428 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-09T14:28:16.469 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-09T14:28:16.512 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-09T14:28:16.553 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-09T14:28:16.601 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-09T14:28:16.601 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-09T14:28:16.611 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-09T14:28:16.694 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-09T14:28:16.745 DEBUG:teuthology.orchestra.run.smithi099:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-09T14:28:16.797 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-09T14:28:16.884 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-09T14:28:16.938 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-09T14:28:16.952 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-09T14:28:17.049 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-09T14:28:17.060 DEBUG:teuthology.orchestra.run.smithi099:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:28:17.062 DEBUG:teuthology.orchestra.run.smithi179:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-09T14:28:17.106 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-09T14:28:17.106 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-09T14:28:17.106 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-09T14:28:17.109 INFO:tasks.ceph.mon.a:Started 2024-03-09T14:28:17.109 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-09T14:28:17.109 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-09T14:28:17.112 INFO:tasks.ceph.mon.c:Started 2024-03-09T14:28:17.112 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-09T14:28:17.112 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-09T14:28:17.152 INFO:tasks.ceph.mon.b:Started 2024-03-09T14:28:17.152 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-09T14:28:17.152 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-09T14:28:17.152 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-09T14:28:17.157 INFO:tasks.ceph.mgr.y:Started 2024-03-09T14:28:17.157 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-09T14:28:17.157 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-09T14:28:17.159 INFO:tasks.ceph.mgr.x:Started 2024-03-09T14:28:17.159 INFO:tasks.ceph:Setting crush tunables to default 2024-03-09T14:28:17.159 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd crush tunables default 2024-03-09T14:28:22.667 INFO:teuthology.orchestra.run.smithi099.stderr:adjusted tunables profile to default 2024-03-09T14:28:22.685 INFO:tasks.ceph:check_enable_crimson: False 2024-03-09T14:28:22.685 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-09T14:28:22.686 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:28:22.686 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-09T14:28:22.696 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:28:22.696 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-09T14:28:22.751 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:28:22.751 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-09T14:28:22.804 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:28:22.804 DEBUG:teuthology.orchestra.run.smithi099:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-09T14:28:22.859 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:28:22.859 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-09T14:28:22.874 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:28:22.874 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-09T14:28:22.934 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:28:22.934 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-09T14:28:22.990 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-03-09T14:28:22.990 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-09T14:28:23.046 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new f7049dc8-86cc-47e3-b16a-e3e9a620ee63 0 2024-03-09T14:28:23.090 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:23.089+0000 7f3c3f0bc180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-09T14:28:23.316 INFO:teuthology.orchestra.run.smithi179.stdout:0 2024-03-09T14:28:23.334 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 5877574c-62c9-4ee0-b9db-cd3995ca0a3c 1 2024-03-09T14:28:23.500 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:23.497+0000 7f3d1b988180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-09T14:28:23.548 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-03-09T14:28:23.562 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:23.561+0000 7f3c3f0bc180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-09T14:28:23.567 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 220962ad-f847-4fb0-9daf-76cf09ca5c7e 2 2024-03-09T14:28:23.756 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:23.757+0000 7f3c3f0bc180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-09T14:28:23.774 INFO:teuthology.orchestra.run.smithi179.stdout:2 2024-03-09T14:28:23.792 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 2a1e0d81-f422-4fa0-af27-6dbefd01b429 3 2024-03-09T14:28:23.998 INFO:teuthology.orchestra.run.smithi179.stdout:3 2024-03-09T14:28:24.016 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 42f23385-6032-4aaf-9d95-3eb6c59eb515 4 2024-03-09T14:28:24.017 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:24.013+0000 7f3d1b988180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-09T14:28:24.215 INFO:teuthology.orchestra.run.smithi179.stdout:4 2024-03-09T14:28:24.229 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:24.225+0000 7f3d1b988180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-09T14:28:24.232 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new e2ff7aea-ca15-4bf6-91df-cef1f6ddac9a 5 2024-03-09T14:28:24.296 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:24.297+0000 7f3c3f0bc180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-09T14:28:24.350 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:24.349+0000 7f3c3f0bc180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-09T14:28:24.402 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:24.401+0000 7f3c3f0bc180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-09T14:28:24.435 INFO:teuthology.orchestra.run.smithi179.stdout:5 2024-03-09T14:28:24.452 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new a58c2272-d8ee-49eb-b12e-d968c541b36e 6 2024-03-09T14:28:24.483 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:24.481+0000 7f3c3f0bc180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-09T14:28:24.534 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:24.533+0000 7f3c3f0bc180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-09T14:28:24.613 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:24.613+0000 7f3c3f0bc180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-09T14:28:24.644 INFO:teuthology.orchestra.run.smithi179.stdout:6 2024-03-09T14:28:24.660 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 8f499990-ff5b-4066-bda3-3eda76980f37 7 2024-03-09T14:28:24.668 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:24.669+0000 7f3c3f0bc180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-09T14:28:24.810 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:24.809+0000 7f3d1b988180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-09T14:28:24.815 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:24.813+0000 7f3c3f0bc180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-09T14:28:24.848 INFO:teuthology.orchestra.run.smithi179.stdout:7 2024-03-09T14:28:24.865 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-09T14:28:24.865 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-09T14:28:24.866 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:24.865+0000 7f3d1b988180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-09T14:28:24.867 INFO:tasks.ceph.osd.0:Started 2024-03-09T14:28:24.867 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-09T14:28:24.868 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-09T14:28:24.870 INFO:tasks.ceph.osd.1:Started 2024-03-09T14:28:24.870 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-09T14:28:24.870 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-09T14:28:24.872 INFO:tasks.ceph.osd.2:Started 2024-03-09T14:28:24.872 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-09T14:28:24.872 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-09T14:28:24.874 INFO:tasks.ceph.osd.3:Started 2024-03-09T14:28:24.875 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-09T14:28:24.875 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-09T14:28:24.876 INFO:tasks.ceph.osd.4:Started 2024-03-09T14:28:24.877 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-09T14:28:24.877 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-09T14:28:24.878 INFO:tasks.ceph.osd.5:Started 2024-03-09T14:28:24.881 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-09T14:28:24.881 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-09T14:28:24.882 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:24.881+0000 7f3c3f0bc180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-09T14:28:24.883 INFO:tasks.ceph.osd.6:Started 2024-03-09T14:28:24.883 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-09T14:28:24.883 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-09T14:28:24.885 INFO:tasks.ceph.osd.7:Started 2024-03-09T14:28:24.886 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-09T14:28:24.927 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:24.925+0000 7f3d1b988180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-09T14:28:25.010 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:25.009+0000 7f3d1b988180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-09T14:28:25.062 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:25.061+0000 7f3d1b988180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-09T14:28:25.076 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:28:25.076 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":10,"fsid":"c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e","created":"2024-03-09T14:28:22.555967+0000","modified":"2024-03-09T14:28:24.846197+0000","last_up_change":"0.000000","last_in_change":"2024-03-09T14:28:24.846197+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f7049dc8-86cc-47e3-b16a-e3e9a620ee63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5877574c-62c9-4ee0-b9db-cd3995ca0a3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"220962ad-f847-4fb0-9daf-76cf09ca5c7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2a1e0d81-f422-4fa0-af27-6dbefd01b429","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"42f23385-6032-4aaf-9d95-3eb6c59eb515","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e2ff7aea-ca15-4bf6-91df-cef1f6ddac9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a58c2272-d8ee-49eb-b12e-d968c541b36e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8f499990-ff5b-4066-bda3-3eda76980f37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T14:28:25.092 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-09T14:28:25.092 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-09T14:28:25.138 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:25.137+0000 7f3d1b988180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-09T14:28:25.191 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:25.189+0000 7f3d1b988180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-09T14:28:25.340 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:25.337+0000 7f3d1b988180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-09T14:28:25.401 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:25.397+0000 7f3d1b988180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-09T14:28:25.504 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-03-09T14:28:25.501+0000 7f50229567c0 -1 Falling back to public interface 2024-03-09T14:28:25.504 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-03-09T14:28:25.501+0000 7fdfcbb777c0 -1 Falling back to public interface 2024-03-09T14:28:25.504 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-03-09T14:28:25.501+0000 7f86af58d7c0 -1 Falling back to public interface 2024-03-09T14:28:25.513 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-03-09T14:28:25.513+0000 7f9989e347c0 -1 Falling back to public interface 2024-03-09T14:28:25.520 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-03-09T14:28:25.521+0000 7f1f0fa7d7c0 -1 Falling back to public interface 2024-03-09T14:28:25.525 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-03-09T14:28:25.525+0000 7f8358f627c0 -1 Falling back to public interface 2024-03-09T14:28:25.531 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-03-09T14:28:25.529+0000 7f807917f7c0 -1 Falling back to public interface 2024-03-09T14:28:25.532 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-03-09T14:28:25.533+0000 7f35a26397c0 -1 Falling back to public interface 2024-03-09T14:28:25.538 INFO:tasks.ceph.mgr.y.smithi099.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-03-09T14:28:25.538 INFO:tasks.ceph.mgr.y.smithi099.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-03-09T14:28:25.538 INFO:tasks.ceph.mgr.y.smithi099.stderr: from numpy import show_config as show_numpy_config 2024-03-09T14:28:25.578 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:25.577+0000 7f3c3f0bc180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-09T14:28:25.720 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:25.721+0000 7f3c3f0bc180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-09T14:28:25.888 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:25.889+0000 7f3c3f0bc180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-09T14:28:25.899 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-09T14:28:25.952 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:25.953+0000 7f3c3f0bc180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-09T14:28:26.039 INFO:tasks.ceph.mgr.x.smithi179.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-03-09T14:28:26.039 INFO:tasks.ceph.mgr.x.smithi179.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-03-09T14:28:26.039 INFO:tasks.ceph.mgr.x.smithi179.stderr: from numpy import show_config as show_numpy_config 2024-03-09T14:28:26.113 INFO:teuthology.misc.health.smithi099.stdout: 2024-03-09T14:28:26.113 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":10,"fsid":"c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e","created":"2024-03-09T14:28:22.555967+0000","modified":"2024-03-09T14:28:24.846197+0000","last_up_change":"0.000000","last_in_change":"2024-03-09T14:28:24.846197+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f7049dc8-86cc-47e3-b16a-e3e9a620ee63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5877574c-62c9-4ee0-b9db-cd3995ca0a3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"220962ad-f847-4fb0-9daf-76cf09ca5c7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2a1e0d81-f422-4fa0-af27-6dbefd01b429","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"42f23385-6032-4aaf-9d95-3eb6c59eb515","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e2ff7aea-ca15-4bf6-91df-cef1f6ddac9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a58c2272-d8ee-49eb-b12e-d968c541b36e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8f499990-ff5b-4066-bda3-3eda76980f37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T14:28:26.114 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:26.113+0000 7f3d1b988180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-09T14:28:26.123 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:26.121+0000 7f3c3f0bc180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-09T14:28:26.128 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-09T14:28:26.296 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:26.293+0000 7f3d1b988180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-09T14:28:26.460 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:26.457+0000 7f3d1b988180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-09T14:28:26.529 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:26.525+0000 7f3d1b988180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-09T14:28:26.667 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:26.665+0000 7f3d1b988180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-09T14:28:26.727 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:26.725+0000 7f3c3f0bc180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-09T14:28:26.802 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:26.801+0000 7f3c3f0bc180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-09T14:28:26.981 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:26.981+0000 7f3c3f0bc180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-09T14:28:27.054 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:27.053+0000 7f3c3f0bc180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-09T14:28:27.278 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:27.273+0000 7f3d1b988180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-09T14:28:27.342 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:27.341+0000 7f3c3f0bc180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-09T14:28:27.353 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:27.349+0000 7f3d1b988180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-09T14:28:27.403 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:27.401+0000 7f3c3f0bc180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-09T14:28:27.539 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:27.537+0000 7f3d1b988180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-09T14:28:27.614 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:27.613+0000 7f3d1b988180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-09T14:28:27.903 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:27.901+0000 7f3d1b988180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-09T14:28:27.965 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-03-09T14:28:27.961+0000 7f3d1b988180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-09T14:28:28.449 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:28.449+0000 7f3be6609640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-09T14:28:28.449 INFO:tasks.ceph.mgr.y.smithi099.stderr:2024-03-09T14:28:28.449+0000 7f3be6609640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-09T14:28:29.300 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-03-09T14:28:29.301+0000 7f35a26397c0 -1 osd.2 0 log_to_monitors true 2024-03-09T14:28:29.312 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-03-09T14:28:29.309+0000 7f86af58d7c0 -1 osd.6 0 log_to_monitors true 2024-03-09T14:28:29.407 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-03-09T14:28:29.405+0000 7f807917f7c0 -1 osd.7 0 log_to_monitors true 2024-03-09T14:28:29.416 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-03-09T14:28:29.417+0000 7f8358f627c0 -1 osd.0 0 log_to_monitors true 2024-03-09T14:28:29.441 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-03-09T14:28:29.441+0000 7f9989e347c0 -1 osd.3 0 log_to_monitors true 2024-03-09T14:28:29.445 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-03-09T14:28:29.445+0000 7f1f0fa7d7c0 -1 osd.1 0 log_to_monitors true 2024-03-09T14:28:29.484 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-03-09T14:28:29.481+0000 7fdfcbb777c0 -1 osd.5 0 log_to_monitors true 2024-03-09T14:28:29.515 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-03-09T14:28:29.513+0000 7f50229567c0 -1 osd.4 0 log_to_monitors true 2024-03-09T14:28:32.661 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-03-09T14:28:32.661+0000 7f1f0b203640 -1 osd.1 0 waiting for initial osdmap 2024-03-09T14:28:32.680 INFO:tasks.ceph.osd.1.smithi099.stderr:2024-03-09T14:28:32.681+0000 7f1f0384a640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:28:32.687 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-03-09T14:28:32.685+0000 7f359f5f5640 -1 osd.2 0 waiting for initial osdmap 2024-03-09T14:28:32.737 INFO:tasks.ceph.osd.2.smithi099.stderr:2024-03-09T14:28:32.737+0000 7f3596406640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:28:32.744 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-03-09T14:28:32.745+0000 7f83546e8640 -1 osd.0 0 waiting for initial osdmap 2024-03-09T14:28:32.765 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-03-09T14:28:32.761+0000 7f8074905640 -1 osd.7 0 waiting for initial osdmap 2024-03-09T14:28:32.770 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-03-09T14:28:32.765+0000 7fdfc72fd640 -1 osd.5 0 waiting for initial osdmap 2024-03-09T14:28:32.772 INFO:tasks.ceph.osd.0.smithi099.stderr:2024-03-09T14:28:32.773+0000 7f834cd2f640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:28:32.776 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-03-09T14:28:32.773+0000 7f86aad13640 -1 osd.6 0 waiting for initial osdmap 2024-03-09T14:28:32.780 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-03-09T14:28:32.781+0000 7f99855ba640 -1 osd.3 0 waiting for initial osdmap 2024-03-09T14:28:32.799 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-03-09T14:28:32.797+0000 7f806cf4c640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:28:32.806 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-03-09T14:28:32.805+0000 7fdfbf944640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:28:32.809 INFO:tasks.ceph.osd.3.smithi099.stderr:2024-03-09T14:28:32.809+0000 7f997dc01640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:28:32.809 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-03-09T14:28:32.805+0000 7f501e0dc640 -1 osd.4 0 waiting for initial osdmap 2024-03-09T14:28:32.818 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-03-09T14:28:32.817+0000 7f86a335a640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:28:32.826 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-03-09T14:28:32.825+0000 7f5016723640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-09T14:28:32.935 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-09T14:28:33.231 INFO:teuthology.misc.health.smithi099.stdout: 2024-03-09T14:28:33.231 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":12,"fsid":"c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e","created":"2024-03-09T14:28:22.555967+0000","modified":"2024-03-09T14:28:30.598728+0000","last_up_change":"0.000000","last_in_change":"2024-03-09T14:28:24.846197+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f7049dc8-86cc-47e3-b16a-e3e9a620ee63","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5877574c-62c9-4ee0-b9db-cd3995ca0a3c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"220962ad-f847-4fb0-9daf-76cf09ca5c7e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"2a1e0d81-f422-4fa0-af27-6dbefd01b429","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"42f23385-6032-4aaf-9d95-3eb6c59eb515","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e2ff7aea-ca15-4bf6-91df-cef1f6ddac9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a58c2272-d8ee-49eb-b12e-d968c541b36e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8f499990-ff5b-4066-bda3-3eda76980f37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T14:28:33.248 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-09T14:28:40.055 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-09T14:28:40.366 INFO:teuthology.misc.health.smithi099.stdout: 2024-03-09T14:28:40.367 INFO:teuthology.misc.health.smithi099.stdout:{"epoch":17,"fsid":"c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e","created":"2024-03-09T14:28:22.555967+0000","modified":"2024-03-09T14:28:37.798886+0000","last_up_change":"2024-03-09T14:28:33.692192+0000","last_in_change":"2024-03-09T14:28:24.846197+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-09T14:28:35.514636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7049dc8-86cc-47e3-b16a-e3e9a620ee63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2757713078},{"type":"v1","addr":"172.21.15.99:6817","nonce":2757713078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2757713078},{"type":"v1","addr":"172.21.15.99:6819","nonce":2757713078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2757713078},{"type":"v1","addr":"172.21.15.99:6823","nonce":2757713078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2757713078},{"type":"v1","addr":"172.21.15.99:6821","nonce":2757713078}]},"public_addr":"172.21.15.99:6817/2757713078","cluster_addr":"172.21.15.99:6819/2757713078","heartbeat_back_addr":"172.21.15.99:6823/2757713078","heartbeat_front_addr":"172.21.15.99:6821/2757713078","state":["exists","up"]},{"osd":1,"uuid":"5877574c-62c9-4ee0-b9db-cd3995ca0a3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2872705330},{"type":"v1","addr":"172.21.15.99:6809","nonce":2872705330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2872705330},{"type":"v1","addr":"172.21.15.99:6811","nonce":2872705330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2872705330},{"type":"v1","addr":"172.21.15.99:6815","nonce":2872705330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2872705330},{"type":"v1","addr":"172.21.15.99:6813","nonce":2872705330}]},"public_addr":"172.21.15.99:6809/2872705330","cluster_addr":"172.21.15.99:6811/2872705330","heartbeat_back_addr":"172.21.15.99:6815/2872705330","heartbeat_front_addr":"172.21.15.99:6813/2872705330","state":["exists","up"]},{"osd":2,"uuid":"220962ad-f847-4fb0-9daf-76cf09ca5c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3618878900},{"type":"v1","addr":"172.21.15.99:6825","nonce":3618878900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3618878900},{"type":"v1","addr":"172.21.15.99:6827","nonce":3618878900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3618878900},{"type":"v1","addr":"172.21.15.99:6831","nonce":3618878900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":3618878900},{"type":"v1","addr":"172.21.15.99:6829","nonce":3618878900}]},"public_addr":"172.21.15.99:6825/3618878900","cluster_addr":"172.21.15.99:6827/3618878900","heartbeat_back_addr":"172.21.15.99:6831/3618878900","heartbeat_front_addr":"172.21.15.99:6829/3618878900","state":["exists","up"]},{"osd":3,"uuid":"2a1e0d81-f422-4fa0-af27-6dbefd01b429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":643519472},{"type":"v1","addr":"172.21.15.99:6801","nonce":643519472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":643519472},{"type":"v1","addr":"172.21.15.99:6803","nonce":643519472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":643519472},{"type":"v1","addr":"172.21.15.99:6807","nonce":643519472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":643519472},{"type":"v1","addr":"172.21.15.99:6805","nonce":643519472}]},"public_addr":"172.21.15.99:6801/643519472","cluster_addr":"172.21.15.99:6803/643519472","heartbeat_back_addr":"172.21.15.99:6807/643519472","heartbeat_front_addr":"172.21.15.99:6805/643519472","state":["exists","up"]},{"osd":4,"uuid":"42f23385-6032-4aaf-9d95-3eb6c59eb515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2461929152},{"type":"v1","addr":"172.21.15.179:6801","nonce":2461929152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2461929152},{"type":"v1","addr":"172.21.15.179:6803","nonce":2461929152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2461929152},{"type":"v1","addr":"172.21.15.179:6815","nonce":2461929152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2461929152},{"type":"v1","addr":"172.21.15.179:6809","nonce":2461929152}]},"public_addr":"172.21.15.179:6801/2461929152","cluster_addr":"172.21.15.179:6803/2461929152","heartbeat_back_addr":"172.21.15.179:6815/2461929152","heartbeat_front_addr":"172.21.15.179:6809/2461929152","state":["exists","up"]},{"osd":5,"uuid":"e2ff7aea-ca15-4bf6-91df-cef1f6ddac9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6807","nonce":4275579646},{"type":"v1","addr":"172.21.15.179:6811","nonce":4275579646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":4275579646},{"type":"v1","addr":"172.21.15.179:6816","nonce":4275579646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4275579646},{"type":"v1","addr":"172.21.15.179:6823","nonce":4275579646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4275579646},{"type":"v1","addr":"172.21.15.179:6820","nonce":4275579646}]},"public_addr":"172.21.15.179:6811/4275579646","cluster_addr":"172.21.15.179:6816/4275579646","heartbeat_back_addr":"172.21.15.179:6823/4275579646","heartbeat_front_addr":"172.21.15.179:6820/4275579646","state":["exists","up"]},{"osd":6,"uuid":"a58c2272-d8ee-49eb-b12e-d968c541b36e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2511961392},{"type":"v1","addr":"172.21.15.179:6806","nonce":2511961392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2511961392},{"type":"v1","addr":"172.21.15.179:6810","nonce":2511961392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2511961392},{"type":"v1","addr":"172.21.15.179:6821","nonce":2511961392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2511961392},{"type":"v1","addr":"172.21.15.179:6817","nonce":2511961392}]},"public_addr":"172.21.15.179:6806/2511961392","cluster_addr":"172.21.15.179:6810/2511961392","heartbeat_back_addr":"172.21.15.179:6821/2511961392","heartbeat_front_addr":"172.21.15.179:6817/2511961392","state":["exists","up"]},{"osd":7,"uuid":"8f499990-ff5b-4066-bda3-3eda76980f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1220611928},{"type":"v1","addr":"172.21.15.179:6825","nonce":1220611928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1220611928},{"type":"v1","addr":"172.21.15.179:6827","nonce":1220611928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1220611928},{"type":"v1","addr":"172.21.15.179:6831","nonce":1220611928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1220611928},{"type":"v1","addr":"172.21.15.179:6829","nonce":1220611928}]},"public_addr":"172.21.15.179:6825/1220611928","cluster_addr":"172.21.15.179:6827/1220611928","heartbeat_back_addr":"172.21.15.179:6831/1220611928","heartbeat_front_addr":"172.21.15.179:6829/1220611928","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.447229+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.475263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.348371+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.438398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.537961+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.533762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.309350+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.419779+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T14:28:40.385 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-09T14:28:40.385 INFO:tasks.ceph:Creating RBD pool 2024-03-09T14:28:40.385 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd pool create rbd 8 2024-03-09T14:28:40.819 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'rbd' created 2024-03-09T14:28:40.841 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-03-09T14:28:41.821 INFO:teuthology.orchestra.run.smithi099.stderr:enabled application 'rbd' on pool 'rbd' 2024-03-09T14:28:41.848 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-09T14:28:41.848 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-09T14:28:41.848 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-09T14:28:41.849 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-09T14:28:41.849 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-09T14:28:42.187 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:28:42.202 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6832","nonce":3421029566},{"type":"v1","addr":"172.21.15.99:6833","nonce":3421029566}]},"active_addr":"172.21.15.99:6833/3421029566","active_change":"2024-03-09T14:28:27.428415+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4120,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":3428795081}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":3794923614}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":2304953627}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.99:0","nonce":607770621}]}]} 2024-03-09T14:28:42.206 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-09T14:28:42.206 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-09T14:28:42.206 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-09T14:28:42.474 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:28:42.474 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":19,"fsid":"c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e","created":"2024-03-09T14:28:22.555967+0000","modified":"2024-03-09T14:28:41.815520+0000","last_up_change":"2024-03-09T14:28:33.692192+0000","last_in_change":"2024-03-09T14:28:24.846197+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-09T14:28:35.514636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-09T14:28:40.724074+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7049dc8-86cc-47e3-b16a-e3e9a620ee63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2757713078},{"type":"v1","addr":"172.21.15.99:6817","nonce":2757713078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2757713078},{"type":"v1","addr":"172.21.15.99:6819","nonce":2757713078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2757713078},{"type":"v1","addr":"172.21.15.99:6823","nonce":2757713078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2757713078},{"type":"v1","addr":"172.21.15.99:6821","nonce":2757713078}]},"public_addr":"172.21.15.99:6817/2757713078","cluster_addr":"172.21.15.99:6819/2757713078","heartbeat_back_addr":"172.21.15.99:6823/2757713078","heartbeat_front_addr":"172.21.15.99:6821/2757713078","state":["exists","up"]},{"osd":1,"uuid":"5877574c-62c9-4ee0-b9db-cd3995ca0a3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2872705330},{"type":"v1","addr":"172.21.15.99:6809","nonce":2872705330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2872705330},{"type":"v1","addr":"172.21.15.99:6811","nonce":2872705330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2872705330},{"type":"v1","addr":"172.21.15.99:6815","nonce":2872705330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2872705330},{"type":"v1","addr":"172.21.15.99:6813","nonce":2872705330}]},"public_addr":"172.21.15.99:6809/2872705330","cluster_addr":"172.21.15.99:6811/2872705330","heartbeat_back_addr":"172.21.15.99:6815/2872705330","heartbeat_front_addr":"172.21.15.99:6813/2872705330","state":["exists","up"]},{"osd":2,"uuid":"220962ad-f847-4fb0-9daf-76cf09ca5c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3618878900},{"type":"v1","addr":"172.21.15.99:6825","nonce":3618878900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3618878900},{"type":"v1","addr":"172.21.15.99:6827","nonce":3618878900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3618878900},{"type":"v1","addr":"172.21.15.99:6831","nonce":3618878900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":3618878900},{"type":"v1","addr":"172.21.15.99:6829","nonce":3618878900}]},"public_addr":"172.21.15.99:6825/3618878900","cluster_addr":"172.21.15.99:6827/3618878900","heartbeat_back_addr":"172.21.15.99:6831/3618878900","heartbeat_front_addr":"172.21.15.99:6829/3618878900","state":["exists","up"]},{"osd":3,"uuid":"2a1e0d81-f422-4fa0-af27-6dbefd01b429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":643519472},{"type":"v1","addr":"172.21.15.99:6801","nonce":643519472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":643519472},{"type":"v1","addr":"172.21.15.99:6803","nonce":643519472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":643519472},{"type":"v1","addr":"172.21.15.99:6807","nonce":643519472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":643519472},{"type":"v1","addr":"172.21.15.99:6805","nonce":643519472}]},"public_addr":"172.21.15.99:6801/643519472","cluster_addr":"172.21.15.99:6803/643519472","heartbeat_back_addr":"172.21.15.99:6807/643519472","heartbeat_front_addr":"172.21.15.99:6805/643519472","state":["exists","up"]},{"osd":4,"uuid":"42f23385-6032-4aaf-9d95-3eb6c59eb515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2461929152},{"type":"v1","addr":"172.21.15.179:6801","nonce":2461929152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2461929152},{"type":"v1","addr":"172.21.15.179:6803","nonce":2461929152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2461929152},{"type":"v1","addr":"172.21.15.179:6815","nonce":2461929152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2461929152},{"type":"v1","addr":"172.21.15.179:6809","nonce":2461929152}]},"public_addr":"172.21.15.179:6801/2461929152","cluster_addr":"172.21.15.179:6803/2461929152","heartbeat_back_addr":"172.21.15.179:6815/2461929152","heartbeat_front_addr":"172.21.15.179:6809/2461929152","state":["exists","up"]},{"osd":5,"uuid":"e2ff7aea-ca15-4bf6-91df-cef1f6ddac9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6807","nonce":4275579646},{"type":"v1","addr":"172.21.15.179:6811","nonce":4275579646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":4275579646},{"type":"v1","addr":"172.21.15.179:6816","nonce":4275579646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4275579646},{"type":"v1","addr":"172.21.15.179:6823","nonce":4275579646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4275579646},{"type":"v1","addr":"172.21.15.179:6820","nonce":4275579646}]},"public_addr":"172.21.15.179:6811/4275579646","cluster_addr":"172.21.15.179:6816/4275579646","heartbeat_back_addr":"172.21.15.179:6823/4275579646","heartbeat_front_addr":"172.21.15.179:6820/4275579646","state":["exists","up"]},{"osd":6,"uuid":"a58c2272-d8ee-49eb-b12e-d968c541b36e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2511961392},{"type":"v1","addr":"172.21.15.179:6806","nonce":2511961392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2511961392},{"type":"v1","addr":"172.21.15.179:6810","nonce":2511961392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2511961392},{"type":"v1","addr":"172.21.15.179:6821","nonce":2511961392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2511961392},{"type":"v1","addr":"172.21.15.179:6817","nonce":2511961392}]},"public_addr":"172.21.15.179:6806/2511961392","cluster_addr":"172.21.15.179:6810/2511961392","heartbeat_back_addr":"172.21.15.179:6821/2511961392","heartbeat_front_addr":"172.21.15.179:6817/2511961392","state":["exists","up"]},{"osd":7,"uuid":"8f499990-ff5b-4066-bda3-3eda76980f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1220611928},{"type":"v1","addr":"172.21.15.179:6825","nonce":1220611928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1220611928},{"type":"v1","addr":"172.21.15.179:6827","nonce":1220611928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1220611928},{"type":"v1","addr":"172.21.15.179:6831","nonce":1220611928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1220611928},{"type":"v1","addr":"172.21.15.179:6829","nonce":1220611928}]},"public_addr":"172.21.15.179:6825/1220611928","cluster_addr":"172.21.15.179:6827/1220611928","heartbeat_back_addr":"172.21.15.179:6831/1220611928","heartbeat_front_addr":"172.21.15.179:6829/1220611928","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.447229+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.475263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.348371+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.438398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.537961+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.533762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.309350+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.419779+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T14:28:42.491 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-09T14:28:42.491 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-09T14:28:42.770 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:28:42.770 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":19,"fsid":"c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e","created":"2024-03-09T14:28:22.555967+0000","modified":"2024-03-09T14:28:41.815520+0000","last_up_change":"2024-03-09T14:28:33.692192+0000","last_in_change":"2024-03-09T14:28:24.846197+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-09T14:28:35.514636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-09T14:28:40.724074+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7049dc8-86cc-47e3-b16a-e3e9a620ee63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2757713078},{"type":"v1","addr":"172.21.15.99:6817","nonce":2757713078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2757713078},{"type":"v1","addr":"172.21.15.99:6819","nonce":2757713078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2757713078},{"type":"v1","addr":"172.21.15.99:6823","nonce":2757713078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2757713078},{"type":"v1","addr":"172.21.15.99:6821","nonce":2757713078}]},"public_addr":"172.21.15.99:6817/2757713078","cluster_addr":"172.21.15.99:6819/2757713078","heartbeat_back_addr":"172.21.15.99:6823/2757713078","heartbeat_front_addr":"172.21.15.99:6821/2757713078","state":["exists","up"]},{"osd":1,"uuid":"5877574c-62c9-4ee0-b9db-cd3995ca0a3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2872705330},{"type":"v1","addr":"172.21.15.99:6809","nonce":2872705330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2872705330},{"type":"v1","addr":"172.21.15.99:6811","nonce":2872705330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2872705330},{"type":"v1","addr":"172.21.15.99:6815","nonce":2872705330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2872705330},{"type":"v1","addr":"172.21.15.99:6813","nonce":2872705330}]},"public_addr":"172.21.15.99:6809/2872705330","cluster_addr":"172.21.15.99:6811/2872705330","heartbeat_back_addr":"172.21.15.99:6815/2872705330","heartbeat_front_addr":"172.21.15.99:6813/2872705330","state":["exists","up"]},{"osd":2,"uuid":"220962ad-f847-4fb0-9daf-76cf09ca5c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3618878900},{"type":"v1","addr":"172.21.15.99:6825","nonce":3618878900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3618878900},{"type":"v1","addr":"172.21.15.99:6827","nonce":3618878900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3618878900},{"type":"v1","addr":"172.21.15.99:6831","nonce":3618878900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":3618878900},{"type":"v1","addr":"172.21.15.99:6829","nonce":3618878900}]},"public_addr":"172.21.15.99:6825/3618878900","cluster_addr":"172.21.15.99:6827/3618878900","heartbeat_back_addr":"172.21.15.99:6831/3618878900","heartbeat_front_addr":"172.21.15.99:6829/3618878900","state":["exists","up"]},{"osd":3,"uuid":"2a1e0d81-f422-4fa0-af27-6dbefd01b429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":643519472},{"type":"v1","addr":"172.21.15.99:6801","nonce":643519472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":643519472},{"type":"v1","addr":"172.21.15.99:6803","nonce":643519472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":643519472},{"type":"v1","addr":"172.21.15.99:6807","nonce":643519472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":643519472},{"type":"v1","addr":"172.21.15.99:6805","nonce":643519472}]},"public_addr":"172.21.15.99:6801/643519472","cluster_addr":"172.21.15.99:6803/643519472","heartbeat_back_addr":"172.21.15.99:6807/643519472","heartbeat_front_addr":"172.21.15.99:6805/643519472","state":["exists","up"]},{"osd":4,"uuid":"42f23385-6032-4aaf-9d95-3eb6c59eb515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2461929152},{"type":"v1","addr":"172.21.15.179:6801","nonce":2461929152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2461929152},{"type":"v1","addr":"172.21.15.179:6803","nonce":2461929152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2461929152},{"type":"v1","addr":"172.21.15.179:6815","nonce":2461929152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2461929152},{"type":"v1","addr":"172.21.15.179:6809","nonce":2461929152}]},"public_addr":"172.21.15.179:6801/2461929152","cluster_addr":"172.21.15.179:6803/2461929152","heartbeat_back_addr":"172.21.15.179:6815/2461929152","heartbeat_front_addr":"172.21.15.179:6809/2461929152","state":["exists","up"]},{"osd":5,"uuid":"e2ff7aea-ca15-4bf6-91df-cef1f6ddac9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6807","nonce":4275579646},{"type":"v1","addr":"172.21.15.179:6811","nonce":4275579646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":4275579646},{"type":"v1","addr":"172.21.15.179:6816","nonce":4275579646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4275579646},{"type":"v1","addr":"172.21.15.179:6823","nonce":4275579646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4275579646},{"type":"v1","addr":"172.21.15.179:6820","nonce":4275579646}]},"public_addr":"172.21.15.179:6811/4275579646","cluster_addr":"172.21.15.179:6816/4275579646","heartbeat_back_addr":"172.21.15.179:6823/4275579646","heartbeat_front_addr":"172.21.15.179:6820/4275579646","state":["exists","up"]},{"osd":6,"uuid":"a58c2272-d8ee-49eb-b12e-d968c541b36e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2511961392},{"type":"v1","addr":"172.21.15.179:6806","nonce":2511961392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2511961392},{"type":"v1","addr":"172.21.15.179:6810","nonce":2511961392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2511961392},{"type":"v1","addr":"172.21.15.179:6821","nonce":2511961392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2511961392},{"type":"v1","addr":"172.21.15.179:6817","nonce":2511961392}]},"public_addr":"172.21.15.179:6806/2511961392","cluster_addr":"172.21.15.179:6810/2511961392","heartbeat_back_addr":"172.21.15.179:6821/2511961392","heartbeat_front_addr":"172.21.15.179:6817/2511961392","state":["exists","up"]},{"osd":7,"uuid":"8f499990-ff5b-4066-bda3-3eda76980f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1220611928},{"type":"v1","addr":"172.21.15.179:6825","nonce":1220611928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1220611928},{"type":"v1","addr":"172.21.15.179:6827","nonce":1220611928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1220611928},{"type":"v1","addr":"172.21.15.179:6831","nonce":1220611928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1220611928},{"type":"v1","addr":"172.21.15.179:6829","nonce":1220611928}]},"public_addr":"172.21.15.179:6825/1220611928","cluster_addr":"172.21.15.179:6827/1220611928","heartbeat_back_addr":"172.21.15.179:6831/1220611928","heartbeat_front_addr":"172.21.15.179:6829/1220611928","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.447229+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.475263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.348371+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.438398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.537961+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.533762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.309350+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.419779+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T14:28:42.787 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-09T14:28:42.788 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-09T14:28:42.788 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-09T14:28:42.789 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-09T14:28:42.789 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-09T14:28:42.789 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-09T14:28:42.790 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-09T14:28:42.790 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-09T14:28:43.024 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-03-09T14:28:43.024 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-09T14:28:43.046 INFO:teuthology.orchestra.run.smithi099.stdout:55834574851 2024-03-09T14:28:43.046 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-09T14:28:43.047 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-03-09T14:28:43.048 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-09T14:28:43.048 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-03-09T14:28:43.049 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-09T14:28:43.061 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-03-09T14:28:43.061 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-09T14:28:43.072 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-03-09T14:28:43.072 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-09T14:28:43.081 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-03-09T14:28:43.081 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-09T14:28:43.086 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-03-09T14:28:43.087 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-09T14:28:43.488 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-03-09T14:28:43.513 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-03-09T14:28:43.528 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-03-09T14:28:43.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-03-09T14:28:43.573 INFO:teuthology.orchestra.run.smithi099.stdout:55834574850 2024-03-09T14:28:43.578 INFO:teuthology.orchestra.run.smithi099.stdout:55834574851 2024-03-09T14:28:43.591 INFO:teuthology.orchestra.run.smithi099.stdout:55834574851 2024-03-09T14:28:43.598 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-03-09T14:28:43.599 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-03-09T14:28:43.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.2 2024-03-09T14:28:43.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2024-03-09T14:28:43.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2024-03-09T14:28:43.616 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-03-09T14:28:43.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-03-09T14:28:43.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-03-09T14:28:43.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-03-09T14:28:44.514 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-09T14:28:44.553 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-09T14:28:44.602 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-09T14:28:44.609 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-09T14:28:44.616 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-09T14:28:44.624 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-09T14:28:44.624 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-09T14:28:44.633 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-09T14:28:44.996 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-03-09T14:28:45.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-03-09T14:28:45.022 DEBUG:teuthology.parallel:result is None 2024-03-09T14:28:45.058 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-03-09T14:28:45.081 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-03-09T14:28:45.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-03-09T14:28:45.083 DEBUG:teuthology.parallel:result is None 2024-03-09T14:28:45.100 INFO:teuthology.orchestra.run.smithi099.stdout:55834574851 2024-03-09T14:28:45.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2024-03-09T14:28:45.105 DEBUG:teuthology.parallel:result is None 2024-03-09T14:28:45.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.2 2024-03-09T14:28:45.125 DEBUG:teuthology.parallel:result is None 2024-03-09T14:28:45.129 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-03-09T14:28:45.132 INFO:teuthology.orchestra.run.smithi099.stdout:55834574853 2024-03-09T14:28:45.142 INFO:teuthology.orchestra.run.smithi099.stdout:55834574852 2024-03-09T14:28:45.145 INFO:teuthology.orchestra.run.smithi099.stdout:55834574854 2024-03-09T14:28:45.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-03-09T14:28:45.154 DEBUG:teuthology.parallel:result is None 2024-03-09T14:28:45.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-03-09T14:28:45.154 DEBUG:teuthology.parallel:result is None 2024-03-09T14:28:45.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2024-03-09T14:28:45.165 DEBUG:teuthology.parallel:result is None 2024-03-09T14:28:45.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-03-09T14:28:45.166 DEBUG:teuthology.parallel:result is None 2024-03-09T14:28:45.166 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-09T14:28:45.166 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T14:28:45.470 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:28:45.471 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-09T14:28:45.487 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-03-09T14:28:45.442277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218944,"kb_used_data":2748,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755776,"statfs":{"total":773094113280,"available":772869914624,"internally_reserved":0,"allocated":2813952,"data_stored":1716868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.625922"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:43.823605+0000","last_change":"2024-03-09T14:28:41.841410+0000","last_active":"2024-03-09T14:28:43.823605+0000","last_peered":"2024-03-09T14:28:43.823605+0000","last_clean":"2024-03-09T14:28:43.823605+0000","last_became_active":"2024-03-09T14:28:41.840575+0000","last_became_peered":"2024-03-09T14:28:41.840575+0000","last_unstale":"2024-03-09T14:28:43.823605+0000","last_undegraded":"2024-03-09T14:28:43.823605+0000","last_fullsized":"2024-03-09T14:28:43.823605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:57.501425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:44.419129+0000","last_change":"2024-03-09T14:28:41.840785+0000","last_active":"2024-03-09T14:28:44.419129+0000","last_peered":"2024-03-09T14:28:44.419129+0000","last_clean":"2024-03-09T14:28:44.419129+0000","last_became_active":"2024-03-09T14:28:41.840168+0000","last_became_peered":"2024-03-09T14:28:41.840168+0000","last_unstale":"2024-03-09T14:28:44.419129+0000","last_undegraded":"2024-03-09T14:28:44.419129+0000","last_fullsized":"2024-03-09T14:28:44.419129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:34:15.498376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:43.917978+0000","last_change":"2024-03-09T14:28:42.127115+0000","last_active":"2024-03-09T14:28:43.917978+0000","last_peered":"2024-03-09T14:28:43.917978+0000","last_clean":"2024-03-09T14:28:43.917978+0000","last_became_active":"2024-03-09T14:28:42.126201+0000","last_became_peered":"2024-03-09T14:28:42.126201+0000","last_unstale":"2024-03-09T14:28:43.917978+0000","last_undegraded":"2024-03-09T14:28:43.917978+0000","last_fullsized":"2024-03-09T14:28:43.917978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:57.954868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:44.419002+0000","last_change":"2024-03-09T14:28:42.127635+0000","last_active":"2024-03-09T14:28:44.419002+0000","last_peered":"2024-03-09T14:28:44.419002+0000","last_clean":"2024-03-09T14:28:44.419002+0000","last_became_active":"2024-03-09T14:28:42.126799+0000","last_became_peered":"2024-03-09T14:28:42.126799+0000","last_unstale":"2024-03-09T14:28:44.419002+0000","last_undegraded":"2024-03-09T14:28:44.419002+0000","last_fullsized":"2024-03-09T14:28:44.419002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:32.493854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:42.895551+0000","last_change":"2024-03-09T14:28:41.843028+0000","last_active":"2024-03-09T14:28:42.895551+0000","last_peered":"2024-03-09T14:28:42.895551+0000","last_clean":"2024-03-09T14:28:42.895551+0000","last_became_active":"2024-03-09T14:28:41.842251+0000","last_became_peered":"2024-03-09T14:28:41.842251+0000","last_unstale":"2024-03-09T14:28:42.895551+0000","last_undegraded":"2024-03-09T14:28:42.895551+0000","last_fullsized":"2024-03-09T14:28:42.895551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:09:29.190170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:42.830330+0000","last_change":"2024-03-09T14:28:41.837266+0000","last_active":"2024-03-09T14:28:42.830330+0000","last_peered":"2024-03-09T14:28:42.830330+0000","last_clean":"2024-03-09T14:28:42.830330+0000","last_became_active":"2024-03-09T14:28:41.836544+0000","last_became_peered":"2024-03-09T14:28:41.836544+0000","last_unstale":"2024-03-09T14:28:42.830330+0000","last_undegraded":"2024-03-09T14:28:42.830330+0000","last_fullsized":"2024-03-09T14:28:42.830330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:40.144949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:43.917890+0000","last_change":"2024-03-09T14:28:41.839813+0000","last_active":"2024-03-09T14:28:43.917890+0000","last_peered":"2024-03-09T14:28:43.917890+0000","last_clean":"2024-03-09T14:28:43.917890+0000","last_became_active":"2024-03-09T14:28:41.838669+0000","last_became_peered":"2024-03-09T14:28:41.838669+0000","last_unstale":"2024-03-09T14:28:43.917890+0000","last_undegraded":"2024-03-09T14:28:43.917890+0000","last_fullsized":"2024-03-09T14:28:43.917890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:52:50.503614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:42.895552+0000","last_change":"2024-03-09T14:28:41.842055+0000","last_active":"2024-03-09T14:28:42.895552+0000","last_peered":"2024-03-09T14:28:42.895552+0000","last_clean":"2024-03-09T14:28:42.895552+0000","last_became_active":"2024-03-09T14:28:41.841153+0000","last_became_peered":"2024-03-09T14:28:41.841153+0000","last_unstale":"2024-03-09T14:28:42.895552+0000","last_undegraded":"2024-03-09T14:28:42.895552+0000","last_fullsized":"2024-03-09T14:28:42.895552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:49.085946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:43.917923+0000","last_change":"2024-03-09T14:28:36.802806+0000","last_active":"2024-03-09T14:28:43.917923+0000","last_peered":"2024-03-09T14:28:43.917923+0000","last_clean":"2024-03-09T14:28:43.917923+0000","last_became_active":"2024-03-09T14:28:36.802270+0000","last_became_peered":"2024-03-09T14:28:36.802270+0000","last_unstale":"2024-03-09T14:28:43.917923+0000","last_undegraded":"2024-03-09T14:28:43.917923+0000","last_fullsized":"2024-03-09T14:28:43.917923+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:35.777784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:35.777784+0000","last_clean_scrub_stamp":"2024-03-09T14:28:35.777784+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:02:15.668382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":658103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":652355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T14:28:45.488 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T14:28:45.767 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:28:45.768 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-09T14:28:45.784 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-03-09T14:28:45.442277+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218944,"kb_used_data":2748,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755776,"statfs":{"total":773094113280,"available":772869914624,"internally_reserved":0,"allocated":2813952,"data_stored":1716868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.625922"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:43.823605+0000","last_change":"2024-03-09T14:28:41.841410+0000","last_active":"2024-03-09T14:28:43.823605+0000","last_peered":"2024-03-09T14:28:43.823605+0000","last_clean":"2024-03-09T14:28:43.823605+0000","last_became_active":"2024-03-09T14:28:41.840575+0000","last_became_peered":"2024-03-09T14:28:41.840575+0000","last_unstale":"2024-03-09T14:28:43.823605+0000","last_undegraded":"2024-03-09T14:28:43.823605+0000","last_fullsized":"2024-03-09T14:28:43.823605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:57.501425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:44.419129+0000","last_change":"2024-03-09T14:28:41.840785+0000","last_active":"2024-03-09T14:28:44.419129+0000","last_peered":"2024-03-09T14:28:44.419129+0000","last_clean":"2024-03-09T14:28:44.419129+0000","last_became_active":"2024-03-09T14:28:41.840168+0000","last_became_peered":"2024-03-09T14:28:41.840168+0000","last_unstale":"2024-03-09T14:28:44.419129+0000","last_undegraded":"2024-03-09T14:28:44.419129+0000","last_fullsized":"2024-03-09T14:28:44.419129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:34:15.498376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:43.917978+0000","last_change":"2024-03-09T14:28:42.127115+0000","last_active":"2024-03-09T14:28:43.917978+0000","last_peered":"2024-03-09T14:28:43.917978+0000","last_clean":"2024-03-09T14:28:43.917978+0000","last_became_active":"2024-03-09T14:28:42.126201+0000","last_became_peered":"2024-03-09T14:28:42.126201+0000","last_unstale":"2024-03-09T14:28:43.917978+0000","last_undegraded":"2024-03-09T14:28:43.917978+0000","last_fullsized":"2024-03-09T14:28:43.917978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:57.954868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:44.419002+0000","last_change":"2024-03-09T14:28:42.127635+0000","last_active":"2024-03-09T14:28:44.419002+0000","last_peered":"2024-03-09T14:28:44.419002+0000","last_clean":"2024-03-09T14:28:44.419002+0000","last_became_active":"2024-03-09T14:28:42.126799+0000","last_became_peered":"2024-03-09T14:28:42.126799+0000","last_unstale":"2024-03-09T14:28:44.419002+0000","last_undegraded":"2024-03-09T14:28:44.419002+0000","last_fullsized":"2024-03-09T14:28:44.419002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:32.493854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:42.895551+0000","last_change":"2024-03-09T14:28:41.843028+0000","last_active":"2024-03-09T14:28:42.895551+0000","last_peered":"2024-03-09T14:28:42.895551+0000","last_clean":"2024-03-09T14:28:42.895551+0000","last_became_active":"2024-03-09T14:28:41.842251+0000","last_became_peered":"2024-03-09T14:28:41.842251+0000","last_unstale":"2024-03-09T14:28:42.895551+0000","last_undegraded":"2024-03-09T14:28:42.895551+0000","last_fullsized":"2024-03-09T14:28:42.895551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:09:29.190170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:42.830330+0000","last_change":"2024-03-09T14:28:41.837266+0000","last_active":"2024-03-09T14:28:42.830330+0000","last_peered":"2024-03-09T14:28:42.830330+0000","last_clean":"2024-03-09T14:28:42.830330+0000","last_became_active":"2024-03-09T14:28:41.836544+0000","last_became_peered":"2024-03-09T14:28:41.836544+0000","last_unstale":"2024-03-09T14:28:42.830330+0000","last_undegraded":"2024-03-09T14:28:42.830330+0000","last_fullsized":"2024-03-09T14:28:42.830330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:40.144949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:43.917890+0000","last_change":"2024-03-09T14:28:41.839813+0000","last_active":"2024-03-09T14:28:43.917890+0000","last_peered":"2024-03-09T14:28:43.917890+0000","last_clean":"2024-03-09T14:28:43.917890+0000","last_became_active":"2024-03-09T14:28:41.838669+0000","last_became_peered":"2024-03-09T14:28:41.838669+0000","last_unstale":"2024-03-09T14:28:43.917890+0000","last_undegraded":"2024-03-09T14:28:43.917890+0000","last_fullsized":"2024-03-09T14:28:43.917890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:52:50.503614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:42.895552+0000","last_change":"2024-03-09T14:28:41.842055+0000","last_active":"2024-03-09T14:28:42.895552+0000","last_peered":"2024-03-09T14:28:42.895552+0000","last_clean":"2024-03-09T14:28:42.895552+0000","last_became_active":"2024-03-09T14:28:41.841153+0000","last_became_peered":"2024-03-09T14:28:41.841153+0000","last_unstale":"2024-03-09T14:28:42.895552+0000","last_undegraded":"2024-03-09T14:28:42.895552+0000","last_fullsized":"2024-03-09T14:28:42.895552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:49.085946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-09T14:28:43.917923+0000","last_change":"2024-03-09T14:28:36.802806+0000","last_active":"2024-03-09T14:28:43.917923+0000","last_peered":"2024-03-09T14:28:43.917923+0000","last_clean":"2024-03-09T14:28:43.917923+0000","last_became_active":"2024-03-09T14:28:36.802270+0000","last_became_peered":"2024-03-09T14:28:36.802270+0000","last_unstale":"2024-03-09T14:28:43.917923+0000","last_undegraded":"2024-03-09T14:28:43.917923+0000","last_fullsized":"2024-03-09T14:28:43.917923+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:35.777784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:35.777784+0000","last_clean_scrub_stamp":"2024-03-09T14:28:35.777784+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:02:15.668382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":798720,"data_stored":658103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":67735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27788,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344052,"statfs":{"total":96636764160,"available":96608309248,"internally_reserved":0,"allocated":786432,"data_stored":652355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T14:28:45.785 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-09T14:28:45.785 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-09T14:28:45.785 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-09T14:28:45.785 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-09T14:28:46.083 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:28:46.084 INFO:teuthology.orchestra.run.smithi099.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-09T14:28:46.100 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-09T14:28:46.101 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-03-09T14:28:46.112 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-03-09T14:28:46.113 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p /home/ubuntu/cephtest/ca 2024-03-09T14:28:46.118 DEBUG:teuthology.orchestra.run.smithi099:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-03-09T14:28:46.524 INFO:teuthology.orchestra.run.smithi099.stderr:.+..+.+......+.....+...+.+......+......+..+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*........+..+................+.....+.........+..........+...+.....+.+.....+.+........+.+..............+...............+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-03-09T14:28:46.741 INFO:teuthology.orchestra.run.smithi099.stderr:.........+......+...+............+....+......+........+.......+.....+.+...+..+.......+......+.........+.....+.+.........+...............+..+.+..+.......+......+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*......+.+........+....+.....+.+.........+.....+..........+...+..+...+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+....+........+..................+.+...+........+....+...+.....+.+.................+...+......+.+.......................+....+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-03-09T14:28:46.757 INFO:teuthology.orchestra.run.smithi099.stderr:----- 2024-03-09T14:28:46.765 DEBUG:teuthology.orchestra.run.smithi099:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/local/share/ca-certificates/root.crt 2024-03-09T14:28:46.791 DEBUG:teuthology.orchestra.run.smithi099:> sudo update-ca-certificates 2024-03-09T14:28:46.850 INFO:teuthology.orchestra.run.smithi099.stdout:Updating certificates in /etc/ssl/certs... 2024-03-09T14:28:47.406 INFO:teuthology.orchestra.run.smithi099.stderr:rehash: warning: skipping ca-certificates.crt,it does not contain exactly one certificate or CRL 2024-03-09T14:28:47.427 INFO:teuthology.orchestra.run.smithi099.stdout:1 added, 0 removed; done. 2024-03-09T14:28:47.437 INFO:teuthology.orchestra.run.smithi099.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-03-09T14:28:47.441 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:28:49.107 INFO:teuthology.orchestra.run.smithi099.stdout:Adding debian:root.pem 2024-03-09T14:28:49.124 INFO:teuthology.orchestra.run.smithi099.stdout:done. 2024-03-09T14:28:49.124 INFO:teuthology.orchestra.run.smithi099.stdout:done. 2024-03-09T14:28:49.128 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p /home/ubuntu/cephtest/ca 2024-03-09T14:28:49.181 DEBUG:teuthology.orchestra.run.smithi099:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi099.front.sepia.ceph.com 2024-03-09T14:28:49.425 INFO:teuthology.orchestra.run.smithi099.stderr:..+.+..+.+.........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.....+.+......+......+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.......................+....................+................+...+.....+.......+.....+...+.+.........+............+..+...............+.+..+...+....+...+...+......+...+...........+.......+...+.....+.+...........+.........+................+...+..+.............+.....+.......+.....+.........+.+..+............+...+...+.......+............+...+..................+.....+............+.......+...+...+..+.+.....+.+.....+.+...+......+.........+.....+......+.........+....+........+............+.+..............+.......+...+...........+....+..+.........+............+....+...+........+...+............+.........+......+.........+...+......................+...+..+.+...+.....+......+...+............+.+..+...+...+.+..................+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-03-09T14:28:49.499 INFO:teuthology.orchestra.run.smithi099.stderr:..........+..........+........+.......+...+...+...........+.........+.+...+......+.....+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*...........+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++*.+.............+..+..........+...+.........+...+..+......+.......+...+..+.........+........................+.........................+.....+....+...+...+..+...+.+...............+.....+.........+.+.....+......+...+.+...........+.........+.+..+...+....+...........+.......+...+..+.+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ 2024-03-09T14:28:49.503 INFO:teuthology.orchestra.run.smithi099.stderr:----- 2024-03-09T14:28:49.506 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:28:49.506 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-03-09T14:28:49.553 DEBUG:teuthology.orchestra.run.smithi099:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-03-09T14:28:49.604 INFO:teuthology.orchestra.run.smithi099.stderr:Certificate request self-signature ok 2024-03-09T14:28:49.604 INFO:teuthology.orchestra.run.smithi099.stderr:subject=CN = smithi099.front.sepia.ceph.com 2024-03-09T14:28:49.616 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-03-09T14:28:49.662 DEBUG:teuthology.orchestra.run.smithi099:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-03-09T14:28:49.714 INFO:teuthology.orchestra.run.smithi099.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-03-09T14:28:49.714 DEBUG:teuthology.orchestra.run.smithi099:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-03-09T14:28:49.762 INFO:teuthology.run_tasks:Running task rgw... 2024-03-09T14:28:49.776 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0'}} 2024-03-09T14:28:49.776 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-03-09T14:28:49.776 INFO:tasks.rgw:Creating data pools 2024-03-09T14:28:49.776 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-03-09T14:28:49.776 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-03-09T14:28:50.521 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-03-09T14:28:52.533 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'default.rgw.buckets.data' created 2024-03-09T14:28:52.568 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-03-09T14:28:53.533 INFO:teuthology.orchestra.run.smithi099.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-03-09T14:28:53.577 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-03-09T14:28:54.537 INFO:teuthology.orchestra.run.smithi099.stderr:pool 'default.rgw.buckets.index' created 2024-03-09T14:28:54.573 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-03-09T14:28:55.574 INFO:teuthology.orchestra.run.smithi099.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-03-09T14:28:55.615 DEBUG:tasks.rgw:Pools created 2024-03-09T14:28:55.616 INFO:tasks.rgw:Configuring compression type = random 2024-03-09T14:28:55.616 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-03-09T14:28:55.616 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-03-09T14:28:55.616 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-03-09T14:28:55.898 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:28:55.899 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:28:57.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.667+0000 7fef6993e640 0 -- 172.21.15.99:0/973353120 >> [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] conn(0x7fee3c065f50 msgr2=0x7fee3c068410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:57.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.675+0000 7fef6b625980 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.675+0000 7fef6993e640 0 -- 172.21.15.99:0/851377553 >> [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] conn(0x7fee30066040 msgr2=0x7fee30068500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:28:57.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.675+0000 7fef6b625980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.675+0000 7fef6b625980 20 realm 2024-03-09T14:28:57.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.675+0000 7fef6b625980 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.675+0000 7fef6b625980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.675+0000 7fef6b625980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:28:57.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.675+0000 7fef6b625980 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.675+0000 7fef6b625980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.675+0000 7fef6b625980 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.679+0000 7fef6b625980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:57.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.679+0000 7fef6b625980 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.679+0000 7fef6b625980 20 rados_obj.operate() r=0 bl.length=957 2024-03-09T14:28:57.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.679+0000 7fef6b625980 20 searching for the correct realm 2024-03-09T14:28:57.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.699+0000 7fef6b625980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:28:57.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.699+0000 7fef6b625980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:28:57.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.699+0000 7fef6b625980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:28:57.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.699+0000 7fef6b625980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:28:57.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.699+0000 7fef6b625980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:28:57.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.699+0000 7fef6b625980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:28:57.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.699+0000 7fef6b625980 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.699+0000 7fef6b625980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.699+0000 7fef6b625980 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.703+0000 7fef6b625980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:28:57.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.703+0000 7fef6b625980 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.703+0000 7fef6b625980 20 rados_obj.operate() r=0 bl.length=398 2024-03-09T14:28:57.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.703+0000 7fef6b625980 20 zone default found 2024-03-09T14:28:57.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.703+0000 7fef6b625980 4 Realm: () 2024-03-09T14:28:57.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.703+0000 7fef6b625980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:28:57.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.703+0000 7fef6b625980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:28:57.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.703+0000 7fef6b625980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:28:57.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.703+0000 7fef6b625980 20 zonegroup default 2024-03-09T14:28:57.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.703+0000 7fef6b625980 20 rados->read ofs=0 len=0 2024-03-09T14:28:57.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.703+0000 7fef6b625980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:57.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:57.703+0000 7fef6b625980 20 rados->read ofs=0 len=0 2024-03-09T14:28:59.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:59.611+0000 7fef6b625980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:59.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:59.611+0000 7fef6b625980 20 rados->read ofs=0 len=0 2024-03-09T14:28:59.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:59.615+0000 7fef6b625980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:28:59.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:59.615+0000 7fef6b625980 20 started sync module instance, tier type = 2024-03-09T14:28:59.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:28:59.615+0000 7fef6b625980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:29:01.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.679+0000 7fef6b625980 20 add_watcher() i=0 2024-03-09T14:29:01.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.679+0000 7fef6b625980 20 add_watcher() i=1 2024-03-09T14:29:01.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.679+0000 7fef6b625980 20 add_watcher() i=2 2024-03-09T14:29:01.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.679+0000 7fef6b625980 20 add_watcher() i=3 2024-03-09T14:29:01.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.679+0000 7fef6b625980 20 add_watcher() i=4 2024-03-09T14:29:01.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.679+0000 7fef6b625980 20 add_watcher() i=5 2024-03-09T14:29:01.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.679+0000 7fef6b625980 20 add_watcher() i=6 2024-03-09T14:29:01.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.679+0000 7fef6b625980 20 add_watcher() i=7 2024-03-09T14:29:01.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.679+0000 7fef6b625980 2 all 8 watchers are set, enabling cache 2024-03-09T14:29:01.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.679+0000 7fef6b625980 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-03-09T14:29:01.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.679+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-03-09T14:29:01.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.679+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.679+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-03-09T14:29:01.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.679+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-03-09T14:29:01.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.679+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-03-09T14:29:01.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-03-09T14:29:01.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-03-09T14:29:01.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-03-09T14:29:01.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-03-09T14:29:01.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-03-09T14:29:01.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-03-09T14:29:01.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-03-09T14:29:01.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-03-09T14:29:01.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-03-09T14:29:01.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-03-09T14:29:01.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-03-09T14:29:01.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-03-09T14:29:01.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-03-09T14:29:01.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-03-09T14:29:01.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-03-09T14:29:01.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.683+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-03-09T14:29:01.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-03-09T14:29:01.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-03-09T14:29:01.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-03-09T14:29:01.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-03-09T14:29:01.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-03-09T14:29:01.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-03-09T14:29:01.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-03-09T14:29:01.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-03-09T14:29:01.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-03-09T14:29:01.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-03-09T14:29:01.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-03-09T14:29:01.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-03-09T14:29:01.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-03-09T14:29:01.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-03-09T14:29:01.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-03-09T14:29:01.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-03-09T14:29:01.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-03-09T14:29:01.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.687+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-03-09T14:29:01.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-03-09T14:29:01.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-03-09T14:29:01.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-03-09T14:29:01.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-03-09T14:29:01.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-03-09T14:29:01.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-03-09T14:29:01.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-03-09T14:29:01.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-03-09T14:29:01.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-03-09T14:29:01.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-03-09T14:29:01.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-03-09T14:29:01.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-03-09T14:29:01.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-03-09T14:29:01.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.691+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-03-09T14:29:01.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-03-09T14:29:01.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-03-09T14:29:01.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-03-09T14:29:01.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-03-09T14:29:01.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-03-09T14:29:01.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-03-09T14:29:01.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-03-09T14:29:01.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-03-09T14:29:01.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-03-09T14:29:01.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-03-09T14:29:01.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-03-09T14:29:01.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.695+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-03-09T14:29:01.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-03-09T14:29:01.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-03-09T14:29:01.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-03-09T14:29:01.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-03-09T14:29:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-03-09T14:29:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-03-09T14:29:01.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-03-09T14:29:01.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-03-09T14:29:01.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-03-09T14:29:01.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-03-09T14:29:01.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-03-09T14:29:01.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-03-09T14:29:01.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-03-09T14:29:01.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-03-09T14:29:01.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-03-09T14:29:01.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.699+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-03-09T14:29:01.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-03-09T14:29:01.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-03-09T14:29:01.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-03-09T14:29:01.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-03-09T14:29:01.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-03-09T14:29:01.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-03-09T14:29:01.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-03-09T14:29:01.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-03-09T14:29:01.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-03-09T14:29:01.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-03-09T14:29:01.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-03-09T14:29:01.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-03-09T14:29:01.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-03-09T14:29:01.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.703+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-03-09T14:29:01.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-03-09T14:29:01.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-03-09T14:29:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-03-09T14:29:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-03-09T14:29:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-03-09T14:29:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-03-09T14:29:01.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-03-09T14:29:01.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-03-09T14:29:01.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-03-09T14:29:01.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-03-09T14:29:01.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-03-09T14:29:01.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-03-09T14:29:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-03-09T14:29:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-03-09T14:29:01.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-03-09T14:29:01.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-03-09T14:29:01.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-03-09T14:29:01.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.707+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-03-09T14:29:01.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-03-09T14:29:01.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-03-09T14:29:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-03-09T14:29:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-03-09T14:29:01.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-03-09T14:29:01.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-03-09T14:29:01.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-03-09T14:29:01.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-03-09T14:29:01.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-03-09T14:29:01.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-03-09T14:29:01.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-03-09T14:29:01.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-03-09T14:29:01.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-03-09T14:29:01.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-03-09T14:29:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-03-09T14:29:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.711+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-03-09T14:29:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-03-09T14:29:01.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-03-09T14:29:01.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-03-09T14:29:01.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-03-09T14:29:01.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-03-09T14:29:01.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-03-09T14:29:01.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-03-09T14:29:01.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-03-09T14:29:01.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-03-09T14:29:01.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-03-09T14:29:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-03-09T14:29:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-03-09T14:29:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-03-09T14:29:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-03-09T14:29:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-03-09T14:29:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.715+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-03-09T14:29:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-03-09T14:29:01.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-03-09T14:29:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-03-09T14:29:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-03-09T14:29:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-03-09T14:29:01.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-03-09T14:29:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-03-09T14:29:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-03-09T14:29:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-03-09T14:29:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-03-09T14:29:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-03-09T14:29:01.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-03-09T14:29:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-03-09T14:29:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.719+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-03-09T14:29:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-03-09T14:29:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-03-09T14:29:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-03-09T14:29:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-03-09T14:29:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-03-09T14:29:01.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-03-09T14:29:01.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-03-09T14:29:01.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-03-09T14:29:01.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-03-09T14:29:01.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-03-09T14:29:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-03-09T14:29:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-03-09T14:29:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-03-09T14:29:01.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.723+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-03-09T14:29:01.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-03-09T14:29:01.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-03-09T14:29:01.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-03-09T14:29:01.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-03-09T14:29:01.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-03-09T14:29:01.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-03-09T14:29:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-03-09T14:29:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-03-09T14:29:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-03-09T14:29:01.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-03-09T14:29:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-03-09T14:29:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-03-09T14:29:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-03-09T14:29:01.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-03-09T14:29:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-03-09T14:29:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.727+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.731+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-03-09T14:29:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.731+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-03-09T14:29:01.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.731+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.731+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-03-09T14:29:01.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.731+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-03-09T14:29:01.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.731+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.731+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-03-09T14:29:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.731+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-03-09T14:29:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.731+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.731+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-03-09T14:29:01.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.731+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-03-09T14:29:01.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.731+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.731+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-03-09T14:29:01.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.731+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-03-09T14:29:01.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.731+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-03-09T14:29:01.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-03-09T14:29:01.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-03-09T14:29:01.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-03-09T14:29:01.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-03-09T14:29:01.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-03-09T14:29:01.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-03-09T14:29:01.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-03-09T14:29:01.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-03-09T14:29:01.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-03-09T14:29:01.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-03-09T14:29:01.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-03-09T14:29:01.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.735+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-03-09T14:29:01.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-03-09T14:29:01.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-03-09T14:29:01.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-03-09T14:29:01.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-03-09T14:29:01.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-03-09T14:29:01.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-03-09T14:29:01.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-03-09T14:29:01.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-03-09T14:29:01.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-03-09T14:29:01.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-03-09T14:29:01.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-03-09T14:29:01.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.739+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-03-09T14:29:01.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-03-09T14:29:01.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-03-09T14:29:01.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-03-09T14:29:01.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-03-09T14:29:01.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-03-09T14:29:01.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-03-09T14:29:01.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-03-09T14:29:01.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-03-09T14:29:01.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-03-09T14:29:01.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-03-09T14:29:01.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-03-09T14:29:01.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-03-09T14:29:01.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-03-09T14:29:01.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-03-09T14:29:01.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-03-09T14:29:01.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.743+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-03-09T14:29:01.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-03-09T14:29:01.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-03-09T14:29:01.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-03-09T14:29:01.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-03-09T14:29:01.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-03-09T14:29:01.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-03-09T14:29:01.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-03-09T14:29:01.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-03-09T14:29:01.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-03-09T14:29:01.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-03-09T14:29:01.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-03-09T14:29:01.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-03-09T14:29:01.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-03-09T14:29:01.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.747+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.751+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-03-09T14:29:01.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.751+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-03-09T14:29:01.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.751+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.751+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-03-09T14:29:01.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.751+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-03-09T14:29:01.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.751+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.751+0000 7fef6b625980 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-03-09T14:29:01.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.751+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-03-09T14:29:01.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.755+0000 7fef6b625980 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-03-09T14:29:01.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.763+0000 7fee1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:01.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.763+0000 7fef6b625980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:29:01.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:01.763+0000 7fef6b625980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:29:04.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.647+0000 7fef6b625980 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-03-09T14:29:04.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.647+0000 7fef6b625980 5 note: GC not initialized 2024-03-09T14:29:04.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.655+0000 7fee1a7e4640 20 reqs_thread_entry: start 2024-03-09T14:29:04.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.655+0000 7fef6b625980 20 init_complete bucket index max shards: 11 2024-03-09T14:29:04.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.655+0000 7fef6b625980 20 Filter name: none 2024-03-09T14:29:04.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.655+0000 7fed7bfff640 20 reqs_thread_entry: start 2024-03-09T14:29:04.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.707+0000 7fee1b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:04.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.711+0000 7fef6b625980 20 remove_watcher() i=0 2024-03-09T14:29:04.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.711+0000 7fef6b625980 2 removed watcher, disabling cache 2024-03-09T14:29:04.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.715+0000 7fef6b625980 20 remove_watcher() i=1 2024-03-09T14:29:04.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.719+0000 7fef6b625980 20 remove_watcher() i=2 2024-03-09T14:29:04.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.719+0000 7fef6b625980 20 remove_watcher() i=3 2024-03-09T14:29:04.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.723+0000 7fef6b625980 20 remove_watcher() i=4 2024-03-09T14:29:04.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.723+0000 7fef6b625980 20 remove_watcher() i=5 2024-03-09T14:29:04.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.727+0000 7fef6b625980 20 remove_watcher() i=6 2024-03-09T14:29:04.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.727+0000 7fef6b625980 20 remove_watcher() i=7 2024-03-09T14:29:04.751 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-03-09T14:29:04.751 DEBUG:tasks.util.rgw: json result: [] 2024-03-09T14:29:04.751 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-03-09T14:29:04.751 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-03-09T14:29:04.752 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-03-09T14:29:04.792 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:29:04.792 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:29:04.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.819+0000 7fd77046a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:29:04.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.819+0000 7fd77046a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:29:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.823+0000 7fd5a3fff640 20 reqs_thread_entry: start 2024-03-09T14:29:04.847 INFO:teuthology.orchestra.run.smithi099.stdout:{"id":"160105e3-abe0-4c80-8c65-b187bbe6d91d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups"} 2024-03-09T14:29:04.847 DEBUG:tasks.util.rgw: json result: {'id': '160105e3-abe0-4c80-8c65-b187bbe6d91d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups'} 2024-03-09T14:29:04.847 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-03-09T14:29:04.847 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-03-09T14:29:04.848 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-03-09T14:29:04.923 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:29:04.923 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:29:04.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.959+0000 7f89bddd4980 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.959+0000 7f89bddd4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:04.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.959+0000 7f89bddd4980 20 realm 2024-03-09T14:29:04.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.959+0000 7f89bddd4980 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.959+0000 7f89bddd4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:04.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.959+0000 7f89bddd4980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:29:04.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.959+0000 7f89bddd4980 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.959+0000 7f89bddd4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:04.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.959+0000 7f89bddd4980 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.963+0000 7f89bddd4980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:04.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.963+0000 7f89bddd4980 20 rados->read ofs=0 len=0 2024-03-09T14:29:04.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.963+0000 7f89bddd4980 20 rados_obj.operate() r=0 bl.length=973 2024-03-09T14:29:04.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.963+0000 7f89bddd4980 20 searching for the correct realm 2024-03-09T14:29:04.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.967+0000 7f89bc0ed640 0 -- 172.21.15.99:0/3622395565 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f89b0057ac0 msgr2=0x7f89b0086410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:29:04.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:04.975+0000 7f89bb0eb640 0 -- 172.21.15.99:0/3622395565 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f89ac05a8b0 msgr2=0x7f89ac05e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:29:05.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.191+0000 7f89bddd4980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:29:05.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.191+0000 7f89bddd4980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:29:05.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.191+0000 7f89bddd4980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:29:05.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.191+0000 7f89bddd4980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:29:05.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.191+0000 7f89bddd4980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:29:05.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.191+0000 7f89bddd4980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:29:05.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.191+0000 7f89bddd4980 20 rados->read ofs=0 len=0 2024-03-09T14:29:05.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.191+0000 7f89bddd4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:05.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.191+0000 7f89bddd4980 20 rados->read ofs=0 len=0 2024-03-09T14:29:05.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.195+0000 7f89bddd4980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:05.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.195+0000 7f89bddd4980 20 rados->read ofs=0 len=0 2024-03-09T14:29:05.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.195+0000 7f89bddd4980 20 rados_obj.operate() r=0 bl.length=398 2024-03-09T14:29:05.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.195+0000 7f89bddd4980 20 zone default found 2024-03-09T14:29:05.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.195+0000 7f89bddd4980 4 Realm: () 2024-03-09T14:29:05.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.195+0000 7f89bddd4980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:29:05.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.195+0000 7f89bddd4980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:29:05.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.195+0000 7f89bddd4980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:29:05.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.195+0000 7f89bddd4980 20 zonegroup default 2024-03-09T14:29:05.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.195+0000 7f89bddd4980 20 rados->read ofs=0 len=0 2024-03-09T14:29:05.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.195+0000 7f89bddd4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:05.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.195+0000 7f89bddd4980 20 rados->read ofs=0 len=0 2024-03-09T14:29:05.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.195+0000 7f89bddd4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:05.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.195+0000 7f89bddd4980 20 rados->read ofs=0 len=0 2024-03-09T14:29:05.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.195+0000 7f89bddd4980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:05.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.195+0000 7f89bddd4980 20 started sync module instance, tier type = 2024-03-09T14:29:05.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.195+0000 7f89bddd4980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:29:05.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.223+0000 7f89bddd4980 20 add_watcher() i=0 2024-03-09T14:29:05.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.223+0000 7f89bddd4980 20 add_watcher() i=1 2024-03-09T14:29:05.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.223+0000 7f89bddd4980 20 add_watcher() i=2 2024-03-09T14:29:05.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.223+0000 7f89bddd4980 20 add_watcher() i=3 2024-03-09T14:29:05.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.223+0000 7f89bddd4980 20 add_watcher() i=4 2024-03-09T14:29:05.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.223+0000 7f89bddd4980 20 add_watcher() i=5 2024-03-09T14:29:05.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.223+0000 7f89bddd4980 20 add_watcher() i=6 2024-03-09T14:29:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.227+0000 7f89bddd4980 20 add_watcher() i=7 2024-03-09T14:29:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.227+0000 7f89bddd4980 2 all 8 watchers are set, enabling cache 2024-03-09T14:29:05.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.231+0000 7f88727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:05.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.231+0000 7f89bddd4980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:29:05.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.231+0000 7f89bddd4980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:29:05.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.231+0000 7f89bddd4980 5 note: GC not initialized 2024-03-09T14:29:05.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.231+0000 7f88717e2640 20 reqs_thread_entry: start 2024-03-09T14:29:05.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.231+0000 7f89bddd4980 20 init_complete bucket index max shards: 11 2024-03-09T14:29:05.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.231+0000 7f89bddd4980 20 Filter name: none 2024-03-09T14:29:05.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.231+0000 7f886a7fc640 20 reqs_thread_entry: start 2024-03-09T14:29:05.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.251+0000 7f88727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:05.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.259+0000 7f89bddd4980 20 remove_watcher() i=0 2024-03-09T14:29:05.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.259+0000 7f89bddd4980 2 removed watcher, disabling cache 2024-03-09T14:29:05.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.263+0000 7f89bddd4980 20 remove_watcher() i=1 2024-03-09T14:29:05.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.263+0000 7f89bddd4980 20 remove_watcher() i=2 2024-03-09T14:29:05.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.267+0000 7f89bddd4980 20 remove_watcher() i=3 2024-03-09T14:29:05.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.267+0000 7f89bddd4980 20 remove_watcher() i=4 2024-03-09T14:29:05.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.271+0000 7f89bddd4980 20 remove_watcher() i=5 2024-03-09T14:29:05.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.271+0000 7f89bddd4980 20 remove_watcher() i=6 2024-03-09T14:29:05.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.275+0000 7f89bddd4980 20 remove_watcher() i=7 2024-03-09T14:29:05.293 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-03-09T14:29:05.293 DEBUG:tasks.util.rgw: json result: [] 2024-03-09T14:29:05.294 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-03-09T14:29:05.294 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-03-09T14:29:05.294 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-03-09T14:29:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:29:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:29:05.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.407+0000 7f234b924980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:29:05.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.407+0000 7f234b924980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:29:05.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.411+0000 7f21877fe640 20 reqs_thread_entry: start 2024-03-09T14:29:05.437 INFO:teuthology.orchestra.run.smithi099.stdout:{"id":"160105e3-abe0-4c80-8c65-b187bbe6d91d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups"} 2024-03-09T14:29:05.437 DEBUG:tasks.util.rgw: json result: {'id': '160105e3-abe0-4c80-8c65-b187bbe6d91d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups'} 2024-03-09T14:29:05.437 INFO:tasks.rgw:Preparing directory for rgw datacache at /tmp/rgw_datacache 2024-03-09T14:29:05.437 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -p /tmp/rgw_datacache 2024-03-09T14:29:05.485 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod a+rwx /tmp/rgw_datacache 2024-03-09T14:29:05.539 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-03-09T14:29:05.539 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-03-09T14:29:05.539 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-03-09T14:29:05.613 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:29:05.614 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:29:05.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.651+0000 7f8fe2d45980 20 rados->read ofs=0 len=0 2024-03-09T14:29:05.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.655+0000 7f8fe2d45980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:05.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.655+0000 7f8fe2d45980 20 realm 2024-03-09T14:29:05.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.655+0000 7f8fe2d45980 20 rados->read ofs=0 len=0 2024-03-09T14:29:05.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.655+0000 7f8fe2d45980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:05.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.655+0000 7f8fe2d45980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:29:05.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.655+0000 7f8fe2d45980 20 rados->read ofs=0 len=0 2024-03-09T14:29:05.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.655+0000 7f8fe2d45980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:05.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.655+0000 7f8fe2d45980 20 rados->read ofs=0 len=0 2024-03-09T14:29:05.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.655+0000 7f8fe2d45980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:05.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.655+0000 7f8fe2d45980 20 rados->read ofs=0 len=0 2024-03-09T14:29:05.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.659+0000 7f8fe2d45980 20 rados_obj.operate() r=0 bl.length=973 2024-03-09T14:29:05.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.659+0000 7f8fe2d45980 20 searching for the correct realm 2024-03-09T14:29:05.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.663+0000 7f8fe105e640 0 -- 172.21.15.99:0/1007947247 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f8fd40da070 msgr2=0x7f8fd410b9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:29:05.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:05.878+0000 7f8fe005c640 0 -- 172.21.15.99:0/1007947247 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f8fd8069940 msgr2=0x7f8fd808f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:29:06.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.094+0000 7f8fe2d45980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:29:06.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.094+0000 7f8fe2d45980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:29:06.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.094+0000 7f8fe2d45980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:29:06.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.094+0000 7f8fe2d45980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:29:06.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.094+0000 7f8fe2d45980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:29:06.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.094+0000 7f8fe2d45980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:29:06.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.094+0000 7f8fe2d45980 20 rados->read ofs=0 len=0 2024-03-09T14:29:06.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.094+0000 7f8fe2d45980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:06.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.094+0000 7f8fe2d45980 20 rados->read ofs=0 len=0 2024-03-09T14:29:06.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.098+0000 7f8fe2d45980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:29:06.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.098+0000 7f8fe2d45980 20 rados->read ofs=0 len=0 2024-03-09T14:29:06.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.098+0000 7f8fe2d45980 20 rados_obj.operate() r=0 bl.length=398 2024-03-09T14:29:06.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.098+0000 7f8fe2d45980 20 zone default found 2024-03-09T14:29:06.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.098+0000 7f8fe2d45980 4 Realm: () 2024-03-09T14:29:06.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.098+0000 7f8fe2d45980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:29:06.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.098+0000 7f8fe2d45980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:29:06.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.098+0000 7f8fe2d45980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:29:06.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.098+0000 7f8fe2d45980 20 zonegroup default 2024-03-09T14:29:06.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.098+0000 7f8fe2d45980 20 rados->read ofs=0 len=0 2024-03-09T14:29:06.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.098+0000 7f8fe2d45980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:06.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.098+0000 7f8fe2d45980 20 rados->read ofs=0 len=0 2024-03-09T14:29:06.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.098+0000 7f8fe2d45980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:06.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.098+0000 7f8fe2d45980 20 rados->read ofs=0 len=0 2024-03-09T14:29:06.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.098+0000 7f8fe2d45980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:29:06.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.098+0000 7f8fe2d45980 20 started sync module instance, tier type = 2024-03-09T14:29:06.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.098+0000 7f8fe2d45980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:29:06.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.126+0000 7f8fe2d45980 20 add_watcher() i=0 2024-03-09T14:29:06.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.126+0000 7f8fe2d45980 20 add_watcher() i=1 2024-03-09T14:29:06.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.126+0000 7f8fe2d45980 20 add_watcher() i=2 2024-03-09T14:29:06.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.126+0000 7f8fe2d45980 20 add_watcher() i=3 2024-03-09T14:29:06.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.126+0000 7f8fe2d45980 20 add_watcher() i=4 2024-03-09T14:29:06.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.126+0000 7f8fe2d45980 20 add_watcher() i=5 2024-03-09T14:29:06.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.130+0000 7f8fe2d45980 20 add_watcher() i=6 2024-03-09T14:29:06.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.130+0000 7f8fe2d45980 20 add_watcher() i=7 2024-03-09T14:29:06.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.130+0000 7f8fe2d45980 2 all 8 watchers are set, enabling cache 2024-03-09T14:29:06.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.134+0000 7f8e977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:06.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.134+0000 7f8fe2d45980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:29:06.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.134+0000 7f8fe2d45980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:29:06.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.134+0000 7f8fe2d45980 5 note: GC not initialized 2024-03-09T14:29:06.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.134+0000 7f8e967e4640 20 reqs_thread_entry: start 2024-03-09T14:29:06.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.134+0000 7f8fe2d45980 20 init_complete bucket index max shards: 11 2024-03-09T14:29:06.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.134+0000 7f8fe2d45980 20 Filter name: none 2024-03-09T14:29:06.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.134+0000 7f8e8ffff640 20 reqs_thread_entry: start 2024-03-09T14:29:06.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.158+0000 7f8e977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:29:06.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.162+0000 7f8fe2d45980 20 remove_watcher() i=0 2024-03-09T14:29:06.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.162+0000 7f8fe2d45980 2 removed watcher, disabling cache 2024-03-09T14:29:06.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.162+0000 7f8fe2d45980 20 remove_watcher() i=1 2024-03-09T14:29:06.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.166+0000 7f8fe2d45980 20 remove_watcher() i=2 2024-03-09T14:29:06.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.166+0000 7f8fe2d45980 20 remove_watcher() i=3 2024-03-09T14:29:06.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.170+0000 7f8fe2d45980 20 remove_watcher() i=4 2024-03-09T14:29:06.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.174+0000 7f8fe2d45980 20 remove_watcher() i=5 2024-03-09T14:29:06.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.174+0000 7f8fe2d45980 20 remove_watcher() i=6 2024-03-09T14:29:06.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.174+0000 7f8fe2d45980 20 remove_watcher() i=7 2024-03-09T14:29:06.197 INFO:teuthology.orchestra.run.smithi099.stdout:[] 2024-03-09T14:29:06.197 DEBUG:tasks.util.rgw: json result: [] 2024-03-09T14:29:06.197 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-03-09T14:29:06.197 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-03-09T14:29:06.197 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-03-09T14:29:06.198 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-03-09T14:29:06.283 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:29:06.283 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:29:06.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.310+0000 7fdacbd75980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:29:06.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.310+0000 7fdacbd75980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:29:06.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.310+0000 7fd8fffff640 20 reqs_thread_entry: start 2024-03-09T14:29:06.334 INFO:teuthology.orchestra.run.smithi099.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-03-09T14:29:06.334 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-03-09T14:29:06.335 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-03-09T14:29:06.335 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-03-09T14:29:06.335 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-03-09T14:29:06.418 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:29:06.418 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:29:06.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.442+0000 7f2ec6961980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:29:06.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.442+0000 7f2ec6961980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:29:06.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.446+0000 7f2d0a7fc640 20 reqs_thread_entry: start 2024-03-09T14:29:06.473 INFO:teuthology.orchestra.run.smithi099.stdout:{"id":"160105e3-abe0-4c80-8c65-b187bbe6d91d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups"} 2024-03-09T14:29:06.473 DEBUG:tasks.util.rgw: json result: {'id': '160105e3-abe0-4c80-8c65-b187bbe6d91d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups'} 2024-03-09T14:29:06.473 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-03-09T14:29:06.473 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-03-09T14:29:06.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-03-09T14:29:06.474 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-03-09T14:29:06.551 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:29:06.551 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:29:06.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.574+0000 7f0762c52980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:29:06.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.574+0000 7f0762c52980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:29:06.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.578+0000 7f061e7fc640 20 reqs_thread_entry: start 2024-03-09T14:29:06.600 INFO:teuthology.orchestra.run.smithi099.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-03-09T14:29:06.600 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-03-09T14:29:06.600 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-03-09T14:29:06.600 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-03-09T14:29:06.600 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-03-09T14:29:06.676 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:29:06.677 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:29:06.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.698+0000 7fdc39a94980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:29:06.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.698+0000 7fdc39a94980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:29:06.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:29:06.702+0000 7fdaf5ffb640 20 reqs_thread_entry: start 2024-03-09T14:29:06.729 INFO:teuthology.orchestra.run.smithi099.stdout:{"id":"160105e3-abe0-4c80-8c65-b187bbe6d91d","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups"} 2024-03-09T14:29:06.729 DEBUG:tasks.util.rgw: json result: {'id': '160105e3-abe0-4c80-8c65-b187bbe6d91d', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups'} 2024-03-09T14:29:06.729 INFO:tasks.rgw:Starting rgw... 2024-03-09T14:29:06.730 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0'} 2024-03-09T14:29:06.730 INFO:tasks.rgw:Using beast as radosgw frontend 2024-03-09T14:29:06.730 DEBUG:teuthology.orchestra.run.smithi099:> sudo echo -n https://smithi099.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-03-09T14:29:06.785 INFO:teuthology.orchestra.run.smithi099.stdout:https://smithi099.front.sepia.ceph.com:443 2024-03-09T14:29:06.786 DEBUG:teuthology.orchestra.run.smithi099:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-03-09T14:29:06.838 DEBUG:teuthology.orchestra.run.smithi099:> sudo keytool -import -alias smithi099.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-03-09T14:29:07.226 INFO:teuthology.orchestra.run.smithi099.stderr:Warning: use -cacerts option to access cacerts keystore 2024-03-09T14:29:07.478 INFO:teuthology.orchestra.run.smithi099.stderr:Certificate was added to keystore 2024-03-09T14:29:07.512 INFO:tasks.rgw.client.0:Restarting daemon 2024-03-09T14:29:07.513 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-03-09T14:29:07.515 INFO:tasks.rgw.client.0:Started 2024-03-09T14:29:07.515 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi099.front.sepia.ceph.com:443/ 2024-03-09T14:29:07.515 DEBUG:teuthology.orchestra.run.smithi099:> curl https://smithi099.front.sepia.ceph.com:443/ 2024-03-09T14:29:07.537 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-09T14:29:07.538 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-09T14:29:07.538 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-03-09T14:29:07.538 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-09T14:29:07.538 INFO:teuthology.orchestra.run.smithi099.stderr:curl: (7) Failed to connect to smithi099.front.sepia.ceph.com port 443 after 0 ms: Connection refused 2024-03-09T14:29:08.110 INFO:tasks.rgw.client.0.smithi099.stdout:2024-03-09T14:29:08.110+0000 7f28aa293a40 -1 ssl_private_key was not found: rgw/cert//default.key 2024-03-09T14:29:08.539 DEBUG:teuthology.orchestra.run.smithi099:> curl https://smithi099.front.sepia.ceph.com:443/ 2024-03-09T14:29:08.550 INFO:teuthology.orchestra.run.smithi099.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-09T14:29:08.550 INFO:teuthology.orchestra.run.smithi099.stderr: Dload Upload Total Spent Left Speed 2024-03-09T14:29:08.670 INFO:teuthology.orchestra.run.smithi099.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 1565 0 --:--:-- --:--:-- --:--:-- 1571 2024-03-09T14:29:08.674 INFO:teuthology.orchestra.run.smithi099.stdout:anonymous 2024-03-09T14:29:08.675 INFO:teuthology.run_tasks:Running task tox... 2024-03-09T14:29:08.686 INFO:tasks.tox:Deploying tox from pip... 2024-03-09T14:29:08.686 DEBUG:teuthology.orchestra.run.smithi099:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-03-09T14:29:11.763 DEBUG:teuthology.orchestra.run.smithi099:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-03-09T14:29:12.477 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting tox==3.15.0 2024-03-09T14:29:12.589 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-03-09T14:29:12.658 INFO:teuthology.orchestra.run.smithi099.stdout: ---------------------------------------- 82.1/82.1 KB 1.2 MB/s eta 0:00:00 2024-03-09T14:29:12.795 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting py<2,>=1.4.17 2024-03-09T14:29:12.813 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-03-09T14:29:12.859 INFO:teuthology.orchestra.run.smithi099.stdout: ---------------------------------------- 98.7/98.7 KB 2.1 MB/s eta 0:00:00 2024-03-09T14:29:12.950 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting pluggy<1,>=0.12.0 2024-03-09T14:29:12.970 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-03-09T14:29:13.086 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting six<2,>=1.14.0 2024-03-09T14:29:13.105 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-09T14:29:13.388 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-03-09T14:29:13.408 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading virtualenv-20.25.1-py3-none-any.whl (3.8 MB) 2024-03-09T14:29:13.563 INFO:teuthology.orchestra.run.smithi099.stdout: ---------------------------------------- 3.8/3.8 MB 25.0 MB/s eta 0:00:00 2024-03-09T14:29:13.675 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting toml>=0.9.4 2024-03-09T14:29:13.695 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-03-09T14:29:13.835 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting filelock<4,>=3.0.0 2024-03-09T14:29:13.853 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading filelock-3.13.1-py3-none-any.whl (11 kB) 2024-03-09T14:29:13.992 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting packaging>=14 2024-03-09T14:29:14.010 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading packaging-23.2-py3-none-any.whl (53 kB) 2024-03-09T14:29:14.048 INFO:teuthology.orchestra.run.smithi099.stdout: ---------------------------------------- 53.0/53.0 KB 1.3 MB/s eta 0:00:00 2024-03-09T14:29:14.196 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting distlib<1,>=0.3.7 2024-03-09T14:29:14.214 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-03-09T14:29:14.250 INFO:teuthology.orchestra.run.smithi099.stdout: -------------------------------------- 468.9/468.9 KB 14.9 MB/s eta 0:00:00 2024-03-09T14:29:14.361 INFO:teuthology.orchestra.run.smithi099.stdout:Collecting platformdirs<5,>=3.9.1 2024-03-09T14:29:14.381 INFO:teuthology.orchestra.run.smithi099.stdout: Downloading platformdirs-4.2.0-py3-none-any.whl (17 kB) 2024-03-09T14:29:14.573 INFO:teuthology.orchestra.run.smithi099.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-03-09T14:29:15.608 INFO:teuthology.orchestra.run.smithi099.stdout:Successfully installed distlib-0.3.8 filelock-3.13.1 packaging-23.2 platformdirs-4.2.0 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.25.1 2024-03-09T14:29:15.693 INFO:teuthology.run_tasks:Running task workunit... 2024-03-09T14:29:15.705 INFO:tasks.workunit:Pulling workunits from ref c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:29:15.706 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-09T14:29:15.706 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:29:15.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:29:15.711 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-09T14:29:15.711 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:29:15.757 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-09T14:29:15.758 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-09T14:29:15.805 INFO:tasks.workunit:timeout=3h 2024-03-09T14:29:15.805 INFO:tasks.workunit:cleanup=True 2024-03-09T14:29:15.806 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:29:15.856 INFO:tasks.workunit.client.0.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-09T14:30:30.608 INFO:tasks.workunit.client.0.smithi099.stderr:Note: switching to 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'. 2024-03-09T14:30:30.609 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:30:30.609 INFO:tasks.workunit.client.0.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-09T14:30:30.609 INFO:tasks.workunit.client.0.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-09T14:30:30.609 INFO:tasks.workunit.client.0.smithi099.stderr:state without impacting any branches by switching back to a branch. 2024-03-09T14:30:30.609 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:30:30.609 INFO:tasks.workunit.client.0.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-09T14:30:30.609 INFO:tasks.workunit.client.0.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-09T14:30:30.609 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:30:30.609 INFO:tasks.workunit.client.0.smithi099.stderr: git switch -c 2024-03-09T14:30:30.609 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:30:30.610 INFO:tasks.workunit.client.0.smithi099.stderr:Or undo this operation with: 2024-03-09T14:30:30.610 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:30:30.610 INFO:tasks.workunit.client.0.smithi099.stderr: git switch - 2024-03-09T14:30:30.610 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:30:30.610 INFO:tasks.workunit.client.0.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-09T14:30:30.610 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:30:30.610 INFO:tasks.workunit.client.0.smithi099.stderr:HEAD is now at c00d9c609fb DNM: point s3tests at branch cbodley:wip-iam-user-apis 2024-03-09T14:30:30.613 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-09T14:30:30.660 INFO:tasks.workunit.client.0.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-09T14:30:30.663 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:30:30.663 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-09T14:30:31.454 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-09T14:30:31.535 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-09T14:30:31.580 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:30:31.582 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:30:31.582 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-09T14:30:31.624 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:30:31.628 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:30:31.628 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-09T14:30:31.674 INFO:tasks.workunit:Running workunits matching rgw/run-datacache.sh on client.0... 2024-03-09T14:30:31.675 INFO:tasks.workunit:Running workunit rgw/run-datacache.sh... 2024-03-09T14:30:31.675 DEBUG:teuthology.orchestra.run.smithi099:workunit test rgw/run-datacache.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 RGW_DATACACHE_PATH=/tmp/rgw_datacache adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-03-09T14:30:31.731 INFO:tasks.workunit.client.0.smithi099.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-datacache.sh 2024-03-09T14:30:31.731 INFO:tasks.workunit.client.0.smithi099.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:30:31.732 INFO:tasks.workunit.client.0.smithi099.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:30:34.637 INFO:tasks.workunit.client.0.smithi099.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-03-09T14:30:34.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ deactivate nondestructive 2024-03-09T14:30:34.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-03-09T14:30:34.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-03-09T14:30:34.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:30:34.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ hash -r 2024-03-09T14:30:34.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-03-09T14:30:34.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset VIRTUAL_ENV 2024-03-09T14:30:34.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-03-09T14:30:34.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-03-09T14:30:34.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:30:34.637 INFO:tasks.workunit.client.0.smithi099.stderr:++ export VIRTUAL_ENV 2024-03-09T14:30:34.638 INFO:tasks.workunit.client.0.smithi099.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-03-09T14:30:34.638 INFO:tasks.workunit.client.0.smithi099.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-03-09T14:30:34.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ export PATH 2024-03-09T14:30:34.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-03-09T14:30:34.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2024-03-09T14:30:34.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ _OLD_VIRTUAL_PS1= 2024-03-09T14:30:34.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ PS1='(rgw) ' 2024-03-09T14:30:34.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ export PS1 2024-03-09T14:30:34.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-03-09T14:30:34.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ export VIRTUAL_ENV_PROMPT 2024-03-09T14:30:34.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:30:34.639 INFO:tasks.workunit.client.0.smithi099.stderr:++ hash -r 2024-03-09T14:30:34.639 INFO:tasks.workunit.client.0.smithi099.stderr:+ pip install pip --upgrade 2024-03-09T14:30:34.994 INFO:tasks.workunit.client.0.smithi099.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-03-09T14:30:35.247 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting pip 2024-03-09T14:30:35.354 INFO:tasks.workunit.client.0.smithi099.stdout: Downloading pip-24.0-py3-none-any.whl (2.1 MB) 2024-03-09T14:30:35.726 INFO:tasks.workunit.client.0.smithi099.stdout: ---------------------------------------- 2.1/2.1 MB 5.8 MB/s eta 0:00:00 2024-03-09T14:30:35.804 INFO:tasks.workunit.client.0.smithi099.stdout:Installing collected packages: pip 2024-03-09T14:30:35.804 INFO:tasks.workunit.client.0.smithi099.stdout: Attempting uninstall: pip 2024-03-09T14:30:35.804 INFO:tasks.workunit.client.0.smithi099.stdout: Found existing installation: pip 22.0.2 2024-03-09T14:30:36.094 INFO:tasks.workunit.client.0.smithi099.stdout: Uninstalling pip-22.0.2: 2024-03-09T14:30:36.100 INFO:tasks.workunit.client.0.smithi099.stdout: Successfully uninstalled pip-22.0.2 2024-03-09T14:30:37.157 INFO:tasks.workunit.client.0.smithi099.stdout:Successfully installed pip-24.0 2024-03-09T14:30:37.228 INFO:tasks.workunit.client.0.smithi099.stderr:+ pip install configobj 2024-03-09T14:30:37.797 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting configobj 2024-03-09T14:30:37.928 INFO:tasks.workunit.client.0.smithi099.stdout: Downloading configobj-5.0.8-py2.py3-none-any.whl.metadata (3.4 kB) 2024-03-09T14:30:38.080 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting six (from configobj) 2024-03-09T14:30:38.100 INFO:tasks.workunit.client.0.smithi099.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-03-09T14:30:38.184 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading configobj-5.0.8-py2.py3-none-any.whl (36 kB) 2024-03-09T14:30:38.277 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-09T14:30:38.393 INFO:tasks.workunit.client.0.smithi099.stdout:Installing collected packages: six, configobj 2024-03-09T14:30:38.554 INFO:tasks.workunit.client.0.smithi099.stdout:Successfully installed configobj-5.0.8 six-1.16.0 2024-03-09T14:30:39.002 INFO:tasks.workunit.client.0.smithi099.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_datacache.py 2024-03-09T14:30:39.035 INFO:tasks.workunit.client.0.smithi099.stderr:DEBUG:root:datacache dir from config is: /tmp/rgw_datacache 2024-03-09T14:30:39.035 INFO:tasks.workunit.client.0.smithi099.stderr:DEBUG:root:exec_cmd(pwd) 2024-03-09T14:30:39.037 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:command succeeded 2024-03-09T14:30:39.037 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:b'/home/ubuntu/cephtest/mnt.0/client.0/tmp\n' 2024-03-09T14:30:39.037 INFO:tasks.workunit.client.0.smithi099.stderr:DEBUG:root:pwd is: /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:30:39.037 INFO:tasks.workunit.client.0.smithi099.stderr:DEBUG:root:exec_cmd(sudo netstat -nltp | egrep "rados|valgr") 2024-03-09T14:30:39.127 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:command succeeded 2024-03-09T14:30:39.127 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:b'tcp 0 0 0.0.0.0:443 0.0.0.0:* LISTEN 38361/radosgw \ntcp6 0 0 :::443 :::* LISTEN 38361/radosgw \n' 2024-03-09T14:30:39.127 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:radosgw port: 443 2024-03-09T14:30:39.127 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:radosgw endpoint is: 127.0.0.1 2024-03-09T14:30:39.127 INFO:tasks.workunit.client.0.smithi099.stderr:DEBUG:root:exec_cmd(dd if=/dev/urandom of=/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat bs=1M count=7) 2024-03-09T14:30:39.158 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:command succeeded 2024-03-09T14:30:39.158 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:b'' 2024-03-09T14:30:39.158 INFO:tasks.workunit.client.0.smithi099.stderr:DEBUG:root:exec_cmd(radosgw-admin user create --uid rgw_datacache_user --display-name DatacacheUser --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn) 2024-03-09T14:30:39.554 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:command succeeded 2024-03-09T14:30:39.554 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:b'{\n "user_id": "rgw_datacache_user",\n "display_name": "DatacacheUser",\n "email": "",\n "suspended": 0,\n "max_buckets": 1000,\n "subusers": [],\n "keys": [\n {\n "user": "rgw_datacache_user",\n "access_key": "NX5QOQKC6BH2IDN8HC7A",\n "secret_key": "LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn",\n "active": true,\n "create_date": "2024-03-09T14:30:39.509723Z"\n }\n ],\n "swift_keys": [],\n "caps": [],\n "op_mask": "read, write, delete",\n "default_placement": "",\n "default_storage_class": "",\n "placement_tags": [],\n "bucket_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "user_quota": {\n "enabled": false,\n "check_on_raw": false,\n "max_size": -1,\n "max_size_kb": 0,\n "max_objects": -1\n },\n "temp_url_keys": [],\n "type": "rgw",\n "mfa_ids": [],\n "account_id": "",\n "path": "/",\n "create_date": "2024-03-09T14:30:39.509682Z",\n "tags": [],\n "group_ids": []\n}\n\n' 2024-03-09T14:30:39.554 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:Creating s3cmd config... 2024-03-09T14:30:39.554 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:proto for s3cmd config is https 2024-03-09T14:30:39.554 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:s3cmd config written 2024-03-09T14:30:39.554 INFO:tasks.workunit.client.0.smithi099.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 mb s3://datacachebucket) 2024-03-09T14:30:39.796 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:command succeeded 2024-03-09T14:30:39.796 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:b"Bucket 's3://datacachebucket/' created\n" 2024-03-09T14:30:39.796 INFO:tasks.workunit.client.0.smithi099.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 put /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat s3://datacachebucket) 2024-03-09T14:30:40.172 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:command succeeded 2024-03-09T14:30:40.172 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:b"upload: '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M.dat' -> 's3://datacachebucket/7M.dat' (7340032 bytes in 0.2 seconds, 41.03 MB/s) [1 of 1]\n" 2024-03-09T14:30:40.172 INFO:tasks.workunit.client.0.smithi099.stderr:DEBUG:root:exec_cmd(s3cmd --access_key=NX5QOQKC6BH2IDN8HC7A --secret_key=LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --config=/home/ubuntu/cephtest/mnt.0/client.0/tmp/s3cfg --no-check-hostname --host=127.0.0.1 get s3://datacachebucket/7M.dat /home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat --force) 2024-03-09T14:30:40.413 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:command succeeded 2024-03-09T14:30:40.413 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:b"download: 's3://datacachebucket/7M.dat' -> '/home/ubuntu/cephtest/mnt.0/client.0/tmp/7M-get.dat' (7340032 bytes in 0.1 seconds, 137.49 MB/s)\n" 2024-03-09T14:30:40.413 INFO:tasks.workunit.client.0.smithi099.stderr:DEBUG:root:exec_cmd(radosgw-admin object stat --bucket=datacachebucket --object=7M.dat) 2024-03-09T14:30:40.576 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:command succeeded 2024-03-09T14:30:40.578 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:b'{\n "name": "7M.dat",\n "size": 7340228,\n "policy": {\n "acl": {\n "acl_user_map": [\n {\n "user": "rgw_datacache_user",\n "acl": 15\n }\n ],\n "acl_group_map": [],\n "grant_map": [\n {\n "id": "rgw_datacache_user",\n "grant": {\n "type": {\n "type": 0\n },\n "id": "rgw_datacache_user",\n "name": "DatacacheUser",\n "permission": {\n "flags": 15\n }\n }\n }\n ]\n },\n "owner": {\n "id": "rgw_datacache_user",\n "display_name": "DatacacheUser"\n }\n },\n "compression": {\n "compression_type": "zstd",\n "orig_size": 7340032,\n "blocks": [\n {\n "old_ofs": 0,\n "new_ofs": 0,\n "len": 4194414\n },\n {\n "old_ofs": 4194304,\n "new_ofs": 4194414,\n "len": 3145814\n }\n ]\n },\n "etag": "c6b5cf3a32b2d8f334d195e13a4b7e09",\n "tag": "160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17188859176033361200",\n "manifest": {\n "objs": [],\n "obj_size": 7340228,\n "explicit_objs": false,\n "head_size": 0,\n "max_head_size": 0,\n "prefix": ".FHytTZegbTtqiZenpdfsr5OQ6cfL-Vw_",\n "rules": [\n {\n "key": 0,\n "val": {\n "start_part_num": 0,\n "start_ofs": 0,\n "part_size": 0,\n "stripe_max_size": 6291456,\n "override_prefix": ""\n }\n }\n ],\n "tail_instance": "",\n "tail_placement": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1",\n "bucket_id": "160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "placement_rule": "default-placement"\n },\n "tier_type": "",\n "begin_iter": {\n "part_ofs": 0,\n "stripe_ofs": 0,\n "ofs": 0,\n "stripe_size": 6291456,\n "cur_part_id": 0,\n "cur_stripe": 0,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1",\n "bucket_id": "160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".FHytTZegbTtqiZenpdfsr5OQ6cfL-Vw_0",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n },\n "end_iter": {\n "part_ofs": 0,\n "stripe_ofs": 6291456,\n "ofs": 7340228,\n "stripe_size": 1048772,\n "cur_part_id": 0,\n "cur_stripe": 1,\n "cur_override_prefix": "",\n "location": {\n "placement_rule": "default-placement",\n "obj": {\n "bucket": {\n "name": "datacachebucket",\n "marker": "160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1",\n "bucket_id": "160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1",\n "tenant": "",\n "explicit_placement": {\n "data_pool": "",\n "data_extra_pool": "",\n "index_pool": ""\n }\n },\n "key": {\n "name": ".FHytTZegbTtqiZenpdfsr5OQ6cfL-Vw_1",\n "instance": "",\n "ns": "shadow"\n }\n },\n "raw_obj": {\n "pool": "",\n "oid": "",\n "loc": ""\n },\n "is_raw": false\n }\n }\n },\n "pg_ver": 0,\n "source_zone": 0,\n "torrent": "",\n "attrs": {\n "user.rgw.content_type": "application/octet-stream",\n "user.rgw.storage_class": "STANDARD",\n "user.rgw.tail_tag": "160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17188859176033361200",\n "user.rgw.x-amz-content-sha256": "9deaf99ddcb142b42811593e6d58866160ef9b3fdcb0e156a31f203d8ba58d4c",\n "user.rgw.x-amz-date": "20240309T143040Z",\n "user.rgw.x-amz-meta-s3cmd-attrs": "atime:1709994639/ctime:1709994639/gid:1271/gname:ubuntu/md5:c6b5cf3a32b2d8f334d195e13a4b7e09/mode:33204/mtime:1709994639/uid:1000/uname:ubuntu"\n }\n}\n' 2024-03-09T14:30:40.578 INFO:tasks.workunit.client.0.smithi099.stderr:DEBUG:root:Cached object name is: .FHytTZegbTtqiZenpdfsr5OQ6cfL-Vw_ 2024-03-09T14:30:40.578 INFO:tasks.workunit.client.0.smithi099.stderr:DEBUG:root:exec_cmd(find /tmp/rgw_datacache -type f | wc -l) 2024-03-09T14:30:40.579 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:command succeeded 2024-03-09T14:30:40.579 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:b'0\n' 2024-03-09T14:30:40.579 INFO:tasks.workunit.client.0.smithi099.stderr:DEBUG:root:Check cache dir content: 0 2024-03-09T14:30:40.579 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:NOTICE: datacache test object not found, inspect if datacache was bypassed or disabled during this check. 2024-03-09T14:30:40.579 INFO:tasks.workunit.client.0.smithi099.stderr:INFO:root:Completed Datacache tests 2024-03-09T14:30:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:+ deactivate 2024-03-09T14:30:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-03-09T14:30:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-03-09T14:30:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2024-03-09T14:30:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset _OLD_VIRTUAL_PATH 2024-03-09T14:30:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n '' ']' 2024-03-09T14:30:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:30:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:+ hash -r 2024-03-09T14:30:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n '' ']' 2024-03-09T14:30:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset VIRTUAL_ENV 2024-03-09T14:30:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-03-09T14:30:40.586 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' '!' '' = nondestructive ']' 2024-03-09T14:30:40.587 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset -f deactivate 2024-03-09T14:30:40.587 INFO:tasks.workunit.client.0.smithi099.stdout:OK. 2024-03-09T14:30:40.588 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo OK. 2024-03-09T14:30:40.588 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:30:40.588 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:30:40.646 INFO:tasks.workunit:Stopping ['rgw/run-datacache.sh'] on client.0... 2024-03-09T14:30:40.647 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-09T14:30:40.976 DEBUG:teuthology.parallel:result is None 2024-03-09T14:30:40.977 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:30:40.989 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:30:40.989 DEBUG:teuthology.orchestra.run.smithi099:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:30:41.041 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:30:41.041 INFO:teuthology.run_tasks:Running task workunit... 2024-03-09T14:30:41.051 INFO:tasks.workunit:Pulling workunits from ref c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:30:41.051 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-09T14:30:41.052 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:30:41.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:30:41.086 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-09T14:30:41.087 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:30:41.135 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-09T14:30:41.135 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-09T14:30:41.182 INFO:tasks.workunit:timeout=3h 2024-03-09T14:30:41.183 INFO:tasks.workunit:cleanup=True 2024-03-09T14:30:41.183 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:30:41.233 INFO:tasks.workunit.client.0.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-09T14:31:57.182 INFO:tasks.workunit.client.0.smithi099.stderr:Note: switching to 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'. 2024-03-09T14:31:57.182 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:31:57.182 INFO:tasks.workunit.client.0.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-09T14:31:57.182 INFO:tasks.workunit.client.0.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-09T14:31:57.183 INFO:tasks.workunit.client.0.smithi099.stderr:state without impacting any branches by switching back to a branch. 2024-03-09T14:31:57.183 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:31:57.183 INFO:tasks.workunit.client.0.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-09T14:31:57.183 INFO:tasks.workunit.client.0.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-09T14:31:57.183 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:31:57.183 INFO:tasks.workunit.client.0.smithi099.stderr: git switch -c 2024-03-09T14:31:57.183 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:31:57.183 INFO:tasks.workunit.client.0.smithi099.stderr:Or undo this operation with: 2024-03-09T14:31:57.183 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:31:57.183 INFO:tasks.workunit.client.0.smithi099.stderr: git switch - 2024-03-09T14:31:57.183 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:31:57.183 INFO:tasks.workunit.client.0.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-09T14:31:57.183 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:31:57.183 INFO:tasks.workunit.client.0.smithi099.stderr:HEAD is now at c00d9c609fb DNM: point s3tests at branch cbodley:wip-iam-user-apis 2024-03-09T14:31:57.187 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-09T14:31:57.238 INFO:tasks.workunit.client.0.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-09T14:31:57.241 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:31:57.241 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-09T14:31:57.300 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-09T14:31:57.355 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-09T14:31:57.401 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:31:57.402 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:31:57.402 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-09T14:31:57.446 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:31:57.449 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:31:57.449 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-09T14:31:57.497 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-03-09T14:31:57.499 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-03-09T14:31:57.499 DEBUG:teuthology.orchestra.run.smithi099:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-03-09T14:31:57.550 INFO:tasks.workunit.client.0.smithi099.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-03-09T14:31:57.552 INFO:tasks.workunit.client.0.smithi099.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:31:57.552 INFO:tasks.workunit.client.0.smithi099.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:32:00.502 INFO:tasks.workunit.client.0.smithi099.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-03-09T14:32:00.502 INFO:tasks.workunit.client.0.smithi099.stderr:++ deactivate nondestructive 2024-03-09T14:32:00.502 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-03-09T14:32:00.502 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-03-09T14:32:00.502 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:32:00.502 INFO:tasks.workunit.client.0.smithi099.stderr:++ hash -r 2024-03-09T14:32:00.502 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-03-09T14:32:00.502 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset VIRTUAL_ENV 2024-03-09T14:32:00.502 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-03-09T14:32:00.503 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-03-09T14:32:00.503 INFO:tasks.workunit.client.0.smithi099.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:32:00.503 INFO:tasks.workunit.client.0.smithi099.stderr:++ export VIRTUAL_ENV 2024-03-09T14:32:00.503 INFO:tasks.workunit.client.0.smithi099.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-03-09T14:32:00.503 INFO:tasks.workunit.client.0.smithi099.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-03-09T14:32:00.503 INFO:tasks.workunit.client.0.smithi099.stderr:++ export PATH 2024-03-09T14:32:00.503 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-03-09T14:32:00.503 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2024-03-09T14:32:00.503 INFO:tasks.workunit.client.0.smithi099.stderr:++ _OLD_VIRTUAL_PS1= 2024-03-09T14:32:00.503 INFO:tasks.workunit.client.0.smithi099.stderr:++ PS1='(rgw) ' 2024-03-09T14:32:00.503 INFO:tasks.workunit.client.0.smithi099.stderr:++ export PS1 2024-03-09T14:32:00.503 INFO:tasks.workunit.client.0.smithi099.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-03-09T14:32:00.503 INFO:tasks.workunit.client.0.smithi099.stderr:++ export VIRTUAL_ENV_PROMPT 2024-03-09T14:32:00.503 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:32:00.503 INFO:tasks.workunit.client.0.smithi099.stderr:++ hash -r 2024-03-09T14:32:00.504 INFO:tasks.workunit.client.0.smithi099.stderr:+ pip install pip --upgrade 2024-03-09T14:32:00.892 INFO:tasks.workunit.client.0.smithi099.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-03-09T14:32:01.123 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting pip 2024-03-09T14:32:01.129 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-03-09T14:32:01.165 INFO:tasks.workunit.client.0.smithi099.stdout:Installing collected packages: pip 2024-03-09T14:32:01.166 INFO:tasks.workunit.client.0.smithi099.stdout: Attempting uninstall: pip 2024-03-09T14:32:01.166 INFO:tasks.workunit.client.0.smithi099.stdout: Found existing installation: pip 22.0.2 2024-03-09T14:32:01.420 INFO:tasks.workunit.client.0.smithi099.stdout: Uninstalling pip-22.0.2: 2024-03-09T14:32:01.425 INFO:tasks.workunit.client.0.smithi099.stdout: Successfully uninstalled pip-22.0.2 2024-03-09T14:32:02.479 INFO:tasks.workunit.client.0.smithi099.stdout:Successfully installed pip-24.0 2024-03-09T14:32:02.551 INFO:tasks.workunit.client.0.smithi099.stderr:+ pip install boto3 2024-03-09T14:32:03.622 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting boto3 2024-03-09T14:32:03.740 INFO:tasks.workunit.client.0.smithi099.stdout: Downloading boto3-1.34.59-py3-none-any.whl.metadata (6.6 kB) 2024-03-09T14:32:04.432 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting botocore<1.35.0,>=1.34.59 (from boto3) 2024-03-09T14:32:04.451 INFO:tasks.workunit.client.0.smithi099.stdout: Downloading botocore-1.34.59-py3-none-any.whl.metadata (5.7 kB) 2024-03-09T14:32:04.588 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-03-09T14:32:04.607 INFO:tasks.workunit.client.0.smithi099.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-03-09T14:32:04.755 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-03-09T14:32:04.776 INFO:tasks.workunit.client.0.smithi099.stdout: Downloading s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-03-09T14:32:04.942 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:32:04.965 INFO:tasks.workunit.client.0.smithi099.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-03-09T14:32:05.189 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting urllib3<2.1,>=1.25.4 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:32:05.207 INFO:tasks.workunit.client.0.smithi099.stdout: Downloading urllib3-2.0.7-py3-none-any.whl.metadata (6.6 kB) 2024-03-09T14:32:05.475 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:32:05.476 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-03-09T14:32:05.511 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading boto3-1.34.59-py3-none-any.whl (139 kB) 2024-03-09T14:32:05.602 INFO:tasks.workunit.client.0.smithi099.stdout: ---------------------------------------- 139.3/139.3 kB 1.6 MB/s eta 0:00:00 2024-03-09T14:32:05.620 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading botocore-1.34.59-py3-none-any.whl (12.0 MB) 2024-03-09T14:32:05.918 INFO:tasks.workunit.client.0.smithi099.stdout: ---------------------------------------- 12.0/12.0 MB 42.1 MB/s eta 0:00:00 2024-03-09T14:32:05.936 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-03-09T14:32:06.008 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-03-09T14:32:06.067 INFO:tasks.workunit.client.0.smithi099.stdout: ---------------------------------------- 82.1/82.1 kB 1.3 MB/s eta 0:00:00 2024-03-09T14:32:06.088 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-03-09T14:32:06.141 INFO:tasks.workunit.client.0.smithi099.stdout: ---------------------------------------- 229.9/229.9 kB 4.4 MB/s eta 0:00:00 2024-03-09T14:32:06.159 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading urllib3-2.0.7-py3-none-any.whl (124 kB) 2024-03-09T14:32:06.217 INFO:tasks.workunit.client.0.smithi099.stdout: ---------------------------------------- 124.2/124.2 kB 2.1 MB/s eta 0:00:00 2024-03-09T14:32:06.219 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-09T14:32:06.341 INFO:tasks.workunit.client.0.smithi099.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-03-09T14:32:07.534 INFO:tasks.workunit.client.0.smithi099.stdout:Successfully installed boto3-1.34.59 botocore-1.34.59 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.0 six-1.16.0 urllib3-2.0.7 2024-03-09T14:32:07.704 INFO:tasks.workunit.client.0.smithi099.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-03-09T14:32:07.852 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-03-09T14:32:07.891 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:07.891 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:07.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:07.926+0000 7f442a3a8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:07.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:07.930+0000 7f442a3a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:07.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:07.930+0000 7f442a3a8980 20 realm 2024-03-09T14:32:07.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:07.930+0000 7f442a3a8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:07.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:07.930+0000 7f442a3a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:07.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:07.930+0000 7f442a3a8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:07.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:07.930+0000 7f442a3a8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:07.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:07.930+0000 7f442a3a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:07.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:07.930+0000 7f442a3a8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:07.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:07.930+0000 7f442a3a8980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:07.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:07.930+0000 7f442a3a8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:07.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:07.934+0000 7f442a3a8980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:07.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:07.934+0000 7f442a3a8980 20 searching for the correct realm 2024-03-09T14:32:07.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:07.938+0000 7f44276bf640 0 -- 172.21.15.99:0/2818081244 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f4410017070 msgr2=0x7f4410053710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:07.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:07.942+0000 7f44276bf640 0 -- 172.21.15.99:0/2818081244 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f4420008040 msgr2=0x7f4420061850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:08.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.158+0000 7f442a3a8980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:08.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.158+0000 7f442a3a8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:08.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.158+0000 7f442a3a8980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:08.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.158+0000 7f442a3a8980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:08.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.158+0000 7f442a3a8980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:08.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.158+0000 7f442a3a8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:08.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.158+0000 7f442a3a8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:08.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.158+0000 7f442a3a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:08.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.158+0000 7f442a3a8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:08.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.162+0000 7f442a3a8980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:08.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.162+0000 7f442a3a8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:08.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.162+0000 7f442a3a8980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:08.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.162+0000 7f442a3a8980 20 zone default found 2024-03-09T14:32:08.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.162+0000 7f442a3a8980 4 Realm: () 2024-03-09T14:32:08.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.162+0000 7f442a3a8980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:08.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.162+0000 7f442a3a8980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:08.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.162+0000 7f442a3a8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:08.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.162+0000 7f442a3a8980 20 zonegroup default 2024-03-09T14:32:08.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.162+0000 7f442a3a8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:08.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.162+0000 7f442a3a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:08.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.162+0000 7f442a3a8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:08.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.162+0000 7f442a3a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:08.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.162+0000 7f442a3a8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:08.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.162+0000 7f442a3a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:08.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.162+0000 7f442a3a8980 20 started sync module instance, tier type = 2024-03-09T14:32:08.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.162+0000 7f442a3a8980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:08.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.190+0000 7f442a3a8980 20 add_watcher() i=0 2024-03-09T14:32:08.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.190+0000 7f442a3a8980 20 add_watcher() i=1 2024-03-09T14:32:08.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.190+0000 7f442a3a8980 20 add_watcher() i=2 2024-03-09T14:32:08.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.190+0000 7f442a3a8980 20 add_watcher() i=3 2024-03-09T14:32:08.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.190+0000 7f442a3a8980 20 add_watcher() i=4 2024-03-09T14:32:08.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.190+0000 7f442a3a8980 20 add_watcher() i=5 2024-03-09T14:32:08.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.190+0000 7f442a3a8980 20 add_watcher() i=6 2024-03-09T14:32:08.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.194+0000 7f442a3a8980 20 add_watcher() i=7 2024-03-09T14:32:08.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.194+0000 7f442a3a8980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:08.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.198+0000 7f42ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:08.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.198+0000 7f442a3a8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:08.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.198+0000 7f442a3a8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:08.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.198+0000 7f442a3a8980 5 note: GC not initialized 2024-03-09T14:32:08.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.202+0000 7f42dcfe1640 20 reqs_thread_entry: start 2024-03-09T14:32:08.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.202+0000 7f442a3a8980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:08.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.202+0000 7f442a3a8980 20 Filter name: none 2024-03-09T14:32:08.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.202+0000 7f42567fc640 20 reqs_thread_entry: start 2024-03-09T14:32:08.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.202+0000 7f442a3a8980 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-03-09T14:32:08.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.202+0000 7f442a3a8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:08.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.202+0000 7f442a3a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:08.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.202+0000 7f442a3a8980 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-03-09T14:32:08.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.202+0000 7f442a3a8980 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-03-09T14:32:08.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.202+0000 7f442a3a8980 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-03-09T14:32:08.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.202+0000 7f442a3a8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:08.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.202+0000 7f442a3a8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:08.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.202+0000 7f442a3a8980 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-03-09T14:32:08.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.202+0000 7f442a3a8980 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-03-09T14:32:08.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.202+0000 7f442a3a8980 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-03-09T14:32:08.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.202+0000 7f442a3a8980 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-03-09T14:32:08.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.206+0000 7f442a3a8980 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-03-09T14:32:08.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.206+0000 7f442a3a8980 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-03-09T14:32:08.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.206+0000 7f442a3a8980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-03-09T14:32:08.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.206+0000 7f4306ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789953 cookie 93976728898624 notifier 4619 bl.length()=593 2024-03-09T14:32:08.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.206+0000 7f4306ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-03-09T14:32:08.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.206+0000 7f4306ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-03-09T14:32:08.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.210+0000 7f442a3a8980 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-03-09T14:32:08.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.210+0000 7f442a3a8980 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-03-09T14:32:08.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.210+0000 7f442a3a8980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-03-09T14:32:08.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.210+0000 7f4306ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789952 cookie 93976728887232 notifier 4619 bl.length()=186 2024-03-09T14:32:08.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.210+0000 7f4306ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-03-09T14:32:08.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.210+0000 7f4306ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-03-09T14:32:08.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.214+0000 7f42ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:08.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.218+0000 7f442a3a8980 20 remove_watcher() i=0 2024-03-09T14:32:08.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.218+0000 7f442a3a8980 2 removed watcher, disabling cache 2024-03-09T14:32:08.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.222+0000 7f442a3a8980 20 remove_watcher() i=1 2024-03-09T14:32:08.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.222+0000 7f442a3a8980 20 remove_watcher() i=2 2024-03-09T14:32:08.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.226+0000 7f442a3a8980 20 remove_watcher() i=3 2024-03-09T14:32:08.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.226+0000 7f442a3a8980 20 remove_watcher() i=4 2024-03-09T14:32:08.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.230+0000 7f442a3a8980 20 remove_watcher() i=5 2024-03-09T14:32:08.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.230+0000 7f442a3a8980 20 remove_watcher() i=6 2024-03-09T14:32:08.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.234+0000 7f442a3a8980 20 remove_watcher() i=7 2024-03-09T14:32:08.409 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:08.409 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:08.458 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:08.458 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:08.505 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:08.505 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:08.533 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:08.533 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:08.555 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:08.555 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:08.561 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:08.561 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:08.578 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:08.579 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:08.585 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:08.585 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:08.594 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:08.594 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:08.635 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:08.635 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:08.644 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:08.644 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:08.684 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:08.684 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:08.693 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:08.693 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:08.733 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:08.734 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:08.742 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:08.743 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:08.784 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:08.784 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:08.790 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: recalculated bucket check stats are correct 2024-03-09T14:32:08.790 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:32:08.791 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-03-09T14:32:08.823 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:08.823 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:08.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.866+0000 7f2f08d31980 20 rados->read ofs=0 len=0 2024-03-09T14:32:08.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.866+0000 7f2f08d31980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:08.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.866+0000 7f2f08d31980 20 realm 2024-03-09T14:32:08.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.866+0000 7f2f08d31980 20 rados->read ofs=0 len=0 2024-03-09T14:32:08.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.866+0000 7f2f08d31980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:08.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.866+0000 7f2f08d31980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:08.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.866+0000 7f2f08d31980 20 rados->read ofs=0 len=0 2024-03-09T14:32:08.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.866+0000 7f2f08d31980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:08.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.866+0000 7f2f08d31980 20 rados->read ofs=0 len=0 2024-03-09T14:32:08.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.870+0000 7f2f08d31980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:08.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.870+0000 7f2f08d31980 20 rados->read ofs=0 len=0 2024-03-09T14:32:08.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.870+0000 7f2f08d31980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:08.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.870+0000 7f2f08d31980 20 searching for the correct realm 2024-03-09T14:32:08.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.870+0000 7f2f06849640 0 -- 172.21.15.99:0/3542271007 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x55bd41149e40 msgr2=0x55bd4114c300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:08.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:08.878+0000 7f2f06849640 0 -- 172.21.15.99:0/3542271007 >> [v2:172.21.15.179:6804/2511961392,v1:172.21.15.179:6806/2511961392] conn(0x7f2f00026070 msgr2=0x7f2f0005c4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:09.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.102+0000 7f2f08d31980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:09.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.102+0000 7f2f08d31980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:09.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.102+0000 7f2f08d31980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:09.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.102+0000 7f2f08d31980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:09.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.102+0000 7f2f08d31980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:09.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.102+0000 7f2f08d31980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:09.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.102+0000 7f2f08d31980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.102+0000 7f2f08d31980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:09.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.102+0000 7f2f08d31980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.102+0000 7f2f08d31980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:09.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.102+0000 7f2f08d31980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.102+0000 7f2f08d31980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:09.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.102+0000 7f2f08d31980 20 zone default found 2024-03-09T14:32:09.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.102+0000 7f2f08d31980 4 Realm: () 2024-03-09T14:32:09.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.106+0000 7f2f08d31980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:09.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.106+0000 7f2f08d31980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:09.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.106+0000 7f2f08d31980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:09.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.106+0000 7f2f08d31980 20 zonegroup default 2024-03-09T14:32:09.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.106+0000 7f2f08d31980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.106+0000 7f2f08d31980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:09.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.106+0000 7f2f08d31980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.106+0000 7f2f08d31980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:09.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.106+0000 7f2f08d31980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.106+0000 7f2f08d31980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:09.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.106+0000 7f2f08d31980 20 started sync module instance, tier type = 2024-03-09T14:32:09.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.106+0000 7f2f08d31980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:09.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.130+0000 7f2f08d31980 20 add_watcher() i=0 2024-03-09T14:32:09.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.130+0000 7f2f08d31980 20 add_watcher() i=1 2024-03-09T14:32:09.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.130+0000 7f2f08d31980 20 add_watcher() i=2 2024-03-09T14:32:09.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.130+0000 7f2f08d31980 20 add_watcher() i=3 2024-03-09T14:32:09.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.130+0000 7f2f08d31980 20 add_watcher() i=4 2024-03-09T14:32:09.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.130+0000 7f2f08d31980 20 add_watcher() i=5 2024-03-09T14:32:09.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.130+0000 7f2f08d31980 20 add_watcher() i=6 2024-03-09T14:32:09.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.134+0000 7f2f08d31980 20 add_watcher() i=7 2024-03-09T14:32:09.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.134+0000 7f2f08d31980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:09.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.138+0000 7f2dbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:09.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.138+0000 7f2f08d31980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:09.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.138+0000 7f2f08d31980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:09.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.138+0000 7f2f08d31980 5 note: GC not initialized 2024-03-09T14:32:09.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.138+0000 7f2dbcfe1640 20 reqs_thread_entry: start 2024-03-09T14:32:09.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.138+0000 7f2f08d31980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:09.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.142+0000 7f2f08d31980 20 Filter name: none 2024-03-09T14:32:09.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.142+0000 7f2db5ffb640 20 reqs_thread_entry: start 2024-03-09T14:32:09.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.142+0000 7f2f08d31980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:32:09.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.142+0000 7f2f08d31980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.142+0000 7f2f08d31980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:09.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.142+0000 7f2f08d31980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:32:09.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.142+0000 7f2f08d31980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:32:09.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.142+0000 7f2f08d31980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 : miss 2024-03-09T14:32:09.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.142+0000 7f2f08d31980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.142+0000 7f2f08d31980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:09.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.142+0000 7f2f08d31980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 info.flags=0x17 2024-03-09T14:32:09.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.142+0000 7f2f08d31980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 to cache LRU end 2024-03-09T14:32:09.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.142+0000 7f2f08d31980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:32:09.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.142+0000 7f2f08d31980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:32:09.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.142+0000 7f2f08d31980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 2024-03-09T14:32:09.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.142+0000 7f2f08d31980 20 list_objects_ordered: starting attempt 1 2024-03-09T14:32:09.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.142+0000 7f2f08d31980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:32:09.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.146+0000 7f2f08d31980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:32:09.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.146+0000 7f2f08d31980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:32:09.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.146+0000 7f2f08d31980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:32:09.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.146+0000 7f2f08d31980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:32:09.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.154+0000 7f2dbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:09.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.158+0000 7f2f08d31980 20 remove_watcher() i=0 2024-03-09T14:32:09.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.158+0000 7f2f08d31980 2 removed watcher, disabling cache 2024-03-09T14:32:09.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.162+0000 7f2f08d31980 20 remove_watcher() i=1 2024-03-09T14:32:09.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.166+0000 7f2f08d31980 20 remove_watcher() i=2 2024-03-09T14:32:09.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.166+0000 7f2f08d31980 20 remove_watcher() i=3 2024-03-09T14:32:09.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.170+0000 7f2f08d31980 20 remove_watcher() i=4 2024-03-09T14:32:09.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.170+0000 7f2f08d31980 20 remove_watcher() i=5 2024-03-09T14:32:09.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.170+0000 7f2f08d31980 20 remove_watcher() i=6 2024-03-09T14:32:09.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.174+0000 7f2f08d31980 20 remove_watcher() i=7 2024-03-09T14:32:09.193 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-03-09T14:32:09.222 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:09.222 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:09.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.262+0000 7f1e3567e980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.262+0000 7f1e3567e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:09.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.262+0000 7f1e3567e980 20 realm 2024-03-09T14:32:09.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.262+0000 7f1e3567e980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.262+0000 7f1e3567e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:09.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.262+0000 7f1e3567e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:09.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.262+0000 7f1e3567e980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.262+0000 7f1e3567e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:09.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.262+0000 7f1e3567e980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.266+0000 7f1e3567e980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:09.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.266+0000 7f1e3567e980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.266+0000 7f1e3567e980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:09.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.266+0000 7f1e3567e980 20 searching for the correct realm 2024-03-09T14:32:09.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.274+0000 7f1e33196640 0 -- 172.21.15.99:0/3244375670 >> [v2:172.21.15.179:6804/2511961392,v1:172.21.15.179:6806/2511961392] conn(0x7f1e2c02b070 msgr2=0x7f1e2c05b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:09.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.490+0000 7f1e32995640 0 -- 172.21.15.99:0/3244375670 >> [v2:172.21.15.179:6807/4275579646,v1:172.21.15.179:6811/4275579646] conn(0x559ff2f21c20 msgr2=0x559ff2f24010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:09.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.498+0000 7f1e3567e980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:09.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.498+0000 7f1e3567e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:09.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.498+0000 7f1e3567e980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:09.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.498+0000 7f1e3567e980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:09.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.498+0000 7f1e3567e980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:09.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.498+0000 7f1e3567e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:09.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.498+0000 7f1e3567e980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.498+0000 7f1e3567e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:09.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.498+0000 7f1e3567e980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.502+0000 7f1e3567e980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:09.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.502+0000 7f1e3567e980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.502+0000 7f1e3567e980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:09.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.502+0000 7f1e3567e980 20 zone default found 2024-03-09T14:32:09.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.502+0000 7f1e3567e980 4 Realm: () 2024-03-09T14:32:09.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.502+0000 7f1e3567e980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:09.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.502+0000 7f1e3567e980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:09.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.502+0000 7f1e3567e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:09.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.502+0000 7f1e3567e980 20 zonegroup default 2024-03-09T14:32:09.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.502+0000 7f1e3567e980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.502+0000 7f1e3567e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:09.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.502+0000 7f1e3567e980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.502+0000 7f1e3567e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:09.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.502+0000 7f1e3567e980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.502+0000 7f1e3567e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:09.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.502+0000 7f1e3567e980 20 started sync module instance, tier type = 2024-03-09T14:32:09.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.502+0000 7f1e3567e980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:09.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.530+0000 7f1e3567e980 20 add_watcher() i=0 2024-03-09T14:32:09.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.530+0000 7f1e3567e980 20 add_watcher() i=1 2024-03-09T14:32:09.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.530+0000 7f1e3567e980 20 add_watcher() i=2 2024-03-09T14:32:09.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.530+0000 7f1e3567e980 20 add_watcher() i=3 2024-03-09T14:32:09.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.530+0000 7f1e3567e980 20 add_watcher() i=4 2024-03-09T14:32:09.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.530+0000 7f1e3567e980 20 add_watcher() i=5 2024-03-09T14:32:09.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.530+0000 7f1e3567e980 20 add_watcher() i=6 2024-03-09T14:32:09.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.534+0000 7f1e3567e980 20 add_watcher() i=7 2024-03-09T14:32:09.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.534+0000 7f1e3567e980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:09.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.542+0000 7f1cea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:09.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.542+0000 7f1e3567e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:09.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.542+0000 7f1e3567e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:09.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.542+0000 7f1e3567e980 5 note: GC not initialized 2024-03-09T14:32:09.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.542+0000 7f1ce97e2640 20 reqs_thread_entry: start 2024-03-09T14:32:09.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.542+0000 7f1e3567e980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:09.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.542+0000 7f1e3567e980 20 Filter name: none 2024-03-09T14:32:09.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.542+0000 7f1ce27fc640 20 reqs_thread_entry: start 2024-03-09T14:32:09.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.542+0000 7f1e3567e980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.542+0000 7f1e3567e980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:09.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.542+0000 7f1e3567e980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.546+0000 7f1e3567e980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:09.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.546+0000 7f1e3567e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:32:09.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.546+0000 7f1e3567e980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.546+0000 7f1e3567e980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:09.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.546+0000 7f1e3567e980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.546+0000 7f1e3567e980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:09.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.546+0000 7f1e3567e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:32:09.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.546+0000 7f1e3567e980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.546+0000 7f1e3567e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:09.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.550+0000 7f1cea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:09.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.554+0000 7f1e3567e980 20 remove_watcher() i=0 2024-03-09T14:32:09.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.554+0000 7f1e3567e980 2 removed watcher, disabling cache 2024-03-09T14:32:09.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.558+0000 7f1e3567e980 20 remove_watcher() i=1 2024-03-09T14:32:09.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.558+0000 7f1e3567e980 20 remove_watcher() i=2 2024-03-09T14:32:09.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.562+0000 7f1e3567e980 20 remove_watcher() i=3 2024-03-09T14:32:09.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.562+0000 7f1e3567e980 20 remove_watcher() i=4 2024-03-09T14:32:09.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.566+0000 7f1e3567e980 20 remove_watcher() i=5 2024-03-09T14:32:09.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.566+0000 7f1e3567e980 20 remove_watcher() i=6 2024-03-09T14:32:09.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.570+0000 7f1e3567e980 20 remove_watcher() i=7 2024-03-09T14:32:09.587 INFO:tasks.workunit.client.0.smithi099.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 88, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-03-09T14:32:09.587 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check unlinked does not report normal entries 2024-03-09T14:32:09.587 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:32:09.587 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-03-09T14:32:09.619 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:09.619 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:09.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.658+0000 7f86a7c70980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.662+0000 7f86a7c70980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:09.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.662+0000 7f86a7c70980 20 realm 2024-03-09T14:32:09.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.662+0000 7f86a7c70980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.662+0000 7f86a7c70980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:09.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.662+0000 7f86a7c70980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:09.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.662+0000 7f86a7c70980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.662+0000 7f86a7c70980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:09.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.662+0000 7f86a7c70980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.866+0000 7f86a7c70980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:09.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.866+0000 7f86a7c70980 20 rados->read ofs=0 len=0 2024-03-09T14:32:09.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.866+0000 7f86a7c70980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:09.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.866+0000 7f86a7c70980 20 searching for the correct realm 2024-03-09T14:32:09.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.874+0000 7f86a5f89640 0 -- 172.21.15.99:0/4028966006 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x559d7d328aa0 msgr2=0x559d7d32ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:09.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:09.882+0000 7f86a4f87640 0 -- 172.21.15.99:0/4028966006 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f86a00fedc0 msgr2=0x7f86a012b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:10.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.098+0000 7f86a7c70980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:10.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.098+0000 7f86a7c70980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:10.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.098+0000 7f86a7c70980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:10.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.098+0000 7f86a7c70980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:10.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.098+0000 7f86a7c70980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:10.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.098+0000 7f86a7c70980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:10.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.098+0000 7f86a7c70980 20 rados->read ofs=0 len=0 2024-03-09T14:32:10.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.098+0000 7f86a7c70980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:10.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.098+0000 7f86a7c70980 20 rados->read ofs=0 len=0 2024-03-09T14:32:10.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.102+0000 7f86a7c70980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:10.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.102+0000 7f86a7c70980 20 rados->read ofs=0 len=0 2024-03-09T14:32:10.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.102+0000 7f86a7c70980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:10.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.102+0000 7f86a7c70980 20 zone default found 2024-03-09T14:32:10.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.102+0000 7f86a7c70980 4 Realm: () 2024-03-09T14:32:10.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.102+0000 7f86a7c70980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:10.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.102+0000 7f86a7c70980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:10.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.102+0000 7f86a7c70980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:10.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.102+0000 7f86a7c70980 20 zonegroup default 2024-03-09T14:32:10.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.102+0000 7f86a7c70980 20 rados->read ofs=0 len=0 2024-03-09T14:32:10.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.102+0000 7f86a7c70980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:10.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.102+0000 7f86a7c70980 20 rados->read ofs=0 len=0 2024-03-09T14:32:10.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.102+0000 7f86a7c70980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:10.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.102+0000 7f86a7c70980 20 rados->read ofs=0 len=0 2024-03-09T14:32:10.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.102+0000 7f86a7c70980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:10.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.102+0000 7f86a7c70980 20 started sync module instance, tier type = 2024-03-09T14:32:10.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.102+0000 7f86a7c70980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:10.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.134+0000 7f86a7c70980 20 add_watcher() i=0 2024-03-09T14:32:10.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.134+0000 7f86a7c70980 20 add_watcher() i=1 2024-03-09T14:32:10.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.134+0000 7f86a7c70980 20 add_watcher() i=2 2024-03-09T14:32:10.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.134+0000 7f86a7c70980 20 add_watcher() i=3 2024-03-09T14:32:10.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.134+0000 7f86a7c70980 20 add_watcher() i=4 2024-03-09T14:32:10.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.134+0000 7f86a7c70980 20 add_watcher() i=5 2024-03-09T14:32:10.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.134+0000 7f86a7c70980 20 add_watcher() i=6 2024-03-09T14:32:10.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.134+0000 7f86a7c70980 20 add_watcher() i=7 2024-03-09T14:32:10.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.134+0000 7f86a7c70980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:10.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.138+0000 7f855b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:10.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:10.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:10.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 5 note: GC not initialized 2024-03-09T14:32:10.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f855a7e4640 20 reqs_thread_entry: start 2024-03-09T14:32:10.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:10.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 20 Filter name: none 2024-03-09T14:32:10.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f84cbfff640 20 reqs_thread_entry: start 2024-03-09T14:32:10.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:32:10.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 20 rados->read ofs=0 len=0 2024-03-09T14:32:10.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:10.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:32:10.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:32:10.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 : miss 2024-03-09T14:32:10.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 20 rados->read ofs=0 len=0 2024-03-09T14:32:10.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:10.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 info.flags=0x17 2024-03-09T14:32:10.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 to cache LRU end 2024-03-09T14:32:10.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:32:10.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:32:10.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 2024-03-09T14:32:10.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.142+0000 7f86a7c70980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:10.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.146+0000 7f86a7c70980 1 NOTICE: finished shard 0 (0 entries found) 2024-03-09T14:32:10.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.146+0000 7f86a7c70980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:10.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.146+0000 7f86a7c70980 1 NOTICE: finished shard 1 (0 entries found) 2024-03-09T14:32:10.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.146+0000 7f86a7c70980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:10.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.146+0000 7f86a7c70980 1 NOTICE: finished shard 2 (0 entries found) 2024-03-09T14:32:10.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.146+0000 7f86a7c70980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:10.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.146+0000 7f86a7c70980 1 NOTICE: finished shard 3 (0 entries found) 2024-03-09T14:32:10.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.146+0000 7f86a7c70980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:10.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.146+0000 7f86a7c70980 1 NOTICE: finished shard 4 (0 entries found) 2024-03-09T14:32:10.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.146+0000 7f86a7c70980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:10.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.150+0000 7f86a7c70980 1 NOTICE: finished shard 5 (0 entries found) 2024-03-09T14:32:10.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.150+0000 7f86a7c70980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:10.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.150+0000 7f86a7c70980 1 NOTICE: finished shard 6 (0 entries found) 2024-03-09T14:32:10.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.150+0000 7f86a7c70980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:10.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.150+0000 7f86a7c70980 1 NOTICE: finished shard 7 (0 entries found) 2024-03-09T14:32:10.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.150+0000 7f86a7c70980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:10.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.154+0000 7f86a7c70980 1 NOTICE: finished shard 8 (0 entries found) 2024-03-09T14:32:10.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.154+0000 7f86a7c70980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:10.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.154+0000 7f86a7c70980 1 NOTICE: finished shard 9 (0 entries found) 2024-03-09T14:32:10.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.154+0000 7f86a7c70980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:10.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.154+0000 7f86a7c70980 1 NOTICE: finished shard 10 (0 entries found) 2024-03-09T14:32:10.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.154+0000 7f86a7c70980 1 NOTICE: finished all shards (0 entries found) 2024-03-09T14:32:10.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.158+0000 7f855b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:10.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.162+0000 7f86a7c70980 20 remove_watcher() i=0 2024-03-09T14:32:10.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.162+0000 7f86a7c70980 2 removed watcher, disabling cache 2024-03-09T14:32:10.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.166+0000 7f86a7c70980 20 remove_watcher() i=1 2024-03-09T14:32:10.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.166+0000 7f86a7c70980 20 remove_watcher() i=2 2024-03-09T14:32:10.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.170+0000 7f86a7c70980 20 remove_watcher() i=3 2024-03-09T14:32:10.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.174+0000 7f86a7c70980 20 remove_watcher() i=4 2024-03-09T14:32:10.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.174+0000 7f86a7c70980 20 remove_watcher() i=5 2024-03-09T14:32:10.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.174+0000 7f86a7c70980 20 remove_watcher() i=6 2024-03-09T14:32:10.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:10.178+0000 7f86a7c70980 20 remove_watcher() i=7 2024-03-09T14:32:10.199 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-03-09T14:32:10.610 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-03-09T14:32:12.033 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:12.033 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:12.102 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:32:12.102 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-09T14:32:12.137 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:12.137 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:12.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.178+0000 7f0a7c2e9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.178+0000 7f0a7c2e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:12.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.178+0000 7f0a7c2e9980 20 realm 2024-03-09T14:32:12.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.178+0000 7f0a7c2e9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.178+0000 7f0a7c2e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:12.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.178+0000 7f0a7c2e9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:12.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.178+0000 7f0a7c2e9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.178+0000 7f0a7c2e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:12.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.178+0000 7f0a7c2e9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.182+0000 7f0a7c2e9980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:12.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.182+0000 7f0a7c2e9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.182+0000 7f0a7c2e9980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:12.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.182+0000 7f0a7c2e9980 20 searching for the correct realm 2024-03-09T14:32:12.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.186+0000 7f0a79600640 0 -- 172.21.15.99:0/4206186964 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f0a6c060a50 msgr2=0x7f0a6c062a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:12.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.194+0000 7f0a79600640 0 -- 172.21.15.99:0/4206186964 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f0a7400c000 msgr2=0x7f0a7402c910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:32:12.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.406+0000 7f0a7c2e9980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:12.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.406+0000 7f0a7c2e9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:12.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.406+0000 7f0a7c2e9980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:12.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.406+0000 7f0a7c2e9980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:12.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.406+0000 7f0a7c2e9980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:12.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.406+0000 7f0a7c2e9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:12.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.406+0000 7f0a7c2e9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.410+0000 7f0a7c2e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:12.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.410+0000 7f0a7c2e9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.410+0000 7f0a7c2e9980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:12.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.410+0000 7f0a7c2e9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.410+0000 7f0a7c2e9980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:12.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.410+0000 7f0a7c2e9980 20 zone default found 2024-03-09T14:32:12.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.410+0000 7f0a7c2e9980 4 Realm: () 2024-03-09T14:32:12.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.410+0000 7f0a7c2e9980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:12.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.410+0000 7f0a7c2e9980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:12.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.410+0000 7f0a7c2e9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:12.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.410+0000 7f0a7c2e9980 20 zonegroup default 2024-03-09T14:32:12.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.410+0000 7f0a7c2e9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.410+0000 7f0a7c2e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:12.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.410+0000 7f0a7c2e9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.410+0000 7f0a7c2e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:12.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.410+0000 7f0a7c2e9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.414+0000 7f0a7c2e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:12.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.414+0000 7f0a7c2e9980 20 started sync module instance, tier type = 2024-03-09T14:32:12.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.414+0000 7f0a7c2e9980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:12.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.438+0000 7f0a7c2e9980 20 add_watcher() i=0 2024-03-09T14:32:12.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.438+0000 7f0a7c2e9980 20 add_watcher() i=1 2024-03-09T14:32:12.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.438+0000 7f0a7c2e9980 20 add_watcher() i=2 2024-03-09T14:32:12.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.438+0000 7f0a7c2e9980 20 add_watcher() i=3 2024-03-09T14:32:12.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.438+0000 7f0a7c2e9980 20 add_watcher() i=4 2024-03-09T14:32:12.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.438+0000 7f0a7c2e9980 20 add_watcher() i=5 2024-03-09T14:32:12.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.438+0000 7f0a7c2e9980 20 add_watcher() i=6 2024-03-09T14:32:12.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.438+0000 7f0a7c2e9980 20 add_watcher() i=7 2024-03-09T14:32:12.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.438+0000 7f0a7c2e9980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:12.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.442+0000 7f092b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:12.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.446+0000 7f0a7c2e9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:12.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.446+0000 7f0a7c2e9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:12.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.446+0000 7f0a7c2e9980 5 note: GC not initialized 2024-03-09T14:32:12.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.446+0000 7f092a7fc640 20 reqs_thread_entry: start 2024-03-09T14:32:12.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.446+0000 7f0a7c2e9980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:12.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.446+0000 7f0a7c2e9980 20 Filter name: none 2024-03-09T14:32:12.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.446+0000 7f089bfff640 20 reqs_thread_entry: start 2024-03-09T14:32:12.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.446+0000 7f0a7c2e9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.446+0000 7f0a7c2e9980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:12.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.446+0000 7f0a7c2e9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.446+0000 7f0a7c2e9980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:12.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.446+0000 7f0a7c2e9980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:32:12.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.446+0000 7f0a7c2e9980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:32:12.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.446+0000 7f0a7c2e9980 20 INFO: main: starting shard=0 2024-03-09T14:32:12.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.446+0000 7f0a7c2e9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:12.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.450+0000 7f0a7c2e9980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.450+0000 7f0a7c2e9980 20 INFO: main: starting shard=1 2024-03-09T14:32:12.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.450+0000 7f0a7c2e9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:12.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.450+0000 7f0a7c2e9980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.450+0000 7f0a7c2e9980 20 INFO: main: starting shard=2 2024-03-09T14:32:12.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.450+0000 7f0a7c2e9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:12.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.450+0000 7f0a7c2e9980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.450+0000 7f0a7c2e9980 20 INFO: main: starting shard=3 2024-03-09T14:32:12.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.450+0000 7f0a7c2e9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:12.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.450+0000 7f0a7c2e9980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.450+0000 7f0a7c2e9980 20 INFO: main: starting shard=4 2024-03-09T14:32:12.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.450+0000 7f0a7c2e9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:12.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.450+0000 7f0a7c2e9980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.450+0000 7f0a7c2e9980 20 INFO: main: starting shard=5 2024-03-09T14:32:12.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.450+0000 7f0a7c2e9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:12.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.454+0000 7f0a7c2e9980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.454+0000 7f0a7c2e9980 20 INFO: main: starting shard=6 2024-03-09T14:32:12.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.454+0000 7f0a7c2e9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:12.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.454+0000 7f0a7c2e9980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.454+0000 7f0a7c2e9980 20 INFO: main: starting shard=7 2024-03-09T14:32:12.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.454+0000 7f0a7c2e9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:12.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.454+0000 7f0a7c2e9980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.454+0000 7f0a7c2e9980 20 INFO: main: starting shard=8 2024-03-09T14:32:12.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.454+0000 7f0a7c2e9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:12.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.454+0000 7f0a7c2e9980 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-09T14:32:12.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.454+0000 7f0a7c2e9980 20 INFO: main: starting shard=9 2024-03-09T14:32:12.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.454+0000 7f0a7c2e9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:12.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.458+0000 7f0a7c2e9980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.458+0000 7f0a7c2e9980 20 INFO: main: starting shard=10 2024-03-09T14:32:12.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.458+0000 7f0a7c2e9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:12.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.458+0000 7f0a7c2e9980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.458+0000 7f0a7c2e9980 20 INFO: main: done 2024-03-09T14:32:12.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.458+0000 7f092b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:12.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.466+0000 7f0a7c2e9980 20 remove_watcher() i=0 2024-03-09T14:32:12.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.466+0000 7f0a7c2e9980 2 removed watcher, disabling cache 2024-03-09T14:32:12.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.466+0000 7f0a7c2e9980 20 remove_watcher() i=1 2024-03-09T14:32:12.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.470+0000 7f0a7c2e9980 20 remove_watcher() i=2 2024-03-09T14:32:12.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.470+0000 7f0a7c2e9980 20 remove_watcher() i=3 2024-03-09T14:32:12.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.474+0000 7f0a7c2e9980 20 remove_watcher() i=4 2024-03-09T14:32:12.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.474+0000 7f0a7c2e9980 20 remove_watcher() i=5 2024-03-09T14:32:12.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.478+0000 7f0a7c2e9980 20 remove_watcher() i=6 2024-03-09T14:32:12.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.478+0000 7f0a7c2e9980 20 remove_watcher() i=7 2024-03-09T14:32:12.503 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:12.503 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:12.507 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:12.507 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:12.573 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:32:12.574 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-09T14:32:12.610 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:12.610 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:12.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.650+0000 7fb0c86a5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.654+0000 7fb0c86a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:12.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.654+0000 7fb0c86a5980 20 realm 2024-03-09T14:32:12.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.654+0000 7fb0c86a5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.654+0000 7fb0c86a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:12.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.654+0000 7fb0c86a5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:12.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.654+0000 7fb0c86a5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.654+0000 7fb0c86a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:12.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.654+0000 7fb0c86a5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.654+0000 7fb0c86a5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:12.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.654+0000 7fb0c86a5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.654+0000 7fb0c86a5980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:12.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.654+0000 7fb0c86a5980 20 searching for the correct realm 2024-03-09T14:32:12.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.658+0000 7fb0c69be640 0 -- 172.21.15.99:0/746232234 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7fb0bc018070 msgr2=0x7fb0bc077540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:12.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.666+0000 7fb0c59bc640 0 -- 172.21.15.99:0/746232234 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fb0c00d8930 msgr2=0x7fb0c00b7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:32:12.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:12.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:12.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:12.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:12.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:12.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:12.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:12.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:12.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:12.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 20 zone default found 2024-03-09T14:32:12.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 4 Realm: () 2024-03-09T14:32:12.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:12.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:12.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:12.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 20 zonegroup default 2024-03-09T14:32:12.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.882+0000 7fb0c86a5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.886+0000 7fb0c86a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:12.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.886+0000 7fb0c86a5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.886+0000 7fb0c86a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:12.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.886+0000 7fb0c86a5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.886+0000 7fb0c86a5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:12.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.886+0000 7fb0c86a5980 20 started sync module instance, tier type = 2024-03-09T14:32:12.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.886+0000 7fb0c86a5980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:12.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.910+0000 7fb0c86a5980 20 add_watcher() i=0 2024-03-09T14:32:12.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.910+0000 7fb0c86a5980 20 add_watcher() i=1 2024-03-09T14:32:12.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.910+0000 7fb0c86a5980 20 add_watcher() i=2 2024-03-09T14:32:12.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.910+0000 7fb0c86a5980 20 add_watcher() i=3 2024-03-09T14:32:12.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.910+0000 7fb0c86a5980 20 add_watcher() i=4 2024-03-09T14:32:12.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.910+0000 7fb0c86a5980 20 add_watcher() i=5 2024-03-09T14:32:12.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.910+0000 7fb0c86a5980 20 add_watcher() i=6 2024-03-09T14:32:12.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.914+0000 7fb0c86a5980 20 add_watcher() i=7 2024-03-09T14:32:12.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.914+0000 7fb0c86a5980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:12.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.918+0000 7faf7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:12.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.918+0000 7fb0c86a5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:12.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.918+0000 7fb0c86a5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:12.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.918+0000 7fb0c86a5980 5 note: GC not initialized 2024-03-09T14:32:12.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.918+0000 7faf777fe640 20 reqs_thread_entry: start 2024-03-09T14:32:12.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.918+0000 7fb0c86a5980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:12.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.922+0000 7fb0c86a5980 20 Filter name: none 2024-03-09T14:32:12.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.922+0000 7faf757fa640 20 reqs_thread_entry: start 2024-03-09T14:32:12.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.922+0000 7fb0c86a5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.922+0000 7fb0c86a5980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:12.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.922+0000 7fb0c86a5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:12.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.922+0000 7fb0c86a5980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:12.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.922+0000 7fb0c86a5980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:32:12.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.922+0000 7fb0c86a5980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:32:12.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.922+0000 7fb0c86a5980 20 INFO: main: starting shard=0 2024-03-09T14:32:12.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.922+0000 7fb0c86a5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:12.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.922+0000 7fb0c86a5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.922+0000 7fb0c86a5980 20 INFO: main: starting shard=1 2024-03-09T14:32:12.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.922+0000 7fb0c86a5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:12.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.922+0000 7fb0c86a5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.922+0000 7fb0c86a5980 20 INFO: main: starting shard=2 2024-03-09T14:32:12.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.922+0000 7fb0c86a5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:12.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.926+0000 7fb0c86a5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.926+0000 7fb0c86a5980 20 INFO: main: starting shard=3 2024-03-09T14:32:12.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.926+0000 7fb0c86a5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:12.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.926+0000 7fb0c86a5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.926+0000 7fb0c86a5980 20 INFO: main: starting shard=4 2024-03-09T14:32:12.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.926+0000 7fb0c86a5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:12.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.926+0000 7fb0c86a5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.926+0000 7fb0c86a5980 20 INFO: main: starting shard=5 2024-03-09T14:32:12.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.926+0000 7fb0c86a5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:12.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.926+0000 7fb0c86a5980 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-09T14:32:12.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.926+0000 7fb0c86a5980 20 INFO: main: starting shard=6 2024-03-09T14:32:12.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.926+0000 7fb0c86a5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:12.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.930+0000 7fb0c86a5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.930+0000 7fb0c86a5980 20 INFO: main: starting shard=7 2024-03-09T14:32:12.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.930+0000 7fb0c86a5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:12.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.930+0000 7fb0c86a5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.930+0000 7fb0c86a5980 20 INFO: main: starting shard=8 2024-03-09T14:32:12.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.930+0000 7fb0c86a5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:12.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.930+0000 7fb0c86a5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.930+0000 7fb0c86a5980 20 INFO: main: starting shard=9 2024-03-09T14:32:12.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.930+0000 7fb0c86a5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:12.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.930+0000 7fb0c86a5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.930+0000 7fb0c86a5980 20 INFO: main: starting shard=10 2024-03-09T14:32:12.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.930+0000 7fb0c86a5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:12.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.934+0000 7fb0c86a5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:12.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.934+0000 7fb0c86a5980 20 INFO: main: done 2024-03-09T14:32:12.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.934+0000 7faf7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:12.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.938+0000 7fb0c86a5980 20 remove_watcher() i=0 2024-03-09T14:32:12.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.938+0000 7fb0c86a5980 2 removed watcher, disabling cache 2024-03-09T14:32:12.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.942+0000 7fb0c86a5980 20 remove_watcher() i=1 2024-03-09T14:32:12.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.942+0000 7fb0c86a5980 20 remove_watcher() i=2 2024-03-09T14:32:12.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.946+0000 7fb0c86a5980 20 remove_watcher() i=3 2024-03-09T14:32:12.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.946+0000 7fb0c86a5980 20 remove_watcher() i=4 2024-03-09T14:32:12.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.950+0000 7fb0c86a5980 20 remove_watcher() i=5 2024-03-09T14:32:12.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.954+0000 7fb0c86a5980 20 remove_watcher() i=6 2024-03-09T14:32:12.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:12.954+0000 7fb0c86a5980 20 remove_watcher() i=7 2024-03-09T14:32:12.974 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:12.974 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:12.979 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:12.979 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:13.046 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:32:13.046 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-03-09T14:32:13.079 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:13.080 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:13.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.122+0000 7f94d4515980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.122+0000 7f94d4515980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:13.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.122+0000 7f94d4515980 20 realm 2024-03-09T14:32:13.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.122+0000 7f94d4515980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.122+0000 7f94d4515980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:13.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.122+0000 7f94d4515980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:13.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.122+0000 7f94d4515980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.122+0000 7f94d4515980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:13.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.122+0000 7f94d4515980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.126+0000 7f94d4515980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:13.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.126+0000 7f94d4515980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.126+0000 7f94d4515980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:13.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.126+0000 7f94d4515980 20 searching for the correct realm 2024-03-09T14:32:13.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.130+0000 7f94d282e640 0 -- 172.21.15.99:0/4247329005 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f94c8032060 msgr2=0x7f94c805b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:32:13.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.138+0000 7f94d182c640 0 -- 172.21.15.99:0/4247329005 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f94cc024920 msgr2=0x7f94cc054400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:13.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:13.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:13.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:13.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:13.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:13.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:13.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:13.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:13.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:13.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 20 zone default found 2024-03-09T14:32:13.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 4 Realm: () 2024-03-09T14:32:13.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:13.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:13.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:13.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 20 zonegroup default 2024-03-09T14:32:13.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:13.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.354+0000 7f94d4515980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.358+0000 7f94d4515980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:13.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.358+0000 7f94d4515980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.358+0000 7f94d4515980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:13.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.358+0000 7f94d4515980 20 started sync module instance, tier type = 2024-03-09T14:32:13.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.358+0000 7f94d4515980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:13.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.390+0000 7f94d4515980 20 add_watcher() i=0 2024-03-09T14:32:13.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.390+0000 7f94d4515980 20 add_watcher() i=1 2024-03-09T14:32:13.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.390+0000 7f94d4515980 20 add_watcher() i=2 2024-03-09T14:32:13.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.390+0000 7f94d4515980 20 add_watcher() i=3 2024-03-09T14:32:13.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.390+0000 7f94d4515980 20 add_watcher() i=4 2024-03-09T14:32:13.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.390+0000 7f94d4515980 20 add_watcher() i=5 2024-03-09T14:32:13.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.390+0000 7f94d4515980 20 add_watcher() i=6 2024-03-09T14:32:13.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.390+0000 7f94d4515980 20 add_watcher() i=7 2024-03-09T14:32:13.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.390+0000 7f94d4515980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:13.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.390+0000 7f9388fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:13.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.390+0000 7f94d4515980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:13.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.390+0000 7f94d4515980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:13.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.390+0000 7f94d4515980 5 note: GC not initialized 2024-03-09T14:32:13.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f93037fe640 20 reqs_thread_entry: start 2024-03-09T14:32:13.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:13.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 Filter name: none 2024-03-09T14:32:13.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f93017fa640 20 reqs_thread_entry: start 2024-03-09T14:32:13.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:13.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:13.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:32:13.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:32:13.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 INFO: main: starting shard=0 2024-03-09T14:32:13.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:13.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 INFO: main: starting shard=1 2024-03-09T14:32:13.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:13.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:32:13.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 INFO: main: starting shard=2 2024-03-09T14:32:13.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:13.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 INFO: main: starting shard=3 2024-03-09T14:32:13.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:13.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 INFO: main: starting shard=4 2024-03-09T14:32:13.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:13.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 INFO: main: starting shard=5 2024-03-09T14:32:13.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.398+0000 7f94d4515980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:13.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.402+0000 7f94d4515980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.402+0000 7f94d4515980 20 INFO: main: starting shard=6 2024-03-09T14:32:13.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.402+0000 7f94d4515980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:13.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.402+0000 7f94d4515980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.402+0000 7f94d4515980 20 INFO: main: starting shard=7 2024-03-09T14:32:13.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.402+0000 7f94d4515980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:13.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.402+0000 7f94d4515980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.402+0000 7f94d4515980 20 INFO: main: starting shard=8 2024-03-09T14:32:13.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.402+0000 7f94d4515980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:13.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.402+0000 7f94d4515980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.402+0000 7f94d4515980 20 INFO: main: starting shard=9 2024-03-09T14:32:13.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.402+0000 7f94d4515980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:13.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.406+0000 7f94d4515980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.406+0000 7f94d4515980 20 INFO: main: starting shard=10 2024-03-09T14:32:13.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.406+0000 7f94d4515980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:13.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.406+0000 7f94d4515980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.406+0000 7f94d4515980 20 INFO: main: done 2024-03-09T14:32:13.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.406+0000 7f9388fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:13.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.418+0000 7f94d4515980 20 remove_watcher() i=0 2024-03-09T14:32:13.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.418+0000 7f94d4515980 2 removed watcher, disabling cache 2024-03-09T14:32:13.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.418+0000 7f94d4515980 20 remove_watcher() i=1 2024-03-09T14:32:13.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.418+0000 7f94d4515980 20 remove_watcher() i=2 2024-03-09T14:32:13.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.418+0000 7f94d4515980 20 remove_watcher() i=3 2024-03-09T14:32:13.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.422+0000 7f94d4515980 20 remove_watcher() i=4 2024-03-09T14:32:13.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.422+0000 7f94d4515980 20 remove_watcher() i=5 2024-03-09T14:32:13.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.426+0000 7f94d4515980 20 remove_watcher() i=6 2024-03-09T14:32:13.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.430+0000 7f94d4515980 20 remove_watcher() i=7 2024-03-09T14:32:13.456 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:13.456 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:13.461 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:13.461 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:13.529 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:32:13.530 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-03-09T14:32:13.564 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:13.564 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:13.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.610+0000 7f3c7d04f980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.614+0000 7f3c7d04f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:13.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.614+0000 7f3c7d04f980 20 realm 2024-03-09T14:32:13.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.614+0000 7f3c7d04f980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.614+0000 7f3c7d04f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:13.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.614+0000 7f3c7d04f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:13.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.614+0000 7f3c7d04f980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.614+0000 7f3c7d04f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:13.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.614+0000 7f3c7d04f980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.614+0000 7f3c7d04f980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:13.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.614+0000 7f3c7d04f980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.618+0000 7f3c7d04f980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:13.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.618+0000 7f3c7d04f980 20 searching for the correct realm 2024-03-09T14:32:13.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.622+0000 7f3c7b368640 0 -- 172.21.15.99:0/1956827651 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f3c70001c90 msgr2=0x7f3c700020f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:13.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.630+0000 7f3c7a366640 0 -- 172.21.15.99:0/1956827651 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f3c741096d0 msgr2=0x7f3c7411c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:13.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.846+0000 7f3c7d04f980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:13.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.846+0000 7f3c7d04f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:13.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.846+0000 7f3c7d04f980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:13.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.846+0000 7f3c7d04f980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:13.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.846+0000 7f3c7d04f980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:13.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.846+0000 7f3c7d04f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:13.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.846+0000 7f3c7d04f980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.850+0000 7f3c7d04f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:13.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.850+0000 7f3c7d04f980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.850+0000 7f3c7d04f980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:13.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.850+0000 7f3c7d04f980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.850+0000 7f3c7d04f980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:13.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.850+0000 7f3c7d04f980 20 zone default found 2024-03-09T14:32:13.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.850+0000 7f3c7d04f980 4 Realm: () 2024-03-09T14:32:13.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.850+0000 7f3c7d04f980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:13.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.850+0000 7f3c7d04f980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:13.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.850+0000 7f3c7d04f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:13.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.850+0000 7f3c7d04f980 20 zonegroup default 2024-03-09T14:32:13.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.850+0000 7f3c7d04f980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.850+0000 7f3c7d04f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:13.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.850+0000 7f3c7d04f980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.850+0000 7f3c7d04f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:13.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.850+0000 7f3c7d04f980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.854+0000 7f3c7d04f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:13.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.854+0000 7f3c7d04f980 20 started sync module instance, tier type = 2024-03-09T14:32:13.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.854+0000 7f3c7d04f980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:13.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.878+0000 7f3c7d04f980 20 add_watcher() i=0 2024-03-09T14:32:13.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.878+0000 7f3c7d04f980 20 add_watcher() i=1 2024-03-09T14:32:13.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.878+0000 7f3c7d04f980 20 add_watcher() i=2 2024-03-09T14:32:13.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.878+0000 7f3c7d04f980 20 add_watcher() i=3 2024-03-09T14:32:13.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.878+0000 7f3c7d04f980 20 add_watcher() i=4 2024-03-09T14:32:13.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.878+0000 7f3c7d04f980 20 add_watcher() i=5 2024-03-09T14:32:13.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.878+0000 7f3c7d04f980 20 add_watcher() i=6 2024-03-09T14:32:13.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.878+0000 7f3c7d04f980 20 add_watcher() i=7 2024-03-09T14:32:13.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.878+0000 7f3c7d04f980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:13.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.886+0000 7f3b317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:13.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.886+0000 7f3c7d04f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:13.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.886+0000 7f3c7d04f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:13.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.886+0000 7f3c7d04f980 5 note: GC not initialized 2024-03-09T14:32:13.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.886+0000 7f3aabfff640 20 reqs_thread_entry: start 2024-03-09T14:32:13.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.886+0000 7f3c7d04f980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:13.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.886+0000 7f3c7d04f980 20 Filter name: none 2024-03-09T14:32:13.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.886+0000 7f3aa9ffb640 20 reqs_thread_entry: start 2024-03-09T14:32:13.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.886+0000 7f3c7d04f980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.886+0000 7f3c7d04f980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:13.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.886+0000 7f3c7d04f980 20 rados->read ofs=0 len=0 2024-03-09T14:32:13.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.886+0000 7f3c7d04f980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:13.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.886+0000 7f3c7d04f980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:32:13.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.886+0000 7f3c7d04f980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:32:13.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.886+0000 7f3c7d04f980 20 INFO: main: starting shard=0 2024-03-09T14:32:13.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.886+0000 7f3c7d04f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:13.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.890+0000 7f3c7d04f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.890+0000 7f3c7d04f980 20 INFO: main: starting shard=1 2024-03-09T14:32:13.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.890+0000 7f3c7d04f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:13.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.890+0000 7f3c7d04f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.890+0000 7f3c7d04f980 20 INFO: main: starting shard=2 2024-03-09T14:32:13.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.890+0000 7f3c7d04f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:13.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.890+0000 7f3c7d04f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.890+0000 7f3c7d04f980 20 INFO: main: starting shard=3 2024-03-09T14:32:13.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.890+0000 7f3c7d04f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:13.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.890+0000 7f3c7d04f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.890+0000 7f3c7d04f980 20 INFO: main: starting shard=4 2024-03-09T14:32:13.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.890+0000 7f3c7d04f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:13.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.890+0000 7f3c7d04f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.890+0000 7f3c7d04f980 20 INFO: main: starting shard=5 2024-03-09T14:32:13.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.890+0000 7f3c7d04f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:13.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.894+0000 7f3c7d04f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.894+0000 7f3c7d04f980 20 INFO: main: starting shard=6 2024-03-09T14:32:13.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.894+0000 7f3c7d04f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:13.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.894+0000 7f3c7d04f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.894+0000 7f3c7d04f980 20 INFO: main: starting shard=7 2024-03-09T14:32:13.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.894+0000 7f3c7d04f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:13.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.894+0000 7f3c7d04f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.894+0000 7f3c7d04f980 20 INFO: main: starting shard=8 2024-03-09T14:32:13.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.894+0000 7f3c7d04f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:13.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.898+0000 7f3c7d04f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.898+0000 7f3c7d04f980 20 INFO: main: starting shard=9 2024-03-09T14:32:13.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.898+0000 7f3c7d04f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:13.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.898+0000 7f3c7d04f980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:13.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.898+0000 7f3c7d04f980 20 INFO: main: starting shard=10 2024-03-09T14:32:13.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.898+0000 7f3c7d04f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:13.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.898+0000 7f3c7d04f980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:32:13.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.898+0000 7f3c7d04f980 20 INFO: main: done 2024-03-09T14:32:13.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.902+0000 7f3b317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:13.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.906+0000 7f3c7d04f980 20 remove_watcher() i=0 2024-03-09T14:32:13.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.906+0000 7f3c7d04f980 2 removed watcher, disabling cache 2024-03-09T14:32:13.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.910+0000 7f3c7d04f980 20 remove_watcher() i=1 2024-03-09T14:32:13.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.910+0000 7f3c7d04f980 20 remove_watcher() i=2 2024-03-09T14:32:13.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.914+0000 7f3c7d04f980 20 remove_watcher() i=3 2024-03-09T14:32:13.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.914+0000 7f3c7d04f980 20 remove_watcher() i=4 2024-03-09T14:32:13.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.918+0000 7f3c7d04f980 20 remove_watcher() i=5 2024-03-09T14:32:13.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.918+0000 7f3c7d04f980 20 remove_watcher() i=6 2024-03-09T14:32:13.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:13.922+0000 7f3c7d04f980 20 remove_watcher() i=7 2024-03-09T14:32:13.938 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:13.938 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:13.942 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-03-09T14:32:14.356 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-03-09T14:32:14.770 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check unlinked finds unlistable entries 2024-03-09T14:32:14.770 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:32:14.770 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-03-09T14:32:14.803 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:14.803 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:14.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.846+0000 7f28136b8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:14.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.846+0000 7f28136b8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:14.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.846+0000 7f28136b8980 20 realm 2024-03-09T14:32:14.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.846+0000 7f28136b8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:14.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.846+0000 7f28136b8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:14.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.846+0000 7f28136b8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:14.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.846+0000 7f28136b8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:14.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.846+0000 7f28136b8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:14.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.846+0000 7f28136b8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:14.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.846+0000 7f28136b8980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:14.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.846+0000 7f28136b8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:14.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.850+0000 7f28136b8980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:14.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.850+0000 7f28136b8980 20 searching for the correct realm 2024-03-09T14:32:14.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.850+0000 7f28109cf640 0 -- 172.21.15.99:0/3255865324 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f280401c040 msgr2=0x7f280402f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:14.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.858+0000 7f28119d1640 0 -- 172.21.15.99:0/3255865324 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f27fc0fcc80 msgr2=0x7f27fc0baac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:14.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:14.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:14.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:14.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:14.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:14.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:14.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:14.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:14.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:14.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:14.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:14.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:14.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 zone default found 2024-03-09T14:32:14.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 4 Realm: () 2024-03-09T14:32:14.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:14.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:14.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:14.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 zonegroup default 2024-03-09T14:32:14.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:14.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:14.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:14.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:14.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:14.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:14.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 started sync module instance, tier type = 2024-03-09T14:32:14.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.870+0000 7f28136b8980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:14.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.890+0000 7f28136b8980 20 add_watcher() i=0 2024-03-09T14:32:14.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.890+0000 7f28136b8980 20 add_watcher() i=1 2024-03-09T14:32:14.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.890+0000 7f28136b8980 20 add_watcher() i=2 2024-03-09T14:32:14.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.890+0000 7f28136b8980 20 add_watcher() i=3 2024-03-09T14:32:14.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.890+0000 7f28136b8980 20 add_watcher() i=4 2024-03-09T14:32:14.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.890+0000 7f28136b8980 20 add_watcher() i=5 2024-03-09T14:32:14.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.890+0000 7f28136b8980 20 add_watcher() i=6 2024-03-09T14:32:14.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.890+0000 7f28136b8980 20 add_watcher() i=7 2024-03-09T14:32:14.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.890+0000 7f28136b8980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:14.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f26c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:14.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:14.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:14.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 5 note: GC not initialized 2024-03-09T14:32:14.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f26c67e4640 20 reqs_thread_entry: start 2024-03-09T14:32:14.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:14.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 20 Filter name: none 2024-03-09T14:32:14.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f2637fff640 20 reqs_thread_entry: start 2024-03-09T14:32:14.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:32:14.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:14.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:14.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:32:14.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:32:14.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 : miss 2024-03-09T14:32:14.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 20 rados->read ofs=0 len=0 2024-03-09T14:32:14.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:14.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 info.flags=0x17 2024-03-09T14:32:14.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 to cache LRU end 2024-03-09T14:32:14.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:32:14.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:32:14.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 2024-03-09T14:32:14.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:14.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 1 NOTICE: finished shard 0 (0 entries found) 2024-03-09T14:32:14.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:14.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.894+0000 7f28136b8980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:14.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.898+0000 7f28136b8980 1 NOTICE: finished shard 2 (0 entries found) 2024-03-09T14:32:14.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.898+0000 7f28136b8980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:14.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.898+0000 7f28136b8980 1 NOTICE: finished shard 3 (0 entries found) 2024-03-09T14:32:14.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.898+0000 7f28136b8980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:14.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.898+0000 7f28136b8980 1 NOTICE: finished shard 4 (0 entries found) 2024-03-09T14:32:14.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.898+0000 7f28136b8980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:14.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.898+0000 7f28136b8980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:14.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.898+0000 7f28136b8980 1 NOTICE: finished shard 6 (0 entries found) 2024-03-09T14:32:14.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.898+0000 7f28136b8980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:14.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.898+0000 7f28136b8980 1 NOTICE: finished shard 7 (0 entries found) 2024-03-09T14:32:14.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.898+0000 7f28136b8980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:14.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.902+0000 7f28136b8980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:14.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.902+0000 7f28136b8980 1 NOTICE: finished shard 9 (0 entries found) 2024-03-09T14:32:14.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.902+0000 7f28136b8980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:14.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.902+0000 7f28136b8980 1 NOTICE: finished shard 1 (1 entries found) 2024-03-09T14:32:14.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.902+0000 7f28136b8980 1 NOTICE: finished shard 5 (1 entries found) 2024-03-09T14:32:14.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.902+0000 7f28136b8980 1 NOTICE: finished shard 8 (1 entries found) 2024-03-09T14:32:14.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.902+0000 7f28136b8980 1 NOTICE: finished shard 10 (1 entries found) 2024-03-09T14:32:14.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.902+0000 7f28136b8980 1 NOTICE: finished all shards (4 entries found) 2024-03-09T14:32:14.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.902+0000 7f26c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:14.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.910+0000 7f28136b8980 20 remove_watcher() i=0 2024-03-09T14:32:14.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.910+0000 7f28136b8980 2 removed watcher, disabling cache 2024-03-09T14:32:14.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.910+0000 7f28136b8980 20 remove_watcher() i=1 2024-03-09T14:32:14.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.914+0000 7f28136b8980 20 remove_watcher() i=2 2024-03-09T14:32:14.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.914+0000 7f28136b8980 20 remove_watcher() i=3 2024-03-09T14:32:14.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.918+0000 7f28136b8980 20 remove_watcher() i=4 2024-03-09T14:32:14.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.918+0000 7f28136b8980 20 remove_watcher() i=5 2024-03-09T14:32:14.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.922+0000 7f28136b8980 20 remove_watcher() i=6 2024-03-09T14:32:14.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:14.922+0000 7f28136b8980 20 remove_watcher() i=7 2024-03-09T14:32:14.934 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: unlinked entries are not listable 2024-03-09T14:32:14.934 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:32:14.936 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:14.936 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:14.941 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-03-09T14:32:14.941 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:32:14.943 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:14.943 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:14.993 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:14.993 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:15.041 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-03-09T14:32:15.042 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:32:15.042 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-09T14:32:15.081 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:15.081 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:15.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.126+0000 7f41f9bd9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.126+0000 7f41f9bd9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:15.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.126+0000 7f41f9bd9980 20 realm 2024-03-09T14:32:15.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.126+0000 7f41f9bd9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.126+0000 7f41f9bd9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:15.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.126+0000 7f41f9bd9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:15.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.126+0000 7f41f9bd9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.126+0000 7f41f9bd9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:15.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.126+0000 7f41f9bd9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.130+0000 7f41f9bd9980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:15.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.130+0000 7f41f9bd9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.130+0000 7f41f9bd9980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:15.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.130+0000 7f41f9bd9980 20 searching for the correct realm 2024-03-09T14:32:15.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.134+0000 7f41f6ef0640 0 -- 172.21.15.99:0/293372249 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f41e80ff710 msgr2=0x7f41e80d3490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:15.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.142+0000 7f41f6ef0640 0 -- 172.21.15.99:0/293372249 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f41f0014420 msgr2=0x7f41f00148a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:15.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.358+0000 7f41f9bd9980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:15.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.358+0000 7f41f9bd9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:15.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.358+0000 7f41f9bd9980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:15.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.358+0000 7f41f9bd9980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:15.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.358+0000 7f41f9bd9980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:15.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.358+0000 7f41f9bd9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:15.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.358+0000 7f41f9bd9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.358+0000 7f41f9bd9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:15.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.358+0000 7f41f9bd9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.362+0000 7f41f9bd9980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:15.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.362+0000 7f41f9bd9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.362+0000 7f41f9bd9980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:15.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.362+0000 7f41f9bd9980 20 zone default found 2024-03-09T14:32:15.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.362+0000 7f41f9bd9980 4 Realm: () 2024-03-09T14:32:15.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.362+0000 7f41f9bd9980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:15.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.362+0000 7f41f9bd9980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:15.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.362+0000 7f41f9bd9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:15.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.362+0000 7f41f9bd9980 20 zonegroup default 2024-03-09T14:32:15.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.362+0000 7f41f9bd9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.362+0000 7f41f9bd9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:15.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.362+0000 7f41f9bd9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.362+0000 7f41f9bd9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:15.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.362+0000 7f41f9bd9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.362+0000 7f41f9bd9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:15.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.362+0000 7f41f9bd9980 20 started sync module instance, tier type = 2024-03-09T14:32:15.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.362+0000 7f41f9bd9980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:15.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.386+0000 7f41f9bd9980 20 add_watcher() i=0 2024-03-09T14:32:15.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.386+0000 7f41f9bd9980 20 add_watcher() i=1 2024-03-09T14:32:15.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.386+0000 7f41f9bd9980 20 add_watcher() i=2 2024-03-09T14:32:15.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.386+0000 7f41f9bd9980 20 add_watcher() i=3 2024-03-09T14:32:15.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.386+0000 7f41f9bd9980 20 add_watcher() i=4 2024-03-09T14:32:15.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.386+0000 7f41f9bd9980 20 add_watcher() i=5 2024-03-09T14:32:15.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.390+0000 7f41f9bd9980 20 add_watcher() i=6 2024-03-09T14:32:15.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.390+0000 7f41f9bd9980 20 add_watcher() i=7 2024-03-09T14:32:15.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.390+0000 7f41f9bd9980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:15.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.394+0000 7f40adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:15.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.394+0000 7f41f9bd9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:15.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.394+0000 7f41f9bd9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:15.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.394+0000 7f41f9bd9980 5 note: GC not initialized 2024-03-09T14:32:15.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.394+0000 7f40acfe1640 20 reqs_thread_entry: start 2024-03-09T14:32:15.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.394+0000 7f41f9bd9980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:15.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 20 Filter name: none 2024-03-09T14:32:15.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f40267fc640 20 reqs_thread_entry: start 2024-03-09T14:32:15.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:32:15.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:15.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:32:15.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:32:15.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 : miss 2024-03-09T14:32:15.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:15.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 info.flags=0x17 2024-03-09T14:32:15.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 to cache LRU end 2024-03-09T14:32:15.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:32:15.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:32:15.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 2024-03-09T14:32:15.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:15.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 1 NOTICE: finished shard 0 (0 entries removed) 2024-03-09T14:32:15.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:15.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.398+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:15.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.402+0000 7f41f9bd9980 1 NOTICE: finished shard 2 (0 entries removed) 2024-03-09T14:32:15.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.402+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:15.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.402+0000 7f41f9bd9980 1 NOTICE: finished shard 3 (0 entries removed) 2024-03-09T14:32:15.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.402+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:15.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.402+0000 7f41f9bd9980 1 NOTICE: finished shard 4 (0 entries removed) 2024-03-09T14:32:15.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.402+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:15.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.402+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:15.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.402+0000 7f41f9bd9980 1 NOTICE: finished shard 6 (0 entries removed) 2024-03-09T14:32:15.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.402+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:15.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.406+0000 7f41f9bd9980 1 NOTICE: finished shard 7 (0 entries removed) 2024-03-09T14:32:15.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.406+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:15.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.406+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:15.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.406+0000 7f41f9bd9980 1 NOTICE: finished shard 9 (0 entries removed) 2024-03-09T14:32:15.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.406+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:15.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.410+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:15.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.410+0000 7f41f9bd9980 20 get_obj_state: octx=0x5633d8b43d30 obj=check-bucket:e state=0x5633d8eb74f8 s->prefetch_data=0 2024-03-09T14:32:15.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.410+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:15.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.410+0000 7f41f9bd9980 20 get_obj_state: octx=0x5633d8c10ec0 obj=check-bucket:d state=0x5633d8eb0528 s->prefetch_data=0 2024-03-09T14:32:15.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.410+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:15.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.410+0000 7f41f9bd9980 20 get_obj_state: octx=0x5633d8eb9a40 obj=check-bucket:c state=0x5633d8eb2488 s->prefetch_data=0 2024-03-09T14:32:15.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.410+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:15.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.410+0000 7f41f9bd9980 20 get_obj_state: octx=0x5633d8eb6820 obj=check-bucket:f state=0x5633d8eb2fe8 s->prefetch_data=0 2024-03-09T14:32:15.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.410+0000 7f41f9bd9980 20 get_obj_state: setting s->obj_tag to cmfy34l62xfibwziovkwano9bnvd5bbz 2024-03-09T14:32:15.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.410+0000 7f41f9bd9980 20 get_obj_state_impl: setting s->olh_tag to ets90und2tgo0sjwlr7w3mc1e1eilo7l 2024-03-09T14:32:15.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.410+0000 7f41f9bd9980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ets90und2tgo0sjwlr7w3mc1e1eilo7l 2024-03-09T14:32:15.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.410+0000 7f41f9bd9980 20 get_obj_state: setting s->obj_tag to 48xbflcwj1em33axbcj6kq13j20ouq98 2024-03-09T14:32:15.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.410+0000 7f41f9bd9980 20 get_obj_state_impl: setting s->olh_tag to 6p3wvz474oauv4v0araw5wgn3p0eeh74 2024-03-09T14:32:15.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.410+0000 7f41f9bd9980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6p3wvz474oauv4v0araw5wgn3p0eeh74 2024-03-09T14:32:15.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.410+0000 7f41f9bd9980 20 get_obj_state: setting s->obj_tag to otko8hwv3indplizsgkkg4zkqlnk12se 2024-03-09T14:32:15.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.410+0000 7f41f9bd9980 20 get_obj_state_impl: setting s->olh_tag to kllywuea5yc1mtw0pnnrv37xsl61cl5c 2024-03-09T14:32:15.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.410+0000 7f41f9bd9980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kllywuea5yc1mtw0pnnrv37xsl61cl5c 2024-03-09T14:32:15.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.414+0000 7f41f9bd9980 20 get_obj_state: setting s->obj_tag to amg6ebwtefruomrwatin18nt6si0uje9 2024-03-09T14:32:15.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.414+0000 7f41f9bd9980 20 get_obj_state_impl: setting s->olh_tag to jal4musd0hqjvpym2gqea9hgmy6esuoq 2024-03-09T14:32:15.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.414+0000 7f41f9bd9980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jal4musd0hqjvpym2gqea9hgmy6esuoq 2024-03-09T14:32:15.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.418+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:15.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.418+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:15.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.418+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:15.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.418+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:15.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.422+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:15.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.422+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:15.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.422+0000 7f41f9bd9980 20 olh_log_entry: epoch=3 op=3 key=c[1Q8nKeKWyt7JDPsGGxRQ9D1cMVefLem] 2024-03-09T14:32:15.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.422+0000 7f41f9bd9980 20 get_obj_state: octx=0x5633d8eb9a40 obj=check-bucket:_:1Q8nKeKWyt7JDPsGGxRQ9D1cMVefLem_c state=0x5633d8f50df8 s->prefetch_data=0 2024-03-09T14:32:15.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.422+0000 7f41f9bd9980 20 olh_log_entry: epoch=3 op=3 key=d[Fo1200lePSh3m.Ii.K82GF2Q8jKt0u0] 2024-03-09T14:32:15.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.422+0000 7f41f9bd9980 20 get_obj_state: octx=0x5633d8c10ec0 obj=check-bucket:_:Fo1200lePSh3m.Ii.K82GF2Q8jKt0u0_d state=0x5633d8f5e808 s->prefetch_data=0 2024-03-09T14:32:15.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.422+0000 7f41f9bd9980 10 manifest: total_size = 11 2024-03-09T14:32:15.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.422+0000 7f41f9bd9980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6776373194712971905 2024-03-09T14:32:15.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.422+0000 7f41f9bd9980 20 get_obj_state: octx=0x5633d8eb9a40 obj=check-bucket:_:1Q8nKeKWyt7JDPsGGxRQ9D1cMVefLem_c state=0x5633d8f50df8 s->prefetch_data=0 2024-03-09T14:32:15.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.422+0000 7f41f9bd9980 20 prepare_atomic_modification: state is not atomic. state=0x5633d8f50df8 2024-03-09T14:32:15.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.422+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:15.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.422+0000 7f41f9bd9980 10 manifest: total_size = 9 2024-03-09T14:32:15.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.422+0000 7f41f9bd9980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5566949962649632141 2024-03-09T14:32:15.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.422+0000 7f41f9bd9980 20 get_obj_state: octx=0x5633d8c10ec0 obj=check-bucket:_:Fo1200lePSh3m.Ii.K82GF2Q8jKt0u0_d state=0x5633d8f5e808 s->prefetch_data=0 2024-03-09T14:32:15.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.422+0000 7f41f9bd9980 20 prepare_atomic_modification: state is not atomic. state=0x5633d8f5e808 2024-03-09T14:32:15.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.422+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:15.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:15.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-03-09T14:32:15.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 20 olh_log_entry: epoch=2 op=3 key=e[B3me1SayItI8oSWPSsOnKjbLg4r7Lij] 2024-03-09T14:32:15.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 20 get_obj_state: octx=0x5633d8b43d30 obj=check-bucket:_:B3me1SayItI8oSWPSsOnKjbLg4r7Lij_e state=0x5633d8f6d7a8 s->prefetch_data=0 2024-03-09T14:32:15.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 10 manifest: total_size = 12 2024-03-09T14:32:15.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.81417617739460790 2024-03-09T14:32:15.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 20 get_obj_state: octx=0x5633d8b43d30 obj=check-bucket:_:B3me1SayItI8oSWPSsOnKjbLg4r7Lij_e state=0x5633d8f6d7a8 s->prefetch_data=0 2024-03-09T14:32:15.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 20 prepare_atomic_modification: state is not atomic. state=0x5633d8f6d7a8 2024-03-09T14:32:15.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:15.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:15.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-03-09T14:32:15.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 20 olh_log_entry: epoch=2 op=3 key=f[BrCyvsSWL5hqGS9B.1wVPq7V4uJSvV4] 2024-03-09T14:32:15.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 20 get_obj_state: octx=0x5633d8eb6820 obj=check-bucket:_:BrCyvsSWL5hqGS9B.1wVPq7V4uJSvV4_f state=0x5633d8f765d8 s->prefetch_data=0 2024-03-09T14:32:15.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 10 manifest: total_size = 12 2024-03-09T14:32:15.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12684056033288645496 2024-03-09T14:32:15.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 20 get_obj_state: octx=0x5633d8eb6820 obj=check-bucket:_:BrCyvsSWL5hqGS9B.1wVPq7V4uJSvV4_f state=0x5633d8f765d8 s->prefetch_data=0 2024-03-09T14:32:15.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 20 prepare_atomic_modification: state is not atomic. state=0x5633d8f765d8 2024-03-09T14:32:15.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.426+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:15.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.430+0000 7f41f9bd9980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:32:15.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.430+0000 7f41f9bd9980 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-03-09T14:32:15.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.430+0000 7f41f9bd9980 0 deleting objects inline since gc isn't initialized 2024-03-09T14:32:15.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.430+0000 7f41f9bd9980 5 delete_objs_inline: removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2__shadow:B3me1SayItI8oSWPSsOnKjbLg4r7Lij_.kd1TC6pJ0yzpSqz_QDkt8THhyMMNKp0_0 2024-03-09T14:32:15.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.438+0000 7f40da7fc640 20 handle_completion(): completion ok for obj=e[B3me1SayItI8oSWPSsOnKjbLg4r7Lij] 2024-03-09T14:32:15.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.438+0000 7f41f9bd9980 5 delete_objs_inline: refcount put returned error -2 2024-03-09T14:32:15.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.438+0000 7f41f9bd9980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:32:15.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.438+0000 7f41f9bd9980 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-03-09T14:32:15.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.438+0000 7f41f9bd9980 0 deleting objects inline since gc isn't initialized 2024-03-09T14:32:15.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.438+0000 7f41f9bd9980 5 delete_objs_inline: removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2__shadow:1Q8nKeKWyt7JDPsGGxRQ9D1cMVefLem_.XpyB9NAApIXB_Gjscl7x2VXcecSYDZf_0 2024-03-09T14:32:15.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.442+0000 7f40da7fc640 20 handle_completion(): completion ok for obj=c[1Q8nKeKWyt7JDPsGGxRQ9D1cMVefLem] 2024-03-09T14:32:15.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.442+0000 7f41f9bd9980 5 delete_objs_inline: refcount put returned error -2 2024-03-09T14:32:15.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.442+0000 7f41f9bd9980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:32:15.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.442+0000 7f41f9bd9980 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-03-09T14:32:15.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.442+0000 7f41f9bd9980 0 deleting objects inline since gc isn't initialized 2024-03-09T14:32:15.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.442+0000 7f41f9bd9980 5 delete_objs_inline: removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2__shadow:Fo1200lePSh3m.Ii.K82GF2Q8jKt0u0_.jCsUpLX3HHfKLsIVbdDv6yAA7seRgoJ_0 2024-03-09T14:32:15.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.446+0000 7f41f9bd9980 5 delete_objs_inline: refcount put returned error -2 2024-03-09T14:32:15.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.450+0000 7f41f9bd9980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:32:15.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.450+0000 7f41f9bd9980 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-03-09T14:32:15.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.450+0000 7f41f9bd9980 0 deleting objects inline since gc isn't initialized 2024-03-09T14:32:15.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.450+0000 7f41f9bd9980 5 delete_objs_inline: removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2__shadow:BrCyvsSWL5hqGS9B.1wVPq7V4uJSvV4_.nFDHWvBtwaFvhB5IzQreoUWYLPMbtY8_0 2024-03-09T14:32:15.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.450+0000 7f40daffd640 20 handle_completion(): completion ok for obj=d[Fo1200lePSh3m.Ii.K82GF2Q8jKt0u0] 2024-03-09T14:32:15.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.454+0000 7f41f9bd9980 5 delete_objs_inline: refcount put returned error -2 2024-03-09T14:32:15.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.454+0000 7f41f9bd9980 20 get_obj_state: octx=0x5633d8b43d30 obj=check-bucket:e state=0x5633d8eb74f8 s->prefetch_data=0 2024-03-09T14:32:15.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.454+0000 7f40da7fc640 20 handle_completion(): completion ok for obj=f[BrCyvsSWL5hqGS9B.1wVPq7V4uJSvV4] 2024-03-09T14:32:15.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.454+0000 7f41f9bd9980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ets90und2tgo0sjwlr7w3mc1e1eilo7l 2024-03-09T14:32:15.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.454+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:15.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.454+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:15.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.454+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:15.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.454+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:15.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.458+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:15.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.458+0000 7f41f9bd9980 1 NOTICE: finished shard 8 (1 entries removed) 2024-03-09T14:32:15.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.458+0000 7f41f9bd9980 20 get_obj_state: octx=0x5633d8eb6820 obj=check-bucket:f state=0x5633d8eb2fe8 s->prefetch_data=0 2024-03-09T14:32:15.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.458+0000 7f41f9bd9980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=jal4musd0hqjvpym2gqea9hgmy6esuoq 2024-03-09T14:32:15.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.462+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:15.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.462+0000 7f41f9bd9980 1 NOTICE: finished shard 5 (1 entries removed) 2024-03-09T14:32:15.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.466+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:15.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.470+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:15.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.470+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:15.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.470+0000 7f41f9bd9980 1 NOTICE: finished shard 1 (1 entries removed) 2024-03-09T14:32:15.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.474+0000 7f41f9bd9980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:15.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.474+0000 7f41f9bd9980 1 NOTICE: finished shard 10 (1 entries removed) 2024-03-09T14:32:15.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.474+0000 7f41f9bd9980 1 NOTICE: finished all shards (4 entries removed) 2024-03-09T14:32:15.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.474+0000 7f40adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:15.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.478+0000 7f41f9bd9980 20 remove_watcher() i=0 2024-03-09T14:32:15.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.478+0000 7f41f9bd9980 2 removed watcher, disabling cache 2024-03-09T14:32:15.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.482+0000 7f41f9bd9980 20 remove_watcher() i=1 2024-03-09T14:32:15.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.486+0000 7f41f9bd9980 20 remove_watcher() i=2 2024-03-09T14:32:15.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.486+0000 7f41f9bd9980 20 remove_watcher() i=3 2024-03-09T14:32:15.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.490+0000 7f41f9bd9980 20 remove_watcher() i=4 2024-03-09T14:32:15.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.490+0000 7f41f9bd9980 20 remove_watcher() i=5 2024-03-09T14:32:15.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.494+0000 7f41f9bd9980 20 remove_watcher() i=6 2024-03-09T14:32:15.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.494+0000 7f41f9bd9980 20 remove_watcher() i=7 2024-03-09T14:32:15.513 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:15.513 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:15.517 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:15.517 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:15.521 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:15.521 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:15.525 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:15.525 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:15.527 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check unlinked does not affect normal entries 2024-03-09T14:32:15.528 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:32:15.528 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:15.529 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:15.578 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:15.578 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:15.584 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:15.584 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:15.593 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:15.593 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:15.599 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:15.599 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:15.602 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-03-09T14:32:15.602 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:32:15.603 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-03-09T14:32:15.638 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:15.638 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:15.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.686+0000 7fa164720980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.686+0000 7fa164720980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:15.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.686+0000 7fa164720980 20 realm 2024-03-09T14:32:15.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.686+0000 7fa164720980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.690+0000 7fa164720980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:15.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.690+0000 7fa164720980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:15.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.690+0000 7fa164720980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.690+0000 7fa164720980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:15.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.690+0000 7fa164720980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.690+0000 7fa164720980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:15.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.690+0000 7fa164720980 20 rados->read ofs=0 len=0 2024-03-09T14:32:15.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.690+0000 7fa164720980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:15.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.690+0000 7fa164720980 20 searching for the correct realm 2024-03-09T14:32:15.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.694+0000 7fa162a39640 0 -- 172.21.15.99:0/2834296791 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7fa1580c6040 msgr2=0x7fa1580e0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:32:15.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:15.910+0000 7fa161a37640 0 -- 172.21.15.99:0/2834296791 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fa15c047450 msgr2=0x7fa15c0478d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:16.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.126+0000 7fa164720980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:16.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.126+0000 7fa164720980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:16.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.126+0000 7fa164720980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:16.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.126+0000 7fa164720980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:16.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.126+0000 7fa164720980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:16.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.126+0000 7fa164720980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:16.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.126+0000 7fa164720980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.126+0000 7fa164720980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.126+0000 7fa164720980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.126+0000 7fa164720980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:16.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.126+0000 7fa164720980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.130+0000 7fa164720980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:16.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.130+0000 7fa164720980 20 zone default found 2024-03-09T14:32:16.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.130+0000 7fa164720980 4 Realm: () 2024-03-09T14:32:16.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.130+0000 7fa164720980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:16.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.130+0000 7fa164720980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:16.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.130+0000 7fa164720980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:16.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.130+0000 7fa164720980 20 zonegroup default 2024-03-09T14:32:16.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.130+0000 7fa164720980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.130+0000 7fa164720980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.130+0000 7fa164720980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.130+0000 7fa164720980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.130+0000 7fa164720980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.130+0000 7fa164720980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.130+0000 7fa164720980 20 started sync module instance, tier type = 2024-03-09T14:32:16.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.130+0000 7fa164720980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:16.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.158+0000 7fa164720980 20 add_watcher() i=0 2024-03-09T14:32:16.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.158+0000 7fa164720980 20 add_watcher() i=1 2024-03-09T14:32:16.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.158+0000 7fa164720980 20 add_watcher() i=2 2024-03-09T14:32:16.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.158+0000 7fa164720980 20 add_watcher() i=3 2024-03-09T14:32:16.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.158+0000 7fa164720980 20 add_watcher() i=4 2024-03-09T14:32:16.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.158+0000 7fa164720980 20 add_watcher() i=5 2024-03-09T14:32:16.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.158+0000 7fa164720980 20 add_watcher() i=6 2024-03-09T14:32:16.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.158+0000 7fa164720980 20 add_watcher() i=7 2024-03-09T14:32:16.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.158+0000 7fa164720980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:16.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.162+0000 7fa0197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:16.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:16.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:16.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 5 note: GC not initialized 2024-03-09T14:32:16.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa0137fe640 20 reqs_thread_entry: start 2024-03-09T14:32:16.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:16.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 20 Filter name: none 2024-03-09T14:32:16.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa0117fa640 20 reqs_thread_entry: start 2024-03-09T14:32:16.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:32:16.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:16.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:32:16.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:32:16.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 : miss 2024-03-09T14:32:16.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:16.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 info.flags=0x17 2024-03-09T14:32:16.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 to cache LRU end 2024-03-09T14:32:16.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:32:16.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:32:16.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.166+0000 7fa164720980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 2024-03-09T14:32:16.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.170+0000 7fa164720980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:16.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.170+0000 7fa164720980 1 NOTICE: finished shard 0 (0 entries found) 2024-03-09T14:32:16.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.170+0000 7fa164720980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:16.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.170+0000 7fa164720980 1 NOTICE: finished shard 1 (0 entries found) 2024-03-09T14:32:16.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.170+0000 7fa164720980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:16.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.170+0000 7fa164720980 1 NOTICE: finished shard 2 (0 entries found) 2024-03-09T14:32:16.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.170+0000 7fa164720980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:16.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.170+0000 7fa164720980 1 NOTICE: finished shard 3 (0 entries found) 2024-03-09T14:32:16.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.170+0000 7fa164720980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:16.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.170+0000 7fa164720980 1 NOTICE: finished shard 4 (0 entries found) 2024-03-09T14:32:16.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.170+0000 7fa164720980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:16.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.174+0000 7fa164720980 1 NOTICE: finished shard 5 (0 entries found) 2024-03-09T14:32:16.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.174+0000 7fa164720980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:16.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.174+0000 7fa164720980 1 NOTICE: finished shard 6 (0 entries found) 2024-03-09T14:32:16.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.174+0000 7fa164720980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:16.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.174+0000 7fa164720980 1 NOTICE: finished shard 7 (0 entries found) 2024-03-09T14:32:16.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.174+0000 7fa164720980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:16.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.178+0000 7fa164720980 1 NOTICE: finished shard 8 (0 entries found) 2024-03-09T14:32:16.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.178+0000 7fa164720980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:16.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.178+0000 7fa164720980 1 NOTICE: finished shard 9 (0 entries found) 2024-03-09T14:32:16.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.178+0000 7fa164720980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:16.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.178+0000 7fa164720980 1 NOTICE: finished shard 10 (0 entries found) 2024-03-09T14:32:16.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.182+0000 7fa164720980 1 NOTICE: finished all shards (0 entries found) 2024-03-09T14:32:16.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.182+0000 7fa0197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:16.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.186+0000 7fa164720980 20 remove_watcher() i=0 2024-03-09T14:32:16.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.186+0000 7fa164720980 2 removed watcher, disabling cache 2024-03-09T14:32:16.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.190+0000 7fa164720980 20 remove_watcher() i=1 2024-03-09T14:32:16.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.194+0000 7fa164720980 20 remove_watcher() i=2 2024-03-09T14:32:16.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.194+0000 7fa164720980 20 remove_watcher() i=3 2024-03-09T14:32:16.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.198+0000 7fa164720980 20 remove_watcher() i=4 2024-03-09T14:32:16.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.198+0000 7fa164720980 20 remove_watcher() i=5 2024-03-09T14:32:16.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.202+0000 7fa164720980 20 remove_watcher() i=6 2024-03-09T14:32:16.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.202+0000 7fa164720980 20 remove_watcher() i=7 2024-03-09T14:32:16.221 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:16.221 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:16.253 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:16.254 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:16.288 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-09T14:32:16.320 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:16.320 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:16.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.362+0000 7f986d585980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.366+0000 7f986d585980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.366+0000 7f986d585980 20 realm 2024-03-09T14:32:16.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.366+0000 7f986d585980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.366+0000 7f986d585980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.366+0000 7f986d585980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:16.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.366+0000 7f986d585980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.366+0000 7f986d585980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.366+0000 7f986d585980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.366+0000 7f986d585980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:16.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.366+0000 7f986d585980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.370+0000 7f986d585980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:16.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.370+0000 7f986d585980 20 searching for the correct realm 2024-03-09T14:32:16.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.370+0000 7f986a89c640 0 -- 172.21.15.99:0/824123075 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f985c0e3040 msgr2=0x7f985c0b12d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:16.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.378+0000 7f986a89c640 0 -- 172.21.15.99:0/824123075 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f9734073b50 msgr2=0x7f9734075f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:32:16.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:16.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:16.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:16.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:16.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:16.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:16.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:16.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:16.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 zone default found 2024-03-09T14:32:16.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 4 Realm: () 2024-03-09T14:32:16.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:16.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:16.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:16.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 zonegroup default 2024-03-09T14:32:16.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 started sync module instance, tier type = 2024-03-09T14:32:16.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.390+0000 7f986d585980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:16.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.406+0000 7f986d585980 20 add_watcher() i=0 2024-03-09T14:32:16.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.406+0000 7f986d585980 20 add_watcher() i=1 2024-03-09T14:32:16.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.406+0000 7f986d585980 20 add_watcher() i=2 2024-03-09T14:32:16.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.406+0000 7f986d585980 20 add_watcher() i=3 2024-03-09T14:32:16.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.406+0000 7f986d585980 20 add_watcher() i=4 2024-03-09T14:32:16.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.406+0000 7f986d585980 20 add_watcher() i=5 2024-03-09T14:32:16.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.406+0000 7f986d585980 20 add_watcher() i=6 2024-03-09T14:32:16.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.410+0000 7f986d585980 20 add_watcher() i=7 2024-03-09T14:32:16.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.410+0000 7f986d585980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:16.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.414+0000 7f97227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:16.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.414+0000 7f986d585980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:16.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.414+0000 7f986d585980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:16.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.414+0000 7f986d585980 5 note: GC not initialized 2024-03-09T14:32:16.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.414+0000 7f97217e2640 20 reqs_thread_entry: start 2024-03-09T14:32:16.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.414+0000 7f986d585980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:16.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.414+0000 7f986d585980 20 Filter name: none 2024-03-09T14:32:16.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.414+0000 7f971a7fc640 20 reqs_thread_entry: start 2024-03-09T14:32:16.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.414+0000 7f986d585980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.414+0000 7f986d585980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:16.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.414+0000 7f986d585980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.414+0000 7f986d585980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:16.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.414+0000 7f986d585980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:32:16.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.414+0000 7f986d585980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:32:16.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.414+0000 7f986d585980 20 INFO: main: starting shard=0 2024-03-09T14:32:16.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.414+0000 7f986d585980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:16.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 INFO: main: starting shard=1 2024-03-09T14:32:16.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:16.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 INFO: main: starting shard=2 2024-03-09T14:32:16.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:16.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 INFO: main: starting shard=3 2024-03-09T14:32:16.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:16.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 INFO: main: starting shard=4 2024-03-09T14:32:16.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:16.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 INFO: main: starting shard=5 2024-03-09T14:32:16.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:16.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 INFO: main: starting shard=6 2024-03-09T14:32:16.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:16.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 INFO: main: starting shard=7 2024-03-09T14:32:16.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.418+0000 7f986d585980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:16.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.422+0000 7f986d585980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.422+0000 7f986d585980 20 INFO: main: starting shard=8 2024-03-09T14:32:16.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.422+0000 7f986d585980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:16.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.422+0000 7f986d585980 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-03-09T14:32:16.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.422+0000 7f986d585980 20 INFO: main: starting shard=9 2024-03-09T14:32:16.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.422+0000 7f986d585980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:16.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.422+0000 7f986d585980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.422+0000 7f986d585980 20 INFO: main: starting shard=10 2024-03-09T14:32:16.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.422+0000 7f986d585980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:16.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.426+0000 7f986d585980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.426+0000 7f986d585980 20 INFO: main: done 2024-03-09T14:32:16.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.426+0000 7f97227e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:16.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.430+0000 7f986d585980 20 remove_watcher() i=0 2024-03-09T14:32:16.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.430+0000 7f986d585980 2 removed watcher, disabling cache 2024-03-09T14:32:16.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.434+0000 7f986d585980 20 remove_watcher() i=1 2024-03-09T14:32:16.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.434+0000 7f986d585980 20 remove_watcher() i=2 2024-03-09T14:32:16.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.438+0000 7f986d585980 20 remove_watcher() i=3 2024-03-09T14:32:16.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.438+0000 7f986d585980 20 remove_watcher() i=4 2024-03-09T14:32:16.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.442+0000 7f986d585980 20 remove_watcher() i=5 2024-03-09T14:32:16.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.442+0000 7f986d585980 20 remove_watcher() i=6 2024-03-09T14:32:16.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.442+0000 7f986d585980 20 remove_watcher() i=7 2024-03-09T14:32:16.458 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-09T14:32:16.487 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:16.487 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:16.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.530+0000 7f67407d6980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.530+0000 7f67407d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.530+0000 7f67407d6980 20 realm 2024-03-09T14:32:16.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.530+0000 7f67407d6980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.530+0000 7f67407d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.530+0000 7f67407d6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:16.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.530+0000 7f67407d6980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.530+0000 7f67407d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.530+0000 7f67407d6980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.534+0000 7f67407d6980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:16.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.534+0000 7f67407d6980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.534+0000 7f67407d6980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:16.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.534+0000 7f67407d6980 20 searching for the correct realm 2024-03-09T14:32:16.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.538+0000 7f673e2ee640 0 -- 172.21.15.99:0/503211996 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x55ea85206510 msgr2=0x55ea852089d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:32:16.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.546+0000 7f673daed640 0 -- 172.21.15.99:0/503211996 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f6738109a70 msgr2=0x7f67380f6a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:16.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.762+0000 7f67407d6980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:16.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.762+0000 7f67407d6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:16.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.762+0000 7f67407d6980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:16.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.762+0000 7f67407d6980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:16.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.762+0000 7f67407d6980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:16.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.762+0000 7f67407d6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:16.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.762+0000 7f67407d6980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.762+0000 7f67407d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.762+0000 7f67407d6980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.766+0000 7f67407d6980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:16.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.766+0000 7f67407d6980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.766+0000 7f67407d6980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:16.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.766+0000 7f67407d6980 20 zone default found 2024-03-09T14:32:16.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.766+0000 7f67407d6980 4 Realm: () 2024-03-09T14:32:16.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.766+0000 7f67407d6980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:16.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.766+0000 7f67407d6980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:16.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.766+0000 7f67407d6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:16.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.766+0000 7f67407d6980 20 zonegroup default 2024-03-09T14:32:16.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.766+0000 7f67407d6980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.766+0000 7f67407d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.766+0000 7f67407d6980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.766+0000 7f67407d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.766+0000 7f67407d6980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.766+0000 7f67407d6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.766+0000 7f67407d6980 20 started sync module instance, tier type = 2024-03-09T14:32:16.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.766+0000 7f67407d6980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:16.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.794+0000 7f67407d6980 20 add_watcher() i=0 2024-03-09T14:32:16.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.794+0000 7f67407d6980 20 add_watcher() i=1 2024-03-09T14:32:16.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.794+0000 7f67407d6980 20 add_watcher() i=2 2024-03-09T14:32:16.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.794+0000 7f67407d6980 20 add_watcher() i=3 2024-03-09T14:32:16.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.794+0000 7f67407d6980 20 add_watcher() i=4 2024-03-09T14:32:16.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.794+0000 7f67407d6980 20 add_watcher() i=5 2024-03-09T14:32:16.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.794+0000 7f67407d6980 20 add_watcher() i=6 2024-03-09T14:32:16.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.798+0000 7f67407d6980 20 add_watcher() i=7 2024-03-09T14:32:16.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.798+0000 7f67407d6980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:16.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.802+0000 7f65f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:16.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.802+0000 7f67407d6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:16.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.802+0000 7f67407d6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:16.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.802+0000 7f67407d6980 5 note: GC not initialized 2024-03-09T14:32:16.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.802+0000 7f65ef7fe640 20 reqs_thread_entry: start 2024-03-09T14:32:16.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.802+0000 7f67407d6980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:16.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.802+0000 7f67407d6980 20 Filter name: none 2024-03-09T14:32:16.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.802+0000 7f65ed7fa640 20 reqs_thread_entry: start 2024-03-09T14:32:16.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.802+0000 7f67407d6980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.802+0000 7f67407d6980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:16.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.802+0000 7f67407d6980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.806+0000 7f67407d6980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:16.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.806+0000 7f67407d6980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:32:16.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.806+0000 7f67407d6980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:32:16.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.806+0000 7f67407d6980 20 INFO: main: starting shard=0 2024-03-09T14:32:16.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.806+0000 7f67407d6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:16.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.806+0000 7f67407d6980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.806+0000 7f67407d6980 20 INFO: main: starting shard=1 2024-03-09T14:32:16.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.806+0000 7f67407d6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:16.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.806+0000 7f67407d6980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.806+0000 7f67407d6980 20 INFO: main: starting shard=2 2024-03-09T14:32:16.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.806+0000 7f67407d6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:16.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.806+0000 7f67407d6980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.806+0000 7f67407d6980 20 INFO: main: starting shard=3 2024-03-09T14:32:16.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.806+0000 7f67407d6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:16.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.806+0000 7f67407d6980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.806+0000 7f67407d6980 20 INFO: main: starting shard=4 2024-03-09T14:32:16.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.806+0000 7f67407d6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:16.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.810+0000 7f67407d6980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.810+0000 7f67407d6980 20 INFO: main: starting shard=5 2024-03-09T14:32:16.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.810+0000 7f67407d6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:16.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.810+0000 7f67407d6980 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-03-09T14:32:16.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.810+0000 7f67407d6980 20 INFO: main: starting shard=6 2024-03-09T14:32:16.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.810+0000 7f67407d6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:16.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.810+0000 7f67407d6980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.810+0000 7f67407d6980 20 INFO: main: starting shard=7 2024-03-09T14:32:16.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.810+0000 7f67407d6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:16.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.810+0000 7f67407d6980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.810+0000 7f67407d6980 20 INFO: main: starting shard=8 2024-03-09T14:32:16.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.810+0000 7f67407d6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:16.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.810+0000 7f67407d6980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.810+0000 7f67407d6980 20 INFO: main: starting shard=9 2024-03-09T14:32:16.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.810+0000 7f67407d6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:16.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.814+0000 7f67407d6980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.814+0000 7f67407d6980 20 INFO: main: starting shard=10 2024-03-09T14:32:16.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.814+0000 7f67407d6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:16.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.814+0000 7f67407d6980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:16.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.814+0000 7f67407d6980 20 INFO: main: done 2024-03-09T14:32:16.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.818+0000 7f65f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:16.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.822+0000 7f67407d6980 20 remove_watcher() i=0 2024-03-09T14:32:16.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.822+0000 7f67407d6980 2 removed watcher, disabling cache 2024-03-09T14:32:16.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.826+0000 7f67407d6980 20 remove_watcher() i=1 2024-03-09T14:32:16.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.826+0000 7f67407d6980 20 remove_watcher() i=2 2024-03-09T14:32:16.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.830+0000 7f67407d6980 20 remove_watcher() i=3 2024-03-09T14:32:16.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.830+0000 7f67407d6980 20 remove_watcher() i=4 2024-03-09T14:32:16.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.834+0000 7f67407d6980 20 remove_watcher() i=5 2024-03-09T14:32:16.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.834+0000 7f67407d6980 20 remove_watcher() i=6 2024-03-09T14:32:16.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.838+0000 7f67407d6980 20 remove_watcher() i=7 2024-03-09T14:32:16.853 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check olh finds leftover OLH entries 2024-03-09T14:32:16.853 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:32:16.853 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-03-09T14:32:16.886 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:16.886 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:16.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.930+0000 7f7182c9c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.930+0000 7f7182c9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.930+0000 7f7182c9c980 20 realm 2024-03-09T14:32:16.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.930+0000 7f7182c9c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.930+0000 7f7182c9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.930+0000 7f7182c9c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:16.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.930+0000 7f7182c9c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.930+0000 7f7182c9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:16.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.930+0000 7f7182c9c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.934+0000 7f7182c9c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:16.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.934+0000 7f7182c9c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:16.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.934+0000 7f7182c9c980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:16.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.934+0000 7f7182c9c980 20 searching for the correct realm 2024-03-09T14:32:16.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.938+0000 7f7180fb5640 0 -- 172.21.15.99:0/3491437496 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f7174008050 msgr2=0x7f717405c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:16.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:16.946+0000 7f717ffb3640 0 -- 172.21.15.99:0/3491437496 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f71780e2c00 msgr2=0x7f71780f2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:17.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.162+0000 7f7182c9c980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:17.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.162+0000 7f7182c9c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:17.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.162+0000 7f7182c9c980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:17.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.162+0000 7f7182c9c980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:17.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.162+0000 7f7182c9c980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:17.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.162+0000 7f7182c9c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:17.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.162+0000 7f7182c9c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.162+0000 7f7182c9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.162+0000 7f7182c9c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.166+0000 7f7182c9c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:17.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.166+0000 7f7182c9c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.166+0000 7f7182c9c980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:17.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.166+0000 7f7182c9c980 20 zone default found 2024-03-09T14:32:17.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.166+0000 7f7182c9c980 4 Realm: () 2024-03-09T14:32:17.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.166+0000 7f7182c9c980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:17.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.166+0000 7f7182c9c980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:17.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.166+0000 7f7182c9c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:17.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.166+0000 7f7182c9c980 20 zonegroup default 2024-03-09T14:32:17.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.166+0000 7f7182c9c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.166+0000 7f7182c9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.166+0000 7f7182c9c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.166+0000 7f7182c9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.166+0000 7f7182c9c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.166+0000 7f7182c9c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.166+0000 7f7182c9c980 20 started sync module instance, tier type = 2024-03-09T14:32:17.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.166+0000 7f7182c9c980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:17.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.194+0000 7f7182c9c980 20 add_watcher() i=0 2024-03-09T14:32:17.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.194+0000 7f7182c9c980 20 add_watcher() i=1 2024-03-09T14:32:17.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.194+0000 7f7182c9c980 20 add_watcher() i=2 2024-03-09T14:32:17.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.194+0000 7f7182c9c980 20 add_watcher() i=3 2024-03-09T14:32:17.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.194+0000 7f7182c9c980 20 add_watcher() i=4 2024-03-09T14:32:17.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.194+0000 7f7182c9c980 20 add_watcher() i=5 2024-03-09T14:32:17.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.194+0000 7f7182c9c980 20 add_watcher() i=6 2024-03-09T14:32:17.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.198+0000 7f7182c9c980 20 add_watcher() i=7 2024-03-09T14:32:17.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.198+0000 7f7182c9c980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:17.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.202+0000 7f7036fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:17.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.202+0000 7f7182c9c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:17.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.202+0000 7f7182c9c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:17.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.202+0000 7f7182c9c980 5 note: GC not initialized 2024-03-09T14:32:17.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.202+0000 7f7035fdb640 20 reqs_thread_entry: start 2024-03-09T14:32:17.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.202+0000 7f7182c9c980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:17.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.202+0000 7f7182c9c980 20 Filter name: none 2024-03-09T14:32:17.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.202+0000 7f6fa77fe640 20 reqs_thread_entry: start 2024-03-09T14:32:17.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.202+0000 7f7182c9c980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:32:17.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.202+0000 7f7182c9c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:17.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:32:17.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:32:17.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 : miss 2024-03-09T14:32:17.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:17.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 info.flags=0x17 2024-03-09T14:32:17.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 to cache LRU end 2024-03-09T14:32:17.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:32:17.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:32:17.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 2024-03-09T14:32:17.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:17.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 1 NOTICE: finished shard 0 (0 entries found) 2024-03-09T14:32:17.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:17.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 1 NOTICE: finished shard 1 (0 entries found) 2024-03-09T14:32:17.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:17.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 1 NOTICE: finished shard 2 (0 entries found) 2024-03-09T14:32:17.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.206+0000 7f7182c9c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:17.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.210+0000 7f7182c9c980 1 NOTICE: finished shard 3 (0 entries found) 2024-03-09T14:32:17.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.210+0000 7f7182c9c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:17.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.210+0000 7f7182c9c980 1 NOTICE: finished shard 4 (0 entries found) 2024-03-09T14:32:17.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.210+0000 7f7182c9c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:17.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.210+0000 7f7182c9c980 1 NOTICE: finished shard 5 (1 entries found) 2024-03-09T14:32:17.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.210+0000 7f7182c9c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:17.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.210+0000 7f7182c9c980 1 NOTICE: finished shard 6 (0 entries found) 2024-03-09T14:32:17.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.210+0000 7f7182c9c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:17.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.210+0000 7f7182c9c980 1 NOTICE: finished shard 7 (0 entries found) 2024-03-09T14:32:17.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.210+0000 7f7182c9c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:17.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.214+0000 7f7182c9c980 1 NOTICE: finished shard 8 (1 entries found) 2024-03-09T14:32:17.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.214+0000 7f7182c9c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:17.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.214+0000 7f7182c9c980 1 NOTICE: finished shard 9 (0 entries found) 2024-03-09T14:32:17.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.214+0000 7f7182c9c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:17.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.214+0000 7f7182c9c980 1 NOTICE: finished shard 10 (0 entries found) 2024-03-09T14:32:17.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.214+0000 7f7182c9c980 1 NOTICE: finished all shards (2 entries found) 2024-03-09T14:32:17.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.218+0000 7f7036fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:17.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.222+0000 7f7182c9c980 20 remove_watcher() i=0 2024-03-09T14:32:17.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.222+0000 7f7182c9c980 2 removed watcher, disabling cache 2024-03-09T14:32:17.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.222+0000 7f7182c9c980 20 remove_watcher() i=1 2024-03-09T14:32:17.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.226+0000 7f7182c9c980 20 remove_watcher() i=2 2024-03-09T14:32:17.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.230+0000 7f7182c9c980 20 remove_watcher() i=3 2024-03-09T14:32:17.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.230+0000 7f7182c9c980 20 remove_watcher() i=4 2024-03-09T14:32:17.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.234+0000 7f7182c9c980 20 remove_watcher() i=5 2024-03-09T14:32:17.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.234+0000 7f7182c9c980 20 remove_watcher() i=6 2024-03-09T14:32:17.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.238+0000 7f7182c9c980 20 remove_watcher() i=7 2024-03-09T14:32:17.255 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-03-09T14:32:17.255 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:32:17.256 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-09T14:32:17.290 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:17.290 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:17.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.334+0000 7f2f8b5bc980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.338+0000 7f2f8b5bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.338+0000 7f2f8b5bc980 20 realm 2024-03-09T14:32:17.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.338+0000 7f2f8b5bc980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.338+0000 7f2f8b5bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.338+0000 7f2f8b5bc980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:17.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.338+0000 7f2f8b5bc980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.338+0000 7f2f8b5bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.338+0000 7f2f8b5bc980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.338+0000 7f2f8b5bc980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:17.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.338+0000 7f2f8b5bc980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.342+0000 7f2f8b5bc980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:17.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.342+0000 7f2f8b5bc980 20 searching for the correct realm 2024-03-09T14:32:17.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.342+0000 7f2f898d5640 0 -- 172.21.15.99:0/716852783 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55edf8133120 msgr2=0x55edf8135530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:17.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.350+0000 7f2f888d3640 0 -- 172.21.15.99:0/716852783 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f2f840fb2e0 msgr2=0x7f2f841139a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:32:17.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.566+0000 7f2f8b5bc980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:17.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.566+0000 7f2f8b5bc980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:17.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.566+0000 7f2f8b5bc980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:17.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.566+0000 7f2f8b5bc980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:17.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.566+0000 7f2f8b5bc980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:17.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.566+0000 7f2f8b5bc980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:17.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.566+0000 7f2f8b5bc980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.566+0000 7f2f8b5bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.566+0000 7f2f8b5bc980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.570+0000 7f2f8b5bc980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:17.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.570+0000 7f2f8b5bc980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.570+0000 7f2f8b5bc980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:17.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.570+0000 7f2f8b5bc980 20 zone default found 2024-03-09T14:32:17.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.570+0000 7f2f8b5bc980 4 Realm: () 2024-03-09T14:32:17.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.570+0000 7f2f8b5bc980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:17.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.570+0000 7f2f8b5bc980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:17.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.570+0000 7f2f8b5bc980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:17.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.570+0000 7f2f8b5bc980 20 zonegroup default 2024-03-09T14:32:17.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.570+0000 7f2f8b5bc980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.570+0000 7f2f8b5bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.570+0000 7f2f8b5bc980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.570+0000 7f2f8b5bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.570+0000 7f2f8b5bc980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.570+0000 7f2f8b5bc980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.570+0000 7f2f8b5bc980 20 started sync module instance, tier type = 2024-03-09T14:32:17.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.570+0000 7f2f8b5bc980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:17.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.598+0000 7f2f8b5bc980 20 add_watcher() i=0 2024-03-09T14:32:17.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.598+0000 7f2f8b5bc980 20 add_watcher() i=1 2024-03-09T14:32:17.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.598+0000 7f2f8b5bc980 20 add_watcher() i=2 2024-03-09T14:32:17.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.598+0000 7f2f8b5bc980 20 add_watcher() i=3 2024-03-09T14:32:17.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.598+0000 7f2f8b5bc980 20 add_watcher() i=4 2024-03-09T14:32:17.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.598+0000 7f2f8b5bc980 20 add_watcher() i=5 2024-03-09T14:32:17.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.598+0000 7f2f8b5bc980 20 add_watcher() i=6 2024-03-09T14:32:17.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.602+0000 7f2f8b5bc980 20 add_watcher() i=7 2024-03-09T14:32:17.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.602+0000 7f2f8b5bc980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:17.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2e3ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:17.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:17.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:17.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 5 note: GC not initialized 2024-03-09T14:32:17.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2e3efe5640 20 reqs_thread_entry: start 2024-03-09T14:32:17.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:17.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 20 Filter name: none 2024-03-09T14:32:17.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2e3cfe1640 20 reqs_thread_entry: start 2024-03-09T14:32:17.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:32:17.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:17.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:32:17.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:32:17.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 : miss 2024-03-09T14:32:17.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:17.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 info.flags=0x17 2024-03-09T14:32:17.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 to cache LRU end 2024-03-09T14:32:17.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:32:17.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:32:17.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.606+0000 7f2f8b5bc980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 2024-03-09T14:32:17.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.610+0000 7f2f8b5bc980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:17.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.610+0000 7f2f8b5bc980 1 NOTICE: finished shard 0 (0 entries removed) 2024-03-09T14:32:17.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.610+0000 7f2f8b5bc980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:17.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.610+0000 7f2f8b5bc980 1 NOTICE: finished shard 1 (0 entries removed) 2024-03-09T14:32:17.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.610+0000 7f2f8b5bc980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:17.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.610+0000 7f2f8b5bc980 1 NOTICE: finished shard 2 (0 entries removed) 2024-03-09T14:32:17.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.610+0000 7f2f8b5bc980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:17.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.610+0000 7f2f8b5bc980 1 NOTICE: finished shard 3 (0 entries removed) 2024-03-09T14:32:17.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.610+0000 7f2f8b5bc980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:17.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.610+0000 7f2f8b5bc980 1 NOTICE: finished shard 4 (0 entries removed) 2024-03-09T14:32:17.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.610+0000 7f2f8b5bc980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:17.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.614+0000 7f2f8b5bc980 20 get_obj_state: octx=0x55edf7dfad30 obj=check-bucket:d state=0x55edf816bb18 s->prefetch_data=0 2024-03-09T14:32:17.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.614+0000 7f2f8b5bc980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:17.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.614+0000 7f2f8b5bc980 1 NOTICE: finished shard 6 (0 entries removed) 2024-03-09T14:32:17.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.614+0000 7f2f8b5bc980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:17.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.614+0000 7f2f8b5bc980 1 NOTICE: finished shard 7 (0 entries removed) 2024-03-09T14:32:17.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.614+0000 7f2f8b5bc980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:17.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.614+0000 7f2f8b5bc980 20 get_obj_state: octx=0x55edf7ec7eb0 obj=check-bucket:c state=0x55edf8164348 s->prefetch_data=0 2024-03-09T14:32:17.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.614+0000 7f2f8b5bc980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:17.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.618+0000 7f2f8b5bc980 1 NOTICE: finished shard 9 (0 entries removed) 2024-03-09T14:32:17.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.618+0000 7f2f8b5bc980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:17.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.618+0000 7f2f8b5bc980 1 NOTICE: finished shard 10 (0 entries removed) 2024-03-09T14:32:17.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.618+0000 7f2f8b5bc980 20 get_obj_state: setting s->obj_tag to 48xbflcwj1em33axbcj6kq13j20ouq98 2024-03-09T14:32:17.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.618+0000 7f2f8b5bc980 20 get_obj_state_impl: setting s->olh_tag to 6p3wvz474oauv4v0araw5wgn3p0eeh74 2024-03-09T14:32:17.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.618+0000 7f2f8b5bc980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:17.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.618+0000 7f2f8b5bc980 20 get_obj_state: setting s->obj_tag to otko8hwv3indplizsgkkg4zkqlnk12se 2024-03-09T14:32:17.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.618+0000 7f2f8b5bc980 20 get_obj_state_impl: setting s->olh_tag to kllywuea5yc1mtw0pnnrv37xsl61cl5c 2024-03-09T14:32:17.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.618+0000 7f2f8b5bc980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:17.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.618+0000 7f2f8b5bc980 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-03-09T14:32:17.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.618+0000 7f2f8b5bc980 20 olh_log_entry: epoch=4 op=3 key=c[p-P1-LfgfUQtXDyhAU0WNjw2fHSYxh3] 2024-03-09T14:32:17.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.618+0000 7f2f8b5bc980 20 get_obj_state: octx=0x55edf81b72b0 obj=check-bucket:_:p-P1-LfgfUQtXDyhAU0WNjw2fHSYxh3_c state=0x55edf81695a8 s->prefetch_data=0 2024-03-09T14:32:17.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.618+0000 7f2f8b5bc980 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-03-09T14:32:17.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.618+0000 7f2f8b5bc980 20 olh_log_entry: epoch=4 op=3 key=d[aYId7ivRxuS6DLX.B98u2qL4-9rPBSo] 2024-03-09T14:32:17.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.618+0000 7f2f8b5bc980 20 get_obj_state: octx=0x55edf81971b0 obj=check-bucket:_:aYId7ivRxuS6DLX.B98u2qL4-9rPBSo_d state=0x55edf81c1f78 s->prefetch_data=0 2024-03-09T14:32:17.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.622+0000 7f2f8b5bc980 20 get_obj_state: octx=0x55edf81b72b0 obj=check-bucket:c state=0x55edf81b7a28 s->prefetch_data=0 2024-03-09T14:32:17.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.622+0000 7f2f8b5bc980 20 get_obj_state: setting s->obj_tag to otko8hwv3indplizsgkkg4zkqlnk12se 2024-03-09T14:32:17.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.622+0000 7f2f8b5bc980 20 get_obj_state_impl: setting s->olh_tag to kllywuea5yc1mtw0pnnrv37xsl61cl5c 2024-03-09T14:32:17.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.622+0000 7f2f8b5bc980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kllywuea5yc1mtw0pnnrv37xsl61cl5c 2024-03-09T14:32:17.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.622+0000 7f2f8b5bc980 20 get_obj_state: octx=0x55edf81971b0 obj=check-bucket:d state=0x55edf8164ea8 s->prefetch_data=0 2024-03-09T14:32:17.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.626+0000 7f2f8b5bc980 20 get_obj_state: setting s->obj_tag to 48xbflcwj1em33axbcj6kq13j20ouq98 2024-03-09T14:32:17.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.626+0000 7f2f8b5bc980 20 get_obj_state_impl: setting s->olh_tag to 6p3wvz474oauv4v0araw5wgn3p0eeh74 2024-03-09T14:32:17.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.626+0000 7f2f8b5bc980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=6p3wvz474oauv4v0araw5wgn3p0eeh74 2024-03-09T14:32:17.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.638+0000 7f2f8b5bc980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:17.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.638+0000 7f2f8b5bc980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:17.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.642+0000 7f2f8b5bc980 1 NOTICE: finished shard 5 (1 entries removed) 2024-03-09T14:32:17.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.642+0000 7f2f8b5bc980 1 NOTICE: finished shard 8 (1 entries removed) 2024-03-09T14:32:17.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.642+0000 7f2f8b5bc980 1 NOTICE: finished all shards (2 entries removed) 2024-03-09T14:32:17.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.646+0000 7f2e3ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:17.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.650+0000 7f2f8b5bc980 20 remove_watcher() i=0 2024-03-09T14:32:17.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.650+0000 7f2f8b5bc980 2 removed watcher, disabling cache 2024-03-09T14:32:17.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.654+0000 7f2f8b5bc980 20 remove_watcher() i=1 2024-03-09T14:32:17.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.654+0000 7f2f8b5bc980 20 remove_watcher() i=2 2024-03-09T14:32:17.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.658+0000 7f2f8b5bc980 20 remove_watcher() i=3 2024-03-09T14:32:17.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.662+0000 7f2f8b5bc980 20 remove_watcher() i=4 2024-03-09T14:32:17.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.662+0000 7f2f8b5bc980 20 remove_watcher() i=5 2024-03-09T14:32:17.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.662+0000 7f2f8b5bc980 20 remove_watcher() i=6 2024-03-09T14:32:17.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.666+0000 7f2f8b5bc980 20 remove_watcher() i=7 2024-03-09T14:32:17.679 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-09T14:32:17.711 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:17.712 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:17.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.754+0000 7f863980c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.754+0000 7f863980c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.754+0000 7f863980c980 20 realm 2024-03-09T14:32:17.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.754+0000 7f863980c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.754+0000 7f863980c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.754+0000 7f863980c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:17.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.754+0000 7f863980c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.754+0000 7f863980c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.754+0000 7f863980c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.758+0000 7f863980c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:17.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.758+0000 7f863980c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.758+0000 7f863980c980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:17.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.758+0000 7f863980c980 20 searching for the correct realm 2024-03-09T14:32:17.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.762+0000 7f8636b23640 0 -- 172.21.15.99:0/4234103006 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f8628054000 msgr2=0x7f8628052c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:17.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.770+0000 7f8636b23640 0 -- 172.21.15.99:0/4234103006 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f86300d0070 msgr2=0x7f86300f93f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:17.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.986+0000 7f863980c980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:17.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.986+0000 7f863980c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:17.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.986+0000 7f863980c980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:17.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.986+0000 7f863980c980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:17.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.986+0000 7f863980c980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:17.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.986+0000 7f863980c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:17.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.986+0000 7f863980c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.986+0000 7f863980c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.986+0000 7f863980c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.990+0000 7f863980c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:17.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.990+0000 7f863980c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.990+0000 7f863980c980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:17.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.990+0000 7f863980c980 20 zone default found 2024-03-09T14:32:17.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.990+0000 7f863980c980 4 Realm: () 2024-03-09T14:32:17.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.990+0000 7f863980c980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:17.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.990+0000 7f863980c980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:17.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.990+0000 7f863980c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:17.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.990+0000 7f863980c980 20 zonegroup default 2024-03-09T14:32:17.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.990+0000 7f863980c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.990+0000 7f863980c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.990+0000 7f863980c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.990+0000 7f863980c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.990+0000 7f863980c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:17.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.990+0000 7f863980c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:17.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.990+0000 7f863980c980 20 started sync module instance, tier type = 2024-03-09T14:32:17.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:17.990+0000 7f863980c980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:18.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.014+0000 7f863980c980 20 add_watcher() i=0 2024-03-09T14:32:18.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.014+0000 7f863980c980 20 add_watcher() i=1 2024-03-09T14:32:18.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.014+0000 7f863980c980 20 add_watcher() i=2 2024-03-09T14:32:18.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.014+0000 7f863980c980 20 add_watcher() i=3 2024-03-09T14:32:18.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.014+0000 7f863980c980 20 add_watcher() i=4 2024-03-09T14:32:18.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.014+0000 7f863980c980 20 add_watcher() i=5 2024-03-09T14:32:18.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.014+0000 7f863980c980 20 add_watcher() i=6 2024-03-09T14:32:18.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.018+0000 7f863980c980 20 add_watcher() i=7 2024-03-09T14:32:18.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.018+0000 7f863980c980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:18.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.022+0000 7f84edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:18.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.022+0000 7f863980c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:18.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.022+0000 7f863980c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:18.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.022+0000 7f863980c980 5 note: GC not initialized 2024-03-09T14:32:18.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.022+0000 7f84ecfe1640 20 reqs_thread_entry: start 2024-03-09T14:32:18.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.022+0000 7f863980c980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:18.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.022+0000 7f863980c980 20 Filter name: none 2024-03-09T14:32:18.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.022+0000 7f84667fc640 20 reqs_thread_entry: start 2024-03-09T14:32:18.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.022+0000 7f863980c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.022+0000 7f863980c980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:18.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.022+0000 7f863980c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:18.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:32:18.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:32:18.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 INFO: main: starting shard=0 2024-03-09T14:32:18.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:18.026 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.026 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 INFO: main: starting shard=1 2024-03-09T14:32:18.026 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:18.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 INFO: main: starting shard=2 2024-03-09T14:32:18.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:18.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 INFO: main: starting shard=3 2024-03-09T14:32:18.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:18.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 INFO: main: starting shard=4 2024-03-09T14:32:18.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:18.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 INFO: main: starting shard=5 2024-03-09T14:32:18.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.026+0000 7f863980c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:18.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.030+0000 7f863980c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.030+0000 7f863980c980 20 INFO: main: starting shard=6 2024-03-09T14:32:18.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.030+0000 7f863980c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:18.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.030+0000 7f863980c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.030+0000 7f863980c980 20 INFO: main: starting shard=7 2024-03-09T14:32:18.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.030+0000 7f863980c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:18.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.030+0000 7f863980c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.030+0000 7f863980c980 20 INFO: main: starting shard=8 2024-03-09T14:32:18.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.030+0000 7f863980c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:18.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.034+0000 7f863980c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.034+0000 7f863980c980 20 INFO: main: starting shard=9 2024-03-09T14:32:18.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.034+0000 7f863980c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:18.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.034+0000 7f863980c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.034+0000 7f863980c980 20 INFO: main: starting shard=10 2024-03-09T14:32:18.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.034+0000 7f863980c980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:18.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.034+0000 7f863980c980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.034+0000 7f863980c980 20 INFO: main: done 2024-03-09T14:32:18.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.038+0000 7f84edfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:18.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.042+0000 7f863980c980 20 remove_watcher() i=0 2024-03-09T14:32:18.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.042+0000 7f863980c980 2 removed watcher, disabling cache 2024-03-09T14:32:18.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.046+0000 7f863980c980 20 remove_watcher() i=1 2024-03-09T14:32:18.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.046+0000 7f863980c980 20 remove_watcher() i=2 2024-03-09T14:32:18.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.050+0000 7f863980c980 20 remove_watcher() i=3 2024-03-09T14:32:18.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.050+0000 7f863980c980 20 remove_watcher() i=4 2024-03-09T14:32:18.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.054+0000 7f863980c980 20 remove_watcher() i=5 2024-03-09T14:32:18.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.054+0000 7f863980c980 20 remove_watcher() i=6 2024-03-09T14:32:18.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.058+0000 7f863980c980 20 remove_watcher() i=7 2024-03-09T14:32:18.073 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-09T14:32:18.106 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:18.106 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:18.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.150+0000 7f932fdbb980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.150+0000 7f932fdbb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:18.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.150+0000 7f932fdbb980 20 realm 2024-03-09T14:32:18.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.150+0000 7f932fdbb980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.150+0000 7f932fdbb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:18.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.150+0000 7f932fdbb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:18.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.150+0000 7f932fdbb980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.150+0000 7f932fdbb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:18.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.150+0000 7f932fdbb980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.154+0000 7f932fdbb980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:18.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.154+0000 7f932fdbb980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.154+0000 7f932fdbb980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:18.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.154+0000 7f932fdbb980 20 searching for the correct realm 2024-03-09T14:32:18.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.162+0000 7f932e0d4640 0 -- 172.21.15.99:0/2897637850 >> [v2:172.21.15.99:6808/2872705330,v1:172.21.15.99:6809/2872705330] conn(0x55e37df939f0 msgr2=0x55e37df95e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:18.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.166+0000 7f932e0d4640 0 -- 172.21.15.99:0/2897637850 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55e37df9b4a0 msgr2=0x55e37df9d890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:18.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:18.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:18.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:18.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:18.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:18.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:18.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:18.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:18.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:18.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 20 zone default found 2024-03-09T14:32:18.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 4 Realm: () 2024-03-09T14:32:18.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:18.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:18.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:18.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 20 zonegroup default 2024-03-09T14:32:18.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:18.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.174+0000 7f932fdbb980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.178+0000 7f932fdbb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:18.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.178+0000 7f932fdbb980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.178+0000 7f932fdbb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:18.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.178+0000 7f932fdbb980 20 started sync module instance, tier type = 2024-03-09T14:32:18.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.178+0000 7f932fdbb980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:18.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.194+0000 7f932fdbb980 20 add_watcher() i=0 2024-03-09T14:32:18.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.194+0000 7f932fdbb980 20 add_watcher() i=1 2024-03-09T14:32:18.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.194+0000 7f932fdbb980 20 add_watcher() i=2 2024-03-09T14:32:18.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.194+0000 7f932fdbb980 20 add_watcher() i=3 2024-03-09T14:32:18.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.194+0000 7f932fdbb980 20 add_watcher() i=4 2024-03-09T14:32:18.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.194+0000 7f932fdbb980 20 add_watcher() i=5 2024-03-09T14:32:18.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.194+0000 7f932fdbb980 20 add_watcher() i=6 2024-03-09T14:32:18.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.194+0000 7f932fdbb980 20 add_watcher() i=7 2024-03-09T14:32:18.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.194+0000 7f932fdbb980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:18.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.198+0000 7f91df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:18.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.198+0000 7f932fdbb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:18.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.198+0000 7f932fdbb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:18.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.198+0000 7f932fdbb980 5 note: GC not initialized 2024-03-09T14:32:18.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.198+0000 7f91de7fc640 20 reqs_thread_entry: start 2024-03-09T14:32:18.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.198+0000 7f932fdbb980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:18.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.198+0000 7f932fdbb980 20 Filter name: none 2024-03-09T14:32:18.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.198+0000 7f914ffff640 20 reqs_thread_entry: start 2024-03-09T14:32:18.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.198+0000 7f932fdbb980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.198+0000 7f932fdbb980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:18.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.198+0000 7f932fdbb980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.198+0000 7f932fdbb980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:18.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.198+0000 7f932fdbb980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:32:18.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.198+0000 7f932fdbb980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:32:18.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.198+0000 7f932fdbb980 20 INFO: main: starting shard=0 2024-03-09T14:32:18.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.198+0000 7f932fdbb980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:18.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 INFO: main: starting shard=1 2024-03-09T14:32:18.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:18.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 INFO: main: starting shard=2 2024-03-09T14:32:18.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:18.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 INFO: main: starting shard=3 2024-03-09T14:32:18.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:18.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 INFO: main: starting shard=4 2024-03-09T14:32:18.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:18.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 INFO: main: starting shard=5 2024-03-09T14:32:18.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:18.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 INFO: main: starting shard=6 2024-03-09T14:32:18.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:18.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 INFO: main: starting shard=7 2024-03-09T14:32:18.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.202+0000 7f932fdbb980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:18.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.206+0000 7f932fdbb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.206+0000 7f932fdbb980 20 INFO: main: starting shard=8 2024-03-09T14:32:18.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.206+0000 7f932fdbb980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:18.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.206+0000 7f932fdbb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.206+0000 7f932fdbb980 20 INFO: main: starting shard=9 2024-03-09T14:32:18.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.206+0000 7f932fdbb980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:18.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.206+0000 7f932fdbb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.206+0000 7f932fdbb980 20 INFO: main: starting shard=10 2024-03-09T14:32:18.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.206+0000 7f932fdbb980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:18.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.206+0000 7f932fdbb980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:18.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.206+0000 7f932fdbb980 20 INFO: main: done 2024-03-09T14:32:18.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.210+0000 7f91df7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:18.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.214+0000 7f932fdbb980 20 remove_watcher() i=0 2024-03-09T14:32:18.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.214+0000 7f932fdbb980 2 removed watcher, disabling cache 2024-03-09T14:32:18.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.218+0000 7f932fdbb980 20 remove_watcher() i=1 2024-03-09T14:32:18.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.218+0000 7f932fdbb980 20 remove_watcher() i=2 2024-03-09T14:32:18.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.222+0000 7f932fdbb980 20 remove_watcher() i=3 2024-03-09T14:32:18.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.222+0000 7f932fdbb980 20 remove_watcher() i=4 2024-03-09T14:32:18.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.222+0000 7f932fdbb980 20 remove_watcher() i=5 2024-03-09T14:32:18.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.230+0000 7f932fdbb980 20 remove_watcher() i=6 2024-03-09T14:32:18.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.230+0000 7f932fdbb980 20 remove_watcher() i=7 2024-03-09T14:32:18.245 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-03-09T14:32:18.245 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:32:18.245 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-03-09T14:32:18.273 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:18.273 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:18.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.314+0000 7f9480408980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.318+0000 7f9480408980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:18.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.318+0000 7f9480408980 20 realm 2024-03-09T14:32:18.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.318+0000 7f9480408980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.318+0000 7f9480408980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:18.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.318+0000 7f9480408980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:18.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.318+0000 7f9480408980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.318+0000 7f9480408980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:18.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.318+0000 7f9480408980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.318+0000 7f9480408980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:18.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.318+0000 7f9480408980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.322+0000 7f9480408980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:18.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.322+0000 7f9480408980 20 searching for the correct realm 2024-03-09T14:32:18.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.326+0000 7f947d71f640 0 -- 172.21.15.99:0/136592434 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f94700bf070 msgr2=0x7f94700effb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:18.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.330+0000 7f947d71f640 0 -- 172.21.15.99:0/136592434 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f9478060590 msgr2=0x7f947807ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:18.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.546+0000 7f9480408980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:18.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.546+0000 7f9480408980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:18.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.546+0000 7f9480408980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:18.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.546+0000 7f9480408980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:18.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.546+0000 7f9480408980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:18.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.546+0000 7f9480408980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:18.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.546+0000 7f9480408980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.546+0000 7f9480408980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:18.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.546+0000 7f9480408980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.546+0000 7f9480408980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:18.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.546+0000 7f9480408980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.550+0000 7f9480408980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:18.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.550+0000 7f9480408980 20 zone default found 2024-03-09T14:32:18.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.550+0000 7f9480408980 4 Realm: () 2024-03-09T14:32:18.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.550+0000 7f9480408980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:18.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.550+0000 7f9480408980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:18.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.550+0000 7f9480408980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:18.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.550+0000 7f9480408980 20 zonegroup default 2024-03-09T14:32:18.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.550+0000 7f9480408980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.550+0000 7f9480408980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:18.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.550+0000 7f9480408980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.550+0000 7f9480408980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:18.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.550+0000 7f9480408980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.550+0000 7f9480408980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:18.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.550+0000 7f9480408980 20 started sync module instance, tier type = 2024-03-09T14:32:18.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.550+0000 7f9480408980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:18.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.578+0000 7f9480408980 20 add_watcher() i=0 2024-03-09T14:32:18.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.578+0000 7f9480408980 20 add_watcher() i=1 2024-03-09T14:32:18.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.578+0000 7f9480408980 20 add_watcher() i=2 2024-03-09T14:32:18.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.578+0000 7f9480408980 20 add_watcher() i=3 2024-03-09T14:32:18.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.578+0000 7f9480408980 20 add_watcher() i=4 2024-03-09T14:32:18.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.578+0000 7f9480408980 20 add_watcher() i=5 2024-03-09T14:32:18.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.578+0000 7f9480408980 20 add_watcher() i=6 2024-03-09T14:32:18.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.582+0000 7f9480408980 20 add_watcher() i=7 2024-03-09T14:32:18.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.582+0000 7f9480408980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:18.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.586+0000 7f932f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:18.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.586+0000 7f9480408980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:18.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.586+0000 7f9480408980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:18.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.586+0000 7f9480408980 5 note: GC not initialized 2024-03-09T14:32:18.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.586+0000 7f932e7fc640 20 reqs_thread_entry: start 2024-03-09T14:32:18.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.586+0000 7f9480408980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:18.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.586+0000 7f9480408980 20 Filter name: none 2024-03-09T14:32:18.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.586+0000 7f929ffff640 20 reqs_thread_entry: start 2024-03-09T14:32:18.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.586+0000 7f9480408980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:32:18.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.586+0000 7f9480408980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.586+0000 7f9480408980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:18.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.586+0000 7f9480408980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:32:18.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.586+0000 7f9480408980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:32:18.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.586+0000 7f9480408980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 : miss 2024-03-09T14:32:18.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.586+0000 7f9480408980 20 rados->read ofs=0 len=0 2024-03-09T14:32:18.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.590+0000 7f9480408980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:18.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.590+0000 7f9480408980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 info.flags=0x17 2024-03-09T14:32:18.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.590+0000 7f9480408980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 to cache LRU end 2024-03-09T14:32:18.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.590+0000 7f9480408980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:32:18.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.590+0000 7f9480408980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:32:18.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.590+0000 7f9480408980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 2024-03-09T14:32:18.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.590+0000 7f9480408980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:18.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.590+0000 7f9480408980 1 NOTICE: finished shard 0 (0 entries found) 2024-03-09T14:32:18.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.590+0000 7f9480408980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:18.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.590+0000 7f9480408980 1 NOTICE: finished shard 1 (0 entries found) 2024-03-09T14:32:18.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.590+0000 7f9480408980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:18.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.590+0000 7f9480408980 1 NOTICE: finished shard 2 (0 entries found) 2024-03-09T14:32:18.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.590+0000 7f9480408980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:18.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.594+0000 7f9480408980 1 NOTICE: finished shard 3 (0 entries found) 2024-03-09T14:32:18.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.594+0000 7f9480408980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:18.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.594+0000 7f9480408980 1 NOTICE: finished shard 4 (0 entries found) 2024-03-09T14:32:18.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.594+0000 7f9480408980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:18.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.594+0000 7f9480408980 1 NOTICE: finished shard 5 (0 entries found) 2024-03-09T14:32:18.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.594+0000 7f9480408980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:18.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.594+0000 7f9480408980 1 NOTICE: finished shard 6 (0 entries found) 2024-03-09T14:32:18.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.594+0000 7f9480408980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:18.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.594+0000 7f9480408980 1 NOTICE: finished shard 7 (0 entries found) 2024-03-09T14:32:18.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.594+0000 7f9480408980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:18.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.598+0000 7f9480408980 1 NOTICE: finished shard 8 (0 entries found) 2024-03-09T14:32:18.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.598+0000 7f9480408980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:18.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.598+0000 7f9480408980 1 NOTICE: finished shard 9 (0 entries found) 2024-03-09T14:32:18.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.598+0000 7f9480408980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:18.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.598+0000 7f9480408980 1 NOTICE: finished shard 10 (0 entries found) 2024-03-09T14:32:18.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.598+0000 7f9480408980 1 NOTICE: finished all shards (0 entries found) 2024-03-09T14:32:18.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.602+0000 7f932f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:18.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.606+0000 7f9480408980 20 remove_watcher() i=0 2024-03-09T14:32:18.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.606+0000 7f9480408980 2 removed watcher, disabling cache 2024-03-09T14:32:18.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.610+0000 7f9480408980 20 remove_watcher() i=1 2024-03-09T14:32:18.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.610+0000 7f9480408980 20 remove_watcher() i=2 2024-03-09T14:32:18.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.614+0000 7f9480408980 20 remove_watcher() i=3 2024-03-09T14:32:18.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.614+0000 7f9480408980 20 remove_watcher() i=4 2024-03-09T14:32:18.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.618+0000 7f9480408980 20 remove_watcher() i=5 2024-03-09T14:32:18.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.618+0000 7f9480408980 20 remove_watcher() i=6 2024-03-09T14:32:18.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:18.622+0000 7f9480408980 20 remove_watcher() i=7 2024-03-09T14:32:18.636 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-03-09T14:32:18.636 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:32:18.638 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:18.638 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:18.642 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:18.642 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:18.650 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:18.650 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:18.695 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-03-09T14:32:18.695 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:32:18.696 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:18.697 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:18.748 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:18.748 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:18.838 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:18.838 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:18.875 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:18.875 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:18.882 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:18.882 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:18.920 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:18.920 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:18.928 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:18.928 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:18.965 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:18.965 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:18.973 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:18.973 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:19.010 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:19.011 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:19.018 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:19.018 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:19.057 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:19.058 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:19.065 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:19.065 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:19.103 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:19.103 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:19.109 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-03-09T14:32:19.528 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-03-09T14:32:20.940 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:20.940 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:21.009 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:32:21.010 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-03-09T14:32:21.044 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:21.044 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:21.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.090+0000 7f745ecf2980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.090+0000 7f745ecf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:21.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.090+0000 7f745ecf2980 20 realm 2024-03-09T14:32:21.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.090+0000 7f745ecf2980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.090+0000 7f745ecf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:21.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.090+0000 7f745ecf2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:21.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.090+0000 7f745ecf2980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.090+0000 7f745ecf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:21.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.090+0000 7f745ecf2980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.090+0000 7f745ecf2980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:21.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.090+0000 7f745ecf2980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.094+0000 7f745ecf2980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:21.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.094+0000 7f745ecf2980 20 searching for the correct realm 2024-03-09T14:32:21.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.098+0000 7f745d00b640 0 -- 172.21.15.99:0/123657180 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f745007e030 msgr2=0x7f745005b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:21.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.106+0000 7f745c009640 0 -- 172.21.15.99:0/123657180 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f7454052910 msgr2=0x7f7454023400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:21.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.322+0000 7f745ecf2980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:21.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.322+0000 7f745ecf2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:21.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.322+0000 7f745ecf2980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:21.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.322+0000 7f745ecf2980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:21.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.322+0000 7f745ecf2980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:21.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.322+0000 7f745ecf2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:21.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.322+0000 7f745ecf2980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.322+0000 7f745ecf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:21.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.322+0000 7f745ecf2980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.326+0000 7f745ecf2980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:21.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.326+0000 7f745ecf2980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.326+0000 7f745ecf2980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:21.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.326+0000 7f745ecf2980 20 zone default found 2024-03-09T14:32:21.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.326+0000 7f745ecf2980 4 Realm: () 2024-03-09T14:32:21.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.326+0000 7f745ecf2980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:21.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.326+0000 7f745ecf2980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:21.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.326+0000 7f745ecf2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:21.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.326+0000 7f745ecf2980 20 zonegroup default 2024-03-09T14:32:21.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.326+0000 7f745ecf2980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.326+0000 7f745ecf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:21.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.326+0000 7f745ecf2980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.326+0000 7f745ecf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:21.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.326+0000 7f745ecf2980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.326+0000 7f745ecf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:21.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.326+0000 7f745ecf2980 20 started sync module instance, tier type = 2024-03-09T14:32:21.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.326+0000 7f745ecf2980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:21.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.350+0000 7f745ecf2980 20 add_watcher() i=0 2024-03-09T14:32:21.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.350+0000 7f745ecf2980 20 add_watcher() i=1 2024-03-09T14:32:21.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.350+0000 7f745ecf2980 20 add_watcher() i=2 2024-03-09T14:32:21.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.350+0000 7f745ecf2980 20 add_watcher() i=3 2024-03-09T14:32:21.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.350+0000 7f745ecf2980 20 add_watcher() i=4 2024-03-09T14:32:21.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.350+0000 7f745ecf2980 20 add_watcher() i=5 2024-03-09T14:32:21.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.350+0000 7f745ecf2980 20 add_watcher() i=6 2024-03-09T14:32:21.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.354+0000 7f745ecf2980 20 add_watcher() i=7 2024-03-09T14:32:21.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.354+0000 7f745ecf2980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:21.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.358+0000 7f7312fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:21.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.358+0000 7f745ecf2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:21.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.358+0000 7f745ecf2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:21.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.358+0000 7f745ecf2980 5 note: GC not initialized 2024-03-09T14:32:21.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.358+0000 7f7311fe3640 20 reqs_thread_entry: start 2024-03-09T14:32:21.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.358+0000 7f745ecf2980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:21.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.362+0000 7f745ecf2980 20 Filter name: none 2024-03-09T14:32:21.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.362+0000 7f72837fe640 20 reqs_thread_entry: start 2024-03-09T14:32:21.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.362+0000 7f745ecf2980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.362+0000 7f745ecf2980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:21.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.362+0000 7f745ecf2980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.362+0000 7f745ecf2980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:21.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.362+0000 7f745ecf2980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:32:21.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.362+0000 7f745ecf2980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:32:21.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.362+0000 7f745ecf2980 20 INFO: main: starting shard=0 2024-03-09T14:32:21.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.362+0000 7f745ecf2980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:21.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.362+0000 7f745ecf2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.362+0000 7f745ecf2980 20 INFO: main: starting shard=1 2024-03-09T14:32:21.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.362+0000 7f745ecf2980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:21.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.362+0000 7f745ecf2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.362+0000 7f745ecf2980 20 INFO: main: starting shard=2 2024-03-09T14:32:21.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.362+0000 7f745ecf2980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:21.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.366+0000 7f745ecf2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.366+0000 7f745ecf2980 20 INFO: main: starting shard=3 2024-03-09T14:32:21.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.366+0000 7f745ecf2980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:21.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.366+0000 7f745ecf2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.366+0000 7f745ecf2980 20 INFO: main: starting shard=4 2024-03-09T14:32:21.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.366+0000 7f745ecf2980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:21.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.366+0000 7f745ecf2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.366+0000 7f745ecf2980 20 INFO: main: starting shard=5 2024-03-09T14:32:21.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.366+0000 7f745ecf2980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:21.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.366+0000 7f745ecf2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.366+0000 7f745ecf2980 20 INFO: main: starting shard=6 2024-03-09T14:32:21.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.366+0000 7f745ecf2980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:21.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.366+0000 7f745ecf2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.366+0000 7f745ecf2980 20 INFO: main: starting shard=7 2024-03-09T14:32:21.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.366+0000 7f745ecf2980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:21.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.370+0000 7f745ecf2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.370+0000 7f745ecf2980 20 INFO: main: starting shard=8 2024-03-09T14:32:21.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.370+0000 7f745ecf2980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:21.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.370+0000 7f745ecf2980 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-09T14:32:21.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.370+0000 7f745ecf2980 20 INFO: main: starting shard=9 2024-03-09T14:32:21.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.370+0000 7f745ecf2980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:21.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.370+0000 7f745ecf2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.370+0000 7f745ecf2980 20 INFO: main: starting shard=10 2024-03-09T14:32:21.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.370+0000 7f745ecf2980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:21.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.374+0000 7f745ecf2980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.374+0000 7f745ecf2980 20 INFO: main: done 2024-03-09T14:32:21.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.374+0000 7f7312fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:21.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.378+0000 7f745ecf2980 20 remove_watcher() i=0 2024-03-09T14:32:21.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.378+0000 7f745ecf2980 2 removed watcher, disabling cache 2024-03-09T14:32:21.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.382+0000 7f745ecf2980 20 remove_watcher() i=1 2024-03-09T14:32:21.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.386+0000 7f745ecf2980 20 remove_watcher() i=2 2024-03-09T14:32:21.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.386+0000 7f745ecf2980 20 remove_watcher() i=3 2024-03-09T14:32:21.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.390+0000 7f745ecf2980 20 remove_watcher() i=4 2024-03-09T14:32:21.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.390+0000 7f745ecf2980 20 remove_watcher() i=5 2024-03-09T14:32:21.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.394+0000 7f745ecf2980 20 remove_watcher() i=6 2024-03-09T14:32:21.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.394+0000 7f745ecf2980 20 remove_watcher() i=7 2024-03-09T14:32:21.412 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:21.412 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:21.416 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:21.416 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:21.482 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:32:21.482 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-03-09T14:32:21.516 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:21.516 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:21.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.558+0000 7f45b6268980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.562+0000 7f45b6268980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:21.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.562+0000 7f45b6268980 20 realm 2024-03-09T14:32:21.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.562+0000 7f45b6268980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.562+0000 7f45b6268980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:21.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.562+0000 7f45b6268980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:21.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.562+0000 7f45b6268980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.562+0000 7f45b6268980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:21.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.562+0000 7f45b6268980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.562+0000 7f45b6268980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:21.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.562+0000 7f45b6268980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.566+0000 7f45b6268980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:21.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.566+0000 7f45b6268980 20 searching for the correct realm 2024-03-09T14:32:21.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.570+0000 7f45b357f640 0 -- 172.21.15.99:0/3003789721 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f45a4026070 msgr2=0x7f45a40791b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:32:21.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.578+0000 7f45b357f640 0 -- 172.21.15.99:0/3003789721 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f45ac0f6c00 msgr2=0x7f45ac0fb040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:32:21.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.794+0000 7f45b6268980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:21.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.794+0000 7f45b6268980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:21.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.794+0000 7f45b6268980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:21.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.794+0000 7f45b6268980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:21.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.794+0000 7f45b6268980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:21.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.794+0000 7f45b6268980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:21.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.794+0000 7f45b6268980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.794+0000 7f45b6268980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:21.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.794+0000 7f45b6268980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.794+0000 7f45b6268980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:21.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.794+0000 7f45b6268980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.798+0000 7f45b6268980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:21.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.798+0000 7f45b6268980 20 zone default found 2024-03-09T14:32:21.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.798+0000 7f45b6268980 4 Realm: () 2024-03-09T14:32:21.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.798+0000 7f45b6268980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:21.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.798+0000 7f45b6268980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:21.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.798+0000 7f45b6268980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:21.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.798+0000 7f45b6268980 20 zonegroup default 2024-03-09T14:32:21.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.798+0000 7f45b6268980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.798+0000 7f45b6268980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:21.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.798+0000 7f45b6268980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.798+0000 7f45b6268980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:21.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.798+0000 7f45b6268980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.798+0000 7f45b6268980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:21.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.798+0000 7f45b6268980 20 started sync module instance, tier type = 2024-03-09T14:32:21.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.798+0000 7f45b6268980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:21.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.822+0000 7f45b6268980 20 add_watcher() i=0 2024-03-09T14:32:21.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.822+0000 7f45b6268980 20 add_watcher() i=1 2024-03-09T14:32:21.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.822+0000 7f45b6268980 20 add_watcher() i=2 2024-03-09T14:32:21.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.822+0000 7f45b6268980 20 add_watcher() i=3 2024-03-09T14:32:21.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.822+0000 7f45b6268980 20 add_watcher() i=4 2024-03-09T14:32:21.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.822+0000 7f45b6268980 20 add_watcher() i=5 2024-03-09T14:32:21.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.822+0000 7f45b6268980 20 add_watcher() i=6 2024-03-09T14:32:21.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.826+0000 7f45b6268980 20 add_watcher() i=7 2024-03-09T14:32:21.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.826+0000 7f45b6268980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:21.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.830+0000 7f4469fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:21.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.830+0000 7f45b6268980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:21.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.830+0000 7f45b6268980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:21.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.830+0000 7f45b6268980 5 note: GC not initialized 2024-03-09T14:32:21.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.830+0000 7f4468fe1640 20 reqs_thread_entry: start 2024-03-09T14:32:21.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.830+0000 7f45b6268980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:21.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.830+0000 7f45b6268980 20 Filter name: none 2024-03-09T14:32:21.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.830+0000 7f43e27fc640 20 reqs_thread_entry: start 2024-03-09T14:32:21.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.830+0000 7f45b6268980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.834+0000 7f45b6268980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:21.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.834+0000 7f45b6268980 20 rados->read ofs=0 len=0 2024-03-09T14:32:21.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.834+0000 7f45b6268980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:21.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.834+0000 7f45b6268980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:32:21.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.834+0000 7f45b6268980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:32:21.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.834+0000 7f45b6268980 20 INFO: main: starting shard=0 2024-03-09T14:32:21.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.834+0000 7f45b6268980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:21.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.834+0000 7f45b6268980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.834+0000 7f45b6268980 20 INFO: main: starting shard=1 2024-03-09T14:32:21.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.834+0000 7f45b6268980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:21.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.834+0000 7f45b6268980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.834+0000 7f45b6268980 20 INFO: main: starting shard=2 2024-03-09T14:32:21.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.834+0000 7f45b6268980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:21.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.834+0000 7f45b6268980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.834+0000 7f45b6268980 20 INFO: main: starting shard=3 2024-03-09T14:32:21.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.834+0000 7f45b6268980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:21.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.838+0000 7f45b6268980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.838+0000 7f45b6268980 20 INFO: main: starting shard=4 2024-03-09T14:32:21.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.838+0000 7f45b6268980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:21.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.838+0000 7f45b6268980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.838+0000 7f45b6268980 20 INFO: main: starting shard=5 2024-03-09T14:32:21.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.838+0000 7f45b6268980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:21.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.838+0000 7f45b6268980 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-03-09T14:32:21.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.838+0000 7f45b6268980 20 INFO: main: starting shard=6 2024-03-09T14:32:21.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.838+0000 7f45b6268980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:21.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.838+0000 7f45b6268980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.838+0000 7f45b6268980 20 INFO: main: starting shard=7 2024-03-09T14:32:21.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.838+0000 7f45b6268980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:21.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.842+0000 7f45b6268980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.842+0000 7f45b6268980 20 INFO: main: starting shard=8 2024-03-09T14:32:21.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.842+0000 7f45b6268980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:21.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.842+0000 7f45b6268980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.842+0000 7f45b6268980 20 INFO: main: starting shard=9 2024-03-09T14:32:21.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.842+0000 7f45b6268980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:21.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.842+0000 7f45b6268980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.842+0000 7f45b6268980 20 INFO: main: starting shard=10 2024-03-09T14:32:21.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.842+0000 7f45b6268980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:21.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.842+0000 7f45b6268980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:21.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.842+0000 7f45b6268980 20 INFO: main: done 2024-03-09T14:32:21.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.846+0000 7f4469fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:21.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.850+0000 7f45b6268980 20 remove_watcher() i=0 2024-03-09T14:32:21.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.850+0000 7f45b6268980 2 removed watcher, disabling cache 2024-03-09T14:32:21.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.854+0000 7f45b6268980 20 remove_watcher() i=1 2024-03-09T14:32:21.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.854+0000 7f45b6268980 20 remove_watcher() i=2 2024-03-09T14:32:21.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.858+0000 7f45b6268980 20 remove_watcher() i=3 2024-03-09T14:32:21.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.858+0000 7f45b6268980 20 remove_watcher() i=4 2024-03-09T14:32:21.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.862+0000 7f45b6268980 20 remove_watcher() i=5 2024-03-09T14:32:21.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.862+0000 7f45b6268980 20 remove_watcher() i=6 2024-03-09T14:32:21.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:21.866+0000 7f45b6268980 20 remove_watcher() i=7 2024-03-09T14:32:21.881 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:21.881 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:21.885 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:21.885 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:21.949 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:32:21.950 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-03-09T14:32:21.985 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:21.985 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:22.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.030+0000 7fbf7cc29980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.034+0000 7fbf7cc29980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:22.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.034+0000 7fbf7cc29980 20 realm 2024-03-09T14:32:22.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.034+0000 7fbf7cc29980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.034+0000 7fbf7cc29980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:22.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.034+0000 7fbf7cc29980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:22.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.034+0000 7fbf7cc29980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.034+0000 7fbf7cc29980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:22.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.034+0000 7fbf7cc29980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.034+0000 7fbf7cc29980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:22.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.034+0000 7fbf7cc29980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.038+0000 7fbf7cc29980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:22.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.038+0000 7fbf7cc29980 20 searching for the correct realm 2024-03-09T14:32:22.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.038+0000 7fbf7af42640 0 -- 172.21.15.99:0/1183212565 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x563734dc56a0 msgr2=0x563734dc7a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:22.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.046+0000 7fbf79f40640 0 -- 172.21.15.99:0/1183212565 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fbf740d6420 msgr2=0x7fbf740d68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:22.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.262+0000 7fbf7cc29980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:22.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.262+0000 7fbf7cc29980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:22.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.262+0000 7fbf7cc29980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:22.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.262+0000 7fbf7cc29980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:22.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.262+0000 7fbf7cc29980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:22.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.262+0000 7fbf7cc29980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:22.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.262+0000 7fbf7cc29980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.262+0000 7fbf7cc29980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:22.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.262+0000 7fbf7cc29980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.262+0000 7fbf7cc29980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:22.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.262+0000 7fbf7cc29980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.262+0000 7fbf7cc29980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:22.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.266+0000 7fbf7cc29980 20 zone default found 2024-03-09T14:32:22.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.266+0000 7fbf7cc29980 4 Realm: () 2024-03-09T14:32:22.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.266+0000 7fbf7cc29980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:22.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.266+0000 7fbf7cc29980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:22.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.266+0000 7fbf7cc29980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:22.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.266+0000 7fbf7cc29980 20 zonegroup default 2024-03-09T14:32:22.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.266+0000 7fbf7cc29980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.266+0000 7fbf7cc29980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:22.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.266+0000 7fbf7cc29980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.266+0000 7fbf7cc29980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:22.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.266+0000 7fbf7cc29980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.266+0000 7fbf7cc29980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:22.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.266+0000 7fbf7cc29980 20 started sync module instance, tier type = 2024-03-09T14:32:22.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.266+0000 7fbf7cc29980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:22.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.294+0000 7fbf7cc29980 20 add_watcher() i=0 2024-03-09T14:32:22.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.294+0000 7fbf7cc29980 20 add_watcher() i=1 2024-03-09T14:32:22.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.294+0000 7fbf7cc29980 20 add_watcher() i=2 2024-03-09T14:32:22.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.294+0000 7fbf7cc29980 20 add_watcher() i=3 2024-03-09T14:32:22.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.294+0000 7fbf7cc29980 20 add_watcher() i=4 2024-03-09T14:32:22.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.294+0000 7fbf7cc29980 20 add_watcher() i=5 2024-03-09T14:32:22.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.294+0000 7fbf7cc29980 20 add_watcher() i=6 2024-03-09T14:32:22.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.294+0000 7fbf7cc29980 20 add_watcher() i=7 2024-03-09T14:32:22.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.294+0000 7fbf7cc29980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:22.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.298+0000 7fbe317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:22.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.302+0000 7fbf7cc29980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:22.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.302+0000 7fbf7cc29980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:22.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.302+0000 7fbf7cc29980 5 note: GC not initialized 2024-03-09T14:32:22.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.302+0000 7fbe2b7fe640 20 reqs_thread_entry: start 2024-03-09T14:32:22.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.302+0000 7fbf7cc29980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:22.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.302+0000 7fbf7cc29980 20 Filter name: none 2024-03-09T14:32:22.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.302+0000 7fbe297fa640 20 reqs_thread_entry: start 2024-03-09T14:32:22.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.302+0000 7fbf7cc29980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.302+0000 7fbf7cc29980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:22.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.302+0000 7fbf7cc29980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.302+0000 7fbf7cc29980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:22.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.302+0000 7fbf7cc29980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:32:22.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.302+0000 7fbf7cc29980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:32:22.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.302+0000 7fbf7cc29980 20 INFO: main: starting shard=0 2024-03-09T14:32:22.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.302+0000 7fbf7cc29980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:22.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.306+0000 7fbf7cc29980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.306+0000 7fbf7cc29980 20 INFO: main: starting shard=1 2024-03-09T14:32:22.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.306+0000 7fbf7cc29980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:22.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.306+0000 7fbf7cc29980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:32:22.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.306+0000 7fbf7cc29980 20 INFO: main: starting shard=2 2024-03-09T14:32:22.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.306+0000 7fbf7cc29980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:22.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.306+0000 7fbf7cc29980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.306+0000 7fbf7cc29980 20 INFO: main: starting shard=3 2024-03-09T14:32:22.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.306+0000 7fbf7cc29980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:22.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.306+0000 7fbf7cc29980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.306+0000 7fbf7cc29980 20 INFO: main: starting shard=4 2024-03-09T14:32:22.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.306+0000 7fbf7cc29980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:22.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.310+0000 7fbf7cc29980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.310+0000 7fbf7cc29980 20 INFO: main: starting shard=5 2024-03-09T14:32:22.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.310+0000 7fbf7cc29980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:22.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.310+0000 7fbf7cc29980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.310+0000 7fbf7cc29980 20 INFO: main: starting shard=6 2024-03-09T14:32:22.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.310+0000 7fbf7cc29980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:22.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.310+0000 7fbf7cc29980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.310+0000 7fbf7cc29980 20 INFO: main: starting shard=7 2024-03-09T14:32:22.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.310+0000 7fbf7cc29980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:22.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.310+0000 7fbf7cc29980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.310+0000 7fbf7cc29980 20 INFO: main: starting shard=8 2024-03-09T14:32:22.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.310+0000 7fbf7cc29980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:22.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.310+0000 7fbf7cc29980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.310+0000 7fbf7cc29980 20 INFO: main: starting shard=9 2024-03-09T14:32:22.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.310+0000 7fbf7cc29980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:22.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.314+0000 7fbf7cc29980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.314+0000 7fbf7cc29980 20 INFO: main: starting shard=10 2024-03-09T14:32:22.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.314+0000 7fbf7cc29980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:22.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.314+0000 7fbf7cc29980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.314+0000 7fbf7cc29980 20 INFO: main: done 2024-03-09T14:32:22.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.314+0000 7fbe317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:22.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.322+0000 7fbf7cc29980 20 remove_watcher() i=0 2024-03-09T14:32:22.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.322+0000 7fbf7cc29980 2 removed watcher, disabling cache 2024-03-09T14:32:22.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.322+0000 7fbf7cc29980 20 remove_watcher() i=1 2024-03-09T14:32:22.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.326+0000 7fbf7cc29980 20 remove_watcher() i=2 2024-03-09T14:32:22.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.330+0000 7fbf7cc29980 20 remove_watcher() i=3 2024-03-09T14:32:22.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.330+0000 7fbf7cc29980 20 remove_watcher() i=4 2024-03-09T14:32:22.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.334+0000 7fbf7cc29980 20 remove_watcher() i=5 2024-03-09T14:32:22.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.334+0000 7fbf7cc29980 20 remove_watcher() i=6 2024-03-09T14:32:22.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.338+0000 7fbf7cc29980 20 remove_watcher() i=7 2024-03-09T14:32:22.356 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:22.356 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:22.361 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:22.361 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:22.425 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:32:22.426 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-03-09T14:32:22.461 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:22.461 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:22.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.506+0000 7f281f3c5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.510+0000 7f281f3c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:22.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.510+0000 7f281f3c5980 20 realm 2024-03-09T14:32:22.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.510+0000 7f281f3c5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.510+0000 7f281f3c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:22.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.510+0000 7f281f3c5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:22.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.510+0000 7f281f3c5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.510+0000 7f281f3c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:22.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.510+0000 7f281f3c5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.510+0000 7f281f3c5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:22.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.510+0000 7f281f3c5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.514+0000 7f281f3c5980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:22.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.514+0000 7f281f3c5980 20 searching for the correct realm 2024-03-09T14:32:22.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.518+0000 7f281d6de640 0 -- 172.21.15.99:0/2034879658 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55de23f066e0 msgr2=0x55de23f08ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:22.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.522+0000 7f281c6dc640 0 -- 172.21.15.99:0/2034879658 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f280c0630c0 msgr2=0x7f280c0848f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:32:22.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.738+0000 7f281f3c5980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:22.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.738+0000 7f281f3c5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:22.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.738+0000 7f281f3c5980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:22.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.738+0000 7f281f3c5980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:22.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.738+0000 7f281f3c5980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:22.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.738+0000 7f281f3c5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:22.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.738+0000 7f281f3c5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.738+0000 7f281f3c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:22.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.738+0000 7f281f3c5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.742+0000 7f281f3c5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:22.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.742+0000 7f281f3c5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.742+0000 7f281f3c5980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:22.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.742+0000 7f281f3c5980 20 zone default found 2024-03-09T14:32:22.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.742+0000 7f281f3c5980 4 Realm: () 2024-03-09T14:32:22.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.742+0000 7f281f3c5980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:22.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.742+0000 7f281f3c5980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:22.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.742+0000 7f281f3c5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:22.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.742+0000 7f281f3c5980 20 zonegroup default 2024-03-09T14:32:22.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.742+0000 7f281f3c5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.742+0000 7f281f3c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:22.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.742+0000 7f281f3c5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.742+0000 7f281f3c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:22.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.742+0000 7f281f3c5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.746+0000 7f281f3c5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:22.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.746+0000 7f281f3c5980 20 started sync module instance, tier type = 2024-03-09T14:32:22.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.746+0000 7f281f3c5980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:22.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.770+0000 7f281f3c5980 20 add_watcher() i=0 2024-03-09T14:32:22.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.770+0000 7f281f3c5980 20 add_watcher() i=1 2024-03-09T14:32:22.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.770+0000 7f281f3c5980 20 add_watcher() i=2 2024-03-09T14:32:22.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.770+0000 7f281f3c5980 20 add_watcher() i=3 2024-03-09T14:32:22.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.770+0000 7f281f3c5980 20 add_watcher() i=4 2024-03-09T14:32:22.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.770+0000 7f281f3c5980 20 add_watcher() i=5 2024-03-09T14:32:22.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.770+0000 7f281f3c5980 20 add_watcher() i=6 2024-03-09T14:32:22.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.770+0000 7f281f3c5980 20 add_watcher() i=7 2024-03-09T14:32:22.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.770+0000 7f281f3c5980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:22.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.774+0000 7f26d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:22.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.774+0000 7f281f3c5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:22.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.774+0000 7f281f3c5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:22.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.774+0000 7f281f3c5980 5 note: GC not initialized 2024-03-09T14:32:22.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.778+0000 7f26d1fe3640 20 reqs_thread_entry: start 2024-03-09T14:32:22.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.778+0000 7f281f3c5980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:22.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.778+0000 7f281f3c5980 20 Filter name: none 2024-03-09T14:32:22.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.778+0000 7f26437fe640 20 reqs_thread_entry: start 2024-03-09T14:32:22.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.778+0000 7f281f3c5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.778+0000 7f281f3c5980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:22.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.778+0000 7f281f3c5980 20 rados->read ofs=0 len=0 2024-03-09T14:32:22.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.778+0000 7f281f3c5980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:22.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.778+0000 7f281f3c5980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:32:22.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.778+0000 7f281f3c5980 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-03-09T14:32:22.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.778+0000 7f281f3c5980 20 INFO: main: starting shard=0 2024-03-09T14:32:22.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.778+0000 7f281f3c5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:22.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.778+0000 7f281f3c5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.778+0000 7f281f3c5980 20 INFO: main: starting shard=1 2024-03-09T14:32:22.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.778+0000 7f281f3c5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:22.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.782+0000 7f281f3c5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.782+0000 7f281f3c5980 20 INFO: main: starting shard=2 2024-03-09T14:32:22.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.782+0000 7f281f3c5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:22.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.782+0000 7f281f3c5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.782+0000 7f281f3c5980 20 INFO: main: starting shard=3 2024-03-09T14:32:22.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.782+0000 7f281f3c5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:22.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.782+0000 7f281f3c5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.782+0000 7f281f3c5980 20 INFO: main: starting shard=4 2024-03-09T14:32:22.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.782+0000 7f281f3c5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:22.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.782+0000 7f281f3c5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.782+0000 7f281f3c5980 20 INFO: main: starting shard=5 2024-03-09T14:32:22.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.782+0000 7f281f3c5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:22.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.786+0000 7f281f3c5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.786+0000 7f281f3c5980 20 INFO: main: starting shard=6 2024-03-09T14:32:22.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.786+0000 7f281f3c5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:22.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.786+0000 7f281f3c5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.786+0000 7f281f3c5980 20 INFO: main: starting shard=7 2024-03-09T14:32:22.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.786+0000 7f281f3c5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:22.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.786+0000 7f281f3c5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.786+0000 7f281f3c5980 20 INFO: main: starting shard=8 2024-03-09T14:32:22.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.786+0000 7f281f3c5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:22.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.786+0000 7f281f3c5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.786+0000 7f281f3c5980 20 INFO: main: starting shard=9 2024-03-09T14:32:22.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.786+0000 7f281f3c5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:22.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.790+0000 7f281f3c5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:32:22.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.790+0000 7f281f3c5980 20 INFO: main: starting shard=10 2024-03-09T14:32:22.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.790+0000 7f281f3c5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:22.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.790+0000 7f281f3c5980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:32:22.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.790+0000 7f281f3c5980 20 INFO: main: done 2024-03-09T14:32:22.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.790+0000 7f26d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:22.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.798+0000 7f281f3c5980 20 remove_watcher() i=0 2024-03-09T14:32:22.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.798+0000 7f281f3c5980 2 removed watcher, disabling cache 2024-03-09T14:32:22.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.798+0000 7f281f3c5980 20 remove_watcher() i=1 2024-03-09T14:32:22.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.802+0000 7f281f3c5980 20 remove_watcher() i=2 2024-03-09T14:32:22.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.802+0000 7f281f3c5980 20 remove_watcher() i=3 2024-03-09T14:32:22.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.806+0000 7f281f3c5980 20 remove_watcher() i=4 2024-03-09T14:32:22.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.806+0000 7f281f3c5980 20 remove_watcher() i=5 2024-03-09T14:32:22.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.810+0000 7f281f3c5980 20 remove_watcher() i=6 2024-03-09T14:32:22.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:22.814+0000 7f281f3c5980 20 remove_watcher() i=7 2024-03-09T14:32:22.832 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:22.832 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:22.836 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-03-09T14:32:23.249 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-03-09T14:32:23.677 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-03-09T14:32:23.707 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:23.708 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:23.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.750+0000 7f7e98a3c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.750+0000 7f7e98a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:23.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.750+0000 7f7e98a3c980 20 realm 2024-03-09T14:32:23.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.750+0000 7f7e98a3c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.750+0000 7f7e98a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:23.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.750+0000 7f7e98a3c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:23.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.750+0000 7f7e98a3c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.754+0000 7f7e98a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:23.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.754+0000 7f7e98a3c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.754+0000 7f7e98a3c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:23.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.754+0000 7f7e98a3c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.754+0000 7f7e98a3c980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:23.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.754+0000 7f7e98a3c980 20 searching for the correct realm 2024-03-09T14:32:23.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.762+0000 7f7e96554640 0 -- 172.21.15.99:0/1052157220 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x55fd5b3c5ae0 msgr2=0x55fd5b3c7fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:23.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.766+0000 7f7e95d53640 0 -- 172.21.15.99:0/1052157220 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f7e90031060 msgr2=0x7f7e9006a9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:23.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:23.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:23.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:23.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:23.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:23.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:23.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:23.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:23.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:23.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 20 zone default found 2024-03-09T14:32:23.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 4 Realm: () 2024-03-09T14:32:23.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:23.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:23.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:23.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 20 zonegroup default 2024-03-09T14:32:23.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.774+0000 7f7e98a3c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.778+0000 7f7e98a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:23.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.778+0000 7f7e98a3c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.778+0000 7f7e98a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:23.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.778+0000 7f7e98a3c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.778+0000 7f7e98a3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:23.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.778+0000 7f7e98a3c980 20 started sync module instance, tier type = 2024-03-09T14:32:23.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.778+0000 7f7e98a3c980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:23.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.798+0000 7f7e98a3c980 20 add_watcher() i=0 2024-03-09T14:32:23.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.798+0000 7f7e98a3c980 20 add_watcher() i=1 2024-03-09T14:32:23.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.798+0000 7f7e98a3c980 20 add_watcher() i=2 2024-03-09T14:32:23.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.798+0000 7f7e98a3c980 20 add_watcher() i=3 2024-03-09T14:32:23.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.798+0000 7f7e98a3c980 20 add_watcher() i=4 2024-03-09T14:32:23.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.798+0000 7f7e98a3c980 20 add_watcher() i=5 2024-03-09T14:32:23.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.798+0000 7f7e98a3c980 20 add_watcher() i=6 2024-03-09T14:32:23.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.798+0000 7f7e98a3c980 20 add_watcher() i=7 2024-03-09T14:32:23.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.798+0000 7f7e98a3c980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:23.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7d4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:23.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:23.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:23.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 5 note: GC not initialized 2024-03-09T14:32:23.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7cc77fe640 20 reqs_thread_entry: start 2024-03-09T14:32:23.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:23.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 20 Filter name: none 2024-03-09T14:32:23.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7cc57fa640 20 reqs_thread_entry: start 2024-03-09T14:32:23.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:32:23.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:23.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:32:23.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:32:23.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 : miss 2024-03-09T14:32:23.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:23.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 info.flags=0x17 2024-03-09T14:32:23.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 to cache LRU end 2024-03-09T14:32:23.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:32:23.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:32:23.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 2024-03-09T14:32:23.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 20 list_objects_ordered: starting attempt 1 2024-03-09T14:32:23.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.802+0000 7f7e98a3c980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:32:23.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.806+0000 7f7e98a3c980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:32:23.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.806+0000 7f7e98a3c980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:32:23.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.806+0000 7f7e98a3c980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:32:23.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.806+0000 7f7e98a3c980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:32:23.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.814+0000 7f7d4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:23.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.818+0000 7f7e98a3c980 20 remove_watcher() i=0 2024-03-09T14:32:23.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.818+0000 7f7e98a3c980 2 removed watcher, disabling cache 2024-03-09T14:32:23.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.822+0000 7f7e98a3c980 20 remove_watcher() i=1 2024-03-09T14:32:23.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.822+0000 7f7e98a3c980 20 remove_watcher() i=2 2024-03-09T14:32:23.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.826+0000 7f7e98a3c980 20 remove_watcher() i=3 2024-03-09T14:32:23.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.826+0000 7f7e98a3c980 20 remove_watcher() i=4 2024-03-09T14:32:23.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.826+0000 7f7e98a3c980 20 remove_watcher() i=5 2024-03-09T14:32:23.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.830+0000 7f7e98a3c980 20 remove_watcher() i=6 2024-03-09T14:32:23.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.830+0000 7f7e98a3c980 20 remove_watcher() i=7 2024-03-09T14:32:23.844 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-09T14:32:23.875 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:23.875 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:23.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.918+0000 7f474d814980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.918+0000 7f474d814980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:23.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.918+0000 7f474d814980 20 realm 2024-03-09T14:32:23.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.918+0000 7f474d814980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.918+0000 7f474d814980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:23.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.918+0000 7f474d814980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:23.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.918+0000 7f474d814980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.918+0000 7f474d814980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:23.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.918+0000 7f474d814980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.922+0000 7f474d814980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:23.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.922+0000 7f474d814980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.922+0000 7f474d814980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:23.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.922+0000 7f474d814980 20 searching for the correct realm 2024-03-09T14:32:23.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.926+0000 7f474b32c640 0 -- 172.21.15.99:0/1107712921 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x55c99975bf70 msgr2=0x55c99975e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:23.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.934+0000 7f474ab2b640 0 -- 172.21.15.99:0/1107712921 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f473c0e8740 msgr2=0x7f473c0c6040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:23.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:23.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:23.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:23.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:23.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:23.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:23.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:23.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:23.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:23.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 20 zone default found 2024-03-09T14:32:23.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 4 Realm: () 2024-03-09T14:32:23.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:23.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:23.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:23.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 20 zonegroup default 2024-03-09T14:32:23.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.942+0000 7f474d814980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.946+0000 7f474d814980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:23.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.946+0000 7f474d814980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.946+0000 7f474d814980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:23.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.946+0000 7f474d814980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.946+0000 7f474d814980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:23.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.946+0000 7f474d814980 20 started sync module instance, tier type = 2024-03-09T14:32:23.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.946+0000 7f474d814980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:23.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.966+0000 7f474d814980 20 add_watcher() i=0 2024-03-09T14:32:23.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.966+0000 7f474d814980 20 add_watcher() i=1 2024-03-09T14:32:23.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.966+0000 7f474d814980 20 add_watcher() i=2 2024-03-09T14:32:23.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.966+0000 7f474d814980 20 add_watcher() i=3 2024-03-09T14:32:23.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.966+0000 7f474d814980 20 add_watcher() i=4 2024-03-09T14:32:23.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.966+0000 7f474d814980 20 add_watcher() i=5 2024-03-09T14:32:23.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.966+0000 7f474d814980 20 add_watcher() i=6 2024-03-09T14:32:23.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.966+0000 7f474d814980 20 add_watcher() i=7 2024-03-09T14:32:23.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.966+0000 7f474d814980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:23.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.966+0000 7f4601fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:23.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:23.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:23.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 5 note: GC not initialized 2024-03-09T14:32:23.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f4600fe1640 20 reqs_thread_entry: start 2024-03-09T14:32:23.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:23.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 20 Filter name: none 2024-03-09T14:32:23.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f457a7fc640 20 reqs_thread_entry: start 2024-03-09T14:32:23.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-03-09T14:32:23.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:23.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-03-09T14:32:23.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-03-09T14:32:23.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 : miss 2024-03-09T14:32:23.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 20 rados->read ofs=0 len=0 2024-03-09T14:32:23.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:23.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 info.flags=0x17 2024-03-09T14:32:23.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 to cache LRU end 2024-03-09T14:32:23.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:32:23.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-03-09T14:32:23.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2 2024-03-09T14:32:23.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.0 2024-03-09T14:32:23.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 1 NOTICE: finished shard 0 (0 entries removed) 2024-03-09T14:32:23.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:23.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.970+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.2 2024-03-09T14:32:23.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.974+0000 7f474d814980 1 NOTICE: finished shard 2 (0 entries removed) 2024-03-09T14:32:23.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.974+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.3 2024-03-09T14:32:23.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.974+0000 7f474d814980 1 NOTICE: finished shard 3 (0 entries removed) 2024-03-09T14:32:23.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.974+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.4 2024-03-09T14:32:23.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.974+0000 7f474d814980 1 NOTICE: finished shard 4 (0 entries removed) 2024-03-09T14:32:23.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.974+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:23.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.974+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.6 2024-03-09T14:32:23.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.974+0000 7f474d814980 1 NOTICE: finished shard 6 (0 entries removed) 2024-03-09T14:32:23.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.974+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.7 2024-03-09T14:32:23.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.978+0000 7f474d814980 1 NOTICE: finished shard 7 (0 entries removed) 2024-03-09T14:32:23.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.978+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:23.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.978+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.9 2024-03-09T14:32:23.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.978+0000 7f474d814980 1 NOTICE: finished shard 9 (0 entries removed) 2024-03-09T14:32:23.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.978+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:23.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.978+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:23.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.978+0000 7f474d814980 20 get_obj_state: octx=0x55c999421d30 obj=check-bucket:e state=0x55c99978eb78 s->prefetch_data=0 2024-03-09T14:32:23.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.978+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:23.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.982+0000 7f474d814980 20 get_obj_state: octx=0x55c9994eeec0 obj=check-bucket:d state=0x55c999788118 s->prefetch_data=0 2024-03-09T14:32:23.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.982+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:23.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.982+0000 7f474d814980 20 get_obj_state: octx=0x55c9997911f0 obj=check-bucket:c state=0x55c999789f08 s->prefetch_data=0 2024-03-09T14:32:23.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.982+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:23.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.982+0000 7f474d814980 20 get_obj_state: octx=0x55c999791bf0 obj=check-bucket:f state=0x55c99978b648 s->prefetch_data=0 2024-03-09T14:32:23.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.982+0000 7f474d814980 20 get_obj_state: setting s->obj_tag to l8evktix9zw483rh05jftcydd2owfaus 2024-03-09T14:32:23.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.982+0000 7f474d814980 20 get_obj_state_impl: setting s->olh_tag to lg7ethpcxujqp1b5jm9ixug3ds3btcee 2024-03-09T14:32:23.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.982+0000 7f474d814980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lg7ethpcxujqp1b5jm9ixug3ds3btcee 2024-03-09T14:32:23.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.982+0000 7f474d814980 20 get_obj_state: setting s->obj_tag to cooku2jzoqb63cr93ufw75fa775khej3 2024-03-09T14:32:23.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.982+0000 7f474d814980 20 get_obj_state_impl: setting s->olh_tag to z7tt4miz57jg0nrt7puctbdftgse9ok9 2024-03-09T14:32:23.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.982+0000 7f474d814980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=z7tt4miz57jg0nrt7puctbdftgse9ok9 2024-03-09T14:32:23.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.982+0000 7f474d814980 20 get_obj_state: setting s->obj_tag to ybvguspwez561gurnel2t1p51b52r9e8 2024-03-09T14:32:23.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.982+0000 7f474d814980 20 get_obj_state_impl: setting s->olh_tag to vmpzvah1dfuiy45jzp41o120fi7424ru 2024-03-09T14:32:23.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.982+0000 7f474d814980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vmpzvah1dfuiy45jzp41o120fi7424ru 2024-03-09T14:32:23.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.982+0000 7f474d814980 20 get_obj_state: setting s->obj_tag to h9z2pdt81pb05i618q2li13ijcidg47b 2024-03-09T14:32:23.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.982+0000 7f474d814980 20 get_obj_state_impl: setting s->olh_tag to 0x0hy00a4do2539ya79i1ea9obckdeh5 2024-03-09T14:32:23.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.982+0000 7f474d814980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0x0hy00a4do2539ya79i1ea9obckdeh5 2024-03-09T14:32:23.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.986+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:23.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.986+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:23.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.990+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:23.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.990+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:23.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.990+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:23.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.990+0000 7f474d814980 20 olh_log_entry: epoch=3 op=3 key=d[7jhLqGCyorscpXNhkp1iwTsb969gR8u] 2024-03-09T14:32:23.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 get_obj_state: octx=0x55c9994eeec0 obj=check-bucket:_:7jhLqGCyorscpXNhkp1iwTsb969gR8u_d state=0x55c9998330b8 s->prefetch_data=0 2024-03-09T14:32:23.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 10 manifest: total_size = 11 2024-03-09T14:32:23.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12876131428777353024 2024-03-09T14:32:23.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 get_obj_state: octx=0x55c9994eeec0 obj=check-bucket:_:7jhLqGCyorscpXNhkp1iwTsb969gR8u_d state=0x55c9998330b8 s->prefetch_data=0 2024-03-09T14:32:23.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 prepare_atomic_modification: state is not atomic. state=0x55c9998330b8 2024-03-09T14:32:23.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:23.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:23.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:23.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:23.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-03-09T14:32:23.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 olh_log_entry: epoch=2 op=3 key=e[zr4C8eqVCFAkxTovhdviXTXxdVTQHJI] 2024-03-09T14:32:23.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 get_obj_state: octx=0x55c999421d30 obj=check-bucket:_:zr4C8eqVCFAkxTovhdviXTXxdVTQHJI_e state=0x55c999839e58 s->prefetch_data=0 2024-03-09T14:32:23.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 olh_log_entry: epoch=3 op=3 key=c[E9xFOw3MSdVnTvUFiTVBSSZKI6pTgiX] 2024-03-09T14:32:23.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 get_obj_state: octx=0x55c9997911f0 obj=check-bucket:_:E9xFOw3MSdVnTvUFiTVBSSZKI6pTgiX_c state=0x55c99983e9f8 s->prefetch_data=0 2024-03-09T14:32:23.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 10 manifest: total_size = 22 2024-03-09T14:32:23.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16166246720622875620 2024-03-09T14:32:23.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 get_obj_state: octx=0x55c999421d30 obj=check-bucket:_:zr4C8eqVCFAkxTovhdviXTXxdVTQHJI_e state=0x55c999839e58 s->prefetch_data=0 2024-03-09T14:32:23.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 prepare_atomic_modification: state is not atomic. state=0x55c999839e58 2024-03-09T14:32:23.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:23.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-03-09T14:32:23.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 olh_log_entry: epoch=2 op=3 key=f[TvBWkZY68kcpE18lKIyqi0n5eQmugJX] 2024-03-09T14:32:23.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 get_obj_state: octx=0x55c999791bf0 obj=check-bucket:_:TvBWkZY68kcpE18lKIyqi0n5eQmugJX_f state=0x55c999849c38 s->prefetch_data=0 2024-03-09T14:32:23.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 10 manifest: total_size = 12 2024-03-09T14:32:23.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4673218578693593949 2024-03-09T14:32:23.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 get_obj_state: octx=0x55c999791bf0 obj=check-bucket:_:TvBWkZY68kcpE18lKIyqi0n5eQmugJX_f state=0x55c999849c38 s->prefetch_data=0 2024-03-09T14:32:23.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 prepare_atomic_modification: state is not atomic. state=0x55c999849c38 2024-03-09T14:32:23.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:23.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 10 manifest: total_size = 12 2024-03-09T14:32:23.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10628793509927189291 2024-03-09T14:32:23.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 get_obj_state: octx=0x55c9997911f0 obj=check-bucket:_:E9xFOw3MSdVnTvUFiTVBSSZKI6pTgiX_c state=0x55c99983e9f8 s->prefetch_data=0 2024-03-09T14:32:23.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 prepare_atomic_modification: state is not atomic. state=0x55c99983e9f8 2024-03-09T14:32:23.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.994+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:24.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.998+0000 7f474d814980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:32:24.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.998+0000 7f474d814980 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-03-09T14:32:24.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.998+0000 7f474d814980 0 deleting objects inline since gc isn't initialized 2024-03-09T14:32:24.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:23.998+0000 7f474d814980 5 delete_objs_inline: removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2__shadow:zr4C8eqVCFAkxTovhdviXTXxdVTQHJI_.xdA0d-xsl-mETrdwurKlygBJCRoAb5t_0 2024-03-09T14:32:24.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.002+0000 7f462e7fc640 20 handle_completion(): completion ok for obj=e[zr4C8eqVCFAkxTovhdviXTXxdVTQHJI] 2024-03-09T14:32:24.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.006+0000 7f474d814980 5 delete_objs_inline: refcount put returned error -2 2024-03-09T14:32:24.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.006+0000 7f474d814980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:32:24.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.006+0000 7f474d814980 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-03-09T14:32:24.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.006+0000 7f474d814980 0 deleting objects inline since gc isn't initialized 2024-03-09T14:32:24.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.006+0000 7f474d814980 5 delete_objs_inline: removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2__shadow:E9xFOw3MSdVnTvUFiTVBSSZKI6pTgiX_.aFzg4dVwgd_Kygl1n_Io5Qb9YXHxI-k_0 2024-03-09T14:32:24.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.006+0000 7f462e7fc640 20 handle_completion(): completion ok for obj=c[E9xFOw3MSdVnTvUFiTVBSSZKI6pTgiX] 2024-03-09T14:32:24.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.010+0000 7f474d814980 5 delete_objs_inline: refcount put returned error -2 2024-03-09T14:32:24.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.010+0000 7f474d814980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:32:24.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.010+0000 7f474d814980 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-03-09T14:32:24.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.010+0000 7f474d814980 0 deleting objects inline since gc isn't initialized 2024-03-09T14:32:24.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.010+0000 7f474d814980 5 delete_objs_inline: removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2__shadow:7jhLqGCyorscpXNhkp1iwTsb969gR8u_.eivxHfQU816XWqWsJSGfvxqctYGes-h_0 2024-03-09T14:32:24.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.014+0000 7f462effd640 20 handle_completion(): completion ok for obj=d[7jhLqGCyorscpXNhkp1iwTsb969gR8u] 2024-03-09T14:32:24.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.018+0000 7f474d814980 5 delete_objs_inline: refcount put returned error -2 2024-03-09T14:32:24.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.018+0000 7f474d814980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:32:24.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.018+0000 7f474d814980 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-03-09T14:32:24.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.018+0000 7f474d814980 0 deleting objects inline since gc isn't initialized 2024-03-09T14:32:24.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.018+0000 7f474d814980 5 delete_objs_inline: removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2__shadow:TvBWkZY68kcpE18lKIyqi0n5eQmugJX_.ZMcJR1pf4l7ZkdO0cdqtBMdBQYccKqi_0 2024-03-09T14:32:24.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.018+0000 7f474d814980 5 delete_objs_inline: refcount put returned error -2 2024-03-09T14:32:24.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.018+0000 7f474d814980 20 get_obj_state: octx=0x55c999421d30 obj=check-bucket:e state=0x55c99978eb78 s->prefetch_data=0 2024-03-09T14:32:24.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.018+0000 7f474d814980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lg7ethpcxujqp1b5jm9ixug3ds3btcee 2024-03-09T14:32:24.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.018+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:24.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.018+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:24.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.018+0000 7f462e7fc640 20 handle_completion(): completion ok for obj=f[TvBWkZY68kcpE18lKIyqi0n5eQmugJX] 2024-03-09T14:32:24.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.018+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:24.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.018+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:24.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.022+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.8 2024-03-09T14:32:24.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.022+0000 7f474d814980 1 NOTICE: finished shard 8 (1 entries removed) 2024-03-09T14:32:24.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.022+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.5 2024-03-09T14:32:24.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.026+0000 7f474d814980 1 NOTICE: finished shard 5 (1 entries removed) 2024-03-09T14:32:24.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.026+0000 7f474d814980 20 get_obj_state: octx=0x55c999791bf0 obj=check-bucket:f state=0x55c99978b648 s->prefetch_data=0 2024-03-09T14:32:24.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.026+0000 7f474d814980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0x0hy00a4do2539ya79i1ea9obckdeh5 2024-03-09T14:32:24.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.030+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:24.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.034+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.1 2024-03-09T14:32:24.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.034+0000 7f474d814980 1 NOTICE: finished shard 1 (1 entries removed) 2024-03-09T14:32:24.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.034+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:24.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.042+0000 7f474d814980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2.10 2024-03-09T14:32:24.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.042+0000 7f474d814980 1 NOTICE: finished shard 10 (1 entries removed) 2024-03-09T14:32:24.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.042+0000 7f474d814980 1 NOTICE: finished all shards (4 entries removed) 2024-03-09T14:32:24.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.042+0000 7f4601fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:24.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.050+0000 7f474d814980 20 remove_watcher() i=0 2024-03-09T14:32:24.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.050+0000 7f474d814980 2 removed watcher, disabling cache 2024-03-09T14:32:24.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.050+0000 7f474d814980 20 remove_watcher() i=1 2024-03-09T14:32:24.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.054+0000 7f474d814980 20 remove_watcher() i=2 2024-03-09T14:32:24.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.054+0000 7f474d814980 20 remove_watcher() i=3 2024-03-09T14:32:24.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.058+0000 7f474d814980 20 remove_watcher() i=4 2024-03-09T14:32:24.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.058+0000 7f474d814980 20 remove_watcher() i=5 2024-03-09T14:32:24.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.058+0000 7f474d814980 20 remove_watcher() i=6 2024-03-09T14:32:24.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.062+0000 7f474d814980 20 remove_watcher() i=7 2024-03-09T14:32:24.077 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:24.077 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:24.083 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:24.083 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:24.139 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-03-09T14:32:24.164 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:32:24.164 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:32:24.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.202+0000 7f58c5f47980 20 rados->read ofs=0 len=0 2024-03-09T14:32:24.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.206+0000 7f58c5f47980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:24.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.206+0000 7f58c5f47980 20 realm 2024-03-09T14:32:24.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.206+0000 7f58c5f47980 20 rados->read ofs=0 len=0 2024-03-09T14:32:24.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.206+0000 7f58c5f47980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:24.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.206+0000 7f58c5f47980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:32:24.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.206+0000 7f58c5f47980 20 rados->read ofs=0 len=0 2024-03-09T14:32:24.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.206+0000 7f58c5f47980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:24.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.206+0000 7f58c5f47980 20 rados->read ofs=0 len=0 2024-03-09T14:32:24.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.206+0000 7f58c5f47980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:24.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.206+0000 7f58c5f47980 20 rados->read ofs=0 len=0 2024-03-09T14:32:24.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.210+0000 7f58c5f47980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:32:24.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.210+0000 7f58c5f47980 20 searching for the correct realm 2024-03-09T14:32:24.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.214+0000 7f58c325e640 0 -- 172.21.15.99:0/586568398 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f58b40b7b60 msgr2=0x7f58b40d1410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:24.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.218+0000 7f58c325e640 0 -- 172.21.15.99:0/586568398 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f58bc0653b0 msgr2=0x7f58bc084a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:32:24.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.434+0000 7f58c5f47980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:32:24.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.434+0000 7f58c5f47980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:32:24.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.434+0000 7f58c5f47980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:32:24.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.434+0000 7f58c5f47980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:32:24.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.434+0000 7f58c5f47980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:32:24.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.434+0000 7f58c5f47980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:32:24.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.434+0000 7f58c5f47980 20 rados->read ofs=0 len=0 2024-03-09T14:32:24.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.434+0000 7f58c5f47980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:24.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.434+0000 7f58c5f47980 20 rados->read ofs=0 len=0 2024-03-09T14:32:24.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.434+0000 7f58c5f47980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:32:24.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.434+0000 7f58c5f47980 20 rados->read ofs=0 len=0 2024-03-09T14:32:24.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.438+0000 7f58c5f47980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:32:24.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.438+0000 7f58c5f47980 20 zone default found 2024-03-09T14:32:24.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.438+0000 7f58c5f47980 4 Realm: () 2024-03-09T14:32:24.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.438+0000 7f58c5f47980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:32:24.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.438+0000 7f58c5f47980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:32:24.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.438+0000 7f58c5f47980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:32:24.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.438+0000 7f58c5f47980 20 zonegroup default 2024-03-09T14:32:24.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.438+0000 7f58c5f47980 20 rados->read ofs=0 len=0 2024-03-09T14:32:24.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.438+0000 7f58c5f47980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:24.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.438+0000 7f58c5f47980 20 rados->read ofs=0 len=0 2024-03-09T14:32:24.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.438+0000 7f58c5f47980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:24.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.438+0000 7f58c5f47980 20 rados->read ofs=0 len=0 2024-03-09T14:32:24.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.438+0000 7f58c5f47980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:24.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.438+0000 7f58c5f47980 20 started sync module instance, tier type = 2024-03-09T14:32:24.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.438+0000 7f58c5f47980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:32:24.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.462+0000 7f58c5f47980 20 add_watcher() i=0 2024-03-09T14:32:24.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.462+0000 7f58c5f47980 20 add_watcher() i=1 2024-03-09T14:32:24.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.462+0000 7f58c5f47980 20 add_watcher() i=2 2024-03-09T14:32:24.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.462+0000 7f58c5f47980 20 add_watcher() i=3 2024-03-09T14:32:24.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.462+0000 7f58c5f47980 20 add_watcher() i=4 2024-03-09T14:32:24.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.462+0000 7f58c5f47980 20 add_watcher() i=5 2024-03-09T14:32:24.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.462+0000 7f58c5f47980 20 add_watcher() i=6 2024-03-09T14:32:24.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.466+0000 7f58c5f47980 20 add_watcher() i=7 2024-03-09T14:32:24.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.466+0000 7f58c5f47980 2 all 8 watchers are set, enabling cache 2024-03-09T14:32:24.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.470+0000 7f5779fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:24.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.470+0000 7f58c5f47980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:32:24.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.470+0000 7f58c5f47980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:32:24.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.470+0000 7f58c5f47980 5 note: GC not initialized 2024-03-09T14:32:24.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.470+0000 7f5778fe1640 20 reqs_thread_entry: start 2024-03-09T14:32:24.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.470+0000 7f58c5f47980 20 init_complete bucket index max shards: 11 2024-03-09T14:32:24.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.470+0000 7f58c5f47980 20 Filter name: none 2024-03-09T14:32:24.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.470+0000 7f56f27fc640 20 reqs_thread_entry: start 2024-03-09T14:32:24.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.470+0000 7f58c5f47980 20 rados->read ofs=0 len=0 2024-03-09T14:32:24.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.474+0000 7f58c5f47980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:24.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.474+0000 7f58c5f47980 20 rados->read ofs=0 len=0 2024-03-09T14:32:24.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.474+0000 7f58c5f47980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:24.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.474+0000 7f58c5f47980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:32:24.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.474+0000 7f58c5f47980 20 rados->read ofs=0 len=0 2024-03-09T14:32:24.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.474+0000 7f58c5f47980 20 rados_obj.operate() r=0 bl.length=190 2024-03-09T14:32:24.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.474+0000 7f58c5f47980 20 rados->read ofs=0 len=0 2024-03-09T14:32:24.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.474+0000 7f58c5f47980 20 rados_obj.operate() r=0 bl.length=404 2024-03-09T14:32:24.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.474+0000 7f58c5f47980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:32:24.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.474+0000 7f58c5f47980 20 rados->read ofs=0 len=0 2024-03-09T14:32:24.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.478+0000 7f58c5f47980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:32:24.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.478+0000 7f5779fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:32:24.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.482+0000 7f58c5f47980 20 remove_watcher() i=0 2024-03-09T14:32:24.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.482+0000 7f58c5f47980 2 removed watcher, disabling cache 2024-03-09T14:32:24.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.486+0000 7f58c5f47980 20 remove_watcher() i=1 2024-03-09T14:32:24.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.486+0000 7f58c5f47980 20 remove_watcher() i=2 2024-03-09T14:32:24.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.490+0000 7f58c5f47980 20 remove_watcher() i=3 2024-03-09T14:32:24.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.490+0000 7f58c5f47980 20 remove_watcher() i=4 2024-03-09T14:32:24.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.494+0000 7f58c5f47980 20 remove_watcher() i=5 2024-03-09T14:32:24.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.494+0000 7f58c5f47980 20 remove_watcher() i=6 2024-03-09T14:32:24.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:32:24.494+0000 7f58c5f47980 20 remove_watcher() i=7 2024-03-09T14:32:24.509 INFO:tasks.workunit.client.0.smithi099.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-03-09T14:32:24.509 INFO:tasks.workunit.client.0.smithi099.stderr:Deleting bucket check-bucket 2024-03-09T14:32:24.511 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:24.511 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:24.515 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:32:24.515 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:32:24.561 INFO:tasks.workunit.client.0.smithi099.stderr:Completed bucket check tests 2024-03-09T14:32:24.561 INFO:tasks.workunit.client.0.smithi099.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-03-09T14:32:24.561 INFO:tasks.workunit.client.0.smithi099.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-03-09T14:32:24.561 INFO:tasks.workunit.client.0.smithi099.stdout:connected to https://localhost:443 2024-03-09T14:32:24.624 INFO:tasks.workunit.client.0.smithi099.stderr:+ deactivate 2024-03-09T14:32:24.624 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-03-09T14:32:24.624 INFO:tasks.workunit.client.0.smithi099.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-03-09T14:32:24.624 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2024-03-09T14:32:24.624 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset _OLD_VIRTUAL_PATH 2024-03-09T14:32:24.624 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n '' ']' 2024-03-09T14:32:24.624 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:32:24.624 INFO:tasks.workunit.client.0.smithi099.stderr:+ hash -r 2024-03-09T14:32:24.625 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n '' ']' 2024-03-09T14:32:24.625 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset VIRTUAL_ENV 2024-03-09T14:32:24.625 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-03-09T14:32:24.625 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' '!' '' = nondestructive ']' 2024-03-09T14:32:24.625 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset -f deactivate 2024-03-09T14:32:24.625 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo OK. 2024-03-09T14:32:24.626 INFO:tasks.workunit.client.0.smithi099.stdout:OK. 2024-03-09T14:32:24.626 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:32:24.626 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:32:24.685 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-03-09T14:32:24.685 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-09T14:32:25.060 DEBUG:teuthology.parallel:result is None 2024-03-09T14:32:25.061 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:32:25.073 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:32:25.073 DEBUG:teuthology.orchestra.run.smithi099:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:32:25.121 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:32:25.121 INFO:teuthology.run_tasks:Running task workunit... 2024-03-09T14:32:25.131 INFO:tasks.workunit:Pulling workunits from ref c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:32:25.131 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-09T14:32:25.131 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:32:25.169 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:32:25.169 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-09T14:32:25.170 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:32:25.217 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-09T14:32:25.218 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-09T14:32:25.265 INFO:tasks.workunit:timeout=3h 2024-03-09T14:32:25.266 INFO:tasks.workunit:cleanup=True 2024-03-09T14:32:25.266 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:32:25.315 INFO:tasks.workunit.client.0.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-09T14:33:40.291 INFO:tasks.workunit.client.0.smithi099.stderr:Note: switching to 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'. 2024-03-09T14:33:40.292 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:33:40.292 INFO:tasks.workunit.client.0.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-09T14:33:40.292 INFO:tasks.workunit.client.0.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-09T14:33:40.292 INFO:tasks.workunit.client.0.smithi099.stderr:state without impacting any branches by switching back to a branch. 2024-03-09T14:33:40.292 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:33:40.292 INFO:tasks.workunit.client.0.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-09T14:33:40.292 INFO:tasks.workunit.client.0.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-09T14:33:40.292 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:33:40.292 INFO:tasks.workunit.client.0.smithi099.stderr: git switch -c 2024-03-09T14:33:40.292 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:33:40.292 INFO:tasks.workunit.client.0.smithi099.stderr:Or undo this operation with: 2024-03-09T14:33:40.292 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:33:40.292 INFO:tasks.workunit.client.0.smithi099.stderr: git switch - 2024-03-09T14:33:40.293 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:33:40.293 INFO:tasks.workunit.client.0.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-09T14:33:40.293 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:33:40.293 INFO:tasks.workunit.client.0.smithi099.stderr:HEAD is now at c00d9c609fb DNM: point s3tests at branch cbodley:wip-iam-user-apis 2024-03-09T14:33:40.296 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-09T14:33:40.349 INFO:tasks.workunit.client.0.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-09T14:33:40.353 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:33:40.353 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-09T14:33:40.412 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-09T14:33:40.473 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-09T14:33:40.518 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:33:40.519 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:33:40.519 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-09T14:33:40.562 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:33:40.566 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:33:40.566 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-09T14:33:40.613 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-03-09T14:33:40.614 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-03-09T14:33:40.614 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-03-09T14:33:40.678 INFO:tasks.workunit.client.0.smithi099.stdout:Running main() from gmock_main.cc 2024-03-09T14:33:40.678 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 11 tests from 1 test suite. 2024-03-09T14:33:40.678 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:33:40.678 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 11 tests from ClsLock 2024-03-09T14:33:40.678 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-03-09T14:33:41.828 INFO:tasks.workunit.client.0.smithi099.stdout:lock: mylock 2024-03-09T14:33:41.828 INFO:tasks.workunit.client.0.smithi099.stdout: lock_type: exclusive 2024-03-09T14:33:41.828 INFO:tasks.workunit.client.0.smithi099.stdout: tag: 2024-03-09T14:33:41.828 INFO:tasks.workunit.client.0.smithi099.stdout: lockers: 2024-03-09T14:33:41.828 INFO:tasks.workunit.client.0.smithi099.stdout: client.5048 expiration=2024-03-09T14:35:41.823304+0000 addr=v1:172.21.15.99:0/548849239 cookie= 2024-03-09T14:33:41.834 INFO:tasks.workunit.client.0.smithi099.stdout:lock: mylock 2024-03-09T14:33:41.834 INFO:tasks.workunit.client.0.smithi099.stdout: lock_type: shared 2024-03-09T14:33:41.834 INFO:tasks.workunit.client.0.smithi099.stdout: tag: 2024-03-09T14:33:41.834 INFO:tasks.workunit.client.0.smithi099.stdout: lockers: 2024-03-09T14:33:41.834 INFO:tasks.workunit.client.0.smithi099.stdout: client.5048 expiration=2024-03-09T14:35:41.833934+0000 addr=v1:172.21.15.99:0/548849239 cookie= 2024-03-09T14:33:41.835 INFO:tasks.workunit.client.0.smithi099.stdout: client.5181 expiration=0.000000 addr=v1:172.21.15.99:0/1809907245 cookie= 2024-03-09T14:33:41.836 INFO:tasks.workunit.client.0.smithi099.stdout:lock: mylock 2024-03-09T14:33:41.837 INFO:tasks.workunit.client.0.smithi099.stdout: lock_type: shared 2024-03-09T14:33:41.837 INFO:tasks.workunit.client.0.smithi099.stdout: tag: 2024-03-09T14:33:41.837 INFO:tasks.workunit.client.0.smithi099.stdout: lockers: 2024-03-09T14:33:41.837 INFO:tasks.workunit.client.0.smithi099.stdout: client.5181 expiration=0.000000 addr=v1:172.21.15.99:0/1809907245 cookie= 2024-03-09T14:33:42.813 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestMultiLocking (2135 ms) 2024-03-09T14:33:42.813 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestMeta 2024-03-09T14:33:45.094 INFO:tasks.workunit.client.0.smithi099.stdout:lock: mylock 2024-03-09T14:33:45.094 INFO:tasks.workunit.client.0.smithi099.stdout: lock_type: shared 2024-03-09T14:33:45.094 INFO:tasks.workunit.client.0.smithi099.stdout: tag: 2024-03-09T14:33:45.094 INFO:tasks.workunit.client.0.smithi099.stdout: lockers: 2024-03-09T14:33:45.095 INFO:tasks.workunit.client.0.smithi099.stdout: client.5060 expiration=0.000000 addr=v1:172.21.15.99:0/3996270296 cookie= 2024-03-09T14:33:45.100 INFO:tasks.workunit.client.0.smithi099.stdout:lock: mylock 2024-03-09T14:33:45.100 INFO:tasks.workunit.client.0.smithi099.stdout: lock_type: exclusive 2024-03-09T14:33:45.100 INFO:tasks.workunit.client.0.smithi099.stdout: tag: new_tag 2024-03-09T14:33:45.101 INFO:tasks.workunit.client.0.smithi099.stdout: lockers: 2024-03-09T14:33:45.101 INFO:tasks.workunit.client.0.smithi099.stdout: client.5187 expiration=0.000000 addr=v1:172.21.15.99:0/817677069 cookie= 2024-03-09T14:33:45.827 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestMeta (3015 ms) 2024-03-09T14:33:45.828 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestCookie 2024-03-09T14:33:47.908 INFO:tasks.workunit.client.0.smithi099.stdout:lock: mylock 2024-03-09T14:33:47.908 INFO:tasks.workunit.client.0.smithi099.stdout: lock_type: exclusive 2024-03-09T14:33:47.908 INFO:tasks.workunit.client.0.smithi099.stdout: tag: 2024-03-09T14:33:47.908 INFO:tasks.workunit.client.0.smithi099.stdout: lockers: 2024-03-09T14:33:47.912 INFO:tasks.workunit.client.0.smithi099.stdout:lock: mylock 2024-03-09T14:33:47.912 INFO:tasks.workunit.client.0.smithi099.stdout: lock_type: shared 2024-03-09T14:33:47.912 INFO:tasks.workunit.client.0.smithi099.stdout: tag: 2024-03-09T14:33:47.912 INFO:tasks.workunit.client.0.smithi099.stdout: lockers: 2024-03-09T14:33:47.912 INFO:tasks.workunit.client.0.smithi099.stdout: client.5199 expiration=0.000000 addr=v1:172.21.15.99:0/2041667943 cookie= 2024-03-09T14:33:47.912 INFO:tasks.workunit.client.0.smithi099.stdout: client.5199 expiration=0.000000 addr=v1:172.21.15.99:0/2041667943 cookie=new cookie 2024-03-09T14:33:48.876 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestCookie (3048 ms) 2024-03-09T14:33:48.876 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-03-09T14:33:51.911 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestMultipleLocks (3031 ms) 2024-03-09T14:33:51.911 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestLockDuration 2024-03-09T14:33:59.047 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestLockDuration (7140 ms) 2024-03-09T14:33:59.047 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-03-09T14:34:02.068 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestAssertLocked (3018 ms) 2024-03-09T14:34:02.068 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestSetCookie 2024-03-09T14:34:05.108 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestSetCookie (3043 ms) 2024-03-09T14:34:05.108 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestRenew 2024-03-09T14:34:25.699 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestRenew (20592 ms) 2024-03-09T14:34:25.700 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-03-09T14:34:31.815 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6114 ms) 2024-03-09T14:34:31.815 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-03-09T14:34:39.887 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8073 ms) 2024-03-09T14:34:39.887 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-03-09T14:34:46.960 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (7074 ms) 2024-03-09T14:34:46.960 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 11 tests from ClsLock (66283 ms total) 2024-03-09T14:34:46.960 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:34:46.960 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:34:46.960 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 11 tests from 1 test suite ran. (66283 ms total) 2024-03-09T14:34:46.961 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 11 tests. 2024-03-09T14:34:46.970 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:34:46.970 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:34:47.024 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-03-09T14:34:47.025 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-03-09T14:34:47.025 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-03-09T14:34:47.090 INFO:tasks.workunit.client.0.smithi099.stdout:Running main() from gmock_main.cc 2024-03-09T14:34:47.090 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 4 tests from 1 test suite. 2024-03-09T14:34:47.091 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:34:47.091 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 4 tests from cls_log 2024-03-09T14:34:47.091 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-03-09T14:34:49.970 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_log.test_log_add_same_time (2877 ms) 2024-03-09T14:34:49.970 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-03-09T14:34:53.027 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_log.test_log_add_different_time (3060 ms) 2024-03-09T14:34:53.027 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_log.trim_by_time 2024-03-09T14:34:56.068 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_log.trim_by_time (3041 ms) 2024-03-09T14:34:56.068 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_log.trim_by_marker 2024-03-09T14:34:59.095 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_log.trim_by_marker (3024 ms) 2024-03-09T14:34:59.095 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 4 tests from cls_log (12002 ms total) 2024-03-09T14:34:59.095 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:34:59.095 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:34:59.095 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 4 tests from 1 test suite ran. (12002 ms total) 2024-03-09T14:34:59.095 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 4 tests. 2024-03-09T14:34:59.101 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:34:59.101 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:34:59.156 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-03-09T14:34:59.158 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-03-09T14:34:59.158 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-03-09T14:34:59.221 INFO:tasks.workunit.client.0.smithi099.stdout:Running main() from gmock_main.cc 2024-03-09T14:34:59.221 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 10 tests from 1 test suite. 2024-03-09T14:34:59.221 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:34:59.221 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 10 tests from cls_refcount 2024-03-09T14:34:59.221 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.test_implicit 2024-03-09T14:35:02.150 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.test_implicit (2930 ms) 2024-03-09T14:35:02.151 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-03-09T14:35:05.211 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3060 ms) 2024-03-09T14:35:05.212 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.test_put_snap 2024-03-09T14:35:13.729 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.test_put_snap (8518 ms) 2024-03-09T14:35:13.729 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.test_explicit 2024-03-09T14:35:16.771 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.test_explicit (3037 ms) 2024-03-09T14:35:16.771 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.set 2024-03-09T14:35:19.819 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.set (3053 ms) 2024-03-09T14:35:19.819 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-03-09T14:35:26.840 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.test_implicit_ec (7021 ms) 2024-03-09T14:35:26.840 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-03-09T14:35:33.892 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7052 ms) 2024-03-09T14:35:33.893 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-03-09T14:35:46.087 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.test_put_snap_ec (12195 ms) 2024-03-09T14:35:46.087 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-03-09T14:35:53.133 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.test_explicit_ec (7046 ms) 2024-03-09T14:35:53.133 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_refcount.set_ec 2024-03-09T14:36:00.203 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_refcount.set_ec (7070 ms) 2024-03-09T14:36:00.203 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 10 tests from cls_refcount (60983 ms total) 2024-03-09T14:36:00.203 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:36:00.203 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:36:00.203 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 10 tests from 1 test suite ran. (60983 ms total) 2024-03-09T14:36:00.203 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 10 tests. 2024-03-09T14:36:00.209 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:36:00.209 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:36:00.268 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-03-09T14:36:00.269 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-03-09T14:36:00.269 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-03-09T14:36:00.334 INFO:tasks.workunit.client.0.smithi099.stdout:Running main() from gmock_main.cc 2024-03-09T14:36:00.334 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 16 tests from 1 test suite. 2024-03-09T14:36:00.335 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:36:00.335 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 16 tests from cls_rgw 2024-03-09T14:36:02.205 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.index_basic 2024-03-09T14:36:02.284 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.index_basic (78 ms) 2024-03-09T14:36:02.284 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-03-09T14:36:02.368 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (85 ms) 2024-03-09T14:36:02.368 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.index_remove_object 2024-03-09T14:36:02.480 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.index_remove_object (111 ms) 2024-03-09T14:36:02.480 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.index_suggest 2024-03-09T14:36:04.964 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.index_suggest (2485 ms) 2024-03-09T14:36:04.964 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-03-09T14:36:04.978 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.index_suggest_complete (14 ms) 2024-03-09T14:36:04.978 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.index_list 2024-03-09T14:36:05.034 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.index_list (56 ms) 2024-03-09T14:36:05.034 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-03-09T14:36:48.019 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.index_list_delimited (42984 ms) 2024-03-09T14:36:48.019 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.bi_list 2024-03-09T14:36:48.188 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.bi_list (170 ms) 2024-03-09T14:36:48.188 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.gc_set 2024-03-09T14:36:48.211 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.gc_set (23 ms) 2024-03-09T14:36:48.212 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.gc_list 2024-03-09T14:36:48.234 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.gc_list (23 ms) 2024-03-09T14:36:48.235 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.gc_defer 2024-03-09T14:36:54.862 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.gc_defer (6627 ms) 2024-03-09T14:36:54.862 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.usage_basic 2024-03-09T14:36:55.047 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.usage_basic (185 ms) 2024-03-09T14:36:55.047 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-03-09T14:36:55.049 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.usage_clear_no_obj (3 ms) 2024-03-09T14:36:55.050 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.usage_clear 2024-03-09T14:36:55.277 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.usage_clear (225 ms) 2024-03-09T14:36:55.277 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-03-09T14:36:55.405 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.bi_log_trim (129 ms) 2024-03-09T14:36:55.406 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-03-09T14:36:55.457 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw.index_racing_removes (53 ms) 2024-03-09T14:36:55.872 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 16 tests from cls_rgw (53252 ms total) 2024-03-09T14:36:55.872 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:36:55.872 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:36:55.872 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 16 tests from 1 test suite ran. (55539 ms total) 2024-03-09T14:36:55.872 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 16 tests. 2024-03-09T14:36:55.880 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:36:55.880 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:36:55.935 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-03-09T14:36:55.936 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-03-09T14:36:55.937 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-03-09T14:36:56.000 INFO:tasks.workunit.client.0.smithi099.stdout:Running main() from gmock_main.cc 2024-03-09T14:36:56.000 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 9 tests from 1 test suite. 2024-03-09T14:36:56.000 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:36:56.000 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 9 tests from cls_rgw_gc 2024-03-09T14:36:56.000 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.init 2024-03-09T14:36:57.880 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.init (1880 ms) 2024-03-09T14:36:57.880 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-03-09T14:36:57.917 INFO:tasks.workunit.client.0.smithi099.stderr:[ ] list info tag = chain-0 2024-03-09T14:36:57.917 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (36 ms) 2024-03-09T14:36:57.917 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-03-09T14:36:57.927 INFO:tasks.workunit.client.0.smithi099.stderr:[ ] next_marker is: = 0/4263 2024-03-09T14:36:57.928 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (12 ms) 2024-03-09T14:36:57.928 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-03-09T14:36:57.940 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (13 ms) 2024-03-09T14:36:57.941 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-03-09T14:36:57.952 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (11 ms) 2024-03-09T14:36:57.953 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-03-09T14:36:57.966 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (14 ms) 2024-03-09T14:36:57.966 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-03-09T14:36:57.979 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (13 ms) 2024-03-09T14:36:57.979 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-03-09T14:36:57.992 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (13 ms) 2024-03-09T14:36:57.993 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_gc.finalize 2024-03-09T14:36:58.875 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_gc.finalize (883 ms) 2024-03-09T14:36:58.875 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 9 tests from cls_rgw_gc (2875 ms total) 2024-03-09T14:36:58.875 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:36:58.875 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:36:58.875 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 9 tests from 1 test suite ran. (2875 ms total) 2024-03-09T14:36:58.876 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 9 tests. 2024-03-09T14:36:58.881 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:36:58.881 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:36:58.942 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-03-09T14:36:58.943 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-03-09T14:36:58.944 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-03-09T14:36:59.018 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:36:59.018 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:36:59.019 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 1 test from 1 test suite. 2024-03-09T14:36:59.019 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:37:00.937 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 1 test from cls_rgw_stats 2024-03-09T14:37:00.938 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] cls_rgw_stats.simulate 2024-03-09T14:37:00.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.963+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~4QWF88Y8P3RI.0 size=1048576 2024-03-09T14:37:00.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.967+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~4QWF88Y8P3RI.1 size=582230 2024-03-09T14:37:00.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.967+0000 7fd389e788c0 1 > prepared multipart upload key=GSNWWDS63MTA upload=4QWF88Y8P3RI tag=AE6IWBMEM8RG type=write size=2679382 2024-03-09T14:37:00.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.971+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~OAH9RDI20ORU.0 size=1048576 2024-03-09T14:37:00.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.971+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~OAH9RDI20ORU.1 size=1008515 2024-03-09T14:37:00.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.971+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=OAH9RDI20ORU tag=VFVIJEN8GJ8Z type=write size=3105667 2024-03-09T14:37:00.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.975+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~6LZBMEZHTSY5.0 size=123665 2024-03-09T14:37:00.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.975+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=6LZBMEZHTSY5 tag=9VRU5UV36RMU type=write size=1172241 2024-03-09T14:37:00.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.979+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~I2OERHR16LNZ.0 size=603158 2024-03-09T14:37:00.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.979+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=I2OERHR16LNZ tag=UCQF92FYLMKE type=write size=1651734 2024-03-09T14:37:00.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.983+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=184C67ZJDTXR type=del size=4061149 2024-03-09T14:37:00.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.987+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~VK3J1DOJFCEV.0 size=1048576 2024-03-09T14:37:00.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.991+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~VK3J1DOJFCEV.1 size=926529 2024-03-09T14:37:00.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.991+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=VK3J1DOJFCEV tag=34MM5QTA25BC type=write size=3023681 2024-03-09T14:37:00.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.991+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=J9ZG31BVNDH8 type=del size=3988504 2024-03-09T14:37:00.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.995+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=UGYKVXJXEEPQ type=del size=511005 2024-03-09T14:37:00.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.999+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=5KLVMQ1I4UGM type=write size=576609 2024-03-09T14:37:01.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:00.999+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=XCRAQR9TK26H type=del size=3962110 2024-03-09T14:37:01.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.003+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=MGLCID5BMI3Z type=del size=3080924 2024-03-09T14:37:01.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.007+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=U6QJLL5B3BIA type=del size=1950022 2024-03-09T14:37:01.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.011+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~BB1EJJ40GWXL.0 size=233453 2024-03-09T14:37:01.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.011+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=BB1EJJ40GWXL tag=YW61460G21IP type=write size=1282029 2024-03-09T14:37:01.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.015+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~EMW4Z963ZPDT.0 size=287319 2024-03-09T14:37:01.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.015+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=EMW4Z963ZPDT tag=EX1I72RBM5YX type=write size=1335895 2024-03-09T14:37:01.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.015+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=0CB7O1HN9A83 type=del size=3729704 2024-03-09T14:37:01.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.019+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=B7A0I17WQBE6 type=del size=786439 2024-03-09T14:37:01.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.023+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~4QWF88Y8P3RI.0 size=1048576 2024-03-09T14:37:01.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.023+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~4QWF88Y8P3RI.1 size=582230 2024-03-09T14:37:01.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.027+0000 7fd389e788c0 1 < completed multipart upload key=GSNWWDS63MTA upload=4QWF88Y8P3RI tag=AE6IWBMEM8RG type=write size=2679382 2024-03-09T14:37:01.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.031+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~IWYD3R0PTCHW.0 size=980587 2024-03-09T14:37:01.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.031+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=IWYD3R0PTCHW tag=T7ZL7N45ASV1 type=write size=2029163 2024-03-09T14:37:01.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.031+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~OAH9RDI20ORU.0 size=1048576 2024-03-09T14:37:01.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.035+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~OAH9RDI20ORU.1 size=1008515 2024-03-09T14:37:01.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.039+0000 7fd389e788c0 1 < completed multipart upload key=IXKMXJ9IZ69S upload=OAH9RDI20ORU tag=VFVIJEN8GJ8Z type=write size=3105667 2024-03-09T14:37:01.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.039+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=3ZYAT86WT9DS type=del size=2340393 2024-03-09T14:37:01.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.043+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~6LZBMEZHTSY5.0 size=123665 2024-03-09T14:37:01.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.047+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=6LZBMEZHTSY5 tag=9VRU5UV36RMU type=write size=1172241 2024-03-09T14:37:01.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.047+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=FVUHEZ7240S4 type=del size=442101 2024-03-09T14:37:01.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.051+0000 7fd389e788c0 1 < canceled part key=_multipart_SVTMMQ2QR603.2~I2OERHR16LNZ.0 size=603158 2024-03-09T14:37:01.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.055+0000 7fd389e788c0 1 < canceled multipart upload key=SVTMMQ2QR603 upload=I2OERHR16LNZ tag=UCQF92FYLMKE type=write size=1651734 2024-03-09T14:37:01.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.055+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=DI9SO53V8JQU type=del size=910302 2024-03-09T14:37:01.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.059+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=184C67ZJDTXR type=del 2024-03-09T14:37:01.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.059+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=4ZK492VV1S0G type=del size=778005 2024-03-09T14:37:01.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.063+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~VK3J1DOJFCEV.0 size=1048576 2024-03-09T14:37:01.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.063+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~VK3J1DOJFCEV.1 size=926529 2024-03-09T14:37:01.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.067+0000 7fd389e788c0 1 < completed multipart upload key=Z18Q66VI5PDN upload=VK3J1DOJFCEV tag=34MM5QTA25BC type=write size=3023681 2024-03-09T14:37:01.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.071+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=ZIP80JQRG9G1 type=del size=317771 2024-03-09T14:37:01.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.075+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=J9ZG31BVNDH8 type=del 2024-03-09T14:37:01.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.075+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=J8J9YX9EJF79 type=del size=234165 2024-03-09T14:37:01.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.079+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=UGYKVXJXEEPQ type=del 2024-03-09T14:37:01.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.083+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~UIEKNXPBM1BE.0 size=742844 2024-03-09T14:37:01.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.083+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=UIEKNXPBM1BE tag=RBXWILB0ID38 type=write size=1791420 2024-03-09T14:37:01.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.087+0000 7fd389e788c0 1 < completed write operation key=Z18Q66VI5PDN tag=5KLVMQ1I4UGM type=write size=576609 2024-03-09T14:37:01.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.091+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~13DGW52J5NEZ.0 size=1048576 2024-03-09T14:37:01.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.095+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~13DGW52J5NEZ.1 size=1048576 2024-03-09T14:37:01.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.095+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~13DGW52J5NEZ.2 size=283630 2024-03-09T14:37:01.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.095+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=13DGW52J5NEZ tag=WGOGP6PIQ2D8 type=write size=3429358 2024-03-09T14:37:01.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.099+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=XCRAQR9TK26H type=del 2024-03-09T14:37:01.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.103+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=BX4VH3H038JL type=del size=3227935 2024-03-09T14:37:01.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.107+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=MGLCID5BMI3Z type=del 2024-03-09T14:37:01.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.111+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~ALFAQKUQHEOY.0 size=556948 2024-03-09T14:37:01.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.111+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=ALFAQKUQHEOY tag=BCBL0VRUCI2B type=write size=1605524 2024-03-09T14:37:01.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.115+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=U6QJLL5B3BIA type=del 2024-03-09T14:37:01.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.119+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~EKHYOBY6AS91.0 size=184186 2024-03-09T14:37:01.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.119+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=EKHYOBY6AS91 tag=8YUSFSWF6RXF type=write size=1232762 2024-03-09T14:37:01.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.123+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~BB1EJJ40GWXL.0 size=233453 2024-03-09T14:37:01.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.127+0000 7fd389e788c0 1 < completed multipart upload key=P83H9137MI7Y upload=BB1EJJ40GWXL tag=YW61460G21IP type=write size=1282029 2024-03-09T14:37:01.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.131+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~T32ZKHGFGUB5.0 size=1048576 2024-03-09T14:37:01.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.131+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~T32ZKHGFGUB5.1 size=787857 2024-03-09T14:37:01.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.131+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=T32ZKHGFGUB5 tag=UT78FDYRKE9W type=write size=2885009 2024-03-09T14:37:01.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.135+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~EMW4Z963ZPDT.0 size=287319 2024-03-09T14:37:01.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.139+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=EMW4Z963ZPDT tag=EX1I72RBM5YX type=write size=1335895 2024-03-09T14:37:01.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.143+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=9XP8MY35TN6R type=del size=2319710 2024-03-09T14:37:01.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.147+0000 7fd389e788c0 1 < suggested update operation key=DIN8WJ9Z9OI8 tag=0CB7O1HN9A83 type=del size=3729704 2024-03-09T14:37:01.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.151+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~ZHD4A8RWBZDO.0 size=1048576 2024-03-09T14:37:01.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.155+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~ZHD4A8RWBZDO.1 size=1048576 2024-03-09T14:37:01.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.155+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~ZHD4A8RWBZDO.2 size=248549 2024-03-09T14:37:01.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.155+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=ZHD4A8RWBZDO tag=J5I02I080QOV type=write size=3394277 2024-03-09T14:37:01.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.159+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=B7A0I17WQBE6 type=del 2024-03-09T14:37:01.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.163+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=JACJP57G39CZ type=del size=4096421 2024-03-09T14:37:01.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.167+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~IWYD3R0PTCHW.0 size=980587 2024-03-09T14:37:01.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.171+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=IWYD3R0PTCHW tag=T7ZL7N45ASV1 type=write size=2029163 2024-03-09T14:37:01.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.171+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=9BTSYQ614ZW0 type=del size=1205247 2024-03-09T14:37:01.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.179+0000 7fd389e788c0 1 < suggested update operation key=I4NA328AI5T1 tag=3ZYAT86WT9DS type=del size=2340393 2024-03-09T14:37:01.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.179+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=XM8QWD5B4FI8 type=del size=1879212 2024-03-09T14:37:01.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.183+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=FVUHEZ7240S4 type=del 2024-03-09T14:37:01.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.187+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=ECL9RY9A31XS type=del size=3048717 2024-03-09T14:37:01.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.191+0000 7fd389e788c0 1 < completed delete operation key=YR2VX4QLOCOG tag=DI9SO53V8JQU type=del 2024-03-09T14:37:01.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.191+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=YWVXYVR2PXLJ type=del size=1796177 2024-03-09T14:37:01.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.195+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=4ZK492VV1S0G type=del 2024-03-09T14:37:01.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.199+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=MF3VPMM0K9NR type=write size=228223 2024-03-09T14:37:01.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.199+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=ZIP80JQRG9G1 type=del 2024-03-09T14:37:01.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.207+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~O8ZOQX0GBW0N.0 size=1048576 2024-03-09T14:37:01.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.207+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~O8ZOQX0GBW0N.1 size=1048576 2024-03-09T14:37:01.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.211+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~O8ZOQX0GBW0N.2 size=394911 2024-03-09T14:37:01.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.211+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=O8ZOQX0GBW0N tag=9C960SUCHY2N type=write size=3540639 2024-03-09T14:37:01.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.211+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=J8J9YX9EJF79 type=del 2024-03-09T14:37:01.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.215+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=GP9BLQOG55PC type=del size=2998063 2024-03-09T14:37:01.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.215+0000 7fd389e788c0 1 < canceled part key=_multipart_I4NA328AI5T1.2~UIEKNXPBM1BE.0 size=742844 2024-03-09T14:37:01.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.219+0000 7fd389e788c0 1 < canceled multipart upload key=I4NA328AI5T1 upload=UIEKNXPBM1BE tag=RBXWILB0ID38 type=write size=1791420 2024-03-09T14:37:01.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.227+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=YJFQOVH5ZKP1 type=del size=2173847 2024-03-09T14:37:01.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.227+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~13DGW52J5NEZ.0 size=1048576 2024-03-09T14:37:01.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.231+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~13DGW52J5NEZ.1 size=1048576 2024-03-09T14:37:01.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.231+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~13DGW52J5NEZ.2 size=283630 2024-03-09T14:37:01.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.235+0000 7fd389e788c0 1 < completed multipart upload key=Z18Q66VI5PDN upload=13DGW52J5NEZ tag=WGOGP6PIQ2D8 type=write size=3429358 2024-03-09T14:37:01.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.243+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~NMHUZ7VJ4VL4.0 size=1048576 2024-03-09T14:37:01.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.243+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~NMHUZ7VJ4VL4.1 size=562654 2024-03-09T14:37:01.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.243+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=NMHUZ7VJ4VL4 tag=6KM49SSF13QI type=write size=2659806 2024-03-09T14:37:01.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.247+0000 7fd389e788c0 1 < suggested remove operation key=61RC3GUU437B tag=BX4VH3H038JL type=del 2024-03-09T14:37:01.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.251+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~VZLT2QZD98KV.0 size=1048576 2024-03-09T14:37:01.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.255+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~VZLT2QZD98KV.1 size=804679 2024-03-09T14:37:01.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.255+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=VZLT2QZD98KV tag=56XM7OOMKIGP type=write size=2901831 2024-03-09T14:37:01.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.259+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~ALFAQKUQHEOY.0 size=556948 2024-03-09T14:37:01.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.263+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=ALFAQKUQHEOY tag=BCBL0VRUCI2B type=write size=1605524 2024-03-09T14:37:01.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.263+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=VLDB0980IP3W type=del size=269470 2024-03-09T14:37:01.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.267+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~EKHYOBY6AS91.0 size=184186 2024-03-09T14:37:01.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.275+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=EKHYOBY6AS91 tag=8YUSFSWF6RXF type=write size=1232762 2024-03-09T14:37:01.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.279+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~40NKD2SVG592.0 size=1048576 2024-03-09T14:37:01.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.283+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~40NKD2SVG592.1 size=481649 2024-03-09T14:37:01.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.283+0000 7fd389e788c0 1 > prepared multipart upload key=UMT7VKZ9R4IR upload=40NKD2SVG592 tag=3NRNH5ZYWV7N type=write size=2578801 2024-03-09T14:37:01.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.283+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~T32ZKHGFGUB5.0 size=1048576 2024-03-09T14:37:01.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.283+0000 7fd389e788c0 1 < canceled part key=_multipart_E65PFNHJQHEO.2~T32ZKHGFGUB5.1 size=787857 2024-03-09T14:37:01.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.291+0000 7fd389e788c0 1 < canceled multipart upload key=E65PFNHJQHEO upload=T32ZKHGFGUB5 tag=UT78FDYRKE9W type=write size=2885009 2024-03-09T14:37:01.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.295+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=B6FVCOBRWAH6 type=del size=146796 2024-03-09T14:37:01.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.295+0000 7fd389e788c0 1 < canceled operation key=Y7E2TLASJM9T tag=9XP8MY35TN6R type=del size=2319710 2024-03-09T14:37:01.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.299+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=T0C85Z2EZBQR type=del size=1759729 2024-03-09T14:37:01.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.303+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~ZHD4A8RWBZDO.0 size=1048576 2024-03-09T14:37:01.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.307+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~ZHD4A8RWBZDO.1 size=1048576 2024-03-09T14:37:01.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.307+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~ZHD4A8RWBZDO.2 size=248549 2024-03-09T14:37:01.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.315+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=ZHD4A8RWBZDO tag=J5I02I080QOV type=write size=3394277 2024-03-09T14:37:01.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.315+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=38R8IKHAN15O type=del size=1388587 2024-03-09T14:37:01.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.319+0000 7fd389e788c0 1 < completed delete operation key=DIN8WJ9Z9OI8 tag=JACJP57G39CZ type=del 2024-03-09T14:37:01.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.327+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~UFG64BKD9NV8.0 size=1048576 2024-03-09T14:37:01.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.327+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~UFG64BKD9NV8.1 size=1048576 2024-03-09T14:37:01.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.331+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~UFG64BKD9NV8.2 size=374583 2024-03-09T14:37:01.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.331+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=UFG64BKD9NV8 tag=49UIMFZICBCS type=write size=3520311 2024-03-09T14:37:01.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.335+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=9BTSYQ614ZW0 type=del 2024-03-09T14:37:01.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.339+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=992HBMF3HPTN type=del size=3037619 2024-03-09T14:37:01.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.343+0000 7fd389e788c0 1 < suggested remove operation key=U8P5Q3D11MM6 tag=XM8QWD5B4FI8 type=del 2024-03-09T14:37:01.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.347+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=HHZ7Y4V9ZHK5 type=del size=3834178 2024-03-09T14:37:01.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.351+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=ECL9RY9A31XS type=del 2024-03-09T14:37:01.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.355+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~LCSB00VKHA5N.0 size=150343 2024-03-09T14:37:01.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.355+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=LCSB00VKHA5N tag=W7MRBQYNMCYW type=write size=1198919 2024-03-09T14:37:01.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.359+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=YWVXYVR2PXLJ type=del 2024-03-09T14:37:01.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.367+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~L6I0XSUB2Z60.0 size=1048576 2024-03-09T14:37:01.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.371+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~L6I0XSUB2Z60.1 size=165365 2024-03-09T14:37:01.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.371+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=L6I0XSUB2Z60 tag=PESOKMO3IL17 type=write size=2262517 2024-03-09T14:37:01.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.375+0000 7fd389e788c0 1 < completed write operation key=DIN8WJ9Z9OI8 tag=MF3VPMM0K9NR type=write size=228223 2024-03-09T14:37:01.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.379+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~ODXKBDQA1128.0 size=1048576 2024-03-09T14:37:01.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.383+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~ODXKBDQA1128.1 size=1048576 2024-03-09T14:37:01.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.383+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~ODXKBDQA1128.2 size=85052 2024-03-09T14:37:01.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.383+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=ODXKBDQA1128 tag=IXNN17YSK3VV type=write size=3230780 2024-03-09T14:37:01.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.387+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~O8ZOQX0GBW0N.0 size=1048576 2024-03-09T14:37:01.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.391+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~O8ZOQX0GBW0N.1 size=1048576 2024-03-09T14:37:01.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.391+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~O8ZOQX0GBW0N.2 size=394911 2024-03-09T14:37:01.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.399+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=O8ZOQX0GBW0N tag=9C960SUCHY2N type=write size=3540639 2024-03-09T14:37:01.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.403+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=CTW8UXEXN4P6 type=del size=1084753 2024-03-09T14:37:01.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.407+0000 7fd389e788c0 1 < suggested remove operation key=PKVYD8DWS7M2 tag=GP9BLQOG55PC type=del 2024-03-09T14:37:01.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.415+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~6WHSTOXS97WW.0 size=1048576 2024-03-09T14:37:01.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.419+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~6WHSTOXS97WW.1 size=763779 2024-03-09T14:37:01.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.419+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=6WHSTOXS97WW tag=2Z03132W6P6V type=write size=2860931 2024-03-09T14:37:01.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.423+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=YJFQOVH5ZKP1 type=del 2024-03-09T14:37:01.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.423+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=LZQS6LL8RMRT type=del size=2114708 2024-03-09T14:37:01.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.427+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~NMHUZ7VJ4VL4.0 size=1048576 2024-03-09T14:37:01.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.431+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~NMHUZ7VJ4VL4.1 size=562654 2024-03-09T14:37:01.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.435+0000 7fd389e788c0 1 < completed multipart upload key=P83H9137MI7Y upload=NMHUZ7VJ4VL4 tag=6KM49SSF13QI type=write size=2659806 2024-03-09T14:37:01.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.439+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=YTDR8OLDD7G9 type=del size=1224685 2024-03-09T14:37:01.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.443+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~VZLT2QZD98KV.0 size=1048576 2024-03-09T14:37:01.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.447+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~VZLT2QZD98KV.1 size=804679 2024-03-09T14:37:01.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.451+0000 7fd389e788c0 1 < completed multipart upload key=P83H9137MI7Y upload=VZLT2QZD98KV tag=56XM7OOMKIGP type=write size=2901831 2024-03-09T14:37:01.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.455+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~AUWBVAZLZRF6.0 size=1048576 2024-03-09T14:37:01.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.459+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~AUWBVAZLZRF6.1 size=1024181 2024-03-09T14:37:01.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.459+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=AUWBVAZLZRF6 tag=0WUNDTKKJ8CJ type=write size=3121333 2024-03-09T14:37:01.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.463+0000 7fd389e788c0 1 < canceled operation key=5ZEDXFB9B3CN tag=VLDB0980IP3W type=del size=269470 2024-03-09T14:37:01.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.467+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~SNE69JC74WI1.0 size=120214 2024-03-09T14:37:01.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.467+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=SNE69JC74WI1 tag=WGXQRQ2RE6ZN type=write size=1168790 2024-03-09T14:37:01.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.471+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~40NKD2SVG592.0 size=1048576 2024-03-09T14:37:01.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.471+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~40NKD2SVG592.1 size=481649 2024-03-09T14:37:01.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.479+0000 7fd389e788c0 1 < completed multipart upload key=UMT7VKZ9R4IR upload=40NKD2SVG592 tag=3NRNH5ZYWV7N type=write size=2578801 2024-03-09T14:37:01.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.483+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=R05Q5ZV5ERIU type=del size=60748 2024-03-09T14:37:01.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.483+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=B6FVCOBRWAH6 type=del 2024-03-09T14:37:01.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.491+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~HAJABKUZC5EK.0 size=266540 2024-03-09T14:37:01.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.491+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=HAJABKUZC5EK tag=I4LNHADF2HLQ type=write size=1315116 2024-03-09T14:37:01.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.491+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=T0C85Z2EZBQR type=del 2024-03-09T14:37:01.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.495+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=98ZQG1Z0Q6C3 type=write size=789077 2024-03-09T14:37:01.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.499+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=38R8IKHAN15O type=del 2024-03-09T14:37:01.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.503+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=8DUBVJE6TXXO type=write size=600723 2024-03-09T14:37:01.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.507+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~UFG64BKD9NV8.0 size=1048576 2024-03-09T14:37:01.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.507+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~UFG64BKD9NV8.1 size=1048576 2024-03-09T14:37:01.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.515+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~UFG64BKD9NV8.2 size=374583 2024-03-09T14:37:01.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.519+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=UFG64BKD9NV8 tag=49UIMFZICBCS type=write size=3520311 2024-03-09T14:37:01.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.523+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=5ND7X20TMVGB type=del size=569952 2024-03-09T14:37:01.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.527+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=992HBMF3HPTN type=del 2024-03-09T14:37:01.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.531+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=M5E5JZQ3RHIQ type=del size=1056557 2024-03-09T14:37:01.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.531+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=HHZ7Y4V9ZHK5 type=del 2024-03-09T14:37:01.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.535+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=094248MLSIQ6 type=del size=1047329 2024-03-09T14:37:01.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.539+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~LCSB00VKHA5N.0 size=150343 2024-03-09T14:37:01.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.543+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=LCSB00VKHA5N tag=W7MRBQYNMCYW type=write size=1198919 2024-03-09T14:37:01.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.547+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=5T3BVMQLU2M8 type=write size=392850 2024-03-09T14:37:01.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.551+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~L6I0XSUB2Z60.0 size=1048576 2024-03-09T14:37:01.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.555+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~L6I0XSUB2Z60.1 size=165365 2024-03-09T14:37:01.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.559+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=L6I0XSUB2Z60 tag=PESOKMO3IL17 type=write size=2262517 2024-03-09T14:37:01.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.563+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=MMW8UEY6HMIW type=del size=976467 2024-03-09T14:37:01.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.563+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~ODXKBDQA1128.0 size=1048576 2024-03-09T14:37:01.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.567+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~ODXKBDQA1128.1 size=1048576 2024-03-09T14:37:01.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.571+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~ODXKBDQA1128.2 size=85052 2024-03-09T14:37:01.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.575+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=ODXKBDQA1128 tag=IXNN17YSK3VV type=write size=3230780 2024-03-09T14:37:01.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.579+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~LV59PUUEOJTT.0 size=788165 2024-03-09T14:37:01.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.579+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=LV59PUUEOJTT tag=WCOE23I0H56V type=write size=1836741 2024-03-09T14:37:01.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.583+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=CTW8UXEXN4P6 type=del 2024-03-09T14:37:01.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.587+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=G0QVCLBO3K8F type=del size=2321919 2024-03-09T14:37:01.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.587+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~6WHSTOXS97WW.0 size=1048576 2024-03-09T14:37:01.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.591+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~6WHSTOXS97WW.1 size=763779 2024-03-09T14:37:01.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.595+0000 7fd389e788c0 1 < completed multipart upload key=P83H9137MI7Y upload=6WHSTOXS97WW tag=2Z03132W6P6V type=write size=2860931 2024-03-09T14:37:01.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.599+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=SE2OHR6GW96T type=del size=3234930 2024-03-09T14:37:01.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.603+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=LZQS6LL8RMRT type=del 2024-03-09T14:37:01.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.607+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=JZLXS09JSYKJ type=write size=1046937 2024-03-09T14:37:01.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.611+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=YTDR8OLDD7G9 type=del 2024-03-09T14:37:01.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.615+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~WKWMWBXYCH2D.0 size=1048576 2024-03-09T14:37:01.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.615+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~WKWMWBXYCH2D.1 size=553738 2024-03-09T14:37:01.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.615+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=WKWMWBXYCH2D tag=5EFKF2K22A7W type=write size=2650890 2024-03-09T14:37:01.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.619+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~AUWBVAZLZRF6.0 size=1048576 2024-03-09T14:37:01.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.619+0000 7fd389e788c0 1 < canceled part key=_multipart_IXKMXJ9IZ69S.2~AUWBVAZLZRF6.1 size=1024181 2024-03-09T14:37:01.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.623+0000 7fd389e788c0 1 < canceled multipart upload key=IXKMXJ9IZ69S upload=AUWBVAZLZRF6 tag=0WUNDTKKJ8CJ type=write size=3121333 2024-03-09T14:37:01.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.627+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=8WYFV13M1OQH type=del size=3508294 2024-03-09T14:37:01.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.627+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~SNE69JC74WI1.0 size=120214 2024-03-09T14:37:01.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.635+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=SNE69JC74WI1 tag=WGXQRQ2RE6ZN type=write size=1168790 2024-03-09T14:37:01.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.635+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=UJZ0BG74YIVO type=del size=3037244 2024-03-09T14:37:01.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.639+0000 7fd389e788c0 1 < completed delete operation key=PKVYD8DWS7M2 tag=R05Q5ZV5ERIU type=del 2024-03-09T14:37:01.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.643+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=94IZS21A4G8B type=del size=974782 2024-03-09T14:37:01.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.643+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~HAJABKUZC5EK.0 size=266540 2024-03-09T14:37:01.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.647+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=HAJABKUZC5EK tag=I4LNHADF2HLQ type=write size=1315116 2024-03-09T14:37:01.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.651+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=8LSIZJFQU38Z type=write size=466335 2024-03-09T14:37:01.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.651+0000 7fd389e788c0 1 < completed write operation key=DIN8WJ9Z9OI8 tag=98ZQG1Z0Q6C3 type=write size=789077 2024-03-09T14:37:01.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.655+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=5WF2O65JXV9C type=del size=2232285 2024-03-09T14:37:01.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.659+0000 7fd389e788c0 1 < completed write operation key=YR2VX4QLOCOG tag=8DUBVJE6TXXO type=write size=600723 2024-03-09T14:37:01.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.663+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=J64MIPVOM0D0 type=del size=1366098 2024-03-09T14:37:01.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.663+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=5ND7X20TMVGB type=del 2024-03-09T14:37:01.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.667+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=K45OSDFB2MNQ type=del size=3208629 2024-03-09T14:37:01.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.671+0000 7fd389e788c0 1 < suggested update operation key=1K5KR8U3GCOV tag=M5E5JZQ3RHIQ type=del size=1056557 2024-03-09T14:37:01.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.671+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=MH709ORNB7QK type=del size=3772343 2024-03-09T14:37:01.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.675+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=094248MLSIQ6 type=del 2024-03-09T14:37:01.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.675+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=07VNK4KC9D7O type=del size=2644179 2024-03-09T14:37:01.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.679+0000 7fd389e788c0 1 < completed write operation key=8J6Z9DT07H0X tag=5T3BVMQLU2M8 type=write size=392850 2024-03-09T14:37:01.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.679+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=FP1OMVS79YOZ type=del size=516278 2024-03-09T14:37:01.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.683+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=MMW8UEY6HMIW type=del 2024-03-09T14:37:01.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.683+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=3NPAG64QL87L type=write size=880825 2024-03-09T14:37:01.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.687+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~LV59PUUEOJTT.0 size=788165 2024-03-09T14:37:01.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.691+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=LV59PUUEOJTT tag=WCOE23I0H56V type=write size=1836741 2024-03-09T14:37:01.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.691+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=SAK3EZAP6HPY type=del size=3792465 2024-03-09T14:37:01.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.695+0000 7fd389e788c0 1 < suggested update operation key=Y7E2TLASJM9T tag=G0QVCLBO3K8F type=del size=2321919 2024-03-09T14:37:01.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.699+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~AZYQUQU4VBVY.0 size=1048576 2024-03-09T14:37:01.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.703+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~AZYQUQU4VBVY.1 size=778992 2024-03-09T14:37:01.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.703+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=AZYQUQU4VBVY tag=VY4HD3PWEPHT type=write size=2876144 2024-03-09T14:37:01.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.703+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=SE2OHR6GW96T type=del 2024-03-09T14:37:01.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.707+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=8MBK713ETRRZ type=write size=237625 2024-03-09T14:37:01.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.707+0000 7fd389e788c0 1 < completed write operation key=UMT7VKZ9R4IR tag=JZLXS09JSYKJ type=write size=1046937 2024-03-09T14:37:01.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.711+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~LLKSPLLBH4ND.0 size=226573 2024-03-09T14:37:01.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.711+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=LLKSPLLBH4ND tag=7LM4EW19FPBD type=write size=1275149 2024-03-09T14:37:01.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.715+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~WKWMWBXYCH2D.0 size=1048576 2024-03-09T14:37:01.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.715+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~WKWMWBXYCH2D.1 size=553738 2024-03-09T14:37:01.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.719+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=WKWMWBXYCH2D tag=5EFKF2K22A7W type=write size=2650890 2024-03-09T14:37:01.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.723+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~RM2QDN0KO0OX.0 size=670098 2024-03-09T14:37:01.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.723+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=RM2QDN0KO0OX tag=AT4PD64VXPWW type=write size=1718674 2024-03-09T14:37:01.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.727+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=8WYFV13M1OQH type=del 2024-03-09T14:37:01.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.727+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=I3QOD3J5D7KL type=del size=2479006 2024-03-09T14:37:01.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.735+0000 7fd389e788c0 1 < suggested remove operation key=Z18Q66VI5PDN tag=UJZ0BG74YIVO type=del 2024-03-09T14:37:01.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.735+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=GGDOGUG5DDQY type=del size=3184382 2024-03-09T14:37:01.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.739+0000 7fd389e788c0 1 < suggested remove operation key=2405Y4I2Q8TY tag=94IZS21A4G8B type=del 2024-03-09T14:37:01.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.747+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~70W4C8P1Z0T1.0 size=35270 2024-03-09T14:37:01.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.747+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=70W4C8P1Z0T1 tag=1R8MHTU9RWDS type=write size=1083846 2024-03-09T14:37:01.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.751+0000 7fd389e788c0 -1 < failed to complete operation key=Z18Q66VI5PDN tag=8LSIZJFQU38Z type=write size=466335: (22) Invalid argument 2024-03-09T14:37:01.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.755+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~0EHE4YLHJTOM.0 size=1048576 2024-03-09T14:37:01.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.755+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~0EHE4YLHJTOM.1 size=1048576 2024-03-09T14:37:01.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.759+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~0EHE4YLHJTOM.2 size=106146 2024-03-09T14:37:01.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.759+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=0EHE4YLHJTOM tag=GPSTSTSLJ1S1 type=write size=3251874 2024-03-09T14:37:01.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.767+0000 7fd389e788c0 1 < suggested update operation key=1K5KR8U3GCOV tag=5WF2O65JXV9C type=del size=2232285 2024-03-09T14:37:01.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.771+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=XWRPCP13L9N9 type=del size=3331747 2024-03-09T14:37:01.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.771+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=J64MIPVOM0D0 type=del 2024-03-09T14:37:01.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.775+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=3W64YU4G2QF3 type=write size=451319 2024-03-09T14:37:01.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.779+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=K45OSDFB2MNQ type=del 2024-03-09T14:37:01.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.783+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=ILP08XCGPRBK type=write size=451406 2024-03-09T14:37:01.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.787+0000 7fd389e788c0 1 < suggested remove operation key=ACL1T9GW2JV9 tag=MH709ORNB7QK type=del 2024-03-09T14:37:01.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.791+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=7BV15HE4E7T7 type=write size=442566 2024-03-09T14:37:01.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.795+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=07VNK4KC9D7O type=del 2024-03-09T14:37:01.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.799+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~KP38QVN44I3Q.0 size=434773 2024-03-09T14:37:01.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.799+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=KP38QVN44I3Q tag=9B2SNESJOURS type=write size=1483349 2024-03-09T14:37:01.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.803+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=FP1OMVS79YOZ type=del 2024-03-09T14:37:01.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.807+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~L4JSHGTGDSRK.0 size=331227 2024-03-09T14:37:01.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.807+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=L4JSHGTGDSRK tag=23R18K36461Q type=write size=1379803 2024-03-09T14:37:01.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.811+0000 7fd389e788c0 1 < suggested remove operation key=U8P5Q3D11MM6 tag=3NPAG64QL87L type=write 2024-03-09T14:37:01.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.815+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=SP7GCX64IPTB type=write size=217675 2024-03-09T14:37:01.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.815+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=SAK3EZAP6HPY type=del 2024-03-09T14:37:01.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.819+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~RZJ6ZUEGZH5V.0 size=208969 2024-03-09T14:37:01.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.819+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=RZJ6ZUEGZH5V tag=8SOY9LYY4T0K type=write size=1257545 2024-03-09T14:37:01.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.823+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~AZYQUQU4VBVY.0 size=1048576 2024-03-09T14:37:01.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.823+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~AZYQUQU4VBVY.1 size=778992 2024-03-09T14:37:01.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.827+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=AZYQUQU4VBVY tag=VY4HD3PWEPHT type=write size=2876144 2024-03-09T14:37:01.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.835+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~N4ORAT33364C.0 size=1048576 2024-03-09T14:37:01.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.835+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~N4ORAT33364C.1 size=1048576 2024-03-09T14:37:01.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.835+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~N4ORAT33364C.2 size=394477 2024-03-09T14:37:01.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.835+0000 7fd389e788c0 1 > prepared multipart upload key=2405Y4I2Q8TY upload=N4ORAT33364C tag=6DFN6Q1LT3LY type=write size=3540205 2024-03-09T14:37:01.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.839+0000 7fd389e788c0 1 < suggested remove operation key=P83H9137MI7Y tag=8MBK713ETRRZ type=write 2024-03-09T14:37:01.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.843+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~PFBX0XP32D90.0 size=1048576 2024-03-09T14:37:01.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.847+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~PFBX0XP32D90.1 size=785350 2024-03-09T14:37:01.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.847+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=PFBX0XP32D90 tag=HCLPBM1J5CNZ type=write size=2882502 2024-03-09T14:37:01.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.847+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~LLKSPLLBH4ND.0 size=226573 2024-03-09T14:37:01.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.851+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=LLKSPLLBH4ND tag=7LM4EW19FPBD type=write size=1275149 2024-03-09T14:37:01.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.855+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=AV92DZKNSBQY type=del size=3425972 2024-03-09T14:37:01.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.855+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~RM2QDN0KO0OX.0 size=670098 2024-03-09T14:37:01.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.859+0000 7fd389e788c0 1 < completed multipart upload key=E2VP0TJ37UX8 upload=RM2QDN0KO0OX tag=AT4PD64VXPWW type=write size=1718674 2024-03-09T14:37:01.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.863+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=VIULNI1BYPWN type=del size=1927411 2024-03-09T14:37:01.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.863+0000 7fd389e788c0 -1 < no bi entry to suggest for operation key=Z18Q66VI5PDN tag=I3QOD3J5D7KL type=del size=2479006: (2) No such file or directory 2024-03-09T14:37:01.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.863+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=NF3XZJ33POBE type=del size=2021098 2024-03-09T14:37:01.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.867+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=GGDOGUG5DDQY type=del 2024-03-09T14:37:01.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.871+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~RO2YZJ01MBK1.0 size=1048576 2024-03-09T14:37:01.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.875+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~RO2YZJ01MBK1.1 size=1048576 2024-03-09T14:37:01.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.875+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~RO2YZJ01MBK1.2 size=340691 2024-03-09T14:37:01.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.875+0000 7fd389e788c0 1 > prepared multipart upload key=UMT7VKZ9R4IR upload=RO2YZJ01MBK1 tag=RRM90HUYSJDP type=write size=3486419 2024-03-09T14:37:01.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.879+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~70W4C8P1Z0T1.0 size=35270 2024-03-09T14:37:01.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.883+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=70W4C8P1Z0T1 tag=1R8MHTU9RWDS type=write size=1083846 2024-03-09T14:37:01.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.883+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=13XZCV4U838Y type=del size=2173542 2024-03-09T14:37:01.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.887+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~0EHE4YLHJTOM.0 size=1048576 2024-03-09T14:37:01.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.887+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~0EHE4YLHJTOM.1 size=1048576 2024-03-09T14:37:01.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.887+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~0EHE4YLHJTOM.2 size=106146 2024-03-09T14:37:01.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.891+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=0EHE4YLHJTOM tag=GPSTSTSLJ1S1 type=write size=3251874 2024-03-09T14:37:01.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.895+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=5DJQ025SC93H type=del size=1744406 2024-03-09T14:37:01.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.899+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=XWRPCP13L9N9 type=del 2024-03-09T14:37:01.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.903+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~DLMIRA98E7ZS.0 size=1048576 2024-03-09T14:37:01.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.903+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~DLMIRA98E7ZS.1 size=1048576 2024-03-09T14:37:01.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.903+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~DLMIRA98E7ZS.2 size=176471 2024-03-09T14:37:01.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.903+0000 7fd389e788c0 1 > prepared multipart upload key=UMT7VKZ9R4IR upload=DLMIRA98E7ZS tag=XHF2GSR3VI9I type=write size=3322199 2024-03-09T14:37:01.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.907+0000 7fd389e788c0 1 < completed write operation key=I4NA328AI5T1 tag=3W64YU4G2QF3 type=write size=451319 2024-03-09T14:37:01.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.911+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~8XZM7Z61VWHO.0 size=218396 2024-03-09T14:37:01.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.911+0000 7fd389e788c0 1 > prepared multipart upload key=GSNWWDS63MTA upload=8XZM7Z61VWHO tag=BSHOIIPK6TN5 type=write size=1266972 2024-03-09T14:37:01.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.915+0000 7fd389e788c0 1 < completed write operation key=IXKMXJ9IZ69S tag=ILP08XCGPRBK type=write size=451406 2024-03-09T14:37:01.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.915+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=A0DEZ0IQ1TB2 type=del size=116016 2024-03-09T14:37:01.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.919+0000 7fd389e788c0 1 < completed write operation key=UMT7VKZ9R4IR tag=7BV15HE4E7T7 type=write size=442566 2024-03-09T14:37:01.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.923+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=DGT8LI7B0ZLE type=del size=3630660 2024-03-09T14:37:01.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.923+0000 7fd389e788c0 1 < canceled part key=_multipart_IXKMXJ9IZ69S.2~KP38QVN44I3Q.0 size=434773 2024-03-09T14:37:01.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.927+0000 7fd389e788c0 1 < canceled multipart upload key=IXKMXJ9IZ69S upload=KP38QVN44I3Q tag=9B2SNESJOURS type=write size=1483349 2024-03-09T14:37:01.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.927+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=5F71B29WN1LH type=del size=2854231 2024-03-09T14:37:01.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.943+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~L4JSHGTGDSRK.0 size=331227 2024-03-09T14:37:01.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.947+0000 7fd389e788c0 1 < completed multipart upload key=E2VP0TJ37UX8 upload=L4JSHGTGDSRK tag=23R18K36461Q type=write size=1379803 2024-03-09T14:37:01.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.947+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~4I32VL5UNY1T.0 size=1048576 2024-03-09T14:37:01.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.951+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~4I32VL5UNY1T.1 size=872888 2024-03-09T14:37:01.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.951+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=4I32VL5UNY1T tag=Q3I6QUVNHT6W type=write size=2970040 2024-03-09T14:37:01.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.951+0000 7fd389e788c0 1 < canceled operation key=71692MJQITX3 tag=SP7GCX64IPTB type=write size=217675 2024-03-09T14:37:01.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.955+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=ZP9J8HOBJ0PO type=del size=3848018 2024-03-09T14:37:01.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.955+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~RZJ6ZUEGZH5V.0 size=208969 2024-03-09T14:37:01.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.959+0000 7fd389e788c0 1 < completed multipart upload key=Z18Q66VI5PDN upload=RZJ6ZUEGZH5V tag=8SOY9LYY4T0K type=write size=1257545 2024-03-09T14:37:01.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.959+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=FXM8LOCOE155 type=write size=745726 2024-03-09T14:37:01.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.963+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~N4ORAT33364C.0 size=1048576 2024-03-09T14:37:01.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.963+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~N4ORAT33364C.1 size=1048576 2024-03-09T14:37:01.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.963+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~N4ORAT33364C.2 size=394477 2024-03-09T14:37:01.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.967+0000 7fd389e788c0 1 < completed multipart upload key=2405Y4I2Q8TY upload=N4ORAT33364C tag=6DFN6Q1LT3LY type=write size=3540205 2024-03-09T14:37:01.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.971+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=HR3UW18K4HTQ type=del size=3375620 2024-03-09T14:37:01.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.971+0000 7fd389e788c0 1 < canceled part key=_multipart_E65PFNHJQHEO.2~PFBX0XP32D90.0 size=1048576 2024-03-09T14:37:01.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.971+0000 7fd389e788c0 1 < canceled part key=_multipart_E65PFNHJQHEO.2~PFBX0XP32D90.1 size=785350 2024-03-09T14:37:01.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.971+0000 7fd389e788c0 1 < canceled multipart upload key=E65PFNHJQHEO upload=PFBX0XP32D90 tag=HCLPBM1J5CNZ type=write size=2882502 2024-03-09T14:37:01.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.975+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=4PPWLPGNRU6T type=del size=1080044 2024-03-09T14:37:01.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.975+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=AV92DZKNSBQY type=del 2024-03-09T14:37:01.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.979+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=6KGRKQM3XPPJ type=del size=3996670 2024-03-09T14:37:01.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.979+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=VIULNI1BYPWN type=del 2024-03-09T14:37:01.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.983+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~B1S7J4MG7449.0 size=1048576 2024-03-09T14:37:01.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.987+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~B1S7J4MG7449.1 size=1048576 2024-03-09T14:37:01.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.987+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~B1S7J4MG7449.2 size=961266 2024-03-09T14:37:01.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.987+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=B1S7J4MG7449 tag=SFK8EBC1IR88 type=write size=4106994 2024-03-09T14:37:01.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.991+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=NF3XZJ33POBE type=del 2024-03-09T14:37:01.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.991+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=LBWMJXBY3N6T type=write size=507272 2024-03-09T14:37:01.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.995+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~RO2YZJ01MBK1.0 size=1048576 2024-03-09T14:37:01.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.995+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~RO2YZJ01MBK1.1 size=1048576 2024-03-09T14:37:01.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.999+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~RO2YZJ01MBK1.2 size=340691 2024-03-09T14:37:02.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:01.999+0000 7fd389e788c0 1 < completed multipart upload key=UMT7VKZ9R4IR upload=RO2YZJ01MBK1 tag=RRM90HUYSJDP type=write size=3486419 2024-03-09T14:37:02.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.003+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~DVOR42NOVMMJ.0 size=1048576 2024-03-09T14:37:02.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.007+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~DVOR42NOVMMJ.1 size=348097 2024-03-09T14:37:02.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.007+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=DVOR42NOVMMJ tag=SH5K3VACJG38 type=write size=2445249 2024-03-09T14:37:02.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.007+0000 7fd389e788c0 1 < suggested remove operation key=SVTMMQ2QR603 tag=13XZCV4U838Y type=del 2024-03-09T14:37:02.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.011+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=FZT9QK1CWSEC type=del size=3054464 2024-03-09T14:37:02.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.011+0000 7fd389e788c0 1 < completed delete operation key=UMT7VKZ9R4IR tag=5DJQ025SC93H type=del 2024-03-09T14:37:02.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.015+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=UZQNL3TWSJA0 type=del size=4040162 2024-03-09T14:37:02.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.015+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~DLMIRA98E7ZS.0 size=1048576 2024-03-09T14:37:02.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.019+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~DLMIRA98E7ZS.1 size=1048576 2024-03-09T14:37:02.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.019+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~DLMIRA98E7ZS.2 size=176471 2024-03-09T14:37:02.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.023+0000 7fd389e788c0 1 < completed multipart upload key=UMT7VKZ9R4IR upload=DLMIRA98E7ZS tag=XHF2GSR3VI9I type=write size=3322199 2024-03-09T14:37:02.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.027+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~T5B1OW1DA6I1.0 size=1048576 2024-03-09T14:37:02.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.027+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~T5B1OW1DA6I1.1 size=1048576 2024-03-09T14:37:02.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.031+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~T5B1OW1DA6I1.2 size=384527 2024-03-09T14:37:02.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.031+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=T5B1OW1DA6I1 tag=DDMBAJJ98J2K type=write size=3530255 2024-03-09T14:37:02.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.031+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~8XZM7Z61VWHO.0 size=218396 2024-03-09T14:37:02.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.035+0000 7fd389e788c0 1 < completed multipart upload key=GSNWWDS63MTA upload=8XZM7Z61VWHO tag=BSHOIIPK6TN5 type=write size=1266972 2024-03-09T14:37:02.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.035+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=TCF365OZ0Y7K type=del size=252948 2024-03-09T14:37:02.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.039+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=A0DEZ0IQ1TB2 type=del 2024-03-09T14:37:02.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.039+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=LNGAF1EU5IG2 type=del size=1177954 2024-03-09T14:37:02.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.043+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=DGT8LI7B0ZLE type=del 2024-03-09T14:37:02.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.047+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=BHWO5AHTN3LC type=del size=560024 2024-03-09T14:37:02.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.047+0000 7fd389e788c0 1 < completed delete operation key=PKVYD8DWS7M2 tag=5F71B29WN1LH type=del 2024-03-09T14:37:02.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.051+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=G6UGR2WFFZ47 type=del size=1877769 2024-03-09T14:37:02.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.051+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~4I32VL5UNY1T.0 size=1048576 2024-03-09T14:37:02.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.051+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~4I32VL5UNY1T.1 size=872888 2024-03-09T14:37:02.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.055+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=4I32VL5UNY1T tag=Q3I6QUVNHT6W type=write size=2970040 2024-03-09T14:37:02.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.059+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=5WGLS65CBRWY type=del size=646786 2024-03-09T14:37:02.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.059+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=ZP9J8HOBJ0PO type=del 2024-03-09T14:37:02.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.063+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=UMR57RU410MY type=del size=1436010 2024-03-09T14:37:02.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.063+0000 7fd389e788c0 1 < completed write operation key=I4NA328AI5T1 tag=FXM8LOCOE155 type=write size=745726 2024-03-09T14:37:02.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.067+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~UPST2OR17E8R.0 size=198846 2024-03-09T14:37:02.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.067+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=UPST2OR17E8R tag=PKK4P9T4RZIH type=write size=1247422 2024-03-09T14:37:02.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.071+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=HR3UW18K4HTQ type=del 2024-03-09T14:37:02.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.075+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~LLFP7ORKQE5H.0 size=1048576 2024-03-09T14:37:02.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.075+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~LLFP7ORKQE5H.1 size=142311 2024-03-09T14:37:02.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.075+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=LLFP7ORKQE5H tag=JYR3CIMFQR26 type=write size=2239463 2024-03-09T14:37:02.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.079+0000 7fd389e788c0 1 < suggested remove operation key=PKVYD8DWS7M2 tag=4PPWLPGNRU6T type=del 2024-03-09T14:37:02.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.079+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=2Y98ERRMQ28C type=del size=2600265 2024-03-09T14:37:02.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.083+0000 7fd389e788c0 1 < suggested update operation key=YR2VX4QLOCOG tag=6KGRKQM3XPPJ type=del size=3996670 2024-03-09T14:37:02.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.087+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=X56KZ2JACVSL type=del size=2104995 2024-03-09T14:37:02.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.087+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~B1S7J4MG7449.0 size=1048576 2024-03-09T14:37:02.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.091+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~B1S7J4MG7449.1 size=1048576 2024-03-09T14:37:02.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.091+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~B1S7J4MG7449.2 size=961266 2024-03-09T14:37:02.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.095+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=B1S7J4MG7449 tag=SFK8EBC1IR88 type=write size=4106994 2024-03-09T14:37:02.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.099+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~TAFHM90SIBGY.0 size=1048576 2024-03-09T14:37:02.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.099+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~TAFHM90SIBGY.1 size=638427 2024-03-09T14:37:02.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.099+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=TAFHM90SIBGY tag=H741YNWTQLR1 type=write size=2735579 2024-03-09T14:37:02.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.103+0000 7fd389e788c0 1 < completed write operation key=1KJK6PF6U226 tag=LBWMJXBY3N6T type=write size=507272 2024-03-09T14:37:02.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.107+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~K06WPG6J1FL8.0 size=1048576 2024-03-09T14:37:02.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.107+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~K06WPG6J1FL8.1 size=56468 2024-03-09T14:37:02.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.107+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=K06WPG6J1FL8 tag=4YFB1VWEFFWE type=write size=2153620 2024-03-09T14:37:02.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.111+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~DVOR42NOVMMJ.0 size=1048576 2024-03-09T14:37:02.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.111+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~DVOR42NOVMMJ.1 size=348097 2024-03-09T14:37:02.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.115+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=DVOR42NOVMMJ tag=SH5K3VACJG38 type=write size=2445249 2024-03-09T14:37:02.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.115+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=8AYYSVD11KKI type=del size=326889 2024-03-09T14:37:02.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.119+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=FZT9QK1CWSEC type=del 2024-03-09T14:37:02.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.119+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~J8F4MKU27GOW.0 size=1048576 2024-03-09T14:37:02.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.123+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~J8F4MKU27GOW.1 size=1048576 2024-03-09T14:37:02.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.123+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~J8F4MKU27GOW.2 size=229447 2024-03-09T14:37:02.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.123+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=J8F4MKU27GOW tag=1T759LLJXZXP type=write size=3375175 2024-03-09T14:37:02.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.127+0000 7fd389e788c0 1 < suggested remove operation key=E2VP0TJ37UX8 tag=UZQNL3TWSJA0 type=del 2024-03-09T14:37:02.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.131+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=CYXGHEYQJE25 type=del size=2838257 2024-03-09T14:37:02.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.131+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~T5B1OW1DA6I1.0 size=1048576 2024-03-09T14:37:02.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.135+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~T5B1OW1DA6I1.1 size=1048576 2024-03-09T14:37:02.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.135+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~T5B1OW1DA6I1.2 size=384527 2024-03-09T14:37:02.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.139+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=T5B1OW1DA6I1 tag=DDMBAJJ98J2K type=write size=3530255 2024-03-09T14:37:02.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.139+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=3BHE2BYHD8W0 type=del size=2569040 2024-03-09T14:37:02.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.143+0000 7fd389e788c0 -1 < no bi entry to suggest for operation key=E2VP0TJ37UX8 tag=TCF365OZ0Y7K type=del size=252948: (2) No such file or directory 2024-03-09T14:37:02.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.147+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~93RCCLXUHSEQ.0 size=701995 2024-03-09T14:37:02.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.147+0000 7fd389e788c0 1 > prepared multipart upload key=GSNWWDS63MTA upload=93RCCLXUHSEQ tag=S03ONNTZWSHR type=write size=1750571 2024-03-09T14:37:02.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.147+0000 7fd389e788c0 1 < canceled operation key=K9X2N6V8R4BY tag=LNGAF1EU5IG2 type=del size=1177954 2024-03-09T14:37:02.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.155+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~MJA4CH75KW9D.0 size=1048576 2024-03-09T14:37:02.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.155+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~MJA4CH75KW9D.1 size=498543 2024-03-09T14:37:02.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.155+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=MJA4CH75KW9D tag=4WPVO270BTTZ type=write size=2595695 2024-03-09T14:37:02.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.159+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=BHWO5AHTN3LC type=del 2024-03-09T14:37:02.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.159+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=3F7VZK87B2W0 type=del size=1599562 2024-03-09T14:37:02.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.163+0000 7fd389e788c0 1 < canceled operation key=K9X2N6V8R4BY tag=G6UGR2WFFZ47 type=del size=1877769 2024-03-09T14:37:02.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.167+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=YV4UJRL0KA62 type=del size=2109535 2024-03-09T14:37:02.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.167+0000 7fd389e788c0 -1 < failed to complete operation key=E2VP0TJ37UX8 tag=5WGLS65CBRWY type=del size=646786: (22) Invalid argument 2024-03-09T14:37:02.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.171+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~J7UR8PDHFEJ0.0 size=1048576 2024-03-09T14:37:02.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.175+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~J7UR8PDHFEJ0.1 size=508534 2024-03-09T14:37:02.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.175+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=J7UR8PDHFEJ0 tag=PTVL1K0LN2MK type=write size=2605686 2024-03-09T14:37:02.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.179+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=UMR57RU410MY type=del 2024-03-09T14:37:02.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.183+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~PTX7IRFFGSMA.0 size=1048576 2024-03-09T14:37:02.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.183+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~PTX7IRFFGSMA.1 size=1048576 2024-03-09T14:37:02.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.187+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~PTX7IRFFGSMA.2 size=287292 2024-03-09T14:37:02.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.187+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=PTX7IRFFGSMA tag=YT8U7Y57O11E type=write size=3433020 2024-03-09T14:37:02.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.187+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~UPST2OR17E8R.0 size=198846 2024-03-09T14:37:02.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.191+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=UPST2OR17E8R tag=PKK4P9T4RZIH type=write size=1247422 2024-03-09T14:37:02.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.195+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=FWHLEQRG0G2J type=del size=788957 2024-03-09T14:37:02.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.195+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~LLFP7ORKQE5H.0 size=1048576 2024-03-09T14:37:02.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.199+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~LLFP7ORKQE5H.1 size=142311 2024-03-09T14:37:02.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.203+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=LLFP7ORKQE5H tag=JYR3CIMFQR26 type=write size=2239463 2024-03-09T14:37:02.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.207+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~1DMX230WZTGI.0 size=684955 2024-03-09T14:37:02.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.207+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=1DMX230WZTGI tag=SEUAPS76LMIP type=write size=1733531 2024-03-09T14:37:02.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.207+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=2Y98ERRMQ28C type=del 2024-03-09T14:37:02.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.211+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=3WXBDWJH9WKQ type=del size=602431 2024-03-09T14:37:02.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.215+0000 7fd389e788c0 1 < suggested remove operation key=YR2VX4QLOCOG tag=X56KZ2JACVSL type=del 2024-03-09T14:37:02.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.215+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=U0JMY1F9YEUL type=del size=3199732 2024-03-09T14:37:02.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.219+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~TAFHM90SIBGY.0 size=1048576 2024-03-09T14:37:02.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.219+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~TAFHM90SIBGY.1 size=638427 2024-03-09T14:37:02.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.223+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=TAFHM90SIBGY tag=H741YNWTQLR1 type=write size=2735579 2024-03-09T14:37:02.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.227+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~LNN2Y6P65L43.0 size=1006316 2024-03-09T14:37:02.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.227+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=LNN2Y6P65L43 tag=5KNB45ONMIFX type=write size=2054892 2024-03-09T14:37:02.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.231+0000 7fd389e788c0 1 < canceled part key=_multipart_1KJK6PF6U226.2~K06WPG6J1FL8.0 size=1048576 2024-03-09T14:37:02.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.231+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~K06WPG6J1FL8.1 size=56468 2024-03-09T14:37:02.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.235+0000 7fd389e788c0 1 < canceled multipart upload key=1KJK6PF6U226 upload=K06WPG6J1FL8 tag=4YFB1VWEFFWE type=write size=2153620 2024-03-09T14:37:02.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.239+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~SLW5BGNE5616.0 size=828874 2024-03-09T14:37:02.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.239+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=SLW5BGNE5616 tag=Z1JJOH1VGCIL type=write size=1877450 2024-03-09T14:37:02.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.239+0000 7fd389e788c0 -1 < failed to complete operation key=YR2VX4QLOCOG tag=8AYYSVD11KKI type=del size=326889: (22) Invalid argument 2024-03-09T14:37:02.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.243+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=50B65YR2AWTO type=del size=1848760 2024-03-09T14:37:02.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.247+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~J8F4MKU27GOW.0 size=1048576 2024-03-09T14:37:02.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.247+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~J8F4MKU27GOW.1 size=1048576 2024-03-09T14:37:02.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.247+0000 7fd389e788c0 1 < canceled part key=_multipart_Y7E2TLASJM9T.2~J8F4MKU27GOW.2 size=229447 2024-03-09T14:37:02.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.251+0000 7fd389e788c0 1 < canceled multipart upload key=Y7E2TLASJM9T upload=J8F4MKU27GOW tag=1T759LLJXZXP type=write size=3375175 2024-03-09T14:37:02.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.255+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~9UEIX14FPFPQ.0 size=1048576 2024-03-09T14:37:02.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.255+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~9UEIX14FPFPQ.1 size=1048576 2024-03-09T14:37:02.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.259+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~9UEIX14FPFPQ.2 size=185604 2024-03-09T14:37:02.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.259+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=9UEIX14FPFPQ tag=T7GEVCC667U8 type=write size=3331332 2024-03-09T14:37:02.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.259+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=CYXGHEYQJE25 type=del 2024-03-09T14:37:02.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.263+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=K7KOT92EIC5W type=del size=822811 2024-03-09T14:37:02.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.263+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=3BHE2BYHD8W0 type=del 2024-03-09T14:37:02.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.267+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~QFOMVN0GKCFJ.0 size=1048576 2024-03-09T14:37:02.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.271+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~QFOMVN0GKCFJ.1 size=286311 2024-03-09T14:37:02.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.271+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=QFOMVN0GKCFJ tag=HW9229980J70 type=write size=2383463 2024-03-09T14:37:02.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.271+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~93RCCLXUHSEQ.0 size=701995 2024-03-09T14:37:02.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.275+0000 7fd389e788c0 1 < completed multipart upload key=GSNWWDS63MTA upload=93RCCLXUHSEQ tag=S03ONNTZWSHR type=write size=1750571 2024-03-09T14:37:02.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.279+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=S4BJKL3X6O98 type=del size=2977519 2024-03-09T14:37:02.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.279+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~MJA4CH75KW9D.0 size=1048576 2024-03-09T14:37:02.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.283+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~MJA4CH75KW9D.1 size=498543 2024-03-09T14:37:02.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.287+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=MJA4CH75KW9D tag=4WPVO270BTTZ type=write size=2595695 2024-03-09T14:37:02.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.291+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~1WSBDKLC9GJ5.0 size=914106 2024-03-09T14:37:02.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.291+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=1WSBDKLC9GJ5 tag=IA5Y9AXRO2I0 type=write size=1962682 2024-03-09T14:37:02.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.291+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=3F7VZK87B2W0 type=del 2024-03-09T14:37:02.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.295+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~QSW0JSEVCF48.0 size=1048576 2024-03-09T14:37:02.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.299+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~QSW0JSEVCF48.1 size=1048576 2024-03-09T14:37:02.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.299+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~QSW0JSEVCF48.2 size=923350 2024-03-09T14:37:02.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.299+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=QSW0JSEVCF48 tag=85FYN706HEE5 type=write size=4069078 2024-03-09T14:37:02.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.299+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=YV4UJRL0KA62 type=del 2024-03-09T14:37:02.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.307+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=L0B38DNT4UTI type=del size=3233995 2024-03-09T14:37:02.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.315+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~J7UR8PDHFEJ0.0 size=1048576 2024-03-09T14:37:02.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.319+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~J7UR8PDHFEJ0.1 size=508534 2024-03-09T14:37:02.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.323+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=J7UR8PDHFEJ0 tag=PTVL1K0LN2MK type=write size=2605686 2024-03-09T14:37:02.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.323+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=HGT8TQ590GMK type=del size=3478992 2024-03-09T14:37:02.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.323+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~PTX7IRFFGSMA.0 size=1048576 2024-03-09T14:37:02.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.327+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~PTX7IRFFGSMA.1 size=1048576 2024-03-09T14:37:02.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.327+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~PTX7IRFFGSMA.2 size=287292 2024-03-09T14:37:02.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.331+0000 7fd389e788c0 1 < completed multipart upload key=K9X2N6V8R4BY upload=PTX7IRFFGSMA tag=YT8U7Y57O11E type=write size=3433020 2024-03-09T14:37:02.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.347+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=774DHJXT166A type=del size=3657237 2024-03-09T14:37:02.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.347+0000 7fd389e788c0 1 < suggested remove operation key=8J6Z9DT07H0X tag=FWHLEQRG0G2J type=del 2024-03-09T14:37:02.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.351+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=6KGVBQUCPEL4 type=del size=1105039 2024-03-09T14:37:02.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.351+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~1DMX230WZTGI.0 size=684955 2024-03-09T14:37:02.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.355+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=1DMX230WZTGI tag=SEUAPS76LMIP type=write size=1733531 2024-03-09T14:37:02.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.355+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~XXK558OX2FFO.0 size=1048576 2024-03-09T14:37:02.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.359+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~XXK558OX2FFO.1 size=188143 2024-03-09T14:37:02.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.359+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=XXK558OX2FFO tag=29QTPWT8XNA4 type=write size=2285295 2024-03-09T14:37:02.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.359+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=3WXBDWJH9WKQ type=del 2024-03-09T14:37:02.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.359+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=Z66QTJHYE0T8 type=del size=448325 2024-03-09T14:37:02.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.363+0000 7fd389e788c0 1 < completed delete operation key=DIN8WJ9Z9OI8 tag=U0JMY1F9YEUL type=del 2024-03-09T14:37:02.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.363+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=1FN7BU6OXE2W type=del size=3344326 2024-03-09T14:37:02.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.367+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~LNN2Y6P65L43.0 size=1006316 2024-03-09T14:37:02.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.367+0000 7fd389e788c0 1 < completed multipart upload key=K9X2N6V8R4BY upload=LNN2Y6P65L43 tag=5KNB45ONMIFX type=write size=2054892 2024-03-09T14:37:02.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.371+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=N4VL6EXVM3YX type=write size=557199 2024-03-09T14:37:02.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.371+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~SLW5BGNE5616.0 size=828874 2024-03-09T14:37:02.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.375+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=SLW5BGNE5616 tag=Z1JJOH1VGCIL type=write size=1877450 2024-03-09T14:37:02.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.375+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=8WX2P5WT3HAE type=del size=2644151 2024-03-09T14:37:02.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.379+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=50B65YR2AWTO type=del 2024-03-09T14:37:02.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.379+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=2SW5WHAACDY4 type=write size=617702 2024-03-09T14:37:02.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.379+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~9UEIX14FPFPQ.0 size=1048576 2024-03-09T14:37:02.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.383+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~9UEIX14FPFPQ.1 size=1048576 2024-03-09T14:37:02.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.383+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~9UEIX14FPFPQ.2 size=185604 2024-03-09T14:37:02.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.387+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=9UEIX14FPFPQ tag=T7GEVCC667U8 type=write size=3331332 2024-03-09T14:37:02.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.391+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~FWV1C6N43P75.0 size=1048576 2024-03-09T14:37:02.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.391+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~FWV1C6N43P75.1 size=995212 2024-03-09T14:37:02.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.391+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=FWV1C6N43P75 tag=0UMS69VL28V0 type=write size=3092364 2024-03-09T14:37:02.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.395+0000 7fd389e788c0 1 < suggested remove operation key=PZJT6RWRJFIN tag=K7KOT92EIC5W type=del 2024-03-09T14:37:02.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.399+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=H32Z3WVNG5B0 type=del size=120954 2024-03-09T14:37:02.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.399+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~QFOMVN0GKCFJ.0 size=1048576 2024-03-09T14:37:02.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.399+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~QFOMVN0GKCFJ.1 size=286311 2024-03-09T14:37:02.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.403+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=QFOMVN0GKCFJ tag=HW9229980J70 type=write size=2383463 2024-03-09T14:37:02.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.407+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=DXTV6FB8C68J type=del size=3364437 2024-03-09T14:37:02.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.407+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=S4BJKL3X6O98 type=del 2024-03-09T14:37:02.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.411+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~KEPC03DR7FBI.0 size=1048576 2024-03-09T14:37:02.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.411+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~KEPC03DR7FBI.1 size=161402 2024-03-09T14:37:02.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.411+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=KEPC03DR7FBI tag=43NLWOXHHX82 type=write size=2258554 2024-03-09T14:37:02.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.415+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~1WSBDKLC9GJ5.0 size=914106 2024-03-09T14:37:02.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.415+0000 7fd389e788c0 1 < completed multipart upload key=E2VP0TJ37UX8 upload=1WSBDKLC9GJ5 tag=IA5Y9AXRO2I0 type=write size=1962682 2024-03-09T14:37:02.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.419+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=00K21Y3OJOGL type=del size=3136857 2024-03-09T14:37:02.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.419+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~QSW0JSEVCF48.0 size=1048576 2024-03-09T14:37:02.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.419+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~QSW0JSEVCF48.1 size=1048576 2024-03-09T14:37:02.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.419+0000 7fd389e788c0 1 < canceled part key=_multipart_P83H9137MI7Y.2~QSW0JSEVCF48.2 size=923350 2024-03-09T14:37:02.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.423+0000 7fd389e788c0 1 < canceled multipart upload key=P83H9137MI7Y upload=QSW0JSEVCF48 tag=85FYN706HEE5 type=write size=4069078 2024-03-09T14:37:02.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.427+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~V8GPYZK8MABZ.0 size=1048576 2024-03-09T14:37:02.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.427+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~V8GPYZK8MABZ.1 size=1048576 2024-03-09T14:37:02.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.431+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~V8GPYZK8MABZ.2 size=993997 2024-03-09T14:37:02.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.431+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=V8GPYZK8MABZ tag=09SZCOJI0897 type=write size=4139725 2024-03-09T14:37:02.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.431+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=L0B38DNT4UTI type=del 2024-03-09T14:37:02.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.435+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=VH0JV5FAM9TQ type=del size=3983189 2024-03-09T14:37:02.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.435+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=HGT8TQ590GMK type=del 2024-03-09T14:37:02.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.439+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~U4D26M53YVXS.0 size=1048576 2024-03-09T14:37:02.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.439+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~U4D26M53YVXS.1 size=55243 2024-03-09T14:37:02.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.439+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=U4D26M53YVXS tag=WQMJMKFEH1GD type=write size=2152395 2024-03-09T14:37:02.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.443+0000 7fd389e788c0 1 < canceled operation key=CLAM83TC7RZ7 tag=774DHJXT166A type=del size=3657237 2024-03-09T14:37:02.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.447+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~KDUC00MJSAT6.0 size=1048576 2024-03-09T14:37:02.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.447+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~KDUC00MJSAT6.1 size=1048576 2024-03-09T14:37:02.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.451+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~KDUC00MJSAT6.2 size=88239 2024-03-09T14:37:02.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.451+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=KDUC00MJSAT6 tag=QWVZHRXTGZ7A type=write size=3233967 2024-03-09T14:37:02.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.451+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=6KGVBQUCPEL4 type=del 2024-03-09T14:37:02.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.455+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=FUS5IILCERQ1 type=del size=949564 2024-03-09T14:37:02.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.455+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~XXK558OX2FFO.0 size=1048576 2024-03-09T14:37:02.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.455+0000 7fd389e788c0 1 < canceled part key=_multipart_E2VP0TJ37UX8.2~XXK558OX2FFO.1 size=188143 2024-03-09T14:37:02.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.459+0000 7fd389e788c0 1 < canceled multipart upload key=E2VP0TJ37UX8 upload=XXK558OX2FFO tag=29QTPWT8XNA4 type=write size=2285295 2024-03-09T14:37:02.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.459+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=Y64G1X6JV0PZ type=del size=2002610 2024-03-09T14:37:02.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.463+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=Z66QTJHYE0T8 type=del 2024-03-09T14:37:02.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.467+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~Q91CXWRO2I9M.0 size=1048576 2024-03-09T14:37:02.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.467+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~Q91CXWRO2I9M.1 size=563711 2024-03-09T14:37:02.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.467+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=Q91CXWRO2I9M tag=0XGS44B4Q72Z type=write size=2660863 2024-03-09T14:37:02.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.471+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=1FN7BU6OXE2W type=del 2024-03-09T14:37:02.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.471+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=XVGMRWM6GUUK type=del size=3173190 2024-03-09T14:37:02.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.475+0000 7fd389e788c0 1 < completed write operation key=44F8QXCBBENS tag=N4VL6EXVM3YX type=write size=557199 2024-03-09T14:37:02.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.479+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~NUNRF25ZIOPQ.0 size=197434 2024-03-09T14:37:02.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.479+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=NUNRF25ZIOPQ tag=91A1VT1CQHQP type=write size=1246010 2024-03-09T14:37:02.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.483+0000 7fd389e788c0 1 < suggested update operation key=71692MJQITX3 tag=8WX2P5WT3HAE type=del size=2644151 2024-03-09T14:37:02.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.483+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=TRJPUSR718A9 type=del size=644295 2024-03-09T14:37:02.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.487+0000 7fd389e788c0 1 < completed write operation key=IXKMXJ9IZ69S tag=2SW5WHAACDY4 type=write size=617702 2024-03-09T14:37:02.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.487+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=ZITHFWW10G88 type=del size=704658 2024-03-09T14:37:02.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.491+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~FWV1C6N43P75.0 size=1048576 2024-03-09T14:37:02.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.491+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~FWV1C6N43P75.1 size=995212 2024-03-09T14:37:02.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.495+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=FWV1C6N43P75 tag=0UMS69VL28V0 type=write size=3092364 2024-03-09T14:37:02.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.495+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=4AMZTTAMPGC3 type=del size=3683694 2024-03-09T14:37:02.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.499+0000 7fd389e788c0 1 < suggested update operation key=ACL1T9GW2JV9 tag=H32Z3WVNG5B0 type=del size=120954 2024-03-09T14:37:02.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.503+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~TGLBIFYD271Z.0 size=1048576 2024-03-09T14:37:02.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.507+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~TGLBIFYD271Z.1 size=1048576 2024-03-09T14:37:02.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.507+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~TGLBIFYD271Z.2 size=233874 2024-03-09T14:37:02.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.507+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=TGLBIFYD271Z tag=3XM546ZU6RO3 type=write size=3379602 2024-03-09T14:37:02.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.507+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=DXTV6FB8C68J type=del 2024-03-09T14:37:02.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.511+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=GXWPTDOXSVD5 type=del size=3050034 2024-03-09T14:37:02.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.511+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~KEPC03DR7FBI.0 size=1048576 2024-03-09T14:37:02.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.515+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~KEPC03DR7FBI.1 size=161402 2024-03-09T14:37:02.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.519+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=KEPC03DR7FBI tag=43NLWOXHHX82 type=write size=2258554 2024-03-09T14:37:02.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.519+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=YZCNR2XYTE06 type=del size=1291753 2024-03-09T14:37:02.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.523+0000 7fd389e788c0 1 < canceled operation key=2405Y4I2Q8TY tag=00K21Y3OJOGL type=del size=3136857 2024-03-09T14:37:02.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.523+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=7T2VS2ONAENZ type=del size=2659966 2024-03-09T14:37:02.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.527+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~V8GPYZK8MABZ.0 size=1048576 2024-03-09T14:37:02.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.527+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~V8GPYZK8MABZ.1 size=1048576 2024-03-09T14:37:02.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.531+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~V8GPYZK8MABZ.2 size=993997 2024-03-09T14:37:02.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.531+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=V8GPYZK8MABZ tag=09SZCOJI0897 type=write size=4139725 2024-03-09T14:37:02.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.535+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=I168US00VTYD type=del size=1116443 2024-03-09T14:37:02.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.535+0000 7fd389e788c0 1 < completed delete operation key=YR2VX4QLOCOG tag=VH0JV5FAM9TQ type=del 2024-03-09T14:37:02.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.539+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~D2C2EZA09LLM.0 size=524772 2024-03-09T14:37:02.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.539+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=D2C2EZA09LLM tag=MDHYX0BQ4UHQ type=write size=1573348 2024-03-09T14:37:02.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.543+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~U4D26M53YVXS.0 size=1048576 2024-03-09T14:37:02.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.543+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~U4D26M53YVXS.1 size=55243 2024-03-09T14:37:02.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.547+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=U4D26M53YVXS tag=WQMJMKFEH1GD type=write size=2152395 2024-03-09T14:37:02.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.551+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=WK36GBJNUKTD type=del size=3910200 2024-03-09T14:37:02.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.551+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~KDUC00MJSAT6.0 size=1048576 2024-03-09T14:37:02.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.555+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~KDUC00MJSAT6.1 size=1048576 2024-03-09T14:37:02.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.555+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~KDUC00MJSAT6.2 size=88239 2024-03-09T14:37:02.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.559+0000 7fd389e788c0 1 < completed multipart upload key=K9X2N6V8R4BY upload=KDUC00MJSAT6 tag=QWVZHRXTGZ7A type=write size=3233967 2024-03-09T14:37:02.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.563+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=HVDW74WLDEZR type=del size=339482 2024-03-09T14:37:02.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.563+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=FUS5IILCERQ1 type=del 2024-03-09T14:37:02.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.567+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~73Q1E7NEA2P2.0 size=1048576 2024-03-09T14:37:02.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.571+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~73Q1E7NEA2P2.1 size=65902 2024-03-09T14:37:02.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.571+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=73Q1E7NEA2P2 tag=UJZ433EQ64AR type=write size=2163054 2024-03-09T14:37:02.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.571+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=Y64G1X6JV0PZ type=del 2024-03-09T14:37:02.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.575+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~ETRXMYFETADY.0 size=1048576 2024-03-09T14:37:02.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.579+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~ETRXMYFETADY.1 size=645807 2024-03-09T14:37:02.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.579+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=ETRXMYFETADY tag=50MC9RLNYJIW type=write size=2742959 2024-03-09T14:37:02.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.579+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~Q91CXWRO2I9M.0 size=1048576 2024-03-09T14:37:02.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.583+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~Q91CXWRO2I9M.1 size=563711 2024-03-09T14:37:02.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.587+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=Q91CXWRO2I9M tag=0XGS44B4Q72Z type=write size=2660863 2024-03-09T14:37:02.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.587+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=IDD4TVLZM4YB type=del size=1525226 2024-03-09T14:37:02.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.591+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=XVGMRWM6GUUK type=del 2024-03-09T14:37:02.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.591+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=AWNMBXA2XMHD type=del size=870645 2024-03-09T14:37:02.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.595+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~NUNRF25ZIOPQ.0 size=197434 2024-03-09T14:37:02.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.599+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=NUNRF25ZIOPQ tag=91A1VT1CQHQP type=write size=1246010 2024-03-09T14:37:02.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.599+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=27T8KQ4OE2QH type=write size=654429 2024-03-09T14:37:02.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.603+0000 7fd389e788c0 1 < suggested remove operation key=MHT268M7S2TY tag=TRJPUSR718A9 type=del 2024-03-09T14:37:02.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.607+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~EP1WXFZWF4HM.0 size=982421 2024-03-09T14:37:02.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.607+0000 7fd389e788c0 1 > prepared multipart upload key=DIN8WJ9Z9OI8 upload=EP1WXFZWF4HM tag=M4HK89Y9K31E type=write size=2030997 2024-03-09T14:37:02.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.611+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=ZITHFWW10G88 type=del 2024-03-09T14:37:02.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.611+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=OMCYVF5CUEBF type=del size=1436419 2024-03-09T14:37:02.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.615+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=4AMZTTAMPGC3 type=del 2024-03-09T14:37:02.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.615+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=J161CVZBTVE0 type=del size=447310 2024-03-09T14:37:02.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.619+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~TGLBIFYD271Z.0 size=1048576 2024-03-09T14:37:02.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.619+0000 7fd389e788c0 1 < canceled part key=_multipart_5ZEDXFB9B3CN.2~TGLBIFYD271Z.1 size=1048576 2024-03-09T14:37:02.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.619+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~TGLBIFYD271Z.2 size=233874 2024-03-09T14:37:02.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.623+0000 7fd389e788c0 1 < canceled multipart upload key=5ZEDXFB9B3CN upload=TGLBIFYD271Z tag=3XM546ZU6RO3 type=write size=3379602 2024-03-09T14:37:02.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.627+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=ID1NQOF8MMA9 type=del size=2156340 2024-03-09T14:37:02.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.627+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=GXWPTDOXSVD5 type=del 2024-03-09T14:37:02.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.631+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=Z61ILZ7FJXWF type=del size=3154467 2024-03-09T14:37:02.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.631+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=YZCNR2XYTE06 type=del 2024-03-09T14:37:02.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.635+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=V8A5MJG2GLPX type=del size=797329 2024-03-09T14:37:02.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.639+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=7T2VS2ONAENZ type=del 2024-03-09T14:37:02.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.639+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=D172QCPOC3AB type=write size=612252 2024-03-09T14:37:02.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.643+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=I168US00VTYD type=del 2024-03-09T14:37:02.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.643+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=KIP39GVJH9R4 type=del size=3748166 2024-03-09T14:37:02.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.647+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~D2C2EZA09LLM.0 size=524772 2024-03-09T14:37:02.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.651+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=D2C2EZA09LLM tag=MDHYX0BQ4UHQ type=write size=1573348 2024-03-09T14:37:02.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.655+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=T95C8ZF0SVH6 type=write size=614006 2024-03-09T14:37:02.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.655+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=WK36GBJNUKTD type=del 2024-03-09T14:37:02.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.659+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=T2GOOW7PG3WG type=del size=1977065 2024-03-09T14:37:02.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.659+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=HVDW74WLDEZR type=del 2024-03-09T14:37:02.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.663+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~MF6UQF5P4G0C.0 size=1048576 2024-03-09T14:37:02.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.667+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~MF6UQF5P4G0C.1 size=1048576 2024-03-09T14:37:02.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.667+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~MF6UQF5P4G0C.2 size=995582 2024-03-09T14:37:02.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.667+0000 7fd389e788c0 1 > prepared multipart upload key=UMT7VKZ9R4IR upload=MF6UQF5P4G0C tag=K4AY1O1QCNJY type=write size=4141310 2024-03-09T14:37:02.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.671+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~73Q1E7NEA2P2.0 size=1048576 2024-03-09T14:37:02.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.671+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~73Q1E7NEA2P2.1 size=65902 2024-03-09T14:37:02.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.675+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=73Q1E7NEA2P2 tag=UJZ433EQ64AR type=write size=2163054 2024-03-09T14:37:02.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.679+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~QNXMBDB28CST.0 size=1048576 2024-03-09T14:37:02.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.679+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~QNXMBDB28CST.1 size=1048576 2024-03-09T14:37:02.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.683+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~QNXMBDB28CST.2 size=213284 2024-03-09T14:37:02.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.683+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=QNXMBDB28CST tag=ZZ2P9RNMVNJ9 type=write size=3359012 2024-03-09T14:37:02.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.683+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~ETRXMYFETADY.0 size=1048576 2024-03-09T14:37:02.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.687+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~ETRXMYFETADY.1 size=645807 2024-03-09T14:37:02.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.691+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=ETRXMYFETADY tag=50MC9RLNYJIW type=write size=2742959 2024-03-09T14:37:02.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.691+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=HM287J0JRAKD type=del size=1910638 2024-03-09T14:37:02.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.695+0000 7fd389e788c0 1 < suggested update operation key=Z18Q66VI5PDN tag=IDD4TVLZM4YB type=del size=1525226 2024-03-09T14:37:02.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.699+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=Y6CE6M08IPEG type=del size=2013800 2024-03-09T14:37:02.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.703+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=AWNMBXA2XMHD type=del 2024-03-09T14:37:02.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.703+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~73KV614CQ3KB.0 size=1048576 2024-03-09T14:37:02.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.707+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~73KV614CQ3KB.1 size=962937 2024-03-09T14:37:02.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.707+0000 7fd389e788c0 1 > prepared multipart upload key=DIN8WJ9Z9OI8 upload=73KV614CQ3KB tag=QFUQU5RAQA9J type=write size=3060089 2024-03-09T14:37:02.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.711+0000 7fd389e788c0 1 < suggested update operation key=1K5KR8U3GCOV tag=27T8KQ4OE2QH type=write size=654429 2024-03-09T14:37:02.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.711+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=842V0KWFB5QT type=del size=2614203 2024-03-09T14:37:02.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.715+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~EP1WXFZWF4HM.0 size=982421 2024-03-09T14:37:02.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.719+0000 7fd389e788c0 1 < completed multipart upload key=DIN8WJ9Z9OI8 upload=EP1WXFZWF4HM tag=M4HK89Y9K31E type=write size=2030997 2024-03-09T14:37:02.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.719+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=FKX02SZ2JL0M type=del size=3079791 2024-03-09T14:37:02.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.723+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=OMCYVF5CUEBF type=del 2024-03-09T14:37:02.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.723+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=UVP2PYKM2RXI type=write size=192005 2024-03-09T14:37:02.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.727+0000 7fd389e788c0 -1 < failed to complete operation key=Z18Q66VI5PDN tag=J161CVZBTVE0 type=del size=447310: (22) Invalid argument 2024-03-09T14:37:02.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.727+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=H2ROK1JBPP4W type=del size=3192901 2024-03-09T14:37:02.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.731+0000 7fd389e788c0 1 < suggested remove operation key=6VT4C288571G tag=ID1NQOF8MMA9 type=del 2024-03-09T14:37:02.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.735+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~7FBJ5FY6RPYI.0 size=1048576 2024-03-09T14:37:02.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.735+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~7FBJ5FY6RPYI.1 size=1048576 2024-03-09T14:37:02.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.739+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~7FBJ5FY6RPYI.2 size=574661 2024-03-09T14:37:02.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.739+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=7FBJ5FY6RPYI tag=2G739XM9SZNJ type=write size=3720389 2024-03-09T14:37:02.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.739+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=Z61ILZ7FJXWF type=del 2024-03-09T14:37:02.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.743+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=PRS7WHN4GL8I type=write size=535805 2024-03-09T14:37:02.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.743+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=V8A5MJG2GLPX type=del 2024-03-09T14:37:02.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.747+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~G2HYQ2LKUG3Q.0 size=1048576 2024-03-09T14:37:02.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.747+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~G2HYQ2LKUG3Q.1 size=565950 2024-03-09T14:37:02.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.747+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=G2HYQ2LKUG3Q tag=E25CPIUE7B3D type=write size=2663102 2024-03-09T14:37:02.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.751+0000 7fd389e788c0 1 < completed write operation key=MHT268M7S2TY tag=D172QCPOC3AB type=write size=612252 2024-03-09T14:37:02.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.751+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=6B2ROA589ADG type=write size=512577 2024-03-09T14:37:02.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.755+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=KIP39GVJH9R4 type=del 2024-03-09T14:37:02.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.755+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=3JFLP5EUIHKS type=del size=3842081 2024-03-09T14:37:02.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.759+0000 7fd389e788c0 1 < completed write operation key=DIN8WJ9Z9OI8 tag=T95C8ZF0SVH6 type=write size=614006 2024-03-09T14:37:02.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.763+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=2AJMO2D1OM0F type=del size=1581566 2024-03-09T14:37:02.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.767+0000 7fd389e788c0 1 < suggested update operation key=GSNWWDS63MTA tag=T2GOOW7PG3WG type=del size=1977065 2024-03-09T14:37:02.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.767+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=W7HC5SFQIWLA type=del size=1835741 2024-03-09T14:37:02.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.771+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~MF6UQF5P4G0C.0 size=1048576 2024-03-09T14:37:02.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.771+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~MF6UQF5P4G0C.1 size=1048576 2024-03-09T14:37:02.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.771+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~MF6UQF5P4G0C.2 size=995582 2024-03-09T14:37:02.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.775+0000 7fd389e788c0 1 < completed multipart upload key=UMT7VKZ9R4IR upload=MF6UQF5P4G0C tag=K4AY1O1QCNJY type=write size=4141310 2024-03-09T14:37:02.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.779+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=I2S94X7V9PP0 type=write size=843930 2024-03-09T14:37:02.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.779+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~QNXMBDB28CST.0 size=1048576 2024-03-09T14:37:02.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.783+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~QNXMBDB28CST.1 size=1048576 2024-03-09T14:37:02.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.783+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~QNXMBDB28CST.2 size=213284 2024-03-09T14:37:02.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.787+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=QNXMBDB28CST tag=ZZ2P9RNMVNJ9 type=write size=3359012 2024-03-09T14:37:02.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.787+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=J9D3EWCUKQC1 type=del size=2070483 2024-03-09T14:37:02.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.791+0000 7fd389e788c0 1 < completed delete operation key=DIN8WJ9Z9OI8 tag=HM287J0JRAKD type=del 2024-03-09T14:37:02.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.791+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=Z8GUZM1P3V63 type=del size=2885759 2024-03-09T14:37:02.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.795+0000 7fd389e788c0 -1 < failed to complete operation key=1K5KR8U3GCOV tag=Y6CE6M08IPEG type=del size=2013800: (22) Invalid argument 2024-03-09T14:37:02.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.795+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=6O6ZLCOARL0O type=del size=2613424 2024-03-09T14:37:02.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.799+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~73KV614CQ3KB.0 size=1048576 2024-03-09T14:37:02.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.799+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~73KV614CQ3KB.1 size=962937 2024-03-09T14:37:02.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.803+0000 7fd389e788c0 1 < completed multipart upload key=DIN8WJ9Z9OI8 upload=73KV614CQ3KB tag=QFUQU5RAQA9J type=write size=3060089 2024-03-09T14:37:02.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.807+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~DOXR447TE2X9.0 size=1048576 2024-03-09T14:37:02.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.807+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~DOXR447TE2X9.1 size=373673 2024-03-09T14:37:02.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.807+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=DOXR447TE2X9 tag=JG319LKEMO5R type=write size=2470825 2024-03-09T14:37:02.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.811+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=842V0KWFB5QT type=del 2024-03-09T14:37:02.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.815+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=EGBZH4JO1NU6 type=del size=4056808 2024-03-09T14:37:02.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.819+0000 7fd389e788c0 1 < suggested remove operation key=61RC3GUU437B tag=FKX02SZ2JL0M type=del 2024-03-09T14:37:02.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.819+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=WGO135WTZ1U6 type=del size=3439037 2024-03-09T14:37:02.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.823+0000 7fd389e788c0 1 < completed write operation key=PKVYD8DWS7M2 tag=UVP2PYKM2RXI type=write size=192005 2024-03-09T14:37:02.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.827+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~UTU9EW460JJL.0 size=1048576 2024-03-09T14:37:02.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.827+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~UTU9EW460JJL.1 size=1048576 2024-03-09T14:37:02.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.831+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~UTU9EW460JJL.2 size=378762 2024-03-09T14:37:02.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.831+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=UTU9EW460JJL tag=9ZIGLND688QN type=write size=3524490 2024-03-09T14:37:02.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.831+0000 7fd389e788c0 -1 < failed to complete operation key=61RC3GUU437B tag=H2ROK1JBPP4W type=del size=3192901: (22) Invalid argument 2024-03-09T14:37:02.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.835+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~ZIWZZEKL5LEX.0 size=739753 2024-03-09T14:37:02.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.835+0000 7fd389e788c0 1 > prepared multipart upload key=2405Y4I2Q8TY upload=ZIWZZEKL5LEX tag=G42GPFMXBGF5 type=write size=1788329 2024-03-09T14:37:02.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.835+0000 7fd389e788c0 1 < canceled part key=_multipart_FY02AR9GS3KG.2~7FBJ5FY6RPYI.0 size=1048576 2024-03-09T14:37:02.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.835+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~7FBJ5FY6RPYI.1 size=1048576 2024-03-09T14:37:02.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.839+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~7FBJ5FY6RPYI.2 size=574661 2024-03-09T14:37:02.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.843+0000 7fd389e788c0 1 < canceled multipart upload key=FY02AR9GS3KG upload=7FBJ5FY6RPYI tag=2G739XM9SZNJ type=write size=3720389 2024-03-09T14:37:02.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.843+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=X7XPUN9A3VTB type=del size=3842768 2024-03-09T14:37:02.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.847+0000 7fd389e788c0 1 < suggested remove operation key=2405Y4I2Q8TY tag=PRS7WHN4GL8I type=write 2024-03-09T14:37:02.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.851+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=3Q9CFQKOXEQP type=del size=1621485 2024-03-09T14:37:02.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.851+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~G2HYQ2LKUG3Q.0 size=1048576 2024-03-09T14:37:02.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.855+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~G2HYQ2LKUG3Q.1 size=565950 2024-03-09T14:37:02.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.855+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=G2HYQ2LKUG3Q tag=E25CPIUE7B3D type=write size=2663102 2024-03-09T14:37:02.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.859+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=RT70S14IG0S4 type=del size=2174905 2024-03-09T14:37:02.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.859+0000 7fd389e788c0 1 < canceled operation key=5ZEDXFB9B3CN tag=6B2ROA589ADG type=write size=512577 2024-03-09T14:37:02.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.863+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=R0JDUS2ZEDYA type=del size=3864565 2024-03-09T14:37:02.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.863+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=3JFLP5EUIHKS type=del 2024-03-09T14:37:02.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.867+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=KNBK17VDZH1A type=del size=3885150 2024-03-09T14:37:02.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.867+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=2AJMO2D1OM0F type=del 2024-03-09T14:37:02.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.871+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=CY57O48VFA8X type=write size=819477 2024-03-09T14:37:02.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.871+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=W7HC5SFQIWLA type=del 2024-03-09T14:37:02.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.875+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=BIQEW0H60Z1K type=del size=2530342 2024-03-09T14:37:02.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.875+0000 7fd389e788c0 1 < completed write operation key=Y7E2TLASJM9T tag=I2S94X7V9PP0 type=write size=843930 2024-03-09T14:37:02.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.879+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=6UECD3KQEZI9 type=del size=1133505 2024-03-09T14:37:02.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.883+0000 7fd389e788c0 1 < suggested update operation key=FLLUAY21DJ12 tag=J9D3EWCUKQC1 type=del size=2070483 2024-03-09T14:37:02.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.887+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~JUX5BSSDEDCU.0 size=887341 2024-03-09T14:37:02.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.887+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=JUX5BSSDEDCU tag=OA0VWP3L5KH5 type=write size=1935917 2024-03-09T14:37:02.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.891+0000 7fd389e788c0 1 < suggested remove operation key=1K5KR8U3GCOV tag=Z8GUZM1P3V63 type=del 2024-03-09T14:37:02.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.891+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=4M1IW7GI7N3N type=del size=2126571 2024-03-09T14:37:02.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.895+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=6O6ZLCOARL0O type=del 2024-03-09T14:37:02.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.895+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=BYZMQ7P5Q686 type=del size=996188 2024-03-09T14:37:02.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.899+0000 7fd389e788c0 1 < canceled part key=_multipart_PZJT6RWRJFIN.2~DOXR447TE2X9.0 size=1048576 2024-03-09T14:37:02.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.899+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~DOXR447TE2X9.1 size=373673 2024-03-09T14:37:02.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.903+0000 7fd389e788c0 1 < canceled multipart upload key=PZJT6RWRJFIN upload=DOXR447TE2X9 tag=JG319LKEMO5R type=write size=2470825 2024-03-09T14:37:02.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.907+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=V0YDV97RULWL type=del size=861818 2024-03-09T14:37:02.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.907+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=EGBZH4JO1NU6 type=del 2024-03-09T14:37:02.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.911+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=Z0H785EDTBRA type=del size=3662928 2024-03-09T14:37:02.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.915+0000 7fd389e788c0 1 < canceled operation key=K9X2N6V8R4BY tag=WGO135WTZ1U6 type=del size=3439037 2024-03-09T14:37:02.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.919+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~8XG7UR1WFTHA.0 size=1048576 2024-03-09T14:37:02.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.919+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~8XG7UR1WFTHA.1 size=1048576 2024-03-09T14:37:02.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.923+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~8XG7UR1WFTHA.2 size=507895 2024-03-09T14:37:02.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.923+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=8XG7UR1WFTHA tag=TNZTLERDYCLX type=write size=3653623 2024-03-09T14:37:02.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.923+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~UTU9EW460JJL.0 size=1048576 2024-03-09T14:37:02.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.927+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~UTU9EW460JJL.1 size=1048576 2024-03-09T14:37:02.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.927+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~UTU9EW460JJL.2 size=378762 2024-03-09T14:37:02.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.931+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=UTU9EW460JJL tag=9ZIGLND688QN type=write size=3524490 2024-03-09T14:37:02.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.935+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~ZZ197BYRQSP5.0 size=1048576 2024-03-09T14:37:02.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.939+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~ZZ197BYRQSP5.1 size=1048576 2024-03-09T14:37:02.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.939+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~ZZ197BYRQSP5.2 size=576739 2024-03-09T14:37:02.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.939+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=ZZ197BYRQSP5 tag=5RI4C27C4PJ0 type=write size=3722467 2024-03-09T14:37:02.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.943+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~ZIWZZEKL5LEX.0 size=739753 2024-03-09T14:37:02.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.947+0000 7fd389e788c0 1 < completed multipart upload key=2405Y4I2Q8TY upload=ZIWZZEKL5LEX tag=G42GPFMXBGF5 type=write size=1788329 2024-03-09T14:37:02.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.951+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~9R741UR3BP52.0 size=1048576 2024-03-09T14:37:02.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.951+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~9R741UR3BP52.1 size=759617 2024-03-09T14:37:02.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.951+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=9R741UR3BP52 tag=V9KP10D04U9E type=write size=2856769 2024-03-09T14:37:02.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.955+0000 7fd389e788c0 1 < canceled operation key=P83H9137MI7Y tag=X7XPUN9A3VTB type=del size=3842768 2024-03-09T14:37:02.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.959+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=HH2XFGGY6E7F type=del size=833256 2024-03-09T14:37:02.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.963+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=3Q9CFQKOXEQP type=del 2024-03-09T14:37:02.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.963+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=ORS2KQMK1643 type=del size=4074290 2024-03-09T14:37:02.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.967+0000 7fd389e788c0 1 < suggested remove operation key=2405Y4I2Q8TY tag=RT70S14IG0S4 type=del 2024-03-09T14:37:02.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.971+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=EO93H3UIICKQ type=del size=1727749 2024-03-09T14:37:02.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.971+0000 7fd389e788c0 -1 < failed to complete operation key=1K5KR8U3GCOV tag=R0JDUS2ZEDYA type=del size=3864565: (22) Invalid argument 2024-03-09T14:37:02.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.979+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~82V7SMX3EI5W.0 size=362283 2024-03-09T14:37:02.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.979+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=82V7SMX3EI5W tag=6O22P0Q2HYM4 type=write size=1410859 2024-03-09T14:37:02.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.979+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=KNBK17VDZH1A type=del 2024-03-09T14:37:02.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.983+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~4RK0U2TCN0BC.0 size=1048576 2024-03-09T14:37:02.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.987+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~4RK0U2TCN0BC.1 size=1048576 2024-03-09T14:37:02.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.987+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~4RK0U2TCN0BC.2 size=885086 2024-03-09T14:37:02.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.987+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=4RK0U2TCN0BC tag=P3Y5OY74H1U3 type=write size=4030814 2024-03-09T14:37:02.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.991+0000 7fd389e788c0 1 < completed write operation key=U8P5Q3D11MM6 tag=CY57O48VFA8X type=write size=819477 2024-03-09T14:37:02.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.995+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=GO89DW24W8IR type=del size=771090 2024-03-09T14:37:02.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:02.995+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=BIQEW0H60Z1K type=del 2024-03-09T14:37:03.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.003+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~0PJLF13TLW0D.0 size=1048576 2024-03-09T14:37:03.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.003+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~0PJLF13TLW0D.1 size=1048576 2024-03-09T14:37:03.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.003+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~0PJLF13TLW0D.2 size=473748 2024-03-09T14:37:03.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.003+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=0PJLF13TLW0D tag=T2XGK2LP9C4D type=write size=3619476 2024-03-09T14:37:03.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.011+0000 7fd389e788c0 1 < suggested remove operation key=5ZEDXFB9B3CN tag=6UECD3KQEZI9 type=del 2024-03-09T14:37:03.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.015+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~JMYNE76TP8XD.0 size=1048576 2024-03-09T14:37:03.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.015+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~JMYNE76TP8XD.1 size=1048576 2024-03-09T14:37:03.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.019+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~JMYNE76TP8XD.2 size=151314 2024-03-09T14:37:03.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.019+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=JMYNE76TP8XD tag=EXM4XOKK3M1D type=write size=3297042 2024-03-09T14:37:03.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.019+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~JUX5BSSDEDCU.0 size=887341 2024-03-09T14:37:03.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.023+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=JUX5BSSDEDCU tag=OA0VWP3L5KH5 type=write size=1935917 2024-03-09T14:37:03.026 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.027+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~BAYVAMH060B3.0 size=1048576 2024-03-09T14:37:03.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.027+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~BAYVAMH060B3.1 size=74429 2024-03-09T14:37:03.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.027+0000 7fd389e788c0 1 > prepared multipart upload key=DIN8WJ9Z9OI8 upload=BAYVAMH060B3 tag=7OKTFK5M1G17 type=write size=2171581 2024-03-09T14:37:03.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.027+0000 7fd389e788c0 1 < completed delete operation key=YR2VX4QLOCOG tag=4M1IW7GI7N3N type=del 2024-03-09T14:37:03.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.031+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~FHYFUFL732J6.0 size=1048576 2024-03-09T14:37:03.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.035+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~FHYFUFL732J6.1 size=1048576 2024-03-09T14:37:03.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.035+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~FHYFUFL732J6.2 size=810606 2024-03-09T14:37:03.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.035+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=FHYFUFL732J6 tag=M8SVPID4Y73P type=write size=3956334 2024-03-09T14:37:03.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.039+0000 7fd389e788c0 1 < completed delete operation key=E2VP0TJ37UX8 tag=BYZMQ7P5Q686 type=del 2024-03-09T14:37:03.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.039+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=X75PJ0D9G04T type=del size=33423 2024-03-09T14:37:03.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.043+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=V0YDV97RULWL type=del 2024-03-09T14:37:03.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.047+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~V1OPRWSVGMNG.0 size=1048576 2024-03-09T14:37:03.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.047+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~V1OPRWSVGMNG.1 size=1048576 2024-03-09T14:37:03.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.047+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~V1OPRWSVGMNG.2 size=83987 2024-03-09T14:37:03.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.047+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=V1OPRWSVGMNG tag=O1EBDCOPL460 type=write size=3229715 2024-03-09T14:37:03.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.051+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=Z0H785EDTBRA type=del 2024-03-09T14:37:03.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.051+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=2QTL3E347R2Q type=del size=3294497 2024-03-09T14:37:03.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.055+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~8XG7UR1WFTHA.0 size=1048576 2024-03-09T14:37:03.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.055+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~8XG7UR1WFTHA.1 size=1048576 2024-03-09T14:37:03.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.059+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~8XG7UR1WFTHA.2 size=507895 2024-03-09T14:37:03.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.063+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=8XG7UR1WFTHA tag=TNZTLERDYCLX type=write size=3653623 2024-03-09T14:37:03.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.063+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=INY84463O4HW type=del size=3939478 2024-03-09T14:37:03.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.063+0000 7fd389e788c0 1 < canceled part key=_multipart_61RC3GUU437B.2~ZZ197BYRQSP5.0 size=1048576 2024-03-09T14:37:03.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.067+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~ZZ197BYRQSP5.1 size=1048576 2024-03-09T14:37:03.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.067+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~ZZ197BYRQSP5.2 size=576739 2024-03-09T14:37:03.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.071+0000 7fd389e788c0 1 < canceled multipart upload key=61RC3GUU437B upload=ZZ197BYRQSP5 tag=5RI4C27C4PJ0 type=write size=3722467 2024-03-09T14:37:03.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.075+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~M6ZQDFSKSL8N.0 size=242481 2024-03-09T14:37:03.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.075+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=M6ZQDFSKSL8N tag=81POH0J11V7Z type=write size=1291057 2024-03-09T14:37:03.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.079+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~9R741UR3BP52.0 size=1048576 2024-03-09T14:37:03.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.079+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~9R741UR3BP52.1 size=759617 2024-03-09T14:37:03.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.083+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=9R741UR3BP52 tag=V9KP10D04U9E type=write size=2856769 2024-03-09T14:37:03.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.087+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~STOP8NLX31GA.0 size=1048576 2024-03-09T14:37:03.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.087+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~STOP8NLX31GA.1 size=1048576 2024-03-09T14:37:03.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.091+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~STOP8NLX31GA.2 size=797609 2024-03-09T14:37:03.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.091+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=STOP8NLX31GA tag=35YZGHYTBBRP type=write size=3943337 2024-03-09T14:37:03.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.091+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=HH2XFGGY6E7F type=del 2024-03-09T14:37:03.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.095+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~O7XY6TM33OI6.0 size=429282 2024-03-09T14:37:03.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.095+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=O7XY6TM33OI6 tag=XR72VHD3ANHF type=write size=1477858 2024-03-09T14:37:03.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.099+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=ORS2KQMK1643 type=del 2024-03-09T14:37:03.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.103+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~L3642FZOP1TJ.0 size=1048576 2024-03-09T14:37:03.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.103+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~L3642FZOP1TJ.1 size=546138 2024-03-09T14:37:03.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.103+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=L3642FZOP1TJ tag=SAAQ6UAGM90W type=write size=2643290 2024-03-09T14:37:03.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.107+0000 7fd389e788c0 1 < suggested remove operation key=UMT7VKZ9R4IR tag=EO93H3UIICKQ type=del 2024-03-09T14:37:03.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.111+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~V9366M3V08F2.0 size=1048576 2024-03-09T14:37:03.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.115+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~V9366M3V08F2.1 size=299949 2024-03-09T14:37:03.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.115+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=V9366M3V08F2 tag=7IOLO30O7N9T type=write size=2397101 2024-03-09T14:37:03.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.115+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~82V7SMX3EI5W.0 size=362283 2024-03-09T14:37:03.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.119+0000 7fd389e788c0 1 < completed multipart upload key=IXKMXJ9IZ69S upload=82V7SMX3EI5W tag=6O22P0Q2HYM4 type=write size=1410859 2024-03-09T14:37:03.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.123+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=WMWI5IE5NZ1S type=del size=584208 2024-03-09T14:37:03.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.123+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~4RK0U2TCN0BC.0 size=1048576 2024-03-09T14:37:03.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.123+0000 7fd389e788c0 1 < canceled part key=_multipart_1KJK6PF6U226.2~4RK0U2TCN0BC.1 size=1048576 2024-03-09T14:37:03.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.127+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~4RK0U2TCN0BC.2 size=885086 2024-03-09T14:37:03.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.131+0000 7fd389e788c0 1 < canceled multipart upload key=1KJK6PF6U226 upload=4RK0U2TCN0BC tag=P3Y5OY74H1U3 type=write size=4030814 2024-03-09T14:37:03.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.135+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=RW23AB57CL6E type=del size=3462506 2024-03-09T14:37:03.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.135+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=GO89DW24W8IR type=del 2024-03-09T14:37:03.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.139+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=7JYJ7RBBESRI type=del size=1031163 2024-03-09T14:37:03.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.139+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~0PJLF13TLW0D.0 size=1048576 2024-03-09T14:37:03.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.143+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~0PJLF13TLW0D.1 size=1048576 2024-03-09T14:37:03.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.143+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~0PJLF13TLW0D.2 size=473748 2024-03-09T14:37:03.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.147+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=0PJLF13TLW0D tag=T2XGK2LP9C4D type=write size=3619476 2024-03-09T14:37:03.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.151+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=XSQVXQME2202 type=del size=1842366 2024-03-09T14:37:03.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.155+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~JMYNE76TP8XD.0 size=1048576 2024-03-09T14:37:03.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.155+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~JMYNE76TP8XD.1 size=1048576 2024-03-09T14:37:03.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.159+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~JMYNE76TP8XD.2 size=151314 2024-03-09T14:37:03.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.163+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=JMYNE76TP8XD tag=EXM4XOKK3M1D type=write size=3297042 2024-03-09T14:37:03.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.167+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=UII6Q0M23UEG type=del size=1604873 2024-03-09T14:37:03.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.167+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~BAYVAMH060B3.0 size=1048576 2024-03-09T14:37:03.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.171+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~BAYVAMH060B3.1 size=74429 2024-03-09T14:37:03.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.175+0000 7fd389e788c0 1 < completed multipart upload key=DIN8WJ9Z9OI8 upload=BAYVAMH060B3 tag=7OKTFK5M1G17 type=write size=2171581 2024-03-09T14:37:03.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.175+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=NKE0N3I23HRX type=del size=3146530 2024-03-09T14:37:03.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.179+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~FHYFUFL732J6.0 size=1048576 2024-03-09T14:37:03.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.179+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~FHYFUFL732J6.1 size=1048576 2024-03-09T14:37:03.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.183+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~FHYFUFL732J6.2 size=810606 2024-03-09T14:37:03.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.183+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=FHYFUFL732J6 tag=M8SVPID4Y73P type=write size=3956334 2024-03-09T14:37:03.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.187+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=04QB52LGBWN8 type=del size=1833737 2024-03-09T14:37:03.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.191+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=X75PJ0D9G04T type=del 2024-03-09T14:37:03.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.191+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=DTNU0XH4V1TO type=del size=661880 2024-03-09T14:37:03.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.191+0000 7fd389e788c0 1 < canceled part key=_multipart_E2VP0TJ37UX8.2~V1OPRWSVGMNG.0 size=1048576 2024-03-09T14:37:03.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.195+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~V1OPRWSVGMNG.1 size=1048576 2024-03-09T14:37:03.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.195+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~V1OPRWSVGMNG.2 size=83987 2024-03-09T14:37:03.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.199+0000 7fd389e788c0 1 < canceled multipart upload key=E2VP0TJ37UX8 upload=V1OPRWSVGMNG tag=O1EBDCOPL460 type=write size=3229715 2024-03-09T14:37:03.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.203+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~EEHOACQI6JLW.0 size=360253 2024-03-09T14:37:03.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.203+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=EEHOACQI6JLW tag=T0GHBTKOK34M type=write size=1408829 2024-03-09T14:37:03.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.207+0000 7fd389e788c0 1 < suggested remove operation key=5ZEDXFB9B3CN tag=2QTL3E347R2Q type=del 2024-03-09T14:37:03.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.211+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=QWBFHJ3PY00C type=del size=2604752 2024-03-09T14:37:03.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.215+0000 7fd389e788c0 1 < suggested update operation key=PZJT6RWRJFIN tag=INY84463O4HW type=del size=3939478 2024-03-09T14:37:03.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.219+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~AG6LLYJWWL09.0 size=329929 2024-03-09T14:37:03.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.219+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=AG6LLYJWWL09 tag=N8J995NF2W24 type=write size=1378505 2024-03-09T14:37:03.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.219+0000 7fd389e788c0 1 < canceled part key=_multipart_MHT268M7S2TY.2~M6ZQDFSKSL8N.0 size=242481 2024-03-09T14:37:03.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.223+0000 7fd389e788c0 1 < canceled multipart upload key=MHT268M7S2TY upload=M6ZQDFSKSL8N tag=81POH0J11V7Z type=write size=1291057 2024-03-09T14:37:03.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.223+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=Z78QPQW5526X type=del size=2862728 2024-03-09T14:37:03.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.227+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~STOP8NLX31GA.0 size=1048576 2024-03-09T14:37:03.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.227+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~STOP8NLX31GA.1 size=1048576 2024-03-09T14:37:03.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.231+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~STOP8NLX31GA.2 size=797609 2024-03-09T14:37:03.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.235+0000 7fd389e788c0 1 < completed multipart upload key=Y7E2TLASJM9T upload=STOP8NLX31GA tag=35YZGHYTBBRP type=write size=3943337 2024-03-09T14:37:03.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.239+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~BZ9YU6Z2ZMRC.0 size=1048576 2024-03-09T14:37:03.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.243+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~BZ9YU6Z2ZMRC.1 size=1048576 2024-03-09T14:37:03.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.243+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~BZ9YU6Z2ZMRC.2 size=489168 2024-03-09T14:37:03.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.243+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=BZ9YU6Z2ZMRC tag=SHC9A43CG1ZO type=write size=3634896 2024-03-09T14:37:03.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.247+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~O7XY6TM33OI6.0 size=429282 2024-03-09T14:37:03.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.251+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=O7XY6TM33OI6 tag=XR72VHD3ANHF type=write size=1477858 2024-03-09T14:37:03.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.255+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=PVFMTS74NAYX type=del size=956724 2024-03-09T14:37:03.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.255+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~L3642FZOP1TJ.0 size=1048576 2024-03-09T14:37:03.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.259+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~L3642FZOP1TJ.1 size=546138 2024-03-09T14:37:03.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.263+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=L3642FZOP1TJ tag=SAAQ6UAGM90W type=write size=2643290 2024-03-09T14:37:03.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.267+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=K5SHDW10LD7K type=del size=2512754 2024-03-09T14:37:03.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.267+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~V9366M3V08F2.0 size=1048576 2024-03-09T14:37:03.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.271+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~V9366M3V08F2.1 size=299949 2024-03-09T14:37:03.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.275+0000 7fd389e788c0 1 < completed multipart upload key=IXKMXJ9IZ69S upload=V9366M3V08F2 tag=7IOLO30O7N9T type=write size=2397101 2024-03-09T14:37:03.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.279+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=IU66GERSI2NC type=del size=731103 2024-03-09T14:37:03.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.279+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=WMWI5IE5NZ1S type=del 2024-03-09T14:37:03.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.283+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=AMJN2QQG81F6 type=del size=2873921 2024-03-09T14:37:03.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.283+0000 7fd389e788c0 -1 < failed to complete operation key=PZJT6RWRJFIN tag=RW23AB57CL6E type=del size=3462506: (22) Invalid argument 2024-03-09T14:37:03.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.287+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~BB7WPOOQEF38.0 size=1048576 2024-03-09T14:37:03.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.291+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~BB7WPOOQEF38.1 size=1048576 2024-03-09T14:37:03.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.291+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~BB7WPOOQEF38.2 size=1001040 2024-03-09T14:37:03.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.291+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=BB7WPOOQEF38 tag=F6VULXFD3YYQ type=write size=4146768 2024-03-09T14:37:03.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.295+0000 7fd389e788c0 1 < canceled operation key=ACL1T9GW2JV9 tag=7JYJ7RBBESRI type=del size=1031163 2024-03-09T14:37:03.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.299+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~5F49Q8YETRJJ.0 size=1048576 2024-03-09T14:37:03.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.299+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~5F49Q8YETRJJ.1 size=740239 2024-03-09T14:37:03.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.299+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=5F49Q8YETRJJ tag=T1W9M6HD0NSK type=write size=2837391 2024-03-09T14:37:03.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.303+0000 7fd389e788c0 -1 < failed to complete operation key=PZJT6RWRJFIN tag=XSQVXQME2202 type=del size=1842366: (22) Invalid argument 2024-03-09T14:37:03.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.307+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=VUX27ZW9ZT1A type=del size=2897246 2024-03-09T14:37:03.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.307+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=UII6Q0M23UEG type=del 2024-03-09T14:37:03.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.311+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=6N4Q82STJ0Q4 type=del size=2024891 2024-03-09T14:37:03.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.311+0000 7fd389e788c0 1 < canceled operation key=1KJK6PF6U226 tag=NKE0N3I23HRX type=del size=3146530 2024-03-09T14:37:03.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.315+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=51QMK06J109B type=del size=1284631 2024-03-09T14:37:03.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.319+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=04QB52LGBWN8 type=del 2024-03-09T14:37:03.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.319+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=8XG5O8BBGQ9U type=del size=3939420 2024-03-09T14:37:03.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.323+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=DTNU0XH4V1TO type=del 2024-03-09T14:37:03.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.327+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~CPGVIQJXK6YF.0 size=245631 2024-03-09T14:37:03.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.327+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=CPGVIQJXK6YF tag=6PQM3AT5085B type=write size=1294207 2024-03-09T14:37:03.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.331+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~EEHOACQI6JLW.0 size=360253 2024-03-09T14:37:03.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.335+0000 7fd389e788c0 1 < completed multipart upload key=Y7E2TLASJM9T upload=EEHOACQI6JLW tag=T0GHBTKOK34M type=write size=1408829 2024-03-09T14:37:03.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.339+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=AW3R45ZU9UBU type=del size=271958 2024-03-09T14:37:03.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.339+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=QWBFHJ3PY00C type=del 2024-03-09T14:37:03.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.343+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=1HXYCT8BZ126 type=del size=1704673 2024-03-09T14:37:03.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.343+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~AG6LLYJWWL09.0 size=329929 2024-03-09T14:37:03.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.347+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=AG6LLYJWWL09 tag=N8J995NF2W24 type=write size=1378505 2024-03-09T14:37:03.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.355+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~FRZXAH9DWXN0.0 size=986893 2024-03-09T14:37:03.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.355+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=FRZXAH9DWXN0 tag=EUXWN53VS0FW type=write size=2035469 2024-03-09T14:37:03.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.355+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=Z78QPQW5526X type=del 2024-03-09T14:37:03.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.359+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~CORNLC1N8IS7.0 size=1048576 2024-03-09T14:37:03.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.363+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~CORNLC1N8IS7.1 size=647999 2024-03-09T14:37:03.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.363+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=CORNLC1N8IS7 tag=3YFAE6K0XL1D type=write size=2745151 2024-03-09T14:37:03.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.363+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~BZ9YU6Z2ZMRC.0 size=1048576 2024-03-09T14:37:03.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.363+0000 7fd389e788c0 1 < canceled part key=_multipart_PKVYD8DWS7M2.2~BZ9YU6Z2ZMRC.1 size=1048576 2024-03-09T14:37:03.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.367+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~BZ9YU6Z2ZMRC.2 size=489168 2024-03-09T14:37:03.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.371+0000 7fd389e788c0 1 < canceled multipart upload key=PKVYD8DWS7M2 upload=BZ9YU6Z2ZMRC tag=SHC9A43CG1ZO type=write size=3634896 2024-03-09T14:37:03.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.371+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=OBEK8506C8PZ type=del size=2912130 2024-03-09T14:37:03.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.375+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=PVFMTS74NAYX type=del 2024-03-09T14:37:03.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.379+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~D5HR5G5KIHCW.0 size=720331 2024-03-09T14:37:03.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.379+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=D5HR5G5KIHCW tag=20C5CEWMQ7XH type=write size=1768907 2024-03-09T14:37:03.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.383+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=K5SHDW10LD7K type=del 2024-03-09T14:37:03.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.387+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=CJNSFF4PMI1U type=del size=1516735 2024-03-09T14:37:03.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.391+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=IU66GERSI2NC type=del 2024-03-09T14:37:03.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.395+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~FM7VOQKC5M3D.0 size=1048576 2024-03-09T14:37:03.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.399+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~FM7VOQKC5M3D.1 size=1048576 2024-03-09T14:37:03.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.399+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~FM7VOQKC5M3D.2 size=138210 2024-03-09T14:37:03.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.399+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=FM7VOQKC5M3D tag=BD77GKK57RO9 type=write size=3283938 2024-03-09T14:37:03.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.403+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=AMJN2QQG81F6 type=del 2024-03-09T14:37:03.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.407+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~0PUT5YRJPBJS.0 size=177979 2024-03-09T14:37:03.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.407+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=0PUT5YRJPBJS tag=KTRK6A560OCZ type=write size=1226555 2024-03-09T14:37:03.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.411+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~BB7WPOOQEF38.0 size=1048576 2024-03-09T14:37:03.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.415+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~BB7WPOOQEF38.1 size=1048576 2024-03-09T14:37:03.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.415+0000 7fd389e788c0 1 < canceled part key=_multipart_I4NA328AI5T1.2~BB7WPOOQEF38.2 size=1001040 2024-03-09T14:37:03.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.419+0000 7fd389e788c0 1 < canceled multipart upload key=I4NA328AI5T1 upload=BB7WPOOQEF38 tag=F6VULXFD3YYQ type=write size=4146768 2024-03-09T14:37:03.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.423+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~13UBD5M604YZ.0 size=497769 2024-03-09T14:37:03.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.423+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=13UBD5M604YZ tag=3R470JKVCGOA type=write size=1546345 2024-03-09T14:37:03.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.427+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~5F49Q8YETRJJ.0 size=1048576 2024-03-09T14:37:03.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.431+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~5F49Q8YETRJJ.1 size=740239 2024-03-09T14:37:03.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.435+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=5F49Q8YETRJJ tag=T1W9M6HD0NSK type=write size=2837391 2024-03-09T14:37:03.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.439+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~FLCL8QDYF98E.0 size=1048576 2024-03-09T14:37:03.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.443+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~FLCL8QDYF98E.1 size=1048576 2024-03-09T14:37:03.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.443+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~FLCL8QDYF98E.2 size=551374 2024-03-09T14:37:03.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.443+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=FLCL8QDYF98E tag=8D9Q57HIPUF2 type=write size=3697102 2024-03-09T14:37:03.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.447+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=VUX27ZW9ZT1A type=del 2024-03-09T14:37:03.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.451+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~OFCH0UF15WF0.0 size=40258 2024-03-09T14:37:03.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.451+0000 7fd389e788c0 1 > prepared multipart upload key=2405Y4I2Q8TY upload=OFCH0UF15WF0 tag=0N1QTVUXIRW0 type=write size=1088834 2024-03-09T14:37:03.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.455+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=6N4Q82STJ0Q4 type=del 2024-03-09T14:37:03.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.459+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~OID81YXNHBK6.0 size=47942 2024-03-09T14:37:03.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.459+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=OID81YXNHBK6 tag=W5YZCYQXAXPZ type=write size=1096518 2024-03-09T14:37:03.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.467+0000 7fd389e788c0 1 < suggested remove operation key=IXKMXJ9IZ69S tag=51QMK06J109B type=del 2024-03-09T14:37:03.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.467+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=0YIYI1Z9D258 type=del size=2702943 2024-03-09T14:37:03.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.471+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=8XG5O8BBGQ9U type=del 2024-03-09T14:37:03.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.475+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~APCQDS7L7Z7T.0 size=1048576 2024-03-09T14:37:03.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.479+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~APCQDS7L7Z7T.1 size=16160 2024-03-09T14:37:03.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.479+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=APCQDS7L7Z7T tag=ZPFDELR6G72H type=write size=2113312 2024-03-09T14:37:03.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.483+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~CPGVIQJXK6YF.0 size=245631 2024-03-09T14:37:03.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.487+0000 7fd389e788c0 1 < completed multipart upload key=Y7E2TLASJM9T upload=CPGVIQJXK6YF tag=6PQM3AT5085B type=write size=1294207 2024-03-09T14:37:03.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.487+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=BA8GHK54K1PV type=del size=1099084 2024-03-09T14:37:03.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.491+0000 7fd389e788c0 1 < completed delete operation key=YR2VX4QLOCOG tag=AW3R45ZU9UBU type=del 2024-03-09T14:37:03.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.495+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~PJT1SM1JR8T4.0 size=1048576 2024-03-09T14:37:03.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.499+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~PJT1SM1JR8T4.1 size=1048576 2024-03-09T14:37:03.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.499+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~PJT1SM1JR8T4.2 size=666663 2024-03-09T14:37:03.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.499+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=PJT1SM1JR8T4 tag=1QBBTW0K3K1L type=write size=3812391 2024-03-09T14:37:03.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.503+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=1HXYCT8BZ126 type=del 2024-03-09T14:37:03.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.507+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=V12EIMN6RW7X type=del size=4037298 2024-03-09T14:37:03.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.511+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~FRZXAH9DWXN0.0 size=986893 2024-03-09T14:37:03.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.515+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=FRZXAH9DWXN0 tag=EUXWN53VS0FW type=write size=2035469 2024-03-09T14:37:03.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.519+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~IVOKH4F72IJC.0 size=1048576 2024-03-09T14:37:03.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.519+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~IVOKH4F72IJC.1 size=957561 2024-03-09T14:37:03.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.519+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=IVOKH4F72IJC tag=5NAH5QVG221I type=write size=3054713 2024-03-09T14:37:03.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.523+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~CORNLC1N8IS7.0 size=1048576 2024-03-09T14:37:03.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.527+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~CORNLC1N8IS7.1 size=647999 2024-03-09T14:37:03.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.531+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=CORNLC1N8IS7 tag=3YFAE6K0XL1D type=write size=2745151 2024-03-09T14:37:03.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.535+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=Z5GXI8HU2JC8 type=del size=3489649 2024-03-09T14:37:03.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.535+0000 7fd389e788c0 1 < canceled operation key=Z18Q66VI5PDN tag=OBEK8506C8PZ type=del size=2912130 2024-03-09T14:37:03.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.539+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=1XNGDS0Y5JVO type=del size=1346398 2024-03-09T14:37:03.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.543+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~D5HR5G5KIHCW.0 size=720331 2024-03-09T14:37:03.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.547+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=D5HR5G5KIHCW tag=20C5CEWMQ7XH type=write size=1768907 2024-03-09T14:37:03.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.551+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=BN1FZP34CLGC type=write size=529203 2024-03-09T14:37:03.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.551+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=CJNSFF4PMI1U type=del 2024-03-09T14:37:03.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.555+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~FZTL3Y2E5UF5.0 size=745834 2024-03-09T14:37:03.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.555+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=FZTL3Y2E5UF5 tag=IJPG5PL3I84V type=write size=1794410 2024-03-09T14:37:03.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.559+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~FM7VOQKC5M3D.0 size=1048576 2024-03-09T14:37:03.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.559+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~FM7VOQKC5M3D.1 size=1048576 2024-03-09T14:37:03.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.563+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~FM7VOQKC5M3D.2 size=138210 2024-03-09T14:37:03.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.567+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=FM7VOQKC5M3D tag=BD77GKK57RO9 type=write size=3283938 2024-03-09T14:37:03.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.571+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=C0OV73S1XXSU type=del size=1834331 2024-03-09T14:37:03.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.571+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~0PUT5YRJPBJS.0 size=177979 2024-03-09T14:37:03.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.575+0000 7fd389e788c0 1 < completed multipart upload key=E2VP0TJ37UX8 upload=0PUT5YRJPBJS tag=KTRK6A560OCZ type=write size=1226555 2024-03-09T14:37:03.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.579+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=DH6QFQY76G7P type=del size=2832830 2024-03-09T14:37:03.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.583+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~13UBD5M604YZ.0 size=497769 2024-03-09T14:37:03.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.587+0000 7fd389e788c0 1 < completed multipart upload key=8J6Z9DT07H0X upload=13UBD5M604YZ tag=3R470JKVCGOA type=write size=1546345 2024-03-09T14:37:03.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.591+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=93XVSY8F0NVO type=del size=3287416 2024-03-09T14:37:03.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.591+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~FLCL8QDYF98E.0 size=1048576 2024-03-09T14:37:03.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.595+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~FLCL8QDYF98E.1 size=1048576 2024-03-09T14:37:03.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.595+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~FLCL8QDYF98E.2 size=551374 2024-03-09T14:37:03.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.603+0000 7fd389e788c0 1 < completed multipart upload key=P83H9137MI7Y upload=FLCL8QDYF98E tag=8D9Q57HIPUF2 type=write size=3697102 2024-03-09T14:37:03.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.603+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=DE939ZGZQ2LD type=del size=3670287 2024-03-09T14:37:03.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.607+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~OFCH0UF15WF0.0 size=40258 2024-03-09T14:37:03.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.611+0000 7fd389e788c0 1 < completed multipart upload key=2405Y4I2Q8TY upload=OFCH0UF15WF0 tag=0N1QTVUXIRW0 type=write size=1088834 2024-03-09T14:37:03.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.615+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~GF7EKY6WUC1P.0 size=1048576 2024-03-09T14:37:03.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.619+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~GF7EKY6WUC1P.1 size=109540 2024-03-09T14:37:03.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.619+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=GF7EKY6WUC1P tag=632128OY1PJ0 type=write size=2206692 2024-03-09T14:37:03.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.619+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~OID81YXNHBK6.0 size=47942 2024-03-09T14:37:03.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.623+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=OID81YXNHBK6 tag=W5YZCYQXAXPZ type=write size=1096518 2024-03-09T14:37:03.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.627+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=LCVUXAANZRNR type=del size=2109440 2024-03-09T14:37:03.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.631+0000 7fd389e788c0 1 < suggested remove operation key=5ZEDXFB9B3CN tag=0YIYI1Z9D258 type=del 2024-03-09T14:37:03.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.635+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~UVZ5BEINJ3I5.0 size=1048576 2024-03-09T14:37:03.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.639+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~UVZ5BEINJ3I5.1 size=674235 2024-03-09T14:37:03.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.639+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=UVZ5BEINJ3I5 tag=UGO4KZESEX5Y type=write size=2771387 2024-03-09T14:37:03.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.639+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~APCQDS7L7Z7T.0 size=1048576 2024-03-09T14:37:03.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.643+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~APCQDS7L7Z7T.1 size=16160 2024-03-09T14:37:03.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.643+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=APCQDS7L7Z7T tag=ZPFDELR6G72H type=write size=2113312 2024-03-09T14:37:03.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.647+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=HRV6EZ138LLG type=del size=2320986 2024-03-09T14:37:03.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.651+0000 7fd389e788c0 1 < suggested remove operation key=I4NA328AI5T1 tag=BA8GHK54K1PV type=del 2024-03-09T14:37:03.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.651+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=CKZK0HPDP2GJ type=del size=1433136 2024-03-09T14:37:03.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.655+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~PJT1SM1JR8T4.0 size=1048576 2024-03-09T14:37:03.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.655+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~PJT1SM1JR8T4.1 size=1048576 2024-03-09T14:37:03.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.659+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~PJT1SM1JR8T4.2 size=666663 2024-03-09T14:37:03.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.663+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=PJT1SM1JR8T4 tag=1QBBTW0K3K1L type=write size=3812391 2024-03-09T14:37:03.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.663+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=H787GXZQPTBN type=write size=340674 2024-03-09T14:37:03.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.667+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=V12EIMN6RW7X type=del 2024-03-09T14:37:03.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.671+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~8YX5CH1N2W3R.0 size=1048576 2024-03-09T14:37:03.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.671+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~8YX5CH1N2W3R.1 size=152659 2024-03-09T14:37:03.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.671+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=8YX5CH1N2W3R tag=WFN81RQQK1E0 type=write size=2249811 2024-03-09T14:37:03.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.675+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~IVOKH4F72IJC.0 size=1048576 2024-03-09T14:37:03.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.675+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~IVOKH4F72IJC.1 size=957561 2024-03-09T14:37:03.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.679+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=IVOKH4F72IJC tag=5NAH5QVG221I type=write size=3054713 2024-03-09T14:37:03.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.683+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~A1ZJI243MK3Z.0 size=217246 2024-03-09T14:37:03.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.683+0000 7fd389e788c0 1 > prepared multipart upload key=GSNWWDS63MTA upload=A1ZJI243MK3Z tag=BOP0PKG1E69K type=write size=1265822 2024-03-09T14:37:03.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.687+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=Z5GXI8HU2JC8 type=del 2024-03-09T14:37:03.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.691+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=UGM7IV7LRTID type=del size=2269154 2024-03-09T14:37:03.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.691+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=1XNGDS0Y5JVO type=del 2024-03-09T14:37:03.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.695+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=TK3QDMTMV9HY type=del size=3981300 2024-03-09T14:37:03.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.695+0000 7fd389e788c0 1 < completed write operation key=1KJK6PF6U226 tag=BN1FZP34CLGC type=write size=529203 2024-03-09T14:37:03.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.699+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=F8PX8ILRZANH type=del size=1255960 2024-03-09T14:37:03.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.699+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~FZTL3Y2E5UF5.0 size=745834 2024-03-09T14:37:03.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.703+0000 7fd389e788c0 1 < completed multipart upload key=8J6Z9DT07H0X upload=FZTL3Y2E5UF5 tag=IJPG5PL3I84V type=write size=1794410 2024-03-09T14:37:03.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.707+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~R9ODG3V5P89F.0 size=1048576 2024-03-09T14:37:03.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.707+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~R9ODG3V5P89F.1 size=992842 2024-03-09T14:37:03.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.707+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=R9ODG3V5P89F tag=Y3RMXP6P44TX type=write size=3089994 2024-03-09T14:37:03.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.711+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=C0OV73S1XXSU type=del 2024-03-09T14:37:03.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.711+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=8ZUW3XKC7KU2 type=del size=429111 2024-03-09T14:37:03.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.715+0000 7fd389e788c0 1 < suggested update operation key=E65PFNHJQHEO tag=DH6QFQY76G7P type=del size=2832830 2024-03-09T14:37:03.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.719+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~6HPAQ77YQNCF.0 size=1048576 2024-03-09T14:37:03.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.723+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~6HPAQ77YQNCF.1 size=1048576 2024-03-09T14:37:03.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.723+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~6HPAQ77YQNCF.2 size=21059 2024-03-09T14:37:03.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.723+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=6HPAQ77YQNCF tag=CQNNGSCPAQHP type=write size=3166787 2024-03-09T14:37:03.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.727+0000 7fd389e788c0 -1 < failed to complete operation key=E65PFNHJQHEO tag=93XVSY8F0NVO type=del size=3287416: (22) Invalid argument 2024-03-09T14:37:03.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.731+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=KWS5V9KOFBDC type=del size=3020904 2024-03-09T14:37:03.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.731+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=DE939ZGZQ2LD type=del 2024-03-09T14:37:03.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.735+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~U5J4NFQ3YW4V.0 size=1048576 2024-03-09T14:37:03.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.735+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~U5J4NFQ3YW4V.1 size=614015 2024-03-09T14:37:03.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.735+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=U5J4NFQ3YW4V tag=QOF3UQAAQ2SJ type=write size=2711167 2024-03-09T14:37:03.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.739+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~GF7EKY6WUC1P.0 size=1048576 2024-03-09T14:37:03.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.743+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~GF7EKY6WUC1P.1 size=109540 2024-03-09T14:37:03.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.747+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=GF7EKY6WUC1P tag=632128OY1PJ0 type=write size=2206692 2024-03-09T14:37:03.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.751+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~N71A6GU3B3T4.0 size=83537 2024-03-09T14:37:03.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.751+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=N71A6GU3B3T4 tag=S1N6PXFKEKNO type=write size=1132113 2024-03-09T14:37:03.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.751+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=LCVUXAANZRNR type=del 2024-03-09T14:37:03.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.755+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=7D5FBKZQL8AC type=del size=1033270 2024-03-09T14:37:03.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.759+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~UVZ5BEINJ3I5.0 size=1048576 2024-03-09T14:37:03.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.759+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~UVZ5BEINJ3I5.1 size=674235 2024-03-09T14:37:03.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.763+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=UVZ5BEINJ3I5 tag=UGO4KZESEX5Y type=write size=2771387 2024-03-09T14:37:03.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.767+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=WM20QADJ4VG0 type=del size=706502 2024-03-09T14:37:03.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.767+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=HRV6EZ138LLG type=del 2024-03-09T14:37:03.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.771+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=P3OKM3KDSNK6 type=del size=3709069 2024-03-09T14:37:03.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.775+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=CKZK0HPDP2GJ type=del 2024-03-09T14:37:03.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.779+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~KS8636KUNOMJ.0 size=1048576 2024-03-09T14:37:03.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.779+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~KS8636KUNOMJ.1 size=570308 2024-03-09T14:37:03.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.779+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=KS8636KUNOMJ tag=RTFLAO43LVP9 type=write size=2667460 2024-03-09T14:37:03.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.783+0000 7fd389e788c0 1 < completed write operation key=I4NA328AI5T1 tag=H787GXZQPTBN type=write size=340674 2024-03-09T14:37:03.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.787+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=8CLVIH08ZI0I type=del size=3553285 2024-03-09T14:37:03.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.787+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~8YX5CH1N2W3R.0 size=1048576 2024-03-09T14:37:03.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.791+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~8YX5CH1N2W3R.1 size=152659 2024-03-09T14:37:03.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.795+0000 7fd389e788c0 1 < completed multipart upload key=P83H9137MI7Y upload=8YX5CH1N2W3R tag=WFN81RQQK1E0 type=write size=2249811 2024-03-09T14:37:03.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.799+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=F44P47SNRBSK type=del size=3440005 2024-03-09T14:37:03.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.803+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~A1ZJI243MK3Z.0 size=217246 2024-03-09T14:37:03.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.807+0000 7fd389e788c0 1 < completed multipart upload key=GSNWWDS63MTA upload=A1ZJI243MK3Z tag=BOP0PKG1E69K type=write size=1265822 2024-03-09T14:37:03.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.815+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~XAAD2476Z7ZH.0 size=649219 2024-03-09T14:37:03.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.815+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=XAAD2476Z7ZH tag=TDK8NQ3HUZ7R type=write size=1697795 2024-03-09T14:37:03.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.819+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=UGM7IV7LRTID type=del 2024-03-09T14:37:03.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.823+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=76IEU1DMSGA2 type=del size=1586645 2024-03-09T14:37:03.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.823+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=TK3QDMTMV9HY type=del 2024-03-09T14:37:03.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.831+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~9T5E6G1PP6R9.0 size=1048576 2024-03-09T14:37:03.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.831+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~9T5E6G1PP6R9.1 size=260359 2024-03-09T14:37:03.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.831+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=9T5E6G1PP6R9 tag=9W1H4VLZJ53S type=write size=2357511 2024-03-09T14:37:03.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.835+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=F8PX8ILRZANH type=del 2024-03-09T14:37:03.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.839+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=PR9JFLW7S80N type=del size=2932897 2024-03-09T14:37:03.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.843+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~R9ODG3V5P89F.0 size=1048576 2024-03-09T14:37:03.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.847+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~R9ODG3V5P89F.1 size=992842 2024-03-09T14:37:03.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.851+0000 7fd389e788c0 1 < completed multipart upload key=E2VP0TJ37UX8 upload=R9ODG3V5P89F tag=Y3RMXP6P44TX type=write size=3089994 2024-03-09T14:37:03.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.855+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~GMJICWBVHUWU.0 size=1048576 2024-03-09T14:37:03.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.859+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~GMJICWBVHUWU.1 size=1017890 2024-03-09T14:37:03.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.859+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=GMJICWBVHUWU tag=6FFAZC2RHGNX type=write size=3115042 2024-03-09T14:37:03.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.863+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=8ZUW3XKC7KU2 type=del 2024-03-09T14:37:03.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.863+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=0U5OLYGK3WNS type=del size=1263823 2024-03-09T14:37:03.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.871+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~6HPAQ77YQNCF.0 size=1048576 2024-03-09T14:37:03.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.871+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~6HPAQ77YQNCF.1 size=1048576 2024-03-09T14:37:03.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.875+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~6HPAQ77YQNCF.2 size=21059 2024-03-09T14:37:03.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.879+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=6HPAQ77YQNCF tag=CQNNGSCPAQHP type=write size=3166787 2024-03-09T14:37:03.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.887+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~QOFIUL9FEVUU.0 size=1048576 2024-03-09T14:37:03.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.887+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~QOFIUL9FEVUU.1 size=1048576 2024-03-09T14:37:03.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.891+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~QOFIUL9FEVUU.2 size=665186 2024-03-09T14:37:03.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.891+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=QOFIUL9FEVUU tag=L34PR93DJ23Q type=write size=3810914 2024-03-09T14:37:03.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.891+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=KWS5V9KOFBDC type=del 2024-03-09T14:37:03.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.899+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~NNZXLP4A0K78.0 size=1048576 2024-03-09T14:37:03.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.899+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~NNZXLP4A0K78.1 size=209168 2024-03-09T14:37:03.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.899+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=NNZXLP4A0K78 tag=HL3WUT92JT41 type=write size=2306320 2024-03-09T14:37:03.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.903+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~U5J4NFQ3YW4V.0 size=1048576 2024-03-09T14:37:03.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.907+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~U5J4NFQ3YW4V.1 size=614015 2024-03-09T14:37:03.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.911+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=U5J4NFQ3YW4V tag=QOF3UQAAQ2SJ type=write size=2711167 2024-03-09T14:37:03.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.911+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=WM27VBU8NUKC type=del size=20854 2024-03-09T14:37:03.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.915+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~N71A6GU3B3T4.0 size=83537 2024-03-09T14:37:03.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.919+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=N71A6GU3B3T4 tag=S1N6PXFKEKNO type=write size=1132113 2024-03-09T14:37:03.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.923+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=B988227G27IN type=write size=290318 2024-03-09T14:37:03.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.927+0000 7fd389e788c0 1 < canceled operation key=1KJK6PF6U226 tag=7D5FBKZQL8AC type=del size=1033270 2024-03-09T14:37:03.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.931+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~XHPK9HVQ7IO8.0 size=1048576 2024-03-09T14:37:03.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.935+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~XHPK9HVQ7IO8.1 size=1048576 2024-03-09T14:37:03.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.935+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~XHPK9HVQ7IO8.2 size=784743 2024-03-09T14:37:03.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.935+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=XHPK9HVQ7IO8 tag=PHSB9VA7D014 type=write size=3930471 2024-03-09T14:37:03.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.939+0000 7fd389e788c0 1 < canceled operation key=P83H9137MI7Y tag=WM20QADJ4VG0 type=del size=706502 2024-03-09T14:37:03.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.943+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~UM0J2C862ABU.0 size=1048576 2024-03-09T14:37:03.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.947+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~UM0J2C862ABU.1 size=744771 2024-03-09T14:37:03.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.947+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=UM0J2C862ABU tag=GYQQORAD2RM2 type=write size=2841923 2024-03-09T14:37:03.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.947+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=P3OKM3KDSNK6 type=del 2024-03-09T14:37:03.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.951+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~WKBIJWDGTP50.0 size=1048576 2024-03-09T14:37:03.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.955+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~WKBIJWDGTP50.1 size=35992 2024-03-09T14:37:03.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.955+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=WKBIJWDGTP50 tag=5FKMKPIX8TWZ type=write size=2133144 2024-03-09T14:37:03.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.955+0000 7fd389e788c0 1 < canceled part key=_multipart_5ZEDXFB9B3CN.2~KS8636KUNOMJ.0 size=1048576 2024-03-09T14:37:03.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.955+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~KS8636KUNOMJ.1 size=570308 2024-03-09T14:37:03.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.959+0000 7fd389e788c0 1 < canceled multipart upload key=5ZEDXFB9B3CN upload=KS8636KUNOMJ tag=RTFLAO43LVP9 type=write size=2667460 2024-03-09T14:37:03.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.963+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=I2IPXM460J3D type=del size=328777 2024-03-09T14:37:03.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.967+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=8CLVIH08ZI0I type=del 2024-03-09T14:37:03.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.971+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~9N688EC7FC3P.0 size=1048576 2024-03-09T14:37:03.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.971+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~9N688EC7FC3P.1 size=1048576 2024-03-09T14:37:03.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.975+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~9N688EC7FC3P.2 size=738523 2024-03-09T14:37:03.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.975+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=9N688EC7FC3P tag=0665R4OTJEQR type=write size=3884251 2024-03-09T14:37:03.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.979+0000 7fd389e788c0 1 < suggested update operation key=6VT4C288571G tag=F44P47SNRBSK type=del size=3440005 2024-03-09T14:37:03.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.983+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=S217DDXSQSTR type=del size=2599578 2024-03-09T14:37:03.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.983+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~XAAD2476Z7ZH.0 size=649219 2024-03-09T14:37:03.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.987+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=XAAD2476Z7ZH tag=TDK8NQ3HUZ7R type=write size=1697795 2024-03-09T14:37:03.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.991+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=C0XBN3V3Z1X5 type=write size=519058 2024-03-09T14:37:03.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.995+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=76IEU1DMSGA2 type=del 2024-03-09T14:37:03.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.995+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=CD2H1V16ISB9 type=del size=631342 2024-03-09T14:37:03.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.999+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~9T5E6G1PP6R9.0 size=1048576 2024-03-09T14:37:03.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:03.999+0000 7fd389e788c0 1 < canceled part key=_multipart_61RC3GUU437B.2~9T5E6G1PP6R9.1 size=260359 2024-03-09T14:37:04.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.003+0000 7fd389e788c0 1 < canceled multipart upload key=61RC3GUU437B upload=9T5E6G1PP6R9 tag=9W1H4VLZJ53S type=write size=2357511 2024-03-09T14:37:04.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.007+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=2RCOX41EE0H0 type=del size=491735 2024-03-09T14:37:04.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.007+0000 7fd389e788c0 -1 < failed to complete operation key=6VT4C288571G tag=PR9JFLW7S80N type=del size=2932897: (22) Invalid argument 2024-03-09T14:37:04.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.011+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~VB4LSKVL408P.0 size=1048576 2024-03-09T14:37:04.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.015+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~VB4LSKVL408P.1 size=1048576 2024-03-09T14:37:04.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.015+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~VB4LSKVL408P.2 size=306670 2024-03-09T14:37:04.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.015+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=VB4LSKVL408P tag=6TSOLKD0C324 type=write size=3452398 2024-03-09T14:37:04.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.015+0000 7fd389e788c0 1 < canceled part key=_multipart_1KJK6PF6U226.2~GMJICWBVHUWU.0 size=1048576 2024-03-09T14:37:04.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.019+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~GMJICWBVHUWU.1 size=1017890 2024-03-09T14:37:04.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.023+0000 7fd389e788c0 1 < canceled multipart upload key=1KJK6PF6U226 upload=GMJICWBVHUWU tag=6FFAZC2RHGNX type=write size=3115042 2024-03-09T14:37:04.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.027+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~B75E2LKP4JTU.0 size=1048576 2024-03-09T14:37:04.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.031+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~B75E2LKP4JTU.1 size=196703 2024-03-09T14:37:04.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.031+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=B75E2LKP4JTU tag=7VYEKK23HBGD type=write size=2293855 2024-03-09T14:37:04.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.031+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=0U5OLYGK3WNS type=del 2024-03-09T14:37:04.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.035+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=PPB5T1AFZFGC type=del size=2977971 2024-03-09T14:37:04.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.039+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~QOFIUL9FEVUU.0 size=1048576 2024-03-09T14:37:04.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.039+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~QOFIUL9FEVUU.1 size=1048576 2024-03-09T14:37:04.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.039+0000 7fd389e788c0 1 < canceled part key=_multipart_8J6Z9DT07H0X.2~QOFIUL9FEVUU.2 size=665186 2024-03-09T14:37:04.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.047+0000 7fd389e788c0 1 < canceled multipart upload key=8J6Z9DT07H0X upload=QOFIUL9FEVUU tag=L34PR93DJ23Q type=write size=3810914 2024-03-09T14:37:04.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.051+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~RUXG8BGF8408.0 size=411228 2024-03-09T14:37:04.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.051+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=RUXG8BGF8408 tag=9HB7GBQF9179 type=write size=1459804 2024-03-09T14:37:04.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.055+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~NNZXLP4A0K78.0 size=1048576 2024-03-09T14:37:04.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.055+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~NNZXLP4A0K78.1 size=209168 2024-03-09T14:37:04.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.059+0000 7fd389e788c0 1 < completed multipart upload key=Y7E2TLASJM9T upload=NNZXLP4A0K78 tag=HL3WUT92JT41 type=write size=2306320 2024-03-09T14:37:04.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.063+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=L0R8OBEJTHYH type=del size=1269993 2024-03-09T14:37:04.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.063+0000 7fd389e788c0 1 < canceled operation key=K9X2N6V8R4BY tag=WM27VBU8NUKC type=del size=20854 2024-03-09T14:37:04.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.067+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=4G1YM55O0VR6 type=del size=1020894 2024-03-09T14:37:04.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.071+0000 7fd389e788c0 1 < completed write operation key=K9X2N6V8R4BY tag=B988227G27IN type=write size=290318 2024-03-09T14:37:04.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.071+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=F0SQ8FEQVQJC type=write size=176902 2024-03-09T14:37:04.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.075+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~XHPK9HVQ7IO8.0 size=1048576 2024-03-09T14:37:04.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.079+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~XHPK9HVQ7IO8.1 size=1048576 2024-03-09T14:37:04.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.079+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~XHPK9HVQ7IO8.2 size=784743 2024-03-09T14:37:04.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.083+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=XHPK9HVQ7IO8 tag=PHSB9VA7D014 type=write size=3930471 2024-03-09T14:37:04.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.087+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=FXH70YBZUWZR type=del size=3865628 2024-03-09T14:37:04.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.091+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~UM0J2C862ABU.0 size=1048576 2024-03-09T14:37:04.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.091+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~UM0J2C862ABU.1 size=744771 2024-03-09T14:37:04.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.099+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=UM0J2C862ABU tag=GYQQORAD2RM2 type=write size=2841923 2024-03-09T14:37:04.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.099+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=M0S4J348RSSR type=del size=428165 2024-03-09T14:37:04.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.103+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~WKBIJWDGTP50.0 size=1048576 2024-03-09T14:37:04.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.107+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~WKBIJWDGTP50.1 size=35992 2024-03-09T14:37:04.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.111+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=WKBIJWDGTP50 tag=5FKMKPIX8TWZ type=write size=2133144 2024-03-09T14:37:04.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.115+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=VWUX4KI332OW type=del size=1759894 2024-03-09T14:37:04.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.119+0000 7fd389e788c0 1 < suggested remove operation key=FY02AR9GS3KG tag=I2IPXM460J3D type=del 2024-03-09T14:37:04.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.123+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=FZYFPQENGM81 type=write size=681633 2024-03-09T14:37:04.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.123+0000 7fd389e788c0 1 < canceled part key=_multipart_1KJK6PF6U226.2~9N688EC7FC3P.0 size=1048576 2024-03-09T14:37:04.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.127+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~9N688EC7FC3P.1 size=1048576 2024-03-09T14:37:04.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.127+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~9N688EC7FC3P.2 size=738523 2024-03-09T14:37:04.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.131+0000 7fd389e788c0 1 < canceled multipart upload key=1KJK6PF6U226 upload=9N688EC7FC3P tag=0665R4OTJEQR type=write size=3884251 2024-03-09T14:37:04.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.139+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~51JNM1ZKTDQU.0 size=1048576 2024-03-09T14:37:04.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.139+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~51JNM1ZKTDQU.1 size=972438 2024-03-09T14:37:04.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.139+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=51JNM1ZKTDQU tag=R3OOYZUR0G4Y type=write size=3069590 2024-03-09T14:37:04.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.147+0000 7fd389e788c0 1 < suggested update operation key=Y7E2TLASJM9T tag=S217DDXSQSTR type=del size=2599578 2024-03-09T14:37:04.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.151+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=L33VWPZGT95Y type=del size=2235824 2024-03-09T14:37:04.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.151+0000 7fd389e788c0 1 < completed write operation key=61RC3GUU437B tag=C0XBN3V3Z1X5 type=write size=519058 2024-03-09T14:37:04.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.159+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~4PO9NPKSWBQD.0 size=1048576 2024-03-09T14:37:04.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.159+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~4PO9NPKSWBQD.1 size=1048576 2024-03-09T14:37:04.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.163+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~4PO9NPKSWBQD.2 size=864021 2024-03-09T14:37:04.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.163+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=4PO9NPKSWBQD tag=DVXC9NF5WK9M type=write size=4009749 2024-03-09T14:37:04.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.163+0000 7fd389e788c0 1 < canceled operation key=71692MJQITX3 tag=CD2H1V16ISB9 type=del size=631342 2024-03-09T14:37:04.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.167+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=QGNNGXTH9LW9 type=del size=3275598 2024-03-09T14:37:04.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.171+0000 7fd389e788c0 1 < canceled operation key=CLAM83TC7RZ7 tag=2RCOX41EE0H0 type=del size=491735 2024-03-09T14:37:04.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.175+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~O7O9J7IU1OKF.0 size=760772 2024-03-09T14:37:04.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.175+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=O7O9J7IU1OKF tag=JKJSX8W5HZYM type=write size=1809348 2024-03-09T14:37:04.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.175+0000 7fd389e788c0 1 < canceled part key=_multipart_ACL1T9GW2JV9.2~VB4LSKVL408P.0 size=1048576 2024-03-09T14:37:04.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.179+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~VB4LSKVL408P.1 size=1048576 2024-03-09T14:37:04.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.179+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~VB4LSKVL408P.2 size=306670 2024-03-09T14:37:04.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.187+0000 7fd389e788c0 1 < canceled multipart upload key=ACL1T9GW2JV9 upload=VB4LSKVL408P tag=6TSOLKD0C324 type=write size=3452398 2024-03-09T14:37:04.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.191+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=442HV7F4VF25 type=del size=3672020 2024-03-09T14:37:04.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.191+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~B75E2LKP4JTU.0 size=1048576 2024-03-09T14:37:04.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.195+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~B75E2LKP4JTU.1 size=196703 2024-03-09T14:37:04.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.199+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=B75E2LKP4JTU tag=7VYEKK23HBGD type=write size=2293855 2024-03-09T14:37:04.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.207+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~XEDPX3JWGSDF.0 size=1048576 2024-03-09T14:37:04.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.207+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~XEDPX3JWGSDF.1 size=474665 2024-03-09T14:37:04.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.207+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=XEDPX3JWGSDF tag=WHGWO9AI274V type=write size=2571817 2024-03-09T14:37:04.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.211+0000 7fd389e788c0 1 < completed delete operation key=E2VP0TJ37UX8 tag=PPB5T1AFZFGC type=del 2024-03-09T14:37:04.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.215+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=OABHK6LHX8TA type=del size=3127245 2024-03-09T14:37:04.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.219+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~RUXG8BGF8408.0 size=411228 2024-03-09T14:37:04.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.223+0000 7fd389e788c0 1 < completed multipart upload key=8J6Z9DT07H0X upload=RUXG8BGF8408 tag=9HB7GBQF9179 type=write size=1459804 2024-03-09T14:37:04.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.223+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=ST32TFSVB82L type=del size=2003972 2024-03-09T14:37:04.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.227+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=L0R8OBEJTHYH type=del 2024-03-09T14:37:04.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.231+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~6RQ1RXXHR337.0 size=1048576 2024-03-09T14:37:04.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.235+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~6RQ1RXXHR337.1 size=1018697 2024-03-09T14:37:04.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.235+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=6RQ1RXXHR337 tag=NH3X3CKV3GC3 type=write size=3115849 2024-03-09T14:37:04.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.243+0000 7fd389e788c0 1 < suggested update operation key=U8P5Q3D11MM6 tag=4G1YM55O0VR6 type=del size=1020894 2024-03-09T14:37:04.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.247+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=YQRAOVKZ09WK type=del size=1129059 2024-03-09T14:37:04.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.251+0000 7fd389e788c0 1 < completed write operation key=AUSZ4JUGI6UU tag=F0SQ8FEQVQJC type=write size=176902 2024-03-09T14:37:04.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.251+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=NDOUJTHOOEA2 type=write size=282446 2024-03-09T14:37:04.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.255+0000 7fd389e788c0 1 < completed delete operation key=YR2VX4QLOCOG tag=FXH70YBZUWZR type=del 2024-03-09T14:37:04.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.259+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=AMVDMGMG26PG type=del size=781533 2024-03-09T14:37:04.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.263+0000 7fd389e788c0 1 < completed delete operation key=DIN8WJ9Z9OI8 tag=M0S4J348RSSR type=del 2024-03-09T14:37:04.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.263+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=1U6AOOOH6CJ6 type=del size=2354449 2024-03-09T14:37:04.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.267+0000 7fd389e788c0 1 < canceled operation key=PZJT6RWRJFIN tag=VWUX4KI332OW type=del size=1759894 2024-03-09T14:37:04.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.275+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~OFCDJJT3UKA1.0 size=1048576 2024-03-09T14:37:04.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.275+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~OFCDJJT3UKA1.1 size=311582 2024-03-09T14:37:04.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.275+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=OFCDJJT3UKA1 tag=YLQHG8EI2466 type=write size=2408734 2024-03-09T14:37:04.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.283+0000 7fd389e788c0 1 < suggested update operation key=CLAM83TC7RZ7 tag=FZYFPQENGM81 type=write size=681633 2024-03-09T14:37:04.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.283+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=4CUXSFWD57E1 type=write size=432860 2024-03-09T14:37:04.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.287+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~51JNM1ZKTDQU.0 size=1048576 2024-03-09T14:37:04.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.291+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~51JNM1ZKTDQU.1 size=972438 2024-03-09T14:37:04.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.295+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=51JNM1ZKTDQU tag=R3OOYZUR0G4Y type=write size=3069590 2024-03-09T14:37:04.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.299+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~PH4Q7E19K2WR.0 size=1048576 2024-03-09T14:37:04.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.303+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~PH4Q7E19K2WR.1 size=1048576 2024-03-09T14:37:04.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.303+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~PH4Q7E19K2WR.2 size=733711 2024-03-09T14:37:04.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.307+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=PH4Q7E19K2WR tag=NKDEHT9DCGXT type=write size=3879439 2024-03-09T14:37:04.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.307+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=L33VWPZGT95Y type=del 2024-03-09T14:37:04.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.311+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=ZPUHWWFBNP2U type=write size=302701 2024-03-09T14:37:04.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.315+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~4PO9NPKSWBQD.0 size=1048576 2024-03-09T14:37:04.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.315+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~4PO9NPKSWBQD.1 size=1048576 2024-03-09T14:37:04.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.315+0000 7fd389e788c0 1 < canceled part key=_multipart_PZJT6RWRJFIN.2~4PO9NPKSWBQD.2 size=864021 2024-03-09T14:37:04.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.323+0000 7fd389e788c0 1 < canceled multipart upload key=PZJT6RWRJFIN upload=4PO9NPKSWBQD tag=DVXC9NF5WK9M type=write size=4009749 2024-03-09T14:37:04.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.323+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=B4VLUJJZRWHQ type=write size=246681 2024-03-09T14:37:04.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.327+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=QGNNGXTH9LW9 type=del 2024-03-09T14:37:04.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.331+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=3Q8B8NA5BEUM type=del size=2081013 2024-03-09T14:37:04.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.335+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~O7O9J7IU1OKF.0 size=760772 2024-03-09T14:37:04.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.339+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=O7O9J7IU1OKF tag=JKJSX8W5HZYM type=write size=1809348 2024-03-09T14:37:04.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.343+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=67YYACMNJMHF type=del size=3411565 2024-03-09T14:37:04.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.343+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=442HV7F4VF25 type=del 2024-03-09T14:37:04.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.347+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=5E7EELCLIR1H type=del size=697641 2024-03-09T14:37:04.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.347+0000 7fd389e788c0 1 < canceled part key=_multipart_E65PFNHJQHEO.2~XEDPX3JWGSDF.0 size=1048576 2024-03-09T14:37:04.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.351+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~XEDPX3JWGSDF.1 size=474665 2024-03-09T14:37:04.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.355+0000 7fd389e788c0 1 < canceled multipart upload key=E65PFNHJQHEO upload=XEDPX3JWGSDF tag=WHGWO9AI274V type=write size=2571817 2024-03-09T14:37:04.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.359+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~3Z7GWNZ5QF0A.0 size=1048576 2024-03-09T14:37:04.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.363+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~3Z7GWNZ5QF0A.1 size=1048576 2024-03-09T14:37:04.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.367+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~3Z7GWNZ5QF0A.2 size=695096 2024-03-09T14:37:04.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.367+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=3Z7GWNZ5QF0A tag=4CQS25NABWUF type=write size=3840824 2024-03-09T14:37:04.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.367+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=OABHK6LHX8TA type=del 2024-03-09T14:37:04.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.375+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~BE8JS1U72K00.0 size=1048576 2024-03-09T14:37:04.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.375+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~BE8JS1U72K00.1 size=1048576 2024-03-09T14:37:04.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.379+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~BE8JS1U72K00.2 size=1021665 2024-03-09T14:37:04.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.379+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=BE8JS1U72K00 tag=LX964KE8TA1X type=write size=4167393 2024-03-09T14:37:04.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.383+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=ST32TFSVB82L type=del 2024-03-09T14:37:04.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.383+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=VCB2VI95BEVT type=del size=1212805 2024-03-09T14:37:04.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.387+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~6RQ1RXXHR337.0 size=1048576 2024-03-09T14:37:04.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.391+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~6RQ1RXXHR337.1 size=1018697 2024-03-09T14:37:04.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.395+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=6RQ1RXXHR337 tag=NH3X3CKV3GC3 type=write size=3115849 2024-03-09T14:37:04.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.403+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~ULK2FTHL7DWJ.0 size=133865 2024-03-09T14:37:04.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.403+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=ULK2FTHL7DWJ tag=C72CN50Y9F5X type=write size=1182441 2024-03-09T14:37:04.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.403+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=YQRAOVKZ09WK type=del 2024-03-09T14:37:04.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.411+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~K5CBBKGE2I17.0 size=782239 2024-03-09T14:37:04.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.411+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=K5CBBKGE2I17 tag=W5J4AAPR9J2V type=write size=1830815 2024-03-09T14:37:04.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.415+0000 7fd389e788c0 1 < completed write operation key=YR2VX4QLOCOG tag=NDOUJTHOOEA2 type=write size=282446 2024-03-09T14:37:04.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.415+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=8076YQPSGPNP type=del size=1826004 2024-03-09T14:37:04.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.419+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=AMVDMGMG26PG type=del 2024-03-09T14:37:04.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.423+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~E2646J76OF61.0 size=1048576 2024-03-09T14:37:04.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.427+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~E2646J76OF61.1 size=1048576 2024-03-09T14:37:04.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.427+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~E2646J76OF61.2 size=210341 2024-03-09T14:37:04.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.427+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=E2646J76OF61 tag=RHIJQJXAHY4M type=write size=3356069 2024-03-09T14:37:04.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.431+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=1U6AOOOH6CJ6 type=del 2024-03-09T14:37:04.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.431+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=TW3BPNNGP7PO type=del size=893373 2024-03-09T14:37:04.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.435+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~OFCDJJT3UKA1.0 size=1048576 2024-03-09T14:37:04.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.435+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~OFCDJJT3UKA1.1 size=311582 2024-03-09T14:37:04.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.443+0000 7fd389e788c0 1 < completed multipart upload key=CLAM83TC7RZ7 upload=OFCDJJT3UKA1 tag=YLQHG8EI2466 type=write size=2408734 2024-03-09T14:37:04.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.443+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=CZGVL2TZ9CKW type=del size=1217493 2024-03-09T14:37:04.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.447+0000 7fd389e788c0 1 < canceled operation key=MHT268M7S2TY tag=4CUXSFWD57E1 type=write size=432860 2024-03-09T14:37:04.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.451+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~JO7HFLZLFYPE.0 size=1048576 2024-03-09T14:37:04.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.455+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~JO7HFLZLFYPE.1 size=1048576 2024-03-09T14:37:04.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.455+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~JO7HFLZLFYPE.2 size=27397 2024-03-09T14:37:04.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.455+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=JO7HFLZLFYPE tag=60AAPLUCY2FJ type=write size=3173125 2024-03-09T14:37:04.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.459+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~PH4Q7E19K2WR.0 size=1048576 2024-03-09T14:37:04.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.463+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~PH4Q7E19K2WR.1 size=1048576 2024-03-09T14:37:04.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.463+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~PH4Q7E19K2WR.2 size=733711 2024-03-09T14:37:04.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.467+0000 7fd389e788c0 1 < completed multipart upload key=E2VP0TJ37UX8 upload=PH4Q7E19K2WR tag=NKDEHT9DCGXT type=write size=3879439 2024-03-09T14:37:04.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.471+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=11R07NTLK1GK type=del size=3345336 2024-03-09T14:37:04.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.475+0000 7fd389e788c0 1 < completed write operation key=SKIBISETJH7B tag=ZPUHWWFBNP2U type=write size=302701 2024-03-09T14:37:04.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.479+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~8F2S815MXIXX.0 size=618884 2024-03-09T14:37:04.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.479+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=8F2S815MXIXX tag=JM9CEXQL9QR0 type=write size=1667460 2024-03-09T14:37:04.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.483+0000 7fd389e788c0 1 < completed write operation key=I4NA328AI5T1 tag=B4VLUJJZRWHQ type=write size=246681 2024-03-09T14:37:04.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.487+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~K6GLA0O8QLSQ.0 size=1048576 2024-03-09T14:37:04.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.487+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~K6GLA0O8QLSQ.1 size=1048576 2024-03-09T14:37:04.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.491+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~K6GLA0O8QLSQ.2 size=156492 2024-03-09T14:37:04.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.491+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=K6GLA0O8QLSQ tag=X7AWEFL94LF1 type=write size=3302220 2024-03-09T14:37:04.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.495+0000 7fd389e788c0 1 < completed delete operation key=UMT7VKZ9R4IR tag=3Q8B8NA5BEUM type=del 2024-03-09T14:37:04.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.495+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=5JOS0O7JO9DZ type=del size=2774895 2024-03-09T14:37:04.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.499+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=67YYACMNJMHF type=del 2024-03-09T14:37:04.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.503+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=ZPJNEQUD951O type=del size=1940403 2024-03-09T14:37:04.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.507+0000 7fd389e788c0 1 < suggested remove operation key=1KJK6PF6U226 tag=5E7EELCLIR1H type=del 2024-03-09T14:37:04.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.515+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~SJ9VKHXFKW3G.0 size=503407 2024-03-09T14:37:04.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.515+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=SJ9VKHXFKW3G tag=F17NKPTCHH2A type=write size=1551983 2024-03-09T14:37:04.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.519+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~3Z7GWNZ5QF0A.0 size=1048576 2024-03-09T14:37:04.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.519+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~3Z7GWNZ5QF0A.1 size=1048576 2024-03-09T14:37:04.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.519+0000 7fd389e788c0 1 < canceled part key=_multipart_71692MJQITX3.2~3Z7GWNZ5QF0A.2 size=695096 2024-03-09T14:37:04.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.523+0000 7fd389e788c0 1 < canceled multipart upload key=71692MJQITX3 upload=3Z7GWNZ5QF0A tag=4CQS25NABWUF type=write size=3840824 2024-03-09T14:37:04.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.527+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=F92AOG5Q8YFJ type=del size=3905405 2024-03-09T14:37:04.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.531+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~BE8JS1U72K00.0 size=1048576 2024-03-09T14:37:04.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.531+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~BE8JS1U72K00.1 size=1048576 2024-03-09T14:37:04.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.535+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~BE8JS1U72K00.2 size=1021665 2024-03-09T14:37:04.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.543+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=BE8JS1U72K00 tag=LX964KE8TA1X type=write size=4167393 2024-03-09T14:37:04.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.547+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~NFJSV9571IVR.0 size=1048576 2024-03-09T14:37:04.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.547+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~NFJSV9571IVR.1 size=1048576 2024-03-09T14:37:04.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.551+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~NFJSV9571IVR.2 size=953312 2024-03-09T14:37:04.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.551+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=NFJSV9571IVR tag=A2DRD5COS32R type=write size=4099040 2024-03-09T14:37:04.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.555+0000 7fd389e788c0 1 < suggested update operation key=U8P5Q3D11MM6 tag=VCB2VI95BEVT type=del size=1212805 2024-03-09T14:37:04.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.559+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=T1WG5OW8N5YH type=del size=1189672 2024-03-09T14:37:04.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.559+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~ULK2FTHL7DWJ.0 size=133865 2024-03-09T14:37:04.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.567+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=ULK2FTHL7DWJ tag=C72CN50Y9F5X type=write size=1182441 2024-03-09T14:37:04.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.567+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=4RPGQOSPXQII type=del size=4061121 2024-03-09T14:37:04.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.571+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~K5CBBKGE2I17.0 size=782239 2024-03-09T14:37:04.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.575+0000 7fd389e788c0 1 < completed multipart upload key=Y7E2TLASJM9T upload=K5CBBKGE2I17 tag=W5J4AAPR9J2V type=write size=1830815 2024-03-09T14:37:04.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.579+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=562NXT83FWJT type=del size=4024556 2024-03-09T14:37:04.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.579+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=8076YQPSGPNP type=del 2024-03-09T14:37:04.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.583+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=SOTO4QXETBR5 type=del size=3742167 2024-03-09T14:37:04.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.587+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~E2646J76OF61.0 size=1048576 2024-03-09T14:37:04.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.587+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~E2646J76OF61.1 size=1048576 2024-03-09T14:37:04.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.591+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~E2646J76OF61.2 size=210341 2024-03-09T14:37:04.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.595+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=E2646J76OF61 tag=RHIJQJXAHY4M type=write size=3356069 2024-03-09T14:37:04.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.599+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~IOWKXZ7XBO7E.0 size=1048576 2024-03-09T14:37:04.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.603+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~IOWKXZ7XBO7E.1 size=1048576 2024-03-09T14:37:04.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.603+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~IOWKXZ7XBO7E.2 size=1048486 2024-03-09T14:37:04.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.603+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=IOWKXZ7XBO7E tag=5XNFXZ4PUIR4 type=write size=4194214 2024-03-09T14:37:04.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.607+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=TW3BPNNGP7PO type=del 2024-03-09T14:37:04.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.611+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~LK5JUAO6Z0MY.0 size=1048576 2024-03-09T14:37:04.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.615+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~LK5JUAO6Z0MY.1 size=821395 2024-03-09T14:37:04.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.615+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=LK5JUAO6Z0MY tag=G491EWXP6LJW type=write size=2918547 2024-03-09T14:37:04.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.615+0000 7fd389e788c0 1 < canceled operation key=5ZEDXFB9B3CN tag=CZGVL2TZ9CKW type=del size=1217493 2024-03-09T14:37:04.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.619+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=7WT3REZAIPTW type=del size=2790527 2024-03-09T14:37:04.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.619+0000 7fd389e788c0 1 < canceled part key=_multipart_ACL1T9GW2JV9.2~JO7HFLZLFYPE.0 size=1048576 2024-03-09T14:37:04.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.623+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~JO7HFLZLFYPE.1 size=1048576 2024-03-09T14:37:04.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.623+0000 7fd389e788c0 1 < canceled part key=_multipart_ACL1T9GW2JV9.2~JO7HFLZLFYPE.2 size=27397 2024-03-09T14:37:04.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.627+0000 7fd389e788c0 1 < canceled multipart upload key=ACL1T9GW2JV9 upload=JO7HFLZLFYPE tag=60AAPLUCY2FJ type=write size=3173125 2024-03-09T14:37:04.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.627+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=IBDCF25JHW5L type=del size=2022664 2024-03-09T14:37:04.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.635+0000 7fd389e788c0 1 < suggested update operation key=E2VP0TJ37UX8 tag=11R07NTLK1GK type=del size=3345336 2024-03-09T14:37:04.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.635+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=YII4120HEJMU type=del size=3082951 2024-03-09T14:37:04.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.639+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~8F2S815MXIXX.0 size=618884 2024-03-09T14:37:04.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.647+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=8F2S815MXIXX tag=JM9CEXQL9QR0 type=write size=1667460 2024-03-09T14:37:04.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.647+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=L09H9DNY5ITM type=del size=2935108 2024-03-09T14:37:04.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.651+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~K6GLA0O8QLSQ.0 size=1048576 2024-03-09T14:37:04.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.651+0000 7fd389e788c0 1 < canceled part key=_multipart_I4NA328AI5T1.2~K6GLA0O8QLSQ.1 size=1048576 2024-03-09T14:37:04.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.655+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~K6GLA0O8QLSQ.2 size=156492 2024-03-09T14:37:04.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.659+0000 7fd389e788c0 1 < canceled multipart upload key=I4NA328AI5T1 upload=K6GLA0O8QLSQ tag=X7AWEFL94LF1 type=write size=3302220 2024-03-09T14:37:04.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.663+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=10HH7432EJGX type=del size=2040346 2024-03-09T14:37:04.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.663+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=5JOS0O7JO9DZ type=del 2024-03-09T14:37:04.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.667+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=8DT8MHHY4USO type=del size=2277515 2024-03-09T14:37:04.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.671+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=ZPJNEQUD951O type=del 2024-03-09T14:37:04.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.671+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=CHJRQ7SHHE7K type=write size=709453 2024-03-09T14:37:04.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.675+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~SJ9VKHXFKW3G.0 size=503407 2024-03-09T14:37:04.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.679+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=SJ9VKHXFKW3G tag=F17NKPTCHH2A type=write size=1551983 2024-03-09T14:37:04.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.683+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~TXAVRJ2STETZ.0 size=10653 2024-03-09T14:37:04.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.683+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=TXAVRJ2STETZ tag=ITZG4L8TOZLM type=write size=1059229 2024-03-09T14:37:04.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.691+0000 7fd389e788c0 1 < suggested update operation key=E65PFNHJQHEO tag=F92AOG5Q8YFJ type=del size=3905405 2024-03-09T14:37:04.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.691+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=03FGXJCD71LR type=write size=146118 2024-03-09T14:37:04.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.695+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~NFJSV9571IVR.0 size=1048576 2024-03-09T14:37:04.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.699+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~NFJSV9571IVR.1 size=1048576 2024-03-09T14:37:04.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.699+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~NFJSV9571IVR.2 size=953312 2024-03-09T14:37:04.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.703+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=NFJSV9571IVR tag=A2DRD5COS32R type=write size=4099040 2024-03-09T14:37:04.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.707+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=6BM826IYTJL7 type=del size=1364039 2024-03-09T14:37:04.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.711+0000 7fd389e788c0 1 < suggested update operation key=DIN8WJ9Z9OI8 tag=T1WG5OW8N5YH type=del size=1189672 2024-03-09T14:37:04.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.719+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~5L97WKGJOK6D.0 size=1048576 2024-03-09T14:37:04.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.719+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~5L97WKGJOK6D.1 size=823584 2024-03-09T14:37:04.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.719+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=5L97WKGJOK6D tag=JBU51CA4OHOW type=write size=2920736 2024-03-09T14:37:04.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.723+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=4RPGQOSPXQII type=del 2024-03-09T14:37:04.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.727+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~AFYJMY3WQRBR.0 size=1048576 2024-03-09T14:37:04.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.727+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~AFYJMY3WQRBR.1 size=1048576 2024-03-09T14:37:04.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.731+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~AFYJMY3WQRBR.2 size=845325 2024-03-09T14:37:04.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.731+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=AFYJMY3WQRBR tag=6QQE7OO22UPB type=write size=3991053 2024-03-09T14:37:04.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.731+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=562NXT83FWJT type=del 2024-03-09T14:37:04.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.735+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=J23NBIGBVM8U type=del size=2527884 2024-03-09T14:37:04.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.739+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=SOTO4QXETBR5 type=del 2024-03-09T14:37:04.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.743+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~B7A2G0CN3I1K.0 size=1048576 2024-03-09T14:37:04.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.743+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~B7A2G0CN3I1K.1 size=1048576 2024-03-09T14:37:04.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.747+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~B7A2G0CN3I1K.2 size=853620 2024-03-09T14:37:04.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.747+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=B7A2G0CN3I1K tag=E4BPOQ0BPYF1 type=write size=3999348 2024-03-09T14:37:04.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.751+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~IOWKXZ7XBO7E.0 size=1048576 2024-03-09T14:37:04.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.751+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~IOWKXZ7XBO7E.1 size=1048576 2024-03-09T14:37:04.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.755+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~IOWKXZ7XBO7E.2 size=1048486 2024-03-09T14:37:04.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.759+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=IOWKXZ7XBO7E tag=5XNFXZ4PUIR4 type=write size=4194214 2024-03-09T14:37:04.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.763+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=1KRLCN93T8KW type=del size=3544080 2024-03-09T14:37:04.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.763+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~LK5JUAO6Z0MY.0 size=1048576 2024-03-09T14:37:04.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.767+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~LK5JUAO6Z0MY.1 size=821395 2024-03-09T14:37:04.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.771+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=LK5JUAO6Z0MY tag=G491EWXP6LJW type=write size=2918547 2024-03-09T14:37:04.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.771+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=SIAYN6PNG1RV type=del size=1395545 2024-03-09T14:37:04.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.779+0000 7fd389e788c0 1 < suggested update operation key=SKIBISETJH7B tag=7WT3REZAIPTW type=del size=2790527 2024-03-09T14:37:04.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.779+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=J7P6Q8NADU8D type=del size=625456 2024-03-09T14:37:04.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.783+0000 7fd389e788c0 -1 < failed to complete operation key=DIN8WJ9Z9OI8 tag=IBDCF25JHW5L type=del size=2022664: (22) Invalid argument 2024-03-09T14:37:04.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.787+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=8S0PN2FRZXIP type=del size=3708004 2024-03-09T14:37:04.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.787+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=YII4120HEJMU type=del 2024-03-09T14:37:04.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.791+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~7MF6N3BFX151.0 size=1048576 2024-03-09T14:37:04.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.795+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~7MF6N3BFX151.1 size=1048576 2024-03-09T14:37:04.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.795+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~7MF6N3BFX151.2 size=517709 2024-03-09T14:37:04.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.795+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=7MF6N3BFX151 tag=T6QNVC0PY3N0 type=write size=3663437 2024-03-09T14:37:04.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.799+0000 7fd389e788c0 1 < canceled operation key=U8P5Q3D11MM6 tag=L09H9DNY5ITM type=del size=2935108 2024-03-09T14:37:04.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.803+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=CV60XLP9WL1L type=del size=3893626 2024-03-09T14:37:04.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.803+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=10HH7432EJGX type=del 2024-03-09T14:37:04.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.811+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~TRCALMJZFFGC.0 size=1048576 2024-03-09T14:37:04.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.811+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~TRCALMJZFFGC.1 size=942738 2024-03-09T14:37:04.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.811+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=TRCALMJZFFGC tag=RP3H7YP8T81G type=write size=3039890 2024-03-09T14:37:04.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.815+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=8DT8MHHY4USO type=del 2024-03-09T14:37:04.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.819+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~G5MXGA787LQU.0 size=1048576 2024-03-09T14:37:04.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.819+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~G5MXGA787LQU.1 size=1048576 2024-03-09T14:37:04.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.823+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~G5MXGA787LQU.2 size=927973 2024-03-09T14:37:04.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.823+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=G5MXGA787LQU tag=45JEE9PZP6QI type=write size=4073701 2024-03-09T14:37:04.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.827+0000 7fd389e788c0 1 < completed write operation key=5ZEDXFB9B3CN tag=CHJRQ7SHHE7K type=write size=709453 2024-03-09T14:37:04.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.827+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=PBSEMHL1FCGJ type=del size=1198161 2024-03-09T14:37:04.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.831+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~TXAVRJ2STETZ.0 size=10653 2024-03-09T14:37:04.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.835+0000 7fd389e788c0 1 < completed multipart upload key=Y7E2TLASJM9T upload=TXAVRJ2STETZ tag=ITZG4L8TOZLM type=write size=1059229 2024-03-09T14:37:04.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.843+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~PD9RSCGVY5K0.0 size=1048576 2024-03-09T14:37:04.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.843+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~PD9RSCGVY5K0.1 size=1048576 2024-03-09T14:37:04.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.847+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~PD9RSCGVY5K0.2 size=915278 2024-03-09T14:37:04.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.847+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=PD9RSCGVY5K0 tag=UI2MH9K6YVDJ type=write size=4061006 2024-03-09T14:37:04.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.847+0000 7fd389e788c0 1 < canceled operation key=1K5KR8U3GCOV tag=03FGXJCD71LR type=write size=146118 2024-03-09T14:37:04.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.851+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=10JJQ7MD3QBM type=del size=1795886 2024-03-09T14:37:04.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.855+0000 7fd389e788c0 1 < suggested remove operation key=YR2VX4QLOCOG tag=6BM826IYTJL7 type=del 2024-03-09T14:37:04.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.859+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~FFXYW1S4L4J1.0 size=1048576 2024-03-09T14:37:04.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.863+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~FFXYW1S4L4J1.1 size=356599 2024-03-09T14:37:04.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.863+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=FFXYW1S4L4J1 tag=N44VCNRZPXLU type=write size=2453751 2024-03-09T14:37:04.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.863+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~5L97WKGJOK6D.0 size=1048576 2024-03-09T14:37:04.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.867+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~5L97WKGJOK6D.1 size=823584 2024-03-09T14:37:04.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.871+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=5L97WKGJOK6D tag=JBU51CA4OHOW type=write size=2920736 2024-03-09T14:37:04.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.875+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=47R6NMKSEING type=write size=483876 2024-03-09T14:37:04.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.875+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~AFYJMY3WQRBR.0 size=1048576 2024-03-09T14:37:04.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.879+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~AFYJMY3WQRBR.1 size=1048576 2024-03-09T14:37:04.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.879+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~AFYJMY3WQRBR.2 size=845325 2024-03-09T14:37:04.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.883+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=AFYJMY3WQRBR tag=6QQE7OO22UPB type=write size=3991053 2024-03-09T14:37:04.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.887+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~GHG7K63LBKWN.0 size=1048576 2024-03-09T14:37:04.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.891+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~GHG7K63LBKWN.1 size=1048576 2024-03-09T14:37:04.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.891+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~GHG7K63LBKWN.2 size=525530 2024-03-09T14:37:04.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.891+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=GHG7K63LBKWN tag=U52T7LZ192S3 type=write size=3671258 2024-03-09T14:37:04.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.895+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=J23NBIGBVM8U type=del 2024-03-09T14:37:04.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.895+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=IL9CZJ3CXJXA type=del size=56029 2024-03-09T14:37:04.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.895+0000 7fd389e788c0 1 < canceled part key=_multipart_E2VP0TJ37UX8.2~B7A2G0CN3I1K.0 size=1048576 2024-03-09T14:37:04.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.899+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~B7A2G0CN3I1K.1 size=1048576 2024-03-09T14:37:04.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.899+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~B7A2G0CN3I1K.2 size=853620 2024-03-09T14:37:04.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.903+0000 7fd389e788c0 1 < canceled multipart upload key=E2VP0TJ37UX8 upload=B7A2G0CN3I1K tag=E4BPOQ0BPYF1 type=write size=3999348 2024-03-09T14:37:04.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.907+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=1KDX6YV4XNEF type=write size=983405 2024-03-09T14:37:04.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.907+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=1KRLCN93T8KW type=del 2024-03-09T14:37:04.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.911+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~N56JFPEL5CJ0.0 size=1034681 2024-03-09T14:37:04.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.911+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=N56JFPEL5CJ0 tag=U3619LQEQQ3K type=write size=2083257 2024-03-09T14:37:04.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.915+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=SIAYN6PNG1RV type=del 2024-03-09T14:37:04.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.915+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=RAH4WUAV7374 type=del size=474655 2024-03-09T14:37:04.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.919+0000 7fd389e788c0 1 < suggested remove operation key=SVTMMQ2QR603 tag=J7P6Q8NADU8D type=del 2024-03-09T14:37:04.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.923+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=JCVILX3DUOX0 type=write size=900926 2024-03-09T14:37:04.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.927+0000 7fd389e788c0 1 < canceled operation key=2405Y4I2Q8TY tag=8S0PN2FRZXIP type=del size=3708004 2024-03-09T14:37:04.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.927+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=DUHUWF3FUU9C type=del size=3359932 2024-03-09T14:37:04.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.931+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~7MF6N3BFX151.0 size=1048576 2024-03-09T14:37:04.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.931+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~7MF6N3BFX151.1 size=1048576 2024-03-09T14:37:04.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.935+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~7MF6N3BFX151.2 size=517709 2024-03-09T14:37:04.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.939+0000 7fd389e788c0 1 < completed multipart upload key=Z18Q66VI5PDN upload=7MF6N3BFX151 tag=T6QNVC0PY3N0 type=write size=3663437 2024-03-09T14:37:04.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.943+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~62LP9F1ALGBI.0 size=1048576 2024-03-09T14:37:04.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.943+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~62LP9F1ALGBI.1 size=920034 2024-03-09T14:37:04.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.943+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=62LP9F1ALGBI tag=VVFBD7DK4FAA type=write size=3017186 2024-03-09T14:37:04.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.947+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=CV60XLP9WL1L type=del 2024-03-09T14:37:04.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.947+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=0CTN5RPCMQQX type=del size=463246 2024-03-09T14:37:04.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.951+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~TRCALMJZFFGC.0 size=1048576 2024-03-09T14:37:04.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.955+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~TRCALMJZFFGC.1 size=942738 2024-03-09T14:37:04.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.959+0000 7fd389e788c0 1 < completed multipart upload key=IXKMXJ9IZ69S upload=TRCALMJZFFGC tag=RP3H7YP8T81G type=write size=3039890 2024-03-09T14:37:04.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.959+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=7HPCSQZRKUGH type=del size=185741 2024-03-09T14:37:04.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.963+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~G5MXGA787LQU.0 size=1048576 2024-03-09T14:37:04.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.967+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~G5MXGA787LQU.1 size=1048576 2024-03-09T14:37:04.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.967+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~G5MXGA787LQU.2 size=927973 2024-03-09T14:37:04.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.971+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=G5MXGA787LQU tag=45JEE9PZP6QI type=write size=4073701 2024-03-09T14:37:04.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.975+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=IUOJC19LWSYU type=del size=4022663 2024-03-09T14:37:04.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.975+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=PBSEMHL1FCGJ type=del 2024-03-09T14:37:04.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.979+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=6RSXB9914UNJ type=del size=99790 2024-03-09T14:37:04.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.979+0000 7fd389e788c0 1 < canceled part key=_multipart_FY02AR9GS3KG.2~PD9RSCGVY5K0.0 size=1048576 2024-03-09T14:37:04.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.979+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~PD9RSCGVY5K0.1 size=1048576 2024-03-09T14:37:04.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.983+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~PD9RSCGVY5K0.2 size=915278 2024-03-09T14:37:04.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.987+0000 7fd389e788c0 1 < canceled multipart upload key=FY02AR9GS3KG upload=PD9RSCGVY5K0 tag=UI2MH9K6YVDJ type=write size=4061006 2024-03-09T14:37:04.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.987+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=1B51T9UE0NEX type=del size=3278898 2024-03-09T14:37:04.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.995+0000 7fd389e788c0 1 < suggested remove operation key=44F8QXCBBENS tag=10JJQ7MD3QBM type=del 2024-03-09T14:37:04.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.999+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~YSNSBR9LDKOS.0 size=1048576 2024-03-09T14:37:05.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:04.999+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~YSNSBR9LDKOS.1 size=1048576 2024-03-09T14:37:05.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.003+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~YSNSBR9LDKOS.2 size=705924 2024-03-09T14:37:05.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.003+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=YSNSBR9LDKOS tag=W61AX8855HIQ type=write size=3851652 2024-03-09T14:37:05.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.003+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~FFXYW1S4L4J1.0 size=1048576 2024-03-09T14:37:05.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.007+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~FFXYW1S4L4J1.1 size=356599 2024-03-09T14:37:05.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.011+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=FFXYW1S4L4J1 tag=N44VCNRZPXLU type=write size=2453751 2024-03-09T14:37:05.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.011+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=BR5NLOSZ5YPD type=del size=360546 2024-03-09T14:37:05.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.015+0000 7fd389e788c0 1 < completed write operation key=E2VP0TJ37UX8 tag=47R6NMKSEING type=write size=483876 2024-03-09T14:37:05.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.019+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~PFGNWE0MZ5TS.0 size=1048576 2024-03-09T14:37:05.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.023+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~PFGNWE0MZ5TS.1 size=779276 2024-03-09T14:37:05.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.023+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=PFGNWE0MZ5TS tag=73RBDIRKLBMU type=write size=2876428 2024-03-09T14:37:05.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.023+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~GHG7K63LBKWN.0 size=1048576 2024-03-09T14:37:05.026 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.027+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~GHG7K63LBKWN.1 size=1048576 2024-03-09T14:37:05.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.027+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~GHG7K63LBKWN.2 size=525530 2024-03-09T14:37:05.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.031+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=GHG7K63LBKWN tag=U52T7LZ192S3 type=write size=3671258 2024-03-09T14:37:05.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.035+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=DTM8R6SFP30H type=del size=1022449 2024-03-09T14:37:05.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.039+0000 7fd389e788c0 1 < canceled operation key=PZJT6RWRJFIN tag=IL9CZJ3CXJXA type=del size=56029 2024-03-09T14:37:05.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.039+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=SVMSOS1T9N1A type=del size=2505200 2024-03-09T14:37:05.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.043+0000 7fd389e788c0 1 < completed write operation key=FY02AR9GS3KG tag=1KDX6YV4XNEF type=write size=983405 2024-03-09T14:37:05.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.047+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~4APG4VH897WU.0 size=1048576 2024-03-09T14:37:05.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.051+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~4APG4VH897WU.1 size=1048576 2024-03-09T14:37:05.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.055+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~4APG4VH897WU.2 size=202856 2024-03-09T14:37:05.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.055+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=4APG4VH897WU tag=5XK09R15SIEF type=write size=3348584 2024-03-09T14:37:05.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.055+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~N56JFPEL5CJ0.0 size=1034681 2024-03-09T14:37:05.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.059+0000 7fd389e788c0 1 < completed multipart upload key=IXKMXJ9IZ69S upload=N56JFPEL5CJ0 tag=U3619LQEQQ3K type=write size=2083257 2024-03-09T14:37:05.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.063+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=7MZK4GEAGS8P type=del size=2775565 2024-03-09T14:37:05.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.067+0000 7fd389e788c0 1 < suggested remove operation key=CLAM83TC7RZ7 tag=RAH4WUAV7374 type=del 2024-03-09T14:37:05.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.071+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~NPNFK1WUN3WI.0 size=608386 2024-03-09T14:37:05.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.071+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=NPNFK1WUN3WI tag=PQXTIQT2VR3T type=write size=1656962 2024-03-09T14:37:05.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.075+0000 7fd389e788c0 -1 < failed to complete operation key=CLAM83TC7RZ7 tag=JCVILX3DUOX0 type=write size=900926: (22) Invalid argument 2024-03-09T14:37:05.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.079+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~G6DR5CXHA750.0 size=922947 2024-03-09T14:37:05.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.079+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=G6DR5CXHA750 tag=H30E3RPC1JUM type=write size=1971523 2024-03-09T14:37:05.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.083+0000 7fd389e788c0 1 < completed delete operation key=DIN8WJ9Z9OI8 tag=DUHUWF3FUU9C type=del 2024-03-09T14:37:05.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.087+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=VCJNPECM2V3R type=del size=669197 2024-03-09T14:37:05.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.091+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~62LP9F1ALGBI.0 size=1048576 2024-03-09T14:37:05.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.091+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~62LP9F1ALGBI.1 size=920034 2024-03-09T14:37:05.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.095+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=62LP9F1ALGBI tag=VVFBD7DK4FAA type=write size=3017186 2024-03-09T14:37:05.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.103+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~953KBKQF5AQA.0 size=1048576 2024-03-09T14:37:05.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.103+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~953KBKQF5AQA.1 size=378462 2024-03-09T14:37:05.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.103+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=953KBKQF5AQA tag=IOY12Q2A3S6A type=write size=2475614 2024-03-09T14:37:05.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.107+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=0CTN5RPCMQQX type=del 2024-03-09T14:37:05.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.111+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~616LUGG67B4G.0 size=1048576 2024-03-09T14:37:05.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.119+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~616LUGG67B4G.1 size=476419 2024-03-09T14:37:05.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.119+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=616LUGG67B4G tag=ZW9Z3FS5CGH6 type=write size=2573571 2024-03-09T14:37:05.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.123+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=7HPCSQZRKUGH type=del 2024-03-09T14:37:05.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.127+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~5506BM78MZOG.0 size=812911 2024-03-09T14:37:05.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.127+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=5506BM78MZOG tag=MLXXTXFT46PI type=write size=1861487 2024-03-09T14:37:05.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.131+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=IUOJC19LWSYU type=del 2024-03-09T14:37:05.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.131+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=Q6PY2343AQ41 type=del size=559827 2024-03-09T14:37:05.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.135+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=6RSXB9914UNJ type=del 2024-03-09T14:37:05.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.143+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~DE874NWVL6ZA.0 size=1048576 2024-03-09T14:37:05.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.143+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~DE874NWVL6ZA.1 size=698017 2024-03-09T14:37:05.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.143+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=DE874NWVL6ZA tag=938MIJB593ZT type=write size=2795169 2024-03-09T14:37:05.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.147+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=1B51T9UE0NEX type=del 2024-03-09T14:37:05.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.151+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=NVG46TOSBLO0 type=del size=3986921 2024-03-09T14:37:05.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.151+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~YSNSBR9LDKOS.0 size=1048576 2024-03-09T14:37:05.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.155+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~YSNSBR9LDKOS.1 size=1048576 2024-03-09T14:37:05.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.155+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~YSNSBR9LDKOS.2 size=705924 2024-03-09T14:37:05.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.159+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=YSNSBR9LDKOS tag=W61AX8855HIQ type=write size=3851652 2024-03-09T14:37:05.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.163+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=B52MW5LIPGOU type=write size=519042 2024-03-09T14:37:05.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.167+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=BR5NLOSZ5YPD type=del 2024-03-09T14:37:05.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.171+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~WVUAJ8LYTY7T.0 size=950918 2024-03-09T14:37:05.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.171+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=WVUAJ8LYTY7T tag=WU8UBNA4W6TP type=write size=1999494 2024-03-09T14:37:05.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.175+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~PFGNWE0MZ5TS.0 size=1048576 2024-03-09T14:37:05.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.175+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~PFGNWE0MZ5TS.1 size=779276 2024-03-09T14:37:05.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.179+0000 7fd389e788c0 1 < completed multipart upload key=8J6Z9DT07H0X upload=PFGNWE0MZ5TS tag=73RBDIRKLBMU type=write size=2876428 2024-03-09T14:37:05.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.183+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=PMEKZL30OEU1 type=del size=3390004 2024-03-09T14:37:05.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.187+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=DTM8R6SFP30H type=del 2024-03-09T14:37:05.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.187+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=W70MO4IFYZ3X type=del size=3781539 2024-03-09T14:37:05.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.191+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=SVMSOS1T9N1A type=del 2024-03-09T14:37:05.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.195+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=6ADBB5K5I7WN type=del size=1888495 2024-03-09T14:37:05.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.199+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~4APG4VH897WU.0 size=1048576 2024-03-09T14:37:05.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.199+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~4APG4VH897WU.1 size=1048576 2024-03-09T14:37:05.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.203+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~4APG4VH897WU.2 size=202856 2024-03-09T14:37:05.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.207+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=4APG4VH897WU tag=5XK09R15SIEF type=write size=3348584 2024-03-09T14:37:05.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.211+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~FEZYUFXK2XFD.0 size=556048 2024-03-09T14:37:05.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.211+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=FEZYUFXK2XFD tag=I1LEYNS9AKQ8 type=write size=1604624 2024-03-09T14:37:05.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.215+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=7MZK4GEAGS8P type=del 2024-03-09T14:37:05.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.219+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=1HKF3IED5QC6 type=del size=100750 2024-03-09T14:37:05.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.223+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~NPNFK1WUN3WI.0 size=608386 2024-03-09T14:37:05.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.227+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=NPNFK1WUN3WI tag=PQXTIQT2VR3T type=write size=1656962 2024-03-09T14:37:05.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.231+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~1926XEQRYIV0.0 size=299225 2024-03-09T14:37:05.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.231+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=1926XEQRYIV0 tag=DOMFRXSD0CCY type=write size=1347801 2024-03-09T14:37:05.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.235+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~G6DR5CXHA750.0 size=922947 2024-03-09T14:37:05.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.239+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=G6DR5CXHA750 tag=H30E3RPC1JUM type=write size=1971523 2024-03-09T14:37:05.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.243+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~KMTHZVQ01IDC.0 size=1048576 2024-03-09T14:37:05.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.247+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~KMTHZVQ01IDC.1 size=905231 2024-03-09T14:37:05.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.247+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=KMTHZVQ01IDC tag=SS0VR3JXG610 type=write size=3002383 2024-03-09T14:37:05.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.251+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=VCJNPECM2V3R type=del 2024-03-09T14:37:05.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.255+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~AF3LW3YN7DK5.0 size=1048576 2024-03-09T14:37:05.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.259+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~AF3LW3YN7DK5.1 size=1048576 2024-03-09T14:37:05.260 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.259+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~AF3LW3YN7DK5.2 size=263961 2024-03-09T14:37:05.260 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.259+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=AF3LW3YN7DK5 tag=LW3E43SDLB2Z type=write size=3409689 2024-03-09T14:37:05.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.263+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~953KBKQF5AQA.0 size=1048576 2024-03-09T14:37:05.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.267+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~953KBKQF5AQA.1 size=378462 2024-03-09T14:37:05.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.271+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=953KBKQF5AQA tag=IOY12Q2A3S6A type=write size=2475614 2024-03-09T14:37:05.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.275+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=JP04MVREDMEL type=del size=1447166 2024-03-09T14:37:05.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.279+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~616LUGG67B4G.0 size=1048576 2024-03-09T14:37:05.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.279+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~616LUGG67B4G.1 size=476419 2024-03-09T14:37:05.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.287+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=616LUGG67B4G tag=ZW9Z3FS5CGH6 type=write size=2573571 2024-03-09T14:37:05.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.287+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=GAZUDQGXVC3J type=del size=3932028 2024-03-09T14:37:05.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.291+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~5506BM78MZOG.0 size=812911 2024-03-09T14:37:05.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.295+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=5506BM78MZOG tag=MLXXTXFT46PI type=write size=1861487 2024-03-09T14:37:05.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.303+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~MZB1U00U3F99.0 size=1048576 2024-03-09T14:37:05.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.303+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~MZB1U00U3F99.1 size=1048576 2024-03-09T14:37:05.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.307+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~MZB1U00U3F99.2 size=550239 2024-03-09T14:37:05.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.307+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=MZB1U00U3F99 tag=ECBHCJ1ATPJP type=write size=3695967 2024-03-09T14:37:05.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.315+0000 7fd389e788c0 1 < suggested update operation key=6VT4C288571G tag=Q6PY2343AQ41 type=del size=559827 2024-03-09T14:37:05.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.319+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~KI4GYKBVSNMP.0 size=1048576 2024-03-09T14:37:05.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.319+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~KI4GYKBVSNMP.1 size=244166 2024-03-09T14:37:05.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.319+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=KI4GYKBVSNMP tag=VIDUFAK3QS8M type=write size=2341318 2024-03-09T14:37:05.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.323+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~DE874NWVL6ZA.0 size=1048576 2024-03-09T14:37:05.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.323+0000 7fd389e788c0 1 < canceled part key=_multipart_1KJK6PF6U226.2~DE874NWVL6ZA.1 size=698017 2024-03-09T14:37:05.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.327+0000 7fd389e788c0 1 < canceled multipart upload key=1KJK6PF6U226 upload=DE874NWVL6ZA tag=938MIJB593ZT type=write size=2795169 2024-03-09T14:37:05.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.331+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=Y873KWF350RQ type=del size=1508541 2024-03-09T14:37:05.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.335+0000 7fd389e788c0 1 < canceled operation key=8J6Z9DT07H0X tag=NVG46TOSBLO0 type=del size=3986921 2024-03-09T14:37:05.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.339+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~41F1WKOL8A1S.0 size=1048576 2024-03-09T14:37:05.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.339+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~41F1WKOL8A1S.1 size=1048576 2024-03-09T14:37:05.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.343+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~41F1WKOL8A1S.2 size=405084 2024-03-09T14:37:05.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.343+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=41F1WKOL8A1S tag=AV8096351QMN type=write size=3550812 2024-03-09T14:37:05.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.347+0000 7fd389e788c0 1 < completed write operation key=Z18Q66VI5PDN tag=B52MW5LIPGOU type=write size=519042 2024-03-09T14:37:05.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.351+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=KXQ2L0WSZZ22 type=del size=1243452 2024-03-09T14:37:05.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.351+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~WVUAJ8LYTY7T.0 size=950918 2024-03-09T14:37:05.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.359+0000 7fd389e788c0 1 < completed multipart upload key=CLAM83TC7RZ7 upload=WVUAJ8LYTY7T tag=WU8UBNA4W6TP type=write size=1999494 2024-03-09T14:37:05.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.363+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~TVM2UI3LP8F8.0 size=418619 2024-03-09T14:37:05.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.363+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=TVM2UI3LP8F8 tag=AE2H19UKA3YP type=write size=1467195 2024-03-09T14:37:05.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.367+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=PMEKZL30OEU1 type=del 2024-03-09T14:37:05.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.371+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~73CG3QTDHCV2.0 size=1048576 2024-03-09T14:37:05.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.371+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~73CG3QTDHCV2.1 size=1048576 2024-03-09T14:37:05.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.375+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~73CG3QTDHCV2.2 size=714165 2024-03-09T14:37:05.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.375+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=73CG3QTDHCV2 tag=KOL2WS229IVC type=write size=3859893 2024-03-09T14:37:05.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.379+0000 7fd389e788c0 1 < completed delete operation key=DIN8WJ9Z9OI8 tag=W70MO4IFYZ3X type=del 2024-03-09T14:37:05.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.387+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~2DG7JSLAPJ41.0 size=1048576 2024-03-09T14:37:05.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.391+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~2DG7JSLAPJ41.1 size=1048576 2024-03-09T14:37:05.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.391+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~2DG7JSLAPJ41.2 size=636175 2024-03-09T14:37:05.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.391+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=2DG7JSLAPJ41 tag=XMJZICRRXAFR type=write size=3781903 2024-03-09T14:37:05.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.395+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=6ADBB5K5I7WN type=del 2024-03-09T14:37:05.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.399+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~AJ1EBNW4KNJA.0 size=1048576 2024-03-09T14:37:05.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.403+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~AJ1EBNW4KNJA.1 size=1048576 2024-03-09T14:37:05.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.407+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~AJ1EBNW4KNJA.2 size=922367 2024-03-09T14:37:05.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.407+0000 7fd389e788c0 1 > prepared multipart upload key=DIN8WJ9Z9OI8 upload=AJ1EBNW4KNJA tag=FJNAO728D0YE type=write size=4068095 2024-03-09T14:37:05.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.407+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~FEZYUFXK2XFD.0 size=556048 2024-03-09T14:37:05.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.415+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=FEZYUFXK2XFD tag=I1LEYNS9AKQ8 type=write size=1604624 2024-03-09T14:37:05.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.419+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~M0YN8E65YDMP.0 size=1048576 2024-03-09T14:37:05.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.423+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~M0YN8E65YDMP.1 size=1048576 2024-03-09T14:37:05.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.423+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~M0YN8E65YDMP.2 size=788347 2024-03-09T14:37:05.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.423+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=M0YN8E65YDMP tag=NMJEG4EWVLKO type=write size=3934075 2024-03-09T14:37:05.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.427+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=1HKF3IED5QC6 type=del 2024-03-09T14:37:05.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.431+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=XPL9P0KRRQPF type=del size=3947556 2024-03-09T14:37:05.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.435+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~1926XEQRYIV0.0 size=299225 2024-03-09T14:37:05.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.439+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=1926XEQRYIV0 tag=DOMFRXSD0CCY type=write size=1347801 2024-03-09T14:37:05.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.443+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=KL2ILLT9OCQ1 type=del size=1475975 2024-03-09T14:37:05.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.443+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~KMTHZVQ01IDC.0 size=1048576 2024-03-09T14:37:05.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.447+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~KMTHZVQ01IDC.1 size=905231 2024-03-09T14:37:05.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.451+0000 7fd389e788c0 1 < completed multipart upload key=Y7E2TLASJM9T upload=KMTHZVQ01IDC tag=SS0VR3JXG610 type=write size=3002383 2024-03-09T14:37:05.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.455+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=3AW7KV90UYZV type=del size=3797886 2024-03-09T14:37:05.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.455+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~AF3LW3YN7DK5.0 size=1048576 2024-03-09T14:37:05.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.455+0000 7fd389e788c0 1 < canceled part key=_multipart_FY02AR9GS3KG.2~AF3LW3YN7DK5.1 size=1048576 2024-03-09T14:37:05.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.455+0000 7fd389e788c0 1 < canceled part key=_multipart_FY02AR9GS3KG.2~AF3LW3YN7DK5.2 size=263961 2024-03-09T14:37:05.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.459+0000 7fd389e788c0 1 < canceled multipart upload key=FY02AR9GS3KG upload=AF3LW3YN7DK5 tag=LW3E43SDLB2Z type=write size=3409689 2024-03-09T14:37:05.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.467+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~UW0UG3NUOMUJ.0 size=1048576 2024-03-09T14:37:05.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.467+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~UW0UG3NUOMUJ.1 size=1048576 2024-03-09T14:37:05.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.471+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~UW0UG3NUOMUJ.2 size=539351 2024-03-09T14:37:05.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.471+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=UW0UG3NUOMUJ tag=POAEPH7O8GF6 type=write size=3685079 2024-03-09T14:37:05.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.471+0000 7fd389e788c0 1 < completed delete operation key=DIN8WJ9Z9OI8 tag=JP04MVREDMEL type=del 2024-03-09T14:37:05.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.475+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=4KSX0ZF0LTG1 type=del size=4075330 2024-03-09T14:37:05.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.479+0000 7fd389e788c0 1 < completed delete operation key=PKVYD8DWS7M2 tag=GAZUDQGXVC3J type=del 2024-03-09T14:37:05.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.479+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=P4K2LGMK7S62 type=del size=3511303 2024-03-09T14:37:05.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.483+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~MZB1U00U3F99.0 size=1048576 2024-03-09T14:37:05.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.487+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~MZB1U00U3F99.1 size=1048576 2024-03-09T14:37:05.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.487+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~MZB1U00U3F99.2 size=550239 2024-03-09T14:37:05.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.491+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=MZB1U00U3F99 tag=ECBHCJ1ATPJP type=write size=3695967 2024-03-09T14:37:05.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.495+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~3M9FNJSIZ2VF.0 size=1048576 2024-03-09T14:37:05.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.499+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~3M9FNJSIZ2VF.1 size=1048576 2024-03-09T14:37:05.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.499+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~3M9FNJSIZ2VF.2 size=281029 2024-03-09T14:37:05.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.499+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=3M9FNJSIZ2VF tag=TI1R2TGRNNYN type=write size=3426757 2024-03-09T14:37:05.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.503+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~KI4GYKBVSNMP.0 size=1048576 2024-03-09T14:37:05.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.507+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~KI4GYKBVSNMP.1 size=244166 2024-03-09T14:37:05.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.511+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=KI4GYKBVSNMP tag=VIDUFAK3QS8M type=write size=2341318 2024-03-09T14:37:05.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.511+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=W6KDATI4ET1X type=write size=218123 2024-03-09T14:37:05.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.515+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=Y873KWF350RQ type=del 2024-03-09T14:37:05.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.519+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=MUBHVO6YCS40 type=del size=1798732 2024-03-09T14:37:05.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.523+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~41F1WKOL8A1S.0 size=1048576 2024-03-09T14:37:05.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.523+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~41F1WKOL8A1S.1 size=1048576 2024-03-09T14:37:05.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.527+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~41F1WKOL8A1S.2 size=405084 2024-03-09T14:37:05.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.531+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=41F1WKOL8A1S tag=AV8096351QMN type=write size=3550812 2024-03-09T14:37:05.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.531+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=X98OSSBR3RFQ type=del size=2647498 2024-03-09T14:37:05.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.535+0000 7fd389e788c0 1 < canceled operation key=71692MJQITX3 tag=KXQ2L0WSZZ22 type=del size=1243452 2024-03-09T14:37:05.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.539+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~M2Y5QRE412R1.0 size=289313 2024-03-09T14:37:05.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.539+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=M2Y5QRE412R1 tag=L7IWGOBHNIB9 type=write size=1337889 2024-03-09T14:37:05.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.543+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~TVM2UI3LP8F8.0 size=418619 2024-03-09T14:37:05.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.547+0000 7fd389e788c0 1 < completed multipart upload key=P83H9137MI7Y upload=TVM2UI3LP8F8 tag=AE2H19UKA3YP type=write size=1467195 2024-03-09T14:37:05.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.555+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~Z6HL7BKC36XQ.0 size=50598 2024-03-09T14:37:05.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.555+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=Z6HL7BKC36XQ tag=OR6G718ZKFQ1 type=write size=1099174 2024-03-09T14:37:05.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.559+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~73CG3QTDHCV2.0 size=1048576 2024-03-09T14:37:05.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.559+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~73CG3QTDHCV2.1 size=1048576 2024-03-09T14:37:05.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.563+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~73CG3QTDHCV2.2 size=714165 2024-03-09T14:37:05.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.567+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=73CG3QTDHCV2 tag=KOL2WS229IVC type=write size=3859893 2024-03-09T14:37:05.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.571+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~LIINCS616JQ7.0 size=1048576 2024-03-09T14:37:05.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.571+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~LIINCS616JQ7.1 size=858675 2024-03-09T14:37:05.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.571+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=LIINCS616JQ7 tag=GT1OUJ50ZDBR type=write size=2955827 2024-03-09T14:37:05.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.575+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~2DG7JSLAPJ41.0 size=1048576 2024-03-09T14:37:05.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.579+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~2DG7JSLAPJ41.1 size=1048576 2024-03-09T14:37:05.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.579+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~2DG7JSLAPJ41.2 size=636175 2024-03-09T14:37:05.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.583+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=2DG7JSLAPJ41 tag=XMJZICRRXAFR type=write size=3781903 2024-03-09T14:37:05.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.587+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=1UI15ZAHWWHF type=del size=3535942 2024-03-09T14:37:05.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.591+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~AJ1EBNW4KNJA.0 size=1048576 2024-03-09T14:37:05.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.591+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~AJ1EBNW4KNJA.1 size=1048576 2024-03-09T14:37:05.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.595+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~AJ1EBNW4KNJA.2 size=922367 2024-03-09T14:37:05.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.599+0000 7fd389e788c0 1 < completed multipart upload key=DIN8WJ9Z9OI8 upload=AJ1EBNW4KNJA tag=FJNAO728D0YE type=write size=4068095 2024-03-09T14:37:05.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.603+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~CYOS6C0PA3WR.0 size=1048576 2024-03-09T14:37:05.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.603+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~CYOS6C0PA3WR.1 size=336676 2024-03-09T14:37:05.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.603+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=CYOS6C0PA3WR tag=J3FW2TOXM0DC type=write size=2433828 2024-03-09T14:37:05.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.607+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~M0YN8E65YDMP.0 size=1048576 2024-03-09T14:37:05.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.607+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~M0YN8E65YDMP.1 size=1048576 2024-03-09T14:37:05.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.611+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~M0YN8E65YDMP.2 size=788347 2024-03-09T14:37:05.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.615+0000 7fd389e788c0 1 < completed multipart upload key=71692MJQITX3 upload=M0YN8E65YDMP tag=NMJEG4EWVLKO type=write size=3934075 2024-03-09T14:37:05.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.619+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~AGXJ8VHP65S4.0 size=1048576 2024-03-09T14:37:05.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.623+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~AGXJ8VHP65S4.1 size=1048576 2024-03-09T14:37:05.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.623+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~AGXJ8VHP65S4.2 size=501384 2024-03-09T14:37:05.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.623+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=AGXJ8VHP65S4 tag=KUUZB5VBE7KA type=write size=3647112 2024-03-09T14:37:05.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.627+0000 7fd389e788c0 1 < completed delete operation key=YR2VX4QLOCOG tag=XPL9P0KRRQPF type=del 2024-03-09T14:37:05.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.627+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=WPH0W6AEC76J type=del size=1293702 2024-03-09T14:37:05.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.631+0000 7fd389e788c0 1 < completed delete operation key=DIN8WJ9Z9OI8 tag=KL2ILLT9OCQ1 type=del 2024-03-09T14:37:05.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.635+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=26Y7AENXVAYQ type=del size=884330 2024-03-09T14:37:05.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.635+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=3AW7KV90UYZV type=del 2024-03-09T14:37:05.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.643+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~FACPB9SIVXDO.0 size=1017592 2024-03-09T14:37:05.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.643+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=FACPB9SIVXDO tag=RHZK80SSTKEZ type=write size=2066168 2024-03-09T14:37:05.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.643+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~UW0UG3NUOMUJ.0 size=1048576 2024-03-09T14:37:05.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.647+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~UW0UG3NUOMUJ.1 size=1048576 2024-03-09T14:37:05.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.647+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~UW0UG3NUOMUJ.2 size=539351 2024-03-09T14:37:05.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.651+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=UW0UG3NUOMUJ tag=POAEPH7O8GF6 type=write size=3685079 2024-03-09T14:37:05.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.651+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=MOX2UXXWPMDZ type=del size=3248301 2024-03-09T14:37:05.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.655+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=4KSX0ZF0LTG1 type=del 2024-03-09T14:37:05.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.659+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=6IEV04FQFCUD type=write size=276832 2024-03-09T14:37:05.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.663+0000 7fd389e788c0 1 < suggested update operation key=1K5KR8U3GCOV tag=P4K2LGMK7S62 type=del size=3511303 2024-03-09T14:37:05.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.867+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=P1HSQVRBO09S type=del size=2667550 2024-03-09T14:37:05.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.871+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~3M9FNJSIZ2VF.0 size=1048576 2024-03-09T14:37:05.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.875+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~3M9FNJSIZ2VF.1 size=1048576 2024-03-09T14:37:05.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.879+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~3M9FNJSIZ2VF.2 size=281029 2024-03-09T14:37:05.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.883+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=3M9FNJSIZ2VF tag=TI1R2TGRNNYN type=write size=3426757 2024-03-09T14:37:05.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.887+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=XNO1U9UGVASM type=del size=2220430 2024-03-09T14:37:05.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.895+0000 7fd389e788c0 1 < suggested update operation key=E2VP0TJ37UX8 tag=W6KDATI4ET1X type=write size=218123 2024-03-09T14:37:05.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.899+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=6R1ZRDIDZCFX type=del size=2617859 2024-03-09T14:37:05.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.899+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=MUBHVO6YCS40 type=del 2024-03-09T14:37:05.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.907+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~U3US0U4LFCUU.0 size=1048576 2024-03-09T14:37:05.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.911+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~U3US0U4LFCUU.1 size=1048576 2024-03-09T14:37:05.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.911+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~U3US0U4LFCUU.2 size=423947 2024-03-09T14:37:05.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.911+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=U3US0U4LFCUU tag=TMEOWQ3TL0HT type=write size=3569675 2024-03-09T14:37:05.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.919+0000 7fd389e788c0 1 < suggested update operation key=8J6Z9DT07H0X tag=X98OSSBR3RFQ type=del size=2647498 2024-03-09T14:37:05.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.923+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=Q2398HA2HIKT type=del size=1452937 2024-03-09T14:37:05.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.927+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~M2Y5QRE412R1.0 size=289313 2024-03-09T14:37:05.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.935+0000 7fd389e788c0 1 < completed multipart upload key=71692MJQITX3 upload=M2Y5QRE412R1 tag=L7IWGOBHNIB9 type=write size=1337889 2024-03-09T14:37:05.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.939+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=C29BEVL38WKU type=del size=3626217 2024-03-09T14:37:05.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.943+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~Z6HL7BKC36XQ.0 size=50598 2024-03-09T14:37:05.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.947+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=Z6HL7BKC36XQ tag=OR6G718ZKFQ1 type=write size=1099174 2024-03-09T14:37:05.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.955+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~WQNJKM492G42.0 size=1048576 2024-03-09T14:37:05.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.959+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~WQNJKM492G42.1 size=1048576 2024-03-09T14:37:05.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.959+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~WQNJKM492G42.2 size=990722 2024-03-09T14:37:05.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.959+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=WQNJKM492G42 tag=1Q597NK6W2ZQ type=write size=4136450 2024-03-09T14:37:05.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.963+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~LIINCS616JQ7.0 size=1048576 2024-03-09T14:37:05.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.967+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~LIINCS616JQ7.1 size=858675 2024-03-09T14:37:05.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.971+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=LIINCS616JQ7 tag=GT1OUJ50ZDBR type=write size=2955827 2024-03-09T14:37:05.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.975+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=SLE2EZPAOQW8 type=del size=91693 2024-03-09T14:37:05.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.979+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=1UI15ZAHWWHF type=del 2024-03-09T14:37:05.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.983+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=3B3ABJIT6Q0U type=del size=310411 2024-03-09T14:37:05.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.987+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~CYOS6C0PA3WR.0 size=1048576 2024-03-09T14:37:05.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.987+0000 7fd389e788c0 1 < canceled part key=_multipart_PKVYD8DWS7M2.2~CYOS6C0PA3WR.1 size=336676 2024-03-09T14:37:05.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.991+0000 7fd389e788c0 1 < canceled multipart upload key=PKVYD8DWS7M2 upload=CYOS6C0PA3WR tag=J3FW2TOXM0DC type=write size=2433828 2024-03-09T14:37:05.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.995+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=V3W6KD0QLBR3 type=del size=1970759 2024-03-09T14:37:05.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:05.999+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~AGXJ8VHP65S4.0 size=1048576 2024-03-09T14:37:06.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.003+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~AGXJ8VHP65S4.1 size=1048576 2024-03-09T14:37:06.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.003+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~AGXJ8VHP65S4.2 size=501384 2024-03-09T14:37:06.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.011+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=AGXJ8VHP65S4 tag=KUUZB5VBE7KA type=write size=3647112 2024-03-09T14:37:06.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.015+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=7JHIYBKXJYR7 type=del size=3559221 2024-03-09T14:37:06.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.015+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=WPH0W6AEC76J type=del 2024-03-09T14:37:06.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.019+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=OB55YXIOCRZ3 type=del size=741875 2024-03-09T14:37:06.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.023+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=26Y7AENXVAYQ type=del 2024-03-09T14:37:06.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.031+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~6QRQ4PVQW2IC.0 size=1048576 2024-03-09T14:37:06.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.031+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~6QRQ4PVQW2IC.1 size=1048576 2024-03-09T14:37:06.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.035+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~6QRQ4PVQW2IC.2 size=379474 2024-03-09T14:37:06.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.035+0000 7fd389e788c0 1 > prepared multipart upload key=DIN8WJ9Z9OI8 upload=6QRQ4PVQW2IC tag=KLQES3RMWWSK type=write size=3525202 2024-03-09T14:37:06.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.039+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~FACPB9SIVXDO.0 size=1017592 2024-03-09T14:37:06.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.043+0000 7fd389e788c0 1 < completed multipart upload key=CLAM83TC7RZ7 upload=FACPB9SIVXDO tag=RHZK80SSTKEZ type=write size=2066168 2024-03-09T14:37:06.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.047+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=VP5ILONO12TT type=del size=4064308 2024-03-09T14:37:06.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.055+0000 7fd389e788c0 1 < suggested remove operation key=AUSZ4JUGI6UU tag=MOX2UXXWPMDZ type=del 2024-03-09T14:37:06.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.063+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~TJ2ZB0XS9RFD.0 size=330730 2024-03-09T14:37:06.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.063+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=TJ2ZB0XS9RFD tag=YUCC2TWBLKLL type=write size=1379306 2024-03-09T14:37:06.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.067+0000 7fd389e788c0 1 < suggested remove operation key=UMT7VKZ9R4IR tag=6IEV04FQFCUD type=write 2024-03-09T14:37:06.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.075+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~VOOMAIB878WZ.0 size=1048576 2024-03-09T14:37:06.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.079+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~VOOMAIB878WZ.1 size=1048576 2024-03-09T14:37:06.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.079+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~VOOMAIB878WZ.2 size=48282 2024-03-09T14:37:06.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.079+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=VOOMAIB878WZ tag=GD501JSB3L9F type=write size=3194010 2024-03-09T14:37:06.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.083+0000 7fd389e788c0 -1 < failed to complete operation key=E2VP0TJ37UX8 tag=P1HSQVRBO09S type=del size=2667550: (22) Invalid argument 2024-03-09T14:37:06.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.087+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=J2VC04YIXW6F type=del size=1598453 2024-03-09T14:37:06.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.091+0000 7fd389e788c0 -1 < failed to complete operation key=8J6Z9DT07H0X tag=XNO1U9UGVASM type=del size=2220430: (22) Invalid argument 2024-03-09T14:37:06.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.095+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=JUIPOBU3J0F0 type=del size=656218 2024-03-09T14:37:06.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.095+0000 7fd389e788c0 -1 < failed to complete operation key=8J6Z9DT07H0X tag=6R1ZRDIDZCFX type=del size=2617859: (22) Invalid argument 2024-03-09T14:37:06.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.099+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=C163BGHNHBAQ type=del size=2993861 2024-03-09T14:37:06.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.103+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~U3US0U4LFCUU.0 size=1048576 2024-03-09T14:37:06.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.107+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~U3US0U4LFCUU.1 size=1048576 2024-03-09T14:37:06.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.111+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~U3US0U4LFCUU.2 size=423947 2024-03-09T14:37:06.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.115+0000 7fd389e788c0 1 < completed multipart upload key=Z18Q66VI5PDN upload=U3US0U4LFCUU tag=TMEOWQ3TL0HT type=write size=3569675 2024-03-09T14:37:06.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.119+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=JD5L79SIZYUL type=del size=80542 2024-03-09T14:37:06.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.127+0000 7fd389e788c0 1 < suggested update operation key=Y7E2TLASJM9T tag=Q2398HA2HIKT type=del size=1452937 2024-03-09T14:37:06.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.131+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=SEG0Z4Y2VDO3 type=write size=24026 2024-03-09T14:37:06.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.135+0000 7fd389e788c0 1 < canceled operation key=GSNWWDS63MTA tag=C29BEVL38WKU type=del size=3626217 2024-03-09T14:37:06.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.135+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=1UWSD872KPW4 type=del size=3730899 2024-03-09T14:37:06.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.139+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~WQNJKM492G42.0 size=1048576 2024-03-09T14:37:06.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.147+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~WQNJKM492G42.1 size=1048576 2024-03-09T14:37:06.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.147+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~WQNJKM492G42.2 size=990722 2024-03-09T14:37:06.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.155+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=WQNJKM492G42 tag=1Q597NK6W2ZQ type=write size=4136450 2024-03-09T14:37:06.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.163+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~I4PEYP38ONQG.0 size=1048576 2024-03-09T14:37:06.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.163+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~I4PEYP38ONQG.1 size=672074 2024-03-09T14:37:06.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.163+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=I4PEYP38ONQG tag=AYRFVROTAO5S type=write size=2769226 2024-03-09T14:37:06.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.167+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=SLE2EZPAOQW8 type=del 2024-03-09T14:37:06.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.175+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~ED0MPX2ISFYE.0 size=1048576 2024-03-09T14:37:06.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.175+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~ED0MPX2ISFYE.1 size=1048576 2024-03-09T14:37:06.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.179+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~ED0MPX2ISFYE.2 size=521725 2024-03-09T14:37:06.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.179+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=ED0MPX2ISFYE tag=6C83IQH6DY2K type=write size=3667453 2024-03-09T14:37:06.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.183+0000 7fd389e788c0 1 < suggested update operation key=5ZEDXFB9B3CN tag=3B3ABJIT6Q0U type=del size=310411 2024-03-09T14:37:06.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.187+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=MEES5OJRAZMF type=del size=3659372 2024-03-09T14:37:06.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.191+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=V3W6KD0QLBR3 type=del 2024-03-09T14:37:06.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.199+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~J3HFSOGA18XL.0 size=1048576 2024-03-09T14:37:06.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.199+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~J3HFSOGA18XL.1 size=1048576 2024-03-09T14:37:06.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.203+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~J3HFSOGA18XL.2 size=550818 2024-03-09T14:37:06.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.203+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=J3HFSOGA18XL tag=GZS6JKVKA0PA type=write size=3696546 2024-03-09T14:37:06.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.207+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=7JHIYBKXJYR7 type=del 2024-03-09T14:37:06.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.211+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~A0P6SIWAJNU3.0 size=1048576 2024-03-09T14:37:06.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.215+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~A0P6SIWAJNU3.1 size=1048576 2024-03-09T14:37:06.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.219+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~A0P6SIWAJNU3.2 size=792940 2024-03-09T14:37:06.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.219+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=A0P6SIWAJNU3 tag=PUWLFPSUS5W7 type=write size=3938668 2024-03-09T14:37:06.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.219+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=OB55YXIOCRZ3 type=del 2024-03-09T14:37:06.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.227+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~I6JC1H2K9PDZ.0 size=1048576 2024-03-09T14:37:06.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.231+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~I6JC1H2K9PDZ.1 size=697119 2024-03-09T14:37:06.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.231+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=I6JC1H2K9PDZ tag=3CN3Z52WFTG6 type=write size=2794271 2024-03-09T14:37:06.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.231+0000 7fd389e788c0 1 < canceled part key=_multipart_DIN8WJ9Z9OI8.2~6QRQ4PVQW2IC.0 size=1048576 2024-03-09T14:37:06.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.235+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~6QRQ4PVQW2IC.1 size=1048576 2024-03-09T14:37:06.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.235+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~6QRQ4PVQW2IC.2 size=379474 2024-03-09T14:37:06.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.243+0000 7fd389e788c0 1 < canceled multipart upload key=DIN8WJ9Z9OI8 upload=6QRQ4PVQW2IC tag=KLQES3RMWWSK type=write size=3525202 2024-03-09T14:37:06.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.247+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~C0V2PAR8M0WV.0 size=1048576 2024-03-09T14:37:06.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.251+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~C0V2PAR8M0WV.1 size=1048576 2024-03-09T14:37:06.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.255+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~C0V2PAR8M0WV.2 size=87936 2024-03-09T14:37:06.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.255+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=C0V2PAR8M0WV tag=AJ0VN660D1SB type=write size=3233664 2024-03-09T14:37:06.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.255+0000 7fd389e788c0 1 < completed delete operation key=E2VP0TJ37UX8 tag=VP5ILONO12TT type=del 2024-03-09T14:37:06.260 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.259+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=JJDNLVDXQ132 type=del size=781656 2024-03-09T14:37:06.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.259+0000 7fd389e788c0 1 < canceled part key=_multipart_CLAM83TC7RZ7.2~TJ2ZB0XS9RFD.0 size=330730 2024-03-09T14:37:06.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.267+0000 7fd389e788c0 1 < canceled multipart upload key=CLAM83TC7RZ7 upload=TJ2ZB0XS9RFD tag=YUCC2TWBLKLL type=write size=1379306 2024-03-09T14:37:06.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.271+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~QSLC3P9SB0Q4.0 size=1048576 2024-03-09T14:37:06.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.275+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~QSLC3P9SB0Q4.1 size=1048576 2024-03-09T14:37:06.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.279+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~QSLC3P9SB0Q4.2 size=805174 2024-03-09T14:37:06.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.279+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=QSLC3P9SB0Q4 tag=I3J7VR3U1KK0 type=write size=3950902 2024-03-09T14:37:06.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.279+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~VOOMAIB878WZ.0 size=1048576 2024-03-09T14:37:06.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.283+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~VOOMAIB878WZ.1 size=1048576 2024-03-09T14:37:06.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.283+0000 7fd389e788c0 1 < canceled part key=_multipart_5ZEDXFB9B3CN.2~VOOMAIB878WZ.2 size=48282 2024-03-09T14:37:06.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.291+0000 7fd389e788c0 1 < canceled multipart upload key=5ZEDXFB9B3CN upload=VOOMAIB878WZ tag=GD501JSB3L9F type=write size=3194010 2024-03-09T14:37:06.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.291+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=7C1MTRSZ47C0 type=del size=1495809 2024-03-09T14:37:06.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.299+0000 7fd389e788c0 1 < suggested update operation key=61RC3GUU437B tag=J2VC04YIXW6F type=del size=1598453 2024-03-09T14:37:06.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.307+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~6J91CXMX3FSZ.0 size=1048576 2024-03-09T14:37:06.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.307+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~6J91CXMX3FSZ.1 size=1048576 2024-03-09T14:37:06.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.311+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~6J91CXMX3FSZ.2 size=218455 2024-03-09T14:37:06.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.311+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=6J91CXMX3FSZ tag=GJ1MZVHL7V55 type=write size=3364183 2024-03-09T14:37:06.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.315+0000 7fd389e788c0 1 < suggested remove operation key=K9X2N6V8R4BY tag=JUIPOBU3J0F0 type=del 2024-03-09T14:37:06.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.319+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=L16RLP7O5EGK type=del size=241057 2024-03-09T14:37:06.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.323+0000 7fd389e788c0 1 < canceled operation key=MHT268M7S2TY tag=C163BGHNHBAQ type=del size=2993861 2024-03-09T14:37:06.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.327+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=P0XS6CGBU8W0 type=write size=920278 2024-03-09T14:37:06.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.331+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=JD5L79SIZYUL type=del 2024-03-09T14:37:06.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.335+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=GV9BREA09Z3L type=del size=314399 2024-03-09T14:37:06.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.335+0000 7fd389e788c0 1 < completed write operation key=MHT268M7S2TY tag=SEG0Z4Y2VDO3 type=write size=24026 2024-03-09T14:37:06.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.343+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~DZQOGWYFD47Q.0 size=1048576 2024-03-09T14:37:06.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.347+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~DZQOGWYFD47Q.1 size=771500 2024-03-09T14:37:06.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.347+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=DZQOGWYFD47Q tag=P3YNPHLTFMUE type=write size=2868652 2024-03-09T14:37:06.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.347+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=1UWSD872KPW4 type=del 2024-03-09T14:37:06.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.351+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=V9VP0QJ8EU0E type=del size=267093 2024-03-09T14:37:06.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.355+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~I4PEYP38ONQG.0 size=1048576 2024-03-09T14:37:06.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.359+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~I4PEYP38ONQG.1 size=672074 2024-03-09T14:37:06.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.363+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=I4PEYP38ONQG tag=AYRFVROTAO5S type=write size=2769226 2024-03-09T14:37:06.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.367+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=OM7H73L6JC7Z type=del size=856430 2024-03-09T14:37:06.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.367+0000 7fd389e788c0 1 < canceled part key=_multipart_I4NA328AI5T1.2~ED0MPX2ISFYE.0 size=1048576 2024-03-09T14:37:06.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.371+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~ED0MPX2ISFYE.1 size=1048576 2024-03-09T14:37:06.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.371+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~ED0MPX2ISFYE.2 size=521725 2024-03-09T14:37:06.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.379+0000 7fd389e788c0 1 < canceled multipart upload key=I4NA328AI5T1 upload=ED0MPX2ISFYE tag=6C83IQH6DY2K type=write size=3667453 2024-03-09T14:37:06.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.383+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~SXFW74WL5CK8.0 size=1048576 2024-03-09T14:37:06.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.387+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~SXFW74WL5CK8.1 size=1048576 2024-03-09T14:37:06.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.391+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~SXFW74WL5CK8.2 size=856012 2024-03-09T14:37:06.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.391+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=SXFW74WL5CK8 tag=1ERGUIDAQZ2X type=write size=4001740 2024-03-09T14:37:06.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.391+0000 7fd389e788c0 1 < canceled operation key=8J6Z9DT07H0X tag=MEES5OJRAZMF type=del size=3659372 2024-03-09T14:37:06.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.395+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=YSBBCZ61A8RY type=del size=1527931 2024-03-09T14:37:06.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.399+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~J3HFSOGA18XL.0 size=1048576 2024-03-09T14:37:06.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.403+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~J3HFSOGA18XL.1 size=1048576 2024-03-09T14:37:06.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.403+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~J3HFSOGA18XL.2 size=550818 2024-03-09T14:37:06.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.411+0000 7fd389e788c0 1 < completed multipart upload key=CLAM83TC7RZ7 upload=J3HFSOGA18XL tag=GZS6JKVKA0PA type=write size=3696546 2024-03-09T14:37:06.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.415+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~CB2NB70ZJ7FL.0 size=1048576 2024-03-09T14:37:06.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.419+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~CB2NB70ZJ7FL.1 size=1048576 2024-03-09T14:37:06.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.419+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~CB2NB70ZJ7FL.2 size=120574 2024-03-09T14:37:06.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.419+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=CB2NB70ZJ7FL tag=NQO3LSI49N6K type=write size=3266302 2024-03-09T14:37:06.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.423+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~A0P6SIWAJNU3.0 size=1048576 2024-03-09T14:37:06.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.427+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~A0P6SIWAJNU3.1 size=1048576 2024-03-09T14:37:06.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.427+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~A0P6SIWAJNU3.2 size=792940 2024-03-09T14:37:06.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.431+0000 7fd389e788c0 1 < completed multipart upload key=8J6Z9DT07H0X upload=A0P6SIWAJNU3 tag=PUWLFPSUS5W7 type=write size=3938668 2024-03-09T14:37:06.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.435+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=5SADHX6X25RZ type=del size=2372190 2024-03-09T14:37:06.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.435+0000 7fd389e788c0 1 < canceled part key=_multipart_E2VP0TJ37UX8.2~I6JC1H2K9PDZ.0 size=1048576 2024-03-09T14:37:06.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.439+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~I6JC1H2K9PDZ.1 size=697119 2024-03-09T14:37:06.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.447+0000 7fd389e788c0 1 < canceled multipart upload key=E2VP0TJ37UX8 upload=I6JC1H2K9PDZ tag=3CN3Z52WFTG6 type=write size=2794271 2024-03-09T14:37:06.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.451+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=RCVEJZ990MX3 type=del size=3504632 2024-03-09T14:37:06.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.455+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~C0V2PAR8M0WV.0 size=1048576 2024-03-09T14:37:06.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.455+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~C0V2PAR8M0WV.1 size=1048576 2024-03-09T14:37:06.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.459+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~C0V2PAR8M0WV.2 size=87936 2024-03-09T14:37:06.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.463+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=C0V2PAR8M0WV tag=AJ0VN660D1SB type=write size=3233664 2024-03-09T14:37:06.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.467+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=62Q1X8W98AX5 type=del size=303830 2024-03-09T14:37:06.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.471+0000 7fd389e788c0 1 < canceled operation key=PKVYD8DWS7M2 tag=JJDNLVDXQ132 type=del size=781656 2024-03-09T14:37:06.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.475+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~JTOGV1C6CRMP.0 size=741956 2024-03-09T14:37:06.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.475+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=JTOGV1C6CRMP tag=ROYYVSMF045L type=write size=1790532 2024-03-09T14:37:06.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.479+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~QSLC3P9SB0Q4.0 size=1048576 2024-03-09T14:37:06.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.483+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~QSLC3P9SB0Q4.1 size=1048576 2024-03-09T14:37:06.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.487+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~QSLC3P9SB0Q4.2 size=805174 2024-03-09T14:37:06.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.491+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=QSLC3P9SB0Q4 tag=I3J7VR3U1KK0 type=write size=3950902 2024-03-09T14:37:06.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.495+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=TE7UAL5DNTEQ type=write size=850703 2024-03-09T14:37:06.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.499+0000 7fd389e788c0 1 < suggested update operation key=1KJK6PF6U226 tag=7C1MTRSZ47C0 type=del size=1495809 2024-03-09T14:37:06.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.503+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=9V533YBJ4CQJ type=write size=613667 2024-03-09T14:37:06.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.507+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~6J91CXMX3FSZ.0 size=1048576 2024-03-09T14:37:06.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.511+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~6J91CXMX3FSZ.1 size=1048576 2024-03-09T14:37:06.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.511+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~6J91CXMX3FSZ.2 size=218455 2024-03-09T14:37:06.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.519+0000 7fd389e788c0 1 < completed multipart upload key=8J6Z9DT07H0X upload=6J91CXMX3FSZ tag=GJ1MZVHL7V55 type=write size=3364183 2024-03-09T14:37:06.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.519+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=V1KSUN3TYEWN type=del size=2947832 2024-03-09T14:37:06.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.527+0000 7fd389e788c0 1 < suggested update operation key=YR2VX4QLOCOG tag=L16RLP7O5EGK type=del size=241057 2024-03-09T14:37:06.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.531+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~U0WXIOITLDTO.0 size=1048576 2024-03-09T14:37:06.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.535+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~U0WXIOITLDTO.1 size=1048576 2024-03-09T14:37:06.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.535+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~U0WXIOITLDTO.2 size=986809 2024-03-09T14:37:06.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.535+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=U0WXIOITLDTO tag=FTWV799696L7 type=write size=4132537 2024-03-09T14:37:06.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.543+0000 7fd389e788c0 1 < suggested update operation key=PZJT6RWRJFIN tag=P0XS6CGBU8W0 type=write size=920278 2024-03-09T14:37:06.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.551+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~BMX6TCG6FC8M.0 size=1048576 2024-03-09T14:37:06.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.551+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~BMX6TCG6FC8M.1 size=357468 2024-03-09T14:37:06.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.551+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=BMX6TCG6FC8M tag=CHGQ0T9N94VJ type=write size=2454620 2024-03-09T14:37:06.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.555+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=GV9BREA09Z3L type=del 2024-03-09T14:37:06.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.563+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~I6OJXSQY2O4B.0 size=301459 2024-03-09T14:37:06.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.563+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=I6OJXSQY2O4B tag=PSCYPLYOV53E type=write size=1350035 2024-03-09T14:37:06.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.567+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~DZQOGWYFD47Q.0 size=1048576 2024-03-09T14:37:06.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.567+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~DZQOGWYFD47Q.1 size=771500 2024-03-09T14:37:06.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.575+0000 7fd389e788c0 1 < completed multipart upload key=IXKMXJ9IZ69S upload=DZQOGWYFD47Q tag=P3YNPHLTFMUE type=write size=2868652 2024-03-09T14:37:06.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.575+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=LYU8Z5M2BJ02 type=del size=2979107 2024-03-09T14:37:06.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.583+0000 7fd389e788c0 1 < suggested remove operation key=YR2VX4QLOCOG tag=V9VP0QJ8EU0E type=del 2024-03-09T14:37:06.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.587+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=P5FTBAAA40XJ type=del size=473919 2024-03-09T14:37:06.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.591+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=OM7H73L6JC7Z type=del 2024-03-09T14:37:06.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.595+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=H6NII16VACBG type=del size=429672 2024-03-09T14:37:06.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.599+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~SXFW74WL5CK8.0 size=1048576 2024-03-09T14:37:06.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.599+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~SXFW74WL5CK8.1 size=1048576 2024-03-09T14:37:06.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.599+0000 7fd389e788c0 1 < canceled part key=_multipart_FY02AR9GS3KG.2~SXFW74WL5CK8.2 size=856012 2024-03-09T14:37:06.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.607+0000 7fd389e788c0 1 < canceled multipart upload key=FY02AR9GS3KG upload=SXFW74WL5CK8 tag=1ERGUIDAQZ2X type=write size=4001740 2024-03-09T14:37:06.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.607+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=0GJ7WWQ0XXS3 type=write size=547515 2024-03-09T14:37:06.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.611+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=YSBBCZ61A8RY type=del 2024-03-09T14:37:06.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.619+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~GHWEY988863W.0 size=1048576 2024-03-09T14:37:06.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.619+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~GHWEY988863W.1 size=1048576 2024-03-09T14:37:06.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.623+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~GHWEY988863W.2 size=894409 2024-03-09T14:37:06.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.623+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=GHWEY988863W tag=EII4ZRNW55QZ type=write size=4040137 2024-03-09T14:37:06.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.623+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~CB2NB70ZJ7FL.0 size=1048576 2024-03-09T14:37:06.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.627+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~CB2NB70ZJ7FL.1 size=1048576 2024-03-09T14:37:06.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.631+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~CB2NB70ZJ7FL.2 size=120574 2024-03-09T14:37:06.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.635+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=CB2NB70ZJ7FL tag=NQO3LSI49N6K type=write size=3266302 2024-03-09T14:37:06.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.639+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=MWG1WBQEFSQT type=del size=2152804 2024-03-09T14:37:06.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.639+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=5SADHX6X25RZ type=del 2024-03-09T14:37:06.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.643+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=G4IEWLGBNRC0 type=del size=408550 2024-03-09T14:37:06.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.647+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=RCVEJZ990MX3 type=del 2024-03-09T14:37:06.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.651+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=OQ72NI959ZZG type=del size=3193379 2024-03-09T14:37:06.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.655+0000 7fd389e788c0 1 < suggested update operation key=AUSZ4JUGI6UU tag=62Q1X8W98AX5 type=del size=303830 2024-03-09T14:37:06.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.659+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~DMIA0ITYO27U.0 size=1048576 2024-03-09T14:37:06.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.663+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~DMIA0ITYO27U.1 size=1048576 2024-03-09T14:37:06.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.667+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~DMIA0ITYO27U.2 size=299168 2024-03-09T14:37:06.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.667+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=DMIA0ITYO27U tag=5EWG8Y02BTV5 type=write size=3444896 2024-03-09T14:37:06.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.667+0000 7fd389e788c0 1 < canceled part key=_multipart_P83H9137MI7Y.2~JTOGV1C6CRMP.0 size=741956 2024-03-09T14:37:06.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.671+0000 7fd389e788c0 1 < canceled multipart upload key=P83H9137MI7Y upload=JTOGV1C6CRMP tag=ROYYVSMF045L type=write size=1790532 2024-03-09T14:37:06.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.675+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~9EX8IJROKT0Y.0 size=1048576 2024-03-09T14:37:06.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.679+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~9EX8IJROKT0Y.1 size=729084 2024-03-09T14:37:06.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.679+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=9EX8IJROKT0Y tag=5EQW9928YGXJ type=write size=2826236 2024-03-09T14:37:06.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.679+0000 7fd389e788c0 1 < completed write operation key=U8P5Q3D11MM6 tag=TE7UAL5DNTEQ type=write size=850703 2024-03-09T14:37:06.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.683+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=9QOY4KZIL6IN type=del size=2263829 2024-03-09T14:37:06.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.687+0000 7fd389e788c0 1 < completed write operation key=CLAM83TC7RZ7 tag=9V533YBJ4CQJ type=write size=613667 2024-03-09T14:37:06.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.691+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=UI37PV5OR4HR type=del size=2861178 2024-03-09T14:37:06.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.695+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=V1KSUN3TYEWN type=del 2024-03-09T14:37:06.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.695+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=LPQ8LCA9WB3K type=write size=120471 2024-03-09T14:37:06.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.699+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~U0WXIOITLDTO.0 size=1048576 2024-03-09T14:37:06.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.703+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~U0WXIOITLDTO.1 size=1048576 2024-03-09T14:37:06.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.703+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~U0WXIOITLDTO.2 size=986809 2024-03-09T14:37:06.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.711+0000 7fd389e788c0 1 < completed multipart upload key=IXKMXJ9IZ69S upload=U0WXIOITLDTO tag=FTWV799696L7 type=write size=4132537 2024-03-09T14:37:06.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.711+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=XK83V5JY3T4Q type=del size=2044957 2024-03-09T14:37:06.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.715+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~BMX6TCG6FC8M.0 size=1048576 2024-03-09T14:37:06.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.723+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~BMX6TCG6FC8M.1 size=357468 2024-03-09T14:37:06.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.727+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=BMX6TCG6FC8M tag=CHGQ0T9N94VJ type=write size=2454620 2024-03-09T14:37:06.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.731+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~4KUSRFPVLF2A.0 size=1048576 2024-03-09T14:37:06.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.735+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~4KUSRFPVLF2A.1 size=26299 2024-03-09T14:37:06.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.735+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=4KUSRFPVLF2A tag=G7RXSUS5V8UG type=write size=2123451 2024-03-09T14:37:06.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.739+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~I6OJXSQY2O4B.0 size=301459 2024-03-09T14:37:06.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.743+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=I6OJXSQY2O4B tag=PSCYPLYOV53E type=write size=1350035 2024-03-09T14:37:06.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.747+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=X8FNKNISIQDW type=del size=541168 2024-03-09T14:37:06.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.755+0000 7fd389e788c0 1 < suggested remove operation key=Y7E2TLASJM9T tag=LYU8Z5M2BJ02 type=del 2024-03-09T14:37:06.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.755+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=3XCP8710BT22 type=write size=141399 2024-03-09T14:37:06.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.759+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=P5FTBAAA40XJ type=del 2024-03-09T14:37:06.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.763+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=A13PQFMQGKZT type=del size=836139 2024-03-09T14:37:06.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.767+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=H6NII16VACBG type=del 2024-03-09T14:37:06.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.767+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=SQT68IXL0D78 type=del size=781846 2024-03-09T14:37:06.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.771+0000 7fd389e788c0 1 < completed write operation key=UMT7VKZ9R4IR tag=0GJ7WWQ0XXS3 type=write size=547515 2024-03-09T14:37:06.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.779+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~0EINR63VBA1M.0 size=1048576 2024-03-09T14:37:06.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.779+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~0EINR63VBA1M.1 size=1048576 2024-03-09T14:37:06.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.783+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~0EINR63VBA1M.2 size=721530 2024-03-09T14:37:06.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.783+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=0EINR63VBA1M tag=5QGF1CM1UHLO type=write size=3867258 2024-03-09T14:37:06.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.787+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~GHWEY988863W.0 size=1048576 2024-03-09T14:37:06.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.791+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~GHWEY988863W.1 size=1048576 2024-03-09T14:37:06.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.791+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~GHWEY988863W.2 size=894409 2024-03-09T14:37:06.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.795+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=GHWEY988863W tag=EII4ZRNW55QZ type=write size=4040137 2024-03-09T14:37:06.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.799+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=VOVSZ0ZVBOIO type=del size=1833237 2024-03-09T14:37:06.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.803+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=MWG1WBQEFSQT type=del 2024-03-09T14:37:06.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.807+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~NV9KRXZLO1YB.0 size=482746 2024-03-09T14:37:06.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.807+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=NV9KRXZLO1YB tag=WB3ZV60FMROV type=write size=1531322 2024-03-09T14:37:06.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.815+0000 7fd389e788c0 1 < suggested update operation key=IXKMXJ9IZ69S tag=G4IEWLGBNRC0 type=del size=408550 2024-03-09T14:37:06.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.819+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=QLEHMAYL9B9O type=del size=3348641 2024-03-09T14:37:06.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.819+0000 7fd389e788c0 -1 < no bi entry to suggest for operation key=Y7E2TLASJM9T tag=OQ72NI959ZZG type=del size=3193379: (2) No such file or directory 2024-03-09T14:37:06.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.823+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~K04K34UZPLDQ.0 size=1048576 2024-03-09T14:37:06.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.827+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~K04K34UZPLDQ.1 size=195853 2024-03-09T14:37:06.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.827+0000 7fd389e788c0 1 > prepared multipart upload key=UMT7VKZ9R4IR upload=K04K34UZPLDQ tag=KXRFX6GHZMX8 type=write size=2293005 2024-03-09T14:37:06.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.827+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~DMIA0ITYO27U.0 size=1048576 2024-03-09T14:37:06.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.831+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~DMIA0ITYO27U.1 size=1048576 2024-03-09T14:37:06.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.835+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~DMIA0ITYO27U.2 size=299168 2024-03-09T14:37:06.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.839+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=DMIA0ITYO27U tag=5EWG8Y02BTV5 type=write size=3444896 2024-03-09T14:37:06.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.843+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=NXBJL2E94UER type=write size=43470 2024-03-09T14:37:06.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.847+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~9EX8IJROKT0Y.0 size=1048576 2024-03-09T14:37:06.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.851+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~9EX8IJROKT0Y.1 size=729084 2024-03-09T14:37:06.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.855+0000 7fd389e788c0 1 < completed multipart upload key=IXKMXJ9IZ69S upload=9EX8IJROKT0Y tag=5EQW9928YGXJ type=write size=2826236 2024-03-09T14:37:06.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.859+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=TIIWTPMMAWV4 type=del size=1332046 2024-03-09T14:37:06.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.867+0000 7fd389e788c0 1 < suggested remove operation key=K9X2N6V8R4BY tag=9QOY4KZIL6IN type=del 2024-03-09T14:37:06.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.871+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~ETKF59L38ZDP.0 size=85618 2024-03-09T14:37:06.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.871+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=ETKF59L38ZDP tag=3SSHBAWNU0YI type=write size=1134194 2024-03-09T14:37:06.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.875+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=UI37PV5OR4HR type=del 2024-03-09T14:37:06.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.879+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=5N09NW4699FC type=del size=3881191 2024-03-09T14:37:06.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.883+0000 7fd389e788c0 1 < completed write operation key=UMT7VKZ9R4IR tag=LPQ8LCA9WB3K type=write size=120471 2024-03-09T14:37:06.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.887+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~EK5KLBMEYG0Y.0 size=1048576 2024-03-09T14:37:06.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.891+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~EK5KLBMEYG0Y.1 size=243706 2024-03-09T14:37:06.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.891+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=EK5KLBMEYG0Y tag=2AG3L5DE4EUO type=write size=2340858 2024-03-09T14:37:06.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.895+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=XK83V5JY3T4Q type=del 2024-03-09T14:37:06.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.895+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=INAYKAQSU5M3 type=del size=3260190 2024-03-09T14:37:06.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.899+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~4KUSRFPVLF2A.0 size=1048576 2024-03-09T14:37:06.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.903+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~4KUSRFPVLF2A.1 size=26299 2024-03-09T14:37:06.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.907+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=4KUSRFPVLF2A tag=G7RXSUS5V8UG type=write size=2123451 2024-03-09T14:37:06.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.911+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=KAMS96ZL3E6G type=del size=2804059 2024-03-09T14:37:06.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.919+0000 7fd389e788c0 1 < suggested update operation key=I4NA328AI5T1 tag=X8FNKNISIQDW type=del size=541168 2024-03-09T14:37:06.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.923+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=SSK99SLK2UQ2 type=del size=2784131 2024-03-09T14:37:06.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.927+0000 7fd389e788c0 1 < completed write operation key=6VT4C288571G tag=3XCP8710BT22 type=write size=141399 2024-03-09T14:37:06.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.931+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=JWIS5R74HXT3 type=del size=3228971 2024-03-09T14:37:06.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.931+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=A13PQFMQGKZT type=del 2024-03-09T14:37:06.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.939+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~AYHKE6QEFTD1.0 size=1048576 2024-03-09T14:37:06.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.939+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~AYHKE6QEFTD1.1 size=257659 2024-03-09T14:37:06.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.939+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=AYHKE6QEFTD1 tag=DSENBB1KIDZM type=write size=2354811 2024-03-09T14:37:06.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.943+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=SQT68IXL0D78 type=del 2024-03-09T14:37:06.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.947+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~B4W6VY4AQM7P.0 size=1048576 2024-03-09T14:37:06.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.951+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~B4W6VY4AQM7P.1 size=769682 2024-03-09T14:37:06.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.951+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=B4W6VY4AQM7P tag=DWF2A5D563D1 type=write size=2866834 2024-03-09T14:37:06.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.955+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~0EINR63VBA1M.0 size=1048576 2024-03-09T14:37:06.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.959+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~0EINR63VBA1M.1 size=1048576 2024-03-09T14:37:06.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.959+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~0EINR63VBA1M.2 size=721530 2024-03-09T14:37:06.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.963+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=0EINR63VBA1M tag=5QGF1CM1UHLO type=write size=3867258 2024-03-09T14:37:06.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.967+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=S404REK3QPKW type=del size=2521399 2024-03-09T14:37:06.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.971+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=VOVSZ0ZVBOIO type=del 2024-03-09T14:37:06.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.975+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=0ETFBVATQORC type=del size=3860980 2024-03-09T14:37:06.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.979+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~NV9KRXZLO1YB.0 size=482746 2024-03-09T14:37:06.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.983+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=NV9KRXZLO1YB tag=WB3ZV60FMROV type=write size=1531322 2024-03-09T14:37:06.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.991+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~GSGME9FXI10Z.0 size=1048576 2024-03-09T14:37:06.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.991+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~GSGME9FXI10Z.1 size=1048576 2024-03-09T14:37:06.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.995+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~GSGME9FXI10Z.2 size=122806 2024-03-09T14:37:06.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.995+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=GSGME9FXI10Z tag=26LZA07ECT6V type=write size=3268534 2024-03-09T14:37:06.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:06.999+0000 7fd389e788c0 1 < completed delete operation key=YR2VX4QLOCOG tag=QLEHMAYL9B9O type=del 2024-03-09T14:37:07.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.003+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~ZTS12NHXGZFX.0 size=1048576 2024-03-09T14:37:07.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.007+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~ZTS12NHXGZFX.1 size=1048576 2024-03-09T14:37:07.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.007+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~ZTS12NHXGZFX.2 size=225407 2024-03-09T14:37:07.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.007+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=ZTS12NHXGZFX tag=1WJOALJ96JY5 type=write size=3371135 2024-03-09T14:37:07.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.011+0000 7fd389e788c0 1 < canceled part key=_multipart_UMT7VKZ9R4IR.2~K04K34UZPLDQ.0 size=1048576 2024-03-09T14:37:07.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.011+0000 7fd389e788c0 1 < canceled part key=_multipart_UMT7VKZ9R4IR.2~K04K34UZPLDQ.1 size=195853 2024-03-09T14:37:07.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.015+0000 7fd389e788c0 1 < canceled multipart upload key=UMT7VKZ9R4IR upload=K04K34UZPLDQ tag=KXRFX6GHZMX8 type=write size=2293005 2024-03-09T14:37:07.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.019+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=DUFQKM7LNJVQ type=del size=1545822 2024-03-09T14:37:07.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.023+0000 7fd389e788c0 1 < suggested update operation key=CLAM83TC7RZ7 tag=NXBJL2E94UER type=write size=43470 2024-03-09T14:37:07.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.027+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=0DYIQCZWCT55 type=del size=3390233 2024-03-09T14:37:07.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.031+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=TIIWTPMMAWV4 type=del 2024-03-09T14:37:07.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.035+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=D5ZLJLFW4OIY type=del size=1088373 2024-03-09T14:37:07.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.039+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~ETKF59L38ZDP.0 size=85618 2024-03-09T14:37:07.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.043+0000 7fd389e788c0 1 < completed multipart upload key=IXKMXJ9IZ69S upload=ETKF59L38ZDP tag=3SSHBAWNU0YI type=write size=1134194 2024-03-09T14:37:07.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.051+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~8ERALNPWFT0F.0 size=231414 2024-03-09T14:37:07.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.051+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=8ERALNPWFT0F tag=46CEJ20YKDNV type=write size=1279990 2024-03-09T14:37:07.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.055+0000 7fd389e788c0 1 < canceled operation key=2405Y4I2Q8TY tag=5N09NW4699FC type=del size=3881191 2024-03-09T14:37:07.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.055+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=5CIYJVZJJQEY type=del size=1733023 2024-03-09T14:37:07.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.059+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~EK5KLBMEYG0Y.0 size=1048576 2024-03-09T14:37:07.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.059+0000 7fd389e788c0 1 < canceled part key=_multipart_1K5KR8U3GCOV.2~EK5KLBMEYG0Y.1 size=243706 2024-03-09T14:37:07.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.063+0000 7fd389e788c0 1 < canceled multipart upload key=1K5KR8U3GCOV upload=EK5KLBMEYG0Y tag=2AG3L5DE4EUO type=write size=2340858 2024-03-09T14:37:07.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.067+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=VW4AI9187RCS type=del size=2715686 2024-03-09T14:37:07.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.071+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=INAYKAQSU5M3 type=del 2024-03-09T14:37:07.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.075+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=EZC9C6GD457Z type=del size=2925657 2024-03-09T14:37:07.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.079+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=KAMS96ZL3E6G type=del 2024-03-09T14:37:07.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.083+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~0WOHPMIELUQ8.0 size=1048576 2024-03-09T14:37:07.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.087+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~0WOHPMIELUQ8.1 size=488092 2024-03-09T14:37:07.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.087+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=0WOHPMIELUQ8 tag=88NLK4CC9B3Y type=write size=2585244 2024-03-09T14:37:07.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.091+0000 7fd389e788c0 1 < canceled operation key=E2VP0TJ37UX8 tag=SSK99SLK2UQ2 type=del size=2784131 2024-03-09T14:37:07.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.095+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~MF7LCYHZW216.0 size=712463 2024-03-09T14:37:07.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.095+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=MF7LCYHZW216 tag=YC9WPYL27SJA type=write size=1761039 2024-03-09T14:37:07.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.099+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=JWIS5R74HXT3 type=del 2024-03-09T14:37:07.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.103+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=YCEY9M3KF2RO type=del size=3476765 2024-03-09T14:37:07.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.107+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~AYHKE6QEFTD1.0 size=1048576 2024-03-09T14:37:07.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.111+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~AYHKE6QEFTD1.1 size=257659 2024-03-09T14:37:07.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.115+0000 7fd389e788c0 1 < completed multipart upload key=IXKMXJ9IZ69S upload=AYHKE6QEFTD1 tag=DSENBB1KIDZM type=write size=2354811 2024-03-09T14:37:07.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.119+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=EK4KET5B0LQX type=del size=1638476 2024-03-09T14:37:07.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.123+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~B4W6VY4AQM7P.0 size=1048576 2024-03-09T14:37:07.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.123+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~B4W6VY4AQM7P.1 size=769682 2024-03-09T14:37:07.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.131+0000 7fd389e788c0 1 < completed multipart upload key=CLAM83TC7RZ7 upload=B4W6VY4AQM7P tag=DWF2A5D563D1 type=write size=2866834 2024-03-09T14:37:07.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.135+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=6Z1GET4HPSLI type=write size=721750 2024-03-09T14:37:07.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.135+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=S404REK3QPKW type=del 2024-03-09T14:37:07.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.143+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~Y1DNQ0G2LIW5.0 size=1020645 2024-03-09T14:37:07.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.143+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=Y1DNQ0G2LIW5 tag=LR1NQVYB998W type=write size=2069221 2024-03-09T14:37:07.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.147+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=0ETFBVATQORC type=del 2024-03-09T14:37:07.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.155+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~Q6PNQMBH0BOJ.0 size=900387 2024-03-09T14:37:07.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.155+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=Q6PNQMBH0BOJ tag=ZORQ7DP7SJNN type=write size=1948963 2024-03-09T14:37:07.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.159+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~GSGME9FXI10Z.0 size=1048576 2024-03-09T14:37:07.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.159+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~GSGME9FXI10Z.1 size=1048576 2024-03-09T14:37:07.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.163+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~GSGME9FXI10Z.2 size=122806 2024-03-09T14:37:07.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.171+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=GSGME9FXI10Z tag=26LZA07ECT6V type=write size=3268534 2024-03-09T14:37:07.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.171+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=2243LA9J769B type=del size=2177478 2024-03-09T14:37:07.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.175+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~ZTS12NHXGZFX.0 size=1048576 2024-03-09T14:37:07.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.179+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~ZTS12NHXGZFX.1 size=1048576 2024-03-09T14:37:07.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.179+0000 7fd389e788c0 1 < canceled part key=_multipart_SVTMMQ2QR603.2~ZTS12NHXGZFX.2 size=225407 2024-03-09T14:37:07.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.187+0000 7fd389e788c0 1 < canceled multipart upload key=SVTMMQ2QR603 upload=ZTS12NHXGZFX tag=1WJOALJ96JY5 type=write size=3371135 2024-03-09T14:37:07.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.191+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=U12TXJ8RY9AF type=del size=297598 2024-03-09T14:37:07.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.195+0000 7fd389e788c0 1 < suggested update operation key=CLAM83TC7RZ7 tag=DUFQKM7LNJVQ type=del size=1545822 2024-03-09T14:37:07.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.199+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=M5IXDMLF3RO6 type=write size=152417 2024-03-09T14:37:07.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.203+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=0DYIQCZWCT55 type=del 2024-03-09T14:37:07.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.207+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=8LSJO0TVXERX type=del size=2806923 2024-03-09T14:37:07.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.211+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=D5ZLJLFW4OIY type=del 2024-03-09T14:37:07.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.215+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=92OJ9Q1M6ET3 type=del size=708451 2024-03-09T14:37:07.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.219+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~8ERALNPWFT0F.0 size=231414 2024-03-09T14:37:07.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.223+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=8ERALNPWFT0F tag=46CEJ20YKDNV type=write size=1279990 2024-03-09T14:37:07.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.227+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~MNU5OQUQ6GFZ.0 size=1048576 2024-03-09T14:37:07.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.231+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~MNU5OQUQ6GFZ.1 size=1034753 2024-03-09T14:37:07.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.231+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=MNU5OQUQ6GFZ tag=X5VHW64MCCVG type=write size=3131905 2024-03-09T14:37:07.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.235+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=5CIYJVZJJQEY type=del 2024-03-09T14:37:07.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.239+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~5KDJNWX8KSFM.0 size=1048576 2024-03-09T14:37:07.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.243+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~5KDJNWX8KSFM.1 size=1048576 2024-03-09T14:37:07.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.247+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~5KDJNWX8KSFM.2 size=9603 2024-03-09T14:37:07.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.247+0000 7fd389e788c0 1 > prepared multipart upload key=2405Y4I2Q8TY upload=5KDJNWX8KSFM tag=TRN9LMDZBDAG type=write size=3155331 2024-03-09T14:37:07.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.247+0000 7fd389e788c0 1 < canceled operation key=Y7E2TLASJM9T tag=VW4AI9187RCS type=del size=2715686 2024-03-09T14:37:07.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.251+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=VKEM7SVDP0TH type=del size=2013595 2024-03-09T14:37:07.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.255+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=EZC9C6GD457Z type=del 2024-03-09T14:37:07.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.263+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~SUOCNPPFKVOC.0 size=744874 2024-03-09T14:37:07.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.263+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=SUOCNPPFKVOC tag=5HAO6K1T2LOG type=write size=1793450 2024-03-09T14:37:07.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.263+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~0WOHPMIELUQ8.0 size=1048576 2024-03-09T14:37:07.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.267+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~0WOHPMIELUQ8.1 size=488092 2024-03-09T14:37:07.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.271+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=0WOHPMIELUQ8 tag=88NLK4CC9B3Y type=write size=2585244 2024-03-09T14:37:07.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.275+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=PVQR2NVNV3KJ type=del size=2606827 2024-03-09T14:37:07.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.279+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~MF7LCYHZW216.0 size=712463 2024-03-09T14:37:07.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.283+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=MF7LCYHZW216 tag=YC9WPYL27SJA type=write size=1761039 2024-03-09T14:37:07.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.287+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=E86PZKJ72V9W type=del size=1560622 2024-03-09T14:37:07.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.291+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=YCEY9M3KF2RO type=del 2024-03-09T14:37:07.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.299+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~MIG3PQ10BBA3.0 size=1048576 2024-03-09T14:37:07.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.303+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~MIG3PQ10BBA3.1 size=1048576 2024-03-09T14:37:07.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.303+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~MIG3PQ10BBA3.2 size=721927 2024-03-09T14:37:07.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.303+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=MIG3PQ10BBA3 tag=D3YVN5IQP2Y5 type=write size=3867655 2024-03-09T14:37:07.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.307+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=EK4KET5B0LQX type=del 2024-03-09T14:37:07.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.311+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~ZZJZ1MDPESTF.0 size=1048576 2024-03-09T14:37:07.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.315+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~ZZJZ1MDPESTF.1 size=786633 2024-03-09T14:37:07.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.315+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=ZZJZ1MDPESTF tag=9RA5U8OBE2RP type=write size=2883785 2024-03-09T14:37:07.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.319+0000 7fd389e788c0 1 < canceled operation key=I4NA328AI5T1 tag=6Z1GET4HPSLI type=write size=721750 2024-03-09T14:37:07.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.323+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~WPQ89NP12U3N.0 size=343461 2024-03-09T14:37:07.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.323+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=WPQ89NP12U3N tag=V6ITHGJ182DL type=write size=1392037 2024-03-09T14:37:07.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.327+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~Y1DNQ0G2LIW5.0 size=1020645 2024-03-09T14:37:07.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.331+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=Y1DNQ0G2LIW5 tag=LR1NQVYB998W type=write size=2069221 2024-03-09T14:37:07.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.339+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~Q1LBQC7IVTMF.0 size=236959 2024-03-09T14:37:07.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.339+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=Q1LBQC7IVTMF tag=FOK6ZS7P5TPD type=write size=1285535 2024-03-09T14:37:07.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.343+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~Q6PNQMBH0BOJ.0 size=900387 2024-03-09T14:37:07.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.351+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=Q6PNQMBH0BOJ tag=ZORQ7DP7SJNN type=write size=1948963 2024-03-09T14:37:07.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.355+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=4R7TX36KDJ9K type=del size=1345726 2024-03-09T14:37:07.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.355+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=2243LA9J769B type=del 2024-03-09T14:37:07.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.359+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=D4WQY1546XIL type=del size=451343 2024-03-09T14:37:07.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.363+0000 7fd389e788c0 1 < canceled operation key=U8P5Q3D11MM6 tag=U12TXJ8RY9AF type=del size=297598 2024-03-09T14:37:07.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.371+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~JXU3KZ271Y0I.0 size=1048576 2024-03-09T14:37:07.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.371+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~JXU3KZ271Y0I.1 size=684207 2024-03-09T14:37:07.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.371+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=JXU3KZ271Y0I tag=90JDABGP2B0R type=write size=2781359 2024-03-09T14:37:07.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.375+0000 7fd389e788c0 1 < completed write operation key=Z18Q66VI5PDN tag=M5IXDMLF3RO6 type=write size=152417 2024-03-09T14:37:07.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.379+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=AV1QRM5NUI0X type=del size=559419 2024-03-09T14:37:07.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.387+0000 7fd389e788c0 1 < suggested remove operation key=PZJT6RWRJFIN tag=8LSJO0TVXERX type=del 2024-03-09T14:37:07.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.387+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=KCTULFLB5YBP type=del size=2650463 2024-03-09T14:37:07.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.391+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=92OJ9Q1M6ET3 type=del 2024-03-09T14:37:07.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.399+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~ZJB8WK9FN6IM.0 size=1048576 2024-03-09T14:37:07.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.399+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~ZJB8WK9FN6IM.1 size=1048576 2024-03-09T14:37:07.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.403+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~ZJB8WK9FN6IM.2 size=254528 2024-03-09T14:37:07.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.403+0000 7fd389e788c0 1 > prepared multipart upload key=DIN8WJ9Z9OI8 upload=ZJB8WK9FN6IM tag=XALSDFEH8EMS type=write size=3400256 2024-03-09T14:37:07.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.407+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~MNU5OQUQ6GFZ.0 size=1048576 2024-03-09T14:37:07.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.407+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~MNU5OQUQ6GFZ.1 size=1034753 2024-03-09T14:37:07.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.415+0000 7fd389e788c0 1 < completed multipart upload key=71692MJQITX3 upload=MNU5OQUQ6GFZ tag=X5VHW64MCCVG type=write size=3131905 2024-03-09T14:37:07.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.419+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~D99NVKWPQZBN.0 size=1048576 2024-03-09T14:37:07.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.423+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~D99NVKWPQZBN.1 size=1048576 2024-03-09T14:37:07.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.423+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~D99NVKWPQZBN.2 size=746907 2024-03-09T14:37:07.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.423+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=D99NVKWPQZBN tag=VFA2YVICAVOA type=write size=3892635 2024-03-09T14:37:07.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.427+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~5KDJNWX8KSFM.0 size=1048576 2024-03-09T14:37:07.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.427+0000 7fd389e788c0 1 < canceled part key=_multipart_2405Y4I2Q8TY.2~5KDJNWX8KSFM.1 size=1048576 2024-03-09T14:37:07.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.431+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~5KDJNWX8KSFM.2 size=9603 2024-03-09T14:37:07.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.435+0000 7fd389e788c0 1 < canceled multipart upload key=2405Y4I2Q8TY upload=5KDJNWX8KSFM tag=TRN9LMDZBDAG type=write size=3155331 2024-03-09T14:37:07.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.439+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=P01JHC0O3UU3 type=del size=1577123 2024-03-09T14:37:07.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.443+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=VKEM7SVDP0TH type=del 2024-03-09T14:37:07.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.447+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~T1ATM0Y0ZUAO.0 size=1048576 2024-03-09T14:37:07.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.451+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~T1ATM0Y0ZUAO.1 size=1048576 2024-03-09T14:37:07.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.455+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~T1ATM0Y0ZUAO.2 size=415637 2024-03-09T14:37:07.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.455+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=T1ATM0Y0ZUAO tag=QDUB2CU37J01 type=write size=3561365 2024-03-09T14:37:07.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.459+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~SUOCNPPFKVOC.0 size=744874 2024-03-09T14:37:07.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.463+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=SUOCNPPFKVOC tag=5HAO6K1T2LOG type=write size=1793450 2024-03-09T14:37:07.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.471+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~JH4R1HR837J7.0 size=108535 2024-03-09T14:37:07.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.471+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=JH4R1HR837J7 tag=1RMOU8ULR03Z type=write size=1157111 2024-03-09T14:37:07.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.471+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=PVQR2NVNV3KJ type=del 2024-03-09T14:37:07.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.475+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=NZA17J5BATU0 type=write size=126599 2024-03-09T14:37:07.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.479+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=E86PZKJ72V9W type=del 2024-03-09T14:37:07.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.487+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~YVWTO8FXLXHD.0 size=260853 2024-03-09T14:37:07.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.487+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=YVWTO8FXLXHD tag=MFCNYNYZ1849 type=write size=1309429 2024-03-09T14:37:07.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.491+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~MIG3PQ10BBA3.0 size=1048576 2024-03-09T14:37:07.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.491+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~MIG3PQ10BBA3.1 size=1048576 2024-03-09T14:37:07.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.495+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~MIG3PQ10BBA3.2 size=721927 2024-03-09T14:37:07.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.503+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=MIG3PQ10BBA3 tag=D3YVN5IQP2Y5 type=write size=3867655 2024-03-09T14:37:07.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.507+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~AF1J6BRTTUDZ.0 size=1048576 2024-03-09T14:37:07.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.507+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~AF1J6BRTTUDZ.1 size=114696 2024-03-09T14:37:07.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.511+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=AF1J6BRTTUDZ tag=E666M1S27VAI type=write size=2211848 2024-03-09T14:37:07.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.511+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~ZZJZ1MDPESTF.0 size=1048576 2024-03-09T14:37:07.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.515+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~ZZJZ1MDPESTF.1 size=786633 2024-03-09T14:37:07.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.519+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=ZZJZ1MDPESTF tag=9RA5U8OBE2RP type=write size=2883785 2024-03-09T14:37:07.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.523+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=IEDDR4R1P63P type=write size=1029879 2024-03-09T14:37:07.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.527+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~WPQ89NP12U3N.0 size=343461 2024-03-09T14:37:07.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.531+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=WPQ89NP12U3N tag=V6ITHGJ182DL type=write size=1392037 2024-03-09T14:37:07.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.535+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=2LNTLQLLFWDV type=del size=2827067 2024-03-09T14:37:07.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.539+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~Q1LBQC7IVTMF.0 size=236959 2024-03-09T14:37:07.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.543+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=Q1LBQC7IVTMF tag=FOK6ZS7P5TPD type=write size=1285535 2024-03-09T14:37:07.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.547+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=YKWMRDRB5FJ1 type=del size=2409619 2024-03-09T14:37:07.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.551+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=4R7TX36KDJ9K type=del 2024-03-09T14:37:07.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.551+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=PYDB7K4UOY99 type=del size=384177 2024-03-09T14:37:07.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.555+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=D4WQY1546XIL type=del 2024-03-09T14:37:07.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.563+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~GRZCOWURDSWR.0 size=1048576 2024-03-09T14:37:07.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.563+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~GRZCOWURDSWR.1 size=520749 2024-03-09T14:37:07.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.563+0000 7fd389e788c0 1 > prepared multipart upload key=GSNWWDS63MTA upload=GRZCOWURDSWR tag=MSXRU978XC69 type=write size=2617901 2024-03-09T14:37:07.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.567+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~JXU3KZ271Y0I.0 size=1048576 2024-03-09T14:37:07.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.567+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~JXU3KZ271Y0I.1 size=684207 2024-03-09T14:37:07.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.575+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=JXU3KZ271Y0I tag=90JDABGP2B0R type=write size=2781359 2024-03-09T14:37:07.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.579+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~D3TGOCS1WKU1.0 size=1048576 2024-03-09T14:37:07.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.579+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~D3TGOCS1WKU1.1 size=1048576 2024-03-09T14:37:07.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.583+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~D3TGOCS1WKU1.2 size=737148 2024-03-09T14:37:07.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.583+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=D3TGOCS1WKU1 tag=AT4H3A1FQS37 type=write size=3882876 2024-03-09T14:37:07.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.587+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=AV1QRM5NUI0X type=del 2024-03-09T14:37:07.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.591+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~QHNNQRF4ERHG.0 size=1048576 2024-03-09T14:37:07.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.591+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~QHNNQRF4ERHG.1 size=1048576 2024-03-09T14:37:07.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.595+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~QHNNQRF4ERHG.2 size=981971 2024-03-09T14:37:07.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.595+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=QHNNQRF4ERHG tag=INGM1TL7FKWB type=write size=4127699 2024-03-09T14:37:07.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.599+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=KCTULFLB5YBP type=del 2024-03-09T14:37:07.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.599+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=8R3TV1HF6SXL type=del size=1828764 2024-03-09T14:37:07.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.603+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~ZJB8WK9FN6IM.0 size=1048576 2024-03-09T14:37:07.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.607+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~ZJB8WK9FN6IM.1 size=1048576 2024-03-09T14:37:07.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.607+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~ZJB8WK9FN6IM.2 size=254528 2024-03-09T14:37:07.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.615+0000 7fd389e788c0 1 < completed multipart upload key=DIN8WJ9Z9OI8 upload=ZJB8WK9FN6IM tag=XALSDFEH8EMS type=write size=3400256 2024-03-09T14:37:07.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.615+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=75D2D8FWM7BN type=del size=978174 2024-03-09T14:37:07.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.619+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~D99NVKWPQZBN.0 size=1048576 2024-03-09T14:37:07.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.623+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~D99NVKWPQZBN.1 size=1048576 2024-03-09T14:37:07.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.623+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~D99NVKWPQZBN.2 size=746907 2024-03-09T14:37:07.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.627+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=D99NVKWPQZBN tag=VFA2YVICAVOA type=write size=3892635 2024-03-09T14:37:07.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.635+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~VBLIRCN3NGWC.0 size=1048576 2024-03-09T14:37:07.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.639+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~VBLIRCN3NGWC.1 size=1048576 2024-03-09T14:37:07.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.639+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~VBLIRCN3NGWC.2 size=303526 2024-03-09T14:37:07.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.639+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=VBLIRCN3NGWC tag=1B0EJ8HR5QB8 type=write size=3449254 2024-03-09T14:37:07.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.643+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=P01JHC0O3UU3 type=del 2024-03-09T14:37:07.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.643+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=Q1CA4PI16SYT type=write size=492018 2024-03-09T14:37:07.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.647+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~T1ATM0Y0ZUAO.0 size=1048576 2024-03-09T14:37:07.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.651+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~T1ATM0Y0ZUAO.1 size=1048576 2024-03-09T14:37:07.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.651+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~T1ATM0Y0ZUAO.2 size=415637 2024-03-09T14:37:07.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.655+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=T1ATM0Y0ZUAO tag=QDUB2CU37J01 type=write size=3561365 2024-03-09T14:37:07.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.659+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=BD7OS0D4B1FE type=write size=582431 2024-03-09T14:37:07.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.659+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~JH4R1HR837J7.0 size=108535 2024-03-09T14:37:07.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.663+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=JH4R1HR837J7 tag=1RMOU8ULR03Z type=write size=1157111 2024-03-09T14:37:07.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.667+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=U4NCUL2XMBVN type=del size=3629740 2024-03-09T14:37:07.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.671+0000 7fd389e788c0 1 < completed write operation key=U8P5Q3D11MM6 tag=NZA17J5BATU0 type=write size=126599 2024-03-09T14:37:07.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.671+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=K7VIILSUUOKG type=del size=680187 2024-03-09T14:37:07.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.675+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~YVWTO8FXLXHD.0 size=260853 2024-03-09T14:37:07.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.679+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=YVWTO8FXLXHD tag=MFCNYNYZ1849 type=write size=1309429 2024-03-09T14:37:07.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.683+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~5TWP4W31IH1V.0 size=919486 2024-03-09T14:37:07.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.683+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=5TWP4W31IH1V tag=6HZ3PKVULU4D type=write size=1968062 2024-03-09T14:37:07.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.687+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~AF1J6BRTTUDZ.0 size=1048576 2024-03-09T14:37:07.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.687+0000 7fd389e788c0 1 < canceled part key=_multipart_E65PFNHJQHEO.2~AF1J6BRTTUDZ.1 size=114696 2024-03-09T14:37:07.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.691+0000 7fd389e788c0 1 < canceled multipart upload key=E65PFNHJQHEO upload=AF1J6BRTTUDZ tag=E666M1S27VAI type=write size=2211848 2024-03-09T14:37:07.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.695+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=W9ECUWDS75G0 type=del size=791338 2024-03-09T14:37:07.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.695+0000 7fd389e788c0 1 < completed write operation key=44F8QXCBBENS tag=IEDDR4R1P63P type=write size=1029879 2024-03-09T14:37:07.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.699+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~DMZNGKNMHBT6.0 size=92575 2024-03-09T14:37:07.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.699+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=DMZNGKNMHBT6 tag=D1M7OBXVVC24 type=write size=1141151 2024-03-09T14:37:07.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.703+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=2LNTLQLLFWDV type=del 2024-03-09T14:37:07.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.707+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=BCGISWTVJJVL type=del size=1200179 2024-03-09T14:37:07.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.711+0000 7fd389e788c0 1 < completed delete operation key=DIN8WJ9Z9OI8 tag=YKWMRDRB5FJ1 type=del 2024-03-09T14:37:07.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.715+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~UEIWDUZHTTMW.0 size=299463 2024-03-09T14:37:07.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.715+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=UEIWDUZHTTMW tag=N5PG1JB47NFR type=write size=1348039 2024-03-09T14:37:07.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.719+0000 7fd389e788c0 1 < suggested update operation key=U8P5Q3D11MM6 tag=PYDB7K4UOY99 type=del size=384177 2024-03-09T14:37:07.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.723+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=83CCFT5L4AUF type=del size=2459337 2024-03-09T14:37:07.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.727+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~GRZCOWURDSWR.0 size=1048576 2024-03-09T14:37:07.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.727+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~GRZCOWURDSWR.1 size=520749 2024-03-09T14:37:07.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.735+0000 7fd389e788c0 1 < completed multipart upload key=GSNWWDS63MTA upload=GRZCOWURDSWR tag=MSXRU978XC69 type=write size=2617901 2024-03-09T14:37:07.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.739+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~YFM5P8IM42GU.0 size=1048576 2024-03-09T14:37:07.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.739+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~YFM5P8IM42GU.1 size=1048576 2024-03-09T14:37:07.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.743+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~YFM5P8IM42GU.2 size=985944 2024-03-09T14:37:07.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.743+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=YFM5P8IM42GU tag=1YZU5SGKJJOO type=write size=4131672 2024-03-09T14:37:07.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.743+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~D3TGOCS1WKU1.0 size=1048576 2024-03-09T14:37:07.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.747+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~D3TGOCS1WKU1.1 size=1048576 2024-03-09T14:37:07.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.751+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~D3TGOCS1WKU1.2 size=737148 2024-03-09T14:37:07.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.755+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=D3TGOCS1WKU1 tag=AT4H3A1FQS37 type=write size=3882876 2024-03-09T14:37:07.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.755+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=YJVM689HC9QQ type=del size=4078864 2024-03-09T14:37:07.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.759+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~QHNNQRF4ERHG.0 size=1048576 2024-03-09T14:37:07.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.759+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~QHNNQRF4ERHG.1 size=1048576 2024-03-09T14:37:07.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.763+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~QHNNQRF4ERHG.2 size=981971 2024-03-09T14:37:07.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.767+0000 7fd389e788c0 1 < completed multipart upload key=8J6Z9DT07H0X upload=QHNNQRF4ERHG tag=INGM1TL7FKWB type=write size=4127699 2024-03-09T14:37:07.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.771+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~IM7B7C8ZD5NQ.0 size=1048576 2024-03-09T14:37:07.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.775+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~IM7B7C8ZD5NQ.1 size=1048576 2024-03-09T14:37:07.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.775+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~IM7B7C8ZD5NQ.2 size=997540 2024-03-09T14:37:07.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.775+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=IM7B7C8ZD5NQ tag=1R4J73512DV1 type=write size=4143268 2024-03-09T14:37:07.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.779+0000 7fd389e788c0 1 < canceled operation key=E2VP0TJ37UX8 tag=8R3TV1HF6SXL type=del size=1828764 2024-03-09T14:37:07.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.783+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=YTWF64LRBGN0 type=del size=144854 2024-03-09T14:37:07.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.787+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=75D2D8FWM7BN type=del 2024-03-09T14:37:07.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.787+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=9ED5MQIPKD7B type=del size=4035750 2024-03-09T14:37:07.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.791+0000 7fd389e788c0 1 < canceled part key=_multipart_SKIBISETJH7B.2~VBLIRCN3NGWC.0 size=1048576 2024-03-09T14:37:07.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.791+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~VBLIRCN3NGWC.1 size=1048576 2024-03-09T14:37:07.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.795+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~VBLIRCN3NGWC.2 size=303526 2024-03-09T14:37:07.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.799+0000 7fd389e788c0 1 < canceled multipart upload key=SKIBISETJH7B upload=VBLIRCN3NGWC tag=1B0EJ8HR5QB8 type=write size=3449254 2024-03-09T14:37:07.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.803+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~SAWMMF0OFY58.0 size=1048576 2024-03-09T14:37:07.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.807+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~SAWMMF0OFY58.1 size=1048576 2024-03-09T14:37:07.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.811+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~SAWMMF0OFY58.2 size=363922 2024-03-09T14:37:07.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.811+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=SAWMMF0OFY58 tag=QCHA5DASS6IK type=write size=3509650 2024-03-09T14:37:07.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.815+0000 7fd389e788c0 1 < canceled operation key=AUSZ4JUGI6UU tag=Q1CA4PI16SYT type=write size=492018 2024-03-09T14:37:07.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.815+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=WI1O2LJLSULZ type=del size=856414 2024-03-09T14:37:07.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.819+0000 7fd389e788c0 1 < canceled operation key=YR2VX4QLOCOG tag=BD7OS0D4B1FE type=write size=582431 2024-03-09T14:37:07.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.823+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=GUWZ86UENUYB type=del size=1797514 2024-03-09T14:37:07.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.827+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=U4NCUL2XMBVN type=del 2024-03-09T14:37:07.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.827+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=XT5OJUJS2UOX type=del size=47248 2024-03-09T14:37:07.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.831+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=K7VIILSUUOKG type=del 2024-03-09T14:37:07.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.831+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=LK1HEUPM1JA1 type=del size=2155252 2024-03-09T14:37:07.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.835+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~5TWP4W31IH1V.0 size=919486 2024-03-09T14:37:07.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.839+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=5TWP4W31IH1V tag=6HZ3PKVULU4D type=write size=1968062 2024-03-09T14:37:07.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.839+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=TFZ09DCGT5CU type=write size=218428 2024-03-09T14:37:07.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.843+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=W9ECUWDS75G0 type=del 2024-03-09T14:37:07.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.847+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=H3RU8249440O type=del size=1507003 2024-03-09T14:37:07.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.851+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~DMZNGKNMHBT6.0 size=92575 2024-03-09T14:37:07.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.855+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=DMZNGKNMHBT6 tag=D1M7OBXVVC24 type=write size=1141151 2024-03-09T14:37:07.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.859+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=YANFDO5YH8SA type=del size=661032 2024-03-09T14:37:07.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.859+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=BCGISWTVJJVL type=del 2024-03-09T14:37:07.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.863+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~32K85TDFU329.0 size=1048576 2024-03-09T14:37:07.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.867+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~32K85TDFU329.1 size=1048576 2024-03-09T14:37:07.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.867+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~32K85TDFU329.2 size=640768 2024-03-09T14:37:07.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.867+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=32K85TDFU329 tag=0F3PZQYNN66G type=write size=3786496 2024-03-09T14:37:07.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.871+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~UEIWDUZHTTMW.0 size=299463 2024-03-09T14:37:07.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.875+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=UEIWDUZHTTMW tag=N5PG1JB47NFR type=write size=1348039 2024-03-09T14:37:07.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.879+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=EYATY4VQ9J66 type=write size=318292 2024-03-09T14:37:07.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.883+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=83CCFT5L4AUF type=del 2024-03-09T14:37:07.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.887+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=9NO8K4VX0RHH type=del size=1485278 2024-03-09T14:37:07.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.887+0000 7fd389e788c0 1 < canceled part key=_multipart_8J6Z9DT07H0X.2~YFM5P8IM42GU.0 size=1048576 2024-03-09T14:37:07.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.891+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~YFM5P8IM42GU.1 size=1048576 2024-03-09T14:37:07.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.891+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~YFM5P8IM42GU.2 size=985944 2024-03-09T14:37:07.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.895+0000 7fd389e788c0 1 < canceled multipart upload key=8J6Z9DT07H0X upload=YFM5P8IM42GU tag=1YZU5SGKJJOO type=write size=4131672 2024-03-09T14:37:07.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.899+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=IO8R2YPB5I7E type=write size=621799 2024-03-09T14:37:07.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.903+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=YJVM689HC9QQ type=del 2024-03-09T14:37:07.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.907+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=DHTE7PLE5ZAS type=write size=176233 2024-03-09T14:37:07.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.907+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~IM7B7C8ZD5NQ.0 size=1048576 2024-03-09T14:37:07.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.911+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~IM7B7C8ZD5NQ.1 size=1048576 2024-03-09T14:37:07.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.915+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~IM7B7C8ZD5NQ.2 size=997540 2024-03-09T14:37:07.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.919+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=IM7B7C8ZD5NQ tag=1R4J73512DV1 type=write size=4143268 2024-03-09T14:37:07.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.923+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=M7QT6IXE5FK9 type=del size=4073867 2024-03-09T14:37:07.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.923+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=YTWF64LRBGN0 type=del 2024-03-09T14:37:07.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.927+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=7SUP4S5W3J7D type=del size=2200056 2024-03-09T14:37:07.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.931+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=9ED5MQIPKD7B type=del 2024-03-09T14:37:07.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.935+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~6H5IVZXOTEF2.0 size=1048576 2024-03-09T14:37:07.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.939+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~6H5IVZXOTEF2.1 size=378138 2024-03-09T14:37:07.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.939+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=6H5IVZXOTEF2 tag=94FW104TAGSK type=write size=2475290 2024-03-09T14:37:07.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.939+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~SAWMMF0OFY58.0 size=1048576 2024-03-09T14:37:07.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.943+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~SAWMMF0OFY58.1 size=1048576 2024-03-09T14:37:07.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.947+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~SAWMMF0OFY58.2 size=363922 2024-03-09T14:37:07.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.951+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=SAWMMF0OFY58 tag=QCHA5DASS6IK type=write size=3509650 2024-03-09T14:37:07.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.955+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~ZRZ7YXYZSOGG.0 size=1048576 2024-03-09T14:37:07.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.959+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~ZRZ7YXYZSOGG.1 size=1048576 2024-03-09T14:37:07.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.959+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~ZRZ7YXYZSOGG.2 size=940670 2024-03-09T14:37:07.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.959+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=ZRZ7YXYZSOGG tag=DY9FYPC6HK6C type=write size=4086398 2024-03-09T14:37:07.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.963+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=WI1O2LJLSULZ type=del 2024-03-09T14:37:07.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.967+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=AF029U4OEZ48 type=del size=704152 2024-03-09T14:37:07.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.967+0000 7fd389e788c0 1 < canceled operation key=IXKMXJ9IZ69S tag=GUWZ86UENUYB type=del size=1797514 2024-03-09T14:37:07.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.975+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~LUSR019UVI1H.0 size=561273 2024-03-09T14:37:07.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.975+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=LUSR019UVI1H tag=SSE0JDSYVUDT type=write size=1609849 2024-03-09T14:37:07.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.979+0000 7fd389e788c0 1 < suggested remove operation key=P83H9137MI7Y tag=XT5OJUJS2UOX type=del 2024-03-09T14:37:07.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.987+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~2F1CCCFWD2PQ.0 size=542530 2024-03-09T14:37:07.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.987+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=2F1CCCFWD2PQ tag=PRREDUDD7L2O type=write size=1591106 2024-03-09T14:37:07.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.991+0000 7fd389e788c0 1 < suggested remove operation key=K9X2N6V8R4BY tag=LK1HEUPM1JA1 type=del 2024-03-09T14:37:07.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.995+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~NDER5GKTZIX8.0 size=607660 2024-03-09T14:37:07.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.995+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=NDER5GKTZIX8 tag=EPE34JH32ESN type=write size=1656236 2024-03-09T14:37:08.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:07.999+0000 7fd389e788c0 1 < completed write operation key=1K5KR8U3GCOV tag=TFZ09DCGT5CU type=write size=218428 2024-03-09T14:37:08.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.007+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~JJF0QUK2KGNJ.0 size=690050 2024-03-09T14:37:08.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.007+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=JJF0QUK2KGNJ tag=BVI2O773JPX9 type=write size=1738626 2024-03-09T14:37:08.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.011+0000 7fd389e788c0 1 < suggested remove operation key=Z18Q66VI5PDN tag=H3RU8249440O type=del 2024-03-09T14:37:08.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.015+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=6309DWZHQRZB type=del size=1401855 2024-03-09T14:37:08.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.015+0000 7fd389e788c0 1 < completed delete operation key=UMT7VKZ9R4IR tag=YANFDO5YH8SA type=del 2024-03-09T14:37:08.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.023+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~RV7ZDJANNPII.0 size=1048576 2024-03-09T14:37:08.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.023+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~RV7ZDJANNPII.1 size=188595 2024-03-09T14:37:08.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.023+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=RV7ZDJANNPII tag=IXB3120NBAPK type=write size=2285747 2024-03-09T14:37:08.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.027+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~32K85TDFU329.0 size=1048576 2024-03-09T14:37:08.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.031+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~32K85TDFU329.1 size=1048576 2024-03-09T14:37:08.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.035+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~32K85TDFU329.2 size=640768 2024-03-09T14:37:08.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.039+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=32K85TDFU329 tag=0F3PZQYNN66G type=write size=3786496 2024-03-09T14:37:08.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.039+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=OOJX5ACXIGDU type=del size=3573630 2024-03-09T14:37:08.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.043+0000 7fd389e788c0 1 < completed write operation key=61RC3GUU437B tag=EYATY4VQ9J66 type=write size=318292 2024-03-09T14:37:08.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.051+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~T0JCJGTE4BY2.0 size=657110 2024-03-09T14:37:08.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.051+0000 7fd389e788c0 1 > prepared multipart upload key=DIN8WJ9Z9OI8 upload=T0JCJGTE4BY2 tag=UC5FTYVEZXP8 type=write size=1705686 2024-03-09T14:37:08.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.055+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=9NO8K4VX0RHH type=del 2024-03-09T14:37:08.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.055+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=2FJQJGTRIB8Q type=del size=1848921 2024-03-09T14:37:08.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.059+0000 7fd389e788c0 1 < completed write operation key=YR2VX4QLOCOG tag=IO8R2YPB5I7E type=write size=621799 2024-03-09T14:37:08.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.063+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=LIUA1M01AJ5T type=del size=678035 2024-03-09T14:37:08.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.067+0000 7fd389e788c0 1 < completed write operation key=SKIBISETJH7B tag=DHTE7PLE5ZAS type=write size=176233 2024-03-09T14:37:08.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.071+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=QFQIFJCK2S5J type=del size=1999224 2024-03-09T14:37:08.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.075+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=M7QT6IXE5FK9 type=del 2024-03-09T14:37:08.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.075+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=RCZVC0FVNJWQ type=del size=3393503 2024-03-09T14:37:08.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.079+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=7SUP4S5W3J7D type=del 2024-03-09T14:37:08.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.083+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=GUVARDWJ53F0 type=del size=3597846 2024-03-09T14:37:08.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.087+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~6H5IVZXOTEF2.0 size=1048576 2024-03-09T14:37:08.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.091+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~6H5IVZXOTEF2.1 size=378138 2024-03-09T14:37:08.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.095+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=6H5IVZXOTEF2 tag=94FW104TAGSK type=write size=2475290 2024-03-09T14:37:08.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.099+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~2E57VK5F7J34.0 size=538601 2024-03-09T14:37:08.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.099+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=2E57VK5F7J34 tag=2BULWB5VZWIN type=write size=1587177 2024-03-09T14:37:08.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.103+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~ZRZ7YXYZSOGG.0 size=1048576 2024-03-09T14:37:08.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.107+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~ZRZ7YXYZSOGG.1 size=1048576 2024-03-09T14:37:08.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.107+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~ZRZ7YXYZSOGG.2 size=940670 2024-03-09T14:37:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.115+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=ZRZ7YXYZSOGG tag=DY9FYPC6HK6C type=write size=4086398 2024-03-09T14:37:08.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.119+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~RIUUAEJA0G0O.0 size=103611 2024-03-09T14:37:08.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.119+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=RIUUAEJA0G0O tag=T60QM03LDWZS type=write size=1152187 2024-03-09T14:37:08.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.123+0000 7fd389e788c0 1 < completed delete operation key=UMT7VKZ9R4IR tag=AF029U4OEZ48 type=del 2024-03-09T14:37:08.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.127+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=VU30VLJ3GSNJ type=del size=404250 2024-03-09T14:37:08.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.127+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~LUSR019UVI1H.0 size=561273 2024-03-09T14:37:08.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.135+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=LUSR019UVI1H tag=SSE0JDSYVUDT type=write size=1609849 2024-03-09T14:37:08.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.139+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~Q32L55S4DA6R.0 size=1048576 2024-03-09T14:37:08.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.143+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~Q32L55S4DA6R.1 size=1048576 2024-03-09T14:37:08.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.147+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~Q32L55S4DA6R.2 size=227446 2024-03-09T14:37:08.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.147+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=Q32L55S4DA6R tag=L9PUMMRKJH50 type=write size=3373174 2024-03-09T14:37:08.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.147+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~2F1CCCFWD2PQ.0 size=542530 2024-03-09T14:37:08.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.155+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=2F1CCCFWD2PQ tag=PRREDUDD7L2O type=write size=1591106 2024-03-09T14:37:08.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.159+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~93QQ6LMBT0HY.0 size=1048576 2024-03-09T14:37:08.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.163+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~93QQ6LMBT0HY.1 size=1048576 2024-03-09T14:37:08.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.167+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~93QQ6LMBT0HY.2 size=166255 2024-03-09T14:37:08.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.167+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=93QQ6LMBT0HY tag=6VKBPFCKUJG8 type=write size=3311983 2024-03-09T14:37:08.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.171+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~NDER5GKTZIX8.0 size=607660 2024-03-09T14:37:08.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.175+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=NDER5GKTZIX8 tag=EPE34JH32ESN type=write size=1656236 2024-03-09T14:37:08.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.183+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~J9DRNWW7X4UJ.0 size=1048576 2024-03-09T14:37:08.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.187+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~J9DRNWW7X4UJ.1 size=1048576 2024-03-09T14:37:08.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.187+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~J9DRNWW7X4UJ.2 size=58960 2024-03-09T14:37:08.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.187+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=J9DRNWW7X4UJ tag=IV2U8KG9IO8W type=write size=3204688 2024-03-09T14:37:08.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.191+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~JJF0QUK2KGNJ.0 size=690050 2024-03-09T14:37:08.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.199+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=JJF0QUK2KGNJ tag=BVI2O773JPX9 type=write size=1738626 2024-03-09T14:37:08.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.203+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=YKLZTX0NI8KN type=del size=2586987 2024-03-09T14:37:08.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.207+0000 7fd389e788c0 1 < canceled operation key=ACL1T9GW2JV9 tag=6309DWZHQRZB type=del size=1401855 2024-03-09T14:37:08.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.211+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~AMI33UV5AKNC.0 size=252953 2024-03-09T14:37:08.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.211+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=AMI33UV5AKNC tag=EFJ41M34D2TM type=write size=1301529 2024-03-09T14:37:08.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.215+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~RV7ZDJANNPII.0 size=1048576 2024-03-09T14:37:08.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.219+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~RV7ZDJANNPII.1 size=188595 2024-03-09T14:37:08.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.223+0000 7fd389e788c0 1 < completed multipart upload key=P83H9137MI7Y upload=RV7ZDJANNPII tag=IXB3120NBAPK type=write size=2285747 2024-03-09T14:37:08.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.227+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=NO52MPRRQR0U type=del size=3793799 2024-03-09T14:37:08.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.227+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=OOJX5ACXIGDU type=del 2024-03-09T14:37:08.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.231+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=3NEF01MUYHA4 type=del size=4133542 2024-03-09T14:37:08.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.235+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~T0JCJGTE4BY2.0 size=657110 2024-03-09T14:37:08.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.239+0000 7fd389e788c0 1 < completed multipart upload key=DIN8WJ9Z9OI8 upload=T0JCJGTE4BY2 tag=UC5FTYVEZXP8 type=write size=1705686 2024-03-09T14:37:08.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.247+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~JFH73X9UR85M.0 size=1048576 2024-03-09T14:37:08.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.247+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~JFH73X9UR85M.1 size=295829 2024-03-09T14:37:08.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.247+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=JFH73X9UR85M tag=3SAJPZITW31F type=write size=2392981 2024-03-09T14:37:08.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.255+0000 7fd389e788c0 1 < suggested update operation key=IXKMXJ9IZ69S tag=2FJQJGTRIB8Q type=del size=1848921 2024-03-09T14:37:08.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.263+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~C7210MHDJ1T8.0 size=1048576 2024-03-09T14:37:08.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.263+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~C7210MHDJ1T8.1 size=1048576 2024-03-09T14:37:08.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.267+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~C7210MHDJ1T8.2 size=46661 2024-03-09T14:37:08.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.267+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=C7210MHDJ1T8 tag=ZQN1RSWRKA26 type=write size=3192389 2024-03-09T14:37:08.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.271+0000 7fd389e788c0 1 < suggested remove operation key=E2VP0TJ37UX8 tag=LIUA1M01AJ5T type=del 2024-03-09T14:37:08.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.275+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=0MG5PJPZ6JS7 type=del size=1874906 2024-03-09T14:37:08.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.283+0000 7fd389e788c0 1 < suggested remove operation key=6VT4C288571G tag=QFQIFJCK2S5J type=del 2024-03-09T14:37:08.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.287+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=BF2P0XQP7EHL type=del size=2644058 2024-03-09T14:37:08.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.291+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=RCZVC0FVNJWQ type=del 2024-03-09T14:37:08.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.295+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=HTHDWA0OATJO type=del size=1470122 2024-03-09T14:37:08.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.299+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=GUVARDWJ53F0 type=del 2024-03-09T14:37:08.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.299+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=7F43WW61VRSG type=del size=2069961 2024-03-09T14:37:08.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.303+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~2E57VK5F7J34.0 size=538601 2024-03-09T14:37:08.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.311+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=2E57VK5F7J34 tag=2BULWB5VZWIN type=write size=1587177 2024-03-09T14:37:08.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.315+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~SWM8A41TVBOQ.0 size=418449 2024-03-09T14:37:08.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.315+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=SWM8A41TVBOQ tag=F852M3J7M1HF type=write size=1467025 2024-03-09T14:37:08.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.315+0000 7fd389e788c0 1 < canceled part key=_multipart_P83H9137MI7Y.2~RIUUAEJA0G0O.0 size=103611 2024-03-09T14:37:08.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.319+0000 7fd389e788c0 1 < canceled multipart upload key=P83H9137MI7Y upload=RIUUAEJA0G0O tag=T60QM03LDWZS type=write size=1152187 2024-03-09T14:37:08.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.323+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=GTGP2462C0LZ type=del size=1598100 2024-03-09T14:37:08.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.331+0000 7fd389e788c0 1 < suggested remove operation key=8J6Z9DT07H0X tag=VU30VLJ3GSNJ type=del 2024-03-09T14:37:08.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.335+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=NST6E0GY9Y1R type=del size=3516722 2024-03-09T14:37:08.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.339+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~Q32L55S4DA6R.0 size=1048576 2024-03-09T14:37:08.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.339+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~Q32L55S4DA6R.1 size=1048576 2024-03-09T14:37:08.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.343+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~Q32L55S4DA6R.2 size=227446 2024-03-09T14:37:08.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.351+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=Q32L55S4DA6R tag=L9PUMMRKJH50 type=write size=3373174 2024-03-09T14:37:08.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.351+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=V12HEL6RRISO type=del size=3367342 2024-03-09T14:37:08.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.355+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~93QQ6LMBT0HY.0 size=1048576 2024-03-09T14:37:08.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.359+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~93QQ6LMBT0HY.1 size=1048576 2024-03-09T14:37:08.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.359+0000 7fd389e788c0 1 < canceled part key=_multipart_SVTMMQ2QR603.2~93QQ6LMBT0HY.2 size=166255 2024-03-09T14:37:08.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.363+0000 7fd389e788c0 1 < canceled multipart upload key=SVTMMQ2QR603 upload=93QQ6LMBT0HY tag=6VKBPFCKUJG8 type=write size=3311983 2024-03-09T14:37:08.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.371+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~UE2SQVCTT7H7.0 size=495120 2024-03-09T14:37:08.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.371+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=UE2SQVCTT7H7 tag=GRZTUZ78GU9P type=write size=1543696 2024-03-09T14:37:08.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.375+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~J9DRNWW7X4UJ.0 size=1048576 2024-03-09T14:37:08.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.379+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~J9DRNWW7X4UJ.1 size=1048576 2024-03-09T14:37:08.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.379+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~J9DRNWW7X4UJ.2 size=58960 2024-03-09T14:37:08.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.387+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=J9DRNWW7X4UJ tag=IV2U8KG9IO8W type=write size=3204688 2024-03-09T14:37:08.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.391+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=9T50GTSGJA65 type=del size=2781375 2024-03-09T14:37:08.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.391+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=YKLZTX0NI8KN type=del 2024-03-09T14:37:08.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.399+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~BC8PDZO2AN6J.0 size=1048576 2024-03-09T14:37:08.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.399+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~BC8PDZO2AN6J.1 size=1048576 2024-03-09T14:37:08.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.403+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~BC8PDZO2AN6J.2 size=853182 2024-03-09T14:37:08.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.403+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=BC8PDZO2AN6J tag=7MMLHJ3Q66D8 type=write size=3998910 2024-03-09T14:37:08.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.407+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~AMI33UV5AKNC.0 size=252953 2024-03-09T14:37:08.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.411+0000 7fd389e788c0 1 < completed multipart upload key=Y7E2TLASJM9T upload=AMI33UV5AKNC tag=EFJ41M34D2TM type=write size=1301529 2024-03-09T14:37:08.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.415+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~3WVEOAKTE88R.0 size=1048576 2024-03-09T14:37:08.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.419+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~3WVEOAKTE88R.1 size=1048576 2024-03-09T14:37:08.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.423+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~3WVEOAKTE88R.2 size=204042 2024-03-09T14:37:08.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.423+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=3WVEOAKTE88R tag=8XJ66L09LFAL type=write size=3349770 2024-03-09T14:37:08.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.423+0000 7fd389e788c0 -1 < failed to complete operation key=6VT4C288571G tag=NO52MPRRQR0U type=del size=3793799: (22) Invalid argument 2024-03-09T14:37:08.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.427+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=6JBPT10X7CFI type=del size=1179184 2024-03-09T14:37:08.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.431+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=3NEF01MUYHA4 type=del 2024-03-09T14:37:08.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.435+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~UZ040CLIEHP3.0 size=1048576 2024-03-09T14:37:08.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.439+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~UZ040CLIEHP3.1 size=170641 2024-03-09T14:37:08.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.439+0000 7fd389e788c0 1 > prepared multipart upload key=2405Y4I2Q8TY upload=UZ040CLIEHP3 tag=X39VG144NUCC type=write size=2267793 2024-03-09T14:37:08.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.443+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~JFH73X9UR85M.0 size=1048576 2024-03-09T14:37:08.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.443+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~JFH73X9UR85M.1 size=295829 2024-03-09T14:37:08.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.451+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=JFH73X9UR85M tag=3SAJPZITW31F type=write size=2392981 2024-03-09T14:37:08.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.451+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=B7LBJJB6KC31 type=write size=383855 2024-03-09T14:37:08.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.455+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~C7210MHDJ1T8.0 size=1048576 2024-03-09T14:37:08.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.459+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~C7210MHDJ1T8.1 size=1048576 2024-03-09T14:37:08.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.463+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~C7210MHDJ1T8.2 size=46661 2024-03-09T14:37:08.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.471+0000 7fd389e788c0 1 < completed multipart upload key=P83H9137MI7Y upload=C7210MHDJ1T8 tag=ZQN1RSWRKA26 type=write size=3192389 2024-03-09T14:37:08.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.471+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=VICYDG1KO2AS type=del size=2295295 2024-03-09T14:37:08.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.475+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=0MG5PJPZ6JS7 type=del 2024-03-09T14:37:08.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.479+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=IRF6T6IRVA87 type=del size=1717400 2024-03-09T14:37:08.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.483+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=BF2P0XQP7EHL type=del 2024-03-09T14:37:08.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.487+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~AUSEVCUX7FRV.0 size=1048576 2024-03-09T14:37:08.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.491+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~AUSEVCUX7FRV.1 size=461219 2024-03-09T14:37:08.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.491+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=AUSEVCUX7FRV tag=YCYAJ64S3990 type=write size=2558371 2024-03-09T14:37:08.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.495+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=HTHDWA0OATJO type=del 2024-03-09T14:37:08.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.499+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~UO3A7H60FZJP.0 size=920729 2024-03-09T14:37:08.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.499+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=UO3A7H60FZJP tag=KYVQFCHDYMGR type=write size=1969305 2024-03-09T14:37:08.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.503+0000 7fd389e788c0 1 < completed delete operation key=UMT7VKZ9R4IR tag=7F43WW61VRSG type=del 2024-03-09T14:37:08.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.511+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~541O5HUNLC2L.0 size=566986 2024-03-09T14:37:08.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.511+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=541O5HUNLC2L tag=H8HP7XSSL7SZ type=write size=1615562 2024-03-09T14:37:08.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.511+0000 7fd389e788c0 1 < canceled part key=_multipart_I4NA328AI5T1.2~SWM8A41TVBOQ.0 size=418449 2024-03-09T14:37:08.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.515+0000 7fd389e788c0 1 < canceled multipart upload key=I4NA328AI5T1 upload=SWM8A41TVBOQ tag=F852M3J7M1HF type=write size=1467025 2024-03-09T14:37:08.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.519+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=1D3LLXHNWAUA type=del size=2447055 2024-03-09T14:37:08.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.523+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=GTGP2462C0LZ type=del 2024-03-09T14:37:08.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.523+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=UOGQOFNCTXBA type=del size=3863367 2024-03-09T14:37:08.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.527+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=NST6E0GY9Y1R type=del 2024-03-09T14:37:08.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.531+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=DQRVUI9UFOV0 type=del size=845017 2024-03-09T14:37:08.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.535+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=V12HEL6RRISO type=del 2024-03-09T14:37:08.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.539+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~F4F20T5OACFR.0 size=1048576 2024-03-09T14:37:08.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.543+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~F4F20T5OACFR.1 size=807012 2024-03-09T14:37:08.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.543+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=F4F20T5OACFR tag=ZFLUEKFAJDZL type=write size=2904164 2024-03-09T14:37:08.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.547+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~UE2SQVCTT7H7.0 size=495120 2024-03-09T14:37:08.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.551+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=UE2SQVCTT7H7 tag=GRZTUZ78GU9P type=write size=1543696 2024-03-09T14:37:08.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.555+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=PVVQYLUWB6BN type=del size=657108 2024-03-09T14:37:08.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.559+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=9T50GTSGJA65 type=del 2024-03-09T14:37:08.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.563+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~JJ6Q6OMB09YF.0 size=925212 2024-03-09T14:37:08.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.563+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=JJ6Q6OMB09YF tag=ZO9WNFDI1SEF type=write size=1973788 2024-03-09T14:37:08.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.567+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~BC8PDZO2AN6J.0 size=1048576 2024-03-09T14:37:08.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.571+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~BC8PDZO2AN6J.1 size=1048576 2024-03-09T14:37:08.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.571+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~BC8PDZO2AN6J.2 size=853182 2024-03-09T14:37:08.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.579+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=BC8PDZO2AN6J tag=7MMLHJ3Q66D8 type=write size=3998910 2024-03-09T14:37:08.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.583+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=9XSHZBFM9HSH type=del size=2406220 2024-03-09T14:37:08.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.587+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~3WVEOAKTE88R.0 size=1048576 2024-03-09T14:37:08.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.587+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~3WVEOAKTE88R.1 size=1048576 2024-03-09T14:37:08.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.591+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~3WVEOAKTE88R.2 size=204042 2024-03-09T14:37:08.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.595+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=3WVEOAKTE88R tag=8XJ66L09LFAL type=write size=3349770 2024-03-09T14:37:08.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.603+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~AMXO98QKP3N9.0 size=1048576 2024-03-09T14:37:08.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.607+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~AMXO98QKP3N9.1 size=219129 2024-03-09T14:37:08.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.607+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=AMXO98QKP3N9 tag=J96FG5CSKUJ0 type=write size=2316281 2024-03-09T14:37:08.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.607+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=6JBPT10X7CFI type=del 2024-03-09T14:37:08.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.611+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=6VXQ151PE2T0 type=del size=2508385 2024-03-09T14:37:08.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.615+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~UZ040CLIEHP3.0 size=1048576 2024-03-09T14:37:08.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.619+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~UZ040CLIEHP3.1 size=170641 2024-03-09T14:37:08.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.623+0000 7fd389e788c0 1 < completed multipart upload key=2405Y4I2Q8TY upload=UZ040CLIEHP3 tag=X39VG144NUCC type=write size=2267793 2024-03-09T14:37:08.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.627+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=0A2IS25R07F2 type=del size=896176 2024-03-09T14:37:08.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.631+0000 7fd389e788c0 1 < canceled operation key=PKVYD8DWS7M2 tag=B7LBJJB6KC31 type=write size=383855 2024-03-09T14:37:08.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.635+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~GQMJPYIWUETO.0 size=204370 2024-03-09T14:37:08.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.635+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=GQMJPYIWUETO tag=2JMHASZH4DKB type=write size=1252946 2024-03-09T14:37:08.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.639+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=VICYDG1KO2AS type=del 2024-03-09T14:37:08.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.643+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~5K9X256XLUG7.0 size=1048576 2024-03-09T14:37:08.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.647+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~5K9X256XLUG7.1 size=1048576 2024-03-09T14:37:08.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.647+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~5K9X256XLUG7.2 size=33328 2024-03-09T14:37:08.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.647+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=5K9X256XLUG7 tag=E5TF6ONG8UTK type=write size=3179056 2024-03-09T14:37:08.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.651+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=IRF6T6IRVA87 type=del 2024-03-09T14:37:08.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.655+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=HXLOJ4DHR14R type=del size=3818689 2024-03-09T14:37:08.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.655+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~AUSEVCUX7FRV.0 size=1048576 2024-03-09T14:37:08.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.659+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~AUSEVCUX7FRV.1 size=461219 2024-03-09T14:37:08.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.663+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=AUSEVCUX7FRV tag=YCYAJ64S3990 type=write size=2558371 2024-03-09T14:37:08.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.667+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=DL3245PT63DG type=del size=1523824 2024-03-09T14:37:08.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.671+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~UO3A7H60FZJP.0 size=920729 2024-03-09T14:37:08.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.675+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=UO3A7H60FZJP tag=KYVQFCHDYMGR type=write size=1969305 2024-03-09T14:37:08.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.679+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~2HYFZT88H100.0 size=1027858 2024-03-09T14:37:08.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.679+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=2HYFZT88H100 tag=M86TIHNTJLVA type=write size=2076434 2024-03-09T14:37:08.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.683+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~541O5HUNLC2L.0 size=566986 2024-03-09T14:37:08.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.687+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=541O5HUNLC2L tag=H8HP7XSSL7SZ type=write size=1615562 2024-03-09T14:37:08.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.691+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=M8T3VFQ0EVPP type=del size=2877174 2024-03-09T14:37:08.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.695+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=1D3LLXHNWAUA type=del 2024-03-09T14:37:08.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.695+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=91VPS23N01F9 type=del size=742147 2024-03-09T14:37:08.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.699+0000 7fd389e788c0 1 < canceled operation key=44F8QXCBBENS tag=UOGQOFNCTXBA type=del size=3863367 2024-03-09T14:37:08.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.703+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=TALOAOPW9YS2 type=del size=557002 2024-03-09T14:37:08.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.703+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=DQRVUI9UFOV0 type=del 2024-03-09T14:37:08.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.707+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=QYCYROTHVFVV type=del size=429701 2024-03-09T14:37:08.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.711+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~F4F20T5OACFR.0 size=1048576 2024-03-09T14:37:08.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.711+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~F4F20T5OACFR.1 size=807012 2024-03-09T14:37:08.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.719+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=F4F20T5OACFR tag=ZFLUEKFAJDZL type=write size=2904164 2024-03-09T14:37:08.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.719+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=934PQRQC9RLI type=del size=2223177 2024-03-09T14:37:08.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.723+0000 7fd389e788c0 1 < canceled operation key=PKVYD8DWS7M2 tag=PVVQYLUWB6BN type=del size=657108 2024-03-09T14:37:08.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.727+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=1RMRM9JCBKCU type=write size=826473 2024-03-09T14:37:08.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.731+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~JJ6Q6OMB09YF.0 size=925212 2024-03-09T14:37:08.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.735+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=JJ6Q6OMB09YF tag=ZO9WNFDI1SEF type=write size=1973788 2024-03-09T14:37:08.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.739+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~UJJDXEDAQTIG.0 size=1048576 2024-03-09T14:37:08.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.743+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~UJJDXEDAQTIG.1 size=347995 2024-03-09T14:37:08.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.743+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=UJJDXEDAQTIG tag=U2V0GHXJD35J type=write size=2445147 2024-03-09T14:37:08.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.743+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=9XSHZBFM9HSH type=del 2024-03-09T14:37:08.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.747+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=59SMMOCF1EG5 type=del size=552397 2024-03-09T14:37:08.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.751+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~AMXO98QKP3N9.0 size=1048576 2024-03-09T14:37:08.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.751+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~AMXO98QKP3N9.1 size=219129 2024-03-09T14:37:08.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.759+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=AMXO98QKP3N9 tag=J96FG5CSKUJ0 type=write size=2316281 2024-03-09T14:37:08.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.767+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~DTQZR6ID6LP0.0 size=1048576 2024-03-09T14:37:08.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.767+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~DTQZR6ID6LP0.1 size=1048576 2024-03-09T14:37:08.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.771+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~DTQZR6ID6LP0.2 size=738 2024-03-09T14:37:08.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.771+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=DTQZR6ID6LP0 tag=ADEN06PQNLVD type=write size=3146466 2024-03-09T14:37:08.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.775+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=6VXQ151PE2T0 type=del 2024-03-09T14:37:08.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.775+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=Z2SVT3ATN9DJ type=write size=560734 2024-03-09T14:37:08.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.779+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=0A2IS25R07F2 type=del 2024-03-09T14:37:08.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.783+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=JIJ3KQJERWHD type=del size=1397468 2024-03-09T14:37:08.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.787+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~GQMJPYIWUETO.0 size=204370 2024-03-09T14:37:08.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.791+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=GQMJPYIWUETO tag=2JMHASZH4DKB type=write size=1252946 2024-03-09T14:37:08.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.795+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=OJ1JL514QUOS type=del size=2534357 2024-03-09T14:37:08.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.799+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~5K9X256XLUG7.0 size=1048576 2024-03-09T14:37:08.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.799+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~5K9X256XLUG7.1 size=1048576 2024-03-09T14:37:08.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.803+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~5K9X256XLUG7.2 size=33328 2024-03-09T14:37:08.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.807+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=5K9X256XLUG7 tag=E5TF6ONG8UTK type=write size=3179056 2024-03-09T14:37:08.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.811+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=YQZCZZFDPGZ9 type=del size=2598207 2024-03-09T14:37:08.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.815+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=HXLOJ4DHR14R type=del 2024-03-09T14:37:08.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.819+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=G1FVODYZJM2Z type=del size=2300318 2024-03-09T14:37:08.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.823+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=DL3245PT63DG type=del 2024-03-09T14:37:08.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.827+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=9D8MX20JXU21 type=del size=3556421 2024-03-09T14:37:08.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.827+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~2HYFZT88H100.0 size=1027858 2024-03-09T14:37:08.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.835+0000 7fd389e788c0 1 < completed multipart upload key=K9X2N6V8R4BY upload=2HYFZT88H100 tag=M86TIHNTJLVA type=write size=2076434 2024-03-09T14:37:08.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.839+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=J83HB4C23FQB type=del size=3996006 2024-03-09T14:37:08.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.843+0000 7fd389e788c0 1 < suggested update operation key=5ZEDXFB9B3CN tag=M8T3VFQ0EVPP type=del size=2877174 2024-03-09T14:37:08.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.847+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=Z15SHNO76IKH type=del size=1018171 2024-03-09T14:37:08.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.851+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=91VPS23N01F9 type=del 2024-03-09T14:37:08.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.859+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~OO0L9T7HLQ3N.0 size=1048576 2024-03-09T14:37:08.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.859+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~OO0L9T7HLQ3N.1 size=1048576 2024-03-09T14:37:08.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.863+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~OO0L9T7HLQ3N.2 size=904752 2024-03-09T14:37:08.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.863+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=OO0L9T7HLQ3N tag=ID02T39TRZXE type=write size=4050480 2024-03-09T14:37:08.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.867+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=TALOAOPW9YS2 type=del 2024-03-09T14:37:08.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.867+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=3LA9X6FOF89W type=write size=602495 2024-03-09T14:37:08.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.871+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=QYCYROTHVFVV type=del 2024-03-09T14:37:08.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.879+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~NXIYWVF0HS8H.0 size=1048576 2024-03-09T14:37:08.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.879+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~NXIYWVF0HS8H.1 size=1048576 2024-03-09T14:37:08.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.883+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~NXIYWVF0HS8H.2 size=221767 2024-03-09T14:37:08.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.883+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=NXIYWVF0HS8H tag=4T7K6L6W7Z9W type=write size=3367495 2024-03-09T14:37:08.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.887+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=934PQRQC9RLI type=del 2024-03-09T14:37:08.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.891+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=6423HV1IOX2O type=del size=913759 2024-03-09T14:37:08.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.895+0000 7fd389e788c0 1 < completed write operation key=AUSZ4JUGI6UU tag=1RMRM9JCBKCU type=write size=826473 2024-03-09T14:37:08.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.895+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=D5DT3CZZNL1W type=del size=2477304 2024-03-09T14:37:08.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.899+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~UJJDXEDAQTIG.0 size=1048576 2024-03-09T14:37:08.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.903+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~UJJDXEDAQTIG.1 size=347995 2024-03-09T14:37:08.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.911+0000 7fd389e788c0 1 < completed multipart upload key=IXKMXJ9IZ69S upload=UJJDXEDAQTIG tag=U2V0GHXJD35J type=write size=2445147 2024-03-09T14:37:08.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.915+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=UFIQ243U0Z8Z type=del size=2976668 2024-03-09T14:37:08.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.919+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=59SMMOCF1EG5 type=del 2024-03-09T14:37:08.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.923+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=HQ2ZJ1ZB1ZP8 type=write size=920597 2024-03-09T14:37:08.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.927+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~DTQZR6ID6LP0.0 size=1048576 2024-03-09T14:37:08.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.927+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~DTQZR6ID6LP0.1 size=1048576 2024-03-09T14:37:08.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.927+0000 7fd389e788c0 1 < canceled part key=_multipart_ACL1T9GW2JV9.2~DTQZR6ID6LP0.2 size=738 2024-03-09T14:37:08.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.935+0000 7fd389e788c0 1 < canceled multipart upload key=ACL1T9GW2JV9 upload=DTQZR6ID6LP0 tag=ADEN06PQNLVD type=write size=3146466 2024-03-09T14:37:08.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.939+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=ZB1OQ0RX3BJO type=del size=4123278 2024-03-09T14:37:08.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.943+0000 7fd389e788c0 1 < suggested update operation key=FY02AR9GS3KG tag=Z2SVT3ATN9DJ type=write size=560734 2024-03-09T14:37:08.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.951+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~WBQOOSDMSSPD.0 size=1048576 2024-03-09T14:37:08.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.955+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~WBQOOSDMSSPD.1 size=1048576 2024-03-09T14:37:08.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.955+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~WBQOOSDMSSPD.2 size=979265 2024-03-09T14:37:08.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.955+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=WBQOOSDMSSPD tag=C2LL627VB6WN type=write size=4124993 2024-03-09T14:37:08.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.959+0000 7fd389e788c0 1 < completed delete operation key=YR2VX4QLOCOG tag=JIJ3KQJERWHD type=del 2024-03-09T14:37:08.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.963+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=85CCN0CUBAON type=write size=235396 2024-03-09T14:37:08.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.967+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=OJ1JL514QUOS type=del 2024-03-09T14:37:08.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.971+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~CQNOL8PQRX04.0 size=1048576 2024-03-09T14:37:08.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.975+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~CQNOL8PQRX04.1 size=1048576 2024-03-09T14:37:08.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.979+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~CQNOL8PQRX04.2 size=635138 2024-03-09T14:37:08.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.979+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=CQNOL8PQRX04 tag=6IIZQG8K4828 type=write size=3780866 2024-03-09T14:37:08.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.979+0000 7fd389e788c0 -1 < failed to complete operation key=5ZEDXFB9B3CN tag=YQZCZZFDPGZ9 type=del size=2598207: (22) Invalid argument 2024-03-09T14:37:08.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.983+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=R8MQ6A0ABR3B type=del size=1958608 2024-03-09T14:37:08.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.987+0000 7fd389e788c0 1 < canceled operation key=71692MJQITX3 tag=G1FVODYZJM2Z type=del size=2300318 2024-03-09T14:37:08.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.991+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~VWVVCPLT34DF.0 size=1048576 2024-03-09T14:37:08.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.995+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~VWVVCPLT34DF.1 size=1048576 2024-03-09T14:37:08.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.999+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~VWVVCPLT34DF.2 size=980953 2024-03-09T14:37:08.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:08.999+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=VWVVCPLT34DF tag=W9F8I9D2GP3Q type=write size=4126681 2024-03-09T14:37:09.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.003+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=9D8MX20JXU21 type=del 2024-03-09T14:37:09.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.007+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~JR53VK6KA3YY.0 size=521883 2024-03-09T14:37:09.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.007+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=JR53VK6KA3YY tag=DT108OD82TD2 type=write size=1570459 2024-03-09T14:37:09.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.011+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=J83HB4C23FQB type=del 2024-03-09T14:37:09.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.015+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=UEAJMYYE1RTB type=write size=898754 2024-03-09T14:37:09.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.019+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=Z15SHNO76IKH type=del 2024-03-09T14:37:09.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.023+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~U3F9R8TRV417.0 size=1048576 2024-03-09T14:37:09.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.023+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~U3F9R8TRV417.1 size=1048576 2024-03-09T14:37:09.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.027+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~U3F9R8TRV417.2 size=279891 2024-03-09T14:37:09.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.027+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=U3F9R8TRV417 tag=OWVPJ6RG7MSM type=write size=3425619 2024-03-09T14:37:09.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.031+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~OO0L9T7HLQ3N.0 size=1048576 2024-03-09T14:37:09.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.031+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~OO0L9T7HLQ3N.1 size=1048576 2024-03-09T14:37:09.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.035+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~OO0L9T7HLQ3N.2 size=904752 2024-03-09T14:37:09.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.039+0000 7fd389e788c0 1 < completed multipart upload key=P83H9137MI7Y upload=OO0L9T7HLQ3N tag=ID02T39TRZXE type=write size=4050480 2024-03-09T14:37:09.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.043+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=PY67RG4ORD9U type=del size=4045013 2024-03-09T14:37:09.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.047+0000 7fd389e788c0 1 < suggested update operation key=2405Y4I2Q8TY tag=3LA9X6FOF89W type=write size=602495 2024-03-09T14:37:09.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.051+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=JQ7S4NS3XK0K type=del size=472708 2024-03-09T14:37:09.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.055+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~NXIYWVF0HS8H.0 size=1048576 2024-03-09T14:37:09.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.059+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~NXIYWVF0HS8H.1 size=1048576 2024-03-09T14:37:09.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.067+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~NXIYWVF0HS8H.2 size=221767 2024-03-09T14:37:09.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.075+0000 7fd389e788c0 1 < completed multipart upload key=8J6Z9DT07H0X upload=NXIYWVF0HS8H tag=4T7K6L6W7Z9W type=write size=3367495 2024-03-09T14:37:09.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.075+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=GSYVIQ526FUQ type=del size=3215986 2024-03-09T14:37:09.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.079+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=6423HV1IOX2O type=del 2024-03-09T14:37:09.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.083+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=YVDQJLSUMGAY type=write size=510021 2024-03-09T14:37:09.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.087+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=D5DT3CZZNL1W type=del 2024-03-09T14:37:09.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.095+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~GMV8O53RRAHF.0 size=180750 2024-03-09T14:37:09.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.095+0000 7fd389e788c0 1 > prepared multipart upload key=GSNWWDS63MTA upload=GMV8O53RRAHF tag=CIDL2ZENMQ71 type=write size=1229326 2024-03-09T14:37:09.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.095+0000 7fd389e788c0 1 < completed delete operation key=PKVYD8DWS7M2 tag=UFIQ243U0Z8Z type=del 2024-03-09T14:37:09.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.099+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=JZJRWR5M8MTJ type=write size=643877 2024-03-09T14:37:09.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.103+0000 7fd389e788c0 -1 < failed to complete operation key=FY02AR9GS3KG tag=HQ2ZJ1ZB1ZP8 type=write size=920597: (22) Invalid argument 2024-03-09T14:37:09.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.111+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~225LDX2GEQC5.0 size=1048576 2024-03-09T14:37:09.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.111+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~225LDX2GEQC5.1 size=533390 2024-03-09T14:37:09.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.111+0000 7fd389e788c0 1 > prepared multipart upload key=DIN8WJ9Z9OI8 upload=225LDX2GEQC5 tag=SB4LGF0UY4YX type=write size=2630542 2024-03-09T14:37:09.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.119+0000 7fd389e788c0 1 < suggested remove operation key=2405Y4I2Q8TY tag=ZB1OQ0RX3BJO type=del 2024-03-09T14:37:09.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.127+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~F266LA8HYM0K.0 size=1048576 2024-03-09T14:37:09.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.127+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~F266LA8HYM0K.1 size=566641 2024-03-09T14:37:09.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.127+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=F266LA8HYM0K tag=Q8HJWAIYOHIW type=write size=2663793 2024-03-09T14:37:09.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.131+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~WBQOOSDMSSPD.0 size=1048576 2024-03-09T14:37:09.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.135+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~WBQOOSDMSSPD.1 size=1048576 2024-03-09T14:37:09.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.139+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~WBQOOSDMSSPD.2 size=979265 2024-03-09T14:37:09.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.143+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=WBQOOSDMSSPD tag=C2LL627VB6WN type=write size=4124993 2024-03-09T14:37:09.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.147+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=WU7KJ3TEQYSM type=del size=3647505 2024-03-09T14:37:09.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.151+0000 7fd389e788c0 1 < completed write operation key=I4NA328AI5T1 tag=85CCN0CUBAON type=write size=235396 2024-03-09T14:37:09.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.159+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~I9SAKKNVQELX.0 size=1048576 2024-03-09T14:37:09.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.159+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~I9SAKKNVQELX.1 size=361862 2024-03-09T14:37:09.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.159+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=I9SAKKNVQELX tag=W4DOZLFJZFIG type=write size=2459014 2024-03-09T14:37:09.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.163+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~CQNOL8PQRX04.0 size=1048576 2024-03-09T14:37:09.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.167+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~CQNOL8PQRX04.1 size=1048576 2024-03-09T14:37:09.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.167+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~CQNOL8PQRX04.2 size=635138 2024-03-09T14:37:09.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.175+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=CQNOL8PQRX04 tag=6IIZQG8K4828 type=write size=3780866 2024-03-09T14:37:09.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.175+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=49KZ6X5MTYJJ type=del size=332623 2024-03-09T14:37:09.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.183+0000 7fd389e788c0 1 < suggested remove operation key=SKIBISETJH7B tag=R8MQ6A0ABR3B type=del 2024-03-09T14:37:09.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.187+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=DZD7LMD5AXBT type=write size=433561 2024-03-09T14:37:09.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.191+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~VWVVCPLT34DF.0 size=1048576 2024-03-09T14:37:09.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.191+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~VWVVCPLT34DF.1 size=1048576 2024-03-09T14:37:09.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.195+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~VWVVCPLT34DF.2 size=980953 2024-03-09T14:37:09.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.199+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=VWVVCPLT34DF tag=W9F8I9D2GP3Q type=write size=4126681 2024-03-09T14:37:09.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.203+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=962VGANGD3YP type=del size=1409501 2024-03-09T14:37:09.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.207+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~JR53VK6KA3YY.0 size=521883 2024-03-09T14:37:09.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.211+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=JR53VK6KA3YY tag=DT108OD82TD2 type=write size=1570459 2024-03-09T14:37:09.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.215+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=7FX361Z2ADQM type=del size=2309007 2024-03-09T14:37:09.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.219+0000 7fd389e788c0 1 < completed write operation key=FY02AR9GS3KG tag=UEAJMYYE1RTB type=write size=898754 2024-03-09T14:37:09.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.223+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=RYDF2XFLI309 type=write size=105778 2024-03-09T14:37:09.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.223+0000 7fd389e788c0 1 < canceled part key=_multipart_YR2VX4QLOCOG.2~U3F9R8TRV417.0 size=1048576 2024-03-09T14:37:09.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.223+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~U3F9R8TRV417.1 size=1048576 2024-03-09T14:37:09.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.227+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~U3F9R8TRV417.2 size=279891 2024-03-09T14:37:09.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.231+0000 7fd389e788c0 1 < canceled multipart upload key=YR2VX4QLOCOG upload=U3F9R8TRV417 tag=OWVPJ6RG7MSM type=write size=3425619 2024-03-09T14:37:09.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.235+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=1DO9YTNK3R9Z type=del size=840671 2024-03-09T14:37:09.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.239+0000 7fd389e788c0 1 < canceled operation key=PKVYD8DWS7M2 tag=PY67RG4ORD9U type=del size=4045013 2024-03-09T14:37:09.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.243+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~89Y2J82WNI28.0 size=1048576 2024-03-09T14:37:09.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.247+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~89Y2J82WNI28.1 size=1048576 2024-03-09T14:37:09.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.247+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~89Y2J82WNI28.2 size=313565 2024-03-09T14:37:09.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.247+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=89Y2J82WNI28 tag=8G3D30AY0X0U type=write size=3459293 2024-03-09T14:37:09.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.251+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=JQ7S4NS3XK0K type=del 2024-03-09T14:37:09.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.255+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=A762ILP72ITJ type=del size=4075233 2024-03-09T14:37:09.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.255+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=GSYVIQ526FUQ type=del 2024-03-09T14:37:09.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.259+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=XVIV7V2HM82V type=write size=850925 2024-03-09T14:37:09.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.263+0000 7fd389e788c0 1 < canceled operation key=44F8QXCBBENS tag=YVDQJLSUMGAY type=write size=510021 2024-03-09T14:37:09.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.267+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~TAXNHIDU6YJY.0 size=414290 2024-03-09T14:37:09.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.267+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=TAXNHIDU6YJY tag=M1AZR1V3XI1G type=write size=1462866 2024-03-09T14:37:09.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.271+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~GMV8O53RRAHF.0 size=180750 2024-03-09T14:37:09.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.275+0000 7fd389e788c0 1 < completed multipart upload key=GSNWWDS63MTA upload=GMV8O53RRAHF tag=CIDL2ZENMQ71 type=write size=1229326 2024-03-09T14:37:09.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.275+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=MUOU2G0FUCK2 type=write size=939462 2024-03-09T14:37:09.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.283+0000 7fd389e788c0 1 < suggested update operation key=IXKMXJ9IZ69S tag=JZJRWR5M8MTJ type=write size=643877 2024-03-09T14:37:09.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.283+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=ANYWVZ5WD26W type=del size=3803385 2024-03-09T14:37:09.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.287+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~225LDX2GEQC5.0 size=1048576 2024-03-09T14:37:09.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.291+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~225LDX2GEQC5.1 size=533390 2024-03-09T14:37:09.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.295+0000 7fd389e788c0 1 < completed multipart upload key=DIN8WJ9Z9OI8 upload=225LDX2GEQC5 tag=SB4LGF0UY4YX type=write size=2630542 2024-03-09T14:37:09.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.299+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=E6XXXCOQORBZ type=del size=1388797 2024-03-09T14:37:09.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.299+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~F266LA8HYM0K.0 size=1048576 2024-03-09T14:37:09.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.303+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~F266LA8HYM0K.1 size=566641 2024-03-09T14:37:09.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.307+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=F266LA8HYM0K tag=Q8HJWAIYOHIW type=write size=2663793 2024-03-09T14:37:09.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.311+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=OQAMOGPZUIQ4 type=write size=563382 2024-03-09T14:37:09.316 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.315+0000 7fd389e788c0 1 < suggested update operation key=FY02AR9GS3KG tag=WU7KJ3TEQYSM type=del size=3647505 2024-03-09T14:37:09.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.319+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=Z0FQQ2UGY9W1 type=del size=2173172 2024-03-09T14:37:09.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.323+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~I9SAKKNVQELX.0 size=1048576 2024-03-09T14:37:09.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.323+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~I9SAKKNVQELX.1 size=361862 2024-03-09T14:37:09.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.327+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=I9SAKKNVQELX tag=W4DOZLFJZFIG type=write size=2459014 2024-03-09T14:37:09.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.331+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=E4YYVSUJEUN6 type=write size=864924 2024-03-09T14:37:09.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.335+0000 7fd389e788c0 1 < canceled operation key=1KJK6PF6U226 tag=49KZ6X5MTYJJ type=del size=332623 2024-03-09T14:37:09.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.335+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=59R4WSFGV9D8 type=del size=1423186 2024-03-09T14:37:09.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.339+0000 7fd389e788c0 1 < completed write operation key=PZJT6RWRJFIN tag=DZD7LMD5AXBT type=write size=433561 2024-03-09T14:37:09.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.343+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~HGJ1YK6JUEK6.0 size=459081 2024-03-09T14:37:09.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.343+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=HGJ1YK6JUEK6 tag=X30LN02VPHUA type=write size=1507657 2024-03-09T14:37:09.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.347+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=962VGANGD3YP type=del 2024-03-09T14:37:09.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.355+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~PC332AVM5UVL.0 size=501521 2024-03-09T14:37:09.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.355+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=PC332AVM5UVL tag=IUE9UPZ42CCY type=write size=1550097 2024-03-09T14:37:09.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.363+0000 7fd389e788c0 1 < suggested remove operation key=U8P5Q3D11MM6 tag=7FX361Z2ADQM type=del 2024-03-09T14:37:09.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.367+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=ROPFJ0P4NB8N type=del size=3249407 2024-03-09T14:37:09.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.371+0000 7fd389e788c0 1 < suggested remove operation key=8J6Z9DT07H0X tag=RYDF2XFLI309 type=write 2024-03-09T14:37:09.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.375+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=Y6L4GOR3X3OZ type=del size=727836 2024-03-09T14:37:09.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.379+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=1DO9YTNK3R9Z type=del 2024-03-09T14:37:09.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.383+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~KOXX4CR44L3K.0 size=1048576 2024-03-09T14:37:09.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.387+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~KOXX4CR44L3K.1 size=983249 2024-03-09T14:37:09.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.387+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=KOXX4CR44L3K tag=64RVIBE0RBFD type=write size=3080401 2024-03-09T14:37:09.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.391+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~89Y2J82WNI28.0 size=1048576 2024-03-09T14:37:09.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.395+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~89Y2J82WNI28.1 size=1048576 2024-03-09T14:37:09.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.395+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~89Y2J82WNI28.2 size=313565 2024-03-09T14:37:09.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.403+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=89Y2J82WNI28 tag=8G3D30AY0X0U type=write size=3459293 2024-03-09T14:37:09.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.407+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~R6OHW8LAUWH0.0 size=1048576 2024-03-09T14:37:09.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.411+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~R6OHW8LAUWH0.1 size=1048576 2024-03-09T14:37:09.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.411+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~R6OHW8LAUWH0.2 size=616578 2024-03-09T14:37:09.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.411+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=R6OHW8LAUWH0 tag=E547Z6QFW78B type=write size=3762306 2024-03-09T14:37:09.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.415+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=A762ILP72ITJ type=del 2024-03-09T14:37:09.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.419+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=XTUGU50CT019 type=del size=3812562 2024-03-09T14:37:09.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.423+0000 7fd389e788c0 1 < completed write operation key=FLLUAY21DJ12 tag=XVIV7V2HM82V type=write size=850925 2024-03-09T14:37:09.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.423+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=0ZUE8CO39AXU type=del size=3460708 2024-03-09T14:37:09.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.427+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~TAXNHIDU6YJY.0 size=414290 2024-03-09T14:37:09.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.431+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=TAXNHIDU6YJY tag=M1AZR1V3XI1G type=write size=1462866 2024-03-09T14:37:09.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.435+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=IY2C3ISE5FBG type=del size=3922329 2024-03-09T14:37:09.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.439+0000 7fd389e788c0 -1 < failed to complete operation key=8J6Z9DT07H0X tag=MUOU2G0FUCK2 type=write size=939462: (22) Invalid argument 2024-03-09T14:37:09.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.443+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~B1NIAFU59FVN.0 size=332033 2024-03-09T14:37:09.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.443+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=B1NIAFU59FVN tag=301ZYOF66TZP type=write size=1380609 2024-03-09T14:37:09.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.447+0000 7fd389e788c0 1 < completed delete operation key=YR2VX4QLOCOG tag=ANYWVZ5WD26W type=del 2024-03-09T14:37:09.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.451+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=CW4IG9HN9EPT type=del size=2473960 2024-03-09T14:37:09.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.451+0000 7fd389e788c0 1 < canceled operation key=FLLUAY21DJ12 tag=E6XXXCOQORBZ type=del size=1388797 2024-03-09T14:37:09.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.459+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~H6YVYEBSZ9PD.0 size=729006 2024-03-09T14:37:09.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.459+0000 7fd389e788c0 1 > prepared multipart upload key=DIN8WJ9Z9OI8 upload=H6YVYEBSZ9PD tag=NWZF450Q7M91 type=write size=1777582 2024-03-09T14:37:09.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.459+0000 7fd389e788c0 1 < canceled operation key=YR2VX4QLOCOG tag=OQAMOGPZUIQ4 type=write size=563382 2024-03-09T14:37:09.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.467+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~D8V06LT112E4.0 size=1048576 2024-03-09T14:37:09.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.467+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~D8V06LT112E4.1 size=1048576 2024-03-09T14:37:09.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.471+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~D8V06LT112E4.2 size=33355 2024-03-09T14:37:09.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.471+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=D8V06LT112E4 tag=9TLPGWSOUK3A type=write size=3179083 2024-03-09T14:37:09.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.475+0000 7fd389e788c0 1 < canceled operation key=E2VP0TJ37UX8 tag=Z0FQQ2UGY9W1 type=del size=2173172 2024-03-09T14:37:09.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.479+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~844YQPU5376V.0 size=1048576 2024-03-09T14:37:09.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.483+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~844YQPU5376V.1 size=98188 2024-03-09T14:37:09.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.483+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=844YQPU5376V tag=BFBTNF9G45VL type=write size=2195340 2024-03-09T14:37:09.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.483+0000 7fd389e788c0 1 < completed write operation key=UMT7VKZ9R4IR tag=E4YYVSUJEUN6 type=write size=864924 2024-03-09T14:37:09.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.487+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=29KBG98RP5VN type=del size=2922859 2024-03-09T14:37:09.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.491+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=59R4WSFGV9D8 type=del 2024-03-09T14:37:09.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.495+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~NZ48ENIXF34N.0 size=1048576 2024-03-09T14:37:09.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.495+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~NZ48ENIXF34N.1 size=1048576 2024-03-09T14:37:09.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.499+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~NZ48ENIXF34N.2 size=278504 2024-03-09T14:37:09.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.499+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=NZ48ENIXF34N tag=L7B5WC611XUH type=write size=3424232 2024-03-09T14:37:09.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.499+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~HGJ1YK6JUEK6.0 size=459081 2024-03-09T14:37:09.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.507+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=HGJ1YK6JUEK6 tag=X30LN02VPHUA type=write size=1507657 2024-03-09T14:37:09.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.507+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=KF1CIDWYWOWA type=del size=3898507 2024-03-09T14:37:09.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.511+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~PC332AVM5UVL.0 size=501521 2024-03-09T14:37:09.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.515+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=PC332AVM5UVL tag=IUE9UPZ42CCY type=write size=1550097 2024-03-09T14:37:09.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.519+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=BCFZ7GDDOBKF type=del size=3518522 2024-03-09T14:37:09.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.523+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=ROPFJ0P4NB8N type=del 2024-03-09T14:37:09.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.527+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~HYJGKIQV1T78.0 size=1048576 2024-03-09T14:37:09.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.527+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~HYJGKIQV1T78.1 size=1048576 2024-03-09T14:37:09.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.531+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~HYJGKIQV1T78.2 size=546810 2024-03-09T14:37:09.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.531+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=HYJGKIQV1T78 tag=RU80N5YSVVDN type=write size=3692538 2024-03-09T14:37:09.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.535+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=Y6L4GOR3X3OZ type=del 2024-03-09T14:37:09.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.535+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=UOG7V1WW0SH2 type=del size=3726526 2024-03-09T14:37:09.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.539+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~KOXX4CR44L3K.0 size=1048576 2024-03-09T14:37:09.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.543+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~KOXX4CR44L3K.1 size=983249 2024-03-09T14:37:09.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.547+0000 7fd389e788c0 1 < completed multipart upload key=Y7E2TLASJM9T upload=KOXX4CR44L3K tag=64RVIBE0RBFD type=write size=3080401 2024-03-09T14:37:09.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.551+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~IE541VKO8O69.0 size=1000559 2024-03-09T14:37:09.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.551+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=IE541VKO8O69 tag=0NE3YGJTXESE type=write size=2049135 2024-03-09T14:37:09.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.551+0000 7fd389e788c0 1 < canceled part key=_multipart_61RC3GUU437B.2~R6OHW8LAUWH0.0 size=1048576 2024-03-09T14:37:09.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.555+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~R6OHW8LAUWH0.1 size=1048576 2024-03-09T14:37:09.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.555+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~R6OHW8LAUWH0.2 size=616578 2024-03-09T14:37:09.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.563+0000 7fd389e788c0 1 < canceled multipart upload key=61RC3GUU437B upload=R6OHW8LAUWH0 tag=E547Z6QFW78B type=write size=3762306 2024-03-09T14:37:09.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.563+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=2RKLVVHIJ4RX type=del size=1254241 2024-03-09T14:37:09.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.567+0000 7fd389e788c0 1 < canceled operation key=2405Y4I2Q8TY tag=XTUGU50CT019 type=del size=3812562 2024-03-09T14:37:09.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.571+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=CXRYGA9EBIIV type=write size=794066 2024-03-09T14:37:09.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.575+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=0ZUE8CO39AXU type=del 2024-03-09T14:37:09.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.579+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~TGPE6T6Y9Q7D.0 size=1048576 2024-03-09T14:37:09.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.583+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~TGPE6T6Y9Q7D.1 size=1048576 2024-03-09T14:37:09.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.583+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~TGPE6T6Y9Q7D.2 size=295066 2024-03-09T14:37:09.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.583+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=TGPE6T6Y9Q7D tag=C4K2JZ297C8W type=write size=3440794 2024-03-09T14:37:09.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.587+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=IY2C3ISE5FBG type=del 2024-03-09T14:37:09.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.591+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=JHPQFQWW56W0 type=del size=896054 2024-03-09T14:37:09.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.595+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~B1NIAFU59FVN.0 size=332033 2024-03-09T14:37:09.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.599+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=B1NIAFU59FVN tag=301ZYOF66TZP type=write size=1380609 2024-03-09T14:37:09.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.603+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~9S6PFXW66LGE.0 size=1048576 2024-03-09T14:37:09.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.603+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~9S6PFXW66LGE.1 size=251717 2024-03-09T14:37:09.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.603+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=9S6PFXW66LGE tag=6VCJSM00A0RK type=write size=2348869 2024-03-09T14:37:09.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.607+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=CW4IG9HN9EPT type=del 2024-03-09T14:37:09.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.611+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~OIARYHEBWJKH.0 size=1048576 2024-03-09T14:37:09.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.615+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~OIARYHEBWJKH.1 size=1048576 2024-03-09T14:37:09.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.615+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~OIARYHEBWJKH.2 size=645458 2024-03-09T14:37:09.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.615+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=OIARYHEBWJKH tag=D1T1FW0MYMJZ type=write size=3791186 2024-03-09T14:37:09.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.619+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~H6YVYEBSZ9PD.0 size=729006 2024-03-09T14:37:09.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.623+0000 7fd389e788c0 1 < completed multipart upload key=DIN8WJ9Z9OI8 upload=H6YVYEBSZ9PD tag=NWZF450Q7M91 type=write size=1777582 2024-03-09T14:37:09.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.631+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~FCU4XXGV3PK8.0 size=1048576 2024-03-09T14:37:09.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.631+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~FCU4XXGV3PK8.1 size=1048576 2024-03-09T14:37:09.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.635+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~FCU4XXGV3PK8.2 size=820983 2024-03-09T14:37:09.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.635+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=FCU4XXGV3PK8 tag=QQR0DLF47H5K type=write size=3966711 2024-03-09T14:37:09.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.635+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~D8V06LT112E4.0 size=1048576 2024-03-09T14:37:09.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.639+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~D8V06LT112E4.1 size=1048576 2024-03-09T14:37:09.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.639+0000 7fd389e788c0 1 < canceled part key=_multipart_6VT4C288571G.2~D8V06LT112E4.2 size=33355 2024-03-09T14:37:09.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.643+0000 7fd389e788c0 1 < canceled multipart upload key=6VT4C288571G upload=D8V06LT112E4 tag=9TLPGWSOUK3A type=write size=3179083 2024-03-09T14:37:09.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.647+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~RNLJOAY8BG92.0 size=1010271 2024-03-09T14:37:09.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.647+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=RNLJOAY8BG92 tag=3E23SQZ9HA6R type=write size=2058847 2024-03-09T14:37:09.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.647+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~844YQPU5376V.0 size=1048576 2024-03-09T14:37:09.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.651+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~844YQPU5376V.1 size=98188 2024-03-09T14:37:09.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.651+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=844YQPU5376V tag=BFBTNF9G45VL type=write size=2195340 2024-03-09T14:37:09.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.655+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=ARBH8ML9TIJP type=del size=2027730 2024-03-09T14:37:09.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.659+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=29KBG98RP5VN type=del 2024-03-09T14:37:09.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.659+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=WMBFO35V6OSS type=del size=3121084 2024-03-09T14:37:09.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.659+0000 7fd389e788c0 1 < canceled part key=_multipart_AUSZ4JUGI6UU.2~NZ48ENIXF34N.0 size=1048576 2024-03-09T14:37:09.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.663+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~NZ48ENIXF34N.1 size=1048576 2024-03-09T14:37:09.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.663+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~NZ48ENIXF34N.2 size=278504 2024-03-09T14:37:09.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.667+0000 7fd389e788c0 1 < canceled multipart upload key=AUSZ4JUGI6UU upload=NZ48ENIXF34N tag=L7B5WC611XUH type=write size=3424232 2024-03-09T14:37:09.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.671+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~8QP0SKMSGW0I.0 size=1048576 2024-03-09T14:37:09.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.675+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~8QP0SKMSGW0I.1 size=182621 2024-03-09T14:37:09.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.675+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=8QP0SKMSGW0I tag=FAE7HXFAG3N7 type=write size=2279773 2024-03-09T14:37:09.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.675+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=KF1CIDWYWOWA type=del 2024-03-09T14:37:09.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.679+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~W8EGA0ML5YQC.0 size=1048576 2024-03-09T14:37:09.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.679+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~W8EGA0ML5YQC.1 size=1048576 2024-03-09T14:37:09.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.683+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~W8EGA0ML5YQC.2 size=73927 2024-03-09T14:37:09.682 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.683+0000 7fd389e788c0 1 > prepared multipart upload key=UMT7VKZ9R4IR upload=W8EGA0ML5YQC tag=1RBPCQR2PBG3 type=write size=3219655 2024-03-09T14:37:09.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.687+0000 7fd389e788c0 1 < suggested remove operation key=P83H9137MI7Y tag=BCFZ7GDDOBKF type=del 2024-03-09T14:37:09.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.687+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=AA6UQ8I0ZCK9 type=del size=2991713 2024-03-09T14:37:09.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.687+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~HYJGKIQV1T78.0 size=1048576 2024-03-09T14:37:09.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.691+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~HYJGKIQV1T78.1 size=1048576 2024-03-09T14:37:09.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.691+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~HYJGKIQV1T78.2 size=546810 2024-03-09T14:37:09.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.695+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=HYJGKIQV1T78 tag=RU80N5YSVVDN type=write size=3692538 2024-03-09T14:37:09.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.699+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=M7NJQBEG0O6K type=del size=3773880 2024-03-09T14:37:09.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.699+0000 7fd389e788c0 -1 < failed to complete operation key=P83H9137MI7Y tag=UOG7V1WW0SH2 type=del size=3726526: (22) Invalid argument 2024-03-09T14:37:09.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.703+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~LME0QD9Z1XFB.0 size=177190 2024-03-09T14:37:09.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.703+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=LME0QD9Z1XFB tag=IRDPW60QBKAF type=write size=1225766 2024-03-09T14:37:09.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.703+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~IE541VKO8O69.0 size=1000559 2024-03-09T14:37:09.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.707+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=IE541VKO8O69 tag=0NE3YGJTXESE type=write size=2049135 2024-03-09T14:37:09.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.711+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=1DZ7FN4D7NAE type=del size=817089 2024-03-09T14:37:09.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.711+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=2RKLVVHIJ4RX type=del 2024-03-09T14:37:09.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.715+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=NZAFUPL1AWEP type=del size=2828767 2024-03-09T14:37:09.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.715+0000 7fd389e788c0 1 < canceled operation key=E2VP0TJ37UX8 tag=CXRYGA9EBIIV type=write size=794066 2024-03-09T14:37:09.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.719+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=KRE7DIBBXY1G type=write size=329612 2024-03-09T14:37:09.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.719+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~TGPE6T6Y9Q7D.0 size=1048576 2024-03-09T14:37:09.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.723+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~TGPE6T6Y9Q7D.1 size=1048576 2024-03-09T14:37:09.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.723+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~TGPE6T6Y9Q7D.2 size=295066 2024-03-09T14:37:09.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.727+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=TGPE6T6Y9Q7D tag=C4K2JZ297C8W type=write size=3440794 2024-03-09T14:37:09.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.731+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=CM53P2MEQE25 type=del size=21094 2024-03-09T14:37:09.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.731+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=JHPQFQWW56W0 type=del 2024-03-09T14:37:09.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.731+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=22NI34K0QA83 type=del size=432026 2024-03-09T14:37:09.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.735+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~9S6PFXW66LGE.0 size=1048576 2024-03-09T14:37:09.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.735+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~9S6PFXW66LGE.1 size=251717 2024-03-09T14:37:09.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.739+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=9S6PFXW66LGE tag=6VCJSM00A0RK type=write size=2348869 2024-03-09T14:37:09.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.743+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~UA0GCX4J83II.0 size=1048576 2024-03-09T14:37:09.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.743+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~UA0GCX4J83II.1 size=105560 2024-03-09T14:37:09.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.743+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=UA0GCX4J83II tag=1DJ16JSQP4CN type=write size=2202712 2024-03-09T14:37:09.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.747+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~OIARYHEBWJKH.0 size=1048576 2024-03-09T14:37:09.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.747+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~OIARYHEBWJKH.1 size=1048576 2024-03-09T14:37:09.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.751+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~OIARYHEBWJKH.2 size=645458 2024-03-09T14:37:09.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.755+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=OIARYHEBWJKH tag=D1T1FW0MYMJZ type=write size=3791186 2024-03-09T14:37:09.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.755+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=4PI2SFCSQ7BZ type=del size=2254446 2024-03-09T14:37:09.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.759+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~FCU4XXGV3PK8.0 size=1048576 2024-03-09T14:37:09.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.759+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~FCU4XXGV3PK8.1 size=1048576 2024-03-09T14:37:09.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.759+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~FCU4XXGV3PK8.2 size=820983 2024-03-09T14:37:09.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.763+0000 7fd389e788c0 1 < completed multipart upload key=8J6Z9DT07H0X upload=FCU4XXGV3PK8 tag=QQR0DLF47H5K type=write size=3966711 2024-03-09T14:37:09.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.767+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=Q2KPEJH0F4OV type=del size=4113389 2024-03-09T14:37:09.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.767+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~RNLJOAY8BG92.0 size=1010271 2024-03-09T14:37:09.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.771+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=RNLJOAY8BG92 tag=3E23SQZ9HA6R type=write size=2058847 2024-03-09T14:37:09.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.775+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=CS72JE9UPJ7F type=del size=602879 2024-03-09T14:37:09.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.775+0000 7fd389e788c0 1 < canceled operation key=AUSZ4JUGI6UU tag=ARBH8ML9TIJP type=del size=2027730 2024-03-09T14:37:09.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.779+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~3LI6WDLRB6G9.0 size=1048576 2024-03-09T14:37:09.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.779+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~3LI6WDLRB6G9.1 size=1010614 2024-03-09T14:37:09.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.779+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=3LI6WDLRB6G9 tag=SZUIN062FU40 type=write size=3107766 2024-03-09T14:37:09.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.783+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=WMBFO35V6OSS type=del 2024-03-09T14:37:09.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.787+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=XYFSW6EF8B9W type=del size=3021952 2024-03-09T14:37:09.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.787+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~8QP0SKMSGW0I.0 size=1048576 2024-03-09T14:37:09.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.791+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~8QP0SKMSGW0I.1 size=182621 2024-03-09T14:37:09.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.791+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=8QP0SKMSGW0I tag=FAE7HXFAG3N7 type=write size=2279773 2024-03-09T14:37:09.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.795+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~3G3BE2ZSLYXB.0 size=1048576 2024-03-09T14:37:09.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.799+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~3G3BE2ZSLYXB.1 size=326801 2024-03-09T14:37:09.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.799+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=3G3BE2ZSLYXB tag=GK9ATYCI0LPI type=write size=2423953 2024-03-09T14:37:09.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.799+0000 7fd389e788c0 1 < canceled part key=_multipart_UMT7VKZ9R4IR.2~W8EGA0ML5YQC.0 size=1048576 2024-03-09T14:37:09.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.799+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~W8EGA0ML5YQC.1 size=1048576 2024-03-09T14:37:09.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.803+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~W8EGA0ML5YQC.2 size=73927 2024-03-09T14:37:09.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.807+0000 7fd389e788c0 1 < canceled multipart upload key=UMT7VKZ9R4IR upload=W8EGA0ML5YQC tag=1RBPCQR2PBG3 type=write size=3219655 2024-03-09T14:37:09.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.807+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=UNNY5LI5D3YV type=del size=2178772 2024-03-09T14:37:09.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.811+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=AA6UQ8I0ZCK9 type=del 2024-03-09T14:37:09.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.815+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=GTGPK740M21P type=del size=257435 2024-03-09T14:37:09.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.819+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=M7NJQBEG0O6K type=del 2024-03-09T14:37:09.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.823+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~RE898JX21MUA.0 size=1048576 2024-03-09T14:37:09.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.823+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~RE898JX21MUA.1 size=1048576 2024-03-09T14:37:09.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.827+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~RE898JX21MUA.2 size=523617 2024-03-09T14:37:09.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.827+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=RE898JX21MUA tag=DYL7F77EZVQ1 type=write size=3669345 2024-03-09T14:37:09.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.827+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~LME0QD9Z1XFB.0 size=177190 2024-03-09T14:37:09.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.831+0000 7fd389e788c0 1 < completed multipart upload key=E2VP0TJ37UX8 upload=LME0QD9Z1XFB tag=IRDPW60QBKAF type=write size=1225766 2024-03-09T14:37:09.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.835+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~907RLDY16MKY.0 size=1048576 2024-03-09T14:37:09.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.835+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~907RLDY16MKY.1 size=1048576 2024-03-09T14:37:09.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.835+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~907RLDY16MKY.2 size=137363 2024-03-09T14:37:09.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.835+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=907RLDY16MKY tag=Y0I9ZXJHZXI8 type=write size=3283091 2024-03-09T14:37:09.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.839+0000 7fd389e788c0 1 < completed delete operation key=DIN8WJ9Z9OI8 tag=1DZ7FN4D7NAE type=del 2024-03-09T14:37:09.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.839+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=NQXTQADULWWT type=del size=1689918 2024-03-09T14:37:09.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.843+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=NZAFUPL1AWEP type=del 2024-03-09T14:37:09.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.843+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=IQM2MTVI0R7F type=del size=2187505 2024-03-09T14:37:09.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.847+0000 7fd389e788c0 1 < completed write operation key=1KJK6PF6U226 tag=KRE7DIBBXY1G type=write size=329612 2024-03-09T14:37:09.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.847+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=MUYWMTIXYF90 type=del size=622180 2024-03-09T14:37:09.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.855+0000 7fd389e788c0 1 < suggested remove operation key=FY02AR9GS3KG tag=CM53P2MEQE25 type=del 2024-03-09T14:37:09.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.855+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=N95VZZYPY5GZ type=del size=589985 2024-03-09T14:37:09.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.859+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=22NI34K0QA83 type=del 2024-03-09T14:37:09.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.859+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=UNQY25IUFQUN type=del size=3494733 2024-03-09T14:37:09.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.863+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~UA0GCX4J83II.0 size=1048576 2024-03-09T14:37:09.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.863+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~UA0GCX4J83II.1 size=105560 2024-03-09T14:37:09.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.867+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=UA0GCX4J83II tag=1DJ16JSQP4CN type=write size=2202712 2024-03-09T14:37:09.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.867+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=DNLQWZE9UJI4 type=del size=239139 2024-03-09T14:37:09.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.871+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=4PI2SFCSQ7BZ type=del 2024-03-09T14:37:09.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.875+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~I724OVMS0GG6.0 size=1048576 2024-03-09T14:37:09.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.875+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~I724OVMS0GG6.1 size=1048576 2024-03-09T14:37:09.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.879+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~I724OVMS0GG6.2 size=582815 2024-03-09T14:37:09.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.879+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=I724OVMS0GG6 tag=ZR4GK1150F4H type=write size=3728543 2024-03-09T14:37:09.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.879+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=Q2KPEJH0F4OV type=del 2024-03-09T14:37:09.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.887+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~OOO2MSP9NRLF.0 size=976987 2024-03-09T14:37:09.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.887+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=OOO2MSP9NRLF tag=6MPEQX965S64 type=write size=2025563 2024-03-09T14:37:09.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.887+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=CS72JE9UPJ7F type=del 2024-03-09T14:37:09.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.891+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=REGIBDITUDAS type=del size=2313203 2024-03-09T14:37:09.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.891+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~3LI6WDLRB6G9.0 size=1048576 2024-03-09T14:37:09.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.895+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~3LI6WDLRB6G9.1 size=1010614 2024-03-09T14:37:09.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.895+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=3LI6WDLRB6G9 tag=SZUIN062FU40 type=write size=3107766 2024-03-09T14:37:09.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.899+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~8WOFZMFNV2VT.0 size=844949 2024-03-09T14:37:09.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.899+0000 7fd389e788c0 1 > prepared multipart upload key=GSNWWDS63MTA upload=8WOFZMFNV2VT tag=0S2HA6569X95 type=write size=1893525 2024-03-09T14:37:09.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.903+0000 7fd389e788c0 1 < completed delete operation key=UMT7VKZ9R4IR tag=XYFSW6EF8B9W type=del 2024-03-09T14:37:09.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.907+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~VFFFZS2X6LEG.0 size=1048576 2024-03-09T14:37:09.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.907+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~VFFFZS2X6LEG.1 size=305498 2024-03-09T14:37:09.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.907+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=VFFFZS2X6LEG tag=SDTTZXDTOL8D type=write size=2402650 2024-03-09T14:37:09.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.911+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~3G3BE2ZSLYXB.0 size=1048576 2024-03-09T14:37:09.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.911+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~3G3BE2ZSLYXB.1 size=326801 2024-03-09T14:37:09.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.915+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=3G3BE2ZSLYXB tag=GK9ATYCI0LPI type=write size=2423953 2024-03-09T14:37:09.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.915+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=RRQR22F0KGJQ type=del size=3833234 2024-03-09T14:37:09.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.923+0000 7fd389e788c0 1 < suggested update operation key=P83H9137MI7Y tag=UNNY5LI5D3YV type=del size=2178772 2024-03-09T14:37:09.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.923+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~SC0R28H5JK38.0 size=1048576 2024-03-09T14:37:09.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.927+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~SC0R28H5JK38.1 size=1048576 2024-03-09T14:37:09.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.927+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~SC0R28H5JK38.2 size=1009400 2024-03-09T14:37:09.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.927+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=SC0R28H5JK38 tag=LDIXST4X7LM8 type=write size=4155128 2024-03-09T14:37:09.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.931+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=GTGPK740M21P type=del 2024-03-09T14:37:09.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.931+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~1ET6CXF2ZVQ7.0 size=1048576 2024-03-09T14:37:09.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.935+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~1ET6CXF2ZVQ7.1 size=57051 2024-03-09T14:37:09.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.935+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=1ET6CXF2ZVQ7 tag=IAQD7NY1KFC9 type=write size=2154203 2024-03-09T14:37:09.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.935+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~RE898JX21MUA.0 size=1048576 2024-03-09T14:37:09.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.939+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~RE898JX21MUA.1 size=1048576 2024-03-09T14:37:09.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.939+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~RE898JX21MUA.2 size=523617 2024-03-09T14:37:09.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.943+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=RE898JX21MUA tag=DYL7F77EZVQ1 type=write size=3669345 2024-03-09T14:37:09.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.943+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=KUIUH93202LC type=write size=465947 2024-03-09T14:37:09.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.947+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~907RLDY16MKY.0 size=1048576 2024-03-09T14:37:09.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.947+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~907RLDY16MKY.1 size=1048576 2024-03-09T14:37:09.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.951+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~907RLDY16MKY.2 size=137363 2024-03-09T14:37:09.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.955+0000 7fd389e788c0 1 < completed multipart upload key=Z18Q66VI5PDN upload=907RLDY16MKY tag=Y0I9ZXJHZXI8 type=write size=3283091 2024-03-09T14:37:09.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.955+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=52KC8UYJDJVC type=del size=2046283 2024-03-09T14:37:09.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.955+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=NQXTQADULWWT type=del 2024-03-09T14:37:09.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.959+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~ZO10NWYX7VJQ.0 size=7706 2024-03-09T14:37:09.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.959+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=ZO10NWYX7VJQ tag=IT8VZT8J1GU0 type=write size=1056282 2024-03-09T14:37:09.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.963+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=IQM2MTVI0R7F type=del 2024-03-09T14:37:09.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.967+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~DQUTVJ0T1A6Y.0 size=1048576 2024-03-09T14:37:09.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.967+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~DQUTVJ0T1A6Y.1 size=444636 2024-03-09T14:37:09.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.967+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=DQUTVJ0T1A6Y tag=E68QVDBQC2TQ type=write size=2541788 2024-03-09T14:37:09.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.971+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=MUYWMTIXYF90 type=del 2024-03-09T14:37:09.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.975+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~DXZI7PALV0XN.0 size=1048576 2024-03-09T14:37:09.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.975+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~DXZI7PALV0XN.1 size=1048576 2024-03-09T14:37:09.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.979+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~DXZI7PALV0XN.2 size=694036 2024-03-09T14:37:09.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.979+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=DXZI7PALV0XN tag=LMY21NMM5KJI type=write size=3839764 2024-03-09T14:37:09.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.983+0000 7fd389e788c0 1 < suggested remove operation key=8J6Z9DT07H0X tag=N95VZZYPY5GZ type=del 2024-03-09T14:37:09.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.987+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~BCF0T0NB74SJ.0 size=1048576 2024-03-09T14:37:09.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.991+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~BCF0T0NB74SJ.1 size=1048576 2024-03-09T14:37:09.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.991+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~BCF0T0NB74SJ.2 size=127492 2024-03-09T14:37:09.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.991+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=BCF0T0NB74SJ tag=1ZY4WOD246ZM type=write size=3273220 2024-03-09T14:37:09.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.995+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=UNQY25IUFQUN type=del 2024-03-09T14:37:09.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.999+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=TJ33VC6HD3II type=del size=764229 2024-03-09T14:37:10.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:09.999+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=DNLQWZE9UJI4 type=del 2024-03-09T14:37:10.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.003+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~CX7QZTRALN09.0 size=448154 2024-03-09T14:37:10.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.003+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=CX7QZTRALN09 tag=N7O7LU57QFLE type=write size=1496730 2024-03-09T14:37:10.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.007+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~I724OVMS0GG6.0 size=1048576 2024-03-09T14:37:10.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.007+0000 7fd389e788c0 1 < canceled part key=_multipart_1KJK6PF6U226.2~I724OVMS0GG6.1 size=1048576 2024-03-09T14:37:10.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.007+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~I724OVMS0GG6.2 size=582815 2024-03-09T14:37:10.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.011+0000 7fd389e788c0 1 < canceled multipart upload key=1KJK6PF6U226 upload=I724OVMS0GG6 tag=ZR4GK1150F4H type=write size=3728543 2024-03-09T14:37:10.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.015+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~8EUQ0T3KCHF7.0 size=407656 2024-03-09T14:37:10.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.015+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=8EUQ0T3KCHF7 tag=0Q3CSQ9SYTI4 type=write size=1456232 2024-03-09T14:37:10.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.019+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~OOO2MSP9NRLF.0 size=976987 2024-03-09T14:37:10.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.019+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=OOO2MSP9NRLF tag=6MPEQX965S64 type=write size=2025563 2024-03-09T14:37:10.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.023+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~9VE1EN9UX89O.0 size=338324 2024-03-09T14:37:10.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.023+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=9VE1EN9UX89O tag=VODO91SISA96 type=write size=1386900 2024-03-09T14:37:10.026 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.027+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=REGIBDITUDAS type=del 2024-03-09T14:37:10.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.027+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=ONR4Q1K1FD78 type=del size=3585259 2024-03-09T14:37:10.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.031+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~8WOFZMFNV2VT.0 size=844949 2024-03-09T14:37:10.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.031+0000 7fd389e788c0 1 < completed multipart upload key=GSNWWDS63MTA upload=8WOFZMFNV2VT tag=0S2HA6569X95 type=write size=1893525 2024-03-09T14:37:10.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.035+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=GAK27XUAPRLD type=del size=1776555 2024-03-09T14:37:10.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.035+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~VFFFZS2X6LEG.0 size=1048576 2024-03-09T14:37:10.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.035+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~VFFFZS2X6LEG.1 size=305498 2024-03-09T14:37:10.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.039+0000 7fd389e788c0 1 < completed multipart upload key=CLAM83TC7RZ7 upload=VFFFZS2X6LEG tag=SDTTZXDTOL8D type=write size=2402650 2024-03-09T14:37:10.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.039+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=JOXJ3XUXB5YD type=del size=3759082 2024-03-09T14:37:10.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.043+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=RRQR22F0KGJQ type=del 2024-03-09T14:37:10.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.047+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~RE8GAL0LX1R4.0 size=1048576 2024-03-09T14:37:10.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.047+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~RE8GAL0LX1R4.1 size=1048576 2024-03-09T14:37:10.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.047+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~RE8GAL0LX1R4.2 size=216817 2024-03-09T14:37:10.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.047+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=RE8GAL0LX1R4 tag=BGXFQSEZ044P type=write size=3362545 2024-03-09T14:37:10.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.051+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~SC0R28H5JK38.0 size=1048576 2024-03-09T14:37:10.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.051+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~SC0R28H5JK38.1 size=1048576 2024-03-09T14:37:10.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.051+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~SC0R28H5JK38.2 size=1009400 2024-03-09T14:37:10.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.055+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=SC0R28H5JK38 tag=LDIXST4X7LM8 type=write size=4155128 2024-03-09T14:37:10.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.059+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~BA3RU9UGX5K0.0 size=1048576 2024-03-09T14:37:10.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.059+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~BA3RU9UGX5K0.1 size=1048576 2024-03-09T14:37:10.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.059+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~BA3RU9UGX5K0.2 size=668368 2024-03-09T14:37:10.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.059+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=BA3RU9UGX5K0 tag=HB43UTX7UY7Q type=write size=3814096 2024-03-09T14:37:10.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.063+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~1ET6CXF2ZVQ7.0 size=1048576 2024-03-09T14:37:10.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.063+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~1ET6CXF2ZVQ7.1 size=57051 2024-03-09T14:37:10.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.067+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=1ET6CXF2ZVQ7 tag=IAQD7NY1KFC9 type=write size=2154203 2024-03-09T14:37:10.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.067+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=0AHE5JT6T4VY type=del size=3268164 2024-03-09T14:37:10.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.071+0000 7fd389e788c0 1 < suggested remove operation key=61RC3GUU437B tag=KUIUH93202LC type=write 2024-03-09T14:37:10.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.075+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~9YA3F4KPEOZ9.0 size=225577 2024-03-09T14:37:10.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.075+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=9YA3F4KPEOZ9 tag=W8TF7FM1RHMY type=write size=1274153 2024-03-09T14:37:10.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.075+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=52KC8UYJDJVC type=del 2024-03-09T14:37:10.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.079+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=HH3P7QAM4TXV type=del size=574951 2024-03-09T14:37:10.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.079+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~ZO10NWYX7VJQ.0 size=7706 2024-03-09T14:37:10.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.083+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=ZO10NWYX7VJQ tag=IT8VZT8J1GU0 type=write size=1056282 2024-03-09T14:37:10.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.083+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=CC7VK9VYV7H2 type=del size=3154285 2024-03-09T14:37:10.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.087+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~DQUTVJ0T1A6Y.0 size=1048576 2024-03-09T14:37:10.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.087+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~DQUTVJ0T1A6Y.1 size=444636 2024-03-09T14:37:10.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.091+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=DQUTVJ0T1A6Y tag=E68QVDBQC2TQ type=write size=2541788 2024-03-09T14:37:10.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.091+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=3V4YWZLXDZE9 type=del size=163222 2024-03-09T14:37:10.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.095+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~DXZI7PALV0XN.0 size=1048576 2024-03-09T14:37:10.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.095+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~DXZI7PALV0XN.1 size=1048576 2024-03-09T14:37:10.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.095+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~DXZI7PALV0XN.2 size=694036 2024-03-09T14:37:10.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.099+0000 7fd389e788c0 1 < completed multipart upload key=IXKMXJ9IZ69S upload=DXZI7PALV0XN tag=LMY21NMM5KJI type=write size=3839764 2024-03-09T14:37:10.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.103+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~R2R2HGFDJCHV.0 size=1048576 2024-03-09T14:37:10.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.103+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~R2R2HGFDJCHV.1 size=1048576 2024-03-09T14:37:10.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.103+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~R2R2HGFDJCHV.2 size=519734 2024-03-09T14:37:10.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.103+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=R2R2HGFDJCHV tag=U053QD4G18N0 type=write size=3665462 2024-03-09T14:37:10.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.107+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~BCF0T0NB74SJ.0 size=1048576 2024-03-09T14:37:10.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.107+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~BCF0T0NB74SJ.1 size=1048576 2024-03-09T14:37:10.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.107+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~BCF0T0NB74SJ.2 size=127492 2024-03-09T14:37:10.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.111+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=BCF0T0NB74SJ tag=1ZY4WOD246ZM type=write size=3273220 2024-03-09T14:37:10.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.111+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=NJEY14G1XLBO type=del size=944604 2024-03-09T14:37:10.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.115+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=TJ33VC6HD3II type=del 2024-03-09T14:37:10.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.115+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=0AHTBBN1R0IX type=write size=180795 2024-03-09T14:37:10.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.115+0000 7fd389e788c0 1 < canceled part key=_multipart_SKIBISETJH7B.2~CX7QZTRALN09.0 size=448154 2024-03-09T14:37:10.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.119+0000 7fd389e788c0 1 < canceled multipart upload key=SKIBISETJH7B upload=CX7QZTRALN09 tag=N7O7LU57QFLE type=write size=1496730 2024-03-09T14:37:10.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.123+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~TB3HPLQGCCVH.0 size=645057 2024-03-09T14:37:10.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.123+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=TB3HPLQGCCVH tag=JUV4M3USGIOW type=write size=1693633 2024-03-09T14:37:10.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.123+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~8EUQ0T3KCHF7.0 size=407656 2024-03-09T14:37:10.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.127+0000 7fd389e788c0 1 < completed multipart upload key=P83H9137MI7Y upload=8EUQ0T3KCHF7 tag=0Q3CSQ9SYTI4 type=write size=1456232 2024-03-09T14:37:10.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.131+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~U8A033AJ3P02.0 size=746591 2024-03-09T14:37:10.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.131+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=U8A033AJ3P02 tag=ZJDSEUFSBLZO type=write size=1795167 2024-03-09T14:37:10.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.135+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~9VE1EN9UX89O.0 size=338324 2024-03-09T14:37:10.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.135+0000 7fd389e788c0 1 < completed multipart upload key=K9X2N6V8R4BY upload=9VE1EN9UX89O tag=VODO91SISA96 type=write size=1386900 2024-03-09T14:37:10.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.139+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~23W5F2REH257.0 size=1048576 2024-03-09T14:37:10.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.139+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~23W5F2REH257.1 size=1048576 2024-03-09T14:37:10.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.143+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~23W5F2REH257.2 size=132970 2024-03-09T14:37:10.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.143+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=23W5F2REH257 tag=89UEU02A5292 type=write size=3278698 2024-03-09T14:37:10.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.143+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=ONR4Q1K1FD78 type=del 2024-03-09T14:37:10.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.147+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=PNS25Y3J9OE9 type=del size=3984511 2024-03-09T14:37:10.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.151+0000 7fd389e788c0 1 < suggested update operation key=K9X2N6V8R4BY tag=GAK27XUAPRLD type=del size=1776555 2024-03-09T14:37:10.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.151+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=4EHCGLS88B3U type=del size=1354079 2024-03-09T14:37:10.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.155+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=JOXJ3XUXB5YD type=del 2024-03-09T14:37:10.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.159+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=OD5KV0UV9TE6 type=del size=627970 2024-03-09T14:37:10.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.159+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~RE8GAL0LX1R4.0 size=1048576 2024-03-09T14:37:10.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.159+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~RE8GAL0LX1R4.1 size=1048576 2024-03-09T14:37:10.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.159+0000 7fd389e788c0 1 < canceled part key=_multipart_71692MJQITX3.2~RE8GAL0LX1R4.2 size=216817 2024-03-09T14:37:10.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.163+0000 7fd389e788c0 1 < canceled multipart upload key=71692MJQITX3 upload=RE8GAL0LX1R4 tag=BGXFQSEZ044P type=write size=3362545 2024-03-09T14:37:10.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.167+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=E2YJ31W23F2L type=del size=3081858 2024-03-09T14:37:10.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.171+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~BA3RU9UGX5K0.0 size=1048576 2024-03-09T14:37:10.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.171+0000 7fd389e788c0 1 < canceled part key=_multipart_I4NA328AI5T1.2~BA3RU9UGX5K0.1 size=1048576 2024-03-09T14:37:10.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.171+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~BA3RU9UGX5K0.2 size=668368 2024-03-09T14:37:10.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.175+0000 7fd389e788c0 1 < canceled multipart upload key=I4NA328AI5T1 upload=BA3RU9UGX5K0 tag=HB43UTX7UY7Q type=write size=3814096 2024-03-09T14:37:10.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.179+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=X870R75VIW3P type=del size=752178 2024-03-09T14:37:10.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.179+0000 7fd389e788c0 1 < suggested update operation key=8J6Z9DT07H0X tag=0AHE5JT6T4VY type=del size=3268164 2024-03-09T14:37:10.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.183+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=8WLE4N6U64U0 type=del size=1616492 2024-03-09T14:37:10.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.183+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~9YA3F4KPEOZ9.0 size=225577 2024-03-09T14:37:10.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.187+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=9YA3F4KPEOZ9 tag=W8TF7FM1RHMY type=write size=1274153 2024-03-09T14:37:10.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.191+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~VQH7TD23BGXA.0 size=1048576 2024-03-09T14:37:10.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.191+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~VQH7TD23BGXA.1 size=1048576 2024-03-09T14:37:10.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.191+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~VQH7TD23BGXA.2 size=159849 2024-03-09T14:37:10.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.191+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=VQH7TD23BGXA tag=QMNDOZOU051D type=write size=3305577 2024-03-09T14:37:10.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.195+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=HH3P7QAM4TXV type=del 2024-03-09T14:37:10.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.195+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=W0PLTWR71AYE type=del size=2399297 2024-03-09T14:37:10.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.199+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=CC7VK9VYV7H2 type=del 2024-03-09T14:37:10.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.199+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=BIW4BQFCEEDC type=del size=2313143 2024-03-09T14:37:10.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.203+0000 7fd389e788c0 1 < completed delete operation key=DIN8WJ9Z9OI8 tag=3V4YWZLXDZE9 type=del 2024-03-09T14:37:10.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.207+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~SLUO1YBSOVPM.0 size=1048576 2024-03-09T14:37:10.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.211+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~SLUO1YBSOVPM.1 size=1045167 2024-03-09T14:37:10.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.211+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=SLUO1YBSOVPM tag=4DNKU00BOI20 type=write size=3142319 2024-03-09T14:37:10.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.211+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~R2R2HGFDJCHV.0 size=1048576 2024-03-09T14:37:10.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.211+0000 7fd389e788c0 1 < canceled part key=_multipart_8J6Z9DT07H0X.2~R2R2HGFDJCHV.1 size=1048576 2024-03-09T14:37:10.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.215+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~R2R2HGFDJCHV.2 size=519734 2024-03-09T14:37:10.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.219+0000 7fd389e788c0 1 < canceled multipart upload key=8J6Z9DT07H0X upload=R2R2HGFDJCHV tag=U053QD4G18N0 type=write size=3665462 2024-03-09T14:37:10.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.219+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=1PV5ABV84OA3 type=del size=3357803 2024-03-09T14:37:10.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.223+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=NJEY14G1XLBO type=del 2024-03-09T14:37:10.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.223+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=IHA8UHQ9IPXE type=del size=2762037 2024-03-09T14:37:10.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.227+0000 7fd389e788c0 1 < suggested update operation key=AUSZ4JUGI6UU tag=0AHTBBN1R0IX type=write size=180795 2024-03-09T14:37:10.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.231+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=0ST4I1ERQ4PF type=del size=521101 2024-03-09T14:37:10.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.231+0000 7fd389e788c0 1 < canceled part key=_multipart_CLAM83TC7RZ7.2~TB3HPLQGCCVH.0 size=645057 2024-03-09T14:37:10.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.235+0000 7fd389e788c0 1 < canceled multipart upload key=CLAM83TC7RZ7 upload=TB3HPLQGCCVH tag=JUV4M3USGIOW type=write size=1693633 2024-03-09T14:37:10.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.235+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=TJWMSS8IAOT1 type=del size=2031767 2024-03-09T14:37:10.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.239+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~U8A033AJ3P02.0 size=746591 2024-03-09T14:37:10.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.243+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=U8A033AJ3P02 tag=ZJDSEUFSBLZO type=write size=1795167 2024-03-09T14:37:10.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.243+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~MI842W1FZ22P.0 size=856945 2024-03-09T14:37:10.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.243+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=MI842W1FZ22P tag=F3KEGNF1W7Y9 type=write size=1905521 2024-03-09T14:37:10.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.247+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~23W5F2REH257.0 size=1048576 2024-03-09T14:37:10.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.251+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~23W5F2REH257.1 size=1048576 2024-03-09T14:37:10.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.251+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~23W5F2REH257.2 size=132970 2024-03-09T14:37:10.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.255+0000 7fd389e788c0 1 < completed multipart upload key=CLAM83TC7RZ7 upload=23W5F2REH257 tag=89UEU02A5292 type=write size=3278698 2024-03-09T14:37:10.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.259+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~TBHMYESUM1EN.0 size=371286 2024-03-09T14:37:10.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.259+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=TBHMYESUM1EN tag=Y89AMBA0RVY8 type=write size=1419862 2024-03-09T14:37:10.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.259+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=PNS25Y3J9OE9 type=del 2024-03-09T14:37:10.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.263+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=ODQAC21O2CDE type=del size=3301277 2024-03-09T14:37:10.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.267+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=4EHCGLS88B3U type=del 2024-03-09T14:37:10.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.267+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=5UE7VSWY1ONC type=del size=3332195 2024-03-09T14:37:10.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.271+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=OD5KV0UV9TE6 type=del 2024-03-09T14:37:10.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.271+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=U6KI4ZIG60TD type=del size=2192944 2024-03-09T14:37:10.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.275+0000 7fd389e788c0 1 < suggested update operation key=P83H9137MI7Y tag=E2YJ31W23F2L type=del size=3081858 2024-03-09T14:37:10.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.279+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=EIDL8J8OQMZ2 type=del size=1869974 2024-03-09T14:37:10.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.279+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=X870R75VIW3P type=del 2024-03-09T14:37:10.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.283+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=HNUTRYRGQD18 type=del size=2317608 2024-03-09T14:37:10.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.283+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=8WLE4N6U64U0 type=del 2024-03-09T14:37:10.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.287+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=DNU0USWXC907 type=del size=3802693 2024-03-09T14:37:10.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.287+0000 7fd389e788c0 1 < canceled part key=_multipart_YR2VX4QLOCOG.2~VQH7TD23BGXA.0 size=1048576 2024-03-09T14:37:10.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.287+0000 7fd389e788c0 1 < canceled part key=_multipart_YR2VX4QLOCOG.2~VQH7TD23BGXA.1 size=1048576 2024-03-09T14:37:10.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.287+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~VQH7TD23BGXA.2 size=159849 2024-03-09T14:37:10.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.291+0000 7fd389e788c0 1 < canceled multipart upload key=YR2VX4QLOCOG upload=VQH7TD23BGXA tag=QMNDOZOU051D type=write size=3305577 2024-03-09T14:37:10.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.295+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=58DD3HTWOAMX type=del size=2538094 2024-03-09T14:37:10.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.299+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=W0PLTWR71AYE type=del 2024-03-09T14:37:10.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.299+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=K1Y7MTEJMR00 type=write size=1009683 2024-03-09T14:37:10.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.303+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=BIW4BQFCEEDC type=del 2024-03-09T14:37:10.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.303+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~IQFPTZPXONHK.0 size=1048576 2024-03-09T14:37:10.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.307+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~IQFPTZPXONHK.1 size=940791 2024-03-09T14:37:10.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.307+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=IQFPTZPXONHK tag=8T7E3DN4AQ2A type=write size=3037943 2024-03-09T14:37:10.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.307+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~SLUO1YBSOVPM.0 size=1048576 2024-03-09T14:37:10.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.311+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~SLUO1YBSOVPM.1 size=1045167 2024-03-09T14:37:10.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.315+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=SLUO1YBSOVPM tag=4DNKU00BOI20 type=write size=3142319 2024-03-09T14:37:10.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.319+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=7BJ1R2O3GEC0 type=del size=2683804 2024-03-09T14:37:10.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.323+0000 7fd389e788c0 1 < suggested remove operation key=SKIBISETJH7B tag=1PV5ABV84OA3 type=del 2024-03-09T14:37:10.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.323+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=XWWHYFVGN42F type=del size=2823143 2024-03-09T14:37:10.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.327+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=IHA8UHQ9IPXE type=del 2024-03-09T14:37:10.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.331+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=1II4GTBJH5H5 type=del size=1254157 2024-03-09T14:37:10.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.331+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=0ST4I1ERQ4PF type=del 2024-03-09T14:37:10.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.335+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~PHGJN2Z2YPX2.0 size=590987 2024-03-09T14:37:10.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.335+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=PHGJN2Z2YPX2 tag=BWQ27POWQQ8P type=write size=1639563 2024-03-09T14:37:10.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.339+0000 7fd389e788c0 1 < canceled operation key=I4NA328AI5T1 tag=TJWMSS8IAOT1 type=del size=2031767 2024-03-09T14:37:10.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.343+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=G2YVDEC4SOJQ type=write size=208843 2024-03-09T14:37:10.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.343+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~MI842W1FZ22P.0 size=856945 2024-03-09T14:37:10.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.347+0000 7fd389e788c0 1 < completed multipart upload key=K9X2N6V8R4BY upload=MI842W1FZ22P tag=F3KEGNF1W7Y9 type=write size=1905521 2024-03-09T14:37:10.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.351+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=1R1YDGZNK61W type=del size=2524895 2024-03-09T14:37:10.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.351+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~TBHMYESUM1EN.0 size=371286 2024-03-09T14:37:10.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.355+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=TBHMYESUM1EN tag=Y89AMBA0RVY8 type=write size=1419862 2024-03-09T14:37:10.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.359+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=OTID9H4CIJOD type=del size=3020555 2024-03-09T14:37:10.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.363+0000 7fd389e788c0 1 < canceled operation key=CLAM83TC7RZ7 tag=ODQAC21O2CDE type=del size=3301277 2024-03-09T14:37:10.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.363+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=RJH63NWX12GL type=del size=144115 2024-03-09T14:37:10.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.367+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=5UE7VSWY1ONC type=del 2024-03-09T14:37:10.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.371+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~7LPAFLY20ZVR.0 size=1048576 2024-03-09T14:37:10.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.371+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~7LPAFLY20ZVR.1 size=534830 2024-03-09T14:37:10.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.371+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=7LPAFLY20ZVR tag=OU9F5HUVEEZE type=write size=2631982 2024-03-09T14:37:10.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.379+0000 7fd389e788c0 1 < canceled operation key=CLAM83TC7RZ7 tag=U6KI4ZIG60TD type=del size=2192944 2024-03-09T14:37:10.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.379+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=NLWIPMHEMVAX type=del size=1271483 2024-03-09T14:37:10.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.383+0000 7fd389e788c0 1 < canceled operation key=I4NA328AI5T1 tag=EIDL8J8OQMZ2 type=del size=1869974 2024-03-09T14:37:10.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.387+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~QIL7RC37EIDP.0 size=605032 2024-03-09T14:37:10.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.387+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=QIL7RC37EIDP tag=NDSU9ZW51230 type=write size=1653608 2024-03-09T14:37:10.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.391+0000 7fd389e788c0 1 < suggested remove operation key=IXKMXJ9IZ69S tag=HNUTRYRGQD18 type=del 2024-03-09T14:37:10.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.395+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=HFHEHSCW957O type=del size=3670923 2024-03-09T14:37:10.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.395+0000 7fd389e788c0 1 < canceled operation key=MHT268M7S2TY tag=DNU0USWXC907 type=del size=3802693 2024-03-09T14:37:10.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.399+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=I4LB3QLYQY8W type=del size=405441 2024-03-09T14:37:10.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.403+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=58DD3HTWOAMX type=del 2024-03-09T14:37:10.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.403+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=TQVH6HXRPQ7A type=del size=2659157 2024-03-09T14:37:10.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.407+0000 7fd389e788c0 1 < completed write operation key=71692MJQITX3 tag=K1Y7MTEJMR00 type=write size=1009683 2024-03-09T14:37:10.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.407+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=WBCJJI30G0CJ type=del size=3058820 2024-03-09T14:37:10.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.411+0000 7fd389e788c0 1 < canceled part key=_multipart_E2VP0TJ37UX8.2~IQFPTZPXONHK.0 size=1048576 2024-03-09T14:37:10.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.411+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~IQFPTZPXONHK.1 size=940791 2024-03-09T14:37:10.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.415+0000 7fd389e788c0 1 < canceled multipart upload key=E2VP0TJ37UX8 upload=IQFPTZPXONHK tag=8T7E3DN4AQ2A type=write size=3037943 2024-03-09T14:37:10.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.419+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~981NUF1AVGAK.0 size=1048576 2024-03-09T14:37:10.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.423+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~981NUF1AVGAK.1 size=27449 2024-03-09T14:37:10.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.423+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=981NUF1AVGAK tag=YTM1UADHVCN7 type=write size=2124601 2024-03-09T14:37:10.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.423+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=7BJ1R2O3GEC0 type=del 2024-03-09T14:37:10.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.427+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~5X0KN2EPUD33.0 size=1048576 2024-03-09T14:37:10.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.431+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~5X0KN2EPUD33.1 size=1048576 2024-03-09T14:37:10.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.431+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~5X0KN2EPUD33.2 size=453536 2024-03-09T14:37:10.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.431+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=5X0KN2EPUD33 tag=BG3CKWKEM3BM type=write size=3599264 2024-03-09T14:37:10.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.435+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=XWWHYFVGN42F type=del 2024-03-09T14:37:10.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.439+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=FZTA3CKW3SIK type=del size=1240841 2024-03-09T14:37:10.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.439+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=1II4GTBJH5H5 type=del 2024-03-09T14:37:10.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.443+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=UXQ10W6VRZYM type=del size=3842803 2024-03-09T14:37:10.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.447+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~PHGJN2Z2YPX2.0 size=590987 2024-03-09T14:37:10.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.451+0000 7fd389e788c0 1 < completed multipart upload key=IXKMXJ9IZ69S upload=PHGJN2Z2YPX2 tag=BWQ27POWQQ8P type=write size=1639563 2024-03-09T14:37:10.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.455+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=O4QT3HII8UBD type=del size=3430795 2024-03-09T14:37:10.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.459+0000 7fd389e788c0 1 < completed write operation key=SKIBISETJH7B tag=G2YVDEC4SOJQ type=write size=208843 2024-03-09T14:37:10.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.459+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=0HJLOAHDM25Z type=del size=3523721 2024-03-09T14:37:10.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.463+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=1R1YDGZNK61W type=del 2024-03-09T14:37:10.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.467+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~P9URF6AP0WCE.0 size=1048576 2024-03-09T14:37:10.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.471+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~P9URF6AP0WCE.1 size=1048576 2024-03-09T14:37:10.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.475+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~P9URF6AP0WCE.2 size=390518 2024-03-09T14:37:10.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.475+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=P9URF6AP0WCE tag=8H6NSS74D683 type=write size=3536246 2024-03-09T14:37:10.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.475+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=OTID9H4CIJOD type=del 2024-03-09T14:37:10.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.483+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~4IT784SGUT74.0 size=980490 2024-03-09T14:37:10.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.483+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=4IT784SGUT74 tag=BLIW5YAL14XR type=write size=2029066 2024-03-09T14:37:10.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.487+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=RJH63NWX12GL type=del 2024-03-09T14:37:10.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.487+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=TIU3VCSD32J9 type=del size=888746 2024-03-09T14:37:10.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.491+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~7LPAFLY20ZVR.0 size=1048576 2024-03-09T14:37:10.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.495+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~7LPAFLY20ZVR.1 size=534830 2024-03-09T14:37:10.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.499+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=7LPAFLY20ZVR tag=OU9F5HUVEEZE type=write size=2631982 2024-03-09T14:37:10.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.503+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=FLSX4RNUIYWE type=del size=2852345 2024-03-09T14:37:10.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.507+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=NLWIPMHEMVAX type=del 2024-03-09T14:37:10.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.511+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=ZNZ4IYUWDHKT type=write size=615070 2024-03-09T14:37:10.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.515+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~QIL7RC37EIDP.0 size=605032 2024-03-09T14:37:10.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.519+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=QIL7RC37EIDP tag=NDSU9ZW51230 type=write size=1653608 2024-03-09T14:37:10.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.523+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=0ELEPPLWYTY4 type=del size=2017833 2024-03-09T14:37:10.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.527+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=HFHEHSCW957O type=del 2024-03-09T14:37:10.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.531+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=05M8NIKABS2C type=del size=4052235 2024-03-09T14:37:10.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.531+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=I4LB3QLYQY8W type=del 2024-03-09T14:37:10.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.539+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~NNXGHEFOQSXI.0 size=1048576 2024-03-09T14:37:10.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.539+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~NNXGHEFOQSXI.1 size=1048576 2024-03-09T14:37:10.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.543+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~NNXGHEFOQSXI.2 size=720905 2024-03-09T14:37:10.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.543+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=NNXGHEFOQSXI tag=122DCMSF371X type=write size=3866633 2024-03-09T14:37:10.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.547+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=TQVH6HXRPQ7A type=del 2024-03-09T14:37:10.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.551+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=F6I3Y0I0VTV5 type=del size=2274518 2024-03-09T14:37:10.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.555+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=WBCJJI30G0CJ type=del 2024-03-09T14:37:10.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.555+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=H5RJGDOXNDII type=write size=548697 2024-03-09T14:37:10.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.559+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~981NUF1AVGAK.0 size=1048576 2024-03-09T14:37:10.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.563+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~981NUF1AVGAK.1 size=27449 2024-03-09T14:37:10.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.571+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=981NUF1AVGAK tag=YTM1UADHVCN7 type=write size=2124601 2024-03-09T14:37:10.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.575+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~ZY0DAV81JQ8V.0 size=1048576 2024-03-09T14:37:10.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.579+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~ZY0DAV81JQ8V.1 size=1048576 2024-03-09T14:37:10.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.579+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~ZY0DAV81JQ8V.2 size=735059 2024-03-09T14:37:10.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.579+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=ZY0DAV81JQ8V tag=8EF2AZ8XJMKL type=write size=3880787 2024-03-09T14:37:10.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.583+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~5X0KN2EPUD33.0 size=1048576 2024-03-09T14:37:10.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.587+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~5X0KN2EPUD33.1 size=1048576 2024-03-09T14:37:10.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.587+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~5X0KN2EPUD33.2 size=453536 2024-03-09T14:37:10.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.595+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=5X0KN2EPUD33 tag=BG3CKWKEM3BM type=write size=3599264 2024-03-09T14:37:10.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.599+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~XBQ6ET1I7JAL.0 size=1048576 2024-03-09T14:37:10.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.603+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~XBQ6ET1I7JAL.1 size=1048576 2024-03-09T14:37:10.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.607+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~XBQ6ET1I7JAL.2 size=789130 2024-03-09T14:37:10.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.607+0000 7fd389e788c0 1 > prepared multipart upload key=2405Y4I2Q8TY upload=XBQ6ET1I7JAL tag=LT4Q4S64QC7R type=write size=3934858 2024-03-09T14:37:10.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.607+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=FZTA3CKW3SIK type=del 2024-03-09T14:37:10.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.611+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=SSHTSRPC0SHJ type=del size=1486768 2024-03-09T14:37:10.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.615+0000 7fd389e788c0 1 < completed delete operation key=UMT7VKZ9R4IR tag=UXQ10W6VRZYM type=del 2024-03-09T14:37:10.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.619+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=H9X81E0O5VRQ type=del size=1122333 2024-03-09T14:37:10.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.623+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=O4QT3HII8UBD type=del 2024-03-09T14:37:10.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.627+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~SG9UTGANC55R.0 size=1048576 2024-03-09T14:37:10.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.631+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~SG9UTGANC55R.1 size=1048576 2024-03-09T14:37:10.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.635+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~SG9UTGANC55R.2 size=1027201 2024-03-09T14:37:10.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.635+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=SG9UTGANC55R tag=VOH5K5N10KP5 type=write size=4172929 2024-03-09T14:37:10.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.639+0000 7fd389e788c0 1 < completed delete operation key=YR2VX4QLOCOG tag=0HJLOAHDM25Z type=del 2024-03-09T14:37:10.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.639+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=ZVQJBANKVK8D type=del size=1008427 2024-03-09T14:37:10.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.643+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~P9URF6AP0WCE.0 size=1048576 2024-03-09T14:37:10.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.647+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~P9URF6AP0WCE.1 size=1048576 2024-03-09T14:37:10.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.647+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~P9URF6AP0WCE.2 size=390518 2024-03-09T14:37:10.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.655+0000 7fd389e788c0 1 < completed multipart upload key=K9X2N6V8R4BY upload=P9URF6AP0WCE tag=8H6NSS74D683 type=write size=3536246 2024-03-09T14:37:10.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.659+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~1GWSYH6Z4FO3.0 size=1048576 2024-03-09T14:37:10.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.663+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~1GWSYH6Z4FO3.1 size=1048576 2024-03-09T14:37:10.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.663+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~1GWSYH6Z4FO3.2 size=176073 2024-03-09T14:37:10.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.663+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=1GWSYH6Z4FO3 tag=D1NGWOJP0ZKM type=write size=3321801 2024-03-09T14:37:10.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.667+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~4IT784SGUT74.0 size=980490 2024-03-09T14:37:10.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.671+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=4IT784SGUT74 tag=BLIW5YAL14XR type=write size=2029066 2024-03-09T14:37:10.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.675+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=TCLKUVSECWMG type=del size=4009257 2024-03-09T14:37:10.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.679+0000 7fd389e788c0 1 < suggested update operation key=2405Y4I2Q8TY tag=TIU3VCSD32J9 type=del size=888746 2024-03-09T14:37:10.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.683+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~ITNI5YVZSL5R.0 size=217239 2024-03-09T14:37:10.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.683+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=ITNI5YVZSL5R tag=ULIET2FYYM1P type=write size=1265815 2024-03-09T14:37:10.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.687+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=FLSX4RNUIYWE type=del 2024-03-09T14:37:10.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.691+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~97ZHHFZ4HNUS.0 size=1048576 2024-03-09T14:37:10.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.695+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~97ZHHFZ4HNUS.1 size=1048576 2024-03-09T14:37:10.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.695+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~97ZHHFZ4HNUS.2 size=368634 2024-03-09T14:37:10.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.695+0000 7fd389e788c0 1 > prepared multipart upload key=UMT7VKZ9R4IR upload=97ZHHFZ4HNUS tag=UIO9WGAJ6Q2R type=write size=3514362 2024-03-09T14:37:10.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.699+0000 7fd389e788c0 1 < completed write operation key=6VT4C288571G tag=ZNZ4IYUWDHKT type=write size=615070 2024-03-09T14:37:10.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.703+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~NFGP1D3L6KOK.0 size=687065 2024-03-09T14:37:10.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.703+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=NFGP1D3L6KOK tag=JVXUX5JI14XE type=write size=1735641 2024-03-09T14:37:10.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.707+0000 7fd389e788c0 1 < completed delete operation key=DIN8WJ9Z9OI8 tag=0ELEPPLWYTY4 type=del 2024-03-09T14:37:10.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.711+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=S7PLO6XTSGC5 type=del size=2883396 2024-03-09T14:37:10.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.715+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=05M8NIKABS2C type=del 2024-03-09T14:37:10.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.715+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=N83V5KJQ1Z84 type=write size=445948 2024-03-09T14:37:10.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.719+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~NNXGHEFOQSXI.0 size=1048576 2024-03-09T14:37:10.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.719+0000 7fd389e788c0 1 < canceled part key=_multipart_61RC3GUU437B.2~NNXGHEFOQSXI.1 size=1048576 2024-03-09T14:37:10.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.723+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~NNXGHEFOQSXI.2 size=720905 2024-03-09T14:37:10.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.727+0000 7fd389e788c0 1 < canceled multipart upload key=61RC3GUU437B upload=NNXGHEFOQSXI tag=122DCMSF371X type=write size=3866633 2024-03-09T14:37:10.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.731+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=I6NGAO8UR6UK type=del size=2534436 2024-03-09T14:37:10.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.735+0000 7fd389e788c0 -1 < failed to complete operation key=2405Y4I2Q8TY tag=F6I3Y0I0VTV5 type=del size=2274518: (22) Invalid argument 2024-03-09T14:37:10.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.735+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=GEFOOSUUBQR1 type=del size=3949559 2024-03-09T14:37:10.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.739+0000 7fd389e788c0 1 < completed write operation key=E2VP0TJ37UX8 tag=H5RJGDOXNDII type=write size=548697 2024-03-09T14:37:10.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.743+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=0APMH7GV1DRF type=del size=2226264 2024-03-09T14:37:10.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.743+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~ZY0DAV81JQ8V.0 size=1048576 2024-03-09T14:37:10.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.747+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~ZY0DAV81JQ8V.1 size=1048576 2024-03-09T14:37:10.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.747+0000 7fd389e788c0 1 < canceled part key=_multipart_SVTMMQ2QR603.2~ZY0DAV81JQ8V.2 size=735059 2024-03-09T14:37:10.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.751+0000 7fd389e788c0 1 < canceled multipart upload key=SVTMMQ2QR603 upload=ZY0DAV81JQ8V tag=8EF2AZ8XJMKL type=write size=3880787 2024-03-09T14:37:10.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.755+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~CLU517ZZ361R.0 size=565501 2024-03-09T14:37:10.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.755+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=CLU517ZZ361R tag=OU1F4UH7282U type=write size=1614077 2024-03-09T14:37:10.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.759+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~XBQ6ET1I7JAL.0 size=1048576 2024-03-09T14:37:10.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.759+0000 7fd389e788c0 1 < canceled part key=_multipart_2405Y4I2Q8TY.2~XBQ6ET1I7JAL.1 size=1048576 2024-03-09T14:37:10.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.759+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~XBQ6ET1I7JAL.2 size=789130 2024-03-09T14:37:10.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.763+0000 7fd389e788c0 1 < canceled multipart upload key=2405Y4I2Q8TY upload=XBQ6ET1I7JAL tag=LT4Q4S64QC7R type=write size=3934858 2024-03-09T14:37:10.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.767+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~PNHGYSJYUGQX.0 size=1048576 2024-03-09T14:37:10.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.771+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~PNHGYSJYUGQX.1 size=1031930 2024-03-09T14:37:10.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.771+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=PNHGYSJYUGQX tag=IWYCDARYI0XY type=write size=3129082 2024-03-09T14:37:10.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.775+0000 7fd389e788c0 1 < canceled operation key=CLAM83TC7RZ7 tag=SSHTSRPC0SHJ type=del size=1486768 2024-03-09T14:37:10.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.775+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=7P56TPOMIC9O type=del size=2826957 2024-03-09T14:37:10.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.779+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=H9X81E0O5VRQ type=del 2024-03-09T14:37:10.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.783+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~6TYZ0PCF9YHL.0 size=1048576 2024-03-09T14:37:10.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.787+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~6TYZ0PCF9YHL.1 size=1048576 2024-03-09T14:37:10.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.787+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~6TYZ0PCF9YHL.2 size=643877 2024-03-09T14:37:10.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.787+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=6TYZ0PCF9YHL tag=WF0HTRWFQGAF type=write size=3789605 2024-03-09T14:37:10.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.791+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~SG9UTGANC55R.0 size=1048576 2024-03-09T14:37:10.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.791+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~SG9UTGANC55R.1 size=1048576 2024-03-09T14:37:10.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.795+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~SG9UTGANC55R.2 size=1027201 2024-03-09T14:37:10.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.799+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=SG9UTGANC55R tag=VOH5K5N10KP5 type=write size=4172929 2024-03-09T14:37:10.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.803+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=2XVNZBTPAZRY type=del size=3168129 2024-03-09T14:37:10.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.807+0000 7fd389e788c0 1 < suggested remove operation key=FY02AR9GS3KG tag=ZVQJBANKVK8D type=del 2024-03-09T14:37:10.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.811+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=YLX3KY5MN99N type=del size=2030265 2024-03-09T14:37:10.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.815+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~1GWSYH6Z4FO3.0 size=1048576 2024-03-09T14:37:10.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.815+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~1GWSYH6Z4FO3.1 size=1048576 2024-03-09T14:37:10.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.819+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~1GWSYH6Z4FO3.2 size=176073 2024-03-09T14:37:10.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.823+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=1GWSYH6Z4FO3 tag=D1NGWOJP0ZKM type=write size=3321801 2024-03-09T14:37:10.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.827+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~3LBWDYXJVV8Z.0 size=790303 2024-03-09T14:37:10.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.827+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=3LBWDYXJVV8Z tag=8QR1SWLQIF2W type=write size=1838879 2024-03-09T14:37:10.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.835+0000 7fd389e788c0 1 < suggested update operation key=IXKMXJ9IZ69S tag=TCLKUVSECWMG type=del size=4009257 2024-03-09T14:37:10.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.839+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~6E4O0ZF17ZS8.0 size=1048576 2024-03-09T14:37:10.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.843+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~6E4O0ZF17ZS8.1 size=412921 2024-03-09T14:37:10.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.843+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=6E4O0ZF17ZS8 tag=XHAA0TKT9WIH type=write size=2510073 2024-03-09T14:37:10.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.847+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~ITNI5YVZSL5R.0 size=217239 2024-03-09T14:37:10.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.851+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=ITNI5YVZSL5R tag=ULIET2FYYM1P type=write size=1265815 2024-03-09T14:37:10.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.851+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=SMA4KWIFOCPH type=del size=3516581 2024-03-09T14:37:10.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.855+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~97ZHHFZ4HNUS.0 size=1048576 2024-03-09T14:37:10.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.859+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~97ZHHFZ4HNUS.1 size=1048576 2024-03-09T14:37:10.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.859+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~97ZHHFZ4HNUS.2 size=368634 2024-03-09T14:37:10.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.863+0000 7fd389e788c0 1 < completed multipart upload key=UMT7VKZ9R4IR upload=97ZHHFZ4HNUS tag=UIO9WGAJ6Q2R type=write size=3514362 2024-03-09T14:37:10.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.867+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=UAPL3977A2E4 type=del size=3832501 2024-03-09T14:37:10.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.871+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~NFGP1D3L6KOK.0 size=687065 2024-03-09T14:37:10.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.875+0000 7fd389e788c0 1 < completed multipart upload key=IXKMXJ9IZ69S upload=NFGP1D3L6KOK tag=JVXUX5JI14XE type=write size=1735641 2024-03-09T14:37:10.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.879+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~ZYAKS4OW6OBZ.0 size=1048576 2024-03-09T14:37:10.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.883+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~ZYAKS4OW6OBZ.1 size=218150 2024-03-09T14:37:10.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.883+0000 7fd389e788c0 1 > prepared multipart upload key=UMT7VKZ9R4IR upload=ZYAKS4OW6OBZ tag=24LNBBICY9ZR type=write size=2315302 2024-03-09T14:37:10.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.887+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=S7PLO6XTSGC5 type=del 2024-03-09T14:37:10.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.887+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=13BQAEH33JVW type=del size=1146763 2024-03-09T14:37:10.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.895+0000 7fd389e788c0 1 < suggested remove operation key=Z18Q66VI5PDN tag=N83V5KJQ1Z84 type=write 2024-03-09T14:37:10.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.899+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~KXC0GVIA0DXZ.0 size=1048576 2024-03-09T14:37:10.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.903+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~KXC0GVIA0DXZ.1 size=742626 2024-03-09T14:37:10.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.903+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=KXC0GVIA0DXZ tag=3I4COAUZZ78C type=write size=2839778 2024-03-09T14:37:10.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.903+0000 7fd389e788c0 1 < canceled operation key=SKIBISETJH7B tag=I6NGAO8UR6UK type=del size=2534436 2024-03-09T14:37:10.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.907+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=TDZBWN9MS1YF type=write size=697396 2024-03-09T14:37:10.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.911+0000 7fd389e788c0 1 < canceled operation key=DIN8WJ9Z9OI8 tag=GEFOOSUUBQR1 type=del size=3949559 2024-03-09T14:37:10.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.915+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=KSQ6H6AD5T6Q type=del size=1764988 2024-03-09T14:37:10.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.919+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=0APMH7GV1DRF type=del 2024-03-09T14:37:10.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.923+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=MHH3TQKL6GZG type=write size=808092 2024-03-09T14:37:10.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.927+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~CLU517ZZ361R.0 size=565501 2024-03-09T14:37:10.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.931+0000 7fd389e788c0 1 < completed multipart upload key=K9X2N6V8R4BY upload=CLU517ZZ361R tag=OU1F4UH7282U type=write size=1614077 2024-03-09T14:37:10.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.931+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=WS08TLGFY747 type=del size=2143510 2024-03-09T14:37:10.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.935+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~PNHGYSJYUGQX.0 size=1048576 2024-03-09T14:37:10.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.935+0000 7fd389e788c0 1 < canceled part key=_multipart_8J6Z9DT07H0X.2~PNHGYSJYUGQX.1 size=1031930 2024-03-09T14:37:10.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.939+0000 7fd389e788c0 1 < canceled multipart upload key=8J6Z9DT07H0X upload=PNHGYSJYUGQX tag=IWYCDARYI0XY type=write size=3129082 2024-03-09T14:37:10.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.947+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~BRORIN8746N6.0 size=625049 2024-03-09T14:37:10.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.947+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=BRORIN8746N6 tag=QH51X8APN204 type=write size=1673625 2024-03-09T14:37:10.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.951+0000 7fd389e788c0 1 < suggested remove operation key=SKIBISETJH7B tag=7P56TPOMIC9O type=del 2024-03-09T14:37:10.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.955+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~YRMY5EQ7SYNR.0 size=1048576 2024-03-09T14:37:10.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.959+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~YRMY5EQ7SYNR.1 size=1048576 2024-03-09T14:37:10.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.959+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~YRMY5EQ7SYNR.2 size=440675 2024-03-09T14:37:10.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.959+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=YRMY5EQ7SYNR tag=Z5XSSPMNCG9P type=write size=3586403 2024-03-09T14:37:10.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.959+0000 7fd389e788c0 1 < canceled part key=_multipart_PKVYD8DWS7M2.2~6TYZ0PCF9YHL.0 size=1048576 2024-03-09T14:37:10.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.963+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~6TYZ0PCF9YHL.1 size=1048576 2024-03-09T14:37:10.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.963+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~6TYZ0PCF9YHL.2 size=643877 2024-03-09T14:37:10.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.967+0000 7fd389e788c0 1 < canceled multipart upload key=PKVYD8DWS7M2 upload=6TYZ0PCF9YHL tag=WF0HTRWFQGAF type=write size=3789605 2024-03-09T14:37:10.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.971+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~SMR00SC98HSX.0 size=954890 2024-03-09T14:37:10.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.971+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=SMR00SC98HSX tag=3XMWT56E111U type=write size=2003466 2024-03-09T14:37:10.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.975+0000 7fd389e788c0 -1 < failed to complete operation key=IXKMXJ9IZ69S tag=2XVNZBTPAZRY type=del size=3168129: (22) Invalid argument 2024-03-09T14:37:10.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.979+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=W9MXM0Q0A4JJ type=del size=3470637 2024-03-09T14:37:10.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.979+0000 7fd389e788c0 1 < canceled operation key=44F8QXCBBENS tag=YLX3KY5MN99N type=del size=2030265 2024-03-09T14:37:10.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.983+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=KH4S0OL0GZD4 type=del size=3041142 2024-03-09T14:37:10.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.987+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~3LBWDYXJVV8Z.0 size=790303 2024-03-09T14:37:10.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.991+0000 7fd389e788c0 1 < completed multipart upload key=K9X2N6V8R4BY upload=3LBWDYXJVV8Z tag=8QR1SWLQIF2W type=write size=1838879 2024-03-09T14:37:10.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.995+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~V4IPT54DXA19.0 size=1048576 2024-03-09T14:37:10.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.999+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~V4IPT54DXA19.1 size=525804 2024-03-09T14:37:10.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.999+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=V4IPT54DXA19 tag=43IXXS3AK9GT type=write size=2622956 2024-03-09T14:37:11.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:10.999+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~6E4O0ZF17ZS8.0 size=1048576 2024-03-09T14:37:11.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.003+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~6E4O0ZF17ZS8.1 size=412921 2024-03-09T14:37:11.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.007+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=6E4O0ZF17ZS8 tag=XHAA0TKT9WIH type=write size=2510073 2024-03-09T14:37:11.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.011+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~Q1YU6MATXTY2.0 size=1048576 2024-03-09T14:37:11.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.015+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~Q1YU6MATXTY2.1 size=1048576 2024-03-09T14:37:11.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.019+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~Q1YU6MATXTY2.2 size=910155 2024-03-09T14:37:11.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.019+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=Q1YU6MATXTY2 tag=GVB4BKARLF97 type=write size=4055883 2024-03-09T14:37:11.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.019+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=SMA4KWIFOCPH type=del 2024-03-09T14:37:11.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.023+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=E6D4E1V210GH type=del size=1195708 2024-03-09T14:37:11.026 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.027+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=UAPL3977A2E4 type=del 2024-03-09T14:37:11.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.027+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=PQJ9CJ71VOZK type=del size=3430705 2024-03-09T14:37:11.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.031+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~ZYAKS4OW6OBZ.0 size=1048576 2024-03-09T14:37:11.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.035+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~ZYAKS4OW6OBZ.1 size=218150 2024-03-09T14:37:11.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.039+0000 7fd389e788c0 1 < completed multipart upload key=UMT7VKZ9R4IR upload=ZYAKS4OW6OBZ tag=24LNBBICY9ZR type=write size=2315302 2024-03-09T14:37:11.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.043+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=QT4DBUWKRGJ6 type=write size=558945 2024-03-09T14:37:11.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.047+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=13BQAEH33JVW type=del 2024-03-09T14:37:11.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.051+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=TN0L1TGWEAYD type=del size=1603089 2024-03-09T14:37:11.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.051+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~KXC0GVIA0DXZ.0 size=1048576 2024-03-09T14:37:11.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.051+0000 7fd389e788c0 1 < canceled part key=_multipart_IXKMXJ9IZ69S.2~KXC0GVIA0DXZ.1 size=742626 2024-03-09T14:37:11.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.059+0000 7fd389e788c0 1 < canceled multipart upload key=IXKMXJ9IZ69S upload=KXC0GVIA0DXZ tag=3I4COAUZZ78C type=write size=2839778 2024-03-09T14:37:11.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.063+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~CAAHRAD6ZKVO.0 size=916382 2024-03-09T14:37:11.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.063+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=CAAHRAD6ZKVO tag=YEY42J1O20M3 type=write size=1964958 2024-03-09T14:37:11.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.067+0000 7fd389e788c0 1 < completed write operation key=K9X2N6V8R4BY tag=TDZBWN9MS1YF type=write size=697396 2024-03-09T14:37:11.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.071+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=JWGJNBB57PA1 type=del size=2734045 2024-03-09T14:37:11.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.075+0000 7fd389e788c0 1 < suggested update operation key=K9X2N6V8R4BY tag=KSQ6H6AD5T6Q type=del size=1764988 2024-03-09T14:37:11.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.083+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~OI7GKM47Y5Z5.0 size=1048576 2024-03-09T14:37:11.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.083+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~OI7GKM47Y5Z5.1 size=1048576 2024-03-09T14:37:11.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.087+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~OI7GKM47Y5Z5.2 size=767442 2024-03-09T14:37:11.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.087+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=OI7GKM47Y5Z5 tag=USURWSIV1UB6 type=write size=3913170 2024-03-09T14:37:11.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.091+0000 7fd389e788c0 1 < completed write operation key=IXKMXJ9IZ69S tag=MHH3TQKL6GZG type=write size=808092 2024-03-09T14:37:11.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.095+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~IKCCLXYBVWJD.0 size=1048576 2024-03-09T14:37:11.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.099+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~IKCCLXYBVWJD.1 size=196237 2024-03-09T14:37:11.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.099+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=IKCCLXYBVWJD tag=JMKDE8N0PAM2 type=write size=2293389 2024-03-09T14:37:11.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.103+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=WS08TLGFY747 type=del 2024-03-09T14:37:11.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.107+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~DUQRCEADJSUV.0 size=755147 2024-03-09T14:37:11.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.107+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=DUQRCEADJSUV tag=HXD4OAFZF622 type=write size=1803723 2024-03-09T14:37:11.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.111+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~BRORIN8746N6.0 size=625049 2024-03-09T14:37:11.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.115+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=BRORIN8746N6 tag=QH51X8APN204 type=write size=1673625 2024-03-09T14:37:11.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.115+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=L1DXZ0S13IAG type=del size=3695556 2024-03-09T14:37:11.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.119+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~YRMY5EQ7SYNR.0 size=1048576 2024-03-09T14:37:11.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.123+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~YRMY5EQ7SYNR.1 size=1048576 2024-03-09T14:37:11.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.123+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~YRMY5EQ7SYNR.2 size=440675 2024-03-09T14:37:11.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.127+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=YRMY5EQ7SYNR tag=Z5XSSPMNCG9P type=write size=3586403 2024-03-09T14:37:11.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.131+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=BHRYGW9G1EO3 type=del size=98124 2024-03-09T14:37:11.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.135+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~SMR00SC98HSX.0 size=954890 2024-03-09T14:37:11.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.139+0000 7fd389e788c0 1 < completed multipart upload key=E2VP0TJ37UX8 upload=SMR00SC98HSX tag=3XMWT56E111U type=write size=2003466 2024-03-09T14:37:11.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.143+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~RNGMCJ9B9CGP.0 size=447568 2024-03-09T14:37:11.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.143+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=RNGMCJ9B9CGP tag=0O4V0W2A2UII type=write size=1496144 2024-03-09T14:37:11.147 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.147+0000 7fd389e788c0 1 < completed delete operation key=E2VP0TJ37UX8 tag=W9MXM0Q0A4JJ type=del 2024-03-09T14:37:11.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.151+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=MBX1QXGRRXHL type=del size=1183146 2024-03-09T14:37:11.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.155+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=KH4S0OL0GZD4 type=del 2024-03-09T14:37:11.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.159+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~JH8WI7KK6HSY.0 size=1048576 2024-03-09T14:37:11.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.163+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~JH8WI7KK6HSY.1 size=1048576 2024-03-09T14:37:11.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.167+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~JH8WI7KK6HSY.2 size=652396 2024-03-09T14:37:11.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.167+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=JH8WI7KK6HSY tag=P7NZHVGDOADL type=write size=3798124 2024-03-09T14:37:11.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.167+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~V4IPT54DXA19.0 size=1048576 2024-03-09T14:37:11.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.171+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~V4IPT54DXA19.1 size=525804 2024-03-09T14:37:11.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.175+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=V4IPT54DXA19 tag=43IXXS3AK9GT type=write size=2622956 2024-03-09T14:37:11.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.179+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=AW8XOH85Q5LZ type=del size=2345169 2024-03-09T14:37:11.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.183+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~Q1YU6MATXTY2.0 size=1048576 2024-03-09T14:37:11.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.187+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~Q1YU6MATXTY2.1 size=1048576 2024-03-09T14:37:11.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.191+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~Q1YU6MATXTY2.2 size=910155 2024-03-09T14:37:11.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.195+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=Q1YU6MATXTY2 tag=GVB4BKARLF97 type=write size=4055883 2024-03-09T14:37:11.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.199+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~4V8Z1TO1G6GK.0 size=946598 2024-03-09T14:37:11.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.199+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=4V8Z1TO1G6GK tag=1ITR0R0MZR98 type=write size=1995174 2024-03-09T14:37:11.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.207+0000 7fd389e788c0 1 < suggested remove operation key=1KJK6PF6U226 tag=E6D4E1V210GH type=del 2024-03-09T14:37:11.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.211+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=C140AOZ0SEFP type=del size=308311 2024-03-09T14:37:11.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.211+0000 7fd389e788c0 1 < canceled operation key=Y7E2TLASJM9T tag=PQJ9CJ71VOZK type=del size=3430705 2024-03-09T14:37:11.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.215+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=O1TT4RE4MBKH type=del size=3925067 2024-03-09T14:37:11.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.219+0000 7fd389e788c0 1 < completed write operation key=MHT268M7S2TY tag=QT4DBUWKRGJ6 type=write size=558945 2024-03-09T14:37:11.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.223+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=4PF9K2P3RWB4 type=del size=3221551 2024-03-09T14:37:11.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.223+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=TN0L1TGWEAYD type=del 2024-03-09T14:37:11.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.231+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~AWW31ZRKTR91.0 size=1048576 2024-03-09T14:37:11.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.231+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~AWW31ZRKTR91.1 size=1048576 2024-03-09T14:37:11.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.235+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~AWW31ZRKTR91.2 size=917386 2024-03-09T14:37:11.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.235+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=AWW31ZRKTR91 tag=8ZMJRLXSZMUZ type=write size=4063114 2024-03-09T14:37:11.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.239+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~CAAHRAD6ZKVO.0 size=916382 2024-03-09T14:37:11.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.243+0000 7fd389e788c0 1 < completed multipart upload key=K9X2N6V8R4BY upload=CAAHRAD6ZKVO tag=YEY42J1O20M3 type=write size=1964958 2024-03-09T14:37:11.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.247+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=FVRD6W9XWWAK type=del size=1182937 2024-03-09T14:37:11.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.247+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=JWGJNBB57PA1 type=del 2024-03-09T14:37:11.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.251+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=SP1AI7NCBW5N type=del size=1307470 2024-03-09T14:37:11.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.251+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~OI7GKM47Y5Z5.0 size=1048576 2024-03-09T14:37:11.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.255+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~OI7GKM47Y5Z5.1 size=1048576 2024-03-09T14:37:11.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.255+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~OI7GKM47Y5Z5.2 size=767442 2024-03-09T14:37:11.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.263+0000 7fd389e788c0 1 < completed multipart upload key=K9X2N6V8R4BY upload=OI7GKM47Y5Z5 tag=USURWSIV1UB6 type=write size=3913170 2024-03-09T14:37:11.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.267+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~SIOA3YB14L0I.0 size=456461 2024-03-09T14:37:11.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.267+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=SIOA3YB14L0I tag=798RI4D67XOW type=write size=1505037 2024-03-09T14:37:11.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.267+0000 7fd389e788c0 1 < canceled part key=_multipart_61RC3GUU437B.2~IKCCLXYBVWJD.0 size=1048576 2024-03-09T14:37:11.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.271+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~IKCCLXYBVWJD.1 size=196237 2024-03-09T14:37:11.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.275+0000 7fd389e788c0 1 < canceled multipart upload key=61RC3GUU437B upload=IKCCLXYBVWJD tag=JMKDE8N0PAM2 type=write size=2293389 2024-03-09T14:37:11.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.279+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~J5ZFW2FSMQX2.0 size=586540 2024-03-09T14:37:11.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.279+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=J5ZFW2FSMQX2 tag=KOOGJROSUEQK type=write size=1635116 2024-03-09T14:37:11.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.283+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~DUQRCEADJSUV.0 size=755147 2024-03-09T14:37:11.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.287+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=DUQRCEADJSUV tag=HXD4OAFZF622 type=write size=1803723 2024-03-09T14:37:11.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.295+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~LGAPB8FACQ81.0 size=1048576 2024-03-09T14:37:11.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.299+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~LGAPB8FACQ81.1 size=1048576 2024-03-09T14:37:11.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.299+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~LGAPB8FACQ81.2 size=81618 2024-03-09T14:37:11.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.299+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=LGAPB8FACQ81 tag=KJN09VAITYAF type=write size=3227346 2024-03-09T14:37:11.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.303+0000 7fd389e788c0 1 < canceled operation key=IXKMXJ9IZ69S tag=L1DXZ0S13IAG type=del size=3695556 2024-03-09T14:37:11.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.307+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=0OA0YV3CKW8N type=write size=954020 2024-03-09T14:37:11.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.307+0000 7fd389e788c0 1 < completed delete operation key=PKVYD8DWS7M2 tag=BHRYGW9G1EO3 type=del 2024-03-09T14:37:11.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.315+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~UV0F36ZFZHTZ.0 size=1048576 2024-03-09T14:37:11.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.315+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~UV0F36ZFZHTZ.1 size=508232 2024-03-09T14:37:11.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.315+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=UV0F36ZFZHTZ tag=DZ93Y0GN3SA6 type=write size=2605384 2024-03-09T14:37:11.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.319+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~RNGMCJ9B9CGP.0 size=447568 2024-03-09T14:37:11.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.323+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=RNGMCJ9B9CGP tag=0O4V0W2A2UII type=write size=1496144 2024-03-09T14:37:11.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.331+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~BPDBCYAHWY7E.0 size=1048576 2024-03-09T14:37:11.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.331+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~BPDBCYAHWY7E.1 size=163167 2024-03-09T14:37:11.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.331+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=BPDBCYAHWY7E tag=8CSHX5ITHM1G type=write size=2260319 2024-03-09T14:37:11.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.335+0000 7fd389e788c0 1 < completed delete operation key=DIN8WJ9Z9OI8 tag=MBX1QXGRRXHL type=del 2024-03-09T14:37:11.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.339+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=G3QGIFOSPNB2 type=del size=1897579 2024-03-09T14:37:11.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.339+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~JH8WI7KK6HSY.0 size=1048576 2024-03-09T14:37:11.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.343+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~JH8WI7KK6HSY.1 size=1048576 2024-03-09T14:37:11.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.347+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~JH8WI7KK6HSY.2 size=652396 2024-03-09T14:37:11.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.351+0000 7fd389e788c0 1 < completed multipart upload key=P83H9137MI7Y upload=JH8WI7KK6HSY tag=P7NZHVGDOADL type=write size=3798124 2024-03-09T14:37:11.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.355+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=TV6FUKQVROWF type=del size=2236528 2024-03-09T14:37:11.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.355+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=AW8XOH85Q5LZ type=del 2024-03-09T14:37:11.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.363+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~F9XW5JZSDFAX.0 size=1048576 2024-03-09T14:37:11.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.363+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~F9XW5JZSDFAX.1 size=1048576 2024-03-09T14:37:11.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.367+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~F9XW5JZSDFAX.2 size=774072 2024-03-09T14:37:11.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.367+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=F9XW5JZSDFAX tag=VIOI6O3TE40V type=write size=3919800 2024-03-09T14:37:11.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.371+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~4V8Z1TO1G6GK.0 size=946598 2024-03-09T14:37:11.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.375+0000 7fd389e788c0 1 < completed multipart upload key=71692MJQITX3 upload=4V8Z1TO1G6GK tag=1ITR0R0MZR98 type=write size=1995174 2024-03-09T14:37:11.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.379+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=0YRL3D85K4CV type=del size=646029 2024-03-09T14:37:11.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.383+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=C140AOZ0SEFP type=del 2024-03-09T14:37:11.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.387+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=2WDIBFPHYTHZ type=write size=202436 2024-03-09T14:37:11.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.391+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=O1TT4RE4MBKH type=del 2024-03-09T14:37:11.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.395+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=IMQ5LNBXY0FP type=del size=223637 2024-03-09T14:37:11.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.399+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=4PF9K2P3RWB4 type=del 2024-03-09T14:37:11.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.403+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~7M590NO3P38W.0 size=1048576 2024-03-09T14:37:11.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.407+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~7M590NO3P38W.1 size=1048576 2024-03-09T14:37:11.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.407+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~7M590NO3P38W.2 size=53263 2024-03-09T14:37:11.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.407+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=7M590NO3P38W tag=F97A4Z3HA6DL type=write size=3198991 2024-03-09T14:37:11.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.411+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~AWW31ZRKTR91.0 size=1048576 2024-03-09T14:37:11.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.415+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~AWW31ZRKTR91.1 size=1048576 2024-03-09T14:37:11.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.415+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~AWW31ZRKTR91.2 size=917386 2024-03-09T14:37:11.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.423+0000 7fd389e788c0 1 < completed multipart upload key=Z18Q66VI5PDN upload=AWW31ZRKTR91 tag=8ZMJRLXSZMUZ type=write size=4063114 2024-03-09T14:37:11.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.423+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=W1A3MRCJ91X4 type=write size=887664 2024-03-09T14:37:11.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.427+0000 7fd389e788c0 1 < canceled operation key=6VT4C288571G tag=FVRD6W9XWWAK type=del size=1182937 2024-03-09T14:37:11.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.435+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~3DNIBYJXHJAX.0 size=1048576 2024-03-09T14:37:11.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.435+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~3DNIBYJXHJAX.1 size=363363 2024-03-09T14:37:11.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.435+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=3DNIBYJXHJAX tag=F4ZWWYJ94SVQ type=write size=2460515 2024-03-09T14:37:11.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.443+0000 7fd389e788c0 1 < suggested remove operation key=71692MJQITX3 tag=SP1AI7NCBW5N type=del 2024-03-09T14:37:11.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.447+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~31N193DD4A2L.0 size=1048576 2024-03-09T14:37:11.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.451+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~31N193DD4A2L.1 size=1048576 2024-03-09T14:37:11.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.451+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~31N193DD4A2L.2 size=965100 2024-03-09T14:37:11.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.451+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=31N193DD4A2L tag=N5ZA7NQO4VTU type=write size=4110828 2024-03-09T14:37:11.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.455+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~SIOA3YB14L0I.0 size=456461 2024-03-09T14:37:11.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.467+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=SIOA3YB14L0I tag=798RI4D67XOW type=write size=1505037 2024-03-09T14:37:11.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.471+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=AELDDAP2F1UH type=del size=1676018 2024-03-09T14:37:11.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.475+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~J5ZFW2FSMQX2.0 size=586540 2024-03-09T14:37:11.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.479+0000 7fd389e788c0 1 < completed multipart upload key=71692MJQITX3 upload=J5ZFW2FSMQX2 tag=KOOGJROSUEQK type=write size=1635116 2024-03-09T14:37:11.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.483+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=AS0AMYIGF90R type=del size=2664134 2024-03-09T14:37:11.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.487+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~LGAPB8FACQ81.0 size=1048576 2024-03-09T14:37:11.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.491+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~LGAPB8FACQ81.1 size=1048576 2024-03-09T14:37:11.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.491+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~LGAPB8FACQ81.2 size=81618 2024-03-09T14:37:11.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.499+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=LGAPB8FACQ81 tag=KJN09VAITYAF type=write size=3227346 2024-03-09T14:37:11.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.503+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~YF5YB3ZP7Q7E.0 size=489583 2024-03-09T14:37:11.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.503+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=YF5YB3ZP7Q7E tag=E3PO4J80335V type=write size=1538159 2024-03-09T14:37:11.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.507+0000 7fd389e788c0 1 < completed write operation key=IXKMXJ9IZ69S tag=0OA0YV3CKW8N type=write size=954020 2024-03-09T14:37:11.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.511+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~C91LVUYKINWB.0 size=1048576 2024-03-09T14:37:11.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.515+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~C91LVUYKINWB.1 size=1048576 2024-03-09T14:37:11.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.515+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~C91LVUYKINWB.2 size=189386 2024-03-09T14:37:11.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.515+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=C91LVUYKINWB tag=1W4KN71GQ5OX type=write size=3335114 2024-03-09T14:37:11.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.515+0000 7fd389e788c0 1 < canceled part key=_multipart_K9X2N6V8R4BY.2~UV0F36ZFZHTZ.0 size=1048576 2024-03-09T14:37:11.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.519+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~UV0F36ZFZHTZ.1 size=508232 2024-03-09T14:37:11.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.523+0000 7fd389e788c0 1 < canceled multipart upload key=K9X2N6V8R4BY upload=UV0F36ZFZHTZ tag=DZ93Y0GN3SA6 type=write size=2605384 2024-03-09T14:37:11.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.527+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=U0I5SGL7Q3EQ type=del size=3223116 2024-03-09T14:37:11.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.527+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~BPDBCYAHWY7E.0 size=1048576 2024-03-09T14:37:11.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.531+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~BPDBCYAHWY7E.1 size=163167 2024-03-09T14:37:11.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.535+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=BPDBCYAHWY7E tag=8CSHX5ITHM1G type=write size=2260319 2024-03-09T14:37:11.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.543+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~2VKZQM9THGQN.0 size=1048576 2024-03-09T14:37:11.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.543+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~2VKZQM9THGQN.1 size=45738 2024-03-09T14:37:11.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.543+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=2VKZQM9THGQN tag=68ZY6CP3U3WV type=write size=2142890 2024-03-09T14:37:11.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.547+0000 7fd389e788c0 1 < canceled operation key=AUSZ4JUGI6UU tag=G3QGIFOSPNB2 type=del size=1897579 2024-03-09T14:37:11.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.551+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=TFB7GFVV7KJR type=del size=2983636 2024-03-09T14:37:11.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.555+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=TV6FUKQVROWF type=del 2024-03-09T14:37:11.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.555+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=JCCVTHLQW5WA type=del size=1106412 2024-03-09T14:37:11.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.559+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~F9XW5JZSDFAX.0 size=1048576 2024-03-09T14:37:11.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.559+0000 7fd389e788c0 1 < canceled part key=_multipart_1KJK6PF6U226.2~F9XW5JZSDFAX.1 size=1048576 2024-03-09T14:37:11.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.563+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~F9XW5JZSDFAX.2 size=774072 2024-03-09T14:37:11.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.567+0000 7fd389e788c0 1 < canceled multipart upload key=1KJK6PF6U226 upload=F9XW5JZSDFAX tag=VIOI6O3TE40V type=write size=3919800 2024-03-09T14:37:11.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.567+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=C5D2NC8R549U type=del size=1561029 2024-03-09T14:37:11.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.571+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=0YRL3D85K4CV type=del 2024-03-09T14:37:11.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.575+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=ZMA811FPU9V5 type=del size=2386719 2024-03-09T14:37:11.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.579+0000 7fd389e788c0 1 < suggested update operation key=SKIBISETJH7B tag=2WDIBFPHYTHZ type=write size=202436 2024-03-09T14:37:11.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.583+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=EJ4ZGJG0JFBU type=del size=1989490 2024-03-09T14:37:11.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.583+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=IMQ5LNBXY0FP type=del 2024-03-09T14:37:11.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.587+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=R1Y7FL810IWE type=del size=183665 2024-03-09T14:37:11.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.591+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~7M590NO3P38W.0 size=1048576 2024-03-09T14:37:11.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.595+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~7M590NO3P38W.1 size=1048576 2024-03-09T14:37:11.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.595+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~7M590NO3P38W.2 size=53263 2024-03-09T14:37:11.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.599+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=7M590NO3P38W tag=F97A4Z3HA6DL type=write size=3198991 2024-03-09T14:37:11.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.603+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~0JHBS9C4FMB4.0 size=1048576 2024-03-09T14:37:11.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.607+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~0JHBS9C4FMB4.1 size=1045814 2024-03-09T14:37:11.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.607+0000 7fd389e788c0 1 > prepared multipart upload key=GSNWWDS63MTA upload=0JHBS9C4FMB4 tag=G2T0OOISYWV7 type=write size=3142966 2024-03-09T14:37:11.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.611+0000 7fd389e788c0 1 < completed write operation key=1KJK6PF6U226 tag=W1A3MRCJ91X4 type=write size=887664 2024-03-09T14:37:11.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.611+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=RBC9LMNE3C7X type=del size=205166 2024-03-09T14:37:11.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.615+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~3DNIBYJXHJAX.0 size=1048576 2024-03-09T14:37:11.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.615+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~3DNIBYJXHJAX.1 size=363363 2024-03-09T14:37:11.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.619+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=3DNIBYJXHJAX tag=F4ZWWYJ94SVQ type=write size=2460515 2024-03-09T14:37:11.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.623+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~W32LSNB6YWLS.0 size=1048576 2024-03-09T14:37:11.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.627+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~W32LSNB6YWLS.1 size=530830 2024-03-09T14:37:11.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.627+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=W32LSNB6YWLS tag=09O8XSRNODIH type=write size=2627982 2024-03-09T14:37:11.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.627+0000 7fd389e788c0 1 < canceled part key=_multipart_8J6Z9DT07H0X.2~31N193DD4A2L.0 size=1048576 2024-03-09T14:37:11.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.631+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~31N193DD4A2L.1 size=1048576 2024-03-09T14:37:11.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.631+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~31N193DD4A2L.2 size=965100 2024-03-09T14:37:11.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.635+0000 7fd389e788c0 1 < canceled multipart upload key=8J6Z9DT07H0X upload=31N193DD4A2L tag=N5ZA7NQO4VTU type=write size=4110828 2024-03-09T14:37:11.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.639+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~T0HDMDJQHRLG.0 size=426885 2024-03-09T14:37:11.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.639+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=T0HDMDJQHRLG tag=LMJI9J7HPJ0R type=write size=1475461 2024-03-09T14:37:11.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.643+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=AELDDAP2F1UH type=del 2024-03-09T14:37:11.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.647+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=B830MY0JNS81 type=del size=1360843 2024-03-09T14:37:11.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.647+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=AS0AMYIGF90R type=del 2024-03-09T14:37:11.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.651+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~B5YJ4ECJ2A98.0 size=593675 2024-03-09T14:37:11.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.651+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=B5YJ4ECJ2A98 tag=FMJQD0885A2K type=write size=1642251 2024-03-09T14:37:11.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.655+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~YF5YB3ZP7Q7E.0 size=489583 2024-03-09T14:37:11.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.659+0000 7fd389e788c0 1 < completed multipart upload key=E2VP0TJ37UX8 upload=YF5YB3ZP7Q7E tag=E3PO4J80335V type=write size=1538159 2024-03-09T14:37:11.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.659+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=KJS0G10K7E6V type=del size=2551479 2024-03-09T14:37:11.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.663+0000 7fd389e788c0 1 < canceled part key=_multipart_Y7E2TLASJM9T.2~C91LVUYKINWB.0 size=1048576 2024-03-09T14:37:11.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.663+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~C91LVUYKINWB.1 size=1048576 2024-03-09T14:37:11.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.663+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~C91LVUYKINWB.2 size=189386 2024-03-09T14:37:11.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.671+0000 7fd389e788c0 1 < canceled multipart upload key=Y7E2TLASJM9T upload=C91LVUYKINWB tag=1W4KN71GQ5OX type=write size=3335114 2024-03-09T14:37:11.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.671+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=O1VHA9ECUBHI type=write size=556393 2024-03-09T14:37:11.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.675+0000 7fd389e788c0 1 < suggested update operation key=IXKMXJ9IZ69S tag=U0I5SGL7Q3EQ type=del size=3223116 2024-03-09T14:37:11.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.679+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=CHFFT1AY573J type=del size=1800180 2024-03-09T14:37:11.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.683+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~2VKZQM9THGQN.0 size=1048576 2024-03-09T14:37:11.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.683+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~2VKZQM9THGQN.1 size=45738 2024-03-09T14:37:11.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.687+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=2VKZQM9THGQN tag=68ZY6CP3U3WV type=write size=2142890 2024-03-09T14:37:11.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.691+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~I3WPOCONKWQP.0 size=1048576 2024-03-09T14:37:11.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.695+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~I3WPOCONKWQP.1 size=924003 2024-03-09T14:37:11.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.695+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=I3WPOCONKWQP tag=FSZZUCZO1Y2S type=write size=3021155 2024-03-09T14:37:11.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.695+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=TFB7GFVV7KJR type=del 2024-03-09T14:37:11.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.699+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=CQ280SM5OF23 type=del size=3187090 2024-03-09T14:37:11.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.699+0000 7fd389e788c0 1 < canceled operation key=CLAM83TC7RZ7 tag=JCCVTHLQW5WA type=del size=1106412 2024-03-09T14:37:11.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.703+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~NGAFBBAM1FJ1.0 size=383945 2024-03-09T14:37:11.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.703+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=NGAFBBAM1FJ1 tag=ETE2QQQCOGSZ type=write size=1432521 2024-03-09T14:37:11.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.707+0000 7fd389e788c0 1 < canceled operation key=ACL1T9GW2JV9 tag=C5D2NC8R549U type=del size=1561029 2024-03-09T14:37:11.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.711+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~KRIDD6RFWIH3.0 size=1048576 2024-03-09T14:37:11.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.715+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~KRIDD6RFWIH3.1 size=1048576 2024-03-09T14:37:11.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.719+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~KRIDD6RFWIH3.2 size=804668 2024-03-09T14:37:11.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.719+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=KRIDD6RFWIH3 tag=7UEEIDEZ8T75 type=write size=3950396 2024-03-09T14:37:11.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.719+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=ZMA811FPU9V5 type=del 2024-03-09T14:37:11.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.723+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=F6MNM22IXZ8L type=del size=136322 2024-03-09T14:37:11.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.727+0000 7fd389e788c0 1 < suggested update operation key=DIN8WJ9Z9OI8 tag=EJ4ZGJG0JFBU type=del size=1989490 2024-03-09T14:37:11.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.727+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=3ZNYXSMX4HU6 type=del size=362040 2024-03-09T14:37:11.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.731+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=R1Y7FL810IWE type=del 2024-03-09T14:37:11.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.735+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=7C564OP1T7KV type=del size=3414736 2024-03-09T14:37:11.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.735+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~0JHBS9C4FMB4.0 size=1048576 2024-03-09T14:37:11.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.735+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~0JHBS9C4FMB4.1 size=1045814 2024-03-09T14:37:11.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.739+0000 7fd389e788c0 1 < completed multipart upload key=GSNWWDS63MTA upload=0JHBS9C4FMB4 tag=G2T0OOISYWV7 type=write size=3142966 2024-03-09T14:37:11.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.743+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~NFFTSZKO7SMV.0 size=1048576 2024-03-09T14:37:11.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.747+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~NFFTSZKO7SMV.1 size=1048576 2024-03-09T14:37:11.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.747+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~NFFTSZKO7SMV.2 size=704519 2024-03-09T14:37:11.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.747+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=NFFTSZKO7SMV tag=LG0CM0FYGD3S type=write size=3850247 2024-03-09T14:37:11.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.751+0000 7fd389e788c0 1 < suggested update operation key=P83H9137MI7Y tag=RBC9LMNE3C7X type=del size=205166 2024-03-09T14:37:11.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.751+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=Z3IF8C6TJ6OE type=write size=696929 2024-03-09T14:37:11.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.755+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~W32LSNB6YWLS.0 size=1048576 2024-03-09T14:37:11.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.755+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~W32LSNB6YWLS.1 size=530830 2024-03-09T14:37:11.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.759+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=W32LSNB6YWLS tag=09O8XSRNODIH type=write size=2627982 2024-03-09T14:37:11.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.763+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=IKN28N5C3644 type=del size=1815592 2024-03-09T14:37:11.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.763+0000 7fd389e788c0 1 < canceled part key=_multipart_PZJT6RWRJFIN.2~T0HDMDJQHRLG.0 size=426885 2024-03-09T14:37:11.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.767+0000 7fd389e788c0 1 < canceled multipart upload key=PZJT6RWRJFIN upload=T0HDMDJQHRLG tag=LMJI9J7HPJ0R type=write size=1475461 2024-03-09T14:37:11.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.767+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=B33YDOZMDEBM type=del size=368762 2024-03-09T14:37:11.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.771+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=B830MY0JNS81 type=del 2024-03-09T14:37:11.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.775+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~7OKSM5OCCQG7.0 size=1048576 2024-03-09T14:37:11.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.775+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~7OKSM5OCCQG7.1 size=1048576 2024-03-09T14:37:11.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.779+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~7OKSM5OCCQG7.2 size=44256 2024-03-09T14:37:11.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.779+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=7OKSM5OCCQG7 tag=PN22DTA606X6 type=write size=3189984 2024-03-09T14:37:11.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.779+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~B5YJ4ECJ2A98.0 size=593675 2024-03-09T14:37:11.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.783+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=B5YJ4ECJ2A98 tag=FMJQD0885A2K type=write size=1642251 2024-03-09T14:37:11.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.787+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=ETJQUS7Y2V6A type=del size=4007015 2024-03-09T14:37:11.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.791+0000 7fd389e788c0 1 < suggested update operation key=2405Y4I2Q8TY tag=KJS0G10K7E6V type=del size=2551479 2024-03-09T14:37:11.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.791+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=JDYD1FBWAPJX type=del size=3836980 2024-03-09T14:37:11.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.795+0000 7fd389e788c0 1 < suggested update operation key=E2VP0TJ37UX8 tag=O1VHA9ECUBHI type=write size=556393 2024-03-09T14:37:11.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.799+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=SBJG18N572LP type=del size=3681015 2024-03-09T14:37:11.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.803+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=CHFFT1AY573J type=del 2024-03-09T14:37:11.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.803+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=EMCLRK2PEFB1 type=del size=786213 2024-03-09T14:37:11.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.807+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~I3WPOCONKWQP.0 size=1048576 2024-03-09T14:37:11.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.811+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~I3WPOCONKWQP.1 size=924003 2024-03-09T14:37:11.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.811+0000 7fd389e788c0 1 < completed multipart upload key=8J6Z9DT07H0X upload=I3WPOCONKWQP tag=FSZZUCZO1Y2S type=write size=3021155 2024-03-09T14:37:11.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.819+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~UGDQD0LZUPN4.0 size=411555 2024-03-09T14:37:11.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.819+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=UGDQD0LZUPN4 tag=77SR0DDFC24E type=write size=1460131 2024-03-09T14:37:11.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.819+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=CQ280SM5OF23 type=del 2024-03-09T14:37:11.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.823+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=XYWRQQ3QX8QW type=del size=1844462 2024-03-09T14:37:11.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.823+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~NGAFBBAM1FJ1.0 size=383945 2024-03-09T14:37:11.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.827+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=NGAFBBAM1FJ1 tag=ETE2QQQCOGSZ type=write size=1432521 2024-03-09T14:37:11.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.831+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=YXVEUCKRCQBI type=del size=1742576 2024-03-09T14:37:11.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.831+0000 7fd389e788c0 1 < canceled part key=_multipart_PZJT6RWRJFIN.2~KRIDD6RFWIH3.0 size=1048576 2024-03-09T14:37:11.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.831+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~KRIDD6RFWIH3.1 size=1048576 2024-03-09T14:37:11.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.835+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~KRIDD6RFWIH3.2 size=804668 2024-03-09T14:37:11.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.839+0000 7fd389e788c0 1 < canceled multipart upload key=PZJT6RWRJFIN upload=KRIDD6RFWIH3 tag=7UEEIDEZ8T75 type=write size=3950396 2024-03-09T14:37:11.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.843+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~GAEY1CFY1HMG.0 size=429966 2024-03-09T14:37:11.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.843+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=GAEY1CFY1HMG tag=VAM2ZV30PSPB type=write size=1478542 2024-03-09T14:37:11.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.843+0000 7fd389e788c0 1 < canceled operation key=SKIBISETJH7B tag=F6MNM22IXZ8L type=del size=136322 2024-03-09T14:37:11.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.847+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~DEO6G5YLTOKO.0 size=1048576 2024-03-09T14:37:11.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.851+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~DEO6G5YLTOKO.1 size=85157 2024-03-09T14:37:11.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.851+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=DEO6G5YLTOKO tag=DRLB2V9SWDGA type=write size=2182309 2024-03-09T14:37:11.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.851+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=3ZNYXSMX4HU6 type=del 2024-03-09T14:37:11.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.855+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=VEC9QJZR72XU type=del size=923966 2024-03-09T14:37:11.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.859+0000 7fd389e788c0 1 < suggested update operation key=5ZEDXFB9B3CN tag=7C564OP1T7KV type=del size=3414736 2024-03-09T14:37:11.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.863+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=WIW0LN0AEXIV type=del size=1329603 2024-03-09T14:37:11.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.863+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~NFFTSZKO7SMV.0 size=1048576 2024-03-09T14:37:11.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.867+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~NFFTSZKO7SMV.1 size=1048576 2024-03-09T14:37:11.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.871+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~NFFTSZKO7SMV.2 size=704519 2024-03-09T14:37:11.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.875+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=NFFTSZKO7SMV tag=LG0CM0FYGD3S type=write size=3850247 2024-03-09T14:37:11.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.875+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=BY1GJCLSJ4R9 type=del size=1687643 2024-03-09T14:37:11.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.879+0000 7fd389e788c0 1 < completed write operation key=K9X2N6V8R4BY tag=Z3IF8C6TJ6OE type=write size=696929 2024-03-09T14:37:11.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.883+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~JUMR9EQW5TFK.0 size=1048576 2024-03-09T14:37:11.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.883+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~JUMR9EQW5TFK.1 size=1048576 2024-03-09T14:37:11.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.883+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~JUMR9EQW5TFK.2 size=226872 2024-03-09T14:37:11.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.883+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=JUMR9EQW5TFK tag=57XMIK8QH6HJ type=write size=3372600 2024-03-09T14:37:11.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.887+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=IKN28N5C3644 type=del 2024-03-09T14:37:11.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.887+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=JCW2KGKDONTU type=del size=4066807 2024-03-09T14:37:11.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.895+0000 7fd389e788c0 1 < suggested remove operation key=5ZEDXFB9B3CN tag=B33YDOZMDEBM type=del 2024-03-09T14:37:11.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.899+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~85FYL1OWPR9K.0 size=16448 2024-03-09T14:37:11.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.899+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=85FYL1OWPR9K tag=NFMYUMT5CBT6 type=write size=1065024 2024-03-09T14:37:11.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.899+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~7OKSM5OCCQG7.0 size=1048576 2024-03-09T14:37:11.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.903+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~7OKSM5OCCQG7.1 size=1048576 2024-03-09T14:37:11.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.903+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~7OKSM5OCCQG7.2 size=44256 2024-03-09T14:37:11.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.907+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=7OKSM5OCCQG7 tag=PN22DTA606X6 type=write size=3189984 2024-03-09T14:37:11.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.911+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=FVA22QO0YH53 type=del size=724899 2024-03-09T14:37:11.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.911+0000 7fd389e788c0 1 < canceled operation key=IXKMXJ9IZ69S tag=ETJQUS7Y2V6A type=del size=4007015 2024-03-09T14:37:11.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.915+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~2BMD0H7F8ANC.0 size=1048576 2024-03-09T14:37:11.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.915+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~2BMD0H7F8ANC.1 size=517379 2024-03-09T14:37:11.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.915+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=2BMD0H7F8ANC tag=3EDZE661457B type=write size=2614531 2024-03-09T14:37:11.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.923+0000 7fd389e788c0 1 < suggested remove operation key=1KJK6PF6U226 tag=JDYD1FBWAPJX type=del 2024-03-09T14:37:11.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.927+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=YVVN83HRY07P type=del size=3571996 2024-03-09T14:37:11.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.931+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=SBJG18N572LP type=del 2024-03-09T14:37:11.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.931+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=E8L9R1SZR1FR type=del size=363935 2024-03-09T14:37:11.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.935+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=EMCLRK2PEFB1 type=del 2024-03-09T14:37:11.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.939+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~QBUL71QLZR1K.0 size=773209 2024-03-09T14:37:11.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.939+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=QBUL71QLZR1K tag=G9XSE73NFQFN type=write size=1821785 2024-03-09T14:37:11.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.939+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~UGDQD0LZUPN4.0 size=411555 2024-03-09T14:37:11.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.943+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=UGDQD0LZUPN4 tag=77SR0DDFC24E type=write size=1460131 2024-03-09T14:37:11.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.947+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~84S88H08WNPC.0 size=1048576 2024-03-09T14:37:11.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.947+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~84S88H08WNPC.1 size=1048576 2024-03-09T14:37:11.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.951+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~84S88H08WNPC.2 size=589758 2024-03-09T14:37:11.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.951+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=84S88H08WNPC tag=T0D3OHJU81RZ type=write size=3735486 2024-03-09T14:37:11.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.955+0000 7fd389e788c0 1 < suggested remove operation key=I4NA328AI5T1 tag=XYWRQQ3QX8QW type=del 2024-03-09T14:37:11.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.959+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~HL4DGA9N2AXY.0 size=1048576 2024-03-09T14:37:11.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.959+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~HL4DGA9N2AXY.1 size=1048576 2024-03-09T14:37:11.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.963+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~HL4DGA9N2AXY.2 size=361102 2024-03-09T14:37:11.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.963+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=HL4DGA9N2AXY tag=1WV0T6I2TGA1 type=write size=3506830 2024-03-09T14:37:11.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.967+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=YXVEUCKRCQBI type=del 2024-03-09T14:37:11.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.971+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~2F83O0G6AZ5U.0 size=1048576 2024-03-09T14:37:11.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.971+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~2F83O0G6AZ5U.1 size=349997 2024-03-09T14:37:11.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.971+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=2F83O0G6AZ5U tag=8TULKKR1LHB1 type=write size=2447149 2024-03-09T14:37:11.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.975+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~GAEY1CFY1HMG.0 size=429966 2024-03-09T14:37:11.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.979+0000 7fd389e788c0 1 < completed multipart upload key=8J6Z9DT07H0X upload=GAEY1CFY1HMG tag=VAM2ZV30PSPB type=write size=1478542 2024-03-09T14:37:11.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.983+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~T4SLF0JIAJLU.0 size=1048576 2024-03-09T14:37:11.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.987+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~T4SLF0JIAJLU.1 size=863644 2024-03-09T14:37:11.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.987+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=T4SLF0JIAJLU tag=6LXRZDB8FZ4U type=write size=2960796 2024-03-09T14:37:11.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.987+0000 7fd389e788c0 1 < canceled part key=_multipart_44F8QXCBBENS.2~DEO6G5YLTOKO.0 size=1048576 2024-03-09T14:37:11.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.987+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~DEO6G5YLTOKO.1 size=85157 2024-03-09T14:37:11.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.995+0000 7fd389e788c0 1 < canceled multipart upload key=44F8QXCBBENS upload=DEO6G5YLTOKO tag=DRLB2V9SWDGA type=write size=2182309 2024-03-09T14:37:11.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.999+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=KAQAETESA9CN type=write size=717743 2024-03-09T14:37:12.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:11.999+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=VEC9QJZR72XU type=del 2024-03-09T14:37:12.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.003+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=QUTQIOBR6IMS type=write size=1047929 2024-03-09T14:37:12.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.007+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=WIW0LN0AEXIV type=del 2024-03-09T14:37:12.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.011+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~X9I36DW92EYW.0 size=1048576 2024-03-09T14:37:12.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.011+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~X9I36DW92EYW.1 size=963103 2024-03-09T14:37:12.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.011+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=X9I36DW92EYW tag=92NFN1A7ATBI type=write size=3060255 2024-03-09T14:37:12.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.015+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=BY1GJCLSJ4R9 type=del 2024-03-09T14:37:12.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.019+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=D97WM9B5K6IZ type=del size=839655 2024-03-09T14:37:12.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.019+0000 7fd389e788c0 1 < canceled part key=_multipart_44F8QXCBBENS.2~JUMR9EQW5TFK.0 size=1048576 2024-03-09T14:37:12.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.019+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~JUMR9EQW5TFK.1 size=1048576 2024-03-09T14:37:12.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.023+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~JUMR9EQW5TFK.2 size=226872 2024-03-09T14:37:12.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.027+0000 7fd389e788c0 1 < canceled multipart upload key=44F8QXCBBENS upload=JUMR9EQW5TFK tag=57XMIK8QH6HJ type=write size=3372600 2024-03-09T14:37:12.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.031+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=WPDR6LBGQJRC type=del size=670004 2024-03-09T14:37:12.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.031+0000 7fd389e788c0 1 < completed delete operation key=DIN8WJ9Z9OI8 tag=JCW2KGKDONTU type=del 2024-03-09T14:37:12.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.035+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~CAQJ8YW8B9UV.0 size=1048576 2024-03-09T14:37:12.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.039+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~CAQJ8YW8B9UV.1 size=1048576 2024-03-09T14:37:12.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.039+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~CAQJ8YW8B9UV.2 size=690065 2024-03-09T14:37:12.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.039+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=CAQJ8YW8B9UV tag=W6TE17KYQ3AG type=write size=3835793 2024-03-09T14:37:12.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.043+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~85FYL1OWPR9K.0 size=16448 2024-03-09T14:37:12.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.047+0000 7fd389e788c0 1 < completed multipart upload key=E2VP0TJ37UX8 upload=85FYL1OWPR9K tag=NFMYUMT5CBT6 type=write size=1065024 2024-03-09T14:37:12.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.051+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=UFZA2W4FH6UQ type=del size=909226 2024-03-09T14:37:12.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.055+0000 7fd389e788c0 1 < suggested remove operation key=DIN8WJ9Z9OI8 tag=FVA22QO0YH53 type=del 2024-03-09T14:37:12.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.059+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=9TSBP8YFX1XR type=del size=2987752 2024-03-09T14:37:12.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.063+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~2BMD0H7F8ANC.0 size=1048576 2024-03-09T14:37:12.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.063+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~2BMD0H7F8ANC.1 size=517379 2024-03-09T14:37:12.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.067+0000 7fd389e788c0 1 < completed multipart upload key=71692MJQITX3 upload=2BMD0H7F8ANC tag=3EDZE661457B type=write size=2614531 2024-03-09T14:37:12.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.071+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=Z2UQ1MQXP1SA type=del size=2716760 2024-03-09T14:37:12.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.075+0000 7fd389e788c0 1 < canceled operation key=Z18Q66VI5PDN tag=YVVN83HRY07P type=del size=3571996 2024-03-09T14:37:12.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.079+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=E3R34KDXOA7X type=del size=3606409 2024-03-09T14:37:12.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.079+0000 7fd389e788c0 1 < canceled operation key=6VT4C288571G tag=E8L9R1SZR1FR type=del size=363935 2024-03-09T14:37:12.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.083+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=GL990R71NRW3 type=del size=1684244 2024-03-09T14:37:12.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.087+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~QBUL71QLZR1K.0 size=773209 2024-03-09T14:37:12.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.091+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=QBUL71QLZR1K tag=G9XSE73NFQFN type=write size=1821785 2024-03-09T14:37:12.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.099+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~10PFC2PXG9F0.0 size=44344 2024-03-09T14:37:12.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.099+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=10PFC2PXG9F0 tag=6R7MVFI6VL6F type=write size=1092920 2024-03-09T14:37:12.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.099+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~84S88H08WNPC.0 size=1048576 2024-03-09T14:37:12.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.103+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~84S88H08WNPC.1 size=1048576 2024-03-09T14:37:12.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.107+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~84S88H08WNPC.2 size=589758 2024-03-09T14:37:12.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.111+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=84S88H08WNPC tag=T0D3OHJU81RZ type=write size=3735486 2024-03-09T14:37:12.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.115+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=5YM5FH9U14PK type=del size=2226158 2024-03-09T14:37:12.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.115+0000 7fd389e788c0 1 < canceled part key=_multipart_IXKMXJ9IZ69S.2~HL4DGA9N2AXY.0 size=1048576 2024-03-09T14:37:12.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.119+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~HL4DGA9N2AXY.1 size=1048576 2024-03-09T14:37:12.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.119+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~HL4DGA9N2AXY.2 size=361102 2024-03-09T14:37:12.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.127+0000 7fd389e788c0 1 < canceled multipart upload key=IXKMXJ9IZ69S upload=HL4DGA9N2AXY tag=1WV0T6I2TGA1 type=write size=3506830 2024-03-09T14:37:12.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.127+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=E533Q8O5HJ5L type=del size=529138 2024-03-09T14:37:12.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.131+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~2F83O0G6AZ5U.0 size=1048576 2024-03-09T14:37:12.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.131+0000 7fd389e788c0 1 < canceled part key=_multipart_FLLUAY21DJ12.2~2F83O0G6AZ5U.1 size=349997 2024-03-09T14:37:12.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.135+0000 7fd389e788c0 1 < canceled multipart upload key=FLLUAY21DJ12 upload=2F83O0G6AZ5U tag=8TULKKR1LHB1 type=write size=2447149 2024-03-09T14:37:12.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.139+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=CIY7WCYWWJ9M type=del size=2400580 2024-03-09T14:37:12.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.143+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~T4SLF0JIAJLU.0 size=1048576 2024-03-09T14:37:12.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.143+0000 7fd389e788c0 1 < canceled part key=_multipart_44F8QXCBBENS.2~T4SLF0JIAJLU.1 size=863644 2024-03-09T14:37:12.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.147+0000 7fd389e788c0 1 < canceled multipart upload key=44F8QXCBBENS upload=T4SLF0JIAJLU tag=6LXRZDB8FZ4U type=write size=2960796 2024-03-09T14:37:12.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.155+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~WUIMYL7H378Y.0 size=768132 2024-03-09T14:37:12.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.155+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=WUIMYL7H378Y tag=3NS45PMVB1Y8 type=write size=1816708 2024-03-09T14:37:12.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.155+0000 7fd389e788c0 1 < completed write operation key=SVTMMQ2QR603 tag=KAQAETESA9CN type=write size=717743 2024-03-09T14:37:12.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.163+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~U77KX7PCD835.0 size=1048576 2024-03-09T14:37:12.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.163+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~U77KX7PCD835.1 size=315275 2024-03-09T14:37:12.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.163+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=U77KX7PCD835 tag=761H413T11VW type=write size=2412427 2024-03-09T14:37:12.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.167+0000 7fd389e788c0 1 < completed write operation key=SVTMMQ2QR603 tag=QUTQIOBR6IMS type=write size=1047929 2024-03-09T14:37:12.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.171+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=9QJC25A39MUO type=del size=2436109 2024-03-09T14:37:12.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.175+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~X9I36DW92EYW.0 size=1048576 2024-03-09T14:37:12.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.179+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~X9I36DW92EYW.1 size=963103 2024-03-09T14:37:12.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.187+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=X9I36DW92EYW tag=92NFN1A7ATBI type=write size=3060255 2024-03-09T14:37:12.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.191+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~7HXPCJCXNU2N.0 size=1048576 2024-03-09T14:37:12.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.191+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~7HXPCJCXNU2N.1 size=723853 2024-03-09T14:37:12.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.191+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=7HXPCJCXNU2N tag=XEN12QV06TSL type=write size=2821005 2024-03-09T14:37:12.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.195+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=D97WM9B5K6IZ type=del 2024-03-09T14:37:12.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.199+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=VYHNZ3KGXXAK type=del size=1293599 2024-03-09T14:37:12.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.199+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=WPDR6LBGQJRC type=del 2024-03-09T14:37:12.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.207+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~SXON5RIQ35QU.0 size=1048576 2024-03-09T14:37:12.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.211+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~SXON5RIQ35QU.1 size=1048576 2024-03-09T14:37:12.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.211+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~SXON5RIQ35QU.2 size=152339 2024-03-09T14:37:12.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.211+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=SXON5RIQ35QU tag=KZ480DBZ018K type=write size=3298067 2024-03-09T14:37:12.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.215+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~CAQJ8YW8B9UV.0 size=1048576 2024-03-09T14:37:12.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.215+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~CAQJ8YW8B9UV.1 size=1048576 2024-03-09T14:37:12.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.219+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~CAQJ8YW8B9UV.2 size=690065 2024-03-09T14:37:12.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.223+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=CAQJ8YW8B9UV tag=W6TE17KYQ3AG type=write size=3835793 2024-03-09T14:37:12.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.231+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~2GDUFY11UNZ2.0 size=1048576 2024-03-09T14:37:12.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.231+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~2GDUFY11UNZ2.1 size=1048576 2024-03-09T14:37:12.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.235+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~2GDUFY11UNZ2.2 size=784854 2024-03-09T14:37:12.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.235+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=2GDUFY11UNZ2 tag=0UI0SD1SK240 type=write size=3930582 2024-03-09T14:37:12.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.235+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=UFZA2W4FH6UQ type=del 2024-03-09T14:37:12.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.243+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~6SY2NOT0FYR3.0 size=1048576 2024-03-09T14:37:12.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.243+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~6SY2NOT0FYR3.1 size=1048576 2024-03-09T14:37:12.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.247+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~6SY2NOT0FYR3.2 size=914692 2024-03-09T14:37:12.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.247+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=6SY2NOT0FYR3 tag=ZALILHDERYE0 type=write size=4060420 2024-03-09T14:37:12.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.251+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=9TSBP8YFX1XR type=del 2024-03-09T14:37:12.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.255+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~JOVLAKE3T1U7.0 size=1048576 2024-03-09T14:37:12.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.259+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~JOVLAKE3T1U7.1 size=1048576 2024-03-09T14:37:12.260 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.259+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~JOVLAKE3T1U7.2 size=421142 2024-03-09T14:37:12.260 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.259+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=JOVLAKE3T1U7 tag=LK16TMAYWATK type=write size=3566870 2024-03-09T14:37:12.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.263+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=Z2UQ1MQXP1SA type=del 2024-03-09T14:37:12.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.271+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~N9V193M01KJJ.0 size=181576 2024-03-09T14:37:12.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.271+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=N9V193M01KJJ tag=KI21BPMKINN4 type=write size=1230152 2024-03-09T14:37:12.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.271+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=E3R34KDXOA7X type=del 2024-03-09T14:37:12.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.275+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=16RZJE7IZ2IT type=write size=938154 2024-03-09T14:37:12.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.279+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=GL990R71NRW3 type=del 2024-03-09T14:37:12.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.283+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=T52HODEEVJME type=del size=1827644 2024-03-09T14:37:12.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.283+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~10PFC2PXG9F0.0 size=44344 2024-03-09T14:37:12.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.291+0000 7fd389e788c0 1 < completed multipart upload key=P83H9137MI7Y upload=10PFC2PXG9F0 tag=6R7MVFI6VL6F type=write size=1092920 2024-03-09T14:37:12.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.291+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=775N4LBDY8UJ type=del size=890013 2024-03-09T14:37:12.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.295+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=5YM5FH9U14PK type=del 2024-03-09T14:37:12.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.299+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~9NA9CSNYLKCN.0 size=1048576 2024-03-09T14:37:12.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.303+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~9NA9CSNYLKCN.1 size=1048576 2024-03-09T14:37:12.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.303+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~9NA9CSNYLKCN.2 size=205711 2024-03-09T14:37:12.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.303+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=9NA9CSNYLKCN tag=GSHB5UFJZD1C type=write size=3351439 2024-03-09T14:37:12.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.307+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=E533Q8O5HJ5L type=del 2024-03-09T14:37:12.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.311+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~T2L1KZK0H65N.0 size=1048576 2024-03-09T14:37:12.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.315+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~T2L1KZK0H65N.1 size=1048576 2024-03-09T14:37:12.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.315+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~T2L1KZK0H65N.2 size=958887 2024-03-09T14:37:12.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.315+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=T2L1KZK0H65N tag=4YWRUFRABUVC type=write size=4104615 2024-03-09T14:37:12.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.319+0000 7fd389e788c0 1 < completed delete operation key=PKVYD8DWS7M2 tag=CIY7WCYWWJ9M type=del 2024-03-09T14:37:12.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.323+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=KPNUNKVZWY4M type=del size=1637395 2024-03-09T14:37:12.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.323+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~WUIMYL7H378Y.0 size=768132 2024-03-09T14:37:12.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.327+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=WUIMYL7H378Y tag=3NS45PMVB1Y8 type=write size=1816708 2024-03-09T14:37:12.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.331+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=C3WC9KSW93ZI type=del size=1284703 2024-03-09T14:37:12.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.335+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~U77KX7PCD835.0 size=1048576 2024-03-09T14:37:12.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.335+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~U77KX7PCD835.1 size=315275 2024-03-09T14:37:12.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.339+0000 7fd389e788c0 1 < completed multipart upload key=K9X2N6V8R4BY upload=U77KX7PCD835 tag=761H413T11VW type=write size=2412427 2024-03-09T14:37:12.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.343+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=3Q1E9CHQRRG8 type=write size=321894 2024-03-09T14:37:12.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.347+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=9QJC25A39MUO type=del 2024-03-09T14:37:12.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.351+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=CF3I9CYKP50F type=del size=581839 2024-03-09T14:37:12.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.351+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~7HXPCJCXNU2N.0 size=1048576 2024-03-09T14:37:12.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.355+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~7HXPCJCXNU2N.1 size=723853 2024-03-09T14:37:12.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.359+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=7HXPCJCXNU2N tag=XEN12QV06TSL type=write size=2821005 2024-03-09T14:37:12.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.363+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~9O6YYUXZ1J04.0 size=794951 2024-03-09T14:37:12.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.363+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=9O6YYUXZ1J04 tag=6YG9YSZM541I type=write size=1843527 2024-03-09T14:37:12.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.367+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=VYHNZ3KGXXAK type=del 2024-03-09T14:37:12.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.371+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~5I6MAS9OHFBT.0 size=1048576 2024-03-09T14:37:12.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.371+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~5I6MAS9OHFBT.1 size=1048576 2024-03-09T14:37:12.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.375+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~5I6MAS9OHFBT.2 size=421391 2024-03-09T14:37:12.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.375+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=5I6MAS9OHFBT tag=V76C3IAB00E9 type=write size=3567119 2024-03-09T14:37:12.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.379+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~SXON5RIQ35QU.0 size=1048576 2024-03-09T14:37:12.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.379+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~SXON5RIQ35QU.1 size=1048576 2024-03-09T14:37:12.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.383+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~SXON5RIQ35QU.2 size=152339 2024-03-09T14:37:12.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.387+0000 7fd389e788c0 1 < completed multipart upload key=E2VP0TJ37UX8 upload=SXON5RIQ35QU tag=KZ480DBZ018K type=write size=3298067 2024-03-09T14:37:12.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.387+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=CJ9EQ7AUH7KE type=del size=343663 2024-03-09T14:37:12.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.391+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~2GDUFY11UNZ2.0 size=1048576 2024-03-09T14:37:12.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.395+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~2GDUFY11UNZ2.1 size=1048576 2024-03-09T14:37:12.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.395+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~2GDUFY11UNZ2.2 size=784854 2024-03-09T14:37:12.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.399+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=2GDUFY11UNZ2 tag=0UI0SD1SK240 type=write size=3930582 2024-03-09T14:37:12.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.403+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~EGQZU72KVLAX.0 size=1048576 2024-03-09T14:37:12.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.407+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~EGQZU72KVLAX.1 size=1048576 2024-03-09T14:37:12.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.407+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~EGQZU72KVLAX.2 size=805397 2024-03-09T14:37:12.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.407+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=EGQZU72KVLAX tag=GLGOTIPR4D2M type=write size=3951125 2024-03-09T14:37:12.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.411+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~6SY2NOT0FYR3.0 size=1048576 2024-03-09T14:37:12.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.411+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~6SY2NOT0FYR3.1 size=1048576 2024-03-09T14:37:12.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.415+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~6SY2NOT0FYR3.2 size=914692 2024-03-09T14:37:12.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.419+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=6SY2NOT0FYR3 tag=ZALILHDERYE0 type=write size=4060420 2024-03-09T14:37:12.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.419+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=EEHG45670PM6 type=write size=694576 2024-03-09T14:37:12.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.423+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~JOVLAKE3T1U7.0 size=1048576 2024-03-09T14:37:12.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.423+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~JOVLAKE3T1U7.1 size=1048576 2024-03-09T14:37:12.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.431+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~JOVLAKE3T1U7.2 size=421142 2024-03-09T14:37:12.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.435+0000 7fd389e788c0 1 < completed multipart upload key=IXKMXJ9IZ69S upload=JOVLAKE3T1U7 tag=LK16TMAYWATK type=write size=3566870 2024-03-09T14:37:12.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.435+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=M83ASLIPX3P0 type=del size=890140 2024-03-09T14:37:12.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.439+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~N9V193M01KJJ.0 size=181576 2024-03-09T14:37:12.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.443+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=N9V193M01KJJ tag=KI21BPMKINN4 type=write size=1230152 2024-03-09T14:37:12.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.443+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=AZQX402WHOW6 type=del size=1591861 2024-03-09T14:37:12.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.447+0000 7fd389e788c0 1 < suggested remove operation key=61RC3GUU437B tag=16RZJE7IZ2IT type=write 2024-03-09T14:37:12.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.451+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=IOAPGGHV44Q4 type=write size=717047 2024-03-09T14:37:12.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.455+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=T52HODEEVJME type=del 2024-03-09T14:37:12.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.455+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=P7I0Y1FTQYCV type=del size=3152329 2024-03-09T14:37:12.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.459+0000 7fd389e788c0 1 < canceled operation key=YR2VX4QLOCOG tag=775N4LBDY8UJ type=del size=890013 2024-03-09T14:37:12.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.463+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~NZJEZB66SFU0.0 size=706955 2024-03-09T14:37:12.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.463+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=NZJEZB66SFU0 tag=PSE5HKZ2GUVN type=write size=1755531 2024-03-09T14:37:12.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.467+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~9NA9CSNYLKCN.0 size=1048576 2024-03-09T14:37:12.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.467+0000 7fd389e788c0 1 < canceled part key=_multipart_FY02AR9GS3KG.2~9NA9CSNYLKCN.1 size=1048576 2024-03-09T14:37:12.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.467+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~9NA9CSNYLKCN.2 size=205711 2024-03-09T14:37:12.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.471+0000 7fd389e788c0 1 < canceled multipart upload key=FY02AR9GS3KG upload=9NA9CSNYLKCN tag=GSHB5UFJZD1C type=write size=3351439 2024-03-09T14:37:12.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.475+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=D01YX29J1YAV type=del size=1043208 2024-03-09T14:37:12.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.475+0000 7fd389e788c0 1 < canceled part key=_multipart_Z18Q66VI5PDN.2~T2L1KZK0H65N.0 size=1048576 2024-03-09T14:37:12.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.479+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~T2L1KZK0H65N.1 size=1048576 2024-03-09T14:37:12.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.479+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~T2L1KZK0H65N.2 size=958887 2024-03-09T14:37:12.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.483+0000 7fd389e788c0 1 < canceled multipart upload key=Z18Q66VI5PDN upload=T2L1KZK0H65N tag=4YWRUFRABUVC type=write size=4104615 2024-03-09T14:37:12.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.487+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=LHSM0ZQC9522 type=write size=961261 2024-03-09T14:37:12.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.491+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=KPNUNKVZWY4M type=del 2024-03-09T14:37:12.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.495+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~U4KK55RTE70I.0 size=228515 2024-03-09T14:37:12.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.495+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=U4KK55RTE70I tag=IGHJ3SKEN9TF type=write size=1277091 2024-03-09T14:37:12.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.495+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=C3WC9KSW93ZI type=del 2024-03-09T14:37:12.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.499+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=VMO8D03AT1C0 type=del size=1873548 2024-03-09T14:37:12.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.499+0000 7fd389e788c0 1 < completed write operation key=YR2VX4QLOCOG tag=3Q1E9CHQRRG8 type=write size=321894 2024-03-09T14:37:12.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.503+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=T9YJ8O56PVOD type=del size=3422913 2024-03-09T14:37:12.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.507+0000 7fd389e788c0 1 < suggested update operation key=1K5KR8U3GCOV tag=CF3I9CYKP50F type=del size=581839 2024-03-09T14:37:12.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.511+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=YE7PMQR7WQR0 type=del size=3576010 2024-03-09T14:37:12.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.511+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~9O6YYUXZ1J04.0 size=794951 2024-03-09T14:37:12.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.515+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=9O6YYUXZ1J04 tag=6YG9YSZM541I type=write size=1843527 2024-03-09T14:37:12.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.519+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=T26JN6K4QBU2 type=del size=1064673 2024-03-09T14:37:12.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.523+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~5I6MAS9OHFBT.0 size=1048576 2024-03-09T14:37:12.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.523+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~5I6MAS9OHFBT.1 size=1048576 2024-03-09T14:37:12.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.527+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~5I6MAS9OHFBT.2 size=421391 2024-03-09T14:37:12.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.531+0000 7fd389e788c0 1 < completed multipart upload key=K9X2N6V8R4BY upload=5I6MAS9OHFBT tag=V76C3IAB00E9 type=write size=3567119 2024-03-09T14:37:12.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.531+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=IHIE41KMJUHG type=del size=454883 2024-03-09T14:37:12.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.539+0000 7fd389e788c0 1 < suggested remove operation key=8J6Z9DT07H0X tag=CJ9EQ7AUH7KE type=del 2024-03-09T14:37:12.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.543+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~AYQ17Q3YVN1P.0 size=1048576 2024-03-09T14:37:12.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.543+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~AYQ17Q3YVN1P.1 size=1048576 2024-03-09T14:37:12.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.547+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~AYQ17Q3YVN1P.2 size=36204 2024-03-09T14:37:12.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.547+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=AYQ17Q3YVN1P tag=E4YFLH78P1V2 type=write size=3181932 2024-03-09T14:37:12.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.547+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~EGQZU72KVLAX.0 size=1048576 2024-03-09T14:37:12.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.551+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~EGQZU72KVLAX.1 size=1048576 2024-03-09T14:37:12.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.551+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~EGQZU72KVLAX.2 size=805397 2024-03-09T14:37:12.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.555+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=EGQZU72KVLAX tag=GLGOTIPR4D2M type=write size=3951125 2024-03-09T14:37:12.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.563+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~8ZYYT10H387Q.0 size=499490 2024-03-09T14:37:12.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.563+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=8ZYYT10H387Q tag=1SFQ31NB2F2D type=write size=1548066 2024-03-09T14:37:12.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.567+0000 7fd389e788c0 1 < suggested update operation key=ACL1T9GW2JV9 tag=EEHG45670PM6 type=write size=694576 2024-03-09T14:37:12.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.567+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=Q31RNU871KUM type=write size=838716 2024-03-09T14:37:12.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.571+0000 7fd389e788c0 1 < suggested remove operation key=E2VP0TJ37UX8 tag=M83ASLIPX3P0 type=del 2024-03-09T14:37:12.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.575+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=042AXUWN210Y type=write size=459753 2024-03-09T14:37:12.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.579+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=AZQX402WHOW6 type=del 2024-03-09T14:37:12.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.583+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~H4AZEIAM9DF2.0 size=440255 2024-03-09T14:37:12.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.583+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=H4AZEIAM9DF2 tag=5SJ2UUGSXD2S type=write size=1488831 2024-03-09T14:37:12.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.587+0000 7fd389e788c0 1 < suggested remove operation key=AUSZ4JUGI6UU tag=IOAPGGHV44Q4 type=write 2024-03-09T14:37:12.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.587+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=3SJ0IQ5JD6JK type=del size=1933253 2024-03-09T14:37:12.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.591+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=P7I0Y1FTQYCV type=del 2024-03-09T14:37:12.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.595+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~R4FK184R7S69.0 size=460181 2024-03-09T14:37:12.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.595+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=R4FK184R7S69 tag=S77FT081J01M type=write size=1508757 2024-03-09T14:37:12.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.599+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~NZJEZB66SFU0.0 size=706955 2024-03-09T14:37:12.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.599+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=NZJEZB66SFU0 tag=PSE5HKZ2GUVN type=write size=1755531 2024-03-09T14:37:12.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.603+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=35U3AYY17YWA type=write size=915235 2024-03-09T14:37:12.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.603+0000 7fd389e788c0 -1 < no bi entry to suggest for operation key=AUSZ4JUGI6UU tag=D01YX29J1YAV type=del size=1043208: (2) No such file or directory 2024-03-09T14:37:12.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.607+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=2T6IDPYHXWLI type=del size=2464655 2024-03-09T14:37:12.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.611+0000 7fd389e788c0 -1 < failed to complete operation key=E2VP0TJ37UX8 tag=LHSM0ZQC9522 type=write size=961261: (22) Invalid argument 2024-03-09T14:37:12.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.611+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=1Y32Z5SVGPK4 type=del size=3321876 2024-03-09T14:37:12.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.611+0000 7fd389e788c0 1 < canceled part key=_multipart_PZJT6RWRJFIN.2~U4KK55RTE70I.0 size=228515 2024-03-09T14:37:12.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.615+0000 7fd389e788c0 1 < canceled multipart upload key=PZJT6RWRJFIN upload=U4KK55RTE70I tag=IGHJ3SKEN9TF type=write size=1277091 2024-03-09T14:37:12.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.623+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=HU6OHJ2URAHV type=write size=408508 2024-03-09T14:37:12.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.627+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=VMO8D03AT1C0 type=del 2024-03-09T14:37:12.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.627+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=7C0WOINMEMM0 type=del size=1706586 2024-03-09T14:37:12.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.631+0000 7fd389e788c0 1 < suggested update operation key=IXKMXJ9IZ69S tag=T9YJ8O56PVOD type=del size=3422913 2024-03-09T14:37:12.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.635+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=V4H0ES5KL0GB type=del size=805690 2024-03-09T14:37:12.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.639+0000 7fd389e788c0 1 < suggested update operation key=PKVYD8DWS7M2 tag=YE7PMQR7WQR0 type=del size=3576010 2024-03-09T14:37:12.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.639+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=NX65VQUNW705 type=del size=2783166 2024-03-09T14:37:12.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.643+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=T26JN6K4QBU2 type=del 2024-03-09T14:37:12.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.647+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~BWPZ54SS0J2Z.0 size=613212 2024-03-09T14:37:12.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.647+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=BWPZ54SS0J2Z tag=6GHN9C2O0QSF type=write size=1661788 2024-03-09T14:37:12.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.651+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=IHIE41KMJUHG type=del 2024-03-09T14:37:12.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.655+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~2QFI2VP269PE.0 size=515566 2024-03-09T14:37:12.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.655+0000 7fd389e788c0 1 > prepared multipart upload key=UMT7VKZ9R4IR upload=2QFI2VP269PE tag=RMBVXEKWBBS5 type=write size=1564142 2024-03-09T14:37:12.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.655+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~AYQ17Q3YVN1P.0 size=1048576 2024-03-09T14:37:12.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.659+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~AYQ17Q3YVN1P.1 size=1048576 2024-03-09T14:37:12.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.663+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~AYQ17Q3YVN1P.2 size=36204 2024-03-09T14:37:12.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.667+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=AYQ17Q3YVN1P tag=E4YFLH78P1V2 type=write size=3181932 2024-03-09T14:37:12.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.671+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=98F5L18ACVII type=del size=1482976 2024-03-09T14:37:12.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.671+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~8ZYYT10H387Q.0 size=499490 2024-03-09T14:37:12.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.675+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=8ZYYT10H387Q tag=1SFQ31NB2F2D type=write size=1548066 2024-03-09T14:37:12.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.679+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=SWA81GX548HF type=del size=3300028 2024-03-09T14:37:12.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.679+0000 7fd389e788c0 1 < completed write operation key=PZJT6RWRJFIN tag=Q31RNU871KUM type=write size=838716 2024-03-09T14:37:12.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.683+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=K1E8XT2O0JE9 type=del size=1832467 2024-03-09T14:37:12.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.687+0000 7fd389e788c0 1 < completed write operation key=FY02AR9GS3KG tag=042AXUWN210Y type=write size=459753 2024-03-09T14:37:12.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.691+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~0VNTZNKE8LL4.0 size=1048576 2024-03-09T14:37:12.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.691+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~0VNTZNKE8LL4.1 size=1048576 2024-03-09T14:37:12.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.695+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~0VNTZNKE8LL4.2 size=57816 2024-03-09T14:37:12.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.695+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=0VNTZNKE8LL4 tag=M10HHSCJ53DK type=write size=3203544 2024-03-09T14:37:12.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.695+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~H4AZEIAM9DF2.0 size=440255 2024-03-09T14:37:12.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.699+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=H4AZEIAM9DF2 tag=5SJ2UUGSXD2S type=write size=1488831 2024-03-09T14:37:12.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.703+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=VU2C7RLNR120 type=del size=1219888 2024-03-09T14:37:12.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.703+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=3SJ0IQ5JD6JK type=del 2024-03-09T14:37:12.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.707+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~03U6VXB7LT0J.0 size=1048576 2024-03-09T14:37:12.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.711+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~03U6VXB7LT0J.1 size=451100 2024-03-09T14:37:12.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.711+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=03U6VXB7LT0J tag=5D84RJNRM567 type=write size=2548252 2024-03-09T14:37:12.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.711+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~R4FK184R7S69.0 size=460181 2024-03-09T14:37:12.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.715+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=R4FK184R7S69 tag=S77FT081J01M type=write size=1508757 2024-03-09T14:37:12.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.719+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~9L27OLOPY1FW.0 size=747062 2024-03-09T14:37:12.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.719+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=9L27OLOPY1FW tag=7TDU7RIBYRLW type=write size=1795638 2024-03-09T14:37:12.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.723+0000 7fd389e788c0 1 < suggested remove operation key=P83H9137MI7Y tag=35U3AYY17YWA type=write 2024-03-09T14:37:12.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.727+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=3J41ITPFRNIF type=del size=203699 2024-03-09T14:37:12.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.731+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=2T6IDPYHXWLI type=del 2024-03-09T14:37:12.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.731+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=7JYTIDY5YY6A type=del size=561196 2024-03-09T14:37:12.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.735+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=1Y32Z5SVGPK4 type=del 2024-03-09T14:37:12.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.739+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=5VWKUEE5883N type=del size=3622730 2024-03-09T14:37:12.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.743+0000 7fd389e788c0 1 < suggested remove operation key=FLLUAY21DJ12 tag=HU6OHJ2URAHV type=write 2024-03-09T14:37:12.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.743+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=780WGDYS2W3P type=del size=811181 2024-03-09T14:37:12.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.751+0000 7fd389e788c0 1 < suggested update operation key=FY02AR9GS3KG tag=7C0WOINMEMM0 type=del size=1706586 2024-03-09T14:37:12.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.755+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~ILEXCITIBMU4.0 size=245472 2024-03-09T14:37:12.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.755+0000 7fd389e788c0 1 > prepared multipart upload key=2405Y4I2Q8TY upload=ILEXCITIBMU4 tag=60JLVSU072JD type=write size=1294048 2024-03-09T14:37:12.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.759+0000 7fd389e788c0 1 < suggested remove operation key=71692MJQITX3 tag=V4H0ES5KL0GB type=del 2024-03-09T14:37:12.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.763+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~4HS1BIMG9H98.0 size=1048576 2024-03-09T14:37:12.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.763+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~4HS1BIMG9H98.1 size=166097 2024-03-09T14:37:12.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.763+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=4HS1BIMG9H98 tag=MKDVCHCICCZ6 type=write size=2263249 2024-03-09T14:37:12.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.767+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=NX65VQUNW705 type=del 2024-03-09T14:37:12.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.767+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=PWTFXPPHI1U4 type=write size=790436 2024-03-09T14:37:12.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.771+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~BWPZ54SS0J2Z.0 size=613212 2024-03-09T14:37:12.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.775+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=BWPZ54SS0J2Z tag=6GHN9C2O0QSF type=write size=1661788 2024-03-09T14:37:12.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.779+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~3WYB3UTVR1XM.0 size=1048576 2024-03-09T14:37:12.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.779+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~3WYB3UTVR1XM.1 size=988306 2024-03-09T14:37:12.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.779+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=3WYB3UTVR1XM tag=JSGVLOH679YV type=write size=3085458 2024-03-09T14:37:12.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.783+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~2QFI2VP269PE.0 size=515566 2024-03-09T14:37:12.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.783+0000 7fd389e788c0 1 < completed multipart upload key=UMT7VKZ9R4IR upload=2QFI2VP269PE tag=RMBVXEKWBBS5 type=write size=1564142 2024-03-09T14:37:12.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.787+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~2BTI8742SA50.0 size=1048576 2024-03-09T14:37:12.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.791+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~2BTI8742SA50.1 size=77276 2024-03-09T14:37:12.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.791+0000 7fd389e788c0 1 > prepared multipart upload key=GSNWWDS63MTA upload=2BTI8742SA50 tag=XC7LTTO2649E type=write size=2174428 2024-03-09T14:37:12.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.795+0000 7fd389e788c0 1 < suggested update operation key=AUSZ4JUGI6UU tag=98F5L18ACVII type=del size=1482976 2024-03-09T14:37:12.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.795+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=C9730T5YNE6H type=del size=3546716 2024-03-09T14:37:12.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.799+0000 7fd389e788c0 1 < suggested remove operation key=I4NA328AI5T1 tag=SWA81GX548HF type=del 2024-03-09T14:37:12.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.803+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~L31T69SIIZ31.0 size=1048576 2024-03-09T14:37:12.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.803+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~L31T69SIIZ31.1 size=1048576 2024-03-09T14:37:12.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.807+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~L31T69SIIZ31.2 size=385258 2024-03-09T14:37:12.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.807+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=L31T69SIIZ31 tag=SC7NZZK6ZR01 type=write size=3530986 2024-03-09T14:37:12.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.807+0000 7fd389e788c0 1 < completed delete operation key=PKVYD8DWS7M2 tag=K1E8XT2O0JE9 type=del 2024-03-09T14:37:12.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.811+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=HVIKYN6MNHJX type=del size=53716 2024-03-09T14:37:12.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.815+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~0VNTZNKE8LL4.0 size=1048576 2024-03-09T14:37:12.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.815+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~0VNTZNKE8LL4.1 size=1048576 2024-03-09T14:37:12.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.819+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~0VNTZNKE8LL4.2 size=57816 2024-03-09T14:37:12.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.823+0000 7fd389e788c0 1 < completed multipart upload key=CLAM83TC7RZ7 upload=0VNTZNKE8LL4 tag=M10HHSCJ53DK type=write size=3203544 2024-03-09T14:37:12.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.823+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=XMHHGV4ULQQ6 type=del size=405881 2024-03-09T14:37:12.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.827+0000 7fd389e788c0 1 < suggested remove operation key=E65PFNHJQHEO tag=VU2C7RLNR120 type=del 2024-03-09T14:37:12.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.831+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~NPTNLW8DLZ9S.0 size=1048576 2024-03-09T14:37:12.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.835+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~NPTNLW8DLZ9S.1 size=1048576 2024-03-09T14:37:12.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.835+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~NPTNLW8DLZ9S.2 size=211478 2024-03-09T14:37:12.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.835+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=NPTNLW8DLZ9S tag=6Z85ZFWTJSD2 type=write size=3357206 2024-03-09T14:37:12.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.839+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~03U6VXB7LT0J.0 size=1048576 2024-03-09T14:37:12.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.839+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~03U6VXB7LT0J.1 size=451100 2024-03-09T14:37:12.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.843+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=03U6VXB7LT0J tag=5D84RJNRM567 type=write size=2548252 2024-03-09T14:37:12.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.847+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~IAHWXBSGQMW7.0 size=1048576 2024-03-09T14:37:12.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.847+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~IAHWXBSGQMW7.1 size=222022 2024-03-09T14:37:12.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.847+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=IAHWXBSGQMW7 tag=Z5AP0WXM905R type=write size=2319174 2024-03-09T14:37:12.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.847+0000 7fd389e788c0 1 < canceled part key=_multipart_5ZEDXFB9B3CN.2~9L27OLOPY1FW.0 size=747062 2024-03-09T14:37:12.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.851+0000 7fd389e788c0 1 < canceled multipart upload key=5ZEDXFB9B3CN upload=9L27OLOPY1FW tag=7TDU7RIBYRLW type=write size=1795638 2024-03-09T14:37:12.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.855+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=1VDM0TE0G2VG type=del size=333246 2024-03-09T14:37:12.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.855+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=3J41ITPFRNIF type=del 2024-03-09T14:37:12.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.859+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=RDHGUJ2Q3O7V type=del size=491536 2024-03-09T14:37:12.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.859+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=7JYTIDY5YY6A type=del 2024-03-09T14:37:12.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.863+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~W5HIOWSTV8P3.0 size=1048576 2024-03-09T14:37:12.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.867+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~W5HIOWSTV8P3.1 size=1048576 2024-03-09T14:37:12.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.871+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~W5HIOWSTV8P3.2 size=511292 2024-03-09T14:37:12.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.871+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=W5HIOWSTV8P3 tag=OE1WCOSA7YYN type=write size=3657020 2024-03-09T14:37:12.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.871+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=5VWKUEE5883N type=del 2024-03-09T14:37:12.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.875+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=C8BIIBW1OLJ2 type=del size=1617490 2024-03-09T14:37:12.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.879+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=780WGDYS2W3P type=del 2024-03-09T14:37:12.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.879+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=U9Y0N0YTHMM8 type=del size=1007784 2024-03-09T14:37:12.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.883+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~ILEXCITIBMU4.0 size=245472 2024-03-09T14:37:12.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.887+0000 7fd389e788c0 1 < completed multipart upload key=2405Y4I2Q8TY upload=ILEXCITIBMU4 tag=60JLVSU072JD type=write size=1294048 2024-03-09T14:37:12.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.887+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=LDW7YP1P65E4 type=del size=778409 2024-03-09T14:37:12.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.887+0000 7fd389e788c0 1 < canceled part key=_multipart_1KJK6PF6U226.2~4HS1BIMG9H98.0 size=1048576 2024-03-09T14:37:12.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.891+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~4HS1BIMG9H98.1 size=166097 2024-03-09T14:37:12.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.895+0000 7fd389e788c0 1 < canceled multipart upload key=1KJK6PF6U226 upload=4HS1BIMG9H98 tag=MKDVCHCICCZ6 type=write size=2263249 2024-03-09T14:37:12.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.895+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=57R3BCU9ESBJ type=del size=291984 2024-03-09T14:37:12.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.899+0000 7fd389e788c0 1 < completed write operation key=8J6Z9DT07H0X tag=PWTFXPPHI1U4 type=write size=790436 2024-03-09T14:37:12.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.903+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~00AVXVUAREQ0.0 size=1048576 2024-03-09T14:37:12.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.903+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~00AVXVUAREQ0.1 size=286865 2024-03-09T14:37:12.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.903+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=00AVXVUAREQ0 tag=RZQF3SGARS78 type=write size=2384017 2024-03-09T14:37:12.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.907+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~3WYB3UTVR1XM.0 size=1048576 2024-03-09T14:37:12.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.907+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~3WYB3UTVR1XM.1 size=988306 2024-03-09T14:37:12.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.911+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=3WYB3UTVR1XM tag=JSGVLOH679YV type=write size=3085458 2024-03-09T14:37:12.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.915+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~S3D3GEH6N2V0.0 size=1048576 2024-03-09T14:37:12.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.915+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~S3D3GEH6N2V0.1 size=609797 2024-03-09T14:37:12.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.915+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=S3D3GEH6N2V0 tag=JTST7MQRXPOP type=write size=2706949 2024-03-09T14:37:12.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.919+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~2BTI8742SA50.0 size=1048576 2024-03-09T14:37:12.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.919+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~2BTI8742SA50.1 size=77276 2024-03-09T14:37:12.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.923+0000 7fd389e788c0 1 < completed multipart upload key=GSNWWDS63MTA upload=2BTI8742SA50 tag=XC7LTTO2649E type=write size=2174428 2024-03-09T14:37:12.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.927+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=YBM6CC23E27R type=del size=545934 2024-03-09T14:37:12.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.927+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=C9730T5YNE6H type=del 2024-03-09T14:37:12.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.931+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=B0IQ19B1JOVY type=del size=3924085 2024-03-09T14:37:12.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.931+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~L31T69SIIZ31.0 size=1048576 2024-03-09T14:37:12.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.935+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~L31T69SIIZ31.1 size=1048576 2024-03-09T14:37:12.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.935+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~L31T69SIIZ31.2 size=385258 2024-03-09T14:37:12.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.939+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=L31T69SIIZ31 tag=SC7NZZK6ZR01 type=write size=3530986 2024-03-09T14:37:12.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.939+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=4ZAQDJS4FCSC type=write size=373442 2024-03-09T14:37:12.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.943+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=HVIKYN6MNHJX type=del 2024-03-09T14:37:12.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.947+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=DS9MLQO1QPN9 type=del size=2275619 2024-03-09T14:37:12.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.947+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=XMHHGV4ULQQ6 type=del 2024-03-09T14:37:12.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.951+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=JP9PR1NHFPAX type=del size=1437725 2024-03-09T14:37:12.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.951+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~NPTNLW8DLZ9S.0 size=1048576 2024-03-09T14:37:12.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.955+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~NPTNLW8DLZ9S.1 size=1048576 2024-03-09T14:37:12.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.955+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~NPTNLW8DLZ9S.2 size=211478 2024-03-09T14:37:12.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.959+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=NPTNLW8DLZ9S tag=6Z85ZFWTJSD2 type=write size=3357206 2024-03-09T14:37:12.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.963+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~V9SIANTDC2VK.0 size=479954 2024-03-09T14:37:12.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.963+0000 7fd389e788c0 1 > prepared multipart upload key=DIN8WJ9Z9OI8 upload=V9SIANTDC2VK tag=PYMG5EYAHNH2 type=write size=1528530 2024-03-09T14:37:12.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.963+0000 7fd389e788c0 1 < canceled part key=_multipart_MHT268M7S2TY.2~IAHWXBSGQMW7.0 size=1048576 2024-03-09T14:37:12.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.963+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~IAHWXBSGQMW7.1 size=222022 2024-03-09T14:37:12.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.967+0000 7fd389e788c0 1 < canceled multipart upload key=MHT268M7S2TY upload=IAHWXBSGQMW7 tag=Z5AP0WXM905R type=write size=2319174 2024-03-09T14:37:12.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.971+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=I9BZKK1KFXHM type=del size=1056668 2024-03-09T14:37:12.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.971+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=1VDM0TE0G2VG type=del 2024-03-09T14:37:12.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.975+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~ZGA67H2UH4EB.0 size=837751 2024-03-09T14:37:12.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.975+0000 7fd389e788c0 1 > prepared multipart upload key=GSNWWDS63MTA upload=ZGA67H2UH4EB tag=EQOCVZ0J3CK3 type=write size=1886327 2024-03-09T14:37:12.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.975+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=RDHGUJ2Q3O7V type=del 2024-03-09T14:37:12.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.979+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=9XMP93ITUB1N type=del size=2099640 2024-03-09T14:37:12.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.979+0000 7fd389e788c0 1 < canceled part key=_multipart_PZJT6RWRJFIN.2~W5HIOWSTV8P3.0 size=1048576 2024-03-09T14:37:12.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.983+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~W5HIOWSTV8P3.1 size=1048576 2024-03-09T14:37:12.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.983+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~W5HIOWSTV8P3.2 size=511292 2024-03-09T14:37:12.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.987+0000 7fd389e788c0 1 < canceled multipart upload key=PZJT6RWRJFIN upload=W5HIOWSTV8P3 tag=OE1WCOSA7YYN type=write size=3657020 2024-03-09T14:37:12.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.987+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=3ED5ALNTU46X type=del size=2285658 2024-03-09T14:37:12.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.991+0000 7fd389e788c0 1 < completed delete operation key=PKVYD8DWS7M2 tag=C8BIIBW1OLJ2 type=del 2024-03-09T14:37:12.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.995+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=PWE71KRW0IA1 type=del size=2206649 2024-03-09T14:37:12.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.995+0000 7fd389e788c0 1 < completed delete operation key=UMT7VKZ9R4IR tag=U9Y0N0YTHMM8 type=del 2024-03-09T14:37:12.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:12.999+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=7R2D3BXRJODR type=write size=175314 2024-03-09T14:37:13.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.003+0000 7fd389e788c0 1 < suggested update operation key=DIN8WJ9Z9OI8 tag=LDW7YP1P65E4 type=del size=778409 2024-03-09T14:37:13.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.003+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=CL9D4HWWMH1C type=del size=3920557 2024-03-09T14:37:13.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.007+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=57R3BCU9ESBJ type=del 2024-03-09T14:37:13.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.011+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~ZNDYJJ0V4VPG.0 size=36146 2024-03-09T14:37:13.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.011+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=ZNDYJJ0V4VPG tag=EUZHEQ4319YJ type=write size=1084722 2024-03-09T14:37:13.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.015+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~00AVXVUAREQ0.0 size=1048576 2024-03-09T14:37:13.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.015+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~00AVXVUAREQ0.1 size=286865 2024-03-09T14:37:13.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.019+0000 7fd389e788c0 1 < completed multipart upload key=P83H9137MI7Y upload=00AVXVUAREQ0 tag=RZQF3SGARS78 type=write size=2384017 2024-03-09T14:37:13.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.019+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=DK2F5DTLGFTQ type=del size=460679 2024-03-09T14:37:13.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.023+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~S3D3GEH6N2V0.0 size=1048576 2024-03-09T14:37:13.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.023+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~S3D3GEH6N2V0.1 size=609797 2024-03-09T14:37:13.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.027+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=S3D3GEH6N2V0 tag=JTST7MQRXPOP type=write size=2706949 2024-03-09T14:37:13.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.031+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~IS83XV7FPKLU.0 size=1048576 2024-03-09T14:37:13.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.035+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~IS83XV7FPKLU.1 size=1048576 2024-03-09T14:37:13.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.035+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~IS83XV7FPKLU.2 size=38455 2024-03-09T14:37:13.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.035+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=IS83XV7FPKLU tag=LD8AG0OQTOMA type=write size=3184183 2024-03-09T14:37:13.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.039+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=YBM6CC23E27R type=del 2024-03-09T14:37:13.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.043+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~AYU5B2ZPA2GR.0 size=1048576 2024-03-09T14:37:13.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.043+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~AYU5B2ZPA2GR.1 size=1048576 2024-03-09T14:37:13.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.043+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~AYU5B2ZPA2GR.2 size=104140 2024-03-09T14:37:13.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.043+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=AYU5B2ZPA2GR tag=HXIX5K5CIEA3 type=write size=3249868 2024-03-09T14:37:13.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.047+0000 7fd389e788c0 1 < suggested update operation key=2405Y4I2Q8TY tag=B0IQ19B1JOVY type=del size=3924085 2024-03-09T14:37:13.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.051+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=1TXP3DGX55HN type=del size=636292 2024-03-09T14:37:13.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.055+0000 7fd389e788c0 1 < completed write operation key=E2VP0TJ37UX8 tag=4ZAQDJS4FCSC type=write size=373442 2024-03-09T14:37:13.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.055+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=D2Z06F2IX5FP type=del size=1109591 2024-03-09T14:37:13.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.059+0000 7fd389e788c0 1 < completed delete operation key=PKVYD8DWS7M2 tag=DS9MLQO1QPN9 type=del 2024-03-09T14:37:13.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.059+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=GUAFYPWTBBVS type=del size=3757767 2024-03-09T14:37:13.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.063+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=JP9PR1NHFPAX type=del 2024-03-09T14:37:13.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.067+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~KVOVT1PHBWIE.0 size=726616 2024-03-09T14:37:13.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.067+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=KVOVT1PHBWIE tag=3YA29J9CCCL5 type=write size=1775192 2024-03-09T14:37:13.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.071+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~V9SIANTDC2VK.0 size=479954 2024-03-09T14:37:13.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.075+0000 7fd389e788c0 1 < completed multipart upload key=DIN8WJ9Z9OI8 upload=V9SIANTDC2VK tag=PYMG5EYAHNH2 type=write size=1528530 2024-03-09T14:37:13.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.079+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~PMOJZW1AWKSH.0 size=1048576 2024-03-09T14:37:13.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.079+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~PMOJZW1AWKSH.1 size=1048576 2024-03-09T14:37:13.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.083+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~PMOJZW1AWKSH.2 size=915298 2024-03-09T14:37:13.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.083+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=PMOJZW1AWKSH tag=H5KGHVJXTJX0 type=write size=4061026 2024-03-09T14:37:13.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.087+0000 7fd389e788c0 1 < suggested update operation key=1K5KR8U3GCOV tag=I9BZKK1KFXHM type=del size=1056668 2024-03-09T14:37:13.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.087+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~QGSVBW6UMTB1.0 size=738843 2024-03-09T14:37:13.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.087+0000 7fd389e788c0 1 > prepared multipart upload key=DIN8WJ9Z9OI8 upload=QGSVBW6UMTB1 tag=FP2LW67Q1O5Q type=write size=1787419 2024-03-09T14:37:13.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.091+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~ZGA67H2UH4EB.0 size=837751 2024-03-09T14:37:13.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.095+0000 7fd389e788c0 1 < completed multipart upload key=GSNWWDS63MTA upload=ZGA67H2UH4EB tag=EQOCVZ0J3CK3 type=write size=1886327 2024-03-09T14:37:13.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.099+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~0673HLIP0ZUA.0 size=521805 2024-03-09T14:37:13.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.099+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=0673HLIP0ZUA tag=H4FG1N60K9K3 type=write size=1570381 2024-03-09T14:37:13.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.099+0000 7fd389e788c0 -1 < failed to complete operation key=DIN8WJ9Z9OI8 tag=9XMP93ITUB1N type=del size=2099640: (22) Invalid argument 2024-03-09T14:37:13.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.103+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=E15LREUFEMVY type=del size=910494 2024-03-09T14:37:13.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.103+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=3ED5ALNTU46X type=del 2024-03-09T14:37:13.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.107+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=F6AB1A43L67U type=del size=3396562 2024-03-09T14:37:13.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.107+0000 7fd389e788c0 -1 < failed to complete operation key=DIN8WJ9Z9OI8 tag=PWE71KRW0IA1 type=del size=2206649: (22) Invalid argument 2024-03-09T14:37:13.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.111+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~N4H9WEM3C4ZE.0 size=1048576 2024-03-09T14:37:13.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.111+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~N4H9WEM3C4ZE.1 size=1048576 2024-03-09T14:37:13.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.115+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~N4H9WEM3C4ZE.2 size=537322 2024-03-09T14:37:13.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.115+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=N4H9WEM3C4ZE tag=C62CI8P1RJ00 type=write size=3683050 2024-03-09T14:37:13.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.115+0000 7fd389e788c0 1 < completed write operation key=P83H9137MI7Y tag=7R2D3BXRJODR type=write size=175314 2024-03-09T14:37:13.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.119+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=G8I3USXFA1Y5 type=write size=96492 2024-03-09T14:37:13.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.119+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=CL9D4HWWMH1C type=del 2024-03-09T14:37:13.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.123+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~X1HYWTWF9OOS.0 size=923173 2024-03-09T14:37:13.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.123+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=X1HYWTWF9OOS tag=CZFAQZ0ENE94 type=write size=1971749 2024-03-09T14:37:13.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.127+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~ZNDYJJ0V4VPG.0 size=36146 2024-03-09T14:37:13.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.131+0000 7fd389e788c0 1 < completed multipart upload key=71692MJQITX3 upload=ZNDYJJ0V4VPG tag=EUZHEQ4319YJ type=write size=1084722 2024-03-09T14:37:13.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.131+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=B5D1KCPXBFJ2 type=del size=1613739 2024-03-09T14:37:13.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.135+0000 7fd389e788c0 1 < completed delete operation key=UMT7VKZ9R4IR tag=DK2F5DTLGFTQ type=del 2024-03-09T14:37:13.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.135+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=0D6MZ96A86HI type=write size=118284 2024-03-09T14:37:13.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.135+0000 7fd389e788c0 1 < canceled part key=_multipart_44F8QXCBBENS.2~IS83XV7FPKLU.0 size=1048576 2024-03-09T14:37:13.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.139+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~IS83XV7FPKLU.1 size=1048576 2024-03-09T14:37:13.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.139+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~IS83XV7FPKLU.2 size=38455 2024-03-09T14:37:13.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.147+0000 7fd389e788c0 1 < canceled multipart upload key=44F8QXCBBENS upload=IS83XV7FPKLU tag=LD8AG0OQTOMA type=write size=3184183 2024-03-09T14:37:13.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.151+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~MSZ9FSER3R5L.0 size=793170 2024-03-09T14:37:13.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.151+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=MSZ9FSER3R5L tag=3SO9KA0UHAB5 type=write size=1841746 2024-03-09T14:37:13.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.155+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~AYU5B2ZPA2GR.0 size=1048576 2024-03-09T14:37:13.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.155+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~AYU5B2ZPA2GR.1 size=1048576 2024-03-09T14:37:13.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.159+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~AYU5B2ZPA2GR.2 size=104140 2024-03-09T14:37:13.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.163+0000 7fd389e788c0 1 < completed multipart upload key=Z18Q66VI5PDN upload=AYU5B2ZPA2GR tag=HXIX5K5CIEA3 type=write size=3249868 2024-03-09T14:37:13.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.167+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~Z43HO1HZ0KNV.0 size=789130 2024-03-09T14:37:13.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.167+0000 7fd389e788c0 1 > prepared multipart upload key=UMT7VKZ9R4IR upload=Z43HO1HZ0KNV tag=VV3GA0OBAQ3R type=write size=1837706 2024-03-09T14:37:13.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.171+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=1TXP3DGX55HN type=del 2024-03-09T14:37:13.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.175+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~MZBMKHU5MNN3.0 size=1048576 2024-03-09T14:37:13.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.175+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~MZBMKHU5MNN3.1 size=749311 2024-03-09T14:37:13.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.175+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=MZBMKHU5MNN3 tag=93T3RBBUAUVV type=write size=2846463 2024-03-09T14:37:13.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.179+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=D2Z06F2IX5FP type=del 2024-03-09T14:37:13.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.183+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~WK2ZYHDYNCCC.0 size=1048576 2024-03-09T14:37:13.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.187+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~WK2ZYHDYNCCC.1 size=1048576 2024-03-09T14:37:13.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.187+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~WK2ZYHDYNCCC.2 size=491419 2024-03-09T14:37:13.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.187+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=WK2ZYHDYNCCC tag=23WWCYL795XT type=write size=3637147 2024-03-09T14:37:13.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.191+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=GUAFYPWTBBVS type=del 2024-03-09T14:37:13.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.195+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=QT6LPJY4HX80 type=del size=66218 2024-03-09T14:37:13.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.199+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~KVOVT1PHBWIE.0 size=726616 2024-03-09T14:37:13.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.203+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=KVOVT1PHBWIE tag=3YA29J9CCCL5 type=write size=1775192 2024-03-09T14:37:13.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.207+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~TFRRNXL6YDA8.0 size=481846 2024-03-09T14:37:13.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.207+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=TFRRNXL6YDA8 tag=4C6V236UB7LV type=write size=1530422 2024-03-09T14:37:13.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.207+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~PMOJZW1AWKSH.0 size=1048576 2024-03-09T14:37:13.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.211+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~PMOJZW1AWKSH.1 size=1048576 2024-03-09T14:37:13.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.211+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~PMOJZW1AWKSH.2 size=915298 2024-03-09T14:37:13.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.219+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=PMOJZW1AWKSH tag=H5KGHVJXTJX0 type=write size=4061026 2024-03-09T14:37:13.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.223+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~B82NZ9LFPY56.0 size=792694 2024-03-09T14:37:13.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.223+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=B82NZ9LFPY56 tag=0Q2OHDRN362J type=write size=1841270 2024-03-09T14:37:13.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.227+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~QGSVBW6UMTB1.0 size=738843 2024-03-09T14:37:13.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.231+0000 7fd389e788c0 1 < completed multipart upload key=DIN8WJ9Z9OI8 upload=QGSVBW6UMTB1 tag=FP2LW67Q1O5Q type=write size=1787419 2024-03-09T14:37:13.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.235+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~WV0HZK36LGRM.0 size=1048576 2024-03-09T14:37:13.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.235+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~WV0HZK36LGRM.1 size=1048576 2024-03-09T14:37:13.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.239+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~WV0HZK36LGRM.2 size=635517 2024-03-09T14:37:13.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.239+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=WV0HZK36LGRM tag=U7JQB1KARTJP type=write size=3781245 2024-03-09T14:37:13.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.243+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~0673HLIP0ZUA.0 size=521805 2024-03-09T14:37:13.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.247+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=0673HLIP0ZUA tag=H4FG1N60K9K3 type=write size=1570381 2024-03-09T14:37:13.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.247+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=SIHYY5FNQEBV type=del size=3996552 2024-03-09T14:37:13.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.251+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=E15LREUFEMVY type=del 2024-03-09T14:37:13.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.255+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~2V8BWNRNY1SS.0 size=300825 2024-03-09T14:37:13.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.255+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=2V8BWNRNY1SS tag=OR2QBLV2VVPH type=write size=1349401 2024-03-09T14:37:13.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.259+0000 7fd389e788c0 1 < completed delete operation key=YR2VX4QLOCOG tag=F6AB1A43L67U type=del 2024-03-09T14:37:13.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.263+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=A7U12W6QXHIC type=del size=2223159 2024-03-09T14:37:13.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.263+0000 7fd389e788c0 1 < canceled part key=_multipart_MHT268M7S2TY.2~N4H9WEM3C4ZE.0 size=1048576 2024-03-09T14:37:13.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.263+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~N4H9WEM3C4ZE.1 size=1048576 2024-03-09T14:37:13.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.267+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~N4H9WEM3C4ZE.2 size=537322 2024-03-09T14:37:13.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.271+0000 7fd389e788c0 1 < canceled multipart upload key=MHT268M7S2TY upload=N4H9WEM3C4ZE tag=C62CI8P1RJ00 type=write size=3683050 2024-03-09T14:37:13.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.275+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=W715875WND38 type=write size=317183 2024-03-09T14:37:13.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.275+0000 7fd389e788c0 1 < completed write operation key=SKIBISETJH7B tag=G8I3USXFA1Y5 type=write size=96492 2024-03-09T14:37:13.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.279+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=EN51EZ6JK4J0 type=del size=978743 2024-03-09T14:37:13.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.283+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~X1HYWTWF9OOS.0 size=923173 2024-03-09T14:37:13.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.287+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=X1HYWTWF9OOS tag=CZFAQZ0ENE94 type=write size=1971749 2024-03-09T14:37:13.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.291+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=8UKTGAI6J3FK type=write size=794263 2024-03-09T14:37:13.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.291+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=B5D1KCPXBFJ2 type=del 2024-03-09T14:37:13.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.303+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=H2J0JRPQLHBM type=del size=3190465 2024-03-09T14:37:13.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.303+0000 7fd389e788c0 1 < completed write operation key=I4NA328AI5T1 tag=0D6MZ96A86HI type=write size=118284 2024-03-09T14:37:13.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.307+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=6D0ILSDEGBY9 type=del size=3279744 2024-03-09T14:37:13.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.311+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~MSZ9FSER3R5L.0 size=793170 2024-03-09T14:37:13.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.315+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=MSZ9FSER3R5L tag=3SO9KA0UHAB5 type=write size=1841746 2024-03-09T14:37:13.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.319+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=A2ZUR8J1NS9I type=del size=474212 2024-03-09T14:37:13.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.323+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~Z43HO1HZ0KNV.0 size=789130 2024-03-09T14:37:13.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.327+0000 7fd389e788c0 1 < completed multipart upload key=UMT7VKZ9R4IR upload=Z43HO1HZ0KNV tag=VV3GA0OBAQ3R type=write size=1837706 2024-03-09T14:37:13.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.331+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=LXUNK78IPHM6 type=del size=3968394 2024-03-09T14:37:13.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.335+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~MZBMKHU5MNN3.0 size=1048576 2024-03-09T14:37:13.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.339+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~MZBMKHU5MNN3.1 size=749311 2024-03-09T14:37:13.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.343+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=MZBMKHU5MNN3 tag=93T3RBBUAUVV type=write size=2846463 2024-03-09T14:37:13.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.347+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=NDPXC64RT4JA type=write size=194167 2024-03-09T14:37:13.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.351+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~WK2ZYHDYNCCC.0 size=1048576 2024-03-09T14:37:13.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.351+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~WK2ZYHDYNCCC.1 size=1048576 2024-03-09T14:37:13.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.355+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~WK2ZYHDYNCCC.2 size=491419 2024-03-09T14:37:13.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.359+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=WK2ZYHDYNCCC tag=23WWCYL795XT type=write size=3637147 2024-03-09T14:37:13.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.367+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~NA4SGUP0AQLW.0 size=1048576 2024-03-09T14:37:13.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.367+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~NA4SGUP0AQLW.1 size=1048576 2024-03-09T14:37:13.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.371+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~NA4SGUP0AQLW.2 size=752667 2024-03-09T14:37:13.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.371+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=NA4SGUP0AQLW tag=KRQMB0GZ53L9 type=write size=3898395 2024-03-09T14:37:13.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.375+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=QT6LPJY4HX80 type=del 2024-03-09T14:37:13.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.379+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~HGO2R0MJIDAU.0 size=1048576 2024-03-09T14:37:13.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.383+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~HGO2R0MJIDAU.1 size=412786 2024-03-09T14:37:13.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.383+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=HGO2R0MJIDAU tag=458X9ZW50QD6 type=write size=2509938 2024-03-09T14:37:13.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.387+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~TFRRNXL6YDA8.0 size=481846 2024-03-09T14:37:13.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.391+0000 7fd389e788c0 1 < completed multipart upload key=71692MJQITX3 upload=TFRRNXL6YDA8 tag=4C6V236UB7LV type=write size=1530422 2024-03-09T14:37:13.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.395+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=NL3L2W7D2V2A type=del size=2369005 2024-03-09T14:37:13.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.399+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~B82NZ9LFPY56.0 size=792694 2024-03-09T14:37:13.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.403+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=B82NZ9LFPY56 tag=0Q2OHDRN362J type=write size=1841270 2024-03-09T14:37:13.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.411+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~VBH6DGDKYE2P.0 size=1048576 2024-03-09T14:37:13.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.411+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~VBH6DGDKYE2P.1 size=1048576 2024-03-09T14:37:13.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.415+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~VBH6DGDKYE2P.2 size=929446 2024-03-09T14:37:13.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.415+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=VBH6DGDKYE2P tag=R9BS0YTZTV18 type=write size=4075174 2024-03-09T14:37:13.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.419+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~WV0HZK36LGRM.0 size=1048576 2024-03-09T14:37:13.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.419+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~WV0HZK36LGRM.1 size=1048576 2024-03-09T14:37:13.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.423+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~WV0HZK36LGRM.2 size=635517 2024-03-09T14:37:13.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.431+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=WV0HZK36LGRM tag=U7JQB1KARTJP type=write size=3781245 2024-03-09T14:37:13.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.435+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~U08B31YAN79R.0 size=1048576 2024-03-09T14:37:13.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.439+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~U08B31YAN79R.1 size=1048576 2024-03-09T14:37:13.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.439+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~U08B31YAN79R.2 size=312674 2024-03-09T14:37:13.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.439+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=U08B31YAN79R tag=X7JZYSRYJTOG type=write size=3458402 2024-03-09T14:37:13.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.443+0000 7fd389e788c0 1 < canceled operation key=ACL1T9GW2JV9 tag=SIHYY5FNQEBV type=del size=3996552 2024-03-09T14:37:13.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.447+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=T4OHQB2OKBMV type=del size=635210 2024-03-09T14:37:13.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.451+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~2V8BWNRNY1SS.0 size=300825 2024-03-09T14:37:13.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.455+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=2V8BWNRNY1SS tag=OR2QBLV2VVPH type=write size=1349401 2024-03-09T14:37:13.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.463+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~Q47ZE3W6IR7B.0 size=1048576 2024-03-09T14:37:13.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.463+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~Q47ZE3W6IR7B.1 size=1048576 2024-03-09T14:37:13.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.467+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~Q47ZE3W6IR7B.2 size=575752 2024-03-09T14:37:13.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.467+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=Q47ZE3W6IR7B tag=JGFWQO3J0BUX type=write size=3721480 2024-03-09T14:37:13.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.475+0000 7fd389e788c0 1 < suggested remove operation key=2405Y4I2Q8TY tag=A7U12W6QXHIC type=del 2024-03-09T14:37:13.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.479+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=AFK6F8OG6ERC type=del size=1126501 2024-03-09T14:37:13.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.483+0000 7fd389e788c0 1 < suggested update operation key=AUSZ4JUGI6UU tag=W715875WND38 type=write size=317183 2024-03-09T14:37:13.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.487+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=IAVVLDEHH030 type=write size=94658 2024-03-09T14:37:13.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.491+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=EN51EZ6JK4J0 type=del 2024-03-09T14:37:13.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.495+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=48M0XI4R50GO type=del size=1272129 2024-03-09T14:37:13.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.499+0000 7fd389e788c0 1 < completed write operation key=U8P5Q3D11MM6 tag=8UKTGAI6J3FK type=write size=794263 2024-03-09T14:37:13.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.499+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=4X2G970YWGD5 type=write size=622115 2024-03-09T14:37:13.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.503+0000 7fd389e788c0 -1 < failed to complete operation key=2405Y4I2Q8TY tag=H2J0JRPQLHBM type=del size=3190465: (22) Invalid argument 2024-03-09T14:37:13.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.507+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=TWGBIQ8NLAS6 type=del size=1139443 2024-03-09T14:37:13.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.511+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=6D0ILSDEGBY9 type=del 2024-03-09T14:37:13.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.515+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=67XYN06N0H4B type=write size=914258 2024-03-09T14:37:13.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.519+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=A2ZUR8J1NS9I type=del 2024-03-09T14:37:13.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.523+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~RJV4MLVERK47.0 size=1048576 2024-03-09T14:37:13.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.527+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~RJV4MLVERK47.1 size=1048576 2024-03-09T14:37:13.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.531+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~RJV4MLVERK47.2 size=445662 2024-03-09T14:37:13.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.531+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=RJV4MLVERK47 tag=GA6JFKMZ7BOZ type=write size=3591390 2024-03-09T14:37:13.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.535+0000 7fd389e788c0 1 < completed delete operation key=DIN8WJ9Z9OI8 tag=LXUNK78IPHM6 type=del 2024-03-09T14:37:13.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.539+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=TCFTTHR08JG1 type=del size=101489 2024-03-09T14:37:13.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.539+0000 7fd389e788c0 1 < completed write operation key=Y7E2TLASJM9T tag=NDPXC64RT4JA type=write size=194167 2024-03-09T14:37:13.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.547+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~BXKUK0LRF5HM.0 size=348689 2024-03-09T14:37:13.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.547+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=BXKUK0LRF5HM tag=5U6JYMRXGCTO type=write size=1397265 2024-03-09T14:37:13.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.547+0000 7fd389e788c0 1 < canceled part key=_multipart_P83H9137MI7Y.2~NA4SGUP0AQLW.0 size=1048576 2024-03-09T14:37:13.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.551+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~NA4SGUP0AQLW.1 size=1048576 2024-03-09T14:37:13.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.555+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~NA4SGUP0AQLW.2 size=752667 2024-03-09T14:37:13.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.559+0000 7fd389e788c0 1 < canceled multipart upload key=P83H9137MI7Y upload=NA4SGUP0AQLW tag=KRQMB0GZ53L9 type=write size=3898395 2024-03-09T14:37:13.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.563+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=EFKD34HO8I3X type=del size=2123626 2024-03-09T14:37:13.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.567+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~HGO2R0MJIDAU.0 size=1048576 2024-03-09T14:37:13.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.567+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~HGO2R0MJIDAU.1 size=412786 2024-03-09T14:37:13.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.575+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=HGO2R0MJIDAU tag=458X9ZW50QD6 type=write size=2509938 2024-03-09T14:37:13.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.575+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=6WLXF4MKOPH8 type=write size=87318 2024-03-09T14:37:13.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.583+0000 7fd389e788c0 1 < suggested remove operation key=PZJT6RWRJFIN tag=NL3L2W7D2V2A type=del 2024-03-09T14:37:13.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.587+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=4TQA4EO2LL9Z type=del size=3431743 2024-03-09T14:37:13.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.591+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~VBH6DGDKYE2P.0 size=1048576 2024-03-09T14:37:13.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.595+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~VBH6DGDKYE2P.1 size=1048576 2024-03-09T14:37:13.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.595+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~VBH6DGDKYE2P.2 size=929446 2024-03-09T14:37:13.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.603+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=VBH6DGDKYE2P tag=R9BS0YTZTV18 type=write size=4075174 2024-03-09T14:37:13.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.607+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=K4063GUTEVNZ type=del size=759599 2024-03-09T14:37:13.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.611+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~U08B31YAN79R.0 size=1048576 2024-03-09T14:37:13.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.611+0000 7fd389e788c0 1 < canceled part key=_multipart_44F8QXCBBENS.2~U08B31YAN79R.1 size=1048576 2024-03-09T14:37:13.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.615+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~U08B31YAN79R.2 size=312674 2024-03-09T14:37:13.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.619+0000 7fd389e788c0 1 < canceled multipart upload key=44F8QXCBBENS upload=U08B31YAN79R tag=X7JZYSRYJTOG type=write size=3458402 2024-03-09T14:37:13.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.627+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~48OLJ3VTA4ES.0 size=1048576 2024-03-09T14:37:13.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.627+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~48OLJ3VTA4ES.1 size=1048576 2024-03-09T14:37:13.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.631+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~48OLJ3VTA4ES.2 size=472619 2024-03-09T14:37:13.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.631+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=48OLJ3VTA4ES tag=J7BD34V1OA2C type=write size=3618347 2024-03-09T14:37:13.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.635+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=T4OHQB2OKBMV type=del 2024-03-09T14:37:13.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.639+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=I776BHW9I8DB type=del size=2227761 2024-03-09T14:37:13.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.639+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~Q47ZE3W6IR7B.0 size=1048576 2024-03-09T14:37:13.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.639+0000 7fd389e788c0 1 < canceled part key=_multipart_CLAM83TC7RZ7.2~Q47ZE3W6IR7B.1 size=1048576 2024-03-09T14:37:13.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.643+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~Q47ZE3W6IR7B.2 size=575752 2024-03-09T14:37:13.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.647+0000 7fd389e788c0 1 < canceled multipart upload key=CLAM83TC7RZ7 upload=Q47ZE3W6IR7B tag=JGFWQO3J0BUX type=write size=3721480 2024-03-09T14:37:13.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.655+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~N1I97H8MI5LA.0 size=1048576 2024-03-09T14:37:13.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.655+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~N1I97H8MI5LA.1 size=1048576 2024-03-09T14:37:13.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.659+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~N1I97H8MI5LA.2 size=1034497 2024-03-09T14:37:13.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.659+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=N1I97H8MI5LA tag=4STX2J0CAOGS type=write size=4180225 2024-03-09T14:37:13.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.659+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=AFK6F8OG6ERC type=del 2024-03-09T14:37:13.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.663+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=V8PWHDLOVO7E type=write size=386223 2024-03-09T14:37:13.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.667+0000 7fd389e788c0 1 < completed write operation key=E2VP0TJ37UX8 tag=IAVVLDEHH030 type=write size=94658 2024-03-09T14:37:13.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.671+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~911XF60LRILO.0 size=678488 2024-03-09T14:37:13.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.671+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=911XF60LRILO tag=3JCZ4D5KCJ2D type=write size=1727064 2024-03-09T14:37:13.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.675+0000 7fd389e788c0 -1 < failed to complete operation key=PZJT6RWRJFIN tag=48M0XI4R50GO type=del size=1272129: (22) Invalid argument 2024-03-09T14:37:13.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.679+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=M8NGCS37GXXC type=del size=2902690 2024-03-09T14:37:13.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.679+0000 7fd389e788c0 1 < completed write operation key=61RC3GUU437B tag=4X2G970YWGD5 type=write size=622115 2024-03-09T14:37:13.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.687+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~CKJD4M643K3C.0 size=1048576 2024-03-09T14:37:13.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.687+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~CKJD4M643K3C.1 size=14393 2024-03-09T14:37:13.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.687+0000 7fd389e788c0 1 > prepared multipart upload key=2405Y4I2Q8TY upload=CKJD4M643K3C tag=GSWLNRCP93SS type=write size=2111545 2024-03-09T14:37:13.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.691+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=TWGBIQ8NLAS6 type=del 2024-03-09T14:37:13.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.695+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~S82Z2OYOLAM0.0 size=612892 2024-03-09T14:37:13.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.695+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=S82Z2OYOLAM0 tag=8VI5K3R7W0Y9 type=write size=1661468 2024-03-09T14:37:13.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.699+0000 7fd389e788c0 1 < completed write operation key=5ZEDXFB9B3CN tag=67XYN06N0H4B type=write size=914258 2024-03-09T14:37:13.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.703+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~M0KSPX7I4ST0.0 size=1048576 2024-03-09T14:37:13.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.707+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~M0KSPX7I4ST0.1 size=118149 2024-03-09T14:37:13.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.707+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=M0KSPX7I4ST0 tag=YI4RWIALC312 type=write size=2215301 2024-03-09T14:37:13.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.711+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~RJV4MLVERK47.0 size=1048576 2024-03-09T14:37:13.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.711+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~RJV4MLVERK47.1 size=1048576 2024-03-09T14:37:13.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.715+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~RJV4MLVERK47.2 size=445662 2024-03-09T14:37:13.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.723+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=RJV4MLVERK47 tag=GA6JFKMZ7BOZ type=write size=3591390 2024-03-09T14:37:13.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.727+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~NX8V2CVX3SDN.0 size=1048576 2024-03-09T14:37:13.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.727+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~NX8V2CVX3SDN.1 size=1048576 2024-03-09T14:37:13.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.731+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~NX8V2CVX3SDN.2 size=555049 2024-03-09T14:37:13.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.731+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=NX8V2CVX3SDN tag=54F9KH0XJ839 type=write size=3700777 2024-03-09T14:37:13.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.735+0000 7fd389e788c0 1 < completed delete operation key=YR2VX4QLOCOG tag=TCFTTHR08JG1 type=del 2024-03-09T14:37:13.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.739+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=QSNA0TCUZ4F0 type=write size=202192 2024-03-09T14:37:13.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.739+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~BXKUK0LRF5HM.0 size=348689 2024-03-09T14:37:13.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.743+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=BXKUK0LRF5HM tag=5U6JYMRXGCTO type=write size=1397265 2024-03-09T14:37:13.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.747+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=9Z0FNF0CZOWW type=del size=2645043 2024-03-09T14:37:13.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.751+0000 7fd389e788c0 1 < suggested remove operation key=CLAM83TC7RZ7 tag=EFKD34HO8I3X type=del 2024-03-09T14:37:13.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.755+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~USL3070J1Z7K.0 size=1048576 2024-03-09T14:37:13.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.759+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~USL3070J1Z7K.1 size=1048576 2024-03-09T14:37:13.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.759+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~USL3070J1Z7K.2 size=925750 2024-03-09T14:37:13.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.759+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=USL3070J1Z7K tag=TH1PC7FVISBF type=write size=4071478 2024-03-09T14:37:13.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.763+0000 7fd389e788c0 1 < completed write operation key=SKIBISETJH7B tag=6WLXF4MKOPH8 type=write size=87318 2024-03-09T14:37:13.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.763+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=1NP22O4LRL7V type=del size=1669684 2024-03-09T14:37:13.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.767+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=4TQA4EO2LL9Z type=del 2024-03-09T14:37:13.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.767+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=DFLT2IR7X19M type=del size=315767 2024-03-09T14:37:13.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.771+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=K4063GUTEVNZ type=del 2024-03-09T14:37:13.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.775+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=FPE1V14ADQQM type=write size=842111 2024-03-09T14:37:13.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.775+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~48OLJ3VTA4ES.0 size=1048576 2024-03-09T14:37:13.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.779+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~48OLJ3VTA4ES.1 size=1048576 2024-03-09T14:37:13.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.779+0000 7fd389e788c0 1 < canceled part key=_multipart_MHT268M7S2TY.2~48OLJ3VTA4ES.2 size=472619 2024-03-09T14:37:13.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.783+0000 7fd389e788c0 1 < canceled multipart upload key=MHT268M7S2TY upload=48OLJ3VTA4ES tag=J7BD34V1OA2C type=write size=3618347 2024-03-09T14:37:13.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.783+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=GIDX2KNSFX6E type=write size=576368 2024-03-09T14:37:13.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.787+0000 7fd389e788c0 1 < canceled operation key=44F8QXCBBENS tag=I776BHW9I8DB type=del size=2227761 2024-03-09T14:37:13.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.791+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=XV0V51241QLL type=del size=2947300 2024-03-09T14:37:13.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.791+0000 7fd389e788c0 1 < canceled part key=_multipart_FLLUAY21DJ12.2~N1I97H8MI5LA.0 size=1048576 2024-03-09T14:37:13.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.795+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~N1I97H8MI5LA.1 size=1048576 2024-03-09T14:37:13.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.795+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~N1I97H8MI5LA.2 size=1034497 2024-03-09T14:37:13.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.803+0000 7fd389e788c0 1 < canceled multipart upload key=FLLUAY21DJ12 upload=N1I97H8MI5LA tag=4STX2J0CAOGS type=write size=4180225 2024-03-09T14:37:13.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.803+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=LQE8QMKL2JF5 type=del size=3922850 2024-03-09T14:37:13.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.807+0000 7fd389e788c0 1 < completed write operation key=UMT7VKZ9R4IR tag=V8PWHDLOVO7E type=write size=386223 2024-03-09T14:37:13.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.811+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~82ZJD2WXXOWF.0 size=125124 2024-03-09T14:37:13.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.811+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=82ZJD2WXXOWF tag=YJROR6VCA2MH type=write size=1173700 2024-03-09T14:37:13.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.815+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~911XF60LRILO.0 size=678488 2024-03-09T14:37:13.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.819+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=911XF60LRILO tag=3JCZ4D5KCJ2D type=write size=1727064 2024-03-09T14:37:13.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.823+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~W0A0OTJFC5Y3.0 size=959749 2024-03-09T14:37:13.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.823+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=W0A0OTJFC5Y3 tag=EE7NEDEKQ3B2 type=write size=2008325 2024-03-09T14:37:13.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.827+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=M8NGCS37GXXC type=del 2024-03-09T14:37:13.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.831+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=507M9Z92LA4J type=write size=808203 2024-03-09T14:37:13.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.831+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~CKJD4M643K3C.0 size=1048576 2024-03-09T14:37:13.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.835+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~CKJD4M643K3C.1 size=14393 2024-03-09T14:37:13.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.839+0000 7fd389e788c0 1 < completed multipart upload key=2405Y4I2Q8TY upload=CKJD4M643K3C tag=GSWLNRCP93SS type=write size=2111545 2024-03-09T14:37:13.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.843+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=LFBIOK80JWXN type=del size=1007337 2024-03-09T14:37:13.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.843+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~S82Z2OYOLAM0.0 size=612892 2024-03-09T14:37:13.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.851+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=S82Z2OYOLAM0 tag=8VI5K3R7W0Y9 type=write size=1661468 2024-03-09T14:37:13.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.851+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=S52WEZ76I85T type=del size=2518145 2024-03-09T14:37:13.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.855+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~M0KSPX7I4ST0.0 size=1048576 2024-03-09T14:37:13.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.855+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~M0KSPX7I4ST0.1 size=118149 2024-03-09T14:37:13.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.863+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=M0KSPX7I4ST0 tag=YI4RWIALC312 type=write size=2215301 2024-03-09T14:37:13.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.863+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=5FINFZ395H5T type=del size=1184553 2024-03-09T14:37:13.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.871+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~NX8V2CVX3SDN.0 size=1048576 2024-03-09T14:37:13.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.875+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~NX8V2CVX3SDN.1 size=1048576 2024-03-09T14:37:13.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.875+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~NX8V2CVX3SDN.2 size=555049 2024-03-09T14:37:13.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.879+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=NX8V2CVX3SDN tag=54F9KH0XJ839 type=write size=3700777 2024-03-09T14:37:13.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.883+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=E9N9DL4CSJ52 type=del size=2370480 2024-03-09T14:37:13.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.891+0000 7fd389e788c0 1 < suggested remove operation key=GSNWWDS63MTA tag=QSNA0TCUZ4F0 type=write 2024-03-09T14:37:13.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.891+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=IAKRGRDXXTZ5 type=del size=2318896 2024-03-09T14:37:13.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.895+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=9Z0FNF0CZOWW type=del 2024-03-09T14:37:13.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.899+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=W18T6GZ1QD2I type=del size=383952 2024-03-09T14:37:13.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.903+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~USL3070J1Z7K.0 size=1048576 2024-03-09T14:37:13.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.903+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~USL3070J1Z7K.1 size=1048576 2024-03-09T14:37:13.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.903+0000 7fd389e788c0 1 < canceled part key=_multipart_I4NA328AI5T1.2~USL3070J1Z7K.2 size=925750 2024-03-09T14:37:13.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.911+0000 7fd389e788c0 1 < canceled multipart upload key=I4NA328AI5T1 upload=USL3070J1Z7K tag=TH1PC7FVISBF type=write size=4071478 2024-03-09T14:37:13.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.915+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~05F5RC3CT9MI.0 size=43041 2024-03-09T14:37:13.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.915+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=05F5RC3CT9MI tag=KXAZUNKAX626 type=write size=1091617 2024-03-09T14:37:13.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.919+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=1NP22O4LRL7V type=del 2024-03-09T14:37:13.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.923+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=IZO7ZCO9VSLJ type=del size=2009110 2024-03-09T14:37:13.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.923+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=DFLT2IR7X19M type=del 2024-03-09T14:37:13.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.931+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~8VIR3RMJJPF6.0 size=1048576 2024-03-09T14:37:13.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.931+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~8VIR3RMJJPF6.1 size=1048576 2024-03-09T14:37:13.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.935+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~8VIR3RMJJPF6.2 size=25050 2024-03-09T14:37:13.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.935+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=8VIR3RMJJPF6 tag=KZ2H1W99U3D2 type=write size=3170778 2024-03-09T14:37:13.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.939+0000 7fd389e788c0 1 < completed write operation key=U8P5Q3D11MM6 tag=FPE1V14ADQQM type=write size=842111 2024-03-09T14:37:13.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.943+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~VAYVI4KBY97U.0 size=568745 2024-03-09T14:37:13.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.943+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=VAYVI4KBY97U tag=S64SZDT2S00X type=write size=1617321 2024-03-09T14:37:13.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.951+0000 7fd389e788c0 1 < suggested update operation key=PZJT6RWRJFIN tag=GIDX2KNSFX6E type=write size=576368 2024-03-09T14:37:13.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.955+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=748W7AFQS40S type=del size=1791808 2024-03-09T14:37:13.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.955+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=XV0V51241QLL type=del 2024-03-09T14:37:13.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.959+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=KZB38UYF4GKC type=del size=198993 2024-03-09T14:37:13.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.963+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=LQE8QMKL2JF5 type=del 2024-03-09T14:37:13.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.967+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~WOSIJDO8H1OE.0 size=1048576 2024-03-09T14:37:13.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.971+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~WOSIJDO8H1OE.1 size=1048576 2024-03-09T14:37:13.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.971+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~WOSIJDO8H1OE.2 size=1037600 2024-03-09T14:37:13.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.971+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=WOSIJDO8H1OE tag=NQHM34WTC5AZ type=write size=4183328 2024-03-09T14:37:13.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.975+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~82ZJD2WXXOWF.0 size=125124 2024-03-09T14:37:13.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.979+0000 7fd389e788c0 1 < completed multipart upload key=K9X2N6V8R4BY upload=82ZJD2WXXOWF tag=YJROR6VCA2MH type=write size=1173700 2024-03-09T14:37:13.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.983+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~RK26BSVA4I43.0 size=228304 2024-03-09T14:37:13.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.983+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=RK26BSVA4I43 tag=IIARXPZ83KEW type=write size=1276880 2024-03-09T14:37:13.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.987+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~W0A0OTJFC5Y3.0 size=959749 2024-03-09T14:37:13.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.991+0000 7fd389e788c0 1 < completed multipart upload key=K9X2N6V8R4BY upload=W0A0OTJFC5Y3 tag=EE7NEDEKQ3B2 type=write size=2008325 2024-03-09T14:37:13.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.995+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=MMTVA90ZL67O type=del size=2682880 2024-03-09T14:37:13.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:13.999+0000 7fd389e788c0 1 < completed write operation key=5ZEDXFB9B3CN tag=507M9Z92LA4J type=write size=808203 2024-03-09T14:37:14.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.003+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=LL7O1BSRQKM2 type=del size=3873391 2024-03-09T14:37:14.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.007+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=LFBIOK80JWXN type=del 2024-03-09T14:37:14.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.011+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~NP5DU1K6HW62.0 size=579213 2024-03-09T14:37:14.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.011+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=NP5DU1K6HW62 tag=HNXM1NYPJ70S type=write size=1627789 2024-03-09T14:37:14.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.015+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=S52WEZ76I85T type=del 2024-03-09T14:37:14.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.023+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~PWNURUWFD12W.0 size=1048576 2024-03-09T14:37:14.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.023+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~PWNURUWFD12W.1 size=100370 2024-03-09T14:37:14.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.023+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=PWNURUWFD12W tag=I4KOG6SSZ0VC type=write size=2197522 2024-03-09T14:37:14.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.027+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=5FINFZ395H5T type=del 2024-03-09T14:37:14.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.031+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~NJ4D9V6D49FN.0 size=842586 2024-03-09T14:37:14.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.031+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=NJ4D9V6D49FN tag=Z110RNBXJZQM type=write size=1891162 2024-03-09T14:37:14.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.039+0000 7fd389e788c0 1 < suggested remove operation key=8J6Z9DT07H0X tag=E9N9DL4CSJ52 type=del 2024-03-09T14:37:14.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.043+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~TJDXLGCUFXJX.0 size=1048576 2024-03-09T14:37:14.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.047+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~TJDXLGCUFXJX.1 size=289171 2024-03-09T14:37:14.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.047+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=TJDXLGCUFXJX tag=BOHL2G52R23Q type=write size=2386323 2024-03-09T14:37:14.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.047+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=IAKRGRDXXTZ5 type=del 2024-03-09T14:37:14.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.051+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=UZD15ZJTEM6R type=del size=2765931 2024-03-09T14:37:14.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.055+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=W18T6GZ1QD2I type=del 2024-03-09T14:37:14.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.059+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=N4AXREC9VMOA type=del size=3404144 2024-03-09T14:37:14.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.063+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~05F5RC3CT9MI.0 size=43041 2024-03-09T14:37:14.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.067+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=05F5RC3CT9MI tag=KXAZUNKAX626 type=write size=1091617 2024-03-09T14:37:14.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.067+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=LPLBKROXZOBJ type=write size=224807 2024-03-09T14:37:14.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.071+0000 7fd389e788c0 1 < canceled operation key=IXKMXJ9IZ69S tag=IZO7ZCO9VSLJ type=del size=2009110 2024-03-09T14:37:14.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.075+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~B7UF34V0CQUQ.0 size=176594 2024-03-09T14:37:14.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.075+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=B7UF34V0CQUQ tag=DVWV9FACM01D type=write size=1225170 2024-03-09T14:37:14.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.079+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~8VIR3RMJJPF6.0 size=1048576 2024-03-09T14:37:14.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.083+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~8VIR3RMJJPF6.1 size=1048576 2024-03-09T14:37:14.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.083+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~8VIR3RMJJPF6.2 size=25050 2024-03-09T14:37:14.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.091+0000 7fd389e788c0 1 < completed multipart upload key=Y7E2TLASJM9T upload=8VIR3RMJJPF6 tag=KZ2H1W99U3D2 type=write size=3170778 2024-03-09T14:37:14.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.095+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~E6Q5U3DOYSHE.0 size=1048576 2024-03-09T14:37:14.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.095+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~E6Q5U3DOYSHE.1 size=1048576 2024-03-09T14:37:14.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.099+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~E6Q5U3DOYSHE.2 size=455812 2024-03-09T14:37:14.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.099+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=E6Q5U3DOYSHE tag=IAYW94XOHVHF type=write size=3601540 2024-03-09T14:37:14.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.103+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~VAYVI4KBY97U.0 size=568745 2024-03-09T14:37:14.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.107+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=VAYVI4KBY97U tag=S64SZDT2S00X type=write size=1617321 2024-03-09T14:37:14.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.111+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~NF2KSPSRSQKM.0 size=283302 2024-03-09T14:37:14.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.111+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=NF2KSPSRSQKM tag=IFPEU0NMRBSX type=write size=1331878 2024-03-09T14:37:14.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.115+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=748W7AFQS40S type=del 2024-03-09T14:37:14.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.119+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~EIIISFQHQRIU.0 size=1048576 2024-03-09T14:37:14.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.119+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~EIIISFQHQRIU.1 size=70790 2024-03-09T14:37:14.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.119+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=EIIISFQHQRIU tag=TUTKWD38YPAS type=write size=2167942 2024-03-09T14:37:14.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.127+0000 7fd389e788c0 1 < suggested update operation key=FLLUAY21DJ12 tag=KZB38UYF4GKC type=del size=198993 2024-03-09T14:37:14.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.131+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~91721U04MJI8.0 size=46895 2024-03-09T14:37:14.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.131+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=91721U04MJI8 tag=GD1WS87ODF0U type=write size=1095471 2024-03-09T14:37:14.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.131+0000 7fd389e788c0 1 < canceled part key=_multipart_6VT4C288571G.2~WOSIJDO8H1OE.0 size=1048576 2024-03-09T14:37:14.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.135+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~WOSIJDO8H1OE.1 size=1048576 2024-03-09T14:37:14.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.135+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~WOSIJDO8H1OE.2 size=1037600 2024-03-09T14:37:14.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.139+0000 7fd389e788c0 1 < canceled multipart upload key=6VT4C288571G upload=WOSIJDO8H1OE tag=NQHM34WTC5AZ type=write size=4183328 2024-03-09T14:37:14.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.147+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=43Z49DCC2XMV type=del size=1044101 2024-03-09T14:37:14.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.151+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~RK26BSVA4I43.0 size=228304 2024-03-09T14:37:14.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.155+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=RK26BSVA4I43 tag=IIARXPZ83KEW type=write size=1276880 2024-03-09T14:37:14.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.159+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~3RPI1ERUQ510.0 size=1048576 2024-03-09T14:37:14.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.163+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~3RPI1ERUQ510.1 size=1048576 2024-03-09T14:37:14.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.163+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~3RPI1ERUQ510.2 size=1034050 2024-03-09T14:37:14.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.163+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=3RPI1ERUQ510 tag=BVMAPL50DSWH type=write size=4179778 2024-03-09T14:37:14.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.167+0000 7fd389e788c0 1 < canceled operation key=Z18Q66VI5PDN tag=MMTVA90ZL67O type=del size=2682880 2024-03-09T14:37:14.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.167+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=BJ2MA5MAGSRK type=del size=735772 2024-03-09T14:37:14.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.171+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=LL7O1BSRQKM2 type=del 2024-03-09T14:37:14.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.175+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~FEYVGG7CDRG2.0 size=1048576 2024-03-09T14:37:14.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.175+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~FEYVGG7CDRG2.1 size=1048576 2024-03-09T14:37:14.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.179+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~FEYVGG7CDRG2.2 size=191289 2024-03-09T14:37:14.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.179+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=FEYVGG7CDRG2 tag=O8F69PWF0BA9 type=write size=3337017 2024-03-09T14:37:14.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.183+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~NP5DU1K6HW62.0 size=579213 2024-03-09T14:37:14.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.187+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=NP5DU1K6HW62 tag=HNXM1NYPJ70S type=write size=1627789 2024-03-09T14:37:14.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.187+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=I4TYUOLDD4VO type=del size=1087055 2024-03-09T14:37:14.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.191+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~PWNURUWFD12W.0 size=1048576 2024-03-09T14:37:14.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.191+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~PWNURUWFD12W.1 size=100370 2024-03-09T14:37:14.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.195+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=PWNURUWFD12W tag=I4KOG6SSZ0VC type=write size=2197522 2024-03-09T14:37:14.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.199+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=M0LVURR6HLMC type=del size=2892101 2024-03-09T14:37:14.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.203+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~NJ4D9V6D49FN.0 size=842586 2024-03-09T14:37:14.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.207+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=NJ4D9V6D49FN tag=Z110RNBXJZQM type=write size=1891162 2024-03-09T14:37:14.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.211+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~MFBPID9E0FAQ.0 size=1048576 2024-03-09T14:37:14.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.215+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~MFBPID9E0FAQ.1 size=1048576 2024-03-09T14:37:14.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.215+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~MFBPID9E0FAQ.2 size=454836 2024-03-09T14:37:14.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.215+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=MFBPID9E0FAQ tag=RH8K44CBQOGL type=write size=3600564 2024-03-09T14:37:14.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.219+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~TJDXLGCUFXJX.0 size=1048576 2024-03-09T14:37:14.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.219+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~TJDXLGCUFXJX.1 size=289171 2024-03-09T14:37:14.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.223+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=TJDXLGCUFXJX tag=BOHL2G52R23Q type=write size=2386323 2024-03-09T14:37:14.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.227+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~I1IJZ09R4EAX.0 size=1048576 2024-03-09T14:37:14.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.231+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~I1IJZ09R4EAX.1 size=1048576 2024-03-09T14:37:14.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.235+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~I1IJZ09R4EAX.2 size=521112 2024-03-09T14:37:14.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.235+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=I1IJZ09R4EAX tag=T0JW8ZSQ68Q2 type=write size=3666840 2024-03-09T14:37:14.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.235+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=UZD15ZJTEM6R type=del 2024-03-09T14:37:14.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.239+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=YG037P4ZGFY5 type=del size=3642144 2024-03-09T14:37:14.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.243+0000 7fd389e788c0 1 < completed delete operation key=K9X2N6V8R4BY tag=N4AXREC9VMOA type=del 2024-03-09T14:37:14.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.243+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=1WAGGDYAMW42 type=del size=3854008 2024-03-09T14:37:14.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.251+0000 7fd389e788c0 1 < suggested remove operation key=PKVYD8DWS7M2 tag=LPLBKROXZOBJ type=write 2024-03-09T14:37:14.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.255+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~1DSSRRIC8SUR.0 size=1048576 2024-03-09T14:37:14.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.259+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~1DSSRRIC8SUR.1 size=704404 2024-03-09T14:37:14.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.259+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=1DSSRRIC8SUR tag=7ZB4EM4BA3EC type=write size=2801556 2024-03-09T14:37:14.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.263+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~B7UF34V0CQUQ.0 size=176594 2024-03-09T14:37:14.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.267+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=B7UF34V0CQUQ tag=DVWV9FACM01D type=write size=1225170 2024-03-09T14:37:14.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.271+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=PITWVNENV7P7 type=write size=356402 2024-03-09T14:37:14.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.275+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~E6Q5U3DOYSHE.0 size=1048576 2024-03-09T14:37:14.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.275+0000 7fd389e788c0 1 < canceled part key=_multipart_8J6Z9DT07H0X.2~E6Q5U3DOYSHE.1 size=1048576 2024-03-09T14:37:14.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.279+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~E6Q5U3DOYSHE.2 size=455812 2024-03-09T14:37:14.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.283+0000 7fd389e788c0 1 < canceled multipart upload key=8J6Z9DT07H0X upload=E6Q5U3DOYSHE tag=IAYW94XOHVHF type=write size=3601540 2024-03-09T14:37:14.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.287+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=6UXFZQM43N6O type=write size=690730 2024-03-09T14:37:14.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.291+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~NF2KSPSRSQKM.0 size=283302 2024-03-09T14:37:14.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.295+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=NF2KSPSRSQKM tag=IFPEU0NMRBSX type=write size=1331878 2024-03-09T14:37:14.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.299+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~7I1MFJ5EAHV6.0 size=63386 2024-03-09T14:37:14.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.299+0000 7fd389e788c0 1 > prepared multipart upload key=DIN8WJ9Z9OI8 upload=7I1MFJ5EAHV6 tag=RFYHU0GWE7VN type=write size=1111962 2024-03-09T14:37:14.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.303+0000 7fd389e788c0 1 < canceled part key=_multipart_FLLUAY21DJ12.2~EIIISFQHQRIU.0 size=1048576 2024-03-09T14:37:14.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.303+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~EIIISFQHQRIU.1 size=70790 2024-03-09T14:37:14.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.311+0000 7fd389e788c0 1 < canceled multipart upload key=FLLUAY21DJ12 upload=EIIISFQHQRIU tag=TUTKWD38YPAS type=write size=2167942 2024-03-09T14:37:14.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.315+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~X59DJ9M2W4DL.0 size=337500 2024-03-09T14:37:14.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.315+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=X59DJ9M2W4DL tag=7U0QWLCN2BIC type=write size=1386076 2024-03-09T14:37:14.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.319+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~91721U04MJI8.0 size=46895 2024-03-09T14:37:14.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.323+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=91721U04MJI8 tag=GD1WS87ODF0U type=write size=1095471 2024-03-09T14:37:14.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.327+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=O348QGOFPFM1 type=del size=3742244 2024-03-09T14:37:14.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.331+0000 7fd389e788c0 1 < suggested remove operation key=SVTMMQ2QR603 tag=43Z49DCC2XMV type=del 2024-03-09T14:37:14.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.335+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~PTYDA3AK4515.0 size=171614 2024-03-09T14:37:14.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.335+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=PTYDA3AK4515 tag=I5PLEWMDFAR4 type=write size=1220190 2024-03-09T14:37:14.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.339+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~3RPI1ERUQ510.0 size=1048576 2024-03-09T14:37:14.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.343+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~3RPI1ERUQ510.1 size=1048576 2024-03-09T14:37:14.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.343+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~3RPI1ERUQ510.2 size=1034050 2024-03-09T14:37:14.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.351+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=3RPI1ERUQ510 tag=BVMAPL50DSWH type=write size=4179778 2024-03-09T14:37:14.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.355+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=TQOLP5W0KQOO type=del size=1365205 2024-03-09T14:37:14.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.355+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=BJ2MA5MAGSRK type=del 2024-03-09T14:37:14.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.363+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~1SQKAT10KG67.0 size=1048576 2024-03-09T14:37:14.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.367+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~1SQKAT10KG67.1 size=400226 2024-03-09T14:37:14.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.367+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=1SQKAT10KG67 tag=9A3RKUKD81VS type=write size=2497378 2024-03-09T14:37:14.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.367+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~FEYVGG7CDRG2.0 size=1048576 2024-03-09T14:37:14.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.371+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~FEYVGG7CDRG2.1 size=1048576 2024-03-09T14:37:14.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.375+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~FEYVGG7CDRG2.2 size=191289 2024-03-09T14:37:14.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.379+0000 7fd389e788c0 1 < completed multipart upload key=K9X2N6V8R4BY upload=FEYVGG7CDRG2 tag=O8F69PWF0BA9 type=write size=3337017 2024-03-09T14:37:14.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.387+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~T1MPUKGTDFY0.0 size=1048576 2024-03-09T14:37:14.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.387+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~T1MPUKGTDFY0.1 size=1048576 2024-03-09T14:37:14.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.391+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~T1MPUKGTDFY0.2 size=462801 2024-03-09T14:37:14.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.391+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=T1MPUKGTDFY0 tag=78PY20NYE45U type=write size=3608529 2024-03-09T14:37:14.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.395+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=I4TYUOLDD4VO type=del 2024-03-09T14:37:14.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.399+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=TTELJ4O6NSQA type=write size=883932 2024-03-09T14:37:14.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.403+0000 7fd389e788c0 1 < canceled operation key=E2VP0TJ37UX8 tag=M0LVURR6HLMC type=del size=2892101 2024-03-09T14:37:14.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.407+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=7POVZWN7LF37 type=del size=386203 2024-03-09T14:37:14.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.411+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~MFBPID9E0FAQ.0 size=1048576 2024-03-09T14:37:14.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.411+0000 7fd389e788c0 1 < canceled part key=_multipart_6VT4C288571G.2~MFBPID9E0FAQ.1 size=1048576 2024-03-09T14:37:14.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.411+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~MFBPID9E0FAQ.2 size=454836 2024-03-09T14:37:14.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.423+0000 7fd389e788c0 1 < canceled multipart upload key=6VT4C288571G upload=MFBPID9E0FAQ tag=RH8K44CBQOGL type=write size=3600564 2024-03-09T14:37:14.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.427+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=436J5Y1WBMA1 type=del size=3247473 2024-03-09T14:37:14.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.431+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~I1IJZ09R4EAX.0 size=1048576 2024-03-09T14:37:14.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.435+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~I1IJZ09R4EAX.1 size=1048576 2024-03-09T14:37:14.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.435+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~I1IJZ09R4EAX.2 size=521112 2024-03-09T14:37:14.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.439+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=I1IJZ09R4EAX tag=T0JW8ZSQ68Q2 type=write size=3666840 2024-03-09T14:37:14.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.447+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~TRWAY3OHE2QJ.0 size=1048576 2024-03-09T14:37:14.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.451+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~TRWAY3OHE2QJ.1 size=1048576 2024-03-09T14:37:14.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.451+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~TRWAY3OHE2QJ.2 size=1011535 2024-03-09T14:37:14.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.451+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=TRWAY3OHE2QJ tag=F0LP182QMDAG type=write size=4157263 2024-03-09T14:37:14.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.455+0000 7fd389e788c0 1 < canceled operation key=PZJT6RWRJFIN tag=YG037P4ZGFY5 type=del size=3642144 2024-03-09T14:37:14.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.459+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=3F392QZXUZ8N type=del size=3609178 2024-03-09T14:37:14.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.463+0000 7fd389e788c0 1 < canceled operation key=Y7E2TLASJM9T tag=1WAGGDYAMW42 type=del size=3854008 2024-03-09T14:37:14.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.463+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=K2O6Y8N8I4GH type=del size=3788993 2024-03-09T14:37:14.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.467+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~1DSSRRIC8SUR.0 size=1048576 2024-03-09T14:37:14.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.471+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~1DSSRRIC8SUR.1 size=704404 2024-03-09T14:37:14.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.475+0000 7fd389e788c0 1 < completed multipart upload key=CLAM83TC7RZ7 upload=1DSSRRIC8SUR tag=7ZB4EM4BA3EC type=write size=2801556 2024-03-09T14:37:14.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.479+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~6VMGLA19URUW.0 size=1048576 2024-03-09T14:37:14.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.483+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~6VMGLA19URUW.1 size=125028 2024-03-09T14:37:14.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.483+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=6VMGLA19URUW tag=F5STN47Q34H2 type=write size=2222180 2024-03-09T14:37:14.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.487+0000 7fd389e788c0 1 < suggested update operation key=FY02AR9GS3KG tag=PITWVNENV7P7 type=write size=356402 2024-03-09T14:37:14.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.495+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~I9Y31GYZO5WY.0 size=1048576 2024-03-09T14:37:14.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.495+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~I9Y31GYZO5WY.1 size=1048576 2024-03-09T14:37:14.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.499+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~I9Y31GYZO5WY.2 size=429801 2024-03-09T14:37:14.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.499+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=I9Y31GYZO5WY tag=NRZIPH81H3RI type=write size=3575529 2024-03-09T14:37:14.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.503+0000 7fd389e788c0 1 < completed write operation key=DIN8WJ9Z9OI8 tag=6UXFZQM43N6O type=write size=690730 2024-03-09T14:37:14.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.503+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=5T8P8VJPJL77 type=del size=2706774 2024-03-09T14:37:14.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.507+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~7I1MFJ5EAHV6.0 size=63386 2024-03-09T14:37:14.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.511+0000 7fd389e788c0 1 < completed multipart upload key=DIN8WJ9Z9OI8 upload=7I1MFJ5EAHV6 tag=RFYHU0GWE7VN type=write size=1111962 2024-03-09T14:37:14.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.515+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=WSNY9R9B4O6T type=del size=1934163 2024-03-09T14:37:14.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.519+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~X59DJ9M2W4DL.0 size=337500 2024-03-09T14:37:14.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.523+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=X59DJ9M2W4DL tag=7U0QWLCN2BIC type=write size=1386076 2024-03-09T14:37:14.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.527+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~TWLTGIDKB890.0 size=1048576 2024-03-09T14:37:14.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.531+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~TWLTGIDKB890.1 size=1048576 2024-03-09T14:37:14.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.535+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~TWLTGIDKB890.2 size=212684 2024-03-09T14:37:14.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.535+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=TWLTGIDKB890 tag=ZM6BAJXXK37J type=write size=3358412 2024-03-09T14:37:14.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.539+0000 7fd389e788c0 1 < suggested remove operation key=YR2VX4QLOCOG tag=O348QGOFPFM1 type=del 2024-03-09T14:37:14.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.547+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~CTHTPTXA2SJS.0 size=1048576 2024-03-09T14:37:14.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.547+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~CTHTPTXA2SJS.1 size=1048576 2024-03-09T14:37:14.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.551+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~CTHTPTXA2SJS.2 size=669995 2024-03-09T14:37:14.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.551+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=CTHTPTXA2SJS tag=9GJ8AR1J4ECD type=write size=3815723 2024-03-09T14:37:14.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.555+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~PTYDA3AK4515.0 size=171614 2024-03-09T14:37:14.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.559+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=PTYDA3AK4515 tag=I5PLEWMDFAR4 type=write size=1220190 2024-03-09T14:37:14.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.563+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=ZTPNPHJY7QK9 type=write size=970448 2024-03-09T14:37:14.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.567+0000 7fd389e788c0 1 < canceled operation key=6VT4C288571G tag=TQOLP5W0KQOO type=del size=1365205 2024-03-09T14:37:14.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.567+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=VLJAYU1HYZNU type=write size=514576 2024-03-09T14:37:14.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.571+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~1SQKAT10KG67.0 size=1048576 2024-03-09T14:37:14.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.571+0000 7fd389e788c0 1 < canceled part key=_multipart_Z18Q66VI5PDN.2~1SQKAT10KG67.1 size=400226 2024-03-09T14:37:14.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.579+0000 7fd389e788c0 1 < canceled multipart upload key=Z18Q66VI5PDN upload=1SQKAT10KG67 tag=9A3RKUKD81VS type=write size=2497378 2024-03-09T14:37:14.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.579+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=JIL21C0NDRQD type=del size=1879583 2024-03-09T14:37:14.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.583+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~T1MPUKGTDFY0.0 size=1048576 2024-03-09T14:37:14.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.587+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~T1MPUKGTDFY0.1 size=1048576 2024-03-09T14:37:14.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.591+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~T1MPUKGTDFY0.2 size=462801 2024-03-09T14:37:14.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.595+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=T1MPUKGTDFY0 tag=78PY20NYE45U type=write size=3608529 2024-03-09T14:37:14.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.599+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=B8W5D0QBHDGF type=del size=1415826 2024-03-09T14:37:14.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.607+0000 7fd389e788c0 1 < suggested remove operation key=UMT7VKZ9R4IR tag=TTELJ4O6NSQA type=write 2024-03-09T14:37:14.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.611+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~PA5MNAKFNAII.0 size=444060 2024-03-09T14:37:14.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.611+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=PA5MNAKFNAII tag=2JRSC3G1R8XT type=write size=1492636 2024-03-09T14:37:14.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.615+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=7POVZWN7LF37 type=del 2024-03-09T14:37:14.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.619+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=Z3GWXY9BW8HO type=del size=2416402 2024-03-09T14:37:14.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.619+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=436J5Y1WBMA1 type=del 2024-03-09T14:37:14.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.627+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~CI0M6GCIBWMC.0 size=305533 2024-03-09T14:37:14.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.627+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=CI0M6GCIBWMC tag=X3GP4ORAAQIX type=write size=1354109 2024-03-09T14:37:14.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.631+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~TRWAY3OHE2QJ.0 size=1048576 2024-03-09T14:37:14.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.631+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~TRWAY3OHE2QJ.1 size=1048576 2024-03-09T14:37:14.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.635+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~TRWAY3OHE2QJ.2 size=1011535 2024-03-09T14:37:14.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.639+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=TRWAY3OHE2QJ tag=F0LP182QMDAG type=write size=4157263 2024-03-09T14:37:14.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.643+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=08K5O8O6W6SE type=del size=1164379 2024-03-09T14:37:14.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.647+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=3F392QZXUZ8N type=del 2024-03-09T14:37:14.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.651+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=TX87Q3WANB5G type=del size=428721 2024-03-09T14:37:14.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.655+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=K2O6Y8N8I4GH type=del 2024-03-09T14:37:14.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.659+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~44C9BMSUSZW4.0 size=1048576 2024-03-09T14:37:14.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.663+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~44C9BMSUSZW4.1 size=912532 2024-03-09T14:37:14.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.663+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=44C9BMSUSZW4 tag=BPSD2SXGI7FM type=write size=3009684 2024-03-09T14:37:14.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.667+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~6VMGLA19URUW.0 size=1048576 2024-03-09T14:37:14.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.671+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~6VMGLA19URUW.1 size=125028 2024-03-09T14:37:14.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.675+0000 7fd389e788c0 1 < completed multipart upload key=Z18Q66VI5PDN upload=6VMGLA19URUW tag=F5STN47Q34H2 type=write size=2222180 2024-03-09T14:37:14.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.679+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=UGHZFDBJTSE6 type=del size=2737364 2024-03-09T14:37:14.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.683+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~I9Y31GYZO5WY.0 size=1048576 2024-03-09T14:37:14.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.687+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~I9Y31GYZO5WY.1 size=1048576 2024-03-09T14:37:14.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.687+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~I9Y31GYZO5WY.2 size=429801 2024-03-09T14:37:14.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.695+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=I9Y31GYZO5WY tag=NRZIPH81H3RI type=write size=3575529 2024-03-09T14:37:14.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.699+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~O8UFBC0AOZY7.0 size=1048576 2024-03-09T14:37:14.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.703+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~O8UFBC0AOZY7.1 size=1048576 2024-03-09T14:37:14.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.707+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~O8UFBC0AOZY7.2 size=870153 2024-03-09T14:37:14.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.707+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=O8UFBC0AOZY7 tag=4TDR5TG16ZLD type=write size=4015881 2024-03-09T14:37:14.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.711+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=5T8P8VJPJL77 type=del 2024-03-09T14:37:14.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.719+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=ZPRW4C0G8LVK type=del size=1065201 2024-03-09T14:37:14.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.723+0000 7fd389e788c0 1 < canceled operation key=FLLUAY21DJ12 tag=WSNY9R9B4O6T type=del size=1934163 2024-03-09T14:37:14.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.727+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=VHKGFADZHH2J type=del size=514458 2024-03-09T14:37:14.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.727+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~TWLTGIDKB890.0 size=1048576 2024-03-09T14:37:14.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.731+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~TWLTGIDKB890.1 size=1048576 2024-03-09T14:37:14.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.735+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~TWLTGIDKB890.2 size=212684 2024-03-09T14:37:14.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.739+0000 7fd389e788c0 1 < completed multipart upload key=Y7E2TLASJM9T upload=TWLTGIDKB890 tag=ZM6BAJXXK37J type=write size=3358412 2024-03-09T14:37:14.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.743+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=F44U0YH0SB4R type=del size=3888313 2024-03-09T14:37:14.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.747+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~CTHTPTXA2SJS.0 size=1048576 2024-03-09T14:37:14.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.747+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~CTHTPTXA2SJS.1 size=1048576 2024-03-09T14:37:14.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.751+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~CTHTPTXA2SJS.2 size=669995 2024-03-09T14:37:14.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.755+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=CTHTPTXA2SJS tag=9GJ8AR1J4ECD type=write size=3815723 2024-03-09T14:37:14.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.759+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~U60EGCQUGPS6.0 size=141892 2024-03-09T14:37:14.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.759+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=U60EGCQUGPS6 tag=ZIY5NI5F9H28 type=write size=1190468 2024-03-09T14:37:14.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.763+0000 7fd389e788c0 1 < canceled operation key=U8P5Q3D11MM6 tag=ZTPNPHJY7QK9 type=write size=970448 2024-03-09T14:37:14.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.763+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=BIYOZDE6M0J0 type=del size=3306536 2024-03-09T14:37:14.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.767+0000 7fd389e788c0 1 < completed write operation key=YR2VX4QLOCOG tag=VLJAYU1HYZNU type=write size=514576 2024-03-09T14:37:14.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.771+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=1PRMXU7G2IKN type=del size=316048 2024-03-09T14:37:14.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.771+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=JIL21C0NDRQD type=del 2024-03-09T14:37:14.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.775+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=7O8IZLG4IURW type=del size=876922 2024-03-09T14:37:14.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.779+0000 7fd389e788c0 1 < canceled operation key=FY02AR9GS3KG tag=B8W5D0QBHDGF type=del size=1415826 2024-03-09T14:37:14.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.783+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=2JL15TI46QE3 type=del size=523092 2024-03-09T14:37:14.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.783+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~PA5MNAKFNAII.0 size=444060 2024-03-09T14:37:14.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.791+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=PA5MNAKFNAII tag=2JRSC3G1R8XT type=write size=1492636 2024-03-09T14:37:14.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.795+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=Y7SHNXZJH6M0 type=del size=1515328 2024-03-09T14:37:14.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.799+0000 7fd389e788c0 1 < suggested remove operation key=AUSZ4JUGI6UU tag=Z3GWXY9BW8HO type=del 2024-03-09T14:37:14.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.803+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=XOTEOZI9Q0LU type=del size=3184123 2024-03-09T14:37:14.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.807+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~CI0M6GCIBWMC.0 size=305533 2024-03-09T14:37:14.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.811+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=CI0M6GCIBWMC tag=X3GP4ORAAQIX type=write size=1354109 2024-03-09T14:37:14.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.815+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=R986CYOW6SDM type=del size=271230 2024-03-09T14:37:14.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.815+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=08K5O8O6W6SE type=del 2024-03-09T14:37:14.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.823+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~51JSG2LVHA0G.0 size=1048576 2024-03-09T14:37:14.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.823+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~51JSG2LVHA0G.1 size=401545 2024-03-09T14:37:14.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.823+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=51JSG2LVHA0G tag=SFG4YLY0N5M5 type=write size=2498697 2024-03-09T14:37:14.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.827+0000 7fd389e788c0 1 < completed delete operation key=PKVYD8DWS7M2 tag=TX87Q3WANB5G type=del 2024-03-09T14:37:14.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.835+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~UZLN86Y2TJ8T.0 size=100546 2024-03-09T14:37:14.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.835+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=UZLN86Y2TJ8T tag=6NAT8BKH5CNX type=write size=1149122 2024-03-09T14:37:14.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.835+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~44C9BMSUSZW4.0 size=1048576 2024-03-09T14:37:14.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.839+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~44C9BMSUSZW4.1 size=912532 2024-03-09T14:37:14.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.843+0000 7fd389e788c0 1 < completed multipart upload key=Z18Q66VI5PDN upload=44C9BMSUSZW4 tag=BPSD2SXGI7FM type=write size=3009684 2024-03-09T14:37:14.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.847+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=OHFG15A77KHR type=write size=909517 2024-03-09T14:37:14.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.851+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=UGHZFDBJTSE6 type=del 2024-03-09T14:37:14.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.855+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=JIT5X36XLJ8U type=del size=3758405 2024-03-09T14:37:14.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.855+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~O8UFBC0AOZY7.0 size=1048576 2024-03-09T14:37:14.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.859+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~O8UFBC0AOZY7.1 size=1048576 2024-03-09T14:37:14.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.859+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~O8UFBC0AOZY7.2 size=870153 2024-03-09T14:37:14.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.867+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=O8UFBC0AOZY7 tag=4TDR5TG16ZLD type=write size=4015881 2024-03-09T14:37:14.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.871+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~W34YBGGP30M4.0 size=1048576 2024-03-09T14:37:14.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.875+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~W34YBGGP30M4.1 size=888912 2024-03-09T14:37:14.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.875+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=W34YBGGP30M4 tag=M9ZURJUR24F0 type=write size=2986064 2024-03-09T14:37:14.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.879+0000 7fd389e788c0 1 < canceled operation key=U8P5Q3D11MM6 tag=ZPRW4C0G8LVK type=del size=1065201 2024-03-09T14:37:14.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.883+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~YTEYO80S88E0.0 size=1048576 2024-03-09T14:37:14.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.887+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~YTEYO80S88E0.1 size=1048576 2024-03-09T14:37:14.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.887+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~YTEYO80S88E0.2 size=775209 2024-03-09T14:37:14.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.887+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=YTEYO80S88E0 tag=SK5ASR5VDLIM type=write size=3920937 2024-03-09T14:37:14.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.891+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=VHKGFADZHH2J type=del 2024-03-09T14:37:14.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.899+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~JSO2EN503DG2.0 size=26657 2024-03-09T14:37:14.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.899+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=JSO2EN503DG2 tag=6JTZIXDJD61S type=write size=1075233 2024-03-09T14:37:14.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.907+0000 7fd389e788c0 1 < suggested update operation key=FLLUAY21DJ12 tag=F44U0YH0SB4R type=del size=3888313 2024-03-09T14:37:14.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.911+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=5T7BMJ5LYX8Q type=write size=824775 2024-03-09T14:37:14.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.915+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~U60EGCQUGPS6.0 size=141892 2024-03-09T14:37:14.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.919+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=U60EGCQUGPS6 tag=ZIY5NI5F9H28 type=write size=1190468 2024-03-09T14:37:14.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.923+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=MOSF3H1VTYLA type=del size=1854393 2024-03-09T14:37:14.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.931+0000 7fd389e788c0 1 < suggested remove operation key=PKVYD8DWS7M2 tag=BIYOZDE6M0J0 type=del 2024-03-09T14:37:14.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.939+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~C8CA95EWE537.0 size=1048576 2024-03-09T14:37:14.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.943+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~C8CA95EWE537.1 size=897188 2024-03-09T14:37:14.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.943+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=C8CA95EWE537 tag=6NM1H8QT18QZ type=write size=2994340 2024-03-09T14:37:14.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.943+0000 7fd389e788c0 -1 < no bi entry to suggest for operation key=PKVYD8DWS7M2 tag=1PRMXU7G2IKN type=del size=316048: (2) No such file or directory 2024-03-09T14:37:14.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.951+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~SXM1OVUM9QAR.0 size=919402 2024-03-09T14:37:14.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.951+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=SXM1OVUM9QAR tag=VWP671XNARZS type=write size=1967978 2024-03-09T14:37:14.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.955+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=7O8IZLG4IURW type=del 2024-03-09T14:37:14.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.959+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=2DQ15923GZOW type=del size=4052339 2024-03-09T14:37:14.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.963+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=2JL15TI46QE3 type=del 2024-03-09T14:37:14.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.967+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=V386M008S2QM type=del size=2631205 2024-03-09T14:37:14.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.971+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=Y7SHNXZJH6M0 type=del 2024-03-09T14:37:14.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.975+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~TRLAF1THEUZD.0 size=1048576 2024-03-09T14:37:14.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.979+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~TRLAF1THEUZD.1 size=1048576 2024-03-09T14:37:14.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.983+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~TRLAF1THEUZD.2 size=535877 2024-03-09T14:37:14.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.983+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=TRLAF1THEUZD tag=UP6X6HO7Q458 type=write size=3681605 2024-03-09T14:37:14.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.987+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=XOTEOZI9Q0LU type=del 2024-03-09T14:37:14.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.991+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=JYCK6N2ZLK8G type=del size=1036089 2024-03-09T14:37:14.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.995+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=R986CYOW6SDM type=del 2024-03-09T14:37:14.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:14.995+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=TILPL8BXBMXJ type=write size=127609 2024-03-09T14:37:15.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.003+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~51JSG2LVHA0G.0 size=1048576 2024-03-09T14:37:15.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.003+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~51JSG2LVHA0G.1 size=401545 2024-03-09T14:37:15.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.011+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=51JSG2LVHA0G tag=SFG4YLY0N5M5 type=write size=2498697 2024-03-09T14:37:15.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.015+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=K5JHXBAMJ2YQ type=write size=474782 2024-03-09T14:37:15.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.015+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~UZLN86Y2TJ8T.0 size=100546 2024-03-09T14:37:15.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.023+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=UZLN86Y2TJ8T tag=6NAT8BKH5CNX type=write size=1149122 2024-03-09T14:37:15.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.031+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=T4KIQP4WEJBF type=del size=309832 2024-03-09T14:37:15.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.039+0000 7fd389e788c0 1 < suggested update operation key=E65PFNHJQHEO tag=OHFG15A77KHR type=write size=909517 2024-03-09T14:37:15.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.043+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=AWHZSYA5DOL0 type=del size=3371427 2024-03-09T14:37:15.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.051+0000 7fd389e788c0 1 < suggested remove operation key=MHT268M7S2TY tag=JIT5X36XLJ8U type=del 2024-03-09T14:37:15.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.055+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~IMTL2L6DX8N6.0 size=704022 2024-03-09T14:37:15.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.055+0000 7fd389e788c0 1 > prepared multipart upload key=UMT7VKZ9R4IR upload=IMTL2L6DX8N6 tag=H9ZFJBY1SKCR type=write size=1752598 2024-03-09T14:37:15.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.063+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~W34YBGGP30M4.0 size=1048576 2024-03-09T14:37:15.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.063+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~W34YBGGP30M4.1 size=888912 2024-03-09T14:37:15.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.071+0000 7fd389e788c0 1 < completed multipart upload key=E2VP0TJ37UX8 upload=W34YBGGP30M4 tag=M9ZURJUR24F0 type=write size=2986064 2024-03-09T14:37:15.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.075+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=BGERZ2BZJ3RF type=del size=3882427 2024-03-09T14:37:15.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.079+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~YTEYO80S88E0.0 size=1048576 2024-03-09T14:37:15.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.083+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~YTEYO80S88E0.1 size=1048576 2024-03-09T14:37:15.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.083+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~YTEYO80S88E0.2 size=775209 2024-03-09T14:37:15.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.091+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=YTEYO80S88E0 tag=SK5ASR5VDLIM type=write size=3920937 2024-03-09T14:37:15.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.095+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=OMEG5WCBGCHE type=write size=79182 2024-03-09T14:37:15.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.099+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~JSO2EN503DG2.0 size=26657 2024-03-09T14:37:15.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.103+0000 7fd389e788c0 1 < completed multipart upload key=Z18Q66VI5PDN upload=JSO2EN503DG2 tag=6JTZIXDJD61S type=write size=1075233 2024-03-09T14:37:15.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.107+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=NQJWCYGUY2FR type=write size=88138 2024-03-09T14:37:15.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.111+0000 7fd389e788c0 1 < completed write operation key=E2VP0TJ37UX8 tag=5T7BMJ5LYX8Q type=write size=824775 2024-03-09T14:37:15.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.115+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=J90Z7ZRH08J0 type=write size=900456 2024-03-09T14:37:15.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.123+0000 7fd389e788c0 1 < suggested update operation key=E65PFNHJQHEO tag=MOSF3H1VTYLA type=del size=1854393 2024-03-09T14:37:15.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.127+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=FYQ2CIYD8Y3W type=write size=792082 2024-03-09T14:37:15.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.127+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~C8CA95EWE537.0 size=1048576 2024-03-09T14:37:15.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.127+0000 7fd389e788c0 1 < canceled part key=_multipart_ACL1T9GW2JV9.2~C8CA95EWE537.1 size=897188 2024-03-09T14:37:15.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.135+0000 7fd389e788c0 1 < canceled multipart upload key=ACL1T9GW2JV9 upload=C8CA95EWE537 tag=6NM1H8QT18QZ type=write size=2994340 2024-03-09T14:37:15.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.139+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=BQF799LKC0VF type=write size=994729 2024-03-09T14:37:15.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.143+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~SXM1OVUM9QAR.0 size=919402 2024-03-09T14:37:15.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.147+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=SXM1OVUM9QAR tag=VWP671XNARZS type=write size=1967978 2024-03-09T14:37:15.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.151+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=5M5YUP1WXHSI type=del size=1029610 2024-03-09T14:37:15.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.155+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=2DQ15923GZOW type=del 2024-03-09T14:37:15.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.159+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=65LSHEXE472N type=del size=126359 2024-03-09T14:37:15.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.159+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=V386M008S2QM type=del 2024-03-09T14:37:15.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.163+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=M6X4EIYGQJK2 type=del size=3702298 2024-03-09T14:37:15.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.167+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~TRLAF1THEUZD.0 size=1048576 2024-03-09T14:37:15.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.171+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~TRLAF1THEUZD.1 size=1048576 2024-03-09T14:37:15.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.171+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~TRLAF1THEUZD.2 size=535877 2024-03-09T14:37:15.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.179+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=TRLAF1THEUZD tag=UP6X6HO7Q458 type=write size=3681605 2024-03-09T14:37:15.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.179+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=3HFXTSFXTQQ5 type=write size=796011 2024-03-09T14:37:15.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.183+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=JYCK6N2ZLK8G type=del 2024-03-09T14:37:15.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.187+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=IVW6WB8PSZQW type=del size=2704383 2024-03-09T14:37:15.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.191+0000 7fd389e788c0 1 < completed write operation key=2405Y4I2Q8TY tag=TILPL8BXBMXJ type=write size=127609 2024-03-09T14:37:15.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.195+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=83I2QXDAO8M3 type=del size=2244892 2024-03-09T14:37:15.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.199+0000 7fd389e788c0 1 < completed write operation key=PKVYD8DWS7M2 tag=K5JHXBAMJ2YQ type=write size=474782 2024-03-09T14:37:15.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.203+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=0VISORTL190L type=write size=44273 2024-03-09T14:37:15.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.203+0000 7fd389e788c0 1 < canceled operation key=1KJK6PF6U226 tag=T4KIQP4WEJBF type=del size=309832 2024-03-09T14:37:15.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.211+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~97JOV95R8QDT.0 size=859279 2024-03-09T14:37:15.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.211+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=97JOV95R8QDT tag=8OJN4D98BRGB type=write size=1907855 2024-03-09T14:37:15.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.215+0000 7fd389e788c0 -1 < failed to complete operation key=E65PFNHJQHEO tag=AWHZSYA5DOL0 type=del size=3371427: (22) Invalid argument 2024-03-09T14:37:15.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.223+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~W2KGCM2BIS0L.0 size=1048576 2024-03-09T14:37:15.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.227+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~W2KGCM2BIS0L.1 size=48661 2024-03-09T14:37:15.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.227+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=W2KGCM2BIS0L tag=N8TU30N0BPCE type=write size=2145813 2024-03-09T14:37:15.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.227+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~IMTL2L6DX8N6.0 size=704022 2024-03-09T14:37:15.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.235+0000 7fd389e788c0 1 < completed multipart upload key=UMT7VKZ9R4IR upload=IMTL2L6DX8N6 tag=H9ZFJBY1SKCR type=write size=1752598 2024-03-09T14:37:15.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.235+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=45WLEGNQHCR0 type=del size=3499235 2024-03-09T14:37:15.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.239+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=BGERZ2BZJ3RF type=del 2024-03-09T14:37:15.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.243+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=4H1VD4B3T8V7 type=del size=2966800 2024-03-09T14:37:15.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.247+0000 7fd389e788c0 1 < canceled operation key=SKIBISETJH7B tag=OMEG5WCBGCHE type=write size=79182 2024-03-09T14:37:15.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.251+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~R5KS7GXT6G09.0 size=1048576 2024-03-09T14:37:15.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.255+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~R5KS7GXT6G09.1 size=1048576 2024-03-09T14:37:15.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.259+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~R5KS7GXT6G09.2 size=384106 2024-03-09T14:37:15.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.259+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=R5KS7GXT6G09 tag=N53QPP7FCKQ2 type=write size=3529834 2024-03-09T14:37:15.260 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.259+0000 7fd389e788c0 1 < completed write operation key=YR2VX4QLOCOG tag=NQJWCYGUY2FR type=write size=88138 2024-03-09T14:37:15.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.267+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~3K62EAIHFLPI.0 size=609194 2024-03-09T14:37:15.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.267+0000 7fd389e788c0 1 > prepared multipart upload key=DIN8WJ9Z9OI8 upload=3K62EAIHFLPI tag=H6BS765OT9KW type=write size=1657770 2024-03-09T14:37:15.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.271+0000 7fd389e788c0 -1 < failed to complete operation key=E65PFNHJQHEO tag=J90Z7ZRH08J0 type=write size=900456: (22) Invalid argument 2024-03-09T14:37:15.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.275+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~BQE4PPUDY1F3.0 size=1048576 2024-03-09T14:37:15.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.279+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~BQE4PPUDY1F3.1 size=1048576 2024-03-09T14:37:15.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.279+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~BQE4PPUDY1F3.2 size=596386 2024-03-09T14:37:15.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.279+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=BQE4PPUDY1F3 tag=Y9KYLOT3SHWP type=write size=3742114 2024-03-09T14:37:15.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.283+0000 7fd389e788c0 1 < completed write operation key=I4NA328AI5T1 tag=FYQ2CIYD8Y3W type=write size=792082 2024-03-09T14:37:15.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.287+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=457KA37WAI6M type=del size=1496204 2024-03-09T14:37:15.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.287+0000 7fd389e788c0 1 < completed write operation key=61RC3GUU437B tag=BQF799LKC0VF type=write size=994729 2024-03-09T14:37:15.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.291+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=51FL17DV914R type=del size=1037794 2024-03-09T14:37:15.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.295+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=5M5YUP1WXHSI type=del 2024-03-09T14:37:15.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.299+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~EVTFJSK680BO.0 size=36468 2024-03-09T14:37:15.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.299+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=EVTFJSK680BO tag=Q264VK5BF5IR type=write size=1085044 2024-03-09T14:37:15.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.303+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=65LSHEXE472N type=del 2024-03-09T14:37:15.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.307+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=DV4FKRS1WD84 type=del size=1901710 2024-03-09T14:37:15.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.311+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=M6X4EIYGQJK2 type=del 2024-03-09T14:37:15.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.315+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=K30U5BG6H3SR type=write size=496893 2024-03-09T14:37:15.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.319+0000 7fd389e788c0 1 < suggested remove operation key=K9X2N6V8R4BY tag=3HFXTSFXTQQ5 type=write 2024-03-09T14:37:15.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.327+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~P2A1P9LLQUE4.0 size=1048576 2024-03-09T14:37:15.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.327+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~P2A1P9LLQUE4.1 size=1048576 2024-03-09T14:37:15.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.331+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~P2A1P9LLQUE4.2 size=728701 2024-03-09T14:37:15.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.331+0000 7fd389e788c0 1 > prepared multipart upload key=GSNWWDS63MTA upload=P2A1P9LLQUE4 tag=UPGF0WJ80HLA type=write size=3874429 2024-03-09T14:37:15.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.335+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=IVW6WB8PSZQW type=del 2024-03-09T14:37:15.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.339+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=LTCF2HJN1S63 type=del size=2231068 2024-03-09T14:37:15.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.343+0000 7fd389e788c0 -1 < failed to complete operation key=K9X2N6V8R4BY tag=83I2QXDAO8M3 type=del size=2244892: (22) Invalid argument 2024-03-09T14:37:15.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.347+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~Z8XC6OEN0MIW.0 size=930910 2024-03-09T14:37:15.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.347+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=Z8XC6OEN0MIW tag=RXRUM6CSKPK1 type=write size=1979486 2024-03-09T14:37:15.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.355+0000 7fd389e788c0 1 < completed write operation key=SKIBISETJH7B tag=0VISORTL190L type=write size=44273 2024-03-09T14:37:15.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.359+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=3T0C95TZSDPX type=del size=3367342 2024-03-09T14:37:15.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.363+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~97JOV95R8QDT.0 size=859279 2024-03-09T14:37:15.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.367+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=97JOV95R8QDT tag=8OJN4D98BRGB type=write size=1907855 2024-03-09T14:37:15.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.371+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=OPACWOKV8YAG type=del size=3329741 2024-03-09T14:37:15.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.375+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~W2KGCM2BIS0L.0 size=1048576 2024-03-09T14:37:15.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.375+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~W2KGCM2BIS0L.1 size=48661 2024-03-09T14:37:15.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.383+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=W2KGCM2BIS0L tag=N8TU30N0BPCE type=write size=2145813 2024-03-09T14:37:15.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.387+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=RL5UQI0WPHXA type=del size=187874 2024-03-09T14:37:15.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.387+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=45WLEGNQHCR0 type=del 2024-03-09T14:37:15.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.391+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=DBSW0YA8YVKL type=del size=439488 2024-03-09T14:37:15.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.395+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=4H1VD4B3T8V7 type=del 2024-03-09T14:37:15.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.399+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~GLW0YGCSHKWQ.0 size=1048576 2024-03-09T14:37:15.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.403+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~GLW0YGCSHKWQ.1 size=224291 2024-03-09T14:37:15.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.403+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=GLW0YGCSHKWQ tag=X15ZDMRL27D1 type=write size=2321443 2024-03-09T14:37:15.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.403+0000 7fd389e788c0 1 < canceled part key=_multipart_U8P5Q3D11MM6.2~R5KS7GXT6G09.0 size=1048576 2024-03-09T14:37:15.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.403+0000 7fd389e788c0 1 < canceled part key=_multipart_U8P5Q3D11MM6.2~R5KS7GXT6G09.1 size=1048576 2024-03-09T14:37:15.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.407+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~R5KS7GXT6G09.2 size=384106 2024-03-09T14:37:15.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.411+0000 7fd389e788c0 1 < canceled multipart upload key=U8P5Q3D11MM6 upload=R5KS7GXT6G09 tag=N53QPP7FCKQ2 type=write size=3529834 2024-03-09T14:37:15.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.419+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~60RIFBAFJIVY.0 size=122048 2024-03-09T14:37:15.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.419+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=60RIFBAFJIVY tag=XI1ONHDQHH02 type=write size=1170624 2024-03-09T14:37:15.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.423+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~3K62EAIHFLPI.0 size=609194 2024-03-09T14:37:15.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.427+0000 7fd389e788c0 1 < completed multipart upload key=DIN8WJ9Z9OI8 upload=3K62EAIHFLPI tag=H6BS765OT9KW type=write size=1657770 2024-03-09T14:37:15.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.431+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=IHO61LD2K541 type=del size=3115792 2024-03-09T14:37:15.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.435+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~BQE4PPUDY1F3.0 size=1048576 2024-03-09T14:37:15.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.435+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~BQE4PPUDY1F3.1 size=1048576 2024-03-09T14:37:15.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.435+0000 7fd389e788c0 1 < canceled part key=_multipart_ACL1T9GW2JV9.2~BQE4PPUDY1F3.2 size=596386 2024-03-09T14:37:15.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.443+0000 7fd389e788c0 1 < canceled multipart upload key=ACL1T9GW2JV9 upload=BQE4PPUDY1F3 tag=Y9KYLOT3SHWP type=write size=3742114 2024-03-09T14:37:15.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.447+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~H3QMO14RKAIE.0 size=1048576 2024-03-09T14:37:15.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.451+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~H3QMO14RKAIE.1 size=1048576 2024-03-09T14:37:15.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.455+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~H3QMO14RKAIE.2 size=232037 2024-03-09T14:37:15.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.455+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=H3QMO14RKAIE tag=XR4CQMHTKU62 type=write size=3377765 2024-03-09T14:37:15.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.459+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=457KA37WAI6M type=del 2024-03-09T14:37:15.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.463+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=3KUQ7TWDSVSY type=del size=2264895 2024-03-09T14:37:15.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.463+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=51FL17DV914R type=del 2024-03-09T14:37:15.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.475+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~WUCL11C098N4.0 size=1048576 2024-03-09T14:37:15.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.475+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~WUCL11C098N4.1 size=884418 2024-03-09T14:37:15.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.475+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=WUCL11C098N4 tag=4A768U2YZJ6K type=write size=2981570 2024-03-09T14:37:15.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.479+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~EVTFJSK680BO.0 size=36468 2024-03-09T14:37:15.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.487+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=EVTFJSK680BO tag=Q264VK5BF5IR type=write size=1085044 2024-03-09T14:37:15.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.491+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~6IVPBSL4G2VM.0 size=1048576 2024-03-09T14:37:15.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.495+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~6IVPBSL4G2VM.1 size=1048576 2024-03-09T14:37:15.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.495+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~6IVPBSL4G2VM.2 size=657697 2024-03-09T14:37:15.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.495+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=6IVPBSL4G2VM tag=I88XF03ZQUXG type=write size=3803425 2024-03-09T14:37:15.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.499+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=DV4FKRS1WD84 type=del 2024-03-09T14:37:15.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.507+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~RASQXDGJZJKW.0 size=773493 2024-03-09T14:37:15.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.507+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=RASQXDGJZJKW tag=Q2KU15DYKRZP type=write size=1822069 2024-03-09T14:37:15.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.511+0000 7fd389e788c0 1 < completed write operation key=1K5KR8U3GCOV tag=K30U5BG6H3SR type=write size=496893 2024-03-09T14:37:15.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.511+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=EBQ1312L0U5I type=del size=2092025 2024-03-09T14:37:15.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.515+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~P2A1P9LLQUE4.0 size=1048576 2024-03-09T14:37:15.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.519+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~P2A1P9LLQUE4.1 size=1048576 2024-03-09T14:37:15.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.523+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~P2A1P9LLQUE4.2 size=728701 2024-03-09T14:37:15.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.527+0000 7fd389e788c0 1 < completed multipart upload key=GSNWWDS63MTA upload=P2A1P9LLQUE4 tag=UPGF0WJ80HLA type=write size=3874429 2024-03-09T14:37:15.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.531+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=PZ0N1CSLXDEL type=del size=2317034 2024-03-09T14:37:15.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.531+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=LTCF2HJN1S63 type=del 2024-03-09T14:37:15.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.535+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=3EZQO6CXHQQ1 type=del size=2598081 2024-03-09T14:37:15.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.539+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~Z8XC6OEN0MIW.0 size=930910 2024-03-09T14:37:15.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.543+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=Z8XC6OEN0MIW tag=RXRUM6CSKPK1 type=write size=1979486 2024-03-09T14:37:15.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.551+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~YJ3DHCHWQV37.0 size=1048576 2024-03-09T14:37:15.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.555+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~YJ3DHCHWQV37.1 size=1048576 2024-03-09T14:37:15.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.559+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~YJ3DHCHWQV37.2 size=800113 2024-03-09T14:37:15.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.559+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=YJ3DHCHWQV37 tag=XFAG8LKQS2AY type=write size=3945841 2024-03-09T14:37:15.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.563+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=3T0C95TZSDPX type=del 2024-03-09T14:37:15.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.563+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=UWIDQ6K1WP76 type=del size=2119668 2024-03-09T14:37:15.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.571+0000 7fd389e788c0 1 < suggested update operation key=I4NA328AI5T1 tag=OPACWOKV8YAG type=del size=3329741 2024-03-09T14:37:15.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.575+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=JCEGUZGWKO4X type=del size=1273566 2024-03-09T14:37:15.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.579+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=RL5UQI0WPHXA type=del 2024-03-09T14:37:15.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.587+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~27GV182UNXCT.0 size=758098 2024-03-09T14:37:15.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.587+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=27GV182UNXCT tag=LWFDOC8GXDRB type=write size=1806674 2024-03-09T14:37:15.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.591+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=DBSW0YA8YVKL type=del 2024-03-09T14:37:15.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.591+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=HX4LPSE8XF33 type=del size=254766 2024-03-09T14:37:15.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.595+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~GLW0YGCSHKWQ.0 size=1048576 2024-03-09T14:37:15.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.599+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~GLW0YGCSHKWQ.1 size=224291 2024-03-09T14:37:15.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.603+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=GLW0YGCSHKWQ tag=X15ZDMRL27D1 type=write size=2321443 2024-03-09T14:37:15.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.611+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~3K2YJBTPGI99.0 size=1048576 2024-03-09T14:37:15.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.615+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~3K2YJBTPGI99.1 size=1048576 2024-03-09T14:37:15.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.615+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~3K2YJBTPGI99.2 size=471991 2024-03-09T14:37:15.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.615+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=3K2YJBTPGI99 tag=JBFQQUTDR2MW type=write size=3617719 2024-03-09T14:37:15.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.619+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~60RIFBAFJIVY.0 size=122048 2024-03-09T14:37:15.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.627+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=60RIFBAFJIVY tag=XI1ONHDQHH02 type=write size=1170624 2024-03-09T14:37:15.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.631+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=9J3P0VXPHVHC type=del size=2416095 2024-03-09T14:37:15.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.631+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=IHO61LD2K541 type=del 2024-03-09T14:37:15.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.635+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=O0ZGNDCOQFC2 type=del size=1592272 2024-03-09T14:37:15.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.639+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~H3QMO14RKAIE.0 size=1048576 2024-03-09T14:37:15.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.639+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~H3QMO14RKAIE.1 size=1048576 2024-03-09T14:37:15.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.639+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~H3QMO14RKAIE.2 size=232037 2024-03-09T14:37:15.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.643+0000 7fd389e788c0 1 < completed multipart upload key=P83H9137MI7Y upload=H3QMO14RKAIE tag=XR4CQMHTKU62 type=write size=3377765 2024-03-09T14:37:15.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.651+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~EBB0RIH7VYG1.0 size=1048576 2024-03-09T14:37:15.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.651+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~EBB0RIH7VYG1.1 size=384371 2024-03-09T14:37:15.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.651+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=EBB0RIH7VYG1 tag=I3LS28ZX1R8C type=write size=2481523 2024-03-09T14:37:15.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.659+0000 7fd389e788c0 1 < suggested remove operation key=Z18Q66VI5PDN tag=3KUQ7TWDSVSY type=del 2024-03-09T14:37:15.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.667+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~6QCB00DFP9T4.0 size=1048576 2024-03-09T14:37:15.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.667+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~6QCB00DFP9T4.1 size=1048576 2024-03-09T14:37:15.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.671+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~6QCB00DFP9T4.2 size=1030396 2024-03-09T14:37:15.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.671+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=6QCB00DFP9T4 tag=PJXUA01FUM70 type=write size=4176124 2024-03-09T14:37:15.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.671+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~WUCL11C098N4.0 size=1048576 2024-03-09T14:37:15.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.671+0000 7fd389e788c0 1 < canceled part key=_multipart_6VT4C288571G.2~WUCL11C098N4.1 size=884418 2024-03-09T14:37:15.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.675+0000 7fd389e788c0 1 < canceled multipart upload key=6VT4C288571G upload=WUCL11C098N4 tag=4A768U2YZJ6K type=write size=2981570 2024-03-09T14:37:15.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.679+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~N3LRH0WVM6QZ.0 size=1048576 2024-03-09T14:37:15.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.683+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~N3LRH0WVM6QZ.1 size=1048576 2024-03-09T14:37:15.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.683+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~N3LRH0WVM6QZ.2 size=2183 2024-03-09T14:37:15.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.683+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=N3LRH0WVM6QZ tag=2930XGXA6UBL type=write size=3147911 2024-03-09T14:37:15.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.687+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~6IVPBSL4G2VM.0 size=1048576 2024-03-09T14:37:15.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.691+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~6IVPBSL4G2VM.1 size=1048576 2024-03-09T14:37:15.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.691+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~6IVPBSL4G2VM.2 size=657697 2024-03-09T14:37:15.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.695+0000 7fd389e788c0 1 < completed multipart upload key=Z18Q66VI5PDN upload=6IVPBSL4G2VM tag=I88XF03ZQUXG type=write size=3803425 2024-03-09T14:37:15.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.699+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=N6ZCXEAM7UT9 type=del size=773146 2024-03-09T14:37:15.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.699+0000 7fd389e788c0 1 < canceled part key=_multipart_AUSZ4JUGI6UU.2~RASQXDGJZJKW.0 size=773493 2024-03-09T14:37:15.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.703+0000 7fd389e788c0 1 < canceled multipart upload key=AUSZ4JUGI6UU upload=RASQXDGJZJKW tag=Q2KU15DYKRZP type=write size=1822069 2024-03-09T14:37:15.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.707+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=IEARZH8I3VJ6 type=del size=1986295 2024-03-09T14:37:15.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.707+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=EBQ1312L0U5I type=del 2024-03-09T14:37:15.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.715+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~K0CXVGRFM7V9.0 size=1048576 2024-03-09T14:37:15.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.715+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~K0CXVGRFM7V9.1 size=379351 2024-03-09T14:37:15.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.715+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=K0CXVGRFM7V9 tag=CVC6B7SHU1G3 type=write size=2476503 2024-03-09T14:37:15.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.723+0000 7fd389e788c0 1 < suggested remove operation key=UMT7VKZ9R4IR tag=PZ0N1CSLXDEL type=del 2024-03-09T14:37:15.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.727+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~Q0E2J0CVA2GR.0 size=716799 2024-03-09T14:37:15.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.727+0000 7fd389e788c0 1 > prepared multipart upload key=DIN8WJ9Z9OI8 upload=Q0E2J0CVA2GR tag=M2H1LARW4OHZ type=write size=1765375 2024-03-09T14:37:15.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.731+0000 7fd389e788c0 1 < suggested remove operation key=SKIBISETJH7B tag=3EZQO6CXHQQ1 type=del 2024-03-09T14:37:15.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.739+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~JO75GA0FF8HB.0 size=817695 2024-03-09T14:37:15.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.739+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=JO75GA0FF8HB tag=NCWXBTXYEGBW type=write size=1866271 2024-03-09T14:37:15.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.743+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~YJ3DHCHWQV37.0 size=1048576 2024-03-09T14:37:15.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.743+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~YJ3DHCHWQV37.1 size=1048576 2024-03-09T14:37:15.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.747+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~YJ3DHCHWQV37.2 size=800113 2024-03-09T14:37:15.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.751+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=YJ3DHCHWQV37 tag=XFAG8LKQS2AY type=write size=3945841 2024-03-09T14:37:15.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.759+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=ECO41CT9LT7Q type=del size=675509 2024-03-09T14:37:15.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.759+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=UWIDQ6K1WP76 type=del 2024-03-09T14:37:15.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.763+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~Z2BGEV9YXL5X.0 size=83814 2024-03-09T14:37:15.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.763+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=Z2BGEV9YXL5X tag=9IYF1X9WPW72 type=write size=1132390 2024-03-09T14:37:15.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.767+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=JCEGUZGWKO4X type=del 2024-03-09T14:37:15.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.779+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~971PQ12AKBDQ.0 size=1048576 2024-03-09T14:37:15.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.783+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~971PQ12AKBDQ.1 size=1048576 2024-03-09T14:37:15.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.783+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~971PQ12AKBDQ.2 size=423529 2024-03-09T14:37:15.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.783+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=971PQ12AKBDQ tag=UCFSKIAX79TF type=write size=3569257 2024-03-09T14:37:15.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.787+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~27GV182UNXCT.0 size=758098 2024-03-09T14:37:15.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.787+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=27GV182UNXCT tag=LWFDOC8GXDRB type=write size=1806674 2024-03-09T14:37:15.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.791+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=MDWY459LLZDK type=del size=1301401 2024-03-09T14:37:15.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.791+0000 7fd389e788c0 1 < completed delete operation key=PKVYD8DWS7M2 tag=HX4LPSE8XF33 type=del 2024-03-09T14:37:15.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.795+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~Z81IE0PZO3M7.0 size=1048576 2024-03-09T14:37:15.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.799+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~Z81IE0PZO3M7.1 size=1048576 2024-03-09T14:37:15.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.799+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~Z81IE0PZO3M7.2 size=655496 2024-03-09T14:37:15.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.799+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=Z81IE0PZO3M7 tag=5G9OZA84TI99 type=write size=3801224 2024-03-09T14:37:15.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.799+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~3K2YJBTPGI99.0 size=1048576 2024-03-09T14:37:15.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.803+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~3K2YJBTPGI99.1 size=1048576 2024-03-09T14:37:15.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.803+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~3K2YJBTPGI99.2 size=471991 2024-03-09T14:37:15.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.807+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=3K2YJBTPGI99 tag=JBFQQUTDR2MW type=write size=3617719 2024-03-09T14:37:15.808 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.807+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=ECJXI80O1LXB type=del size=3574514 2024-03-09T14:37:15.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.811+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=9J3P0VXPHVHC type=del 2024-03-09T14:37:15.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.811+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=P00ZION642U3 type=del size=2340307 2024-03-09T14:37:15.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.815+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=O0ZGNDCOQFC2 type=del 2024-03-09T14:37:15.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.815+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~8HJK2ZFTOIJQ.0 size=1048576 2024-03-09T14:37:15.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.819+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~8HJK2ZFTOIJQ.1 size=131334 2024-03-09T14:37:15.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.819+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=8HJK2ZFTOIJQ tag=POPRIWBWO3PH type=write size=2228486 2024-03-09T14:37:15.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.819+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~EBB0RIH7VYG1.0 size=1048576 2024-03-09T14:37:15.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.823+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~EBB0RIH7VYG1.1 size=384371 2024-03-09T14:37:15.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.823+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=EBB0RIH7VYG1 tag=I3LS28ZX1R8C type=write size=2481523 2024-03-09T14:37:15.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.827+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=IWBGLYQN13LI type=del size=271377 2024-03-09T14:37:15.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.827+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~6QCB00DFP9T4.0 size=1048576 2024-03-09T14:37:15.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.831+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~6QCB00DFP9T4.1 size=1048576 2024-03-09T14:37:15.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.831+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~6QCB00DFP9T4.2 size=1030396 2024-03-09T14:37:15.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.835+0000 7fd389e788c0 1 < completed multipart upload key=CLAM83TC7RZ7 upload=6QCB00DFP9T4 tag=PJXUA01FUM70 type=write size=4176124 2024-03-09T14:37:15.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.835+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=3Z3VST8HT9GF type=del size=3193148 2024-03-09T14:37:15.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.839+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~N3LRH0WVM6QZ.0 size=1048576 2024-03-09T14:37:15.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.839+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~N3LRH0WVM6QZ.1 size=1048576 2024-03-09T14:37:15.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.839+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~N3LRH0WVM6QZ.2 size=2183 2024-03-09T14:37:15.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.843+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=N3LRH0WVM6QZ tag=2930XGXA6UBL type=write size=3147911 2024-03-09T14:37:15.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.847+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=GWCE6JBWN30S type=del size=1164652 2024-03-09T14:37:15.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.847+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=N6ZCXEAM7UT9 type=del 2024-03-09T14:37:15.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.847+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=O8KX4HNSMSR9 type=del size=3594447 2024-03-09T14:37:15.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.851+0000 7fd389e788c0 1 < suggested update operation key=SKIBISETJH7B tag=IEARZH8I3VJ6 type=del size=1986295 2024-03-09T14:37:15.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.855+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=2AHKEY5UO8OO type=del size=454616 2024-03-09T14:37:15.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.855+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~K0CXVGRFM7V9.0 size=1048576 2024-03-09T14:37:15.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.859+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~K0CXVGRFM7V9.1 size=379351 2024-03-09T14:37:15.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.859+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=K0CXVGRFM7V9 tag=CVC6B7SHU1G3 type=write size=2476503 2024-03-09T14:37:15.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.863+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=Y0M9HMNK4ZBT type=del size=3470059 2024-03-09T14:37:15.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.863+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~Q0E2J0CVA2GR.0 size=716799 2024-03-09T14:37:15.868 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.867+0000 7fd389e788c0 1 < completed multipart upload key=DIN8WJ9Z9OI8 upload=Q0E2J0CVA2GR tag=M2H1LARW4OHZ type=write size=1765375 2024-03-09T14:37:15.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.871+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=DY93TFQO43VM type=write size=354930 2024-03-09T14:37:15.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.871+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~JO75GA0FF8HB.0 size=817695 2024-03-09T14:37:15.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.879+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=JO75GA0FF8HB tag=NCWXBTXYEGBW type=write size=1866271 2024-03-09T14:37:15.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.883+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~RGAHYMHW5H9S.0 size=1048576 2024-03-09T14:37:15.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.883+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~RGAHYMHW5H9S.1 size=1048576 2024-03-09T14:37:15.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.887+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~RGAHYMHW5H9S.2 size=815943 2024-03-09T14:37:15.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.887+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=RGAHYMHW5H9S tag=CS6YLWL8BJW1 type=write size=3961671 2024-03-09T14:37:15.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.887+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=ECO41CT9LT7Q type=del 2024-03-09T14:37:15.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.895+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~TIX5Q5FMEWSD.0 size=662850 2024-03-09T14:37:15.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.895+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=TIX5Q5FMEWSD tag=BYCZ264CL2NX type=write size=1711426 2024-03-09T14:37:15.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.895+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~Z2BGEV9YXL5X.0 size=83814 2024-03-09T14:37:15.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.899+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=Z2BGEV9YXL5X tag=9IYF1X9WPW72 type=write size=1132390 2024-03-09T14:37:15.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.899+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=A9HRF47AE5VJ type=del size=4161769 2024-03-09T14:37:15.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.903+0000 7fd389e788c0 1 < canceled part key=_multipart_8J6Z9DT07H0X.2~971PQ12AKBDQ.0 size=1048576 2024-03-09T14:37:15.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.903+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~971PQ12AKBDQ.1 size=1048576 2024-03-09T14:37:15.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.903+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~971PQ12AKBDQ.2 size=423529 2024-03-09T14:37:15.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.907+0000 7fd389e788c0 1 < canceled multipart upload key=8J6Z9DT07H0X upload=971PQ12AKBDQ tag=UCFSKIAX79TF type=write size=3569257 2024-03-09T14:37:15.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.911+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~FHUNEWADS0ZM.0 size=329830 2024-03-09T14:37:15.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.911+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=FHUNEWADS0ZM tag=GQE2JLHZVDC6 type=write size=1378406 2024-03-09T14:37:15.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.915+0000 7fd389e788c0 -1 < failed to complete operation key=SKIBISETJH7B tag=MDWY459LLZDK type=del size=1301401: (22) Invalid argument 2024-03-09T14:37:15.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.915+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=EWMNE3QJX7D6 type=del size=2781184 2024-03-09T14:37:15.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.919+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~Z81IE0PZO3M7.0 size=1048576 2024-03-09T14:37:15.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.919+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~Z81IE0PZO3M7.1 size=1048576 2024-03-09T14:37:15.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.919+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~Z81IE0PZO3M7.2 size=655496 2024-03-09T14:37:15.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.923+0000 7fd389e788c0 1 < completed multipart upload key=71692MJQITX3 upload=Z81IE0PZO3M7 tag=5G9OZA84TI99 type=write size=3801224 2024-03-09T14:37:15.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.927+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~9RZY6ZTWAR0K.0 size=1048576 2024-03-09T14:37:15.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.927+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~9RZY6ZTWAR0K.1 size=545082 2024-03-09T14:37:15.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.927+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=9RZY6ZTWAR0K tag=KTKBAFQJ8MZB type=write size=2642234 2024-03-09T14:37:15.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.931+0000 7fd389e788c0 1 < canceled operation key=Z18Q66VI5PDN tag=ECJXI80O1LXB type=del size=3574514 2024-03-09T14:37:15.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.935+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~QEIH2ATNZUHO.0 size=1048576 2024-03-09T14:37:15.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.935+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~QEIH2ATNZUHO.1 size=354009 2024-03-09T14:37:15.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.935+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=QEIH2ATNZUHO tag=3T4ACOE96XCC type=write size=2451161 2024-03-09T14:37:15.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.935+0000 7fd389e788c0 1 < completed delete operation key=E2VP0TJ37UX8 tag=P00ZION642U3 type=del 2024-03-09T14:37:15.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.939+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~UR4JN26ZPQG3.0 size=1048576 2024-03-09T14:37:15.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.943+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~UR4JN26ZPQG3.1 size=849640 2024-03-09T14:37:15.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.943+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=UR4JN26ZPQG3 tag=I880QQNACASL type=write size=2946792 2024-03-09T14:37:15.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.943+0000 7fd389e788c0 1 < canceled part key=_multipart_Y7E2TLASJM9T.2~8HJK2ZFTOIJQ.0 size=1048576 2024-03-09T14:37:15.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.943+0000 7fd389e788c0 1 < canceled part key=_multipart_Y7E2TLASJM9T.2~8HJK2ZFTOIJQ.1 size=131334 2024-03-09T14:37:15.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.943+0000 7fd389e788c0 1 < canceled multipart upload key=Y7E2TLASJM9T upload=8HJK2ZFTOIJQ tag=POPRIWBWO3PH type=write size=2228486 2024-03-09T14:37:15.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.947+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~WEPU4CGJHUR1.0 size=1048576 2024-03-09T14:37:15.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.951+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~WEPU4CGJHUR1.1 size=48140 2024-03-09T14:37:15.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.951+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=WEPU4CGJHUR1 tag=2NHJSB8ONMVC type=write size=2145292 2024-03-09T14:37:15.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.951+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=IWBGLYQN13LI type=del 2024-03-09T14:37:15.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.955+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=IG7NCRBO2ZLR type=del size=1808649 2024-03-09T14:37:15.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.955+0000 7fd389e788c0 1 < suggested remove operation key=FY02AR9GS3KG tag=3Z3VST8HT9GF type=del 2024-03-09T14:37:15.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.959+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=NIS2QM0CZBXT type=write size=595241 2024-03-09T14:37:15.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.959+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=GWCE6JBWN30S type=del 2024-03-09T14:37:15.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.963+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~WCU38U3G7GZD.0 size=1048576 2024-03-09T14:37:15.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.967+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~WCU38U3G7GZD.1 size=1048576 2024-03-09T14:37:15.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.967+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~WCU38U3G7GZD.2 size=782780 2024-03-09T14:37:15.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.967+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=WCU38U3G7GZD tag=3BGLVL9S6X49 type=write size=3928508 2024-03-09T14:37:15.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.971+0000 7fd389e788c0 1 < suggested update operation key=2405Y4I2Q8TY tag=O8KX4HNSMSR9 type=del size=3594447 2024-03-09T14:37:15.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.975+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=3D9Y7WKEJX3H type=del size=1209 2024-03-09T14:37:15.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.979+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=2AHKEY5UO8OO type=del 2024-03-09T14:37:15.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.983+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~3MWVL6A0A8MX.0 size=649978 2024-03-09T14:37:15.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.983+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=3MWVL6A0A8MX tag=A62INJ5MY5JG type=write size=1698554 2024-03-09T14:37:15.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.987+0000 7fd389e788c0 -1 < failed to complete operation key=2405Y4I2Q8TY tag=Y0M9HMNK4ZBT type=del size=3470059: (22) Invalid argument 2024-03-09T14:37:15.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.987+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=RWJNZ9CH370D type=del size=2065150 2024-03-09T14:37:15.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.991+0000 7fd389e788c0 -1 < no bi entry to suggest for operation key=FY02AR9GS3KG tag=DY93TFQO43VM type=write size=354930: (2) No such file or directory 2024-03-09T14:37:15.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.995+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~EAWQIAIR67M1.0 size=1048576 2024-03-09T14:37:15.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.995+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~EAWQIAIR67M1.1 size=56873 2024-03-09T14:37:15.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.995+0000 7fd389e788c0 1 > prepared multipart upload key=GSNWWDS63MTA upload=EAWQIAIR67M1 tag=IGYDWLX4PGUA type=write size=2154025 2024-03-09T14:37:16.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:15.999+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~RGAHYMHW5H9S.0 size=1048576 2024-03-09T14:37:16.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.003+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~RGAHYMHW5H9S.1 size=1048576 2024-03-09T14:37:16.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.003+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~RGAHYMHW5H9S.2 size=815943 2024-03-09T14:37:16.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.007+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=RGAHYMHW5H9S tag=CS6YLWL8BJW1 type=write size=3961671 2024-03-09T14:37:16.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.011+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=D9TB1QPHE5X2 type=del size=1615478 2024-03-09T14:37:16.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.011+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~TIX5Q5FMEWSD.0 size=662850 2024-03-09T14:37:16.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.015+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=TIX5Q5FMEWSD tag=BYCZ264CL2NX type=write size=1711426 2024-03-09T14:37:16.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.019+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=OFF3FZEHNMNV type=del size=1906295 2024-03-09T14:37:16.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.019+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=A9HRF47AE5VJ type=del 2024-03-09T14:37:16.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.023+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=HR99I3R4707P type=del size=668955 2024-03-09T14:37:16.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.027+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~FHUNEWADS0ZM.0 size=329830 2024-03-09T14:37:16.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.031+0000 7fd389e788c0 1 < completed multipart upload key=8J6Z9DT07H0X upload=FHUNEWADS0ZM tag=GQE2JLHZVDC6 type=write size=1378406 2024-03-09T14:37:16.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.035+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~Z50YU7759VFD.0 size=1048576 2024-03-09T14:37:16.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.035+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~Z50YU7759VFD.1 size=1048576 2024-03-09T14:37:16.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.035+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~Z50YU7759VFD.2 size=673296 2024-03-09T14:37:16.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.035+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=Z50YU7759VFD tag=BQXL9AD9BY8Z type=write size=3819024 2024-03-09T14:37:16.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.039+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=EWMNE3QJX7D6 type=del 2024-03-09T14:37:16.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.043+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~15ZEGYBTBYDL.0 size=1048576 2024-03-09T14:37:16.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.043+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~15ZEGYBTBYDL.1 size=1048576 2024-03-09T14:37:16.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.047+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~15ZEGYBTBYDL.2 size=1009451 2024-03-09T14:37:16.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.047+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=15ZEGYBTBYDL tag=FY3TTV3XK6Q2 type=write size=4155179 2024-03-09T14:37:16.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.051+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~9RZY6ZTWAR0K.0 size=1048576 2024-03-09T14:37:16.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.051+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~9RZY6ZTWAR0K.1 size=545082 2024-03-09T14:37:16.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.055+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=9RZY6ZTWAR0K tag=KTKBAFQJ8MZB type=write size=2642234 2024-03-09T14:37:16.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.059+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=4QMKQ76PY316 type=del size=2972148 2024-03-09T14:37:16.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.059+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~QEIH2ATNZUHO.0 size=1048576 2024-03-09T14:37:16.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.063+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~QEIH2ATNZUHO.1 size=354009 2024-03-09T14:37:16.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.067+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=QEIH2ATNZUHO tag=3T4ACOE96XCC type=write size=2451161 2024-03-09T14:37:16.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.067+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=TAL9NKHOLYJB type=del size=239436 2024-03-09T14:37:16.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.071+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~UR4JN26ZPQG3.0 size=1048576 2024-03-09T14:37:16.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.071+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~UR4JN26ZPQG3.1 size=849640 2024-03-09T14:37:16.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.079+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=UR4JN26ZPQG3 tag=I880QQNACASL type=write size=2946792 2024-03-09T14:37:16.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.083+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=RNHA08X5TZLQ type=write size=546552 2024-03-09T14:37:16.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.087+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~WEPU4CGJHUR1.0 size=1048576 2024-03-09T14:37:16.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.091+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~WEPU4CGJHUR1.1 size=48140 2024-03-09T14:37:16.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.095+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=WEPU4CGJHUR1 tag=2NHJSB8ONMVC type=write size=2145292 2024-03-09T14:37:16.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.099+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~RW2Q10EIN40E.0 size=1048576 2024-03-09T14:37:16.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.099+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~RW2Q10EIN40E.1 size=1048576 2024-03-09T14:37:16.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.103+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~RW2Q10EIN40E.2 size=698553 2024-03-09T14:37:16.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.103+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=RW2Q10EIN40E tag=Y44YU9JUPKQW type=write size=3844281 2024-03-09T14:37:16.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.103+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=IG7NCRBO2ZLR type=del 2024-03-09T14:37:16.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.107+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~RO07B7VJS232.0 size=1048576 2024-03-09T14:37:16.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.111+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~RO07B7VJS232.1 size=959179 2024-03-09T14:37:16.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.111+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=RO07B7VJS232 tag=AV70L2H7SU0N type=write size=3056331 2024-03-09T14:37:16.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.115+0000 7fd389e788c0 1 < suggested update operation key=P83H9137MI7Y tag=NIS2QM0CZBXT type=write size=595241 2024-03-09T14:37:16.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.115+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=Q5GTG2Y31UUH type=del size=1389974 2024-03-09T14:37:16.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.119+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~WCU38U3G7GZD.0 size=1048576 2024-03-09T14:37:16.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.119+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~WCU38U3G7GZD.1 size=1048576 2024-03-09T14:37:16.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.123+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~WCU38U3G7GZD.2 size=782780 2024-03-09T14:37:16.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.127+0000 7fd389e788c0 1 < completed multipart upload key=CLAM83TC7RZ7 upload=WCU38U3G7GZD tag=3BGLVL9S6X49 type=write size=3928508 2024-03-09T14:37:16.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.131+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~GLH2Q8KISI15.0 size=861097 2024-03-09T14:37:16.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.131+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=GLH2Q8KISI15 tag=C5WV4YDRQQ3A type=write size=1909673 2024-03-09T14:37:16.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.131+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=3D9Y7WKEJX3H type=del 2024-03-09T14:37:16.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.135+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=ID4VTZ2H3317 type=del size=1774864 2024-03-09T14:37:16.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.135+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~3MWVL6A0A8MX.0 size=649978 2024-03-09T14:37:16.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.139+0000 7fd389e788c0 1 < completed multipart upload key=71692MJQITX3 upload=3MWVL6A0A8MX tag=A62INJ5MY5JG type=write size=1698554 2024-03-09T14:37:16.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.143+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=WOKLTEJHILZ9 type=del size=3414954 2024-03-09T14:37:16.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.147+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=RWJNZ9CH370D type=del 2024-03-09T14:37:16.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.147+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=I5GTTEEQJWYK type=del size=3310178 2024-03-09T14:37:16.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.151+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~EAWQIAIR67M1.0 size=1048576 2024-03-09T14:37:16.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.151+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~EAWQIAIR67M1.1 size=56873 2024-03-09T14:37:16.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.155+0000 7fd389e788c0 1 < completed multipart upload key=GSNWWDS63MTA upload=EAWQIAIR67M1 tag=IGYDWLX4PGUA type=write size=2154025 2024-03-09T14:37:16.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.159+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=YG5V2AW8WQ4X type=del size=2908467 2024-03-09T14:37:16.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.159+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=D9TB1QPHE5X2 type=del 2024-03-09T14:37:16.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.163+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=HY67K7X101GR type=del size=786499 2024-03-09T14:37:16.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.163+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=OFF3FZEHNMNV type=del 2024-03-09T14:37:16.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.167+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=M051OALNJWCF type=del size=1324444 2024-03-09T14:37:16.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.167+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=HR99I3R4707P type=del 2024-03-09T14:37:16.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.171+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=XXRRVSSOU0HL type=del size=1091520 2024-03-09T14:37:16.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.175+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~Z50YU7759VFD.0 size=1048576 2024-03-09T14:37:16.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.175+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~Z50YU7759VFD.1 size=1048576 2024-03-09T14:37:16.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.175+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~Z50YU7759VFD.2 size=673296 2024-03-09T14:37:16.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.179+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=Z50YU7759VFD tag=BQXL9AD9BY8Z type=write size=3819024 2024-03-09T14:37:16.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.183+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=1CPT9VPSOLXP type=del size=3304058 2024-03-09T14:37:16.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.187+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~15ZEGYBTBYDL.0 size=1048576 2024-03-09T14:37:16.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.187+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~15ZEGYBTBYDL.1 size=1048576 2024-03-09T14:37:16.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.191+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~15ZEGYBTBYDL.2 size=1009451 2024-03-09T14:37:16.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.195+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=15ZEGYBTBYDL tag=FY3TTV3XK6Q2 type=write size=4155179 2024-03-09T14:37:16.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.195+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=2EUOB8P9FJ0U type=del size=642948 2024-03-09T14:37:16.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.199+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=4QMKQ76PY316 type=del 2024-03-09T14:37:16.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.203+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~JFM86IPACWWK.0 size=1048576 2024-03-09T14:37:16.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.203+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~JFM86IPACWWK.1 size=1048576 2024-03-09T14:37:16.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.207+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~JFM86IPACWWK.2 size=533611 2024-03-09T14:37:16.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.207+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=JFM86IPACWWK tag=Q40GCKAU1M3F type=write size=3679339 2024-03-09T14:37:16.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.207+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=TAL9NKHOLYJB type=del 2024-03-09T14:37:16.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.211+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=MMQ0O8B8KX3C type=del size=430306 2024-03-09T14:37:16.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.215+0000 7fd389e788c0 1 < completed write operation key=44F8QXCBBENS tag=RNHA08X5TZLQ type=write size=546552 2024-03-09T14:37:16.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.215+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=EXIL0DSU48VE type=del size=1890866 2024-03-09T14:37:16.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.215+0000 7fd389e788c0 1 < canceled part key=_multipart_FLLUAY21DJ12.2~RW2Q10EIN40E.0 size=1048576 2024-03-09T14:37:16.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.219+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~RW2Q10EIN40E.1 size=1048576 2024-03-09T14:37:16.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.219+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~RW2Q10EIN40E.2 size=698553 2024-03-09T14:37:16.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.223+0000 7fd389e788c0 1 < canceled multipart upload key=FLLUAY21DJ12 upload=RW2Q10EIN40E tag=Y44YU9JUPKQW type=write size=3844281 2024-03-09T14:37:16.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.227+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~97BD8FC1EKSC.0 size=1037161 2024-03-09T14:37:16.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.227+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=97BD8FC1EKSC tag=ZJUITUGT01IB type=write size=2085737 2024-03-09T14:37:16.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.231+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~RO07B7VJS232.0 size=1048576 2024-03-09T14:37:16.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.231+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~RO07B7VJS232.1 size=959179 2024-03-09T14:37:16.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.235+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=RO07B7VJS232 tag=AV70L2H7SU0N type=write size=3056331 2024-03-09T14:37:16.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.239+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=QQ652UAQG7IF type=del size=589765 2024-03-09T14:37:16.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.243+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=Q5GTG2Y31UUH type=del 2024-03-09T14:37:16.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.247+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~WXE3I370T09E.0 size=601989 2024-03-09T14:37:16.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.247+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=WXE3I370T09E tag=VUS0EG61K6VF type=write size=1650565 2024-03-09T14:37:16.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.247+0000 7fd389e788c0 1 < canceled part key=_multipart_61RC3GUU437B.2~GLH2Q8KISI15.0 size=861097 2024-03-09T14:37:16.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.251+0000 7fd389e788c0 1 < canceled multipart upload key=61RC3GUU437B upload=GLH2Q8KISI15 tag=C5WV4YDRQQ3A type=write size=1909673 2024-03-09T14:37:16.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.255+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~YC1A3UJ76P0E.0 size=1048576 2024-03-09T14:37:16.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.255+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~YC1A3UJ76P0E.1 size=1048576 2024-03-09T14:37:16.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.255+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~YC1A3UJ76P0E.2 size=368134 2024-03-09T14:37:16.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.255+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=YC1A3UJ76P0E tag=D7A37RLLBH6G type=write size=3513862 2024-03-09T14:37:16.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.259+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=ID4VTZ2H3317 type=del 2024-03-09T14:37:16.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.263+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=LBF0DQJPIY3U type=del size=455899 2024-03-09T14:37:16.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.267+0000 7fd389e788c0 1 < suggested remove operation key=1KJK6PF6U226 tag=WOKLTEJHILZ9 type=del 2024-03-09T14:37:16.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.267+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=ORV49SD0MWI3 type=del size=1241417 2024-03-09T14:37:16.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.271+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=I5GTTEEQJWYK type=del 2024-03-09T14:37:16.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.275+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~LMQDHBNHZDFF.0 size=786851 2024-03-09T14:37:16.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.275+0000 7fd389e788c0 1 > prepared multipart upload key=DIN8WJ9Z9OI8 upload=LMQDHBNHZDFF tag=X8JKLONL9GE2 type=write size=1835427 2024-03-09T14:37:16.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.279+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=YG5V2AW8WQ4X type=del 2024-03-09T14:37:16.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.283+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=Q02O20042UXI type=del size=1565328 2024-03-09T14:37:16.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.287+0000 7fd389e788c0 1 < suggested update operation key=2405Y4I2Q8TY tag=HY67K7X101GR type=del size=786499 2024-03-09T14:37:16.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.291+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=DWSO7X9Q529D type=del size=1160354 2024-03-09T14:37:16.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.291+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=M051OALNJWCF type=del 2024-03-09T14:37:16.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.295+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=N5Y3HCRD8JG7 type=del size=864 2024-03-09T14:37:16.299 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.299+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=XXRRVSSOU0HL type=del 2024-03-09T14:37:16.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.307+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=ETN3K08I8N0E type=del size=3804926 2024-03-09T14:37:16.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.307+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=1CPT9VPSOLXP type=del 2024-03-09T14:37:16.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.311+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=WHPDHF77OMRW type=del size=2785068 2024-03-09T14:37:16.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.319+0000 7fd389e788c0 1 < suggested remove operation key=FLLUAY21DJ12 tag=2EUOB8P9FJ0U type=del 2024-03-09T14:37:16.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.323+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=MD8QGCKKFM94 type=del size=2746429 2024-03-09T14:37:16.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.327+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~JFM86IPACWWK.0 size=1048576 2024-03-09T14:37:16.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.327+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~JFM86IPACWWK.1 size=1048576 2024-03-09T14:37:16.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.331+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~JFM86IPACWWK.2 size=533611 2024-03-09T14:37:16.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.335+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=JFM86IPACWWK tag=Q40GCKAU1M3F type=write size=3679339 2024-03-09T14:37:16.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.343+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~RGXRD0UDYR47.0 size=1048576 2024-03-09T14:37:16.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.343+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~RGXRD0UDYR47.1 size=760256 2024-03-09T14:37:16.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.343+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=RGXRD0UDYR47 tag=BEPIZFBO3MFG type=write size=2857408 2024-03-09T14:37:16.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.347+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=MMQ0O8B8KX3C type=del 2024-03-09T14:37:16.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.355+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~WEVSSAOFZLN6.0 size=1048576 2024-03-09T14:37:16.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.359+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~WEVSSAOFZLN6.1 size=1048576 2024-03-09T14:37:16.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.359+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~WEVSSAOFZLN6.2 size=937235 2024-03-09T14:37:16.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.359+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=WEVSSAOFZLN6 tag=HVM0VA2IYO03 type=write size=4082963 2024-03-09T14:37:16.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.363+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=EXIL0DSU48VE type=del 2024-03-09T14:37:16.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.367+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~LQNHPEOLMTJ3.0 size=266581 2024-03-09T14:37:16.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.367+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=LQNHPEOLMTJ3 tag=STXIFCED5KX7 type=write size=1315157 2024-03-09T14:37:16.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.371+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~97BD8FC1EKSC.0 size=1037161 2024-03-09T14:37:16.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.379+0000 7fd389e788c0 1 < completed multipart upload key=Y7E2TLASJM9T upload=97BD8FC1EKSC tag=ZJUITUGT01IB type=write size=2085737 2024-03-09T14:37:16.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.379+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=2D1WIJ388SNA type=del size=1415121 2024-03-09T14:37:16.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.383+0000 7fd389e788c0 -1 < failed to complete operation key=2405Y4I2Q8TY tag=QQ652UAQG7IF type=del size=589765: (22) Invalid argument 2024-03-09T14:37:16.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.387+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=MJAM5RAZIM9P type=del size=654001 2024-03-09T14:37:16.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.391+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~WXE3I370T09E.0 size=601989 2024-03-09T14:37:16.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.399+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=WXE3I370T09E tag=VUS0EG61K6VF type=write size=1650565 2024-03-09T14:37:16.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.403+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~1LPT7I45F01H.0 size=724268 2024-03-09T14:37:16.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.403+0000 7fd389e788c0 1 > prepared multipart upload key=GSNWWDS63MTA upload=1LPT7I45F01H tag=TV6T85VOOVU4 type=write size=1772844 2024-03-09T14:37:16.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.403+0000 7fd389e788c0 1 < canceled part key=_multipart_5ZEDXFB9B3CN.2~YC1A3UJ76P0E.0 size=1048576 2024-03-09T14:37:16.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.407+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~YC1A3UJ76P0E.1 size=1048576 2024-03-09T14:37:16.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.411+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~YC1A3UJ76P0E.2 size=368134 2024-03-09T14:37:16.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.415+0000 7fd389e788c0 1 < canceled multipart upload key=5ZEDXFB9B3CN upload=YC1A3UJ76P0E tag=D7A37RLLBH6G type=write size=3513862 2024-03-09T14:37:16.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.423+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~U13G3CUSUFUZ.0 size=1048576 2024-03-09T14:37:16.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.427+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~U13G3CUSUFUZ.1 size=1048576 2024-03-09T14:37:16.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.427+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~U13G3CUSUFUZ.2 size=304295 2024-03-09T14:37:16.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.427+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=U13G3CUSUFUZ tag=WWO1MYL8DE55 type=write size=3450023 2024-03-09T14:37:16.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.431+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=LBF0DQJPIY3U type=del 2024-03-09T14:37:16.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.435+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=F013AQS4PK45 type=write size=987178 2024-03-09T14:37:16.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.439+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=ORV49SD0MWI3 type=del 2024-03-09T14:37:16.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.443+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=88STMV1IIUFI type=del size=1154278 2024-03-09T14:37:16.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.447+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~LMQDHBNHZDFF.0 size=786851 2024-03-09T14:37:16.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.451+0000 7fd389e788c0 1 < completed multipart upload key=DIN8WJ9Z9OI8 upload=LMQDHBNHZDFF tag=X8JKLONL9GE2 type=write size=1835427 2024-03-09T14:37:16.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.459+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~K0JZGRX5SHS0.0 size=760264 2024-03-09T14:37:16.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.459+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=K0JZGRX5SHS0 tag=D8E504PQTVTR type=write size=1808840 2024-03-09T14:37:16.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.459+0000 7fd389e788c0 1 < canceled operation key=Z18Q66VI5PDN tag=Q02O20042UXI type=del size=1565328 2024-03-09T14:37:16.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.467+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~IVK0GGP58TSR.0 size=1048576 2024-03-09T14:37:16.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.471+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~IVK0GGP58TSR.1 size=447610 2024-03-09T14:37:16.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.471+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=IVK0GGP58TSR tag=DQZ5GI7K60MP type=write size=2544762 2024-03-09T14:37:16.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.475+0000 7fd389e788c0 1 < suggested update operation key=61RC3GUU437B tag=DWSO7X9Q529D type=del size=1160354 2024-03-09T14:37:16.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.479+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=D4CDF4JQEOTO type=write size=723785 2024-03-09T14:37:16.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.483+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=N5Y3HCRD8JG7 type=del 2024-03-09T14:37:16.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.487+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~ZU55HPFQ7U6W.0 size=1048576 2024-03-09T14:37:16.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.491+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~ZU55HPFQ7U6W.1 size=1048576 2024-03-09T14:37:16.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.495+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~ZU55HPFQ7U6W.2 size=33446 2024-03-09T14:37:16.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.495+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=ZU55HPFQ7U6W tag=ZVI6FX4T78GO type=write size=3179174 2024-03-09T14:37:16.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.495+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=ETN3K08I8N0E type=del 2024-03-09T14:37:16.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.499+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=6R3QS6239GC0 type=del size=1265260 2024-03-09T14:37:16.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.507+0000 7fd389e788c0 1 < suggested update operation key=SKIBISETJH7B tag=WHPDHF77OMRW type=del size=2785068 2024-03-09T14:37:16.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.507+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=Z4GBDOV2VMP9 type=del size=2738792 2024-03-09T14:37:16.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.515+0000 7fd389e788c0 1 < suggested update operation key=SKIBISETJH7B tag=MD8QGCKKFM94 type=del size=2746429 2024-03-09T14:37:16.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.519+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=DP2N2OW1CW57 type=del size=1578259 2024-03-09T14:37:16.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.523+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~RGXRD0UDYR47.0 size=1048576 2024-03-09T14:37:16.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.523+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~RGXRD0UDYR47.1 size=760256 2024-03-09T14:37:16.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.531+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=RGXRD0UDYR47 tag=BEPIZFBO3MFG type=write size=2857408 2024-03-09T14:37:16.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.535+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=T1NAAVH1ZM0Q type=del size=1237413 2024-03-09T14:37:16.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.539+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~WEVSSAOFZLN6.0 size=1048576 2024-03-09T14:37:16.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.539+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~WEVSSAOFZLN6.1 size=1048576 2024-03-09T14:37:16.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.543+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~WEVSSAOFZLN6.2 size=937235 2024-03-09T14:37:16.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.551+0000 7fd389e788c0 1 < completed multipart upload key=CLAM83TC7RZ7 upload=WEVSSAOFZLN6 tag=HVM0VA2IYO03 type=write size=4082963 2024-03-09T14:37:16.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.551+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=TR5ETC8IQEH8 type=del size=1849419 2024-03-09T14:37:16.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.555+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~LQNHPEOLMTJ3.0 size=266581 2024-03-09T14:37:16.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.563+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=LQNHPEOLMTJ3 tag=STXIFCED5KX7 type=write size=1315157 2024-03-09T14:37:16.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.563+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=35QR6FO51C7O type=del size=1372811 2024-03-09T14:37:16.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.571+0000 7fd389e788c0 1 < suggested remove operation key=44F8QXCBBENS tag=2D1WIJ388SNA type=del 2024-03-09T14:37:16.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.575+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=Z4F1YUDRPGJC type=write size=638112 2024-03-09T14:37:16.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.579+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=MJAM5RAZIM9P type=del 2024-03-09T14:37:16.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.583+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~BH63UUI1NIDF.0 size=1048576 2024-03-09T14:37:16.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.587+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~BH63UUI1NIDF.1 size=748384 2024-03-09T14:37:16.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.587+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=BH63UUI1NIDF tag=ANZ2UBNC45FK type=write size=2845536 2024-03-09T14:37:16.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.587+0000 7fd389e788c0 1 < canceled part key=_multipart_GSNWWDS63MTA.2~1LPT7I45F01H.0 size=724268 2024-03-09T14:37:16.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.591+0000 7fd389e788c0 1 < canceled multipart upload key=GSNWWDS63MTA upload=1LPT7I45F01H tag=TV6T85VOOVU4 type=write size=1772844 2024-03-09T14:37:16.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.599+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~ZSE3Y10C3AJY.0 size=1048576 2024-03-09T14:37:16.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.603+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~ZSE3Y10C3AJY.1 size=1048576 2024-03-09T14:37:16.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.603+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~ZSE3Y10C3AJY.2 size=665197 2024-03-09T14:37:16.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.603+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=ZSE3Y10C3AJY tag=XH7CC5OR3J1D type=write size=3810925 2024-03-09T14:37:16.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.607+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~U13G3CUSUFUZ.0 size=1048576 2024-03-09T14:37:16.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.611+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~U13G3CUSUFUZ.1 size=1048576 2024-03-09T14:37:16.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.619+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~U13G3CUSUFUZ.2 size=304295 2024-03-09T14:37:16.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.623+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=U13G3CUSUFUZ tag=WWO1MYL8DE55 type=write size=3450023 2024-03-09T14:37:16.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.627+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~9W176RC6I5DJ.0 size=1048576 2024-03-09T14:37:16.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.631+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~9W176RC6I5DJ.1 size=1048576 2024-03-09T14:37:16.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.635+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~9W176RC6I5DJ.2 size=122761 2024-03-09T14:37:16.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.635+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=9W176RC6I5DJ tag=VRRFM4XZBXBV type=write size=3268489 2024-03-09T14:37:16.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.635+0000 7fd389e788c0 1 < completed write operation key=FLLUAY21DJ12 tag=F013AQS4PK45 type=write size=987178 2024-03-09T14:37:16.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.639+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=Z3YX9PDATBM3 type=del size=3880174 2024-03-09T14:37:16.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.643+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=88STMV1IIUFI type=del 2024-03-09T14:37:16.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.647+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~2Z669A8ZQM86.0 size=694290 2024-03-09T14:37:16.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.647+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=2Z669A8ZQM86 tag=3ST4CDB09VJ6 type=write size=1742866 2024-03-09T14:37:16.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.651+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~K0JZGRX5SHS0.0 size=760264 2024-03-09T14:37:16.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.655+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=K0JZGRX5SHS0 tag=D8E504PQTVTR type=write size=1808840 2024-03-09T14:37:16.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.659+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=KO6YM4JPK79X type=del size=2691729 2024-03-09T14:37:16.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.663+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~IVK0GGP58TSR.0 size=1048576 2024-03-09T14:37:16.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.663+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~IVK0GGP58TSR.1 size=447610 2024-03-09T14:37:16.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.671+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=IVK0GGP58TSR tag=DQZ5GI7K60MP type=write size=2544762 2024-03-09T14:37:16.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.675+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=CDGRJE9W3W11 type=del size=3561745 2024-03-09T14:37:16.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.675+0000 7fd389e788c0 -1 < failed to complete operation key=44F8QXCBBENS tag=D4CDF4JQEOTO type=write size=723785: (22) Invalid argument 2024-03-09T14:37:16.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.679+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=142R9683YZ9N type=del size=929849 2024-03-09T14:37:16.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.683+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~ZU55HPFQ7U6W.0 size=1048576 2024-03-09T14:37:16.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.683+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~ZU55HPFQ7U6W.1 size=1048576 2024-03-09T14:37:16.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.687+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~ZU55HPFQ7U6W.2 size=33446 2024-03-09T14:37:16.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.691+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=ZU55HPFQ7U6W tag=ZVI6FX4T78GO type=write size=3179174 2024-03-09T14:37:16.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.695+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=W5G0DX24TTT9 type=del size=182694 2024-03-09T14:37:16.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.699+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=6R3QS6239GC0 type=del 2024-03-09T14:37:16.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.699+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=ZMK625SXVUQH type=del size=2443031 2024-03-09T14:37:16.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.703+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=Z4GBDOV2VMP9 type=del 2024-03-09T14:37:16.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.707+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~2BCNWIXBRF54.0 size=1048576 2024-03-09T14:37:16.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.711+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~2BCNWIXBRF54.1 size=775004 2024-03-09T14:37:16.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.711+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=2BCNWIXBRF54 tag=DGYLVTEXC6KD type=write size=2872156 2024-03-09T14:37:16.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.715+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=DP2N2OW1CW57 type=del 2024-03-09T14:37:16.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.719+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~AYMQAQEUU7UI.0 size=1048576 2024-03-09T14:37:16.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.723+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~AYMQAQEUU7UI.1 size=1048576 2024-03-09T14:37:16.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.723+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~AYMQAQEUU7UI.2 size=446541 2024-03-09T14:37:16.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.723+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=AYMQAQEUU7UI tag=6YGSBOWP6RM3 type=write size=3592269 2024-03-09T14:37:16.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.727+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=T1NAAVH1ZM0Q type=del 2024-03-09T14:37:16.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.731+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=QH6O43OVZI90 type=del size=2812080 2024-03-09T14:37:16.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.735+0000 7fd389e788c0 1 < suggested remove operation key=P83H9137MI7Y tag=TR5ETC8IQEH8 type=del 2024-03-09T14:37:16.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.739+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=PBJKRDZR6XBQ type=del size=2101358 2024-03-09T14:37:16.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.743+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=35QR6FO51C7O type=del 2024-03-09T14:37:16.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.743+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=HWYONMYAVUFO type=del size=813245 2024-03-09T14:37:16.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.747+0000 7fd389e788c0 1 < completed write operation key=UMT7VKZ9R4IR tag=Z4F1YUDRPGJC type=write size=638112 2024-03-09T14:37:16.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.751+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=F06RTKOGNQG1 type=del size=31478 2024-03-09T14:37:16.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.755+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~BH63UUI1NIDF.0 size=1048576 2024-03-09T14:37:16.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.759+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~BH63UUI1NIDF.1 size=748384 2024-03-09T14:37:16.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.763+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=BH63UUI1NIDF tag=ANZ2UBNC45FK type=write size=2845536 2024-03-09T14:37:16.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.763+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=VPBLU68H6GKQ type=del size=3479932 2024-03-09T14:37:16.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.767+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~ZSE3Y10C3AJY.0 size=1048576 2024-03-09T14:37:16.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.771+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~ZSE3Y10C3AJY.1 size=1048576 2024-03-09T14:37:16.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.771+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~ZSE3Y10C3AJY.2 size=665197 2024-03-09T14:37:16.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.775+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=ZSE3Y10C3AJY tag=XH7CC5OR3J1D type=write size=3810925 2024-03-09T14:37:16.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.779+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=T26IP9SQF84P type=del size=317825 2024-03-09T14:37:16.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.779+0000 7fd389e788c0 1 < canceled part key=_multipart_FLLUAY21DJ12.2~9W176RC6I5DJ.0 size=1048576 2024-03-09T14:37:16.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.783+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~9W176RC6I5DJ.1 size=1048576 2024-03-09T14:37:16.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.783+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~9W176RC6I5DJ.2 size=122761 2024-03-09T14:37:16.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.787+0000 7fd389e788c0 1 < canceled multipart upload key=FLLUAY21DJ12 upload=9W176RC6I5DJ tag=VRRFM4XZBXBV type=write size=3268489 2024-03-09T14:37:16.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.791+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=1AGCZSCCRQ9T type=del size=3649968 2024-03-09T14:37:16.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.795+0000 7fd389e788c0 1 < suggested remove operation key=44F8QXCBBENS tag=Z3YX9PDATBM3 type=del 2024-03-09T14:37:16.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.799+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=ATH99ZGMJNX3 type=del size=834869 2024-03-09T14:37:16.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.803+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~2Z669A8ZQM86.0 size=694290 2024-03-09T14:37:16.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.807+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=2Z669A8ZQM86 tag=3ST4CDB09VJ6 type=write size=1742866 2024-03-09T14:37:16.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.811+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=HE6TT9IPPJ3G type=del size=1815339 2024-03-09T14:37:16.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.815+0000 7fd389e788c0 1 < canceled operation key=MHT268M7S2TY tag=KO6YM4JPK79X type=del size=2691729 2024-03-09T14:37:16.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.815+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=07Y9RJVH8SHY type=del size=701988 2024-03-09T14:37:16.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.819+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=CDGRJE9W3W11 type=del 2024-03-09T14:37:16.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.823+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~X303M4VFCVNP.0 size=1048576 2024-03-09T14:37:16.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.827+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~X303M4VFCVNP.1 size=1048576 2024-03-09T14:37:16.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.827+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~X303M4VFCVNP.2 size=520166 2024-03-09T14:37:16.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.827+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=X303M4VFCVNP tag=Q3NAXD5C0P26 type=write size=3665894 2024-03-09T14:37:16.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.831+0000 7fd389e788c0 1 < completed delete operation key=YR2VX4QLOCOG tag=142R9683YZ9N type=del 2024-03-09T14:37:16.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.835+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=FU9JI9D6ISO8 type=del size=3770309 2024-03-09T14:37:16.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.839+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=W5G0DX24TTT9 type=del 2024-03-09T14:37:16.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.843+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=88E6JW51GCLZ type=write size=623326 2024-03-09T14:37:16.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.843+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=ZMK625SXVUQH type=del 2024-03-09T14:37:16.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.847+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=2AW47ZY61ZCH type=del size=452841 2024-03-09T14:37:16.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.847+0000 7fd389e788c0 1 < canceled part key=_multipart_1KJK6PF6U226.2~2BCNWIXBRF54.0 size=1048576 2024-03-09T14:37:16.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.851+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~2BCNWIXBRF54.1 size=775004 2024-03-09T14:37:16.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.855+0000 7fd389e788c0 1 < canceled multipart upload key=1KJK6PF6U226 upload=2BCNWIXBRF54 tag=DGYLVTEXC6KD type=write size=2872156 2024-03-09T14:37:16.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.859+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=W8WR67A0A5VC type=del size=223014 2024-03-09T14:37:16.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.859+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~AYMQAQEUU7UI.0 size=1048576 2024-03-09T14:37:16.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.863+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~AYMQAQEUU7UI.1 size=1048576 2024-03-09T14:37:16.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.867+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~AYMQAQEUU7UI.2 size=446541 2024-03-09T14:37:16.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.871+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=AYMQAQEUU7UI tag=6YGSBOWP6RM3 type=write size=3592269 2024-03-09T14:37:16.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.875+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=1S1TNEO5X0CK type=del size=2135521 2024-03-09T14:37:16.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.879+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=QH6O43OVZI90 type=del 2024-03-09T14:37:16.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.883+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~QZEQ0BX57N14.0 size=1048576 2024-03-09T14:37:16.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.887+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~QZEQ0BX57N14.1 size=205422 2024-03-09T14:37:16.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.887+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=QZEQ0BX57N14 tag=7QPTR42TZLW1 type=write size=2302574 2024-03-09T14:37:16.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.891+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=PBJKRDZR6XBQ type=del 2024-03-09T14:37:16.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.895+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=NX9LHSXHN13Z type=write size=995502 2024-03-09T14:37:16.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.903+0000 7fd389e788c0 1 < suggested remove operation key=E2VP0TJ37UX8 tag=HWYONMYAVUFO type=del 2024-03-09T14:37:16.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.907+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~JOMQD8CQUXQX.0 size=1048576 2024-03-09T14:37:16.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.911+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~JOMQD8CQUXQX.1 size=589693 2024-03-09T14:37:16.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.911+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=JOMQD8CQUXQX tag=76PFBY0EE12W type=write size=2686845 2024-03-09T14:37:16.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.915+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=F06RTKOGNQG1 type=del 2024-03-09T14:37:16.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.923+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~4Q623H7KWW28.0 size=1048576 2024-03-09T14:37:16.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.923+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~4Q623H7KWW28.1 size=82277 2024-03-09T14:37:16.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.923+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=4Q623H7KWW28 tag=FLYWERTAJ9XY type=write size=2179429 2024-03-09T14:37:16.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.931+0000 7fd389e788c0 1 < suggested update operation key=U8P5Q3D11MM6 tag=VPBLU68H6GKQ type=del size=3479932 2024-03-09T14:37:16.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.935+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~UYAWPO71HCX2.0 size=1048576 2024-03-09T14:37:16.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.939+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~UYAWPO71HCX2.1 size=754615 2024-03-09T14:37:16.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.939+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=UYAWPO71HCX2 tag=MFV3QNXVW38X type=write size=2851767 2024-03-09T14:37:16.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.943+0000 7fd389e788c0 -1 < failed to complete operation key=U8P5Q3D11MM6 tag=T26IP9SQF84P type=del size=317825: (22) Invalid argument 2024-03-09T14:37:16.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.947+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~2XF7BE7A547E.0 size=1048576 2024-03-09T14:37:16.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.951+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~2XF7BE7A547E.1 size=1048576 2024-03-09T14:37:16.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.955+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~2XF7BE7A547E.2 size=1037005 2024-03-09T14:37:16.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.955+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=2XF7BE7A547E tag=P40AFMH4Z1VP type=write size=4182733 2024-03-09T14:37:16.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.955+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=1AGCZSCCRQ9T type=del 2024-03-09T14:37:16.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.959+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=CEN738CE7FQF type=del size=296543 2024-03-09T14:37:16.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.963+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=ATH99ZGMJNX3 type=del 2024-03-09T14:37:16.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.967+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~C4DMXUZSYCUQ.0 size=48639 2024-03-09T14:37:16.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.967+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=C4DMXUZSYCUQ tag=KTZD5DD0J6C0 type=write size=1097215 2024-03-09T14:37:16.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.971+0000 7fd389e788c0 1 < canceled operation key=5ZEDXFB9B3CN tag=HE6TT9IPPJ3G type=del size=1815339 2024-03-09T14:37:16.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.975+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~D3H3270WK5SH.0 size=1048576 2024-03-09T14:37:16.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.975+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~D3H3270WK5SH.1 size=1048576 2024-03-09T14:37:16.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.979+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~D3H3270WK5SH.2 size=422937 2024-03-09T14:37:16.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.979+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=D3H3270WK5SH tag=NODY8O1YMEXO type=write size=3568665 2024-03-09T14:37:16.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.979+0000 7fd389e788c0 1 < canceled operation key=SVTMMQ2QR603 tag=07Y9RJVH8SHY type=del size=701988 2024-03-09T14:37:16.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.987+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~3Y04K9RV1XPY.0 size=712310 2024-03-09T14:37:16.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.987+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=3Y04K9RV1XPY tag=UG0P1GQ7ULX7 type=write size=1760886 2024-03-09T14:37:16.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.987+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~X303M4VFCVNP.0 size=1048576 2024-03-09T14:37:16.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.991+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~X303M4VFCVNP.1 size=1048576 2024-03-09T14:37:16.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.995+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~X303M4VFCVNP.2 size=520166 2024-03-09T14:37:16.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.999+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=X303M4VFCVNP tag=Q3NAXD5C0P26 type=write size=3665894 2024-03-09T14:37:17.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:16.999+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=60UKGSX4WDAK type=del size=4034963 2024-03-09T14:37:17.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.003+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=FU9JI9D6ISO8 type=del 2024-03-09T14:37:17.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.003+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=3B0W10O4YVG8 type=del size=3722019 2024-03-09T14:37:17.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.007+0000 7fd389e788c0 1 < completed write operation key=Z18Q66VI5PDN tag=88E6JW51GCLZ type=write size=623326 2024-03-09T14:37:17.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.011+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~8OFVPHAAQ1ED.0 size=767556 2024-03-09T14:37:17.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.011+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=8OFVPHAAQ1ED tag=KJKTYG5NBEE4 type=write size=1816132 2024-03-09T14:37:17.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.015+0000 7fd389e788c0 1 < suggested remove operation key=K9X2N6V8R4BY tag=2AW47ZY61ZCH type=del 2024-03-09T14:37:17.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.019+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=6WNEZZUQ1C0N type=del size=51634 2024-03-09T14:37:17.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.023+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=W8WR67A0A5VC type=del 2024-03-09T14:37:17.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.023+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=OTUXE6OOATXS type=del size=2911435 2024-03-09T14:37:17.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.027+0000 7fd389e788c0 -1 < failed to complete operation key=K9X2N6V8R4BY tag=1S1TNEO5X0CK type=del size=2135521: (22) Invalid argument 2024-03-09T14:37:17.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.031+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=1L3ZKLYT5J6R type=del size=381608 2024-03-09T14:37:17.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.031+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~QZEQ0BX57N14.0 size=1048576 2024-03-09T14:37:17.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.035+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~QZEQ0BX57N14.1 size=205422 2024-03-09T14:37:17.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.039+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=QZEQ0BX57N14 tag=7QPTR42TZLW1 type=write size=2302574 2024-03-09T14:37:17.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.043+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=I80QQXZQ4AZL type=del size=3955965 2024-03-09T14:37:17.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.043+0000 7fd389e788c0 1 < completed write operation key=DIN8WJ9Z9OI8 tag=NX9LHSXHN13Z type=write size=995502 2024-03-09T14:37:17.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.051+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~I8CY56X3YTOJ.0 size=1048576 2024-03-09T14:37:17.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.051+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~I8CY56X3YTOJ.1 size=1048576 2024-03-09T14:37:17.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.055+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~I8CY56X3YTOJ.2 size=892685 2024-03-09T14:37:17.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.055+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=I8CY56X3YTOJ tag=UX83KHQ3O9Q7 type=write size=4038413 2024-03-09T14:37:17.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.055+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~JOMQD8CQUXQX.0 size=1048576 2024-03-09T14:37:17.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.059+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~JOMQD8CQUXQX.1 size=589693 2024-03-09T14:37:17.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.063+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=JOMQD8CQUXQX tag=76PFBY0EE12W type=write size=2686845 2024-03-09T14:37:17.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.071+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~V51LG8PUYUIN.0 size=1048576 2024-03-09T14:37:17.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.071+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~V51LG8PUYUIN.1 size=436569 2024-03-09T14:37:17.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.071+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=V51LG8PUYUIN tag=2W913SSE184W type=write size=2533721 2024-03-09T14:37:17.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.075+0000 7fd389e788c0 1 < canceled part key=_multipart_44F8QXCBBENS.2~4Q623H7KWW28.0 size=1048576 2024-03-09T14:37:17.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.075+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~4Q623H7KWW28.1 size=82277 2024-03-09T14:37:17.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.079+0000 7fd389e788c0 1 < canceled multipart upload key=44F8QXCBBENS upload=4Q623H7KWW28 tag=FLYWERTAJ9XY type=write size=2179429 2024-03-09T14:37:17.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.083+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=MLJEFWFIFCP6 type=del size=2550300 2024-03-09T14:37:17.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.087+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~UYAWPO71HCX2.0 size=1048576 2024-03-09T14:37:17.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.091+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~UYAWPO71HCX2.1 size=754615 2024-03-09T14:37:17.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.095+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=UYAWPO71HCX2 tag=MFV3QNXVW38X type=write size=2851767 2024-03-09T14:37:17.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.099+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=EDME8BRJVV7P type=del size=3418056 2024-03-09T14:37:17.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.099+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~2XF7BE7A547E.0 size=1048576 2024-03-09T14:37:17.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.103+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~2XF7BE7A547E.1 size=1048576 2024-03-09T14:37:17.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.107+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~2XF7BE7A547E.2 size=1037005 2024-03-09T14:37:17.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.111+0000 7fd389e788c0 1 < completed multipart upload key=8J6Z9DT07H0X upload=2XF7BE7A547E tag=P40AFMH4Z1VP type=write size=4182733 2024-03-09T14:37:17.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.115+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=A3F344XO4BZS type=del size=3793061 2024-03-09T14:37:17.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.119+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=CEN738CE7FQF type=del 2024-03-09T14:37:17.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.123+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~S434IP15XY0X.0 size=614465 2024-03-09T14:37:17.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.123+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=S434IP15XY0X tag=R9VG4FJVF2J6 type=write size=1663041 2024-03-09T14:37:17.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.127+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~C4DMXUZSYCUQ.0 size=48639 2024-03-09T14:37:17.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.131+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=C4DMXUZSYCUQ tag=KTZD5DD0J6C0 type=write size=1097215 2024-03-09T14:37:17.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.135+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~GOTZELCBDZX6.0 size=209213 2024-03-09T14:37:17.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.135+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=GOTZELCBDZX6 tag=SYW6G9YPK74R type=write size=1257789 2024-03-09T14:37:17.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.139+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~D3H3270WK5SH.0 size=1048576 2024-03-09T14:37:17.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.143+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~D3H3270WK5SH.1 size=1048576 2024-03-09T14:37:17.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.143+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~D3H3270WK5SH.2 size=422937 2024-03-09T14:37:17.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.147+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=D3H3270WK5SH tag=NODY8O1YMEXO type=write size=3568665 2024-03-09T14:37:17.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.151+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=7AN9AIMAFLL1 type=del size=1226448 2024-03-09T14:37:17.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.151+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~3Y04K9RV1XPY.0 size=712310 2024-03-09T14:37:17.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.155+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=3Y04K9RV1XPY tag=UG0P1GQ7ULX7 type=write size=1760886 2024-03-09T14:37:17.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.163+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~KQUYD8WSJF1R.0 size=1048576 2024-03-09T14:37:17.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.167+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~KQUYD8WSJF1R.1 size=12923 2024-03-09T14:37:17.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.167+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=KQUYD8WSJF1R tag=L5IYY594T3S5 type=write size=2110075 2024-03-09T14:37:17.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.167+0000 7fd389e788c0 1 < completed delete operation key=PKVYD8DWS7M2 tag=60UKGSX4WDAK type=del 2024-03-09T14:37:17.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.171+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=GXVVOD885MD5 type=del size=2162713 2024-03-09T14:37:17.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.175+0000 7fd389e788c0 1 < suggested remove operation key=DIN8WJ9Z9OI8 tag=3B0W10O4YVG8 type=del 2024-03-09T14:37:17.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.179+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=1FFSKY49Y0KW type=del size=3650345 2024-03-09T14:37:17.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.179+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~8OFVPHAAQ1ED.0 size=767556 2024-03-09T14:37:17.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.183+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=8OFVPHAAQ1ED tag=KJKTYG5NBEE4 type=write size=1816132 2024-03-09T14:37:17.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.187+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=EQ7607469S8T type=del size=2283916 2024-03-09T14:37:17.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.191+0000 7fd389e788c0 1 < canceled operation key=MHT268M7S2TY tag=6WNEZZUQ1C0N type=del size=51634 2024-03-09T14:37:17.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.191+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=ZMBN4TAPPCPN type=del size=2010878 2024-03-09T14:37:17.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.195+0000 7fd389e788c0 1 < canceled operation key=1K5KR8U3GCOV tag=OTUXE6OOATXS type=del size=2911435 2024-03-09T14:37:17.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.199+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~DOLH3F883OWB.0 size=455238 2024-03-09T14:37:17.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.199+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=DOLH3F883OWB tag=UD0JKTWC94W1 type=write size=1503814 2024-03-09T14:37:17.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.207+0000 7fd389e788c0 1 < suggested update operation key=AUSZ4JUGI6UU tag=1L3ZKLYT5J6R type=del size=381608 2024-03-09T14:37:17.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.211+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~63J8Q78SAGZJ.0 size=1048576 2024-03-09T14:37:17.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.211+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~63J8Q78SAGZJ.1 size=178793 2024-03-09T14:37:17.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.211+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=63J8Q78SAGZJ tag=L761610MY58U type=write size=2275945 2024-03-09T14:37:17.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.215+0000 7fd389e788c0 1 < suggested update operation key=MHT268M7S2TY tag=I80QQXZQ4AZL type=del size=3955965 2024-03-09T14:37:17.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.219+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~1IGX24319ATC.0 size=1048576 2024-03-09T14:37:17.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.223+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~1IGX24319ATC.1 size=34831 2024-03-09T14:37:17.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.223+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=1IGX24319ATC tag=RRN215GY14CH type=write size=2131983 2024-03-09T14:37:17.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.227+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~I8CY56X3YTOJ.0 size=1048576 2024-03-09T14:37:17.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.227+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~I8CY56X3YTOJ.1 size=1048576 2024-03-09T14:37:17.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.231+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~I8CY56X3YTOJ.2 size=892685 2024-03-09T14:37:17.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.235+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=I8CY56X3YTOJ tag=UX83KHQ3O9Q7 type=write size=4038413 2024-03-09T14:37:17.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.235+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=2AJBGGSQ9Y75 type=write size=960646 2024-03-09T14:37:17.239 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.239+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~V51LG8PUYUIN.0 size=1048576 2024-03-09T14:37:17.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.243+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~V51LG8PUYUIN.1 size=436569 2024-03-09T14:37:17.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.247+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=V51LG8PUYUIN tag=2W913SSE184W type=write size=2533721 2024-03-09T14:37:17.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.251+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~RXME1BBQA9K9.0 size=1048576 2024-03-09T14:37:17.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.255+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~RXME1BBQA9K9.1 size=1048576 2024-03-09T14:37:17.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.255+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~RXME1BBQA9K9.2 size=810476 2024-03-09T14:37:17.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.255+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=RXME1BBQA9K9 tag=L3R3XT7W2XC4 type=write size=3956204 2024-03-09T14:37:17.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.259+0000 7fd389e788c0 -1 < failed to complete operation key=AUSZ4JUGI6UU tag=MLJEFWFIFCP6 type=del size=2550300: (22) Invalid argument 2024-03-09T14:37:17.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.263+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~JSWAWLHWTYFW.0 size=1048576 2024-03-09T14:37:17.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.263+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~JSWAWLHWTYFW.1 size=1048576 2024-03-09T14:37:17.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.267+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~JSWAWLHWTYFW.2 size=678987 2024-03-09T14:37:17.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.267+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=JSWAWLHWTYFW tag=DEWT52NAEAWL type=write size=3824715 2024-03-09T14:37:17.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.267+0000 7fd389e788c0 1 < canceled operation key=8J6Z9DT07H0X tag=EDME8BRJVV7P type=del size=3418056 2024-03-09T14:37:17.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.271+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=1KA7EEOVUU88 type=del size=4019247 2024-03-09T14:37:17.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.271+0000 7fd389e788c0 1 < canceled operation key=P83H9137MI7Y tag=A3F344XO4BZS type=del size=3793061 2024-03-09T14:37:17.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.275+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=6Y35COI80NK0 type=del size=3438960 2024-03-09T14:37:17.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.279+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~S434IP15XY0X.0 size=614465 2024-03-09T14:37:17.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.283+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=S434IP15XY0X tag=R9VG4FJVF2J6 type=write size=1663041 2024-03-09T14:37:17.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.287+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=V4BVTVS934O5 type=write size=34707 2024-03-09T14:37:17.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.287+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~GOTZELCBDZX6.0 size=209213 2024-03-09T14:37:17.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.295+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=GOTZELCBDZX6 tag=SYW6G9YPK74R type=write size=1257789 2024-03-09T14:37:17.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.295+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=VCLUBI4LXNYG type=del size=2396218 2024-03-09T14:37:17.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.303+0000 7fd389e788c0 1 < suggested update operation key=IXKMXJ9IZ69S tag=7AN9AIMAFLL1 type=del size=1226448 2024-03-09T14:37:17.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.307+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~8J3VBO1BIPLV.0 size=1048576 2024-03-09T14:37:17.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.307+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~8J3VBO1BIPLV.1 size=982320 2024-03-09T14:37:17.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.307+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=8J3VBO1BIPLV tag=K860X3UMDTL3 type=write size=3079472 2024-03-09T14:37:17.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.311+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~KQUYD8WSJF1R.0 size=1048576 2024-03-09T14:37:17.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.315+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~KQUYD8WSJF1R.1 size=12923 2024-03-09T14:37:17.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.319+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=KQUYD8WSJF1R tag=L5IYY594T3S5 type=write size=2110075 2024-03-09T14:37:17.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.319+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=FN7W3329STHK type=write size=155456 2024-03-09T14:37:17.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.323+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=GXVVOD885MD5 type=del 2024-03-09T14:37:17.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.323+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=SGK4QZD9RW37 type=del size=3340068 2024-03-09T14:37:17.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.327+0000 7fd389e788c0 1 < completed delete operation key=YR2VX4QLOCOG tag=1FFSKY49Y0KW type=del 2024-03-09T14:37:17.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.331+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=Z94Y10ECG32E type=write size=765766 2024-03-09T14:37:17.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.331+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=EQ7607469S8T type=del 2024-03-09T14:37:17.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.335+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=V0N53F7RPG5V type=del size=2071669 2024-03-09T14:37:17.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.339+0000 7fd389e788c0 1 < suggested update operation key=71692MJQITX3 tag=ZMBN4TAPPCPN type=del size=2010878 2024-03-09T14:37:17.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.343+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=XATP5ILISBMC type=del size=1285449 2024-03-09T14:37:17.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.347+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~DOLH3F883OWB.0 size=455238 2024-03-09T14:37:17.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.351+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=DOLH3F883OWB tag=UD0JKTWC94W1 type=write size=1503814 2024-03-09T14:37:17.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.351+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=U5XKS3X9CGGK type=write size=795142 2024-03-09T14:37:17.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.355+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~63J8Q78SAGZJ.0 size=1048576 2024-03-09T14:37:17.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.359+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~63J8Q78SAGZJ.1 size=178793 2024-03-09T14:37:17.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.363+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=63J8Q78SAGZJ tag=L761610MY58U type=write size=2275945 2024-03-09T14:37:17.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.367+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=XH970SYQYT36 type=del size=4123189 2024-03-09T14:37:17.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.367+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~1IGX24319ATC.0 size=1048576 2024-03-09T14:37:17.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.371+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~1IGX24319ATC.1 size=34831 2024-03-09T14:37:17.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.375+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=1IGX24319ATC tag=RRN215GY14CH type=write size=2131983 2024-03-09T14:37:17.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.379+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=KE3WF3SQAN2A type=del size=3085894 2024-03-09T14:37:17.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.379+0000 7fd389e788c0 1 < completed write operation key=SKIBISETJH7B tag=2AJBGGSQ9Y75 type=write size=960646 2024-03-09T14:37:17.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.383+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~OSPJAEOKT956.0 size=1048576 2024-03-09T14:37:17.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.387+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~OSPJAEOKT956.1 size=1048576 2024-03-09T14:37:17.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.387+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~OSPJAEOKT956.2 size=300442 2024-03-09T14:37:17.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.387+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=OSPJAEOKT956 tag=4UL7VIS5TVPW type=write size=3446170 2024-03-09T14:37:17.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.391+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~RXME1BBQA9K9.0 size=1048576 2024-03-09T14:37:17.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.391+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~RXME1BBQA9K9.1 size=1048576 2024-03-09T14:37:17.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.391+0000 7fd389e788c0 1 < canceled part key=_multipart_K9X2N6V8R4BY.2~RXME1BBQA9K9.2 size=810476 2024-03-09T14:37:17.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.395+0000 7fd389e788c0 1 < canceled multipart upload key=K9X2N6V8R4BY upload=RXME1BBQA9K9 tag=L3R3XT7W2XC4 type=write size=3956204 2024-03-09T14:37:17.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.403+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=AB2KF9HW0JCJ type=del size=2903216 2024-03-09T14:37:17.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.403+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~JSWAWLHWTYFW.0 size=1048576 2024-03-09T14:37:17.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.403+0000 7fd389e788c0 1 < canceled part key=_multipart_P83H9137MI7Y.2~JSWAWLHWTYFW.1 size=1048576 2024-03-09T14:37:17.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.403+0000 7fd389e788c0 1 < canceled part key=_multipart_P83H9137MI7Y.2~JSWAWLHWTYFW.2 size=678987 2024-03-09T14:37:17.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.407+0000 7fd389e788c0 1 < canceled multipart upload key=P83H9137MI7Y upload=JSWAWLHWTYFW tag=DEWT52NAEAWL type=write size=3824715 2024-03-09T14:37:17.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.411+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=NWQDY9JYT2ID type=del size=863572 2024-03-09T14:37:17.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.411+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=1KA7EEOVUU88 type=del 2024-03-09T14:37:17.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.415+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~A9Z9ZSE69V7H.0 size=341836 2024-03-09T14:37:17.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.415+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=A9Z9ZSE69V7H tag=FIWE5Q2U2DIT type=write size=1390412 2024-03-09T14:37:17.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.419+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=6Y35COI80NK0 type=del 2024-03-09T14:37:17.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.423+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~F0QN9AYLEB1M.0 size=925377 2024-03-09T14:37:17.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.423+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=F0QN9AYLEB1M tag=Z9A4RLOC4H37 type=write size=1973953 2024-03-09T14:37:17.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.427+0000 7fd389e788c0 1 < completed write operation key=6VT4C288571G tag=V4BVTVS934O5 type=write size=34707 2024-03-09T14:37:17.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.427+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=ACGJZW0JNVUD type=del size=2898240 2024-03-09T14:37:17.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.431+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=VCLUBI4LXNYG type=del 2024-03-09T14:37:17.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.431+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=OFANFS54L126 type=del size=3302866 2024-03-09T14:37:17.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.435+0000 7fd389e788c0 1 < canceled part key=_multipart_6VT4C288571G.2~8J3VBO1BIPLV.0 size=1048576 2024-03-09T14:37:17.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.435+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~8J3VBO1BIPLV.1 size=982320 2024-03-09T14:37:17.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.439+0000 7fd389e788c0 1 < canceled multipart upload key=6VT4C288571G upload=8J3VBO1BIPLV tag=K860X3UMDTL3 type=write size=3079472 2024-03-09T14:37:17.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.443+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~JFVAZFJD8B7S.0 size=1048576 2024-03-09T14:37:17.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.443+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~JFVAZFJD8B7S.1 size=1048576 2024-03-09T14:37:17.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.447+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~JFVAZFJD8B7S.2 size=1003038 2024-03-09T14:37:17.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.447+0000 7fd389e788c0 1 > prepared multipart upload key=2405Y4I2Q8TY upload=JFVAZFJD8B7S tag=N0GVQUHQLPDP type=write size=4148766 2024-03-09T14:37:17.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.451+0000 7fd389e788c0 1 < canceled operation key=44F8QXCBBENS tag=FN7W3329STHK type=write size=155456 2024-03-09T14:37:17.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.451+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=PTJNPC6J9KIB type=del size=3760260 2024-03-09T14:37:17.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.455+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=SGK4QZD9RW37 type=del 2024-03-09T14:37:17.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.459+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=1U42XIAVKMZK type=del size=3311248 2024-03-09T14:37:17.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.463+0000 7fd389e788c0 1 < completed write operation key=IXKMXJ9IZ69S tag=Z94Y10ECG32E type=write size=765766 2024-03-09T14:37:17.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.467+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~6OM2YMOU0IQ5.0 size=1048576 2024-03-09T14:37:17.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.471+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~6OM2YMOU0IQ5.1 size=232690 2024-03-09T14:37:17.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.471+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=6OM2YMOU0IQ5 tag=2QN498TKDXUG type=write size=2329842 2024-03-09T14:37:17.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.471+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=V0N53F7RPG5V type=del 2024-03-09T14:37:17.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.479+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~7VNMX25ZR67N.0 size=1048576 2024-03-09T14:37:17.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.479+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~7VNMX25ZR67N.1 size=819861 2024-03-09T14:37:17.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.479+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=7VNMX25ZR67N tag=PS51FSROOYE6 type=write size=2917013 2024-03-09T14:37:17.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.483+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=XATP5ILISBMC type=del 2024-03-09T14:37:17.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.487+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=B64FBE4EDN54 type=del size=1412333 2024-03-09T14:37:17.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.491+0000 7fd389e788c0 1 < completed write operation key=CLAM83TC7RZ7 tag=U5XKS3X9CGGK type=write size=795142 2024-03-09T14:37:17.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.491+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=KYNTMPLW872H type=del size=1731346 2024-03-09T14:37:17.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.499+0000 7fd389e788c0 1 < suggested update operation key=Z18Q66VI5PDN tag=XH970SYQYT36 type=del size=4123189 2024-03-09T14:37:17.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.499+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=ZXDAKV483RW2 type=del size=4011424 2024-03-09T14:37:17.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.503+0000 7fd389e788c0 1 < completed delete operation key=UMT7VKZ9R4IR tag=KE3WF3SQAN2A type=del 2024-03-09T14:37:17.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.507+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=YLQ5UAMT6LG3 type=del size=3124195 2024-03-09T14:37:17.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.507+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~OSPJAEOKT956.0 size=1048576 2024-03-09T14:37:17.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.511+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~OSPJAEOKT956.1 size=1048576 2024-03-09T14:37:17.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.511+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~OSPJAEOKT956.2 size=300442 2024-03-09T14:37:17.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.519+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=OSPJAEOKT956 tag=4UL7VIS5TVPW type=write size=3446170 2024-03-09T14:37:17.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.519+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=X4WPBQU6BQ85 type=write size=229877 2024-03-09T14:37:17.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.523+0000 7fd389e788c0 1 < completed delete operation key=UMT7VKZ9R4IR tag=AB2KF9HW0JCJ type=del 2024-03-09T14:37:17.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.527+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~C1D153BPVEQ4.0 size=1048576 2024-03-09T14:37:17.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.531+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~C1D153BPVEQ4.1 size=1048576 2024-03-09T14:37:17.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.531+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~C1D153BPVEQ4.2 size=238222 2024-03-09T14:37:17.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.531+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=C1D153BPVEQ4 tag=5TDW2F0MMXPF type=write size=3383950 2024-03-09T14:37:17.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.535+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=NWQDY9JYT2ID type=del 2024-03-09T14:37:17.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.535+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=IE457NEFI327 type=del size=2035267 2024-03-09T14:37:17.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.539+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~A9Z9ZSE69V7H.0 size=341836 2024-03-09T14:37:17.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.543+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=A9Z9ZSE69V7H tag=FIWE5Q2U2DIT type=write size=1390412 2024-03-09T14:37:17.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.547+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~QUCJALN61D7N.0 size=613277 2024-03-09T14:37:17.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.547+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=QUCJALN61D7N tag=CBD1XL00LBZB type=write size=1661853 2024-03-09T14:37:17.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.551+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~F0QN9AYLEB1M.0 size=925377 2024-03-09T14:37:17.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.555+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=F0QN9AYLEB1M tag=Z9A4RLOC4H37 type=write size=1973953 2024-03-09T14:37:17.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.559+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~JTZ8GYJEJY8J.0 size=1048576 2024-03-09T14:37:17.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.559+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~JTZ8GYJEJY8J.1 size=429634 2024-03-09T14:37:17.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.559+0000 7fd389e788c0 1 > prepared multipart upload key=UMT7VKZ9R4IR upload=JTZ8GYJEJY8J tag=KTHW4BBHR4UI type=write size=2526786 2024-03-09T14:37:17.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.563+0000 7fd389e788c0 1 < completed delete operation key=YR2VX4QLOCOG tag=ACGJZW0JNVUD type=del 2024-03-09T14:37:17.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.567+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=INC186GA9C99 type=del size=1428118 2024-03-09T14:37:17.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.567+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=OFANFS54L126 type=del 2024-03-09T14:37:17.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.571+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=3RWT1MSY6WJN type=write size=601718 2024-03-09T14:37:17.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.571+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~JFVAZFJD8B7S.0 size=1048576 2024-03-09T14:37:17.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.575+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~JFVAZFJD8B7S.1 size=1048576 2024-03-09T14:37:17.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.575+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~JFVAZFJD8B7S.2 size=1003038 2024-03-09T14:37:17.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.583+0000 7fd389e788c0 1 < completed multipart upload key=2405Y4I2Q8TY upload=JFVAZFJD8B7S tag=N0GVQUHQLPDP type=write size=4148766 2024-03-09T14:37:17.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.583+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=YRTB2MW3DEE0 type=write size=322099 2024-03-09T14:37:17.588 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.587+0000 7fd389e788c0 1 < suggested update operation key=Y7E2TLASJM9T tag=PTJNPC6J9KIB type=del size=3760260 2024-03-09T14:37:17.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.591+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=32TUW6S8FNGY type=del size=3488388 2024-03-09T14:37:17.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.591+0000 7fd389e788c0 1 < canceled operation key=61RC3GUU437B tag=1U42XIAVKMZK type=del size=3311248 2024-03-09T14:37:17.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.595+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=WDBJBT18TIXR type=write size=169702 2024-03-09T14:37:17.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.599+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~6OM2YMOU0IQ5.0 size=1048576 2024-03-09T14:37:17.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.599+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~6OM2YMOU0IQ5.1 size=232690 2024-03-09T14:37:17.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.603+0000 7fd389e788c0 1 < completed multipart upload key=8J6Z9DT07H0X upload=6OM2YMOU0IQ5 tag=2QN498TKDXUG type=write size=2329842 2024-03-09T14:37:17.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.607+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=LIU8X8BLSFBX type=del size=3152091 2024-03-09T14:37:17.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.607+0000 7fd389e788c0 1 < canceled part key=_multipart_YR2VX4QLOCOG.2~7VNMX25ZR67N.0 size=1048576 2024-03-09T14:37:17.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.611+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~7VNMX25ZR67N.1 size=819861 2024-03-09T14:37:17.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.615+0000 7fd389e788c0 1 < canceled multipart upload key=YR2VX4QLOCOG upload=7VNMX25ZR67N tag=PS51FSROOYE6 type=write size=2917013 2024-03-09T14:37:17.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.619+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~0YHJZAE90OG7.0 size=974868 2024-03-09T14:37:17.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.619+0000 7fd389e788c0 1 > prepared multipart upload key=GSNWWDS63MTA upload=0YHJZAE90OG7 tag=UOI78MW5HI0X type=write size=2023444 2024-03-09T14:37:17.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.619+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=B64FBE4EDN54 type=del 2024-03-09T14:37:17.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.623+0000 7fd389e788c0 1 > prepared part key=_multipart_DIN8WJ9Z9OI8.2~LRL5JMX4QEXM.0 size=1032123 2024-03-09T14:37:17.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.623+0000 7fd389e788c0 1 > prepared multipart upload key=DIN8WJ9Z9OI8 upload=LRL5JMX4QEXM tag=VLLE80DZOOME type=write size=2080699 2024-03-09T14:37:17.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.627+0000 7fd389e788c0 1 < suggested remove operation key=CLAM83TC7RZ7 tag=KYNTMPLW872H type=del 2024-03-09T14:37:17.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.631+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=LNUNPP1AEXYC type=del size=65165 2024-03-09T14:37:17.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.631+0000 7fd389e788c0 -1 < failed to complete operation key=Y7E2TLASJM9T tag=ZXDAKV483RW2 type=del size=4011424: (22) Invalid argument 2024-03-09T14:37:17.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.635+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=5OFY1GI5US2H type=del size=2399010 2024-03-09T14:37:17.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.643+0000 7fd389e788c0 1 < suggested remove operation key=8J6Z9DT07H0X tag=YLQ5UAMT6LG3 type=del 2024-03-09T14:37:17.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.643+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=789VIPZDCRR5 type=write size=872940 2024-03-09T14:37:17.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.647+0000 7fd389e788c0 1 < suggested update operation key=61RC3GUU437B tag=X4WPBQU6BQ85 type=write size=229877 2024-03-09T14:37:17.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.651+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~7QVE7EQWMWXN.0 size=1048576 2024-03-09T14:37:17.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.655+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~7QVE7EQWMWXN.1 size=213887 2024-03-09T14:37:17.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.655+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=7QVE7EQWMWXN tag=XU30FA3T5FSL type=write size=2311039 2024-03-09T14:37:17.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.655+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~C1D153BPVEQ4.0 size=1048576 2024-03-09T14:37:17.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.659+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~C1D153BPVEQ4.1 size=1048576 2024-03-09T14:37:17.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.659+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~C1D153BPVEQ4.2 size=238222 2024-03-09T14:37:17.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.663+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=C1D153BPVEQ4 tag=5TDW2F0MMXPF type=write size=3383950 2024-03-09T14:37:17.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.667+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~JKW1P6B8MNRO.0 size=1048576 2024-03-09T14:37:17.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.667+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~JKW1P6B8MNRO.1 size=1048576 2024-03-09T14:37:17.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.671+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~JKW1P6B8MNRO.2 size=201148 2024-03-09T14:37:17.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.671+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=JKW1P6B8MNRO tag=53M1J1TXE5KM type=write size=3346876 2024-03-09T14:37:17.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.671+0000 7fd389e788c0 1 < canceled operation key=5ZEDXFB9B3CN tag=IE457NEFI327 type=del size=2035267 2024-03-09T14:37:17.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.675+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~0PU616S2GW4N.0 size=1031581 2024-03-09T14:37:17.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.675+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=0PU616S2GW4N tag=PPKW1IVI8E0Q type=write size=2080157 2024-03-09T14:37:17.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.675+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~QUCJALN61D7N.0 size=613277 2024-03-09T14:37:17.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.679+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=QUCJALN61D7N tag=CBD1XL00LBZB type=write size=1661853 2024-03-09T14:37:17.682 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.683+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~QSSB2I1U5J3B.0 size=1048576 2024-03-09T14:37:17.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.683+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~QSSB2I1U5J3B.1 size=1048576 2024-03-09T14:37:17.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.687+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~QSSB2I1U5J3B.2 size=1011907 2024-03-09T14:37:17.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.687+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=QSSB2I1U5J3B tag=SJU75HTQMV1O type=write size=4157635 2024-03-09T14:37:17.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.687+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~JTZ8GYJEJY8J.0 size=1048576 2024-03-09T14:37:17.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.687+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~JTZ8GYJEJY8J.1 size=429634 2024-03-09T14:37:17.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.691+0000 7fd389e788c0 1 < completed multipart upload key=UMT7VKZ9R4IR upload=JTZ8GYJEJY8J tag=KTHW4BBHR4UI type=write size=2526786 2024-03-09T14:37:17.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.695+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~93BV5STKX3XF.0 size=100389 2024-03-09T14:37:17.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.695+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=93BV5STKX3XF tag=EVP3UIG8KRNT type=write size=1148965 2024-03-09T14:37:17.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.695+0000 7fd389e788c0 -1 < failed to complete operation key=61RC3GUU437B tag=INC186GA9C99 type=del size=1428118: (22) Invalid argument 2024-03-09T14:37:17.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.699+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=CWZALIR0AQ4F type=del size=3155883 2024-03-09T14:37:17.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.703+0000 7fd389e788c0 1 < suggested remove operation key=SVTMMQ2QR603 tag=3RWT1MSY6WJN type=write 2024-03-09T14:37:17.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.703+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=ELB5K46EP2BZ type=del size=2925348 2024-03-09T14:37:17.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.707+0000 7fd389e788c0 1 < suggested remove operation key=ACL1T9GW2JV9 tag=YRTB2MW3DEE0 type=write 2024-03-09T14:37:17.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.707+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=7OTKSJ47W2LC type=del size=1932670 2024-03-09T14:37:17.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.711+0000 7fd389e788c0 -1 < no bi entry to suggest for operation key=CLAM83TC7RZ7 tag=32TUW6S8FNGY type=del size=3488388: (2) No such file or directory 2024-03-09T14:37:17.712 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.711+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~OQS00ST001YX.0 size=1048576 2024-03-09T14:37:17.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.715+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~OQS00ST001YX.1 size=1048576 2024-03-09T14:37:17.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.715+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~OQS00ST001YX.2 size=469256 2024-03-09T14:37:17.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.715+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=OQS00ST001YX tag=7FNHX7OU1WJB type=write size=3614984 2024-03-09T14:37:17.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.715+0000 7fd389e788c0 1 < completed write operation key=E65PFNHJQHEO tag=WDBJBT18TIXR type=write size=169702 2024-03-09T14:37:17.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.719+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=SOIUV9BHVWIR type=del size=698518 2024-03-09T14:37:17.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.719+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=LIU8X8BLSFBX type=del 2024-03-09T14:37:17.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.723+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=TED00QM1PTW0 type=del size=3887762 2024-03-09T14:37:17.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.723+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~0YHJZAE90OG7.0 size=974868 2024-03-09T14:37:17.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.727+0000 7fd389e788c0 1 < completed multipart upload key=GSNWWDS63MTA upload=0YHJZAE90OG7 tag=UOI78MW5HI0X type=write size=2023444 2024-03-09T14:37:17.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.727+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=79WGFDRKH7YH type=del size=1016295 2024-03-09T14:37:17.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.731+0000 7fd389e788c0 1 < completed part key=_multipart_DIN8WJ9Z9OI8.2~LRL5JMX4QEXM.0 size=1032123 2024-03-09T14:37:17.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.731+0000 7fd389e788c0 1 < completed multipart upload key=DIN8WJ9Z9OI8 upload=LRL5JMX4QEXM tag=VLLE80DZOOME type=write size=2080699 2024-03-09T14:37:17.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.735+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=VHXS29WQSZB2 type=del size=441928 2024-03-09T14:37:17.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.735+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=LNUNPP1AEXYC type=del 2024-03-09T14:37:17.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.739+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~K34C5TFI6ASR.0 size=706239 2024-03-09T14:37:17.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.739+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=K34C5TFI6ASR tag=B0MIIU0MTKXJ type=write size=1754815 2024-03-09T14:37:17.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.739+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=5OFY1GI5US2H type=del 2024-03-09T14:37:17.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.743+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=PY4TTG5EIM7C type=del size=3040023 2024-03-09T14:37:17.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.743+0000 7fd389e788c0 1 < completed write operation key=2405Y4I2Q8TY tag=789VIPZDCRR5 type=write size=872940 2024-03-09T14:37:17.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.747+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=8BX71SG9A2MN type=del size=3280040 2024-03-09T14:37:17.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.747+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~7QVE7EQWMWXN.0 size=1048576 2024-03-09T14:37:17.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.747+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~7QVE7EQWMWXN.1 size=213887 2024-03-09T14:37:17.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.751+0000 7fd389e788c0 1 < completed multipart upload key=P83H9137MI7Y upload=7QVE7EQWMWXN tag=XU30FA3T5FSL type=write size=2311039 2024-03-09T14:37:17.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.751+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=7ND4W1FI1Y0C type=del size=2826994 2024-03-09T14:37:17.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.755+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~JKW1P6B8MNRO.0 size=1048576 2024-03-09T14:37:17.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.755+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~JKW1P6B8MNRO.1 size=1048576 2024-03-09T14:37:17.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.759+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~JKW1P6B8MNRO.2 size=201148 2024-03-09T14:37:17.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.759+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=JKW1P6B8MNRO tag=53M1J1TXE5KM type=write size=3346876 2024-03-09T14:37:17.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.763+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=127ILA5S8TEL type=del size=588661 2024-03-09T14:37:17.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.763+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~0PU616S2GW4N.0 size=1031581 2024-03-09T14:37:17.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.767+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=0PU616S2GW4N tag=PPKW1IVI8E0Q type=write size=2080157 2024-03-09T14:37:17.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.767+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=VD4995Z1E63F type=del size=3072963 2024-03-09T14:37:17.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.767+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~QSSB2I1U5J3B.0 size=1048576 2024-03-09T14:37:17.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.767+0000 7fd389e788c0 1 < canceled part key=_multipart_Y7E2TLASJM9T.2~QSSB2I1U5J3B.1 size=1048576 2024-03-09T14:37:17.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.767+0000 7fd389e788c0 1 < canceled part key=_multipart_Y7E2TLASJM9T.2~QSSB2I1U5J3B.2 size=1011907 2024-03-09T14:37:17.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.771+0000 7fd389e788c0 1 < canceled multipart upload key=Y7E2TLASJM9T upload=QSSB2I1U5J3B tag=SJU75HTQMV1O type=write size=4157635 2024-03-09T14:37:17.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.775+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=2772PH0XGJUJ type=del size=342800 2024-03-09T14:37:17.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.775+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~93BV5STKX3XF.0 size=100389 2024-03-09T14:37:17.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.779+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=93BV5STKX3XF tag=EVP3UIG8KRNT type=write size=1148965 2024-03-09T14:37:17.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.783+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~PAWLD1E85XZZ.0 size=1015364 2024-03-09T14:37:17.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.783+0000 7fd389e788c0 1 > prepared multipart upload key=2405Y4I2Q8TY upload=PAWLD1E85XZZ tag=XTUH21AWNN01 type=write size=2063940 2024-03-09T14:37:17.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.783+0000 7fd389e788c0 1 < suggested remove operation key=2405Y4I2Q8TY tag=CWZALIR0AQ4F type=del 2024-03-09T14:37:17.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.787+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=PCVM0Z18GV0Y type=write size=343896 2024-03-09T14:37:17.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.787+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=ELB5K46EP2BZ type=del 2024-03-09T14:37:17.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.791+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=5RKRMK7N2M7M type=del size=413009 2024-03-09T14:37:17.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.791+0000 7fd389e788c0 1 < completed delete operation key=DIN8WJ9Z9OI8 tag=7OTKSJ47W2LC type=del 2024-03-09T14:37:17.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.795+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=3UYAHK75LKH7 type=del size=263296 2024-03-09T14:37:17.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.795+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~OQS00ST001YX.0 size=1048576 2024-03-09T14:37:17.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.799+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~OQS00ST001YX.1 size=1048576 2024-03-09T14:37:17.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.799+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~OQS00ST001YX.2 size=469256 2024-03-09T14:37:17.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.803+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=OQS00ST001YX tag=7FNHX7OU1WJB type=write size=3614984 2024-03-09T14:37:17.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.807+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=QWVEWZFKEMCY type=write size=124531 2024-03-09T14:37:17.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.807+0000 7fd389e788c0 1 < canceled operation key=FY02AR9GS3KG tag=SOIUV9BHVWIR type=del size=698518 2024-03-09T14:37:17.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.811+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=WZPB86MFXERK type=del size=1182327 2024-03-09T14:37:17.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.811+0000 7fd389e788c0 1 < completed delete operation key=E2VP0TJ37UX8 tag=TED00QM1PTW0 type=del 2024-03-09T14:37:17.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.815+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=FI1IBK0F2NIP type=write size=1002156 2024-03-09T14:37:17.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.815+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=79WGFDRKH7YH type=del 2024-03-09T14:37:17.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.815+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=3ZLPPKJAW72T type=write size=596923 2024-03-09T14:37:17.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.819+0000 7fd389e788c0 1 < suggested remove operation key=AUSZ4JUGI6UU tag=VHXS29WQSZB2 type=del 2024-03-09T14:37:17.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.823+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=URB9EGPPHXFK type=write size=770072 2024-03-09T14:37:17.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.823+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~K34C5TFI6ASR.0 size=706239 2024-03-09T14:37:17.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.827+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=K34C5TFI6ASR tag=B0MIIU0MTKXJ type=write size=1754815 2024-03-09T14:37:17.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.831+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=IEKZCY8HZ5QD type=del size=3237291 2024-03-09T14:37:17.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.831+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=PY4TTG5EIM7C type=del 2024-03-09T14:37:17.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.831+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=O8S70NRSMHZP type=del size=2279934 2024-03-09T14:37:17.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.835+0000 7fd389e788c0 1 < canceled operation key=61RC3GUU437B tag=8BX71SG9A2MN type=del size=3280040 2024-03-09T14:37:17.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.839+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~WVRMK6KIIVVB.0 size=1048576 2024-03-09T14:37:17.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.839+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~WVRMK6KIIVVB.1 size=792737 2024-03-09T14:37:17.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.839+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=WVRMK6KIIVVB tag=S9ZULYNMQWWP type=write size=2889889 2024-03-09T14:37:17.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.839+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=7ND4W1FI1Y0C type=del 2024-03-09T14:37:17.842 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.843+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=0M2TITDUXDDZ type=write size=641298 2024-03-09T14:37:17.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.843+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=127ILA5S8TEL type=del 2024-03-09T14:37:17.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.847+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=ZZR9OF63CLHH type=del size=511950 2024-03-09T14:37:17.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.847+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=VD4995Z1E63F type=del 2024-03-09T14:37:17.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.851+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~JCU0QIPP9LMN.0 size=1048576 2024-03-09T14:37:17.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.851+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~JCU0QIPP9LMN.1 size=205353 2024-03-09T14:37:17.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.851+0000 7fd389e788c0 1 > prepared multipart upload key=GSNWWDS63MTA upload=JCU0QIPP9LMN tag=RS42WZZAO0H3 type=write size=2302505 2024-03-09T14:37:17.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.855+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=2772PH0XGJUJ type=del 2024-03-09T14:37:17.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.855+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=J1Y6G9MNQERH type=del size=3414947 2024-03-09T14:37:17.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.859+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~PAWLD1E85XZZ.0 size=1015364 2024-03-09T14:37:17.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.859+0000 7fd389e788c0 1 < completed multipart upload key=2405Y4I2Q8TY upload=PAWLD1E85XZZ tag=XTUH21AWNN01 type=write size=2063940 2024-03-09T14:37:17.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.863+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~PIIYXZ0G4853.0 size=1048576 2024-03-09T14:37:17.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.863+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~PIIYXZ0G4853.1 size=652666 2024-03-09T14:37:17.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.863+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=PIIYXZ0G4853 tag=HPWZFCOLC3TU type=write size=2749818 2024-03-09T14:37:17.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.867+0000 7fd389e788c0 1 < suggested remove operation key=U8P5Q3D11MM6 tag=PCVM0Z18GV0Y type=write 2024-03-09T14:37:17.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.871+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~FF2REZ63NR2A.0 size=1048576 2024-03-09T14:37:17.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.875+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~FF2REZ63NR2A.1 size=877683 2024-03-09T14:37:17.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.875+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=FF2REZ63NR2A tag=MMM3CJIZ0ZYQ type=write size=2974835 2024-03-09T14:37:17.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.875+0000 7fd389e788c0 1 < suggested update operation key=FLLUAY21DJ12 tag=5RKRMK7N2M7M type=del size=413009 2024-03-09T14:37:17.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.879+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~HZH4VUW8SP81.0 size=985828 2024-03-09T14:37:17.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.879+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=HZH4VUW8SP81 tag=6BE6864B5KFU type=write size=2034404 2024-03-09T14:37:17.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.883+0000 7fd389e788c0 1 < suggested update operation key=SVTMMQ2QR603 tag=3UYAHK75LKH7 type=del size=263296 2024-03-09T14:37:17.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.883+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=K1JB0ZGY6DGQ type=write size=387576 2024-03-09T14:37:17.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.887+0000 7fd389e788c0 1 < canceled operation key=K9X2N6V8R4BY tag=QWVEWZFKEMCY type=write size=124531 2024-03-09T14:37:17.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.891+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~BWU481TWTHJ1.0 size=1048576 2024-03-09T14:37:17.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.891+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~BWU481TWTHJ1.1 size=431508 2024-03-09T14:37:17.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.891+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=BWU481TWTHJ1 tag=EE5PFQH8AA85 type=write size=2528660 2024-03-09T14:37:17.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.891+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=WZPB86MFXERK type=del 2024-03-09T14:37:17.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.895+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~1E7C2T9AY62F.0 size=1048576 2024-03-09T14:37:17.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.895+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~1E7C2T9AY62F.1 size=1048576 2024-03-09T14:37:17.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.899+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~1E7C2T9AY62F.2 size=614811 2024-03-09T14:37:17.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.899+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=1E7C2T9AY62F tag=6B21U5TAZBJW type=write size=3760539 2024-03-09T14:37:17.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.899+0000 7fd389e788c0 1 < completed write operation key=MHT268M7S2TY tag=FI1IBK0F2NIP type=write size=1002156 2024-03-09T14:37:17.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.903+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=XMXU84XT30O6 type=del size=1882144 2024-03-09T14:37:17.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.903+0000 7fd389e788c0 1 < suggested remove operation key=6VT4C288571G tag=3ZLPPKJAW72T type=write 2024-03-09T14:37:17.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.907+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=FICTNILKV5WV type=del size=3950646 2024-03-09T14:37:17.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.907+0000 7fd389e788c0 1 < completed write operation key=IXKMXJ9IZ69S tag=URB9EGPPHXFK type=write size=770072 2024-03-09T14:37:17.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.911+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=NB6MFN1QE0LX type=del size=2621831 2024-03-09T14:37:17.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.911+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=IEKZCY8HZ5QD type=del 2024-03-09T14:37:17.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.915+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=A46OWBA6AKBI type=del size=3948175 2024-03-09T14:37:17.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.915+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=O8S70NRSMHZP type=del 2024-03-09T14:37:17.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.919+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~TFHEIO7S9X94.0 size=713486 2024-03-09T14:37:17.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.919+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=TFHEIO7S9X94 tag=NN18QDH1HBLR type=write size=1762062 2024-03-09T14:37:17.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.923+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~WVRMK6KIIVVB.0 size=1048576 2024-03-09T14:37:17.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.923+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~WVRMK6KIIVVB.1 size=792737 2024-03-09T14:37:17.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.927+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=WVRMK6KIIVVB tag=S9ZULYNMQWWP type=write size=2889889 2024-03-09T14:37:17.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.931+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~7OQSKJ8CALS1.0 size=53252 2024-03-09T14:37:17.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.931+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=7OQSKJ8CALS1 tag=UVOGWRLW73KP type=write size=1101828 2024-03-09T14:37:17.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.931+0000 7fd389e788c0 1 < completed write operation key=PZJT6RWRJFIN tag=0M2TITDUXDDZ type=write size=641298 2024-03-09T14:37:17.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.931+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=WTXYBPQ7R1JP type=del size=193824 2024-03-09T14:37:17.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.935+0000 7fd389e788c0 1 < suggested update operation key=SKIBISETJH7B tag=ZZR9OF63CLHH type=del size=511950 2024-03-09T14:37:17.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.939+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=51Y7WFKF1ZKO type=del size=584769 2024-03-09T14:37:17.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.939+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~JCU0QIPP9LMN.0 size=1048576 2024-03-09T14:37:17.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.939+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~JCU0QIPP9LMN.1 size=205353 2024-03-09T14:37:17.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.943+0000 7fd389e788c0 1 < completed multipart upload key=GSNWWDS63MTA upload=JCU0QIPP9LMN tag=RS42WZZAO0H3 type=write size=2302505 2024-03-09T14:37:17.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.947+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=MPN5IX3PUM3G type=del size=3413959 2024-03-09T14:37:17.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.947+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=J1Y6G9MNQERH type=del 2024-03-09T14:37:17.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.951+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~5ZT6TF5K4FPM.0 size=720148 2024-03-09T14:37:17.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.951+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=5ZT6TF5K4FPM tag=1F0CHX1XMYEY type=write size=1768724 2024-03-09T14:37:17.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.951+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~PIIYXZ0G4853.0 size=1048576 2024-03-09T14:37:17.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.951+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~PIIYXZ0G4853.1 size=652666 2024-03-09T14:37:17.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.955+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=PIIYXZ0G4853 tag=HPWZFCOLC3TU type=write size=2749818 2024-03-09T14:37:17.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.959+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=99T0P585Z39K type=del size=2036498 2024-03-09T14:37:17.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.959+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~FF2REZ63NR2A.0 size=1048576 2024-03-09T14:37:17.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.959+0000 7fd389e788c0 1 < canceled part key=_multipart_MHT268M7S2TY.2~FF2REZ63NR2A.1 size=877683 2024-03-09T14:37:17.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.963+0000 7fd389e788c0 1 < canceled multipart upload key=MHT268M7S2TY upload=FF2REZ63NR2A tag=MMM3CJIZ0ZYQ type=write size=2974835 2024-03-09T14:37:17.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.967+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~AJ98TM8RXSMY.0 size=1048576 2024-03-09T14:37:17.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.967+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~AJ98TM8RXSMY.1 size=1048576 2024-03-09T14:37:17.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.971+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~AJ98TM8RXSMY.2 size=246457 2024-03-09T14:37:17.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.971+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=AJ98TM8RXSMY tag=U8HS71EVMQ6D type=write size=3392185 2024-03-09T14:37:17.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.975+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~HZH4VUW8SP81.0 size=985828 2024-03-09T14:37:17.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.975+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=HZH4VUW8SP81 tag=6BE6864B5KFU type=write size=2034404 2024-03-09T14:37:17.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.979+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=5P1C2EVWK01R type=del size=2873722 2024-03-09T14:37:17.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.979+0000 7fd389e788c0 1 < completed write operation key=K9X2N6V8R4BY tag=K1JB0ZGY6DGQ type=write size=387576 2024-03-09T14:37:17.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.983+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~WXRGDI3243OK.0 size=1048576 2024-03-09T14:37:17.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.987+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~WXRGDI3243OK.1 size=1048576 2024-03-09T14:37:17.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.987+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~WXRGDI3243OK.2 size=196940 2024-03-09T14:37:17.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.987+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=WXRGDI3243OK tag=LZLKH5AMP14H type=write size=3342668 2024-03-09T14:37:17.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.991+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~BWU481TWTHJ1.0 size=1048576 2024-03-09T14:37:17.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.991+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~BWU481TWTHJ1.1 size=431508 2024-03-09T14:37:17.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.995+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=BWU481TWTHJ1 tag=EE5PFQH8AA85 type=write size=2528660 2024-03-09T14:37:17.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.999+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~EI8E9BYN3PV2.0 size=909788 2024-03-09T14:37:17.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.999+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=EI8E9BYN3PV2 tag=N902ACWACSFG type=write size=1958364 2024-03-09T14:37:17.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.999+0000 7fd389e788c0 1 < canceled part key=_multipart_YR2VX4QLOCOG.2~1E7C2T9AY62F.0 size=1048576 2024-03-09T14:37:17.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.999+0000 7fd389e788c0 1 < canceled part key=_multipart_YR2VX4QLOCOG.2~1E7C2T9AY62F.1 size=1048576 2024-03-09T14:37:17.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:17.999+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~1E7C2T9AY62F.2 size=614811 2024-03-09T14:37:18.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.003+0000 7fd389e788c0 1 < canceled multipart upload key=YR2VX4QLOCOG upload=1E7C2T9AY62F tag=6B21U5TAZBJW type=write size=3760539 2024-03-09T14:37:18.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.003+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=WZ2QSLCTYY2Z type=del size=1405235 2024-03-09T14:37:18.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.007+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=XMXU84XT30O6 type=del 2024-03-09T14:37:18.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.011+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~NF9ES421VC1G.0 size=1048576 2024-03-09T14:37:18.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.011+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~NF9ES421VC1G.1 size=1048576 2024-03-09T14:37:18.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.011+0000 7fd389e788c0 1 > prepared part key=_multipart_1KJK6PF6U226.2~NF9ES421VC1G.2 size=291635 2024-03-09T14:37:18.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.011+0000 7fd389e788c0 1 > prepared multipart upload key=1KJK6PF6U226 upload=NF9ES421VC1G tag=NTJFD67IKFJG type=write size=3437363 2024-03-09T14:37:18.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.015+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=FICTNILKV5WV type=del 2024-03-09T14:37:18.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.015+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=IEK05SHK2Q7M type=del size=2353540 2024-03-09T14:37:18.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.019+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=NB6MFN1QE0LX type=del 2024-03-09T14:37:18.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.023+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~R4S2Q48UKGIU.0 size=784669 2024-03-09T14:37:18.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.023+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=R4S2Q48UKGIU tag=NNXX0EQBPC3A type=write size=1833245 2024-03-09T14:37:18.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.023+0000 7fd389e788c0 1 < completed delete operation key=FLLUAY21DJ12 tag=A46OWBA6AKBI type=del 2024-03-09T14:37:18.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.027+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~NC2C48U64JO9.0 size=859251 2024-03-09T14:37:18.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.027+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=NC2C48U64JO9 tag=5EZ6IYY0864X type=write size=1907827 2024-03-09T14:37:18.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.031+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~TFHEIO7S9X94.0 size=713486 2024-03-09T14:37:18.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.031+0000 7fd389e788c0 1 < completed multipart upload key=Z18Q66VI5PDN upload=TFHEIO7S9X94 tag=NN18QDH1HBLR type=write size=1762062 2024-03-09T14:37:18.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.035+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=9LX2YF30A2CR type=del size=443634 2024-03-09T14:37:18.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.035+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~7OQSKJ8CALS1.0 size=53252 2024-03-09T14:37:18.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.039+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=7OQSKJ8CALS1 tag=UVOGWRLW73KP type=write size=1101828 2024-03-09T14:37:18.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.043+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~8XU6OL4V1Z6U.0 size=1048576 2024-03-09T14:37:18.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.043+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~8XU6OL4V1Z6U.1 size=401257 2024-03-09T14:37:18.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.043+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=8XU6OL4V1Z6U tag=N4R498VLWDZJ type=write size=2498409 2024-03-09T14:37:18.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.047+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=WTXYBPQ7R1JP type=del 2024-03-09T14:37:18.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.047+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=B3CCITDM9PAM type=del size=1688517 2024-03-09T14:37:18.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.047+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=51Y7WFKF1ZKO type=del 2024-03-09T14:37:18.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.051+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=2DH5QZTO006O type=del size=1787301 2024-03-09T14:37:18.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.051+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=MPN5IX3PUM3G type=del 2024-03-09T14:37:18.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.055+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=Q6BKOLVLNHF7 type=write size=901998 2024-03-09T14:37:18.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.055+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~5ZT6TF5K4FPM.0 size=720148 2024-03-09T14:37:18.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.059+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=5ZT6TF5K4FPM tag=1F0CHX1XMYEY type=write size=1768724 2024-03-09T14:37:18.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.063+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=NEQUXTTJU83I type=write size=237834 2024-03-09T14:37:18.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.063+0000 7fd389e788c0 1 < suggested update operation key=61RC3GUU437B tag=99T0P585Z39K type=del size=2036498 2024-03-09T14:37:18.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.067+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=70R9BHJ3RTLY type=del size=2819020 2024-03-09T14:37:18.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.067+0000 7fd389e788c0 1 < canceled part key=_multipart_FY02AR9GS3KG.2~AJ98TM8RXSMY.0 size=1048576 2024-03-09T14:37:18.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.067+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~AJ98TM8RXSMY.1 size=1048576 2024-03-09T14:37:18.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.071+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~AJ98TM8RXSMY.2 size=246457 2024-03-09T14:37:18.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.075+0000 7fd389e788c0 1 < canceled multipart upload key=FY02AR9GS3KG upload=AJ98TM8RXSMY tag=U8HS71EVMQ6D type=write size=3392185 2024-03-09T14:37:18.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.075+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=AQ52V0UOR2FU type=del size=4065252 2024-03-09T14:37:18.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.075+0000 7fd389e788c0 1 < canceled operation key=I4NA328AI5T1 tag=5P1C2EVWK01R type=del size=2873722 2024-03-09T14:37:18.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.079+0000 7fd389e788c0 1 > prepared operation key=FLLUAY21DJ12 tag=6PH1OFU1DDNK type=write size=258652 2024-03-09T14:37:18.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.079+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~WXRGDI3243OK.0 size=1048576 2024-03-09T14:37:18.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.083+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~WXRGDI3243OK.1 size=1048576 2024-03-09T14:37:18.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.083+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~WXRGDI3243OK.2 size=196940 2024-03-09T14:37:18.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.087+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=WXRGDI3243OK tag=LZLKH5AMP14H type=write size=3342668 2024-03-09T14:37:18.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.091+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~T7KRQNAYT479.0 size=244108 2024-03-09T14:37:18.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.091+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=T7KRQNAYT479 tag=K9059SOMA67I type=write size=1292684 2024-03-09T14:37:18.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.091+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~EI8E9BYN3PV2.0 size=909788 2024-03-09T14:37:18.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.095+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=EI8E9BYN3PV2 tag=N902ACWACSFG type=write size=1958364 2024-03-09T14:37:18.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.095+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=3J0857NQELVW type=write size=148703 2024-03-09T14:37:18.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.099+0000 7fd389e788c0 -1 < failed to complete operation key=61RC3GUU437B tag=WZ2QSLCTYY2Z type=del size=1405235: (22) Invalid argument 2024-03-09T14:37:18.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.099+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~RB87J026ELZC.0 size=1048576 2024-03-09T14:37:18.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.103+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~RB87J026ELZC.1 size=1014112 2024-03-09T14:37:18.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.103+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=RB87J026ELZC tag=0346VV0ECTJG type=write size=3111264 2024-03-09T14:37:18.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.103+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~NF9ES421VC1G.0 size=1048576 2024-03-09T14:37:18.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.107+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~NF9ES421VC1G.1 size=1048576 2024-03-09T14:37:18.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.107+0000 7fd389e788c0 1 < completed part key=_multipart_1KJK6PF6U226.2~NF9ES421VC1G.2 size=291635 2024-03-09T14:37:18.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.111+0000 7fd389e788c0 1 < completed multipart upload key=1KJK6PF6U226 upload=NF9ES421VC1G tag=NTJFD67IKFJG type=write size=3437363 2024-03-09T14:37:18.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.111+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=70UUCOT2ZXDC type=del size=2770461 2024-03-09T14:37:18.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.111+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=IEK05SHK2Q7M type=del 2024-03-09T14:37:18.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.115+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=HCUJYTXSNFZ8 type=del size=1775362 2024-03-09T14:37:18.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.115+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~R4S2Q48UKGIU.0 size=784669 2024-03-09T14:37:18.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.119+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=R4S2Q48UKGIU tag=NNXX0EQBPC3A type=write size=1833245 2024-03-09T14:37:18.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.123+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=8JY7HXEKAWER type=del size=288681 2024-03-09T14:37:18.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.123+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~NC2C48U64JO9.0 size=859251 2024-03-09T14:37:18.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.127+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=NC2C48U64JO9 tag=5EZ6IYY0864X type=write size=1907827 2024-03-09T14:37:18.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.127+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=NWL7IVFRYAFR type=del size=2890559 2024-03-09T14:37:18.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.131+0000 7fd389e788c0 1 < suggested update operation key=SVTMMQ2QR603 tag=9LX2YF30A2CR type=del size=443634 2024-03-09T14:37:18.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.131+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=PLNMEK0ENOKM type=del size=4186764 2024-03-09T14:37:18.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.135+0000 7fd389e788c0 1 < canceled part key=_multipart_E65PFNHJQHEO.2~8XU6OL4V1Z6U.0 size=1048576 2024-03-09T14:37:18.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.135+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~8XU6OL4V1Z6U.1 size=401257 2024-03-09T14:37:18.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.139+0000 7fd389e788c0 1 < canceled multipart upload key=E65PFNHJQHEO upload=8XU6OL4V1Z6U tag=N4R498VLWDZJ type=write size=2498409 2024-03-09T14:37:18.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.143+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~IEX12LLNODCY.0 size=539154 2024-03-09T14:37:18.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.143+0000 7fd389e788c0 1 > prepared multipart upload key=2405Y4I2Q8TY upload=IEX12LLNODCY tag=EJENHXACQQHR type=write size=1587730 2024-03-09T14:37:18.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.147+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=B3CCITDM9PAM type=del 2024-03-09T14:37:18.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.147+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=50J1AWC0AQB1 type=write size=498212 2024-03-09T14:37:18.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.151+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=2DH5QZTO006O type=del 2024-03-09T14:37:18.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.155+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~7BEZW7L6U5YA.0 size=1048576 2024-03-09T14:37:18.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.155+0000 7fd389e788c0 1 > prepared part key=_multipart_GSNWWDS63MTA.2~7BEZW7L6U5YA.1 size=669775 2024-03-09T14:37:18.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.155+0000 7fd389e788c0 1 > prepared multipart upload key=GSNWWDS63MTA upload=7BEZW7L6U5YA tag=781KQLSV6BZ1 type=write size=2766927 2024-03-09T14:37:18.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.155+0000 7fd389e788c0 1 < completed write operation key=SKIBISETJH7B tag=Q6BKOLVLNHF7 type=write size=901998 2024-03-09T14:37:18.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.159+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=OEYBO1OHU2Q2 type=write size=407328 2024-03-09T14:37:18.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.159+0000 7fd389e788c0 1 < canceled operation key=PKVYD8DWS7M2 tag=NEQUXTTJU83I type=write size=237834 2024-03-09T14:37:18.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.163+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=2K1TQD3AX2O3 type=del size=3384041 2024-03-09T14:37:18.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.167+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=70R9BHJ3RTLY type=del 2024-03-09T14:37:18.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.167+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=I8ZK3M13XYAP type=del size=2371494 2024-03-09T14:37:18.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.171+0000 7fd389e788c0 1 < suggested remove operation key=SKIBISETJH7B tag=AQ52V0UOR2FU type=del 2024-03-09T14:37:18.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.175+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=6XFXPBMNABXO type=del size=1377280 2024-03-09T14:37:18.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.179+0000 7fd389e788c0 1 < suggested update operation key=FLLUAY21DJ12 tag=6PH1OFU1DDNK type=write size=258652 2024-03-09T14:37:18.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.179+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~ES3NZQKZMY22.0 size=243501 2024-03-09T14:37:18.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.179+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=ES3NZQKZMY22 tag=C0NISTN6A6FN type=write size=1292077 2024-03-09T14:37:18.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.183+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~T7KRQNAYT479.0 size=244108 2024-03-09T14:37:18.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.187+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=T7KRQNAYT479 tag=K9059SOMA67I type=write size=1292684 2024-03-09T14:37:18.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.187+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=ASA5V0UGR6RW type=write size=180597 2024-03-09T14:37:18.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.191+0000 7fd389e788c0 1 < suggested remove operation key=ACL1T9GW2JV9 tag=3J0857NQELVW type=write 2024-03-09T14:37:18.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.195+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=MSE992H7AYW9 type=write size=12550 2024-03-09T14:37:18.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.195+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~RB87J026ELZC.0 size=1048576 2024-03-09T14:37:18.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.199+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~RB87J026ELZC.1 size=1014112 2024-03-09T14:37:18.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.203+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=RB87J026ELZC tag=0346VV0ECTJG type=write size=3111264 2024-03-09T14:37:18.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.203+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=4MQFJAWN9I4E type=del size=4017855 2024-03-09T14:37:18.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.207+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=70UUCOT2ZXDC type=del 2024-03-09T14:37:18.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.207+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=9HPT377AWFZE type=del size=3421155 2024-03-09T14:37:18.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.211+0000 7fd389e788c0 1 < suggested update operation key=AUSZ4JUGI6UU tag=HCUJYTXSNFZ8 type=del size=1775362 2024-03-09T14:37:18.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.215+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~J9T2DE6HCQ1E.0 size=4611 2024-03-09T14:37:18.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.215+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=J9T2DE6HCQ1E tag=KIXPWGXFG47Q type=write size=1053187 2024-03-09T14:37:18.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.219+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=8JY7HXEKAWER type=del 2024-03-09T14:37:18.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.219+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~FQGD3JTRJAVS.0 size=1048576 2024-03-09T14:37:18.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.223+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~FQGD3JTRJAVS.1 size=1048576 2024-03-09T14:37:18.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.223+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~FQGD3JTRJAVS.2 size=142320 2024-03-09T14:37:18.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.223+0000 7fd389e788c0 1 > prepared multipart upload key=UMT7VKZ9R4IR upload=FQGD3JTRJAVS tag=JIFS8H7CXS3I type=write size=3288048 2024-03-09T14:37:18.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.227+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=NWL7IVFRYAFR type=del 2024-03-09T14:37:18.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.227+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=TAS1USRLBFL3 type=write size=437275 2024-03-09T14:37:18.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.227+0000 7fd389e788c0 1 < completed delete operation key=UMT7VKZ9R4IR tag=PLNMEK0ENOKM type=del 2024-03-09T14:37:18.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.231+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~CH2APR0N40XQ.0 size=1032035 2024-03-09T14:37:18.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.231+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=CH2APR0N40XQ tag=LVXLT9K394TO type=write size=2080611 2024-03-09T14:37:18.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.235+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~IEX12LLNODCY.0 size=539154 2024-03-09T14:37:18.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.235+0000 7fd389e788c0 1 < completed multipart upload key=2405Y4I2Q8TY upload=IEX12LLNODCY tag=EJENHXACQQHR type=write size=1587730 2024-03-09T14:37:18.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.239+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~EG1QHOA6BR89.0 size=1048576 2024-03-09T14:37:18.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.243+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~EG1QHOA6BR89.1 size=1048576 2024-03-09T14:37:18.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.243+0000 7fd389e788c0 1 > prepared part key=_multipart_61RC3GUU437B.2~EG1QHOA6BR89.2 size=803406 2024-03-09T14:37:18.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.243+0000 7fd389e788c0 1 > prepared multipart upload key=61RC3GUU437B upload=EG1QHOA6BR89 tag=BRQVUQVFO4B2 type=write size=3949134 2024-03-09T14:37:18.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.243+0000 7fd389e788c0 1 < completed write operation key=71692MJQITX3 tag=50J1AWC0AQB1 type=write size=498212 2024-03-09T14:37:18.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.247+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=YUMZ4C7DQFSC type=write size=1007059 2024-03-09T14:37:18.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.247+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~7BEZW7L6U5YA.0 size=1048576 2024-03-09T14:37:18.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.251+0000 7fd389e788c0 1 < completed part key=_multipart_GSNWWDS63MTA.2~7BEZW7L6U5YA.1 size=669775 2024-03-09T14:37:18.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.251+0000 7fd389e788c0 1 < completed multipart upload key=GSNWWDS63MTA upload=7BEZW7L6U5YA tag=781KQLSV6BZ1 type=write size=2766927 2024-03-09T14:37:18.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.255+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~95ZA2ZJ0LRB1.0 size=1048576 2024-03-09T14:37:18.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.255+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~95ZA2ZJ0LRB1.1 size=963867 2024-03-09T14:37:18.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.255+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=95ZA2ZJ0LRB1 tag=764IOM4E01ZT type=write size=3061019 2024-03-09T14:37:18.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.259+0000 7fd389e788c0 1 < completed write operation key=P83H9137MI7Y tag=OEYBO1OHU2Q2 type=write size=407328 2024-03-09T14:37:18.260 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.259+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=NYORZFF9HFI6 type=del size=97046 2024-03-09T14:37:18.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.263+0000 7fd389e788c0 1 < suggested update operation key=PKVYD8DWS7M2 tag=2K1TQD3AX2O3 type=del size=3384041 2024-03-09T14:37:18.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.267+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~PCLI654A0W7G.0 size=708218 2024-03-09T14:37:18.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.267+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=PCLI654A0W7G tag=3SSBWXCOMUDX type=write size=1756794 2024-03-09T14:37:18.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.271+0000 7fd389e788c0 -1 < failed to complete operation key=ACL1T9GW2JV9 tag=I8ZK3M13XYAP type=del size=2371494: (22) Invalid argument 2024-03-09T14:37:18.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.271+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=KWGQN1B5N3TG type=del size=1454465 2024-03-09T14:37:18.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.275+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=6XFXPBMNABXO type=del 2024-03-09T14:37:18.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.275+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~FH08P2OZAXDF.0 size=838768 2024-03-09T14:37:18.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.275+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=FH08P2OZAXDF tag=29H70O3ZNPJ3 type=write size=1887344 2024-03-09T14:37:18.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.279+0000 7fd389e788c0 1 < canceled part key=_multipart_PZJT6RWRJFIN.2~ES3NZQKZMY22.0 size=243501 2024-03-09T14:37:18.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.279+0000 7fd389e788c0 1 < canceled multipart upload key=PZJT6RWRJFIN upload=ES3NZQKZMY22 tag=C0NISTN6A6FN type=write size=1292077 2024-03-09T14:37:18.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.283+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=MDCKPM9M4GAC type=del size=742128 2024-03-09T14:37:18.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.283+0000 7fd389e788c0 1 < completed write operation key=CLAM83TC7RZ7 tag=ASA5V0UGR6RW type=write size=180597 2024-03-09T14:37:18.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.287+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~O1T0S5QBN6VC.0 size=1048576 2024-03-09T14:37:18.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.291+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~O1T0S5QBN6VC.1 size=1048576 2024-03-09T14:37:18.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.291+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~O1T0S5QBN6VC.2 size=44282 2024-03-09T14:37:18.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.291+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=O1T0S5QBN6VC tag=7A6TIHHSQPMA type=write size=3190010 2024-03-09T14:37:18.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.295+0000 7fd389e788c0 1 < completed write operation key=GSNWWDS63MTA tag=MSE992H7AYW9 type=write size=12550 2024-03-09T14:37:18.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.295+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~PSIJ8LYB34TD.0 size=1048576 2024-03-09T14:37:18.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.299+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~PSIJ8LYB34TD.1 size=276689 2024-03-09T14:37:18.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.299+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=PSIJ8LYB34TD tag=DD9WXFMQHM4Q type=write size=2373841 2024-03-09T14:37:18.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.299+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=4MQFJAWN9I4E type=del 2024-03-09T14:37:18.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.303+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~NET5707B0QX5.0 size=221243 2024-03-09T14:37:18.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.303+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=NET5707B0QX5 tag=R23766BC6Q92 type=write size=1269819 2024-03-09T14:37:18.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.307+0000 7fd389e788c0 -1 < failed to complete operation key=AUSZ4JUGI6UU tag=9HPT377AWFZE type=del size=3421155: (22) Invalid argument 2024-03-09T14:37:18.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.307+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=X0454503BN07 type=del size=313493 2024-03-09T14:37:18.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.311+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~J9T2DE6HCQ1E.0 size=4611 2024-03-09T14:37:18.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.315+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=J9T2DE6HCQ1E tag=KIXPWGXFG47Q type=write size=1053187 2024-03-09T14:37:18.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.315+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=DYLB09GYXNP3 type=del size=1086317 2024-03-09T14:37:18.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.319+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~FQGD3JTRJAVS.0 size=1048576 2024-03-09T14:37:18.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.319+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~FQGD3JTRJAVS.1 size=1048576 2024-03-09T14:37:18.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.319+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~FQGD3JTRJAVS.2 size=142320 2024-03-09T14:37:18.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.327+0000 7fd389e788c0 1 < completed multipart upload key=UMT7VKZ9R4IR upload=FQGD3JTRJAVS tag=JIFS8H7CXS3I type=write size=3288048 2024-03-09T14:37:18.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.331+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~3ZHM32LZKR9R.0 size=1048576 2024-03-09T14:37:18.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.331+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~3ZHM32LZKR9R.1 size=596698 2024-03-09T14:37:18.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.331+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=3ZHM32LZKR9R tag=LPZJAMV2FSW2 type=write size=2693850 2024-03-09T14:37:18.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.335+0000 7fd389e788c0 1 < completed write operation key=6VT4C288571G tag=TAS1USRLBFL3 type=write size=437275 2024-03-09T14:37:18.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.335+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=U79F4TNZWVP2 type=write size=645009 2024-03-09T14:37:18.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.339+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~CH2APR0N40XQ.0 size=1032035 2024-03-09T14:37:18.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.339+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=CH2APR0N40XQ tag=LVXLT9K394TO type=write size=2080611 2024-03-09T14:37:18.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.343+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~HFM79VUFOHEX.0 size=1048576 2024-03-09T14:37:18.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.347+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~HFM79VUFOHEX.1 size=1048576 2024-03-09T14:37:18.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.347+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~HFM79VUFOHEX.2 size=701554 2024-03-09T14:37:18.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.347+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=HFM79VUFOHEX tag=CX6DGI7W2AJJ type=write size=3847282 2024-03-09T14:37:18.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.351+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~EG1QHOA6BR89.0 size=1048576 2024-03-09T14:37:18.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.351+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~EG1QHOA6BR89.1 size=1048576 2024-03-09T14:37:18.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.351+0000 7fd389e788c0 1 < completed part key=_multipart_61RC3GUU437B.2~EG1QHOA6BR89.2 size=803406 2024-03-09T14:37:18.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.355+0000 7fd389e788c0 1 < completed multipart upload key=61RC3GUU437B upload=EG1QHOA6BR89 tag=BRQVUQVFO4B2 type=write size=3949134 2024-03-09T14:37:18.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.359+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~8R5ZNVCSH2CQ.0 size=1048576 2024-03-09T14:37:18.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.363+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~8R5ZNVCSH2CQ.1 size=290402 2024-03-09T14:37:18.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.363+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=8R5ZNVCSH2CQ tag=XKN35XPXWLSF type=write size=2387554 2024-03-09T14:37:18.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.363+0000 7fd389e788c0 1 < completed write operation key=SKIBISETJH7B tag=YUMZ4C7DQFSC type=write size=1007059 2024-03-09T14:37:18.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.367+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=JT13OVDA4L26 type=write size=776532 2024-03-09T14:37:18.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.367+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~95ZA2ZJ0LRB1.0 size=1048576 2024-03-09T14:37:18.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.371+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~95ZA2ZJ0LRB1.1 size=963867 2024-03-09T14:37:18.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.375+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=95ZA2ZJ0LRB1 tag=764IOM4E01ZT type=write size=3061019 2024-03-09T14:37:18.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.375+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=2RCJPN13TLWA type=del size=1239298 2024-03-09T14:37:18.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.379+0000 7fd389e788c0 1 < suggested remove operation key=71692MJQITX3 tag=NYORZFF9HFI6 type=del 2024-03-09T14:37:18.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.379+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=7N0GHXTFKB3U type=del size=3618490 2024-03-09T14:37:18.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.383+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~PCLI654A0W7G.0 size=708218 2024-03-09T14:37:18.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.387+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=PCLI654A0W7G tag=3SSBWXCOMUDX type=write size=1756794 2024-03-09T14:37:18.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.387+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~HB524SHYQE0U.0 size=1048576 2024-03-09T14:37:18.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.391+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~HB524SHYQE0U.1 size=799834 2024-03-09T14:37:18.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.391+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=HB524SHYQE0U tag=06DXHW5H6J0B type=write size=2896986 2024-03-09T14:37:18.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.391+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=KWGQN1B5N3TG type=del 2024-03-09T14:37:18.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.395+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=YN411MJ80NFM type=del size=3793075 2024-03-09T14:37:18.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.395+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~FH08P2OZAXDF.0 size=838768 2024-03-09T14:37:18.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.399+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=FH08P2OZAXDF tag=29H70O3ZNPJ3 type=write size=1887344 2024-03-09T14:37:18.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.399+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~FAP3DAMXCSOH.0 size=431031 2024-03-09T14:37:18.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.399+0000 7fd389e788c0 1 > prepared multipart upload key=2405Y4I2Q8TY upload=FAP3DAMXCSOH tag=AM59KRLEI2FI type=write size=1479607 2024-03-09T14:37:18.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.403+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=MDCKPM9M4GAC type=del 2024-03-09T14:37:18.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.403+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=AGTMXGCG23ZX type=del size=4126467 2024-03-09T14:37:18.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.407+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~O1T0S5QBN6VC.0 size=1048576 2024-03-09T14:37:18.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.407+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~O1T0S5QBN6VC.1 size=1048576 2024-03-09T14:37:18.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.407+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~O1T0S5QBN6VC.2 size=44282 2024-03-09T14:37:18.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.411+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=O1T0S5QBN6VC tag=7A6TIHHSQPMA type=write size=3190010 2024-03-09T14:37:18.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.411+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=9AT7B41JFHEM type=del size=2198200 2024-03-09T14:37:18.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.415+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~PSIJ8LYB34TD.0 size=1048576 2024-03-09T14:37:18.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.415+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~PSIJ8LYB34TD.1 size=276689 2024-03-09T14:37:18.419 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.419+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=PSIJ8LYB34TD tag=DD9WXFMQHM4Q type=write size=2373841 2024-03-09T14:37:18.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.423+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~USX97XB2ZIFZ.0 size=1048576 2024-03-09T14:37:18.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.423+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~USX97XB2ZIFZ.1 size=625376 2024-03-09T14:37:18.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.423+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=USX97XB2ZIFZ tag=890GOWHYJDVN type=write size=2722528 2024-03-09T14:37:18.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.423+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~NET5707B0QX5.0 size=221243 2024-03-09T14:37:18.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.427+0000 7fd389e788c0 1 < completed multipart upload key=P83H9137MI7Y upload=NET5707B0QX5 tag=R23766BC6Q92 type=write size=1269819 2024-03-09T14:37:18.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.431+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~6YRFO3YX0AZW.0 size=1048576 2024-03-09T14:37:18.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.431+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~6YRFO3YX0AZW.1 size=1048576 2024-03-09T14:37:18.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.435+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~6YRFO3YX0AZW.2 size=49529 2024-03-09T14:37:18.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.435+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=6YRFO3YX0AZW tag=UO4ANUCX7LV9 type=write size=3195257 2024-03-09T14:37:18.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.435+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=X0454503BN07 type=del 2024-03-09T14:37:18.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.435+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=X87Q40Y5941B type=write size=523792 2024-03-09T14:37:18.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.439+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=DYLB09GYXNP3 type=del 2024-03-09T14:37:18.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.439+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=VELKE8AP21KL type=del size=948572 2024-03-09T14:37:18.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.443+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~3ZHM32LZKR9R.0 size=1048576 2024-03-09T14:37:18.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.443+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~3ZHM32LZKR9R.1 size=596698 2024-03-09T14:37:18.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.447+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=3ZHM32LZKR9R tag=LPZJAMV2FSW2 type=write size=2693850 2024-03-09T14:37:18.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.451+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=G6XOH3L01AW8 type=del size=1567843 2024-03-09T14:37:18.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.455+0000 7fd389e788c0 1 < suggested remove operation key=SVTMMQ2QR603 tag=U79F4TNZWVP2 type=write 2024-03-09T14:37:18.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.455+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=SW3OJ5DZT9VN type=del size=1089809 2024-03-09T14:37:18.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.455+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~HFM79VUFOHEX.0 size=1048576 2024-03-09T14:37:18.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.459+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~HFM79VUFOHEX.1 size=1048576 2024-03-09T14:37:18.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.459+0000 7fd389e788c0 1 < canceled part key=_multipart_FLLUAY21DJ12.2~HFM79VUFOHEX.2 size=701554 2024-03-09T14:37:18.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.463+0000 7fd389e788c0 1 < canceled multipart upload key=FLLUAY21DJ12 upload=HFM79VUFOHEX tag=CX6DGI7W2AJJ type=write size=3847282 2024-03-09T14:37:18.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.463+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=MT5UE7M2W6MY type=write size=714215 2024-03-09T14:37:18.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.467+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~8R5ZNVCSH2CQ.0 size=1048576 2024-03-09T14:37:18.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.467+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~8R5ZNVCSH2CQ.1 size=290402 2024-03-09T14:37:18.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.471+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=8R5ZNVCSH2CQ tag=XKN35XPXWLSF type=write size=2387554 2024-03-09T14:37:18.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.475+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=GFXF0IXFKIB0 type=del size=2778147 2024-03-09T14:37:18.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.475+0000 7fd389e788c0 1 < completed write operation key=UMT7VKZ9R4IR tag=JT13OVDA4L26 type=write size=776532 2024-03-09T14:37:18.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.479+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=61VV5TLBGDAE type=write size=231739 2024-03-09T14:37:18.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.479+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=2RCJPN13TLWA type=del 2024-03-09T14:37:18.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.483+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=T096AJ93BINM type=del size=1261748 2024-03-09T14:37:18.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.487+0000 7fd389e788c0 1 < canceled operation key=6VT4C288571G tag=7N0GHXTFKB3U type=del size=3618490 2024-03-09T14:37:18.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.487+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~YZJE9RQVL1FU.0 size=1048576 2024-03-09T14:37:18.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.491+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~YZJE9RQVL1FU.1 size=1020556 2024-03-09T14:37:18.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.491+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=YZJE9RQVL1FU tag=TYW8A5XKD9CD type=write size=3117708 2024-03-09T14:37:18.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.491+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~HB524SHYQE0U.0 size=1048576 2024-03-09T14:37:18.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.495+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~HB524SHYQE0U.1 size=799834 2024-03-09T14:37:18.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.499+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=HB524SHYQE0U tag=06DXHW5H6J0B type=write size=2896986 2024-03-09T14:37:18.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.503+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=XZPR5Y9TM4KK type=del size=2366903 2024-03-09T14:37:18.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.503+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=YN411MJ80NFM type=del 2024-03-09T14:37:18.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.507+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~6IHKVM7FFUX0.0 size=1048576 2024-03-09T14:37:18.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.511+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~6IHKVM7FFUX0.1 size=1048576 2024-03-09T14:37:18.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.511+0000 7fd389e788c0 1 > prepared part key=_multipart_FY02AR9GS3KG.2~6IHKVM7FFUX0.2 size=916586 2024-03-09T14:37:18.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.511+0000 7fd389e788c0 1 > prepared multipart upload key=FY02AR9GS3KG upload=6IHKVM7FFUX0 tag=SPZJLUBS516X type=write size=4062314 2024-03-09T14:37:18.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.515+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~FAP3DAMXCSOH.0 size=431031 2024-03-09T14:37:18.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.519+0000 7fd389e788c0 1 < completed multipart upload key=2405Y4I2Q8TY upload=FAP3DAMXCSOH tag=AM59KRLEI2FI type=write size=1479607 2024-03-09T14:37:18.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.519+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=UPIBIRTZVC4V type=write size=485910 2024-03-09T14:37:18.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.523+0000 7fd389e788c0 1 < suggested remove operation key=GSNWWDS63MTA tag=AGTMXGCG23ZX type=del 2024-03-09T14:37:18.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.527+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~VDPHXB313LME.0 size=1048576 2024-03-09T14:37:18.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.531+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~VDPHXB313LME.1 size=1048576 2024-03-09T14:37:18.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.531+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~VDPHXB313LME.2 size=1042584 2024-03-09T14:37:18.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.531+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=VDPHXB313LME tag=P79RAHKD1EXP type=write size=4188312 2024-03-09T14:37:18.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.539+0000 7fd389e788c0 1 < suggested remove operation key=Y7E2TLASJM9T tag=9AT7B41JFHEM type=del 2024-03-09T14:37:18.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.539+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=NPIPAGNL7UTB type=del size=2283876 2024-03-09T14:37:18.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.543+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~USX97XB2ZIFZ.0 size=1048576 2024-03-09T14:37:18.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.543+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~USX97XB2ZIFZ.1 size=625376 2024-03-09T14:37:18.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.547+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=USX97XB2ZIFZ tag=890GOWHYJDVN type=write size=2722528 2024-03-09T14:37:18.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.551+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=SAF07BUHO1CU type=del size=4170359 2024-03-09T14:37:18.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.551+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~6YRFO3YX0AZW.0 size=1048576 2024-03-09T14:37:18.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.555+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~6YRFO3YX0AZW.1 size=1048576 2024-03-09T14:37:18.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.555+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~6YRFO3YX0AZW.2 size=49529 2024-03-09T14:37:18.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.559+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=6YRFO3YX0AZW tag=UO4ANUCX7LV9 type=write size=3195257 2024-03-09T14:37:18.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.563+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~J8TWSFBU9VVR.0 size=1048576 2024-03-09T14:37:18.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.563+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~J8TWSFBU9VVR.1 size=364215 2024-03-09T14:37:18.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.563+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=J8TWSFBU9VVR tag=OE4QPKBB2BN3 type=write size=2461367 2024-03-09T14:37:18.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.567+0000 7fd389e788c0 1 < completed write operation key=E2VP0TJ37UX8 tag=X87Q40Y5941B type=write size=523792 2024-03-09T14:37:18.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.571+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=I372IY1VVWAB type=del size=1757314 2024-03-09T14:37:18.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.571+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=VELKE8AP21KL type=del 2024-03-09T14:37:18.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.575+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=KAXOZNXL6684 type=del size=1617231 2024-03-09T14:37:18.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.575+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=G6XOH3L01AW8 type=del 2024-03-09T14:37:18.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.579+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~Z7NIPLG32SE4.0 size=1048576 2024-03-09T14:37:18.582 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.583+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~Z7NIPLG32SE4.1 size=1048576 2024-03-09T14:37:18.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.583+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~Z7NIPLG32SE4.2 size=335158 2024-03-09T14:37:18.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.583+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=Z7NIPLG32SE4 tag=4O3LW3UD15LR type=write size=3480886 2024-03-09T14:37:18.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.587+0000 7fd389e788c0 1 < canceled operation key=6VT4C288571G tag=SW3OJ5DZT9VN type=del size=1089809 2024-03-09T14:37:18.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.591+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~ET0587W8H4M7.0 size=1048576 2024-03-09T14:37:18.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.591+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~ET0587W8H4M7.1 size=1048576 2024-03-09T14:37:18.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.595+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~ET0587W8H4M7.2 size=893716 2024-03-09T14:37:18.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.595+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=ET0587W8H4M7 tag=01TY0AKLT3WF type=write size=4039444 2024-03-09T14:37:18.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.595+0000 7fd389e788c0 1 < completed write operation key=5ZEDXFB9B3CN tag=MT5UE7M2W6MY type=write size=714215 2024-03-09T14:37:18.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.599+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~JURRZS2BZY87.0 size=165992 2024-03-09T14:37:18.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.599+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=JURRZS2BZY87 tag=GNFY8Q5YI9IQ type=write size=1214568 2024-03-09T14:37:18.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.603+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=GFXF0IXFKIB0 type=del 2024-03-09T14:37:18.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.603+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=16NAQT7N1GAD type=del size=3021306 2024-03-09T14:37:18.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.607+0000 7fd389e788c0 1 < canceled operation key=DIN8WJ9Z9OI8 tag=61VV5TLBGDAE type=write size=231739 2024-03-09T14:37:18.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.607+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=3SXQVMQQ0PJH type=del size=2303373 2024-03-09T14:37:18.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.611+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=T096AJ93BINM type=del 2024-03-09T14:37:18.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.611+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=IU8V03MLWE7I type=del size=1714657 2024-03-09T14:37:18.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.615+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~YZJE9RQVL1FU.0 size=1048576 2024-03-09T14:37:18.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.615+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~YZJE9RQVL1FU.1 size=1020556 2024-03-09T14:37:18.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.619+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=YZJE9RQVL1FU tag=TYW8A5XKD9CD type=write size=3117708 2024-03-09T14:37:18.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.623+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=9P8L84KMAFL1 type=del size=3036276 2024-03-09T14:37:18.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.623+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=XZPR5Y9TM4KK type=del 2024-03-09T14:37:18.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.627+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~RVQ0S7AZSSXR.0 size=1048576 2024-03-09T14:37:18.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.627+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~RVQ0S7AZSSXR.1 size=668442 2024-03-09T14:37:18.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.627+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=RVQ0S7AZSSXR tag=7YXOV014QZLB type=write size=2765594 2024-03-09T14:37:18.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.631+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~6IHKVM7FFUX0.0 size=1048576 2024-03-09T14:37:18.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.631+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~6IHKVM7FFUX0.1 size=1048576 2024-03-09T14:37:18.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.635+0000 7fd389e788c0 1 < completed part key=_multipart_FY02AR9GS3KG.2~6IHKVM7FFUX0.2 size=916586 2024-03-09T14:37:18.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.639+0000 7fd389e788c0 1 < completed multipart upload key=FY02AR9GS3KG upload=6IHKVM7FFUX0 tag=SPZJLUBS516X type=write size=4062314 2024-03-09T14:37:18.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.643+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=2IYWXR2GRU42 type=del size=1525718 2024-03-09T14:37:18.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.643+0000 7fd389e788c0 1 < completed write operation key=6VT4C288571G tag=UPIBIRTZVC4V type=write size=485910 2024-03-09T14:37:18.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.647+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=RRE783F1088P type=del size=1488276 2024-03-09T14:37:18.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.647+0000 7fd389e788c0 1 < canceled part key=_multipart_E2VP0TJ37UX8.2~VDPHXB313LME.0 size=1048576 2024-03-09T14:37:18.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.647+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~VDPHXB313LME.1 size=1048576 2024-03-09T14:37:18.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.651+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~VDPHXB313LME.2 size=1042584 2024-03-09T14:37:18.653 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.655+0000 7fd389e788c0 1 < canceled multipart upload key=E2VP0TJ37UX8 upload=VDPHXB313LME tag=P79RAHKD1EXP type=write size=4188312 2024-03-09T14:37:18.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.655+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=QWC3HRA4RGRI type=del size=2650520 2024-03-09T14:37:18.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.659+0000 7fd389e788c0 1 < suggested update operation key=FY02AR9GS3KG tag=NPIPAGNL7UTB type=del size=2283876 2024-03-09T14:37:18.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.663+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~N3M2O13F8JZ2.0 size=698671 2024-03-09T14:37:18.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.663+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=N3M2O13F8JZ2 tag=CU1BRUI6CUG7 type=write size=1747247 2024-03-09T14:37:18.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.667+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=SAF07BUHO1CU type=del 2024-03-09T14:37:18.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.667+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=4RIW65GJDPTR type=del size=284625 2024-03-09T14:37:18.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.671+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~J8TWSFBU9VVR.0 size=1048576 2024-03-09T14:37:18.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.671+0000 7fd389e788c0 1 < canceled part key=_multipart_P83H9137MI7Y.2~J8TWSFBU9VVR.1 size=364215 2024-03-09T14:37:18.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.675+0000 7fd389e788c0 1 < canceled multipart upload key=P83H9137MI7Y upload=J8TWSFBU9VVR tag=OE4QPKBB2BN3 type=write size=2461367 2024-03-09T14:37:18.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.675+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=ZEZ3ZV754T1F type=del size=1857541 2024-03-09T14:37:18.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.679+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=I372IY1VVWAB type=del 2024-03-09T14:37:18.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.683+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=Q3ZVTM5ZOSQN type=del size=3661565 2024-03-09T14:37:18.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.683+0000 7fd389e788c0 1 < completed delete operation key=PKVYD8DWS7M2 tag=KAXOZNXL6684 type=del 2024-03-09T14:37:18.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.687+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=MCWPFSGQGJQV type=write size=666024 2024-03-09T14:37:18.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.687+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~Z7NIPLG32SE4.0 size=1048576 2024-03-09T14:37:18.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.691+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~Z7NIPLG32SE4.1 size=1048576 2024-03-09T14:37:18.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.691+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~Z7NIPLG32SE4.2 size=335158 2024-03-09T14:37:18.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.695+0000 7fd389e788c0 1 < completed multipart upload key=71692MJQITX3 upload=Z7NIPLG32SE4 tag=4O3LW3UD15LR type=write size=3480886 2024-03-09T14:37:18.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.695+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=SR5DWQZHTATV type=write size=110975 2024-03-09T14:37:18.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.699+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~ET0587W8H4M7.0 size=1048576 2024-03-09T14:37:18.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.699+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~ET0587W8H4M7.1 size=1048576 2024-03-09T14:37:18.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.703+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~ET0587W8H4M7.2 size=893716 2024-03-09T14:37:18.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.707+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=ET0587W8H4M7 tag=01TY0AKLT3WF type=write size=4039444 2024-03-09T14:37:18.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.711+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=IUUJHJ5WO8FO type=del size=1852913 2024-03-09T14:37:18.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.715+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~JURRZS2BZY87.0 size=165992 2024-03-09T14:37:18.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.715+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=JURRZS2BZY87 tag=GNFY8Q5YI9IQ type=write size=1214568 2024-03-09T14:37:18.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.719+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=07KNZOEJCNYR type=write size=514702 2024-03-09T14:37:18.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.719+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=16NAQT7N1GAD type=del 2024-03-09T14:37:18.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.723+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=7FOYGJUYHACD type=del size=3392730 2024-03-09T14:37:18.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.723+0000 7fd389e788c0 1 < completed delete operation key=6VT4C288571G tag=3SXQVMQQ0PJH type=del 2024-03-09T14:37:18.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.727+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=8N0MWG01PETJ type=del size=3193163 2024-03-09T14:37:18.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.727+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=IU8V03MLWE7I type=del 2024-03-09T14:37:18.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.731+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=9ID78PYABYMC type=del size=2633030 2024-03-09T14:37:18.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.735+0000 7fd389e788c0 1 < suggested remove operation key=Z18Q66VI5PDN tag=9P8L84KMAFL1 type=del 2024-03-09T14:37:18.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.735+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=5PZ1QUAJP94C type=del size=2832305 2024-03-09T14:37:18.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.739+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~RVQ0S7AZSSXR.0 size=1048576 2024-03-09T14:37:18.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.739+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~RVQ0S7AZSSXR.1 size=668442 2024-03-09T14:37:18.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.743+0000 7fd389e788c0 1 < completed multipart upload key=Z18Q66VI5PDN upload=RVQ0S7AZSSXR tag=7YXOV014QZLB type=write size=2765594 2024-03-09T14:37:18.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.747+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=QSLSG1IDPPLD type=del size=3436635 2024-03-09T14:37:18.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.747+0000 7fd389e788c0 1 < canceled operation key=MHT268M7S2TY tag=2IYWXR2GRU42 type=del size=1525718 2024-03-09T14:37:18.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.751+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=NO2ND3Y39ZV6 type=del size=2831970 2024-03-09T14:37:18.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.755+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=RRE783F1088P type=del 2024-03-09T14:37:18.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.755+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=GT2SS6PINJ6D type=del size=3680559 2024-03-09T14:37:18.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.759+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=QWC3HRA4RGRI type=del 2024-03-09T14:37:18.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.763+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~I1Z65NPN3C9F.0 size=625511 2024-03-09T14:37:18.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.763+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=I1Z65NPN3C9F tag=SCUM0JZP3GVQ type=write size=1674087 2024-03-09T14:37:18.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.767+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~N3M2O13F8JZ2.0 size=698671 2024-03-09T14:37:18.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.767+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=N3M2O13F8JZ2 tag=CU1BRUI6CUG7 type=write size=1747247 2024-03-09T14:37:18.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.771+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=X1UA1HBIW1TM type=del size=4075897 2024-03-09T14:37:18.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.771+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=4RIW65GJDPTR type=del 2024-03-09T14:37:18.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.775+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=247D68YBF8JZ type=del size=172779 2024-03-09T14:37:18.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.775+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=ZEZ3ZV754T1F type=del 2024-03-09T14:37:18.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.779+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~2F88GX5Q3SKL.0 size=1048576 2024-03-09T14:37:18.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.783+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~2F88GX5Q3SKL.1 size=1048576 2024-03-09T14:37:18.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.783+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~2F88GX5Q3SKL.2 size=508260 2024-03-09T14:37:18.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.783+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=2F88GX5Q3SKL tag=H0JU5NTGNFW0 type=write size=3653988 2024-03-09T14:37:18.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.787+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=Q3ZVTM5ZOSQN type=del 2024-03-09T14:37:18.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.787+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=S0FH22BNSJDT type=write size=182754 2024-03-09T14:37:18.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.791+0000 7fd389e788c0 1 < completed write operation key=K9X2N6V8R4BY tag=MCWPFSGQGJQV type=write size=666024 2024-03-09T14:37:18.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.791+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=YXGV3ROJL28B type=del size=3466164 2024-03-09T14:37:18.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.795+0000 7fd389e788c0 1 < suggested update operation key=U8P5Q3D11MM6 tag=SR5DWQZHTATV type=write size=110975 2024-03-09T14:37:18.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.799+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~QBJRV86SFN04.0 size=1048576 2024-03-09T14:37:18.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.803+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~QBJRV86SFN04.1 size=1048576 2024-03-09T14:37:18.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.803+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~QBJRV86SFN04.2 size=412413 2024-03-09T14:37:18.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.803+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=QBJRV86SFN04 tag=7QRQUF1WHYCI type=write size=3558141 2024-03-09T14:37:18.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.803+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=IUUJHJ5WO8FO type=del 2024-03-09T14:37:18.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.807+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=N6ASGAG2LLBK type=write size=103929 2024-03-09T14:37:18.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.811+0000 7fd389e788c0 1 < completed write operation key=PKVYD8DWS7M2 tag=07KNZOEJCNYR type=write size=514702 2024-03-09T14:37:18.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.811+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=Z0DYQN6U4X66 type=write size=539135 2024-03-09T14:37:18.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.815+0000 7fd389e788c0 1 < suggested update operation key=K9X2N6V8R4BY tag=7FOYGJUYHACD type=del size=3392730 2024-03-09T14:37:18.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.819+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~OP3KW2XIC44T.0 size=211679 2024-03-09T14:37:18.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.819+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=OP3KW2XIC44T tag=0VZE3CTVJQ8B type=write size=1260255 2024-03-09T14:37:18.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.823+0000 7fd389e788c0 1 < suggested update operation key=71692MJQITX3 tag=8N0MWG01PETJ type=del size=3193163 2024-03-09T14:37:18.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.827+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~JEM964MMUQ8K.0 size=1048576 2024-03-09T14:37:18.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.827+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~JEM964MMUQ8K.1 size=837655 2024-03-09T14:37:18.829 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.827+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=JEM964MMUQ8K tag=4GULSJ6HHKJQ type=write size=2934807 2024-03-09T14:37:18.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.831+0000 7fd389e788c0 1 < canceled operation key=ACL1T9GW2JV9 tag=9ID78PYABYMC type=del size=2633030 2024-03-09T14:37:18.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.835+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~7E64KJ4S6VLQ.0 size=1048576 2024-03-09T14:37:18.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.835+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~7E64KJ4S6VLQ.1 size=1048576 2024-03-09T14:37:18.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.839+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~7E64KJ4S6VLQ.2 size=800829 2024-03-09T14:37:18.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.839+0000 7fd389e788c0 1 > prepared multipart upload key=UMT7VKZ9R4IR upload=7E64KJ4S6VLQ tag=P26C0P2FW5E1 type=write size=3946557 2024-03-09T14:37:18.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.839+0000 7fd389e788c0 -1 < failed to complete operation key=U8P5Q3D11MM6 tag=5PZ1QUAJP94C type=del size=2832305: (22) Invalid argument 2024-03-09T14:37:18.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.843+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~YZYVRUGSUPKR.0 size=1048576 2024-03-09T14:37:18.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.843+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~YZYVRUGSUPKR.1 size=1048576 2024-03-09T14:37:18.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.847+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~YZYVRUGSUPKR.2 size=837953 2024-03-09T14:37:18.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.847+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=YZYVRUGSUPKR tag=BEAOEW2GLMFD type=write size=3983681 2024-03-09T14:37:18.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.847+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=QSLSG1IDPPLD type=del 2024-03-09T14:37:18.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.851+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=4T50IONZRSVW type=del size=273295 2024-03-09T14:37:18.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.855+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=NO2ND3Y39ZV6 type=del 2024-03-09T14:37:18.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.859+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~MH4SBATP7HGT.0 size=734671 2024-03-09T14:37:18.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.859+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=MH4SBATP7HGT tag=0D84HWRBB5OI type=write size=1783247 2024-03-09T14:37:18.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.859+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=GT2SS6PINJ6D type=del 2024-03-09T14:37:18.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.863+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=SXPOGEDRYIY3 type=del size=314051 2024-03-09T14:37:18.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.863+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~I1Z65NPN3C9F.0 size=625511 2024-03-09T14:37:18.869 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.867+0000 7fd389e788c0 1 < completed multipart upload key=Y7E2TLASJM9T upload=I1Z65NPN3C9F tag=SCUM0JZP3GVQ type=write size=1674087 2024-03-09T14:37:18.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.875+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~25FY7QK3EPLE.0 size=1048576 2024-03-09T14:37:18.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.875+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~25FY7QK3EPLE.1 size=1048576 2024-03-09T14:37:18.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.879+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~25FY7QK3EPLE.2 size=571363 2024-03-09T14:37:18.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.879+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=25FY7QK3EPLE tag=JJ7JLZ1LMI08 type=write size=3717091 2024-03-09T14:37:18.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.879+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=X1UA1HBIW1TM type=del 2024-03-09T14:37:18.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.883+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=KANLXZPD7KPN type=write size=350670 2024-03-09T14:37:18.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.887+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=247D68YBF8JZ type=del 2024-03-09T14:37:18.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.887+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=P4FS0ZHYOTQL type=del size=393446 2024-03-09T14:37:18.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.891+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~2F88GX5Q3SKL.0 size=1048576 2024-03-09T14:37:18.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.891+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~2F88GX5Q3SKL.1 size=1048576 2024-03-09T14:37:18.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.895+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~2F88GX5Q3SKL.2 size=508260 2024-03-09T14:37:18.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.899+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=2F88GX5Q3SKL tag=H0JU5NTGNFW0 type=write size=3653988 2024-03-09T14:37:18.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.899+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=X7BSY8VIYC0D type=write size=91249 2024-03-09T14:37:18.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.903+0000 7fd389e788c0 1 < completed write operation key=PKVYD8DWS7M2 tag=S0FH22BNSJDT type=write size=182754 2024-03-09T14:37:18.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.903+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=K5KAP7IXKVS4 type=write size=1036981 2024-03-09T14:37:18.908 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.907+0000 7fd389e788c0 1 < suggested update operation key=PKVYD8DWS7M2 tag=YXGV3ROJL28B type=del size=3466164 2024-03-09T14:37:18.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.911+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=I41H40NZBMV4 type=del size=317796 2024-03-09T14:37:18.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.915+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~QBJRV86SFN04.0 size=1048576 2024-03-09T14:37:18.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.919+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~QBJRV86SFN04.1 size=1048576 2024-03-09T14:37:18.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.919+0000 7fd389e788c0 1 < canceled part key=_multipart_PZJT6RWRJFIN.2~QBJRV86SFN04.2 size=412413 2024-03-09T14:37:18.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.923+0000 7fd389e788c0 1 < canceled multipart upload key=PZJT6RWRJFIN upload=QBJRV86SFN04 tag=7QRQUF1WHYCI type=write size=3558141 2024-03-09T14:37:18.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.923+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=EMXC9868LTM3 type=write size=612761 2024-03-09T14:37:18.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.927+0000 7fd389e788c0 -1 < failed to complete operation key=K9X2N6V8R4BY tag=N6ASGAG2LLBK type=write size=103929: (22) Invalid argument 2024-03-09T14:37:18.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.931+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~4POAWUCUPKY2.0 size=1048576 2024-03-09T14:37:18.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.931+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~4POAWUCUPKY2.1 size=153285 2024-03-09T14:37:18.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.931+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=4POAWUCUPKY2 tag=GP9430SPNV30 type=write size=2250437 2024-03-09T14:37:18.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.935+0000 7fd389e788c0 1 < suggested update operation key=MHT268M7S2TY tag=Z0DYQN6U4X66 type=write size=539135 2024-03-09T14:37:18.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.939+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=Z5O4VRQCRURL type=del size=2687073 2024-03-09T14:37:18.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.939+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~OP3KW2XIC44T.0 size=211679 2024-03-09T14:37:18.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.943+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=OP3KW2XIC44T tag=0VZE3CTVJQ8B type=write size=1260255 2024-03-09T14:37:18.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.947+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=2CMA8XD81S4K type=del size=1341982 2024-03-09T14:37:18.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.947+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~JEM964MMUQ8K.0 size=1048576 2024-03-09T14:37:18.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.951+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~JEM964MMUQ8K.1 size=837655 2024-03-09T14:37:18.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.955+0000 7fd389e788c0 1 < completed multipart upload key=Y7E2TLASJM9T upload=JEM964MMUQ8K tag=4GULSJ6HHKJQ type=write size=2934807 2024-03-09T14:37:18.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.955+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=2Y8WW4K3IHC1 type=write size=449478 2024-03-09T14:37:18.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.959+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~7E64KJ4S6VLQ.0 size=1048576 2024-03-09T14:37:18.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.959+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~7E64KJ4S6VLQ.1 size=1048576 2024-03-09T14:37:18.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.963+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~7E64KJ4S6VLQ.2 size=800829 2024-03-09T14:37:18.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.967+0000 7fd389e788c0 1 < completed multipart upload key=UMT7VKZ9R4IR upload=7E64KJ4S6VLQ tag=P26C0P2FW5E1 type=write size=3946557 2024-03-09T14:37:18.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.967+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=KMA1LO9557WT type=del size=590957 2024-03-09T14:37:18.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.971+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~YZYVRUGSUPKR.0 size=1048576 2024-03-09T14:37:18.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.971+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~YZYVRUGSUPKR.1 size=1048576 2024-03-09T14:37:18.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.975+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~YZYVRUGSUPKR.2 size=837953 2024-03-09T14:37:18.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.979+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=YZYVRUGSUPKR tag=BEAOEW2GLMFD type=write size=3983681 2024-03-09T14:37:18.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.983+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~3HRU7B6BEGBD.0 size=1048576 2024-03-09T14:37:18.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.983+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~3HRU7B6BEGBD.1 size=1048576 2024-03-09T14:37:18.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.987+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~3HRU7B6BEGBD.2 size=253272 2024-03-09T14:37:18.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.987+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=3HRU7B6BEGBD tag=V6B0XAPXV0Y0 type=write size=3399000 2024-03-09T14:37:18.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.987+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=4T50IONZRSVW type=del 2024-03-09T14:37:18.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.991+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=QTCWKQ1PAWQO type=del size=1832431 2024-03-09T14:37:18.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.991+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~MH4SBATP7HGT.0 size=734671 2024-03-09T14:37:18.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.995+0000 7fd389e788c0 1 < completed multipart upload key=Y7E2TLASJM9T upload=MH4SBATP7HGT tag=0D84HWRBB5OI type=write size=1783247 2024-03-09T14:37:18.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.999+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=P7YBAIGEAO0Y type=del size=3092155 2024-03-09T14:37:18.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:18.999+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=SXPOGEDRYIY3 type=del 2024-03-09T14:37:19.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.003+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~4111S4BR3C1X.0 size=1048576 2024-03-09T14:37:19.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.003+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~4111S4BR3C1X.1 size=1048576 2024-03-09T14:37:19.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.007+0000 7fd389e788c0 1 > prepared part key=_multipart_I4NA328AI5T1.2~4111S4BR3C1X.2 size=514780 2024-03-09T14:37:19.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.007+0000 7fd389e788c0 1 > prepared multipart upload key=I4NA328AI5T1 upload=4111S4BR3C1X tag=201T12K2QK6L type=write size=3660508 2024-03-09T14:37:19.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.007+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~25FY7QK3EPLE.0 size=1048576 2024-03-09T14:37:19.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.011+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~25FY7QK3EPLE.1 size=1048576 2024-03-09T14:37:19.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.011+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~25FY7QK3EPLE.2 size=571363 2024-03-09T14:37:19.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.015+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=25FY7QK3EPLE tag=JJ7JLZ1LMI08 type=write size=3717091 2024-03-09T14:37:19.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.019+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~2WT1HNZNFBJS.0 size=1048576 2024-03-09T14:37:19.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.019+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~2WT1HNZNFBJS.1 size=850739 2024-03-09T14:37:19.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.019+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=2WT1HNZNFBJS tag=5M54LW6GI6FS type=write size=2947891 2024-03-09T14:37:19.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.023+0000 7fd389e788c0 1 < completed write operation key=PZJT6RWRJFIN tag=KANLXZPD7KPN type=write size=350670 2024-03-09T14:37:19.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.023+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=IFIV1MKDBY1B type=del size=3282267 2024-03-09T14:37:19.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.027+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=P4FS0ZHYOTQL type=del 2024-03-09T14:37:19.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.027+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=LHLXYPYET90I type=write size=877993 2024-03-09T14:37:19.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.031+0000 7fd389e788c0 1 < completed write operation key=K9X2N6V8R4BY tag=X7BSY8VIYC0D type=write size=91249 2024-03-09T14:37:19.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.035+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~5P1UBDP6A2OS.0 size=1018498 2024-03-09T14:37:19.034 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.035+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=5P1UBDP6A2OS tag=LD7L451KRSNS type=write size=2067074 2024-03-09T14:37:19.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.035+0000 7fd389e788c0 1 < completed write operation key=1K5KR8U3GCOV tag=K5KAP7IXKVS4 type=write size=1036981 2024-03-09T14:37:19.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.035+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=ZT3ZSCDFE7W2 type=del size=3022251 2024-03-09T14:37:19.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.039+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=I41H40NZBMV4 type=del 2024-03-09T14:37:19.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.043+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=JQPMNBDOE7XI type=del size=1380327 2024-03-09T14:37:19.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.043+0000 7fd389e788c0 1 < completed write operation key=E65PFNHJQHEO tag=EMXC9868LTM3 type=write size=612761 2024-03-09T14:37:19.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.047+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=3OJU9CUQ2G2F type=del size=1832053 2024-03-09T14:37:19.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.047+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~4POAWUCUPKY2.0 size=1048576 2024-03-09T14:37:19.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.051+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~4POAWUCUPKY2.1 size=153285 2024-03-09T14:37:19.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.055+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=4POAWUCUPKY2 tag=GP9430SPNV30 type=write size=2250437 2024-03-09T14:37:19.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.055+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=CKNG69EYGOP9 type=del size=1422133 2024-03-09T14:37:19.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.059+0000 7fd389e788c0 1 < completed delete operation key=UMT7VKZ9R4IR tag=Z5O4VRQCRURL type=del 2024-03-09T14:37:19.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.059+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=1OUSL41F1OFT type=del size=3319098 2024-03-09T14:37:19.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.063+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=2CMA8XD81S4K type=del 2024-03-09T14:37:19.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.067+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=ZT7J7JJ1026Q type=del size=136414 2024-03-09T14:37:19.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.067+0000 7fd389e788c0 1 < completed write operation key=U8P5Q3D11MM6 tag=2Y8WW4K3IHC1 type=write size=449478 2024-03-09T14:37:19.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.071+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~2CUO2MH56BHD.0 size=1048576 2024-03-09T14:37:19.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.075+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~2CUO2MH56BHD.1 size=1048576 2024-03-09T14:37:19.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.075+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~2CUO2MH56BHD.2 size=91047 2024-03-09T14:37:19.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.075+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=2CUO2MH56BHD tag=NSA2TMXSXBW4 type=write size=3236775 2024-03-09T14:37:19.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.079+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=KMA1LO9557WT type=del 2024-03-09T14:37:19.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.083+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~P47E5KT4NMUM.0 size=1048576 2024-03-09T14:37:19.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.087+0000 7fd389e788c0 1 > prepared part key=_multipart_PZJT6RWRJFIN.2~P47E5KT4NMUM.1 size=273156 2024-03-09T14:37:19.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.087+0000 7fd389e788c0 1 > prepared multipart upload key=PZJT6RWRJFIN upload=P47E5KT4NMUM tag=B53M1F9771YA type=write size=2370308 2024-03-09T14:37:19.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.087+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~3HRU7B6BEGBD.0 size=1048576 2024-03-09T14:37:19.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.091+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~3HRU7B6BEGBD.1 size=1048576 2024-03-09T14:37:19.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.091+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~3HRU7B6BEGBD.2 size=253272 2024-03-09T14:37:19.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.095+0000 7fd389e788c0 1 < completed multipart upload key=IXKMXJ9IZ69S upload=3HRU7B6BEGBD tag=V6B0XAPXV0Y0 type=write size=3399000 2024-03-09T14:37:19.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.099+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=AXWT0BADLHVM type=del size=1647393 2024-03-09T14:37:19.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.099+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=QTCWKQ1PAWQO type=del 2024-03-09T14:37:19.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.103+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=PYBP3ND0YPF2 type=write size=386910 2024-03-09T14:37:19.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.103+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=P7YBAIGEAO0Y type=del 2024-03-09T14:37:19.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.107+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~S3VVIVB3H6V2.0 size=1048576 2024-03-09T14:37:19.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.111+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~S3VVIVB3H6V2.1 size=1048576 2024-03-09T14:37:19.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.111+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~S3VVIVB3H6V2.2 size=764544 2024-03-09T14:37:19.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.111+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=S3VVIVB3H6V2 tag=LML4QWDPZ1ZE type=write size=3910272 2024-03-09T14:37:19.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.119+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~4111S4BR3C1X.0 size=1048576 2024-03-09T14:37:19.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.119+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~4111S4BR3C1X.1 size=1048576 2024-03-09T14:37:19.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.123+0000 7fd389e788c0 1 < completed part key=_multipart_I4NA328AI5T1.2~4111S4BR3C1X.2 size=514780 2024-03-09T14:37:19.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.127+0000 7fd389e788c0 1 < completed multipart upload key=I4NA328AI5T1 upload=4111S4BR3C1X tag=201T12K2QK6L type=write size=3660508 2024-03-09T14:37:19.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.127+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=93C778F89ZZ6 type=del size=423603 2024-03-09T14:37:19.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.131+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~2WT1HNZNFBJS.0 size=1048576 2024-03-09T14:37:19.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.131+0000 7fd389e788c0 1 < canceled part key=_multipart_IXKMXJ9IZ69S.2~2WT1HNZNFBJS.1 size=850739 2024-03-09T14:37:19.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.135+0000 7fd389e788c0 1 < canceled multipart upload key=IXKMXJ9IZ69S upload=2WT1HNZNFBJS tag=5M54LW6GI6FS type=write size=2947891 2024-03-09T14:37:19.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.135+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=9IF9XZEY6UY9 type=del size=1868893 2024-03-09T14:37:19.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.143+0000 7fd389e788c0 1 < suggested remove operation key=AUSZ4JUGI6UU tag=IFIV1MKDBY1B type=del 2024-03-09T14:37:19.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.143+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=NEQXIZRQLA1P type=del size=2624480 2024-03-09T14:37:19.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.147+0000 7fd389e788c0 1 < canceled operation key=CLAM83TC7RZ7 tag=LHLXYPYET90I type=write size=877993 2024-03-09T14:37:19.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.147+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=3ZI2IKENQJAN type=del size=4008623 2024-03-09T14:37:19.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.151+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~5P1UBDP6A2OS.0 size=1018498 2024-03-09T14:37:19.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.155+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=5P1UBDP6A2OS tag=LD7L451KRSNS type=write size=2067074 2024-03-09T14:37:19.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.155+0000 7fd389e788c0 1 > prepared operation key=6VT4C288571G tag=S25DNDMUHOYJ type=write size=653889 2024-03-09T14:37:19.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.159+0000 7fd389e788c0 1 < canceled operation key=MHT268M7S2TY tag=ZT3ZSCDFE7W2 type=del size=3022251 2024-03-09T14:37:19.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.159+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=CW1VZUSJVP25 type=del size=418677 2024-03-09T14:37:19.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.163+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=JQPMNBDOE7XI type=del 2024-03-09T14:37:19.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.167+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~W7I86D3RRMOP.0 size=801409 2024-03-09T14:37:19.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.167+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=W7I86D3RRMOP tag=P2N62IA2DOMD type=write size=1849985 2024-03-09T14:37:19.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.171+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=3OJU9CUQ2G2F type=del 2024-03-09T14:37:19.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.175+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=VWOFLRXOPX9L type=del size=1543671 2024-03-09T14:37:19.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.175+0000 7fd389e788c0 -1 < failed to complete operation key=AUSZ4JUGI6UU tag=CKNG69EYGOP9 type=del size=1422133: (22) Invalid argument 2024-03-09T14:37:19.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.179+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=32M2JDH4T506 type=write size=836666 2024-03-09T14:37:19.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.183+0000 7fd389e788c0 1 < canceled operation key=E65PFNHJQHEO tag=1OUSL41F1OFT type=del size=3319098 2024-03-09T14:37:19.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.187+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~UM0UFS359CKT.0 size=678098 2024-03-09T14:37:19.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.187+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=UM0UFS359CKT tag=4BGJOUVFMX6S type=write size=1726674 2024-03-09T14:37:19.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.191+0000 7fd389e788c0 1 < completed delete operation key=PKVYD8DWS7M2 tag=ZT7J7JJ1026Q type=del 2024-03-09T14:37:19.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.195+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=0UXK0G5BQSMA type=del size=4071869 2024-03-09T14:37:19.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.195+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~2CUO2MH56BHD.0 size=1048576 2024-03-09T14:37:19.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.199+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~2CUO2MH56BHD.1 size=1048576 2024-03-09T14:37:19.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.199+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~2CUO2MH56BHD.2 size=91047 2024-03-09T14:37:19.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.203+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=2CUO2MH56BHD tag=NSA2TMXSXBW4 type=write size=3236775 2024-03-09T14:37:19.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.207+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=Z65F3S08193C type=del size=350032 2024-03-09T14:37:19.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.211+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~P47E5KT4NMUM.0 size=1048576 2024-03-09T14:37:19.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.211+0000 7fd389e788c0 1 < completed part key=_multipart_PZJT6RWRJFIN.2~P47E5KT4NMUM.1 size=273156 2024-03-09T14:37:19.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.215+0000 7fd389e788c0 1 < completed multipart upload key=PZJT6RWRJFIN upload=P47E5KT4NMUM tag=B53M1F9771YA type=write size=2370308 2024-03-09T14:37:19.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.219+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=XMZQ0D423V2G type=write size=449445 2024-03-09T14:37:19.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.223+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=AXWT0BADLHVM type=del 2024-03-09T14:37:19.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.227+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~F7I3URFB8CBX.0 size=1048576 2024-03-09T14:37:19.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.227+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~F7I3URFB8CBX.1 size=1048576 2024-03-09T14:37:19.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.231+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~F7I3URFB8CBX.2 size=815680 2024-03-09T14:37:19.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.231+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=F7I3URFB8CBX tag=KZQB2JX397RC type=write size=3961408 2024-03-09T14:37:19.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.231+0000 7fd389e788c0 -1 < failed to complete operation key=AUSZ4JUGI6UU tag=PYBP3ND0YPF2 type=write size=386910: (22) Invalid argument 2024-03-09T14:37:19.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.235+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=U360AOQLAPF5 type=del size=3549923 2024-03-09T14:37:19.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.235+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~S3VVIVB3H6V2.0 size=1048576 2024-03-09T14:37:19.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.239+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~S3VVIVB3H6V2.1 size=1048576 2024-03-09T14:37:19.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.239+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~S3VVIVB3H6V2.2 size=764544 2024-03-09T14:37:19.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.243+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=S3VVIVB3H6V2 tag=LML4QWDPZ1ZE type=write size=3910272 2024-03-09T14:37:19.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.247+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~0JRPH6TVHLYS.0 size=1048576 2024-03-09T14:37:19.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.251+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~0JRPH6TVHLYS.1 size=903871 2024-03-09T14:37:19.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.251+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=0JRPH6TVHLYS tag=0QNE1T87LHBN type=write size=3001023 2024-03-09T14:37:19.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.251+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=93C778F89ZZ6 type=del 2024-03-09T14:37:19.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.255+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~PX4J626D56PY.0 size=1035039 2024-03-09T14:37:19.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.255+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=PX4J626D56PY tag=FI9XLYRVU485 type=write size=2083615 2024-03-09T14:37:19.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.259+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=9IF9XZEY6UY9 type=del 2024-03-09T14:37:19.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.263+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~8GR46PITGQ53.0 size=611740 2024-03-09T14:37:19.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.263+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=8GR46PITGQ53 tag=6ZAA3E09JULT type=write size=1660316 2024-03-09T14:37:19.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.267+0000 7fd389e788c0 1 < canceled operation key=DIN8WJ9Z9OI8 tag=NEQXIZRQLA1P type=del size=2624480 2024-03-09T14:37:19.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.267+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=004PGQ49WBIT type=del size=623600 2024-03-09T14:37:19.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.271+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=3ZI2IKENQJAN type=del 2024-03-09T14:37:19.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.275+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=QN0CCPG8HIX1 type=del size=1858705 2024-03-09T14:37:19.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.275+0000 7fd389e788c0 1 < completed write operation key=6VT4C288571G tag=S25DNDMUHOYJ type=write size=653889 2024-03-09T14:37:19.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.279+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=Q9G14VCEC8ZB type=del size=633829 2024-03-09T14:37:19.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.283+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=CW1VZUSJVP25 type=del 2024-03-09T14:37:19.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.287+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=RCKGV4S7CVHK type=del size=214876 2024-03-09T14:37:19.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.287+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~W7I86D3RRMOP.0 size=801409 2024-03-09T14:37:19.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.295+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=W7I86D3RRMOP tag=P2N62IA2DOMD type=write size=1849985 2024-03-09T14:37:19.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.299+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~DJ9PI66IUKT1.0 size=412839 2024-03-09T14:37:19.298 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.299+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=DJ9PI66IUKT1 tag=RIYA378M17VT type=write size=1461415 2024-03-09T14:37:19.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.299+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=VWOFLRXOPX9L type=del 2024-03-09T14:37:19.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.303+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~MPCUDKM4RZWU.0 size=1048576 2024-03-09T14:37:19.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.307+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~MPCUDKM4RZWU.1 size=781320 2024-03-09T14:37:19.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.307+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=MPCUDKM4RZWU tag=T8662PNPSOBB type=write size=2878472 2024-03-09T14:37:19.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.307+0000 7fd389e788c0 1 < completed write operation key=E65PFNHJQHEO tag=32M2JDH4T506 type=write size=836666 2024-03-09T14:37:19.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.311+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=JXMIED5WD74N type=write size=146492 2024-03-09T14:37:19.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.315+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~UM0UFS359CKT.0 size=678098 2024-03-09T14:37:19.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.319+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=UM0UFS359CKT tag=4BGJOUVFMX6S type=write size=1726674 2024-03-09T14:37:19.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.319+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=YGJU2Q7A1FU4 type=del size=1835651 2024-03-09T14:37:19.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.327+0000 7fd389e788c0 1 < suggested remove operation key=SKIBISETJH7B tag=0UXK0G5BQSMA type=del 2024-03-09T14:37:19.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.327+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=Z7JZ8HYHA1S4 type=del size=2310296 2024-03-09T14:37:19.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.331+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=Z65F3S08193C type=del 2024-03-09T14:37:19.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.331+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=0OR093QR6QQ2 type=del size=264256 2024-03-09T14:37:19.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.335+0000 7fd389e788c0 1 < completed write operation key=1KJK6PF6U226 tag=XMZQ0D423V2G type=write size=449445 2024-03-09T14:37:19.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.339+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=NQ1GH3CI7S7A type=del size=1856238 2024-03-09T14:37:19.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.339+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~F7I3URFB8CBX.0 size=1048576 2024-03-09T14:37:19.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.343+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~F7I3URFB8CBX.1 size=1048576 2024-03-09T14:37:19.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.343+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~F7I3URFB8CBX.2 size=815680 2024-03-09T14:37:19.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.347+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=F7I3URFB8CBX tag=KZQB2JX397RC type=write size=3961408 2024-03-09T14:37:19.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.351+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=G2WERLGGTM4E type=del size=2744187 2024-03-09T14:37:19.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.355+0000 7fd389e788c0 1 < completed delete operation key=U8P5Q3D11MM6 tag=U360AOQLAPF5 type=del 2024-03-09T14:37:19.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.359+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~1ZRPS30FQNIV.0 size=940070 2024-03-09T14:37:19.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.359+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=1ZRPS30FQNIV tag=4QT3BWFKNNFE type=write size=1988646 2024-03-09T14:37:19.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.359+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~0JRPH6TVHLYS.0 size=1048576 2024-03-09T14:37:19.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.363+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~0JRPH6TVHLYS.1 size=903871 2024-03-09T14:37:19.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.367+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=0JRPH6TVHLYS tag=0QNE1T87LHBN type=write size=3001023 2024-03-09T14:37:19.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.367+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=GOO2KR7J1ZEN type=del size=754411 2024-03-09T14:37:19.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.367+0000 7fd389e788c0 1 < canceled part key=_multipart_5ZEDXFB9B3CN.2~PX4J626D56PY.0 size=1035039 2024-03-09T14:37:19.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.371+0000 7fd389e788c0 1 < canceled multipart upload key=5ZEDXFB9B3CN upload=PX4J626D56PY tag=FI9XLYRVU485 type=write size=2083615 2024-03-09T14:37:19.374 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.375+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=XDRFNIG5IMEV type=del size=560423 2024-03-09T14:37:19.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.375+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~8GR46PITGQ53.0 size=611740 2024-03-09T14:37:19.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.379+0000 7fd389e788c0 1 < completed multipart upload key=SVTMMQ2QR603 upload=8GR46PITGQ53 tag=6ZAA3E09JULT type=write size=1660316 2024-03-09T14:37:19.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.383+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=VKLRKBTFTCM2 type=del size=1034945 2024-03-09T14:37:19.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.383+0000 7fd389e788c0 1 < canceled operation key=FY02AR9GS3KG tag=004PGQ49WBIT type=del size=623600 2024-03-09T14:37:19.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.387+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~8N6KFXU6EJ9U.0 size=1048576 2024-03-09T14:37:19.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.391+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~8N6KFXU6EJ9U.1 size=578299 2024-03-09T14:37:19.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.391+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=8N6KFXU6EJ9U tag=Q8ZXYVUICJBC type=write size=2675451 2024-03-09T14:37:19.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.391+0000 7fd389e788c0 1 < completed delete operation key=DIN8WJ9Z9OI8 tag=QN0CCPG8HIX1 type=del 2024-03-09T14:37:19.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.395+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=3A8FBWQ422R7 type=del size=3495478 2024-03-09T14:37:19.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.395+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=Q9G14VCEC8ZB type=del 2024-03-09T14:37:19.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.399+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=KE101OVT26F1 type=write size=761871 2024-03-09T14:37:19.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.403+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=RCKGV4S7CVHK type=del 2024-03-09T14:37:19.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.407+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~7FB44ZEZYYEK.0 size=1008421 2024-03-09T14:37:19.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.407+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=7FB44ZEZYYEK tag=GB99ND5TB2AK type=write size=2056997 2024-03-09T14:37:19.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.407+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~DJ9PI66IUKT1.0 size=412839 2024-03-09T14:37:19.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.411+0000 7fd389e788c0 1 < completed multipart upload key=IXKMXJ9IZ69S upload=DJ9PI66IUKT1 tag=RIYA378M17VT type=write size=1461415 2024-03-09T14:37:19.416 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.415+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=GXKY3V9LSYGW type=del size=2505717 2024-03-09T14:37:19.417 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.415+0000 7fd389e788c0 1 < canceled part key=_multipart_Z18Q66VI5PDN.2~MPCUDKM4RZWU.0 size=1048576 2024-03-09T14:37:19.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.419+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~MPCUDKM4RZWU.1 size=781320 2024-03-09T14:37:19.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.423+0000 7fd389e788c0 1 < canceled multipart upload key=Z18Q66VI5PDN upload=MPCUDKM4RZWU tag=T8662PNPSOBB type=write size=2878472 2024-03-09T14:37:19.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.427+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~HCEBFECMRBQ0.0 size=471725 2024-03-09T14:37:19.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.427+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=HCEBFECMRBQ0 tag=MTF0TJ7Y21HS type=write size=1520301 2024-03-09T14:37:19.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.427+0000 7fd389e788c0 1 < canceled operation key=GSNWWDS63MTA tag=JXMIED5WD74N type=write size=146492 2024-03-09T14:37:19.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.431+0000 7fd389e788c0 1 > prepared operation key=71692MJQITX3 tag=IY61C0QV5ORQ type=del size=2430836 2024-03-09T14:37:19.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.431+0000 7fd389e788c0 1 < completed delete operation key=UMT7VKZ9R4IR tag=YGJU2Q7A1FU4 type=del 2024-03-09T14:37:19.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.435+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~2WW9P5KY8068.0 size=1048576 2024-03-09T14:37:19.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.439+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~2WW9P5KY8068.1 size=439383 2024-03-09T14:37:19.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.439+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=2WW9P5KY8068 tag=1KC2ACBJ0ZJ1 type=write size=2536535 2024-03-09T14:37:19.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.443+0000 7fd389e788c0 1 < suggested remove operation key=8J6Z9DT07H0X tag=Z7JZ8HYHA1S4 type=del 2024-03-09T14:37:19.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.447+0000 7fd389e788c0 1 > prepared operation key=PZJT6RWRJFIN tag=WNGTN9UC9UV2 type=del size=3523459 2024-03-09T14:37:19.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.451+0000 7fd389e788c0 1 < suggested remove operation key=1K5KR8U3GCOV tag=0OR093QR6QQ2 type=del 2024-03-09T14:37:19.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.455+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=OZOIM60ICEVZ type=del size=2032981 2024-03-09T14:37:19.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.455+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=NQ1GH3CI7S7A type=del 2024-03-09T14:37:19.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.459+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~Z3UZHKWCZRSS.0 size=68077 2024-03-09T14:37:19.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.459+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=Z3UZHKWCZRSS tag=FW03DWRJ2UZA type=write size=1116653 2024-03-09T14:37:19.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.459+0000 7fd389e788c0 -1 < failed to complete operation key=1K5KR8U3GCOV tag=G2WERLGGTM4E type=del size=2744187: (22) Invalid argument 2024-03-09T14:37:19.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.463+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=RQDB5Y6MYBMX type=del size=346670 2024-03-09T14:37:19.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.463+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~1ZRPS30FQNIV.0 size=940070 2024-03-09T14:37:19.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.467+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=1ZRPS30FQNIV tag=4QT3BWFKNNFE type=write size=1988646 2024-03-09T14:37:19.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.471+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~1ST2QWBUTIGQ.0 size=371947 2024-03-09T14:37:19.471 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.471+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=1ST2QWBUTIGQ tag=6LKGHNF7XBTH type=write size=1420523 2024-03-09T14:37:19.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.471+0000 7fd389e788c0 1 < canceled operation key=1KJK6PF6U226 tag=GOO2KR7J1ZEN type=del size=754411 2024-03-09T14:37:19.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.475+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=3IV6RT7TUXZH type=del size=422346 2024-03-09T14:37:19.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.475+0000 7fd389e788c0 1 < canceled operation key=K9X2N6V8R4BY tag=XDRFNIG5IMEV type=del size=560423 2024-03-09T14:37:19.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.479+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=5OMB26DVQUGQ type=del size=2909539 2024-03-09T14:37:19.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.483+0000 7fd389e788c0 1 < canceled operation key=YR2VX4QLOCOG tag=VKLRKBTFTCM2 type=del size=1034945 2024-03-09T14:37:19.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.483+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=LC86LG2R7V14 type=del size=1483484 2024-03-09T14:37:19.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.487+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~8N6KFXU6EJ9U.0 size=1048576 2024-03-09T14:37:19.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.487+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~8N6KFXU6EJ9U.1 size=578299 2024-03-09T14:37:19.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.491+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=8N6KFXU6EJ9U tag=Q8ZXYVUICJBC type=write size=2675451 2024-03-09T14:37:19.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.491+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=ALS6W0R3PP0I type=write size=909866 2024-03-09T14:37:19.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.495+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=3A8FBWQ422R7 type=del 2024-03-09T14:37:19.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.499+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~HQU1F82XB3QR.0 size=1048576 2024-03-09T14:37:19.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.499+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~HQU1F82XB3QR.1 size=882613 2024-03-09T14:37:19.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.499+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=HQU1F82XB3QR tag=1NI6BZODWEEA type=write size=2979765 2024-03-09T14:37:19.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.503+0000 7fd389e788c0 1 < completed write operation key=2405Y4I2Q8TY tag=KE101OVT26F1 type=write size=761871 2024-03-09T14:37:19.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.503+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~UBTGO3J10AME.0 size=1048576 2024-03-09T14:37:19.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.507+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~UBTGO3J10AME.1 size=1048576 2024-03-09T14:37:19.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.507+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~UBTGO3J10AME.2 size=240082 2024-03-09T14:37:19.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.507+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=UBTGO3J10AME tag=Y1K5SMXMQYV9 type=write size=3385810 2024-03-09T14:37:19.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.511+0000 7fd389e788c0 1 < completed part key=_multipart_44F8QXCBBENS.2~7FB44ZEZYYEK.0 size=1008421 2024-03-09T14:37:19.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.511+0000 7fd389e788c0 1 < completed multipart upload key=44F8QXCBBENS upload=7FB44ZEZYYEK tag=GB99ND5TB2AK type=write size=2056997 2024-03-09T14:37:19.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.515+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=WICJR6GZSBQI type=del size=3626467 2024-03-09T14:37:19.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.519+0000 7fd389e788c0 1 < suggested remove operation key=FY02AR9GS3KG tag=GXKY3V9LSYGW type=del 2024-03-09T14:37:19.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.523+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~UQZ73XYNVZJK.0 size=1048576 2024-03-09T14:37:19.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.523+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~UQZ73XYNVZJK.1 size=1048576 2024-03-09T14:37:19.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.527+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~UQZ73XYNVZJK.2 size=286371 2024-03-09T14:37:19.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.527+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=UQZ73XYNVZJK tag=XHWB6PSHMYJQ type=write size=3432099 2024-03-09T14:37:19.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.527+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~HCEBFECMRBQ0.0 size=471725 2024-03-09T14:37:19.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.531+0000 7fd389e788c0 1 < completed multipart upload key=71692MJQITX3 upload=HCEBFECMRBQ0 tag=MTF0TJ7Y21HS type=write size=1520301 2024-03-09T14:37:19.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.535+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=V8INPC1FZE7C type=del size=2178377 2024-03-09T14:37:19.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.535+0000 7fd389e788c0 1 < completed delete operation key=71692MJQITX3 tag=IY61C0QV5ORQ type=del 2024-03-09T14:37:19.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.539+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=W789EKXHKL7L type=del size=218832 2024-03-09T14:37:19.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.539+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~2WW9P5KY8068.0 size=1048576 2024-03-09T14:37:19.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.543+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~2WW9P5KY8068.1 size=439383 2024-03-09T14:37:19.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.547+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=2WW9P5KY8068 tag=1KC2ACBJ0ZJ1 type=write size=2536535 2024-03-09T14:37:19.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.547+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=1BXEF58DH5LW type=write size=796540 2024-03-09T14:37:19.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.551+0000 7fd389e788c0 1 < completed delete operation key=PZJT6RWRJFIN tag=WNGTN9UC9UV2 type=del 2024-03-09T14:37:19.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.555+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=J231Z9VCK406 type=del size=2180851 2024-03-09T14:37:19.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.559+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=OZOIM60ICEVZ type=del 2024-03-09T14:37:19.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.563+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~FN9LMVJECRDP.0 size=1048576 2024-03-09T14:37:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.563+0000 7fd389e788c0 1 > prepared part key=_multipart_YR2VX4QLOCOG.2~FN9LMVJECRDP.1 size=998379 2024-03-09T14:37:19.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.563+0000 7fd389e788c0 1 > prepared multipart upload key=YR2VX4QLOCOG upload=FN9LMVJECRDP tag=UIMNZP02GCLI type=write size=3095531 2024-03-09T14:37:19.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.567+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~Z3UZHKWCZRSS.0 size=68077 2024-03-09T14:37:19.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.571+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=Z3UZHKWCZRSS tag=FW03DWRJ2UZA type=write size=1116653 2024-03-09T14:37:19.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.575+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~GA8UZTITEXM2.0 size=1048576 2024-03-09T14:37:19.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.575+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~GA8UZTITEXM2.1 size=1048576 2024-03-09T14:37:19.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.579+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~GA8UZTITEXM2.2 size=1009664 2024-03-09T14:37:19.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.579+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=GA8UZTITEXM2 tag=E6262V292NJZ type=write size=4155392 2024-03-09T14:37:19.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.579+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=RQDB5Y6MYBMX type=del 2024-03-09T14:37:19.583 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.583+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=5G2L7AST5DTL type=del size=1394227 2024-03-09T14:37:19.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.587+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~1ST2QWBUTIGQ.0 size=371947 2024-03-09T14:37:19.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.591+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=1ST2QWBUTIGQ tag=6LKGHNF7XBTH type=write size=1420523 2024-03-09T14:37:19.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.591+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=37R0MIWKFLB2 type=del size=2749540 2024-03-09T14:37:19.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.595+0000 7fd389e788c0 1 < suggested update operation key=61RC3GUU437B tag=3IV6RT7TUXZH type=del size=422346 2024-03-09T14:37:19.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.599+0000 7fd389e788c0 1 > prepared operation key=ACL1T9GW2JV9 tag=QUGNJOYLCJV7 type=del size=3435029 2024-03-09T14:37:19.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.599+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=5OMB26DVQUGQ type=del 2024-03-09T14:37:19.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.603+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=2OE1EDUXXSUZ type=del size=849533 2024-03-09T14:37:19.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.603+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=LC86LG2R7V14 type=del 2024-03-09T14:37:19.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.607+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=WCPTSF4WLRC4 type=del size=2617475 2024-03-09T14:37:19.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.607+0000 7fd389e788c0 1 < canceled operation key=E65PFNHJQHEO tag=ALS6W0R3PP0I type=write size=909866 2024-03-09T14:37:19.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.611+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=JFIBINOQ5TRQ type=del size=3583608 2024-03-09T14:37:19.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.611+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~HQU1F82XB3QR.0 size=1048576 2024-03-09T14:37:19.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.615+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~HQU1F82XB3QR.1 size=882613 2024-03-09T14:37:19.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.615+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=HQU1F82XB3QR tag=1NI6BZODWEEA type=write size=2979765 2024-03-09T14:37:19.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.619+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=XT6Q6NF8LSXS type=del size=3186199 2024-03-09T14:37:19.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.619+0000 7fd389e788c0 1 < completed part key=_multipart_IXKMXJ9IZ69S.2~UBTGO3J10AME.0 size=1048576 2024-03-09T14:37:19.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.619+0000 7fd389e788c0 1 < canceled part key=_multipart_IXKMXJ9IZ69S.2~UBTGO3J10AME.1 size=1048576 2024-03-09T14:37:19.620 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.619+0000 7fd389e788c0 1 < canceled part key=_multipart_IXKMXJ9IZ69S.2~UBTGO3J10AME.2 size=240082 2024-03-09T14:37:19.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.623+0000 7fd389e788c0 1 < canceled multipart upload key=IXKMXJ9IZ69S upload=UBTGO3J10AME tag=Y1K5SMXMQYV9 type=write size=3385810 2024-03-09T14:37:19.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.623+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=508V0LF3WJD1 type=write size=172613 2024-03-09T14:37:19.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.627+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=WICJR6GZSBQI type=del 2024-03-09T14:37:19.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.627+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=WBN4PNE3OJO9 type=del size=3061579 2024-03-09T14:37:19.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.631+0000 7fd389e788c0 1 < canceled part key=_multipart_Y7E2TLASJM9T.2~UQZ73XYNVZJK.0 size=1048576 2024-03-09T14:37:19.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.631+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~UQZ73XYNVZJK.1 size=1048576 2024-03-09T14:37:19.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.631+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~UQZ73XYNVZJK.2 size=286371 2024-03-09T14:37:19.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.635+0000 7fd389e788c0 1 < canceled multipart upload key=Y7E2TLASJM9T upload=UQZ73XYNVZJK tag=XHWB6PSHMYJQ type=write size=3432099 2024-03-09T14:37:19.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.635+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=9W3MHKDZGLI3 type=write size=243165 2024-03-09T14:37:19.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.639+0000 7fd389e788c0 1 < completed delete operation key=1K5KR8U3GCOV tag=V8INPC1FZE7C type=del 2024-03-09T14:37:19.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.643+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=Y2FKOSIDAYM1 type=del size=4106249 2024-03-09T14:37:19.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.643+0000 7fd389e788c0 1 < canceled operation key=SKIBISETJH7B tag=W789EKXHKL7L type=del size=218832 2024-03-09T14:37:19.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.647+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~E4OA129Z4PK1.0 size=1048576 2024-03-09T14:37:19.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.647+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~E4OA129Z4PK1.1 size=971958 2024-03-09T14:37:19.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.647+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=E4OA129Z4PK1 tag=ZKN5LYPZSLBK type=write size=3069110 2024-03-09T14:37:19.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.651+0000 7fd389e788c0 1 < suggested remove operation key=GSNWWDS63MTA tag=1BXEF58DH5LW type=write 2024-03-09T14:37:19.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.655+0000 7fd389e788c0 1 > prepared part key=_multipart_ACL1T9GW2JV9.2~93IAU2WDT04J.0 size=310490 2024-03-09T14:37:19.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.655+0000 7fd389e788c0 1 > prepared multipart upload key=ACL1T9GW2JV9 upload=93IAU2WDT04J tag=K1KT8R3620CD type=write size=1359066 2024-03-09T14:37:19.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.655+0000 7fd389e788c0 -1 < no bi entry to suggest for operation key=GSNWWDS63MTA tag=J231Z9VCK406 type=del size=2180851: (2) No such file or directory 2024-03-09T14:37:19.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.659+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~BYGUIPN7YGBZ.0 size=1048576 2024-03-09T14:37:19.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.659+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~BYGUIPN7YGBZ.1 size=344482 2024-03-09T14:37:19.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.659+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=BYGUIPN7YGBZ tag=JHEUXY03KNSV type=write size=2441634 2024-03-09T14:37:19.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.663+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~FN9LMVJECRDP.0 size=1048576 2024-03-09T14:37:19.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.663+0000 7fd389e788c0 1 < completed part key=_multipart_YR2VX4QLOCOG.2~FN9LMVJECRDP.1 size=998379 2024-03-09T14:37:19.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.667+0000 7fd389e788c0 1 < completed multipart upload key=YR2VX4QLOCOG upload=FN9LMVJECRDP tag=UIMNZP02GCLI type=write size=3095531 2024-03-09T14:37:19.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.671+0000 7fd389e788c0 1 > prepared part key=_multipart_6VT4C288571G.2~MKG2204P1HBG.0 size=390043 2024-03-09T14:37:19.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.671+0000 7fd389e788c0 1 > prepared multipart upload key=6VT4C288571G upload=MKG2204P1HBG tag=6IYF706NKA5C type=write size=1438619 2024-03-09T14:37:19.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.675+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~GA8UZTITEXM2.0 size=1048576 2024-03-09T14:37:19.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.675+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~GA8UZTITEXM2.1 size=1048576 2024-03-09T14:37:19.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.675+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~GA8UZTITEXM2.2 size=1009664 2024-03-09T14:37:19.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.679+0000 7fd389e788c0 1 < completed multipart upload key=71692MJQITX3 upload=GA8UZTITEXM2 tag=E6262V292NJZ type=write size=4155392 2024-03-09T14:37:19.683 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.683+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~5TTOGCSA0OWO.0 size=1048576 2024-03-09T14:37:19.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.683+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~5TTOGCSA0OWO.1 size=400825 2024-03-09T14:37:19.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.683+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=5TTOGCSA0OWO tag=D8TY1SLF612P type=write size=2497977 2024-03-09T14:37:19.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.687+0000 7fd389e788c0 1 < canceled operation key=IXKMXJ9IZ69S tag=5G2L7AST5DTL type=del size=1394227 2024-03-09T14:37:19.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.687+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=ULYRH7O4FL2F type=del size=3452253 2024-03-09T14:37:19.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.691+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=37R0MIWKFLB2 type=del 2024-03-09T14:37:19.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.691+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=MAQ90GSZPSS3 type=del size=540684 2024-03-09T14:37:19.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.695+0000 7fd389e788c0 1 < completed delete operation key=ACL1T9GW2JV9 tag=QUGNJOYLCJV7 type=del 2024-03-09T14:37:19.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.699+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~04NLZMG2WKXM.0 size=20182 2024-03-09T14:37:19.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.699+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=04NLZMG2WKXM tag=RQVPI0ZA1C02 type=write size=1068758 2024-03-09T14:37:19.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.703+0000 7fd389e788c0 1 < suggested remove operation key=PKVYD8DWS7M2 tag=2OE1EDUXXSUZ type=del 2024-03-09T14:37:19.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.703+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=0OWJ3CMXC0NT type=del size=2438829 2024-03-09T14:37:19.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.707+0000 7fd389e788c0 1 < completed delete operation key=61RC3GUU437B tag=WCPTSF4WLRC4 type=del 2024-03-09T14:37:19.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.707+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~Q7G6P9G3WCX0.0 size=594945 2024-03-09T14:37:19.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.707+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=Q7G6P9G3WCX0 tag=O19CA2F26N6E type=write size=1643521 2024-03-09T14:37:19.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.711+0000 7fd389e788c0 1 < completed delete operation key=Y7E2TLASJM9T tag=JFIBINOQ5TRQ type=del 2024-03-09T14:37:19.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.715+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~FDQT8PRWHACK.0 size=379448 2024-03-09T14:37:19.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.715+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=FDQT8PRWHACK tag=J4S9HA10F5QC type=write size=1428024 2024-03-09T14:37:19.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.715+0000 7fd389e788c0 1 < canceled operation key=AUSZ4JUGI6UU tag=XT6Q6NF8LSXS type=del size=3186199 2024-03-09T14:37:19.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.719+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=MTHIHE7FCSLC type=del size=489672 2024-03-09T14:37:19.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.719+0000 7fd389e788c0 1 < completed write operation key=SVTMMQ2QR603 tag=508V0LF3WJD1 type=write size=172613 2024-03-09T14:37:19.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.719+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=3BODP1A4OD5T type=del size=861968 2024-03-09T14:37:19.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.723+0000 7fd389e788c0 1 < suggested remove operation key=MHT268M7S2TY tag=WBN4PNE3OJO9 type=del 2024-03-09T14:37:19.726 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.727+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=DR29AZ1TJ041 type=del size=4003741 2024-03-09T14:37:19.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.727+0000 7fd389e788c0 1 < canceled operation key=E2VP0TJ37UX8 tag=9W3MHKDZGLI3 type=write size=243165 2024-03-09T14:37:19.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.731+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=VI5KGJ4QWEBZ type=del size=734680 2024-03-09T14:37:19.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.731+0000 7fd389e788c0 1 < suggested update operation key=Z18Q66VI5PDN tag=Y2FKOSIDAYM1 type=del size=4106249 2024-03-09T14:37:19.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.735+0000 7fd389e788c0 1 > prepared operation key=1KJK6PF6U226 tag=NU1W2OKL96N6 type=del size=621229 2024-03-09T14:37:19.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.735+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~E4OA129Z4PK1.0 size=1048576 2024-03-09T14:37:19.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.735+0000 7fd389e788c0 1 < canceled part key=_multipart_E65PFNHJQHEO.2~E4OA129Z4PK1.1 size=971958 2024-03-09T14:37:19.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.739+0000 7fd389e788c0 1 < canceled multipart upload key=E65PFNHJQHEO upload=E4OA129Z4PK1 tag=ZKN5LYPZSLBK type=write size=3069110 2024-03-09T14:37:19.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.743+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=WBVD3W8NPLW3 type=del size=3372087 2024-03-09T14:37:19.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.743+0000 7fd389e788c0 1 < completed part key=_multipart_ACL1T9GW2JV9.2~93IAU2WDT04J.0 size=310490 2024-03-09T14:37:19.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.747+0000 7fd389e788c0 1 < completed multipart upload key=ACL1T9GW2JV9 upload=93IAU2WDT04J tag=K1KT8R3620CD type=write size=1359066 2024-03-09T14:37:19.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.751+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~2IS26X457B7U.0 size=1048576 2024-03-09T14:37:19.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.751+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~2IS26X457B7U.1 size=1048576 2024-03-09T14:37:19.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.751+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~2IS26X457B7U.2 size=995219 2024-03-09T14:37:19.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.751+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=2IS26X457B7U tag=CLR8M0XY7J5M type=write size=4140947 2024-03-09T14:37:19.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.755+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~BYGUIPN7YGBZ.0 size=1048576 2024-03-09T14:37:19.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.755+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~BYGUIPN7YGBZ.1 size=344482 2024-03-09T14:37:19.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.759+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=BYGUIPN7YGBZ tag=JHEUXY03KNSV type=write size=2441634 2024-03-09T14:37:19.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.759+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=4O7C1XR392KI type=write size=412375 2024-03-09T14:37:19.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.763+0000 7fd389e788c0 1 < completed part key=_multipart_6VT4C288571G.2~MKG2204P1HBG.0 size=390043 2024-03-09T14:37:19.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.767+0000 7fd389e788c0 1 < completed multipart upload key=6VT4C288571G upload=MKG2204P1HBG tag=6IYF706NKA5C type=write size=1438619 2024-03-09T14:37:19.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.767+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=X4SUBQ472PX3 type=del size=2266086 2024-03-09T14:37:19.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.767+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~5TTOGCSA0OWO.0 size=1048576 2024-03-09T14:37:19.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.771+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~5TTOGCSA0OWO.1 size=400825 2024-03-09T14:37:19.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.771+0000 7fd389e788c0 1 < completed multipart upload key=CLAM83TC7RZ7 upload=5TTOGCSA0OWO tag=D8TY1SLF612P type=write size=2497977 2024-03-09T14:37:19.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.775+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=N16780473WE1 type=write size=497811 2024-03-09T14:37:19.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.775+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=ULYRH7O4FL2F type=del 2024-03-09T14:37:19.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.779+0000 7fd389e788c0 1 > prepared operation key=DIN8WJ9Z9OI8 tag=TJSK4V1WL7UW type=del size=1388803 2024-03-09T14:37:19.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.779+0000 7fd389e788c0 1 < suggested remove operation key=I4NA328AI5T1 tag=MAQ90GSZPSS3 type=del 2024-03-09T14:37:19.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.783+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=SAYG0QEZAWAM type=del size=948638 2024-03-09T14:37:19.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.783+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~04NLZMG2WKXM.0 size=20182 2024-03-09T14:37:19.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.787+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=04NLZMG2WKXM tag=RQVPI0ZA1C02 type=write size=1068758 2024-03-09T14:37:19.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.787+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~VFJGFY0XMP1Q.0 size=1048576 2024-03-09T14:37:19.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.791+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~VFJGFY0XMP1Q.1 size=419755 2024-03-09T14:37:19.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.791+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=VFJGFY0XMP1Q tag=0W5P4N08VEEK type=write size=2516907 2024-03-09T14:37:19.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.791+0000 7fd389e788c0 1 < completed delete operation key=E2VP0TJ37UX8 tag=0OWJ3CMXC0NT type=del 2024-03-09T14:37:19.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.795+0000 7fd389e788c0 1 > prepared operation key=44F8QXCBBENS tag=Y527CONSBBJ9 type=del size=1200516 2024-03-09T14:37:19.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.795+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~Q7G6P9G3WCX0.0 size=594945 2024-03-09T14:37:19.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.799+0000 7fd389e788c0 1 < completed multipart upload key=U8P5Q3D11MM6 upload=Q7G6P9G3WCX0 tag=O19CA2F26N6E type=write size=1643521 2024-03-09T14:37:19.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.799+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=H1L6EJU3G1AY type=del size=3738674 2024-03-09T14:37:19.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.799+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~FDQT8PRWHACK.0 size=379448 2024-03-09T14:37:19.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.803+0000 7fd389e788c0 1 < completed multipart upload key=5ZEDXFB9B3CN upload=FDQT8PRWHACK tag=J4S9HA10F5QC type=write size=1428024 2024-03-09T14:37:19.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.803+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=Z15GX14XQS0G type=del size=1063119 2024-03-09T14:37:19.806 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.807+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=MTHIHE7FCSLC type=del 2024-03-09T14:37:19.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.811+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~SDFKPI3B9RLW.0 size=1048576 2024-03-09T14:37:19.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.811+0000 7fd389e788c0 1 > prepared part key=_multipart_8J6Z9DT07H0X.2~SDFKPI3B9RLW.1 size=648881 2024-03-09T14:37:19.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.811+0000 7fd389e788c0 1 > prepared multipart upload key=8J6Z9DT07H0X upload=SDFKPI3B9RLW tag=LICPEXWU6029 type=write size=2746033 2024-03-09T14:37:19.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.815+0000 7fd389e788c0 1 < suggested update operation key=8J6Z9DT07H0X tag=3BODP1A4OD5T type=del size=861968 2024-03-09T14:37:19.815 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.815+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=K7P5F23Y1UHN type=del size=913107 2024-03-09T14:37:19.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.819+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=DR29AZ1TJ041 type=del 2024-03-09T14:37:19.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.819+0000 7fd389e788c0 1 > prepared operation key=8J6Z9DT07H0X tag=S9FOJGNKGF71 type=del size=3022166 2024-03-09T14:37:19.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.819+0000 7fd389e788c0 -1 < failed to complete operation key=8J6Z9DT07H0X tag=VI5KGJ4QWEBZ type=del size=734680: (22) Invalid argument 2024-03-09T14:37:19.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.823+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=XP81P6NLA8FL type=del size=2890930 2024-03-09T14:37:19.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.823+0000 7fd389e788c0 1 < completed delete operation key=1KJK6PF6U226 tag=NU1W2OKL96N6 type=del 2024-03-09T14:37:19.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.827+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=SY1FMCFGJ146 type=del size=3982660 2024-03-09T14:37:19.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.827+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=WBVD3W8NPLW3 type=del 2024-03-09T14:37:19.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.831+0000 7fd389e788c0 1 > prepared operation key=SKIBISETJH7B tag=A3928ZBGLI5W type=del size=3369055 2024-03-09T14:37:19.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.831+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~2IS26X457B7U.0 size=1048576 2024-03-09T14:37:19.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.835+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~2IS26X457B7U.1 size=1048576 2024-03-09T14:37:19.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.835+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~2IS26X457B7U.2 size=995219 2024-03-09T14:37:19.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.839+0000 7fd389e788c0 1 < completed multipart upload key=Z18Q66VI5PDN upload=2IS26X457B7U tag=CLR8M0XY7J5M type=write size=4140947 2024-03-09T14:37:19.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.839+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=M24NZGRCHPF4 type=del size=2132552 2024-03-09T14:37:19.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.843+0000 7fd389e788c0 1 < completed write operation key=1K5KR8U3GCOV tag=4O7C1XR392KI type=write size=412375 2024-03-09T14:37:19.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.847+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~WW5EE4822GAS.0 size=1048576 2024-03-09T14:37:19.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.847+0000 7fd389e788c0 1 > prepared part key=_multipart_5ZEDXFB9B3CN.2~WW5EE4822GAS.1 size=129062 2024-03-09T14:37:19.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.847+0000 7fd389e788c0 1 > prepared multipart upload key=5ZEDXFB9B3CN upload=WW5EE4822GAS tag=XXPCMACAVYKH type=write size=2226214 2024-03-09T14:37:19.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.847+0000 7fd389e788c0 -1 < no bi entry to suggest for operation key=I4NA328AI5T1 tag=X4SUBQ472PX3 type=del size=2266086: (2) No such file or directory 2024-03-09T14:37:19.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.851+0000 7fd389e788c0 1 > prepared operation key=GSNWWDS63MTA tag=OUMSN33M3T0B type=del size=944237 2024-03-09T14:37:19.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.855+0000 7fd389e788c0 1 < suggested remove operation key=IXKMXJ9IZ69S tag=N16780473WE1 type=write 2024-03-09T14:37:19.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.855+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=8IV0MP6SR4Y0 type=del size=3318625 2024-03-09T14:37:19.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.859+0000 7fd389e788c0 1 < canceled operation key=DIN8WJ9Z9OI8 tag=TJSK4V1WL7UW type=del size=1388803 2024-03-09T14:37:19.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.859+0000 7fd389e788c0 1 > prepared operation key=E2VP0TJ37UX8 tag=PEZSCCBBQQGB type=del size=3451314 2024-03-09T14:37:19.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.863+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=SAYG0QEZAWAM type=del 2024-03-09T14:37:19.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.863+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=DDDFVL04HQ92 type=del size=2583514 2024-03-09T14:37:19.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.867+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~VFJGFY0XMP1Q.0 size=1048576 2024-03-09T14:37:19.867 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.867+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~VFJGFY0XMP1Q.1 size=419755 2024-03-09T14:37:19.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.871+0000 7fd389e788c0 1 < completed multipart upload key=71692MJQITX3 upload=VFJGFY0XMP1Q tag=0W5P4N08VEEK type=write size=2516907 2024-03-09T14:37:19.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.875+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~SYOIWQCF39O9.0 size=1048576 2024-03-09T14:37:19.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.875+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~SYOIWQCF39O9.1 size=1048576 2024-03-09T14:37:19.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.875+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~SYOIWQCF39O9.2 size=848388 2024-03-09T14:37:19.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.875+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=SYOIWQCF39O9 tag=3Y7Q2FVTQGJC type=write size=3994116 2024-03-09T14:37:19.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.879+0000 7fd389e788c0 1 < completed delete operation key=44F8QXCBBENS tag=Y527CONSBBJ9 type=del 2024-03-09T14:37:19.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.879+0000 7fd389e788c0 1 > prepared operation key=U8P5Q3D11MM6 tag=8F0MW79FHYJI type=del size=3407453 2024-03-09T14:37:19.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.883+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=H1L6EJU3G1AY type=del 2024-03-09T14:37:19.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.883+0000 7fd389e788c0 1 > prepared operation key=61RC3GUU437B tag=ZUG1II37HVJH type=del size=3718208 2024-03-09T14:37:19.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.887+0000 7fd389e788c0 1 < suggested update operation key=5ZEDXFB9B3CN tag=Z15GX14XQS0G type=del size=1063119 2024-03-09T14:37:19.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.891+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~8XWC618AAR54.0 size=1048576 2024-03-09T14:37:19.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.891+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~8XWC618AAR54.1 size=1048576 2024-03-09T14:37:19.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.895+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~8XWC618AAR54.2 size=710558 2024-03-09T14:37:19.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.895+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=8XWC618AAR54 tag=J2AI752M86MX type=write size=3856286 2024-03-09T14:37:19.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.895+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~SDFKPI3B9RLW.0 size=1048576 2024-03-09T14:37:19.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.899+0000 7fd389e788c0 1 < completed part key=_multipart_8J6Z9DT07H0X.2~SDFKPI3B9RLW.1 size=648881 2024-03-09T14:37:19.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.899+0000 7fd389e788c0 1 < completed multipart upload key=8J6Z9DT07H0X upload=SDFKPI3B9RLW tag=LICPEXWU6029 type=write size=2746033 2024-03-09T14:37:19.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.903+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=N3J9M1X3JNSE type=write size=417259 2024-03-09T14:37:19.907 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.907+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=K7P5F23Y1UHN type=del 2024-03-09T14:37:19.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.911+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=LQ34XUXNNW8J type=write size=908649 2024-03-09T14:37:19.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.911+0000 7fd389e788c0 1 < completed delete operation key=8J6Z9DT07H0X tag=S9FOJGNKGF71 type=del 2024-03-09T14:37:19.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.911+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=BWX1QFGLDHN5 type=del size=553230 2024-03-09T14:37:19.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.915+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=XP81P6NLA8FL type=del 2024-03-09T14:37:19.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.919+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~6GAB45N2QGYI.0 size=1048576 2024-03-09T14:37:19.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.919+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~6GAB45N2QGYI.1 size=1048576 2024-03-09T14:37:19.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.919+0000 7fd389e788c0 1 > prepared part key=_multipart_UMT7VKZ9R4IR.2~6GAB45N2QGYI.2 size=154188 2024-03-09T14:37:19.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.919+0000 7fd389e788c0 1 > prepared multipart upload key=UMT7VKZ9R4IR upload=6GAB45N2QGYI tag=JR6MC97KLGGZ type=write size=3299916 2024-03-09T14:37:19.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.923+0000 7fd389e788c0 1 < suggested remove operation key=P83H9137MI7Y tag=SY1FMCFGJ146 type=del 2024-03-09T14:37:19.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.927+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=EANBCW3ZV7MG type=write size=737850 2024-03-09T14:37:19.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.927+0000 7fd389e788c0 1 < completed delete operation key=SKIBISETJH7B tag=A3928ZBGLI5W type=del 2024-03-09T14:37:19.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.931+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=ADH9B8V3JGL7 type=del size=59387 2024-03-09T14:37:19.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.931+0000 7fd389e788c0 -1 < failed to complete operation key=IXKMXJ9IZ69S tag=M24NZGRCHPF4 type=del size=2132552: (22) Invalid argument 2024-03-09T14:37:19.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.935+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=L0DNJWW16748 type=del size=1626988 2024-03-09T14:37:19.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.935+0000 7fd389e788c0 1 < completed part key=_multipart_5ZEDXFB9B3CN.2~WW5EE4822GAS.0 size=1048576 2024-03-09T14:37:19.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.935+0000 7fd389e788c0 1 < canceled part key=_multipart_5ZEDXFB9B3CN.2~WW5EE4822GAS.1 size=129062 2024-03-09T14:37:19.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.939+0000 7fd389e788c0 1 < canceled multipart upload key=5ZEDXFB9B3CN upload=WW5EE4822GAS tag=XXPCMACAVYKH type=write size=2226214 2024-03-09T14:37:19.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.939+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=QV0CCOXXR3OK type=del size=219646 2024-03-09T14:37:19.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.943+0000 7fd389e788c0 1 < completed delete operation key=GSNWWDS63MTA tag=OUMSN33M3T0B type=del 2024-03-09T14:37:19.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.943+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=62N21H7DVZ58 type=del size=2712937 2024-03-09T14:37:19.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.947+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=8IV0MP6SR4Y0 type=del 2024-03-09T14:37:19.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.947+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=4MHYDVSZ1COX type=del size=2174605 2024-03-09T14:37:19.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.951+0000 7fd389e788c0 1 < completed delete operation key=E2VP0TJ37UX8 tag=PEZSCCBBQQGB type=del 2024-03-09T14:37:19.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.951+0000 7fd389e788c0 1 > prepared operation key=MHT268M7S2TY tag=2YRMD4JCF28Y type=del size=2040512 2024-03-09T14:37:19.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.955+0000 7fd389e788c0 1 < completed delete operation key=FY02AR9GS3KG tag=DDDFVL04HQ92 type=del 2024-03-09T14:37:19.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.955+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=KTVI6KN2MMTD type=del size=3910599 2024-03-09T14:37:19.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.955+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~SYOIWQCF39O9.0 size=1048576 2024-03-09T14:37:19.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.959+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~SYOIWQCF39O9.1 size=1048576 2024-03-09T14:37:19.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.959+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~SYOIWQCF39O9.2 size=848388 2024-03-09T14:37:19.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.963+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=SYOIWQCF39O9 tag=3Y7Q2FVTQGJC type=write size=3994116 2024-03-09T14:37:19.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.967+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~3W8KS5VMGSEX.0 size=1048576 2024-03-09T14:37:19.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.967+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~3W8KS5VMGSEX.1 size=1007715 2024-03-09T14:37:19.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.967+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=3W8KS5VMGSEX tag=7FY70CY7YXYB type=write size=3104867 2024-03-09T14:37:19.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.971+0000 7fd389e788c0 1 < suggested remove operation key=U8P5Q3D11MM6 tag=8F0MW79FHYJI type=del 2024-03-09T14:37:19.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.971+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=4T2O8OEBFFNO type=write size=412091 2024-03-09T14:37:19.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.975+0000 7fd389e788c0 1 < canceled operation key=61RC3GUU437B tag=ZUG1II37HVJH type=del size=3718208 2024-03-09T14:37:19.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.975+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=AXTY12BYGS7K type=del size=3727657 2024-03-09T14:37:19.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.979+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~8XWC618AAR54.0 size=1048576 2024-03-09T14:37:19.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.979+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~8XWC618AAR54.1 size=1048576 2024-03-09T14:37:19.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.979+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~8XWC618AAR54.2 size=710558 2024-03-09T14:37:19.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.983+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=8XWC618AAR54 tag=J2AI752M86MX type=write size=3856286 2024-03-09T14:37:19.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.987+0000 7fd389e788c0 1 > prepared part key=_multipart_AUSZ4JUGI6UU.2~VU00I6VBEGI3.0 size=1011410 2024-03-09T14:37:19.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.987+0000 7fd389e788c0 1 > prepared multipart upload key=AUSZ4JUGI6UU upload=VU00I6VBEGI3 tag=JGMNCF57L144 type=write size=2059986 2024-03-09T14:37:19.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.991+0000 7fd389e788c0 1 < completed write operation key=Y7E2TLASJM9T tag=N3J9M1X3JNSE type=write size=417259 2024-03-09T14:37:19.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.991+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~WNGLHU0DI7DF.0 size=1048576 2024-03-09T14:37:19.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.995+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~WNGLHU0DI7DF.1 size=1048576 2024-03-09T14:37:19.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.995+0000 7fd389e788c0 1 > prepared part key=_multipart_MHT268M7S2TY.2~WNGLHU0DI7DF.2 size=684364 2024-03-09T14:37:19.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.995+0000 7fd389e788c0 1 > prepared multipart upload key=MHT268M7S2TY upload=WNGLHU0DI7DF tag=1R0EN0LUBE7R type=write size=3830092 2024-03-09T14:37:19.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.999+0000 7fd389e788c0 1 < completed write operation key=SVTMMQ2QR603 tag=LQ34XUXNNW8J type=write size=908649 2024-03-09T14:37:20.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:19.999+0000 7fd389e788c0 1 > prepared operation key=K9X2N6V8R4BY tag=ZAIBMJQQOPBJ type=del size=1857302 2024-03-09T14:37:20.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.003+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=BWX1QFGLDHN5 type=del 2024-03-09T14:37:20.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.007+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~8H6PP82YR2JH.0 size=1048576 2024-03-09T14:37:20.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.007+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~8H6PP82YR2JH.1 size=234057 2024-03-09T14:37:20.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.007+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=8H6PP82YR2JH tag=6RJNS391M0VL type=write size=2331209 2024-03-09T14:37:20.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.011+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~6GAB45N2QGYI.0 size=1048576 2024-03-09T14:37:20.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.011+0000 7fd389e788c0 1 < canceled part key=_multipart_UMT7VKZ9R4IR.2~6GAB45N2QGYI.1 size=1048576 2024-03-09T14:37:20.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.011+0000 7fd389e788c0 1 < completed part key=_multipart_UMT7VKZ9R4IR.2~6GAB45N2QGYI.2 size=154188 2024-03-09T14:37:20.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.015+0000 7fd389e788c0 1 < canceled multipart upload key=UMT7VKZ9R4IR upload=6GAB45N2QGYI tag=JR6MC97KLGGZ type=write size=3299916 2024-03-09T14:37:20.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.019+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~164BQXGJL7KS.0 size=1048576 2024-03-09T14:37:20.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.019+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~164BQXGJL7KS.1 size=1048576 2024-03-09T14:37:20.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.023+0000 7fd389e788c0 1 > prepared part key=_multipart_E2VP0TJ37UX8.2~164BQXGJL7KS.2 size=855768 2024-03-09T14:37:20.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.023+0000 7fd389e788c0 1 > prepared multipart upload key=E2VP0TJ37UX8 upload=164BQXGJL7KS tag=RMJUF8NRO77E type=write size=4001496 2024-03-09T14:37:20.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.023+0000 7fd389e788c0 1 < canceled operation key=IXKMXJ9IZ69S tag=EANBCW3ZV7MG type=write size=737850 2024-03-09T14:37:20.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.027+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~M96OLTA4AV5K.0 size=1048576 2024-03-09T14:37:20.028 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.027+0000 7fd389e788c0 1 > prepared part key=_multipart_P83H9137MI7Y.2~M96OLTA4AV5K.1 size=553926 2024-03-09T14:37:20.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.027+0000 7fd389e788c0 1 > prepared multipart upload key=P83H9137MI7Y upload=M96OLTA4AV5K tag=L5RP9SUHGGR6 type=write size=2651078 2024-03-09T14:37:20.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.031+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=ADH9B8V3JGL7 type=del 2024-03-09T14:37:20.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.031+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=M8VCGOMK43GZ type=del size=85546 2024-03-09T14:37:20.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.035+0000 7fd389e788c0 1 < suggested update operation key=2405Y4I2Q8TY tag=L0DNJWW16748 type=del size=1626988 2024-03-09T14:37:20.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.039+0000 7fd389e788c0 1 > prepared part key=_multipart_2405Y4I2Q8TY.2~2OLD44FQ25VG.0 size=475392 2024-03-09T14:37:20.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.039+0000 7fd389e788c0 1 > prepared multipart upload key=2405Y4I2Q8TY upload=2OLD44FQ25VG tag=7IQP4SSFA8IH type=write size=1523968 2024-03-09T14:37:20.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.043+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=QV0CCOXXR3OK type=del 2024-03-09T14:37:20.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.043+0000 7fd389e788c0 1 > prepared operation key=SVTMMQ2QR603 tag=7DZLK7X11D2R type=del size=3352755 2024-03-09T14:37:20.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.047+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=62N21H7DVZ58 type=del 2024-03-09T14:37:20.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.051+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~JRTUWO5677NW.0 size=1048576 2024-03-09T14:37:20.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.051+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~JRTUWO5677NW.1 size=1048576 2024-03-09T14:37:20.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.055+0000 7fd389e788c0 1 > prepared part key=_multipart_Y7E2TLASJM9T.2~JRTUWO5677NW.2 size=944177 2024-03-09T14:37:20.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.055+0000 7fd389e788c0 1 > prepared multipart upload key=Y7E2TLASJM9T upload=JRTUWO5677NW tag=CQ0RJD4YJJML type=write size=4089905 2024-03-09T14:37:20.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.055+0000 7fd389e788c0 1 < completed delete operation key=CLAM83TC7RZ7 tag=4MHYDVSZ1COX type=del 2024-03-09T14:37:20.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.059+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~VKNZBY89Y609.0 size=821228 2024-03-09T14:37:20.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.059+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=VKNZBY89Y609 tag=RTOEO8J1D995 type=write size=1869804 2024-03-09T14:37:20.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.063+0000 7fd389e788c0 1 < completed delete operation key=MHT268M7S2TY tag=2YRMD4JCF28Y type=del 2024-03-09T14:37:20.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.067+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~DFLOG2ABBQLY.0 size=1048576 2024-03-09T14:37:20.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.067+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~DFLOG2ABBQLY.1 size=1048576 2024-03-09T14:37:20.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.067+0000 7fd389e788c0 1 > prepared part key=_multipart_E65PFNHJQHEO.2~DFLOG2ABBQLY.2 size=547280 2024-03-09T14:37:20.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.067+0000 7fd389e788c0 1 > prepared multipart upload key=E65PFNHJQHEO upload=DFLOG2ABBQLY tag=M7ZRKR4OW9YK type=write size=3693008 2024-03-09T14:37:20.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.071+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=KTVI6KN2MMTD type=del 2024-03-09T14:37:20.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.071+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=71P38LOV7WKD type=del size=72453 2024-03-09T14:37:20.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.075+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~3W8KS5VMGSEX.0 size=1048576 2024-03-09T14:37:20.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.075+0000 7fd389e788c0 1 < completed part key=_multipart_71692MJQITX3.2~3W8KS5VMGSEX.1 size=1007715 2024-03-09T14:37:20.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.079+0000 7fd389e788c0 1 < completed multipart upload key=71692MJQITX3 upload=3W8KS5VMGSEX tag=7FY70CY7YXYB type=write size=3104867 2024-03-09T14:37:20.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.079+0000 7fd389e788c0 1 > prepared operation key=I4NA328AI5T1 tag=CG7NC28N9LZH type=del size=2376425 2024-03-09T14:37:20.082 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.083+0000 7fd389e788c0 1 < completed write operation key=CLAM83TC7RZ7 tag=4T2O8OEBFFNO type=write size=412091 2024-03-09T14:37:20.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.087+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=H8BXHW9JQIP2 type=del size=459551 2024-03-09T14:37:20.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.087+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=AXTY12BYGS7K type=del 2024-03-09T14:37:20.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.091+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~F20D6CBIO755.0 size=1048576 2024-03-09T14:37:20.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.095+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~F20D6CBIO755.1 size=525400 2024-03-09T14:37:20.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.095+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=F20D6CBIO755 tag=8M0Q5EYXDTKF type=write size=2622552 2024-03-09T14:37:20.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.095+0000 7fd389e788c0 1 < completed part key=_multipart_AUSZ4JUGI6UU.2~VU00I6VBEGI3.0 size=1011410 2024-03-09T14:37:20.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.099+0000 7fd389e788c0 1 < completed multipart upload key=AUSZ4JUGI6UU upload=VU00I6VBEGI3 tag=JGMNCF57L144 type=write size=2059986 2024-03-09T14:37:20.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.099+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=0L8L6QBIGD45 type=del size=102955 2024-03-09T14:37:20.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.103+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~WNGLHU0DI7DF.0 size=1048576 2024-03-09T14:37:20.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.103+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~WNGLHU0DI7DF.1 size=1048576 2024-03-09T14:37:20.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.107+0000 7fd389e788c0 1 < completed part key=_multipart_MHT268M7S2TY.2~WNGLHU0DI7DF.2 size=684364 2024-03-09T14:37:20.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.111+0000 7fd389e788c0 1 < completed multipart upload key=MHT268M7S2TY upload=WNGLHU0DI7DF tag=1R0EN0LUBE7R type=write size=3830092 2024-03-09T14:37:20.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.115+0000 7fd389e788c0 1 > prepared part key=_multipart_SKIBISETJH7B.2~22O7DWZ1BSUB.0 size=968824 2024-03-09T14:37:20.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.115+0000 7fd389e788c0 1 > prepared multipart upload key=SKIBISETJH7B upload=22O7DWZ1BSUB tag=0MBF4121TYGW type=write size=2017400 2024-03-09T14:37:20.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.119+0000 7fd389e788c0 1 < suggested update operation key=K9X2N6V8R4BY tag=ZAIBMJQQOPBJ type=del size=1857302 2024-03-09T14:37:20.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.119+0000 7fd389e788c0 1 > prepared operation key=UMT7VKZ9R4IR tag=3VXGOPVA1CPF type=del size=2430467 2024-03-09T14:37:20.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.123+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~8H6PP82YR2JH.0 size=1048576 2024-03-09T14:37:20.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.123+0000 7fd389e788c0 1 < completed part key=_multipart_K9X2N6V8R4BY.2~8H6PP82YR2JH.1 size=234057 2024-03-09T14:37:20.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.127+0000 7fd389e788c0 1 < completed multipart upload key=K9X2N6V8R4BY upload=8H6PP82YR2JH tag=6RJNS391M0VL type=write size=2331209 2024-03-09T14:37:20.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.135+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~FPWHD84DGAWM.0 size=1048576 2024-03-09T14:37:20.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.135+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~FPWHD84DGAWM.1 size=489151 2024-03-09T14:37:20.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.135+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=FPWHD84DGAWM tag=2912OMF1K6W4 type=write size=2586303 2024-03-09T14:37:20.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.139+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~164BQXGJL7KS.0 size=1048576 2024-03-09T14:37:20.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.139+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~164BQXGJL7KS.1 size=1048576 2024-03-09T14:37:20.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.139+0000 7fd389e788c0 1 < completed part key=_multipart_E2VP0TJ37UX8.2~164BQXGJL7KS.2 size=855768 2024-03-09T14:37:20.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.143+0000 7fd389e788c0 1 < completed multipart upload key=E2VP0TJ37UX8 upload=164BQXGJL7KS tag=RMJUF8NRO77E type=write size=4001496 2024-03-09T14:37:20.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.147+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~J7XUFCKA3U3B.0 size=1048576 2024-03-09T14:37:20.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.151+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~J7XUFCKA3U3B.1 size=697614 2024-03-09T14:37:20.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.151+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=J7XUFCKA3U3B tag=5ND7UREGN3XC type=write size=2794766 2024-03-09T14:37:20.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.151+0000 7fd389e788c0 1 < canceled part key=_multipart_P83H9137MI7Y.2~M96OLTA4AV5K.0 size=1048576 2024-03-09T14:37:20.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.151+0000 7fd389e788c0 1 < completed part key=_multipart_P83H9137MI7Y.2~M96OLTA4AV5K.1 size=553926 2024-03-09T14:37:20.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.155+0000 7fd389e788c0 1 < canceled multipart upload key=P83H9137MI7Y upload=M96OLTA4AV5K tag=L5RP9SUHGGR6 type=write size=2651078 2024-03-09T14:37:20.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.159+0000 7fd389e788c0 1 > prepared part key=_multipart_CLAM83TC7RZ7.2~EMR7Q5ANARJS.0 size=623130 2024-03-09T14:37:20.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.159+0000 7fd389e788c0 1 > prepared multipart upload key=CLAM83TC7RZ7 upload=EMR7Q5ANARJS tag=71GH7C4OHJTP type=write size=1671706 2024-03-09T14:37:20.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.163+0000 7fd389e788c0 1 < completed delete operation key=E65PFNHJQHEO tag=M8VCGOMK43GZ type=del 2024-03-09T14:37:20.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.167+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~BY3JDN5D3IQR.0 size=376722 2024-03-09T14:37:20.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.167+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=BY3JDN5D3IQR tag=SKG50ISYVY0J type=write size=1425298 2024-03-09T14:37:20.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.167+0000 7fd389e788c0 1 < completed part key=_multipart_2405Y4I2Q8TY.2~2OLD44FQ25VG.0 size=475392 2024-03-09T14:37:20.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.171+0000 7fd389e788c0 1 < completed multipart upload key=2405Y4I2Q8TY upload=2OLD44FQ25VG tag=7IQP4SSFA8IH type=write size=1523968 2024-03-09T14:37:20.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.175+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~V1ACQSOFPI2O.0 size=1048576 2024-03-09T14:37:20.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.179+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~V1ACQSOFPI2O.1 size=1048576 2024-03-09T14:37:20.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.179+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~V1ACQSOFPI2O.2 size=25459 2024-03-09T14:37:20.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.179+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=V1ACQSOFPI2O tag=C3FRNAR1GGOL type=write size=3171187 2024-03-09T14:37:20.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.183+0000 7fd389e788c0 1 < completed delete operation key=SVTMMQ2QR603 tag=7DZLK7X11D2R type=del 2024-03-09T14:37:20.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.187+0000 7fd389e788c0 1 > prepared operation key=FY02AR9GS3KG tag=IVJAS6O09SBE type=write size=157998 2024-03-09T14:37:20.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.187+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~JRTUWO5677NW.0 size=1048576 2024-03-09T14:37:20.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.191+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~JRTUWO5677NW.1 size=1048576 2024-03-09T14:37:20.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.191+0000 7fd389e788c0 1 < completed part key=_multipart_Y7E2TLASJM9T.2~JRTUWO5677NW.2 size=944177 2024-03-09T14:37:20.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.195+0000 7fd389e788c0 1 < completed multipart upload key=Y7E2TLASJM9T upload=JRTUWO5677NW tag=CQ0RJD4YJJML type=write size=4089905 2024-03-09T14:37:20.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.199+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=I6YY0458K8EM type=write size=931841 2024-03-09T14:37:20.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.199+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~VKNZBY89Y609.0 size=821228 2024-03-09T14:37:20.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.203+0000 7fd389e788c0 1 < completed multipart upload key=CLAM83TC7RZ7 upload=VKNZBY89Y609 tag=RTOEO8J1D995 type=write size=1869804 2024-03-09T14:37:20.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.207+0000 7fd389e788c0 1 > prepared operation key=P83H9137MI7Y tag=QXN41M5JCJ0U type=del size=3365587 2024-03-09T14:37:20.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.207+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~DFLOG2ABBQLY.0 size=1048576 2024-03-09T14:37:20.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.211+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~DFLOG2ABBQLY.1 size=1048576 2024-03-09T14:37:20.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.211+0000 7fd389e788c0 1 < completed part key=_multipart_E65PFNHJQHEO.2~DFLOG2ABBQLY.2 size=547280 2024-03-09T14:37:20.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.215+0000 7fd389e788c0 1 < completed multipart upload key=E65PFNHJQHEO upload=DFLOG2ABBQLY tag=M7ZRKR4OW9YK type=write size=3693008 2024-03-09T14:37:20.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.219+0000 7fd389e788c0 1 > prepared part key=_multipart_Z18Q66VI5PDN.2~9HWI5RW04IXM.0 size=780319 2024-03-09T14:37:20.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.219+0000 7fd389e788c0 1 > prepared multipart upload key=Z18Q66VI5PDN upload=9HWI5RW04IXM tag=SCBT02UZHE50 type=write size=1828895 2024-03-09T14:37:20.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.223+0000 7fd389e788c0 1 < suggested remove operation key=1K5KR8U3GCOV tag=71P38LOV7WKD type=del 2024-03-09T14:37:20.227 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.227+0000 7fd389e788c0 1 > prepared operation key=YR2VX4QLOCOG tag=83IUUATTTQVS type=write size=789642 2024-03-09T14:37:20.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.227+0000 7fd389e788c0 1 < completed delete operation key=I4NA328AI5T1 tag=CG7NC28N9LZH type=del 2024-03-09T14:37:20.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.231+0000 7fd389e788c0 1 > prepared operation key=5ZEDXFB9B3CN tag=VTSJXJZ8S3VP type=del size=4041581 2024-03-09T14:37:20.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.235+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=H8BXHW9JQIP2 type=del 2024-03-09T14:37:20.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.235+0000 7fd389e788c0 1 > prepared operation key=2405Y4I2Q8TY tag=UECM3X11C2YN type=del size=2527465 2024-03-09T14:37:20.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.235+0000 7fd389e788c0 1 < canceled part key=_multipart_1K5KR8U3GCOV.2~F20D6CBIO755.0 size=1048576 2024-03-09T14:37:20.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.239+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~F20D6CBIO755.1 size=525400 2024-03-09T14:37:20.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.243+0000 7fd389e788c0 1 < canceled multipart upload key=1K5KR8U3GCOV upload=F20D6CBIO755 tag=8M0Q5EYXDTKF type=write size=2622552 2024-03-09T14:37:20.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.243+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=4QARORDBCTYE type=del size=1846817 2024-03-09T14:37:20.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.247+0000 7fd389e788c0 1 < completed delete operation key=IXKMXJ9IZ69S tag=0L8L6QBIGD45 type=del 2024-03-09T14:37:20.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.251+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~SZWUHFAEATLY.0 size=1048576 2024-03-09T14:37:20.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.251+0000 7fd389e788c0 1 > prepared part key=_multipart_SVTMMQ2QR603.2~SZWUHFAEATLY.1 size=112078 2024-03-09T14:37:20.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.251+0000 7fd389e788c0 1 > prepared multipart upload key=SVTMMQ2QR603 upload=SZWUHFAEATLY tag=OA7HUTG3RH21 type=write size=2209230 2024-03-09T14:37:20.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.255+0000 7fd389e788c0 1 < completed part key=_multipart_SKIBISETJH7B.2~22O7DWZ1BSUB.0 size=968824 2024-03-09T14:37:20.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.259+0000 7fd389e788c0 1 < completed multipart upload key=SKIBISETJH7B upload=22O7DWZ1BSUB tag=0MBF4121TYGW type=write size=2017400 2024-03-09T14:37:20.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.259+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=M6XS0CUN62PU type=del size=1738411 2024-03-09T14:37:20.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.263+0000 7fd389e788c0 1 < completed delete operation key=UMT7VKZ9R4IR tag=3VXGOPVA1CPF type=del 2024-03-09T14:37:20.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.267+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~8057RDU8U5KX.0 size=1048576 2024-03-09T14:37:20.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.267+0000 7fd389e788c0 1 > prepared part key=_multipart_71692MJQITX3.2~8057RDU8U5KX.1 size=589906 2024-03-09T14:37:20.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.267+0000 7fd389e788c0 1 > prepared multipart upload key=71692MJQITX3 upload=8057RDU8U5KX tag=16CYCDLRO01K type=write size=2687058 2024-03-09T14:37:20.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.271+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~FPWHD84DGAWM.0 size=1048576 2024-03-09T14:37:20.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.271+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~FPWHD84DGAWM.1 size=489151 2024-03-09T14:37:20.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.275+0000 7fd389e788c0 1 < completed multipart upload key=1K5KR8U3GCOV upload=FPWHD84DGAWM tag=2912OMF1K6W4 type=write size=2586303 2024-03-09T14:37:20.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.283+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~NVIFEA6TCKQI.0 size=1048576 2024-03-09T14:37:20.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.283+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~NVIFEA6TCKQI.1 size=122815 2024-03-09T14:37:20.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.283+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=NVIFEA6TCKQI tag=9XFTUJ9Q30FU type=write size=2219967 2024-03-09T14:37:20.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.287+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~J7XUFCKA3U3B.0 size=1048576 2024-03-09T14:37:20.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.287+0000 7fd389e788c0 1 < completed part key=_multipart_CLAM83TC7RZ7.2~J7XUFCKA3U3B.1 size=697614 2024-03-09T14:37:20.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.295+0000 7fd389e788c0 1 < completed multipart upload key=CLAM83TC7RZ7 upload=J7XUFCKA3U3B tag=5ND7UREGN3XC type=write size=2794766 2024-03-09T14:37:20.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.295+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=OYYD6JEROYFU type=del size=2492956 2024-03-09T14:37:20.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.295+0000 7fd389e788c0 1 < canceled part key=_multipart_CLAM83TC7RZ7.2~EMR7Q5ANARJS.0 size=623130 2024-03-09T14:37:20.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.299+0000 7fd389e788c0 1 < canceled multipart upload key=CLAM83TC7RZ7 upload=EMR7Q5ANARJS tag=71GH7C4OHJTP type=write size=1671706 2024-03-09T14:37:20.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.307+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~WO98II701EYN.0 size=272640 2024-03-09T14:37:20.305 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.307+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=WO98II701EYN tag=QCXA46O1TAYK type=write size=1321216 2024-03-09T14:37:20.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.307+0000 7fd389e788c0 1 < completed part key=_multipart_PKVYD8DWS7M2.2~BY3JDN5D3IQR.0 size=376722 2024-03-09T14:37:20.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.311+0000 7fd389e788c0 1 < completed multipart upload key=PKVYD8DWS7M2 upload=BY3JDN5D3IQR tag=SKG50ISYVY0J type=write size=1425298 2024-03-09T14:37:20.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.315+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~HGCVRXB29FCQ.0 size=1048576 2024-03-09T14:37:20.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.319+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~HGCVRXB29FCQ.1 size=1048576 2024-03-09T14:37:20.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.319+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~HGCVRXB29FCQ.2 size=658128 2024-03-09T14:37:20.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.319+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=HGCVRXB29FCQ tag=TLKT0Z0P8GUQ type=write size=3803856 2024-03-09T14:37:20.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.323+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~V1ACQSOFPI2O.0 size=1048576 2024-03-09T14:37:20.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.327+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~V1ACQSOFPI2O.1 size=1048576 2024-03-09T14:37:20.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.327+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~V1ACQSOFPI2O.2 size=25459 2024-03-09T14:37:20.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.331+0000 7fd389e788c0 1 < completed multipart upload key=Z18Q66VI5PDN upload=V1ACQSOFPI2O tag=C3FRNAR1GGOL type=write size=3171187 2024-03-09T14:37:20.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.335+0000 7fd389e788c0 1 > prepared operation key=PKVYD8DWS7M2 tag=0GAMLAEU8V9D type=del size=73558 2024-03-09T14:37:20.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.339+0000 7fd389e788c0 1 < suggested update operation key=FY02AR9GS3KG tag=IVJAS6O09SBE type=write size=157998 2024-03-09T14:37:20.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.347+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~PFYMTRLUPNYO.0 size=1048576 2024-03-09T14:37:20.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.347+0000 7fd389e788c0 1 > prepared part key=_multipart_FLLUAY21DJ12.2~PFYMTRLUPNYO.1 size=527420 2024-03-09T14:37:20.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.347+0000 7fd389e788c0 1 > prepared multipart upload key=FLLUAY21DJ12 upload=PFYMTRLUPNYO tag=27Z47X6VY3DK type=write size=2624572 2024-03-09T14:37:20.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.351+0000 7fd389e788c0 1 < completed write operation key=E65PFNHJQHEO tag=I6YY0458K8EM type=write size=931841 2024-03-09T14:37:20.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.355+0000 7fd389e788c0 1 > prepared operation key=CLAM83TC7RZ7 tag=IWP7N46XEH6F type=del size=2774738 2024-03-09T14:37:20.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.355+0000 7fd389e788c0 1 < completed delete operation key=P83H9137MI7Y tag=QXN41M5JCJ0U type=del 2024-03-09T14:37:20.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.359+0000 7fd389e788c0 1 > prepared operation key=Z18Q66VI5PDN tag=H0CSC2ES9AQ3 type=del size=2085800 2024-03-09T14:37:20.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.359+0000 7fd389e788c0 1 < completed part key=_multipart_Z18Q66VI5PDN.2~9HWI5RW04IXM.0 size=780319 2024-03-09T14:37:20.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.363+0000 7fd389e788c0 1 < completed multipart upload key=Z18Q66VI5PDN upload=9HWI5RW04IXM tag=SCBT02UZHE50 type=write size=1828895 2024-03-09T14:37:20.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.367+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~17HKB4PAMSHP.0 size=1048576 2024-03-09T14:37:20.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.371+0000 7fd389e788c0 1 > prepared part key=_multipart_1K5KR8U3GCOV.2~17HKB4PAMSHP.1 size=674242 2024-03-09T14:37:20.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.371+0000 7fd389e788c0 1 > prepared multipart upload key=1K5KR8U3GCOV upload=17HKB4PAMSHP tag=HXQFGVQ5HNM7 type=write size=2771394 2024-03-09T14:37:20.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.371+0000 7fd389e788c0 1 < completed write operation key=YR2VX4QLOCOG tag=83IUUATTTQVS type=write size=789642 2024-03-09T14:37:20.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.375+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~AUI4B089TNXA.0 size=1048576 2024-03-09T14:37:20.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.379+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~AUI4B089TNXA.1 size=1048576 2024-03-09T14:37:20.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.379+0000 7fd389e788c0 1 > prepared part key=_multipart_IXKMXJ9IZ69S.2~AUI4B089TNXA.2 size=236816 2024-03-09T14:37:20.380 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.379+0000 7fd389e788c0 1 > prepared multipart upload key=IXKMXJ9IZ69S upload=AUI4B089TNXA tag=LKTK6YMY7IFM type=write size=3382544 2024-03-09T14:37:20.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.383+0000 7fd389e788c0 1 < completed delete operation key=5ZEDXFB9B3CN tag=VTSJXJZ8S3VP type=del 2024-03-09T14:37:20.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.387+0000 7fd389e788c0 1 > prepared part key=_multipart_U8P5Q3D11MM6.2~QFDOUWP5KBHX.0 size=954711 2024-03-09T14:37:20.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.387+0000 7fd389e788c0 1 > prepared multipart upload key=U8P5Q3D11MM6 upload=QFDOUWP5KBHX tag=2CY18IMLHUJE type=write size=2003287 2024-03-09T14:37:20.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.391+0000 7fd389e788c0 1 < completed delete operation key=2405Y4I2Q8TY tag=UECM3X11C2YN type=del 2024-03-09T14:37:20.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.395+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~RKFJPY3FRGNM.0 size=345152 2024-03-09T14:37:20.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.395+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=RKFJPY3FRGNM tag=2X6K12P7TMDM type=write size=1393728 2024-03-09T14:37:20.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.395+0000 7fd389e788c0 1 < completed delete operation key=Z18Q66VI5PDN tag=4QARORDBCTYE type=del 2024-03-09T14:37:20.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.399+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~GTJ89K0K0Q9C.0 size=1048576 2024-03-09T14:37:20.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.403+0000 7fd389e788c0 1 > prepared part key=_multipart_44F8QXCBBENS.2~GTJ89K0K0Q9C.1 size=417250 2024-03-09T14:37:20.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.403+0000 7fd389e788c0 1 > prepared multipart upload key=44F8QXCBBENS upload=GTJ89K0K0Q9C tag=7RMSM2DQ0ESY type=write size=2514402 2024-03-09T14:37:20.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.407+0000 7fd389e788c0 1 < completed part key=_multipart_SVTMMQ2QR603.2~SZWUHFAEATLY.0 size=1048576 2024-03-09T14:37:20.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.407+0000 7fd389e788c0 1 < canceled part key=_multipart_SVTMMQ2QR603.2~SZWUHFAEATLY.1 size=112078 2024-03-09T14:37:20.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.411+0000 7fd389e788c0 1 < canceled multipart upload key=SVTMMQ2QR603 upload=SZWUHFAEATLY tag=OA7HUTG3RH21 type=write size=2209230 2024-03-09T14:37:20.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.411+0000 7fd389e788c0 1 > prepared operation key=E65PFNHJQHEO tag=GQO7CNC1LX9R type=del size=692539 2024-03-09T14:37:20.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.415+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=M6XS0CUN62PU type=del 2024-03-09T14:37:20.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.419+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~11WCQCFGJREF.0 size=1048576 2024-03-09T14:37:20.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.423+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~11WCQCFGJREF.1 size=1048576 2024-03-09T14:37:20.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.423+0000 7fd389e788c0 1 > prepared part key=_multipart_K9X2N6V8R4BY.2~11WCQCFGJREF.2 size=854008 2024-03-09T14:37:20.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.423+0000 7fd389e788c0 1 > prepared multipart upload key=K9X2N6V8R4BY upload=11WCQCFGJREF tag=Y43MJWLXUTY3 type=write size=3999736 2024-03-09T14:37:20.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.423+0000 7fd389e788c0 1 < canceled part key=_multipart_71692MJQITX3.2~8057RDU8U5KX.0 size=1048576 2024-03-09T14:37:20.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.423+0000 7fd389e788c0 1 < canceled part key=_multipart_71692MJQITX3.2~8057RDU8U5KX.1 size=589906 2024-03-09T14:37:20.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.427+0000 7fd389e788c0 1 < canceled multipart upload key=71692MJQITX3 upload=8057RDU8U5KX tag=16CYCDLRO01K type=write size=2687058 2024-03-09T14:37:20.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.431+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=TMPN3MYYZQYN type=del size=496732 2024-03-09T14:37:20.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.435+0000 7fd389e788c0 1 < completed part key=_multipart_U8P5Q3D11MM6.2~NVIFEA6TCKQI.0 size=1048576 2024-03-09T14:37:20.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.435+0000 7fd389e788c0 1 < canceled part key=_multipart_U8P5Q3D11MM6.2~NVIFEA6TCKQI.1 size=122815 2024-03-09T14:37:20.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.439+0000 7fd389e788c0 1 < canceled multipart upload key=U8P5Q3D11MM6 upload=NVIFEA6TCKQI tag=9XFTUJ9Q30FU type=write size=2219967 2024-03-09T14:37:20.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.443+0000 7fd389e788c0 1 > prepared operation key=1K5KR8U3GCOV tag=M3MK2YCCNTRX type=del size=3905706 2024-03-09T14:37:20.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.443+0000 7fd389e788c0 1 < completed delete operation key=AUSZ4JUGI6UU tag=OYYD6JEROYFU type=del 2024-03-09T14:37:20.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.447+0000 7fd389e788c0 1 > prepared operation key=Y7E2TLASJM9T tag=SAYSEEE5APH2 type=del size=1015101 2024-03-09T14:37:20.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.451+0000 7fd389e788c0 1 < completed part key=_multipart_FLLUAY21DJ12.2~WO98II701EYN.0 size=272640 2024-03-09T14:37:20.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.455+0000 7fd389e788c0 1 < completed multipart upload key=FLLUAY21DJ12 upload=WO98II701EYN tag=QCXA46O1TAYK type=write size=1321216 2024-03-09T14:37:20.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.459+0000 7fd389e788c0 1 > prepared operation key=AUSZ4JUGI6UU tag=STZ87Y03W6C2 type=del size=3908810 2024-03-09T14:37:20.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.459+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~HGCVRXB29FCQ.0 size=1048576 2024-03-09T14:37:20.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.463+0000 7fd389e788c0 1 < completed part key=_multipart_1K5KR8U3GCOV.2~HGCVRXB29FCQ.1 size=1048576 2024-03-09T14:37:20.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.463+0000 7fd389e788c0 1 < canceled part key=_multipart_1K5KR8U3GCOV.2~HGCVRXB29FCQ.2 size=658128 2024-03-09T14:37:20.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.467+0000 7fd389e788c0 1 < canceled multipart upload key=1K5KR8U3GCOV upload=HGCVRXB29FCQ tag=TLKT0Z0P8GUQ type=write size=3803856 2024-03-09T14:37:20.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.471+0000 7fd389e788c0 1 > prepared operation key=IXKMXJ9IZ69S tag=74DR9YMUTATN type=del size=626936 2024-03-09T14:37:20.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.475+0000 7fd389e788c0 1 < suggested remove operation key=PKVYD8DWS7M2 tag=0GAMLAEU8V9D type=del 2024-03-09T14:37:20.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.479+0000 7fd389e788c0 1 > prepared part key=_multipart_PKVYD8DWS7M2.2~I32C7OMAMC45.0 size=81698 2024-03-09T14:37:20.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:37:20.479+0000 7fd389e788c0 1 > prepared multipart upload key=PKVYD8DWS7M2 upload=I32C7OMAMC45 tag=D2SB07CI6J9P type=write size=1130274 2024-03-09T14:37:20.479 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] cls_rgw_stats.simulate (19543 ms) 2024-03-09T14:37:20.479 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 1 test from cls_rgw_stats (19543 ms total) 2024-03-09T14:37:20.480 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:37:20.480 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:37:20.779 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 1 test from 1 test suite ran. (21759 ms total) 2024-03-09T14:37:20.779 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 1 test. 2024-03-09T14:37:20.785 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:37:20.786 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:37:20.842 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-03-09T14:37:20.887 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-03-09T14:37:20.887 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-03-09T14:37:20.910 INFO:tasks.workunit.client.0.smithi099.stdout:Running main() from gmock_main.cc 2024-03-09T14:37:20.910 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 31 tests from 1 test suite. 2024-03-09T14:37:20.910 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:37:22.804 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 31 tests from CmpOmap 2024-03-09T14:37:22.804 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-03-09T14:37:22.826 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (22 ms) 2024-03-09T14:37:22.826 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-03-09T14:37:22.843 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (17 ms) 2024-03-09T14:37:22.843 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-03-09T14:37:22.848 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (5 ms) 2024-03-09T14:37:22.848 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-03-09T14:37:22.854 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (6 ms) 2024-03-09T14:37:22.854 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-03-09T14:37:22.871 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_str (17 ms) 2024-03-09T14:37:22.871 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-03-09T14:37:22.884 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_u64 (12 ms) 2024-03-09T14:37:22.884 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-03-09T14:37:22.890 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (7 ms) 2024-03-09T14:37:22.890 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-03-09T14:37:22.898 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (8 ms) 2024-03-09T14:37:22.899 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-03-09T14:37:22.909 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (10 ms) 2024-03-09T14:37:22.909 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-03-09T14:37:22.920 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (11 ms) 2024-03-09T14:37:22.920 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-03-09T14:37:22.922 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (2 ms) 2024-03-09T14:37:22.922 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-03-09T14:37:22.924 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (2 ms) 2024-03-09T14:37:22.924 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-03-09T14:37:22.941 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (17 ms) 2024-03-09T14:37:22.941 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-03-09T14:37:22.957 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (16 ms) 2024-03-09T14:37:22.957 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-03-09T14:37:22.975 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (17 ms) 2024-03-09T14:37:22.975 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-03-09T14:37:22.991 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (16 ms) 2024-03-09T14:37:22.991 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-03-09T14:37:23.012 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_str (21 ms) 2024-03-09T14:37:23.012 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-03-09T14:37:23.032 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (21 ms) 2024-03-09T14:37:23.033 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-03-09T14:37:23.040 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (7 ms) 2024-03-09T14:37:23.040 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-03-09T14:37:23.046 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (6 ms) 2024-03-09T14:37:23.046 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-03-09T14:37:23.049 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (3 ms) 2024-03-09T14:37:23.049 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-03-09T14:37:23.051 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (3 ms) 2024-03-09T14:37:23.051 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-03-09T14:37:23.068 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (16 ms) 2024-03-09T14:37:23.068 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-03-09T14:37:23.084 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (17 ms) 2024-03-09T14:37:23.085 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-03-09T14:37:23.105 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (20 ms) 2024-03-09T14:37:23.105 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-03-09T14:37:23.125 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (20 ms) 2024-03-09T14:37:23.125 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-03-09T14:37:23.133 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (7 ms) 2024-03-09T14:37:23.134 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-03-09T14:37:23.138 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (6 ms) 2024-03-09T14:37:23.138 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-03-09T14:37:23.141 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-03-09T14:37:23.141 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-03-09T14:37:23.143 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (3 ms) 2024-03-09T14:37:23.143 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-03-09T14:37:23.163 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (19 ms) 2024-03-09T14:37:23.163 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 31 tests from CmpOmap (359 ms total) 2024-03-09T14:37:23.163 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:37:23.163 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:37:23.827 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 31 tests from 1 test suite ran. (2916 ms total) 2024-03-09T14:37:23.827 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 31 tests. 2024-03-09T14:37:23.831 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:37:23.831 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:37:23.886 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-03-09T14:37:23.888 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-03-09T14:37:23.888 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-03-09T14:37:23.952 INFO:tasks.workunit.client.0.smithi099.stdout:Running main() from gmock_main.cc 2024-03-09T14:37:23.952 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-09T14:37:23.952 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:37:23.952 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 24 tests from TestCls2PCQueue 2024-03-09T14:37:23.952 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-03-09T14:37:26.841 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2887 ms) 2024-03-09T14:37:26.841 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-03-09T14:37:29.882 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3039 ms) 2024-03-09T14:37:29.882 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-03-09T14:37:32.893 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.Reserve (3015 ms) 2024-03-09T14:37:32.893 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-03-09T14:37:35.961 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3068 ms) 2024-03-09T14:37:35.961 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-03-09T14:37:40.041 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.Commit (4072 ms) 2024-03-09T14:37:40.041 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-03-09T14:37:44.093 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.Stats (4061 ms) 2024-03-09T14:37:44.093 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-03-09T14:37:48.141 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4039 ms) 2024-03-09T14:37:48.141 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-03-09T14:37:51.183 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.Abort (3050 ms) 2024-03-09T14:37:51.183 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-03-09T14:37:54.210 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.ReserveError (3028 ms) 2024-03-09T14:37:54.210 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-03-09T14:37:57.263 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.CommitError (3053 ms) 2024-03-09T14:37:57.263 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-03-09T14:38:00.308 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.AbortError (3042 ms) 2024-03-09T14:38:00.308 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-03-09T14:38:03.333 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3021 ms) 2024-03-09T14:38:03.333 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-03-09T14:38:06.393 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3065 ms) 2024-03-09T14:38:06.393 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-03-09T14:38:09.398 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3004 ms) 2024-03-09T14:38:09.398 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-03-09T14:38:12.449 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3054 ms) 2024-03-09T14:38:12.449 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-03-09T14:38:15.515 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3063 ms) 2024-03-09T14:38:15.515 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-03-09T14:38:18.546 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3033 ms) 2024-03-09T14:38:18.546 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-03-09T14:38:21.568 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.Cleanup (3019 ms) 2024-03-09T14:38:21.568 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-03-09T14:38:33.785 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.MultiProducer (12221 ms) 2024-03-09T14:38:33.785 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-03-09T14:38:38.846 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5061 ms) 2024-03-09T14:38:38.846 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-03-09T14:38:51.946 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13100 ms) 2024-03-09T14:38:51.946 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-03-09T14:38:57.986 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (6040 ms) 2024-03-09T14:38:57.986 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-03-09T14:39:08.802 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (10816 ms) 2024-03-09T14:39:08.802 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-03-09T14:39:18.871 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (10069 ms) 2024-03-09T14:39:18.871 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 24 tests from TestCls2PCQueue (114920 ms total) 2024-03-09T14:39:18.871 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:39:18.871 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:39:18.871 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 24 tests from 1 test suite ran. (114920 ms total) 2024-03-09T14:39:18.871 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 24 tests. 2024-03-09T14:39:18.876 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:39:18.876 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:39:18.938 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-03-09T14:39:18.939 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-03-09T14:39:18.939 DEBUG:teuthology.orchestra.run.smithi099:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-03-09T14:39:19.012 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:19.012 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:19.012 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 4 tests from 1 test suite. 2024-03-09T14:39:19.012 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:39:20.894 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 4 tests from ClsAccount 2024-03-09T14:39:20.894 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsAccount.add 2024-03-09T14:39:20.921 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsAccount.add (28 ms) 2024-03-09T14:39:20.921 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsAccount.get 2024-03-09T14:39:20.930 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsAccount.get (9 ms) 2024-03-09T14:39:20.930 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsAccount.rm 2024-03-09T14:39:20.979 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsAccount.rm (49 ms) 2024-03-09T14:39:20.980 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] ClsAccount.list 2024-03-09T14:39:21.029 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] ClsAccount.list (50 ms) 2024-03-09T14:39:21.029 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 4 tests from ClsAccount (136 ms total) 2024-03-09T14:39:21.029 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:39:21.029 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:39:21.910 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 4 tests from 1 test suite ran. (2898 ms total) 2024-03-09T14:39:21.911 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 4 tests. 2024-03-09T14:39:21.919 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:39:21.919 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:39:21.973 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-03-09T14:39:21.974 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-03-09T14:39:21.974 DEBUG:teuthology.orchestra.run.smithi099:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-03-09T14:39:22.047 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:22.047 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:22.048 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 6 tests from 1 test suite. 2024-03-09T14:39:22.048 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:39:23.905 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 6 tests from rgw_gc_log 2024-03-09T14:39:23.906 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-03-09T14:39:23.952 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] rgw_gc_log.init_existing_queue (47 ms) 2024-03-09T14:39:23.952 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-03-09T14:39:23.957 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] rgw_gc_log.init_existing_omap (5 ms) 2024-03-09T14:39:23.957 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-03-09T14:39:23.964 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (7 ms) 2024-03-09T14:39:23.964 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-03-09T14:39:23.966 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-03-09T14:39:23.966 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-03-09T14:39:23.971 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] rgw_gc_log.defer1_after_init (5 ms) 2024-03-09T14:39:23.971 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-03-09T14:39:23.974 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] rgw_gc_log.defer2_before_init (3 ms) 2024-03-09T14:39:23.974 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 6 tests from rgw_gc_log (69 ms total) 2024-03-09T14:39:23.975 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:39:23.975 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:39:24.917 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 6 tests from 1 test suite ran. (2870 ms total) 2024-03-09T14:39:24.917 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 6 tests. 2024-03-09T14:39:24.924 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:39:24.925 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:39:24.980 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-03-09T14:39:24.981 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-03-09T14:39:24.981 DEBUG:teuthology.orchestra.run.smithi099:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-03-09T14:39:25.053 INFO:tasks.workunit.client.0.smithi099.stdout:Running main() from gmock_main.cc 2024-03-09T14:39:25.054 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 4 tests from 1 test suite. 2024-03-09T14:39:25.054 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:39:25.054 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 4 tests from TestRGWObj 2024-03-09T14:39:25.054 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestRGWObj.underscore 2024-03-09T14:39:25.054 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-03-09T14:39:25.054 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-03-09T14:39:25.054 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns= i= 2024-03-09T14:39:25.054 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-03-09T14:39:25.054 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-03-09T14:39:25.054 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns= i= 2024-03-09T14:39:25.054 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-03-09T14:39:25.055 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-03-09T14:39:25.055 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns= i= 2024-03-09T14:39:25.055 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.055 INFO:tasks.workunit.client.0.smithi099.stdout: "obj1": { 2024-03-09T14:39:25.055 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.055 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.055 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.055 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.055 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.055 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.055 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.055 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.055 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.055 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.055 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.056 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.056 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-03-09T14:39:25.056 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.056 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.056 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.056 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.056 INFO:tasks.workunit.client.0.smithi099.stdout: "obj2": { 2024-03-09T14:39:25.056 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.056 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.056 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.056 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.056 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.056 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.056 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.056 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.057 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.057 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.057 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.057 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.057 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-03-09T14:39:25.057 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.057 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.057 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.057 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.057 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3": { 2024-03-09T14:39:25.057 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.057 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.057 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.057 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.058 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.058 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.058 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.058 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.058 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.058 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.058 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.058 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.058 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-03-09T14:39:25.058 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.058 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.058 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.058 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.058 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3-2": { 2024-03-09T14:39:25.059 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.059 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.059 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.059 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.059 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.059 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.059 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.059 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.059 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.059 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.060 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.060 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.060 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-03-09T14:39:25.060 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.060 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.060 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.060 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.060 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.060 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-03-09T14:39:25.060 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-03-09T14:39:25.060 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns=ns i= 2024-03-09T14:39:25.060 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-03-09T14:39:25.060 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-03-09T14:39:25.061 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns=ns i= 2024-03-09T14:39:25.061 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-03-09T14:39:25.061 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj 2024-03-09T14:39:25.061 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns=ns i= 2024-03-09T14:39:25.061 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.061 INFO:tasks.workunit.client.0.smithi099.stdout: "obj1": { 2024-03-09T14:39:25.061 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.061 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.061 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.061 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.061 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.061 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.061 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.062 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.062 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.062 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.062 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.062 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.062 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-03-09T14:39:25.062 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.062 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.062 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.062 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.062 INFO:tasks.workunit.client.0.smithi099.stdout: "obj2": { 2024-03-09T14:39:25.062 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.062 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.063 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.063 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.063 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.063 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.063 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.063 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.063 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.063 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.063 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.063 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.063 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-03-09T14:39:25.063 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.063 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.063 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.064 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.064 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3": { 2024-03-09T14:39:25.064 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.064 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.064 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.064 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.064 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.064 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.064 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.064 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.064 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.064 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.064 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.065 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.065 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-03-09T14:39:25.065 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.065 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.065 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.065 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.065 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3-2": { 2024-03-09T14:39:25.065 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.065 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.065 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.065 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.065 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.065 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.066 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.066 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.066 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.066 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.066 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.066 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.066 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-03-09T14:39:25.066 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.066 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.066 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.066 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.066 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.066 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-03-09T14:39:25.066 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-03-09T14:39:25.066 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns= i=v1 2024-03-09T14:39:25.067 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-03-09T14:39:25.067 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-03-09T14:39:25.067 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns= i=v1 2024-03-09T14:39:25.067 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-03-09T14:39:25.067 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-03-09T14:39:25.067 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns= i=v1 2024-03-09T14:39:25.067 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.067 INFO:tasks.workunit.client.0.smithi099.stdout: "obj1": { 2024-03-09T14:39:25.067 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.067 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.067 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.067 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.067 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.067 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.068 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.068 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.068 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.068 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.068 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.068 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.068 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-03-09T14:39:25.068 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-03-09T14:39:25.068 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.068 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.068 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.068 INFO:tasks.workunit.client.0.smithi099.stdout: "obj2": { 2024-03-09T14:39:25.068 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.068 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.068 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.069 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.069 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.069 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.069 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.069 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.069 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.069 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.069 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.069 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.069 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-03-09T14:39:25.069 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-03-09T14:39:25.069 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.069 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.069 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.069 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3": { 2024-03-09T14:39:25.070 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.070 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.070 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.070 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.070 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.070 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.070 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.070 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.070 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.070 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.070 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.070 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.070 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-03-09T14:39:25.070 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.071 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.071 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.071 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.071 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3-2": { 2024-03-09T14:39:25.071 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.071 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.071 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.071 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.071 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.071 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.071 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.071 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.072 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.072 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.072 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.072 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.072 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-03-09T14:39:25.072 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-03-09T14:39:25.072 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.072 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.072 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.072 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.072 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-03-09T14:39:25.072 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-03-09T14:39:25.072 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns=ns i=v1 2024-03-09T14:39:25.072 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-03-09T14:39:25.072 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-03-09T14:39:25.073 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns=ns i=v1 2024-03-09T14:39:25.073 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-03-09T14:39:25.073 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: _obj[v1] 2024-03-09T14:39:25.073 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: _obj ns=ns i=v1 2024-03-09T14:39:25.073 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.073 INFO:tasks.workunit.client.0.smithi099.stdout: "obj1": { 2024-03-09T14:39:25.073 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.073 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.073 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.073 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.073 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.073 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.073 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.074 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.074 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.074 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.074 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.074 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.074 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-03-09T14:39:25.074 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-03-09T14:39:25.074 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.074 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.074 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.074 INFO:tasks.workunit.client.0.smithi099.stdout: "obj2": { 2024-03-09T14:39:25.074 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.074 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.074 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.075 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.075 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.075 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.075 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.075 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.075 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.075 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.075 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.075 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.075 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-03-09T14:39:25.075 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-03-09T14:39:25.075 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.075 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.075 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.076 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3": { 2024-03-09T14:39:25.076 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.076 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.076 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.076 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.076 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.076 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.076 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.076 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.076 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.076 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.077 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.077 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.077 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-03-09T14:39:25.077 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.077 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.077 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.077 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.077 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3-2": { 2024-03-09T14:39:25.077 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.077 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.077 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.077 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.077 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.077 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.077 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.078 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.078 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.078 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.078 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.078 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.078 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_obj", 2024-03-09T14:39:25.078 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-03-09T14:39:25.078 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.078 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.078 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.078 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.078 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-03-09T14:39:25.078 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestRGWObj.no_underscore 2024-03-09T14:39:25.079 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-03-09T14:39:25.079 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-03-09T14:39:25.079 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns= i= 2024-03-09T14:39:25.079 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-03-09T14:39:25.079 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-03-09T14:39:25.079 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns= i= 2024-03-09T14:39:25.079 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-03-09T14:39:25.079 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-03-09T14:39:25.079 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns= i= 2024-03-09T14:39:25.079 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.079 INFO:tasks.workunit.client.0.smithi099.stdout: "obj1": { 2024-03-09T14:39:25.079 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.079 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.080 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.080 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.080 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.080 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.080 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.080 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.080 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.080 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.080 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.080 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.080 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-03-09T14:39:25.080 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.080 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.081 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.081 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.081 INFO:tasks.workunit.client.0.smithi099.stdout: "obj2": { 2024-03-09T14:39:25.081 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.081 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.081 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.081 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.081 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.081 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.081 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.081 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.081 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.081 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.082 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.082 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.082 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-03-09T14:39:25.082 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.082 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.082 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.082 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.082 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3": { 2024-03-09T14:39:25.082 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.082 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.082 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.082 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.082 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.082 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.083 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.083 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.083 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.083 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.083 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.083 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.083 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-03-09T14:39:25.083 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.083 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.083 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.083 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.083 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3-2": { 2024-03-09T14:39:25.083 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.084 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.084 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.084 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.084 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.084 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.084 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.084 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.084 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.084 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.084 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.084 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.084 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-03-09T14:39:25.084 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.085 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.085 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.085 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.085 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.085 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-03-09T14:39:25.085 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-03-09T14:39:25.085 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns=ns i= 2024-03-09T14:39:25.085 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-03-09T14:39:25.085 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-03-09T14:39:25.085 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns=ns i= 2024-03-09T14:39:25.085 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-03-09T14:39:25.085 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj 2024-03-09T14:39:25.085 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns=ns i= 2024-03-09T14:39:25.086 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.086 INFO:tasks.workunit.client.0.smithi099.stdout: "obj1": { 2024-03-09T14:39:25.086 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.086 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.086 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.086 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.086 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.086 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.086 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.086 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.086 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.086 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.087 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.087 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.087 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-03-09T14:39:25.087 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.087 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.087 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.087 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.087 INFO:tasks.workunit.client.0.smithi099.stdout: "obj2": { 2024-03-09T14:39:25.087 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.087 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.087 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.087 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.087 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.087 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.088 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.088 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.088 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.088 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.088 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.088 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.088 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-03-09T14:39:25.088 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.088 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.088 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.088 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.088 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3": { 2024-03-09T14:39:25.088 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.088 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.088 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.089 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.089 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.089 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.089 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.089 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.089 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.089 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.089 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.089 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.089 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-03-09T14:39:25.089 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.089 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.089 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.089 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.090 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3-2": { 2024-03-09T14:39:25.090 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.090 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.090 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.090 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.090 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.090 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.090 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.090 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.090 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.090 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.090 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.090 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.090 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-03-09T14:39:25.091 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.091 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.091 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.091 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.091 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.091 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-03-09T14:39:25.091 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-03-09T14:39:25.091 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns= i=v1 2024-03-09T14:39:25.091 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-03-09T14:39:25.091 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-03-09T14:39:25.091 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns= i=v1 2024-03-09T14:39:25.091 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-03-09T14:39:25.091 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-03-09T14:39:25.091 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns= i=v1 2024-03-09T14:39:25.091 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.092 INFO:tasks.workunit.client.0.smithi099.stdout: "obj1": { 2024-03-09T14:39:25.092 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.092 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.092 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.092 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.092 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.092 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.092 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.092 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.092 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.092 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.092 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.092 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.092 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-03-09T14:39:25.092 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-03-09T14:39:25.093 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.093 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.093 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.093 INFO:tasks.workunit.client.0.smithi099.stdout: "obj2": { 2024-03-09T14:39:25.093 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.093 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.093 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.093 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.093 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.093 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.093 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.093 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.093 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.093 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.093 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.094 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.094 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-03-09T14:39:25.094 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-03-09T14:39:25.094 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.094 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.094 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.094 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3": { 2024-03-09T14:39:25.094 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.094 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.094 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.094 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.094 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.094 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.094 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.094 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.095 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.095 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.095 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.095 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.095 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-03-09T14:39:25.095 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.095 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.095 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.095 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.095 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3-2": { 2024-03-09T14:39:25.095 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.095 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.095 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.095 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.095 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.096 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.096 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.096 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.096 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.096 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.096 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.096 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.096 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-03-09T14:39:25.096 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-03-09T14:39:25.096 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.096 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.096 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.096 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.096 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-03-09T14:39:25.097 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-03-09T14:39:25.097 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns=ns i=v1 2024-03-09T14:39:25.097 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-03-09T14:39:25.097 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-03-09T14:39:25.097 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns=ns i=v1 2024-03-09T14:39:25.097 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-03-09T14:39:25.097 INFO:tasks.workunit.client.0.smithi099.stdout:parsed: obj[v1] 2024-03-09T14:39:25.097 INFO:tasks.workunit.client.0.smithi099.stdout:stripped: obj ns=ns i=v1 2024-03-09T14:39:25.097 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.097 INFO:tasks.workunit.client.0.smithi099.stdout: "obj1": { 2024-03-09T14:39:25.097 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.097 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.098 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.098 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.098 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.098 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.098 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.098 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.098 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.098 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.098 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.098 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.098 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-03-09T14:39:25.098 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-03-09T14:39:25.098 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.099 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.099 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.099 INFO:tasks.workunit.client.0.smithi099.stdout: "obj2": { 2024-03-09T14:39:25.099 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.099 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.099 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.099 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.099 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.099 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.099 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.099 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.099 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.100 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.100 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.100 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.100 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-03-09T14:39:25.100 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-03-09T14:39:25.100 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.100 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.100 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.100 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3": { 2024-03-09T14:39:25.100 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.100 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.100 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.100 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.101 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.101 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.101 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.101 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.101 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.101 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.101 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.101 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.101 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-03-09T14:39:25.101 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.101 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.101 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.102 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.102 INFO:tasks.workunit.client.0.smithi099.stdout: "obj3-2": { 2024-03-09T14:39:25.102 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.102 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.102 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.102 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.102 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.102 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.102 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.102 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.102 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.102 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.102 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.103 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.103 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "obj", 2024-03-09T14:39:25.103 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "v1", 2024-03-09T14:39:25.103 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.103 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.103 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.103 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.103 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-03-09T14:39:25.103 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-03-09T14:39:25.103 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.103 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.103 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.104 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.104 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.104 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.104 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.104 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.104 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.104 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.104 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.104 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.104 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.104 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.104 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.105 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.105 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.105 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.105 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.105 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.105 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.105 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.105 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.105 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.105 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.105 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.105 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.105 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.106 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.106 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.106 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.106 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.106 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.106 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.106 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.106 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-03-09T14:39:25.106 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker_myobj", 2024-03-09T14:39:25.106 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.106 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.106 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.106 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.107 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.107 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.107 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.107 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.107 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.107 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.107 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.107 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.107 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.107 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.107 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.107 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.108 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.108 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.108 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.108 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.108 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.108 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.108 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.108 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.108 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.108 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.108 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.108 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.108 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.109 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.109 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.109 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.109 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.109 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.109 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.109 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.109 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.109 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.109 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.109 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.109 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.109 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.109 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.109 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.110 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.110 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.110 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.110 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.110 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.110 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.110 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.110 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.110 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.110 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.110 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.111 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.111 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.111 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.111 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.111 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker_myobj", 2024-03-09T14:39:25.111 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.111 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.111 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.111 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.111 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.111 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.111 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.112 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.112 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.112 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.112 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.112 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.112 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.112 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.112 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.112 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.112 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.113 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.113 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.113 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.113 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.113 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.113 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.113 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.113 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.113 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.113 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.113 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.113 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.113 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.114 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.114 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.114 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.114 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.114 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.114 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.114 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.114 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.114 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.114 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.114 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.115 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.115 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.115 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.115 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.115 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.115 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.115 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.115 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.115 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.115 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.115 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.116 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.116 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.116 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.116 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.116 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.116 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.116 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-03-09T14:39:25.116 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns_myobj", 2024-03-09T14:39:25.116 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.116 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.116 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.116 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.116 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.117 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.117 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.117 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.117 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.117 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.117 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.117 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.117 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.117 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.117 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.117 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.117 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.118 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.118 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.118 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.118 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.118 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.118 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.118 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.118 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.118 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.118 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.118 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.118 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.118 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.118 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.119 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.119 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.119 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.119 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.119 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.119 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.119 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.119 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.119 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.119 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.119 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.119 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.120 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.120 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.120 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.120 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.120 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.120 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.120 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.120 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.120 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.120 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.120 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.120 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.121 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.121 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.121 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.121 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.121 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns_myobj", 2024-03-09T14:39:25.121 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.121 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.121 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.121 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.121 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.121 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.121 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.121 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.121 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.122 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.122 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.122 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.122 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.122 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.122 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.122 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.122 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.122 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.122 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.122 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.123 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.123 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.123 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.123 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.123 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.123 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.123 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.123 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.123 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.123 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.123 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.123 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.123 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.123 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.124 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.124 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.124 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.124 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.124 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.124 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.124 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.124 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.124 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.124 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.124 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.124 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.124 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.125 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.125 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.125 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.125 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.125 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.125 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.125 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.125 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.125 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.125 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.125 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.125 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-03-09T14:39:25.125 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst_myobj", 2024-03-09T14:39:25.126 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.126 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.126 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.126 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.126 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.126 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.126 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.126 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.126 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.126 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.126 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.126 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.126 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.126 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.127 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.127 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.127 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.127 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.127 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.127 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.127 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.127 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.127 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.127 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.127 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.127 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.127 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.127 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.128 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.128 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.128 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.128 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.128 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.128 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.128 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.128 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.128 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.128 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.128 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.128 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.128 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.128 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.128 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.129 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.129 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.129 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.129 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.129 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.129 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.129 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.129 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.129 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.129 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.129 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.129 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.129 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.129 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.130 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.130 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.130 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst_myobj", 2024-03-09T14:39:25.130 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.130 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.130 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.130 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.130 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.130 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.130 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.130 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.130 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.130 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.131 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.131 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.131 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.131 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.131 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.131 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.131 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.131 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.131 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.131 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.131 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.131 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.131 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.131 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.131 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.132 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.132 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.132 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.132 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.132 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.132 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.132 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.132 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.132 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.132 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.132 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.132 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.132 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.132 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.133 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.133 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.133 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.133 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.133 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.133 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.133 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.133 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.133 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.133 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.133 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.133 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.133 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.133 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.133 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.134 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.134 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.134 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.134 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.134 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-03-09T14:39:25.134 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst_myobj", 2024-03-09T14:39:25.134 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.134 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.134 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.134 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.135 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.135 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.135 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.135 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.135 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.135 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.135 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.135 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.135 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.135 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.135 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.135 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.136 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.136 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.136 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.136 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.136 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.136 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.136 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.136 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.136 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.136 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.136 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.137 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.137 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.137 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.137 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.137 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.137 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.137 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.137 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.137 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.137 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.137 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.137 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.137 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.138 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.138 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.138 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.138 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.138 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.138 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.138 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.138 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.138 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.138 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.138 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.138 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.139 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.139 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.139 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.139 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.139 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.139 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.139 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.139 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst_myobj", 2024-03-09T14:39:25.139 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.139 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.139 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.139 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.139 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.140 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.140 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.140 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.140 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.140 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.140 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.140 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.140 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.140 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.140 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.140 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.140 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.140 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.140 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.140 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.141 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.141 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.141 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.141 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.141 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.141 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.141 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.141 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.141 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.141 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.141 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.141 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.141 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.141 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.142 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.142 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.142 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.142 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.142 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.142 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.142 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.142 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.142 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.142 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.142 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.142 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.142 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.143 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.143 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.143 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.143 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.143 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.143 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.143 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.143 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.143 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.143 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.143 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.143 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-03-09T14:39:25.143 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker___myobj", 2024-03-09T14:39:25.143 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj" 2024-03-09T14:39:25.144 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.144 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.144 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.144 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.144 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.144 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.144 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.144 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.144 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.144 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.144 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.144 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.144 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.144 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.145 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.145 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.145 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.145 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.145 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.145 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.145 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.145 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.145 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.145 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.145 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.145 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.146 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.146 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.146 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.146 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.146 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.146 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.146 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.146 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.146 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.146 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.146 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.146 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.146 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.147 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.147 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.147 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.147 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.147 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.147 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.147 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.147 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.147 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.147 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.147 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.147 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.148 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.148 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.148 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.148 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.148 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.148 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.148 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.148 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker___myobj", 2024-03-09T14:39:25.148 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj" 2024-03-09T14:39:25.148 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.148 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.148 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.148 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.148 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.149 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.149 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.149 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.149 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.149 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.149 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.149 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.149 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.149 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.149 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.149 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.150 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.150 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.150 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.150 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.150 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.150 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.150 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.150 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.150 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.150 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.150 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.150 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.150 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.150 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.151 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.151 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.151 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.151 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.151 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.151 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.151 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.151 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.151 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.151 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.151 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.152 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.152 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.152 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.152 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.152 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.152 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.152 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.152 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.152 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.152 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.152 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.152 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.152 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.152 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.152 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.153 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.153 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-03-09T14:39:25.153 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns__myobj", 2024-03-09T14:39:25.153 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.153 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.153 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.153 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.153 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.153 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.153 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.153 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.153 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.154 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.154 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.154 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.154 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.154 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.154 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.154 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.154 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.154 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.154 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.154 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.154 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.154 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.154 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.155 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.155 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.155 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.155 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.155 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.155 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.155 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.155 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.155 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.155 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.155 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.155 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.156 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.156 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.156 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.156 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.156 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.156 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.156 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.156 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.156 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.156 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.156 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.156 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.156 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.157 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.157 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.157 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.157 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.157 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.157 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.157 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.157 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.157 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.157 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.157 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.157 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns__myobj", 2024-03-09T14:39:25.157 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.158 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.158 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.158 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.158 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.158 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.158 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.158 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.158 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.158 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.158 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.158 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.158 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.158 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.159 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.159 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.159 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.159 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.159 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.159 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.159 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.159 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.159 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.159 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.159 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.159 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.159 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.159 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.160 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.160 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.160 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.160 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.160 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.160 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.160 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.160 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.160 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.160 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.160 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.160 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.160 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.161 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.161 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.161 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.161 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.161 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.161 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.161 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.161 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.161 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.161 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.161 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.161 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.161 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.161 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.161 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.162 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.162 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.162 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-03-09T14:39:25.162 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst__myobj", 2024-03-09T14:39:25.162 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj" 2024-03-09T14:39:25.162 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.162 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.162 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.162 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.162 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.162 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.162 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.162 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.163 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.163 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.163 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.163 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.163 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.163 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.163 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.163 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.163 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.163 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.163 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.163 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.163 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.164 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.164 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.164 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.164 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.164 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.164 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.164 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.164 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.164 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.164 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.164 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.164 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.164 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.164 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.165 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.165 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.165 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.165 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.165 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.165 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.165 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.165 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.165 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.165 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.165 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.165 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.165 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.165 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.165 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.166 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.166 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.166 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.166 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.166 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.166 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.166 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.166 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.166 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst__myobj", 2024-03-09T14:39:25.166 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj" 2024-03-09T14:39:25.166 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.166 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.167 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.167 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.167 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.167 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.167 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.167 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.167 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.167 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.167 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.167 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.167 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.167 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.167 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.167 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.167 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.168 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.168 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.168 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.168 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.168 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.168 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.168 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.168 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.168 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.168 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.168 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.168 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.168 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.168 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.168 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.169 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.169 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.169 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.169 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.169 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.169 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.169 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.169 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.169 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.169 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.169 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.169 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.169 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.169 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.169 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.170 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.170 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.170 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.170 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.170 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.170 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.170 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.170 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.170 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.170 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.170 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-03-09T14:39:25.170 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst__myobj", 2024-03-09T14:39:25.170 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.170 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.171 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.171 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.171 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.171 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.171 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.171 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.171 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.171 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.171 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.171 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.171 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.171 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.171 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.172 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.172 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.172 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.172 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.172 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.172 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.172 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.172 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.172 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.172 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.172 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.173 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.173 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.173 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.173 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.173 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.173 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.173 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.173 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.173 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.173 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.173 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.173 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.173 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.174 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.174 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.174 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.174 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.174 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.174 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.174 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.174 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.174 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.174 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.174 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.175 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.175 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.175 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.175 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.175 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.175 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.175 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.175 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.175 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.175 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst__myobj", 2024-03-09T14:39:25.175 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.175 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.176 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.176 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.176 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.176 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.176 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.176 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.176 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.176 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.176 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.176 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.176 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.176 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.176 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.176 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.177 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.177 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.177 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.177 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.177 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.177 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.177 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.177 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.177 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.177 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.177 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.177 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.177 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.178 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.178 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.178 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.178 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.178 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.178 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.178 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.178 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.178 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.178 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.178 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.178 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.179 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.179 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.179 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.179 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.179 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.179 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.179 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.179 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.179 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.179 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.179 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.179 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.179 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.179 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.179 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.180 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.180 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.180 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-03-09T14:39:25.180 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker___myobj_", 2024-03-09T14:39:25.180 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj_" 2024-03-09T14:39:25.180 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.180 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.180 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.180 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.180 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.180 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.180 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.180 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.180 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.180 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.181 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.181 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.181 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.181 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.181 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.181 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.181 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.181 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.181 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.181 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.181 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.181 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.181 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.182 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.182 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.182 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.182 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.182 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.182 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.182 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.182 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.182 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.182 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.182 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.182 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.182 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.183 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.183 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.183 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.183 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.183 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.183 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.183 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.183 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.183 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.183 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.183 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.183 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.183 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.183 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.183 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.184 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.184 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.184 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.184 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.184 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.184 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.184 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.184 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker___myobj_", 2024-03-09T14:39:25.184 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj_" 2024-03-09T14:39:25.184 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.184 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.185 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.185 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.185 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.185 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.185 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.185 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.185 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.185 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.185 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.185 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.185 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.185 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.185 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.185 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.185 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.186 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.186 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.186 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.186 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.186 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.186 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.186 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.186 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.186 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.186 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.186 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.186 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.187 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.187 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.187 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.187 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.187 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.187 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.187 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.187 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.187 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.187 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.187 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.187 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.187 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.187 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.188 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.188 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.188 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.188 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.188 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.188 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.188 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.188 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.188 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.188 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.188 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.188 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.189 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.189 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.189 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-03-09T14:39:25.189 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns__myobj_", 2024-03-09T14:39:25.189 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.189 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.189 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.189 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.189 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.189 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.189 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.189 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.189 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.190 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.190 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.190 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.190 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.190 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.190 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.190 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.190 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.190 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.190 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.190 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.190 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.191 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.191 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.191 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.191 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.191 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.191 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.191 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.191 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.191 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.191 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.191 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.191 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.191 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.192 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.192 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.192 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.192 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.192 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.192 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.192 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.192 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.192 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.192 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.192 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.192 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.193 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.193 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.193 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.193 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.193 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.193 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.193 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.193 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.193 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.193 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.193 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.193 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.193 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.194 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns__myobj_", 2024-03-09T14:39:25.194 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.194 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.194 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.194 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.194 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.194 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.194 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.194 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.194 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.194 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.194 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.194 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.194 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.195 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.195 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.195 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.195 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.195 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.195 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.195 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.195 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.195 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.195 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.195 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.195 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.195 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.196 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.196 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.196 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.196 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.196 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.196 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.196 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.196 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.196 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.196 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.196 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.197 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.197 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.197 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.197 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.197 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.197 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.197 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.197 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.197 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.197 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.197 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.197 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.197 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.198 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.198 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.198 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.198 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.198 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.198 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.198 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.198 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.198 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-03-09T14:39:25.198 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst__myobj_", 2024-03-09T14:39:25.198 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj_" 2024-03-09T14:39:25.198 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.198 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.199 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.199 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.199 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.199 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.199 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.199 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.199 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.199 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.199 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.199 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.199 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.199 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.200 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.200 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.200 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.200 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.200 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.200 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.200 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.200 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.200 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.200 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.200 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.200 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.200 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.200 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.200 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.201 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.201 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.201 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.201 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.201 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.201 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.201 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.201 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.201 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.201 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.201 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.201 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.201 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.201 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.202 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.202 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.202 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.202 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.202 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.202 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.202 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.202 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.202 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.202 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.202 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.202 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.202 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.203 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.203 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.203 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst__myobj_", 2024-03-09T14:39:25.203 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj_" 2024-03-09T14:39:25.203 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.203 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.203 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.203 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.203 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.203 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.203 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.203 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.203 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.203 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.204 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.204 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.204 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.204 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.204 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.204 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.204 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.204 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.204 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.204 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.204 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.204 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.204 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.205 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.205 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.205 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.205 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.205 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.205 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.205 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.205 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.205 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.205 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.205 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.205 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.205 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.205 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.206 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.206 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.206 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.206 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.206 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.206 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.206 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.206 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.206 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.206 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.206 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.206 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.206 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.207 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.207 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.207 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.207 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.207 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.207 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.207 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.207 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": "default-placement.data", 2024-03-09T14:39:25.207 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-09T14:39:25.207 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.207 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.207 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.207 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.208 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.208 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.208 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "test", 2024-03-09T14:39:25.208 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.208 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.208 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.208 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.208 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": "", 2024-03-09T14:39:25.208 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.208 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": "" 2024-03-09T14:39:25.208 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.209 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.209 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.209 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.209 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.209 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.209 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.209 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.209 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.209 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.209 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.209 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.209 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.210 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.210 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.210 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.210 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.210 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.210 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.210 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.210 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.210 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.210 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.211 INFO:tasks.workunit.client.0.smithi099.stdout: "obj": { 2024-03-09T14:39:25.211 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.211 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.211 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.211 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.211 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.211 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.211 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.211 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.211 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.211 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.211 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.211 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.212 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.212 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.212 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.212 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.212 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.212 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.212 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.212 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.212 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.212 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-09T14:39:25.212 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.213 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.213 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.213 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.213 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.213 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.213 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.213 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.213 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.213 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.213 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.213 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.213 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.213 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.214 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.214 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.214 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.214 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.214 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.214 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.214 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.214 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.214 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.214 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-03-09T14:39:25.214 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-03-09T14:39:25.214 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.215 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.215 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.215 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker_myobj", 2024-03-09T14:39:25.215 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.215 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.215 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.215 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.215 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.215 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.215 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.215 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.215 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.215 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.216 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.216 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.216 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.216 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.216 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.216 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.216 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.216 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.216 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.216 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.216 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.216 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.216 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.216 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker_myobj 2024-03-09T14:39:25.217 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.217 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-03-09T14:39:25.217 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.217 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker_myobj", 2024-03-09T14:39:25.217 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.217 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.217 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.217 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.217 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-03-09T14:39:25.217 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.217 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.217 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.217 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.217 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.218 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.218 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.218 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.218 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.218 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.218 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.218 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.218 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.218 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.218 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.218 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.218 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.218 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.218 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker_myobj 2024-03-09T14:39:25.219 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.219 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.219 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.219 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns_myobj", 2024-03-09T14:39:25.219 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.219 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.219 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.219 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.219 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.219 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.219 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.219 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.219 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.219 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.220 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.220 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.220 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.220 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.220 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.220 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.220 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.220 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.220 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.220 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.220 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.220 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.220 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.221 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__ns_myobj 2024-03-09T14:39:25.221 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.221 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-03-09T14:39:25.221 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.221 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns_myobj", 2024-03-09T14:39:25.221 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.221 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.221 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.221 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.221 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-03-09T14:39:25.221 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.221 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.221 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.222 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.222 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.222 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.222 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.222 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.222 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.222 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.222 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.222 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.222 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.222 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.222 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.222 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.223 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.223 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.223 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__ns_myobj 2024-03-09T14:39:25.223 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.223 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.223 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.223 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst_myobj", 2024-03-09T14:39:25.223 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.223 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.223 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.223 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.224 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.224 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.224 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.224 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.224 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.224 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.224 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.224 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.224 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.224 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.224 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.224 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.224 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.225 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.225 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.225 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.225 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.225 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.225 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.225 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__:inst_myobj 2024-03-09T14:39:25.225 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.225 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-03-09T14:39:25.225 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.225 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst_myobj", 2024-03-09T14:39:25.225 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.225 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.225 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.226 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.226 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-03-09T14:39:25.226 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.226 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.226 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.226 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.226 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.226 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.226 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.226 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.227 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.227 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.227 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.227 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.227 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.227 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.227 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.227 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.227 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.227 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.227 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__:inst_myobj 2024-03-09T14:39:25.227 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.227 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.227 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.228 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst_myobj", 2024-03-09T14:39:25.228 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.228 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.228 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.228 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.228 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.228 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.228 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.228 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.228 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.228 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.228 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.228 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.229 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.229 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.229 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.229 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.229 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.229 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.229 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.229 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.229 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.229 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.229 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.230 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-03-09T14:39:25.230 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.230 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-03-09T14:39:25.230 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.230 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst_myobj", 2024-03-09T14:39:25.230 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.230 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.230 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.230 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.230 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-03-09T14:39:25.230 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.230 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.230 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.230 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.231 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.231 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.231 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.231 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.231 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.231 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.231 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.231 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.231 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "myobj", 2024-03-09T14:39:25.231 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.231 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.231 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.231 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.231 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.232 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-03-09T14:39:25.232 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.232 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.232 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.232 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker___myobj", 2024-03-09T14:39:25.232 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj" 2024-03-09T14:39:25.232 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.232 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.232 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.232 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.232 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.232 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.232 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.233 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.233 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.233 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.233 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.233 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.233 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.233 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.233 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.233 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.233 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.233 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.233 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.233 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.233 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.234 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.234 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker___myobj 2024-03-09T14:39:25.234 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.234 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-03-09T14:39:25.234 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.234 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker___myobj", 2024-03-09T14:39:25.234 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj" 2024-03-09T14:39:25.234 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.234 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.234 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.234 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-03-09T14:39:25.234 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.235 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.235 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.235 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.235 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.235 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.235 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.235 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.235 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.235 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.235 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.235 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.235 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.235 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.235 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.236 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.236 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.236 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.236 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker___myobj 2024-03-09T14:39:25.236 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.236 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.236 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.236 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns__myobj", 2024-03-09T14:39:25.236 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.236 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.236 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.237 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.237 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.237 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.237 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.237 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.237 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.237 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.237 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.237 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.237 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.237 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.237 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.237 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.237 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.237 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.238 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.238 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.238 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.238 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.238 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.238 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__ns__myobj 2024-03-09T14:39:25.238 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.238 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-03-09T14:39:25.238 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.238 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns__myobj", 2024-03-09T14:39:25.238 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.238 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.239 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.239 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.239 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-03-09T14:39:25.239 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.239 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.239 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.239 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.239 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.239 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.239 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.239 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.239 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.239 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.240 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.240 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.240 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.240 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.240 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.240 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.240 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.240 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.240 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__ns__myobj 2024-03-09T14:39:25.240 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.240 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.240 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.240 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst__myobj", 2024-03-09T14:39:25.240 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj" 2024-03-09T14:39:25.241 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.241 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.241 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.241 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.241 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.241 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.241 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.241 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.241 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.241 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.241 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.241 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.241 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.241 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.242 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.242 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.242 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.242 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.242 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.242 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.242 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.242 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.242 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__:inst__myobj 2024-03-09T14:39:25.242 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.242 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-03-09T14:39:25.242 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.242 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst__myobj", 2024-03-09T14:39:25.242 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj" 2024-03-09T14:39:25.243 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.243 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.243 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.243 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-03-09T14:39:25.243 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.243 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.243 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.243 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.243 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.243 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.243 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.244 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.244 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.244 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.244 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.244 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.244 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.244 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.244 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.244 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.244 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.244 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.244 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__:inst__myobj 2024-03-09T14:39:25.244 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.245 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.245 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.245 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst__myobj", 2024-03-09T14:39:25.245 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.245 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.245 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.245 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.245 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.245 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.245 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.245 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.245 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.245 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.245 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.245 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.246 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.246 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.246 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.246 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.246 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.246 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.246 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.246 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.246 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.246 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.246 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.246 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-03-09T14:39:25.246 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.246 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-03-09T14:39:25.247 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.247 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst__myobj", 2024-03-09T14:39:25.247 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.247 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.247 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.247 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.247 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-03-09T14:39:25.247 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.247 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.247 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.247 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.247 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.247 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.247 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.248 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.248 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.248 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.248 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.248 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.248 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj", 2024-03-09T14:39:25.248 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.248 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.248 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.248 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.248 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.248 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-03-09T14:39:25.248 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.248 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.248 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.248 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker___myobj_", 2024-03-09T14:39:25.249 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj_" 2024-03-09T14:39:25.249 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.249 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.249 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.249 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.249 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.249 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.249 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.249 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.249 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.249 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.249 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.249 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.249 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.250 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.250 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.250 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.250 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.250 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.250 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.250 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.250 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.250 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.250 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker___myobj_ 2024-03-09T14:39:25.250 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.250 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-03-09T14:39:25.251 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.251 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker___myobj_", 2024-03-09T14:39:25.251 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj_" 2024-03-09T14:39:25.251 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.251 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.251 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.251 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-03-09T14:39:25.251 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.251 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.251 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.251 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.251 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.251 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.251 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.251 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.252 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.252 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.252 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.252 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.252 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.252 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.252 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.252 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.252 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.252 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.252 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker___myobj_ 2024-03-09T14:39:25.252 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.252 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.252 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.253 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns__myobj_", 2024-03-09T14:39:25.253 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.253 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.253 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.253 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.253 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.253 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.253 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.253 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.253 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.253 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.253 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.253 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.253 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.253 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.254 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.254 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.254 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.254 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.254 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.254 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.254 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.254 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.254 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.254 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__ns__myobj_ 2024-03-09T14:39:25.254 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.254 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-03-09T14:39:25.254 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.254 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns__myobj_", 2024-03-09T14:39:25.255 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.255 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.255 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.255 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.255 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-03-09T14:39:25.255 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.255 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.255 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.255 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.255 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.255 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.255 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.255 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.255 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.255 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.256 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.256 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.256 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.256 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "", 2024-03-09T14:39:25.256 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.256 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.256 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.256 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.256 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-03-09T14:39:25.256 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.256 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.256 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.256 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst__myobj_", 2024-03-09T14:39:25.257 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj_" 2024-03-09T14:39:25.257 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.257 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.257 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.257 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.257 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.257 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.257 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.257 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.257 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.257 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.257 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.257 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.257 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.257 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.258 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.258 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.258 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.258 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.258 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.258 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.258 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.258 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.258 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-03-09T14:39:25.258 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.258 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-03-09T14:39:25.258 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.258 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__:inst__myobj_", 2024-03-09T14:39:25.259 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "marker__myobj_" 2024-03-09T14:39:25.259 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.259 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.259 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.259 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-03-09T14:39:25.259 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.259 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.259 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.259 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.259 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.259 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.259 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.259 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.259 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.260 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.260 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.260 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.260 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.260 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.260 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "" 2024-03-09T14:39:25.260 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.260 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.260 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.260 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-03-09T14:39:25.260 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.260 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj": { 2024-03-09T14:39:25.260 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.260 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-09T14:39:25.260 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.261 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.261 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.261 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.261 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj": { 2024-03-09T14:39:25.261 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.261 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.261 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.261 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.261 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.261 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.261 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.261 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.261 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.261 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.262 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.262 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.262 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.262 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.262 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.262 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.262 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.262 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.262 INFO:tasks.workunit.client.0.smithi099.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-03-09T14:39:25.262 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.262 INFO:tasks.workunit.client.0.smithi099.stdout: "raw_obj2": { 2024-03-09T14:39:25.262 INFO:tasks.workunit.client.0.smithi099.stdout: "pool": ".data-pool", 2024-03-09T14:39:25.262 INFO:tasks.workunit.client.0.smithi099.stdout: "oid": "marker__ns:inst__myobj_", 2024-03-09T14:39:25.262 INFO:tasks.workunit.client.0.smithi099.stdout: "loc": "" 2024-03-09T14:39:25.263 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.263 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.263 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.263 INFO:tasks.workunit.client.0.smithi099.stdout: "new_obj2": { 2024-03-09T14:39:25.263 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket": { 2024-03-09T14:39:25.263 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "ebtest", 2024-03-09T14:39:25.263 INFO:tasks.workunit.client.0.smithi099.stdout: "marker": "marker", 2024-03-09T14:39:25.263 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_id": "bucket-id", 2024-03-09T14:39:25.263 INFO:tasks.workunit.client.0.smithi099.stdout: "tenant": "", 2024-03-09T14:39:25.263 INFO:tasks.workunit.client.0.smithi099.stdout: "explicit_placement": { 2024-03-09T14:39:25.263 INFO:tasks.workunit.client.0.smithi099.stdout: "data_pool": ".data-pool", 2024-03-09T14:39:25.263 INFO:tasks.workunit.client.0.smithi099.stdout: "data_extra_pool": "", 2024-03-09T14:39:25.264 INFO:tasks.workunit.client.0.smithi099.stdout: "index_pool": ".index-pool" 2024-03-09T14:39:25.264 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.264 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.264 INFO:tasks.workunit.client.0.smithi099.stdout: "key": { 2024-03-09T14:39:25.264 INFO:tasks.workunit.client.0.smithi099.stdout: "name": "_myobj_", 2024-03-09T14:39:25.264 INFO:tasks.workunit.client.0.smithi099.stdout: "instance": "inst", 2024-03-09T14:39:25.264 INFO:tasks.workunit.client.0.smithi099.stdout: "ns": "ns" 2024-03-09T14:39:25.264 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.264 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.264 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.264 INFO:tasks.workunit.client.0.smithi099.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-03-09T14:39:25.264 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-03-09T14:39:25.264 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-03-09T14:39:25.264 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:39:25.264 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:39:25.265 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-03-09T14:39:25.265 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 4 tests. 2024-03-09T14:39:25.265 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:39:25.265 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:39:25.280 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-03-09T14:39:25.281 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-03-09T14:39:25.281 DEBUG:teuthology.orchestra.run.smithi099:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-03-09T14:39:25.382 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:25.383 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:25.437 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.441+0000 7fc8aa296980 20 rados->read ofs=0 len=0 2024-03-09T14:39:25.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.441+0000 7fc8aa296980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:25.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.441+0000 7fc8aa296980 20 realm 2024-03-09T14:39:25.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.441+0000 7fc8aa296980 20 rados->read ofs=0 len=0 2024-03-09T14:39:25.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.441+0000 7fc8aa296980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:25.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.441+0000 7fc8aa296980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:39:25.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.441+0000 7fc8aa296980 20 rados->read ofs=0 len=0 2024-03-09T14:39:25.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.441+0000 7fc8aa296980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:25.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.441+0000 7fc8aa296980 20 rados->read ofs=0 len=0 2024-03-09T14:39:25.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.445+0000 7fc8aa296980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:25.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.445+0000 7fc8aa296980 20 rados->read ofs=0 len=0 2024-03-09T14:39:25.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.445+0000 7fc8aa296980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:39:25.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.445+0000 7fc8aa296980 20 searching for the correct realm 2024-03-09T14:39:25.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.453+0000 7fc8a85af640 0 -- 172.21.15.99:0/3151115813 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7fc89c0e0030 msgr2=0x7fc89c0e0410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:25.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.473+0000 7fc8a75ad640 0 -- 172.21.15.99:0/3151115813 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fc8a0067be0 msgr2=0x7fc8a007d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:25.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.689+0000 7fc8aa296980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:39:25.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.689+0000 7fc8aa296980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:39:25.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.689+0000 7fc8aa296980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:39:25.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.689+0000 7fc8aa296980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:39:25.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.689+0000 7fc8aa296980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:39:25.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.689+0000 7fc8aa296980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:39:25.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.689+0000 7fc8aa296980 20 rados->read ofs=0 len=0 2024-03-09T14:39:25.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.689+0000 7fc8aa296980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:25.687 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.689+0000 7fc8aa296980 20 rados->read ofs=0 len=0 2024-03-09T14:39:25.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.689+0000 7fc8aa296980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:25.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.689+0000 7fc8aa296980 20 rados->read ofs=0 len=0 2024-03-09T14:39:25.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.693+0000 7fc8aa296980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:39:25.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.693+0000 7fc8aa296980 20 zone default found 2024-03-09T14:39:25.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.693+0000 7fc8aa296980 4 Realm: () 2024-03-09T14:39:25.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.693+0000 7fc8aa296980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:39:25.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.693+0000 7fc8aa296980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:39:25.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.693+0000 7fc8aa296980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:39:25.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.693+0000 7fc8aa296980 20 zonegroup default 2024-03-09T14:39:25.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.693+0000 7fc8aa296980 20 rados->read ofs=0 len=0 2024-03-09T14:39:25.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.693+0000 7fc8aa296980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:25.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.693+0000 7fc8aa296980 20 rados->read ofs=0 len=0 2024-03-09T14:39:25.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.693+0000 7fc8aa296980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:25.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.693+0000 7fc8aa296980 20 rados->read ofs=0 len=0 2024-03-09T14:39:25.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.693+0000 7fc8aa296980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:25.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.693+0000 7fc8aa296980 20 started sync module instance, tier type = 2024-03-09T14:39:25.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.693+0000 7fc8aa296980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:39:25.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.717+0000 7fc8aa296980 20 add_watcher() i=0 2024-03-09T14:39:25.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.717+0000 7fc8aa296980 20 add_watcher() i=1 2024-03-09T14:39:25.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.717+0000 7fc8aa296980 20 add_watcher() i=2 2024-03-09T14:39:25.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.717+0000 7fc8aa296980 20 add_watcher() i=3 2024-03-09T14:39:25.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.717+0000 7fc8aa296980 20 add_watcher() i=4 2024-03-09T14:39:25.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.717+0000 7fc8aa296980 20 add_watcher() i=5 2024-03-09T14:39:25.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.717+0000 7fc8aa296980 20 add_watcher() i=6 2024-03-09T14:39:25.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.721+0000 7fc8aa296980 20 add_watcher() i=7 2024-03-09T14:39:25.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.721+0000 7fc8aa296980 2 all 8 watchers are set, enabling cache 2024-03-09T14:39:25.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.725+0000 7fc75e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:25.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.725+0000 7fc8aa296980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:39:25.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.725+0000 7fc8aa296980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:39:25.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.725+0000 7fc8aa296980 5 note: GC not initialized 2024-03-09T14:39:25.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.725+0000 7fc75d7e2640 20 reqs_thread_entry: start 2024-03-09T14:39:25.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.725+0000 7fc8aa296980 20 init_complete bucket index max shards: 11 2024-03-09T14:39:25.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.725+0000 7fc8aa296980 20 Filter name: none 2024-03-09T14:39:25.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.725+0000 7fc7567fc640 20 reqs_thread_entry: start 2024-03-09T14:39:25.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.725+0000 7fc8aa296980 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-03-09T14:39:25.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.725+0000 7fc8aa296980 20 rados->read ofs=0 len=0 2024-03-09T14:39:25.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.725+0000 7fc8aa296980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:25.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.725+0000 7fc8aa296980 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-03-09T14:39:25.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.725+0000 7fc8aa296980 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-03-09T14:39:25.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.725+0000 7fc8aa296980 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-03-09T14:39:25.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.725+0000 7fc8aa296980 20 rados->read ofs=0 len=0 2024-03-09T14:39:25.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.729+0000 7fc8aa296980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:25.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.729+0000 7fc8aa296980 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-03-09T14:39:25.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.729+0000 7fc8aa296980 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-03-09T14:39:25.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.729+0000 7fc8aa296980 10 cache get: name=default.rgw.meta+users.keys+dxIIaUaZL+Xqzwn53O2z8LaY4+o= : miss 2024-03-09T14:39:25.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.729+0000 7fc8aa296980 20 rados->read ofs=0 len=0 2024-03-09T14:39:25.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.729+0000 7fc8aa296980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:25.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.729+0000 7fc8aa296980 10 cache put: name=default.rgw.meta+users.keys+dxIIaUaZL+Xqzwn53O2z8LaY4+o= info.flags=0x0 2024-03-09T14:39:25.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.729+0000 7fc8aa296980 10 adding default.rgw.meta+users.keys+dxIIaUaZL+Xqzwn53O2z8LaY4+o= to cache LRU end 2024-03-09T14:39:25.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.729+0000 7fc8aa296980 10 cache get: name=default.rgw.meta+users.keys+dxIIaUaZL+Xqzwn53O2z8LaY4+o= : hit (negative entry) 2024-03-09T14:39:25.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.729+0000 7fc8aa296980 10 cache get: name=default.rgw.meta+users.keys+dxIIaUaZL+Xqzwn53O2z8LaY4+o= : hit (negative entry) 2024-03-09T14:39:25.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.733+0000 7fc8aa296980 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-03-09T14:39:25.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.733+0000 7fc8aa296980 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-03-09T14:39:25.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.733+0000 7fc8aa296980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-03-09T14:39:25.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.733+0000 7fc786ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824002 cookie 94763797233056 notifier 5342 bl.length()=697 2024-03-09T14:39:25.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.733+0000 7fc786ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-03-09T14:39:25.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.733+0000 7fc786ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-03-09T14:39:25.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.737+0000 7fc8aa296980 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-03-09T14:39:25.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.737+0000 7fc8aa296980 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-03-09T14:39:25.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.737+0000 7fc8aa296980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-03-09T14:39:25.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.737+0000 7fc786ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824000 cookie 94763797240320 notifier 5342 bl.length()=194 2024-03-09T14:39:25.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.737+0000 7fc786ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-03-09T14:39:25.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.737+0000 7fc786ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-03-09T14:39:25.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.741+0000 7fc8aa296980 10 cache put: name=default.rgw.meta+users.keys+dxIIaUaZL+Xqzwn53O2z8LaY4+o= info.flags=0x7 2024-03-09T14:39:25.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.741+0000 7fc8aa296980 10 moving default.rgw.meta+users.keys+dxIIaUaZL+Xqzwn53O2z8LaY4+o= to cache LRU end 2024-03-09T14:39:25.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.741+0000 7fc8aa296980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:dxIIaUaZL+Xqzwn53O2z8LaY4+o=, ofs0, ns] 2024-03-09T14:39:25.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.741+0000 7fc786ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824001 cookie 94763797248128 notifier 5342 bl.length()=203 2024-03-09T14:39:25.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.741+0000 7fc786ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+dxIIaUaZL+Xqzwn53O2z8LaY4+o= info.flags=0x7 2024-03-09T14:39:25.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.741+0000 7fc786ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+dxIIaUaZL+Xqzwn53O2z8LaY4+o= to cache LRU end 2024-03-09T14:39:25.739 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:25.739 INFO:tasks.workunit.client.0.smithi099.stdout: "user_id": "ceph-test-librgw-file", 2024-03-09T14:39:25.739 INFO:tasks.workunit.client.0.smithi099.stdout: "display_name": "librgw test user", 2024-03-09T14:39:25.739 INFO:tasks.workunit.client.0.smithi099.stdout: "email": "librgw@example.com", 2024-03-09T14:39:25.739 INFO:tasks.workunit.client.0.smithi099.stdout: "suspended": 0, 2024-03-09T14:39:25.739 INFO:tasks.workunit.client.0.smithi099.stdout: "max_buckets": 1000, 2024-03-09T14:39:25.740 INFO:tasks.workunit.client.0.smithi099.stdout: "subusers": [], 2024-03-09T14:39:25.740 INFO:tasks.workunit.client.0.smithi099.stdout: "keys": [ 2024-03-09T14:39:25.740 INFO:tasks.workunit.client.0.smithi099.stdout: { 2024-03-09T14:39:25.740 INFO:tasks.workunit.client.0.smithi099.stdout: "user": "ceph-test-librgw-file", 2024-03-09T14:39:25.740 INFO:tasks.workunit.client.0.smithi099.stdout: "access_key": "dxIIaUaZL+Xqzwn53O2z8LaY4+o=", 2024-03-09T14:39:25.740 INFO:tasks.workunit.client.0.smithi099.stdout: "secret_key": "pfEmdjksFMk8/xsKf6MByAw0FQfm6JfpSn76pTFNsbzYhvE2akBycg==", 2024-03-09T14:39:25.740 INFO:tasks.workunit.client.0.smithi099.stdout: "active": true, 2024-03-09T14:39:25.740 INFO:tasks.workunit.client.0.smithi099.stdout: "create_date": "2024-03-09T14:39:25.731774Z" 2024-03-09T14:39:25.740 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:25.740 INFO:tasks.workunit.client.0.smithi099.stdout: ], 2024-03-09T14:39:25.740 INFO:tasks.workunit.client.0.smithi099.stdout: "swift_keys": [], 2024-03-09T14:39:25.740 INFO:tasks.workunit.client.0.smithi099.stdout: "caps": [], 2024-03-09T14:39:25.740 INFO:tasks.workunit.client.0.smithi099.stdout: "op_mask": "read, write, delete", 2024-03-09T14:39:25.740 INFO:tasks.workunit.client.0.smithi099.stdout: "default_placement": "", 2024-03-09T14:39:25.741 INFO:tasks.workunit.client.0.smithi099.stdout: "default_storage_class": "", 2024-03-09T14:39:25.741 INFO:tasks.workunit.client.0.smithi099.stdout: "placement_tags": [], 2024-03-09T14:39:25.741 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_quota": { 2024-03-09T14:39:25.741 INFO:tasks.workunit.client.0.smithi099.stdout: "enabled": false, 2024-03-09T14:39:25.741 INFO:tasks.workunit.client.0.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:39:25.741 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size": -1, 2024-03-09T14:39:25.741 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:39:25.741 INFO:tasks.workunit.client.0.smithi099.stdout: "max_objects": -1 2024-03-09T14:39:25.741 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.741 INFO:tasks.workunit.client.0.smithi099.stdout: "user_quota": { 2024-03-09T14:39:25.741 INFO:tasks.workunit.client.0.smithi099.stdout: "enabled": false, 2024-03-09T14:39:25.741 INFO:tasks.workunit.client.0.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:39:25.741 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size": -1, 2024-03-09T14:39:25.741 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:39:25.741 INFO:tasks.workunit.client.0.smithi099.stdout: "max_objects": -1 2024-03-09T14:39:25.742 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:25.742 INFO:tasks.workunit.client.0.smithi099.stdout: "temp_url_keys": [], 2024-03-09T14:39:25.742 INFO:tasks.workunit.client.0.smithi099.stdout: "type": "rgw", 2024-03-09T14:39:25.742 INFO:tasks.workunit.client.0.smithi099.stdout: "mfa_ids": [], 2024-03-09T14:39:25.742 INFO:tasks.workunit.client.0.smithi099.stdout: "account_id": "", 2024-03-09T14:39:25.742 INFO:tasks.workunit.client.0.smithi099.stdout: "path": "/", 2024-03-09T14:39:25.742 INFO:tasks.workunit.client.0.smithi099.stdout: "create_date": "2024-03-09T14:39:25.731731Z", 2024-03-09T14:39:25.742 INFO:tasks.workunit.client.0.smithi099.stdout: "tags": [], 2024-03-09T14:39:25.742 INFO:tasks.workunit.client.0.smithi099.stdout: "group_ids": [] 2024-03-09T14:39:25.742 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:25.742 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:39:25.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.745+0000 7fc75e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:25.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.749+0000 7fc8aa296980 20 remove_watcher() i=0 2024-03-09T14:39:25.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.749+0000 7fc8aa296980 2 removed watcher, disabling cache 2024-03-09T14:39:25.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.753+0000 7fc8aa296980 20 remove_watcher() i=1 2024-03-09T14:39:25.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.753+0000 7fc8aa296980 20 remove_watcher() i=2 2024-03-09T14:39:25.753 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.757+0000 7fc8aa296980 20 remove_watcher() i=3 2024-03-09T14:39:25.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.757+0000 7fc8aa296980 20 remove_watcher() i=4 2024-03-09T14:39:25.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.761+0000 7fc8aa296980 20 remove_watcher() i=5 2024-03-09T14:39:25.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.761+0000 7fc8aa296980 20 remove_watcher() i=6 2024-03-09T14:39:25.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:25.765+0000 7fc8aa296980 20 remove_watcher() i=7 2024-03-09T14:39:25.775 INFO:tasks.workunit.client.0.smithi099.stdout:phase 1.1 2024-03-09T14:39:25.794 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-09T14:39:25.795 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:39:25.795 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 24 tests from LibRGW 2024-03-09T14:39:25.795 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:39:25.807 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:25.807 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:26.381 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (587 ms) 2024-03-09T14:39:26.381 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-03-09T14:39:26.383 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-03-09T14:39:26.383 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:39:26.383 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-09T14:39:26.383 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-03-09T14:39:26.402 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/baz/quux 2024-03-09T14:39:26.409 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/f1 2024-03-09T14:39:26.414 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/f2 2024-03-09T14:39:26.418 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/f1 2024-03-09T14:39:26.426 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/d1/ 2024-03-09T14:39:26.433 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-03-09T14:39:26.440 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-03-09T14:39:26.444 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/baz/momma 2024-03-09T14:39:26.451 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-03-09T14:39:26.458 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-03-09T14:39:26.463 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-03-09T14:39:26.469 INFO:tasks.workunit.client.0.smithi099.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-03-09T14:39:26.475 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETUP_HIER1 (92 ms) 2024-03-09T14:39:26.475 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-03-09T14:39:26.717 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETUP_DIRS1 (242 ms) 2024-03-09T14:39:26.717 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETATTR 2024-03-09T14:39:26.717 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-03-09T14:39:26.717 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-03-09T14:39:26.758 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (40 ms) 2024-03-09T14:39:26.758 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-03-09T14:39:26.853 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (95 ms) 2024-03-09T14:39:26.853 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-03-09T14:39:26.853 INFO:tasks.workunit.client.0.smithi099.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-03-09T14:39:26.867 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (15 ms) 2024-03-09T14:39:26.867 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-03-09T14:39:26.867 INFO:tasks.workunit.client.0.smithi099.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-03-09T14:39:26.889 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (22 ms) 2024-03-09T14:39:26.889 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-03-09T14:39:26.889 INFO:tasks.workunit.client.0.smithi099.stdout:scanning objects in /bdirs1/dir_0 2024-03-09T14:39:26.889 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:39:26.889 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:39:26.889 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:39:26.889 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:39:26.889 INFO:tasks.workunit.client.0.smithi099.stdout:scanning objects in /bdirs1/dir_1 2024-03-09T14:39:26.889 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:39:26.890 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:39:26.890 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:39:26.890 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:39:26.890 INFO:tasks.workunit.client.0.smithi099.stdout:scanning objects in /bdirs1/dir_2 2024-03-09T14:39:26.890 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:39:26.890 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:39:26.890 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:39:26.890 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:39:26.890 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-03-09T14:39:26.890 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-03-09T14:39:26.890 INFO:tasks.workunit.client.0.smithi099.stdout:read back objects in /bdirs1/dir_0 2024-03-09T14:39:26.890 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_0/sfile_0 2024-03-09T14:39:26.894 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:39:26.894 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_0/sfile_1 2024-03-09T14:39:26.897 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:39:26.897 INFO:tasks.workunit.client.0.smithi099.stdout:read back objects in /bdirs1/dir_1 2024-03-09T14:39:26.898 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_1/sfile_0 2024-03-09T14:39:26.901 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:39:26.901 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_1/sfile_1 2024-03-09T14:39:26.905 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:39:26.905 INFO:tasks.workunit.client.0.smithi099.stdout:read back objects in /bdirs1/dir_2 2024-03-09T14:39:26.905 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_2/sfile_0 2024-03-09T14:39:26.908 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:39:26.908 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_2/sfile_1 2024-03-09T14:39:26.911 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:39:26.911 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READ_DIRS1 (22 ms) 2024-03-09T14:39:26.912 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-03-09T14:39:27.128 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READF_SETUP1 (217 ms) 2024-03-09T14:39:27.129 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-03-09T14:39:27.129 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-03-09T14:39:27.129 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-03-09T14:39:27.129 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-03-09T14:39:27.129 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-03-09T14:39:27.129 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:39:27.129 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:39:27.129 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:39:27.129 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:39:27.129 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:39:27.129 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:39:27.129 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:39:27.129 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:39:27.129 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:39:27.130 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:39:27.130 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:39:27.130 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:39:27.130 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-03-09T14:39:27.130 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.HIER1 2024-03-09T14:39:27.141 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/f2 (f2): FILE 2024-03-09T14:39:27.141 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/f1 (f1): FILE 2024-03-09T14:39:27.147 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-03-09T14:39:27.150 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-03-09T14:39:27.157 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-09T14:39:27.157 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-09T14:39:27.158 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-03-09T14:39:27.159 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-03-09T14:39:27.159 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-09T14:39:27.160 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-09T14:39:27.160 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-03-09T14:39:27.164 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-03-09T14:39:27.164 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-03-09T14:39:27.164 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar (bar): DIR 2024-03-09T14:39:27.164 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo (foo): DIR 2024-03-09T14:39:27.164 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot (nfsroot): DIR 2024-03-09T14:39:27.164 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.HIER1 (35 ms) 2024-03-09T14:39:27.164 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-09T14:39:27.164 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-03-09T14:39:27.164 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-09T14:39:27.164 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-09T14:39:27.165 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-09T14:39:27.165 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-09T14:39:27.165 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-09T14:39:27.165 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-09T14:39:27.165 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:39:27.165 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:39:27.165 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:39:27.165 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:39:27.165 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:39:27.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:27.165+0000 7f3bd8660a80 -1 shutting down 2024-03-09T14:39:27.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:27.169+0000 7f3ab41d3640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57288, si_uid : 1000, si_addr0x3e80000dfc8, si_status0 2024-03-09T14:39:27.324 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (160 ms) 2024-03-09T14:39:27.324 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 24 tests from LibRGW (1529 ms total) 2024-03-09T14:39:27.324 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:39:27.324 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:39:27.325 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 24 tests from 1 test suite ran. (1529 ms total) 2024-03-09T14:39:27.325 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 24 tests. 2024-03-09T14:39:27.353 INFO:tasks.workunit.client.0.smithi099.stdout:phase 1.2 2024-03-09T14:39:27.375 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-09T14:39:27.375 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:39:27.376 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 24 tests from LibRGW 2024-03-09T14:39:27.376 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:39:27.385 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:27.385 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:27.937 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (561 ms) 2024-03-09T14:39:27.937 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-03-09T14:39:27.938 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-03-09T14:39:27.939 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:39:27.939 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-03-09T14:39:27.939 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-03-09T14:39:27.939 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-03-09T14:39:27.939 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-03-09T14:39:27.939 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-03-09T14:39:27.939 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETATTR 2024-03-09T14:39:27.939 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-03-09T14:39:27.939 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-03-09T14:39:27.939 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-03-09T14:39:27.939 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-03-09T14:39:27.939 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-03-09T14:39:27.940 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-03-09T14:39:27.940 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-03-09T14:39:27.940 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-03-09T14:39:27.940 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-03-09T14:39:27.940 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-03-09T14:39:27.940 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-03-09T14:39:27.940 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-03-09T14:39:27.940 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-03-09T14:39:27.940 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-03-09T14:39:27.940 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-03-09T14:39:27.940 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-03-09T14:39:27.940 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-03-09T14:39:27.941 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-03-09T14:39:27.941 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-03-09T14:39:27.941 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-03-09T14:39:27.941 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-03-09T14:39:27.941 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.HIER1 2024-03-09T14:39:27.941 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-03-09T14:39:27.941 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-09T14:39:27.941 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-03-09T14:39:27.941 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-09T14:39:27.941 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-09T14:39:27.941 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-09T14:39:27.941 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-09T14:39:27.941 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-09T14:39:27.941 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-09T14:39:27.942 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:39:27.942 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:39:27.942 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:39:27.942 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:39:27.942 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:39:27.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:27.941+0000 7f4e860d0a80 -1 shutting down 2024-03-09T14:39:27.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:27.945+0000 7f4d61c43640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57931, si_uid : 1000, si_addr0x3e80000e24b, si_status0 2024-03-09T14:39:28.092 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (154 ms) 2024-03-09T14:39:28.092 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 24 tests from LibRGW (717 ms total) 2024-03-09T14:39:28.092 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:39:28.093 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:39:28.093 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 24 tests from 1 test suite ran. (717 ms total) 2024-03-09T14:39:28.093 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 24 tests. 2024-03-09T14:39:28.108 INFO:tasks.workunit.client.0.smithi099.stdout:phase 1.3 2024-03-09T14:39:28.129 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 24 tests from 1 test suite. 2024-03-09T14:39:28.129 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:39:28.129 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 24 tests from LibRGW 2024-03-09T14:39:28.129 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:39:28.141 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:28.141 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:28.409 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (280 ms) 2024-03-09T14:39:28.410 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-03-09T14:39:28.411 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-03-09T14:39:28.411 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:39:28.411 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:39:28.411 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-03-09T14:39:28.418 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETUP_HIER1 (7 ms) 2024-03-09T14:39:28.418 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-03-09T14:39:28.518 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETUP_DIRS1 (100 ms) 2024-03-09T14:39:28.519 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SETATTR 2024-03-09T14:39:28.519 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-03-09T14:39:28.519 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-03-09T14:39:28.519 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-03-09T14:39:28.519 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-03-09T14:39:28.519 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-03-09T14:39:28.519 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-03-09T14:39:28.519 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-03-09T14:39:28.519 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-03-09T14:39:28.519 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-03-09T14:39:28.519 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-03-09T14:39:28.519 INFO:tasks.workunit.client.0.smithi099.stdout:scanning objects in /bdirs1/dir_0 2024-03-09T14:39:28.519 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:39:28.520 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:39:28.520 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:39:28.520 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:39:28.520 INFO:tasks.workunit.client.0.smithi099.stdout:scanning objects in /bdirs1/dir_1 2024-03-09T14:39:28.520 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:39:28.520 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:39:28.520 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:39:28.520 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:39:28.520 INFO:tasks.workunit.client.0.smithi099.stdout:scanning objects in /bdirs1/dir_2 2024-03-09T14:39:28.520 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-03-09T14:39:28.520 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-03-09T14:39:28.520 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-03-09T14:39:28.521 INFO:tasks.workunit.client.0.smithi099.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-03-09T14:39:28.521 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-03-09T14:39:28.521 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-03-09T14:39:28.521 INFO:tasks.workunit.client.0.smithi099.stdout:read back objects in /bdirs1/dir_0 2024-03-09T14:39:28.521 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_0/sfile_0 2024-03-09T14:39:28.525 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:39:28.525 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_0/sfile_1 2024-03-09T14:39:28.527 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:39:28.527 INFO:tasks.workunit.client.0.smithi099.stdout:read back objects in /bdirs1/dir_1 2024-03-09T14:39:28.527 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_1/sfile_0 2024-03-09T14:39:28.530 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:39:28.530 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_1/sfile_1 2024-03-09T14:39:28.532 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:39:28.533 INFO:tasks.workunit.client.0.smithi099.stdout:read back objects in /bdirs1/dir_2 2024-03-09T14:39:28.533 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_2/sfile_0 2024-03-09T14:39:28.534 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_0 : "data for sfile_0" 2024-03-09T14:39:28.534 INFO:tasks.workunit.client.0.smithi099.stdout:reading 0,256 dir_2/sfile_1 2024-03-09T14:39:28.536 INFO:tasks.workunit.client.0.smithi099.stdout: read back from sfile_1 : "data for sfile_1" 2024-03-09T14:39:28.537 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READ_DIRS1 (18 ms) 2024-03-09T14:39:28.537 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-03-09T14:39:28.537 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-03-09T14:39:28.537 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-03-09T14:39:28.537 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-03-09T14:39:28.537 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-03-09T14:39:28.537 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-03-09T14:39:28.537 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-03-09T14:39:28.537 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:39:28.537 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:39:28.537 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:39:28.537 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:39:28.537 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:39:28.537 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:39:28.538 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:39:28.538 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:39:28.538 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_0 type: DIR refs: 2 2024-03-09T14:39:28.538 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_0 type: FILE refs: 2 2024-03-09T14:39:28.538 INFO:tasks.workunit.client.0.smithi099.stdout:release sdir_1 type: DIR refs: 2 2024-03-09T14:39:28.538 INFO:tasks.workunit.client.0.smithi099.stdout:release sfile_1 type: FILE refs: 2 2024-03-09T14:39:28.538 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-03-09T14:39:28.538 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.HIER1 2024-03-09T14:39:28.547 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/f2 (f2): FILE 2024-03-09T14:39:28.548 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/f1 (f1): FILE 2024-03-09T14:39:28.552 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-03-09T14:39:28.555 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-03-09T14:39:28.560 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-09T14:39:28.560 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-03-09T14:39:28.561 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-03-09T14:39:28.562 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-03-09T14:39:28.563 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-09T14:39:28.563 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-03-09T14:39:28.564 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-03-09T14:39:28.567 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-03-09T14:39:28.567 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-03-09T14:39:28.568 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo/bar (bar): DIR 2024-03-09T14:39:28.568 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot/foo (foo): DIR 2024-03-09T14:39:28.568 INFO:tasks.workunit.client.0.smithi099.stdout:/nfsroot (nfsroot): DIR 2024-03-09T14:39:28.568 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.HIER1 (31 ms) 2024-03-09T14:39:28.568 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-09T14:39:28.568 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-03-09T14:39:28.568 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-09T14:39:28.568 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-09T14:39:28.568 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-09T14:39:28.568 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-09T14:39:28.568 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-09T14:39:28.568 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-09T14:39:28.568 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:39:28.568 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:39:28.569 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:39:28.569 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:39:28.569 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:39:28.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:28.569+0000 7fa039e3ca80 -1 shutting down 2024-03-09T14:39:28.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:28.573+0000 7f9f159af640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58574, si_uid : 1000, si_addr0x3e80000e4ce, si_status0 2024-03-09T14:39:28.645 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (78 ms) 2024-03-09T14:39:28.645 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 24 tests from LibRGW (516 ms total) 2024-03-09T14:39:28.645 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:39:28.645 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:39:28.645 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 24 tests from 1 test suite ran. (516 ms total) 2024-03-09T14:39:28.646 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 24 tests. 2024-03-09T14:39:28.652 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2.1 2024-03-09T14:39:28.672 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 9 tests from 1 test suite. 2024-03-09T14:39:28.672 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:39:28.672 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 9 tests from LibRGW 2024-03-09T14:39:28.672 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:39:28.682 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:28.683 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:28.961 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (289 ms) 2024-03-09T14:39:28.961 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:39:28.962 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:39:28.962 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:39:28.978 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CREATE_BUCKET (16 ms) 2024-03-09T14:39:28.978 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:39:28.978 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-03-09T14:39:28.979 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-03-09T14:39:28.995 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave0 2024-03-09T14:39:29.014 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave1 2024-03-09T14:39:29.031 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave2 2024-03-09T14:39:29.046 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave3 2024-03-09T14:39:29.063 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave4 2024-03-09T14:39:29.081 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave5 2024-03-09T14:39:29.101 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave6 2024-03-09T14:39:29.119 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave7 2024-03-09T14:39:29.136 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave8 2024-03-09T14:39:29.157 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave9 2024-03-09T14:39:29.157 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (179 ms) 2024-03-09T14:39:29.157 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-03-09T14:39:29.891 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (733 ms) 2024-03-09T14:39:29.891 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:39:29.891 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:39:29.891 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:39:29.891 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:39:29.891 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:39:29.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:29.893+0000 7f91094d1a80 -1 shutting down 2024-03-09T14:39:29.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:29.897+0000 7f8fe5044640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59217, si_uid : 1000, si_addr0x3e80000e751, si_status0 2024-03-09T14:39:30.024 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (134 ms) 2024-03-09T14:39:30.024 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 9 tests from LibRGW (1352 ms total) 2024-03-09T14:39:30.024 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:39:30.024 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:39:30.024 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 9 tests from 1 test suite ran. (1352 ms total) 2024-03-09T14:39:30.025 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 9 tests. 2024-03-09T14:39:30.039 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2.2 2024-03-09T14:39:30.060 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 9 tests from 1 test suite. 2024-03-09T14:39:30.060 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:39:30.061 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 9 tests from LibRGW 2024-03-09T14:39:30.061 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:39:30.071 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:30.072 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:30.641 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (580 ms) 2024-03-09T14:39:30.641 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:39:30.643 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (3 ms) 2024-03-09T14:39:30.643 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:39:30.643 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-03-09T14:39:30.643 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:39:30.701 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_BUCKET (58 ms) 2024-03-09T14:39:30.701 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-03-09T14:39:30.716 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave0 2024-03-09T14:39:30.734 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave1 2024-03-09T14:39:30.752 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave2 2024-03-09T14:39:30.770 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave3 2024-03-09T14:39:30.789 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave4 2024-03-09T14:39:30.807 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave5 2024-03-09T14:39:30.826 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave6 2024-03-09T14:39:30.844 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave7 2024-03-09T14:39:30.866 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave8 2024-03-09T14:39:30.886 INFO:tasks.workunit.client.0.smithi099.stdout:created: sorrydave9 2024-03-09T14:39:30.886 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (185 ms) 2024-03-09T14:39:30.886 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-03-09T14:39:31.586 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (700 ms) 2024-03-09T14:39:31.586 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:39:31.586 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:39:31.586 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:39:31.587 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:39:31.587 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:39:31.587 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:31.589+0000 7f51239cfa80 -1 shutting down 2024-03-09T14:39:31.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:31.593+0000 7f4fff542640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59860, si_uid : 1000, si_addr0x3e80000e9d4, si_status0 2024-03-09T14:39:31.677 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (90 ms) 2024-03-09T14:39:31.677 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 9 tests from LibRGW (1616 ms total) 2024-03-09T14:39:31.677 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:39:31.677 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:39:31.677 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 9 tests from 1 test suite ran. (1616 ms total) 2024-03-09T14:39:31.677 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 9 tests. 2024-03-09T14:39:31.686 INFO:tasks.workunit.client.0.smithi099.stdout:phase 3.1 2024-03-09T14:39:32.026 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 13 tests from 1 test suite. 2024-03-09T14:39:32.027 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:39:32.027 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 13 tests from LibRGW 2024-03-09T14:39:32.027 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:39:32.036 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:32.037 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:32.617 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (591 ms) 2024-03-09T14:39:32.617 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:39:32.618 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:39:32.618 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:39:32.635 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CREATE_BUCKET (17 ms) 2024-03-09T14:39:32.635 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-09T14:39:32.639 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-03-09T14:39:32.639 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-09T14:39:32.642 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-03-09T14:39:32.642 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LARGE1 2024-03-09T14:39:32.701 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LARGE1 (59 ms) 2024-03-09T14:39:32.702 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LARGE2 2024-03-09T14:39:32.747 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LARGE2 (46 ms) 2024-03-09T14:39:32.747 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-09T14:39:32.747 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-09T14:39:32.747 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-09T14:39:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-03-09T14:39:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:39:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-03-09T14:39:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:39:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:39:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:39:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:39:32.748 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:39:32.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:32.749+0000 7f1262f7fa80 -1 shutting down 2024-03-09T14:39:32.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:32.753+0000 7f113eaf2640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60503, si_uid : 1000, si_addr0x3e80000ec57, si_status0 2024-03-09T14:39:32.828 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (81 ms) 2024-03-09T14:39:32.828 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 13 tests from LibRGW (802 ms total) 2024-03-09T14:39:32.829 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:39:32.829 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:39:32.829 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 13 tests from 1 test suite ran. (802 ms total) 2024-03-09T14:39:32.829 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 13 tests. 2024-03-09T14:39:32.841 INFO:tasks.workunit.client.0.smithi099.stdout:phase 3.2 2024-03-09T14:39:33.183 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 13 tests from 1 test suite. 2024-03-09T14:39:33.183 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:39:33.183 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 13 tests from LibRGW 2024-03-09T14:39:33.183 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:39:33.192 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:33.192 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:33.732 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (548 ms) 2024-03-09T14:39:33.732 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:39:33.733 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:39:33.733 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:39:33.733 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-03-09T14:39:33.733 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-09T14:39:33.740 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (7 ms) 2024-03-09T14:39:33.740 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-09T14:39:33.747 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (7 ms) 2024-03-09T14:39:33.747 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LARGE1 2024-03-09T14:39:33.826 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LARGE1 (79 ms) 2024-03-09T14:39:33.826 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LARGE2 2024-03-09T14:39:33.826 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-03-09T14:39:33.826 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-09T14:39:33.826 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-09T14:39:33.827 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-09T14:39:33.837 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_OBJECT (11 ms) 2024-03-09T14:39:33.837 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:39:33.897 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_BUCKET (60 ms) 2024-03-09T14:39:33.897 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:39:33.897 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:39:33.897 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:39:33.897 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:39:33.897 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:39:33.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:33.901+0000 7f19c8e08a80 -1 shutting down 2024-03-09T14:39:33.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:33.905+0000 7f18a497b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61147, si_uid : 1000, si_addr0x3e80000eedb, si_status0 2024-03-09T14:39:33.964 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (67 ms) 2024-03-09T14:39:33.964 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 13 tests from LibRGW (781 ms total) 2024-03-09T14:39:33.964 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:39:33.964 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:39:33.964 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 13 tests from 1 test suite ran. (781 ms total) 2024-03-09T14:39:33.964 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 13 tests. 2024-03-09T14:39:33.973 INFO:tasks.workunit.client.0.smithi099.stdout:phase 4.1 2024-03-09T14:39:33.995 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 11 tests from 1 test suite. 2024-03-09T14:39:33.995 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:39:33.995 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 11 tests from LibRGW 2024-03-09T14:39:33.995 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.TVAR 2024-03-09T14:39:33.995 INFO:tasks.workunit.client.0.smithi099.stdout:read i1: 64001 2024-03-09T14:39:33.995 INFO:tasks.workunit.client.0.smithi099.stdout:read s1: blunderbuss 2024-03-09T14:39:33.995 INFO:tasks.workunit.client.0.smithi099.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-03-09T14:39:33.995 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:39:34.008 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:34.008 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:34.553 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (558 ms) 2024-03-09T14:39:34.553 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:39:34.554 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-03-09T14:39:34.554 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-09T14:39:34.582 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (27 ms) 2024-03-09T14:39:34.582 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-09T14:39:35.933 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_0 2024-03-09T14:39:35.933 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_1 2024-03-09T14:39:35.933 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_2 2024-03-09T14:39:35.933 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_3 2024-03-09T14:39:35.933 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_4 2024-03-09T14:39:35.933 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_5 2024-03-09T14:39:35.933 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_6 2024-03-09T14:39:35.933 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_7 2024-03-09T14:39:35.933 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_8 2024-03-09T14:39:35.933 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_9 2024-03-09T14:39:35.933 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_10 2024-03-09T14:39:35.934 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_11 2024-03-09T14:39:35.934 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_12 2024-03-09T14:39:35.934 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_13 2024-03-09T14:39:35.934 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_14 2024-03-09T14:39:35.934 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_15 2024-03-09T14:39:35.934 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_16 2024-03-09T14:39:35.934 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_17 2024-03-09T14:39:35.934 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_18 2024-03-09T14:39:35.934 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_19 2024-03-09T14:39:35.934 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_20 2024-03-09T14:39:35.934 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_21 2024-03-09T14:39:35.934 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_22 2024-03-09T14:39:35.934 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_23 2024-03-09T14:39:35.934 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_24 2024-03-09T14:39:35.935 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_25 2024-03-09T14:39:35.935 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_26 2024-03-09T14:39:35.935 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_27 2024-03-09T14:39:35.935 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_28 2024-03-09T14:39:35.935 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_29 2024-03-09T14:39:35.935 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_30 2024-03-09T14:39:35.935 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_31 2024-03-09T14:39:35.935 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_32 2024-03-09T14:39:35.935 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_33 2024-03-09T14:39:35.935 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_34 2024-03-09T14:39:35.935 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_35 2024-03-09T14:39:35.935 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_36 2024-03-09T14:39:35.935 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_37 2024-03-09T14:39:35.935 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_38 2024-03-09T14:39:35.935 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_39 2024-03-09T14:39:35.936 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_40 2024-03-09T14:39:35.936 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_41 2024-03-09T14:39:35.936 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_42 2024-03-09T14:39:35.936 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_43 2024-03-09T14:39:35.936 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_44 2024-03-09T14:39:35.936 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_45 2024-03-09T14:39:35.936 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_46 2024-03-09T14:39:35.936 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_47 2024-03-09T14:39:35.936 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_48 2024-03-09T14:39:35.936 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_49 2024-03-09T14:39:35.936 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_50 2024-03-09T14:39:35.936 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_51 2024-03-09T14:39:35.936 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_52 2024-03-09T14:39:35.936 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_53 2024-03-09T14:39:35.936 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_54 2024-03-09T14:39:35.937 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_55 2024-03-09T14:39:35.937 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_56 2024-03-09T14:39:35.937 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_57 2024-03-09T14:39:35.937 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_58 2024-03-09T14:39:35.937 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_59 2024-03-09T14:39:35.937 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_60 2024-03-09T14:39:35.937 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_61 2024-03-09T14:39:35.937 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_62 2024-03-09T14:39:35.937 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_63 2024-03-09T14:39:35.937 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_64 2024-03-09T14:39:35.937 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_65 2024-03-09T14:39:35.937 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_66 2024-03-09T14:39:35.937 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_67 2024-03-09T14:39:35.937 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_68 2024-03-09T14:39:35.937 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_69 2024-03-09T14:39:35.938 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_70 2024-03-09T14:39:35.938 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_71 2024-03-09T14:39:35.938 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_72 2024-03-09T14:39:35.938 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_73 2024-03-09T14:39:35.938 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_74 2024-03-09T14:39:35.938 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_75 2024-03-09T14:39:35.938 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_76 2024-03-09T14:39:35.938 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_77 2024-03-09T14:39:35.938 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_78 2024-03-09T14:39:35.938 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_79 2024-03-09T14:39:35.938 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_80 2024-03-09T14:39:35.938 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_81 2024-03-09T14:39:35.938 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_82 2024-03-09T14:39:35.938 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_83 2024-03-09T14:39:35.939 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_84 2024-03-09T14:39:35.939 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_85 2024-03-09T14:39:35.939 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_86 2024-03-09T14:39:35.939 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_87 2024-03-09T14:39:35.939 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_88 2024-03-09T14:39:35.939 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_89 2024-03-09T14:39:35.939 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_90 2024-03-09T14:39:35.939 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_91 2024-03-09T14:39:35.939 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_92 2024-03-09T14:39:35.939 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_93 2024-03-09T14:39:35.939 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_94 2024-03-09T14:39:35.939 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_95 2024-03-09T14:39:35.939 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_96 2024-03-09T14:39:35.939 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_97 2024-03-09T14:39:35.939 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_98 2024-03-09T14:39:35.940 INFO:tasks.workunit.client.0.smithi099.stdout:created: dmarker:f_99 2024-03-09T14:39:35.940 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1351 ms) 2024-03-09T14:39:35.940 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-09T14:39:35.940 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-03-09T14:39:35.940 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-03-09T14:39:35.941 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-03-09T14:39:35.941 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-03-09T14:39:35.941 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-03-09T14:39:35.941 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-03-09T14:39:35.941 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-03-09T14:39:35.941 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-03-09T14:39:35.941 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-03-09T14:39:35.941 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-03-09T14:39:35.941 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-03-09T14:39:35.941 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-03-09T14:39:35.941 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-03-09T14:39:35.941 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-03-09T14:39:35.941 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-03-09T14:39:35.941 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-03-09T14:39:35.942 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-03-09T14:39:35.942 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-03-09T14:39:35.942 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-03-09T14:39:35.942 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-03-09T14:39:35.942 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-03-09T14:39:35.942 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-03-09T14:39:35.942 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-03-09T14:39:35.942 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-03-09T14:39:35.942 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-03-09T14:39:35.942 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-03-09T14:39:35.942 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-03-09T14:39:35.942 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-03-09T14:39:35.942 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-03-09T14:39:35.942 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-03-09T14:39:35.943 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-03-09T14:39:35.943 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-03-09T14:39:35.943 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-03-09T14:39:35.943 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-03-09T14:39:35.943 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-03-09T14:39:35.943 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-03-09T14:39:35.943 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-03-09T14:39:35.943 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-03-09T14:39:35.943 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-03-09T14:39:35.943 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-03-09T14:39:35.943 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-03-09T14:39:35.943 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-03-09T14:39:35.943 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-03-09T14:39:35.943 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-03-09T14:39:35.943 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-03-09T14:39:35.944 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-03-09T14:39:35.944 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-03-09T14:39:35.944 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-03-09T14:39:35.944 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-03-09T14:39:35.944 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-03-09T14:39:35.944 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-03-09T14:39:35.944 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-03-09T14:39:35.944 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-03-09T14:39:35.944 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-03-09T14:39:35.944 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-03-09T14:39:35.944 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-03-09T14:39:35.944 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-03-09T14:39:35.944 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-03-09T14:39:35.944 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-03-09T14:39:35.945 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-03-09T14:39:35.945 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-03-09T14:39:35.945 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-03-09T14:39:35.945 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-03-09T14:39:35.945 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-03-09T14:39:35.945 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-03-09T14:39:35.945 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-03-09T14:39:35.945 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-03-09T14:39:35.945 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-03-09T14:39:35.945 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-03-09T14:39:35.945 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-03-09T14:39:35.945 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-03-09T14:39:35.945 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-03-09T14:39:35.945 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-03-09T14:39:35.945 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-03-09T14:39:35.946 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-03-09T14:39:35.946 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-03-09T14:39:35.946 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-03-09T14:39:35.946 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-03-09T14:39:35.946 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-03-09T14:39:35.946 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-03-09T14:39:35.946 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-03-09T14:39:35.946 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-03-09T14:39:35.946 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-03-09T14:39:35.946 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-03-09T14:39:35.946 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-03-09T14:39:35.946 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-03-09T14:39:35.946 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-03-09T14:39:35.946 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-03-09T14:39:35.947 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-03-09T14:39:35.947 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-03-09T14:39:35.947 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-03-09T14:39:35.947 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-03-09T14:39:35.947 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-03-09T14:39:35.947 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-03-09T14:39:35.947 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-03-09T14:39:35.947 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-03-09T14:39:35.947 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-03-09T14:39:35.947 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-03-09T14:39:35.947 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-03-09T14:39:35.947 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-03-09T14:39:35.947 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-03-09T14:39:35.947 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-03-09T14:39:35.947 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_READDIR (8 ms) 2024-03-09T14:39:35.948 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-03-09T14:39:35.948 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-03-09T14:39:35.948 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-03-09T14:39:35.949 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-03-09T14:39:35.949 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-03-09T14:39:35.949 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-03-09T14:39:35.949 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-03-09T14:39:35.949 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-03-09T14:39:35.949 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-03-09T14:39:35.949 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-03-09T14:39:35.949 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-03-09T14:39:35.949 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-03-09T14:39:35.949 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-03-09T14:39:35.949 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-03-09T14:39:35.949 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-03-09T14:39:35.949 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-03-09T14:39:35.949 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-03-09T14:39:35.950 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-03-09T14:39:35.950 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-03-09T14:39:35.950 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-03-09T14:39:35.950 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-03-09T14:39:35.950 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-03-09T14:39:35.950 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-03-09T14:39:35.950 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-03-09T14:39:35.950 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-03-09T14:39:35.950 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-03-09T14:39:35.950 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-03-09T14:39:35.950 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-03-09T14:39:35.950 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-03-09T14:39:35.950 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-03-09T14:39:35.950 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-03-09T14:39:35.951 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-03-09T14:39:35.951 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-03-09T14:39:35.951 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-03-09T14:39:35.951 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-03-09T14:39:35.951 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-03-09T14:39:35.951 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-03-09T14:39:35.951 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-03-09T14:39:35.951 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-03-09T14:39:35.951 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-03-09T14:39:35.951 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-03-09T14:39:35.951 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-03-09T14:39:35.951 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-03-09T14:39:35.951 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-03-09T14:39:35.951 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-03-09T14:39:35.952 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-03-09T14:39:35.952 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-03-09T14:39:35.952 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-03-09T14:39:35.952 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-03-09T14:39:35.952 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-03-09T14:39:35.952 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-03-09T14:39:35.952 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-03-09T14:39:35.952 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-03-09T14:39:35.952 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-03-09T14:39:35.952 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-03-09T14:39:35.952 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-03-09T14:39:35.952 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-03-09T14:39:35.952 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-03-09T14:39:35.952 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-03-09T14:39:35.952 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-03-09T14:39:35.953 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-03-09T14:39:35.953 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-03-09T14:39:35.953 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-03-09T14:39:35.953 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-03-09T14:39:35.953 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-03-09T14:39:35.953 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-03-09T14:39:35.953 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-03-09T14:39:35.953 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-03-09T14:39:35.953 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-03-09T14:39:35.953 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-03-09T14:39:35.953 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-03-09T14:39:35.953 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-03-09T14:39:35.953 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-03-09T14:39:35.953 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-03-09T14:39:35.954 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-03-09T14:39:35.954 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-03-09T14:39:35.954 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-03-09T14:39:35.954 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-03-09T14:39:35.954 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-03-09T14:39:35.954 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-03-09T14:39:35.954 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-03-09T14:39:35.954 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-03-09T14:39:35.954 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-03-09T14:39:35.954 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-03-09T14:39:35.954 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-03-09T14:39:35.954 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-03-09T14:39:35.954 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-03-09T14:39:35.954 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-03-09T14:39:35.955 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-03-09T14:39:35.955 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-03-09T14:39:35.955 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-03-09T14:39:35.955 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-03-09T14:39:35.955 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-03-09T14:39:35.955 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-03-09T14:39:35.955 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-03-09T14:39:35.955 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-03-09T14:39:35.955 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-03-09T14:39:35.955 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-03-09T14:39:35.955 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-03-09T14:39:35.955 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-03-09T14:39:35.955 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-03-09T14:39:35.955 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-03-09T14:39:35.955 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-09T14:39:35.956 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-09T14:39:35.956 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:39:35.956 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:39:35.956 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:39:35.956 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:39:35.956 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:39:35.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:35.949+0000 7f00a20aba80 -1 shutting down 2024-03-09T14:39:35.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:35.949+0000 7eff7dc1e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61790, si_uid : 1000, si_addr0x3e80000f15e, si_status0 2024-03-09T14:39:36.121 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (177 ms) 2024-03-09T14:39:36.122 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 11 tests from LibRGW (2127 ms total) 2024-03-09T14:39:36.122 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:39:36.122 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:39:36.122 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 11 tests from 1 test suite ran. (2127 ms total) 2024-03-09T14:39:36.122 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 11 tests. 2024-03-09T14:39:36.136 INFO:tasks.workunit.client.0.smithi099.stdout:phase 4.2 2024-03-09T14:39:36.161 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 11 tests from 1 test suite. 2024-03-09T14:39:36.161 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:39:36.162 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 11 tests from LibRGW 2024-03-09T14:39:36.162 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.TVAR 2024-03-09T14:39:36.162 INFO:tasks.workunit.client.0.smithi099.stdout:read i1: 64001 2024-03-09T14:39:36.162 INFO:tasks.workunit.client.0.smithi099.stdout:read s1: blunderbuss 2024-03-09T14:39:36.162 INFO:tasks.workunit.client.0.smithi099.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-03-09T14:39:36.162 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:39:36.174 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:36.174 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:36.715 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (554 ms) 2024-03-09T14:39:36.715 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:39:36.716 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:39:36.716 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-03-09T14:39:36.731 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (15 ms) 2024-03-09T14:39:36.731 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-03-09T14:39:36.731 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-03-09T14:39:36.731 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-03-09T14:39:36.731 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-03-09T14:39:36.731 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-03-09T14:39:36.735 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-03-09T14:39:36.735 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-03-09T14:39:36.735 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-03-09T14:39:36.735 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-03-09T14:39:36.735 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-03-09T14:39:36.735 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-03-09T14:39:36.735 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-03-09T14:39:36.735 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-03-09T14:39:36.735 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-03-09T14:39:36.735 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-03-09T14:39:36.735 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-03-09T14:39:36.735 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-03-09T14:39:36.736 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-03-09T14:39:36.736 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-03-09T14:39:36.736 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-03-09T14:39:36.736 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-03-09T14:39:36.736 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-03-09T14:39:36.736 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-03-09T14:39:36.736 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-03-09T14:39:36.736 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-03-09T14:39:36.736 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-03-09T14:39:36.736 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-03-09T14:39:36.736 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-03-09T14:39:36.736 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-03-09T14:39:36.737 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-03-09T14:39:36.737 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-03-09T14:39:36.737 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-03-09T14:39:36.737 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-03-09T14:39:36.737 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-03-09T14:39:36.737 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-03-09T14:39:36.737 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-03-09T14:39:36.737 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-03-09T14:39:36.737 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-03-09T14:39:36.737 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-03-09T14:39:36.737 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-03-09T14:39:36.737 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-03-09T14:39:36.737 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-03-09T14:39:36.738 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-03-09T14:39:36.738 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-03-09T14:39:36.738 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-03-09T14:39:36.738 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-03-09T14:39:36.738 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-03-09T14:39:36.738 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-03-09T14:39:36.738 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-03-09T14:39:36.738 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-03-09T14:39:36.738 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-03-09T14:39:36.738 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-03-09T14:39:36.738 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-03-09T14:39:36.738 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-03-09T14:39:36.739 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-03-09T14:39:36.739 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-03-09T14:39:36.739 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-03-09T14:39:36.739 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-03-09T14:39:36.739 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-03-09T14:39:36.739 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-03-09T14:39:36.739 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-03-09T14:39:36.739 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-03-09T14:39:36.739 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-03-09T14:39:36.739 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-03-09T14:39:36.739 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-03-09T14:39:36.739 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-03-09T14:39:36.739 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-03-09T14:39:36.740 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-03-09T14:39:36.740 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-03-09T14:39:36.740 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-03-09T14:39:36.740 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-03-09T14:39:36.740 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-03-09T14:39:36.740 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-03-09T14:39:36.740 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-03-09T14:39:36.740 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-03-09T14:39:36.740 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-03-09T14:39:36.740 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-03-09T14:39:36.740 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-03-09T14:39:36.740 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-03-09T14:39:36.741 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-03-09T14:39:36.741 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-03-09T14:39:36.741 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-03-09T14:39:36.741 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-03-09T14:39:36.741 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-03-09T14:39:36.741 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-03-09T14:39:36.741 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-03-09T14:39:36.741 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-03-09T14:39:36.741 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-03-09T14:39:36.741 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-03-09T14:39:36.741 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-03-09T14:39:36.741 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-03-09T14:39:36.741 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-03-09T14:39:36.742 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-03-09T14:39:36.742 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-03-09T14:39:36.742 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-03-09T14:39:36.742 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-03-09T14:39:36.742 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-03-09T14:39:36.742 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-03-09T14:39:36.742 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-03-09T14:39:36.742 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-03-09T14:39:36.742 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-03-09T14:39:36.742 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-03-09T14:39:36.742 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-03-09T14:39:36.742 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-03-09T14:39:36.743 INFO:tasks.workunit.client.0.smithi099.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-03-09T14:39:36.743 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-03-09T14:39:36.743 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-03-09T14:39:36.743 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-03-09T14:39:36.743 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:39:36.743 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:39:36.743 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:39:36.743 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:39:36.743 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:39:36.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:36.737+0000 7f452e4e1a80 -1 shutting down 2024-03-09T14:39:36.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:36.741+0000 7f440a054640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62433, si_uid : 1000, si_addr0x3e80000f3e1, si_status0 2024-03-09T14:39:36.872 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (137 ms) 2024-03-09T14:39:36.872 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 11 tests from LibRGW (711 ms total) 2024-03-09T14:39:36.872 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:39:36.872 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:39:36.873 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 11 tests from 1 test suite ran. (711 ms total) 2024-03-09T14:39:36.873 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 11 tests. 2024-03-09T14:39:36.886 INFO:tasks.workunit.client.0.smithi099.stdout:phase 5.1 2024-03-09T14:39:36.919 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 19 tests from 1 test suite. 2024-03-09T14:39:36.919 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:39:36.919 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 19 tests from LibRGW 2024-03-09T14:39:36.919 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:39:36.930 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:36.930 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:37.480 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (561 ms) 2024-03-09T14:39:37.480 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:39:37.481 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-03-09T14:39:37.481 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:39:37.498 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CREATE_BUCKET (17 ms) 2024-03-09T14:39:37.498 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-09T14:39:37.504 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-03-09T14:39:37.504 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-03-09T14:39:37.504 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-03-09T14:39:37.504 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-09T14:39:37.508 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-03-09T14:39:37.508 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-03-09T14:39:37.508 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-03-09T14:39:37.508 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-03-09T14:39:37.518 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.PUT_OBJECT (10 ms) 2024-03-09T14:39:37.518 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-03-09T14:39:37.524 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.GET_OBJECT (6 ms) 2024-03-09T14:39:37.524 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-09T14:39:37.524 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-09T14:39:37.524 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-03-09T14:39:37.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-03-09T14:39:37.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.WRITEV 2024-03-09T14:39:37.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-03-09T14:39:37.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READV 2024-03-09T14:39:37.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READV (0 ms) 2024-03-09T14:39:37.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-03-09T14:39:37.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-03-09T14:39:37.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-09T14:39:37.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-03-09T14:39:37.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:39:37.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-03-09T14:39:37.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:39:37.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:39:37.525 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:39:37.526 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:39:37.526 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:39:37.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:37.529+0000 7fd346ddca80 -1 shutting down 2024-03-09T14:39:37.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:37.529+0000 7fd22294f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63076, si_uid : 1000, si_addr0x3e80000f664, si_status0 2024-03-09T14:39:37.621 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (97 ms) 2024-03-09T14:39:37.621 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 19 tests from LibRGW (702 ms total) 2024-03-09T14:39:37.621 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:39:37.621 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:39:37.621 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 19 tests from 1 test suite ran. (702 ms total) 2024-03-09T14:39:37.621 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 19 tests. 2024-03-09T14:39:37.629 INFO:tasks.workunit.client.0.smithi099.stdout:phase 5.2 2024-03-09T14:39:37.661 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] Running 19 tests from 1 test suite. 2024-03-09T14:39:37.662 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment set-up. 2024-03-09T14:39:37.662 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 19 tests from LibRGW 2024-03-09T14:39:37.662 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.INIT 2024-03-09T14:39:37.670 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:37.670 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:38.434 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.INIT (773 ms) 2024-03-09T14:39:38.435 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.MOUNT 2024-03-09T14:39:38.435 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-03-09T14:39:38.436 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-03-09T14:39:38.436 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-03-09T14:39:38.436 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-03-09T14:39:38.445 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (8 ms) 2024-03-09T14:39:38.445 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-03-09T14:39:38.445 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-03-09T14:39:38.445 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-03-09T14:39:38.445 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-03-09T14:39:38.445 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-03-09T14:39:38.445 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-03-09T14:39:38.445 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-03-09T14:39:38.445 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-03-09T14:39:38.445 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-03-09T14:39:38.445 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-03-09T14:39:38.445 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-03-09T14:39:38.445 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-03-09T14:39:38.446 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-03-09T14:39:38.446 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-03-09T14:39:38.446 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.WRITEV 2024-03-09T14:39:38.446 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-03-09T14:39:38.446 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READV 2024-03-09T14:39:38.446 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READV (0 ms) 2024-03-09T14:39:38.446 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-03-09T14:39:38.446 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-03-09T14:39:38.446 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-03-09T14:39:38.457 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_OBJECT (12 ms) 2024-03-09T14:39:38.457 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-03-09T14:39:38.516 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.DELETE_BUCKET (58 ms) 2024-03-09T14:39:38.516 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.CLEANUP 2024-03-09T14:39:38.516 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-03-09T14:39:38.516 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.UMOUNT 2024-03-09T14:39:38.516 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-03-09T14:39:38.516 INFO:tasks.workunit.client.0.smithi099.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-03-09T14:39:38.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:38.521+0000 7f34ca665a80 -1 shutting down 2024-03-09T14:39:38.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:38.521+0000 7f33a61d8640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63719, si_uid : 1000, si_addr0x3e80000f8e7, si_status0 2024-03-09T14:39:38.678 INFO:tasks.workunit.client.0.smithi099.stdout:[ OK ] LibRGW.SHUTDOWN (163 ms) 2024-03-09T14:39:38.678 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] 19 tests from LibRGW (1017 ms total) 2024-03-09T14:39:38.679 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:39:38.679 INFO:tasks.workunit.client.0.smithi099.stdout:[----------] Global test environment tear-down 2024-03-09T14:39:38.679 INFO:tasks.workunit.client.0.smithi099.stdout:[==========] 19 tests from 1 test suite ran. (1017 ms total) 2024-03-09T14:39:38.679 INFO:tasks.workunit.client.0.smithi099.stdout:[ PASSED ] 19 tests. 2024-03-09T14:39:38.694 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:39:38.694 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:39:38.708 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-03-09T14:39:38.709 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-03-09T14:39:38.709 DEBUG:teuthology.orchestra.run.smithi099:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-03-09T14:39:38.760 INFO:tasks.workunit.client.0.smithi099.stderr:+ [ -z ] 2024-03-09T14:39:38.760 INFO:tasks.workunit.client.0.smithi099.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-03-09T14:39:38.760 INFO:tasks.workunit.client.0.smithi099.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-03-09T14:39:38.761 INFO:tasks.workunit.client.0.smithi099.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-03-09T14:39:38.800 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:39:38.800 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:39:38.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:38.849+0000 7f5ea1c73980 20 rados->read ofs=0 len=0 2024-03-09T14:39:38.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:38.849+0000 7f5ea1c73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:38.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:38.849+0000 7f5ea1c73980 20 realm 2024-03-09T14:39:38.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:38.849+0000 7f5ea1c73980 20 rados->read ofs=0 len=0 2024-03-09T14:39:38.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:38.853+0000 7f5ea1c73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:38.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:38.853+0000 7f5ea1c73980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:39:38.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:38.853+0000 7f5ea1c73980 20 rados->read ofs=0 len=0 2024-03-09T14:39:38.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:38.853+0000 7f5ea1c73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:38.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:38.853+0000 7f5ea1c73980 20 rados->read ofs=0 len=0 2024-03-09T14:39:38.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:38.853+0000 7f5ea1c73980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:38.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:38.853+0000 7f5ea1c73980 20 rados->read ofs=0 len=0 2024-03-09T14:39:38.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:38.853+0000 7f5ea1c73980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:39:38.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:38.853+0000 7f5ea1c73980 20 searching for the correct realm 2024-03-09T14:39:38.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:38.857+0000 7f5e9ff8c640 0 -- 172.21.15.99:0/2420769110 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f5e880ee910 msgr2=0x7f5e880b73d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:39.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.073+0000 7f5e9ef8a640 0 -- 172.21.15.99:0/2420769110 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f5e98042410 msgr2=0x7f5e98042890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:39:39.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.289+0000 7f5ea1c73980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:39:39.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.289+0000 7f5ea1c73980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:39:39.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.289+0000 7f5ea1c73980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:39:39.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.289+0000 7f5ea1c73980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:39:39.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.289+0000 7f5ea1c73980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:39:39.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.289+0000 7f5ea1c73980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:39:39.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.289+0000 7f5ea1c73980 20 rados->read ofs=0 len=0 2024-03-09T14:39:39.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.293+0000 7f5ea1c73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:39.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.293+0000 7f5ea1c73980 20 rados->read ofs=0 len=0 2024-03-09T14:39:39.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.293+0000 7f5ea1c73980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:39:39.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.293+0000 7f5ea1c73980 20 rados->read ofs=0 len=0 2024-03-09T14:39:39.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.293+0000 7f5ea1c73980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:39:39.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.293+0000 7f5ea1c73980 20 zone default found 2024-03-09T14:39:39.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.293+0000 7f5ea1c73980 4 Realm: () 2024-03-09T14:39:39.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.293+0000 7f5ea1c73980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:39:39.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.293+0000 7f5ea1c73980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:39:39.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.293+0000 7f5ea1c73980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:39:39.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.293+0000 7f5ea1c73980 20 zonegroup default 2024-03-09T14:39:39.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.293+0000 7f5ea1c73980 20 rados->read ofs=0 len=0 2024-03-09T14:39:39.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.293+0000 7f5ea1c73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:39.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.293+0000 7f5ea1c73980 20 rados->read ofs=0 len=0 2024-03-09T14:39:39.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.293+0000 7f5ea1c73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:39.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.293+0000 7f5ea1c73980 20 rados->read ofs=0 len=0 2024-03-09T14:39:39.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.297+0000 7f5ea1c73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:39.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.297+0000 7f5ea1c73980 20 started sync module instance, tier type = 2024-03-09T14:39:39.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.297+0000 7f5ea1c73980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:39:39.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.317+0000 7f5ea1c73980 20 add_watcher() i=0 2024-03-09T14:39:39.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.317+0000 7f5ea1c73980 20 add_watcher() i=1 2024-03-09T14:39:39.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.317+0000 7f5ea1c73980 20 add_watcher() i=2 2024-03-09T14:39:39.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.317+0000 7f5ea1c73980 20 add_watcher() i=3 2024-03-09T14:39:39.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.317+0000 7f5ea1c73980 20 add_watcher() i=4 2024-03-09T14:39:39.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.317+0000 7f5ea1c73980 20 add_watcher() i=5 2024-03-09T14:39:39.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.317+0000 7f5ea1c73980 20 add_watcher() i=6 2024-03-09T14:39:39.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.321+0000 7f5ea1c73980 20 add_watcher() i=7 2024-03-09T14:39:39.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.321+0000 7f5ea1c73980 2 all 8 watchers are set, enabling cache 2024-03-09T14:39:39.321 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.325+0000 7f5d55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:39.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.325+0000 7f5ea1c73980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:39:39.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.325+0000 7f5ea1c73980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:39:39.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.325+0000 7f5ea1c73980 5 note: GC not initialized 2024-03-09T14:39:39.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.325+0000 7f5d54fe1640 20 reqs_thread_entry: start 2024-03-09T14:39:39.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.325+0000 7f5ea1c73980 20 init_complete bucket index max shards: 11 2024-03-09T14:39:39.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.325+0000 7f5ea1c73980 20 Filter name: none 2024-03-09T14:39:39.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.325+0000 7f5cce7fc640 20 reqs_thread_entry: start 2024-03-09T14:39:39.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-03-09T14:39:39.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 20 rados->read ofs=0 len=0 2024-03-09T14:39:39.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:39.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-03-09T14:39:39.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-03-09T14:39:39.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-03-09T14:39:39.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 20 rados->read ofs=0 len=0 2024-03-09T14:39:39.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:39.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-03-09T14:39:39.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-03-09T14:39:39.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-03-09T14:39:39.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 20 rados->read ofs=0 len=0 2024-03-09T14:39:39.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:39:39.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-03-09T14:39:39.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-03-09T14:39:39.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-03-09T14:39:39.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-03-09T14:39:39.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-03-09T14:39:39.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-03-09T14:39:39.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.329+0000 7f5ea1c73980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-03-09T14:39:39.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.333+0000 7f5d82ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824002 cookie 93934977903712 notifier 5736 bl.length()=677 2024-03-09T14:39:39.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.333+0000 7f5d82ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-03-09T14:39:39.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.333+0000 7f5d82ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-03-09T14:39:39.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.333+0000 7f5ea1c73980 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-03-09T14:39:39.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.333+0000 7f5ea1c73980 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-03-09T14:39:39.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.333+0000 7f5ea1c73980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-03-09T14:39:39.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.337+0000 7f5d827fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824003 cookie 93934977889920 notifier 5736 bl.length()=187 2024-03-09T14:39:39.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.337+0000 7f5d827fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-03-09T14:39:39.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.337+0000 7f5d827fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-03-09T14:39:39.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.337+0000 7f5ea1c73980 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-03-09T14:39:39.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.337+0000 7f5ea1c73980 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-03-09T14:39:39.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.337+0000 7f5ea1c73980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-03-09T14:39:39.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.341+0000 7f5d82ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824004 cookie 93934977889920 notifier 5736 bl.length()=197 2024-03-09T14:39:39.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.341+0000 7f5d82ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-03-09T14:39:39.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.341+0000 7f5d82ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-03-09T14:39:39.337 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:39:39.337 INFO:tasks.workunit.client.0.smithi099.stdout: "user_id": "ceph-test-maven", 2024-03-09T14:39:39.337 INFO:tasks.workunit.client.0.smithi099.stdout: "display_name": "maven test user", 2024-03-09T14:39:39.337 INFO:tasks.workunit.client.0.smithi099.stdout: "email": "sigv4@example.com", 2024-03-09T14:39:39.337 INFO:tasks.workunit.client.0.smithi099.stdout: "suspended": 0, 2024-03-09T14:39:39.337 INFO:tasks.workunit.client.0.smithi099.stdout: "max_buckets": 1000, 2024-03-09T14:39:39.337 INFO:tasks.workunit.client.0.smithi099.stdout: "subusers": [], 2024-03-09T14:39:39.337 INFO:tasks.workunit.client.0.smithi099.stdout: "keys": [ 2024-03-09T14:39:39.337 INFO:tasks.workunit.client.0.smithi099.stdout: { 2024-03-09T14:39:39.338 INFO:tasks.workunit.client.0.smithi099.stdout: "user": "ceph-test-maven", 2024-03-09T14:39:39.338 INFO:tasks.workunit.client.0.smithi099.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-03-09T14:39:39.338 INFO:tasks.workunit.client.0.smithi099.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-03-09T14:39:39.338 INFO:tasks.workunit.client.0.smithi099.stdout: "active": true, 2024-03-09T14:39:39.338 INFO:tasks.workunit.client.0.smithi099.stdout: "create_date": "2024-03-09T14:39:39.332618Z" 2024-03-09T14:39:39.338 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:39:39.338 INFO:tasks.workunit.client.0.smithi099.stdout: ], 2024-03-09T14:39:39.338 INFO:tasks.workunit.client.0.smithi099.stdout: "swift_keys": [], 2024-03-09T14:39:39.338 INFO:tasks.workunit.client.0.smithi099.stdout: "caps": [], 2024-03-09T14:39:39.338 INFO:tasks.workunit.client.0.smithi099.stdout: "op_mask": "read, write, delete", 2024-03-09T14:39:39.338 INFO:tasks.workunit.client.0.smithi099.stdout: "default_placement": "", 2024-03-09T14:39:39.338 INFO:tasks.workunit.client.0.smithi099.stdout: "default_storage_class": "", 2024-03-09T14:39:39.338 INFO:tasks.workunit.client.0.smithi099.stdout: "placement_tags": [], 2024-03-09T14:39:39.338 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_quota": { 2024-03-09T14:39:39.338 INFO:tasks.workunit.client.0.smithi099.stdout: "enabled": false, 2024-03-09T14:39:39.339 INFO:tasks.workunit.client.0.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:39:39.339 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size": -1, 2024-03-09T14:39:39.339 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:39:39.339 INFO:tasks.workunit.client.0.smithi099.stdout: "max_objects": -1 2024-03-09T14:39:39.339 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:39.339 INFO:tasks.workunit.client.0.smithi099.stdout: "user_quota": { 2024-03-09T14:39:39.339 INFO:tasks.workunit.client.0.smithi099.stdout: "enabled": false, 2024-03-09T14:39:39.339 INFO:tasks.workunit.client.0.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:39:39.339 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size": -1, 2024-03-09T14:39:39.339 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:39:39.339 INFO:tasks.workunit.client.0.smithi099.stdout: "max_objects": -1 2024-03-09T14:39:39.339 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:39:39.339 INFO:tasks.workunit.client.0.smithi099.stdout: "temp_url_keys": [], 2024-03-09T14:39:39.339 INFO:tasks.workunit.client.0.smithi099.stdout: "type": "rgw", 2024-03-09T14:39:39.339 INFO:tasks.workunit.client.0.smithi099.stdout: "mfa_ids": [], 2024-03-09T14:39:39.339 INFO:tasks.workunit.client.0.smithi099.stdout: "account_id": "", 2024-03-09T14:39:39.340 INFO:tasks.workunit.client.0.smithi099.stdout: "path": "/", 2024-03-09T14:39:39.340 INFO:tasks.workunit.client.0.smithi099.stdout: "create_date": "2024-03-09T14:39:39.332587Z", 2024-03-09T14:39:39.340 INFO:tasks.workunit.client.0.smithi099.stdout: "tags": [], 2024-03-09T14:39:39.340 INFO:tasks.workunit.client.0.smithi099.stdout: "group_ids": [] 2024-03-09T14:39:39.340 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:39:39.340 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:39:39.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.341+0000 7f5d55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:39:39.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.345+0000 7f5ea1c73980 20 remove_watcher() i=0 2024-03-09T14:39:39.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.345+0000 7f5ea1c73980 2 removed watcher, disabling cache 2024-03-09T14:39:39.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.349+0000 7f5ea1c73980 20 remove_watcher() i=1 2024-03-09T14:39:39.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.353+0000 7f5ea1c73980 20 remove_watcher() i=2 2024-03-09T14:39:39.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.353+0000 7f5ea1c73980 20 remove_watcher() i=3 2024-03-09T14:39:39.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.357+0000 7f5ea1c73980 20 remove_watcher() i=4 2024-03-09T14:39:39.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.357+0000 7f5ea1c73980 20 remove_watcher() i=5 2024-03-09T14:39:39.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.357+0000 7f5ea1c73980 20 remove_watcher() i=6 2024-03-09T14:39:39.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:39:39.361+0000 7f5ea1c73980 20 remove_watcher() i=7 2024-03-09T14:39:39.371 INFO:tasks.workunit.client.0.smithi099.stderr:+ [ -z ] 2024-03-09T14:39:39.371 INFO:tasks.workunit.client.0.smithi099.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-03-09T14:39:39.371 INFO:tasks.workunit.client.0.smithi099.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-03-09T14:39:39.372 INFO:tasks.workunit.client.0.smithi099.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi099.front.sepia.ceph.com:443 2024-03-09T14:39:39.372 INFO:tasks.workunit.client.0.smithi099.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-03-09T14:39:39.372 INFO:tasks.workunit.client.0.smithi099.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-03-09T14:39:39.372 INFO:tasks.workunit.client.0.smithi099.stderr:+ ./mvnw clean package 2024-03-09T14:39:39.378 INFO:tasks.workunit.client.0.smithi099.stdout:Warning: JAVA_HOME environment variable is not set. 2024-03-09T14:39:42.461 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Scanning for projects... 2024-03-09T14:39:42.583 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-03-09T14:39:42.695 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 49 kB/s) 2024-03-09T14:39:42.718 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-03-09T14:39:42.761 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 1.9 MB/s) 2024-03-09T14:39:42.775 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-03-09T14:39:42.799 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.2 MB/s) 2024-03-09T14:39:42.839 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:39:42.840 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-03-09T14:39:42.840 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Building jcksum 1.0 2024-03-09T14:39:42.840 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] from pom.xml 2024-03-09T14:39:42.840 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-03-09T14:39:42.844 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-03-09T14:39:42.864 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 265 kB/s) 2024-03-09T14:39:42.873 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-03-09T14:39:42.893 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 495 kB/s) 2024-03-09T14:39:42.897 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-03-09T14:39:42.918 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.2 MB/s) 2024-03-09T14:39:42.925 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-03-09T14:39:42.944 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.1 MB/s) 2024-03-09T14:39:42.959 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-03-09T14:39:42.980 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 1.7 MB/s) 2024-03-09T14:39:42.990 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-03-09T14:39:43.009 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 429 kB/s) 2024-03-09T14:39:43.013 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-03-09T14:39:43.032 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 426 kB/s) 2024-03-09T14:39:43.035 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-03-09T14:39:43.057 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.2 MB/s) 2024-03-09T14:39:43.065 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-03-09T14:39:43.085 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 987 kB/s) 2024-03-09T14:39:43.095 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-03-09T14:39:43.117 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.3 MB/s) 2024-03-09T14:39:43.129 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-03-09T14:39:43.149 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 491 kB/s) 2024-03-09T14:39:43.161 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-03-09T14:39:43.183 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/66 kB Progress (1): 32/66 kB Progress (1): 49/66 kB Progress (1): 65/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.0 MB/s) 2024-03-09T14:39:43.195 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-03-09T14:39:43.216 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 253 kB/s) 2024-03-09T14:39:43.221 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-03-09T14:39:43.241 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.1 MB/s) 2024-03-09T14:39:43.247 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-03-09T14:39:43.270 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.2 MB/s) 2024-03-09T14:39:43.280 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-03-09T14:39:43.300 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.1 MB/s) 2024-03-09T14:39:43.313 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-03-09T14:39:43.333 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 282 kB/s) 2024-03-09T14:39:43.341 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-03-09T14:39:43.363 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.0 MB/s) 2024-03-09T14:39:43.381 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-03-09T14:39:43.401 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 338 kB/s) 2024-03-09T14:39:43.406 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-03-09T14:39:43.426 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 495 kB/s) 2024-03-09T14:39:43.431 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-03-09T14:39:43.453 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/46 kB Progress (1): 32/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.0 MB/s) 2024-03-09T14:39:43.462 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-03-09T14:39:43.483 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 970 kB/s) 2024-03-09T14:39:43.494 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-03-09T14:39:43.515 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.3 MB/s) 2024-03-09T14:39:43.547 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-03-09T14:39:43.567 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 304 kB/s) 2024-03-09T14:39:43.571 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-03-09T14:39:43.592 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.0 MB/s) 2024-03-09T14:39:43.606 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-03-09T14:39:43.627 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 953 kB/s) 2024-03-09T14:39:43.642 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-03-09T14:39:43.662 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 191 kB/s) 2024-03-09T14:39:43.666 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-03-09T14:39:43.685 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 82 kB/s) 2024-03-09T14:39:43.689 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-03-09T14:39:43.711 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 101 kB/s) 2024-03-09T14:39:43.720 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-03-09T14:39:43.740 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 182 kB/s) 2024-03-09T14:39:43.750 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-03-09T14:39:43.769 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 161 kB/s) 2024-03-09T14:39:43.778 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-03-09T14:39:43.799 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 522 kB/s) 2024-03-09T14:39:43.809 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-03-09T14:39:43.829 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 80 kB/s) 2024-03-09T14:39:43.837 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-03-09T14:39:43.858 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 182 kB/s) 2024-03-09T14:39:43.866 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-03-09T14:39:43.886 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 246 kB/s) 2024-03-09T14:39:43.893 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-03-09T14:39:43.916 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 50 kB/s) 2024-03-09T14:39:43.921 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-03-09T14:39:43.944 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 167 kB/s) 2024-03-09T14:39:43.948 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-03-09T14:39:43.967 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 727 kB/s) 2024-03-09T14:39:43.973 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-03-09T14:39:43.993 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 193 kB/s) 2024-03-09T14:39:44.003 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-03-09T14:39:44.023 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 122 kB/s) 2024-03-09T14:39:44.031 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-03-09T14:39:44.050 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 146 kB/s) 2024-03-09T14:39:44.059 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-03-09T14:39:44.078 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 370 kB/s) 2024-03-09T14:39:44.090 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-03-09T14:39:44.113 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 237 kB/s) 2024-03-09T14:39:44.123 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-03-09T14:39:44.143 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 174 kB/s) 2024-03-09T14:39:44.158 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-03-09T14:39:44.179 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 191 kB/s) 2024-03-09T14:39:44.185 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-03-09T14:39:44.206 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 109 kB/s) 2024-03-09T14:39:44.215 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-03-09T14:39:44.234 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 339 kB/s) 2024-03-09T14:39:44.241 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-03-09T14:39:44.260 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 319 kB/s) 2024-03-09T14:39:44.269 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-03-09T14:39:44.288 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 149 kB/s) 2024-03-09T14:39:44.296 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-03-09T14:39:44.315 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 183 kB/s) 2024-03-09T14:39:44.326 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-03-09T14:39:44.345 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 215 kB/s) 2024-03-09T14:39:44.349 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-03-09T14:39:44.368 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 89 kB/s) 2024-03-09T14:39:44.377 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-03-09T14:39:44.398 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 315 kB/s) 2024-03-09T14:39:44.404 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-03-09T14:39:44.424 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 819 kB/s) 2024-03-09T14:39:44.430 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-03-09T14:39:44.453 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.5 MB/s) 2024-03-09T14:39:44.464 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-03-09T14:39:44.484 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 815 kB/s) 2024-03-09T14:39:44.493 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-03-09T14:39:44.518 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 191 kB/s) 2024-03-09T14:39:44.521 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-03-09T14:39:44.539 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 693 kB/s) 2024-03-09T14:39:44.547 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-03-09T14:39:44.568 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 635 kB/s) 2024-03-09T14:39:44.573 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-03-09T14:39:44.595 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.1 MB/s) 2024-03-09T14:39:44.609 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-03-09T14:39:44.627 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 825 kB/s) 2024-03-09T14:39:44.636 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-03-09T14:39:44.655 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 772 kB/s) 2024-03-09T14:39:44.660 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-03-09T14:39:44.681 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 3.8 MB/s) 2024-03-09T14:39:44.689 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-03-09T14:39:44.708 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 970 kB/s) 2024-03-09T14:39:44.716 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-03-09T14:39:44.735 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 998 kB/s) 2024-03-09T14:39:44.741 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-03-09T14:39:44.764 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.4 MB/s) 2024-03-09T14:39:44.776 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-03-09T14:39:44.795 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 202 kB/s) 2024-03-09T14:39:44.799 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-03-09T14:39:44.818 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 727 kB/s) 2024-03-09T14:39:44.824 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-03-09T14:39:44.843 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 169 kB/s) 2024-03-09T14:39:44.849 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-03-09T14:39:44.868 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 168 kB/s) 2024-03-09T14:39:44.875 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-03-09T14:39:44.895 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 102 kB/s) 2024-03-09T14:39:44.899 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-03-09T14:39:44.918 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 149 kB/s) 2024-03-09T14:39:44.925 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-03-09T14:39:44.945 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 76 kB/s) 2024-03-09T14:39:44.950 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-03-09T14:39:44.973 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 143 kB/s) 2024-03-09T14:39:44.978 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-03-09T14:39:44.997 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 169 kB/s) 2024-03-09T14:39:45.002 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-03-09T14:39:45.021 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 169 kB/s) 2024-03-09T14:39:45.029 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-03-09T14:39:45.048 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 51 kB/s) 2024-03-09T14:39:45.057 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-03-09T14:39:45.077 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 48 kB/s) 2024-03-09T14:39:45.084 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-03-09T14:39:45.104 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 153 kB/s) 2024-03-09T14:39:45.109 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-03-09T14:39:45.128 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 152 kB/s) 2024-03-09T14:39:45.134 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-03-09T14:39:45.154 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 172 kB/s) 2024-03-09T14:39:45.159 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-03-09T14:39:45.178 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 181 kB/s) 2024-03-09T14:39:45.183 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-03-09T14:39:45.203 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 151 kB/s) 2024-03-09T14:39:45.284 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-03-09T14:39:45.428 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 23 MB/s) 2024-03-09T14:39:45.430 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-03-09T14:39:45.431 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-03-09T14:39:45.431 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-03-09T14:39:45.431 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-03-09T14:39:45.431 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-03-09T14:39:45.479 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/71 kB Progress (1): 33/71 kB Progress (1): 49/71 kB Progress (1): 66/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.4 MB/s) 2024-03-09T14:39:45.479 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-03-09T14:39:45.497 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 243 kB/s) 2024-03-09T14:39:45.497 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-03-09T14:39:45.529 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/49 kB Progress (1): 2.8/49 kB Progress (1): 4.1/49 kB Progress (2): 4.1/49 kB | 16/782 kB Progress (2): 5.5/49 kB | 16/782 kB Progress (2): 6.9/49 kB | 16/782 kB Progress (2): 6.9/49 kB | 33/782 kB Progress (2): 8.3/49 kB | 33/782 kB Progress (3): 8.3/49 kB | 33/782 kB | 1.4/35 kB Progress (3): 9.7/49 kB | 33/782 kB | 1.4/35 kB Progress (3): 9.7/49 kB | 33/782 kB | 2.8/35 kB Progress (3): 9.7/49 kB | 49/782 kB | 2.8/35 kB Progress (3): 11/49 kB | 49/782 kB | 2.8/35 kB Progress (3): 11/49 kB | 49/782 kB | 4.1/35 kB Progress (3): 12/49 kB | 49/782 kB | 4.1/35 kB Progress (3): 12/49 kB | 66/782 kB | 4.1/35 kB Progress (3): 12/49 kB | 66/782 kB | 5.5/35 kB Progress (3): 12/49 kB | 82/782 kB | 5.5/35 kB Progress (3): 12/49 kB | 82/782 kB | 6.9/35 kB Progress (3): 12/49 kB | 98/782 kB | 6.9/35 kB Progress (3): 12/49 kB | 98/782 kB | 8.3/35 kB Progress (3): 12/49 kB | 115/782 kB | 8.3/35 kB Progress (3): 12/49 kB | 115/782 kB | 9.7/35 kB Progress (3): 12/49 kB | 131/782 kB | 9.7/35 kB Progress (3): 12/49 kB | 147/782 kB | 9.7/35 kB Progress (3): 12/49 kB | 147/782 kB | 11/35 kB Progress (3): 12/49 kB | 164/782 kB | 11/35 kB Progress (3): 12/49 kB | 164/782 kB | 12/35 kB Progress (3): 14/49 kB | 164/782 kB | 12/35 kB Progress (3): 14/49 kB | 180/782 kB | 12/35 kB Progress (3): 15/49 kB | 180/782 kB | 12/35 kB Progress (3): 15/49 kB | 197/782 kB | 12/35 kB Progress (3): 15/49 kB | 213/782 kB | 12/35 kB Progress (3): 15/49 kB | 229/782 kB | 12/35 kB Progress (3): 15/49 kB | 246/782 kB | 12/35 kB Progress (3): 15/49 kB | 256/782 kB | 12/35 kB Progress (3): 15/49 kB | 272/782 kB | 12/35 kB Progress (3): 15/49 kB | 289/782 kB | 12/35 kB Progress (3): 15/49 kB | 289/782 kB | 14/35 kB Progress (3): 15/49 kB | 305/782 kB | 14/35 kB Progress (3): 15/49 kB | 305/782 kB | 15/35 kB Progress (3): 15/49 kB | 321/782 kB | 15/35 kB Progress (3): 17/49 kB | 321/782 kB | 15/35 kB Progress (3): 17/49 kB | 321/782 kB | 17/35 kB Progress (3): 18/49 kB | 321/782 kB | 17/35 kB Progress (3): 18/49 kB | 338/782 kB | 17/35 kB Progress (3): 18/49 kB | 338/782 kB | 18/35 kB Progress (3): 18/49 kB | 354/782 kB | 18/35 kB Progress (3): 19/49 kB | 354/782 kB | 18/35 kB Progress (3): 19/49 kB | 354/782 kB | 19/35 kB Progress (3): 21/49 kB | 354/782 kB | 19/35 kB Progress (3): 21/49 kB | 370/782 kB | 19/35 kB Progress (3): 21/49 kB | 370/782 kB | 21/35 kB Progress (3): 22/49 kB | 370/782 kB | 21/35 kB Progress (3): 22/49 kB | 387/782 kB | 21/35 kB Progress (3): 22/49 kB | 387/782 kB | 22/35 kB Progress (3): 23/49 kB | 387/782 kB | 22/35 kB Progress (3): 23/49 kB | 403/782 kB | 22/35 kB Progress (3): 23/49 kB | 403/782 kB | 23/35 kB Progress (3): 25/49 kB | 403/782 kB | 23/35 kB Progress (3): 25/49 kB | 420/782 kB | 23/35 kB Progress (3): 25/49 kB | 420/782 kB | 25/35 kB Progress (3): 26/49 kB | 420/782 kB | 25/35 kB Progress (3): 26/49 kB | 436/782 kB | 25/35 kB Progress (3): 26/49 kB | 436/782 kB | 26/35 kB Progress (3): 28/49 kB | 436/782 kB | 26/35 kB Progress (3): 28/49 kB | 452/782 kB | 26/35 kB Progress (3): 28/49 kB | 452/782 kB | 28/35 kB Progress (3): 29/49 kB | 452/782 kB | 28/35 kB Progress (3): 29/49 kB | 469/782 kB | 28/35 kB Progress (3): 29/49 kB | 469/782 kB | 29/35 kB Progress (3): 30/49 kB | 469/782 kB | 29/35 kB Progress (3): 30/49 kB | 485/782 kB | 29/35 kB Progress (3): 30/49 kB | 485/782 kB | 30/35 kB Progress (3): 32/49 kB | 485/782 kB | 30/35 kB Progress (3): 32/49 kB | 485/782 kB | 32/35 kB Progress (3): 32/49 kB | 502/782 kB | 32/35 kB Progress (3): 33/49 kB | 502/782 kB | 32/35 kB Progress (3): 34/49 kB | 502/782 kB | 32/35 kB Progress (3): 34/49 kB | 518/782 kB | 32/35 kB Progress (3): 34/49 kB | 534/782 kB | 32/35 kB Progress (3): 34/49 kB | 534/782 kB | 33/35 kB Progress (3): 36/49 kB | 534/782 kB | 33/35 kB Progress (3): 36/49 kB | 551/782 kB | 33/35 kB Progress (3): 36/49 kB | 551/782 kB | 34/35 kB Progress (3): 37/49 kB | 551/782 kB | 34/35 kB Progress (3): 37/49 kB | 567/782 kB | 34/35 kB Progress (3): 37/49 kB | 567/782 kB | 35 kB Progress (3): 37/49 kB | 583/782 kB | 35 kB Progress (3): 37/49 kB | 600/782 kB | 35 kB Progress (3): 39/49 kB | 600/782 kB | 35 kB Progress (3): 39/49 kB | 616/782 kB | 35 kB Progress (4): 39/49 kB | 616/782 kB | 35 kB | 16/98 kB Progress (4): 39/49 kB | 633/782 kB | 35 kB | 16/98 kB Progress (4): 40/49 kB | 633/782 kB | 35 kB | 16/98 kB Progress (4): 40/49 kB | 649/782 kB | 35 kB | 16/98 kB Progress (4): 41/49 kB | 649/782 kB | 35 kB | 16/98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 352 kB/s) 2024-03-09T14:39:45.554 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 41/49 kB | 665/782 kB | 16/98 kB Progress (3): 43/49 kB | 665/782 kB | 16/98 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-03-09T14:39:45.557 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 44/49 kB | 665/782 kB | 16/98 kB Progress (3): 44/49 kB | 682/782 kB | 16/98 kB Progress (3): 44/49 kB | 682/782 kB | 33/98 kB Progress (4): 44/49 kB | 682/782 kB | 33/98 kB | 1.4/16 kB Progress (4): 44/49 kB | 682/782 kB | 33/98 kB | 2.8/16 kB Progress (4): 44/49 kB | 698/782 kB | 33/98 kB | 2.8/16 kB Progress (4): 44/49 kB | 698/782 kB | 49/98 kB | 2.8/16 kB Progress (4): 44/49 kB | 698/782 kB | 49/98 kB | 4.1/16 kB Progress (4): 46/49 kB | 698/782 kB | 49/98 kB | 4.1/16 kB Progress (4): 46/49 kB | 698/782 kB | 49/98 kB | 5.5/16 kB Progress (4): 47/49 kB | 698/782 kB | 49/98 kB | 5.5/16 kB Progress (4): 47/49 kB | 715/782 kB | 49/98 kB | 5.5/16 kB Progress (4): 48/49 kB | 715/782 kB | 49/98 kB | 5.5/16 kB Progress (4): 48/49 kB | 715/782 kB | 49/98 kB | 6.9/16 kB Progress (4): 48/49 kB | 715/782 kB | 66/98 kB | 6.9/16 kB Progress (4): 48/49 kB | 715/782 kB | 66/98 kB | 8.3/16 kB Progress (4): 49 kB | 715/782 kB | 66/98 kB | 8.3/16 kB Progress (4): 49 kB | 715/782 kB | 66/98 kB | 9.7/16 kB Progress (4): 49 kB | 731/782 kB | 66/98 kB | 9.7/16 kB Progress (4): 49 kB | 731/782 kB | 66/98 kB | 11/16 kB Progress (4): 49 kB | 731/782 kB | 66/98 kB | 12/16 kB Progress (4): 49 kB | 731/782 kB | 66/98 kB | 14/16 kB Progress (4): 49 kB | 747/782 kB | 66/98 kB | 14/16 kB Progress (4): 49 kB | 747/782 kB | 66/98 kB | 15/16 kB Progress (4): 49 kB | 747/782 kB | 66/98 kB | 16 kB Progress (4): 49 kB | 764/782 kB | 66/98 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 391 kB/s) 2024-03-09T14:39:45.557 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-03-09T14:39:45.557 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 780/782 kB | 66/98 kB | 16 kB Progress (3): 782 kB | 66/98 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 124 kB/s) 2024-03-09T14:39:45.557 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-03-09T14:39:45.558 INFO:tasks.workunit.client.0.smithi099.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 6.2 MB/s) 2024-03-09T14:39:45.558 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-03-09T14:39:45.570 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 82/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 691 kB/s) 2024-03-09T14:39:45.570 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-03-09T14:39:45.572 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/11 kB Progress (1): 2.8/11 kB Progress (1): 4.1/11 kB Progress (1): 5.5/11 kB Progress (1): 6.9/11 kB Progress (1): 8.3/11 kB Progress (1): 9.7/11 kB Progress (1): 11/11 kB Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 81 kB/s) 2024-03-09T14:39:45.572 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-03-09T14:39:45.578 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/205 kB Progress (1): 33/205 kB Progress (1): 49/205 kB Progress (1): 66/205 kB Progress (2): 66/205 kB | 1.4/30 kB Progress (2): 82/205 kB | 1.4/30 kB Progress (2): 82/205 kB | 2.8/30 kB Progress (2): 82/205 kB | 4.1/30 kB Progress (2): 98/205 kB | 4.1/30 kB Progress (2): 98/205 kB | 5.5/30 kB Progress (2): 98/205 kB | 6.9/30 kB Progress (3): 98/205 kB | 6.9/30 kB | 16/81 kB Progress (3): 115/205 kB | 6.9/30 kB | 16/81 kB Progress (3): 115/205 kB | 8.3/30 kB | 16/81 kB Progress (3): 115/205 kB | 9.7/30 kB | 16/81 kB Progress (3): 131/205 kB | 9.7/30 kB | 16/81 kB Progress (3): 147/205 kB | 9.7/30 kB | 16/81 kB Progress (3): 147/205 kB | 11/30 kB | 16/81 kB Progress (3): 147/205 kB | 12/30 kB | 16/81 kB Progress (3): 164/205 kB | 12/30 kB | 16/81 kB Progress (3): 180/205 kB | 12/30 kB | 16/81 kB Progress (3): 180/205 kB | 14/30 kB | 16/81 kB Progress (3): 197/205 kB | 14/30 kB | 16/81 kB Progress (3): 197/205 kB | 14/30 kB | 33/81 kB Progress (3): 197/205 kB | 15/30 kB | 33/81 kB Progress (3): 205 kB | 15/30 kB | 33/81 kB Progress (3): 205 kB | 17/30 kB | 33/81 kB Progress (3): 205 kB | 18/30 kB | 33/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 1.4 MB/s) 2024-03-09T14:39:45.578 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-03-09T14:39:45.582 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 19/30 kB | 33/81 kB Progress (2): 21/30 kB | 33/81 kB Progress (2): 22/30 kB | 33/81 kB Progress (2): 22/30 kB | 49/81 kB Progress (2): 23/30 kB | 49/81 kB Progress (2): 25/30 kB | 49/81 kB Progress (2): 26/30 kB | 49/81 kB Progress (2): 26/30 kB | 64/81 kB Progress (2): 28/30 kB | 64/81 kB Progress (2): 29/30 kB | 64/81 kB Progress (2): 30 kB | 64/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 201 kB/s) 2024-03-09T14:39:45.582 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-03-09T14:39:45.590 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 64/81 kB | 1.4/13 kB Progress (2): 64/81 kB | 2.8/13 kB Progress (2): 64/81 kB | 4.1/13 kB Progress (2): 64/81 kB | 5.5/13 kB Progress (2): 64/81 kB | 6.9/13 kB Progress (3): 64/81 kB | 6.9/13 kB | 16/798 kB Progress (3): 64/81 kB | 8.3/13 kB | 16/798 kB Progress (3): 64/81 kB | 9.7/13 kB | 16/798 kB Progress (3): 64/81 kB | 11/13 kB | 16/798 kB Progress (3): 64/81 kB | 12/13 kB | 16/798 kB Progress (3): 64/81 kB | 13 kB | 16/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 84 kB/s) 2024-03-09T14:39:45.590 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-03-09T14:39:45.591 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 81/81 kB | 16/798 kB Progress (2): 81 kB | 16/798 kB Progress (2): 81 kB | 33/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 514 kB/s) 2024-03-09T14:39:45.591 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-03-09T14:39:45.598 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 49/798 kB Progress (1): 66/798 kB Progress (1): 82/798 kB Progress (1): 98/798 kB Progress (2): 98/798 kB | 16/182 kB Progress (2): 98/798 kB | 32/182 kB Progress (2): 98/798 kB | 49/182 kB Progress (2): 98/798 kB | 65/182 kB Progress (2): 98/798 kB | 81/182 kB Progress (2): 98/798 kB | 98/182 kB Progress (2): 98/798 kB | 114/182 kB Progress (2): 98/798 kB | 130/182 kB Progress (2): 98/798 kB | 147/182 kB Progress (2): 98/798 kB | 163/182 kB Progress (2): 98/798 kB | 180/182 kB Progress (2): 98/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.1 MB/s) 2024-03-09T14:39:45.598 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-03-09T14:39:45.608 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 98/798 kB | 16/151 kB Progress (2): 98/798 kB | 33/151 kB Progress (2): 115/798 kB | 33/151 kB Progress (2): 131/798 kB | 33/151 kB Progress (2): 131/798 kB | 49/151 kB Progress (2): 147/798 kB | 49/151 kB Progress (2): 164/798 kB | 49/151 kB Progress (3): 164/798 kB | 49/151 kB | 16/27 kB Progress (3): 180/798 kB | 49/151 kB | 16/27 kB Progress (3): 180/798 kB | 49/151 kB | 27 kB Progress (3): 197/798 kB | 49/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 158 kB/s) 2024-03-09T14:39:45.608 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-03-09T14:39:45.611 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 197/798 kB | 49/151 kB | 16/30 kB Progress (3): 213/798 kB | 49/151 kB | 16/30 kB Progress (3): 213/798 kB | 49/151 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 171 kB/s) 2024-03-09T14:39:45.611 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-03-09T14:39:45.621 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 213/798 kB | 66/151 kB Progress (3): 213/798 kB | 66/151 kB | 16/385 kB Progress (3): 213/798 kB | 82/151 kB | 16/385 kB Progress (3): 213/798 kB | 82/151 kB | 33/385 kB Progress (3): 213/798 kB | 82/151 kB | 37/385 kB Progress (3): 213/798 kB | 82/151 kB | 53/385 kB Progress (3): 213/798 kB | 82/151 kB | 69/385 kB Progress (3): 213/798 kB | 82/151 kB | 86/385 kB Progress (3): 213/798 kB | 82/151 kB | 102/385 kB Progress (3): 213/798 kB | 82/151 kB | 118/385 kB Progress (3): 213/798 kB | 82/151 kB | 135/385 kB Progress (3): 213/798 kB | 82/151 kB | 151/385 kB Progress (3): 213/798 kB | 82/151 kB | 168/385 kB Progress (3): 213/798 kB | 98/151 kB | 168/385 kB Progress (3): 213/798 kB | 98/151 kB | 184/385 kB Progress (3): 229/798 kB | 98/151 kB | 184/385 kB Progress (3): 229/798 kB | 115/151 kB | 184/385 kB Progress (3): 229/798 kB | 115/151 kB | 200/385 kB Progress (3): 229/798 kB | 131/151 kB | 200/385 kB Progress (3): 246/798 kB | 131/151 kB | 200/385 kB Progress (3): 246/798 kB | 131/151 kB | 217/385 kB Progress (3): 246/798 kB | 131/151 kB | 233/385 kB Progress (3): 246/798 kB | 131/151 kB | 250/385 kB Progress (3): 256/798 kB | 131/151 kB | 250/385 kB Progress (3): 256/798 kB | 147/151 kB | 250/385 kB Progress (3): 256/798 kB | 151 kB | 250/385 kB Progress (3): 256/798 kB | 151 kB | 266/385 kB Progress (3): 256/798 kB | 151 kB | 282/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 810 kB/s) 2024-03-09T14:39:45.621 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-03-09T14:39:45.624 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 256/798 kB | 299/385 kB Progress (2): 256/798 kB | 315/385 kB Progress (2): 256/798 kB | 331/385 kB Progress (2): 256/798 kB | 348/385 kB Progress (2): 272/798 kB | 348/385 kB Progress (2): 272/798 kB | 364/385 kB Progress (2): 272/798 kB | 381/385 kB Progress (2): 272/798 kB | 385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.0 MB/s) 2024-03-09T14:39:45.624 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-03-09T14:39:45.629 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 289/798 kB Progress (1): 305/798 kB Progress (1): 321/798 kB Progress (1): 338/798 kB Progress (2): 338/798 kB | 16/75 kB Progress (3): 338/798 kB | 16/75 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 68 kB/s) 2024-03-09T14:39:45.629 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-03-09T14:39:45.635 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 338/798 kB | 33/75 kB Progress (2): 338/798 kB | 49/75 kB Progress (2): 338/798 kB | 66/75 kB Progress (2): 354/798 kB | 66/75 kB Progress (2): 354/798 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 375 kB/s) 2024-03-09T14:39:45.635 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-03-09T14:39:45.648 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 370/798 kB Progress (1): 387/798 kB Progress (2): 387/798 kB | 16/780 kB Progress (2): 387/798 kB | 32/780 kB Progress (2): 403/798 kB | 32/780 kB Progress (2): 403/798 kB | 49/780 kB Progress (2): 403/798 kB | 65/780 kB Progress (2): 403/798 kB | 81/780 kB Progress (2): 403/798 kB | 98/780 kB Progress (2): 420/798 kB | 98/780 kB Progress (3): 420/798 kB | 98/780 kB | 16/329 kB Progress (3): 420/798 kB | 98/780 kB | 33/329 kB Progress (3): 420/798 kB | 98/780 kB | 49/329 kB Progress (3): 420/798 kB | 98/780 kB | 66/329 kB Progress (3): 420/798 kB | 114/780 kB | 66/329 kB Progress (3): 420/798 kB | 114/780 kB | 82/329 kB Progress (3): 420/798 kB | 114/780 kB | 98/329 kB Progress (3): 420/798 kB | 114/780 kB | 115/329 kB Progress (3): 420/798 kB | 114/780 kB | 131/329 kB Progress (3): 420/798 kB | 114/780 kB | 147/329 kB Progress (3): 420/798 kB | 114/780 kB | 164/329 kB Progress (3): 420/798 kB | 114/780 kB | 180/329 kB Progress (3): 436/798 kB | 114/780 kB | 180/329 kB Progress (3): 436/798 kB | 114/780 kB | 197/329 kB Progress (3): 436/798 kB | 131/780 kB | 197/329 kB Progress (3): 436/798 kB | 131/780 kB | 213/329 kB Progress (3): 452/798 kB | 131/780 kB | 213/329 kB Progress (3): 452/798 kB | 131/780 kB | 229/329 kB Progress (3): 452/798 kB | 147/780 kB | 229/329 kB Progress (3): 452/798 kB | 147/780 kB | 246/329 kB Progress (3): 452/798 kB | 147/780 kB | 262/329 kB Progress (3): 452/798 kB | 163/780 kB | 262/329 kB Progress (3): 452/798 kB | 163/780 kB | 279/329 kB Progress (3): 452/798 kB | 180/780 kB | 279/329 kB Progress (3): 452/798 kB | 180/780 kB | 295/329 kB Progress (4): 452/798 kB | 180/780 kB | 295/329 kB | 16/501 kB Progress (4): 452/798 kB | 196/780 kB | 295/329 kB | 16/501 kB Progress (4): 452/798 kB | 196/780 kB | 311/329 kB | 16/501 kB Progress (4): 452/798 kB | 196/780 kB | 311/329 kB | 32/501 kB Progress (4): 452/798 kB | 196/780 kB | 328/329 kB | 32/501 kB Progress (4): 452/798 kB | 212/780 kB | 328/329 kB | 32/501 kB Progress (4): 452/798 kB | 212/780 kB | 329 kB | 32/501 kB Progress (4): 452/798 kB | 212/780 kB | 329 kB | 49/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.5 MB/s) 2024-03-09T14:39:45.648 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-03-09T14:39:45.667 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 452/798 kB | 212/780 kB | 65/501 kB Progress (3): 469/798 kB | 212/780 kB | 65/501 kB Progress (3): 469/798 kB | 212/780 kB | 81/501 kB Progress (3): 469/798 kB | 212/780 kB | 98/501 kB Progress (3): 469/798 kB | 212/780 kB | 114/501 kB Progress (3): 485/798 kB | 212/780 kB | 114/501 kB Progress (3): 485/798 kB | 212/780 kB | 131/501 kB Progress (3): 502/798 kB | 212/780 kB | 131/501 kB Progress (3): 502/798 kB | 212/780 kB | 147/501 kB Progress (4): 502/798 kB | 212/780 kB | 147/501 kB | 16/354 kB Progress (4): 502/798 kB | 229/780 kB | 147/501 kB | 16/354 kB Progress (4): 502/798 kB | 245/780 kB | 147/501 kB | 16/354 kB Progress (4): 518/798 kB | 245/780 kB | 147/501 kB | 16/354 kB Progress (4): 518/798 kB | 262/780 kB | 147/501 kB | 16/354 kB Progress (4): 518/798 kB | 262/780 kB | 147/501 kB | 33/354 kB Progress (4): 518/798 kB | 278/780 kB | 147/501 kB | 33/354 kB Progress (4): 518/798 kB | 278/780 kB | 147/501 kB | 49/354 kB Progress (4): 534/798 kB | 278/780 kB | 147/501 kB | 49/354 kB Progress (4): 534/798 kB | 294/780 kB | 147/501 kB | 49/354 kB Progress (4): 534/798 kB | 294/780 kB | 147/501 kB | 66/354 kB Progress (4): 534/798 kB | 311/780 kB | 147/501 kB | 66/354 kB Progress (4): 534/798 kB | 327/780 kB | 147/501 kB | 66/354 kB Progress (4): 534/798 kB | 327/780 kB | 147/501 kB | 82/354 kB Progress (4): 534/798 kB | 344/780 kB | 147/501 kB | 82/354 kB Progress (4): 534/798 kB | 344/780 kB | 147/501 kB | 98/354 kB Progress (4): 534/798 kB | 360/780 kB | 147/501 kB | 98/354 kB Progress (4): 534/798 kB | 360/780 kB | 147/501 kB | 115/354 kB Progress (4): 534/798 kB | 376/780 kB | 147/501 kB | 115/354 kB Progress (4): 534/798 kB | 376/780 kB | 147/501 kB | 131/354 kB Progress (4): 534/798 kB | 393/780 kB | 147/501 kB | 131/354 kB Progress (4): 534/798 kB | 402/780 kB | 147/501 kB | 131/354 kB Progress (4): 534/798 kB | 402/780 kB | 147/501 kB | 147/354 kB Progress (4): 534/798 kB | 418/780 kB | 147/501 kB | 147/354 kB Progress (4): 551/798 kB | 418/780 kB | 147/501 kB | 147/354 kB Progress (4): 551/798 kB | 435/780 kB | 147/501 kB | 147/354 kB Progress (4): 551/798 kB | 435/780 kB | 163/501 kB | 147/354 kB Progress (4): 551/798 kB | 451/780 kB | 163/501 kB | 147/354 kB Progress (4): 551/798 kB | 451/780 kB | 180/501 kB | 147/354 kB Progress (4): 551/798 kB | 468/780 kB | 180/501 kB | 147/354 kB Progress (4): 567/798 kB | 468/780 kB | 180/501 kB | 147/354 kB Progress (4): 567/798 kB | 484/780 kB | 180/501 kB | 147/354 kB Progress (4): 567/798 kB | 484/780 kB | 196/501 kB | 147/354 kB Progress (4): 567/798 kB | 500/780 kB | 196/501 kB | 147/354 kB Progress (4): 567/798 kB | 500/780 kB | 212/501 kB | 147/354 kB Progress (4): 567/798 kB | 517/780 kB | 212/501 kB | 147/354 kB Progress (4): 567/798 kB | 517/780 kB | 229/501 kB | 147/354 kB Progress (4): 567/798 kB | 533/780 kB | 229/501 kB | 147/354 kB Progress (4): 583/798 kB | 533/780 kB | 229/501 kB | 147/354 kB Progress (4): 583/798 kB | 549/780 kB | 229/501 kB | 147/354 kB Progress (4): 583/798 kB | 549/780 kB | 245/501 kB | 147/354 kB Progress (4): 583/798 kB | 566/780 kB | 245/501 kB | 147/354 kB Progress (4): 583/798 kB | 566/780 kB | 262/501 kB | 147/354 kB Progress (4): 583/798 kB | 566/780 kB | 278/501 kB | 147/354 kB Progress (4): 583/798 kB | 582/780 kB | 278/501 kB | 147/354 kB Progress (4): 600/798 kB | 582/780 kB | 278/501 kB | 147/354 kB Progress (5): 600/798 kB | 582/780 kB | 278/501 kB | 147/354 kB | 16/41 kB Progress (5): 600/798 kB | 599/780 kB | 278/501 kB | 147/354 kB | 16/41 kB Progress (5): 600/798 kB | 599/780 kB | 294/501 kB | 147/354 kB | 16/41 kB Progress (5): 600/798 kB | 599/780 kB | 294/501 kB | 147/354 kB | 32/41 kB Progress (5): 600/798 kB | 599/780 kB | 294/501 kB | 147/354 kB | 41 kB Progress (5): 600/798 kB | 599/780 kB | 311/501 kB | 147/354 kB | 41 kB Progress (5): 600/798 kB | 615/780 kB | 311/501 kB | 147/354 kB | 41 kB Progress (5): 600/798 kB | 631/780 kB | 311/501 kB | 147/354 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 178 kB/s) 2024-03-09T14:39:45.667 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-03-09T14:39:45.673 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (4): 600/798 kB | 631/780 kB | 327/501 kB | 147/354 kB Progress (4): 600/798 kB | 631/780 kB | 344/501 kB | 147/354 kB Progress (4): 600/798 kB | 648/780 kB | 344/501 kB | 147/354 kB Progress (4): 600/798 kB | 664/780 kB | 344/501 kB | 147/354 kB Progress (4): 600/798 kB | 664/780 kB | 360/501 kB | 147/354 kB Progress (4): 616/798 kB | 664/780 kB | 360/501 kB | 147/354 kB Progress (4): 616/798 kB | 664/780 kB | 360/501 kB | 164/354 kB Progress (4): 616/798 kB | 664/780 kB | 376/501 kB | 164/354 kB Progress (4): 616/798 kB | 681/780 kB | 376/501 kB | 164/354 kB Progress (4): 616/798 kB | 681/780 kB | 393/501 kB | 164/354 kB Progress (4): 616/798 kB | 681/780 kB | 393/501 kB | 180/354 kB Progress (4): 616/798 kB | 681/780 kB | 402/501 kB | 180/354 kB Progress (4): 616/798 kB | 697/780 kB | 402/501 kB | 180/354 kB Progress (4): 616/798 kB | 697/780 kB | 418/501 kB | 180/354 kB Progress (4): 616/798 kB | 697/780 kB | 435/501 kB | 180/354 kB Progress (4): 616/798 kB | 713/780 kB | 435/501 kB | 180/354 kB Progress (4): 616/798 kB | 713/780 kB | 451/501 kB | 180/354 kB Progress (4): 616/798 kB | 730/780 kB | 451/501 kB | 180/354 kB Progress (4): 616/798 kB | 746/780 kB | 451/501 kB | 180/354 kB Progress (4): 616/798 kB | 746/780 kB | 451/501 kB | 197/354 kB Progress (4): 633/798 kB | 746/780 kB | 451/501 kB | 197/354 kB Progress (4): 633/798 kB | 762/780 kB | 451/501 kB | 197/354 kB Progress (4): 633/798 kB | 762/780 kB | 468/501 kB | 197/354 kB Progress (4): 633/798 kB | 762/780 kB | 468/501 kB | 213/354 kB Progress (4): 633/798 kB | 762/780 kB | 484/501 kB | 213/354 kB Progress (4): 633/798 kB | 779/780 kB | 484/501 kB | 213/354 kB Progress (4): 633/798 kB | 779/780 kB | 484/501 kB | 229/354 kB Progress (4): 633/798 kB | 780 kB | 484/501 kB | 229/354 kB Progress (4): 633/798 kB | 780 kB | 484/501 kB | 246/354 kB Progress (4): 649/798 kB | 780 kB | 484/501 kB | 246/354 kB Progress (4): 649/798 kB | 780 kB | 484/501 kB | 262/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 3.3 MB/s) 2024-03-09T14:39:45.673 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-03-09T14:39:45.675 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 649/798 kB | 484/501 kB | 279/354 kB Progress (3): 649/798 kB | 484/501 kB | 295/354 kB Progress (3): 649/798 kB | 484/501 kB | 311/354 kB Progress (3): 649/798 kB | 484/501 kB | 328/354 kB Progress (3): 649/798 kB | 484/501 kB | 344/354 kB Progress (3): 649/798 kB | 484/501 kB | 354 kB Progress (3): 665/798 kB | 484/501 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.5 MB/s) 2024-03-09T14:39:45.675 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-03-09T14:39:45.676 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 665/798 kB | 500/501 kB Progress (2): 665/798 kB | 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.1 MB/s) 2024-03-09T14:39:45.676 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-03-09T14:39:45.683 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 682/798 kB Progress (1): 698/798 kB Progress (1): 715/798 kB Progress (1): 731/798 kB Progress (2): 731/798 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 26 kB/s) 2024-03-09T14:39:45.683 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-03-09T14:39:45.693 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 747/798 kB Progress (1): 764/798 kB Progress (1): 780/798 kB Progress (2): 780/798 kB | 16/586 kB Progress (2): 780/798 kB | 33/586 kB Progress (2): 780/798 kB | 49/586 kB Progress (2): 780/798 kB | 66/586 kB Progress (2): 780/798 kB | 82/586 kB Progress (2): 780/798 kB | 98/586 kB Progress (2): 796/798 kB | 98/586 kB Progress (2): 798 kB | 98/586 kB Progress (2): 798 kB | 115/586 kB Progress (2): 798 kB | 131/586 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 3.1 MB/s) 2024-03-09T14:39:45.693 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-03-09T14:39:45.696 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 147/586 kB Progress (1): 164/586 kB Progress (1): 180/586 kB Progress (1): 197/586 kB Progress (2): 197/586 kB | 16/211 kB Progress (2): 213/586 kB | 16/211 kB Progress (2): 213/586 kB | 33/211 kB Progress (2): 229/586 kB | 33/211 kB Progress (2): 229/586 kB | 49/211 kB Progress (2): 246/586 kB | 49/211 kB Progress (3): 246/586 kB | 49/211 kB | 14 kB Progress (3): 262/586 kB | 49/211 kB | 14 kB Progress (3): 262/586 kB | 66/211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 55 kB/s) 2024-03-09T14:39:45.696 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-03-09T14:39:45.701 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 279/586 kB | 66/211 kB Progress (2): 279/586 kB | 82/211 kB Progress (2): 295/586 kB | 82/211 kB Progress (2): 295/586 kB | 98/211 kB Progress (2): 311/586 kB | 98/211 kB Progress (2): 311/586 kB | 115/211 kB Progress (2): 328/586 kB | 115/211 kB Progress (2): 328/586 kB | 131/211 kB Progress (2): 344/586 kB | 131/211 kB Progress (2): 344/586 kB | 147/211 kB Progress (2): 360/586 kB | 147/211 kB Progress (2): 360/586 kB | 164/211 kB Progress (2): 377/586 kB | 164/211 kB Progress (2): 377/586 kB | 180/211 kB Progress (2): 393/586 kB | 180/211 kB Progress (2): 393/586 kB | 197/211 kB Progress (2): 410/586 kB | 197/211 kB Progress (2): 410/586 kB | 211 kB Progress (2): 426/586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 799 kB/s) 2024-03-09T14:39:45.701 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 426/586 kB | 16/106 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-03-09T14:39:45.703 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 442/586 kB | 16/106 kB Progress (2): 442/586 kB | 33/106 kB Progress (2): 459/586 kB | 33/106 kB Progress (2): 459/586 kB | 49/106 kB Progress (2): 475/586 kB | 49/106 kB Progress (2): 492/586 kB | 49/106 kB Progress (2): 492/586 kB | 66/106 kB Progress (2): 508/586 kB | 66/106 kB Progress (2): 508/586 kB | 82/106 kB Progress (2): 524/586 kB | 82/106 kB Progress (2): 524/586 kB | 98/106 kB Progress (2): 541/586 kB | 98/106 kB Progress (2): 541/586 kB | 106 kB Progress (2): 557/586 kB | 106 kB Progress (2): 573/586 kB | 106 kB Progress (2): 585/586 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 398 kB/s) 2024-03-09T14:39:45.703 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-03-09T14:39:45.704 INFO:tasks.workunit.client.0.smithi099.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.2 MB/s) 2024-03-09T14:39:45.704 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-03-09T14:39:45.710 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 25 kB/s) 2024-03-09T14:39:45.710 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-03-09T14:39:45.717 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 66/245 kB Progress (1): 82/245 kB Progress (1): 98/245 kB Progress (1): 115/245 kB Progress (1): 131/245 kB Progress (1): 147/245 kB Progress (1): 164/245 kB Progress (1): 180/245 kB Progress (1): 197/245 kB Progress (1): 213/245 kB Progress (1): 229/245 kB Progress (1): 245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 871 kB/s) 2024-03-09T14:39:45.717 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-03-09T14:39:45.721 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/205 kB Progress (1): 32/205 kB Progress (1): 49/205 kB Progress (1): 65/205 kB Progress (1): 81/205 kB Progress (1): 98/205 kB Progress (1): 114/205 kB Progress (2): 114/205 kB | 16/16 kB Progress (2): 114/205 kB | 16 kB Progress (2): 130/205 kB | 16 kB Progress (2): 147/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 58 kB/s) 2024-03-09T14:39:45.721 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-03-09T14:39:45.723 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 147/205 kB | 15 kB Progress (2): 163/205 kB | 15 kB Progress (2): 180/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 53 kB/s) 2024-03-09T14:39:45.723 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-03-09T14:39:45.723 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 196/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 714 kB/s) 2024-03-09T14:39:45.723 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-03-09T14:39:45.728 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 22 kB/s) 2024-03-09T14:39:45.733 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 76 kB/s) 2024-03-09T14:39:45.738 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 80 kB/s) 2024-03-09T14:39:45.740 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/17 kB Progress (2): 16/17 kB | 16/184 kB Progress (2): 17 kB | 16/184 kB Progress (2): 17 kB | 32/184 kB Progress (2): 17 kB | 49/184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 57 kB/s) 2024-03-09T14:39:45.743 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 131/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 601 kB/s) 2024-03-09T14:39:45.762 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:39:45.762 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-03-09T14:39:45.769 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-03-09T14:39:45.790 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 324 kB/s) 2024-03-09T14:39:45.790 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-03-09T14:39:45.806 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 300 kB/s) 2024-03-09T14:39:45.808 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-03-09T14:39:45.825 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.4 MB/s) 2024-03-09T14:39:45.830 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-03-09T14:39:45.848 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 792 kB/s) 2024-03-09T14:39:45.854 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-03-09T14:39:45.877 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 66/153 kB Progress (1): 82/153 kB Progress (1): 98/153 kB Progress (1): 115/153 kB Progress (1): 131/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 6.7 MB/s) 2024-03-09T14:39:45.877 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-03-09T14:39:45.901 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 66/215 kB Progress (1): 82/215 kB Progress (1): 98/215 kB Progress (1): 115/215 kB Progress (1): 131/215 kB Progress (1): 147/215 kB Progress (1): 164/215 kB Progress (1): 180/215 kB Progress (1): 197/215 kB Progress (1): 213/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 8.9 MB/s) 2024-03-09T14:39:45.961 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:39:45.962 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-03-09T14:39:45.966 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-03-09T14:39:45.984 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 148 kB/s) 2024-03-09T14:39:45.986 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-03-09T14:39:46.004 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.3 MB/s) 2024-03-09T14:39:46.008 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-03-09T14:39:46.038 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 292 kB/s) 2024-03-09T14:39:46.041 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-03-09T14:39:46.059 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.5 MB/s) 2024-03-09T14:39:46.064 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-03-09T14:39:46.081 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 355 kB/s) 2024-03-09T14:39:46.084 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-03-09T14:39:46.101 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 189 kB/s) 2024-03-09T14:39:46.106 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-03-09T14:39:46.123 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 36 kB/s) 2024-03-09T14:39:46.125 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-03-09T14:39:46.141 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 171 kB/s) 2024-03-09T14:39:46.143 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-03-09T14:39:46.160 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 881 kB/s) 2024-03-09T14:39:46.163 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-03-09T14:39:46.181 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 188 kB/s) 2024-03-09T14:39:46.183 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-03-09T14:39:46.202 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 440 kB/s) 2024-03-09T14:39:46.205 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-03-09T14:39:46.227 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 380 kB/s) 2024-03-09T14:39:46.231 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-03-09T14:39:46.250 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 422 kB/s) 2024-03-09T14:39:46.255 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-03-09T14:39:46.277 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 897 kB/s) 2024-03-09T14:39:46.285 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-03-09T14:39:46.304 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 255 kB/s) 2024-03-09T14:39:46.308 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-03-09T14:39:46.326 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.7 MB/s) 2024-03-09T14:39:46.333 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-03-09T14:39:46.350 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 300 kB/s) 2024-03-09T14:39:46.357 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-03-09T14:39:46.376 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 4.5 MB/s) 2024-03-09T14:39:46.377 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-03-09T14:39:46.377 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-03-09T14:39:46.377 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-03-09T14:39:46.378 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-03-09T14:39:46.378 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-03-09T14:39:46.395 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 499 kB/s) 2024-03-09T14:39:46.395 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-03-09T14:39:46.395 INFO:tasks.workunit.client.0.smithi099.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 139 kB/s) 2024-03-09T14:39:46.395 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-03-09T14:39:46.397 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/55 kB Progress (1): 33/55 kB Progress (1): 49/55 kB Progress (2): 49/55 kB | 16/269 kB Progress (2): 55 kB | 16/269 kB Progress (2): 55 kB | 33/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.7 MB/s) 2024-03-09T14:39:46.399 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 49/269 kB Progress (2): 49/269 kB | 16/41 kB Progress (2): 66/269 kB | 16/41 kB Progress (2): 66/269 kB | 33/41 kB Progress (2): 82/269 kB | 33/41 kB Progress (2): 82/269 kB | 41 kB Progress (2): 98/269 kB | 41 kB Progress (2): 115/269 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 1.9 MB/s) 2024-03-09T14:39:46.406 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 256/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 9.3 MB/s) 2024-03-09T14:39:46.420 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/587 kB Progress (1): 32/587 kB Progress (2): 32/587 kB | 16/327 kB Progress (2): 49/587 kB | 16/327 kB Progress (2): 49/587 kB | 33/327 kB Progress (2): 65/587 kB | 33/327 kB Progress (2): 65/587 kB | 49/327 kB Progress (2): 81/587 kB | 49/327 kB Progress (2): 81/587 kB | 66/327 kB Progress (2): 98/587 kB | 66/327 kB Progress (2): 98/587 kB | 82/327 kB Progress (2): 114/587 kB | 82/327 kB Progress (2): 114/587 kB | 98/327 kB Progress (2): 130/587 kB | 98/327 kB Progress (2): 130/587 kB | 115/327 kB Progress (2): 147/587 kB | 115/327 kB Progress (2): 147/587 kB | 131/327 kB Progress (2): 147/587 kB | 147/327 kB Progress (2): 163/587 kB | 147/327 kB Progress (2): 163/587 kB | 164/327 kB Progress (2): 180/587 kB | 164/327 kB Progress (2): 180/587 kB | 180/327 kB Progress (2): 196/587 kB | 180/327 kB Progress (2): 196/587 kB | 197/327 kB Progress (2): 212/587 kB | 197/327 kB Progress (2): 212/587 kB | 213/327 kB Progress (2): 229/587 kB | 213/327 kB Progress (2): 229/587 kB | 229/327 kB Progress (2): 229/587 kB | 246/327 kB Progress (2): 245/587 kB | 246/327 kB Progress (2): 245/587 kB | 262/327 kB Progress (2): 262/587 kB | 262/327 kB Progress (2): 262/587 kB | 279/327 kB Progress (2): 278/587 kB | 279/327 kB Progress (2): 278/587 kB | 295/327 kB Progress (2): 294/587 kB | 295/327 kB Progress (2): 294/587 kB | 311/327 kB Progress (2): 294/587 kB | 327 kB Progress (2): 311/587 kB | 327 kB Progress (2): 327/587 kB | 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 7.8 MB/s) 2024-03-09T14:39:46.428 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 343/587 kB Progress (1): 360/587 kB Progress (1): 376/587 kB Progress (1): 393/587 kB Progress (1): 402/587 kB Progress (1): 418/587 kB Progress (1): 435/587 kB Progress (1): 451/587 kB Progress (1): 468/587 kB Progress (1): 484/587 kB Progress (1): 500/587 kB Progress (1): 517/587 kB Progress (1): 533/587 kB Progress (1): 549/587 kB Progress (1): 566/587 kB Progress (1): 582/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 12 MB/s) 2024-03-09T14:39:46.471 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-03-09T14:39:46.472 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:39:46.472 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-03-09T14:39:46.477 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-03-09T14:39:46.495 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 279 kB/s) 2024-03-09T14:39:46.497 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-03-09T14:39:46.515 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 374 kB/s) 2024-03-09T14:39:46.517 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-03-09T14:39:46.535 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/33 kB Progress (1): 32/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 1.7 MB/s) 2024-03-09T14:39:46.538 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-03-09T14:39:46.555 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 822 kB/s) 2024-03-09T14:39:46.559 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-03-09T14:39:46.576 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 48 kB/s) 2024-03-09T14:39:46.579 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-03-09T14:39:46.596 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 236 kB/s) 2024-03-09T14:39:46.599 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-03-09T14:39:46.617 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 961 kB/s) 2024-03-09T14:39:46.621 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-03-09T14:39:46.639 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 276 kB/s) 2024-03-09T14:39:46.642 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-03-09T14:39:46.660 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 230 kB/s) 2024-03-09T14:39:46.664 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-03-09T14:39:46.684 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 113 kB/s) 2024-03-09T14:39:46.687 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-03-09T14:39:46.705 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 627 kB/s) 2024-03-09T14:39:46.708 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-03-09T14:39:46.728 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 862 kB/s) 2024-03-09T14:39:46.731 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-03-09T14:39:46.748 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 365 kB/s) 2024-03-09T14:39:46.751 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-03-09T14:39:46.770 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 59 kB/s) 2024-03-09T14:39:46.772 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-03-09T14:39:46.790 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 466 kB/s) 2024-03-09T14:39:46.792 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-03-09T14:39:46.811 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 141 kB/s) 2024-03-09T14:39:46.814 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-03-09T14:39:46.831 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 331 kB/s) 2024-03-09T14:39:46.835 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-03-09T14:39:46.853 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 63 kB/s) 2024-03-09T14:39:46.857 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-03-09T14:39:46.874 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 45 kB/s) 2024-03-09T14:39:46.876 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-03-09T14:39:46.895 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 318 kB/s) 2024-03-09T14:39:46.898 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-03-09T14:39:46.918 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.3 MB/s) 2024-03-09T14:39:46.924 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-03-09T14:39:46.942 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 67 kB/s) 2024-03-09T14:39:46.946 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-03-09T14:39:46.965 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 74 kB/s) 2024-03-09T14:39:46.978 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-03-09T14:39:46.996 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 752 kB/s) 2024-03-09T14:39:46.997 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-03-09T14:39:46.997 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-03-09T14:39:46.998 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-03-09T14:39:46.998 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-03-09T14:39:46.998 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-03-09T14:39:47.016 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/55 kB Progress (3): 4.2 kB | 16/55 kB | 16/122 kB Progress (3): 4.2 kB | 33/55 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 222 kB/s) 2024-03-09T14:39:47.016 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-03-09T14:39:47.018 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 33/55 kB | 16/122 kB | 16/334 kB Progress (3): 49/55 kB | 16/122 kB | 16/334 kB Progress (3): 49/55 kB | 16/122 kB | 33/334 kB Progress (3): 55 kB | 16/122 kB | 33/334 kB Progress (3): 55 kB | 16/122 kB | 49/334 kB Progress (3): 55 kB | 16/122 kB | 66/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 2.7 MB/s) 2024-03-09T14:39:47.018 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 16/122 kB | 82/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-03-09T14:39:47.021 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 16/122 kB | 98/334 kB Progress (2): 16/122 kB | 115/334 kB Progress (2): 16/122 kB | 131/334 kB Progress (2): 33/122 kB | 131/334 kB Progress (2): 33/122 kB | 147/334 kB Progress (2): 49/122 kB | 147/334 kB Progress (2): 49/122 kB | 164/334 kB Progress (3): 49/122 kB | 164/334 kB | 16/27 kB Progress (3): 49/122 kB | 180/334 kB | 16/27 kB Progress (3): 49/122 kB | 180/334 kB | 27 kB Progress (3): 49/122 kB | 197/334 kB | 27 kB Progress (3): 66/122 kB | 197/334 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.2 MB/s) 2024-03-09T14:39:47.021 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 66/122 kB | 213/334 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-03-09T14:39:47.024 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 66/122 kB | 229/334 kB Progress (2): 66/122 kB | 246/334 kB Progress (2): 66/122 kB | 262/334 kB Progress (2): 82/122 kB | 262/334 kB Progress (2): 82/122 kB | 279/334 kB Progress (2): 82/122 kB | 295/334 kB Progress (2): 82/122 kB | 311/334 kB Progress (2): 82/122 kB | 328/334 kB Progress (2): 82/122 kB | 334 kB Progress (2): 98/122 kB | 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 12 MB/s) 2024-03-09T14:39:47.030 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 115/122 kB Progress (1): 122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 3.6 MB/s) 2024-03-09T14:39:47.035 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (1): 66/267 kB Progress (2): 66/267 kB | 4.7 kB Progress (2): 82/267 kB | 4.7 kB Progress (2): 98/267 kB | 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 126 kB/s) 2024-03-09T14:39:47.040 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (2): 229/267 kB | 16/23 kB Progress (2): 246/267 kB | 16/23 kB Progress (2): 246/267 kB | 23 kB Progress (2): 262/267 kB | 23 kB Progress (2): 267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 570 kB/s) 2024-03-09T14:39:47.040 INFO:tasks.workunit.client.0.smithi099.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 6.5 MB/s) 2024-03-09T14:39:47.193 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Changes detected - recompiling the module! :source 2024-03-09T14:39:47.195 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-03-09T14:39:48.346 INFO:tasks.workunit.client.0.smithi099.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-03-09T14:39:48.346 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:39:48.346 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-03-09T14:39:48.350 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-03-09T14:39:48.350 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:39:48.350 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-03-09T14:39:48.357 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-03-09T14:39:48.358 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-03-09T14:39:48.536 INFO:tasks.workunit.client.0.smithi099.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-03-09T14:39:48.536 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:39:48.536 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-03-09T14:39:48.540 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-03-09T14:39:48.558 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 347 kB/s) 2024-03-09T14:39:48.561 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-03-09T14:39:48.578 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 208 kB/s) 2024-03-09T14:39:48.582 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-03-09T14:39:48.599 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 181 kB/s) 2024-03-09T14:39:48.603 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-03-09T14:39:48.620 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 226 kB/s) 2024-03-09T14:39:48.624 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-03-09T14:39:48.641 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 194 kB/s) 2024-03-09T14:39:48.644 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-03-09T14:39:48.662 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 262 kB/s) 2024-03-09T14:39:48.666 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-03-09T14:39:48.683 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 104 kB/s) 2024-03-09T14:39:48.686 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-03-09T14:39:48.704 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 129 kB/s) 2024-03-09T14:39:48.706 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-03-09T14:39:48.724 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.7 MB/s) 2024-03-09T14:39:48.728 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-03-09T14:39:48.745 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 112 kB/s) 2024-03-09T14:39:48.749 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-03-09T14:39:48.767 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 322 kB/s) 2024-03-09T14:39:48.772 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-03-09T14:39:48.790 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 130 kB/s) 2024-03-09T14:39:48.792 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-03-09T14:39:48.811 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.2 MB/s) 2024-03-09T14:39:48.815 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-03-09T14:39:48.833 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/37 kB Progress (1): 32/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.1 MB/s) 2024-03-09T14:39:48.837 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-03-09T14:39:48.855 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 802 kB/s) 2024-03-09T14:39:48.861 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-03-09T14:39:48.880 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 456 kB/s) 2024-03-09T14:39:48.885 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-03-09T14:39:48.904 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.4 MB/s) 2024-03-09T14:39:48.910 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-03-09T14:39:48.928 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 448 kB/s) 2024-03-09T14:39:48.935 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-03-09T14:39:48.954 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 114 kB/s) 2024-03-09T14:39:48.960 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-03-09T14:39:48.977 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 153 kB/s) 2024-03-09T14:39:48.984 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-03-09T14:39:49.001 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 91 kB/s) 2024-03-09T14:39:49.004 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-03-09T14:39:49.022 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 170 kB/s) 2024-03-09T14:39:49.025 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-03-09T14:39:49.043 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.1 MB/s) 2024-03-09T14:39:49.047 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-03-09T14:39:49.066 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 356 kB/s) 2024-03-09T14:39:49.070 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-03-09T14:39:49.089 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 678 kB/s) 2024-03-09T14:39:49.095 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-03-09T14:39:49.113 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 156 kB/s) 2024-03-09T14:39:49.117 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-03-09T14:39:49.136 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 358 kB/s) 2024-03-09T14:39:49.139 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-03-09T14:39:49.157 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 442 kB/s) 2024-03-09T14:39:49.163 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-03-09T14:39:49.182 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 115 kB/s) 2024-03-09T14:39:49.186 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-03-09T14:39:49.205 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 124 kB/s) 2024-03-09T14:39:49.213 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-03-09T14:39:49.231 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 168 kB/s) 2024-03-09T14:39:49.238 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-03-09T14:39:49.257 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 788 kB/s) 2024-03-09T14:39:49.261 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-03-09T14:39:49.281 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 725 kB/s) 2024-03-09T14:39:49.289 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-03-09T14:39:49.307 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 707 kB/s) 2024-03-09T14:39:49.311 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-03-09T14:39:49.330 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 266 kB/s) 2024-03-09T14:39:49.334 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-03-09T14:39:49.352 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 349 kB/s) 2024-03-09T14:39:49.356 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-03-09T14:39:49.376 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.6 MB/s) 2024-03-09T14:39:49.382 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-03-09T14:39:49.401 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 913 kB/s) 2024-03-09T14:39:49.405 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-03-09T14:39:49.426 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 705 kB/s) 2024-03-09T14:39:49.432 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-03-09T14:39:49.451 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 39 kB/s) 2024-03-09T14:39:49.455 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-03-09T14:39:49.478 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 240 kB/s) 2024-03-09T14:39:49.480 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-03-09T14:39:49.500 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 396 kB/s) 2024-03-09T14:39:49.505 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-03-09T14:39:49.530 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 120 kB/s) 2024-03-09T14:39:49.537 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-03-09T14:39:49.555 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 236 kB/s) 2024-03-09T14:39:49.562 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-03-09T14:39:49.581 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 108 kB/s) 2024-03-09T14:39:49.588 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-03-09T14:39:49.607 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 183 kB/s) 2024-03-09T14:39:49.616 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-03-09T14:39:49.634 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 576 kB/s) 2024-03-09T14:39:49.640 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-03-09T14:39:49.665 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 539 kB/s) 2024-03-09T14:39:49.669 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-03-09T14:39:49.688 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 986 kB/s) 2024-03-09T14:39:49.693 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-03-09T14:39:49.712 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 19 kB/s) 2024-03-09T14:39:49.716 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-03-09T14:39:49.735 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 321 kB/s) 2024-03-09T14:39:49.739 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-03-09T14:39:49.757 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 408 kB/s) 2024-03-09T14:39:49.760 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-03-09T14:39:49.780 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 254 kB/s) 2024-03-09T14:39:49.785 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-03-09T14:39:49.803 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 406 kB/s) 2024-03-09T14:39:49.809 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-03-09T14:39:49.829 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.1 MB/s) 2024-03-09T14:39:49.834 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-03-09T14:39:49.857 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 3.4 MB/s) 2024-03-09T14:39:49.867 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-03-09T14:39:49.888 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.1 MB/s) 2024-03-09T14:39:49.895 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-03-09T14:39:49.915 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 269 kB/s) 2024-03-09T14:39:49.920 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-03-09T14:39:49.938 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 237 kB/s) 2024-03-09T14:39:49.943 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-03-09T14:39:49.961 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 177 kB/s) 2024-03-09T14:39:49.964 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-03-09T14:39:49.984 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.4 MB/s) 2024-03-09T14:39:49.990 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-03-09T14:39:50.008 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 125 kB/s) 2024-03-09T14:39:50.024 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-03-09T14:39:50.057 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 115/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 164/308 kB Progress (1): 180/308 kB Progress (1): 197/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 246/308 kB Progress (1): 256/308 kB Progress (1): 272/308 kB Progress (1): 289/308 kB Progress (1): 305/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 9.3 MB/s) 2024-03-09T14:39:50.057 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-03-09T14:39:50.058 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-03-09T14:39:50.058 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-03-09T14:39:50.058 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-03-09T14:39:50.059 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-03-09T14:39:50.077 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 14 kB Progress (2): 14 kB | 16/171 kB Progress (2): 14 kB | 32/171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 679 kB/s) 2024-03-09T14:39:50.077 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 32/171 kB | 8.2 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-03-09T14:39:50.078 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 49/171 kB | 8.2 kB Progress (2): 65/171 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 409 kB/s) 2024-03-09T14:39:50.078 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-03-09T14:39:50.080 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 65/171 kB | 16/118 kB Progress (2): 81/171 kB | 16/118 kB Progress (3): 81/171 kB | 16/118 kB | 16/26 kB Progress (3): 81/171 kB | 33/118 kB | 16/26 kB Progress (3): 98/171 kB | 33/118 kB | 16/26 kB Progress (3): 114/171 kB | 33/118 kB | 16/26 kB Progress (3): 114/171 kB | 49/118 kB | 16/26 kB Progress (3): 114/171 kB | 49/118 kB | 26 kB Progress (3): 130/171 kB | 49/118 kB | 26 kB Progress (3): 130/171 kB | 66/118 kB | 26 kB Progress (3): 147/171 kB | 66/118 kB | 26 kB Progress (3): 147/171 kB | 82/118 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.2 MB/s) 2024-03-09T14:39:50.081 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-03-09T14:39:50.082 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 163/171 kB | 82/118 kB Progress (2): 163/171 kB | 98/118 kB Progress (2): 171 kB | 98/118 kB Progress (2): 171 kB | 115/118 kB Progress (2): 171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 6.8 MB/s) 2024-03-09T14:39:50.082 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-03-09T14:39:50.082 INFO:tasks.workunit.client.0.smithi099.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 4.9 MB/s) 2024-03-09T14:39:50.082 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-03-09T14:39:50.097 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/146 kB Progress (1): 33/146 kB Progress (1): 49/146 kB Progress (1): 66/146 kB Progress (1): 82/146 kB Progress (1): 98/146 kB Progress (2): 98/146 kB | 16/136 kB Progress (2): 115/146 kB | 16/136 kB Progress (2): 115/146 kB | 33/136 kB Progress (2): 131/146 kB | 33/136 kB Progress (2): 131/146 kB | 49/136 kB Progress (2): 146 kB | 49/136 kB Progress (2): 146 kB | 66/136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.8 MB/s) 2024-03-09T14:39:50.098 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 82/136 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-03-09T14:39:50.099 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 98/136 kB Progress (2): 98/136 kB | 16/61 kB Progress (2): 115/136 kB | 16/61 kB Progress (2): 131/136 kB | 16/61 kB Progress (2): 136 kB | 16/61 kB Progress (3): 136 kB | 16/61 kB | 16/58 kB Progress (3): 136 kB | 16/61 kB | 33/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.4 MB/s) 2024-03-09T14:39:50.100 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-03-09T14:39:50.101 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 16/61 kB | 33/58 kB | 16/501 kB Progress (3): 16/61 kB | 49/58 kB | 16/501 kB Progress (3): 16/61 kB | 49/58 kB | 33/501 kB Progress (3): 16/61 kB | 58 kB | 33/501 kB Progress (3): 16/61 kB | 58 kB | 49/501 kB Progress (3): 16/61 kB | 58 kB | 66/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.4 MB/s) 2024-03-09T14:39:50.104 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 33/61 kB | 66/501 kB Progress (2): 33/61 kB | 82/501 kB Progress (2): 33/61 kB | 98/501 kB Progress (2): 33/61 kB | 115/501 kB Progress (2): 33/61 kB | 131/501 kB Progress (2): 33/61 kB | 147/501 kB Progress (2): 33/61 kB | 164/501 kB Progress (2): 49/61 kB | 164/501 kB Progress (2): 49/61 kB | 180/501 kB Progress (2): 61 kB | 180/501 kB Progress (2): 61 kB | 197/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.4 MB/s) 2024-03-09T14:39:50.114 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 213/501 kB Progress (1): 229/501 kB Progress (1): 246/501 kB Progress (1): 262/501 kB Progress (1): 279/501 kB Progress (1): 295/501 kB Progress (1): 311/501 kB Progress (1): 328/501 kB Progress (1): 344/501 kB Progress (1): 360/501 kB Progress (1): 377/501 kB Progress (1): 393/501 kB Progress (1): 410/501 kB Progress (1): 426/501 kB Progress (1): 442/501 kB Progress (1): 459/501 kB Progress (1): 475/501 kB Progress (1): 492/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 9.1 MB/s) 2024-03-09T14:39:50.131 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (2): 0.4/2.4 MB | 16/124 kB Progress (2): 0.5/2.4 MB | 16/124 kB Progress (2): 0.5/2.4 MB | 33/124 kB Progress (2): 0.5/2.4 MB | 33/124 kB Progress (2): 0.5/2.4 MB | 49/124 kB Progress (2): 0.5/2.4 MB | 49/124 kB Progress (2): 0.5/2.4 MB | 66/124 kB Progress (2): 0.5/2.4 MB | 82/124 kB Progress (2): 0.5/2.4 MB | 82/124 kB Progress (2): 0.5/2.4 MB | 98/124 kB Progress (2): 0.5/2.4 MB | 98/124 kB Progress (2): 0.5/2.4 MB | 115/124 kB Progress (2): 0.5/2.4 MB | 115/124 kB Progress (2): 0.5/2.4 MB | 124 kB Progress (2): 0.6/2.4 MB | 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 1.7 MB/s) 2024-03-09T14:39:50.171 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 22 MB/s) 2024-03-09T14:39:50.303 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:39:50.303 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-03-09T14:39:50.307 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-03-09T14:39:50.325 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 249 kB/s) 2024-03-09T14:39:50.328 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-03-09T14:39:50.345 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 272 kB/s) 2024-03-09T14:39:50.347 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-03-09T14:39:50.366 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.5 MB/s) 2024-03-09T14:39:50.369 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-03-09T14:39:50.387 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.1 MB/s) 2024-03-09T14:39:50.392 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-03-09T14:39:50.409 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 305 kB/s) 2024-03-09T14:39:50.413 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-03-09T14:39:50.430 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 218 kB/s) 2024-03-09T14:39:50.434 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-03-09T14:39:50.452 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 334 kB/s) 2024-03-09T14:39:50.456 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-03-09T14:39:50.474 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 348 kB/s) 2024-03-09T14:39:50.477 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-03-09T14:39:50.498 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 984 kB/s) 2024-03-09T14:39:50.502 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-03-09T14:39:50.519 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 808 kB/s) 2024-03-09T14:39:50.522 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-03-09T14:39:50.540 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 114 kB/s) 2024-03-09T14:39:50.542 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-03-09T14:39:50.559 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 456 kB/s) 2024-03-09T14:39:50.561 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-03-09T14:39:50.579 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.5 MB/s) 2024-03-09T14:39:50.586 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-03-09T14:39:50.604 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 1.9 MB/s) 2024-03-09T14:39:50.605 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-03-09T14:39:50.605 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-03-09T14:39:50.605 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-03-09T14:39:50.606 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-03-09T14:39:50.606 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-03-09T14:39:50.626 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/79 kB Progress (2): 16/79 kB | 16/211 kB Progress (2): 33/79 kB | 16/211 kB Progress (2): 33/79 kB | 33/211 kB Progress (2): 49/79 kB | 33/211 kB Progress (2): 49/79 kB | 49/211 kB Progress (2): 66/79 kB | 49/211 kB Progress (2): 66/79 kB | 62/211 kB Progress (2): 79 kB | 62/211 kB Progress (2): 79 kB | 78/211 kB Progress (2): 79 kB | 95/211 kB Progress (3): 79 kB | 95/211 kB | 16/26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.2 MB/s) 2024-03-09T14:39:50.626 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 111/211 kB | 16/26 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-03-09T14:39:50.626 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 111/211 kB | 26 kB Progress (3): 111/211 kB | 26 kB | 16/58 kB Progress (3): 127/211 kB | 26 kB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.3 MB/s) 2024-03-09T14:39:50.626 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 127/211 kB | 32/58 kB Progress (2): 144/211 kB | 32/58 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-03-09T14:39:50.627 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 144/211 kB | 32/58 kB | 0/1.0 MB Progress (3): 160/211 kB | 32/58 kB | 0/1.0 MB Progress (3): 160/211 kB | 49/58 kB | 0/1.0 MB Progress (3): 176/211 kB | 49/58 kB | 0/1.0 MB Progress (3): 176/211 kB | 58 kB | 0/1.0 MB Progress (3): 193/211 kB | 58 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 2.8 MB/s) 2024-03-09T14:39:50.627 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 209/211 kB | 0/1.0 MB Progress (2): 209/211 kB | 0/1.0 MB Progress (2): 211 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 9.6 MB/s) 2024-03-09T14:39:50.643 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 0/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (2): 0.1/1.0 MB | 16/116 kB Progress (2): 0.1/1.0 MB | 33/116 kB Progress (2): 0.1/1.0 MB | 49/116 kB Progress (2): 0.1/1.0 MB | 66/116 kB Progress (2): 0.1/1.0 MB | 82/116 kB Progress (2): 0.1/1.0 MB | 82/116 kB Progress (2): 0.1/1.0 MB | 98/116 kB Progress (2): 0.1/1.0 MB | 115/116 kB Progress (2): 0.1/1.0 MB | 116 kB Progress (3): 0.1/1.0 MB | 116 kB | 16/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.1 MB/s) 2024-03-09T14:39:50.650 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 0.1/1.0 MB | 33/267 kB Progress (2): 0.1/1.0 MB | 49/267 kB Progress (2): 0.1/1.0 MB | 66/267 kB Progress (2): 0.1/1.0 MB | 82/267 kB Progress (2): 0.1/1.0 MB | 98/267 kB Progress (2): 0.2/1.0 MB | 98/267 kB Progress (2): 0.2/1.0 MB | 115/267 kB Progress (2): 0.2/1.0 MB | 115/267 kB Progress (2): 0.2/1.0 MB | 131/267 kB Progress (2): 0.2/1.0 MB | 131/267 kB Progress (2): 0.2/1.0 MB | 147/267 kB Progress (2): 0.2/1.0 MB | 164/267 kB Progress (2): 0.2/1.0 MB | 180/267 kB Progress (2): 0.2/1.0 MB | 197/267 kB Progress (2): 0.2/1.0 MB | 197/267 kB Progress (2): 0.2/1.0 MB | 213/267 kB Progress (2): 0.2/1.0 MB | 229/267 kB Progress (2): 0.2/1.0 MB | 246/267 kB Progress (2): 0.2/1.0 MB | 256/267 kB Progress (2): 0.2/1.0 MB | 267 kB Progress (2): 0.2/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 5.9 MB/s) 2024-03-09T14:39:50.750 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 7.0 MB/s) 2024-03-09T14:39:50.946 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-03-09T14:39:50.983 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:39:50.983 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] BUILD SUCCESS 2024-03-09T14:39:50.983 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:39:50.984 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Total time: 8.561 s 2024-03-09T14:39:50.984 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Finished at: 2024-03-09T14:39:50Z 2024-03-09T14:39:50.984 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:39:51.023 INFO:tasks.workunit.client.0.smithi099.stderr:+ ./mvnw test -Dtest=PutObjects 2024-03-09T14:39:51.028 INFO:tasks.workunit.client.0.smithi099.stdout:Warning: JAVA_HOME environment variable is not set. 2024-03-09T14:39:52.142 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Scanning for projects... 2024-03-09T14:39:52.235 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:39:52.235 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-03-09T14:39:52.236 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Building jcksum 1.0 2024-03-09T14:39:52.236 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] from pom.xml 2024-03-09T14:39:52.236 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-03-09T14:39:52.499 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:39:52.499 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-03-09T14:39:52.623 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-03-09T14:39:52.624 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:39:52.624 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-03-09T14:39:52.723 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Nothing to compile - all classes are up to date 2024-03-09T14:39:52.724 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:39:52.724 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-03-09T14:39:52.726 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-03-09T14:39:52.726 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:39:52.726 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-03-09T14:39:52.730 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Nothing to compile - all classes are up to date 2024-03-09T14:39:52.730 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:39:52.731 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-03-09T14:39:52.930 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-03-09T14:39:53.135 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-03-09T14:39:53.334 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-03-09T14:39:53.342 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-03-09T14:39:53.361 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 131 kB/s) 2024-03-09T14:39:53.367 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-03-09T14:39:53.386 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 148 kB/s) 2024-03-09T14:39:53.391 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-03-09T14:39:53.409 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 159 kB/s) 2024-03-09T14:39:53.412 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-03-09T14:39:53.431 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 169 kB/s) 2024-03-09T14:39:53.434 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-03-09T14:39:53.452 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 89 kB/s) 2024-03-09T14:39:53.455 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-03-09T14:39:53.474 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 149 kB/s) 2024-03-09T14:39:53.480 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-03-09T14:39:53.505 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.1 MB/s) 2024-03-09T14:39:53.506 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-03-09T14:39:53.507 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-03-09T14:39:53.507 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-03-09T14:39:53.508 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-03-09T14:39:53.509 INFO:tasks.workunit.client.0.smithi099.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-03-09T14:39:53.533 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 650 kB/s) 2024-03-09T14:39:53.571 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 1.4/189 kB Progress (2): 1.4/189 kB | 1.4/7.7 kB Progress (2): 2.8/189 kB | 1.4/7.7 kB Progress (2): 2.8/189 kB | 2.8/7.7 kB Progress (2): 4.1/189 kB | 2.8/7.7 kB Progress (2): 4.1/189 kB | 4.1/7.7 kB Progress (2): 5.5/189 kB | 4.1/7.7 kB Progress (2): 5.5/189 kB | 5.5/7.7 kB Progress (2): 6.9/189 kB | 5.5/7.7 kB Progress (3): 6.9/189 kB | 5.5/7.7 kB | 16/103 kB Progress (3): 8.3/189 kB | 5.5/7.7 kB | 16/103 kB Progress (3): 8.3/189 kB | 6.9/7.7 kB | 16/103 kB Progress (3): 9.7/189 kB | 6.9/7.7 kB | 16/103 kB Progress (4): 9.7/189 kB | 6.9/7.7 kB | 16/103 kB | 16/169 kB Progress (4): 9.7/189 kB | 7.7 kB | 16/103 kB | 16/169 kB Progress (4): 11/189 kB | 7.7 kB | 16/103 kB | 16/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 121 kB/s) 2024-03-09T14:39:53.598 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (3): 12/189 kB | 16/103 kB | 16/169 kB Progress (3): 14/189 kB | 16/103 kB | 16/169 kB Progress (3): 14/189 kB | 33/103 kB | 16/169 kB Progress (3): 15/189 kB | 33/103 kB | 16/169 kB Progress (3): 15/189 kB | 33/103 kB | 33/169 kB Progress (3): 17/189 kB | 33/103 kB | 33/169 kB Progress (3): 18/189 kB | 33/103 kB | 33/169 kB Progress (3): 19/189 kB | 33/103 kB | 33/169 kB Progress (3): 21/189 kB | 33/103 kB | 33/169 kB Progress (3): 22/189 kB | 33/103 kB | 33/169 kB Progress (3): 23/189 kB | 33/103 kB | 33/169 kB Progress (3): 25/189 kB | 33/103 kB | 33/169 kB Progress (3): 26/189 kB | 33/103 kB | 33/169 kB Progress (3): 28/189 kB | 33/103 kB | 33/169 kB Progress (3): 29/189 kB | 33/103 kB | 33/169 kB Progress (3): 30/189 kB | 33/103 kB | 33/169 kB Progress (3): 32/189 kB | 33/103 kB | 33/169 kB Progress (3): 33/189 kB | 33/103 kB | 33/169 kB Progress (3): 34/189 kB | 33/103 kB | 33/169 kB Progress (3): 36/189 kB | 33/103 kB | 33/169 kB Progress (3): 37/189 kB | 33/103 kB | 33/169 kB Progress (3): 39/189 kB | 33/103 kB | 33/169 kB Progress (3): 39/189 kB | 33/103 kB | 49/169 kB Progress (3): 40/189 kB | 33/103 kB | 49/169 kB Progress (3): 40/189 kB | 49/103 kB | 49/169 kB Progress (3): 41/189 kB | 49/103 kB | 49/169 kB Progress (3): 41/189 kB | 49/103 kB | 66/169 kB Progress (3): 43/189 kB | 49/103 kB | 66/169 kB Progress (3): 44/189 kB | 49/103 kB | 66/169 kB Progress (3): 44/189 kB | 66/103 kB | 66/169 kB Progress (3): 46/189 kB | 66/103 kB | 66/169 kB Progress (3): 47/189 kB | 66/103 kB | 66/169 kB Progress (3): 48/189 kB | 66/103 kB | 66/169 kB Progress (3): 48/189 kB | 82/103 kB | 66/169 kB Progress (3): 50/189 kB | 82/103 kB | 66/169 kB Progress (3): 51/189 kB | 82/103 kB | 66/169 kB Progress (3): 52/189 kB | 82/103 kB | 66/169 kB Progress (3): 54/189 kB | 82/103 kB | 66/169 kB Progress (3): 55/189 kB | 82/103 kB | 66/169 kB Progress (3): 57/189 kB | 82/103 kB | 66/169 kB Progress (3): 57/189 kB | 82/103 kB | 82/169 kB Progress (3): 57/189 kB | 98/103 kB | 82/169 kB Progress (3): 58/189 kB | 98/103 kB | 82/169 kB Progress (3): 59/189 kB | 98/103 kB | 82/169 kB Progress (3): 61/189 kB | 98/103 kB | 82/169 kB Progress (3): 62/189 kB | 98/103 kB | 82/169 kB Progress (3): 62/189 kB | 103 kB | 82/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-03-09T14:39:53.606 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (2): 62/189 kB | 98/169 kB Progress (2): 78/189 kB | 98/169 kB Progress (2): 78/189 kB | 115/169 kB Progress (2): 95/189 kB | 115/169 kB Progress (2): 95/189 kB | 131/169 kB Progress (2): 111/189 kB | 131/169 kB Progress (2): 111/189 kB | 147/169 kB Progress (2): 111/189 kB | 164/169 kB Progress (2): 127/189 kB | 164/169 kB Progress (2): 127/189 kB | 169 kB Progress (2): 144/189 kB | 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.7 MB/s) 2024-03-09T14:39:53.610 INFO:tasks.workunit.client.0.smithi099.stdout:Progress (1): 160/189 kB Progress (1): 176/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 1.8 MB/s) 2024-03-09T14:39:53.631 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:39:53.631 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ------------------------------------------------------- 2024-03-09T14:39:53.631 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] T E S T S 2024-03-09T14:39:53.631 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ------------------------------------------------------- 2024-03-09T14:39:54.160 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-03-09T14:39:54.272 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjects.java: starting test run: 2024-03-09T14:39:54.272 INFO:tasks.workunit.client.0.smithi099.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-03-09T14:39:54.272 INFO:tasks.workunit.client.0.smithi099.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-03-09T14:39:54.272 INFO:tasks.workunit.client.0.smithi099.stdout: EndpointUrl=https://smithi099.front.sepia.ceph.com:443 2024-03-09T14:39:54.272 INFO:tasks.workunit.client.0.smithi099.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-03-09T14:39:54.370 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Environment Variables Read 2024-03-09T14:39:54.772 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: S3 Client Initialized 2024-03-09T14:39:54.772 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Generating File 2024-03-09T14:39:54.772 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: File Generated 2024-03-09T14:39:54.772 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Generating File 2024-03-09T14:39:54.772 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: File Generated 2024-03-09T14:39:54.772 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Generating File 2024-03-09T14:39:54.872 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: File Generated 2024-03-09T14:39:54.872 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Generating File 2024-03-09T14:39:54.872 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: File Generated 2024-03-09T14:39:54.872 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Generating File 2024-03-09T14:39:54.872 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: File Generated 2024-03-09T14:39:54.872 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Generating File 2024-03-09T14:39:54.872 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: File Generated 2024-03-09T14:39:54.872 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Generated Big Files 2024-03-09T14:39:55.199 INFO:tasks.workunit.client.0.smithi099.stdout:HeadBucketResponse() 2024-03-09T14:39:55.200 INFO:tasks.workunit.client.0.smithi099.stdout:sheik is ready 2024-03-09T14:39:55.200 INFO:tasks.workunit.client.0.smithi099.stdout:DEBUG: Test Bucket Created 2024-03-09T14:39:55.272 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-0b 2024-03-09T14:39:55.372 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-8b 2024-03-09T14:39:55.472 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-200b 2024-03-09T14:39:55.573 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-21983b 2024-03-09T14:39:55.673 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-5519b 2024-03-09T14:39:55.773 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-204329b 2024-03-09T14:39:55.873 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-256k 2024-03-09T14:39:55.973 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-1m 2024-03-09T14:39:56.073 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-03-09T14:39:56.274 INFO:tasks.workunit.client.0.smithi099.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-03-09T14:39:58.881 INFO:tasks.workunit.client.0.smithi099.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-03-09T14:39:59.783 INFO:tasks.workunit.client.0.smithi099.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-03-09T14:40:02.913 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-0b 2024-03-09T14:40:02.914 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-8b 2024-03-09T14:40:02.915 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-200b 2024-03-09T14:40:02.916 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-21983b 2024-03-09T14:40:02.917 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-5519b 2024-03-09T14:40:02.918 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-204329b 2024-03-09T14:40:02.919 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-256k 2024-03-09T14:40:02.921 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-1m 2024-03-09T14:40:02.922 INFO:tasks.workunit.client.0.smithi099.stdout:arg: file-1038757b 2024-03-09T14:40:02.967 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-0b 2024-03-09T14:40:02.967 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-03-09T14:40:02.994 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-8b 2024-03-09T14:40:02.994 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-03-09T14:40:03.091 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-200b 2024-03-09T14:40:03.091 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-03-09T14:40:03.194 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-21983b 2024-03-09T14:40:03.194 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-03-09T14:40:03.286 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-5519b 2024-03-09T14:40:03.286 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-03-09T14:40:03.292 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-204329b 2024-03-09T14:40:03.352 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-03-09T14:40:03.394 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-256k 2024-03-09T14:40:03.410 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-03-09T14:40:03.492 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-1m 2024-03-09T14:40:03.493 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-03-09T14:40:03.593 INFO:tasks.workunit.client.0.smithi099.stdout:putObjectFromFileCksum called with file-1038757b 2024-03-09T14:40:03.593 INFO:tasks.workunit.client.0.smithi099.stdout:PutObjectResponse 2024-03-09T14:40:03.693 INFO:tasks.workunit.client.0.smithi099.stdout:mpuObjectFromFileCksum called with file-5m 2024-03-09T14:40:04.094 INFO:tasks.workunit.client.0.smithi099.stdout:mpuObjectFromFileCksum called with file-10m 2024-03-09T14:40:04.695 INFO:tasks.workunit.client.0.smithi099.stdout:mpuObjectFromFileCksum called with file-100m 2024-03-09T14:40:08.805 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.63 s -- in io.ceph.jcksum.PutObjects 2024-03-09T14:40:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:40:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Results: 2024-03-09T14:40:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:40:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-03-09T14:40:08.834 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] 2024-03-09T14:40:08.836 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:40:08.836 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] BUILD SUCCESS 2024-03-09T14:40:08.836 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:40:08.837 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Total time: 16.717 s 2024-03-09T14:40:08.837 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] Finished at: 2024-03-09T14:40:08Z 2024-03-09T14:40:08.837 INFO:tasks.workunit.client.0.smithi099.stdout:[INFO] ------------------------------------------------------------------------ 2024-03-09T14:40:08.866 INFO:tasks.workunit.client.0.smithi099.stderr:+ exit 2024-03-09T14:40:08.866 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:40:08.866 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:40:08.917 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-03-09T14:40:08.917 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-09T14:40:09.279 DEBUG:teuthology.parallel:result is None 2024-03-09T14:40:09.279 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:40:09.290 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:40:09.290 DEBUG:teuthology.orchestra.run.smithi099:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:40:09.336 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:40:09.336 INFO:teuthology.run_tasks:Running task workunit... 2024-03-09T14:40:09.352 INFO:tasks.workunit:Pulling workunits from ref c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:40:09.352 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-09T14:40:09.353 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:40:09.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:40:09.384 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-09T14:40:09.385 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:40:09.431 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-09T14:40:09.432 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-09T14:40:09.479 INFO:tasks.workunit:timeout=3h 2024-03-09T14:40:09.480 INFO:tasks.workunit:cleanup=True 2024-03-09T14:40:09.480 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:40:09.534 INFO:tasks.workunit.client.0.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-09T14:41:36.283 INFO:tasks.workunit.client.0.smithi099.stderr:Note: switching to 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'. 2024-03-09T14:41:36.284 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:41:36.284 INFO:tasks.workunit.client.0.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-09T14:41:36.284 INFO:tasks.workunit.client.0.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-09T14:41:36.284 INFO:tasks.workunit.client.0.smithi099.stderr:state without impacting any branches by switching back to a branch. 2024-03-09T14:41:36.284 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:41:36.284 INFO:tasks.workunit.client.0.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-09T14:41:36.284 INFO:tasks.workunit.client.0.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-09T14:41:36.284 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:41:36.284 INFO:tasks.workunit.client.0.smithi099.stderr: git switch -c 2024-03-09T14:41:36.285 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:41:36.285 INFO:tasks.workunit.client.0.smithi099.stderr:Or undo this operation with: 2024-03-09T14:41:36.285 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:41:36.285 INFO:tasks.workunit.client.0.smithi099.stderr: git switch - 2024-03-09T14:41:36.285 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:41:36.285 INFO:tasks.workunit.client.0.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-09T14:41:36.285 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:41:36.285 INFO:tasks.workunit.client.0.smithi099.stderr:HEAD is now at c00d9c609fb DNM: point s3tests at branch cbodley:wip-iam-user-apis 2024-03-09T14:41:36.289 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-09T14:41:36.335 INFO:tasks.workunit.client.0.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-09T14:41:36.338 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:41:36.339 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-09T14:41:36.391 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-09T14:41:36.440 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-09T14:41:36.478 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:41:36.479 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:41:36.479 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-09T14:41:36.520 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:41:36.523 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:41:36.523 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-09T14:41:36.570 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-03-09T14:41:36.572 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-03-09T14:41:36.572 DEBUG:teuthology.orchestra.run.smithi099:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-03-09T14:41:36.625 INFO:tasks.workunit.client.0.smithi099.stdout:INFO: fully qualified domain name: smithi099.front.sepia.ceph.com 2024-03-09T14:41:36.625 INFO:tasks.workunit.client.0.smithi099.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-03-09T14:41:36.625 INFO:tasks.workunit.client.0.smithi099.stdout:== TESTING NON-VERSIONED BUCKET == 2024-03-09T14:41:39.965 INFO:tasks.workunit.client.0.smithi099.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-03-09T14:41:40.170 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting pip 2024-03-09T14:41:40.177 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-03-09T14:41:40.214 INFO:tasks.workunit.client.0.smithi099.stdout:Installing collected packages: pip 2024-03-09T14:41:40.215 INFO:tasks.workunit.client.0.smithi099.stdout: Attempting uninstall: pip 2024-03-09T14:41:40.215 INFO:tasks.workunit.client.0.smithi099.stdout: Found existing installation: pip 22.0.2 2024-03-09T14:41:40.473 INFO:tasks.workunit.client.0.smithi099.stdout: Uninstalling pip-22.0.2: 2024-03-09T14:41:40.479 INFO:tasks.workunit.client.0.smithi099.stdout: Successfully uninstalled pip-22.0.2 2024-03-09T14:41:41.417 INFO:tasks.workunit.client.0.smithi099.stdout:Successfully installed pip-24.0 2024-03-09T14:41:42.384 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting boto3 2024-03-09T14:41:42.385 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached boto3-1.34.59-py3-none-any.whl.metadata (6.6 kB) 2024-03-09T14:41:42.940 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting botocore<1.35.0,>=1.34.59 (from boto3) 2024-03-09T14:41:42.941 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached botocore-1.34.59-py3-none-any.whl.metadata (5.7 kB) 2024-03-09T14:41:42.997 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-03-09T14:41:42.998 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-03-09T14:41:43.050 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-03-09T14:41:43.051 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-03-09T14:41:43.113 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:41:43.115 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-03-09T14:41:43.214 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting urllib3<2.1,>=1.25.4 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:41:43.215 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached urllib3-2.0.7-py3-none-any.whl.metadata (6.6 kB) 2024-03-09T14:41:43.415 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:41:43.416 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-03-09T14:41:43.429 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached boto3-1.34.59-py3-none-any.whl (139 kB) 2024-03-09T14:41:43.430 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached botocore-1.34.59-py3-none-any.whl (12.0 MB) 2024-03-09T14:41:43.451 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-03-09T14:41:43.452 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-03-09T14:41:43.453 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-03-09T14:41:43.455 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached urllib3-2.0.7-py3-none-any.whl (124 kB) 2024-03-09T14:41:43.456 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-09T14:41:43.549 INFO:tasks.workunit.client.0.smithi099.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-03-09T14:41:44.660 INFO:tasks.workunit.client.0.smithi099.stdout:Successfully installed boto3-1.34.59 botocore-1.34.59 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.0 six-1.16.0 urllib3-2.0.7 2024-03-09T14:41:44.950 INFO:tasks.workunit.client.0.smithi099.stdout:INFO: creating user 2024-03-09T14:41:45.074 INFO:tasks.workunit.client.0.smithi099.stdout:{ 2024-03-09T14:41:45.075 INFO:tasks.workunit.client.0.smithi099.stdout: "user_id": "testid", 2024-03-09T14:41:45.075 INFO:tasks.workunit.client.0.smithi099.stdout: "display_name": "M. Tester", 2024-03-09T14:41:45.075 INFO:tasks.workunit.client.0.smithi099.stdout: "email": "tester@ceph.com", 2024-03-09T14:41:45.075 INFO:tasks.workunit.client.0.smithi099.stdout: "suspended": 0, 2024-03-09T14:41:45.075 INFO:tasks.workunit.client.0.smithi099.stdout: "max_buckets": 1000, 2024-03-09T14:41:45.075 INFO:tasks.workunit.client.0.smithi099.stdout: "subusers": [], 2024-03-09T14:41:45.075 INFO:tasks.workunit.client.0.smithi099.stdout: "keys": [ 2024-03-09T14:41:45.075 INFO:tasks.workunit.client.0.smithi099.stdout: { 2024-03-09T14:41:45.075 INFO:tasks.workunit.client.0.smithi099.stdout: "user": "testid", 2024-03-09T14:41:45.075 INFO:tasks.workunit.client.0.smithi099.stdout: "access_key": "0555b35654ad1656d804", 2024-03-09T14:41:45.075 INFO:tasks.workunit.client.0.smithi099.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-03-09T14:41:45.075 INFO:tasks.workunit.client.0.smithi099.stdout: "active": true, 2024-03-09T14:41:45.076 INFO:tasks.workunit.client.0.smithi099.stdout: "create_date": "2024-03-09T14:41:45.073443Z" 2024-03-09T14:41:45.076 INFO:tasks.workunit.client.0.smithi099.stdout: } 2024-03-09T14:41:45.076 INFO:tasks.workunit.client.0.smithi099.stdout: ], 2024-03-09T14:41:45.076 INFO:tasks.workunit.client.0.smithi099.stdout: "swift_keys": [], 2024-03-09T14:41:45.076 INFO:tasks.workunit.client.0.smithi099.stdout: "caps": [], 2024-03-09T14:41:45.076 INFO:tasks.workunit.client.0.smithi099.stdout: "op_mask": "read, write, delete", 2024-03-09T14:41:45.076 INFO:tasks.workunit.client.0.smithi099.stdout: "default_placement": "", 2024-03-09T14:41:45.076 INFO:tasks.workunit.client.0.smithi099.stdout: "default_storage_class": "", 2024-03-09T14:41:45.076 INFO:tasks.workunit.client.0.smithi099.stdout: "placement_tags": [], 2024-03-09T14:41:45.076 INFO:tasks.workunit.client.0.smithi099.stdout: "bucket_quota": { 2024-03-09T14:41:45.076 INFO:tasks.workunit.client.0.smithi099.stdout: "enabled": false, 2024-03-09T14:41:45.076 INFO:tasks.workunit.client.0.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:41:45.076 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size": -1, 2024-03-09T14:41:45.077 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:41:45.077 INFO:tasks.workunit.client.0.smithi099.stdout: "max_objects": -1 2024-03-09T14:41:45.077 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:41:45.077 INFO:tasks.workunit.client.0.smithi099.stdout: "user_quota": { 2024-03-09T14:41:45.077 INFO:tasks.workunit.client.0.smithi099.stdout: "enabled": false, 2024-03-09T14:41:45.077 INFO:tasks.workunit.client.0.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:41:45.077 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size": -1, 2024-03-09T14:41:45.077 INFO:tasks.workunit.client.0.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:41:45.077 INFO:tasks.workunit.client.0.smithi099.stdout: "max_objects": -1 2024-03-09T14:41:45.077 INFO:tasks.workunit.client.0.smithi099.stdout: }, 2024-03-09T14:41:45.077 INFO:tasks.workunit.client.0.smithi099.stdout: "temp_url_keys": [], 2024-03-09T14:41:45.077 INFO:tasks.workunit.client.0.smithi099.stdout: "type": "rgw", 2024-03-09T14:41:45.077 INFO:tasks.workunit.client.0.smithi099.stdout: "mfa_ids": [], 2024-03-09T14:41:45.077 INFO:tasks.workunit.client.0.smithi099.stdout: "account_id": "", 2024-03-09T14:41:45.078 INFO:tasks.workunit.client.0.smithi099.stdout: "path": "/", 2024-03-09T14:41:45.078 INFO:tasks.workunit.client.0.smithi099.stdout: "create_date": "2024-03-09T14:41:45.073428Z", 2024-03-09T14:41:45.078 INFO:tasks.workunit.client.0.smithi099.stdout: "tags": [], 2024-03-09T14:41:45.078 INFO:tasks.workunit.client.0.smithi099.stdout: "group_ids": [] 2024-03-09T14:41:45.078 INFO:tasks.workunit.client.0.smithi099.stdout:} 2024-03-09T14:41:45.078 INFO:tasks.workunit.client.0.smithi099.stdout: 2024-03-09T14:41:53.310 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi099.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:41:53.310 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:41:53.356 INFO:tasks.workunit.client.0.smithi099.stderr:5+0 records in 2024-03-09T14:41:53.356 INFO:tasks.workunit.client.0.smithi099.stderr:5+0 records out 2024-03-09T14:41:53.356 INFO:tasks.workunit.client.0.smithi099.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0216041 s, 243 MB/s 2024-03-09T14:41:53.359 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi099.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:41:53.360 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:41:53.440 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi099.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:41:53.440 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:41:53.572 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi099.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:41:53.572 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:41:53.698 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi099.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:41:53.699 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:41:53.840 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi099.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:41:53.840 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:41:53.986 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi099.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:41:53.986 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:41:54.134 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi099.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:41:54.134 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:41:54.269 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi099.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:41:54.270 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:41:54.418 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi099.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:41:54.418 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:41:54.562 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi099.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:41:54.562 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:41:54.702 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi099.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:41:54.702 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:41:54.842 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi099.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:41:54.843 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:41:54.976 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi099.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:41:54.976 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:41:55.119 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi099.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:41:55.119 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:41:55.232 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi099.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:41:55.232 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:41:55.309 INFO:tasks.workunit.client.0.smithi099.stdout:bucket nams is reupload-bkt-107418 2024-03-09T14:41:55.309 INFO:tasks.workunit.client.0.smithi099.stdout:endpoint is https://smithi099.front.sepia.ceph.com:443 2024-03-09T14:41:55.309 INFO:tasks.workunit.client.0.smithi099.stdout:start UploadId=2~CGrkbCDN-1Kq6zK1WRMyU05kq5iAG3N 2024-03-09T14:41:55.309 INFO:tasks.workunit.client.0.smithi099.stdout:phase 1 uploaded part {'ETag': '"27baad8c3df65bc47fb42f65a8d043e0"', 'PartNumber': 1} 2024-03-09T14:41:55.309 INFO:tasks.workunit.client.0.smithi099.stdout:phase 1 uploaded part {'ETag': '"27baad8c3df65bc47fb42f65a8d043e0"', 'PartNumber': 2} 2024-03-09T14:41:55.309 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"27baad8c3df65bc47fb42f65a8d043e0"', 'PartNumber': 1} 2024-03-09T14:41:55.310 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"27baad8c3df65bc47fb42f65a8d043e0"', 'PartNumber': 1} 2024-03-09T14:41:55.310 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"27baad8c3df65bc47fb42f65a8d043e0"', 'PartNumber': 1} 2024-03-09T14:41:55.310 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"27baad8c3df65bc47fb42f65a8d043e0"', 'PartNumber': 1} 2024-03-09T14:41:55.310 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"27baad8c3df65bc47fb42f65a8d043e0"', 'PartNumber': 1} 2024-03-09T14:41:55.310 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"27baad8c3df65bc47fb42f65a8d043e0"', 'PartNumber': 1} 2024-03-09T14:41:55.310 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"27baad8c3df65bc47fb42f65a8d043e0"', 'PartNumber': 1} 2024-03-09T14:41:55.310 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"27baad8c3df65bc47fb42f65a8d043e0"', 'PartNumber': 1} 2024-03-09T14:41:55.310 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"27baad8c3df65bc47fb42f65a8d043e0"', 'PartNumber': 1} 2024-03-09T14:41:55.310 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"27baad8c3df65bc47fb42f65a8d043e0"', 'PartNumber': 1} 2024-03-09T14:41:55.310 INFO:tasks.workunit.client.0.smithi099.stdout:phase 2 uploaded part {'ETag': '"27baad8c3df65bc47fb42f65a8d043e0"', 'PartNumber': 1} 2024-03-09T14:41:55.310 INFO:tasks.workunit.client.0.smithi099.stdout:completing multipart upload, parts=[{'ETag': '"27baad8c3df65bc47fb42f65a8d043e0"', 'PartNumber': 1}, {'ETag': '"27baad8c3df65bc47fb42f65a8d043e0"', 'PartNumber': 2}] 2024-03-09T14:41:57.324 INFO:tasks.workunit.client.0.smithi099.stdout:radosgw-admin bucket radoslist: 2024-03-09T14:41:57.325 INFO:tasks.workunit.client.0.smithi099.stdout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4_mpu_test4 2024-03-09T14:41:57.325 INFO:tasks.workunit.client.0.smithi099.stdout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4__multipart_mpu_test4.2~CGrkbCDN-1Kq6zK1WRMyU05kq5iAG3N.2 2024-03-09T14:41:57.325 INFO:tasks.workunit.client.0.smithi099.stdout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4__multipart_mpu_test4.jtJs-7BrJ1RIGgl0FRJYoMdEmhB7_r2H.1 2024-03-09T14:41:57.411 INFO:tasks.workunit.client.0.smithi099.stdout:rados ls: 2024-03-09T14:41:57.412 INFO:tasks.workunit.client.0.smithi099.stdout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4_mpu_test4 2024-03-09T14:41:57.412 INFO:tasks.workunit.client.0.smithi099.stdout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4__multipart_mpu_test4.2~CGrkbCDN-1Kq6zK1WRMyU05kq5iAG3N.2 2024-03-09T14:41:57.412 INFO:tasks.workunit.client.0.smithi099.stdout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4__multipart_mpu_test4.jtJs-7BrJ1RIGgl0FRJYoMdEmhB7_r2H.1 2024-03-09T14:41:57.435 INFO:tasks.workunit.client.0.smithi099.stdout:== PASSED == 2024-03-09T14:41:57.435 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:41:57.435 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:41:57.488 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-03-09T14:41:57.488 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-09T14:41:57.876 DEBUG:teuthology.parallel:result is None 2024-03-09T14:41:57.877 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:41:57.890 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:41:57.891 DEBUG:teuthology.orchestra.run.smithi099:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:41:57.938 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:41:57.938 INFO:teuthology.run_tasks:Running task ragweed... 2024-03-09T14:41:57.955 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-03-09T14:41:57.956 INFO:tasks.ragweed:Downloading ragweed... 2024-03-09T14:41:57.956 INFO:tasks.ragweed:Using branch 'wip-rgw-account-v3' for ragweed 2024-03-09T14:41:57.956 DEBUG:teuthology.orchestra.run.smithi099:> git clone -b wip-rgw-account-v3 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-03-09T14:41:57.986 INFO:teuthology.orchestra.run.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-03-09T14:41:58.046 INFO:teuthology.orchestra.run.smithi099.stderr:fatal: Remote branch wip-rgw-account-v3 not found in upstream origin 2024-03-09T14:41:58.047 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-03-09T14:41:58.048 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-03-09T14:41:58.049 DEBUG:teuthology.orchestra.run.smithi099:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-03-09T14:41:58.095 INFO:teuthology.orchestra.run.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-03-09T14:41:58.286 INFO:tasks.ragweed:Creating rgw users... 2024-03-09T14:41:58.286 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-03-09T14:41:58.286 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key PZWEELDSVMBTIOBPRRDY --secret Hz6K/6P+CVBvBByn1wqpUSkEzt1QZ1v3rJbOLVcZzvdrbeAyTNoQLQ== --email ragweed.client.0+test@test.test --system false 2024-03-09T14:41:58.376 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:58.376 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:58.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.420+0000 7fb36447c980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.424+0000 7fb36447c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:58.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.424+0000 7fb36447c980 20 realm 2024-03-09T14:41:58.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.424+0000 7fb36447c980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.424+0000 7fb36447c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:58.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.424+0000 7fb36447c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:58.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.424+0000 7fb36447c980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.424+0000 7fb36447c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:58.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.424+0000 7fb36447c980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.424+0000 7fb36447c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:58.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.424+0000 7fb36447c980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.428+0000 7fb36447c980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:58.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.428+0000 7fb36447c980 20 searching for the correct realm 2024-03-09T14:41:58.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.428+0000 7fb362795640 0 -- 172.21.15.99:0/1101802261 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7fb34c0e4bc0 msgr2=0x7fb34c0d6920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:58.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.436+0000 7fb361793640 0 -- 172.21.15.99:0/1101802261 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fb35406d870 msgr2=0x7fb35407a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:58.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.652+0000 7fb36447c980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:41:58.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.652+0000 7fb36447c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:58.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.652+0000 7fb36447c980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:41:58.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.652+0000 7fb36447c980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:58.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.652+0000 7fb36447c980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:58.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.652+0000 7fb36447c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:58.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.652+0000 7fb36447c980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.652+0000 7fb36447c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:58.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.652+0000 7fb36447c980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.652+0000 7fb36447c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:58.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.652+0000 7fb36447c980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.656+0000 7fb36447c980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:58.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.656+0000 7fb36447c980 20 zone default found 2024-03-09T14:41:58.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.656+0000 7fb36447c980 4 Realm: () 2024-03-09T14:41:58.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.656+0000 7fb36447c980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:41:58.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.656+0000 7fb36447c980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:41:58.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.656+0000 7fb36447c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:58.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.656+0000 7fb36447c980 20 zonegroup default 2024-03-09T14:41:58.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.656+0000 7fb36447c980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.656+0000 7fb36447c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:58.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.656+0000 7fb36447c980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.656+0000 7fb36447c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:58.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.656+0000 7fb36447c980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.656+0000 7fb36447c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:58.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.656+0000 7fb36447c980 20 started sync module instance, tier type = 2024-03-09T14:41:58.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.656+0000 7fb36447c980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:41:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.680+0000 7fb36447c980 20 add_watcher() i=0 2024-03-09T14:41:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.680+0000 7fb36447c980 20 add_watcher() i=1 2024-03-09T14:41:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.680+0000 7fb36447c980 20 add_watcher() i=2 2024-03-09T14:41:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.680+0000 7fb36447c980 20 add_watcher() i=3 2024-03-09T14:41:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.680+0000 7fb36447c980 20 add_watcher() i=4 2024-03-09T14:41:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.680+0000 7fb36447c980 20 add_watcher() i=5 2024-03-09T14:41:58.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.680+0000 7fb36447c980 20 add_watcher() i=6 2024-03-09T14:41:58.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.684+0000 7fb36447c980 20 add_watcher() i=7 2024-03-09T14:41:58.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.684+0000 7fb36447c980 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:58.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.688+0000 7fb217fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:58.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.688+0000 7fb36447c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:58.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.688+0000 7fb36447c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:58.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.688+0000 7fb36447c980 5 note: GC not initialized 2024-03-09T14:41:58.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.688+0000 7fb216fe5640 20 reqs_thread_entry: start 2024-03-09T14:41:58.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.688+0000 7fb36447c980 20 init_complete bucket index max shards: 11 2024-03-09T14:41:58.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.688+0000 7fb36447c980 20 Filter name: none 2024-03-09T14:41:58.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.688+0000 7fb214fe1640 20 reqs_thread_entry: start 2024-03-09T14:41:58.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.688+0000 7fb36447c980 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-03-09T14:41:58.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.688+0000 7fb36447c980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.688+0000 7fb36447c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:58.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.688+0000 7fb36447c980 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-03-09T14:41:58.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.688+0000 7fb36447c980 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-09T14:41:58.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.688+0000 7fb36447c980 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-03-09T14:41:58.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.688+0000 7fb36447c980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.692+0000 7fb36447c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:58.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.692+0000 7fb36447c980 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-03-09T14:41:58.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.692+0000 7fb36447c980 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-03-09T14:41:58.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.692+0000 7fb36447c980 10 cache get: name=default.rgw.meta+users.keys+PZWEELDSVMBTIOBPRRDY : miss 2024-03-09T14:41:58.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.692+0000 7fb36447c980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.692+0000 7fb36447c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:58.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.692+0000 7fb36447c980 10 cache put: name=default.rgw.meta+users.keys+PZWEELDSVMBTIOBPRRDY info.flags=0x0 2024-03-09T14:41:58.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.692+0000 7fb36447c980 10 adding default.rgw.meta+users.keys+PZWEELDSVMBTIOBPRRDY to cache LRU end 2024-03-09T14:41:58.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.692+0000 7fb36447c980 10 cache get: name=default.rgw.meta+users.keys+PZWEELDSVMBTIOBPRRDY : hit (negative entry) 2024-03-09T14:41:58.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.692+0000 7fb36447c980 10 cache get: name=default.rgw.meta+users.keys+PZWEELDSVMBTIOBPRRDY : hit (negative entry) 2024-03-09T14:41:58.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.696+0000 7fb36447c980 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-03-09T14:41:58.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.696+0000 7fb36447c980 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-09T14:41:58.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.696+0000 7fb36447c980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-03-09T14:41:58.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.696+0000 7fb2457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725954 cookie 93958541831664 notifier 5645 bl.length()=675 2024-03-09T14:41:58.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.696+0000 7fb2457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-03-09T14:41:58.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.696+0000 7fb2457fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-09T14:41:58.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.700+0000 7fb36447c980 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-03-09T14:41:58.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.700+0000 7fb36447c980 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-03-09T14:41:58.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.700+0000 7fb36447c980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-03-09T14:41:58.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.700+0000 7fb2457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725893 cookie 93958541824512 notifier 5645 bl.length()=202 2024-03-09T14:41:58.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.700+0000 7fb2457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-03-09T14:41:58.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.700+0000 7fb2457fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-03-09T14:41:58.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.704+0000 7fb36447c980 10 cache put: name=default.rgw.meta+users.keys+PZWEELDSVMBTIOBPRRDY info.flags=0x7 2024-03-09T14:41:58.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.704+0000 7fb36447c980 10 moving default.rgw.meta+users.keys+PZWEELDSVMBTIOBPRRDY to cache LRU end 2024-03-09T14:41:58.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.704+0000 7fb36447c980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:PZWEELDSVMBTIOBPRRDY, ofs0, ns] 2024-03-09T14:41:58.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.704+0000 7fb2457fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725894 cookie 93958541825568 notifier 5645 bl.length()=190 2024-03-09T14:41:58.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.704+0000 7fb2457fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PZWEELDSVMBTIOBPRRDY info.flags=0x7 2024-03-09T14:41:58.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.704+0000 7fb2457fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PZWEELDSVMBTIOBPRRDY to cache LRU end 2024-03-09T14:41:58.702 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T14:41:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "ragweed.client.0", 2024-03-09T14:41:58.702 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr. ragweed.client.0", 2024-03-09T14:41:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "ragweed.client.0+test@test.test", 2024-03-09T14:41:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-03-09T14:41:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-03-09T14:41:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-03-09T14:41:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-03-09T14:41:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-09T14:41:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "ragweed.client.0", 2024-03-09T14:41:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "PZWEELDSVMBTIOBPRRDY", 2024-03-09T14:41:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "Hz6K/6P+CVBvBByn1wqpUSkEzt1QZ1v3rJbOLVcZzvdrbeAyTNoQLQ==", 2024-03-09T14:41:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-03-09T14:41:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:41:58.696224Z" 2024-03-09T14:41:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-09T14:41:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-09T14:41:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-03-09T14:41:58.703 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-03-09T14:41:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-03-09T14:41:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-03-09T14:41:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-03-09T14:41:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-03-09T14:41:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-03-09T14:41:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:41:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:41:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:41:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:41:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:41:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:41:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-03-09T14:41:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:41:58.704 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:41:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:41:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:41:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:41:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:41:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-03-09T14:41:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "rgw", 2024-03-09T14:41:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-03-09T14:41:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "", 2024-03-09T14:41:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-09T14:41:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:41:58.696191Z", 2024-03-09T14:41:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-03-09T14:41:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-03-09T14:41:58.705 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T14:41:58.705 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:41:58.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.708+0000 7fb217fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:58.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.712+0000 7fb36447c980 20 remove_watcher() i=0 2024-03-09T14:41:58.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.712+0000 7fb36447c980 2 removed watcher, disabling cache 2024-03-09T14:41:58.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.716+0000 7fb36447c980 20 remove_watcher() i=1 2024-03-09T14:41:58.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.720+0000 7fb36447c980 20 remove_watcher() i=2 2024-03-09T14:41:58.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.720+0000 7fb36447c980 20 remove_watcher() i=3 2024-03-09T14:41:58.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.724+0000 7fb36447c980 20 remove_watcher() i=4 2024-03-09T14:41:58.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.724+0000 7fb36447c980 20 remove_watcher() i=5 2024-03-09T14:41:58.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.724+0000 7fb36447c980 20 remove_watcher() i=6 2024-03-09T14:41:58.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.728+0000 7fb36447c980 20 remove_watcher() i=7 2024-03-09T14:41:58.737 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-03-09T14:41:58.737 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key WKVVHKASRZIPTMPTNZYC --secret ORzENFmScRnR434oaTNZJgVZAVaysCJZuFgMR+j2uz4QInvsvLFXBg== --email sysuser.client.0+test@test.test --system true 2024-03-09T14:41:58.778 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:41:58.778 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:41:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.824+0000 7f7daa3ee980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.824+0000 7f7daa3ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:58.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.824+0000 7f7daa3ee980 20 realm 2024-03-09T14:41:58.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.824+0000 7f7daa3ee980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.824+0000 7f7daa3ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:58.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.824+0000 7f7daa3ee980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:41:58.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.824+0000 7f7daa3ee980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.824+0000 7f7daa3ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:58.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.824+0000 7f7daa3ee980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.828+0000 7f7daa3ee980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:58.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.828+0000 7f7daa3ee980 20 rados->read ofs=0 len=0 2024-03-09T14:41:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.828+0000 7f7daa3ee980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:41:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.828+0000 7f7daa3ee980 20 searching for the correct realm 2024-03-09T14:41:58.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:58.832+0000 7f7da7705640 0 -- 172.21.15.99:0/2811082142 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f7d98008050 msgr2=0x7f7d9807a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:59.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.044+0000 7f7da8707640 0 -- 172.21.15.99:0/2811082142 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f7d9c0f1c90 msgr2=0x7f7d9c0f6430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:41:59.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.264+0000 7f7daa3ee980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:41:59.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.264+0000 7f7daa3ee980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:41:59.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.264+0000 7f7daa3ee980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:41:59.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.264+0000 7f7daa3ee980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:41:59.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.264+0000 7f7daa3ee980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:41:59.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.264+0000 7f7daa3ee980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:41:59.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.264+0000 7f7daa3ee980 20 rados->read ofs=0 len=0 2024-03-09T14:41:59.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.264+0000 7f7daa3ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:59.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.264+0000 7f7daa3ee980 20 rados->read ofs=0 len=0 2024-03-09T14:41:59.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.268+0000 7f7daa3ee980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:41:59.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.268+0000 7f7daa3ee980 20 rados->read ofs=0 len=0 2024-03-09T14:41:59.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.268+0000 7f7daa3ee980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:41:59.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.268+0000 7f7daa3ee980 20 zone default found 2024-03-09T14:41:59.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.268+0000 7f7daa3ee980 4 Realm: () 2024-03-09T14:41:59.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.268+0000 7f7daa3ee980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:41:59.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.268+0000 7f7daa3ee980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:41:59.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.268+0000 7f7daa3ee980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:41:59.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.268+0000 7f7daa3ee980 20 zonegroup default 2024-03-09T14:41:59.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.268+0000 7f7daa3ee980 20 rados->read ofs=0 len=0 2024-03-09T14:41:59.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.268+0000 7f7daa3ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:59.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.268+0000 7f7daa3ee980 20 rados->read ofs=0 len=0 2024-03-09T14:41:59.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.268+0000 7f7daa3ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:59.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.268+0000 7f7daa3ee980 20 rados->read ofs=0 len=0 2024-03-09T14:41:59.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.268+0000 7f7daa3ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:59.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.268+0000 7f7daa3ee980 20 started sync module instance, tier type = 2024-03-09T14:41:59.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.268+0000 7f7daa3ee980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:41:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.292+0000 7f7daa3ee980 20 add_watcher() i=0 2024-03-09T14:41:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.292+0000 7f7daa3ee980 20 add_watcher() i=1 2024-03-09T14:41:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.292+0000 7f7daa3ee980 20 add_watcher() i=2 2024-03-09T14:41:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.292+0000 7f7daa3ee980 20 add_watcher() i=3 2024-03-09T14:41:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.292+0000 7f7daa3ee980 20 add_watcher() i=4 2024-03-09T14:41:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.292+0000 7f7daa3ee980 20 add_watcher() i=5 2024-03-09T14:41:59.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.292+0000 7f7daa3ee980 20 add_watcher() i=6 2024-03-09T14:41:59.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.296+0000 7f7daa3ee980 20 add_watcher() i=7 2024-03-09T14:41:59.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.296+0000 7f7daa3ee980 2 all 8 watchers are set, enabling cache 2024-03-09T14:41:59.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7c5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:59.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7daa3ee980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:41:59.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7daa3ee980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:41:59.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7daa3ee980 5 note: GC not initialized 2024-03-09T14:41:59.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7c5cfe1640 20 reqs_thread_entry: start 2024-03-09T14:41:59.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7daa3ee980 20 init_complete bucket index max shards: 11 2024-03-09T14:41:59.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7daa3ee980 20 Filter name: none 2024-03-09T14:41:59.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7bd67fc640 20 reqs_thread_entry: start 2024-03-09T14:41:59.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7daa3ee980 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-03-09T14:41:59.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7daa3ee980 20 rados->read ofs=0 len=0 2024-03-09T14:41:59.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7daa3ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:59.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7daa3ee980 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-03-09T14:41:59.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7daa3ee980 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-09T14:41:59.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7daa3ee980 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-03-09T14:41:59.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7daa3ee980 20 rados->read ofs=0 len=0 2024-03-09T14:41:59.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7daa3ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:59.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7daa3ee980 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-03-09T14:41:59.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7daa3ee980 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-03-09T14:41:59.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7daa3ee980 10 cache get: name=default.rgw.meta+users.keys+WKVVHKASRZIPTMPTNZYC : miss 2024-03-09T14:41:59.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.300+0000 7f7daa3ee980 20 rados->read ofs=0 len=0 2024-03-09T14:41:59.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.304+0000 7f7daa3ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:41:59.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.304+0000 7f7daa3ee980 10 cache put: name=default.rgw.meta+users.keys+WKVVHKASRZIPTMPTNZYC info.flags=0x0 2024-03-09T14:41:59.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.304+0000 7f7daa3ee980 10 adding default.rgw.meta+users.keys+WKVVHKASRZIPTMPTNZYC to cache LRU end 2024-03-09T14:41:59.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.304+0000 7f7daa3ee980 10 cache get: name=default.rgw.meta+users.keys+WKVVHKASRZIPTMPTNZYC : hit (negative entry) 2024-03-09T14:41:59.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.304+0000 7f7daa3ee980 10 cache get: name=default.rgw.meta+users.keys+WKVVHKASRZIPTMPTNZYC : hit (negative entry) 2024-03-09T14:41:59.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.304+0000 7f7daa3ee980 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-03-09T14:41:59.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.304+0000 7f7daa3ee980 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-09T14:41:59.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.304+0000 7f7daa3ee980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-03-09T14:41:59.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.308+0000 7f7c86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725894 cookie 94182794945984 notifier 5880 bl.length()=675 2024-03-09T14:41:59.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.308+0000 7f7c86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-03-09T14:41:59.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.308+0000 7f7c86ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-09T14:41:59.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.308+0000 7f7daa3ee980 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-03-09T14:41:59.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.308+0000 7f7daa3ee980 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-03-09T14:41:59.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.308+0000 7f7daa3ee980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-03-09T14:41:59.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.312+0000 7f7c867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725955 cookie 94182794952944 notifier 5880 bl.length()=202 2024-03-09T14:41:59.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.312+0000 7f7c867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-03-09T14:41:59.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.312+0000 7f7c867fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-03-09T14:41:59.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.316+0000 7f7daa3ee980 10 cache put: name=default.rgw.meta+users.keys+WKVVHKASRZIPTMPTNZYC info.flags=0x7 2024-03-09T14:41:59.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.316+0000 7f7daa3ee980 10 moving default.rgw.meta+users.keys+WKVVHKASRZIPTMPTNZYC to cache LRU end 2024-03-09T14:41:59.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.316+0000 7f7daa3ee980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:WKVVHKASRZIPTMPTNZYC, ofs0, ns] 2024-03-09T14:41:59.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.316+0000 7f7c867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725918 cookie 94182794954064 notifier 5880 bl.length()=190 2024-03-09T14:41:59.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.316+0000 7f7c867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WKVVHKASRZIPTMPTNZYC info.flags=0x7 2024-03-09T14:41:59.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.316+0000 7f7c867fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WKVVHKASRZIPTMPTNZYC to cache LRU end 2024-03-09T14:41:59.312 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T14:41:59.313 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "sysuser.client.0", 2024-03-09T14:41:59.313 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr. sysuser.client.0", 2024-03-09T14:41:59.313 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "sysuser.client.0+test@test.test", 2024-03-09T14:41:59.313 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-03-09T14:41:59.313 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-03-09T14:41:59.313 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-03-09T14:41:59.313 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-03-09T14:41:59.313 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-09T14:41:59.313 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "sysuser.client.0", 2024-03-09T14:41:59.313 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "WKVVHKASRZIPTMPTNZYC", 2024-03-09T14:41:59.313 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "ORzENFmScRnR434oaTNZJgVZAVaysCJZuFgMR+j2uz4QInvsvLFXBg==", 2024-03-09T14:41:59.313 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-03-09T14:41:59.313 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:41:59.307648Z" 2024-03-09T14:41:59.314 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-09T14:41:59.314 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-09T14:41:59.314 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-03-09T14:41:59.314 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-03-09T14:41:59.314 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-03-09T14:41:59.314 INFO:teuthology.orchestra.run.smithi099.stdout: "system": true, 2024-03-09T14:41:59.314 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-03-09T14:41:59.314 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-03-09T14:41:59.314 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-03-09T14:41:59.314 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-03-09T14:41:59.314 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:41:59.314 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:41:59.314 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:41:59.314 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:41:59.315 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:41:59.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:41:59.315 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-03-09T14:41:59.315 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:41:59.315 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:41:59.315 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:41:59.315 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:41:59.315 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:41:59.315 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:41:59.315 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-03-09T14:41:59.315 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "rgw", 2024-03-09T14:41:59.315 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-03-09T14:41:59.315 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "", 2024-03-09T14:41:59.315 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-09T14:41:59.315 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:41:59.307591Z", 2024-03-09T14:41:59.316 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-03-09T14:41:59.316 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-03-09T14:41:59.316 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T14:41:59.316 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:41:59.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.320+0000 7f7c5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:41:59.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.324+0000 7f7daa3ee980 20 remove_watcher() i=0 2024-03-09T14:41:59.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.324+0000 7f7daa3ee980 2 removed watcher, disabling cache 2024-03-09T14:41:59.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.324+0000 7f7daa3ee980 20 remove_watcher() i=1 2024-03-09T14:41:59.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.328+0000 7f7daa3ee980 20 remove_watcher() i=2 2024-03-09T14:41:59.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.332+0000 7f7daa3ee980 20 remove_watcher() i=3 2024-03-09T14:41:59.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.332+0000 7f7daa3ee980 20 remove_watcher() i=4 2024-03-09T14:41:59.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.336+0000 7f7daa3ee980 20 remove_watcher() i=5 2024-03-09T14:41:59.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.336+0000 7f7daa3ee980 20 remove_watcher() i=6 2024-03-09T14:41:59.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:41:59.336+0000 7f7daa3ee980 20 remove_watcher() i=7 2024-03-09T14:41:59.349 INFO:tasks.ragweed:Configuring ragweed... 2024-03-09T14:41:59.349 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:41:59.350 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-03-09T14:41:59.395 INFO:tasks.ragweed:Configuring boto... 2024-03-09T14:41:59.395 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:41:59.396 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-03-09T14:41:59.443 DEBUG:teuthology.orchestra.run.smithi099:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-03-09T14:41:59.619 INFO:teuthology.orchestra.run.smithi099.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-03-09T14:41:59.801 INFO:teuthology.orchestra.run.smithi099.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-03-09T14:42:00.354 INFO:teuthology.orchestra.run.smithi099.stdout:py installdeps: -rrequirements.txt 2024-03-09T14:42:03.735 INFO:teuthology.orchestra.run.smithi099.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-03-09T14:42:06.410 INFO:teuthology.orchestra.run.smithi099.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=a32600ae719ce8a0e7c604767601f2f1b682db2c0f79de5d335990c55932e6f0,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-03-09T14:42:06.411 INFO:teuthology.orchestra.run.smithi099.stdout:py run-test-pre: PYTHONHASHSEED='1637681312' 2024-03-09T14:42:06.411 INFO:teuthology.orchestra.run.smithi099.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-03-09T14:42:06.577 INFO:teuthology.orchestra.run.smithi099.stdout:============================= test session starts ============================== 2024-03-09T14:42:06.577 INFO:teuthology.orchestra.run.smithi099.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-03-09T14:42:06.577 INFO:teuthology.orchestra.run.smithi099.stdout:cachedir: .tox/py/.pytest_cache 2024-03-09T14:42:06.577 INFO:teuthology.orchestra.run.smithi099.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-03-09T14:42:06.738 INFO:teuthology.orchestra.run.smithi099.stdout:collecting ... collected 9 items 2024-03-09T14:42:06.738 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:42:08.968 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-03-09T14:42:10.249 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-03-09T14:42:11.452 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-03-09T14:42:12.585 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-03-09T14:42:13.749 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-03-09T14:42:21.122 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-03-09T14:42:23.503 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-03-09T14:42:26.559 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-03-09T14:42:31.292 INFO:teuthology.orchestra.run.smithi099.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-03-09T14:42:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:42:31.293 INFO:teuthology.orchestra.run.smithi099.stdout:=============================== warnings summary =============================== 2024-03-09T14:42:31.293 INFO:teuthology.orchestra.run.smithi099.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-03-09T14:42:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-03-09T14:42:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: import imp 2024-03-09T14:42:31.293 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:42:31.293 INFO:teuthology.orchestra.run.smithi099.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-03-09T14:42:31.293 INFO:teuthology.orchestra.run.smithi099.stdout:======================== 9 passed, 1 warning in 24.72s ========================= 2024-03-09T14:42:31.338 INFO:teuthology.orchestra.run.smithi099.stdout:___________________________________ summary ____________________________________ 2024-03-09T14:42:31.339 INFO:teuthology.orchestra.run.smithi099.stdout: py: commands succeeded 2024-03-09T14:42:31.339 INFO:teuthology.orchestra.run.smithi099.stdout: congratulations :) 2024-03-09T14:42:31.355 INFO:tasks.ragweed:Cleaning up boto... 2024-03-09T14:42:31.356 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-03-09T14:42:31.363 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-03-09T14:42:31.440 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:42:31.440 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:42:31.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.483+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.487+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:31.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.487+0000 7f7b89c92980 20 realm 2024-03-09T14:42:31.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.487+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.487+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:31.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.487+0000 7f7b89c92980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:42:31.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.487+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.487+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:31.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.487+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.487+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:31.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.487+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.491+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:42:31.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.491+0000 7f7b89c92980 20 searching for the correct realm 2024-03-09T14:42:31.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.495+0000 7f7b87fab640 0 -- 172.21.15.99:0/3527430847 >> [v2:172.21.15.99:6808/2872705330,v1:172.21.15.99:6809/2872705330] conn(0x55a1a98f2410 msgr2=0x55a1a98f48a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:31.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.499+0000 7f7b86fa9640 0 -- 172.21.15.99:0/3527430847 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f7b80039930 msgr2=0x7f7b80023400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:31.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.507+0000 7f7b89c92980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:42:31.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.507+0000 7f7b89c92980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:42:31.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.507+0000 7f7b89c92980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:42:31.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.507+0000 7f7b89c92980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:42:31.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.507+0000 7f7b89c92980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:42:31.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.507+0000 7f7b89c92980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:42:31.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.507+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.507+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:31.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.507+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.511+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:31.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.511+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.511+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:42:31.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.511+0000 7f7b89c92980 20 zone default found 2024-03-09T14:42:31.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.511+0000 7f7b89c92980 4 Realm: () 2024-03-09T14:42:31.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.511+0000 7f7b89c92980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:42:31.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.511+0000 7f7b89c92980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:42:31.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.511+0000 7f7b89c92980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:42:31.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.511+0000 7f7b89c92980 20 zonegroup default 2024-03-09T14:42:31.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.511+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.511+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:31.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.511+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.511+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:31.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.511+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.511+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:31.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.511+0000 7f7b89c92980 20 started sync module instance, tier type = 2024-03-09T14:42:31.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.511+0000 7f7b89c92980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:42:31.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.527+0000 7f7b89c92980 20 add_watcher() i=0 2024-03-09T14:42:31.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.527+0000 7f7b89c92980 20 add_watcher() i=1 2024-03-09T14:42:31.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.527+0000 7f7b89c92980 20 add_watcher() i=2 2024-03-09T14:42:31.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.527+0000 7f7b89c92980 20 add_watcher() i=3 2024-03-09T14:42:31.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.527+0000 7f7b89c92980 20 add_watcher() i=4 2024-03-09T14:42:31.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.527+0000 7f7b89c92980 20 add_watcher() i=5 2024-03-09T14:42:31.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.527+0000 7f7b89c92980 20 add_watcher() i=6 2024-03-09T14:42:31.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.527+0000 7f7b89c92980 20 add_watcher() i=7 2024-03-09T14:42:31.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.527+0000 7f7b89c92980 2 all 8 watchers are set, enabling cache 2024-03-09T14:42:31.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.531+0000 7f7a3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:31.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.531+0000 7f7b89c92980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:42:31.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.531+0000 7f7b89c92980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:42:31.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.603+0000 7f7a3cfe1640 20 reqs_thread_entry: start 2024-03-09T14:42:31.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.603+0000 7f7b89c92980 20 init_complete bucket index max shards: 11 2024-03-09T14:42:31.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.603+0000 7f7b89c92980 20 Filter name: none 2024-03-09T14:42:31.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.603+0000 7f79b67fc640 20 reqs_thread_entry: start 2024-03-09T14:42:31.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.603+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-03-09T14:42:31.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.603+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.603+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=486 2024-03-09T14:42:31.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.603+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-03-09T14:42:31.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.603+0000 7f7b89c92980 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-03-09T14:42:31.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.603+0000 7f7b89c92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:31.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.603+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5 : miss 2024-03-09T14:42:31.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.603+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.607+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=418 2024-03-09T14:42:31.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.607+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5 info.flags=0x17 2024-03-09T14:42:31.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.607+0000 7f7b89c92980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5 to cache LRU end 2024-03-09T14:42:31.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.607+0000 7f7b89c92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:31.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.607+0000 7f7b89c92980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:42:31.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.607+0000 7f7b89c92980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5 2024-03-09T14:42:31.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.607+0000 7f7b89c92980 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-03-09T14:42:31.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.607+0000 7f7b89c92980 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-03-09T14:42:31.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.607+0000 7f7b89c92980 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-03-09T14:42:31.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.607+0000 7f7b89c92980 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-03-09T14:42:31.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.611+0000 7f7b89c92980 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-03-09T14:42:31.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.611+0000 7f7b89c92980 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-03-09T14:42:31.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.611+0000 7f7b89c92980 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-03-09T14:42:31.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.611+0000 7f7b89c92980 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-03-09T14:42:31.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.611+0000 7f7b89c92980 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-03-09T14:42:31.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.611+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b78059150 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55a1a99add78 s->prefetch_data=0 2024-03-09T14:42:31.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.615+0000 7f7b89c92980 10 manifest: total_size = 5040 2024-03-09T14:42:31.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.615+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12762894921746473561 2024-03-09T14:42:31.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.615+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b78059150 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55a1a99add78 s->prefetch_data=0 2024-03-09T14:42:31.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.615+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a99add78 2024-03-09T14:42:31.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.615+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5.1 2024-03-09T14:42:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.619+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.619+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5040 stripe_ofs=5040 part_ofs=0 rule->part_size=0 2024-03-09T14:42:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.619+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12762894921746473561 2024-03-09T14:42:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.619+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.619+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.xfL7hlHYt0iBjOK1pGfoN0ICGQBbrln_0 2024-03-09T14:42:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.619+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-03-09T14:42:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.619+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.619+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12762894921746473561 2024-03-09T14:42:31.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.623+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-03-09T14:42:31.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.623+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b78059150 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55a1a9932d58 s->prefetch_data=0 2024-03-09T14:42:31.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.623+0000 7f7b89c92980 10 manifest: total_size = 7496 2024-03-09T14:42:31.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.623+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1313143874673826862 2024-03-09T14:42:31.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.623+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b78059150 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55a1a9932d58 s->prefetch_data=0 2024-03-09T14:42:31.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.623+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9932d58 2024-03-09T14:42:31.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.623+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5.2 2024-03-09T14:42:31.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.627+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:31.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.627+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=7496 stripe_ofs=7496 part_ofs=0 rule->part_size=0 2024-03-09T14:42:31.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.627+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1313143874673826862 2024-03-09T14:42:31.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.627+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.627+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.On3SrxHAtKikFGqfYgPM2ppi4umTO9W_0 2024-03-09T14:42:31.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.627+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-03-09T14:42:31.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.627+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.627+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1313143874673826862 2024-03-09T14:42:31.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.631+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-03-09T14:42:31.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.631+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b78059150 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55a1a9932d58 s->prefetch_data=0 2024-03-09T14:42:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.631+0000 7f7b89c92980 10 manifest: total_size = 7666 2024-03-09T14:42:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.631+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3878556563969087193 2024-03-09T14:42:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.631+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b78059150 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55a1a9932d58 s->prefetch_data=0 2024-03-09T14:42:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.631+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9932d58 2024-03-09T14:42:31.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.631+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5.2 2024-03-09T14:42:31.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.635+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:31.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.635+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=7666 stripe_ofs=7666 part_ofs=0 rule->part_size=0 2024-03-09T14:42:31.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.635+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3878556563969087193 2024-03-09T14:42:31.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.635+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.635+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.5ETKPwS8uXItWmrA0lBnLmVgXGlX0CO_0 2024-03-09T14:42:31.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.635+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-03-09T14:42:31.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.635+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.635+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3878556563969087193 2024-03-09T14:42:31.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.639+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b78059150 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55a1a9932d58 s->prefetch_data=0 2024-03-09T14:42:31.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.639+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-03-09T14:42:31.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.639+0000 7f7b89c92980 10 manifest: total_size = 13063 2024-03-09T14:42:31.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.639+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12219736868535372840 2024-03-09T14:42:31.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.639+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b78059150 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55a1a9932d58 s->prefetch_data=0 2024-03-09T14:42:31.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.639+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9932d58 2024-03-09T14:42:31.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.639+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5.3 2024-03-09T14:42:31.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.647+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:31.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.647+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=13063 stripe_ofs=13063 part_ofs=0 rule->part_size=0 2024-03-09T14:42:31.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.647+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12219736868535372840 2024-03-09T14:42:31.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.647+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.647+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.IrWBPzKAy30FBDDTyfTstmABh-lBq8A_0 2024-03-09T14:42:31.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.647+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-03-09T14:42:31.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.647+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.647+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12219736868535372840 2024-03-09T14:42:31.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.651+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-03-09T14:42:31.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.651+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99381a0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55a1a9932d58 s->prefetch_data=0 2024-03-09T14:42:31.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.651+0000 7f7b89c92980 10 manifest: total_size = 4957 2024-03-09T14:42:31.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.651+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8044039954805917167 2024-03-09T14:42:31.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.651+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99381a0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55a1a9932d58 s->prefetch_data=0 2024-03-09T14:42:31.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.651+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9932d58 2024-03-09T14:42:31.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.651+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5.4 2024-03-09T14:42:31.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.655+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:31.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.655+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=4957 stripe_ofs=4957 part_ofs=0 rule->part_size=0 2024-03-09T14:42:31.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.655+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8044039954805917167 2024-03-09T14:42:31.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.655+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.655+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.aqfTHyXUhiw82ixN-CMLrv4MDYB1tkm_0 2024-03-09T14:42:31.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.655+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-03-09T14:42:31.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.655+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.655+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8044039954805917167 2024-03-09T14:42:31.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.655+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99381a0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55a1a9932d58 s->prefetch_data=0 2024-03-09T14:42:31.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.659+0000 7f7b89c92980 10 manifest: total_size = 7512 2024-03-09T14:42:31.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.659+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13428238659694273952 2024-03-09T14:42:31.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.659+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99381a0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55a1a9932d58 s->prefetch_data=0 2024-03-09T14:42:31.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.659+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9932d58 2024-03-09T14:42:31.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.659+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5.4 2024-03-09T14:42:31.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.659+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-03-09T14:42:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.663+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.663+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=7512 stripe_ofs=7512 part_ofs=0 rule->part_size=0 2024-03-09T14:42:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.663+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13428238659694273952 2024-03-09T14:42:31.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.663+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.663+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.7Hqy97EzjsAqsgDgJgett9O498bsUm4_0 2024-03-09T14:42:31.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.663+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-03-09T14:42:31.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.663+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.663+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13428238659694273952 2024-03-09T14:42:31.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.667+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-03-09T14:42:31.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.667+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9939d90 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55a1a9932d58 s->prefetch_data=0 2024-03-09T14:42:31.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.667+0000 7f7b89c92980 10 manifest: total_size = 4860 2024-03-09T14:42:31.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.667+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4509385844286689815 2024-03-09T14:42:31.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.667+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9939d90 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55a1a9932d58 s->prefetch_data=0 2024-03-09T14:42:31.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.667+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9932d58 2024-03-09T14:42:31.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.667+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5.5 2024-03-09T14:42:31.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.675+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:31.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.675+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=4860 stripe_ofs=4860 part_ofs=0 rule->part_size=0 2024-03-09T14:42:31.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.675+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4509385844286689815 2024-03-09T14:42:31.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.675+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.675+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.U3oehVO2zRbJpXHTk6MBOf39FIntC4R_0 2024-03-09T14:42:31.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.675+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-03-09T14:42:31.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.675+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.675+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4509385844286689815 2024-03-09T14:42:31.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.675+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-03-09T14:42:31.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.679+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9939d90 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55a1a9932d58 s->prefetch_data=0 2024-03-09T14:42:31.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.679+0000 7f7b89c92980 10 manifest: total_size = 14164 2024-03-09T14:42:31.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.679+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7234337851937919698 2024-03-09T14:42:31.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.679+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9939d90 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55a1a9932d58 s->prefetch_data=0 2024-03-09T14:42:31.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.679+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9932d58 2024-03-09T14:42:31.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.679+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5.7 2024-03-09T14:42:31.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.683+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.683+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=14164 stripe_ofs=14164 part_ofs=0 rule->part_size=0 2024-03-09T14:42:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.683+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7234337851937919698 2024-03-09T14:42:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.683+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.683+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.Kn9IM7i6NjKBwQzNPrBfxa9c33vdkFo_0 2024-03-09T14:42:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.683+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-03-09T14:42:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.683+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.683+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7234337851937919698 2024-03-09T14:42:31.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.683+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-03-09T14:42:31.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.687+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9939d90 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55a1a9932d58 s->prefetch_data=0 2024-03-09T14:42:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.687+0000 7f7b89c92980 10 manifest: total_size = 5339 2024-03-09T14:42:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.687+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16492511991223704355 2024-03-09T14:42:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.687+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9939d90 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55a1a9932d58 s->prefetch_data=0 2024-03-09T14:42:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.687+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9932d58 2024-03-09T14:42:31.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.687+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5.8 2024-03-09T14:42:31.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.691+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:31.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.691+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5339 stripe_ofs=5339 part_ofs=0 rule->part_size=0 2024-03-09T14:42:31.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.691+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16492511991223704355 2024-03-09T14:42:31.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.691+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.691+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.za1hVEV8Gnp2qBw26sEUXshXnkZ6UH-_0 2024-03-09T14:42:31.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.691+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-03-09T14:42:31.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.691+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.691+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16492511991223704355 2024-03-09T14:42:31.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.695+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-03-09T14:42:31.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.695+0000 7f7b89c92980 20 list_objects_ordered: starting attempt 1 2024-03-09T14:42:31.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.695+0000 7f7b89c92980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:42:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.699+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:42:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.699+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:42:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.699+0000 7f7b89c92980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:42:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.699+0000 7f7b89c92980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:42:31.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.699+0000 7f7b89c92980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5])"; uploads.size()=0; is_truncated=0 2024-03-09T14:42:31.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.699+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-03-09T14:42:31.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.699+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.699+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=204 2024-03-09T14:42:31.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.699+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-03-09T14:42:31.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.699+0000 7f7b89c92980 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-03-09T14:42:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.703+0000 7f7b89c92980 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-03-09T14:42:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.703+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-03-09T14:42:31.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.703+0000 7f7a6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464329 cookie 94152822831856 notifier 5684 bl.length()=162 2024-03-09T14:42:31.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.707+0000 7f7b89c92980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5 from cache 2024-03-09T14:42:31.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.707+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5, ofs0, ns] 2024-03-09T14:42:31.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.707+0000 7f7a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464268 cookie 94152822899216 notifier 5684 bl.length()=219 2024-03-09T14:42:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.711+0000 7f7b89c92980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5 : miss 2024-03-09T14:42:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.711+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.711+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.711+0000 7f7b89c92980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5 info.flags=0x0 2024-03-09T14:42:31.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.711+0000 7f7b89c92980 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5 to cache LRU end 2024-03-09T14:42:31.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.715+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12 : miss 2024-03-09T14:42:31.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.715+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.715+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=449 2024-03-09T14:42:31.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.715+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12 info.flags=0x17 2024-03-09T14:42:31.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.715+0000 7f7b89c92980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12 to cache LRU end 2024-03-09T14:42:31.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.715+0000 7f7b89c92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:31.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.715+0000 7f7b89c92980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:42:31.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.715+0000 7f7b89c92980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12 2024-03-09T14:42:31.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.723+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo 2024-03-09T14:42:31.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.723+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7808af50 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55a1a9932828 s->prefetch_data=0 2024-03-09T14:42:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.723+0000 7f7b89c92980 10 manifest: total_size = 1667 2024-03-09T14:42:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.723+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5172718757300203297 2024-03-09T14:42:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.723+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7808af50 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55a1a9932828 s->prefetch_data=0 2024-03-09T14:42:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.723+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9932828 2024-03-09T14:42:31.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.723+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12.10 2024-03-09T14:42:31.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-09T14:42:31.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-03-09T14:42:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-03-09T14:42:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-09T14:42:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-03-09T14:42:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-03-09T14:42:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-09T14:42:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-03-09T14:42:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-03-09T14:42:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-03-09T14:42:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-03-09T14:42:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-03-09T14:42:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5172718757300203297 2024-03-09T14:42:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12__multipart_foo.2~GetD61F8Kt2MwWSRmIeATGVty1lEErh.1 2024-03-09T14:42:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-03-09T14:42:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12__multipart_foo.2~GetD61F8Kt2MwWSRmIeATGVty1lEErh.2 2024-03-09T14:42:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-03-09T14:42:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12__multipart_foo.2~GetD61F8Kt2MwWSRmIeATGVty1lEErh.3 2024-03-09T14:42:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-03-09T14:42:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12__multipart_foo.2~GetD61F8Kt2MwWSRmIeATGVty1lEErh.4 2024-03-09T14:42:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-03-09T14:42:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5172718757300203297 2024-03-09T14:42:31.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo 2024-03-09T14:42:31.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 20 list_objects_ordered: starting attempt 1 2024-03-09T14:42:31.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.731+0000 7f7b89c92980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:42:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.735+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:42:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.735+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:42:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.735+0000 7f7b89c92980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:42:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.735+0000 7f7b89c92980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:42:31.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.735+0000 7f7b89c92980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12])"; uploads.size()=0; is_truncated=0 2024-03-09T14:42:31.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.739+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-03-09T14:42:31.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.739+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.739+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=235 2024-03-09T14:42:31.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.739+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-03-09T14:42:31.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.739+0000 7f7b89c92980 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-03-09T14:42:31.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.739+0000 7f7b89c92980 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-03-09T14:42:31.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.739+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-03-09T14:42:31.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.743+0000 7f7a6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464309 cookie 94152822893024 notifier 5684 bl.length()=191 2024-03-09T14:42:31.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.747+0000 7f7b89c92980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12 from cache 2024-03-09T14:42:31.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.747+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12, ofs0, ns] 2024-03-09T14:42:31.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.747+0000 7f7a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464269 cookie 94152822899216 notifier 5684 bl.length()=249 2024-03-09T14:42:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.751+0000 7f7b89c92980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12 : miss 2024-03-09T14:42:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.751+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.751+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:31.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.751+0000 7f7b89c92980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12 info.flags=0x0 2024-03-09T14:42:31.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.751+0000 7f7b89c92980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12 to cache LRU end 2024-03-09T14:42:31.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.755+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13 : miss 2024-03-09T14:42:31.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.755+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.755+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=456 2024-03-09T14:42:31.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.755+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13 info.flags=0x17 2024-03-09T14:42:31.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.755+0000 7f7b89c92980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13 to cache LRU end 2024-03-09T14:42:31.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.755+0000 7f7b89c92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:31.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.755+0000 7f7b89c92980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:42:31.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.755+0000 7f7b89c92980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13 2024-03-09T14:42:31.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.767+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo 2024-03-09T14:42:31.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.767+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99af320 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55a1a993e638 s->prefetch_data=0 2024-03-09T14:42:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.767+0000 7f7b89c92980 10 manifest: total_size = 1667 2024-03-09T14:42:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.767+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7712252492017385009 2024-03-09T14:42:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.767+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99af320 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55a1a993e638 s->prefetch_data=0 2024-03-09T14:42:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.767+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a993e638 2024-03-09T14:42:31.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.767+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13.10 2024-03-09T14:42:31.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-09T14:42:31.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-03-09T14:42:31.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-03-09T14:42:31.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-09T14:42:31.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-03-09T14:42:31.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-03-09T14:42:31.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-09T14:42:31.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-03-09T14:42:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-03-09T14:42:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-03-09T14:42:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-03-09T14:42:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-03-09T14:42:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7712252492017385009 2024-03-09T14:42:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13__multipart_foo.2~5pX1dHf4xZ5tA-V4Dr_OMorqc9cmfIP.1 2024-03-09T14:42:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-03-09T14:42:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13__multipart_foo.2~5pX1dHf4xZ5tA-V4Dr_OMorqc9cmfIP.2 2024-03-09T14:42:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-03-09T14:42:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13__multipart_foo.2~5pX1dHf4xZ5tA-V4Dr_OMorqc9cmfIP.3 2024-03-09T14:42:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-03-09T14:42:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13__multipart_foo.2~5pX1dHf4xZ5tA-V4Dr_OMorqc9cmfIP.4 2024-03-09T14:42:31.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-03-09T14:42:31.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7712252492017385009 2024-03-09T14:42:31.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 20 list_objects_ordered: starting attempt 1 2024-03-09T14:42:31.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.775+0000 7f7b89c92980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:42:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.779+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo 2024-03-09T14:42:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.779+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:42:31.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.779+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:42:31.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.779+0000 7f7b89c92980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:42:31.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.779+0000 7f7b89c92980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:42:31.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.779+0000 7f7b89c92980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13])"; uploads.size()=0; is_truncated=0 2024-03-09T14:42:31.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.783+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-03-09T14:42:31.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.783+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.783+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=242 2024-03-09T14:42:31.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.783+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-03-09T14:42:31.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.783+0000 7f7b89c92980 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-03-09T14:42:31.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.787+0000 7f7b89c92980 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-03-09T14:42:31.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.787+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-03-09T14:42:31.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.787+0000 7f7a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464267 cookie 94152822896576 notifier 5684 bl.length()=198 2024-03-09T14:42:31.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.791+0000 7f7b89c92980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13 from cache 2024-03-09T14:42:31.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.791+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13, ofs0, ns] 2024-03-09T14:42:31.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.791+0000 7f7a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464330 cookie 94152822831856 notifier 5684 bl.length()=256 2024-03-09T14:42:31.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.799+0000 7f7b89c92980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13 : miss 2024-03-09T14:42:31.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.799+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.799+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.799+0000 7f7b89c92980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13 info.flags=0x0 2024-03-09T14:42:31.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.799+0000 7f7b89c92980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13 to cache LRU end 2024-03-09T14:42:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.803+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11 : miss 2024-03-09T14:42:31.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.803+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.803+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=451 2024-03-09T14:42:31.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.803+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11 info.flags=0x17 2024-03-09T14:42:31.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.803+0000 7f7b89c92980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11 to cache LRU end 2024-03-09T14:42:31.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.803+0000 7f7b89c92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:31.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.803+0000 7f7b89c92980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:42:31.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.803+0000 7f7b89c92980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11 2024-03-09T14:42:31.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.815+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo[Vwkhk2l9L0zto.4mJQVTBF.U3V.kUM8] 2024-03-09T14:42:31.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.815+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11.10 2024-03-09T14:42:31.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.815+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9932de0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55a1a993d608 s->prefetch_data=0 2024-03-09T14:42:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.815+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to wr9d5qhrauqcuwxhzltx1fdzrxy5c1eb 2024-03-09T14:42:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.815+0000 7f7b89c92980 20 get_obj_state_impl: setting s->olh_tag to pumolb4p32n32fqpsc9m6qkjuu3fwjwf 2024-03-09T14:42:31.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.815+0000 7f7b89c92980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=pumolb4p32n32fqpsc9m6qkjuu3fwjwf 2024-03-09T14:42:31.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.819+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11.10 2024-03-09T14:42:31.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.819+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11.10 2024-03-09T14:42:31.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.823+0000 7f7b89c92980 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-03-09T14:42:31.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.823+0000 7f7b89c92980 20 olh_log_entry: epoch=3 op=3 key=foo[Vwkhk2l9L0zto.4mJQVTBF.U3V.kUM8] 2024-03-09T14:42:31.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.823+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9932de0 obj=test-client.0-r-test-multipart-index-versioning.1:_:Vwkhk2l9L0zto.4mJQVTBF.U3V.kUM8_foo state=0x55a1a993e168 s->prefetch_data=0 2024-03-09T14:42:31.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.823+0000 7f7b89c92980 10 manifest: total_size = 26081 2024-03-09T14:42:31.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.823+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6124823075515677926 2024-03-09T14:42:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.823+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9932de0 obj=test-client.0-r-test-multipart-index-versioning.1:_:Vwkhk2l9L0zto.4mJQVTBF.U3V.kUM8_foo state=0x55a1a993e168 s->prefetch_data=0 2024-03-09T14:42:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.823+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a993e168 2024-03-09T14:42:31.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.823+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11.10 2024-03-09T14:42:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=4 2024-03-09T14:42:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7673 2024-03-09T14:42:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=7673 stripe_ofs=7673 part_ofs=7673 rule->part_size=7670 2024-03-09T14:42:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2024-03-09T14:42:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6299129 part_ofs=7673 rule->part_size=7670 2024-03-09T14:42:31.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=7671 2024-03-09T14:42:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-03-09T14:42:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6306799 part_ofs=15343 rule->part_size=7671 2024-03-09T14:42:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=23014 stripe_ofs=23014 part_ofs=23014 rule->part_size=3067 2024-03-09T14:42:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-03-09T14:42:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6314470 part_ofs=23014 rule->part_size=3067 2024-03-09T14:42:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=26081 stripe_ofs=26081 part_ofs=26081 rule->part_size=3067 2024-03-09T14:42:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6124823075515677926 2024-03-09T14:42:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11__multipart_foo.2~rXypnLeKOGnv1Oxr9loXVrfmtDr8Bqr.1 2024-03-09T14:42:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-03-09T14:42:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11__multipart_foo.2~rXypnLeKOGnv1Oxr9loXVrfmtDr8Bqr.2 2024-03-09T14:42:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-03-09T14:42:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11__multipart_foo.2~rXypnLeKOGnv1Oxr9loXVrfmtDr8Bqr.3 2024-03-09T14:42:31.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-03-09T14:42:31.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11__multipart_foo.2~rXypnLeKOGnv1Oxr9loXVrfmtDr8Bqr.4 2024-03-09T14:42:31.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-03-09T14:42:31.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.827+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6124823075515677926 2024-03-09T14:42:31.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.831+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo[Vwkhk2l9L0zto.4mJQVTBF.U3V.kUM8] 2024-03-09T14:42:31.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.835+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9932de0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55a1a993d608 s->prefetch_data=0 2024-03-09T14:42:31.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.839+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11.10 2024-03-09T14:42:31.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.843+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11.10 2024-03-09T14:42:31.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.843+0000 7f7b89c92980 20 list_objects_ordered: starting attempt 1 2024-03-09T14:42:31.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.843+0000 7f7b89c92980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:42:31.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.843+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:42:31.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.843+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:42:31.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.843+0000 7f7b89c92980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:42:31.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.843+0000 7f7b89c92980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:42:31.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.843+0000 7f7b89c92980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11])"; uploads.size()=0; is_truncated=0 2024-03-09T14:42:31.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.847+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-03-09T14:42:31.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.847+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.847+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=237 2024-03-09T14:42:31.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.847+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-03-09T14:42:31.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.847+0000 7f7b89c92980 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-03-09T14:42:31.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.851+0000 7f7b89c92980 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-03-09T14:42:31.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.851+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-03-09T14:42:31.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.851+0000 7f7a6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464268 cookie 94152822896576 notifier 5684 bl.length()=193 2024-03-09T14:42:31.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.855+0000 7f7b89c92980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11 from cache 2024-03-09T14:42:31.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.855+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11, ofs0, ns] 2024-03-09T14:42:31.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.855+0000 7f7a6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464294 cookie 94152822908064 notifier 5684 bl.length()=251 2024-03-09T14:42:31.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.863+0000 7f7b89c92980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11 : miss 2024-03-09T14:42:31.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.863+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.863+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:31.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.863+0000 7f7b89c92980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11 info.flags=0x0 2024-03-09T14:42:31.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.863+0000 7f7b89c92980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11 to cache LRU end 2024-03-09T14:42:31.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.867+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10 : miss 2024-03-09T14:42:31.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.867+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.867+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=441 2024-03-09T14:42:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.867+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10 info.flags=0x17 2024-03-09T14:42:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.867+0000 7f7b89c92980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10 to cache LRU end 2024-03-09T14:42:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.867+0000 7f7b89c92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.867+0000 7f7b89c92980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:42:31.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.867+0000 7f7b89c92980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10 2024-03-09T14:42:31.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.875+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo 2024-03-09T14:42:31.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.875+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9932e80 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55a1a97ab1b8 s->prefetch_data=0 2024-03-09T14:42:31.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.879+0000 7f7b89c92980 10 manifest: total_size = 18874368 2024-03-09T14:42:31.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.879+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13413091151430590113 2024-03-09T14:42:31.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.879+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9932e80 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55a1a97ab1b8 s->prefetch_data=0 2024-03-09T14:42:31.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.879+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a97ab1b8 2024-03-09T14:42:31.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.879+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10.10 2024-03-09T14:42:31.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:42:31.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-09T14:42:31.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:42:31.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:42:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:42:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-03-09T14:42:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:42:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-03-09T14:42:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-03-09T14:42:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-03-09T14:42:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-03-09T14:42:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-03-09T14:42:31.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13413091151430590113 2024-03-09T14:42:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10__multipart_foo.2~hYMZWuLVsT9nQQzbtE8M1MyUem3ommB.1 2024-03-09T14:42:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-03-09T14:42:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10__multipart_foo.2~hYMZWuLVsT9nQQzbtE8M1MyUem3ommB.2 2024-03-09T14:42:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-03-09T14:42:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10__multipart_foo.2~hYMZWuLVsT9nQQzbtE8M1MyUem3ommB.3 2024-03-09T14:42:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-03-09T14:42:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10__multipart_foo.2~hYMZWuLVsT9nQQzbtE8M1MyUem3ommB.4 2024-03-09T14:42:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-03-09T14:42:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.883+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13413091151430590113 2024-03-09T14:42:31.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.887+0000 7f7b89c92980 20 list_objects_ordered: starting attempt 1 2024-03-09T14:42:31.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.887+0000 7f7b89c92980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:42:31.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.887+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo 2024-03-09T14:42:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.891+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:42:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.891+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:42:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.891+0000 7f7b89c92980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:42:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.891+0000 7f7b89c92980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:42:31.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.891+0000 7f7b89c92980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10])"; uploads.size()=0; is_truncated=0 2024-03-09T14:42:31.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.895+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-03-09T14:42:31.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.895+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.895+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=227 2024-03-09T14:42:31.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.895+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-03-09T14:42:31.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.895+0000 7f7b89c92980 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-03-09T14:42:31.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.899+0000 7f7b89c92980 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-03-09T14:42:31.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.899+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-03-09T14:42:31.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.899+0000 7f7a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464331 cookie 94152822834064 notifier 5684 bl.length()=183 2024-03-09T14:42:31.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.903+0000 7f7b89c92980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10 from cache 2024-03-09T14:42:31.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.903+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10, ofs0, ns] 2024-03-09T14:42:31.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.903+0000 7f7a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464332 cookie 94152822834064 notifier 5684 bl.length()=241 2024-03-09T14:42:31.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.911+0000 7f7b89c92980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10 : miss 2024-03-09T14:42:31.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.911+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.911+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:31.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.911+0000 7f7b89c92980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10 info.flags=0x0 2024-03-09T14:42:31.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.911+0000 7f7b89c92980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10 to cache LRU end 2024-03-09T14:42:31.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.915+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16 : miss 2024-03-09T14:42:31.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.915+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:31.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.919+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=447 2024-03-09T14:42:31.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.919+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16 info.flags=0x17 2024-03-09T14:42:31.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.919+0000 7f7b89c92980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16 to cache LRU end 2024-03-09T14:42:31.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.919+0000 7f7b89c92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:31.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.919+0000 7f7b89c92980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:42:31.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.919+0000 7f7b89c92980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16 2024-03-09T14:42:31.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.919+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-03-09T14:42:31.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.919+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-03-09T14:42:31.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.923+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-09T14:42:31.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.923+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-03-09T14:42:31.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.923+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-03-09T14:42:31.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.923+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-09T14:42:31.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.927+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-03-09T14:42:31.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.927+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-09T14:42:31.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.927+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-03-09T14:42:31.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.927+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-03-09T14:42:31.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.927+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-03-09T14:42:31.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.927+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-03-09T14:42:31.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.927+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9932e80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55a1a97ab5f8 s->prefetch_data=0 2024-03-09T14:42:31.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.931+0000 7f7b89c92980 10 manifest: total_size = 22651 2024-03-09T14:42:31.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.931+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to _BlwWKAg-0WhjUkvSJtjyCBTBf1c9QRD 2024-03-09T14:42:31.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.931+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9932e80 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55a1a97ab5f8 s->prefetch_data=0 2024-03-09T14:42:31.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.931+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a97ab5f8 2024-03-09T14:42:31.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.931+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16.0 2024-03-09T14:42:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.935+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:31.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.935+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-03-09T14:42:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.935+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: _BlwWKAg-0WhjUkvSJtjyCBTBf1c9QRD 2024-03-09T14:42:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.935+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.935+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.sx7akAxfVCUOLfOGPtrdWvvMw4XC3F7_0 2024-03-09T14:42:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.935+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-09T14:42:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.935+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.935+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _BlwWKAg-0WhjUkvSJtjyCBTBf1c9QRD 2024-03-09T14:42:31.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.939+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7805af50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55a1a97ab5f8 s->prefetch_data=0 2024-03-09T14:42:31.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.939+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-03-09T14:42:31.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.939+0000 7f7b89c92980 10 manifest: total_size = 5242880 2024-03-09T14:42:31.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.939+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to _gSz5HmO_k4scKep43UWh2A4fd9u3fjk 2024-03-09T14:42:31.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.939+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7805af50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55a1a97ab5f8 s->prefetch_data=0 2024-03-09T14:42:31.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.939+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a97ab5f8 2024-03-09T14:42:31.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.939+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16.2 2024-03-09T14:42:31.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.947+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:31.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.947+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:42:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.947+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: _gSz5HmO_k4scKep43UWh2A4fd9u3fjk 2024-03-09T14:42:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.947+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.947+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.IN3mjvWg9_2qAlUOOcVA2deKKJ3hrkV_0 2024-03-09T14:42:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.947+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-09T14:42:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.947+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.947+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _gSz5HmO_k4scKep43UWh2A4fd9u3fjk 2024-03-09T14:42:31.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.951+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-03-09T14:42:31.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.951+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7805af50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:31.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.951+0000 7f7b89c92980 10 manifest: total_size = 5242880 2024-03-09T14:42:31.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.951+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18091906517887606087 2024-03-09T14:42:31.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.951+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7805af50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:31.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.951+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a97ab588 2024-03-09T14:42:31.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.951+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16.3 2024-03-09T14:42:31.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.959+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:31.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.959+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:42:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.959+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18091906517887606087 2024-03-09T14:42:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.959+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.959+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.QzgAzUREowEtpj_EF8yRc4KzJtjo2vz_0 2024-03-09T14:42:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.959+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-03-09T14:42:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.959+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.959+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18091906517887606087 2024-03-09T14:42:31.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.963+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-09T14:42:31.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.963+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7805af50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.963+0000 7f7b89c92980 10 manifest: total_size = 5242880 2024-03-09T14:42:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.963+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to _c6rh76dHR8RitBxfARQh0GLrx_kHpYc 2024-03-09T14:42:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.963+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7805af50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.963+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a97ab588 2024-03-09T14:42:31.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.963+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16.5 2024-03-09T14:42:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.967+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.967+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:42:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.967+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: _c6rh76dHR8RitBxfARQh0GLrx_kHpYc 2024-03-09T14:42:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.967+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.967+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.052cmxGJ_5aun4ZdJu_N63j6vL_2aYr_0 2024-03-09T14:42:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.967+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-09T14:42:31.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.967+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.967+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _c6rh76dHR8RitBxfARQh0GLrx_kHpYc 2024-03-09T14:42:31.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.971+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-03-09T14:42:31.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.975+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b800149d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:31.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.975+0000 7f7b89c92980 10 manifest: total_size = 5242880 2024-03-09T14:42:31.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.975+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to _MftkGW7YieZc8Is2FmVQJQBjXmNjDDW 2024-03-09T14:42:31.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.975+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b800149d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:31.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.975+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a97ab588 2024-03-09T14:42:31.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.975+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16.5 2024-03-09T14:42:31.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.979+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:31.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.979+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:42:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.979+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: _MftkGW7YieZc8Is2FmVQJQBjXmNjDDW 2024-03-09T14:42:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.979+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.979+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.dJg8ZmJR7zo21dgKiVKKLudFpJDtl6h_0 2024-03-09T14:42:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.979+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-09T14:42:31.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.979+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.979+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _MftkGW7YieZc8Is2FmVQJQBjXmNjDDW 2024-03-09T14:42:31.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.983+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b800149d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.983+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-03-09T14:42:31.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.983+0000 7f7b89c92980 10 manifest: total_size = 22651 2024-03-09T14:42:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.983+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16656033103987340499 2024-03-09T14:42:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.983+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b800149d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.983+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a97ab588 2024-03-09T14:42:31.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.983+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16.5 2024-03-09T14:42:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.991+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.991+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-03-09T14:42:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.991+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16656033103987340499 2024-03-09T14:42:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.991+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.991+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.ZVXFgPTvPTok0u5XpsbTJUj6CWamAGE_0 2024-03-09T14:42:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.991+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-03-09T14:42:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.991+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.991+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16656033103987340499 2024-03-09T14:42:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.995+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-09T14:42:31.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.995+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b800149d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.995+0000 7f7b89c92980 10 manifest: total_size = 5242880 2024-03-09T14:42:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.995+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to _551Sms9dm7encro--MVyfedLLaq9igk 2024-03-09T14:42:31.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.995+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b800149d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:31.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.995+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a97ab588 2024-03-09T14:42:31.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:31.995+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16.7 2024-03-09T14:42:31.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.003+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:31.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.003+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:42:31.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.003+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: _551Sms9dm7encro--MVyfedLLaq9igk 2024-03-09T14:42:31.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.003+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:31.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.003+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.uPWQ9JxWy6PdvixXMMIUHFaAHv49wFF_0 2024-03-09T14:42:31.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.003+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-09T14:42:31.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.003+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:31.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.003+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _551Sms9dm7encro--MVyfedLLaq9igk 2024-03-09T14:42:32.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.007+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7808af50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:32.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.007+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-03-09T14:42:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.007+0000 7f7b89c92980 10 manifest: total_size = 5242880 2024-03-09T14:42:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.007+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6771451508076974484 2024-03-09T14:42:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.007+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7808af50 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.007+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a97ab588 2024-03-09T14:42:32.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.007+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16.7 2024-03-09T14:42:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.015+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.015+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.015+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6771451508076974484 2024-03-09T14:42:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.015+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.015+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.hd-Z1ASaPkdg1FOVsqPBrP0QIqivd5D_0 2024-03-09T14:42:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.015+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-03-09T14:42:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.015+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.015+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6771451508076974484 2024-03-09T14:42:32.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.019+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b800149d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:32.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.019+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-09T14:42:32.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.019+0000 7f7b89c92980 10 manifest: total_size = 22651 2024-03-09T14:42:32.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.019+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.019+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.019+0000 7f7b89c92980 10 generate_fake_tag new tag=160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.ZVXFgPTvPTok0u5XpsbTJUj6CWamAGE_1_1b0dafb776485298dcc174c71be51d25 2024-03-09T14:42:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.019+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.ZVXFgPTvPTok0u5XpsbTJUj6CWamAGE_1_1b0dafb776485298dcc174c71be51d25 2024-03-09T14:42:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.019+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b800149d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.019+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a97ab588 2024-03-09T14:42:32.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.019+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16.7 2024-03-09T14:42:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.027+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.027+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.027+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.ZVXFgPTvPTok0u5XpsbTJUj6CWamAGE_1_1b0dafb776485298dcc174c71be51d25 2024-03-09T14:42:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.027+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.027+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.ZVXFgPTvPTok0u5XpsbTJUj6CWamAGE_0 2024-03-09T14:42:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.027+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 389 2024-03-09T14:42:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.027+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.027+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.ZVXFgPTvPTok0u5XpsbTJUj6CWamAGE_1_1b0dafb776485298dcc174c71be51d25 2024-03-09T14:42:32.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.027+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-03-09T14:42:32.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.031+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b800149d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:32.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.031+0000 7f7b89c92980 10 manifest: total_size = 5242880 2024-03-09T14:42:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.031+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.031+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.031+0000 7f7b89c92980 10 generate_fake_tag new tag=160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.hd-Z1ASaPkdg1FOVsqPBrP0QIqivd5D_1_6143e565ee763cb2428b7f2ba99732ea 2024-03-09T14:42:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.031+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.hd-Z1ASaPkdg1FOVsqPBrP0QIqivd5D_1_6143e565ee763cb2428b7f2ba99732ea 2024-03-09T14:42:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.031+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b800149d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.031+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a97ab588 2024-03-09T14:42:32.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.031+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16.8 2024-03-09T14:42:32.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.039+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.039+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.039+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.hd-Z1ASaPkdg1FOVsqPBrP0QIqivd5D_1_6143e565ee763cb2428b7f2ba99732ea 2024-03-09T14:42:32.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.039+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.039+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.hd-Z1ASaPkdg1FOVsqPBrP0QIqivd5D_0 2024-03-09T14:42:32.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.039+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 398 2024-03-09T14:42:32.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.039+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.039+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.hd-Z1ASaPkdg1FOVsqPBrP0QIqivd5D_1_6143e565ee763cb2428b7f2ba99732ea 2024-03-09T14:42:32.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.039+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-03-09T14:42:32.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.039+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b800149d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:32.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.039+0000 7f7b89c92980 10 manifest: total_size = 22651 2024-03-09T14:42:32.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.043+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to _5uB0r0ACi23ZUhU7PAX6lB1TkLDjIxY 2024-03-09T14:42:32.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.043+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b800149d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:32.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.043+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a97ab588 2024-03-09T14:42:32.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.043+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16.8 2024-03-09T14:42:32.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.047+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.047+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.047+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: _5uB0r0ACi23ZUhU7PAX6lB1TkLDjIxY 2024-03-09T14:42:32.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.047+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.047+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.b1iHL0cE016ico8KojL_fCsyADxl0Ss_0 2024-03-09T14:42:32.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.047+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-09T14:42:32.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.047+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.047+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _5uB0r0ACi23ZUhU7PAX6lB1TkLDjIxY 2024-03-09T14:42:32.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.051+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b800149d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:32.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.051+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-03-09T14:42:32.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.051+0000 7f7b89c92980 10 manifest: total_size = 5242880 2024-03-09T14:42:32.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.051+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.051+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.051+0000 7f7b89c92980 10 generate_fake_tag new tag=160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.QzgAzUREowEtpj_EF8yRc4KzJtjo2vz_1_db0b5b883935ab4c04e42ea52d021cbf 2024-03-09T14:42:32.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.051+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.QzgAzUREowEtpj_EF8yRc4KzJtjo2vz_1_db0b5b883935ab4c04e42ea52d021cbf 2024-03-09T14:42:32.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.051+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b800149d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55a1a97ab588 s->prefetch_data=0 2024-03-09T14:42:32.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.051+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a97ab588 2024-03-09T14:42:32.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.051+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16.9 2024-03-09T14:42:32.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.059+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.059+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.059+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.QzgAzUREowEtpj_EF8yRc4KzJtjo2vz_1_db0b5b883935ab4c04e42ea52d021cbf 2024-03-09T14:42:32.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.059+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.059+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.QzgAzUREowEtpj_EF8yRc4KzJtjo2vz_0 2024-03-09T14:42:32.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.059+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 396 2024-03-09T14:42:32.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.059+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.059+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.QzgAzUREowEtpj_EF8yRc4KzJtjo2vz_1_db0b5b883935ab4c04e42ea52d021cbf 2024-03-09T14:42:32.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.059+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-03-09T14:42:32.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.063+0000 7f7b89c92980 20 list_objects_ordered: starting attempt 1 2024-03-09T14:42:32.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.063+0000 7f7b89c92980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:42:32.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.063+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:42:32.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.063+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:42:32.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.063+0000 7f7b89c92980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:42:32.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.063+0000 7f7b89c92980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:42:32.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.063+0000 7f7b89c92980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16])"; uploads.size()=0; is_truncated=0 2024-03-09T14:42:32.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.067+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-03-09T14:42:32.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.067+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.071+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=233 2024-03-09T14:42:32.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.071+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-03-09T14:42:32.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.071+0000 7f7b89c92980 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-03-09T14:42:32.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.075+0000 7f7b89c92980 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-03-09T14:42:32.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.075+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-03-09T14:42:32.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.075+0000 7f7a6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464269 cookie 94152822896576 notifier 5684 bl.length()=189 2024-03-09T14:42:32.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.079+0000 7f7b89c92980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16 from cache 2024-03-09T14:42:32.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.079+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16, ofs0, ns] 2024-03-09T14:42:32.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.079+0000 7f7a6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464295 cookie 94152822908064 notifier 5684 bl.length()=247 2024-03-09T14:42:32.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.087+0000 7f7b89c92980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16 : miss 2024-03-09T14:42:32.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.087+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.087+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.087+0000 7f7b89c92980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16 info.flags=0x0 2024-03-09T14:42:32.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.087+0000 7f7b89c92980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16 to cache LRU end 2024-03-09T14:42:32.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.091+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17 : miss 2024-03-09T14:42:32.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.091+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.095+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=457 2024-03-09T14:42:32.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.095+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17 info.flags=0x17 2024-03-09T14:42:32.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.095+0000 7f7b89c92980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17 to cache LRU end 2024-03-09T14:42:32.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.095+0000 7f7b89c92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:32.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.095+0000 7f7b89c92980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:42:32.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.095+0000 7f7b89c92980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17 2024-03-09T14:42:32.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.095+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-03-09T14:42:32.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.095+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-03-09T14:42:32.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.099+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-09T14:42:32.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.099+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-03-09T14:42:32.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.099+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-03-09T14:42:32.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.099+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-09T14:42:32.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.099+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-03-09T14:42:32.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.099+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-09T14:42:32.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.099+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-03-09T14:42:32.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.103+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-03-09T14:42:32.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.103+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-03-09T14:42:32.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.103+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-03-09T14:42:32.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.103+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a97ac260 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.103+0000 7f7b89c92980 10 manifest: total_size = 16383 2024-03-09T14:42:32.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.103+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to _0-O90LsW7P5tpIso8O2o71Kr_m6uXYL 2024-03-09T14:42:32.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.103+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a97ac260 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.103+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9935108 2024-03-09T14:42:32.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.103+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17.0 2024-03-09T14:42:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.111+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.111+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=16383 stripe_ofs=16383 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.111+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: _0-O90LsW7P5tpIso8O2o71Kr_m6uXYL 2024-03-09T14:42:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.111+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.111+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.y3wEfYzWsvMmIEJrHje1xeAGNwETvix_0 2024-03-09T14:42:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.111+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-09T14:42:32.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.111+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.111+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: _0-O90LsW7P5tpIso8O2o71Kr_m6uXYL 2024-03-09T14:42:32.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.111+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-03-09T14:42:32.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.111+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b80007e30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.115+0000 7f7b89c92980 10 manifest: total_size = 11534336 2024-03-09T14:42:32.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.115+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to _D-Pr25k93dwxxxe9jzokvzzCr0A_QfW 2024-03-09T14:42:32.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.115+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b80007e30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.115+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9935108 2024-03-09T14:42:32.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.115+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17.2 2024-03-09T14:42:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.119+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.119+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.119+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.119+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.119+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: _D-Pr25k93dwxxxe9jzokvzzCr0A_QfW 2024-03-09T14:42:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.119+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.119+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.k7fFj-wCizJcryngNXa94z7qrsLvbNg_0 2024-03-09T14:42:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.119+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-09T14:42:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.119+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.k7fFj-wCizJcryngNXa94z7qrsLvbNg_1 2024-03-09T14:42:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.119+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-03-09T14:42:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.119+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.119+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _D-Pr25k93dwxxxe9jzokvzzCr0A_QfW 2024-03-09T14:42:32.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.123+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b80007e30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.123+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-03-09T14:42:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.123+0000 7f7b89c92980 10 manifest: total_size = 11534336 2024-03-09T14:42:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.123+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16264664694984483120 2024-03-09T14:42:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.123+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b80007e30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.123+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9935108 2024-03-09T14:42:32.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.123+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17.3 2024-03-09T14:42:32.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:42:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-09T14:42:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:42:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:42:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:42:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:42:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:42:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:42:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:42:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16264664694984483120 2024-03-09T14:42:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-FROZEN.2~YGuMzAqEpEjqOYbyxSVmKI39QB9SADO.1 2024-03-09T14:42:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-03-09T14:42:32.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-FROZEN.2~YGuMzAqEpEjqOYbyxSVmKI39QB9SADO.2 2024-03-09T14:42:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-03-09T14:42:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-FROZEN.2~YGuMzAqEpEjqOYbyxSVmKI39QB9SADO.3 2024-03-09T14:42:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-03-09T14:42:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.131+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16264664694984483120 2024-03-09T14:42:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.135+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-09T14:42:32.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.135+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b80007e30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.135+0000 7f7b89c92980 10 manifest: total_size = 11534336 2024-03-09T14:42:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.135+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to _MMmm3_m4vPFdfWJj8ICqp3MqibYWvrk 2024-03-09T14:42:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.135+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b80007e30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.135+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9935108 2024-03-09T14:42:32.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.135+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17.5 2024-03-09T14:42:32.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.139+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.139+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.139+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.139+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.139+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: _MMmm3_m4vPFdfWJj8ICqp3MqibYWvrk 2024-03-09T14:42:32.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.139+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.139+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.yznCBwSlUz1nYvXF-R7BqKBLjqaeRGk_0 2024-03-09T14:42:32.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.139+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-03-09T14:42:32.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.139+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.yznCBwSlUz1nYvXF-R7BqKBLjqaeRGk_1 2024-03-09T14:42:32.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.139+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-03-09T14:42:32.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.139+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.139+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _MMmm3_m4vPFdfWJj8ICqp3MqibYWvrk 2024-03-09T14:42:32.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.143+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-03-09T14:42:32.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.143+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b80007e30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.147+0000 7f7b89c92980 10 manifest: total_size = 11534336 2024-03-09T14:42:32.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.147+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to _qqym9ZaEfp-bDGgOXE4f2Nie4cq5tIe 2024-03-09T14:42:32.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.147+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b80007e30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.147+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9935108 2024-03-09T14:42:32.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.147+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17.5 2024-03-09T14:42:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.151+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.151+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.151+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.151+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.151+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: _qqym9ZaEfp-bDGgOXE4f2Nie4cq5tIe 2024-03-09T14:42:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.151+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.151+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.9u4xjTafESix_BrJVCKl3sB52eRS9N0_0 2024-03-09T14:42:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.151+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-09T14:42:32.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.151+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.9u4xjTafESix_BrJVCKl3sB52eRS9N0_1 2024-03-09T14:42:32.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.151+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-03-09T14:42:32.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.151+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.151+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _qqym9ZaEfp-bDGgOXE4f2Nie4cq5tIe 2024-03-09T14:42:32.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.155+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-03-09T14:42:32.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.155+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7c10f630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.155+0000 7f7b89c92980 10 manifest: total_size = 16383 2024-03-09T14:42:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.155+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18211660871331282399 2024-03-09T14:42:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.155+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7c10f630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.155+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9935108 2024-03-09T14:42:32.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.155+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17.5 2024-03-09T14:42:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=2 2024-03-09T14:42:32.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7674 2024-03-09T14:42:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=7674 stripe_ofs=7674 part_ofs=7674 rule->part_size=7674 2024-03-09T14:42:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=2 2024-03-09T14:42:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6299130 part_ofs=7674 rule->part_size=7674 2024-03-09T14:42:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=15348 stripe_ofs=15348 part_ofs=15348 rule->part_size=1035 2024-03-09T14:42:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=2 2024-03-09T14:42:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6306804 part_ofs=15348 rule->part_size=1035 2024-03-09T14:42:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=16383 stripe_ofs=16383 part_ofs=16383 rule->part_size=1035 2024-03-09T14:42:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18211660871331282399 2024-03-09T14:42:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-STANDARD.2~E70XJhn5n-V7ByeAc2hn6q-eOLkOFeV.1 2024-03-09T14:42:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-03-09T14:42:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-STANDARD.2~E70XJhn5n-V7ByeAc2hn6q-eOLkOFeV.2 2024-03-09T14:42:32.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-03-09T14:42:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-STANDARD.2~E70XJhn5n-V7ByeAc2hn6q-eOLkOFeV.3 2024-03-09T14:42:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-03-09T14:42:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.159+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18211660871331282399 2024-03-09T14:42:32.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.163+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-09T14:42:32.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.163+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b80007e30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.167+0000 7f7b89c92980 10 manifest: total_size = 11534336 2024-03-09T14:42:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.167+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to _AKQhXHQ43ZpQtbluO5udnX4jWWxmk0i 2024-03-09T14:42:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.167+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b80007e30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.167+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9935108 2024-03-09T14:42:32.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.167+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17.7 2024-03-09T14:42:32.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.171+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.171+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.171+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.171+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.171+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: _AKQhXHQ43ZpQtbluO5udnX4jWWxmk0i 2024-03-09T14:42:32.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.171+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.171+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.uVDwWC-3QQS7FLto-ehUdb8EC5kZh-V_0 2024-03-09T14:42:32.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.171+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-03-09T14:42:32.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.171+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.uVDwWC-3QQS7FLto-ehUdb8EC5kZh-V_1 2024-03-09T14:42:32.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.171+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-03-09T14:42:32.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.171+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.171+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _AKQhXHQ43ZpQtbluO5udnX4jWWxmk0i 2024-03-09T14:42:32.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.175+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-03-09T14:42:32.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.175+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b80007e30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.175+0000 7f7b89c92980 10 manifest: total_size = 11534336 2024-03-09T14:42:32.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.175+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15880555619203367589 2024-03-09T14:42:32.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.175+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b80007e30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.175+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9935108 2024-03-09T14:42:32.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.175+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17.7 2024-03-09T14:42:32.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:42:32.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-09T14:42:32.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:42:32.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:42:32.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:42:32.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:42:32.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:42:32.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:42:32.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:42:32.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15880555619203367589 2024-03-09T14:42:32.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-LUKEWARM.2~CCSvct-ww4j6v5AoPJGm3f8T1gxZdaO.1 2024-03-09T14:42:32.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-03-09T14:42:32.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-LUKEWARM.2~CCSvct-ww4j6v5AoPJGm3f8T1gxZdaO.2 2024-03-09T14:42:32.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-03-09T14:42:32.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-LUKEWARM.2~CCSvct-ww4j6v5AoPJGm3f8T1gxZdaO.3 2024-03-09T14:42:32.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-03-09T14:42:32.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15880555619203367589 2024-03-09T14:42:32.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99af9f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.183+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-09T14:42:32.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.187+0000 7f7b89c92980 10 manifest: total_size = 16383 2024-03-09T14:42:32.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.187+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=2 2024-03-09T14:42:32.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.187+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7674 2024-03-09T14:42:32.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.187+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=7674 stripe_ofs=7674 part_ofs=7674 rule->part_size=7674 2024-03-09T14:42:32.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.187+0000 7f7b89c92980 10 generate_fake_tag new tag=160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-STANDARD.2~E70XJhn5n-V7ByeAc2hn6q-eOLkOFeV.2_a1bda6bf6fb99a565fec9bcee685e37c 2024-03-09T14:42:32.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.187+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-STANDARD.2~E70XJhn5n-V7ByeAc2hn6q-eOLkOFeV.2_a1bda6bf6fb99a565fec9bcee685e37c 2024-03-09T14:42:32.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.187+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99af9f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.187+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9935108 2024-03-09T14:42:32.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.187+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17.7 2024-03-09T14:42:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=2 2024-03-09T14:42:32.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7674 2024-03-09T14:42:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=7674 stripe_ofs=7674 part_ofs=7674 rule->part_size=7674 2024-03-09T14:42:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=7674 rules.size()=2 2024-03-09T14:42:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6299130 part_ofs=7674 rule->part_size=7674 2024-03-09T14:42:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=15348 stripe_ofs=15348 part_ofs=15348 rule->part_size=1035 2024-03-09T14:42:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=2 2024-03-09T14:42:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6306804 part_ofs=15348 rule->part_size=1035 2024-03-09T14:42:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=16383 stripe_ofs=16383 part_ofs=16383 rule->part_size=1035 2024-03-09T14:42:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-STANDARD.2~E70XJhn5n-V7ByeAc2hn6q-eOLkOFeV.2_a1bda6bf6fb99a565fec9bcee685e37c 2024-03-09T14:42:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-STANDARD.2~E70XJhn5n-V7ByeAc2hn6q-eOLkOFeV.1 2024-03-09T14:42:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 440 2024-03-09T14:42:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-STANDARD.2~E70XJhn5n-V7ByeAc2hn6q-eOLkOFeV.2 2024-03-09T14:42:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 704 2024-03-09T14:42:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-STANDARD.2~E70XJhn5n-V7ByeAc2hn6q-eOLkOFeV.3 2024-03-09T14:42:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 968 2024-03-09T14:42:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.191+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-STANDARD.2~E70XJhn5n-V7ByeAc2hn6q-eOLkOFeV.2_a1bda6bf6fb99a565fec9bcee685e37c 2024-03-09T14:42:32.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.195+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-03-09T14:42:32.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.195+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9938eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.195+0000 7f7b89c92980 10 manifest: total_size = 11534336 2024-03-09T14:42:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.195+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:42:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.195+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-09T14:42:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.195+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:42:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.195+0000 7f7b89c92980 10 generate_fake_tag new tag=160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-LUKEWARM.2~CCSvct-ww4j6v5AoPJGm3f8T1gxZdaO.2_4fa87d455cd83b51fe58b555400e7d9a 2024-03-09T14:42:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.195+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-LUKEWARM.2~CCSvct-ww4j6v5AoPJGm3f8T1gxZdaO.2_4fa87d455cd83b51fe58b555400e7d9a 2024-03-09T14:42:32.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.195+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9938eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.195+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9935108 2024-03-09T14:42:32.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.195+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17.8 2024-03-09T14:42:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:42:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-09T14:42:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:42:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:42:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:42:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:42:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:42:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:42:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:42:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-LUKEWARM.2~CCSvct-ww4j6v5AoPJGm3f8T1gxZdaO.2_4fa87d455cd83b51fe58b555400e7d9a 2024-03-09T14:42:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-LUKEWARM.2~CCSvct-ww4j6v5AoPJGm3f8T1gxZdaO.1 2024-03-09T14:42:32.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 449 2024-03-09T14:42:32.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-LUKEWARM.2~CCSvct-ww4j6v5AoPJGm3f8T1gxZdaO.2 2024-03-09T14:42:32.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 722 2024-03-09T14:42:32.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-LUKEWARM.2~CCSvct-ww4j6v5AoPJGm3f8T1gxZdaO.3 2024-03-09T14:42:32.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 995 2024-03-09T14:42:32.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.203+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-LUKEWARM.2~CCSvct-ww4j6v5AoPJGm3f8T1gxZdaO.2_4fa87d455cd83b51fe58b555400e7d9a 2024-03-09T14:42:32.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.207+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-03-09T14:42:32.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.207+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7c10f630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.207+0000 7f7b89c92980 10 manifest: total_size = 16383 2024-03-09T14:42:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.207+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to _XVuHmLfYOykk5krFvYVYZAsDoEd6Hr_ 2024-03-09T14:42:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.207+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7c10f630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.207+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9935108 2024-03-09T14:42:32.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.207+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17.8 2024-03-09T14:42:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.211+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.211+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=16383 stripe_ofs=16383 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.211+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: _XVuHmLfYOykk5krFvYVYZAsDoEd6Hr_ 2024-03-09T14:42:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.211+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.211+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.Mun_Aphhxp5CFDUo3aSXDXJ0Cj3wocd_0 2024-03-09T14:42:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.211+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-03-09T14:42:32.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.211+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.211+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _XVuHmLfYOykk5krFvYVYZAsDoEd6Hr_ 2024-03-09T14:42:32.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.215+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-03-09T14:42:32.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.215+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7c0ef8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.215+0000 7f7b89c92980 10 manifest: total_size = 11534336 2024-03-09T14:42:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.215+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:42:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.215+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-09T14:42:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.215+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:42:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.215+0000 7f7b89c92980 10 generate_fake_tag new tag=160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-FROZEN.2~YGuMzAqEpEjqOYbyxSVmKI39QB9SADO.2_299479feca2d8079602e341650dd5730 2024-03-09T14:42:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.215+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-FROZEN.2~YGuMzAqEpEjqOYbyxSVmKI39QB9SADO.2_299479feca2d8079602e341650dd5730 2024-03-09T14:42:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.215+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7c0ef8c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55a1a9935108 s->prefetch_data=0 2024-03-09T14:42:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.215+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9935108 2024-03-09T14:42:32.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.215+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17.9 2024-03-09T14:42:32.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:42:32.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-09T14:42:32.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:42:32.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:42:32.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:42:32.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:42:32.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:42:32.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:42:32.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:42:32.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-FROZEN.2~YGuMzAqEpEjqOYbyxSVmKI39QB9SADO.2_299479feca2d8079602e341650dd5730 2024-03-09T14:42:32.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-FROZEN.2~YGuMzAqEpEjqOYbyxSVmKI39QB9SADO.1 2024-03-09T14:42:32.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 441 2024-03-09T14:42:32.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-FROZEN.2~YGuMzAqEpEjqOYbyxSVmKI39QB9SADO.2 2024-03-09T14:42:32.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 708 2024-03-09T14:42:32.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-FROZEN.2~YGuMzAqEpEjqOYbyxSVmKI39QB9SADO.3 2024-03-09T14:42:32.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 975 2024-03-09T14:42:32.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.223+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-FROZEN.2~YGuMzAqEpEjqOYbyxSVmKI39QB9SADO.2_299479feca2d8079602e341650dd5730 2024-03-09T14:42:32.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.227+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-03-09T14:42:32.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.231+0000 7f7b89c92980 20 list_objects_ordered: starting attempt 1 2024-03-09T14:42:32.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.231+0000 7f7b89c92980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:42:32.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.231+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:42:32.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.231+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:42:32.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.231+0000 7f7b89c92980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:42:32.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.231+0000 7f7b89c92980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:42:32.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.231+0000 7f7b89c92980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17])"; uploads.size()=0; is_truncated=0 2024-03-09T14:42:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.235+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-03-09T14:42:32.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.235+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.239+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=243 2024-03-09T14:42:32.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.239+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-03-09T14:42:32.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.239+0000 7f7b89c92980 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-03-09T14:42:32.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.239+0000 7f7b89c92980 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-03-09T14:42:32.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.239+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-03-09T14:42:32.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.239+0000 7f7a6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464270 cookie 94152822899216 notifier 5684 bl.length()=199 2024-03-09T14:42:32.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.243+0000 7f7b89c92980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17 from cache 2024-03-09T14:42:32.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.243+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17, ofs0, ns] 2024-03-09T14:42:32.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.243+0000 7f7a6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464310 cookie 94152822893024 notifier 5684 bl.length()=257 2024-03-09T14:42:32.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.251+0000 7f7b89c92980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17 : miss 2024-03-09T14:42:32.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.251+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.251+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.251+0000 7f7b89c92980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17 info.flags=0x0 2024-03-09T14:42:32.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.251+0000 7f7b89c92980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17 to cache LRU end 2024-03-09T14:42:32.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.255+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15 : miss 2024-03-09T14:42:32.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.255+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.255+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=452 2024-03-09T14:42:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.255+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15 info.flags=0x17 2024-03-09T14:42:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.255+0000 7f7b89c92980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15 to cache LRU end 2024-03-09T14:42:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.255+0000 7f7b89c92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.255+0000 7f7b89c92980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:42:32.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.255+0000 7f7b89c92980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15 2024-03-09T14:42:32.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.259+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-09T14:42:32.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.263+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-09T14:42:32.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.263+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-09T14:42:32.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.267+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9937960 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55a1a97adbd8 s->prefetch_data=0 2024-03-09T14:42:32.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.267+0000 7f7b89c92980 10 manifest: total_size = 11534336 2024-03-09T14:42:32.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.267+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9203501908804720736 2024-03-09T14:42:32.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.267+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9937960 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55a1a97adbd8 s->prefetch_data=0 2024-03-09T14:42:32.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.267+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a97adbd8 2024-03-09T14:42:32.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.267+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15.3 2024-03-09T14:42:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:42:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-09T14:42:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:42:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:42:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:42:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:42:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:42:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:42:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:42:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9203501908804720736 2024-03-09T14:42:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-FROZEN.2~Aay9Lf6A2AvHb4BujpaPJwheBqNiQtd.1 2024-03-09T14:42:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-03-09T14:42:32.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-FROZEN.2~Aay9Lf6A2AvHb4BujpaPJwheBqNiQtd.2 2024-03-09T14:42:32.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-03-09T14:42:32.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-FROZEN.2~Aay9Lf6A2AvHb4BujpaPJwheBqNiQtd.3 2024-03-09T14:42:32.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-03-09T14:42:32.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.275+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9203501908804720736 2024-03-09T14:42:32.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.279+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-09T14:42:32.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.279+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7c10f630 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55a1a97adbd8 s->prefetch_data=0 2024-03-09T14:42:32.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.279+0000 7f7b89c92980 10 manifest: total_size = 1087 2024-03-09T14:42:32.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.279+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13141793555833164032 2024-03-09T14:42:32.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.279+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7c10f630 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55a1a97adbd8 s->prefetch_data=0 2024-03-09T14:42:32.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.279+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a97adbd8 2024-03-09T14:42:32.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.279+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15.5 2024-03-09T14:42:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-09T14:42:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-03-09T14:42:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-03-09T14:42:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-03-09T14:42:32.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-03-09T14:42:32.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-03-09T14:42:32.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-03-09T14:42:32.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=55 2024-03-09T14:42:32.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-03-09T14:42:32.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13141793555833164032 2024-03-09T14:42:32.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-STANDARD.2~X7wW1pA6uFxnUQwgTOMCwAvUYspw9-C.1 2024-03-09T14:42:32.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-03-09T14:42:32.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-STANDARD.2~X7wW1pA6uFxnUQwgTOMCwAvUYspw9-C.2 2024-03-09T14:42:32.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-03-09T14:42:32.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-STANDARD.2~X7wW1pA6uFxnUQwgTOMCwAvUYspw9-C.3 2024-03-09T14:42:32.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-03-09T14:42:32.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.287+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13141793555833164032 2024-03-09T14:42:32.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.291+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99afef0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55a1a993d8b8 s->prefetch_data=0 2024-03-09T14:42:32.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.291+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-09T14:42:32.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.291+0000 7f7b89c92980 10 manifest: total_size = 11534336 2024-03-09T14:42:32.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.291+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1038073593230360963 2024-03-09T14:42:32.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.291+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99afef0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55a1a993d8b8 s->prefetch_data=0 2024-03-09T14:42:32.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.291+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a993d8b8 2024-03-09T14:42:32.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.291+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15.7 2024-03-09T14:42:32.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:42:32.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-03-09T14:42:32.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:42:32.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-03-09T14:42:32.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-03-09T14:42:32.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:42:32.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-03-09T14:42:32.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-03-09T14:42:32.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-03-09T14:42:32.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1038073593230360963 2024-03-09T14:42:32.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-LUKEWARM.2~AIT3qrJUMOeFauuHGfDY6cdVkK2ILUx.1 2024-03-09T14:42:32.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-03-09T14:42:32.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-LUKEWARM.2~AIT3qrJUMOeFauuHGfDY6cdVkK2ILUx.2 2024-03-09T14:42:32.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-03-09T14:42:32.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-LUKEWARM.2~AIT3qrJUMOeFauuHGfDY6cdVkK2ILUx.3 2024-03-09T14:42:32.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-03-09T14:42:32.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.299+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1038073593230360963 2024-03-09T14:42:32.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.303+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-09T14:42:32.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.303+0000 7f7b89c92980 20 list_objects_ordered: starting attempt 1 2024-03-09T14:42:32.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.303+0000 7f7b89c92980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:42:32.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.307+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:42:32.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.307+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:42:32.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.307+0000 7f7b89c92980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:42:32.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.307+0000 7f7b89c92980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:42:32.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.307+0000 7f7b89c92980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15])"; uploads.size()=0; is_truncated=0 2024-03-09T14:42:32.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.311+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-03-09T14:42:32.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.311+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.311+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=238 2024-03-09T14:42:32.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.311+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-03-09T14:42:32.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.311+0000 7f7b89c92980 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-03-09T14:42:32.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.315+0000 7f7b89c92980 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-03-09T14:42:32.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.315+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-03-09T14:42:32.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.315+0000 7f7a6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464296 cookie 94152822904416 notifier 5684 bl.length()=194 2024-03-09T14:42:32.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.319+0000 7f7b89c92980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15 from cache 2024-03-09T14:42:32.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.319+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15, ofs0, ns] 2024-03-09T14:42:32.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.319+0000 7f7a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464311 cookie 94152822893024 notifier 5684 bl.length()=252 2024-03-09T14:42:32.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.327+0000 7f7b89c92980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15 : miss 2024-03-09T14:42:32.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.327+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.327+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.327+0000 7f7b89c92980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15 info.flags=0x0 2024-03-09T14:42:32.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.327+0000 7f7b89c92980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15 to cache LRU end 2024-03-09T14:42:32.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.335+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14 : miss 2024-03-09T14:42:32.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.335+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.335+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=442 2024-03-09T14:42:32.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.335+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14 info.flags=0x17 2024-03-09T14:42:32.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.335+0000 7f7b89c92980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14 to cache LRU end 2024-03-09T14:42:32.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.335+0000 7f7b89c92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:32.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.335+0000 7f7b89c92980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:42:32.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.335+0000 7f7b89c92980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14 2024-03-09T14:42:32.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.339+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-FROZEN 2024-03-09T14:42:32.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.343+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-STANDARD 2024-03-09T14:42:32.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.343+0000 7f7b89c92980 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-03-09T14:42:32.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.347+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99086c0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55a1a995f778 s->prefetch_data=0 2024-03-09T14:42:32.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.347+0000 7f7b89c92980 10 manifest: total_size = 10485760 2024-03-09T14:42:32.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.347+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13506226817995096102 2024-03-09T14:42:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.347+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99086c0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55a1a995f778 s->prefetch_data=0 2024-03-09T14:42:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.347+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a995f778 2024-03-09T14:42:32.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.347+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14.3 2024-03-09T14:42:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.355+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.355+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.355+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.355+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.355+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13506226817995096102 2024-03-09T14:42:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.355+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.355+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14__shadow_.ScEt0p2NbbES_tFsyJgRxMOy3KifhcT_0 2024-03-09T14:42:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.355+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-03-09T14:42:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.355+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14__shadow_.ScEt0p2NbbES_tFsyJgRxMOy3KifhcT_1 2024-03-09T14:42:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.355+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-03-09T14:42:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.355+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.355+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13506226817995096102 2024-03-09T14:42:32.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.359+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-03-09T14:42:32.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.359+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7c10f630 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55a1a995f668 s->prefetch_data=0 2024-03-09T14:42:32.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.359+0000 7f7b89c92980 10 manifest: total_size = 10485760 2024-03-09T14:42:32.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.359+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1015650765751546338 2024-03-09T14:42:32.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.359+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7c10f630 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55a1a995f668 s->prefetch_data=0 2024-03-09T14:42:32.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.359+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a995f668 2024-03-09T14:42:32.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.359+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14.5 2024-03-09T14:42:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.367+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.367+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.367+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.367+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.367+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1015650765751546338 2024-03-09T14:42:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.367+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.367+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14__shadow_.aj2FjCarhq4TxUFsWoNwl8LK_6mQ4Bh_0 2024-03-09T14:42:32.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.367+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-03-09T14:42:32.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.367+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14__shadow_.aj2FjCarhq4TxUFsWoNwl8LK_6mQ4Bh_1 2024-03-09T14:42:32.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.367+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 560 2024-03-09T14:42:32.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.367+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.367+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1015650765751546338 2024-03-09T14:42:32.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.371+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-03-09T14:42:32.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.371+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b80007e30 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55a1a995f668 s->prefetch_data=0 2024-03-09T14:42:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.371+0000 7f7b89c92980 10 manifest: total_size = 10485760 2024-03-09T14:42:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.371+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13804327044622994221 2024-03-09T14:42:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.371+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b80007e30 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55a1a995f668 s->prefetch_data=0 2024-03-09T14:42:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.371+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a995f668 2024-03-09T14:42:32.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.371+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14.7 2024-03-09T14:42:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.379+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.379+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.379+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.379+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.379+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13804327044622994221 2024-03-09T14:42:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.379+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.379+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14__shadow_.oHPjwmpINUccgfqBrOnnFegYnI-g-pM_0 2024-03-09T14:42:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.379+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-03-09T14:42:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.379+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14__shadow_.oHPjwmpINUccgfqBrOnnFegYnI-g-pM_1 2024-03-09T14:42:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.379+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-03-09T14:42:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.379+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.379+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13804327044622994221 2024-03-09T14:42:32.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.379+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-03-09T14:42:32.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.383+0000 7f7b89c92980 20 list_objects_ordered: starting attempt 1 2024-03-09T14:42:32.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.383+0000 7f7b89c92980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:42:32.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.383+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:42:32.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.383+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:42:32.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.383+0000 7f7b89c92980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:42:32.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.383+0000 7f7b89c92980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:42:32.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.383+0000 7f7b89c92980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14])"; uploads.size()=0; is_truncated=0 2024-03-09T14:42:32.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.387+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-03-09T14:42:32.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.387+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.391+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=228 2024-03-09T14:42:32.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.391+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-03-09T14:42:32.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.391+0000 7f7b89c92980 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-03-09T14:42:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.391+0000 7f7b89c92980 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-03-09T14:42:32.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.391+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-03-09T14:42:32.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.391+0000 7f7a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464270 cookie 94152822896576 notifier 5684 bl.length()=184 2024-03-09T14:42:32.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.395+0000 7f7b89c92980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14 from cache 2024-03-09T14:42:32.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.395+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14, ofs0, ns] 2024-03-09T14:42:32.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.399+0000 7f7a6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464333 cookie 94152822831856 notifier 5684 bl.length()=242 2024-03-09T14:42:32.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.407+0000 7f7b89c92980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14 : miss 2024-03-09T14:42:32.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.407+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.407+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.407+0000 7f7b89c92980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14 info.flags=0x0 2024-03-09T14:42:32.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.407+0000 7f7b89c92980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14 to cache LRU end 2024-03-09T14:42:32.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.411+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7 : miss 2024-03-09T14:42:32.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.411+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.415+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=437 2024-03-09T14:42:32.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.415+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7 info.flags=0x17 2024-03-09T14:42:32.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.415+0000 7f7b89c92980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7 to cache LRU end 2024-03-09T14:42:32.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.415+0000 7f7b89c92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:32.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.415+0000 7f7b89c92980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:42:32.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.415+0000 7f7b89c92980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7 2024-03-09T14:42:32.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.419+0000 7f7b89c92980 10 cls_bucket_list_unordered: got ___ 2024-03-09T14:42:32.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.419+0000 7f7b89c92980 10 cls_bucket_list_unordered: got __ _ 2024-03-09T14:42:32.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.423+0000 7f7b89c92980 10 cls_bucket_list_unordered: got __ 2024-03-09T14:42:32.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.423+0000 7f7b89c92980 10 cls_bucket_list_unordered: got obj 2024-03-09T14:42:32.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.427+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9937f20 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55a1a995ed18 s->prefetch_data=0 2024-03-09T14:42:32.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.427+0000 7f7b89c92980 10 manifest: total_size = 0 2024-03-09T14:42:32.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.427+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9499373876077448890 2024-03-09T14:42:32.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.427+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9937f20 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55a1a995ed18 s->prefetch_data=0 2024-03-09T14:42:32.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.427+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a995ed18 2024-03-09T14:42:32.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.427+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7.2 2024-03-09T14:42:32.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.431+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9937f20 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55a1a995ed18 s->prefetch_data=0 2024-03-09T14:42:32.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.435+0000 7f7b89c92980 10 manifest: total_size = 0 2024-03-09T14:42:32.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.435+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8981453104309003163 2024-03-09T14:42:32.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.435+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9937f20 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55a1a995ed18 s->prefetch_data=0 2024-03-09T14:42:32.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.435+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a995ed18 2024-03-09T14:42:32.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.435+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7.3 2024-03-09T14:42:32.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.435+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=___ 2024-03-09T14:42:32.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.443+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9937f20 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55a1a995ed18 s->prefetch_data=0 2024-03-09T14:42:32.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.443+0000 7f7b89c92980 10 manifest: total_size = 0 2024-03-09T14:42:32.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.443+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4781985508063861981 2024-03-09T14:42:32.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.443+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9937f20 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55a1a995ed18 s->prefetch_data=0 2024-03-09T14:42:32.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.443+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a995ed18 2024-03-09T14:42:32.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.443+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7.6 2024-03-09T14:42:32.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.443+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=__ _ 2024-03-09T14:42:32.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.451+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7c0ef8c0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55a1a995ed18 s->prefetch_data=0 2024-03-09T14:42:32.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.451+0000 7f7b89c92980 10 manifest: total_size = 0 2024-03-09T14:42:32.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.451+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9982144461361560739 2024-03-09T14:42:32.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.451+0000 7f7b89c92980 20 get_obj_state: octx=0x7f7b7c0ef8c0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55a1a995ed18 s->prefetch_data=0 2024-03-09T14:42:32.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.451+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a995ed18 2024-03-09T14:42:32.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.451+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7.8 2024-03-09T14:42:32.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.455+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=__ 2024-03-09T14:42:32.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.459+0000 7f7b89c92980 20 list_objects_ordered: starting attempt 1 2024-03-09T14:42:32.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.459+0000 7f7b89c92980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:42:32.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.463+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=obj 2024-03-09T14:42:32.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.463+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:42:32.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.463+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:42:32.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.463+0000 7f7b89c92980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:42:32.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.463+0000 7f7b89c92980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:42:32.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.463+0000 7f7b89c92980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7])"; uploads.size()=0; is_truncated=0 2024-03-09T14:42:32.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.467+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-03-09T14:42:32.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.467+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.467+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=223 2024-03-09T14:42:32.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.467+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-03-09T14:42:32.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.467+0000 7f7b89c92980 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-03-09T14:42:32.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.471+0000 7f7b89c92980 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-03-09T14:42:32.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.471+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-03-09T14:42:32.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.471+0000 7f7a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464312 cookie 94152822893024 notifier 5684 bl.length()=181 2024-03-09T14:42:32.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.475+0000 7f7b89c92980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7 from cache 2024-03-09T14:42:32.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.475+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7, ofs0, ns] 2024-03-09T14:42:32.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.479+0000 7f7a6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464297 cookie 94152822908064 notifier 5684 bl.length()=238 2024-03-09T14:42:32.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.483+0000 7f7b89c92980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7 : miss 2024-03-09T14:42:32.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.483+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.487+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.487+0000 7f7b89c92980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7 info.flags=0x0 2024-03-09T14:42:32.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.487+0000 7f7b89c92980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7 to cache LRU end 2024-03-09T14:42:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.491+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8 : miss 2024-03-09T14:42:32.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.491+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.491+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=437 2024-03-09T14:42:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.491+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8 info.flags=0x17 2024-03-09T14:42:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.491+0000 7f7b89c92980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8 to cache LRU end 2024-03-09T14:42:32.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.491+0000 7f7b89c92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:32.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.491+0000 7f7b89c92980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:42:32.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.491+0000 7f7b89c92980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8 2024-03-09T14:42:32.491 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.495+0000 7f7b89c92980 10 cls_bucket_list_unordered: got ___ 2024-03-09T14:42:32.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.495+0000 7f7b89c92980 10 cls_bucket_list_unordered: got __ _ 2024-03-09T14:42:32.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.499+0000 7f7b89c92980 10 cls_bucket_list_unordered: got __ 2024-03-09T14:42:32.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.499+0000 7f7b89c92980 10 cls_bucket_list_unordered: got obj 2024-03-09T14:42:32.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.503+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99345d0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55a1a995ed18 s->prefetch_data=0 2024-03-09T14:42:32.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.503+0000 7f7b89c92980 10 manifest: total_size = 24595 2024-03-09T14:42:32.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.503+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11337754820338479604 2024-03-09T14:42:32.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.503+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99345d0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55a1a995ed18 s->prefetch_data=0 2024-03-09T14:42:32.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.503+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a995ed18 2024-03-09T14:42:32.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.503+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8.2 2024-03-09T14:42:32.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.511+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.511+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.511+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11337754820338479604 2024-03-09T14:42:32.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.511+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.511+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8__shadow_.RmMIq0OCKfLx011_fbD3V7x6_4hA8im_0 2024-03-09T14:42:32.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.511+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-03-09T14:42:32.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.511+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.511+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11337754820338479604 2024-03-09T14:42:32.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.515+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=___ 2024-03-09T14:42:32.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.515+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99345d0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55a1a995ed18 s->prefetch_data=0 2024-03-09T14:42:32.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.515+0000 7f7b89c92980 10 manifest: total_size = 527 2024-03-09T14:42:32.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.515+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12561061919858879911 2024-03-09T14:42:32.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.515+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99345d0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55a1a995ed18 s->prefetch_data=0 2024-03-09T14:42:32.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.515+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a995ed18 2024-03-09T14:42:32.513 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.515+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8.3 2024-03-09T14:42:32.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.523+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.523+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.523+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12561061919858879911 2024-03-09T14:42:32.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.523+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.523+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8__shadow_.mvyNjEtkX0W9lx7ydirgcWTqTivs-we_0 2024-03-09T14:42:32.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.523+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-03-09T14:42:32.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.523+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.523+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12561061919858879911 2024-03-09T14:42:32.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.527+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=__ _ 2024-03-09T14:42:32.523 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.527+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99345d0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55a1a995ed18 s->prefetch_data=0 2024-03-09T14:42:32.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.527+0000 7f7b89c92980 10 manifest: total_size = 527 2024-03-09T14:42:32.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.527+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7631120914895796072 2024-03-09T14:42:32.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.527+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99345d0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55a1a995ed18 s->prefetch_data=0 2024-03-09T14:42:32.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.527+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a995ed18 2024-03-09T14:42:32.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.527+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8.6 2024-03-09T14:42:32.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.535+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.535+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.535+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7631120914895796072 2024-03-09T14:42:32.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.535+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.535+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8__shadow_.A5CLBoMZCUQEj8HH9uUIV88X39q_3S0_0 2024-03-09T14:42:32.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.535+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-03-09T14:42:32.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.535+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.535+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7631120914895796072 2024-03-09T14:42:32.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.539+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99345d0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55a1a995ed18 s->prefetch_data=0 2024-03-09T14:42:32.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.539+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=__ 2024-03-09T14:42:32.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.539+0000 7f7b89c92980 10 manifest: total_size = 24595 2024-03-09T14:42:32.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.539+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14138818904124684565 2024-03-09T14:42:32.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.539+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a99345d0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55a1a995ed18 s->prefetch_data=0 2024-03-09T14:42:32.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.539+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a995ed18 2024-03-09T14:42:32.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.539+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8.8 2024-03-09T14:42:32.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.543+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.543+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.543+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14138818904124684565 2024-03-09T14:42:32.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.543+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.543+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8__shadow_.Xg5NA4dkixtEpzO8M1LeIQCCxx_JPEB_0 2024-03-09T14:42:32.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.543+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-03-09T14:42:32.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.543+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.543+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14138818904124684565 2024-03-09T14:42:32.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.547+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=obj 2024-03-09T14:42:32.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.547+0000 7f7b89c92980 20 list_objects_ordered: starting attempt 1 2024-03-09T14:42:32.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.547+0000 7f7b89c92980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:42:32.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.551+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:42:32.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.551+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:42:32.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.551+0000 7f7b89c92980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:42:32.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.551+0000 7f7b89c92980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:42:32.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.551+0000 7f7b89c92980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8])"; uploads.size()=0; is_truncated=0 2024-03-09T14:42:32.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.555+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-03-09T14:42:32.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.555+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.559+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=223 2024-03-09T14:42:32.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.559+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-03-09T14:42:32.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.559+0000 7f7b89c92980 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-03-09T14:42:32.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.559+0000 7f7b89c92980 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-03-09T14:42:32.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.559+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-03-09T14:42:32.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.559+0000 7f7a6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464313 cookie 94152822893024 notifier 5684 bl.length()=181 2024-03-09T14:42:32.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.563+0000 7f7b89c92980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8 from cache 2024-03-09T14:42:32.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.563+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8, ofs0, ns] 2024-03-09T14:42:32.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.567+0000 7f7a6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464298 cookie 94152822908064 notifier 5684 bl.length()=238 2024-03-09T14:42:32.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.575+0000 7f7b89c92980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8 : miss 2024-03-09T14:42:32.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.575+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.575+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.575+0000 7f7b89c92980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8 info.flags=0x0 2024-03-09T14:42:32.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.575+0000 7f7b89c92980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8 to cache LRU end 2024-03-09T14:42:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.579+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9 : miss 2024-03-09T14:42:32.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.579+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.583+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=437 2024-03-09T14:42:32.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.583+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9 info.flags=0x17 2024-03-09T14:42:32.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.583+0000 7f7b89c92980 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9 to cache LRU end 2024-03-09T14:42:32.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.583+0000 7f7b89c92980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:32.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.583+0000 7f7b89c92980 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-03-09T14:42:32.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.583+0000 7f7b89c92980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9 2024-03-09T14:42:32.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.583+0000 7f7b89c92980 10 cls_bucket_list_unordered: got ___ 2024-03-09T14:42:32.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.587+0000 7f7b89c92980 10 cls_bucket_list_unordered: got __ _ 2024-03-09T14:42:32.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.587+0000 7f7b89c92980 10 cls_bucket_list_unordered: got __ 2024-03-09T14:42:32.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.591+0000 7f7b89c92980 10 cls_bucket_list_unordered: got obj 2024-03-09T14:42:32.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.595+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9938170 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55a1a9949d08 s->prefetch_data=0 2024-03-09T14:42:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.595+0000 7f7b89c92980 10 manifest: total_size = 49187 2024-03-09T14:42:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.595+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8758169255122677636 2024-03-09T14:42:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.595+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9938170 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55a1a9949d08 s->prefetch_data=0 2024-03-09T14:42:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.595+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9949d08 2024-03-09T14:42:32.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.595+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9.2 2024-03-09T14:42:32.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.599+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.599+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.599+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8758169255122677636 2024-03-09T14:42:32.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.599+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.599+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9__shadow_.f49KCqiNAmzvossn9TjElJVEGnML1lB_0 2024-03-09T14:42:32.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.599+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-03-09T14:42:32.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.599+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.599+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8758169255122677636 2024-03-09T14:42:32.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.603+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9938170 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55a1a9949d08 s->prefetch_data=0 2024-03-09T14:42:32.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.603+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=___ 2024-03-09T14:42:32.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.607+0000 7f7b89c92980 10 manifest: total_size = 49187 2024-03-09T14:42:32.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.607+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16190395723998415652 2024-03-09T14:42:32.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.607+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9938170 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55a1a9949d08 s->prefetch_data=0 2024-03-09T14:42:32.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.607+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9949d08 2024-03-09T14:42:32.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.607+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9.3 2024-03-09T14:42:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.611+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.611+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.611+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16190395723998415652 2024-03-09T14:42:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.611+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.611+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9__shadow_.zB4CT-6HFmvo21jhPbzPKcN7OWb4QH6_0 2024-03-09T14:42:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.611+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-03-09T14:42:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.611+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.611+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16190395723998415652 2024-03-09T14:42:32.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.615+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=__ _ 2024-03-09T14:42:32.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.615+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9938170 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55a1a9949d08 s->prefetch_data=0 2024-03-09T14:42:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.615+0000 7f7b89c92980 10 manifest: total_size = 1048576 2024-03-09T14:42:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.615+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1785604922320076188 2024-03-09T14:42:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.615+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9938170 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55a1a9949d08 s->prefetch_data=0 2024-03-09T14:42:32.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.615+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9949d08 2024-03-09T14:42:32.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.615+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9.6 2024-03-09T14:42:32.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.623+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.623+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.623+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1785604922320076188 2024-03-09T14:42:32.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.623+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.623+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9__shadow_.dIPhjKPecdH5UW1dq-324GincVKg6Ax_0 2024-03-09T14:42:32.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.623+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-03-09T14:42:32.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.623+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.623+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1785604922320076188 2024-03-09T14:42:32.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.627+0000 7f7a6affd640 20 handle_completion(): completion ok for obj=__ 2024-03-09T14:42:32.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.627+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9938170 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55a1a9949d08 s->prefetch_data=0 2024-03-09T14:42:32.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.627+0000 7f7b89c92980 10 manifest: total_size = 4134 2024-03-09T14:42:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.627+0000 7f7b89c92980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4932823654951343289 2024-03-09T14:42:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.627+0000 7f7b89c92980 20 get_obj_state: octx=0x55a1a9938170 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55a1a9949d08 s->prefetch_data=0 2024-03-09T14:42:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.627+0000 7f7b89c92980 20 prepare_atomic_modification: state is not atomic. state=0x55a1a9949d08 2024-03-09T14:42:32.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.627+0000 7f7b89c92980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9.8 2024-03-09T14:42:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.635+0000 7f7b89c92980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:42:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.635+0000 7f7b89c92980 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-03-09T14:42:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.635+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4932823654951343289 2024-03-09T14:42:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.635+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-03-09T14:42:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.635+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9__shadow_.i-fu7AJ7B2ecP1a1PE4dsVUg3aWy0_y_0 2024-03-09T14:42:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.635+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-03-09T14:42:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.635+0000 7f7b89c92980 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-03-09T14:42:32.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.635+0000 7f7b89c92980 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4932823654951343289 2024-03-09T14:42:32.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.639+0000 7f7a6a7fc640 20 handle_completion(): completion ok for obj=obj 2024-03-09T14:42:32.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.639+0000 7f7b89c92980 20 list_objects_ordered: starting attempt 1 2024-03-09T14:42:32.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.639+0000 7f7b89c92980 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-09T14:42:32.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.643+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-09T14:42:32.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.643+0000 7f7b89c92980 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-09T14:42:32.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.643+0000 7f7b89c92980 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-09T14:42:32.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.643+0000 7f7b89c92980 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-09T14:42:32.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.643+0000 7f7b89c92980 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9])"; uploads.size()=0; is_truncated=0 2024-03-09T14:42:32.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.647+0000 7f7b89c92980 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-03-09T14:42:32.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.647+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.647+0000 7f7b89c92980 20 rados_obj.operate() r=0 bl.length=223 2024-03-09T14:42:32.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.647+0000 7f7b89c92980 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-03-09T14:42:32.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.647+0000 7f7b89c92980 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-03-09T14:42:32.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.647+0000 7f7b89c92980 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-03-09T14:42:32.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.651+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-03-09T14:42:32.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.651+0000 7f7a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464314 cookie 94152822893024 notifier 5684 bl.length()=181 2024-03-09T14:42:32.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.655+0000 7f7b89c92980 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9 from cache 2024-03-09T14:42:32.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.655+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9, ofs0, ns] 2024-03-09T14:42:32.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.655+0000 7f7a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464299 cookie 94152822908064 notifier 5684 bl.length()=238 2024-03-09T14:42:32.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.663+0000 7f7b89c92980 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9 : miss 2024-03-09T14:42:32.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.663+0000 7f7b89c92980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.663+0000 7f7b89c92980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.663+0000 7f7b89c92980 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9 info.flags=0x0 2024-03-09T14:42:32.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.663+0000 7f7b89c92980 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9 to cache LRU end 2024-03-09T14:42:32.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.667+0000 7f7b89c92980 10 removing key index: PZWEELDSVMBTIOBPRRDY 2024-03-09T14:42:32.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.671+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:PZWEELDSVMBTIOBPRRDY, ofs0, ns] 2024-03-09T14:42:32.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.671+0000 7f7a6affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464271 cookie 94152822899216 notifier 5684 bl.length()=170 2024-03-09T14:42:32.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.671+0000 7f7b89c92980 10 removing email index: ragweed.client.0+test@test.test 2024-03-09T14:42:32.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.675+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-03-09T14:42:32.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.675+0000 7f7a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464271 cookie 94152822896576 notifier 5684 bl.length()=182 2024-03-09T14:42:32.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.675+0000 7f7b89c92980 10 removing user buckets index 2024-03-09T14:42:32.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.679+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-03-09T14:42:32.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.679+0000 7f7a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464300 cookie 94152822904416 notifier 5684 bl.length()=173 2024-03-09T14:42:32.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.679+0000 7f7b89c92980 10 removing user index: ragweed.client.0 2024-03-09T14:42:32.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.683+0000 7f7b89c92980 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-03-09T14:42:32.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.683+0000 7f7b89c92980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-03-09T14:42:32.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.683+0000 7f7a6a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464334 cookie 94152822834064 notifier 5684 bl.length()=165 2024-03-09T14:42:32.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.687+0000 7f7a3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:32.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.691+0000 7f7b89c92980 20 remove_watcher() i=0 2024-03-09T14:42:32.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.691+0000 7f7b89c92980 2 removed watcher, disabling cache 2024-03-09T14:42:32.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.695+0000 7f7b89c92980 20 remove_watcher() i=1 2024-03-09T14:42:32.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.699+0000 7f7b89c92980 20 remove_watcher() i=2 2024-03-09T14:42:32.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.699+0000 7f7b89c92980 20 remove_watcher() i=3 2024-03-09T14:42:32.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.703+0000 7f7b89c92980 20 remove_watcher() i=4 2024-03-09T14:42:32.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.703+0000 7f7b89c92980 20 remove_watcher() i=5 2024-03-09T14:42:32.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.707+0000 7f7b89c92980 20 remove_watcher() i=6 2024-03-09T14:42:32.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.711+0000 7f7b89c92980 20 remove_watcher() i=7 2024-03-09T14:42:32.727 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-03-09T14:42:32.804 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:42:32.804 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:42:32.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.851+0000 7f504d33a980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.851+0000 7f504d33a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.851+0000 7f504d33a980 20 realm 2024-03-09T14:42:32.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.851+0000 7f504d33a980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.855+0000 7f504d33a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.855+0000 7f504d33a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:42:32.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.855+0000 7f504d33a980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.855+0000 7f504d33a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:32.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.855+0000 7f504d33a980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.855+0000 7f504d33a980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:32.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.855+0000 7f504d33a980 20 rados->read ofs=0 len=0 2024-03-09T14:42:32.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.859+0000 7f504d33a980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:42:32.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.859+0000 7f504d33a980 20 searching for the correct realm 2024-03-09T14:42:32.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.859+0000 7f504b653640 0 -- 172.21.15.99:0/459414944 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f5034008050 msgr2=0x7f5034047940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:32.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:32.867+0000 7f504a651640 0 -- 172.21.15.99:0/459414944 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f5044023070 msgr2=0x7f5044058050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:42:33.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.083+0000 7f504d33a980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:42:33.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.083+0000 7f504d33a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:42:33.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.083+0000 7f504d33a980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:42:33.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.083+0000 7f504d33a980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:42:33.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.083+0000 7f504d33a980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:42:33.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.083+0000 7f504d33a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:42:33.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.083+0000 7f504d33a980 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.087+0000 7f504d33a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.087+0000 7f504d33a980 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.087+0000 7f504d33a980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:42:33.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.087+0000 7f504d33a980 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.087+0000 7f504d33a980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:42:33.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.087+0000 7f504d33a980 20 zone default found 2024-03-09T14:42:33.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.087+0000 7f504d33a980 4 Realm: () 2024-03-09T14:42:33.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.087+0000 7f504d33a980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:42:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.087+0000 7f504d33a980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:42:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.087+0000 7f504d33a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:42:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.087+0000 7f504d33a980 20 zonegroup default 2024-03-09T14:42:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.087+0000 7f504d33a980 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.087+0000 7f504d33a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.087+0000 7f504d33a980 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.087+0000 7f504d33a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.087+0000 7f504d33a980 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.087+0000 7f504d33a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:42:33.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.091+0000 7f504d33a980 20 started sync module instance, tier type = 2024-03-09T14:42:33.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.091+0000 7f504d33a980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:42:33.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.111+0000 7f504d33a980 20 add_watcher() i=0 2024-03-09T14:42:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.111+0000 7f504d33a980 20 add_watcher() i=1 2024-03-09T14:42:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.111+0000 7f504d33a980 20 add_watcher() i=2 2024-03-09T14:42:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.111+0000 7f504d33a980 20 add_watcher() i=3 2024-03-09T14:42:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.111+0000 7f504d33a980 20 add_watcher() i=4 2024-03-09T14:42:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.111+0000 7f504d33a980 20 add_watcher() i=5 2024-03-09T14:42:33.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.111+0000 7f504d33a980 20 add_watcher() i=6 2024-03-09T14:42:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.115+0000 7f504d33a980 20 add_watcher() i=7 2024-03-09T14:42:33.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.115+0000 7f504d33a980 2 all 8 watchers are set, enabling cache 2024-03-09T14:42:33.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.119+0000 7f4f017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:33.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.119+0000 7f504d33a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:42:33.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.119+0000 7f504d33a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:42:33.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.199+0000 7f4e7bfff640 20 reqs_thread_entry: start 2024-03-09T14:42:33.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.199+0000 7f504d33a980 20 init_complete bucket index max shards: 11 2024-03-09T14:42:33.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.199+0000 7f504d33a980 20 Filter name: none 2024-03-09T14:42:33.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.203+0000 7f4e79ffb640 20 reqs_thread_entry: start 2024-03-09T14:42:33.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.203+0000 7f504d33a980 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-03-09T14:42:33.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.203+0000 7f504d33a980 20 rados->read ofs=0 len=0 2024-03-09T14:42:33.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.203+0000 7f504d33a980 20 rados_obj.operate() r=0 bl.length=486 2024-03-09T14:42:33.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.203+0000 7f504d33a980 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-03-09T14:42:33.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.203+0000 7f504d33a980 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-03-09T14:42:33.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.203+0000 7f504d33a980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:42:33.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.203+0000 7f504d33a980 10 removing key index: WKVVHKASRZIPTMPTNZYC 2024-03-09T14:42:33.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.207+0000 7f504d33a980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:WKVVHKASRZIPTMPTNZYC, ofs0, ns] 2024-03-09T14:42:33.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.207+0000 7f4f2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464301 cookie 94121006053888 notifier 5699 bl.length()=170 2024-03-09T14:42:33.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.207+0000 7f504d33a980 10 removing email index: sysuser.client.0+test@test.test 2024-03-09T14:42:33.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.211+0000 7f504d33a980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-03-09T14:42:33.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.211+0000 7f4f2e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464335 cookie 94121006051040 notifier 5699 bl.length()=182 2024-03-09T14:42:33.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.211+0000 7f504d33a980 10 removing user buckets index 2024-03-09T14:42:33.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.215+0000 7f504d33a980 10 removing user index: sysuser.client.0 2024-03-09T14:42:33.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.215+0000 7f504d33a980 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-03-09T14:42:33.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.215+0000 7f504d33a980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-03-09T14:42:33.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.219+0000 7f4f2dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464272 cookie 94121006044544 notifier 5699 bl.length()=165 2024-03-09T14:42:33.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.219+0000 7f4f017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:42:33.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.223+0000 7f504d33a980 20 remove_watcher() i=0 2024-03-09T14:42:33.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.223+0000 7f504d33a980 2 removed watcher, disabling cache 2024-03-09T14:42:33.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.227+0000 7f504d33a980 20 remove_watcher() i=1 2024-03-09T14:42:33.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.231+0000 7f504d33a980 20 remove_watcher() i=2 2024-03-09T14:42:33.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.231+0000 7f504d33a980 20 remove_watcher() i=3 2024-03-09T14:42:33.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.235+0000 7f504d33a980 20 remove_watcher() i=4 2024-03-09T14:42:33.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.235+0000 7f504d33a980 20 remove_watcher() i=5 2024-03-09T14:42:33.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.235+0000 7f504d33a980 20 remove_watcher() i=6 2024-03-09T14:42:33.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:42:33.239+0000 7f504d33a980 20 remove_watcher() i=7 2024-03-09T14:42:33.250 INFO:tasks.ragweed:Removing ragweed... 2024-03-09T14:42:33.251 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-03-09T14:42:33.339 INFO:teuthology.run_tasks:Running task workunit... 2024-03-09T14:42:33.355 INFO:tasks.workunit:Pulling workunits from ref c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:42:33.355 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-09T14:42:33.355 DEBUG:teuthology.orchestra.run.smithi099:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:42:33.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T14:42:33.363 INFO:teuthology.orchestra.run.smithi099.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-03-09T14:42:33.363 DEBUG:teuthology.orchestra.run.smithi099:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:42:33.410 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-03-09T14:42:33.410 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-03-09T14:42:33.458 INFO:tasks.workunit:timeout=3h 2024-03-09T14:42:33.458 INFO:tasks.workunit:cleanup=True 2024-03-09T14:42:33.458 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout c00d9c609fb42a2a25f1c196bed064ca8bb02413 2024-03-09T14:42:33.508 INFO:tasks.workunit.client.0.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-09T14:43:47.533 INFO:tasks.workunit.client.0.smithi099.stderr:Note: switching to 'c00d9c609fb42a2a25f1c196bed064ca8bb02413'. 2024-03-09T14:43:47.533 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:43:47.533 INFO:tasks.workunit.client.0.smithi099.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-09T14:43:47.533 INFO:tasks.workunit.client.0.smithi099.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-09T14:43:47.533 INFO:tasks.workunit.client.0.smithi099.stderr:state without impacting any branches by switching back to a branch. 2024-03-09T14:43:47.533 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:43:47.534 INFO:tasks.workunit.client.0.smithi099.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-09T14:43:47.534 INFO:tasks.workunit.client.0.smithi099.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-09T14:43:47.534 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:43:47.534 INFO:tasks.workunit.client.0.smithi099.stderr: git switch -c 2024-03-09T14:43:47.534 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:43:47.534 INFO:tasks.workunit.client.0.smithi099.stderr:Or undo this operation with: 2024-03-09T14:43:47.534 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:43:47.534 INFO:tasks.workunit.client.0.smithi099.stderr: git switch - 2024-03-09T14:43:47.534 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:43:47.534 INFO:tasks.workunit.client.0.smithi099.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-09T14:43:47.534 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:43:47.534 INFO:tasks.workunit.client.0.smithi099.stderr:HEAD is now at c00d9c609fb DNM: point s3tests at branch cbodley:wip-iam-user-apis 2024-03-09T14:43:47.538 DEBUG:teuthology.orchestra.run.smithi099:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-09T14:43:47.586 INFO:tasks.workunit.client.0.smithi099.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-09T14:43:47.590 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:43:47.590 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-09T14:43:47.647 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-09T14:43:47.704 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-09T14:43:47.748 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-09T14:43:47.750 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:43:47.750 INFO:tasks.workunit.client.0.smithi099.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-09T14:43:47.797 INFO:tasks.workunit.client.0.smithi099.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-09T14:43:47.801 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:43:47.801 DEBUG:teuthology.orchestra.run.smithi099:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-09T14:43:47.846 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-03-09T14:43:47.847 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-03-09T14:43:47.848 DEBUG:teuthology.orchestra.run.smithi099:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c00d9c609fb42a2a25f1c196bed064ca8bb02413 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-03-09T14:43:47.899 INFO:tasks.workunit.client.0.smithi099.stderr:+ ulimit -c 0 2024-03-09T14:43:47.899 INFO:tasks.workunit.client.0.smithi099.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-03-09T14:43:47.900 INFO:tasks.workunit.client.0.smithi099.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:43:47.900 INFO:tasks.workunit.client.0.smithi099.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:43:50.846 INFO:tasks.workunit.client.0.smithi099.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-03-09T14:43:50.846 INFO:tasks.workunit.client.0.smithi099.stderr:++ deactivate nondestructive 2024-03-09T14:43:50.846 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-03-09T14:43:50.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-03-09T14:43:50.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:43:50.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ hash -r 2024-03-09T14:43:50.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-03-09T14:43:50.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset VIRTUAL_ENV 2024-03-09T14:43:50.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-03-09T14:43:50.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-03-09T14:43:50.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-03-09T14:43:50.847 INFO:tasks.workunit.client.0.smithi099.stderr:++ export VIRTUAL_ENV 2024-03-09T14:43:50.848 INFO:tasks.workunit.client.0.smithi099.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-03-09T14:43:50.848 INFO:tasks.workunit.client.0.smithi099.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-03-09T14:43:50.848 INFO:tasks.workunit.client.0.smithi099.stderr:++ export PATH 2024-03-09T14:43:50.848 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n '' ']' 2024-03-09T14:43:50.848 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -z '' ']' 2024-03-09T14:43:50.849 INFO:tasks.workunit.client.0.smithi099.stderr:++ _OLD_VIRTUAL_PS1= 2024-03-09T14:43:50.849 INFO:tasks.workunit.client.0.smithi099.stderr:++ PS1='(rgw) ' 2024-03-09T14:43:50.849 INFO:tasks.workunit.client.0.smithi099.stderr:++ export PS1 2024-03-09T14:43:50.849 INFO:tasks.workunit.client.0.smithi099.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-03-09T14:43:50.849 INFO:tasks.workunit.client.0.smithi099.stderr:++ export VIRTUAL_ENV_PROMPT 2024-03-09T14:43:50.849 INFO:tasks.workunit.client.0.smithi099.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:43:50.849 INFO:tasks.workunit.client.0.smithi099.stderr:++ hash -r 2024-03-09T14:43:50.849 INFO:tasks.workunit.client.0.smithi099.stderr:+ pip install pip --upgrade 2024-03-09T14:43:51.240 INFO:tasks.workunit.client.0.smithi099.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-03-09T14:43:51.493 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting pip 2024-03-09T14:43:51.500 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached pip-24.0-py3-none-any.whl (2.1 MB) 2024-03-09T14:43:51.537 INFO:tasks.workunit.client.0.smithi099.stdout:Installing collected packages: pip 2024-03-09T14:43:51.537 INFO:tasks.workunit.client.0.smithi099.stdout: Attempting uninstall: pip 2024-03-09T14:43:51.537 INFO:tasks.workunit.client.0.smithi099.stdout: Found existing installation: pip 22.0.2 2024-03-09T14:43:51.813 INFO:tasks.workunit.client.0.smithi099.stdout: Uninstalling pip-22.0.2: 2024-03-09T14:43:51.819 INFO:tasks.workunit.client.0.smithi099.stdout: Successfully uninstalled pip-22.0.2 2024-03-09T14:43:52.846 INFO:tasks.workunit.client.0.smithi099.stdout:Successfully installed pip-24.0 2024-03-09T14:43:52.916 INFO:tasks.workunit.client.0.smithi099.stderr:+ pip install boto3 2024-03-09T14:43:53.819 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting boto3 2024-03-09T14:43:53.820 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached boto3-1.34.59-py3-none-any.whl.metadata (6.6 kB) 2024-03-09T14:43:54.319 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting botocore<1.35.0,>=1.34.59 (from boto3) 2024-03-09T14:43:54.321 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached botocore-1.34.59-py3-none-any.whl.metadata (5.7 kB) 2024-03-09T14:43:54.382 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-03-09T14:43:54.382 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-03-09T14:43:54.434 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-03-09T14:43:54.435 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached s3transfer-0.10.0-py3-none-any.whl.metadata (1.7 kB) 2024-03-09T14:43:54.516 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:43:54.518 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-03-09T14:43:54.629 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting urllib3<2.1,>=1.25.4 (from botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:43:54.630 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached urllib3-2.0.7-py3-none-any.whl.metadata (6.6 kB) 2024-03-09T14:43:54.782 INFO:tasks.workunit.client.0.smithi099.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.35.0,>=1.34.59->boto3) 2024-03-09T14:43:54.783 INFO:tasks.workunit.client.0.smithi099.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-03-09T14:43:54.797 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached boto3-1.34.59-py3-none-any.whl (139 kB) 2024-03-09T14:43:54.798 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached botocore-1.34.59-py3-none-any.whl (12.0 MB) 2024-03-09T14:43:54.819 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-03-09T14:43:54.820 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached s3transfer-0.10.0-py3-none-any.whl (82 kB) 2024-03-09T14:43:54.822 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-03-09T14:43:54.823 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached urllib3-2.0.7-py3-none-any.whl (124 kB) 2024-03-09T14:43:54.825 INFO:tasks.workunit.client.0.smithi099.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-03-09T14:43:54.917 INFO:tasks.workunit.client.0.smithi099.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-03-09T14:43:56.102 INFO:tasks.workunit.client.0.smithi099.stdout:Successfully installed boto3-1.34.59 botocore-1.34.59 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.0 six-1.16.0 urllib3-2.0.7 2024-03-09T14:43:56.267 INFO:tasks.workunit.client.0.smithi099.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-03-09T14:43:56.405 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-03-09T14:43:56.444 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:43:56.444 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:43:56.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.493+0000 7f28da47d980 20 rados->read ofs=0 len=0 2024-03-09T14:43:56.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.493+0000 7f28da47d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:56.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.493+0000 7f28da47d980 20 realm 2024-03-09T14:43:56.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.493+0000 7f28da47d980 20 rados->read ofs=0 len=0 2024-03-09T14:43:56.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.493+0000 7f28da47d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:56.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.493+0000 7f28da47d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:43:56.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.493+0000 7f28da47d980 20 rados->read ofs=0 len=0 2024-03-09T14:43:56.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.493+0000 7f28da47d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:56.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.493+0000 7f28da47d980 20 rados->read ofs=0 len=0 2024-03-09T14:43:56.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.497+0000 7f28da47d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:56.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.497+0000 7f28da47d980 20 rados->read ofs=0 len=0 2024-03-09T14:43:56.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.497+0000 7f28da47d980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:43:56.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.497+0000 7f28da47d980 20 searching for the correct realm 2024-03-09T14:43:56.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.501+0000 7f28d8796640 0 -- 172.21.15.99:0/101826796 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f28cc05d620 msgr2=0x7f28cc07b1f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:56.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.509+0000 7f28d7794640 0 -- 172.21.15.99:0/101826796 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f28d00d6aa0 msgr2=0x7f28d0009cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:43:56.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.725+0000 7f28da47d980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:43:56.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.725+0000 7f28da47d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:43:56.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.725+0000 7f28da47d980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:43:56.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.725+0000 7f28da47d980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:43:56.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.725+0000 7f28da47d980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:43:56.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.725+0000 7f28da47d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:43:56.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.725+0000 7f28da47d980 20 rados->read ofs=0 len=0 2024-03-09T14:43:56.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.725+0000 7f28da47d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:56.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.725+0000 7f28da47d980 20 rados->read ofs=0 len=0 2024-03-09T14:43:56.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.729+0000 7f28da47d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:43:56.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.729+0000 7f28da47d980 20 rados->read ofs=0 len=0 2024-03-09T14:43:56.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.729+0000 7f28da47d980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:43:56.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.729+0000 7f28da47d980 20 zone default found 2024-03-09T14:43:56.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.729+0000 7f28da47d980 4 Realm: () 2024-03-09T14:43:56.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.729+0000 7f28da47d980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:43:56.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.729+0000 7f28da47d980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:43:56.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.729+0000 7f28da47d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:43:56.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.729+0000 7f28da47d980 20 zonegroup default 2024-03-09T14:43:56.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.729+0000 7f28da47d980 20 rados->read ofs=0 len=0 2024-03-09T14:43:56.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.729+0000 7f28da47d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:56.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.729+0000 7f28da47d980 20 rados->read ofs=0 len=0 2024-03-09T14:43:56.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.729+0000 7f28da47d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:56.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.729+0000 7f28da47d980 20 rados->read ofs=0 len=0 2024-03-09T14:43:56.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.729+0000 7f28da47d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:56.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.729+0000 7f28da47d980 20 started sync module instance, tier type = 2024-03-09T14:43:56.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.729+0000 7f28da47d980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:43:56.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.753+0000 7f28da47d980 20 add_watcher() i=0 2024-03-09T14:43:56.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.753+0000 7f28da47d980 20 add_watcher() i=1 2024-03-09T14:43:56.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.753+0000 7f28da47d980 20 add_watcher() i=2 2024-03-09T14:43:56.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.753+0000 7f28da47d980 20 add_watcher() i=3 2024-03-09T14:43:56.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.753+0000 7f28da47d980 20 add_watcher() i=4 2024-03-09T14:43:56.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.753+0000 7f28da47d980 20 add_watcher() i=5 2024-03-09T14:43:56.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.753+0000 7f28da47d980 20 add_watcher() i=6 2024-03-09T14:43:56.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.757+0000 7f28da47d980 20 add_watcher() i=7 2024-03-09T14:43:56.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.757+0000 7f28da47d980 2 all 8 watchers are set, enabling cache 2024-03-09T14:43:56.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.761+0000 7f278dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:56.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.761+0000 7f28da47d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:43:56.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.761+0000 7f28da47d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:43:56.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.761+0000 7f28da47d980 5 note: GC not initialized 2024-03-09T14:43:56.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.761+0000 7f278cfe1640 20 reqs_thread_entry: start 2024-03-09T14:43:56.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.761+0000 7f28da47d980 20 init_complete bucket index max shards: 11 2024-03-09T14:43:56.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.761+0000 7f28da47d980 20 Filter name: none 2024-03-09T14:43:56.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f27067fc640 20 reqs_thread_entry: start 2024-03-09T14:43:56.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-03-09T14:43:56.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 20 rados->read ofs=0 len=0 2024-03-09T14:43:56.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:43:56.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-03-09T14:43:56.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-03-09T14:43:56.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-03-09T14:43:56.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 20 rados->read ofs=0 len=0 2024-03-09T14:43:56.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 20 rados_obj.operate() r=0 bl.length=22 2024-03-09T14:43:56.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x5 2024-03-09T14:43:56.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-09T14:43:56.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 10 cache get: name=default.rgw.meta+users.uid+rgw_datacache_user : miss 2024-03-09T14:43:56.760 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 20 rados->read ofs=0 len=0 2024-03-09T14:43:56.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 20 rados_obj.operate() r=0 bl.length=420 2024-03-09T14:43:56.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 10 cache put: name=default.rgw.meta+users.uid+rgw_datacache_user info.flags=0x13 2024-03-09T14:43:56.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 10 adding default.rgw.meta+users.uid+rgw_datacache_user to cache LRU end 2024-03-09T14:43:56.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:43:56.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+rgw_datacache_user 2024-03-09T14:43:56.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.765+0000 7f28da47d980 20 get_user_info_from_index found 0 xattrs 2024-03-09T14:43:56.761 INFO:tasks.workunit.client.0.smithi099.stderr:could not create user: unable to parse parameters, duplicate key provided 2024-03-09T14:43:56.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.769+0000 7f278dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:43:56.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.773+0000 7f28da47d980 20 remove_watcher() i=0 2024-03-09T14:43:56.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.773+0000 7f28da47d980 2 removed watcher, disabling cache 2024-03-09T14:43:56.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.773+0000 7f28da47d980 20 remove_watcher() i=1 2024-03-09T14:43:56.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.777+0000 7f28da47d980 20 remove_watcher() i=2 2024-03-09T14:43:56.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.781+0000 7f28da47d980 20 remove_watcher() i=3 2024-03-09T14:43:56.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.781+0000 7f28da47d980 20 remove_watcher() i=4 2024-03-09T14:43:56.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.785+0000 7f28da47d980 20 remove_watcher() i=5 2024-03-09T14:43:56.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.785+0000 7f28da47d980 20 remove_watcher() i=6 2024-03-09T14:43:56.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:43:56.785+0000 7f28da47d980 20 remove_watcher() i=7 2024-03-09T14:44:07.546 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:07.546 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:07.601 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:07.601 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:07.634 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:07.634 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:07.666 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:07.666 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:07.680 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:07.680 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:07.726 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:07.726 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:07.771 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard add 2024-03-09T14:44:07.771 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:07.771 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-09T14:44:07.804 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:07.804 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:07.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:07.857+0000 7efd43a73980 20 rados->read ofs=0 len=0 2024-03-09T14:44:07.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:07.857+0000 7efd43a73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:07.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:07.857+0000 7efd43a73980 20 realm 2024-03-09T14:44:07.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:07.857+0000 7efd43a73980 20 rados->read ofs=0 len=0 2024-03-09T14:44:07.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:07.857+0000 7efd43a73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:07.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:07.857+0000 7efd43a73980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:07.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:07.857+0000 7efd43a73980 20 rados->read ofs=0 len=0 2024-03-09T14:44:07.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:07.857+0000 7efd43a73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:07.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:07.857+0000 7efd43a73980 20 rados->read ofs=0 len=0 2024-03-09T14:44:07.853 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:07.861+0000 7efd43a73980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:07.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:07.861+0000 7efd43a73980 20 rados->read ofs=0 len=0 2024-03-09T14:44:07.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:07.861+0000 7efd43a73980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:07.855 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:07.861+0000 7efd43a73980 20 searching for the correct realm 2024-03-09T14:44:07.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:07.865+0000 7efd41d8c640 0 -- 172.21.15.99:0/2328227998 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55626914d420 msgr2=0x55626914f810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:07.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:07.873+0000 7efd40d8a640 0 -- 172.21.15.99:0/2328227998 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7efd3c055bd0 msgr2=0x7efd3c06d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:08.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.089+0000 7efd43a73980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:08.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.089+0000 7efd43a73980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:08.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.089+0000 7efd43a73980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:08.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.089+0000 7efd43a73980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:08.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.089+0000 7efd43a73980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:08.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.089+0000 7efd43a73980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:08.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.089+0000 7efd43a73980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.089+0000 7efd43a73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.089+0000 7efd43a73980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.093+0000 7efd43a73980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:08.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.093+0000 7efd43a73980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.093+0000 7efd43a73980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:08.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.093+0000 7efd43a73980 20 zone default found 2024-03-09T14:44:08.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.093+0000 7efd43a73980 4 Realm: () 2024-03-09T14:44:08.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.093+0000 7efd43a73980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:08.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.093+0000 7efd43a73980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:08.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.093+0000 7efd43a73980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:08.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.093+0000 7efd43a73980 20 zonegroup default 2024-03-09T14:44:08.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.093+0000 7efd43a73980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.093+0000 7efd43a73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.093+0000 7efd43a73980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.093+0000 7efd43a73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.093+0000 7efd43a73980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.093+0000 7efd43a73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.093+0000 7efd43a73980 20 started sync module instance, tier type = 2024-03-09T14:44:08.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.093+0000 7efd43a73980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.117+0000 7efd43a73980 20 add_watcher() i=0 2024-03-09T14:44:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.117+0000 7efd43a73980 20 add_watcher() i=1 2024-03-09T14:44:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.117+0000 7efd43a73980 20 add_watcher() i=2 2024-03-09T14:44:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.117+0000 7efd43a73980 20 add_watcher() i=3 2024-03-09T14:44:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.117+0000 7efd43a73980 20 add_watcher() i=4 2024-03-09T14:44:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.117+0000 7efd43a73980 20 add_watcher() i=5 2024-03-09T14:44:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.121+0000 7efd43a73980 20 add_watcher() i=6 2024-03-09T14:44:08.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.121+0000 7efd43a73980 20 add_watcher() i=7 2024-03-09T14:44:08.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.121+0000 7efd43a73980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:08.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.125+0000 7efbf77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:08.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.125+0000 7efd43a73980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:08.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.125+0000 7efd43a73980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:08.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.125+0000 7efd43a73980 5 note: GC not initialized 2024-03-09T14:44:08.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.125+0000 7efbf67e4640 20 reqs_thread_entry: start 2024-03-09T14:44:08.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.129+0000 7efd43a73980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:08.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.129+0000 7efd43a73980 20 Filter name: none 2024-03-09T14:44:08.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.129+0000 7efb67fff640 20 reqs_thread_entry: start 2024-03-09T14:44:08.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.129+0000 7efd43a73980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.129+0000 7efd43a73980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:44:08.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.129+0000 7efd43a73980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.133+0000 7efd43a73980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:44:08.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.133+0000 7efd43a73980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:08.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.133+0000 7efd43a73980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.133+0000 7efd43a73980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:44:08.127 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.133+0000 7efd43a73980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.133+0000 7efd43a73980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:44:08.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.133+0000 7efd43a73980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:08.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.137+0000 7efd43a73980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.137+0000 7efd43a73980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.137+0000 7efbf77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:08.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.145+0000 7efd43a73980 20 remove_watcher() i=0 2024-03-09T14:44:08.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.145+0000 7efd43a73980 2 removed watcher, disabling cache 2024-03-09T14:44:08.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.145+0000 7efd43a73980 20 remove_watcher() i=1 2024-03-09T14:44:08.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.149+0000 7efd43a73980 20 remove_watcher() i=2 2024-03-09T14:44:08.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.149+0000 7efd43a73980 20 remove_watcher() i=3 2024-03-09T14:44:08.148 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.153+0000 7efd43a73980 20 remove_watcher() i=4 2024-03-09T14:44:08.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.157+0000 7efd43a73980 20 remove_watcher() i=5 2024-03-09T14:44:08.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.157+0000 7efd43a73980 20 remove_watcher() i=6 2024-03-09T14:44:08.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.157+0000 7efd43a73980 20 remove_watcher() i=7 2024-03-09T14:44:08.168 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:08.168 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:44:08.169 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: a-bucket id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-03-09T14:44:08.169 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:08.169 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-03-09T14:44:08.201 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:08.201 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:08.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.249+0000 7f546adf2980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.253+0000 7f546adf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.253+0000 7f546adf2980 20 realm 2024-03-09T14:44:08.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.253+0000 7f546adf2980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.253+0000 7f546adf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.253+0000 7f546adf2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:08.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.253+0000 7f546adf2980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.253+0000 7f546adf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.253+0000 7f546adf2980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.253+0000 7f546adf2980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:08.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.253+0000 7f546adf2980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.257+0000 7f546adf2980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:08.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.257+0000 7f546adf2980 20 searching for the correct realm 2024-03-09T14:44:08.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.261+0000 7f546890a640 0 -- 172.21.15.99:0/1251246617 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x55d00a6eb3a0 msgr2=0x55d00a6ed860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:08.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.265+0000 7f5463fff640 0 -- 172.21.15.99:0/1251246617 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f54640513f0 msgr2=0x7f5464051870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:08.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.273+0000 7f546adf2980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:08.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.273+0000 7f546adf2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:08.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.273+0000 7f546adf2980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:08.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.273+0000 7f546adf2980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:08.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.273+0000 7f546adf2980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:08.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.273+0000 7f546adf2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:08.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.273+0000 7f546adf2980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.273+0000 7f546adf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.273+0000 7f546adf2980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.277+0000 7f546adf2980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:08.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.277+0000 7f546adf2980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.277+0000 7f546adf2980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:08.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.277+0000 7f546adf2980 20 zone default found 2024-03-09T14:44:08.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.277+0000 7f546adf2980 4 Realm: () 2024-03-09T14:44:08.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.277+0000 7f546adf2980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:08.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.277+0000 7f546adf2980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:08.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.277+0000 7f546adf2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:08.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.277+0000 7f546adf2980 20 zonegroup default 2024-03-09T14:44:08.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.277+0000 7f546adf2980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.277+0000 7f546adf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.277+0000 7f546adf2980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.277+0000 7f546adf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.277+0000 7f546adf2980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.277+0000 7f546adf2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.277+0000 7f546adf2980 20 started sync module instance, tier type = 2024-03-09T14:44:08.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.277+0000 7f546adf2980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:08.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.293+0000 7f546adf2980 20 add_watcher() i=0 2024-03-09T14:44:08.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.293+0000 7f546adf2980 20 add_watcher() i=1 2024-03-09T14:44:08.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.293+0000 7f546adf2980 20 add_watcher() i=2 2024-03-09T14:44:08.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.293+0000 7f546adf2980 20 add_watcher() i=3 2024-03-09T14:44:08.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.293+0000 7f546adf2980 20 add_watcher() i=4 2024-03-09T14:44:08.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.293+0000 7f546adf2980 20 add_watcher() i=5 2024-03-09T14:44:08.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.293+0000 7f546adf2980 20 add_watcher() i=6 2024-03-09T14:44:08.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.293+0000 7f546adf2980 20 add_watcher() i=7 2024-03-09T14:44:08.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.293+0000 7f546adf2980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:08.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.297+0000 7f531efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:08.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.297+0000 7f546adf2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:08.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.297+0000 7f546adf2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:08.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.297+0000 7f546adf2980 5 note: GC not initialized 2024-03-09T14:44:08.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.297+0000 7f531dfe3640 20 reqs_thread_entry: start 2024-03-09T14:44:08.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.297+0000 7f546adf2980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:08.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.297+0000 7f546adf2980 20 Filter name: none 2024-03-09T14:44:08.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.297+0000 7f528f7fe640 20 reqs_thread_entry: start 2024-03-09T14:44:08.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.297+0000 7f546adf2980 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-09T14:44:08.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.297+0000 7f546adf2980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.297+0000 7f546adf2980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:44:08.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.297+0000 7f546adf2980 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-03-09T14:44:08.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.297+0000 7f546adf2980 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-09T14:44:08.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.297+0000 7f546adf2980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 : miss 2024-03-09T14:44:08.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.297+0000 7f546adf2980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.301+0000 7f546adf2980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:44:08.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.301+0000 7f546adf2980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 info.flags=0x17 2024-03-09T14:44:08.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.301+0000 7f546adf2980 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 to cache LRU end 2024-03-09T14:44:08.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.301+0000 7f546adf2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:08.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.301+0000 7f546adf2980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:44:08.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.301+0000 7f546adf2980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 2024-03-09T14:44:08.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.301+0000 7f531efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:08.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.305+0000 7f546adf2980 20 remove_watcher() i=0 2024-03-09T14:44:08.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.305+0000 7f546adf2980 2 removed watcher, disabling cache 2024-03-09T14:44:08.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.309+0000 7f546adf2980 20 remove_watcher() i=1 2024-03-09T14:44:08.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.313+0000 7f546adf2980 20 remove_watcher() i=2 2024-03-09T14:44:08.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.313+0000 7f546adf2980 20 remove_watcher() i=3 2024-03-09T14:44:08.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.317+0000 7f546adf2980 20 remove_watcher() i=4 2024-03-09T14:44:08.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.317+0000 7f546adf2980 20 remove_watcher() i=5 2024-03-09T14:44:08.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.317+0000 7f546adf2980 20 remove_watcher() i=6 2024-03-09T14:44:08.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.321+0000 7f546adf2980 20 remove_watcher() i=7 2024-03-09T14:44:08.327 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshard list 2024-03-09T14:44:08.351 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:08.351 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:08.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.401+0000 7f27c42f8980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.401+0000 7f27c42f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.401+0000 7f27c42f8980 20 realm 2024-03-09T14:44:08.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.401+0000 7f27c42f8980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.401+0000 7f27c42f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.401+0000 7f27c42f8980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:08.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.401+0000 7f27c42f8980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.401+0000 7f27c42f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.401+0000 7f27c42f8980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.405+0000 7f27c42f8980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:08.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.405+0000 7f27c42f8980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.405+0000 7f27c42f8980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:08.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.405+0000 7f27c42f8980 20 searching for the correct realm 2024-03-09T14:44:08.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.409+0000 7f27c2611640 0 -- 172.21.15.99:0/2783079743 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f27b80f0040 msgr2=0x7f27b80ef410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:08.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.417+0000 7f27c160f640 0 -- 172.21.15.99:0/2783079743 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f27bc07d400 msgr2=0x7f27bc00e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:08.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.633+0000 7f27c42f8980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:08.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.633+0000 7f27c42f8980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:08.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.633+0000 7f27c42f8980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:08.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.633+0000 7f27c42f8980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:08.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.633+0000 7f27c42f8980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:08.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.633+0000 7f27c42f8980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:08.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.633+0000 7f27c42f8980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.633+0000 7f27c42f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.633+0000 7f27c42f8980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.637+0000 7f27c42f8980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:08.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.637+0000 7f27c42f8980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.637+0000 7f27c42f8980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:08.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.637+0000 7f27c42f8980 20 zone default found 2024-03-09T14:44:08.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.637+0000 7f27c42f8980 4 Realm: () 2024-03-09T14:44:08.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.637+0000 7f27c42f8980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:08.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.637+0000 7f27c42f8980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:08.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.637+0000 7f27c42f8980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:08.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.637+0000 7f27c42f8980 20 zonegroup default 2024-03-09T14:44:08.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.637+0000 7f27c42f8980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.637+0000 7f27c42f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.637+0000 7f27c42f8980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.637+0000 7f27c42f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.637+0000 7f27c42f8980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.637+0000 7f27c42f8980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.637+0000 7f27c42f8980 20 started sync module instance, tier type = 2024-03-09T14:44:08.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.637+0000 7f27c42f8980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:08.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.661+0000 7f27c42f8980 20 add_watcher() i=0 2024-03-09T14:44:08.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.661+0000 7f27c42f8980 20 add_watcher() i=1 2024-03-09T14:44:08.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.661+0000 7f27c42f8980 20 add_watcher() i=2 2024-03-09T14:44:08.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.661+0000 7f27c42f8980 20 add_watcher() i=3 2024-03-09T14:44:08.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.661+0000 7f27c42f8980 20 add_watcher() i=4 2024-03-09T14:44:08.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.661+0000 7f27c42f8980 20 add_watcher() i=5 2024-03-09T14:44:08.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.661+0000 7f27c42f8980 20 add_watcher() i=6 2024-03-09T14:44:08.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.661+0000 7f27c42f8980 20 add_watcher() i=7 2024-03-09T14:44:08.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.661+0000 7f27c42f8980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:08.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.665+0000 7f26737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:08.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.665+0000 7f27c42f8980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:08.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.665+0000 7f27c42f8980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:08.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.665+0000 7f27c42f8980 5 note: GC not initialized 2024-03-09T14:44:08.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.665+0000 7f26727fc640 20 reqs_thread_entry: start 2024-03-09T14:44:08.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.665+0000 7f27c42f8980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:08.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.665+0000 7f27c42f8980 20 Filter name: none 2024-03-09T14:44:08.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.665+0000 7f25e3fff640 20 reqs_thread_entry: start 2024-03-09T14:44:08.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.681+0000 7f26737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:08.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.685+0000 7f27c42f8980 20 remove_watcher() i=0 2024-03-09T14:44:08.679 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.685+0000 7f27c42f8980 2 removed watcher, disabling cache 2024-03-09T14:44:08.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.685+0000 7f27c42f8980 20 remove_watcher() i=1 2024-03-09T14:44:08.684 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.689+0000 7f27c42f8980 20 remove_watcher() i=2 2024-03-09T14:44:08.686 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.693+0000 7f27c42f8980 20 remove_watcher() i=3 2024-03-09T14:44:08.688 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.693+0000 7f27c42f8980 20 remove_watcher() i=4 2024-03-09T14:44:08.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.697+0000 7f27c42f8980 20 remove_watcher() i=5 2024-03-09T14:44:08.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.697+0000 7f27c42f8980 20 remove_watcher() i=6 2024-03-09T14:44:08.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.697+0000 7f27c42f8980 20 remove_watcher() i=7 2024-03-09T14:44:08.709 INFO:tasks.workunit.client.0.smithi099.stderr:bucket name a-bucket 2024-03-09T14:44:08.710 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard process 2024-03-09T14:44:08.710 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:08.710 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshard process 2024-03-09T14:44:08.737 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:08.738 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:08.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.789+0000 7f8ccd816980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.789+0000 7f8ccd816980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.789+0000 7f8ccd816980 20 realm 2024-03-09T14:44:08.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.789+0000 7f8ccd816980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.789+0000 7f8ccd816980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.789+0000 7f8ccd816980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:08.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.789+0000 7f8ccd816980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.789+0000 7f8ccd816980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:08.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.789+0000 7f8ccd816980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.793+0000 7f8ccd816980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:08.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.793+0000 7f8ccd816980 20 rados->read ofs=0 len=0 2024-03-09T14:44:08.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.793+0000 7f8ccd816980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:08.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.793+0000 7f8ccd816980 20 searching for the correct realm 2024-03-09T14:44:08.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.797+0000 7f8ccab2d640 0 -- 172.21.15.99:0/2360156664 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f8cbc030040 msgr2=0x7f8cbc03b920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:08.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:08.805+0000 7f8ccab2d640 0 -- 172.21.15.99:0/2360156664 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f8cc408d280 msgr2=0x7f8cc4076450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:09.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.021+0000 7f8ccd816980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:09.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.021+0000 7f8ccd816980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:09.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.021+0000 7f8ccd816980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:09.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.021+0000 7f8ccd816980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:09.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.021+0000 7f8ccd816980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:09.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.021+0000 7f8ccd816980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:09.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.021+0000 7f8ccd816980 20 rados->read ofs=0 len=0 2024-03-09T14:44:09.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.021+0000 7f8ccd816980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:09.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.021+0000 7f8ccd816980 20 rados->read ofs=0 len=0 2024-03-09T14:44:09.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.025+0000 7f8ccd816980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:09.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.025+0000 7f8ccd816980 20 rados->read ofs=0 len=0 2024-03-09T14:44:09.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.025+0000 7f8ccd816980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:09.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.025+0000 7f8ccd816980 20 zone default found 2024-03-09T14:44:09.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.025+0000 7f8ccd816980 4 Realm: () 2024-03-09T14:44:09.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.025+0000 7f8ccd816980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:09.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.025+0000 7f8ccd816980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:09.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.025+0000 7f8ccd816980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:09.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.025+0000 7f8ccd816980 20 zonegroup default 2024-03-09T14:44:09.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.025+0000 7f8ccd816980 20 rados->read ofs=0 len=0 2024-03-09T14:44:09.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.025+0000 7f8ccd816980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:09.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.025+0000 7f8ccd816980 20 rados->read ofs=0 len=0 2024-03-09T14:44:09.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.025+0000 7f8ccd816980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:09.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.025+0000 7f8ccd816980 20 rados->read ofs=0 len=0 2024-03-09T14:44:09.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.025+0000 7f8ccd816980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:09.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.025+0000 7f8ccd816980 20 started sync module instance, tier type = 2024-03-09T14:44:09.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.025+0000 7f8ccd816980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:09.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.053+0000 7f8ccd816980 20 add_watcher() i=0 2024-03-09T14:44:09.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.053+0000 7f8ccd816980 20 add_watcher() i=1 2024-03-09T14:44:09.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.053+0000 7f8ccd816980 20 add_watcher() i=2 2024-03-09T14:44:09.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.053+0000 7f8ccd816980 20 add_watcher() i=3 2024-03-09T14:44:09.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.053+0000 7f8ccd816980 20 add_watcher() i=4 2024-03-09T14:44:09.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.053+0000 7f8ccd816980 20 add_watcher() i=5 2024-03-09T14:44:09.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.053+0000 7f8ccd816980 20 add_watcher() i=6 2024-03-09T14:44:09.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.053+0000 7f8ccd816980 20 add_watcher() i=7 2024-03-09T14:44:09.048 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.053+0000 7f8ccd816980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:09.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.057+0000 7f8b81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:09.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.057+0000 7f8ccd816980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:09.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.057+0000 7f8ccd816980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:09.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.061+0000 7f8ccd816980 5 note: GC not initialized 2024-03-09T14:44:09.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.061+0000 7f8b80fe1640 20 reqs_thread_entry: start 2024-03-09T14:44:09.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.061+0000 7f8ccd816980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:09.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.061+0000 7f8ccd816980 20 Filter name: none 2024-03-09T14:44:09.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.061+0000 7f8afa7fc640 20 reqs_thread_entry: start 2024-03-09T14:44:09.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.061+0000 7f8ccd816980 20 processing logshard = reshard.0000000000 2024-03-09T14:44:09.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.069+0000 7f8ccd816980 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-03-09T14:44:09.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.069+0000 7f8ccd816980 20 processing logshard = reshard.0000000001 2024-03-09T14:44:09.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.073+0000 7f8ccd816980 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-03-09T14:44:09.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.073+0000 7f8ccd816980 20 processing logshard = reshard.0000000002 2024-03-09T14:44:09.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.077+0000 7f8ccd816980 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-03-09T14:44:09.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.077+0000 7f8ccd816980 20 processing logshard = reshard.0000000003 2024-03-09T14:44:09.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.081+0000 7f8ccd816980 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-03-09T14:44:09.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.081+0000 7f8ccd816980 20 processing logshard = reshard.0000000004 2024-03-09T14:44:09.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.089+0000 7f8ccd816980 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-03-09T14:44:09.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.089+0000 7f8ccd816980 20 processing logshard = reshard.0000000005 2024-03-09T14:44:09.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.093+0000 7f8ccd816980 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-03-09T14:44:09.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.093+0000 7f8ccd816980 20 processing logshard = reshard.0000000006 2024-03-09T14:44:09.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.097+0000 7f8ccd816980 20 process_entry resharding a-bucket 2024-03-09T14:44:09.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.097+0000 7f8ccd816980 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-09T14:44:09.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.097+0000 7f8ccd816980 20 rados->read ofs=0 len=0 2024-03-09T14:44:09.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.097+0000 7f8ccd816980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:44:09.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.097+0000 7f8ccd816980 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-03-09T14:44:09.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.097+0000 7f8ccd816980 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-09T14:44:09.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.097+0000 7f8ccd816980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 : miss 2024-03-09T14:44:09.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.097+0000 7f8ccd816980 20 rados->read ofs=0 len=0 2024-03-09T14:44:09.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.101+0000 7f8ccd816980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:44:09.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.101+0000 7f8ccd816980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 info.flags=0x17 2024-03-09T14:44:09.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.101+0000 7f8ccd816980 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 to cache LRU end 2024-03-09T14:44:09.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.101+0000 7f8ccd816980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:09.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.101+0000 7f8ccd816980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:44:09.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.101+0000 7f8ccd816980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 2024-03-09T14:44:09.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.113+0000 7f8ccd816980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 info.flags=0x17 2024-03-09T14:44:09.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.113+0000 7f8ccd816980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 to cache LRU end 2024-03-09T14:44:09.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.113+0000 7f8ccd816980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:44:09.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.113+0000 7f8ccd816980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18, ofs0, ns] 2024-03-09T14:44:09.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.113+0000 7f8bae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464274 cookie 94744436286976 notifier 5786 bl.length()=903 2024-03-09T14:44:09.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.113+0000 7f8bae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 info.flags=0x17 2024-03-09T14:44:09.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.113+0000 7f8bae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 to cache LRU end 2024-03-09T14:44:09.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.113+0000 7f8bae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:44:09.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.117+0000 7f8ccd816980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): orig_sources= new_sources= 2024-03-09T14:44:09.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.117+0000 7f8ccd816980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): potential sources added=[] removed=[] 2024-03-09T14:44:09.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.117+0000 7f8ccd816980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): orig_dests= new_dests= 2024-03-09T14:44:09.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.117+0000 7f8ccd816980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): potential dests added=[] removed=[] 2024-03-09T14:44:09.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.0 2024-03-09T14:44:09.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.0 2024-03-09T14:44:09.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.1 2024-03-09T14:44:09.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.1 2024-03-09T14:44:09.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.2 2024-03-09T14:44:09.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.2 2024-03-09T14:44:09.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.3 2024-03-09T14:44:09.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.3 2024-03-09T14:44:09.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.4 2024-03-09T14:44:09.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.4 2024-03-09T14:44:09.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.5 2024-03-09T14:44:09.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.5 2024-03-09T14:44:09.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.6 2024-03-09T14:44:09.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.6 2024-03-09T14:44:09.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.7 2024-03-09T14:44:09.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.7 2024-03-09T14:44:09.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.8 2024-03-09T14:44:09.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.8 2024-03-09T14:44:09.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.9 2024-03-09T14:44:09.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.9 2024-03-09T14:44:09.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.10 2024-03-09T14:44:09.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.10 2024-03-09T14:44:09.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.11 2024-03-09T14:44:09.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.11 2024-03-09T14:44:09.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.0 2024-03-09T14:44:09.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.121+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1 2024-03-09T14:44:09.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.125+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2 2024-03-09T14:44:09.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.125+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.3 2024-03-09T14:44:09.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.125+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.4 2024-03-09T14:44:09.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.125+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.5 2024-03-09T14:44:09.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.129+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.6 2024-03-09T14:44:09.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.129+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.7 2024-03-09T14:44:09.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.129+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.8 2024-03-09T14:44:09.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.129+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.9 2024-03-09T14:44:09.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.133+0000 7f8ccd816980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.10 2024-03-09T14:44:09.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.133+0000 7f8ccd816980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 : hit (requested=0x17, cached=0x17) 2024-03-09T14:44:09.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.133+0000 7f8ccd816980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 2024-03-09T14:44:09.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.137+0000 7f8ccd816980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 info.flags=0x17 2024-03-09T14:44:09.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.137+0000 7f8ccd816980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 to cache LRU end 2024-03-09T14:44:09.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.137+0000 7f8ccd816980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:44:09.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.137+0000 7f8ccd816980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18, ofs0, ns] 2024-03-09T14:44:09.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.137+0000 7f8bae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464275 cookie 94744436286976 notifier 5786 bl.length()=871 2024-03-09T14:44:09.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.137+0000 7f8bae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 info.flags=0x17 2024-03-09T14:44:09.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.137+0000 7f8bae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 to cache LRU end 2024-03-09T14:44:09.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.137+0000 7f8bae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:44:09.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.137+0000 7f8ccd816980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): orig_sources= new_sources= 2024-03-09T14:44:09.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.137+0000 7f8ccd816980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): potential sources added=[] removed=[] 2024-03-09T14:44:09.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.137+0000 7f8ccd816980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): orig_dests= new_dests= 2024-03-09T14:44:09.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.137+0000 7f8ccd816980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): potential dests added=[] removed=[] 2024-03-09T14:44:09.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.145+0000 7f8ccd816980 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-03-09T14:44:09.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.145+0000 7f8ccd816980 20 process_entry removing reshard queue entry for bucket a-bucket 2024-03-09T14:44:09.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.149+0000 7f8ccd816980 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-03-09T14:44:09.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.149+0000 7f8ccd816980 20 processing logshard = reshard.0000000007 2024-03-09T14:44:09.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.153+0000 7f8ccd816980 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-03-09T14:44:09.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.153+0000 7f8ccd816980 20 processing logshard = reshard.0000000008 2024-03-09T14:44:09.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.161+0000 7f8ccd816980 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-03-09T14:44:09.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.161+0000 7f8ccd816980 20 processing logshard = reshard.0000000009 2024-03-09T14:44:09.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.165+0000 7f8ccd816980 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-03-09T14:44:09.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.165+0000 7f8ccd816980 20 processing logshard = reshard.0000000010 2024-03-09T14:44:09.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.173+0000 7f8ccd816980 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-03-09T14:44:09.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.173+0000 7f8ccd816980 20 processing logshard = reshard.0000000011 2024-03-09T14:44:09.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.177+0000 7f8ccd816980 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-03-09T14:44:09.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.177+0000 7f8ccd816980 20 processing logshard = reshard.0000000012 2024-03-09T14:44:09.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.181+0000 7f8ccd816980 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-03-09T14:44:09.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.181+0000 7f8ccd816980 20 processing logshard = reshard.0000000013 2024-03-09T14:44:09.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.189+0000 7f8ccd816980 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-03-09T14:44:09.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.189+0000 7f8ccd816980 20 processing logshard = reshard.0000000014 2024-03-09T14:44:09.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.193+0000 7f8ccd816980 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-03-09T14:44:09.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.193+0000 7f8ccd816980 20 processing logshard = reshard.0000000015 2024-03-09T14:44:09.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.201+0000 7f8ccd816980 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-03-09T14:44:09.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.201+0000 7f8b81fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:09.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.209+0000 7f8ccd816980 20 remove_watcher() i=0 2024-03-09T14:44:09.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.209+0000 7f8ccd816980 2 removed watcher, disabling cache 2024-03-09T14:44:09.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.209+0000 7f8ccd816980 20 remove_watcher() i=1 2024-03-09T14:44:09.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.213+0000 7f8ccd816980 20 remove_watcher() i=2 2024-03-09T14:44:09.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.217+0000 7f8ccd816980 20 remove_watcher() i=3 2024-03-09T14:44:09.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.217+0000 7f8ccd816980 20 remove_watcher() i=4 2024-03-09T14:44:09.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.221+0000 7f8ccd816980 20 remove_watcher() i=5 2024-03-09T14:44:09.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.221+0000 7f8ccd816980 20 remove_watcher() i=6 2024-03-09T14:44:09.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:09.225+0000 7f8ccd816980 20 remove_watcher() i=7 2024-03-09T14:44:14.241 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-09T14:44:14.274 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:14.274 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:14.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.329+0000 7ff407e9a980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.329+0000 7ff407e9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:14.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.329+0000 7ff407e9a980 20 realm 2024-03-09T14:44:14.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.329+0000 7ff407e9a980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.333+0000 7ff407e9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:14.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.333+0000 7ff407e9a980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:14.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.333+0000 7ff407e9a980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.333+0000 7ff407e9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:14.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.333+0000 7ff407e9a980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.333+0000 7ff407e9a980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:14.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.333+0000 7ff407e9a980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.333+0000 7ff407e9a980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:14.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.333+0000 7ff407e9a980 20 searching for the correct realm 2024-03-09T14:44:14.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.337+0000 7ff4061b3640 0 -- 172.21.15.99:0/3334542062 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7ff3fc008050 msgr2=0x7ff3fc070a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:14.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.345+0000 7ff4051b1640 0 -- 172.21.15.99:0/3334542062 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7ff400018040 msgr2=0x7ff400050460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:14.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.561+0000 7ff407e9a980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:14.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.561+0000 7ff407e9a980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:14.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.561+0000 7ff407e9a980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:14.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.561+0000 7ff407e9a980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:14.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.561+0000 7ff407e9a980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:14.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.561+0000 7ff407e9a980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:14.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.561+0000 7ff407e9a980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.561+0000 7ff407e9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:14.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.561+0000 7ff407e9a980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.565+0000 7ff407e9a980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:14.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.565+0000 7ff407e9a980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.565+0000 7ff407e9a980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:14.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.565+0000 7ff407e9a980 20 zone default found 2024-03-09T14:44:14.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.565+0000 7ff407e9a980 4 Realm: () 2024-03-09T14:44:14.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.565+0000 7ff407e9a980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:14.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.565+0000 7ff407e9a980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:14.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.565+0000 7ff407e9a980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:14.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.565+0000 7ff407e9a980 20 zonegroup default 2024-03-09T14:44:14.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.565+0000 7ff407e9a980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.565+0000 7ff407e9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:14.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.565+0000 7ff407e9a980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.565+0000 7ff407e9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:14.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.565+0000 7ff407e9a980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.565+0000 7ff407e9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:14.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.565+0000 7ff407e9a980 20 started sync module instance, tier type = 2024-03-09T14:44:14.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.565+0000 7ff407e9a980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:14.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.589+0000 7ff407e9a980 20 add_watcher() i=0 2024-03-09T14:44:14.584 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.589+0000 7ff407e9a980 20 add_watcher() i=1 2024-03-09T14:44:14.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.589+0000 7ff407e9a980 20 add_watcher() i=2 2024-03-09T14:44:14.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.589+0000 7ff407e9a980 20 add_watcher() i=3 2024-03-09T14:44:14.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.589+0000 7ff407e9a980 20 add_watcher() i=4 2024-03-09T14:44:14.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.589+0000 7ff407e9a980 20 add_watcher() i=5 2024-03-09T14:44:14.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.589+0000 7ff407e9a980 20 add_watcher() i=6 2024-03-09T14:44:14.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.593+0000 7ff407e9a980 20 add_watcher() i=7 2024-03-09T14:44:14.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.593+0000 7ff407e9a980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:14.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.597+0000 7ff2b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:14.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.597+0000 7ff407e9a980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:14.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.597+0000 7ff407e9a980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:14.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.597+0000 7ff407e9a980 5 note: GC not initialized 2024-03-09T14:44:14.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.597+0000 7ff2b67fc640 20 reqs_thread_entry: start 2024-03-09T14:44:14.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.597+0000 7ff407e9a980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:14.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.597+0000 7ff407e9a980 20 Filter name: none 2024-03-09T14:44:14.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.597+0000 7ff227fff640 20 reqs_thread_entry: start 2024-03-09T14:44:14.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.597+0000 7ff407e9a980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.593 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.597+0000 7ff407e9a980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:44:14.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.597+0000 7ff407e9a980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.601+0000 7ff407e9a980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:44:14.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.601+0000 7ff407e9a980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:14.595 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.601+0000 7ff407e9a980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.601+0000 7ff407e9a980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:44:14.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.601+0000 7ff407e9a980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.596 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.601+0000 7ff407e9a980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:44:14.597 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.601+0000 7ff407e9a980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:14.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.605+0000 7ff407e9a980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.605+0000 7ff407e9a980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:14.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.605+0000 7ff2b77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:14.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.609+0000 7ff407e9a980 20 remove_watcher() i=0 2024-03-09T14:44:14.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.609+0000 7ff407e9a980 2 removed watcher, disabling cache 2024-03-09T14:44:14.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.613+0000 7ff407e9a980 20 remove_watcher() i=1 2024-03-09T14:44:14.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.613+0000 7ff407e9a980 20 remove_watcher() i=2 2024-03-09T14:44:14.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.617+0000 7ff407e9a980 20 remove_watcher() i=3 2024-03-09T14:44:14.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.621+0000 7ff407e9a980 20 remove_watcher() i=4 2024-03-09T14:44:14.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.621+0000 7ff407e9a980 20 remove_watcher() i=5 2024-03-09T14:44:14.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.621+0000 7ff407e9a980 20 remove_watcher() i=6 2024-03-09T14:44:14.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.625+0000 7ff407e9a980 20 remove_watcher() i=7 2024-03-09T14:44:14.633 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:14.634 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:44:14.634 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: a-bucket id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-03-09T14:44:14.634 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:14.634 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard add non empty bucket 2024-03-09T14:44:14.634 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:14.638 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:14.638 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:14.654 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:14.654 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:14.669 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:14.669 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:14.683 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:14.683 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:14.696 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:14.696 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:14.710 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:14.710 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:14.725 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:14.725 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:14.738 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:14.739 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:14.751 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-09T14:44:14.780 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:14.780 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:14.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.829+0000 7fd64dddb980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.833+0000 7fd64dddb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:14.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.833+0000 7fd64dddb980 20 realm 2024-03-09T14:44:14.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.833+0000 7fd64dddb980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.833+0000 7fd64dddb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:14.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.833+0000 7fd64dddb980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:14.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.833+0000 7fd64dddb980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.833+0000 7fd64dddb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:14.827 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.833+0000 7fd64dddb980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.833+0000 7fd64dddb980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:14.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.833+0000 7fd64dddb980 20 rados->read ofs=0 len=0 2024-03-09T14:44:14.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.837+0000 7fd64dddb980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:14.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.837+0000 7fd64dddb980 20 searching for the correct realm 2024-03-09T14:44:14.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.837+0000 7fd64c0f4640 0 -- 172.21.15.99:0/146973843 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7fd64010fc20 msgr2=0x7fd6400f0310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:14.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:14.845+0000 7fd64b0f2640 0 -- 172.21.15.99:0/146973843 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fd644082b80 msgr2=0x7fd6440268d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:15.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.061+0000 7fd64dddb980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:15.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.061+0000 7fd64dddb980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:15.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.061+0000 7fd64dddb980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:15.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.061+0000 7fd64dddb980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:15.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.061+0000 7fd64dddb980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:15.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.061+0000 7fd64dddb980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:15.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.061+0000 7fd64dddb980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.061+0000 7fd64dddb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.061+0000 7fd64dddb980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.061+0000 7fd64dddb980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:15.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.061+0000 7fd64dddb980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.065+0000 7fd64dddb980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:15.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.065+0000 7fd64dddb980 20 zone default found 2024-03-09T14:44:15.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.065+0000 7fd64dddb980 4 Realm: () 2024-03-09T14:44:15.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.065+0000 7fd64dddb980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:15.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.065+0000 7fd64dddb980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:15.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.065+0000 7fd64dddb980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:15.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.065+0000 7fd64dddb980 20 zonegroup default 2024-03-09T14:44:15.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.065+0000 7fd64dddb980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.065+0000 7fd64dddb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.065+0000 7fd64dddb980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.065+0000 7fd64dddb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.065+0000 7fd64dddb980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.065+0000 7fd64dddb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.065+0000 7fd64dddb980 20 started sync module instance, tier type = 2024-03-09T14:44:15.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.065+0000 7fd64dddb980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:15.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.089+0000 7fd64dddb980 20 add_watcher() i=0 2024-03-09T14:44:15.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.089+0000 7fd64dddb980 20 add_watcher() i=1 2024-03-09T14:44:15.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.089+0000 7fd64dddb980 20 add_watcher() i=2 2024-03-09T14:44:15.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.089+0000 7fd64dddb980 20 add_watcher() i=3 2024-03-09T14:44:15.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.089+0000 7fd64dddb980 20 add_watcher() i=4 2024-03-09T14:44:15.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.089+0000 7fd64dddb980 20 add_watcher() i=5 2024-03-09T14:44:15.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.089+0000 7fd64dddb980 20 add_watcher() i=6 2024-03-09T14:44:15.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.093+0000 7fd64dddb980 20 add_watcher() i=7 2024-03-09T14:44:15.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.093+0000 7fd64dddb980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:15.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.097+0000 7fd501fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:15.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.097+0000 7fd64dddb980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:15.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.097+0000 7fd64dddb980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:15.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.097+0000 7fd64dddb980 5 note: GC not initialized 2024-03-09T14:44:15.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.097+0000 7fd500fe1640 20 reqs_thread_entry: start 2024-03-09T14:44:15.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.097+0000 7fd64dddb980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:15.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.097+0000 7fd64dddb980 20 Filter name: none 2024-03-09T14:44:15.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.097+0000 7fd47a7fc640 20 reqs_thread_entry: start 2024-03-09T14:44:15.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.097+0000 7fd64dddb980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.101+0000 7fd64dddb980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:44:15.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.101+0000 7fd64dddb980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.101+0000 7fd64dddb980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:44:15.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.101+0000 7fd64dddb980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:15.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.101+0000 7fd64dddb980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.101+0000 7fd64dddb980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:44:15.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.101+0000 7fd64dddb980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.105+0000 7fd64dddb980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:44:15.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.105+0000 7fd64dddb980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:15.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.105+0000 7fd64dddb980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.105+0000 7fd64dddb980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.109+0000 7fd501fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:15.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.113+0000 7fd64dddb980 20 remove_watcher() i=0 2024-03-09T14:44:15.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.113+0000 7fd64dddb980 2 removed watcher, disabling cache 2024-03-09T14:44:15.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.113+0000 7fd64dddb980 20 remove_watcher() i=1 2024-03-09T14:44:15.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.117+0000 7fd64dddb980 20 remove_watcher() i=2 2024-03-09T14:44:15.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.121+0000 7fd64dddb980 20 remove_watcher() i=3 2024-03-09T14:44:15.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.121+0000 7fd64dddb980 20 remove_watcher() i=4 2024-03-09T14:44:15.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.125+0000 7fd64dddb980 20 remove_watcher() i=5 2024-03-09T14:44:15.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.125+0000 7fd64dddb980 20 remove_watcher() i=6 2024-03-09T14:44:15.121 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.125+0000 7fd64dddb980 20 remove_watcher() i=7 2024-03-09T14:44:15.142 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:15.142 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:44:15.142 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: a-bucket id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 num_objects: 8 size_kb: 1 num_shards: 12 2024-03-09T14:44:15.142 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:15.143 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-03-09T14:44:15.171 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:15.172 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:15.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.221+0000 7f80cf761980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.221+0000 7f80cf761980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.221+0000 7f80cf761980 20 realm 2024-03-09T14:44:15.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.221+0000 7f80cf761980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.221+0000 7f80cf761980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.221+0000 7f80cf761980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:15.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.221+0000 7f80cf761980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.225+0000 7f80cf761980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.218 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.225+0000 7f80cf761980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.225+0000 7f80cf761980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:15.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.225+0000 7f80cf761980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.225+0000 7f80cf761980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:15.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.225+0000 7f80cf761980 20 searching for the correct realm 2024-03-09T14:44:15.225 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.233+0000 7f80cca78640 0 -- 172.21.15.99:0/2145298569 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f80c00d4440 msgr2=0x7f80c00d4860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:15.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.237+0000 7f80cca78640 0 -- 172.21.15.99:0/2145298569 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f80c8062130 msgr2=0x7f80c8077850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:15.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.453+0000 7f80cf761980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:15.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.453+0000 7f80cf761980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:15.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.453+0000 7f80cf761980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:15.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.453+0000 7f80cf761980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:15.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.453+0000 7f80cf761980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:15.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.453+0000 7f80cf761980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:15.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.453+0000 7f80cf761980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.453+0000 7f80cf761980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.453+0000 7f80cf761980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.457+0000 7f80cf761980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:15.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.457+0000 7f80cf761980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.457+0000 7f80cf761980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:15.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.457+0000 7f80cf761980 20 zone default found 2024-03-09T14:44:15.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.457+0000 7f80cf761980 4 Realm: () 2024-03-09T14:44:15.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.457+0000 7f80cf761980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:15.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.457+0000 7f80cf761980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:15.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.457+0000 7f80cf761980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:15.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.457+0000 7f80cf761980 20 zonegroup default 2024-03-09T14:44:15.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.457+0000 7f80cf761980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.457+0000 7f80cf761980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.457+0000 7f80cf761980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.457+0000 7f80cf761980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.457+0000 7f80cf761980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.457+0000 7f80cf761980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.457+0000 7f80cf761980 20 started sync module instance, tier type = 2024-03-09T14:44:15.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.457+0000 7f80cf761980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:15.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.481+0000 7f80cf761980 20 add_watcher() i=0 2024-03-09T14:44:15.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.481+0000 7f80cf761980 20 add_watcher() i=1 2024-03-09T14:44:15.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.481+0000 7f80cf761980 20 add_watcher() i=2 2024-03-09T14:44:15.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.481+0000 7f80cf761980 20 add_watcher() i=3 2024-03-09T14:44:15.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.481+0000 7f80cf761980 20 add_watcher() i=4 2024-03-09T14:44:15.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.481+0000 7f80cf761980 20 add_watcher() i=5 2024-03-09T14:44:15.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.481+0000 7f80cf761980 20 add_watcher() i=6 2024-03-09T14:44:15.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.485+0000 7f80cf761980 20 add_watcher() i=7 2024-03-09T14:44:15.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.485+0000 7f80cf761980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:15.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.493+0000 7f7f837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:15.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.493+0000 7f80cf761980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:15.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.493+0000 7f80cf761980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:15.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.493+0000 7f80cf761980 5 note: GC not initialized 2024-03-09T14:44:15.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.493+0000 7f7f827e4640 20 reqs_thread_entry: start 2024-03-09T14:44:15.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.493+0000 7f80cf761980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:15.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.493+0000 7f80cf761980 20 Filter name: none 2024-03-09T14:44:15.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.493+0000 7f7ef3fff640 20 reqs_thread_entry: start 2024-03-09T14:44:15.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.493+0000 7f80cf761980 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-09T14:44:15.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.493+0000 7f80cf761980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.493+0000 7f80cf761980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:44:15.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.493+0000 7f80cf761980 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-03-09T14:44:15.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.493+0000 7f80cf761980 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-09T14:44:15.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.493+0000 7f80cf761980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 : miss 2024-03-09T14:44:15.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.493+0000 7f80cf761980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.497+0000 7f80cf761980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:44:15.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.497+0000 7f80cf761980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 info.flags=0x17 2024-03-09T14:44:15.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.497+0000 7f80cf761980 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 to cache LRU end 2024-03-09T14:44:15.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.497+0000 7f80cf761980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:15.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.497+0000 7f80cf761980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:44:15.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.497+0000 7f80cf761980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 2024-03-09T14:44:15.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.501+0000 7f7f837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:15.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.505+0000 7f80cf761980 20 remove_watcher() i=0 2024-03-09T14:44:15.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.505+0000 7f80cf761980 2 removed watcher, disabling cache 2024-03-09T14:44:15.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.505+0000 7f80cf761980 20 remove_watcher() i=1 2024-03-09T14:44:15.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.509+0000 7f80cf761980 20 remove_watcher() i=2 2024-03-09T14:44:15.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.509+0000 7f80cf761980 20 remove_watcher() i=3 2024-03-09T14:44:15.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.513+0000 7f80cf761980 20 remove_watcher() i=4 2024-03-09T14:44:15.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.513+0000 7f80cf761980 20 remove_watcher() i=5 2024-03-09T14:44:15.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.517+0000 7f80cf761980 20 remove_watcher() i=6 2024-03-09T14:44:15.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.517+0000 7f80cf761980 20 remove_watcher() i=7 2024-03-09T14:44:15.529 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshard list 2024-03-09T14:44:15.553 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:15.554 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:15.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.605+0000 7fbd2e990980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.605+0000 7fbd2e990980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.605+0000 7fbd2e990980 20 realm 2024-03-09T14:44:15.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.605+0000 7fbd2e990980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.605+0000 7fbd2e990980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.605+0000 7fbd2e990980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:15.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.605+0000 7fbd2e990980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.609+0000 7fbd2e990980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.609+0000 7fbd2e990980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.609+0000 7fbd2e990980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:15.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.609+0000 7fbd2e990980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.609+0000 7fbd2e990980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:15.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.609+0000 7fbd2e990980 20 searching for the correct realm 2024-03-09T14:44:15.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.613+0000 7fbd2cca9640 0 -- 172.21.15.99:0/2159937946 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7fbd1403e060 msgr2=0x7fbd1400a2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:15.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.621+0000 7fbd2bca7640 0 -- 172.21.15.99:0/2159937946 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fbd24008040 msgr2=0x7fbd2403a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:15.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.837+0000 7fbd2e990980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:15.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.837+0000 7fbd2e990980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:15.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.837+0000 7fbd2e990980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:15.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.837+0000 7fbd2e990980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:15.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.837+0000 7fbd2e990980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:15.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.837+0000 7fbd2e990980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:15.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.837+0000 7fbd2e990980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.837+0000 7fbd2e990980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.837+0000 7fbd2e990980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.841+0000 7fbd2e990980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:15.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.841+0000 7fbd2e990980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.841+0000 7fbd2e990980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:15.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.841+0000 7fbd2e990980 20 zone default found 2024-03-09T14:44:15.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.841+0000 7fbd2e990980 4 Realm: () 2024-03-09T14:44:15.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.841+0000 7fbd2e990980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:15.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.841+0000 7fbd2e990980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:15.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.841+0000 7fbd2e990980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:15.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.841+0000 7fbd2e990980 20 zonegroup default 2024-03-09T14:44:15.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.841+0000 7fbd2e990980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.841+0000 7fbd2e990980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.841+0000 7fbd2e990980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.841+0000 7fbd2e990980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.841+0000 7fbd2e990980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.841+0000 7fbd2e990980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.841+0000 7fbd2e990980 20 started sync module instance, tier type = 2024-03-09T14:44:15.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.841+0000 7fbd2e990980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:15.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.865+0000 7fbd2e990980 20 add_watcher() i=0 2024-03-09T14:44:15.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.865+0000 7fbd2e990980 20 add_watcher() i=1 2024-03-09T14:44:15.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.865+0000 7fbd2e990980 20 add_watcher() i=2 2024-03-09T14:44:15.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.865+0000 7fbd2e990980 20 add_watcher() i=3 2024-03-09T14:44:15.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.865+0000 7fbd2e990980 20 add_watcher() i=4 2024-03-09T14:44:15.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.865+0000 7fbd2e990980 20 add_watcher() i=5 2024-03-09T14:44:15.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.865+0000 7fbd2e990980 20 add_watcher() i=6 2024-03-09T14:44:15.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.865+0000 7fbd2e990980 20 add_watcher() i=7 2024-03-09T14:44:15.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.865+0000 7fbd2e990980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:15.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.869+0000 7fbbe37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:15.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.869+0000 7fbd2e990980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:15.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.869+0000 7fbd2e990980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:15.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.869+0000 7fbd2e990980 5 note: GC not initialized 2024-03-09T14:44:15.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.869+0000 7fbbe27dc640 20 reqs_thread_entry: start 2024-03-09T14:44:15.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.869+0000 7fbd2e990980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:15.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.869+0000 7fbd2e990980 20 Filter name: none 2024-03-09T14:44:15.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.869+0000 7fbbdb7fe640 20 reqs_thread_entry: start 2024-03-09T14:44:15.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.881+0000 7fbbe37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:15.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.889+0000 7fbd2e990980 20 remove_watcher() i=0 2024-03-09T14:44:15.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.889+0000 7fbd2e990980 2 removed watcher, disabling cache 2024-03-09T14:44:15.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.889+0000 7fbd2e990980 20 remove_watcher() i=1 2024-03-09T14:44:15.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.893+0000 7fbd2e990980 20 remove_watcher() i=2 2024-03-09T14:44:15.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.893+0000 7fbd2e990980 20 remove_watcher() i=3 2024-03-09T14:44:15.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.897+0000 7fbd2e990980 20 remove_watcher() i=4 2024-03-09T14:44:15.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.897+0000 7fbd2e990980 20 remove_watcher() i=5 2024-03-09T14:44:15.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.901+0000 7fbd2e990980 20 remove_watcher() i=6 2024-03-09T14:44:15.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.901+0000 7fbd2e990980 20 remove_watcher() i=7 2024-03-09T14:44:15.910 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard process non empty bucket 2024-03-09T14:44:15.910 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:15.910 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin reshard process 2024-03-09T14:44:15.935 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:15.935 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:15.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.985+0000 7f6c63422980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.989+0000 7f6c63422980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.989+0000 7f6c63422980 20 realm 2024-03-09T14:44:15.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.989+0000 7f6c63422980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.989+0000 7f6c63422980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.989+0000 7f6c63422980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:15.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.989+0000 7f6c63422980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.989+0000 7f6c63422980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:15.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.989+0000 7f6c63422980 20 rados->read ofs=0 len=0 2024-03-09T14:44:15.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.989+0000 7f6c63422980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:15.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:15.989+0000 7f6c63422980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.193+0000 7f6c63422980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:16.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.193+0000 7f6c63422980 20 searching for the correct realm 2024-03-09T14:44:16.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.201+0000 7f6c6173b640 0 -- 172.21.15.99:0/2669863821 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x5614f2a89440 msgr2=0x5614f2a8b830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:16.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.209+0000 7f6c60739640 0 -- 172.21.15.99:0/2669863821 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f6c580e73f0 msgr2=0x7f6c580e7870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:16.420 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.425+0000 7f6c63422980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:16.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.425+0000 7f6c63422980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:16.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.425+0000 7f6c63422980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:16.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.425+0000 7f6c63422980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:16.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.425+0000 7f6c63422980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:16.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.425+0000 7f6c63422980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:16.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.425+0000 7f6c63422980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.425+0000 7f6c63422980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:16.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.425+0000 7f6c63422980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.429+0000 7f6c63422980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:16.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.429+0000 7f6c63422980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.429+0000 7f6c63422980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:16.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.429+0000 7f6c63422980 20 zone default found 2024-03-09T14:44:16.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.429+0000 7f6c63422980 4 Realm: () 2024-03-09T14:44:16.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.429+0000 7f6c63422980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:16.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.429+0000 7f6c63422980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:16.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.429+0000 7f6c63422980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:16.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.429+0000 7f6c63422980 20 zonegroup default 2024-03-09T14:44:16.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.429+0000 7f6c63422980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.429+0000 7f6c63422980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:16.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.429+0000 7f6c63422980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.429+0000 7f6c63422980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:16.424 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.429+0000 7f6c63422980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.429+0000 7f6c63422980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:16.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.429+0000 7f6c63422980 20 started sync module instance, tier type = 2024-03-09T14:44:16.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.429+0000 7f6c63422980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:16.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.453+0000 7f6c63422980 20 add_watcher() i=0 2024-03-09T14:44:16.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.453+0000 7f6c63422980 20 add_watcher() i=1 2024-03-09T14:44:16.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.453+0000 7f6c63422980 20 add_watcher() i=2 2024-03-09T14:44:16.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.453+0000 7f6c63422980 20 add_watcher() i=3 2024-03-09T14:44:16.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.453+0000 7f6c63422980 20 add_watcher() i=4 2024-03-09T14:44:16.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.453+0000 7f6c63422980 20 add_watcher() i=5 2024-03-09T14:44:16.449 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.453+0000 7f6c63422980 20 add_watcher() i=6 2024-03-09T14:44:16.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.457+0000 7f6c63422980 20 add_watcher() i=7 2024-03-09T14:44:16.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.457+0000 7f6c63422980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:16.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.461+0000 7f6b16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:16.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.461+0000 7f6c63422980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:16.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.461+0000 7f6c63422980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:16.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.461+0000 7f6c63422980 5 note: GC not initialized 2024-03-09T14:44:16.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.461+0000 7f6b15fe3640 20 reqs_thread_entry: start 2024-03-09T14:44:16.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.461+0000 7f6c63422980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:16.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.461+0000 7f6c63422980 20 Filter name: none 2024-03-09T14:44:16.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.461+0000 7f6a877fe640 20 reqs_thread_entry: start 2024-03-09T14:44:16.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.461+0000 7f6c63422980 20 processing logshard = reshard.0000000000 2024-03-09T14:44:16.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.469+0000 7f6c63422980 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-03-09T14:44:16.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.469+0000 7f6c63422980 20 processing logshard = reshard.0000000001 2024-03-09T14:44:16.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.473+0000 7f6c63422980 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-03-09T14:44:16.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.473+0000 7f6c63422980 20 processing logshard = reshard.0000000002 2024-03-09T14:44:16.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.481+0000 7f6c63422980 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-03-09T14:44:16.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.481+0000 7f6c63422980 20 processing logshard = reshard.0000000003 2024-03-09T14:44:16.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.485+0000 7f6c63422980 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-03-09T14:44:16.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.485+0000 7f6c63422980 20 processing logshard = reshard.0000000004 2024-03-09T14:44:16.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.489+0000 7f6c63422980 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-03-09T14:44:16.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.489+0000 7f6c63422980 20 processing logshard = reshard.0000000005 2024-03-09T14:44:16.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.497+0000 7f6c63422980 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-03-09T14:44:16.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.497+0000 7f6c63422980 20 processing logshard = reshard.0000000006 2024-03-09T14:44:16.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.501+0000 7f6c63422980 20 process_entry resharding a-bucket 2024-03-09T14:44:16.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.501+0000 7f6c63422980 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-09T14:44:16.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.501+0000 7f6c63422980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.494 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.501+0000 7f6c63422980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:44:16.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.501+0000 7f6c63422980 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-03-09T14:44:16.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.501+0000 7f6c63422980 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-09T14:44:16.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.501+0000 7f6c63422980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 : miss 2024-03-09T14:44:16.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.501+0000 7f6c63422980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.501+0000 7f6c63422980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:44:16.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.501+0000 7f6c63422980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 info.flags=0x17 2024-03-09T14:44:16.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.501+0000 7f6c63422980 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 to cache LRU end 2024-03-09T14:44:16.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.501+0000 7f6c63422980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:16.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.501+0000 7f6c63422980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:44:16.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.501+0000 7f6c63422980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 2024-03-09T14:44:16.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.517+0000 7f6c63422980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 info.flags=0x17 2024-03-09T14:44:16.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.517+0000 7f6c63422980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 to cache LRU end 2024-03-09T14:44:16.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.517+0000 7f6c63422980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:44:16.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.517+0000 7f6c63422980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18, ofs0, ns] 2024-03-09T14:44:16.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.517+0000 7f6b37fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464276 cookie 94647970505856 notifier 6117 bl.length()=903 2024-03-09T14:44:16.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.517+0000 7f6b37fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 info.flags=0x17 2024-03-09T14:44:16.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.517+0000 7f6b37fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 to cache LRU end 2024-03-09T14:44:16.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.517+0000 7f6b37fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:44:16.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.517+0000 7f6c63422980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): orig_sources= new_sources= 2024-03-09T14:44:16.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.517+0000 7f6c63422980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): potential sources added=[] removed=[] 2024-03-09T14:44:16.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.517+0000 7f6c63422980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): orig_dests= new_dests= 2024-03-09T14:44:16.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.517+0000 7f6c63422980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): potential dests added=[] removed=[] 2024-03-09T14:44:16.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.0 2024-03-09T14:44:16.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.0 2024-03-09T14:44:16.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.1 2024-03-09T14:44:16.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.1 2024-03-09T14:44:16.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.2 2024-03-09T14:44:16.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.2 2024-03-09T14:44:16.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.3 2024-03-09T14:44:16.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.3 2024-03-09T14:44:16.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.4 2024-03-09T14:44:16.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.4 2024-03-09T14:44:16.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.5 2024-03-09T14:44:16.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.5 2024-03-09T14:44:16.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.6 2024-03-09T14:44:16.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.6 2024-03-09T14:44:16.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.7 2024-03-09T14:44:16.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.7 2024-03-09T14:44:16.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.8 2024-03-09T14:44:16.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.8 2024-03-09T14:44:16.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.9 2024-03-09T14:44:16.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.9 2024-03-09T14:44:16.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.10 2024-03-09T14:44:16.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.10 2024-03-09T14:44:16.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.11 2024-03-09T14:44:16.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.11 2024-03-09T14:44:16.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.12 2024-03-09T14:44:16.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.12 2024-03-09T14:44:16.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.0 2024-03-09T14:44:16.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.0 2024-03-09T14:44:16.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.1 2024-03-09T14:44:16.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.1 2024-03-09T14:44:16.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.2 2024-03-09T14:44:16.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.2 2024-03-09T14:44:16.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.3 2024-03-09T14:44:16.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.3 2024-03-09T14:44:16.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.4 2024-03-09T14:44:16.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.525+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.4 2024-03-09T14:44:16.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.529+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.5 2024-03-09T14:44:16.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.529+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.5 2024-03-09T14:44:16.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.529+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.6 2024-03-09T14:44:16.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.529+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.6 2024-03-09T14:44:16.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.529+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.7 2024-03-09T14:44:16.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.529+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.7 2024-03-09T14:44:16.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.529+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.8 2024-03-09T14:44:16.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.529+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.8 2024-03-09T14:44:16.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.533+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.9 2024-03-09T14:44:16.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.533+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.9 2024-03-09T14:44:16.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.533+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.10 2024-03-09T14:44:16.528 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.533+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.10 2024-03-09T14:44:16.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.533+0000 7f6c63422980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.11 2024-03-09T14:44:16.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.533+0000 7f6c63422980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.1.11 2024-03-09T14:44:16.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.541+0000 7f6c63422980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 : hit (requested=0x17, cached=0x17) 2024-03-09T14:44:16.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.541+0000 7f6c63422980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 2024-03-09T14:44:16.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.541+0000 7f6c63422980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 info.flags=0x17 2024-03-09T14:44:16.537 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.541+0000 7f6c63422980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 to cache LRU end 2024-03-09T14:44:16.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.541+0000 7f6c63422980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:44:16.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.541+0000 7f6c63422980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18, ofs0, ns] 2024-03-09T14:44:16.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.545+0000 7f6b377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464277 cookie 94647970505856 notifier 6117 bl.length()=871 2024-03-09T14:44:16.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.545+0000 7f6b377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 info.flags=0x17 2024-03-09T14:44:16.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.545+0000 7f6b377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 to cache LRU end 2024-03-09T14:44:16.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.545+0000 7f6b377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:44:16.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.545+0000 7f6c63422980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): orig_sources= new_sources= 2024-03-09T14:44:16.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.545+0000 7f6c63422980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): potential sources added=[] removed=[] 2024-03-09T14:44:16.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.545+0000 7f6c63422980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): orig_dests= new_dests= 2024-03-09T14:44:16.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.545+0000 7f6c63422980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): potential dests added=[] removed=[] 2024-03-09T14:44:16.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.549+0000 7f6c63422980 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-03-09T14:44:16.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.553+0000 7f6c63422980 20 process_entry removing reshard queue entry for bucket a-bucket 2024-03-09T14:44:16.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.557+0000 7f6c63422980 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-03-09T14:44:16.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.557+0000 7f6c63422980 20 processing logshard = reshard.0000000007 2024-03-09T14:44:16.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.565+0000 7f6c63422980 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-03-09T14:44:16.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.565+0000 7f6c63422980 20 processing logshard = reshard.0000000008 2024-03-09T14:44:16.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.569+0000 7f6c63422980 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-03-09T14:44:16.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.569+0000 7f6c63422980 20 processing logshard = reshard.0000000009 2024-03-09T14:44:16.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.577+0000 7f6c63422980 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-03-09T14:44:16.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.577+0000 7f6c63422980 20 processing logshard = reshard.0000000010 2024-03-09T14:44:16.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.581+0000 7f6c63422980 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-03-09T14:44:16.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.581+0000 7f6c63422980 20 processing logshard = reshard.0000000011 2024-03-09T14:44:16.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.585+0000 7f6c63422980 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-03-09T14:44:16.581 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.585+0000 7f6c63422980 20 processing logshard = reshard.0000000012 2024-03-09T14:44:16.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.593+0000 7f6c63422980 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-03-09T14:44:16.586 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.593+0000 7f6c63422980 20 processing logshard = reshard.0000000013 2024-03-09T14:44:16.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.597+0000 7f6c63422980 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-03-09T14:44:16.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.597+0000 7f6c63422980 20 processing logshard = reshard.0000000014 2024-03-09T14:44:16.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.605+0000 7f6c63422980 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-03-09T14:44:16.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.605+0000 7f6c63422980 20 processing logshard = reshard.0000000015 2024-03-09T14:44:16.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.609+0000 7f6c63422980 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-03-09T14:44:16.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.613+0000 7f6b16fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:16.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.617+0000 7f6c63422980 20 remove_watcher() i=0 2024-03-09T14:44:16.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.617+0000 7f6c63422980 2 removed watcher, disabling cache 2024-03-09T14:44:16.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.621+0000 7f6c63422980 20 remove_watcher() i=1 2024-03-09T14:44:16.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.621+0000 7f6c63422980 20 remove_watcher() i=2 2024-03-09T14:44:16.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.625+0000 7f6c63422980 20 remove_watcher() i=3 2024-03-09T14:44:16.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.629+0000 7f6c63422980 20 remove_watcher() i=4 2024-03-09T14:44:16.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.629+0000 7f6c63422980 20 remove_watcher() i=5 2024-03-09T14:44:16.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.629+0000 7f6c63422980 20 remove_watcher() i=6 2024-03-09T14:44:16.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.633+0000 7f6c63422980 20 remove_watcher() i=7 2024-03-09T14:44:16.651 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-09T14:44:16.681 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:16.682 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:16.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.733+0000 7fec44785980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.733+0000 7fec44785980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:16.728 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.733+0000 7fec44785980 20 realm 2024-03-09T14:44:16.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.733+0000 7fec44785980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.733+0000 7fec44785980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:16.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.733+0000 7fec44785980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:16.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.733+0000 7fec44785980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.733+0000 7fec44785980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:16.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.733+0000 7fec44785980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.730 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.737+0000 7fec44785980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:16.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.737+0000 7fec44785980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.737+0000 7fec44785980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:16.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.737+0000 7fec44785980 20 searching for the correct realm 2024-03-09T14:44:16.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.741+0000 7fec41a9c640 0 -- 172.21.15.99:0/4096048050 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7fec34028040 msgr2=0x7fec34028930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:16.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.749+0000 7fec41a9c640 0 -- 172.21.15.99:0/4096048050 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fec3c0564e0 msgr2=0x7fec3c0592d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:16.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.965+0000 7fec44785980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:16.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.965+0000 7fec44785980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:16.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.965+0000 7fec44785980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:16.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.965+0000 7fec44785980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:16.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.965+0000 7fec44785980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:16.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.965+0000 7fec44785980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:16.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.965+0000 7fec44785980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.969+0000 7fec44785980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:16.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.969+0000 7fec44785980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.969+0000 7fec44785980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:16.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.969+0000 7fec44785980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.969+0000 7fec44785980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:16.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.969+0000 7fec44785980 20 zone default found 2024-03-09T14:44:16.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.969+0000 7fec44785980 4 Realm: () 2024-03-09T14:44:16.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.969+0000 7fec44785980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:16.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.969+0000 7fec44785980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:16.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.969+0000 7fec44785980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:16.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.969+0000 7fec44785980 20 zonegroup default 2024-03-09T14:44:16.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.969+0000 7fec44785980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.969+0000 7fec44785980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:16.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.969+0000 7fec44785980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.969+0000 7fec44785980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:16.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.969+0000 7fec44785980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.973+0000 7fec44785980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:16.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.973+0000 7fec44785980 20 started sync module instance, tier type = 2024-03-09T14:44:16.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.973+0000 7fec44785980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:16.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.993+0000 7fec44785980 20 add_watcher() i=0 2024-03-09T14:44:16.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.993+0000 7fec44785980 20 add_watcher() i=1 2024-03-09T14:44:16.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.993+0000 7fec44785980 20 add_watcher() i=2 2024-03-09T14:44:16.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.993+0000 7fec44785980 20 add_watcher() i=3 2024-03-09T14:44:16.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.993+0000 7fec44785980 20 add_watcher() i=4 2024-03-09T14:44:16.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.993+0000 7fec44785980 20 add_watcher() i=5 2024-03-09T14:44:16.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.993+0000 7fec44785980 20 add_watcher() i=6 2024-03-09T14:44:16.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.997+0000 7fec44785980 20 add_watcher() i=7 2024-03-09T14:44:16.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:16.997+0000 7fec44785980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:16.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.001+0000 7feaf8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:16.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.001+0000 7fec44785980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:16.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.001+0000 7fec44785980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:16.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.001+0000 7fec44785980 5 note: GC not initialized 2024-03-09T14:44:16.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.001+0000 7fea737fe640 20 reqs_thread_entry: start 2024-03-09T14:44:16.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.001+0000 7fec44785980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:16.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.001+0000 7fec44785980 20 Filter name: none 2024-03-09T14:44:16.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.001+0000 7fea717fa640 20 reqs_thread_entry: start 2024-03-09T14:44:16.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.001+0000 7fec44785980 20 rados->read ofs=0 len=0 2024-03-09T14:44:16.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.005+0000 7fec44785980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:44:16.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.005+0000 7fec44785980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.005+0000 7fec44785980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:44:17.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.005+0000 7fec44785980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:17.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.005+0000 7fec44785980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.005+0000 7fec44785980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:44:17.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.005+0000 7fec44785980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.009+0000 7fec44785980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:44:17.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.009+0000 7fec44785980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:17.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.009+0000 7fec44785980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.009+0000 7fec44785980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:17.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.013+0000 7feaf8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:17.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.017+0000 7fec44785980 20 remove_watcher() i=0 2024-03-09T14:44:17.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.017+0000 7fec44785980 2 removed watcher, disabling cache 2024-03-09T14:44:17.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.017+0000 7fec44785980 20 remove_watcher() i=1 2024-03-09T14:44:17.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.021+0000 7fec44785980 20 remove_watcher() i=2 2024-03-09T14:44:17.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.021+0000 7fec44785980 20 remove_watcher() i=3 2024-03-09T14:44:17.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.025+0000 7fec44785980 20 remove_watcher() i=4 2024-03-09T14:44:17.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.025+0000 7fec44785980 20 remove_watcher() i=5 2024-03-09T14:44:17.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.029+0000 7fec44785980 20 remove_watcher() i=6 2024-03-09T14:44:17.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.029+0000 7fec44785980 20 remove_watcher() i=7 2024-03-09T14:44:17.040 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:17.040 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:44:17.040 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: a-bucket id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 num_objects: 8 size_kb: 1 num_shards: 13 2024-03-09T14:44:17.041 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:17.041 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-03-09T14:44:17.041 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:17.042 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.043 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.059 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.059 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.105 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.105 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.128 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.128 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.148 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.148 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.168 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.168 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.190 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.190 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.212 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.212 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.233 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.233 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.253 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.253 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.272 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.273 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.294 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.294 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.314 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.314 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.335 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.335 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.354 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.354 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.377 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.377 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.398 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.398 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.418 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.418 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.439 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.440 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.460 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.460 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.480 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.480 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.503 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:17.503 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:17.521 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-09T14:44:17.554 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:17.555 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:17.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.605+0000 7facb5088980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.605+0000 7facb5088980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:17.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.605+0000 7facb5088980 20 realm 2024-03-09T14:44:17.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.605+0000 7facb5088980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.609+0000 7facb5088980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:17.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.609+0000 7facb5088980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:17.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.609+0000 7facb5088980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.609+0000 7facb5088980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:17.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.609+0000 7facb5088980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.609+0000 7facb5088980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:17.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.609+0000 7facb5088980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.613+0000 7facb5088980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:17.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.613+0000 7facb5088980 20 searching for the correct realm 2024-03-09T14:44:17.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.617+0000 7facb2ba0640 0 -- 172.21.15.99:0/440224700 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x55ca2c36c430 msgr2=0x55ca2c36e8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:17.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.625+0000 7facb239f640 0 -- 172.21.15.99:0/440224700 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7facac0ee470 msgr2=0x7facac0ee8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:17.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.841+0000 7facb5088980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:17.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.841+0000 7facb5088980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:17.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.841+0000 7facb5088980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:17.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.841+0000 7facb5088980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:17.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.841+0000 7facb5088980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:17.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.841+0000 7facb5088980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:17.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.841+0000 7facb5088980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.841+0000 7facb5088980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:17.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.841+0000 7facb5088980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.841+0000 7facb5088980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:17.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.841+0000 7facb5088980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.845+0000 7facb5088980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:17.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.845+0000 7facb5088980 20 zone default found 2024-03-09T14:44:17.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.845+0000 7facb5088980 4 Realm: () 2024-03-09T14:44:17.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.845+0000 7facb5088980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:17.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.845+0000 7facb5088980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:17.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.845+0000 7facb5088980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:17.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.845+0000 7facb5088980 20 zonegroup default 2024-03-09T14:44:17.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.845+0000 7facb5088980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.845+0000 7facb5088980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:17.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.845+0000 7facb5088980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.845+0000 7facb5088980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:17.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.845+0000 7facb5088980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.845+0000 7facb5088980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:17.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.845+0000 7facb5088980 20 started sync module instance, tier type = 2024-03-09T14:44:17.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.845+0000 7facb5088980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:17.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.869+0000 7facb5088980 20 add_watcher() i=0 2024-03-09T14:44:17.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.869+0000 7facb5088980 20 add_watcher() i=1 2024-03-09T14:44:17.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.869+0000 7facb5088980 20 add_watcher() i=2 2024-03-09T14:44:17.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.869+0000 7facb5088980 20 add_watcher() i=3 2024-03-09T14:44:17.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.869+0000 7facb5088980 20 add_watcher() i=4 2024-03-09T14:44:17.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.869+0000 7facb5088980 20 add_watcher() i=5 2024-03-09T14:44:17.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.869+0000 7facb5088980 20 add_watcher() i=6 2024-03-09T14:44:17.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.873+0000 7facb5088980 20 add_watcher() i=7 2024-03-09T14:44:17.866 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.873+0000 7facb5088980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:17.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.877+0000 7fab69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:17.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.877+0000 7facb5088980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:17.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.877+0000 7facb5088980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:17.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.877+0000 7facb5088980 5 note: GC not initialized 2024-03-09T14:44:17.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.877+0000 7fab68fe1640 20 reqs_thread_entry: start 2024-03-09T14:44:17.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.877+0000 7facb5088980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:17.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.877+0000 7facb5088980 20 Filter name: none 2024-03-09T14:44:17.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.877+0000 7fab61ffb640 20 reqs_thread_entry: start 2024-03-09T14:44:17.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.877+0000 7facb5088980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.877+0000 7facb5088980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:17.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.877+0000 7facb5088980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.881+0000 7facb5088980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:17.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.881+0000 7facb5088980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:17.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.881+0000 7facb5088980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.881+0000 7facb5088980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:17.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.881+0000 7facb5088980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.881+0000 7facb5088980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:17.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.881+0000 7facb5088980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:17.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.881+0000 7facb5088980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.885+0000 7facb5088980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:17.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.885+0000 7fab69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:17.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.889+0000 7facb5088980 20 remove_watcher() i=0 2024-03-09T14:44:17.884 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.889+0000 7facb5088980 2 removed watcher, disabling cache 2024-03-09T14:44:17.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.893+0000 7facb5088980 20 remove_watcher() i=1 2024-03-09T14:44:17.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.893+0000 7facb5088980 20 remove_watcher() i=2 2024-03-09T14:44:17.891 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.897+0000 7facb5088980 20 remove_watcher() i=3 2024-03-09T14:44:17.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.901+0000 7facb5088980 20 remove_watcher() i=4 2024-03-09T14:44:17.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.901+0000 7facb5088980 20 remove_watcher() i=5 2024-03-09T14:44:17.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.901+0000 7facb5088980 20 remove_watcher() i=6 2024-03-09T14:44:17.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:17.905+0000 7facb5088980 20 remove_watcher() i=7 2024-03-09T14:44:17.914 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:17.914 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:44:17.915 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-set-target-layout id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:44:17.915 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:17.915 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-03-09T14:44:17.952 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:17.952 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:17.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.001+0000 7fdc37947980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.001+0000 7fdc37947980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:17.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.001+0000 7fdc37947980 20 realm 2024-03-09T14:44:17.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.001+0000 7fdc37947980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.001+0000 7fdc37947980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:17.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.001+0000 7fdc37947980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:17.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.001+0000 7fdc37947980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.001+0000 7fdc37947980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:17.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.001+0000 7fdc37947980 20 rados->read ofs=0 len=0 2024-03-09T14:44:17.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.005+0000 7fdc37947980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:18.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.005+0000 7fdc37947980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.005+0000 7fdc37947980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:18.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.005+0000 7fdc37947980 20 searching for the correct realm 2024-03-09T14:44:18.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.013+0000 7fdc3545f640 0 -- 172.21.15.99:0/471323527 >> [v2:172.21.15.99:6808/2872705330,v1:172.21.15.99:6809/2872705330] conn(0x55a5dea08820 msgr2=0x55a5dea0acc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:18.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.017+0000 7fdc35c60640 0 -- 172.21.15.99:0/471323527 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55a5dea102d0 msgr2=0x55a5dea126e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:18.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:18.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:18.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:18.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:18.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:18.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:18.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:18.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:18.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 20 zone default found 2024-03-09T14:44:18.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 4 Realm: () 2024-03-09T14:44:18.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:18.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:18.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:18.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 20 zonegroup default 2024-03-09T14:44:18.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.025+0000 7fdc37947980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.029+0000 7fdc37947980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.029+0000 7fdc37947980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.029+0000 7fdc37947980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.029+0000 7fdc37947980 20 started sync module instance, tier type = 2024-03-09T14:44:18.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.029+0000 7fdc37947980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:18.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.045+0000 7fdc37947980 20 add_watcher() i=0 2024-03-09T14:44:18.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.045+0000 7fdc37947980 20 add_watcher() i=1 2024-03-09T14:44:18.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.045+0000 7fdc37947980 20 add_watcher() i=2 2024-03-09T14:44:18.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.045+0000 7fdc37947980 20 add_watcher() i=3 2024-03-09T14:44:18.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.045+0000 7fdc37947980 20 add_watcher() i=4 2024-03-09T14:44:18.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.045+0000 7fdc37947980 20 add_watcher() i=5 2024-03-09T14:44:18.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.045+0000 7fdc37947980 20 add_watcher() i=6 2024-03-09T14:44:18.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.045+0000 7fdc37947980 20 add_watcher() i=7 2024-03-09T14:44:18.039 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.045+0000 7fdc37947980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:18.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdaebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:18.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:18.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:18.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 5 note: GC not initialized 2024-03-09T14:44:18.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdaeafe5640 20 reqs_thread_entry: start 2024-03-09T14:44:18.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:18.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 20 Filter name: none 2024-03-09T14:44:18.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-03-09T14:44:18.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdae8fe1640 20 reqs_thread_entry: start 2024-03-09T14:44:18.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:18.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-03-09T14:44:18.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-03-09T14:44:18.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 : miss 2024-03-09T14:44:18.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:18.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 info.flags=0x17 2024-03-09T14:44:18.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 to cache LRU end 2024-03-09T14:44:18.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:18.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:18.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.049+0000 7fdc37947980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 2024-03-09T14:44:18.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.057+0000 7fdc37947980 -1 Injecting error=-5 at location=set_target_layout 2024-03-09T14:44:18.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.057+0000 7fdc37947980 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-03-09T14:44:18.060 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.065+0000 7fdaebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:18.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.069+0000 7fdc37947980 20 remove_watcher() i=0 2024-03-09T14:44:18.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.069+0000 7fdc37947980 2 removed watcher, disabling cache 2024-03-09T14:44:18.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.073+0000 7fdc37947980 20 remove_watcher() i=1 2024-03-09T14:44:18.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.077+0000 7fdc37947980 20 remove_watcher() i=2 2024-03-09T14:44:18.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.077+0000 7fdc37947980 20 remove_watcher() i=3 2024-03-09T14:44:18.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.081+0000 7fdc37947980 20 remove_watcher() i=4 2024-03-09T14:44:18.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.081+0000 7fdc37947980 20 remove_watcher() i=5 2024-03-09T14:44:18.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.081+0000 7fdc37947980 20 remove_watcher() i=6 2024-03-09T14:44:18.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.085+0000 7fdc37947980 20 remove_watcher() i=7 2024-03-09T14:44:18.093 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-09T14:44:18.118 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:18.118 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:18.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.165+0000 7fb8aa517980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.169+0000 7fb8aa517980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.169+0000 7fb8aa517980 20 realm 2024-03-09T14:44:18.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.169+0000 7fb8aa517980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.169+0000 7fb8aa517980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.169+0000 7fb8aa517980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:18.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.169+0000 7fb8aa517980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.169+0000 7fb8aa517980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.169+0000 7fb8aa517980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.173+0000 7fb8aa517980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:18.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.173+0000 7fb8aa517980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.177+0000 7fb8aa517980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:18.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.177+0000 7fb8aa517980 20 searching for the correct realm 2024-03-09T14:44:18.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.185+0000 7fb8a802f640 0 -- 172.21.15.99:0/196538413 >> [v2:172.21.15.179:6804/2511961392,v1:172.21.15.179:6806/2511961392] conn(0x7fb8a0017040 msgr2=0x7fb8a0027410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:18.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.401+0000 7fb8a782e640 0 -- 172.21.15.99:0/196538413 >> [v2:172.21.15.179:6807/4275579646,v1:172.21.15.179:6811/4275579646] conn(0x5649605ad330 msgr2=0x5649605af740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:18.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.409+0000 7fb8aa517980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:18.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.409+0000 7fb8aa517980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:18.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.409+0000 7fb8aa517980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:18.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.409+0000 7fb8aa517980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:18.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.409+0000 7fb8aa517980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:18.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.409+0000 7fb8aa517980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:18.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.409+0000 7fb8aa517980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.409+0000 7fb8aa517980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.409+0000 7fb8aa517980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.409+0000 7fb8aa517980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:18.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.409+0000 7fb8aa517980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.413+0000 7fb8aa517980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:18.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.413+0000 7fb8aa517980 20 zone default found 2024-03-09T14:44:18.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.413+0000 7fb8aa517980 4 Realm: () 2024-03-09T14:44:18.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.413+0000 7fb8aa517980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:18.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.413+0000 7fb8aa517980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:18.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.413+0000 7fb8aa517980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:18.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.413+0000 7fb8aa517980 20 zonegroup default 2024-03-09T14:44:18.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.413+0000 7fb8aa517980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.413+0000 7fb8aa517980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.413+0000 7fb8aa517980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.413+0000 7fb8aa517980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.413+0000 7fb8aa517980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.413+0000 7fb8aa517980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.413+0000 7fb8aa517980 20 started sync module instance, tier type = 2024-03-09T14:44:18.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.413+0000 7fb8aa517980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:18.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.437+0000 7fb8aa517980 20 add_watcher() i=0 2024-03-09T14:44:18.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.437+0000 7fb8aa517980 20 add_watcher() i=1 2024-03-09T14:44:18.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.437+0000 7fb8aa517980 20 add_watcher() i=2 2024-03-09T14:44:18.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.437+0000 7fb8aa517980 20 add_watcher() i=3 2024-03-09T14:44:18.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.437+0000 7fb8aa517980 20 add_watcher() i=4 2024-03-09T14:44:18.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.437+0000 7fb8aa517980 20 add_watcher() i=5 2024-03-09T14:44:18.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.441+0000 7fb8aa517980 20 add_watcher() i=6 2024-03-09T14:44:18.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.441+0000 7fb8aa517980 20 add_watcher() i=7 2024-03-09T14:44:18.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.441+0000 7fb8aa517980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:18.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.445+0000 7fb75efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:18.440 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.445+0000 7fb8aa517980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:18.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.445+0000 7fb8aa517980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:18.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.445+0000 7fb8aa517980 5 note: GC not initialized 2024-03-09T14:44:18.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.445+0000 7fb75dfdb640 20 reqs_thread_entry: start 2024-03-09T14:44:18.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.445+0000 7fb8aa517980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:18.441 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.445+0000 7fb8aa517980 20 Filter name: none 2024-03-09T14:44:18.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.449+0000 7fb6cf7fe640 20 reqs_thread_entry: start 2024-03-09T14:44:18.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.449+0000 7fb8aa517980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.449+0000 7fb8aa517980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:18.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.449+0000 7fb8aa517980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.449+0000 7fb8aa517980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:18.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.449+0000 7fb8aa517980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:18.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.449+0000 7fb8aa517980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.449+0000 7fb8aa517980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:18.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.449+0000 7fb8aa517980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.449+0000 7fb8aa517980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:18.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.449+0000 7fb8aa517980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:18.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.453+0000 7fb8aa517980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.446 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.453+0000 7fb8aa517980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.453+0000 7fb75efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:18.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.457+0000 7fb8aa517980 20 remove_watcher() i=0 2024-03-09T14:44:18.453 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.457+0000 7fb8aa517980 2 removed watcher, disabling cache 2024-03-09T14:44:18.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.461+0000 7fb8aa517980 20 remove_watcher() i=1 2024-03-09T14:44:18.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.465+0000 7fb8aa517980 20 remove_watcher() i=2 2024-03-09T14:44:18.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.465+0000 7fb8aa517980 20 remove_watcher() i=3 2024-03-09T14:44:18.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.469+0000 7fb8aa517980 20 remove_watcher() i=4 2024-03-09T14:44:18.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.469+0000 7fb8aa517980 20 remove_watcher() i=5 2024-03-09T14:44:18.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.473+0000 7fb8aa517980 20 remove_watcher() i=6 2024-03-09T14:44:18.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.473+0000 7fb8aa517980 20 remove_watcher() i=7 2024-03-09T14:44:18.482 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:18.482 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:44:18.482 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-set-target-layout id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:44:18.483 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:18.485 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:18.486 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:18.498 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:18.498 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:18.543 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:44:18.577 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:18.577 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:18.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.629+0000 7f5423da5980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.629+0000 7f5423da5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.629+0000 7f5423da5980 20 realm 2024-03-09T14:44:18.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.629+0000 7f5423da5980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.629+0000 7f5423da5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.629+0000 7f5423da5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:18.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.629+0000 7f5423da5980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.629+0000 7f5423da5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.629+0000 7f5423da5980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.633+0000 7f5423da5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:18.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.633+0000 7f5423da5980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.633+0000 7f5423da5980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:18.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.633+0000 7f5423da5980 20 searching for the correct realm 2024-03-09T14:44:18.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.637+0000 7f54220be640 0 -- 172.21.15.99:0/3935992791 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55d5b964f5a0 msgr2=0x55d5b96519b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:18.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.645+0000 7f54210bc640 0 -- 172.21.15.99:0/3935992791 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f541c0709e0 msgr2=0x7f541c05cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:18.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.861+0000 7f5423da5980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:18.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.861+0000 7f5423da5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:18.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.861+0000 7f5423da5980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:18.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.861+0000 7f5423da5980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:18.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.861+0000 7f5423da5980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:18.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.861+0000 7f5423da5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:18.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.861+0000 7f5423da5980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.861+0000 7f5423da5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.861+0000 7f5423da5980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.865+0000 7f5423da5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:18.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.865+0000 7f5423da5980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.865+0000 7f5423da5980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:18.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.865+0000 7f5423da5980 20 zone default found 2024-03-09T14:44:18.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.865+0000 7f5423da5980 4 Realm: () 2024-03-09T14:44:18.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.865+0000 7f5423da5980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:18.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.865+0000 7f5423da5980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:18.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.865+0000 7f5423da5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:18.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.865+0000 7f5423da5980 20 zonegroup default 2024-03-09T14:44:18.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.865+0000 7f5423da5980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.865+0000 7f5423da5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.865+0000 7f5423da5980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.865+0000 7f5423da5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.865+0000 7f5423da5980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.865+0000 7f5423da5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:18.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.865+0000 7f5423da5980 20 started sync module instance, tier type = 2024-03-09T14:44:18.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.865+0000 7f5423da5980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:18.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.893+0000 7f5423da5980 20 add_watcher() i=0 2024-03-09T14:44:18.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.893+0000 7f5423da5980 20 add_watcher() i=1 2024-03-09T14:44:18.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.893+0000 7f5423da5980 20 add_watcher() i=2 2024-03-09T14:44:18.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.893+0000 7f5423da5980 20 add_watcher() i=3 2024-03-09T14:44:18.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.893+0000 7f5423da5980 20 add_watcher() i=4 2024-03-09T14:44:18.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.893+0000 7f5423da5980 20 add_watcher() i=5 2024-03-09T14:44:18.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.893+0000 7f5423da5980 20 add_watcher() i=6 2024-03-09T14:44:18.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.893+0000 7f5423da5980 20 add_watcher() i=7 2024-03-09T14:44:18.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.893+0000 7f5423da5980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:18.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.897+0000 7f52d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:18.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.897+0000 7f5423da5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:18.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.897+0000 7f5423da5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:18.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.897+0000 7f5423da5980 5 note: GC not initialized 2024-03-09T14:44:18.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.901+0000 7f52d27fc640 20 reqs_thread_entry: start 2024-03-09T14:44:18.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.901+0000 7f5423da5980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:18.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.901+0000 7f5423da5980 20 Filter name: none 2024-03-09T14:44:18.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.901+0000 7f5243fff640 20 reqs_thread_entry: start 2024-03-09T14:44:18.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.901+0000 7f5423da5980 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-03-09T14:44:18.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.901+0000 7f5423da5980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.901+0000 7f5423da5980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:18.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.901+0000 7f5423da5980 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-03-09T14:44:18.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.901+0000 7f5423da5980 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-03-09T14:44:18.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.901+0000 7f5423da5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 : miss 2024-03-09T14:44:18.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.901+0000 7f5423da5980 20 rados->read ofs=0 len=0 2024-03-09T14:44:18.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.901+0000 7f5423da5980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:18.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.901+0000 7f5423da5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 info.flags=0x17 2024-03-09T14:44:18.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.901+0000 7f5423da5980 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 to cache LRU end 2024-03-09T14:44:18.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.901+0000 7f5423da5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:18.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.901+0000 7f5423da5980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:18.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.901+0000 7f5423da5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 2024-03-09T14:44:18.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.909+0000 7f5423da5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 info.flags=0x17 2024-03-09T14:44:18.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.909+0000 7f5423da5980 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 to cache LRU end 2024-03-09T14:44:18.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.909+0000 7f5423da5980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:18.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.909+0000 7f5423da5980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20, ofs0, ns] 2024-03-09T14:44:18.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.909+0000 7f53057fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94376426802080 notifier 6210 bl.length()=1001 2024-03-09T14:44:18.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.909+0000 7f53057fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 info.flags=0x17 2024-03-09T14:44:18.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.909+0000 7f53057fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 to cache LRU end 2024-03-09T14:44:18.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.909+0000 7f53057fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:18.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.913+0000 7f5423da5980 20 handle_bi_update(): bucket=:error-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20]): orig_sources= new_sources= 2024-03-09T14:44:18.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.913+0000 7f5423da5980 20 handle_bi_update(): bucket=:error-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20]): potential sources added=[] removed=[] 2024-03-09T14:44:18.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.913+0000 7f5423da5980 20 handle_bi_update(): bucket=:error-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20]): orig_dests= new_dests= 2024-03-09T14:44:18.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.913+0000 7f5423da5980 20 handle_bi_update(): bucket=:error-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20]): potential dests added=[] removed=[] 2024-03-09T14:44:18.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.0 2024-03-09T14:44:18.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.0 2024-03-09T14:44:18.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.1 2024-03-09T14:44:18.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.1 2024-03-09T14:44:18.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.2 2024-03-09T14:44:18.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.2 2024-03-09T14:44:18.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.3 2024-03-09T14:44:18.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.3 2024-03-09T14:44:18.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.4 2024-03-09T14:44:18.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.4 2024-03-09T14:44:18.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.5 2024-03-09T14:44:18.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.5 2024-03-09T14:44:18.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.6 2024-03-09T14:44:18.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.6 2024-03-09T14:44:18.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.7 2024-03-09T14:44:18.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.7 2024-03-09T14:44:18.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.8 2024-03-09T14:44:18.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.8 2024-03-09T14:44:18.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.9 2024-03-09T14:44:18.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.9 2024-03-09T14:44:18.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.10 2024-03-09T14:44:18.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.10 2024-03-09T14:44:18.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.11 2024-03-09T14:44:18.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1.11 2024-03-09T14:44:18.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.0 2024-03-09T14:44:18.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.1 2024-03-09T14:44:18.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.2 2024-03-09T14:44:18.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.3 2024-03-09T14:44:18.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.917+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.4 2024-03-09T14:44:18.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.921+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.5 2024-03-09T14:44:18.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.921+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.6 2024-03-09T14:44:18.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.921+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.7 2024-03-09T14:44:18.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.921+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.8 2024-03-09T14:44:18.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.921+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.9 2024-03-09T14:44:18.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.925+0000 7f5423da5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20.10 2024-03-09T14:44:18.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.929+0000 7f5423da5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 : hit (requested=0x17, cached=0x17) 2024-03-09T14:44:18.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.929+0000 7f5423da5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 2024-03-09T14:44:18.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.933+0000 7f5423da5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 info.flags=0x17 2024-03-09T14:44:18.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.933+0000 7f5423da5980 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 to cache LRU end 2024-03-09T14:44:18.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.933+0000 7f5423da5980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:18.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.933+0000 7f5423da5980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20, ofs0, ns] 2024-03-09T14:44:18.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.933+0000 7f5304ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94376426802080 notifier 6210 bl.length()=969 2024-03-09T14:44:18.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.933+0000 7f5304ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 info.flags=0x17 2024-03-09T14:44:18.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.933+0000 7f5304ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 to cache LRU end 2024-03-09T14:44:18.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.933+0000 7f5304ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:18.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.933+0000 7f5423da5980 20 handle_bi_update(): bucket=:error-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20]): orig_sources= new_sources= 2024-03-09T14:44:18.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.933+0000 7f5423da5980 20 handle_bi_update(): bucket=:error-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20]): potential sources added=[] removed=[] 2024-03-09T14:44:18.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.933+0000 7f5423da5980 20 handle_bi_update(): bucket=:error-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20]): orig_dests= new_dests= 2024-03-09T14:44:18.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.933+0000 7f5423da5980 20 handle_bi_update(): bucket=:error-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20]): potential dests added=[] removed=[] 2024-03-09T14:44:18.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.937+0000 7f5423da5980 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-03-09T14:44:18.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.941+0000 7f52d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:18.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.945+0000 7f5423da5980 20 remove_watcher() i=0 2024-03-09T14:44:18.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.945+0000 7f5423da5980 2 removed watcher, disabling cache 2024-03-09T14:44:18.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.949+0000 7f5423da5980 20 remove_watcher() i=1 2024-03-09T14:44:18.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.949+0000 7f5423da5980 20 remove_watcher() i=2 2024-03-09T14:44:18.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.953+0000 7f5423da5980 20 remove_watcher() i=3 2024-03-09T14:44:18.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.953+0000 7f5423da5980 20 remove_watcher() i=4 2024-03-09T14:44:18.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.957+0000 7f5423da5980 20 remove_watcher() i=5 2024-03-09T14:44:18.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.957+0000 7f5423da5980 20 remove_watcher() i=6 2024-03-09T14:44:18.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:18.957+0000 7f5423da5980 20 remove_watcher() i=7 2024-03-09T14:44:18.970 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-09T14:44:18.996 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:18.996 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:19.041 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.045+0000 7fd7fb338980 20 rados->read ofs=0 len=0 2024-03-09T14:44:19.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.049+0000 7fd7fb338980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:19.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.049+0000 7fd7fb338980 20 realm 2024-03-09T14:44:19.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.049+0000 7fd7fb338980 20 rados->read ofs=0 len=0 2024-03-09T14:44:19.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.049+0000 7fd7fb338980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:19.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.049+0000 7fd7fb338980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:19.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.049+0000 7fd7fb338980 20 rados->read ofs=0 len=0 2024-03-09T14:44:19.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.049+0000 7fd7fb338980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:19.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.049+0000 7fd7fb338980 20 rados->read ofs=0 len=0 2024-03-09T14:44:19.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.049+0000 7fd7fb338980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:19.045 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.049+0000 7fd7fb338980 20 rados->read ofs=0 len=0 2024-03-09T14:44:19.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.053+0000 7fd7fb338980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:19.047 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.053+0000 7fd7fb338980 20 searching for the correct realm 2024-03-09T14:44:19.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.057+0000 7fd7f9651640 0 -- 172.21.15.99:0/1837338229 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7fd7ec048930 msgr2=0x7fd7ec046400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:19.058 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.065+0000 7fd7f864f640 0 -- 172.21.15.99:0/1837338229 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fd7f0008040 msgr2=0x7fd7f0070400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:19.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.281+0000 7fd7fb338980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:19.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.281+0000 7fd7fb338980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:19.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.281+0000 7fd7fb338980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:19.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.281+0000 7fd7fb338980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:19.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.281+0000 7fd7fb338980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:19.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.281+0000 7fd7fb338980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:19.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.281+0000 7fd7fb338980 20 rados->read ofs=0 len=0 2024-03-09T14:44:19.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.281+0000 7fd7fb338980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:19.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.281+0000 7fd7fb338980 20 rados->read ofs=0 len=0 2024-03-09T14:44:19.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.285+0000 7fd7fb338980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:19.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.285+0000 7fd7fb338980 20 rados->read ofs=0 len=0 2024-03-09T14:44:19.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.285+0000 7fd7fb338980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:19.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.285+0000 7fd7fb338980 20 zone default found 2024-03-09T14:44:19.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.285+0000 7fd7fb338980 4 Realm: () 2024-03-09T14:44:19.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.285+0000 7fd7fb338980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:19.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.285+0000 7fd7fb338980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:19.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.285+0000 7fd7fb338980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:19.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.285+0000 7fd7fb338980 20 zonegroup default 2024-03-09T14:44:19.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.285+0000 7fd7fb338980 20 rados->read ofs=0 len=0 2024-03-09T14:44:19.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.285+0000 7fd7fb338980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:19.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.285+0000 7fd7fb338980 20 rados->read ofs=0 len=0 2024-03-09T14:44:19.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.285+0000 7fd7fb338980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:19.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.285+0000 7fd7fb338980 20 rados->read ofs=0 len=0 2024-03-09T14:44:19.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.285+0000 7fd7fb338980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:19.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.285+0000 7fd7fb338980 20 started sync module instance, tier type = 2024-03-09T14:44:19.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.285+0000 7fd7fb338980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:19.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.309+0000 7fd7fb338980 20 add_watcher() i=0 2024-03-09T14:44:19.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.309+0000 7fd7fb338980 20 add_watcher() i=1 2024-03-09T14:44:19.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.309+0000 7fd7fb338980 20 add_watcher() i=2 2024-03-09T14:44:19.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.309+0000 7fd7fb338980 20 add_watcher() i=3 2024-03-09T14:44:19.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.309+0000 7fd7fb338980 20 add_watcher() i=4 2024-03-09T14:44:19.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.309+0000 7fd7fb338980 20 add_watcher() i=5 2024-03-09T14:44:19.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.309+0000 7fd7fb338980 20 add_watcher() i=6 2024-03-09T14:44:19.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.309+0000 7fd7fb338980 20 add_watcher() i=7 2024-03-09T14:44:19.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.309+0000 7fd7fb338980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:19.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.313+0000 7fd6aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:19.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.313+0000 7fd7fb338980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:19.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.313+0000 7fd7fb338980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:19.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.313+0000 7fd7fb338980 5 note: GC not initialized 2024-03-09T14:44:19.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.313+0000 7fd6adfe3640 20 reqs_thread_entry: start 2024-03-09T14:44:19.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.313+0000 7fd7fb338980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:19.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.313+0000 7fd7fb338980 20 Filter name: none 2024-03-09T14:44:19.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.313+0000 7fd61f7fe640 20 reqs_thread_entry: start 2024-03-09T14:44:19.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.317+0000 7fd7fb338980 20 rados->read ofs=0 len=0 2024-03-09T14:44:19.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.317+0000 7fd7fb338980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:19.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.317+0000 7fd7fb338980 20 rados->read ofs=0 len=0 2024-03-09T14:44:19.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.317+0000 7fd7fb338980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:19.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.317+0000 7fd7fb338980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:19.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.317+0000 7fd7fb338980 20 rados->read ofs=0 len=0 2024-03-09T14:44:19.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.317+0000 7fd7fb338980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:19.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.317+0000 7fd7fb338980 20 rados->read ofs=0 len=0 2024-03-09T14:44:19.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.317+0000 7fd7fb338980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:19.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.317+0000 7fd7fb338980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:19.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.321+0000 7fd7fb338980 20 rados->read ofs=0 len=0 2024-03-09T14:44:19.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.321+0000 7fd7fb338980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:19.315 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.321+0000 7fd6aefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:19.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.329+0000 7fd7fb338980 20 remove_watcher() i=0 2024-03-09T14:44:19.324 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.329+0000 7fd7fb338980 2 removed watcher, disabling cache 2024-03-09T14:44:19.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.333+0000 7fd7fb338980 20 remove_watcher() i=1 2024-03-09T14:44:19.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.337+0000 7fd7fb338980 20 remove_watcher() i=2 2024-03-09T14:44:19.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.341+0000 7fd7fb338980 20 remove_watcher() i=3 2024-03-09T14:44:19.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.345+0000 7fd7fb338980 20 remove_watcher() i=4 2024-03-09T14:44:19.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.345+0000 7fd7fb338980 20 remove_watcher() i=5 2024-03-09T14:44:19.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.349+0000 7fd7fb338980 20 remove_watcher() i=6 2024-03-09T14:44:19.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:19.349+0000 7fd7fb338980 20 remove_watcher() i=7 2024-03-09T14:44:19.360 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:19.360 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:44:19.360 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-set-target-layout id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-09T14:44:19.360 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:19.361 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.361 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.365 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.365 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.419 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.419 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.471 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-03-09T14:44:19.471 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:19.472 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.472 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.495 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.495 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.541 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.541 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.562 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.562 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.582 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.582 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.601 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.601 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.622 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.622 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.645 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.645 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.667 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.667 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.686 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.687 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.706 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.706 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.725 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.725 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.747 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.747 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.767 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.767 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.791 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.792 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.808 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.808 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.828 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.828 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.850 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.850 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.871 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.871 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.890 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.890 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.911 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.911 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.930 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:19.931 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:19.950 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-09T14:44:19.982 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:19.982 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:20.029 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.033+0000 7fd46ea88980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.037+0000 7fd46ea88980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.037+0000 7fd46ea88980 20 realm 2024-03-09T14:44:20.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.037+0000 7fd46ea88980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.037+0000 7fd46ea88980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.037+0000 7fd46ea88980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:20.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.037+0000 7fd46ea88980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.037+0000 7fd46ea88980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.032 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.037+0000 7fd46ea88980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.037+0000 7fd46ea88980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:20.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.037+0000 7fd46ea88980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.041+0000 7fd46ea88980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:20.035 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.041+0000 7fd46ea88980 20 searching for the correct realm 2024-03-09T14:44:20.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.045+0000 7fd46c5a0640 0 -- 172.21.15.99:0/2888182794 >> [v2:172.21.15.99:6808/2872705330,v1:172.21.15.99:6809/2872705330] conn(0x5584ccd37b90 msgr2=0x5584ccd3a000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:20.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.053+0000 7fd46bd9f640 0 -- 172.21.15.99:0/2888182794 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fd464067290 msgr2=0x7fd46406d2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:20.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:20.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:20.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:20.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:20.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:20.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:20.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.054 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:20.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.055 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:20.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 zone default found 2024-03-09T14:44:20.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 4 Realm: () 2024-03-09T14:44:20.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:20.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:20.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:20.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 zonegroup default 2024-03-09T14:44:20.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 started sync module instance, tier type = 2024-03-09T14:44:20.057 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.061+0000 7fd46ea88980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:20.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.077+0000 7fd46ea88980 20 add_watcher() i=0 2024-03-09T14:44:20.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.077+0000 7fd46ea88980 20 add_watcher() i=1 2024-03-09T14:44:20.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.077+0000 7fd46ea88980 20 add_watcher() i=2 2024-03-09T14:44:20.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.077+0000 7fd46ea88980 20 add_watcher() i=3 2024-03-09T14:44:20.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.077+0000 7fd46ea88980 20 add_watcher() i=4 2024-03-09T14:44:20.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.077+0000 7fd46ea88980 20 add_watcher() i=5 2024-03-09T14:44:20.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.077+0000 7fd46ea88980 20 add_watcher() i=6 2024-03-09T14:44:20.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.081+0000 7fd46ea88980 20 add_watcher() i=7 2024-03-09T14:44:20.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.081+0000 7fd46ea88980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:20.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.081+0000 7fd3237de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:20.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.081+0000 7fd46ea88980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:20.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.081+0000 7fd46ea88980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:20.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.085+0000 7fd46ea88980 5 note: GC not initialized 2024-03-09T14:44:20.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.085+0000 7fd3227dc640 20 reqs_thread_entry: start 2024-03-09T14:44:20.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.085+0000 7fd46ea88980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:20.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.085+0000 7fd46ea88980 20 Filter name: none 2024-03-09T14:44:20.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.085+0000 7fd31b7fe640 20 reqs_thread_entry: start 2024-03-09T14:44:20.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.085+0000 7fd46ea88980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.085+0000 7fd46ea88980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:20.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.085+0000 7fd46ea88980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.085+0000 7fd46ea88980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:20.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.085+0000 7fd46ea88980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:20.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.085+0000 7fd46ea88980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.085+0000 7fd46ea88980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:20.080 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.085+0000 7fd46ea88980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.085+0000 7fd46ea88980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:20.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.085+0000 7fd46ea88980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:20.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.089+0000 7fd46ea88980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.089+0000 7fd46ea88980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.089+0000 7fd3237de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:20.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.093+0000 7fd46ea88980 20 remove_watcher() i=0 2024-03-09T14:44:20.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.093+0000 7fd46ea88980 2 removed watcher, disabling cache 2024-03-09T14:44:20.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.097+0000 7fd46ea88980 20 remove_watcher() i=1 2024-03-09T14:44:20.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.097+0000 7fd46ea88980 20 remove_watcher() i=2 2024-03-09T14:44:20.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.101+0000 7fd46ea88980 20 remove_watcher() i=3 2024-03-09T14:44:20.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.101+0000 7fd46ea88980 20 remove_watcher() i=4 2024-03-09T14:44:20.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.105+0000 7fd46ea88980 20 remove_watcher() i=5 2024-03-09T14:44:20.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.105+0000 7fd46ea88980 20 remove_watcher() i=6 2024-03-09T14:44:20.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.105+0000 7fd46ea88980 20 remove_watcher() i=7 2024-03-09T14:44:20.115 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:20.115 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:44:20.115 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-set-target-layout id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:44:20.115 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:20.115 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-03-09T14:44:20.149 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:20.149 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:20.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.197+0000 7ff0149fd980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.201+0000 7ff0149fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.201+0000 7ff0149fd980 20 realm 2024-03-09T14:44:20.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.201+0000 7ff0149fd980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.201+0000 7ff0149fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.201+0000 7ff0149fd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:20.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.201+0000 7ff0149fd980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.201+0000 7ff0149fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.201+0000 7ff0149fd980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.201+0000 7ff0149fd980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:20.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.201+0000 7ff0149fd980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.205+0000 7ff0149fd980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:20.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.205+0000 7ff0149fd980 20 searching for the correct realm 2024-03-09T14:44:20.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.209+0000 7ff012d16640 0 -- 172.21.15.99:0/3956629181 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x560828a7b140 msgr2=0x560828a7d550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:20.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.213+0000 7ff011d14640 0 -- 172.21.15.99:0/3956629181 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7ff00400a040 msgr2=0x7ff004033960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:20.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.429+0000 7ff0149fd980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:20.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.429+0000 7ff0149fd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:20.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.429+0000 7ff0149fd980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:20.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.429+0000 7ff0149fd980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:20.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.429+0000 7ff0149fd980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:20.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.429+0000 7ff0149fd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:20.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.429+0000 7ff0149fd980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.429+0000 7ff0149fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.429+0000 7ff0149fd980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.433+0000 7ff0149fd980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:20.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.433+0000 7ff0149fd980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.433+0000 7ff0149fd980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:20.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.433+0000 7ff0149fd980 20 zone default found 2024-03-09T14:44:20.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.433+0000 7ff0149fd980 4 Realm: () 2024-03-09T14:44:20.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.433+0000 7ff0149fd980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:20.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.433+0000 7ff0149fd980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:20.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.433+0000 7ff0149fd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:20.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.433+0000 7ff0149fd980 20 zonegroup default 2024-03-09T14:44:20.427 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.433+0000 7ff0149fd980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.433+0000 7ff0149fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.433+0000 7ff0149fd980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.433+0000 7ff0149fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.433+0000 7ff0149fd980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.433+0000 7ff0149fd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.433+0000 7ff0149fd980 20 started sync module instance, tier type = 2024-03-09T14:44:20.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.433+0000 7ff0149fd980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:20.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.465+0000 7ff0149fd980 20 add_watcher() i=0 2024-03-09T14:44:20.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.465+0000 7ff0149fd980 20 add_watcher() i=1 2024-03-09T14:44:20.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.465+0000 7ff0149fd980 20 add_watcher() i=2 2024-03-09T14:44:20.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.465+0000 7ff0149fd980 20 add_watcher() i=3 2024-03-09T14:44:20.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.465+0000 7ff0149fd980 20 add_watcher() i=4 2024-03-09T14:44:20.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.465+0000 7ff0149fd980 20 add_watcher() i=5 2024-03-09T14:44:20.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.465+0000 7ff0149fd980 20 add_watcher() i=6 2024-03-09T14:44:20.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.465+0000 7ff0149fd980 20 add_watcher() i=7 2024-03-09T14:44:20.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.465+0000 7ff0149fd980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:20.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.469+0000 7feec8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:20.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.469+0000 7ff0149fd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:20.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.469+0000 7ff0149fd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:20.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.469+0000 7ff0149fd980 5 note: GC not initialized 2024-03-09T14:44:20.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.469+0000 7fee437fe640 20 reqs_thread_entry: start 2024-03-09T14:44:20.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.473+0000 7ff0149fd980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:20.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.473+0000 7ff0149fd980 20 Filter name: none 2024-03-09T14:44:20.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.473+0000 7fee417fa640 20 reqs_thread_entry: start 2024-03-09T14:44:20.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.473+0000 7ff0149fd980 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-03-09T14:44:20.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.473+0000 7ff0149fd980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.473+0000 7ff0149fd980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:20.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.473+0000 7ff0149fd980 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-03-09T14:44:20.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.473+0000 7ff0149fd980 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-03-09T14:44:20.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.473+0000 7ff0149fd980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21 : miss 2024-03-09T14:44:20.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.473+0000 7ff0149fd980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.473+0000 7ff0149fd980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:20.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.473+0000 7ff0149fd980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21 info.flags=0x17 2024-03-09T14:44:20.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.473+0000 7ff0149fd980 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21 to cache LRU end 2024-03-09T14:44:20.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.473+0000 7ff0149fd980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:20.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.473+0000 7ff0149fd980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:20.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.473+0000 7ff0149fd980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21 2024-03-09T14:44:20.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.481+0000 7ff0149fd980 -1 Injecting error=-125 at location=set_target_layout 2024-03-09T14:44:20.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.485+0000 7ff0149fd980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21 info.flags=0x17 2024-03-09T14:44:20.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.485+0000 7ff0149fd980 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21 to cache LRU end 2024-03-09T14:44:20.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.485+0000 7ff0149fd980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:20.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.485+0000 7ff0149fd980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21, ofs0, ns] 2024-03-09T14:44:20.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.485+0000 7feef57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94593041842656 notifier 6267 bl.length()=1001 2024-03-09T14:44:20.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.485+0000 7feef57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21 info.flags=0x17 2024-03-09T14:44:20.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.485+0000 7feef57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21 to cache LRU end 2024-03-09T14:44:20.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.485+0000 7feef57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:20.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.485+0000 7ff0149fd980 20 handle_bi_update(): bucket=:error-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21]): orig_sources= new_sources= 2024-03-09T14:44:20.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.485+0000 7ff0149fd980 20 handle_bi_update(): bucket=:error-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21]): potential sources added=[] removed=[] 2024-03-09T14:44:20.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.485+0000 7ff0149fd980 20 handle_bi_update(): bucket=:error-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21]): orig_dests= new_dests= 2024-03-09T14:44:20.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.485+0000 7ff0149fd980 20 handle_bi_update(): bucket=:error-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21]): potential dests added=[] removed=[] 2024-03-09T14:44:20.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.0 2024-03-09T14:44:20.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.0 2024-03-09T14:44:20.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.1 2024-03-09T14:44:20.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.1 2024-03-09T14:44:20.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.2 2024-03-09T14:44:20.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.2 2024-03-09T14:44:20.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.3 2024-03-09T14:44:20.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.3 2024-03-09T14:44:20.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.4 2024-03-09T14:44:20.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.4 2024-03-09T14:44:20.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.5 2024-03-09T14:44:20.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.5 2024-03-09T14:44:20.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.6 2024-03-09T14:44:20.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.6 2024-03-09T14:44:20.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.7 2024-03-09T14:44:20.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.7 2024-03-09T14:44:20.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.8 2024-03-09T14:44:20.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.8 2024-03-09T14:44:20.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.9 2024-03-09T14:44:20.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.9 2024-03-09T14:44:20.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.10 2024-03-09T14:44:20.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.10 2024-03-09T14:44:20.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.11 2024-03-09T14:44:20.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1.11 2024-03-09T14:44:20.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.489+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.0 2024-03-09T14:44:20.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.493+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.1 2024-03-09T14:44:20.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.493+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.2 2024-03-09T14:44:20.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.493+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.3 2024-03-09T14:44:20.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.493+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.4 2024-03-09T14:44:20.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.497+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.5 2024-03-09T14:44:20.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.497+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.6 2024-03-09T14:44:20.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.497+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.7 2024-03-09T14:44:20.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.497+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.8 2024-03-09T14:44:20.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.501+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.9 2024-03-09T14:44:20.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.501+0000 7ff0149fd980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21.10 2024-03-09T14:44:20.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.509+0000 7ff0149fd980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21 : hit (requested=0x17, cached=0x17) 2024-03-09T14:44:20.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.509+0000 7ff0149fd980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21 2024-03-09T14:44:20.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.509+0000 7ff0149fd980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21 info.flags=0x17 2024-03-09T14:44:20.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.509+0000 7ff0149fd980 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21 to cache LRU end 2024-03-09T14:44:20.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.509+0000 7ff0149fd980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:20.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.509+0000 7ff0149fd980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21, ofs0, ns] 2024-03-09T14:44:20.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.513+0000 7feef57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464287 cookie 94593041842656 notifier 6267 bl.length()=969 2024-03-09T14:44:20.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.513+0000 7feef57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21 info.flags=0x17 2024-03-09T14:44:20.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.513+0000 7feef57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21 to cache LRU end 2024-03-09T14:44:20.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.513+0000 7feef57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:20.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.513+0000 7ff0149fd980 20 handle_bi_update(): bucket=:error-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21]): orig_sources= new_sources= 2024-03-09T14:44:20.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.513+0000 7ff0149fd980 20 handle_bi_update(): bucket=:error-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21]): potential sources added=[] removed=[] 2024-03-09T14:44:20.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.513+0000 7ff0149fd980 20 handle_bi_update(): bucket=:error-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21]): orig_dests= new_dests= 2024-03-09T14:44:20.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.513+0000 7ff0149fd980 20 handle_bi_update(): bucket=:error-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21]): potential dests added=[] removed=[] 2024-03-09T14:44:20.511 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.517+0000 7ff0149fd980 1 execute INFO: reshard of bucket "error-at-set-target-layout" completed successfully 2024-03-09T14:44:20.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.521+0000 7feec8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:20.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.525+0000 7ff0149fd980 20 remove_watcher() i=0 2024-03-09T14:44:20.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.525+0000 7ff0149fd980 2 removed watcher, disabling cache 2024-03-09T14:44:20.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.529+0000 7ff0149fd980 20 remove_watcher() i=1 2024-03-09T14:44:20.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.529+0000 7ff0149fd980 20 remove_watcher() i=2 2024-03-09T14:44:20.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.533+0000 7ff0149fd980 20 remove_watcher() i=3 2024-03-09T14:44:20.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.533+0000 7ff0149fd980 20 remove_watcher() i=4 2024-03-09T14:44:20.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.537+0000 7ff0149fd980 20 remove_watcher() i=5 2024-03-09T14:44:20.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.537+0000 7ff0149fd980 20 remove_watcher() i=6 2024-03-09T14:44:20.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.537+0000 7ff0149fd980 20 remove_watcher() i=7 2024-03-09T14:44:20.550 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-03-09T14:44:20.581 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:20.581 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:20.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.633+0000 7f03070d9980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.633+0000 7f03070d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.633+0000 7f03070d9980 20 realm 2024-03-09T14:44:20.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.633+0000 7f03070d9980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.633+0000 7f03070d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.633+0000 7f03070d9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:20.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.633+0000 7f03070d9980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.633+0000 7f03070d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.628 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.633+0000 7f03070d9980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.637+0000 7f03070d9980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:20.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.637+0000 7f03070d9980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.637+0000 7f03070d9980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:20.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.637+0000 7f03070d9980 20 searching for the correct realm 2024-03-09T14:44:20.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.641+0000 7f02fffff640 0 -- 172.21.15.99:0/2716210989 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f02f80c3940 msgr2=0x7f02f80d2410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:20.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.649+0000 7f02fffff640 0 -- 172.21.15.99:0/2716210989 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f030000e040 msgr2=0x7f0300026940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:20.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.865+0000 7f03070d9980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:20.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.865+0000 7f03070d9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:20.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.865+0000 7f03070d9980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:20.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.865+0000 7f03070d9980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:20.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.865+0000 7f03070d9980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:20.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.865+0000 7f03070d9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:20.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.865+0000 7f03070d9980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.865+0000 7f03070d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.865+0000 7f03070d9980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.865+0000 7f03070d9980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:20.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.869+0000 7f03070d9980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.869+0000 7f03070d9980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:20.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.869+0000 7f03070d9980 20 zone default found 2024-03-09T14:44:20.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.869+0000 7f03070d9980 4 Realm: () 2024-03-09T14:44:20.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.869+0000 7f03070d9980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:20.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.869+0000 7f03070d9980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:20.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.869+0000 7f03070d9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:20.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.869+0000 7f03070d9980 20 zonegroup default 2024-03-09T14:44:20.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.869+0000 7f03070d9980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.869+0000 7f03070d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.869+0000 7f03070d9980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.869+0000 7f03070d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.869+0000 7f03070d9980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.869+0000 7f03070d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.869+0000 7f03070d9980 20 started sync module instance, tier type = 2024-03-09T14:44:20.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.869+0000 7f03070d9980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:20.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.893+0000 7f03070d9980 20 add_watcher() i=0 2024-03-09T14:44:20.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.893+0000 7f03070d9980 20 add_watcher() i=1 2024-03-09T14:44:20.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.893+0000 7f03070d9980 20 add_watcher() i=2 2024-03-09T14:44:20.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.893+0000 7f03070d9980 20 add_watcher() i=3 2024-03-09T14:44:20.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.893+0000 7f03070d9980 20 add_watcher() i=4 2024-03-09T14:44:20.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.893+0000 7f03070d9980 20 add_watcher() i=5 2024-03-09T14:44:20.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.897+0000 7f03070d9980 20 add_watcher() i=6 2024-03-09T14:44:20.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.897+0000 7f03070d9980 20 add_watcher() i=7 2024-03-09T14:44:20.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.897+0000 7f03070d9980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:20.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.901+0000 7f01bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:20.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.901+0000 7f03070d9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:20.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.901+0000 7f03070d9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:20.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.901+0000 7f03070d9980 5 note: GC not initialized 2024-03-09T14:44:20.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.901+0000 7f01ba7e4640 20 reqs_thread_entry: start 2024-03-09T14:44:20.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.901+0000 7f03070d9980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:20.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.901+0000 7f03070d9980 20 Filter name: none 2024-03-09T14:44:20.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.901+0000 7f01b37fe640 20 reqs_thread_entry: start 2024-03-09T14:44:20.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.901+0000 7f03070d9980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.901+0000 7f03070d9980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:20.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.901+0000 7f03070d9980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.905+0000 7f03070d9980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:20.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.905+0000 7f03070d9980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:20.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.905+0000 7f03070d9980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.905+0000 7f03070d9980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:20.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.905+0000 7f03070d9980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.905+0000 7f03070d9980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:20.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.905+0000 7f03070d9980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:20.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.909+0000 7f03070d9980 20 rados->read ofs=0 len=0 2024-03-09T14:44:20.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.909+0000 7f03070d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:20.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.909+0000 7f01bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:20.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.917+0000 7f03070d9980 20 remove_watcher() i=0 2024-03-09T14:44:20.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.917+0000 7f03070d9980 2 removed watcher, disabling cache 2024-03-09T14:44:20.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.917+0000 7f03070d9980 20 remove_watcher() i=1 2024-03-09T14:44:20.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.921+0000 7f03070d9980 20 remove_watcher() i=2 2024-03-09T14:44:20.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.921+0000 7f03070d9980 20 remove_watcher() i=3 2024-03-09T14:44:20.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.925+0000 7f03070d9980 20 remove_watcher() i=4 2024-03-09T14:44:20.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.925+0000 7f03070d9980 20 remove_watcher() i=5 2024-03-09T14:44:20.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.925+0000 7f03070d9980 20 remove_watcher() i=6 2024-03-09T14:44:20.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:20.929+0000 7f03070d9980 20 remove_watcher() i=7 2024-03-09T14:44:20.940 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:20.940 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:44:20.940 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-set-target-layout id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21 num_objects: 20 size_kb: 1 num_shards: 12 2024-03-09T14:44:20.940 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:20.941 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:20.941 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:20.944 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:20.944 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.002 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.002 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.047 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with abort at set_target_layout 2024-03-09T14:44:21.048 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:21.050 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.050 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.077 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.077 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.126 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.126 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.148 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.148 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.169 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.169 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.189 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.189 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.209 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.209 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.231 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.231 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.252 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.252 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.273 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.273 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.295 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.295 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.315 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.315 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.335 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.336 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.358 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.358 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.380 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.380 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.400 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.401 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.423 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.423 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.445 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.445 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.467 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.467 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.488 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.488 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.509 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.509 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.530 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:21.530 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:21.549 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-03-09T14:44:21.580 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:21.580 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:21.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.636+0000 7f31df279980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.636+0000 7f31df279980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:21.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.636+0000 7f31df279980 20 realm 2024-03-09T14:44:21.633 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.636+0000 7f31df279980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.640+0000 7f31df279980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:21.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.640+0000 7f31df279980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:21.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.640+0000 7f31df279980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.640+0000 7f31df279980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:21.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.640+0000 7f31df279980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.640+0000 7f31df279980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:21.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.640+0000 7f31df279980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.648+0000 7f31df279980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:21.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.648+0000 7f31df279980 20 searching for the correct realm 2024-03-09T14:44:21.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.652+0000 7f31dcd91640 0 -- 172.21.15.99:0/1675754266 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x55d4ee2a3f10 msgr2=0x55d4ee2a63b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:21.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.660+0000 7f31dc590640 0 -- 172.21.15.99:0/1675754266 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f31cc07b400 msgr2=0x7f31cc0554d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:21.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:21.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:21.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:21.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:21.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:21.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:21.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:21.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:21.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:21.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 20 zone default found 2024-03-09T14:44:21.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 4 Realm: () 2024-03-09T14:44:21.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:21.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:21.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:21.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 20 zonegroup default 2024-03-09T14:44:21.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:21.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.672+0000 7f31df279980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.676+0000 7f31df279980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:21.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.676+0000 7f31df279980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.676+0000 7f31df279980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:21.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.676+0000 7f31df279980 20 started sync module instance, tier type = 2024-03-09T14:44:21.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.676+0000 7f31df279980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:21.689 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.692+0000 7f31df279980 20 add_watcher() i=0 2024-03-09T14:44:21.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.692+0000 7f31df279980 20 add_watcher() i=1 2024-03-09T14:44:21.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.692+0000 7f31df279980 20 add_watcher() i=2 2024-03-09T14:44:21.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.692+0000 7f31df279980 20 add_watcher() i=3 2024-03-09T14:44:21.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.692+0000 7f31df279980 20 add_watcher() i=4 2024-03-09T14:44:21.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.692+0000 7f31df279980 20 add_watcher() i=5 2024-03-09T14:44:21.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.692+0000 7f31df279980 20 add_watcher() i=6 2024-03-09T14:44:21.690 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.696+0000 7f31df279980 20 add_watcher() i=7 2024-03-09T14:44:21.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.696+0000 7f31df279980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:21.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.696+0000 7f3092fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:21.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.696+0000 7f31df279980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:21.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.696+0000 7f31df279980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:21.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.700+0000 7f31df279980 5 note: GC not initialized 2024-03-09T14:44:21.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.700+0000 7f3091fe3640 20 reqs_thread_entry: start 2024-03-09T14:44:21.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.700+0000 7f31df279980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:21.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.700+0000 7f31df279980 20 Filter name: none 2024-03-09T14:44:21.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.700+0000 7f30037fe640 20 reqs_thread_entry: start 2024-03-09T14:44:21.695 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.700+0000 7f31df279980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.700+0000 7f31df279980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:21.696 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.700+0000 7f31df279980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.700+0000 7f31df279980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:21.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.700+0000 7f31df279980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:21.697 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.700+0000 7f31df279980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.704+0000 7f31df279980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:21.698 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.704+0000 7f31df279980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.704+0000 7f31df279980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:21.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.704+0000 7f31df279980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:21.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.704+0000 7f31df279980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.704+0000 7f31df279980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:21.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.708+0000 7f3092fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:21.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.712+0000 7f31df279980 20 remove_watcher() i=0 2024-03-09T14:44:21.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.712+0000 7f31df279980 2 removed watcher, disabling cache 2024-03-09T14:44:21.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.712+0000 7f31df279980 20 remove_watcher() i=1 2024-03-09T14:44:21.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.716+0000 7f31df279980 20 remove_watcher() i=2 2024-03-09T14:44:21.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.716+0000 7f31df279980 20 remove_watcher() i=3 2024-03-09T14:44:21.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.720+0000 7f31df279980 20 remove_watcher() i=4 2024-03-09T14:44:21.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.720+0000 7f31df279980 20 remove_watcher() i=5 2024-03-09T14:44:21.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.724+0000 7f31df279980 20 remove_watcher() i=6 2024-03-09T14:44:21.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.724+0000 7f31df279980 20 remove_watcher() i=7 2024-03-09T14:44:21.732 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:21.733 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:44:21.733 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-set-target-layout id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:44:21.733 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:21.733 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-03-09T14:44:21.764 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:21.764 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:21.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:21.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 realm 2024-03-09T14:44:21.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:21.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.816+0000 7f2ce9b98980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:21.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:21.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.820+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:21.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.820+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:21.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.828+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:21.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.828+0000 7f2ce9b98980 20 searching for the correct realm 2024-03-09T14:44:21.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:21.836+0000 7f2ce76b0640 0 -- 172.21.15.99:0/1868086840 >> [v2:172.21.15.179:6804/2511961392,v1:172.21.15.179:6806/2511961392] conn(0x7f2cd805f040 msgr2=0x7f2cd8083360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:22.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.056+0000 7f2ce6eaf640 0 -- 172.21.15.99:0/1868086840 >> [v2:172.21.15.179:6807/4275579646,v1:172.21.15.179:6811/4275579646] conn(0x55f0804fe0f0 msgr2=0x55f080500520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:22.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:22.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:22.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:22.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:22.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:22.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:22.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:22.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:22.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 zone default found 2024-03-09T14:44:22.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 4 Realm: () 2024-03-09T14:44:22.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:22.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:22.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:22.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 zonegroup default 2024-03-09T14:44:22.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.066 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.067 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 started sync module instance, tier type = 2024-03-09T14:44:22.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:22.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=0 2024-03-09T14:44:22.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=1 2024-03-09T14:44:22.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=2 2024-03-09T14:44:22.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=3 2024-03-09T14:44:22.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=4 2024-03-09T14:44:22.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=5 2024-03-09T14:44:22.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=6 2024-03-09T14:44:22.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.100+0000 7f2ce9b98980 20 add_watcher() i=7 2024-03-09T14:44:22.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.100+0000 7f2ce9b98980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:22.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.100+0000 7f2b9e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:22.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:22.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:22.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 note: GC not initialized 2024-03-09T14:44:22.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.104+0000 7f2b9d7e2640 20 reqs_thread_entry: start 2024-03-09T14:44:22.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:22.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 Filter name: none 2024-03-09T14:44:22.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.104+0000 7f2b967fc640 20 reqs_thread_entry: start 2024-03-09T14:44:22.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.104+0000 7f2ce9b98980 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-09T14:44:22.101 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:22.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.104+0000 7f2ce9b98980 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-09T14:44:22.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.104+0000 7f2ce9b98980 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-09T14:44:22.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.104+0000 7f2ce9b98980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 : miss 2024-03-09T14:44:22.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.108+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:22.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.108+0000 7f2ce9b98980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 info.flags=0x17 2024-03-09T14:44:22.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.108+0000 7f2ce9b98980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 to cache LRU end 2024-03-09T14:44:22.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.108+0000 7f2ce9b98980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:22.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.108+0000 7f2ce9b98980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:22.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.108+0000 7f2ce9b98980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 2024-03-09T14:44:22.111 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2ce9b98980 time 2024-03-09T14:44:22.120325+0000 2024-03-09T14:44:22.111 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:44:22.112 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:44:22.113 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2ced46dd7b] 2024-03-09T14:44:22.113 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f2ced46df2f] 2024-03-09T14:44:22.113 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f07eb73c51] 2024-03-09T14:44:22.113 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x8d9bf2) [0x55f07eb87bf2] 2024-03-09T14:44:22.113 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55f07eb9422b] 2024-03-09T14:44:22.113 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-03-09T14:44:22.114 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2cec2d8d90] 2024-03-09T14:44:22.114 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-03-09T14:44:22.114 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-03-09T14:44:22.114 INFO:tasks.workunit.client.0.smithi099.stderr:*** Caught signal (Aborted) ** 2024-03-09T14:44:22.114 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f2ce9b98980 thread_name:radosgw-admin 2024-03-09T14:44:22.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.116+0000 7f2ce9b98980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2ce9b98980 time 2024-03-09T14:44:22.120325+0000 2024-03-09T14:44:22.115 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:44:22.115 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.115 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:44:22.115 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2ced46dd7b] 2024-03-09T14:44:22.115 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f2ced46df2f] 2024-03-09T14:44:22.115 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f07eb73c51] 2024-03-09T14:44:22.116 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x8d9bf2) [0x55f07eb87bf2] 2024-03-09T14:44:22.116 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55f07eb9422b] 2024-03-09T14:44:22.116 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-03-09T14:44:22.116 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2cec2d8d90] 2024-03-09T14:44:22.116 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-03-09T14:44:22.116 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-03-09T14:44:22.116 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.154 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:44:22.154 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2cec2f1520] 2024-03-09T14:44:22.155 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-03-09T14:44:22.155 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-03-09T14:44:22.155 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-03-09T14:44:22.155 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2ced46ddd5] 2024-03-09T14:44:22.155 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f2ced46df2f] 2024-03-09T14:44:22.155 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f07eb73c51] 2024-03-09T14:44:22.155 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x8d9bf2) [0x55f07eb87bf2] 2024-03-09T14:44:22.156 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55f07eb9422b] 2024-03-09T14:44:22.156 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-03-09T14:44:22.156 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2cec2d8d90] 2024-03-09T14:44:22.156 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-03-09T14:44:22.156 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-03-09T14:44:22.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.116+0000 7f2ce9b98980 -1 *** Caught signal (Aborted) ** 2024-03-09T14:44:22.157 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f2ce9b98980 thread_name:radosgw-admin 2024-03-09T14:44:22.157 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.157 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:44:22.157 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2cec2f1520] 2024-03-09T14:44:22.157 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-03-09T14:44:22.157 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-03-09T14:44:22.157 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-03-09T14:44:22.157 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2ced46ddd5] 2024-03-09T14:44:22.157 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f2ced46df2f] 2024-03-09T14:44:22.157 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f07eb73c51] 2024-03-09T14:44:22.158 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x8d9bf2) [0x55f07eb87bf2] 2024-03-09T14:44:22.158 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55f07eb9422b] 2024-03-09T14:44:22.158 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-03-09T14:44:22.158 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2cec2d8d90] 2024-03-09T14:44:22.158 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-03-09T14:44:22.158 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-03-09T14:44:22.158 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:44:22.158 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.158 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-03-09T14:44:22.158 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-03-09T14:44:21.788+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.158 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-03-09T14:44:21.788+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.158 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-03-09T14:44:21.788+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.158 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-03-09T14:44:21.788+0000 7f2ce9b98980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:22.158 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-03-09T14:44:21.788+0000 7f2ce9b98980 10 monclient(hunting): authenticate will time out at 1915.590605s 2024-03-09T14:44:22.159 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-03-09T14:44:21.788+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request con 0x55f080411fa0 auth_method 0 2024-03-09T14:44:22.159 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-03-09T14:44:21.788+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.159 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-03-09T14:44:21.788+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.159 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-03-09T14:44:21.788+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.159 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient(hunting): get_auth_request con 0x55f080358620 auth_method 0 2024-03-09T14:44:22.159 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.159 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.159 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.159 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-03-09T14:44:21.788+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.159 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-03-09T14:44:21.788+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.159 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-03-09T14:44:21.788+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.159 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.159 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.159 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.160 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient(hunting): handle_auth_done global_id 6312 payload 274 2024-03-09T14:44:22.160 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient: _finish_hunting 0 2024-03-09T14:44:22.160 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 1 monclient: found mon.noname-a 2024-03-09T14:44:22.160 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:44:22.160 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.160 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:44:22.160 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: dump: 2024-03-09T14:44:22.160 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.160 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.160 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.160 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.160 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.160 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.160 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.160 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.161 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.161 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.161 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: _finish_auth 0 2024-03-09T14:44:22.161 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: _check_auth_tickets 2024-03-09T14:44:22.161 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:22.161 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-03-09T14:44:21.788+0000 7f2ce9b98980 5 monclient: authenticate success, global_id 6312 2024-03-09T14:44:22.161 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-03-09T14:44:21.788+0000 7f2ce9b98980 10 monclient: get_monmap_and_config success 2024-03-09T14:44:22.161 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.161 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-03-09T14:44:21.788+0000 7f2ce9b98980 4 set_mon_vals no callback set 2024-03-09T14:44:22.161 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:44:22.161 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: dump: 2024-03-09T14:44:22.161 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.161 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.161 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.161 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.162 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.162 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.162 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.162 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.162 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.162 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.162 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: shutdown 2024-03-09T14:44:22.162 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) unregister_commands rotate-key 2024-03-09T14:44:22.162 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: build_initial_monmap 2024-03-09T14:44:22.162 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 1 build_initial for_mkfs: 0 2024-03-09T14:44:22.162 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: monmap: 2024-03-09T14:44:22.162 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:44:22.162 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:44:22.162 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:44:22.162 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:44:22.163 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:44:22.163 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.163 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:44:22.163 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:44:22.163 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:44:22.163 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.163 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding auth protocol: cephx 2024-03-09T14:44:22.163 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding auth protocol: cephx 2024-03-09T14:44:22.163 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding auth protocol: cephx 2024-03-09T14:44:22.163 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: secure 2024-03-09T14:44:22.163 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: crc 2024-03-09T14:44:22.163 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: secure 2024-03-09T14:44:22.163 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: crc 2024-03-09T14:44:22.163 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: secure 2024-03-09T14:44:22.164 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: crc 2024-03-09T14:44:22.164 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: crc 2024-03-09T14:44:22.164 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: secure 2024-03-09T14:44:22.164 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: crc 2024-03-09T14:44:22.164 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: secure 2024-03-09T14:44:22.164 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: crc 2024-03-09T14:44:22.164 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: secure 2024-03-09T14:44:22.164 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.164 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 1 librados: starting msgr at 2024-03-09T14:44:22.164 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 1 librados: starting objecter 2024-03-09T14:44:22.164 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command objecter_requests hook 0x55f080289b30 2024-03-09T14:44:22.164 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 1 librados: setting wanted keys 2024-03-09T14:44:22.164 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 1 librados: calling monclient init 2024-03-09T14:44:22.164 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: init 2024-03-09T14:44:22.165 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding auth protocol: cephx 2024-03-09T14:44:22.165 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding auth protocol: cephx 2024-03-09T14:44:22.165 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding auth protocol: cephx 2024-03-09T14:44:22.165 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: secure 2024-03-09T14:44:22.165 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: crc 2024-03-09T14:44:22.165 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: secure 2024-03-09T14:44:22.165 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: crc 2024-03-09T14:44:22.165 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: secure 2024-03-09T14:44:22.165 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: crc 2024-03-09T14:44:22.165 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: crc 2024-03-09T14:44:22.165 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: secure 2024-03-09T14:44:22.165 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: crc 2024-03-09T14:44:22.165 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: secure 2024-03-09T14:44:22.165 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: crc 2024-03-09T14:44:22.165 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: secure 2024-03-09T14:44:22.166 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.166 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.166 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command rotate-key hook 0x55f08040bb18 2024-03-09T14:44:22.166 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: _reopen_session rank -1 2024-03-09T14:44:22.166 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: _add_conns ranks=[2,1,0] 2024-03-09T14:44:22.166 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-c con 0x55f080299680 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:44:22.166 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-b con 0x55f080358620 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:44:22.166 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-a con 0x55f080411fa0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:44:22.166 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.166 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.166 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.166 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:22.166 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient(hunting): authenticate will time out at 1915.593513s 2024-03-09T14:44:22.166 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient(hunting): get_auth_request con 0x55f080299680 auth_method 0 2024-03-09T14:44:22.167 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.167 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.167 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.167 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-03-09T14:44:21.792+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request con 0x55f080411fa0 auth_method 0 2024-03-09T14:44:22.167 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-03-09T14:44:21.792+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.167 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-03-09T14:44:21.792+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.167 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-03-09T14:44:21.792+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.167 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.167 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.167 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.167 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-03-09T14:44:21.792+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.167 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-03-09T14:44:21.792+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.167 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-03-09T14:44:21.792+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.167 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_done global_id 6047 payload 824 2024-03-09T14:44:22.167 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient: _finish_hunting 0 2024-03-09T14:44:22.168 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 1 monclient: found mon.noname-c 2024-03-09T14:44:22.168 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:44:22.168 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.168 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:44:22.168 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: dump: 2024-03-09T14:44:22.168 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.168 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.168 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.168 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.168 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.168 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.168 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.168 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.168 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.168 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.169 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: _finish_auth 0 2024-03-09T14:44:22.169 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: _check_auth_tickets 2024-03-09T14:44:22.169 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:22.169 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.169 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:44:22.169 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: dump: 2024-03-09T14:44:22.169 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.169 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.169 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.169 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.169 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.169 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.169 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.169 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.170 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.170 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.170 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-03-09T14:44:21.792+0000 7f2bd560a640 4 set_mon_vals no callback set 2024-03-09T14:44:22.170 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 monclient: authenticate success, global_id 6047 2024-03-09T14:44:22.170 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: _renew_subs 2024-03-09T14:44:22.170 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:44:22.170 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: _renew_subs 2024-03-09T14:44:22.170 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:44:22.170 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 1 librados: init done 2024-03-09T14:44:22.170 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-03-09T14:44:21.796+0000 7f2bd3e07640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:44:22.170 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-03-09T14:44:21.796+0000 7f2bd3e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:22.170 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-03-09T14:44:21.796+0000 7f2bd3e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:22.170 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-03-09T14:44:21.796+0000 7f2ce6eaf640 10 monclient: get_auth_request con 0x7f2bcc066070 auth_method 0 2024-03-09T14:44:22.170 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-03-09T14:44:21.796+0000 7f2ce7eb1640 10 monclient: get_auth_request con 0x55f080439110 auth_method 0 2024-03-09T14:44:22.171 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-03-09T14:44:21.796+0000 7f2ce76b0640 10 monclient: get_auth_request con 0x55f080456830 auth_method 0 2024-03-09T14:44:22.171 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-03-09T14:44:21.800+0000 7f2ce6eaf640 10 monclient: get_auth_request con 0x55f08045ac20 auth_method 0 2024-03-09T14:44:22.171 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-03-09T14:44:21.804+0000 7f2ce7eb1640 10 monclient: get_auth_request con 0x55f08045a0f0 auth_method 0 2024-03-09T14:44:22.171 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: build_initial_monmap 2024-03-09T14:44:22.171 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 1 build_initial for_mkfs: 0 2024-03-09T14:44:22.171 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: monmap: 2024-03-09T14:44:22.171 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:44:22.171 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:44:22.171 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:44:22.171 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:44:22.171 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:44:22.171 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.171 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:44:22.171 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:44:22.171 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:44:22.172 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.172 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding auth protocol: cephx 2024-03-09T14:44:22.172 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding auth protocol: cephx 2024-03-09T14:44:22.172 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding auth protocol: cephx 2024-03-09T14:44:22.172 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: secure 2024-03-09T14:44:22.172 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: crc 2024-03-09T14:44:22.172 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: secure 2024-03-09T14:44:22.172 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: crc 2024-03-09T14:44:22.172 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: secure 2024-03-09T14:44:22.172 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: crc 2024-03-09T14:44:22.172 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: crc 2024-03-09T14:44:22.172 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: secure 2024-03-09T14:44:22.172 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: crc 2024-03-09T14:44:22.172 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: secure 2024-03-09T14:44:22.173 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: crc 2024-03-09T14:44:22.173 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: secure 2024-03-09T14:44:22.173 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.173 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command objecter_requests cmddesc objecter_requests hook 0x55f0804683a0 EEXIST 2024-03-09T14:44:22.173 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: init 2024-03-09T14:44:22.173 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding auth protocol: cephx 2024-03-09T14:44:22.173 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding auth protocol: cephx 2024-03-09T14:44:22.173 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding auth protocol: cephx 2024-03-09T14:44:22.173 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: secure 2024-03-09T14:44:22.173 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: crc 2024-03-09T14:44:22.173 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: secure 2024-03-09T14:44:22.173 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: crc 2024-03-09T14:44:22.173 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: secure 2024-03-09T14:44:22.173 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: crc 2024-03-09T14:44:22.173 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: crc 2024-03-09T14:44:22.174 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: secure 2024-03-09T14:44:22.174 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: crc 2024-03-09T14:44:22.174 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: secure 2024-03-09T14:44:22.174 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: crc 2024-03-09T14:44:22.174 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: secure 2024-03-09T14:44:22.174 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.174 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.174 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command rotate-key cmddesc rotate-key hook 0x55f080461e00 EEXIST 2024-03-09T14:44:22.174 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: _reopen_session rank -1 2024-03-09T14:44:22.174 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: _add_conns ranks=[0,2,1] 2024-03-09T14:44:22.174 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-a con 0x55f08048d000 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:44:22.174 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-c con 0x55f08048d3e0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:44:22.174 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-b con 0x55f0804885a0 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:44:22.174 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.174 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.175 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.175 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:22.175 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient(hunting): authenticate will time out at 1915.609267s 2024-03-09T14:44:22.175 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request con 0x55f08048d3e0 auth_method 0 2024-03-09T14:44:22.175 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.175 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.175 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.175 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-03-09T14:44:21.808+0000 7f2ce6eaf640 10 monclient(hunting): get_auth_request con 0x55f08048d000 auth_method 0 2024-03-09T14:44:22.175 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-03-09T14:44:21.808+0000 7f2ce6eaf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.175 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-03-09T14:44:21.808+0000 7f2ce6eaf640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.175 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-03-09T14:44:21.808+0000 7f2ce6eaf640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.175 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.175 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.175 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.176 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-03-09T14:44:21.808+0000 7f2ce6eaf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.176 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-03-09T14:44:21.808+0000 7f2ce6eaf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.176 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-03-09T14:44:21.808+0000 7f2ce6eaf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.176 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_done global_id 6050 payload 824 2024-03-09T14:44:22.176 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient: _finish_hunting 0 2024-03-09T14:44:22.176 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 1 monclient: found mon.noname-c 2024-03-09T14:44:22.176 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:44:22.176 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-03-09T14:44:21.808+0000 7f2ce76b0640 10 monclient: get_auth_request con 0x55f0804885a0 auth_method 0 2024-03-09T14:44:22.176 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.176 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:44:22.176 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: dump: 2024-03-09T14:44:22.176 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.176 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.176 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.177 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.177 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.177 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.177 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.177 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.177 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.177 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.177 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: _finish_auth 0 2024-03-09T14:44:22.177 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: _check_auth_tickets 2024-03-09T14:44:22.177 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:22.177 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.177 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:44:22.177 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: dump: 2024-03-09T14:44:22.177 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.178 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.178 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.178 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.178 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.178 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.178 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.178 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.178 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.178 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.178 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-03-09T14:44:21.808+0000 7f2ce86b2640 4 set_mon_vals no callback set 2024-03-09T14:44:22.178 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 monclient: authenticate success, global_id 6050 2024-03-09T14:44:22.178 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: _renew_subs 2024-03-09T14:44:22.178 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:44:22.178 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: _renew_subs 2024-03-09T14:44:22.178 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:44:22.179 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-03-09T14:44:21.808+0000 7f2bd1602640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:44:22.179 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-03-09T14:44:21.808+0000 7f2bd1602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:22.179 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-03-09T14:44:21.808+0000 7f2bd1602640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:22.179 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-03-09T14:44:21.812+0000 7f2ce6eaf640 10 monclient: get_auth_request con 0x7f2bc0065f80 auth_method 0 2024-03-09T14:44:22.179 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: get_monmap_and_config 2024-03-09T14:44:22.179 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: build_initial_monmap 2024-03-09T14:44:22.179 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 1 build_initial for_mkfs: 0 2024-03-09T14:44:22.179 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: monmap: 2024-03-09T14:44:22.179 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:44:22.179 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:44:22.179 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:44:22.179 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:44:22.179 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:44:22.179 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.180 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:44:22.180 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:44:22.180 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:44:22.180 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.180 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding auth protocol: cephx 2024-03-09T14:44:22.180 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding auth protocol: cephx 2024-03-09T14:44:22.180 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding auth protocol: cephx 2024-03-09T14:44:22.180 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.180 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.180 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.180 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.180 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.180 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.180 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.181 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.181 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.181 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.181 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.181 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.181 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.181 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: init 2024-03-09T14:44:22.181 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding auth protocol: cephx 2024-03-09T14:44:22.181 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding auth protocol: cephx 2024-03-09T14:44:22.181 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding auth protocol: cephx 2024-03-09T14:44:22.181 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: secure 2024-03-09T14:44:22.181 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: crc 2024-03-09T14:44:22.181 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: secure 2024-03-09T14:44:22.181 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: crc 2024-03-09T14:44:22.181 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: secure 2024-03-09T14:44:22.182 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: crc 2024-03-09T14:44:22.182 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: crc 2024-03-09T14:44:22.182 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: secure 2024-03-09T14:44:22.182 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: crc 2024-03-09T14:44:22.182 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: secure 2024-03-09T14:44:22.182 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: crc 2024-03-09T14:44:22.182 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: secure 2024-03-09T14:44:22.182 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.182 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.182 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command rotate-key cmddesc rotate-key hook 0x7ffc5040c7d8 EEXIST 2024-03-09T14:44:22.182 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: _reopen_session rank -1 2024-03-09T14:44:22.182 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:44:22.182 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-b con 0x55f0804df540 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:44:22.182 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-a con 0x55f0804d95d0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:44:22.183 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-c con 0x55f0804e4bb0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:44:22.183 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.183 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.183 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.183 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:22.183 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): authenticate will time out at 1915.613351s 2024-03-09T14:44:22.183 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): get_auth_request con 0x55f0804e4bb0 auth_method 0 2024-03-09T14:44:22.183 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.183 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.183 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.183 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request con 0x55f0804d95d0 auth_method 0 2024-03-09T14:44:22.183 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.183 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.183 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.183 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.184 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.184 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.184 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.184 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.184 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.184 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_done global_id 6053 payload 274 2024-03-09T14:44:22.184 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient: _finish_hunting 0 2024-03-09T14:44:22.184 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 1 monclient: found mon.noname-c 2024-03-09T14:44:22.184 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:44:22.184 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.184 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:44:22.184 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: dump: 2024-03-09T14:44:22.184 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.184 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.185 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.185 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.185 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.185 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.185 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.185 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.185 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.185 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.185 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: _finish_auth 0 2024-03-09T14:44:22.185 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: _check_auth_tickets 2024-03-09T14:44:22.185 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:22.185 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.185 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:44:22.185 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: dump: 2024-03-09T14:44:22.185 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.186 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.186 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.186 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.186 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.186 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.186 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.186 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.186 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.186 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.186 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 monclient: authenticate success, global_id 6053 2024-03-09T14:44:22.186 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: get_monmap_and_config success 2024-03-09T14:44:22.186 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 4 set_mon_vals no callback set 2024-03-09T14:44:22.186 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: shutdown 2024-03-09T14:44:22.186 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: build_initial_monmap 2024-03-09T14:44:22.186 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 1 build_initial for_mkfs: 0 2024-03-09T14:44:22.187 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: monmap: 2024-03-09T14:44:22.187 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:44:22.187 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:44:22.187 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:44:22.187 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:44:22.187 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:44:22.187 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.187 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:44:22.187 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:44:22.187 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:44:22.187 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.187 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding auth protocol: cephx 2024-03-09T14:44:22.187 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding auth protocol: cephx 2024-03-09T14:44:22.187 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding auth protocol: cephx 2024-03-09T14:44:22.187 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.188 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.188 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.188 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.188 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.188 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.188 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.188 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.188 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.188 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.188 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.188 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.188 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.188 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 1 librados: starting msgr at 2024-03-09T14:44:22.188 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 1 librados: starting objecter 2024-03-09T14:44:22.189 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command objecter_requests cmddesc objecter_requests hook 0x55f08048c8e0 EEXIST 2024-03-09T14:44:22.189 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 1 librados: setting wanted keys 2024-03-09T14:44:22.189 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 1 librados: calling monclient init 2024-03-09T14:44:22.189 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: init 2024-03-09T14:44:22.189 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding auth protocol: cephx 2024-03-09T14:44:22.189 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding auth protocol: cephx 2024-03-09T14:44:22.189 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding auth protocol: cephx 2024-03-09T14:44:22.189 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: secure 2024-03-09T14:44:22.189 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: crc 2024-03-09T14:44:22.189 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: secure 2024-03-09T14:44:22.189 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: crc 2024-03-09T14:44:22.189 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: secure 2024-03-09T14:44:22.189 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: crc 2024-03-09T14:44:22.189 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: crc 2024-03-09T14:44:22.189 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: secure 2024-03-09T14:44:22.190 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: crc 2024-03-09T14:44:22.190 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: secure 2024-03-09T14:44:22.190 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: crc 2024-03-09T14:44:22.190 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: secure 2024-03-09T14:44:22.190 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.190 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.190 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command rotate-key cmddesc rotate-key hook 0x55f0804a9e68 EEXIST 2024-03-09T14:44:22.190 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: _reopen_session rank -1 2024-03-09T14:44:22.190 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:44:22.190 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-b con 0x55f0804df540 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:44:22.190 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-c con 0x55f0804e4bb0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:44:22.190 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-a con 0x55f0804d73c0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:44:22.190 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.190 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.191 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.191 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:22.191 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): authenticate will time out at 1915.615853s 2024-03-09T14:44:22.191 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request con 0x55f0804e4bb0 auth_method 0 2024-03-09T14:44:22.191 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.191 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.191 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.191 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): get_auth_request con 0x55f0804d73c0 auth_method 0 2024-03-09T14:44:22.191 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.191 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.191 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.191 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-03-09T14:44:21.816+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.191 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-03-09T14:44:21.816+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.191 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-03-09T14:44:21.816+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.191 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-03-09T14:44:21.816+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.192 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-03-09T14:44:21.816+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.192 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-03-09T14:44:21.816+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.192 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-03-09T14:44:21.816+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_done global_id 6324 payload 824 2024-03-09T14:44:22.192 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-03-09T14:44:21.816+0000 7f2ce76b0640 10 monclient: _finish_hunting 0 2024-03-09T14:44:22.192 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-03-09T14:44:21.816+0000 7f2ce76b0640 1 monclient: found mon.noname-a 2024-03-09T14:44:22.192 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-03-09T14:44:21.816+0000 7f2ce76b0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:44:22.192 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.192 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:44:22.192 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: dump: 2024-03-09T14:44:22.192 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.192 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.192 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.192 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.192 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.192 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.193 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.193 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.193 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.193 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.193 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: _finish_auth 0 2024-03-09T14:44:22.193 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: _check_auth_tickets 2024-03-09T14:44:22.193 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 5 monclient: authenticate success, global_id 6324 2024-03-09T14:44:22.193 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:22.193 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.193 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:44:22.193 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: dump: 2024-03-09T14:44:22.193 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.193 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.193 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.193 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.193 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.194 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.194 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.194 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.194 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.194 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.194 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-03-09T14:44:21.816+0000 7f2bcaffd640 4 set_mon_vals no callback set 2024-03-09T14:44:22.194 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 10 monclient: _renew_subs 2024-03-09T14:44:22.194 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:44:22.194 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 10 monclient: _renew_subs 2024-03-09T14:44:22.194 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:44:22.194 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 1 librados: init done 2024-03-09T14:44:22.194 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command cr dump hook 0x7f2ce0001d98 2024-03-09T14:44:22.194 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.194 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:44:22.195 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:22.195 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:22.195 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-03-09T14:44:21.816+0000 7f2ce6eaf640 10 monclient: get_auth_request con 0x7f2bb0066070 auth_method 0 2024-03-09T14:44:22.195 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-03-09T14:44:21.816+0000 7f2ce7eb1640 10 monclient: get_auth_request con 0x55f0804f9e50 auth_method 0 2024-03-09T14:44:22.195 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.195 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 realm 2024-03-09T14:44:22.195 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.195 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.195 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:22.195 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.195 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.195 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.195 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-03-09T14:44:21.820+0000 7f2ce6eaf640 10 monclient: get_auth_request con 0x55f0804fe0f0 auth_method 0 2024-03-09T14:44:22.195 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-03-09T14:44:21.820+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:22.195 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-03-09T14:44:21.820+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.196 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-03-09T14:44:21.820+0000 7f2ce7eb1640 10 monclient: get_auth_request con 0x55f080501950 auth_method 0 2024-03-09T14:44:22.196 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-03-09T14:44:21.828+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:22.196 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-03-09T14:44:21.828+0000 7f2ce9b98980 20 searching for the correct realm 2024-03-09T14:44:22.196 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-03-09T14:44:21.828+0000 7f2ce76b0640 10 monclient: get_auth_request con 0x55f080506600 auth_method 0 2024-03-09T14:44:22.196 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-03-09T14:44:21.828+0000 7f2ce6eaf640 10 monclient: get_auth_request con 0x7f2ce008e380 auth_method 0 2024-03-09T14:44:22.196 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-03-09T14:44:21.832+0000 7f2ce7eb1640 10 monclient: get_auth_request con 0x7f2cd00ce040 auth_method 0 2024-03-09T14:44:22.196 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-03-09T14:44:21.836+0000 7f2ce76b0640 0 -- 172.21.15.99:0/1868086840 >> [v2:172.21.15.179:6804/2511961392,v1:172.21.15.179:6806/2511961392] conn(0x7f2cd805f040 msgr2=0x7f2cd8083360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:22.196 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-03-09T14:44:22.040+0000 7f2ce76b0640 10 monclient: get_auth_request con 0x7f2cd805f040 auth_method 0 2024-03-09T14:44:22.196 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-03-09T14:44:22.048+0000 7f2ce6eaf640 10 monclient: get_auth_request con 0x7f2cd8020030 auth_method 0 2024-03-09T14:44:22.196 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-03-09T14:44:22.056+0000 7f2ce6eaf640 0 -- 172.21.15.99:0/1868086840 >> [v2:172.21.15.179:6807/4275579646,v1:172.21.15.179:6811/4275579646] conn(0x55f0804fe0f0 msgr2=0x55f080500520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:22.196 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-03-09T14:44:22.056+0000 7f2bc97fa640 1 client.6324.objecter ms_handle_reset 0x55f0804fe0f0 session 0x55f0804fda70 osd.5 2024-03-09T14:44:22.196 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-03-09T14:44:22.056+0000 7f2bc97fa640 10 monclient: _renew_subs 2024-03-09T14:44:22.196 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-03-09T14:44:22.056+0000 7f2bc97fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:44:22.196 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-03-09T14:44:22.056+0000 7f2ce6eaf640 10 monclient: get_auth_request con 0x7f2bb0076610 auth_method 0 2024-03-09T14:44:22.196 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:22.197 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:22.197 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:22.197 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:22.197 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:22.197 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:22.197 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.197 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.197 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.197 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:22.197 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.197 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:22.197 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 zone default found 2024-03-09T14:44:22.197 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 4 Realm: () 2024-03-09T14:44:22.197 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:22.197 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:22.198 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:22.198 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 zonegroup default 2024-03-09T14:44:22.198 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.198 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.198 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.198 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.198 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.198 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.198 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 started sync module instance, tier type = 2024-03-09T14:44:22.198 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:22.198 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=0 2024-03-09T14:44:22.198 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=1 2024-03-09T14:44:22.198 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=2 2024-03-09T14:44:22.199 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=3 2024-03-09T14:44:22.199 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=4 2024-03-09T14:44:22.199 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=5 2024-03-09T14:44:22.199 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=6 2024-03-09T14:44:22.199 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 20 add_watcher() i=7 2024-03-09T14:44:22.199 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:22.199 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding auth protocol: cephx 2024-03-09T14:44:22.199 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding auth protocol: cephx 2024-03-09T14:44:22.199 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding auth protocol: cephx 2024-03-09T14:44:22.199 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: secure 2024-03-09T14:44:22.199 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: crc 2024-03-09T14:44:22.199 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-03-09T14:44:22.100+0000 7f2b9e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:22.199 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: secure 2024-03-09T14:44:22.199 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: crc 2024-03-09T14:44:22.199 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: secure 2024-03-09T14:44:22.200 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: crc 2024-03-09T14:44:22.200 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: crc 2024-03-09T14:44:22.200 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: secure 2024-03-09T14:44:22.200 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: crc 2024-03-09T14:44:22.200 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: secure 2024-03-09T14:44:22.200 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: crc 2024-03-09T14:44:22.200 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: secure 2024-03-09T14:44:22.200 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.200 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:22.200 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:22.200 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command cache list hook 0x55f0804dd1f0 2024-03-09T14:44:22.200 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command cache inspect hook 0x55f0804dd1f0 2024-03-09T14:44:22.200 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command cache erase hook 0x55f0804dd1f0 2024-03-09T14:44:22.200 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command cache zap hook 0x55f0804dd1f0 2024-03-09T14:44:22.201 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 note: GC not initialized 2024-03-09T14:44:22.201 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-03-09T14:44:22.104+0000 7f2b9d7e2640 20 reqs_thread_entry: start 2024-03-09T14:44:22.201 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command sync trace show hook 0x7f2cd0004470 2024-03-09T14:44:22.201 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command sync trace history hook 0x7f2cd0004470 2024-03-09T14:44:22.201 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command sync trace active hook 0x7f2cd0004470 2024-03-09T14:44:22.201 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command sync trace active_short hook 0x7f2cd0004470 2024-03-09T14:44:22.201 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:22.201 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 Filter name: none 2024-03-09T14:44:22.201 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-03-09T14:44:22.104+0000 7f2b967fc640 20 reqs_thread_entry: start 2024-03-09T14:44:22.201 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-09T14:44:22.201 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.201 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:22.201 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-09T14:44:22.201 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-09T14:44:22.202 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 : miss 2024-03-09T14:44:22.202 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.202 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-03-09T14:44:22.108+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:22.202 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-03-09T14:44:22.108+0000 7f2ce9b98980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 info.flags=0x17 2024-03-09T14:44:22.202 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-03-09T14:44:22.108+0000 7f2ce9b98980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 to cache LRU end 2024-03-09T14:44:22.202 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-03-09T14:44:22.108+0000 7f2ce9b98980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:22.202 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-03-09T14:44:22.108+0000 7f2ce9b98980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:22.202 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-03-09T14:44:22.108+0000 7f2ce9b98980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 2024-03-09T14:44:22.202 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-03-09T14:44:22.116+0000 7f2ce9b98980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2ce9b98980 time 2024-03-09T14:44:22.120325+0000 2024-03-09T14:44:22.202 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:44:22.202 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.202 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:44:22.202 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2ced46dd7b] 2024-03-09T14:44:22.202 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f2ced46df2f] 2024-03-09T14:44:22.203 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f07eb73c51] 2024-03-09T14:44:22.203 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x8d9bf2) [0x55f07eb87bf2] 2024-03-09T14:44:22.203 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55f07eb9422b] 2024-03-09T14:44:22.203 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-03-09T14:44:22.203 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2cec2d8d90] 2024-03-09T14:44:22.203 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-03-09T14:44:22.203 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-03-09T14:44:22.203 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.203 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-03-09T14:44:22.116+0000 7f2ce9b98980 -1 *** Caught signal (Aborted) ** 2024-03-09T14:44:22.203 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f2ce9b98980 thread_name:radosgw-admin 2024-03-09T14:44:22.203 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.203 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:44:22.203 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2cec2f1520] 2024-03-09T14:44:22.203 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-03-09T14:44:22.203 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-03-09T14:44:22.204 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-03-09T14:44:22.204 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2ced46ddd5] 2024-03-09T14:44:22.204 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f2ced46df2f] 2024-03-09T14:44:22.204 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f07eb73c51] 2024-03-09T14:44:22.204 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x8d9bf2) [0x55f07eb87bf2] 2024-03-09T14:44:22.204 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55f07eb9422b] 2024-03-09T14:44:22.204 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-03-09T14:44:22.204 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2cec2d8d90] 2024-03-09T14:44:22.204 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-03-09T14:44:22.204 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-03-09T14:44:22.204 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:44:22.204 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.204 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-03-09T14:44:22.204 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-03-09T14:44:22.204 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-03-09T14:44:22.205 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-03-09T14:44:22.205 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-03-09T14:44:22.205 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-03-09T14:44:22.205 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-03-09T14:44:22.205 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-03-09T14:44:22.205 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-03-09T14:44:22.205 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-03-09T14:44:22.205 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-03-09T14:44:22.205 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-03-09T14:44:22.205 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-03-09T14:44:22.205 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-03-09T14:44:22.205 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-03-09T14:44:22.205 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-03-09T14:44:22.205 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-03-09T14:44:22.205 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-03-09T14:44:22.206 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-03-09T14:44:22.206 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-03-09T14:44:22.206 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-03-09T14:44:22.206 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-03-09T14:44:22.206 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-03-09T14:44:22.206 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:44:22.206 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-03-09T14:44:22.206 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-03-09T14:44:22.206 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-03-09T14:44:22.206 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-03-09T14:44:22.206 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-03-09T14:44:22.206 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-03-09T14:44:22.206 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-03-09T14:44:22.206 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-03-09T14:44:22.207 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-03-09T14:44:22.207 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-03-09T14:44:22.207 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-03-09T14:44:22.207 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-03-09T14:44:22.207 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-03-09T14:44:22.207 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-03-09T14:44:22.207 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-03-09T14:44:22.207 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-03-09T14:44:22.207 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-03-09T14:44:22.207 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-03-09T14:44:22.207 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-03-09T14:44:22.207 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-03-09T14:44:22.207 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-03-09T14:44:22.207 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:44:22.207 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-03-09T14:44:22.208 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:44:22.208 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-03-09T14:44:22.208 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-03-09T14:44:22.208 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-03-09T14:44:22.208 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-03-09T14:44:22.208 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-03-09T14:44:22.208 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-03-09T14:44:22.208 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-03-09T14:44:22.208 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-03-09T14:44:22.208 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-03-09T14:44:22.208 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-03-09T14:44:22.208 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-03-09T14:44:22.208 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-03-09T14:44:22.208 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-03-09T14:44:22.208 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-03-09T14:44:22.209 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-03-09T14:44:22.209 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-03-09T14:44:22.209 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-03-09T14:44:22.209 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:44:22.209 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-03-09T14:44:22.209 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:44:22.209 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-03-09T14:44:22.209 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-03-09T14:44:22.209 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-03-09T14:44:22.209 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-03-09T14:44:22.209 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-03-09T14:44:22.209 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-03-09T14:44:22.209 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:44:22.209 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-03-09T14:44:22.209 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-03-09T14:44:22.209 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:44:22.210 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-03-09T14:44:22.210 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-03-09T14:44:22.210 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-03-09T14:44:22.210 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-03-09T14:44:22.210 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-03-09T14:44:22.210 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-03-09T14:44:22.210 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-03-09T14:44:22.210 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-03-09T14:44:22.210 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-03-09T14:44:22.210 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-03-09T14:44:22.210 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-03-09T14:44:22.210 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-03-09T14:44:22.210 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:44:22.210 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2b967fc640 / http_manager 2024-03-09T14:44:22.211 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2b9d7e2640 / http_manager 2024-03-09T14:44:22.211 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2b9e7e4640 / rgw_dt_lg_renew 2024-03-09T14:44:22.211 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2bc97fa640 / ms_dispatch 2024-03-09T14:44:22.211 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2bcaffd640 / io_context_pool 2024-03-09T14:44:22.211 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2bd1602640 / ms_dispatch 2024-03-09T14:44:22.211 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2bd3e07640 / ms_dispatch 2024-03-09T14:44:22.211 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2bd560a640 / io_context_pool 2024-03-09T14:44:22.211 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2ce6eaf640 / msgr-worker-2 2024-03-09T14:44:22.211 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2ce76b0640 / msgr-worker-1 2024-03-09T14:44:22.211 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2ce7eb1640 / msgr-worker-0 2024-03-09T14:44:22.211 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2ce86b2640 / io_context_pool 2024-03-09T14:44:22.211 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2ce9b98980 / radosgw-admin 2024-03-09T14:44:22.211 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-03-09T14:44:22.211 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-03-09T14:44:22.211 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/log/ceph/ceph-client.admin.82608.log 2024-03-09T14:44:22.212 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-03-09T14:44:22.212 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-03-09T14:44:22.212 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-03-09T14:44:21.788+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.212 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-03-09T14:44:21.788+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.212 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-03-09T14:44:21.788+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.212 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-03-09T14:44:21.788+0000 7f2ce9b98980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:22.212 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-03-09T14:44:21.788+0000 7f2ce9b98980 10 monclient(hunting): authenticate will time out at 1915.590605s 2024-03-09T14:44:22.212 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-03-09T14:44:21.788+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request con 0x55f080411fa0 auth_method 0 2024-03-09T14:44:22.212 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-03-09T14:44:21.788+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.212 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-03-09T14:44:21.788+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.212 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-03-09T14:44:21.788+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.212 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient(hunting): get_auth_request con 0x55f080358620 auth_method 0 2024-03-09T14:44:22.212 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.212 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.212 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.213 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-03-09T14:44:21.788+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.213 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-03-09T14:44:21.788+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.213 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-03-09T14:44:21.788+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.213 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.213 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.213 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.213 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient(hunting): handle_auth_done global_id 6312 payload 274 2024-03-09T14:44:22.213 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient: _finish_hunting 0 2024-03-09T14:44:22.213 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 1 monclient: found mon.noname-a 2024-03-09T14:44:22.213 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-03-09T14:44:21.788+0000 7f2ce6eaf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:44:22.213 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.213 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:44:22.213 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: dump: 2024-03-09T14:44:22.213 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.214 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.214 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.214 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.214 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.214 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.214 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.214 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.214 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.214 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.214 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: _finish_auth 0 2024-03-09T14:44:22.214 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: _check_auth_tickets 2024-03-09T14:44:22.214 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:22.214 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-03-09T14:44:21.788+0000 7f2ce9b98980 5 monclient: authenticate success, global_id 6312 2024-03-09T14:44:22.214 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-03-09T14:44:21.788+0000 7f2ce9b98980 10 monclient: get_monmap_and_config success 2024-03-09T14:44:22.214 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.215 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-03-09T14:44:21.788+0000 7f2ce9b98980 4 set_mon_vals no callback set 2024-03-09T14:44:22.215 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:44:22.215 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-03-09T14:44:21.788+0000 7f2bd560a640 10 monclient: dump: 2024-03-09T14:44:22.215 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.215 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.215 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.215 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.215 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.215 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.215 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.215 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.215 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.215 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.215 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: shutdown 2024-03-09T14:44:22.215 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) unregister_commands rotate-key 2024-03-09T14:44:22.216 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: build_initial_monmap 2024-03-09T14:44:22.216 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 1 build_initial for_mkfs: 0 2024-03-09T14:44:22.216 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: monmap: 2024-03-09T14:44:22.216 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:44:22.216 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:44:22.216 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:44:22.216 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:44:22.216 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:44:22.216 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.216 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:44:22.216 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:44:22.216 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:44:22.216 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.216 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding auth protocol: cephx 2024-03-09T14:44:22.216 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding auth protocol: cephx 2024-03-09T14:44:22.217 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding auth protocol: cephx 2024-03-09T14:44:22.217 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: secure 2024-03-09T14:44:22.217 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: crc 2024-03-09T14:44:22.217 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: secure 2024-03-09T14:44:22.217 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: crc 2024-03-09T14:44:22.217 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: secure 2024-03-09T14:44:22.217 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: crc 2024-03-09T14:44:22.217 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: crc 2024-03-09T14:44:22.217 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: secure 2024-03-09T14:44:22.217 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: crc 2024-03-09T14:44:22.217 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: secure 2024-03-09T14:44:22.217 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: crc 2024-03-09T14:44:22.217 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804111e0) adding con mode: secure 2024-03-09T14:44:22.217 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.217 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 1 librados: starting msgr at 2024-03-09T14:44:22.218 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 1 librados: starting objecter 2024-03-09T14:44:22.218 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command objecter_requests hook 0x55f080289b30 2024-03-09T14:44:22.218 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 1 librados: setting wanted keys 2024-03-09T14:44:22.218 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 1 librados: calling monclient init 2024-03-09T14:44:22.218 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: init 2024-03-09T14:44:22.218 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding auth protocol: cephx 2024-03-09T14:44:22.218 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding auth protocol: cephx 2024-03-09T14:44:22.218 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding auth protocol: cephx 2024-03-09T14:44:22.218 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: secure 2024-03-09T14:44:22.218 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: crc 2024-03-09T14:44:22.218 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: secure 2024-03-09T14:44:22.218 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: crc 2024-03-09T14:44:22.219 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: secure 2024-03-09T14:44:22.219 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: crc 2024-03-09T14:44:22.219 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: crc 2024-03-09T14:44:22.219 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: secure 2024-03-09T14:44:22.219 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: crc 2024-03-09T14:44:22.219 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: secure 2024-03-09T14:44:22.219 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: crc 2024-03-09T14:44:22.219 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 AuthRegistry(0x55f08040b9d0) adding con mode: secure 2024-03-09T14:44:22.219 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.219 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.219 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command rotate-key hook 0x55f08040bb18 2024-03-09T14:44:22.219 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: _reopen_session rank -1 2024-03-09T14:44:22.219 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: _add_conns ranks=[2,1,0] 2024-03-09T14:44:22.219 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-c con 0x55f080299680 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:44:22.220 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-b con 0x55f080358620 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:44:22.220 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-a con 0x55f080411fa0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:44:22.220 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.220 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.220 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.220 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:22.220 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient(hunting): authenticate will time out at 1915.593513s 2024-03-09T14:44:22.220 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient(hunting): get_auth_request con 0x55f080299680 auth_method 0 2024-03-09T14:44:22.220 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.220 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.220 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.220 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-03-09T14:44:21.792+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request con 0x55f080411fa0 auth_method 0 2024-03-09T14:44:22.220 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-03-09T14:44:21.792+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.220 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-03-09T14:44:21.792+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.221 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-03-09T14:44:21.792+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.221 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.221 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.221 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.221 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-03-09T14:44:21.792+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.221 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-03-09T14:44:21.792+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.221 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-03-09T14:44:21.792+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.221 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_done global_id 6047 payload 824 2024-03-09T14:44:22.221 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient: _finish_hunting 0 2024-03-09T14:44:22.221 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 1 monclient: found mon.noname-c 2024-03-09T14:44:22.221 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-03-09T14:44:21.792+0000 7f2ce76b0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:44:22.221 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.221 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:44:22.221 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: dump: 2024-03-09T14:44:22.222 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.222 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.222 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.222 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.222 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.222 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.222 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.222 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.222 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.222 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.222 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: _finish_auth 0 2024-03-09T14:44:22.222 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: _check_auth_tickets 2024-03-09T14:44:22.222 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:22.222 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.222 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:44:22.223 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-03-09T14:44:21.792+0000 7f2bd3e07640 10 monclient: dump: 2024-03-09T14:44:22.223 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.223 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.223 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.223 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.223 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.223 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.223 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.223 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.223 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.223 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.223 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-03-09T14:44:21.792+0000 7f2bd560a640 4 set_mon_vals no callback set 2024-03-09T14:44:22.223 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 5 monclient: authenticate success, global_id 6047 2024-03-09T14:44:22.223 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: _renew_subs 2024-03-09T14:44:22.223 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:44:22.224 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: _renew_subs 2024-03-09T14:44:22.224 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:44:22.224 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-03-09T14:44:21.792+0000 7f2ce9b98980 1 librados: init done 2024-03-09T14:44:22.224 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-03-09T14:44:21.796+0000 7f2bd3e07640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:44:22.224 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-03-09T14:44:21.796+0000 7f2bd3e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:22.224 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-03-09T14:44:21.796+0000 7f2bd3e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:22.224 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-03-09T14:44:21.796+0000 7f2ce6eaf640 10 monclient: get_auth_request con 0x7f2bcc066070 auth_method 0 2024-03-09T14:44:22.224 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-03-09T14:44:21.796+0000 7f2ce7eb1640 10 monclient: get_auth_request con 0x55f080439110 auth_method 0 2024-03-09T14:44:22.224 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-03-09T14:44:21.796+0000 7f2ce76b0640 10 monclient: get_auth_request con 0x55f080456830 auth_method 0 2024-03-09T14:44:22.224 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-03-09T14:44:21.800+0000 7f2ce6eaf640 10 monclient: get_auth_request con 0x55f08045ac20 auth_method 0 2024-03-09T14:44:22.224 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-03-09T14:44:21.804+0000 7f2ce7eb1640 10 monclient: get_auth_request con 0x55f08045a0f0 auth_method 0 2024-03-09T14:44:22.224 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: build_initial_monmap 2024-03-09T14:44:22.224 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 1 build_initial for_mkfs: 0 2024-03-09T14:44:22.224 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: monmap: 2024-03-09T14:44:22.224 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:44:22.225 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:44:22.225 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:44:22.225 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:44:22.225 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:44:22.225 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.225 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:44:22.225 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:44:22.225 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:44:22.225 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.225 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding auth protocol: cephx 2024-03-09T14:44:22.225 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding auth protocol: cephx 2024-03-09T14:44:22.225 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding auth protocol: cephx 2024-03-09T14:44:22.225 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: secure 2024-03-09T14:44:22.225 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: crc 2024-03-09T14:44:22.226 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: secure 2024-03-09T14:44:22.226 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: crc 2024-03-09T14:44:22.226 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: secure 2024-03-09T14:44:22.226 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: crc 2024-03-09T14:44:22.226 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: crc 2024-03-09T14:44:22.226 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: secure 2024-03-09T14:44:22.226 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: crc 2024-03-09T14:44:22.226 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: secure 2024-03-09T14:44:22.226 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: crc 2024-03-09T14:44:22.226 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080462ce0) adding con mode: secure 2024-03-09T14:44:22.226 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.226 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command objecter_requests cmddesc objecter_requests hook 0x55f0804683a0 EEXIST 2024-03-09T14:44:22.226 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: init 2024-03-09T14:44:22.226 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding auth protocol: cephx 2024-03-09T14:44:22.226 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding auth protocol: cephx 2024-03-09T14:44:22.227 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding auth protocol: cephx 2024-03-09T14:44:22.227 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: secure 2024-03-09T14:44:22.227 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: crc 2024-03-09T14:44:22.227 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: secure 2024-03-09T14:44:22.227 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: crc 2024-03-09T14:44:22.227 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: secure 2024-03-09T14:44:22.227 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: crc 2024-03-09T14:44:22.227 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: crc 2024-03-09T14:44:22.227 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: secure 2024-03-09T14:44:22.227 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: crc 2024-03-09T14:44:22.227 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: secure 2024-03-09T14:44:22.227 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: crc 2024-03-09T14:44:22.227 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 AuthRegistry(0x55f080461cb8) adding con mode: secure 2024-03-09T14:44:22.227 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.228 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.228 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command rotate-key cmddesc rotate-key hook 0x55f080461e00 EEXIST 2024-03-09T14:44:22.228 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: _reopen_session rank -1 2024-03-09T14:44:22.228 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: _add_conns ranks=[0,2,1] 2024-03-09T14:44:22.228 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-a con 0x55f08048d000 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:44:22.228 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-c con 0x55f08048d3e0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:44:22.228 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-b con 0x55f0804885a0 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:44:22.228 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.228 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.228 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.228 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:22.228 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient(hunting): authenticate will time out at 1915.609267s 2024-03-09T14:44:22.228 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request con 0x55f08048d3e0 auth_method 0 2024-03-09T14:44:22.228 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.228 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.229 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.229 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-03-09T14:44:21.808+0000 7f2ce6eaf640 10 monclient(hunting): get_auth_request con 0x55f08048d000 auth_method 0 2024-03-09T14:44:22.229 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-03-09T14:44:21.808+0000 7f2ce6eaf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.229 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-03-09T14:44:21.808+0000 7f2ce6eaf640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.229 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-03-09T14:44:21.808+0000 7f2ce6eaf640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.229 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.229 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.229 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.229 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-03-09T14:44:21.808+0000 7f2ce6eaf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.229 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-03-09T14:44:21.808+0000 7f2ce6eaf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.229 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-03-09T14:44:21.808+0000 7f2ce6eaf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.229 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_done global_id 6050 payload 824 2024-03-09T14:44:22.229 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient: _finish_hunting 0 2024-03-09T14:44:22.229 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 1 monclient: found mon.noname-c 2024-03-09T14:44:22.230 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-03-09T14:44:21.808+0000 7f2ce7eb1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:44:22.230 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-03-09T14:44:21.808+0000 7f2ce76b0640 10 monclient: get_auth_request con 0x55f0804885a0 auth_method 0 2024-03-09T14:44:22.230 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.230 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:44:22.230 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: dump: 2024-03-09T14:44:22.230 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.230 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.230 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.230 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.230 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.230 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.230 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.230 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.230 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.230 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.231 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: _finish_auth 0 2024-03-09T14:44:22.231 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: _check_auth_tickets 2024-03-09T14:44:22.231 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:22.231 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.231 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:44:22.231 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-03-09T14:44:21.808+0000 7f2bd1602640 10 monclient: dump: 2024-03-09T14:44:22.231 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.231 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.231 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.231 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.231 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.231 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.231 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.231 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.232 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.232 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.232 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-03-09T14:44:21.808+0000 7f2ce86b2640 4 set_mon_vals no callback set 2024-03-09T14:44:22.232 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 5 monclient: authenticate success, global_id 6050 2024-03-09T14:44:22.232 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: _renew_subs 2024-03-09T14:44:22.232 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:44:22.232 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: _renew_subs 2024-03-09T14:44:22.232 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-03-09T14:44:21.808+0000 7f2ce9b98980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:44:22.232 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-03-09T14:44:21.808+0000 7f2bd1602640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:44:22.232 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-03-09T14:44:21.808+0000 7f2bd1602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:22.232 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-03-09T14:44:21.808+0000 7f2bd1602640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:22.232 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-03-09T14:44:21.812+0000 7f2ce6eaf640 10 monclient: get_auth_request con 0x7f2bc0065f80 auth_method 0 2024-03-09T14:44:22.232 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: get_monmap_and_config 2024-03-09T14:44:22.232 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: build_initial_monmap 2024-03-09T14:44:22.233 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 1 build_initial for_mkfs: 0 2024-03-09T14:44:22.233 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: monmap: 2024-03-09T14:44:22.233 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:44:22.233 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:44:22.233 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:44:22.233 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:44:22.233 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:44:22.233 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.233 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:44:22.233 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:44:22.233 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:44:22.233 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.233 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding auth protocol: cephx 2024-03-09T14:44:22.233 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding auth protocol: cephx 2024-03-09T14:44:22.233 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding auth protocol: cephx 2024-03-09T14:44:22.234 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.234 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.234 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.234 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.234 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.234 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.234 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.234 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.234 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.234 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.234 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.234 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.234 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.234 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: init 2024-03-09T14:44:22.235 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding auth protocol: cephx 2024-03-09T14:44:22.235 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding auth protocol: cephx 2024-03-09T14:44:22.235 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding auth protocol: cephx 2024-03-09T14:44:22.235 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: secure 2024-03-09T14:44:22.235 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: crc 2024-03-09T14:44:22.235 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: secure 2024-03-09T14:44:22.235 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: crc 2024-03-09T14:44:22.235 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: secure 2024-03-09T14:44:22.235 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: crc 2024-03-09T14:44:22.235 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: crc 2024-03-09T14:44:22.235 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: secure 2024-03-09T14:44:22.236 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: crc 2024-03-09T14:44:22.236 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: secure 2024-03-09T14:44:22.236 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: crc 2024-03-09T14:44:22.236 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040c690) adding con mode: secure 2024-03-09T14:44:22.236 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.236 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.236 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command rotate-key cmddesc rotate-key hook 0x7ffc5040c7d8 EEXIST 2024-03-09T14:44:22.236 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: _reopen_session rank -1 2024-03-09T14:44:22.236 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:44:22.236 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-b con 0x55f0804df540 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:44:22.236 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-a con 0x55f0804d95d0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:44:22.236 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-c con 0x55f0804e4bb0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:44:22.236 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.236 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.237 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.237 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:22.237 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): authenticate will time out at 1915.613351s 2024-03-09T14:44:22.237 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): get_auth_request con 0x55f0804e4bb0 auth_method 0 2024-03-09T14:44:22.237 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.237 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.237 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.237 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request con 0x55f0804d95d0 auth_method 0 2024-03-09T14:44:22.237 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.237 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.237 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.237 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.237 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.237 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.237 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.238 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.238 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.238 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_done global_id 6053 payload 274 2024-03-09T14:44:22.238 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient: _finish_hunting 0 2024-03-09T14:44:22.238 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 1 monclient: found mon.noname-c 2024-03-09T14:44:22.238 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:44:22.238 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.238 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:44:22.238 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: dump: 2024-03-09T14:44:22.238 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.238 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.238 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.242 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.242 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.242 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.242 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.242 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.242 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.242 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.242 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: _finish_auth 0 2024-03-09T14:44:22.242 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: _check_auth_tickets 2024-03-09T14:44:22.242 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:22.242 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.242 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:44:22.243 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-03-09T14:44:21.812+0000 7f2bcaffd640 10 monclient: dump: 2024-03-09T14:44:22.243 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.243 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.243 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.243 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.243 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.243 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.243 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.243 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.243 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.243 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.243 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 monclient: authenticate success, global_id 6053 2024-03-09T14:44:22.243 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: get_monmap_and_config success 2024-03-09T14:44:22.243 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 4 set_mon_vals no callback set 2024-03-09T14:44:22.244 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: shutdown 2024-03-09T14:44:22.244 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: build_initial_monmap 2024-03-09T14:44:22.244 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 1 build_initial for_mkfs: 0 2024-03-09T14:44:22.244 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: monmap: 2024-03-09T14:44:22.244 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:44:22.244 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:44:22.244 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:44:22.244 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:44:22.244 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:44:22.244 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.244 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:44:22.244 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:44:22.244 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:44:22.244 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.245 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding auth protocol: cephx 2024-03-09T14:44:22.245 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding auth protocol: cephx 2024-03-09T14:44:22.245 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding auth protocol: cephx 2024-03-09T14:44:22.245 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.245 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.245 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.245 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.245 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.245 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.245 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.245 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.245 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.245 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.245 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: crc 2024-03-09T14:44:22.246 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804aab50) adding con mode: secure 2024-03-09T14:44:22.246 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.246 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 1 librados: starting msgr at 2024-03-09T14:44:22.246 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 1 librados: starting objecter 2024-03-09T14:44:22.246 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command objecter_requests cmddesc objecter_requests hook 0x55f08048c8e0 EEXIST 2024-03-09T14:44:22.246 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 1 librados: setting wanted keys 2024-03-09T14:44:22.246 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 1 librados: calling monclient init 2024-03-09T14:44:22.246 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: init 2024-03-09T14:44:22.246 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding auth protocol: cephx 2024-03-09T14:44:22.246 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding auth protocol: cephx 2024-03-09T14:44:22.246 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding auth protocol: cephx 2024-03-09T14:44:22.246 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: secure 2024-03-09T14:44:22.246 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: crc 2024-03-09T14:44:22.246 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: secure 2024-03-09T14:44:22.247 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: crc 2024-03-09T14:44:22.247 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: secure 2024-03-09T14:44:22.247 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: crc 2024-03-09T14:44:22.247 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: crc 2024-03-09T14:44:22.247 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: secure 2024-03-09T14:44:22.247 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: crc 2024-03-09T14:44:22.247 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: secure 2024-03-09T14:44:22.247 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: crc 2024-03-09T14:44:22.247 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 AuthRegistry(0x55f0804a9d20) adding con mode: secure 2024-03-09T14:44:22.247 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.247 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.247 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command rotate-key cmddesc rotate-key hook 0x55f0804a9e68 EEXIST 2024-03-09T14:44:22.247 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: _reopen_session rank -1 2024-03-09T14:44:22.247 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:44:22.248 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-b con 0x55f0804df540 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:44:22.248 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-c con 0x55f0804e4bb0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:44:22.248 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): picked mon.noname-a con 0x55f0804d73c0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:44:22.248 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.248 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.248 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:22.248 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:22.248 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-03-09T14:44:21.812+0000 7f2ce9b98980 10 monclient(hunting): authenticate will time out at 1915.615853s 2024-03-09T14:44:22.248 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request con 0x55f0804e4bb0 auth_method 0 2024-03-09T14:44:22.248 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.248 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.248 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-03-09T14:44:21.812+0000 7f2ce7eb1640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.248 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): get_auth_request con 0x55f0804d73c0 auth_method 0 2024-03-09T14:44:22.248 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:22.249 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:22.249 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-03-09T14:44:21.812+0000 7f2ce76b0640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:22.249 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-03-09T14:44:21.816+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.249 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-03-09T14:44:21.816+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.249 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-03-09T14:44:21.816+0000 7f2ce7eb1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.249 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-03-09T14:44:21.816+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:22.249 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-03-09T14:44:21.816+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:22.249 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-03-09T14:44:21.816+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:22.249 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-03-09T14:44:21.816+0000 7f2ce76b0640 10 monclient(hunting): handle_auth_done global_id 6324 payload 824 2024-03-09T14:44:22.249 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-03-09T14:44:21.816+0000 7f2ce76b0640 10 monclient: _finish_hunting 0 2024-03-09T14:44:22.249 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-03-09T14:44:21.816+0000 7f2ce76b0640 1 monclient: found mon.noname-a 2024-03-09T14:44:22.249 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-03-09T14:44:21.816+0000 7f2ce76b0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:44:22.249 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.249 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:44:22.249 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: dump: 2024-03-09T14:44:22.250 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.250 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.250 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.250 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.250 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.250 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.250 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.250 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.250 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.250 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.250 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: _finish_auth 0 2024-03-09T14:44:22.250 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: _check_auth_tickets 2024-03-09T14:44:22.250 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 5 monclient: authenticate success, global_id 6324 2024-03-09T14:44:22.250 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:22.251 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:22.251 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:44:22.251 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 10 monclient: dump: 2024-03-09T14:44:22.251 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:22.251 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:22.251 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.251 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:22.251 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:22.251 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:22.251 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:22.251 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:22.251 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:22.251 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.251 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-03-09T14:44:21.816+0000 7f2bcaffd640 4 set_mon_vals no callback set 2024-03-09T14:44:22.252 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 10 monclient: _renew_subs 2024-03-09T14:44:22.252 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:44:22.252 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 10 monclient: _renew_subs 2024-03-09T14:44:22.252 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:44:22.252 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 1 librados: init done 2024-03-09T14:44:22.252 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command cr dump hook 0x7f2ce0001d98 2024-03-09T14:44:22.252 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.252 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:44:22.252 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:22.252 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-03-09T14:44:21.816+0000 7f2bc97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:22.252 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-03-09T14:44:21.816+0000 7f2ce6eaf640 10 monclient: get_auth_request con 0x7f2bb0066070 auth_method 0 2024-03-09T14:44:22.252 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-03-09T14:44:21.816+0000 7f2ce7eb1640 10 monclient: get_auth_request con 0x55f0804f9e50 auth_method 0 2024-03-09T14:44:22.252 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.252 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 realm 2024-03-09T14:44:22.252 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.253 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.253 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:22.253 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.253 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.253 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-03-09T14:44:21.816+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.253 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-03-09T14:44:21.820+0000 7f2ce6eaf640 10 monclient: get_auth_request con 0x55f0804fe0f0 auth_method 0 2024-03-09T14:44:22.253 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-03-09T14:44:21.820+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:22.253 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-03-09T14:44:21.820+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.253 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-03-09T14:44:21.820+0000 7f2ce7eb1640 10 monclient: get_auth_request con 0x55f080501950 auth_method 0 2024-03-09T14:44:22.253 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-03-09T14:44:21.828+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:22.253 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-03-09T14:44:21.828+0000 7f2ce9b98980 20 searching for the correct realm 2024-03-09T14:44:22.253 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-03-09T14:44:21.828+0000 7f2ce76b0640 10 monclient: get_auth_request con 0x55f080506600 auth_method 0 2024-03-09T14:44:22.253 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-03-09T14:44:21.828+0000 7f2ce6eaf640 10 monclient: get_auth_request con 0x7f2ce008e380 auth_method 0 2024-03-09T14:44:22.253 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-03-09T14:44:21.832+0000 7f2ce7eb1640 10 monclient: get_auth_request con 0x7f2cd00ce040 auth_method 0 2024-03-09T14:44:22.253 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-03-09T14:44:21.836+0000 7f2ce76b0640 0 -- 172.21.15.99:0/1868086840 >> [v2:172.21.15.179:6804/2511961392,v1:172.21.15.179:6806/2511961392] conn(0x7f2cd805f040 msgr2=0x7f2cd8083360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:22.254 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-03-09T14:44:22.040+0000 7f2ce76b0640 10 monclient: get_auth_request con 0x7f2cd805f040 auth_method 0 2024-03-09T14:44:22.254 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-03-09T14:44:22.048+0000 7f2ce6eaf640 10 monclient: get_auth_request con 0x7f2cd8020030 auth_method 0 2024-03-09T14:44:22.254 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-03-09T14:44:22.056+0000 7f2ce6eaf640 0 -- 172.21.15.99:0/1868086840 >> [v2:172.21.15.179:6807/4275579646,v1:172.21.15.179:6811/4275579646] conn(0x55f0804fe0f0 msgr2=0x55f080500520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:22.254 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-03-09T14:44:22.056+0000 7f2bc97fa640 1 client.6324.objecter ms_handle_reset 0x55f0804fe0f0 session 0x55f0804fda70 osd.5 2024-03-09T14:44:22.254 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-03-09T14:44:22.056+0000 7f2bc97fa640 10 monclient: _renew_subs 2024-03-09T14:44:22.254 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-03-09T14:44:22.056+0000 7f2bc97fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:44:22.254 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-03-09T14:44:22.056+0000 7f2ce6eaf640 10 monclient: get_auth_request con 0x7f2bb0076610 auth_method 0 2024-03-09T14:44:22.254 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:22.254 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:22.254 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:22.254 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:22.254 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:22.254 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:22.255 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.255 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.255 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.255 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:22.255 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.255 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:22.255 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 zone default found 2024-03-09T14:44:22.255 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 4 Realm: () 2024-03-09T14:44:22.255 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:22.255 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:22.255 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:22.255 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 zonegroup default 2024-03-09T14:44:22.255 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-03-09T14:44:22.068+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.255 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.256 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.256 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.256 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.256 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.256 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 started sync module instance, tier type = 2024-03-09T14:44:22.256 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-03-09T14:44:22.072+0000 7f2ce9b98980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:22.256 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=0 2024-03-09T14:44:22.256 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=1 2024-03-09T14:44:22.256 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=2 2024-03-09T14:44:22.256 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=3 2024-03-09T14:44:22.256 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=4 2024-03-09T14:44:22.256 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=5 2024-03-09T14:44:22.256 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-03-09T14:44:22.096+0000 7f2ce9b98980 20 add_watcher() i=6 2024-03-09T14:44:22.256 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 20 add_watcher() i=7 2024-03-09T14:44:22.257 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:22.257 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding auth protocol: cephx 2024-03-09T14:44:22.257 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding auth protocol: cephx 2024-03-09T14:44:22.257 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding auth protocol: cephx 2024-03-09T14:44:22.257 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: secure 2024-03-09T14:44:22.257 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: crc 2024-03-09T14:44:22.257 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-03-09T14:44:22.100+0000 7f2b9e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:22.257 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: secure 2024-03-09T14:44:22.257 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: crc 2024-03-09T14:44:22.257 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: secure 2024-03-09T14:44:22.257 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: crc 2024-03-09T14:44:22.257 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: crc 2024-03-09T14:44:22.257 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: secure 2024-03-09T14:44:22.257 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: crc 2024-03-09T14:44:22.257 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: secure 2024-03-09T14:44:22.258 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: crc 2024-03-09T14:44:22.258 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-03-09T14:44:22.100+0000 7f2ce9b98980 5 AuthRegistry(0x7ffc5040cb20) adding con mode: secure 2024-03-09T14:44:22.258 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:22.258 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:22.258 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:22.258 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command cache list hook 0x55f0804dd1f0 2024-03-09T14:44:22.258 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command cache inspect hook 0x55f0804dd1f0 2024-03-09T14:44:22.258 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command cache erase hook 0x55f0804dd1f0 2024-03-09T14:44:22.258 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command cache zap hook 0x55f0804dd1f0 2024-03-09T14:44:22.258 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 note: GC not initialized 2024-03-09T14:44:22.258 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-03-09T14:44:22.104+0000 7f2b9d7e2640 20 reqs_thread_entry: start 2024-03-09T14:44:22.258 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command sync trace show hook 0x7f2cd0004470 2024-03-09T14:44:22.258 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command sync trace history hook 0x7f2cd0004470 2024-03-09T14:44:22.258 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command sync trace active hook 0x7f2cd0004470 2024-03-09T14:44:22.258 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 5 asok(0x55f0801ffbb0) register_command sync trace active_short hook 0x7f2cd0004470 2024-03-09T14:44:22.259 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:22.259 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 Filter name: none 2024-03-09T14:44:22.259 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-03-09T14:44:22.104+0000 7f2b967fc640 20 reqs_thread_entry: start 2024-03-09T14:44:22.259 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-09T14:44:22.259 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.259 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:22.259 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-09T14:44:22.259 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-09T14:44:22.259 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 : miss 2024-03-09T14:44:22.259 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-03-09T14:44:22.104+0000 7f2ce9b98980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.259 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-03-09T14:44:22.108+0000 7f2ce9b98980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:22.259 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-03-09T14:44:22.108+0000 7f2ce9b98980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 info.flags=0x17 2024-03-09T14:44:22.259 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-03-09T14:44:22.108+0000 7f2ce9b98980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 to cache LRU end 2024-03-09T14:44:22.260 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-03-09T14:44:22.108+0000 7f2ce9b98980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:22.260 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-03-09T14:44:22.108+0000 7f2ce9b98980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:22.260 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-03-09T14:44:22.108+0000 7f2ce9b98980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 2024-03-09T14:44:22.260 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-03-09T14:44:22.116+0000 7f2ce9b98980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2ce9b98980 time 2024-03-09T14:44:22.120325+0000 2024-03-09T14:44:22.260 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:44:22.260 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.260 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:44:22.260 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2ced46dd7b] 2024-03-09T14:44:22.260 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f2ced46df2f] 2024-03-09T14:44:22.260 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f07eb73c51] 2024-03-09T14:44:22.260 INFO:tasks.workunit.client.0.smithi099.stderr: 4: radosgw-admin(+0x8d9bf2) [0x55f07eb87bf2] 2024-03-09T14:44:22.260 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55f07eb9422b] 2024-03-09T14:44:22.260 INFO:tasks.workunit.client.0.smithi099.stderr: 6: main() 2024-03-09T14:44:22.260 INFO:tasks.workunit.client.0.smithi099.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2cec2d8d90] 2024-03-09T14:44:22.260 INFO:tasks.workunit.client.0.smithi099.stderr: 8: __libc_start_main() 2024-03-09T14:44:22.261 INFO:tasks.workunit.client.0.smithi099.stderr: 9: _start() 2024-03-09T14:44:22.261 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.261 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-03-09T14:44:22.116+0000 7f2ce9b98980 -1 *** Caught signal (Aborted) ** 2024-03-09T14:44:22.261 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f2ce9b98980 thread_name:radosgw-admin 2024-03-09T14:44:22.261 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.261 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:44:22.261 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2cec2f1520] 2024-03-09T14:44:22.261 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-03-09T14:44:22.261 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-03-09T14:44:22.261 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-03-09T14:44:22.261 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2ced46ddd5] 2024-03-09T14:44:22.261 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f2ced46df2f] 2024-03-09T14:44:22.261 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f07eb73c51] 2024-03-09T14:44:22.261 INFO:tasks.workunit.client.0.smithi099.stderr: 8: radosgw-admin(+0x8d9bf2) [0x55f07eb87bf2] 2024-03-09T14:44:22.262 INFO:tasks.workunit.client.0.smithi099.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x24b) [0x55f07eb9422b] 2024-03-09T14:44:22.262 INFO:tasks.workunit.client.0.smithi099.stderr: 10: main() 2024-03-09T14:44:22.262 INFO:tasks.workunit.client.0.smithi099.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2cec2d8d90] 2024-03-09T14:44:22.262 INFO:tasks.workunit.client.0.smithi099.stderr: 12: __libc_start_main() 2024-03-09T14:44:22.262 INFO:tasks.workunit.client.0.smithi099.stderr: 13: _start() 2024-03-09T14:44:22.262 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:44:22.262 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.262 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-03-09T14:44:22.262 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-03-09T14:44:22.262 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-03-09T14:44:22.262 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-03-09T14:44:22.262 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-03-09T14:44:22.262 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-03-09T14:44:22.262 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-03-09T14:44:22.263 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-03-09T14:44:22.263 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-03-09T14:44:22.263 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-03-09T14:44:22.263 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-03-09T14:44:22.263 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-03-09T14:44:22.263 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-03-09T14:44:22.263 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-03-09T14:44:22.263 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-03-09T14:44:22.263 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-03-09T14:44:22.263 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-03-09T14:44:22.263 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-03-09T14:44:22.263 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-03-09T14:44:22.263 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-03-09T14:44:22.263 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-03-09T14:44:22.263 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-03-09T14:44:22.264 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-03-09T14:44:22.264 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:44:22.264 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-03-09T14:44:22.264 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-03-09T14:44:22.264 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-03-09T14:44:22.264 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-03-09T14:44:22.264 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-03-09T14:44:22.264 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-03-09T14:44:22.264 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-03-09T14:44:22.264 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-03-09T14:44:22.264 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-03-09T14:44:22.264 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-03-09T14:44:22.264 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-03-09T14:44:22.264 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-03-09T14:44:22.265 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-03-09T14:44:22.265 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-03-09T14:44:22.265 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-03-09T14:44:22.265 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-03-09T14:44:22.265 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-03-09T14:44:22.265 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-03-09T14:44:22.265 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-03-09T14:44:22.265 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-03-09T14:44:22.265 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-03-09T14:44:22.265 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:44:22.265 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-03-09T14:44:22.265 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:44:22.265 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-03-09T14:44:22.265 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-03-09T14:44:22.266 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-03-09T14:44:22.266 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-03-09T14:44:22.266 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-03-09T14:44:22.266 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-03-09T14:44:22.266 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-03-09T14:44:22.266 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-03-09T14:44:22.266 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-03-09T14:44:22.266 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-03-09T14:44:22.266 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-03-09T14:44:22.266 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-03-09T14:44:22.266 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-03-09T14:44:22.266 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-03-09T14:44:22.266 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-03-09T14:44:22.266 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-03-09T14:44:22.267 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-03-09T14:44:22.267 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:44:22.267 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-03-09T14:44:22.267 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:44:22.267 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-03-09T14:44:22.267 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-03-09T14:44:22.267 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-03-09T14:44:22.267 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-03-09T14:44:22.267 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-03-09T14:44:22.267 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-03-09T14:44:22.267 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:44:22.267 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-03-09T14:44:22.267 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-03-09T14:44:22.267 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:44:22.267 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-03-09T14:44:22.268 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-03-09T14:44:22.268 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-03-09T14:44:22.268 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-03-09T14:44:22.268 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-03-09T14:44:22.268 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-03-09T14:44:22.268 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-03-09T14:44:22.268 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-03-09T14:44:22.268 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-03-09T14:44:22.268 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-03-09T14:44:22.268 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-03-09T14:44:22.268 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-03-09T14:44:22.268 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:44:22.268 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2b967fc640 / http_manager 2024-03-09T14:44:22.268 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2b9d7e2640 / http_manager 2024-03-09T14:44:22.269 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2b9e7e4640 / rgw_dt_lg_renew 2024-03-09T14:44:22.269 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2bc97fa640 / ms_dispatch 2024-03-09T14:44:22.269 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2bcaffd640 / io_context_pool 2024-03-09T14:44:22.269 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2bd1602640 / ms_dispatch 2024-03-09T14:44:22.269 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2bd3e07640 / ms_dispatch 2024-03-09T14:44:22.269 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2bd560a640 / io_context_pool 2024-03-09T14:44:22.269 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2ce6eaf640 / msgr-worker-2 2024-03-09T14:44:22.269 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2ce76b0640 / msgr-worker-1 2024-03-09T14:44:22.269 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2ce7eb1640 / msgr-worker-0 2024-03-09T14:44:22.269 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2ce86b2640 / io_context_pool 2024-03-09T14:44:22.269 INFO:tasks.workunit.client.0.smithi099.stderr: 7f2ce9b98980 / radosgw-admin 2024-03-09T14:44:22.269 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-03-09T14:44:22.269 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-03-09T14:44:22.269 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/lib/ceph/crash/2024-03-09T14:44:22.122583Z_cc4334cd-ed0d-445a-99f2-05a63b92e894/log 2024-03-09T14:44:22.269 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-03-09T14:44:22.270 INFO:tasks.workunit.client.0.smithi099.stderr:Aborted 2024-03-09T14:44:22.270 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-03-09T14:44:22.270 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:22.270 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:22.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.200+0000 7f886625d980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.204+0000 7f886625d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.204+0000 7f886625d980 20 realm 2024-03-09T14:44:22.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.204+0000 7f886625d980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.204+0000 7f886625d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.204+0000 7f886625d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:22.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.204+0000 7f886625d980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.204+0000 7f886625d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.204+0000 7f886625d980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.204+0000 7f886625d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:22.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.204+0000 7f886625d980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.208+0000 7f886625d980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:22.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.208+0000 7f886625d980 20 searching for the correct realm 2024-03-09T14:44:22.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.208+0000 7f8864576640 0 -- 172.21.15.99:0/1389333478 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55a8d009bd30 msgr2=0x55a8d009e120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:22.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.216+0000 7f8863574640 0 -- 172.21.15.99:0/1389333478 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f885401a1f0 msgr2=0x7f8854089040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:22.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.432+0000 7f886625d980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:22.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.432+0000 7f886625d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:22.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.432+0000 7f886625d980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:22.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.432+0000 7f886625d980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:22.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.432+0000 7f886625d980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:22.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.432+0000 7f886625d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:22.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.432+0000 7f886625d980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.436+0000 7f886625d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.436+0000 7f886625d980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.436+0000 7f886625d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:22.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.436+0000 7f886625d980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.436+0000 7f886625d980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:22.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.436+0000 7f886625d980 20 zone default found 2024-03-09T14:44:22.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.436+0000 7f886625d980 4 Realm: () 2024-03-09T14:44:22.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.436+0000 7f886625d980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:22.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.436+0000 7f886625d980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:22.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.436+0000 7f886625d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:22.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.436+0000 7f886625d980 20 zonegroup default 2024-03-09T14:44:22.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.436+0000 7f886625d980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.436+0000 7f886625d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.436+0000 7f886625d980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.440+0000 7f886625d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.440+0000 7f886625d980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.440+0000 7f886625d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.440+0000 7f886625d980 20 started sync module instance, tier type = 2024-03-09T14:44:22.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.440+0000 7f886625d980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:22.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.464+0000 7f886625d980 20 add_watcher() i=0 2024-03-09T14:44:22.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.464+0000 7f886625d980 20 add_watcher() i=1 2024-03-09T14:44:22.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.464+0000 7f886625d980 20 add_watcher() i=2 2024-03-09T14:44:22.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.464+0000 7f886625d980 20 add_watcher() i=3 2024-03-09T14:44:22.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.464+0000 7f886625d980 20 add_watcher() i=4 2024-03-09T14:44:22.458 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.464+0000 7f886625d980 20 add_watcher() i=5 2024-03-09T14:44:22.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.464+0000 7f886625d980 20 add_watcher() i=6 2024-03-09T14:44:22.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.464+0000 7f886625d980 20 add_watcher() i=7 2024-03-09T14:44:22.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.464+0000 7f886625d980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:22.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.468+0000 7f8719fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:22.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.468+0000 7f886625d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:22.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.468+0000 7f886625d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:22.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.468+0000 7f886625d980 5 note: GC not initialized 2024-03-09T14:44:22.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.472+0000 7f8718fe1640 20 reqs_thread_entry: start 2024-03-09T14:44:22.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.472+0000 7f886625d980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:22.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.472+0000 7f886625d980 20 Filter name: none 2024-03-09T14:44:22.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.472+0000 7f86927fc640 20 reqs_thread_entry: start 2024-03-09T14:44:22.467 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.472+0000 7f886625d980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.472+0000 7f886625d980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:22.468 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.472+0000 7f886625d980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.472+0000 7f886625d980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:22.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.472+0000 7f886625d980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:22.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.472+0000 7f886625d980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.472+0000 7f886625d980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:22.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.476+0000 7f886625d980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.476+0000 7f886625d980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:22.470 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.476+0000 7f886625d980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:22.472 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.476+0000 7f886625d980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.476+0000 7f886625d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.480+0000 7f8719fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:22.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.484+0000 7f886625d980 20 remove_watcher() i=0 2024-03-09T14:44:22.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.484+0000 7f886625d980 2 removed watcher, disabling cache 2024-03-09T14:44:22.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.488+0000 7f886625d980 20 remove_watcher() i=1 2024-03-09T14:44:22.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.488+0000 7f886625d980 20 remove_watcher() i=2 2024-03-09T14:44:22.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.492+0000 7f886625d980 20 remove_watcher() i=3 2024-03-09T14:44:22.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.492+0000 7f886625d980 20 remove_watcher() i=4 2024-03-09T14:44:22.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.496+0000 7f886625d980 20 remove_watcher() i=5 2024-03-09T14:44:22.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.496+0000 7f886625d980 20 remove_watcher() i=6 2024-03-09T14:44:22.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.496+0000 7f886625d980 20 remove_watcher() i=7 2024-03-09T14:44:22.515 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.516 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:44:22.516 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-set-target-layout id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:44:22.516 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:22.518 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:22.518 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:22.534 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:22.534 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:22.579 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:44:22.616 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:22.616 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:22.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.664+0000 7f3e669a0980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.664+0000 7f3e669a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.664+0000 7f3e669a0980 20 realm 2024-03-09T14:44:22.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.664+0000 7f3e669a0980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.664+0000 7f3e669a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.664+0000 7f3e669a0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:22.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.664+0000 7f3e669a0980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.664+0000 7f3e669a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.662 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.664+0000 7f3e669a0980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.668+0000 7f3e669a0980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:22.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.668+0000 7f3e669a0980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.668+0000 7f3e669a0980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:22.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.668+0000 7f3e669a0980 20 searching for the correct realm 2024-03-09T14:44:22.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.672+0000 7f3e64cb9640 0 -- 172.21.15.99:0/420623757 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55c2e056e290 msgr2=0x55c2e05706a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:22.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.680+0000 7f3e5bfff640 0 -- 172.21.15.99:0/420623757 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f3e5c0cf040 msgr2=0x7f3e5c0f8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:22.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:22.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:22.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:22.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:22.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:22.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:22.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:22.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:22.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 20 zone default found 2024-03-09T14:44:22.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 4 Realm: () 2024-03-09T14:44:22.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:22.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:22.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:22.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 20 zonegroup default 2024-03-09T14:44:22.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.900+0000 7f3e669a0980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.904+0000 7f3e669a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.904+0000 7f3e669a0980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.904+0000 7f3e669a0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:22.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.904+0000 7f3e669a0980 20 started sync module instance, tier type = 2024-03-09T14:44:22.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.904+0000 7f3e669a0980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:22.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.928+0000 7f3e669a0980 20 add_watcher() i=0 2024-03-09T14:44:22.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.928+0000 7f3e669a0980 20 add_watcher() i=1 2024-03-09T14:44:22.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.928+0000 7f3e669a0980 20 add_watcher() i=2 2024-03-09T14:44:22.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.928+0000 7f3e669a0980 20 add_watcher() i=3 2024-03-09T14:44:22.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.928+0000 7f3e669a0980 20 add_watcher() i=4 2024-03-09T14:44:22.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.928+0000 7f3e669a0980 20 add_watcher() i=5 2024-03-09T14:44:22.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.928+0000 7f3e669a0980 20 add_watcher() i=6 2024-03-09T14:44:22.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.932+0000 7f3e669a0980 20 add_watcher() i=7 2024-03-09T14:44:22.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.932+0000 7f3e669a0980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:22.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.936+0000 7f3d1b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:22.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.936+0000 7f3e669a0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:22.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.936+0000 7f3e669a0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:22.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.936+0000 7f3e669a0980 5 note: GC not initialized 2024-03-09T14:44:22.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.936+0000 7f3d1a7dc640 20 reqs_thread_entry: start 2024-03-09T14:44:22.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.936+0000 7f3e669a0980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:22.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.936+0000 7f3e669a0980 20 Filter name: none 2024-03-09T14:44:22.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.940+0000 7f3d137fe640 20 reqs_thread_entry: start 2024-03-09T14:44:22.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.940+0000 7f3e669a0980 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-09T14:44:22.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.940+0000 7f3e669a0980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.940+0000 7f3e669a0980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:22.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.940+0000 7f3e669a0980 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-09T14:44:22.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.940+0000 7f3e669a0980 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-09T14:44:22.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.940+0000 7f3e669a0980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 : miss 2024-03-09T14:44:22.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.940+0000 7f3e669a0980 20 rados->read ofs=0 len=0 2024-03-09T14:44:22.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.940+0000 7f3e669a0980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:22.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.940+0000 7f3e669a0980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 info.flags=0x17 2024-03-09T14:44:22.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.940+0000 7f3e669a0980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 to cache LRU end 2024-03-09T14:44:22.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.940+0000 7f3e669a0980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:22.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.940+0000 7f3e669a0980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:22.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.940+0000 7f3e669a0980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 2024-03-09T14:44:22.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.944+0000 7f3e669a0980 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 to be held by another RGW process; skipping for now 2024-03-09T14:44:22.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.944+0000 7f3d1b7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:22.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.952+0000 7f3e669a0980 20 remove_watcher() i=0 2024-03-09T14:44:22.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.952+0000 7f3e669a0980 2 removed watcher, disabling cache 2024-03-09T14:44:22.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.952+0000 7f3e669a0980 20 remove_watcher() i=1 2024-03-09T14:44:22.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.956+0000 7f3e669a0980 20 remove_watcher() i=2 2024-03-09T14:44:22.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.960+0000 7f3e669a0980 20 remove_watcher() i=3 2024-03-09T14:44:22.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.964+0000 7f3e669a0980 20 remove_watcher() i=4 2024-03-09T14:44:22.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.964+0000 7f3e669a0980 20 remove_watcher() i=5 2024-03-09T14:44:22.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.964+0000 7f3e669a0980 20 remove_watcher() i=6 2024-03-09T14:44:22.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:22.968+0000 7f3e669a0980 20 remove_watcher() i=7 2024-03-09T14:44:22.979 INFO:tasks.workunit.client.0.smithi099.stderr:waiting 30 seconds for reshard lock to expire... 2024-03-09T14:44:53.011 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:44:53.047 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:53.047 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:53.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.096+0000 7f0b743af980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.100+0000 7f0b743af980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:53.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.100+0000 7f0b743af980 20 realm 2024-03-09T14:44:53.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.100+0000 7f0b743af980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.100+0000 7f0b743af980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:53.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.100+0000 7f0b743af980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:53.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.100+0000 7f0b743af980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.100+0000 7f0b743af980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:53.095 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.100+0000 7f0b743af980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.100+0000 7f0b743af980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:53.096 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.100+0000 7f0b743af980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.104+0000 7f0b743af980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:53.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.104+0000 7f0b743af980 20 searching for the correct realm 2024-03-09T14:44:53.100 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.104+0000 7f0b716c6640 0 -- 172.21.15.99:0/2320565514 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f0b640d1040 msgr2=0x7f0b640d0410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:53.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.112+0000 7f0b726c8640 0 -- 172.21.15.99:0/2320565514 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f0b5c028020 msgr2=0x7f0b5c06f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:53.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.120+0000 7f0b743af980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:53.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.120+0000 7f0b743af980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:53.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.120+0000 7f0b743af980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:53.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.120+0000 7f0b743af980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:53.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.120+0000 7f0b743af980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:53.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.120+0000 7f0b743af980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:53.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.120+0000 7f0b743af980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.120+0000 7f0b743af980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:53.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.120+0000 7f0b743af980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.120+0000 7f0b743af980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:53.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.120+0000 7f0b743af980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.124+0000 7f0b743af980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:53.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.124+0000 7f0b743af980 20 zone default found 2024-03-09T14:44:53.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.124+0000 7f0b743af980 4 Realm: () 2024-03-09T14:44:53.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.124+0000 7f0b743af980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:53.119 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.124+0000 7f0b743af980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:53.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.124+0000 7f0b743af980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:53.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.124+0000 7f0b743af980 20 zonegroup default 2024-03-09T14:44:53.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.124+0000 7f0b743af980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.124+0000 7f0b743af980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:53.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.124+0000 7f0b743af980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.124+0000 7f0b743af980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:53.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.124+0000 7f0b743af980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.124+0000 7f0b743af980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:53.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.124+0000 7f0b743af980 20 started sync module instance, tier type = 2024-03-09T14:44:53.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.124+0000 7f0b743af980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:53.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.140+0000 7f0b743af980 20 add_watcher() i=0 2024-03-09T14:44:53.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.140+0000 7f0b743af980 20 add_watcher() i=1 2024-03-09T14:44:53.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.140+0000 7f0b743af980 20 add_watcher() i=2 2024-03-09T14:44:53.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.140+0000 7f0b743af980 20 add_watcher() i=3 2024-03-09T14:44:53.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.140+0000 7f0b743af980 20 add_watcher() i=4 2024-03-09T14:44:53.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.140+0000 7f0b743af980 20 add_watcher() i=5 2024-03-09T14:44:53.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.140+0000 7f0b743af980 20 add_watcher() i=6 2024-03-09T14:44:53.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.140+0000 7f0b743af980 20 add_watcher() i=7 2024-03-09T14:44:53.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.140+0000 7f0b743af980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:53.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0a27fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:53.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:53.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:53.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 5 note: GC not initialized 2024-03-09T14:44:53.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0a26fe5640 20 reqs_thread_entry: start 2024-03-09T14:44:53.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:53.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 20 Filter name: none 2024-03-09T14:44:53.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0a24fe1640 20 reqs_thread_entry: start 2024-03-09T14:44:53.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-03-09T14:44:53.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:53.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-03-09T14:44:53.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-03-09T14:44:53.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 : miss 2024-03-09T14:44:53.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:53.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 info.flags=0x17 2024-03-09T14:44:53.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 to cache LRU end 2024-03-09T14:44:53.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:53.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:53.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.144+0000 7f0b743af980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 2024-03-09T14:44:53.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.152+0000 7f0b743af980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 info.flags=0x17 2024-03-09T14:44:53.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.152+0000 7f0b743af980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 to cache LRU end 2024-03-09T14:44:53.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.152+0000 7f0b743af980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:53.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.152+0000 7f0b743af980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22, ofs0, ns] 2024-03-09T14:44:53.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.152+0000 7f0a54ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464340 cookie 94813060911376 notifier 6378 bl.length()=1001 2024-03-09T14:44:53.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.152+0000 7f0a54ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 info.flags=0x17 2024-03-09T14:44:53.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.152+0000 7f0a54ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 to cache LRU end 2024-03-09T14:44:53.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.152+0000 7f0a54ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:53.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.156+0000 7f0b743af980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22]): orig_sources= new_sources= 2024-03-09T14:44:53.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.156+0000 7f0b743af980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22]): potential sources added=[] removed=[] 2024-03-09T14:44:53.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.156+0000 7f0b743af980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22]): orig_dests= new_dests= 2024-03-09T14:44:53.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.156+0000 7f0b743af980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22]): potential dests added=[] removed=[] 2024-03-09T14:44:53.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.0 2024-03-09T14:44:53.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.0 2024-03-09T14:44:53.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.1 2024-03-09T14:44:53.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.1 2024-03-09T14:44:53.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.2 2024-03-09T14:44:53.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.2 2024-03-09T14:44:53.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.3 2024-03-09T14:44:53.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.3 2024-03-09T14:44:53.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.4 2024-03-09T14:44:53.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.4 2024-03-09T14:44:53.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.5 2024-03-09T14:44:53.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.5 2024-03-09T14:44:53.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.6 2024-03-09T14:44:53.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.6 2024-03-09T14:44:53.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.7 2024-03-09T14:44:53.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.7 2024-03-09T14:44:53.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.8 2024-03-09T14:44:53.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.8 2024-03-09T14:44:53.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.9 2024-03-09T14:44:53.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.9 2024-03-09T14:44:53.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.10 2024-03-09T14:44:53.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.10 2024-03-09T14:44:53.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.11 2024-03-09T14:44:53.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1.11 2024-03-09T14:44:53.156 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.0 2024-03-09T14:44:53.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.1 2024-03-09T14:44:53.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.160+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.2 2024-03-09T14:44:53.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.164+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.3 2024-03-09T14:44:53.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.164+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.4 2024-03-09T14:44:53.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.164+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.5 2024-03-09T14:44:53.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.164+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.6 2024-03-09T14:44:53.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.164+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.7 2024-03-09T14:44:53.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.164+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.8 2024-03-09T14:44:53.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.168+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.9 2024-03-09T14:44:53.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.168+0000 7f0b743af980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22.10 2024-03-09T14:44:53.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.172+0000 7f0b743af980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 : hit (requested=0x17, cached=0x17) 2024-03-09T14:44:53.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.172+0000 7f0b743af980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 2024-03-09T14:44:53.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.172+0000 7f0b743af980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 info.flags=0x17 2024-03-09T14:44:53.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.172+0000 7f0b743af980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 to cache LRU end 2024-03-09T14:44:53.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.172+0000 7f0b743af980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:53.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.172+0000 7f0b743af980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22, ofs0, ns] 2024-03-09T14:44:53.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.176+0000 7f0a54ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464341 cookie 94813060911376 notifier 6378 bl.length()=969 2024-03-09T14:44:53.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.176+0000 7f0a54ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 info.flags=0x17 2024-03-09T14:44:53.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.176+0000 7f0a54ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 to cache LRU end 2024-03-09T14:44:53.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.176+0000 7f0a54ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:53.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.176+0000 7f0b743af980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22]): orig_sources= new_sources= 2024-03-09T14:44:53.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.176+0000 7f0b743af980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22]): potential sources added=[] removed=[] 2024-03-09T14:44:53.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.176+0000 7f0b743af980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22]): orig_dests= new_dests= 2024-03-09T14:44:53.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.176+0000 7f0b743af980 20 handle_bi_update(): bucket=:abort-at-set-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22]): potential dests added=[] removed=[] 2024-03-09T14:44:53.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.180+0000 7f0b743af980 1 execute INFO: reshard of bucket "abort-at-set-target-layout" completed successfully 2024-03-09T14:44:53.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.184+0000 7f0a27fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:53.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.188+0000 7f0b743af980 20 remove_watcher() i=0 2024-03-09T14:44:53.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.188+0000 7f0b743af980 2 removed watcher, disabling cache 2024-03-09T14:44:53.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.192+0000 7f0b743af980 20 remove_watcher() i=1 2024-03-09T14:44:53.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.196+0000 7f0b743af980 20 remove_watcher() i=2 2024-03-09T14:44:53.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.196+0000 7f0b743af980 20 remove_watcher() i=3 2024-03-09T14:44:53.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.200+0000 7f0b743af980 20 remove_watcher() i=4 2024-03-09T14:44:53.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.200+0000 7f0b743af980 20 remove_watcher() i=5 2024-03-09T14:44:53.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.200+0000 7f0b743af980 20 remove_watcher() i=6 2024-03-09T14:44:53.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.204+0000 7f0b743af980 20 remove_watcher() i=7 2024-03-09T14:44:53.212 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-03-09T14:44:53.238 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:53.238 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:53.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.288+0000 7f4361174980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.288+0000 7f4361174980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:53.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.288+0000 7f4361174980 20 realm 2024-03-09T14:44:53.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.288+0000 7f4361174980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.288+0000 7f4361174980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:53.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.288+0000 7f4361174980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:53.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.288+0000 7f4361174980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.288+0000 7f4361174980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:53.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.288+0000 7f4361174980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.292+0000 7f4361174980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:53.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.292+0000 7f4361174980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.292+0000 7f4361174980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:53.288 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.292+0000 7f4361174980 20 searching for the correct realm 2024-03-09T14:44:53.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.296+0000 7f435ec8c640 0 -- 172.21.15.99:0/1667868904 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x5558919d5700 msgr2=0x5558919d7bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:53.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.304+0000 7f435e48b640 0 -- 172.21.15.99:0/1667868904 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f4358079760 msgr2=0x7f43580739b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:53.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.520+0000 7f4361174980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:53.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.520+0000 7f4361174980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:53.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.520+0000 7f4361174980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:53.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.520+0000 7f4361174980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:53.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.520+0000 7f4361174980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:53.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.520+0000 7f4361174980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:53.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.520+0000 7f4361174980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.520+0000 7f4361174980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:53.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.520+0000 7f4361174980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.524+0000 7f4361174980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:53.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.524+0000 7f4361174980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.524+0000 7f4361174980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:53.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.524+0000 7f4361174980 20 zone default found 2024-03-09T14:44:53.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.524+0000 7f4361174980 4 Realm: () 2024-03-09T14:44:53.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.524+0000 7f4361174980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:53.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.524+0000 7f4361174980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:53.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.524+0000 7f4361174980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:53.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.524+0000 7f4361174980 20 zonegroup default 2024-03-09T14:44:53.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.524+0000 7f4361174980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.524+0000 7f4361174980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:53.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.524+0000 7f4361174980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.524+0000 7f4361174980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:53.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.524+0000 7f4361174980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.524+0000 7f4361174980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:53.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.524+0000 7f4361174980 20 started sync module instance, tier type = 2024-03-09T14:44:53.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.524+0000 7f4361174980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:53.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.548+0000 7f4361174980 20 add_watcher() i=0 2024-03-09T14:44:53.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.548+0000 7f4361174980 20 add_watcher() i=1 2024-03-09T14:44:53.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.548+0000 7f4361174980 20 add_watcher() i=2 2024-03-09T14:44:53.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.548+0000 7f4361174980 20 add_watcher() i=3 2024-03-09T14:44:53.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.548+0000 7f4361174980 20 add_watcher() i=4 2024-03-09T14:44:53.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.548+0000 7f4361174980 20 add_watcher() i=5 2024-03-09T14:44:53.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.548+0000 7f4361174980 20 add_watcher() i=6 2024-03-09T14:44:53.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.552+0000 7f4361174980 20 add_watcher() i=7 2024-03-09T14:44:53.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.552+0000 7f4361174980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:53.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.556+0000 7f42157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:53.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.556+0000 7f4361174980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:53.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.556+0000 7f4361174980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:53.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.556+0000 7f4361174980 5 note: GC not initialized 2024-03-09T14:44:53.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.556+0000 7f418ffff640 20 reqs_thread_entry: start 2024-03-09T14:44:53.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.556+0000 7f4361174980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:53.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.556+0000 7f4361174980 20 Filter name: none 2024-03-09T14:44:53.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.556+0000 7f418dffb640 20 reqs_thread_entry: start 2024-03-09T14:44:53.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.556+0000 7f4361174980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.556+0000 7f4361174980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:53.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.556+0000 7f4361174980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.560+0000 7f4361174980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:53.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.560+0000 7f4361174980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:53.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.560+0000 7f4361174980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.560+0000 7f4361174980 20 rados_obj.operate() r=0 bl.length=218 2024-03-09T14:44:53.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.560+0000 7f4361174980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.560+0000 7f4361174980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:53.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.560+0000 7f4361174980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:53.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.564+0000 7f4361174980 20 rados->read ofs=0 len=0 2024-03-09T14:44:53.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.564+0000 7f4361174980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:53.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.564+0000 7f42157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:53.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.568+0000 7f4361174980 20 remove_watcher() i=0 2024-03-09T14:44:53.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.568+0000 7f4361174980 2 removed watcher, disabling cache 2024-03-09T14:44:53.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.572+0000 7f4361174980 20 remove_watcher() i=1 2024-03-09T14:44:53.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.572+0000 7f4361174980 20 remove_watcher() i=2 2024-03-09T14:44:53.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.576+0000 7f4361174980 20 remove_watcher() i=3 2024-03-09T14:44:53.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.580+0000 7f4361174980 20 remove_watcher() i=4 2024-03-09T14:44:53.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.580+0000 7f4361174980 20 remove_watcher() i=5 2024-03-09T14:44:53.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.580+0000 7f4361174980 20 remove_watcher() i=6 2024-03-09T14:44:53.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:53.584+0000 7f4361174980 20 remove_watcher() i=7 2024-03-09T14:44:53.597 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:53.597 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:44:53.597 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-set-target-layout id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-09T14:44:53.597 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:53.599 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:53.599 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:53.603 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:53.603 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:53.656 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:53.656 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:53.700 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-03-09T14:44:53.700 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:53.701 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:53.701 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:53.717 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:53.717 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:53.760 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:53.760 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:53.783 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:53.783 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:53.803 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:53.804 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:53.824 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:53.825 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:53.846 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:53.846 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:53.868 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:53.868 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:53.889 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:53.889 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:53.912 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:53.912 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:53.935 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:53.935 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:53.955 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:53.955 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:53.978 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:53.978 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:53.998 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:53.999 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:54.020 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:54.020 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:54.041 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:54.041 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:54.062 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:54.062 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:54.082 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:54.083 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:54.104 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:54.104 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:54.125 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:54.125 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:54.145 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:54.146 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:54.167 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:54.167 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:54.184 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-03-09T14:44:54.215 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:54.215 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:54.260 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.264+0000 7fb2e7231980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.264+0000 7fb2e7231980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:54.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.264+0000 7fb2e7231980 20 realm 2024-03-09T14:44:54.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.264+0000 7fb2e7231980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.268+0000 7fb2e7231980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:54.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.268+0000 7fb2e7231980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:54.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.268+0000 7fb2e7231980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.268+0000 7fb2e7231980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:54.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.268+0000 7fb2e7231980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.268+0000 7fb2e7231980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:54.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.268+0000 7fb2e7231980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.268+0000 7fb2e7231980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:54.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.268+0000 7fb2e7231980 20 searching for the correct realm 2024-03-09T14:44:54.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.272+0000 7fb2e554a640 0 -- 172.21.15.99:0/2251466330 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7fb2d8033060 msgr2=0x7fb2d805ad30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:54.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.280+0000 7fb2e554a640 0 -- 172.21.15.99:0/2251466330 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x7fb2d8033060 msgr2=0x7fb1b007b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:54.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:54.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:54.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:54.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:54.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:54.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:54.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:54.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:54.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:54.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 20 zone default found 2024-03-09T14:44:54.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 4 Realm: () 2024-03-09T14:44:54.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:54.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:54.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:54.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 20 zonegroup default 2024-03-09T14:44:54.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:54.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.500+0000 7fb2e7231980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.504+0000 7fb2e7231980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:54.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.504+0000 7fb2e7231980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.504+0000 7fb2e7231980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:54.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.504+0000 7fb2e7231980 20 started sync module instance, tier type = 2024-03-09T14:44:54.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.504+0000 7fb2e7231980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:54.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.528+0000 7fb2e7231980 20 add_watcher() i=0 2024-03-09T14:44:54.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.528+0000 7fb2e7231980 20 add_watcher() i=1 2024-03-09T14:44:54.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.528+0000 7fb2e7231980 20 add_watcher() i=2 2024-03-09T14:44:54.523 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.528+0000 7fb2e7231980 20 add_watcher() i=3 2024-03-09T14:44:54.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.528+0000 7fb2e7231980 20 add_watcher() i=4 2024-03-09T14:44:54.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.528+0000 7fb2e7231980 20 add_watcher() i=5 2024-03-09T14:44:54.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.528+0000 7fb2e7231980 20 add_watcher() i=6 2024-03-09T14:44:54.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.528+0000 7fb2e7231980 20 add_watcher() i=7 2024-03-09T14:44:54.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.528+0000 7fb2e7231980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:54.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.532+0000 7fb19b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:54.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.532+0000 7fb2e7231980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:54.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.532+0000 7fb2e7231980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:54.530 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.532+0000 7fb2e7231980 5 note: GC not initialized 2024-03-09T14:44:54.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.536+0000 7fb19a7e4640 20 reqs_thread_entry: start 2024-03-09T14:44:54.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.536+0000 7fb2e7231980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:54.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.536+0000 7fb2e7231980 20 Filter name: none 2024-03-09T14:44:54.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.536+0000 7fb1987e0640 20 reqs_thread_entry: start 2024-03-09T14:44:54.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.536+0000 7fb2e7231980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.536+0000 7fb2e7231980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:44:54.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.536+0000 7fb2e7231980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.536+0000 7fb2e7231980 20 rados_obj.operate() r=0 bl.length=427 2024-03-09T14:44:54.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.536+0000 7fb2e7231980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:54.534 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.536+0000 7fb2e7231980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.540+0000 7fb2e7231980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:44:54.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.540+0000 7fb2e7231980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.540+0000 7fb2e7231980 20 rados_obj.operate() r=0 bl.length=427 2024-03-09T14:44:54.536 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.540+0000 7fb2e7231980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:54.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.544+0000 7fb2e7231980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.538 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.544+0000 7fb2e7231980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:54.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.544+0000 7fb19b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:54.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.548+0000 7fb2e7231980 20 remove_watcher() i=0 2024-03-09T14:44:54.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.548+0000 7fb2e7231980 2 removed watcher, disabling cache 2024-03-09T14:44:54.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.552+0000 7fb2e7231980 20 remove_watcher() i=1 2024-03-09T14:44:54.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.556+0000 7fb2e7231980 20 remove_watcher() i=2 2024-03-09T14:44:54.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.556+0000 7fb2e7231980 20 remove_watcher() i=3 2024-03-09T14:44:54.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.560+0000 7fb2e7231980 20 remove_watcher() i=4 2024-03-09T14:44:54.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.560+0000 7fb2e7231980 20 remove_watcher() i=5 2024-03-09T14:44:54.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.564+0000 7fb2e7231980 20 remove_watcher() i=6 2024-03-09T14:44:54.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.564+0000 7fb2e7231980 20 remove_watcher() i=7 2024-03-09T14:44:54.578 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:54.578 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:44:54.578 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-block-writes id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:44:54.578 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:54.578 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-03-09T14:44:54.608 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:54.608 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:54.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.656+0000 7f0832c89980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.656+0000 7f0832c89980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:54.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.656+0000 7f0832c89980 20 realm 2024-03-09T14:44:54.654 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.656+0000 7f0832c89980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.656+0000 7f0832c89980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:54.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.656+0000 7f0832c89980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:54.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.656+0000 7f0832c89980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.656+0000 7f0832c89980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:54.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.656+0000 7f0832c89980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.660+0000 7f0832c89980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:54.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.660+0000 7f0832c89980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.660+0000 7f0832c89980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:54.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.660+0000 7f0832c89980 20 searching for the correct realm 2024-03-09T14:44:54.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.664+0000 7f0830fa2640 0 -- 172.21.15.99:0/2811004818 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f082401a040 msgr2=0x7f0824055b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:54.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.672+0000 7f082ffa0640 0 -- 172.21.15.99:0/2811004818 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f08280c8410 msgr2=0x7f08280c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:54.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.888+0000 7f0832c89980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:54.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.888+0000 7f0832c89980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:54.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.888+0000 7f0832c89980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:54.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.888+0000 7f0832c89980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:54.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.888+0000 7f0832c89980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:54.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.888+0000 7f0832c89980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:54.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.888+0000 7f0832c89980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.888+0000 7f0832c89980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:54.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.888+0000 7f0832c89980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.892+0000 7f0832c89980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:54.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.892+0000 7f0832c89980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.892+0000 7f0832c89980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:54.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.892+0000 7f0832c89980 20 zone default found 2024-03-09T14:44:54.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.892+0000 7f0832c89980 4 Realm: () 2024-03-09T14:44:54.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.892+0000 7f0832c89980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:54.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.892+0000 7f0832c89980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:54.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.892+0000 7f0832c89980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:54.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.892+0000 7f0832c89980 20 zonegroup default 2024-03-09T14:44:54.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.892+0000 7f0832c89980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.892+0000 7f0832c89980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:54.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.892+0000 7f0832c89980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.892+0000 7f0832c89980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:54.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.892+0000 7f0832c89980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.896+0000 7f0832c89980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:54.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.896+0000 7f0832c89980 20 started sync module instance, tier type = 2024-03-09T14:44:54.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.896+0000 7f0832c89980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:54.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.916+0000 7f0832c89980 20 add_watcher() i=0 2024-03-09T14:44:54.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.916+0000 7f0832c89980 20 add_watcher() i=1 2024-03-09T14:44:54.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.916+0000 7f0832c89980 20 add_watcher() i=2 2024-03-09T14:44:54.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.916+0000 7f0832c89980 20 add_watcher() i=3 2024-03-09T14:44:54.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.916+0000 7f0832c89980 20 add_watcher() i=4 2024-03-09T14:44:54.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.916+0000 7f0832c89980 20 add_watcher() i=5 2024-03-09T14:44:54.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.920+0000 7f0832c89980 20 add_watcher() i=6 2024-03-09T14:44:54.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.920+0000 7f0832c89980 20 add_watcher() i=7 2024-03-09T14:44:54.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.920+0000 7f0832c89980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:54.921 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.924+0000 7f06e77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:54.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:54.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:54.922 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 5 note: GC not initialized 2024-03-09T14:44:54.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f06e67dc640 20 reqs_thread_entry: start 2024-03-09T14:44:54.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:54.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 20 Filter name: none 2024-03-09T14:44:54.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f06df7fe640 20 reqs_thread_entry: start 2024-03-09T14:44:54.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-03-09T14:44:54.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:44:54.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-03-09T14:44:54.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-03-09T14:44:54.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 : miss 2024-03-09T14:44:54.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 20 rados->read ofs=0 len=0 2024-03-09T14:44:54.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 20 rados_obj.operate() r=0 bl.length=427 2024-03-09T14:44:54.925 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 info.flags=0x17 2024-03-09T14:44:54.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 to cache LRU end 2024-03-09T14:44:54.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:54.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:54.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.928+0000 7f0832c89980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 2024-03-09T14:44:54.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.940+0000 7f0832c89980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 info.flags=0x17 2024-03-09T14:44:54.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.940+0000 7f0832c89980 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 to cache LRU end 2024-03-09T14:44:54.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.940+0000 7f0832c89980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:54.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.940+0000 7f0832c89980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23, ofs0, ns] 2024-03-09T14:44:54.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.940+0000 7f0706ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464316 cookie 94455140326096 notifier 6435 bl.length()=991 2024-03-09T14:44:54.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.944+0000 7f0706ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 info.flags=0x17 2024-03-09T14:44:54.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.944+0000 7f0706ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 to cache LRU end 2024-03-09T14:44:54.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.944+0000 7f0706ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:54.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.944+0000 7f0832c89980 20 handle_bi_update(): bucket=:error-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23]): orig_sources= new_sources= 2024-03-09T14:44:54.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.944+0000 7f0832c89980 20 handle_bi_update(): bucket=:error-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23]): potential sources added=[] removed=[] 2024-03-09T14:44:54.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.944+0000 7f0832c89980 20 handle_bi_update(): bucket=:error-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23]): orig_dests= new_dests= 2024-03-09T14:44:54.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.944+0000 7f0832c89980 20 handle_bi_update(): bucket=:error-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23]): potential dests added=[] removed=[] 2024-03-09T14:44:54.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.944+0000 7f0832c89980 -1 Injecting error=-5 at location=block_writes 2024-03-09T14:44:54.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.944+0000 7f0832c89980 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-03-09T14:44:54.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.948+0000 7f0832c89980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 : hit (requested=0x17, cached=0x17) 2024-03-09T14:44:54.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.948+0000 7f0832c89980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 2024-03-09T14:44:54.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.952+0000 7f0832c89980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 info.flags=0x17 2024-03-09T14:44:54.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.952+0000 7f0832c89980 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 to cache LRU end 2024-03-09T14:44:54.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.952+0000 7f0832c89980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:54.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.952+0000 7f0832c89980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23, ofs0, ns] 2024-03-09T14:44:54.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.952+0000 7f07077fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464317 cookie 94455140326096 notifier 6435 bl.length()=959 2024-03-09T14:44:54.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.952+0000 7f07077fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 info.flags=0x17 2024-03-09T14:44:54.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.952+0000 7f07077fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 to cache LRU end 2024-03-09T14:44:54.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.952+0000 7f07077fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:54.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.952+0000 7f0832c89980 20 handle_bi_update(): bucket=:error-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23]): orig_sources= new_sources= 2024-03-09T14:44:54.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.952+0000 7f0832c89980 20 handle_bi_update(): bucket=:error-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23]): potential sources added=[] removed=[] 2024-03-09T14:44:54.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.952+0000 7f0832c89980 20 handle_bi_update(): bucket=:error-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23]): orig_dests= new_dests= 2024-03-09T14:44:54.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.952+0000 7f0832c89980 20 handle_bi_update(): bucket=:error-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23]): potential dests added=[] removed=[] 2024-03-09T14:44:54.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.956+0000 7f06e77de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:54.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.964+0000 7f0832c89980 20 remove_watcher() i=0 2024-03-09T14:44:54.958 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.964+0000 7f0832c89980 2 removed watcher, disabling cache 2024-03-09T14:44:54.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.964+0000 7f0832c89980 20 remove_watcher() i=1 2024-03-09T14:44:54.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.968+0000 7f0832c89980 20 remove_watcher() i=2 2024-03-09T14:44:54.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.968+0000 7f0832c89980 20 remove_watcher() i=3 2024-03-09T14:44:54.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.972+0000 7f0832c89980 20 remove_watcher() i=4 2024-03-09T14:44:54.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.972+0000 7f0832c89980 20 remove_watcher() i=5 2024-03-09T14:44:54.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.976+0000 7f0832c89980 20 remove_watcher() i=6 2024-03-09T14:44:54.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:54.976+0000 7f0832c89980 20 remove_watcher() i=7 2024-03-09T14:44:54.989 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-03-09T14:44:55.015 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:55.016 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:55.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.064+0000 7f59b083c980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.064+0000 7f59b083c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.064+0000 7f59b083c980 20 realm 2024-03-09T14:44:55.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.064+0000 7f59b083c980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.064+0000 7f59b083c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.064+0000 7f59b083c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:55.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.064+0000 7f59b083c980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.064+0000 7f59b083c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.064+0000 7f59b083c980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.068+0000 7f59b083c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:55.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.068+0000 7f59b083c980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.068+0000 7f59b083c980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:55.064 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.068+0000 7f59b083c980 20 searching for the correct realm 2024-03-09T14:44:55.068 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.072+0000 7f59adb53640 0 -- 172.21.15.99:0/2469014637 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f59a0026040 msgr2=0x7f59a0036920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:55.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.080+0000 7f59adb53640 0 -- 172.21.15.99:0/2469014637 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f59a8019040 msgr2=0x7f59a806f9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:55.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.296+0000 7f59b083c980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:55.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.296+0000 7f59b083c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:55.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.296+0000 7f59b083c980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:55.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.296+0000 7f59b083c980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:55.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.296+0000 7f59b083c980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:55.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.296+0000 7f59b083c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:55.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.296+0000 7f59b083c980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.296+0000 7f59b083c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.296+0000 7f59b083c980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.300+0000 7f59b083c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:55.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.300+0000 7f59b083c980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.300+0000 7f59b083c980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:55.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.300+0000 7f59b083c980 20 zone default found 2024-03-09T14:44:55.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.300+0000 7f59b083c980 4 Realm: () 2024-03-09T14:44:55.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.300+0000 7f59b083c980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:55.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.300+0000 7f59b083c980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:55.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.300+0000 7f59b083c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:55.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.300+0000 7f59b083c980 20 zonegroup default 2024-03-09T14:44:55.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.300+0000 7f59b083c980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.296 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.300+0000 7f59b083c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.300+0000 7f59b083c980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.300+0000 7f59b083c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.300+0000 7f59b083c980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.300+0000 7f59b083c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.300+0000 7f59b083c980 20 started sync module instance, tier type = 2024-03-09T14:44:55.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.300+0000 7f59b083c980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:55.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.324+0000 7f59b083c980 20 add_watcher() i=0 2024-03-09T14:44:55.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.324+0000 7f59b083c980 20 add_watcher() i=1 2024-03-09T14:44:55.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.324+0000 7f59b083c980 20 add_watcher() i=2 2024-03-09T14:44:55.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.324+0000 7f59b083c980 20 add_watcher() i=3 2024-03-09T14:44:55.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.324+0000 7f59b083c980 20 add_watcher() i=4 2024-03-09T14:44:55.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.324+0000 7f59b083c980 20 add_watcher() i=5 2024-03-09T14:44:55.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.324+0000 7f59b083c980 20 add_watcher() i=6 2024-03-09T14:44:55.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.324+0000 7f59b083c980 20 add_watcher() i=7 2024-03-09T14:44:55.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.324+0000 7f59b083c980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:55.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.328+0000 7f58657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:55.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.328+0000 7f59b083c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:55.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.328+0000 7f59b083c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:55.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.328+0000 7f59b083c980 5 note: GC not initialized 2024-03-09T14:44:55.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.328+0000 7f585f7fe640 20 reqs_thread_entry: start 2024-03-09T14:44:55.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.328+0000 7f59b083c980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:55.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.328+0000 7f59b083c980 20 Filter name: none 2024-03-09T14:44:55.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.328+0000 7f585d7fa640 20 reqs_thread_entry: start 2024-03-09T14:44:55.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.328+0000 7f59b083c980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.332+0000 7f59b083c980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:44:55.326 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.332+0000 7f59b083c980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.332+0000 7f59b083c980 20 rados_obj.operate() r=0 bl.length=427 2024-03-09T14:44:55.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.332+0000 7f59b083c980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:55.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.332+0000 7f59b083c980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.332+0000 7f59b083c980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:44:55.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.332+0000 7f59b083c980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.332+0000 7f59b083c980 20 rados_obj.operate() r=0 bl.length=427 2024-03-09T14:44:55.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.332+0000 7f59b083c980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:55.329 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.332+0000 7f59b083c980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.336+0000 7f59b083c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.331 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.336+0000 7f58657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:55.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.340+0000 7f59b083c980 20 remove_watcher() i=0 2024-03-09T14:44:55.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.340+0000 7f59b083c980 2 removed watcher, disabling cache 2024-03-09T14:44:55.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.344+0000 7f59b083c980 20 remove_watcher() i=1 2024-03-09T14:44:55.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.344+0000 7f59b083c980 20 remove_watcher() i=2 2024-03-09T14:44:55.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.348+0000 7f59b083c980 20 remove_watcher() i=3 2024-03-09T14:44:55.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.348+0000 7f59b083c980 20 remove_watcher() i=4 2024-03-09T14:44:55.346 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.352+0000 7f59b083c980 20 remove_watcher() i=5 2024-03-09T14:44:55.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.352+0000 7f59b083c980 20 remove_watcher() i=6 2024-03-09T14:44:55.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.352+0000 7f59b083c980 20 remove_watcher() i=7 2024-03-09T14:44:55.364 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:55.364 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:44:55.364 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-block-writes id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:44:55.365 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:55.365 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:55.365 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:55.377 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:55.377 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:55.423 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:44:55.458 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:55.458 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:55.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.508+0000 7fd5944b6980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.508+0000 7fd5944b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.508+0000 7fd5944b6980 20 realm 2024-03-09T14:44:55.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.508+0000 7fd5944b6980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.508+0000 7fd5944b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.508+0000 7fd5944b6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:55.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.508+0000 7fd5944b6980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.508+0000 7fd5944b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.508+0000 7fd5944b6980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.512+0000 7fd5944b6980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:55.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.512+0000 7fd5944b6980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.512+0000 7fd5944b6980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:55.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.512+0000 7fd5944b6980 20 searching for the correct realm 2024-03-09T14:44:55.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.516+0000 7fd5917cd640 0 -- 172.21.15.99:0/2564290519 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7fd58401a040 msgr2=0x7fd584036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:44:55.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.524+0000 7fd5917cd640 0 -- 172.21.15.99:0/2564290519 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fd58c018750 msgr2=0x7fd58c0256e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:55.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.740+0000 7fd5944b6980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:55.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.740+0000 7fd5944b6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:55.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.740+0000 7fd5944b6980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:55.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.740+0000 7fd5944b6980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:55.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.740+0000 7fd5944b6980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:55.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.740+0000 7fd5944b6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:55.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.740+0000 7fd5944b6980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.740+0000 7fd5944b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.740+0000 7fd5944b6980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.744+0000 7fd5944b6980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:55.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.744+0000 7fd5944b6980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.744+0000 7fd5944b6980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:55.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.744+0000 7fd5944b6980 20 zone default found 2024-03-09T14:44:55.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.744+0000 7fd5944b6980 4 Realm: () 2024-03-09T14:44:55.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.744+0000 7fd5944b6980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:55.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.744+0000 7fd5944b6980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:55.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.744+0000 7fd5944b6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:55.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.744+0000 7fd5944b6980 20 zonegroup default 2024-03-09T14:44:55.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.744+0000 7fd5944b6980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.744+0000 7fd5944b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.744+0000 7fd5944b6980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.744+0000 7fd5944b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.744+0000 7fd5944b6980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.744+0000 7fd5944b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.744+0000 7fd5944b6980 20 started sync module instance, tier type = 2024-03-09T14:44:55.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.744+0000 7fd5944b6980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:55.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.768+0000 7fd5944b6980 20 add_watcher() i=0 2024-03-09T14:44:55.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.768+0000 7fd5944b6980 20 add_watcher() i=1 2024-03-09T14:44:55.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.768+0000 7fd5944b6980 20 add_watcher() i=2 2024-03-09T14:44:55.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.768+0000 7fd5944b6980 20 add_watcher() i=3 2024-03-09T14:44:55.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.768+0000 7fd5944b6980 20 add_watcher() i=4 2024-03-09T14:44:55.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.768+0000 7fd5944b6980 20 add_watcher() i=5 2024-03-09T14:44:55.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.768+0000 7fd5944b6980 20 add_watcher() i=6 2024-03-09T14:44:55.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.772+0000 7fd5944b6980 20 add_watcher() i=7 2024-03-09T14:44:55.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.772+0000 7fd5944b6980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:55.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.772+0000 7fd4437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:55.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:55.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:55.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 5 note: GC not initialized 2024-03-09T14:44:55.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd4427fc640 20 reqs_thread_entry: start 2024-03-09T14:44:55.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:55.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 20 Filter name: none 2024-03-09T14:44:55.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd3b3fff640 20 reqs_thread_entry: start 2024-03-09T14:44:55.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-03-09T14:44:55.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:44:55.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-03-09T14:44:55.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-03-09T14:44:55.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 : miss 2024-03-09T14:44:55.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 20 rados_obj.operate() r=0 bl.length=427 2024-03-09T14:44:55.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 info.flags=0x17 2024-03-09T14:44:55.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 to cache LRU end 2024-03-09T14:44:55.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:55.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:55.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.776+0000 7fd5944b6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 2024-03-09T14:44:55.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.788+0000 7fd5944b6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 info.flags=0x17 2024-03-09T14:44:55.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.788+0000 7fd5944b6980 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 to cache LRU end 2024-03-09T14:44:55.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.788+0000 7fd5944b6980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:55.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.788+0000 7fd5944b6980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23, ofs0, ns] 2024-03-09T14:44:55.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.788+0000 7fd4757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464318 cookie 94797049245808 notifier 6471 bl.length()=991 2024-03-09T14:44:55.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.788+0000 7fd4757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 info.flags=0x17 2024-03-09T14:44:55.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.788+0000 7fd4757fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 to cache LRU end 2024-03-09T14:44:55.786 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.788+0000 7fd4757fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:55.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.792+0000 7fd5944b6980 20 handle_bi_update(): bucket=:error-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23]): orig_sources= new_sources= 2024-03-09T14:44:55.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.792+0000 7fd5944b6980 20 handle_bi_update(): bucket=:error-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23]): potential sources added=[] removed=[] 2024-03-09T14:44:55.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.792+0000 7fd5944b6980 20 handle_bi_update(): bucket=:error-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23]): orig_dests= new_dests= 2024-03-09T14:44:55.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.792+0000 7fd5944b6980 20 handle_bi_update(): bucket=:error-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23]): potential dests added=[] removed=[] 2024-03-09T14:44:55.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.0 2024-03-09T14:44:55.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.0 2024-03-09T14:44:55.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.1 2024-03-09T14:44:55.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.1 2024-03-09T14:44:55.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.2 2024-03-09T14:44:55.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.2 2024-03-09T14:44:55.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.3 2024-03-09T14:44:55.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.3 2024-03-09T14:44:55.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.4 2024-03-09T14:44:55.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.4 2024-03-09T14:44:55.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.5 2024-03-09T14:44:55.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.5 2024-03-09T14:44:55.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.6 2024-03-09T14:44:55.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.6 2024-03-09T14:44:55.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.7 2024-03-09T14:44:55.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.7 2024-03-09T14:44:55.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.8 2024-03-09T14:44:55.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.8 2024-03-09T14:44:55.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.9 2024-03-09T14:44:55.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.9 2024-03-09T14:44:55.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.10 2024-03-09T14:44:55.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.10 2024-03-09T14:44:55.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.11 2024-03-09T14:44:55.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1.11 2024-03-09T14:44:55.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.0 2024-03-09T14:44:55.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.1 2024-03-09T14:44:55.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.796+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.2 2024-03-09T14:44:55.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.800+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.3 2024-03-09T14:44:55.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.800+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.4 2024-03-09T14:44:55.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.800+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.5 2024-03-09T14:44:55.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.800+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.6 2024-03-09T14:44:55.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.800+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.7 2024-03-09T14:44:55.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.804+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.8 2024-03-09T14:44:55.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.804+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.9 2024-03-09T14:44:55.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.804+0000 7fd5944b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23.10 2024-03-09T14:44:55.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.812+0000 7fd5944b6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 : hit (requested=0x17, cached=0x17) 2024-03-09T14:44:55.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.812+0000 7fd5944b6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 2024-03-09T14:44:55.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.812+0000 7fd5944b6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 info.flags=0x17 2024-03-09T14:44:55.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.812+0000 7fd5944b6980 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 to cache LRU end 2024-03-09T14:44:55.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.812+0000 7fd5944b6980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:55.809 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.812+0000 7fd5944b6980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23, ofs0, ns] 2024-03-09T14:44:55.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.816+0000 7fd4757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464319 cookie 94797049245808 notifier 6471 bl.length()=959 2024-03-09T14:44:55.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.816+0000 7fd4757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 info.flags=0x17 2024-03-09T14:44:55.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.816+0000 7fd4757fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 to cache LRU end 2024-03-09T14:44:55.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.816+0000 7fd4757fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:55.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.816+0000 7fd5944b6980 20 handle_bi_update(): bucket=:error-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23]): orig_sources= new_sources= 2024-03-09T14:44:55.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.816+0000 7fd5944b6980 20 handle_bi_update(): bucket=:error-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23]): potential sources added=[] removed=[] 2024-03-09T14:44:55.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.816+0000 7fd5944b6980 20 handle_bi_update(): bucket=:error-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23]): orig_dests= new_dests= 2024-03-09T14:44:55.811 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.816+0000 7fd5944b6980 20 handle_bi_update(): bucket=:error-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23]): potential dests added=[] removed=[] 2024-03-09T14:44:55.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.820+0000 7fd5944b6980 1 execute INFO: reshard of bucket "error-at-block-writes" completed successfully 2024-03-09T14:44:55.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.824+0000 7fd4437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:55.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.828+0000 7fd5944b6980 20 remove_watcher() i=0 2024-03-09T14:44:55.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.828+0000 7fd5944b6980 2 removed watcher, disabling cache 2024-03-09T14:44:55.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.832+0000 7fd5944b6980 20 remove_watcher() i=1 2024-03-09T14:44:55.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.832+0000 7fd5944b6980 20 remove_watcher() i=2 2024-03-09T14:44:55.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.836+0000 7fd5944b6980 20 remove_watcher() i=3 2024-03-09T14:44:55.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.836+0000 7fd5944b6980 20 remove_watcher() i=4 2024-03-09T14:44:55.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.836+0000 7fd5944b6980 20 remove_watcher() i=5 2024-03-09T14:44:55.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.840+0000 7fd5944b6980 20 remove_watcher() i=6 2024-03-09T14:44:55.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.840+0000 7fd5944b6980 20 remove_watcher() i=7 2024-03-09T14:44:55.853 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-03-09T14:44:55.883 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:55.883 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:55.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.932+0000 7f6cd6d85980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.932+0000 7f6cd6d85980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.932+0000 7f6cd6d85980 20 realm 2024-03-09T14:44:55.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.932+0000 7f6cd6d85980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.936+0000 7f6cd6d85980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.936+0000 7f6cd6d85980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:55.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.936+0000 7f6cd6d85980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.936+0000 7f6cd6d85980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.931 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.936+0000 7f6cd6d85980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.936+0000 7f6cd6d85980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:55.932 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.936+0000 7f6cd6d85980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.936+0000 7f6cd6d85980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:55.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.936+0000 7f6cd6d85980 20 searching for the correct realm 2024-03-09T14:44:55.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.944+0000 7f6cd489d640 0 -- 172.21.15.99:0/1361047504 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x563b482eded0 msgr2=0x563b482f0390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:55.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.948+0000 7f6cd409c640 0 -- 172.21.15.99:0/1361047504 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f6ccc065350 msgr2=0x7f6ccc08d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:55.953 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.956+0000 7f6cd6d85980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:55.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.956+0000 7f6cd6d85980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:55.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.956+0000 7f6cd6d85980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:55.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.956+0000 7f6cd6d85980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:55.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.956+0000 7f6cd6d85980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:55.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.956+0000 7f6cd6d85980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:55.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.956+0000 7f6cd6d85980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.956+0000 7f6cd6d85980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.954 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.956+0000 7f6cd6d85980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.960+0000 7f6cd6d85980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:55.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.960+0000 7f6cd6d85980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.960+0000 7f6cd6d85980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:55.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.960+0000 7f6cd6d85980 20 zone default found 2024-03-09T14:44:55.955 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.960+0000 7f6cd6d85980 4 Realm: () 2024-03-09T14:44:55.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.960+0000 7f6cd6d85980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:55.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.960+0000 7f6cd6d85980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:55.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.960+0000 7f6cd6d85980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:55.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.960+0000 7f6cd6d85980 20 zonegroup default 2024-03-09T14:44:55.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.960+0000 7f6cd6d85980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.960+0000 7f6cd6d85980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.956 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.960+0000 7f6cd6d85980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.960+0000 7f6cd6d85980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.960+0000 7f6cd6d85980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.960+0000 7f6cd6d85980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.960+0000 7f6cd6d85980 20 started sync module instance, tier type = 2024-03-09T14:44:55.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.960+0000 7f6cd6d85980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:55.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.980+0000 7f6cd6d85980 20 add_watcher() i=0 2024-03-09T14:44:55.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.980+0000 7f6cd6d85980 20 add_watcher() i=1 2024-03-09T14:44:55.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.980+0000 7f6cd6d85980 20 add_watcher() i=2 2024-03-09T14:44:55.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.980+0000 7f6cd6d85980 20 add_watcher() i=3 2024-03-09T14:44:55.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.980+0000 7f6cd6d85980 20 add_watcher() i=4 2024-03-09T14:44:55.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.980+0000 7f6cd6d85980 20 add_watcher() i=5 2024-03-09T14:44:55.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.980+0000 7f6cd6d85980 20 add_watcher() i=6 2024-03-09T14:44:55.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.980+0000 7f6cd6d85980 20 add_watcher() i=7 2024-03-09T14:44:55.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.980+0000 7f6cd6d85980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:55.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.980+0000 7f6b8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:55.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.984+0000 7f6cd6d85980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:55.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.984+0000 7f6cd6d85980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:55.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.984+0000 7f6cd6d85980 5 note: GC not initialized 2024-03-09T14:44:55.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.984+0000 7f6b89fe3640 20 reqs_thread_entry: start 2024-03-09T14:44:55.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.984+0000 7f6cd6d85980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:55.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.984+0000 7f6cd6d85980 20 Filter name: none 2024-03-09T14:44:55.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.984+0000 7f6afb7fe640 20 reqs_thread_entry: start 2024-03-09T14:44:55.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.984+0000 7f6cd6d85980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.984+0000 7f6cd6d85980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:44:55.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.984+0000 7f6cd6d85980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.984+0000 7f6cd6d85980 20 rados_obj.operate() r=0 bl.length=427 2024-03-09T14:44:55.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.984+0000 7f6cd6d85980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:55.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.984+0000 7f6cd6d85980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.984+0000 7f6cd6d85980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:44:55.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.984+0000 7f6cd6d85980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.984+0000 7f6cd6d85980 20 rados_obj.operate() r=0 bl.length=427 2024-03-09T14:44:55.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.984+0000 7f6cd6d85980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:55.983 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.988+0000 7f6cd6d85980 20 rados->read ofs=0 len=0 2024-03-09T14:44:55.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.988+0000 7f6cd6d85980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:55.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.988+0000 7f6b8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:55.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.996+0000 7f6cd6d85980 20 remove_watcher() i=0 2024-03-09T14:44:55.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.996+0000 7f6cd6d85980 2 removed watcher, disabling cache 2024-03-09T14:44:55.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:55.996+0000 7f6cd6d85980 20 remove_watcher() i=1 2024-03-09T14:44:55.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.000+0000 7f6cd6d85980 20 remove_watcher() i=2 2024-03-09T14:44:55.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.000+0000 7f6cd6d85980 20 remove_watcher() i=3 2024-03-09T14:44:55.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.004+0000 7f6cd6d85980 20 remove_watcher() i=4 2024-03-09T14:44:55.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.004+0000 7f6cd6d85980 20 remove_watcher() i=5 2024-03-09T14:44:56.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.004+0000 7f6cd6d85980 20 remove_watcher() i=6 2024-03-09T14:44:56.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.008+0000 7f6cd6d85980 20 remove_watcher() i=7 2024-03-09T14:44:56.015 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:56.015 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:44:56.015 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-block-writes id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-09T14:44:56.015 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:56.016 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.016 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.019 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.020 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.108 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.108 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.184 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with abort at block_writes 2024-03-09T14:44:56.184 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:56.187 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.187 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.219 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.219 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.265 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.266 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.288 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.288 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.313 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.313 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.333 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.333 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.353 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.353 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.374 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.375 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.397 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.397 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.422 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.422 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.440 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.440 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.461 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.461 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.482 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.482 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.503 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.504 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.524 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.525 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.545 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.545 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.567 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.567 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.587 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.588 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.608 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.608 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.630 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.631 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.651 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.651 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.672 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:56.672 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:56.690 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-03-09T14:44:56.722 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:56.723 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:56.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.772+0000 7f64157c3980 20 rados->read ofs=0 len=0 2024-03-09T14:44:56.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.776+0000 7f64157c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:56.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.776+0000 7f64157c3980 20 realm 2024-03-09T14:44:56.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.776+0000 7f64157c3980 20 rados->read ofs=0 len=0 2024-03-09T14:44:56.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.776+0000 7f64157c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:56.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.776+0000 7f64157c3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:56.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.776+0000 7f64157c3980 20 rados->read ofs=0 len=0 2024-03-09T14:44:56.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.776+0000 7f64157c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:56.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.776+0000 7f64157c3980 20 rados->read ofs=0 len=0 2024-03-09T14:44:56.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.776+0000 7f64157c3980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:56.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.776+0000 7f64157c3980 20 rados->read ofs=0 len=0 2024-03-09T14:44:56.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.776+0000 7f64157c3980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:56.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.776+0000 7f64157c3980 20 searching for the correct realm 2024-03-09T14:44:56.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.780+0000 7f6413adc640 0 -- 172.21.15.99:0/1966762078 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f640806e700 msgr2=0x7f640806f920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:56.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:56.788+0000 7f6412ada640 0 -- 172.21.15.99:0/1966762078 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f640c05eaa0 msgr2=0x7f640c076130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:57.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.004+0000 7f64157c3980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:57.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.004+0000 7f64157c3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:57.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.004+0000 7f64157c3980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:57.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.004+0000 7f64157c3980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:57.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.004+0000 7f64157c3980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:57.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.004+0000 7f64157c3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:57.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.004+0000 7f64157c3980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.004+0000 7f64157c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.004+0000 7f64157c3980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.008+0000 7f64157c3980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:57.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.008+0000 7f64157c3980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.008+0000 7f64157c3980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:57.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.008+0000 7f64157c3980 20 zone default found 2024-03-09T14:44:57.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.008+0000 7f64157c3980 4 Realm: () 2024-03-09T14:44:57.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.008+0000 7f64157c3980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:57.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.008+0000 7f64157c3980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:57.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.008+0000 7f64157c3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:57.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.008+0000 7f64157c3980 20 zonegroup default 2024-03-09T14:44:57.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.008+0000 7f64157c3980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.008+0000 7f64157c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.008+0000 7f64157c3980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.008+0000 7f64157c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.008+0000 7f64157c3980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.008+0000 7f64157c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.008+0000 7f64157c3980 20 started sync module instance, tier type = 2024-03-09T14:44:57.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.012+0000 7f64157c3980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:57.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.036+0000 7f64157c3980 20 add_watcher() i=0 2024-03-09T14:44:57.030 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.036+0000 7f64157c3980 20 add_watcher() i=1 2024-03-09T14:44:57.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.036+0000 7f64157c3980 20 add_watcher() i=2 2024-03-09T14:44:57.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.036+0000 7f64157c3980 20 add_watcher() i=3 2024-03-09T14:44:57.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.036+0000 7f64157c3980 20 add_watcher() i=4 2024-03-09T14:44:57.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.036+0000 7f64157c3980 20 add_watcher() i=5 2024-03-09T14:44:57.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.036+0000 7f64157c3980 20 add_watcher() i=6 2024-03-09T14:44:57.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.036+0000 7f64157c3980 20 add_watcher() i=7 2024-03-09T14:44:57.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.036+0000 7f64157c3980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:57.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.040+0000 7f62c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:57.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.040+0000 7f64157c3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:57.037 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.040+0000 7f64157c3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:57.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.040+0000 7f64157c3980 5 note: GC not initialized 2024-03-09T14:44:57.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.044+0000 7f62c8fe1640 20 reqs_thread_entry: start 2024-03-09T14:44:57.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.044+0000 7f64157c3980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:57.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.044+0000 7f64157c3980 20 Filter name: none 2024-03-09T14:44:57.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.044+0000 7f62427fc640 20 reqs_thread_entry: start 2024-03-09T14:44:57.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.044+0000 7f64157c3980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.044+0000 7f64157c3980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:44:57.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.044+0000 7f64157c3980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.044+0000 7f64157c3980 20 rados_obj.operate() r=0 bl.length=427 2024-03-09T14:44:57.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.044+0000 7f64157c3980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:57.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.044+0000 7f64157c3980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.044+0000 7f64157c3980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:44:57.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.044+0000 7f64157c3980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.048+0000 7f64157c3980 20 rados_obj.operate() r=0 bl.length=427 2024-03-09T14:44:57.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.048+0000 7f64157c3980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:57.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.048+0000 7f64157c3980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.044 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.048+0000 7f64157c3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.052+0000 7f62c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:57.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.056+0000 7f64157c3980 20 remove_watcher() i=0 2024-03-09T14:44:57.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.056+0000 7f64157c3980 2 removed watcher, disabling cache 2024-03-09T14:44:57.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.056+0000 7f64157c3980 20 remove_watcher() i=1 2024-03-09T14:44:57.056 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.060+0000 7f64157c3980 20 remove_watcher() i=2 2024-03-09T14:44:57.059 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.064+0000 7f64157c3980 20 remove_watcher() i=3 2024-03-09T14:44:57.061 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.064+0000 7f64157c3980 20 remove_watcher() i=4 2024-03-09T14:44:57.062 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.068+0000 7f64157c3980 20 remove_watcher() i=5 2024-03-09T14:44:57.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.068+0000 7f64157c3980 20 remove_watcher() i=6 2024-03-09T14:44:57.065 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.068+0000 7f64157c3980 20 remove_watcher() i=7 2024-03-09T14:44:57.081 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.081 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:44:57.082 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-block-writes id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:44:57.082 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.082 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-03-09T14:44:57.113 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:57.114 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:57.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.160+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.164+0000 7f7a69184980 20 realm 2024-03-09T14:44:57.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.164+0000 7f7a69184980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:57.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:57.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.168+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:57.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.168+0000 7f7a69184980 20 searching for the correct realm 2024-03-09T14:44:57.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.172+0000 7f7a6749d640 0 -- 172.21.15.99:0/824474536 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f7a5c0f6400 msgr2=0x7f7a5c0f6820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:57.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.180+0000 7f7a6649b640 0 -- 172.21.15.99:0/824474536 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f7a60018070 msgr2=0x7f7a60088150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:57.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:57.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:57.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:57.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:57.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:57.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:57.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.396+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.396+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.396+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:57.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:57.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.400+0000 7f7a69184980 20 zone default found 2024-03-09T14:44:57.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.400+0000 7f7a69184980 4 Realm: () 2024-03-09T14:44:57.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.400+0000 7f7a69184980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:57.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.400+0000 7f7a69184980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:57.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.400+0000 7f7a69184980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:57.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.400+0000 7f7a69184980 20 zonegroup default 2024-03-09T14:44:57.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.400+0000 7f7a69184980 20 started sync module instance, tier type = 2024-03-09T14:44:57.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.400+0000 7f7a69184980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:57.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=0 2024-03-09T14:44:57.422 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=1 2024-03-09T14:44:57.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=2 2024-03-09T14:44:57.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=3 2024-03-09T14:44:57.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=4 2024-03-09T14:44:57.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=5 2024-03-09T14:44:57.423 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=6 2024-03-09T14:44:57.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=7 2024-03-09T14:44:57.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.428+0000 7f7a69184980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:57.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.432+0000 7f791dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:57.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:57.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:57.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 5 note: GC not initialized 2024-03-09T14:44:57.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f791cfe1640 20 reqs_thread_entry: start 2024-03-09T14:44:57.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:57.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 20 Filter name: none 2024-03-09T14:44:57.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7915ffb640 20 reqs_thread_entry: start 2024-03-09T14:44:57.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-09T14:44:57.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:44:57.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-09T14:44:57.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-09T14:44:57.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 : miss 2024-03-09T14:44:57.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=427 2024-03-09T14:44:57.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 info.flags=0x17 2024-03-09T14:44:57.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 to cache LRU end 2024-03-09T14:44:57.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:57.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:57.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.436+0000 7f7a69184980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 2024-03-09T14:44:57.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.452+0000 7f7a69184980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 info.flags=0x17 2024-03-09T14:44:57.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.452+0000 7f7a69184980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 to cache LRU end 2024-03-09T14:44:57.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.452+0000 7f7a69184980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:57.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.452+0000 7f7a69184980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24, ofs0, ns] 2024-03-09T14:44:57.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.456+0000 7f7949ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464345 cookie 94433362940912 notifier 6522 bl.length()=991 2024-03-09T14:44:57.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.456+0000 7f7949ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 info.flags=0x17 2024-03-09T14:44:57.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.456+0000 7f7949ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 to cache LRU end 2024-03-09T14:44:57.451 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.456+0000 7f7949ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:57.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.456+0000 7f7a69184980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): orig_sources= new_sources= 2024-03-09T14:44:57.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.456+0000 7f7a69184980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): potential sources added=[] removed=[] 2024-03-09T14:44:57.452 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7a69184980 time 2024-03-09T14:44:57.461475+0000 2024-03-09T14:44:57.452 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:44:57.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.456+0000 7f7a69184980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): orig_dests= new_dests= 2024-03-09T14:44:57.452 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.456+0000 7f7a69184980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): potential dests added=[] removed=[] 2024-03-09T14:44:57.453 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:44:57.453 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7a6ca59d7b] 2024-03-09T14:44:57.453 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f7a6ca59f2f] 2024-03-09T14:44:57.453 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2f96b0c51] 2024-03-09T14:44:57.453 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a5) [0x55e2f96d1285] 2024-03-09T14:44:57.453 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-03-09T14:44:57.454 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a6b8c4d90] 2024-03-09T14:44:57.454 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-03-09T14:44:57.454 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-03-09T14:44:57.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.456+0000 7f7a69184980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7a69184980 time 2024-03-09T14:44:57.461475+0000 2024-03-09T14:44:57.454 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:44:57.454 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.454 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:44:57.454 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7a6ca59d7b] 2024-03-09T14:44:57.454 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f7a6ca59f2f] 2024-03-09T14:44:57.454 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2f96b0c51] 2024-03-09T14:44:57.454 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a5) [0x55e2f96d1285] 2024-03-09T14:44:57.454 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-03-09T14:44:57.454 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a6b8c4d90] 2024-03-09T14:44:57.454 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-03-09T14:44:57.454 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-03-09T14:44:57.455 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.455 INFO:tasks.workunit.client.0.smithi099.stderr:*** Caught signal (Aborted) ** 2024-03-09T14:44:57.455 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f7a69184980 thread_name:radosgw-admin 2024-03-09T14:44:57.468 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:44:57.468 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7a6b8dd520] 2024-03-09T14:44:57.469 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-03-09T14:44:57.469 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-03-09T14:44:57.469 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-03-09T14:44:57.469 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7a6ca59dd5] 2024-03-09T14:44:57.469 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f7a6ca59f2f] 2024-03-09T14:44:57.469 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2f96b0c51] 2024-03-09T14:44:57.469 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a5) [0x55e2f96d1285] 2024-03-09T14:44:57.469 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-03-09T14:44:57.469 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a6b8c4d90] 2024-03-09T14:44:57.469 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-03-09T14:44:57.469 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-03-09T14:44:57.469 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.460+0000 7f7a69184980 -1 *** Caught signal (Aborted) ** 2024-03-09T14:44:57.469 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f7a69184980 thread_name:radosgw-admin 2024-03-09T14:44:57.469 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.470 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:44:57.470 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7a6b8dd520] 2024-03-09T14:44:57.470 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-03-09T14:44:57.470 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-03-09T14:44:57.470 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-03-09T14:44:57.470 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7a6ca59dd5] 2024-03-09T14:44:57.470 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f7a6ca59f2f] 2024-03-09T14:44:57.470 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2f96b0c51] 2024-03-09T14:44:57.470 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a5) [0x55e2f96d1285] 2024-03-09T14:44:57.470 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-03-09T14:44:57.470 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a6b8c4d90] 2024-03-09T14:44:57.470 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-03-09T14:44:57.470 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-03-09T14:44:57.470 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:44:57.471 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.471 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-03-09T14:44:57.471 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-03-09T14:44:57.140+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.471 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-03-09T14:44:57.140+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.471 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-03-09T14:44:57.140+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.471 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-03-09T14:44:57.140+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.471 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-03-09T14:44:57.140+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.471 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-03-09T14:44:57.140+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.471 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-03-09T14:44:57.140+0000 7f7a6649b640 10 monclient(hunting): handle_auth_done global_id 6510 payload 274 2024-03-09T14:44:57.471 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-03-09T14:44:57.140+0000 7f7a6649b640 10 monclient: _finish_hunting 0 2024-03-09T14:44:57.471 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-03-09T14:44:57.140+0000 7f7a6649b640 1 monclient: found mon.noname-a 2024-03-09T14:44:57.471 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-03-09T14:44:57.140+0000 7f7a6649b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:44:57.471 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.471 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:44:57.472 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: dump: 2024-03-09T14:44:57.472 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.472 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.472 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.472 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.472 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.472 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.472 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.472 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.472 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.472 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.472 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: _finish_auth 0 2024-03-09T14:44:57.472 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: _check_auth_tickets 2024-03-09T14:44:57.472 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:57.472 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.473 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:44:57.473 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: dump: 2024-03-09T14:44:57.473 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.473 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.473 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.473 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.473 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.473 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.473 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.473 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.473 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.473 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.473 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 monclient: authenticate success, global_id 6510 2024-03-09T14:44:57.473 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-03-09T14:44:57.140+0000 7f7a69184980 10 monclient: get_monmap_and_config success 2024-03-09T14:44:57.473 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-03-09T14:44:57.140+0000 7f7a69184980 4 set_mon_vals no callback set 2024-03-09T14:44:57.474 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-03-09T14:44:57.140+0000 7f7a69184980 10 monclient: shutdown 2024-03-09T14:44:57.474 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) unregister_commands rotate-key 2024-03-09T14:44:57.474 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-03-09T14:44:57.140+0000 7f7a69184980 10 monclient: build_initial_monmap 2024-03-09T14:44:57.474 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-03-09T14:44:57.140+0000 7f7a69184980 1 build_initial for_mkfs: 0 2024-03-09T14:44:57.474 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-03-09T14:44:57.140+0000 7f7a69184980 10 monclient: monmap: 2024-03-09T14:44:57.474 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:44:57.474 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:44:57.474 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:44:57.474 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:44:57.474 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:44:57.474 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.474 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:44:57.474 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:44:57.474 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:44:57.475 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.475 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding auth protocol: cephx 2024-03-09T14:44:57.475 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding auth protocol: cephx 2024-03-09T14:44:57.475 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding auth protocol: cephx 2024-03-09T14:44:57.475 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: secure 2024-03-09T14:44:57.475 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: crc 2024-03-09T14:44:57.475 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: secure 2024-03-09T14:44:57.475 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: crc 2024-03-09T14:44:57.475 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: secure 2024-03-09T14:44:57.475 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: crc 2024-03-09T14:44:57.475 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: crc 2024-03-09T14:44:57.475 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: secure 2024-03-09T14:44:57.475 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: crc 2024-03-09T14:44:57.475 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: secure 2024-03-09T14:44:57.475 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: crc 2024-03-09T14:44:57.476 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: secure 2024-03-09T14:44:57.476 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-03-09T14:44:57.140+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.476 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-03-09T14:44:57.140+0000 7f7a69184980 1 librados: starting msgr at 2024-03-09T14:44:57.476 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-03-09T14:44:57.140+0000 7f7a69184980 1 librados: starting objecter 2024-03-09T14:44:57.476 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command objecter_requests hook 0x55e2fae69ce0 2024-03-09T14:44:57.476 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-03-09T14:44:57.140+0000 7f7a69184980 1 librados: setting wanted keys 2024-03-09T14:44:57.476 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-03-09T14:44:57.140+0000 7f7a69184980 1 librados: calling monclient init 2024-03-09T14:44:57.476 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-03-09T14:44:57.140+0000 7f7a69184980 10 monclient: init 2024-03-09T14:44:57.476 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding auth protocol: cephx 2024-03-09T14:44:57.476 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding auth protocol: cephx 2024-03-09T14:44:57.476 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding auth protocol: cephx 2024-03-09T14:44:57.476 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: secure 2024-03-09T14:44:57.476 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: crc 2024-03-09T14:44:57.476 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: secure 2024-03-09T14:44:57.477 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: crc 2024-03-09T14:44:57.477 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: secure 2024-03-09T14:44:57.477 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: crc 2024-03-09T14:44:57.477 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: crc 2024-03-09T14:44:57.477 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: secure 2024-03-09T14:44:57.477 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: crc 2024-03-09T14:44:57.477 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: secure 2024-03-09T14:44:57.477 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: crc 2024-03-09T14:44:57.477 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: secure 2024-03-09T14:44:57.477 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-03-09T14:44:57.140+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.477 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-03-09T14:44:57.144+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.477 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-03-09T14:44:57.144+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command rotate-key hook 0x55e2fafddcc8 2024-03-09T14:44:57.477 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient: _reopen_session rank -1 2024-03-09T14:44:57.477 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient: _add_conns ranks=[0,2,1] 2024-03-09T14:44:57.477 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-a con 0x55e2fae6bbc0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:44:57.478 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-c con 0x55e2faf245f0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:44:57.478 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-b con 0x55e2fafe4390 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:44:57.478 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.478 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.478 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.478 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:57.478 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient(hunting): authenticate will time out at 1950.944233s 2024-03-09T14:44:57.478 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-03-09T14:44:57.144+0000 7f7a6649b640 10 monclient(hunting): get_auth_request con 0x55e2faf245f0 auth_method 0 2024-03-09T14:44:57.478 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-03-09T14:44:57.144+0000 7f7a6649b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:57.478 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-03-09T14:44:57.144+0000 7f7a6649b640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:57.478 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-03-09T14:44:57.144+0000 7f7a6649b640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:57.478 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient(hunting): get_auth_request con 0x55e2fae6bbc0 auth_method 0 2024-03-09T14:44:57.478 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:57.478 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:57.479 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:57.479 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.479 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.479 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.479 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-03-09T14:44:57.144+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.479 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-03-09T14:44:57.144+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.479 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-03-09T14:44:57.144+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.479 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_done global_id 6513 payload 824 2024-03-09T14:44:57.479 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient: _finish_hunting 0 2024-03-09T14:44:57.479 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 1 monclient: found mon.noname-a 2024-03-09T14:44:57.479 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:44:57.479 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.479 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:44:57.479 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: dump: 2024-03-09T14:44:57.479 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.480 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.480 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.480 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.480 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.480 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.480 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.480 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.480 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.480 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.480 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: _finish_auth 0 2024-03-09T14:44:57.480 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: _check_auth_tickets 2024-03-09T14:44:57.480 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:57.480 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.480 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:44:57.480 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: dump: 2024-03-09T14:44:57.481 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.481 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.481 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.481 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.481 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.481 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.481 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.481 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.481 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.481 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.481 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-03-09T14:44:57.144+0000 7f7a69184980 5 monclient: authenticate success, global_id 6513 2024-03-09T14:44:57.481 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient: _renew_subs 2024-03-09T14:44:57.481 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-03-09T14:44:57.144+0000 7f7954e09640 4 set_mon_vals no callback set 2024-03-09T14:44:57.481 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:44:57.482 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient: _renew_subs 2024-03-09T14:44:57.482 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:44:57.482 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-03-09T14:44:57.144+0000 7f7a69184980 1 librados: init done 2024-03-09T14:44:57.482 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-03-09T14:44:57.144+0000 7f7953606640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:44:57.482 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-03-09T14:44:57.144+0000 7f7953606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:57.482 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-03-09T14:44:57.144+0000 7f7953606640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:57.482 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-03-09T14:44:57.144+0000 7f7a6649b640 10 monclient: get_auth_request con 0x7f794c066040 auth_method 0 2024-03-09T14:44:57.482 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-03-09T14:44:57.144+0000 7f7a6749d640 10 monclient: get_auth_request con 0x55e2fb00ae30 auth_method 0 2024-03-09T14:44:57.482 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-03-09T14:44:57.148+0000 7f7a66c9c640 10 monclient: get_auth_request con 0x55e2fb028630 auth_method 0 2024-03-09T14:44:57.482 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-03-09T14:44:57.148+0000 7f7a6649b640 10 monclient: get_auth_request con 0x55e2fb02ca60 auth_method 0 2024-03-09T14:44:57.482 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient: get_auth_request con 0x55e2fb02beb0 auth_method 0 2024-03-09T14:44:57.482 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: build_initial_monmap 2024-03-09T14:44:57.482 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-03-09T14:44:57.152+0000 7f7a69184980 1 build_initial for_mkfs: 0 2024-03-09T14:44:57.483 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: monmap: 2024-03-09T14:44:57.483 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:44:57.483 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:44:57.483 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:44:57.483 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:44:57.483 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:44:57.483 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.483 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:44:57.483 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:44:57.483 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:44:57.483 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.483 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding auth protocol: cephx 2024-03-09T14:44:57.483 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding auth protocol: cephx 2024-03-09T14:44:57.483 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding auth protocol: cephx 2024-03-09T14:44:57.483 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: secure 2024-03-09T14:44:57.484 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: crc 2024-03-09T14:44:57.484 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: secure 2024-03-09T14:44:57.484 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: crc 2024-03-09T14:44:57.484 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: secure 2024-03-09T14:44:57.484 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: crc 2024-03-09T14:44:57.484 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: crc 2024-03-09T14:44:57.484 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: secure 2024-03-09T14:44:57.484 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: crc 2024-03-09T14:44:57.484 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: secure 2024-03-09T14:44:57.484 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: crc 2024-03-09T14:44:57.484 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: secure 2024-03-09T14:44:57.484 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-03-09T14:44:57.152+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.484 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command objecter_requests cmddesc objecter_requests hook 0x55e2fb03a2b0 EEXIST 2024-03-09T14:44:57.484 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: init 2024-03-09T14:44:57.484 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding auth protocol: cephx 2024-03-09T14:44:57.485 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding auth protocol: cephx 2024-03-09T14:44:57.485 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding auth protocol: cephx 2024-03-09T14:44:57.485 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: secure 2024-03-09T14:44:57.485 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: crc 2024-03-09T14:44:57.485 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: secure 2024-03-09T14:44:57.485 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: crc 2024-03-09T14:44:57.485 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: secure 2024-03-09T14:44:57.485 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: crc 2024-03-09T14:44:57.485 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: crc 2024-03-09T14:44:57.485 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: secure 2024-03-09T14:44:57.485 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: crc 2024-03-09T14:44:57.485 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: secure 2024-03-09T14:44:57.485 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: crc 2024-03-09T14:44:57.485 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: secure 2024-03-09T14:44:57.486 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-03-09T14:44:57.152+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.486 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-03-09T14:44:57.152+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.486 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command rotate-key cmddesc rotate-key hook 0x55e2fb033c10 EEXIST 2024-03-09T14:44:57.486 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: _reopen_session rank -1 2024-03-09T14:44:57.486 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:44:57.486 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-b con 0x55e2fb05ef10 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:44:57.486 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-c con 0x55e2fb05f2f0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:44:57.486 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-a con 0x55e2fb05a4b0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:44:57.486 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.486 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.486 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.486 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:57.486 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient(hunting): authenticate will time out at 1950.954682s 2024-03-09T14:44:57.486 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient(hunting): get_auth_request con 0x55e2fb05f2f0 auth_method 0 2024-03-09T14:44:57.486 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:57.487 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:57.487 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:57.487 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-03-09T14:44:57.152+0000 7f7a66c9c640 10 monclient(hunting): get_auth_request con 0x55e2fb05a4b0 auth_method 0 2024-03-09T14:44:57.487 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-03-09T14:44:57.152+0000 7f7a66c9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:57.487 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-03-09T14:44:57.152+0000 7f7a66c9c640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:57.487 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-03-09T14:44:57.152+0000 7f7a66c9c640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:57.487 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.487 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.487 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.487 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-03-09T14:44:57.152+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.487 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-03-09T14:44:57.152+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.487 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-03-09T14:44:57.152+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.487 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient(hunting): handle_auth_done global_id 6239 payload 824 2024-03-09T14:44:57.487 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient: _finish_hunting 0 2024-03-09T14:44:57.488 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-03-09T14:44:57.152+0000 7f7a6749d640 1 monclient: found mon.noname-c 2024-03-09T14:44:57.488 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:44:57.488 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.488 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:44:57.488 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: dump: 2024-03-09T14:44:57.488 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.488 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.488 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.488 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.488 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.488 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.488 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.488 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.488 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.488 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.489 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: _finish_auth 0 2024-03-09T14:44:57.489 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: _check_auth_tickets 2024-03-09T14:44:57.489 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 monclient: authenticate success, global_id 6239 2024-03-09T14:44:57.489 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: _renew_subs 2024-03-09T14:44:57.489 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:44:57.489 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:57.489 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.489 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:44:57.489 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: dump: 2024-03-09T14:44:57.489 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.489 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.489 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.490 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.490 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.490 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.490 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.490 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.490 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.490 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.490 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-03-09T14:44:57.152+0000 7f7a67c9e640 4 set_mon_vals no callback set 2024-03-09T14:44:57.490 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: _renew_subs 2024-03-09T14:44:57.490 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:44:57.490 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-03-09T14:44:57.156+0000 7f7950e01640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:44:57.490 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-03-09T14:44:57.156+0000 7f7950e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:57.490 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-03-09T14:44:57.156+0000 7f7950e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:57.491 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-03-09T14:44:57.156+0000 7f7a6649b640 10 monclient: get_auth_request con 0x7f7940065f80 auth_method 0 2024-03-09T14:44:57.491 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient: get_monmap_and_config 2024-03-09T14:44:57.491 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient: build_initial_monmap 2024-03-09T14:44:57.491 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-03-09T14:44:57.156+0000 7f7a69184980 1 build_initial for_mkfs: 0 2024-03-09T14:44:57.491 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient: monmap: 2024-03-09T14:44:57.491 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:44:57.491 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:44:57.491 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:44:57.491 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:44:57.491 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:44:57.491 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.491 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:44:57.491 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:44:57.491 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:44:57.491 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.492 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding auth protocol: cephx 2024-03-09T14:44:57.492 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding auth protocol: cephx 2024-03-09T14:44:57.492 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding auth protocol: cephx 2024-03-09T14:44:57.492 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.492 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.492 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.492 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.492 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.492 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.492 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.492 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.492 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.492 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.492 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.492 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.493 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-03-09T14:44:57.156+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.493 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient: init 2024-03-09T14:44:57.493 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding auth protocol: cephx 2024-03-09T14:44:57.493 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding auth protocol: cephx 2024-03-09T14:44:57.493 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding auth protocol: cephx 2024-03-09T14:44:57.493 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: secure 2024-03-09T14:44:57.493 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: crc 2024-03-09T14:44:57.493 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: secure 2024-03-09T14:44:57.493 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: crc 2024-03-09T14:44:57.493 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: secure 2024-03-09T14:44:57.493 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: crc 2024-03-09T14:44:57.493 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: crc 2024-03-09T14:44:57.493 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: secure 2024-03-09T14:44:57.493 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: crc 2024-03-09T14:44:57.493 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: secure 2024-03-09T14:44:57.494 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: crc 2024-03-09T14:44:57.494 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: secure 2024-03-09T14:44:57.494 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-03-09T14:44:57.156+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.494 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-03-09T14:44:57.156+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.494 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command rotate-key cmddesc rotate-key hook 0x7fffba34d1c8 EEXIST 2024-03-09T14:44:57.494 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient: _reopen_session rank -1 2024-03-09T14:44:57.494 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient: _add_conns ranks=[0,2,1] 2024-03-09T14:44:57.494 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-a con 0x55e2fb0b1420 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:44:57.494 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-c con 0x55e2fb0ab4b0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:44:57.494 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-b con 0x55e2fb0ad050 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:44:57.494 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.494 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.494 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.495 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:57.495 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient(hunting): authenticate will time out at 1950.958660s 2024-03-09T14:44:57.495 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient(hunting): get_auth_request con 0x55e2fb0ab4b0 auth_method 0 2024-03-09T14:44:57.495 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:57.495 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:57.495 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:57.495 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-03-09T14:44:57.156+0000 7f7a6649b640 10 monclient(hunting): get_auth_request con 0x55e2fb0b1420 auth_method 0 2024-03-09T14:44:57.495 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-03-09T14:44:57.156+0000 7f7a6649b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:57.495 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-03-09T14:44:57.156+0000 7f7a6649b640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:57.495 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-03-09T14:44:57.156+0000 7f7a6649b640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:57.495 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.495 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.495 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.495 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-03-09T14:44:57.156+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.495 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-03-09T14:44:57.156+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.496 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-03-09T14:44:57.156+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.496 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient(hunting): handle_auth_done global_id 6242 payload 274 2024-03-09T14:44:57.496 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient: _finish_hunting 0 2024-03-09T14:44:57.496 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-03-09T14:44:57.156+0000 7f7a6749d640 1 monclient: found mon.noname-c 2024-03-09T14:44:57.496 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:44:57.496 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.496 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:44:57.496 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: dump: 2024-03-09T14:44:57.496 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.496 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.496 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.496 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.496 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.496 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.496 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.497 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.497 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.497 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.497 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: _finish_auth 0 2024-03-09T14:44:57.497 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: _check_auth_tickets 2024-03-09T14:44:57.497 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:57.497 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 monclient: authenticate success, global_id 6242 2024-03-09T14:44:57.497 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient: get_monmap_and_config success 2024-03-09T14:44:57.497 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-03-09T14:44:57.156+0000 7f7a69184980 4 set_mon_vals no callback set 2024-03-09T14:44:57.497 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.497 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:44:57.497 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: dump: 2024-03-09T14:44:57.497 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.497 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.497 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.498 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.498 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.498 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.498 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.498 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.498 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.498 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.498 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient: shutdown 2024-03-09T14:44:57.498 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: build_initial_monmap 2024-03-09T14:44:57.498 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-03-09T14:44:57.160+0000 7f7a69184980 1 build_initial for_mkfs: 0 2024-03-09T14:44:57.498 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: monmap: 2024-03-09T14:44:57.498 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:44:57.498 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:44:57.498 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:44:57.499 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:44:57.499 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:44:57.499 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.499 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:44:57.499 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:44:57.499 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:44:57.499 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.499 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding auth protocol: cephx 2024-03-09T14:44:57.499 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding auth protocol: cephx 2024-03-09T14:44:57.499 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding auth protocol: cephx 2024-03-09T14:44:57.499 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.499 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.499 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.499 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.499 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.500 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.500 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.500 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.500 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.500 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.500 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.500 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.500 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-03-09T14:44:57.160+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.500 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-03-09T14:44:57.160+0000 7f7a69184980 1 librados: starting msgr at 2024-03-09T14:44:57.500 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-03-09T14:44:57.160+0000 7f7a69184980 1 librados: starting objecter 2024-03-09T14:44:57.500 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command objecter_requests cmddesc objecter_requests hook 0x55e2fb0ac430 EEXIST 2024-03-09T14:44:57.500 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-03-09T14:44:57.160+0000 7f7a69184980 1 librados: setting wanted keys 2024-03-09T14:44:57.500 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-03-09T14:44:57.160+0000 7f7a69184980 1 librados: calling monclient init 2024-03-09T14:44:57.500 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: init 2024-03-09T14:44:57.500 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding auth protocol: cephx 2024-03-09T14:44:57.500 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding auth protocol: cephx 2024-03-09T14:44:57.501 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding auth protocol: cephx 2024-03-09T14:44:57.501 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: secure 2024-03-09T14:44:57.501 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: crc 2024-03-09T14:44:57.501 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: secure 2024-03-09T14:44:57.501 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: crc 2024-03-09T14:44:57.501 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: secure 2024-03-09T14:44:57.501 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: crc 2024-03-09T14:44:57.501 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: crc 2024-03-09T14:44:57.501 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: secure 2024-03-09T14:44:57.501 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: crc 2024-03-09T14:44:57.501 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: secure 2024-03-09T14:44:57.501 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: crc 2024-03-09T14:44:57.501 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: secure 2024-03-09T14:44:57.502 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-03-09T14:44:57.160+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.502 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-03-09T14:44:57.160+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.502 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command rotate-key cmddesc rotate-key hook 0x55e2fb07bd78 EEXIST 2024-03-09T14:44:57.502 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: _reopen_session rank -1 2024-03-09T14:44:57.502 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:44:57.502 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-b con 0x55e2fb0ab4b0 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:44:57.502 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-c con 0x55e2fb0ad050 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:44:57.502 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-a con 0x55e2fb0b1420 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:44:57.502 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.502 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.502 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.502 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:57.502 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient(hunting): authenticate will time out at 1950.961161s 2024-03-09T14:44:57.502 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient(hunting): get_auth_request con 0x55e2fb0b1420 auth_method 0 2024-03-09T14:44:57.503 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:57.503 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:57.503 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:57.503 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-03-09T14:44:57.160+0000 7f7a6749d640 10 monclient(hunting): get_auth_request con 0x55e2fb0ad050 auth_method 0 2024-03-09T14:44:57.503 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-03-09T14:44:57.160+0000 7f7a6749d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:57.503 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-03-09T14:44:57.160+0000 7f7a6749d640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:57.503 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-03-09T14:44:57.160+0000 7f7a6749d640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:57.503 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-03-09T14:44:57.160+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.503 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-03-09T14:44:57.160+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.503 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-03-09T14:44:57.160+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.503 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.503 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.503 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.503 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_done global_id 6522 payload 824 2024-03-09T14:44:57.503 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient: _finish_hunting 0 2024-03-09T14:44:57.504 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 1 monclient: found mon.noname-a 2024-03-09T14:44:57.504 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:44:57.504 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.504 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:44:57.504 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: dump: 2024-03-09T14:44:57.504 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.504 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.504 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.504 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.504 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.504 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.504 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.504 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.504 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.504 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.505 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: _finish_auth 0 2024-03-09T14:44:57.505 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: _check_auth_tickets 2024-03-09T14:44:57.505 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:57.505 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.505 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:44:57.505 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: dump: 2024-03-09T14:44:57.505 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.505 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.505 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.505 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.505 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.505 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.505 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.505 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.505 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.506 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.506 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-03-09T14:44:57.160+0000 7f794a7fc640 4 set_mon_vals no callback set 2024-03-09T14:44:57.506 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 monclient: authenticate success, global_id 6522 2024-03-09T14:44:57.506 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: _renew_subs 2024-03-09T14:44:57.506 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:44:57.506 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: _renew_subs 2024-03-09T14:44:57.506 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:44:57.506 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-03-09T14:44:57.160+0000 7f7a69184980 1 librados: init done 2024-03-09T14:44:57.506 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command cr dump hook 0x55e2fb0a5d58 2024-03-09T14:44:57.506 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-03-09T14:44:57.160+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.506 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-03-09T14:44:57.164+0000 7f7948ff9640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:44:57.506 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-03-09T14:44:57.164+0000 7f7948ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:57.506 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-03-09T14:44:57.164+0000 7f7948ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:57.506 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-03-09T14:44:57.164+0000 7f7a6649b640 10 monclient: get_auth_request con 0x7f7930066040 auth_method 0 2024-03-09T14:44:57.507 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-03-09T14:44:57.164+0000 7f7a6749d640 10 monclient: get_auth_request con 0x55e2fb0cb4d0 auth_method 0 2024-03-09T14:44:57.507 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-03-09T14:44:57.164+0000 7f7948ff9640 1 client.6522.objecter ms_handle_reset 0x55e2fb0cb4d0 session 0x55e2fb0cae50 osd.1 2024-03-09T14:44:57.507 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-03-09T14:44:57.164+0000 7f7948ff9640 10 monclient: _renew_subs 2024-03-09T14:44:57.507 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-03-09T14:44:57.164+0000 7f7948ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:44:57.507 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-03-09T14:44:57.164+0000 7f7a6749d640 10 monclient: get_auth_request con 0x7f7930076660 auth_method 0 2024-03-09T14:44:57.507 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.507 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 realm 2024-03-09T14:44:57.507 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.507 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.507 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-03-09T14:44:57.164+0000 7f7a69184980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:57.507 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.507 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.507 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.507 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-03-09T14:44:57.164+0000 7f7a6649b640 10 monclient: get_auth_request con 0x55e2fb0ccb30 auth_method 0 2024-03-09T14:44:57.507 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:57.508 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.508 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-03-09T14:44:57.168+0000 7f7a6749d640 10 monclient: get_auth_request con 0x55e2fb0d0980 auth_method 0 2024-03-09T14:44:57.508 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-03-09T14:44:57.168+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:57.508 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-03-09T14:44:57.168+0000 7f7a69184980 20 searching for the correct realm 2024-03-09T14:44:57.508 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-03-09T14:44:57.168+0000 7f7a66c9c640 10 monclient: get_auth_request con 0x55e2fb0d5650 auth_method 0 2024-03-09T14:44:57.508 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-03-09T14:44:57.168+0000 7f7a6649b640 10 monclient: get_auth_request con 0x7f7a5801f060 auth_method 0 2024-03-09T14:44:57.508 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-03-09T14:44:57.172+0000 7f7a6749d640 10 monclient: get_auth_request con 0x7f7a5c0f6400 auth_method 0 2024-03-09T14:44:57.508 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-03-09T14:44:57.172+0000 7f7a6749d640 0 -- 172.21.15.99:0/824474536 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f7a5c0f6400 msgr2=0x7f7a5c0f6820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:57.508 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-03-09T14:44:57.172+0000 7f7948ff9640 1 client.6522.objecter ms_handle_reset 0x7f7a5c0f6400 session 0x7f7a5c0ef040 osd.2 2024-03-09T14:44:57.508 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-03-09T14:44:57.172+0000 7f7a6749d640 10 monclient: get_auth_request con 0x55e2fb0cb4d0 auth_method 0 2024-03-09T14:44:57.508 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-03-09T14:44:57.176+0000 7f7a66c9c640 10 monclient: get_auth_request con 0x7f7a6007c040 auth_method 0 2024-03-09T14:44:57.508 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-03-09T14:44:57.180+0000 7f7a6649b640 0 -- 172.21.15.99:0/824474536 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f7a60018070 msgr2=0x7f7a60088150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:57.508 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-03-09T14:44:57.384+0000 7f7a6649b640 10 monclient: get_auth_request con 0x7f7a60018070 auth_method 0 2024-03-09T14:44:57.508 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:57.509 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:57.509 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:57.509 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:57.509 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:57.509 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:57.509 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.509 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.509 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.509 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:57.509 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.509 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:57.509 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 zone default found 2024-03-09T14:44:57.509 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-03-09T14:44:57.400+0000 7f7a69184980 4 Realm: () 2024-03-09T14:44:57.509 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-03-09T14:44:57.400+0000 7f7a69184980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:57.509 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-03-09T14:44:57.400+0000 7f7a69184980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:57.510 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-03-09T14:44:57.400+0000 7f7a69184980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:57.510 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 zonegroup default 2024-03-09T14:44:57.510 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.510 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.510 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.510 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.510 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.510 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.510 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 started sync module instance, tier type = 2024-03-09T14:44:57.510 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:57.510 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=0 2024-03-09T14:44:57.510 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=1 2024-03-09T14:44:57.510 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=2 2024-03-09T14:44:57.510 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=3 2024-03-09T14:44:57.510 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=4 2024-03-09T14:44:57.511 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=5 2024-03-09T14:44:57.511 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=6 2024-03-09T14:44:57.511 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=7 2024-03-09T14:44:57.511 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-03-09T14:44:57.428+0000 7f7a69184980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:57.511 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding auth protocol: cephx 2024-03-09T14:44:57.511 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding auth protocol: cephx 2024-03-09T14:44:57.511 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding auth protocol: cephx 2024-03-09T14:44:57.511 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: secure 2024-03-09T14:44:57.511 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: crc 2024-03-09T14:44:57.511 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: secure 2024-03-09T14:44:57.511 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: crc 2024-03-09T14:44:57.511 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: secure 2024-03-09T14:44:57.511 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: crc 2024-03-09T14:44:57.511 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: crc 2024-03-09T14:44:57.512 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-03-09T14:44:57.432+0000 7f791dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:57.512 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: secure 2024-03-09T14:44:57.512 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: crc 2024-03-09T14:44:57.512 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: secure 2024-03-09T14:44:57.512 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: crc 2024-03-09T14:44:57.512 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: secure 2024-03-09T14:44:57.512 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-03-09T14:44:57.436+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.512 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-03-09T14:44:57.436+0000 7f7a69184980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:57.512 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-03-09T14:44:57.436+0000 7f7a69184980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:57.512 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command cache list hook 0x55e2fb0ae5d0 2024-03-09T14:44:57.512 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command cache inspect hook 0x55e2fb0ae5d0 2024-03-09T14:44:57.512 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command cache erase hook 0x55e2fb0ae5d0 2024-03-09T14:44:57.512 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command cache zap hook 0x55e2fb0ae5d0 2024-03-09T14:44:57.512 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 note: GC not initialized 2024-03-09T14:44:57.512 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-03-09T14:44:57.436+0000 7f791cfe1640 20 reqs_thread_entry: start 2024-03-09T14:44:57.513 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command sync trace show hook 0x7f7a5c0043b0 2024-03-09T14:44:57.513 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command sync trace history hook 0x7f7a5c0043b0 2024-03-09T14:44:57.513 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command sync trace active hook 0x7f7a5c0043b0 2024-03-09T14:44:57.513 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command sync trace active_short hook 0x7f7a5c0043b0 2024-03-09T14:44:57.513 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-03-09T14:44:57.436+0000 7f7a69184980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:57.513 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-03-09T14:44:57.436+0000 7f7a69184980 20 Filter name: none 2024-03-09T14:44:57.513 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-03-09T14:44:57.436+0000 7f7915ffb640 20 reqs_thread_entry: start 2024-03-09T14:44:57.513 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-09T14:44:57.513 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-03-09T14:44:57.436+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.513 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-03-09T14:44:57.436+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:44:57.513 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-09T14:44:57.513 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-09T14:44:57.513 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 : miss 2024-03-09T14:44:57.513 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-03-09T14:44:57.436+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.513 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-03-09T14:44:57.436+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=427 2024-03-09T14:44:57.514 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 info.flags=0x17 2024-03-09T14:44:57.514 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 to cache LRU end 2024-03-09T14:44:57.514 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:57.514 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:57.514 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 2024-03-09T14:44:57.514 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-03-09T14:44:57.452+0000 7f7a69184980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 info.flags=0x17 2024-03-09T14:44:57.514 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-03-09T14:44:57.452+0000 7f7a69184980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 to cache LRU end 2024-03-09T14:44:57.514 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-03-09T14:44:57.452+0000 7f7a69184980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:57.514 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-03-09T14:44:57.452+0000 7f7a69184980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24, ofs0, ns] 2024-03-09T14:44:57.514 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-03-09T14:44:57.456+0000 7f7949ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464345 cookie 94433362940912 notifier 6522 bl.length()=991 2024-03-09T14:44:57.514 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-03-09T14:44:57.456+0000 7f7949ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 info.flags=0x17 2024-03-09T14:44:57.514 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-03-09T14:44:57.456+0000 7f7949ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 to cache LRU end 2024-03-09T14:44:57.514 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-03-09T14:44:57.456+0000 7f7949ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:57.515 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-03-09T14:44:57.456+0000 7f7a69184980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): orig_sources= new_sources= 2024-03-09T14:44:57.515 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-03-09T14:44:57.456+0000 7f7a69184980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): potential sources added=[] removed=[] 2024-03-09T14:44:57.515 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-03-09T14:44:57.456+0000 7f7a69184980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): orig_dests= new_dests= 2024-03-09T14:44:57.515 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-03-09T14:44:57.456+0000 7f7a69184980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): potential dests added=[] removed=[] 2024-03-09T14:44:57.515 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-03-09T14:44:57.456+0000 7f7a69184980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7a69184980 time 2024-03-09T14:44:57.461475+0000 2024-03-09T14:44:57.515 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:44:57.515 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.515 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:44:57.515 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7a6ca59d7b] 2024-03-09T14:44:57.515 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f7a6ca59f2f] 2024-03-09T14:44:57.515 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2f96b0c51] 2024-03-09T14:44:57.515 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a5) [0x55e2f96d1285] 2024-03-09T14:44:57.515 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-03-09T14:44:57.516 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a6b8c4d90] 2024-03-09T14:44:57.516 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-03-09T14:44:57.516 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-03-09T14:44:57.516 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.516 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-03-09T14:44:57.460+0000 7f7a69184980 -1 *** Caught signal (Aborted) ** 2024-03-09T14:44:57.516 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f7a69184980 thread_name:radosgw-admin 2024-03-09T14:44:57.516 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.516 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:44:57.516 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7a6b8dd520] 2024-03-09T14:44:57.516 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-03-09T14:44:57.516 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-03-09T14:44:57.516 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-03-09T14:44:57.516 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7a6ca59dd5] 2024-03-09T14:44:57.516 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f7a6ca59f2f] 2024-03-09T14:44:57.516 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2f96b0c51] 2024-03-09T14:44:57.517 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a5) [0x55e2f96d1285] 2024-03-09T14:44:57.517 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-03-09T14:44:57.517 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a6b8c4d90] 2024-03-09T14:44:57.517 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-03-09T14:44:57.517 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-03-09T14:44:57.517 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:44:57.517 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.517 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-03-09T14:44:57.517 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-03-09T14:44:57.517 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-03-09T14:44:57.517 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-03-09T14:44:57.517 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-03-09T14:44:57.517 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-03-09T14:44:57.517 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-03-09T14:44:57.518 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-03-09T14:44:57.518 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-03-09T14:44:57.518 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-03-09T14:44:57.518 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-03-09T14:44:57.518 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-03-09T14:44:57.518 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-03-09T14:44:57.518 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-03-09T14:44:57.518 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-03-09T14:44:57.518 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-03-09T14:44:57.518 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-03-09T14:44:57.518 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-03-09T14:44:57.518 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-03-09T14:44:57.518 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-03-09T14:44:57.518 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-03-09T14:44:57.518 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-03-09T14:44:57.519 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-03-09T14:44:57.519 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:44:57.519 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-03-09T14:44:57.519 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-03-09T14:44:57.519 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-03-09T14:44:57.519 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-03-09T14:44:57.519 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-03-09T14:44:57.519 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-03-09T14:44:57.519 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-03-09T14:44:57.519 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-03-09T14:44:57.519 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-03-09T14:44:57.519 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-03-09T14:44:57.519 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-03-09T14:44:57.519 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-03-09T14:44:57.519 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-03-09T14:44:57.520 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-03-09T14:44:57.520 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-03-09T14:44:57.520 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-03-09T14:44:57.520 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-03-09T14:44:57.520 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-03-09T14:44:57.520 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-03-09T14:44:57.520 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-03-09T14:44:57.520 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-03-09T14:44:57.520 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:44:57.520 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-03-09T14:44:57.520 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:44:57.520 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-03-09T14:44:57.520 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-03-09T14:44:57.520 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-03-09T14:44:57.521 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-03-09T14:44:57.521 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-03-09T14:44:57.521 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-03-09T14:44:57.521 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-03-09T14:44:57.521 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-03-09T14:44:57.521 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-03-09T14:44:57.521 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-03-09T14:44:57.521 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-03-09T14:44:57.521 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-03-09T14:44:57.521 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-03-09T14:44:57.521 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-03-09T14:44:57.521 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-03-09T14:44:57.521 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-03-09T14:44:57.521 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-03-09T14:44:57.521 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:44:57.522 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-03-09T14:44:57.522 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:44:57.522 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-03-09T14:44:57.522 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-03-09T14:44:57.522 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-03-09T14:44:57.522 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-03-09T14:44:57.522 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-03-09T14:44:57.522 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-03-09T14:44:57.522 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:44:57.522 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-03-09T14:44:57.522 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-03-09T14:44:57.522 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:44:57.522 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-03-09T14:44:57.522 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-03-09T14:44:57.522 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-03-09T14:44:57.523 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-03-09T14:44:57.523 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-03-09T14:44:57.523 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-03-09T14:44:57.523 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-03-09T14:44:57.523 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-03-09T14:44:57.523 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-03-09T14:44:57.523 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-03-09T14:44:57.523 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-03-09T14:44:57.523 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-03-09T14:44:57.523 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:44:57.523 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7915ffb640 / http_manager 2024-03-09T14:44:57.523 INFO:tasks.workunit.client.0.smithi099.stderr: 7f791cfe1640 / http_manager 2024-03-09T14:44:57.523 INFO:tasks.workunit.client.0.smithi099.stderr: 7f791dfe3640 / rgw_dt_lg_renew 2024-03-09T14:44:57.523 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7948ff9640 / ms_dispatch 2024-03-09T14:44:57.524 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7949ffb640 / io_context_pool 2024-03-09T14:44:57.524 INFO:tasks.workunit.client.0.smithi099.stderr: 7f794a7fc640 / io_context_pool 2024-03-09T14:44:57.524 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7950e01640 / ms_dispatch 2024-03-09T14:44:57.524 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7953606640 / ms_dispatch 2024-03-09T14:44:57.524 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7954e09640 / io_context_pool 2024-03-09T14:44:57.524 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a6649b640 / msgr-worker-2 2024-03-09T14:44:57.524 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a66c9c640 / msgr-worker-1 2024-03-09T14:44:57.524 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a6749d640 / msgr-worker-0 2024-03-09T14:44:57.524 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a67c9e640 / io_context_pool 2024-03-09T14:44:57.524 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a69184980 / radosgw-admin 2024-03-09T14:44:57.524 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-03-09T14:44:57.524 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-03-09T14:44:57.524 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/log/ceph/ceph-client.admin.89098.log 2024-03-09T14:44:57.524 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-03-09T14:44:57.524 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-03-09T14:44:57.524 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-03-09T14:44:57.140+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.525 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-03-09T14:44:57.140+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.525 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-03-09T14:44:57.140+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.525 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-03-09T14:44:57.140+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.525 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-03-09T14:44:57.140+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.525 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-03-09T14:44:57.140+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.525 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-03-09T14:44:57.140+0000 7f7a6649b640 10 monclient(hunting): handle_auth_done global_id 6510 payload 274 2024-03-09T14:44:57.525 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-03-09T14:44:57.140+0000 7f7a6649b640 10 monclient: _finish_hunting 0 2024-03-09T14:44:57.525 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-03-09T14:44:57.140+0000 7f7a6649b640 1 monclient: found mon.noname-a 2024-03-09T14:44:57.525 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-03-09T14:44:57.140+0000 7f7a6649b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:44:57.525 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.525 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:44:57.525 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: dump: 2024-03-09T14:44:57.525 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.525 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.526 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.526 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.526 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.526 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.526 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.526 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.526 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.526 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.526 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: _finish_auth 0 2024-03-09T14:44:57.526 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: _check_auth_tickets 2024-03-09T14:44:57.526 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:57.526 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.526 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:44:57.526 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-03-09T14:44:57.140+0000 7f7954e09640 10 monclient: dump: 2024-03-09T14:44:57.526 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.527 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.527 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.527 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.527 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.527 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.527 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.527 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.527 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.527 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.527 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 monclient: authenticate success, global_id 6510 2024-03-09T14:44:57.527 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-03-09T14:44:57.140+0000 7f7a69184980 10 monclient: get_monmap_and_config success 2024-03-09T14:44:57.527 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-03-09T14:44:57.140+0000 7f7a69184980 4 set_mon_vals no callback set 2024-03-09T14:44:57.527 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-03-09T14:44:57.140+0000 7f7a69184980 10 monclient: shutdown 2024-03-09T14:44:57.527 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) unregister_commands rotate-key 2024-03-09T14:44:57.527 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-03-09T14:44:57.140+0000 7f7a69184980 10 monclient: build_initial_monmap 2024-03-09T14:44:57.527 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-03-09T14:44:57.140+0000 7f7a69184980 1 build_initial for_mkfs: 0 2024-03-09T14:44:57.528 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-03-09T14:44:57.140+0000 7f7a69184980 10 monclient: monmap: 2024-03-09T14:44:57.528 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:44:57.528 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:44:57.528 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:44:57.528 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:44:57.528 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:44:57.528 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.528 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:44:57.528 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:44:57.528 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:44:57.528 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.528 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding auth protocol: cephx 2024-03-09T14:44:57.528 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding auth protocol: cephx 2024-03-09T14:44:57.528 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding auth protocol: cephx 2024-03-09T14:44:57.529 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: secure 2024-03-09T14:44:57.529 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: crc 2024-03-09T14:44:57.529 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: secure 2024-03-09T14:44:57.529 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: crc 2024-03-09T14:44:57.529 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: secure 2024-03-09T14:44:57.529 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: crc 2024-03-09T14:44:57.529 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: crc 2024-03-09T14:44:57.529 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: secure 2024-03-09T14:44:57.529 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: crc 2024-03-09T14:44:57.529 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: secure 2024-03-09T14:44:57.529 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: crc 2024-03-09T14:44:57.529 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fb00db70) adding con mode: secure 2024-03-09T14:44:57.529 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-03-09T14:44:57.140+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.529 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-03-09T14:44:57.140+0000 7f7a69184980 1 librados: starting msgr at 2024-03-09T14:44:57.529 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-03-09T14:44:57.140+0000 7f7a69184980 1 librados: starting objecter 2024-03-09T14:44:57.530 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command objecter_requests hook 0x55e2fae69ce0 2024-03-09T14:44:57.530 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-03-09T14:44:57.140+0000 7f7a69184980 1 librados: setting wanted keys 2024-03-09T14:44:57.530 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-03-09T14:44:57.140+0000 7f7a69184980 1 librados: calling monclient init 2024-03-09T14:44:57.530 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-03-09T14:44:57.140+0000 7f7a69184980 10 monclient: init 2024-03-09T14:44:57.530 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding auth protocol: cephx 2024-03-09T14:44:57.530 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding auth protocol: cephx 2024-03-09T14:44:57.530 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding auth protocol: cephx 2024-03-09T14:44:57.530 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: secure 2024-03-09T14:44:57.530 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: crc 2024-03-09T14:44:57.530 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: secure 2024-03-09T14:44:57.530 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: crc 2024-03-09T14:44:57.530 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: secure 2024-03-09T14:44:57.530 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: crc 2024-03-09T14:44:57.530 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: crc 2024-03-09T14:44:57.530 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: secure 2024-03-09T14:44:57.531 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: crc 2024-03-09T14:44:57.531 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: secure 2024-03-09T14:44:57.531 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: crc 2024-03-09T14:44:57.531 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-03-09T14:44:57.140+0000 7f7a69184980 5 AuthRegistry(0x55e2fafddb80) adding con mode: secure 2024-03-09T14:44:57.531 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-03-09T14:44:57.140+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.531 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-03-09T14:44:57.144+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.531 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-03-09T14:44:57.144+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command rotate-key hook 0x55e2fafddcc8 2024-03-09T14:44:57.531 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient: _reopen_session rank -1 2024-03-09T14:44:57.531 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient: _add_conns ranks=[0,2,1] 2024-03-09T14:44:57.531 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-a con 0x55e2fae6bbc0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:44:57.531 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-c con 0x55e2faf245f0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:44:57.531 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-b con 0x55e2fafe4390 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:44:57.531 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.531 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.531 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.532 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:57.532 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient(hunting): authenticate will time out at 1950.944233s 2024-03-09T14:44:57.532 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-03-09T14:44:57.144+0000 7f7a6649b640 10 monclient(hunting): get_auth_request con 0x55e2faf245f0 auth_method 0 2024-03-09T14:44:57.532 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-03-09T14:44:57.144+0000 7f7a6649b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:57.532 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-03-09T14:44:57.144+0000 7f7a6649b640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:57.532 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-03-09T14:44:57.144+0000 7f7a6649b640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:57.532 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient(hunting): get_auth_request con 0x55e2fae6bbc0 auth_method 0 2024-03-09T14:44:57.532 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:57.532 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:57.532 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:57.532 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.532 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.532 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.532 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-03-09T14:44:57.144+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.532 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-03-09T14:44:57.144+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.533 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-03-09T14:44:57.144+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.533 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_done global_id 6513 payload 824 2024-03-09T14:44:57.533 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient: _finish_hunting 0 2024-03-09T14:44:57.533 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 1 monclient: found mon.noname-a 2024-03-09T14:44:57.533 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-03-09T14:44:57.144+0000 7f7a66c9c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:44:57.533 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.533 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:44:57.533 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: dump: 2024-03-09T14:44:57.533 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.533 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.533 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.533 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.533 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.533 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.533 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.534 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.534 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.534 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.534 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: _finish_auth 0 2024-03-09T14:44:57.534 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: _check_auth_tickets 2024-03-09T14:44:57.534 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:57.534 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.534 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:44:57.534 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-03-09T14:44:57.144+0000 7f7953606640 10 monclient: dump: 2024-03-09T14:44:57.534 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.534 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.534 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.534 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.534 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.534 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.535 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.535 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.535 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.535 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.535 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-03-09T14:44:57.144+0000 7f7a69184980 5 monclient: authenticate success, global_id 6513 2024-03-09T14:44:57.535 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient: _renew_subs 2024-03-09T14:44:57.535 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-03-09T14:44:57.144+0000 7f7954e09640 4 set_mon_vals no callback set 2024-03-09T14:44:57.535 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:44:57.535 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient: _renew_subs 2024-03-09T14:44:57.535 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-03-09T14:44:57.144+0000 7f7a69184980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:44:57.535 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-03-09T14:44:57.144+0000 7f7a69184980 1 librados: init done 2024-03-09T14:44:57.535 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-03-09T14:44:57.144+0000 7f7953606640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:44:57.535 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-03-09T14:44:57.144+0000 7f7953606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:57.535 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-03-09T14:44:57.144+0000 7f7953606640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:57.535 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-03-09T14:44:57.144+0000 7f7a6649b640 10 monclient: get_auth_request con 0x7f794c066040 auth_method 0 2024-03-09T14:44:57.536 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-03-09T14:44:57.144+0000 7f7a6749d640 10 monclient: get_auth_request con 0x55e2fb00ae30 auth_method 0 2024-03-09T14:44:57.536 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-03-09T14:44:57.148+0000 7f7a66c9c640 10 monclient: get_auth_request con 0x55e2fb028630 auth_method 0 2024-03-09T14:44:57.536 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-03-09T14:44:57.148+0000 7f7a6649b640 10 monclient: get_auth_request con 0x55e2fb02ca60 auth_method 0 2024-03-09T14:44:57.536 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient: get_auth_request con 0x55e2fb02beb0 auth_method 0 2024-03-09T14:44:57.536 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: build_initial_monmap 2024-03-09T14:44:57.536 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-03-09T14:44:57.152+0000 7f7a69184980 1 build_initial for_mkfs: 0 2024-03-09T14:44:57.536 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: monmap: 2024-03-09T14:44:57.536 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:44:57.536 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:44:57.536 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:44:57.536 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:44:57.536 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:44:57.536 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.536 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:44:57.536 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:44:57.537 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:44:57.537 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.537 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding auth protocol: cephx 2024-03-09T14:44:57.537 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding auth protocol: cephx 2024-03-09T14:44:57.537 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding auth protocol: cephx 2024-03-09T14:44:57.537 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: secure 2024-03-09T14:44:57.537 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: crc 2024-03-09T14:44:57.537 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: secure 2024-03-09T14:44:57.537 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: crc 2024-03-09T14:44:57.537 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: secure 2024-03-09T14:44:57.537 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: crc 2024-03-09T14:44:57.537 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: crc 2024-03-09T14:44:57.537 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: secure 2024-03-09T14:44:57.537 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: crc 2024-03-09T14:44:57.537 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: secure 2024-03-09T14:44:57.538 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: crc 2024-03-09T14:44:57.538 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb034b80) adding con mode: secure 2024-03-09T14:44:57.538 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-03-09T14:44:57.152+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.538 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command objecter_requests cmddesc objecter_requests hook 0x55e2fb03a2b0 EEXIST 2024-03-09T14:44:57.538 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: init 2024-03-09T14:44:57.538 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding auth protocol: cephx 2024-03-09T14:44:57.538 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding auth protocol: cephx 2024-03-09T14:44:57.538 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding auth protocol: cephx 2024-03-09T14:44:57.538 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: secure 2024-03-09T14:44:57.538 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: crc 2024-03-09T14:44:57.538 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: secure 2024-03-09T14:44:57.538 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: crc 2024-03-09T14:44:57.538 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: secure 2024-03-09T14:44:57.538 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: crc 2024-03-09T14:44:57.539 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: crc 2024-03-09T14:44:57.539 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: secure 2024-03-09T14:44:57.539 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: crc 2024-03-09T14:44:57.539 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: secure 2024-03-09T14:44:57.539 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: crc 2024-03-09T14:44:57.539 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 AuthRegistry(0x55e2fb033ac8) adding con mode: secure 2024-03-09T14:44:57.539 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-03-09T14:44:57.152+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.539 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-03-09T14:44:57.152+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.539 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command rotate-key cmddesc rotate-key hook 0x55e2fb033c10 EEXIST 2024-03-09T14:44:57.539 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: _reopen_session rank -1 2024-03-09T14:44:57.539 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:44:57.539 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-b con 0x55e2fb05ef10 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:44:57.539 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-c con 0x55e2fb05f2f0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:44:57.539 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-a con 0x55e2fb05a4b0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:44:57.540 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.540 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.540 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.540 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:57.540 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient(hunting): authenticate will time out at 1950.954682s 2024-03-09T14:44:57.540 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient(hunting): get_auth_request con 0x55e2fb05f2f0 auth_method 0 2024-03-09T14:44:57.540 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:57.540 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:57.540 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:57.540 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-03-09T14:44:57.152+0000 7f7a66c9c640 10 monclient(hunting): get_auth_request con 0x55e2fb05a4b0 auth_method 0 2024-03-09T14:44:57.540 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-03-09T14:44:57.152+0000 7f7a66c9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:57.540 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-03-09T14:44:57.152+0000 7f7a66c9c640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:57.540 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-03-09T14:44:57.152+0000 7f7a66c9c640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:57.540 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.540 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.541 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.541 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-03-09T14:44:57.152+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.541 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-03-09T14:44:57.152+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.541 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-03-09T14:44:57.152+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.541 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient(hunting): handle_auth_done global_id 6239 payload 824 2024-03-09T14:44:57.541 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient: _finish_hunting 0 2024-03-09T14:44:57.541 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-03-09T14:44:57.152+0000 7f7a6749d640 1 monclient: found mon.noname-c 2024-03-09T14:44:57.541 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-03-09T14:44:57.152+0000 7f7a6749d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:44:57.541 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.541 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:44:57.541 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: dump: 2024-03-09T14:44:57.541 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.541 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.541 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.541 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.541 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.542 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.542 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.542 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.542 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.542 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.542 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: _finish_auth 0 2024-03-09T14:44:57.542 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: _check_auth_tickets 2024-03-09T14:44:57.542 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-03-09T14:44:57.152+0000 7f7a69184980 5 monclient: authenticate success, global_id 6239 2024-03-09T14:44:57.542 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: _renew_subs 2024-03-09T14:44:57.542 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:44:57.542 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:57.542 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.542 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:44:57.542 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-03-09T14:44:57.152+0000 7f7950e01640 10 monclient: dump: 2024-03-09T14:44:57.543 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.543 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.543 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.543 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.543 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.543 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.543 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.543 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.543 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.543 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.543 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-03-09T14:44:57.152+0000 7f7a67c9e640 4 set_mon_vals no callback set 2024-03-09T14:44:57.543 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: _renew_subs 2024-03-09T14:44:57.543 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-03-09T14:44:57.152+0000 7f7a69184980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:44:57.543 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-03-09T14:44:57.156+0000 7f7950e01640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:44:57.543 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-03-09T14:44:57.156+0000 7f7950e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:57.544 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-03-09T14:44:57.156+0000 7f7950e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:57.544 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-03-09T14:44:57.156+0000 7f7a6649b640 10 monclient: get_auth_request con 0x7f7940065f80 auth_method 0 2024-03-09T14:44:57.544 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient: get_monmap_and_config 2024-03-09T14:44:57.544 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient: build_initial_monmap 2024-03-09T14:44:57.544 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-03-09T14:44:57.156+0000 7f7a69184980 1 build_initial for_mkfs: 0 2024-03-09T14:44:57.544 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient: monmap: 2024-03-09T14:44:57.544 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:44:57.544 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:44:57.544 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:44:57.544 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:44:57.544 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:44:57.544 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.544 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:44:57.544 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:44:57.544 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:44:57.545 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.545 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding auth protocol: cephx 2024-03-09T14:44:57.545 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding auth protocol: cephx 2024-03-09T14:44:57.545 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding auth protocol: cephx 2024-03-09T14:44:57.545 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.545 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.545 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.545 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.545 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.545 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.545 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.545 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.545 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.545 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.545 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.546 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.546 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-03-09T14:44:57.156+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.546 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient: init 2024-03-09T14:44:57.546 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding auth protocol: cephx 2024-03-09T14:44:57.546 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding auth protocol: cephx 2024-03-09T14:44:57.546 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding auth protocol: cephx 2024-03-09T14:44:57.546 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: secure 2024-03-09T14:44:57.546 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: crc 2024-03-09T14:44:57.546 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: secure 2024-03-09T14:44:57.546 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: crc 2024-03-09T14:44:57.546 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: secure 2024-03-09T14:44:57.546 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: crc 2024-03-09T14:44:57.546 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: crc 2024-03-09T14:44:57.546 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: secure 2024-03-09T14:44:57.547 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: crc 2024-03-09T14:44:57.547 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: secure 2024-03-09T14:44:57.547 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: crc 2024-03-09T14:44:57.547 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d080) adding con mode: secure 2024-03-09T14:44:57.547 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-03-09T14:44:57.156+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.547 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-03-09T14:44:57.156+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.547 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command rotate-key cmddesc rotate-key hook 0x7fffba34d1c8 EEXIST 2024-03-09T14:44:57.547 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient: _reopen_session rank -1 2024-03-09T14:44:57.547 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient: _add_conns ranks=[0,2,1] 2024-03-09T14:44:57.547 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-a con 0x55e2fb0b1420 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:44:57.547 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-c con 0x55e2fb0ab4b0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:44:57.547 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-b con 0x55e2fb0ad050 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:44:57.547 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.547 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.548 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.548 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:57.548 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient(hunting): authenticate will time out at 1950.958660s 2024-03-09T14:44:57.548 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient(hunting): get_auth_request con 0x55e2fb0ab4b0 auth_method 0 2024-03-09T14:44:57.548 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:57.548 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:57.548 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:57.548 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-03-09T14:44:57.156+0000 7f7a6649b640 10 monclient(hunting): get_auth_request con 0x55e2fb0b1420 auth_method 0 2024-03-09T14:44:57.548 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-03-09T14:44:57.156+0000 7f7a6649b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:57.548 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-03-09T14:44:57.156+0000 7f7a6649b640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:57.548 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-03-09T14:44:57.156+0000 7f7a6649b640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:57.548 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.548 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.548 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.548 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-03-09T14:44:57.156+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.549 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-03-09T14:44:57.156+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.549 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-03-09T14:44:57.156+0000 7f7a6649b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.549 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient(hunting): handle_auth_done global_id 6242 payload 274 2024-03-09T14:44:57.549 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient: _finish_hunting 0 2024-03-09T14:44:57.549 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-03-09T14:44:57.156+0000 7f7a6749d640 1 monclient: found mon.noname-c 2024-03-09T14:44:57.549 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-03-09T14:44:57.156+0000 7f7a6749d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:44:57.549 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.549 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:44:57.549 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: dump: 2024-03-09T14:44:57.549 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.549 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.549 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.549 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.550 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.550 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.550 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.550 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.550 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.550 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.550 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: _finish_auth 0 2024-03-09T14:44:57.550 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: _check_auth_tickets 2024-03-09T14:44:57.550 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:57.550 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-03-09T14:44:57.156+0000 7f7a69184980 5 monclient: authenticate success, global_id 6242 2024-03-09T14:44:57.550 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient: get_monmap_and_config success 2024-03-09T14:44:57.550 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-03-09T14:44:57.156+0000 7f7a69184980 4 set_mon_vals no callback set 2024-03-09T14:44:57.550 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.550 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:44:57.550 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-03-09T14:44:57.156+0000 7f794a7fc640 10 monclient: dump: 2024-03-09T14:44:57.551 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.551 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.551 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.551 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.551 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.551 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.551 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.551 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.551 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.551 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.551 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-03-09T14:44:57.156+0000 7f7a69184980 10 monclient: shutdown 2024-03-09T14:44:57.551 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: build_initial_monmap 2024-03-09T14:44:57.551 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-03-09T14:44:57.160+0000 7f7a69184980 1 build_initial for_mkfs: 0 2024-03-09T14:44:57.551 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: monmap: 2024-03-09T14:44:57.551 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:44:57.552 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:44:57.552 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:44:57.552 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:44:57.552 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:44:57.552 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.552 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:44:57.552 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:44:57.552 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:44:57.552 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.552 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding auth protocol: cephx 2024-03-09T14:44:57.552 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding auth protocol: cephx 2024-03-09T14:44:57.552 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding auth protocol: cephx 2024-03-09T14:44:57.552 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.552 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.552 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.553 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.553 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.553 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.553 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.553 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.553 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.553 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.553 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: crc 2024-03-09T14:44:57.553 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07ca60) adding con mode: secure 2024-03-09T14:44:57.553 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-03-09T14:44:57.160+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.553 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-03-09T14:44:57.160+0000 7f7a69184980 1 librados: starting msgr at 2024-03-09T14:44:57.553 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-03-09T14:44:57.160+0000 7f7a69184980 1 librados: starting objecter 2024-03-09T14:44:57.553 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command objecter_requests cmddesc objecter_requests hook 0x55e2fb0ac430 EEXIST 2024-03-09T14:44:57.553 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-03-09T14:44:57.160+0000 7f7a69184980 1 librados: setting wanted keys 2024-03-09T14:44:57.554 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-03-09T14:44:57.160+0000 7f7a69184980 1 librados: calling monclient init 2024-03-09T14:44:57.554 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: init 2024-03-09T14:44:57.554 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding auth protocol: cephx 2024-03-09T14:44:57.554 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding auth protocol: cephx 2024-03-09T14:44:57.554 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding auth protocol: cephx 2024-03-09T14:44:57.554 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: secure 2024-03-09T14:44:57.554 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: crc 2024-03-09T14:44:57.554 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: secure 2024-03-09T14:44:57.554 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: crc 2024-03-09T14:44:57.554 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: secure 2024-03-09T14:44:57.554 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: crc 2024-03-09T14:44:57.554 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: crc 2024-03-09T14:44:57.554 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: secure 2024-03-09T14:44:57.554 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: crc 2024-03-09T14:44:57.554 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: secure 2024-03-09T14:44:57.555 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: crc 2024-03-09T14:44:57.555 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 AuthRegistry(0x55e2fb07bc30) adding con mode: secure 2024-03-09T14:44:57.555 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-03-09T14:44:57.160+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.555 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-03-09T14:44:57.160+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.555 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command rotate-key cmddesc rotate-key hook 0x55e2fb07bd78 EEXIST 2024-03-09T14:44:57.555 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: _reopen_session rank -1 2024-03-09T14:44:57.555 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:44:57.555 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-b con 0x55e2fb0ab4b0 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:44:57.555 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-c con 0x55e2fb0ad050 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:44:57.555 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient(hunting): picked mon.noname-a con 0x55e2fb0b1420 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:44:57.555 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.555 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.555 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient(hunting): start opening mon connection 2024-03-09T14:44:57.555 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient(hunting): _renew_subs 2024-03-09T14:44:57.555 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient(hunting): authenticate will time out at 1950.961161s 2024-03-09T14:44:57.556 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient(hunting): get_auth_request con 0x55e2fb0b1420 auth_method 0 2024-03-09T14:44:57.556 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:57.556 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:57.556 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:57.556 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-03-09T14:44:57.160+0000 7f7a6749d640 10 monclient(hunting): get_auth_request con 0x55e2fb0ad050 auth_method 0 2024-03-09T14:44:57.556 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-03-09T14:44:57.160+0000 7f7a6749d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:44:57.556 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-03-09T14:44:57.160+0000 7f7a6749d640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:44:57.556 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-03-09T14:44:57.160+0000 7f7a6749d640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:44:57.556 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-03-09T14:44:57.160+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.556 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-03-09T14:44:57.160+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.556 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-03-09T14:44:57.160+0000 7f7a6749d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.556 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:44:57.556 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:44:57.556 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:44:57.557 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient(hunting): handle_auth_done global_id 6522 payload 824 2024-03-09T14:44:57.557 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient: _finish_hunting 0 2024-03-09T14:44:57.557 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 1 monclient: found mon.noname-a 2024-03-09T14:44:57.557 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-03-09T14:44:57.160+0000 7f7a66c9c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:44:57.557 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.557 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:44:57.557 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: dump: 2024-03-09T14:44:57.557 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.557 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.557 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.557 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.557 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.557 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.557 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.557 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.558 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.558 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.558 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: _finish_auth 0 2024-03-09T14:44:57.558 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: _check_auth_tickets 2024-03-09T14:44:57.558 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:44:57.558 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:44:57.558 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:44:57.558 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-03-09T14:44:57.160+0000 7f7948ff9640 10 monclient: dump: 2024-03-09T14:44:57.558 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:44:57.558 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:44:57.558 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.558 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:44:57.558 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:44:57.558 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:44:57.559 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:44:57.559 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:44:57.559 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:44:57.559 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.559 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-03-09T14:44:57.160+0000 7f794a7fc640 4 set_mon_vals no callback set 2024-03-09T14:44:57.559 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 monclient: authenticate success, global_id 6522 2024-03-09T14:44:57.559 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: _renew_subs 2024-03-09T14:44:57.559 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:44:57.559 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: _renew_subs 2024-03-09T14:44:57.559 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-03-09T14:44:57.160+0000 7f7a69184980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:44:57.559 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-03-09T14:44:57.160+0000 7f7a69184980 1 librados: init done 2024-03-09T14:44:57.559 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-03-09T14:44:57.160+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command cr dump hook 0x55e2fb0a5d58 2024-03-09T14:44:57.559 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-03-09T14:44:57.160+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.559 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-03-09T14:44:57.164+0000 7f7948ff9640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:44:57.559 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-03-09T14:44:57.164+0000 7f7948ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:57.560 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-03-09T14:44:57.164+0000 7f7948ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:44:57.560 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-03-09T14:44:57.164+0000 7f7a6649b640 10 monclient: get_auth_request con 0x7f7930066040 auth_method 0 2024-03-09T14:44:57.560 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-03-09T14:44:57.164+0000 7f7a6749d640 10 monclient: get_auth_request con 0x55e2fb0cb4d0 auth_method 0 2024-03-09T14:44:57.560 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-03-09T14:44:57.164+0000 7f7948ff9640 1 client.6522.objecter ms_handle_reset 0x55e2fb0cb4d0 session 0x55e2fb0cae50 osd.1 2024-03-09T14:44:57.560 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-03-09T14:44:57.164+0000 7f7948ff9640 10 monclient: _renew_subs 2024-03-09T14:44:57.560 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-03-09T14:44:57.164+0000 7f7948ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:44:57.560 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-03-09T14:44:57.164+0000 7f7a6749d640 10 monclient: get_auth_request con 0x7f7930076660 auth_method 0 2024-03-09T14:44:57.560 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.560 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 realm 2024-03-09T14:44:57.560 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.560 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.560 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-03-09T14:44:57.164+0000 7f7a69184980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:57.560 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.560 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.560 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.561 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-03-09T14:44:57.164+0000 7f7a6649b640 10 monclient: get_auth_request con 0x55e2fb0ccb30 auth_method 0 2024-03-09T14:44:57.561 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:57.561 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-03-09T14:44:57.164+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.561 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-03-09T14:44:57.168+0000 7f7a6749d640 10 monclient: get_auth_request con 0x55e2fb0d0980 auth_method 0 2024-03-09T14:44:57.561 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-03-09T14:44:57.168+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:57.561 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-03-09T14:44:57.168+0000 7f7a69184980 20 searching for the correct realm 2024-03-09T14:44:57.561 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-03-09T14:44:57.168+0000 7f7a66c9c640 10 monclient: get_auth_request con 0x55e2fb0d5650 auth_method 0 2024-03-09T14:44:57.561 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-03-09T14:44:57.168+0000 7f7a6649b640 10 monclient: get_auth_request con 0x7f7a5801f060 auth_method 0 2024-03-09T14:44:57.561 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-03-09T14:44:57.172+0000 7f7a6749d640 10 monclient: get_auth_request con 0x7f7a5c0f6400 auth_method 0 2024-03-09T14:44:57.561 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-03-09T14:44:57.172+0000 7f7a6749d640 0 -- 172.21.15.99:0/824474536 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f7a5c0f6400 msgr2=0x7f7a5c0f6820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:57.561 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-03-09T14:44:57.172+0000 7f7948ff9640 1 client.6522.objecter ms_handle_reset 0x7f7a5c0f6400 session 0x7f7a5c0ef040 osd.2 2024-03-09T14:44:57.561 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-03-09T14:44:57.172+0000 7f7a6749d640 10 monclient: get_auth_request con 0x55e2fb0cb4d0 auth_method 0 2024-03-09T14:44:57.561 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-03-09T14:44:57.176+0000 7f7a66c9c640 10 monclient: get_auth_request con 0x7f7a6007c040 auth_method 0 2024-03-09T14:44:57.561 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-03-09T14:44:57.180+0000 7f7a6649b640 0 -- 172.21.15.99:0/824474536 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f7a60018070 msgr2=0x7f7a60088150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:57.562 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-03-09T14:44:57.384+0000 7f7a6649b640 10 monclient: get_auth_request con 0x7f7a60018070 auth_method 0 2024-03-09T14:44:57.562 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:57.562 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:57.562 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:57.562 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:57.562 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:57.562 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:57.562 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.562 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.562 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-03-09T14:44:57.396+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.562 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:57.562 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.562 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:57.562 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 zone default found 2024-03-09T14:44:57.562 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-03-09T14:44:57.400+0000 7f7a69184980 4 Realm: () 2024-03-09T14:44:57.563 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-03-09T14:44:57.400+0000 7f7a69184980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:57.563 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-03-09T14:44:57.400+0000 7f7a69184980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:57.563 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-03-09T14:44:57.400+0000 7f7a69184980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:57.563 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 zonegroup default 2024-03-09T14:44:57.563 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.563 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.563 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.563 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.563 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.563 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.563 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 started sync module instance, tier type = 2024-03-09T14:44:57.563 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-03-09T14:44:57.400+0000 7f7a69184980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:57.563 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=0 2024-03-09T14:44:57.563 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=1 2024-03-09T14:44:57.564 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=2 2024-03-09T14:44:57.564 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=3 2024-03-09T14:44:57.564 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=4 2024-03-09T14:44:57.564 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=5 2024-03-09T14:44:57.564 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=6 2024-03-09T14:44:57.564 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-03-09T14:44:57.428+0000 7f7a69184980 20 add_watcher() i=7 2024-03-09T14:44:57.564 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-03-09T14:44:57.428+0000 7f7a69184980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:57.564 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding auth protocol: cephx 2024-03-09T14:44:57.564 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding auth protocol: cephx 2024-03-09T14:44:57.564 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding auth protocol: cephx 2024-03-09T14:44:57.564 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: secure 2024-03-09T14:44:57.564 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: crc 2024-03-09T14:44:57.564 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: secure 2024-03-09T14:44:57.564 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: crc 2024-03-09T14:44:57.564 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: secure 2024-03-09T14:44:57.565 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: crc 2024-03-09T14:44:57.565 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: crc 2024-03-09T14:44:57.565 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-03-09T14:44:57.432+0000 7f791dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:57.565 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: secure 2024-03-09T14:44:57.565 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: crc 2024-03-09T14:44:57.565 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: secure 2024-03-09T14:44:57.565 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: crc 2024-03-09T14:44:57.565 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-03-09T14:44:57.432+0000 7f7a69184980 5 AuthRegistry(0x7fffba34d510) adding con mode: secure 2024-03-09T14:44:57.565 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-03-09T14:44:57.436+0000 7f7a69184980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:44:57.565 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-03-09T14:44:57.436+0000 7f7a69184980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:57.565 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-03-09T14:44:57.436+0000 7f7a69184980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:57.565 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command cache list hook 0x55e2fb0ae5d0 2024-03-09T14:44:57.565 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command cache inspect hook 0x55e2fb0ae5d0 2024-03-09T14:44:57.565 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command cache erase hook 0x55e2fb0ae5d0 2024-03-09T14:44:57.565 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command cache zap hook 0x55e2fb0ae5d0 2024-03-09T14:44:57.566 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 note: GC not initialized 2024-03-09T14:44:57.566 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-03-09T14:44:57.436+0000 7f791cfe1640 20 reqs_thread_entry: start 2024-03-09T14:44:57.566 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command sync trace show hook 0x7f7a5c0043b0 2024-03-09T14:44:57.566 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command sync trace history hook 0x7f7a5c0043b0 2024-03-09T14:44:57.566 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command sync trace active hook 0x7f7a5c0043b0 2024-03-09T14:44:57.566 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-03-09T14:44:57.436+0000 7f7a69184980 5 asok(0x55e2fadd1bb0) register_command sync trace active_short hook 0x7f7a5c0043b0 2024-03-09T14:44:57.566 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-03-09T14:44:57.436+0000 7f7a69184980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:57.566 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-03-09T14:44:57.436+0000 7f7a69184980 20 Filter name: none 2024-03-09T14:44:57.566 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-03-09T14:44:57.436+0000 7f7915ffb640 20 reqs_thread_entry: start 2024-03-09T14:44:57.566 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-09T14:44:57.566 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-03-09T14:44:57.436+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.566 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-03-09T14:44:57.436+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:44:57.566 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-09T14:44:57.566 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-09T14:44:57.566 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 : miss 2024-03-09T14:44:57.567 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-03-09T14:44:57.436+0000 7f7a69184980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.567 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-03-09T14:44:57.436+0000 7f7a69184980 20 rados_obj.operate() r=0 bl.length=427 2024-03-09T14:44:57.567 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 info.flags=0x17 2024-03-09T14:44:57.567 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 to cache LRU end 2024-03-09T14:44:57.567 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:57.567 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:57.567 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-03-09T14:44:57.436+0000 7f7a69184980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 2024-03-09T14:44:57.567 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-03-09T14:44:57.452+0000 7f7a69184980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 info.flags=0x17 2024-03-09T14:44:57.567 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-03-09T14:44:57.452+0000 7f7a69184980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 to cache LRU end 2024-03-09T14:44:57.567 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-03-09T14:44:57.452+0000 7f7a69184980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:57.567 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-03-09T14:44:57.452+0000 7f7a69184980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24, ofs0, ns] 2024-03-09T14:44:57.567 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-03-09T14:44:57.456+0000 7f7949ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464345 cookie 94433362940912 notifier 6522 bl.length()=991 2024-03-09T14:44:57.567 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-03-09T14:44:57.456+0000 7f7949ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 info.flags=0x17 2024-03-09T14:44:57.567 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-03-09T14:44:57.456+0000 7f7949ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 to cache LRU end 2024-03-09T14:44:57.568 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-03-09T14:44:57.456+0000 7f7949ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:57.568 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-03-09T14:44:57.456+0000 7f7a69184980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): orig_sources= new_sources= 2024-03-09T14:44:57.568 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-03-09T14:44:57.456+0000 7f7a69184980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): potential sources added=[] removed=[] 2024-03-09T14:44:57.568 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-03-09T14:44:57.456+0000 7f7a69184980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): orig_dests= new_dests= 2024-03-09T14:44:57.568 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-03-09T14:44:57.456+0000 7f7a69184980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): potential dests added=[] removed=[] 2024-03-09T14:44:57.568 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-03-09T14:44:57.456+0000 7f7a69184980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7a69184980 time 2024-03-09T14:44:57.461475+0000 2024-03-09T14:44:57.568 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:44:57.568 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.568 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:44:57.568 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7a6ca59d7b] 2024-03-09T14:44:57.568 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f7a6ca59f2f] 2024-03-09T14:44:57.568 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2f96b0c51] 2024-03-09T14:44:57.568 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a5) [0x55e2f96d1285] 2024-03-09T14:44:57.568 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-03-09T14:44:57.568 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a6b8c4d90] 2024-03-09T14:44:57.569 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-03-09T14:44:57.569 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-03-09T14:44:57.569 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.569 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-03-09T14:44:57.460+0000 7f7a69184980 -1 *** Caught signal (Aborted) ** 2024-03-09T14:44:57.569 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f7a69184980 thread_name:radosgw-admin 2024-03-09T14:44:57.569 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.569 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:44:57.569 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7a6b8dd520] 2024-03-09T14:44:57.569 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-03-09T14:44:57.569 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-03-09T14:44:57.569 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-03-09T14:44:57.569 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7a6ca59dd5] 2024-03-09T14:44:57.569 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f7a6ca59f2f] 2024-03-09T14:44:57.569 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55e2f96b0c51] 2024-03-09T14:44:57.569 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x2a5) [0x55e2f96d1285] 2024-03-09T14:44:57.570 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-03-09T14:44:57.570 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7a6b8c4d90] 2024-03-09T14:44:57.570 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-03-09T14:44:57.570 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-03-09T14:44:57.570 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:44:57.570 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:57.570 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-03-09T14:44:57.570 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-03-09T14:44:57.570 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-03-09T14:44:57.570 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-03-09T14:44:57.570 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-03-09T14:44:57.570 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-03-09T14:44:57.570 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-03-09T14:44:57.570 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-03-09T14:44:57.571 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-03-09T14:44:57.571 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-03-09T14:44:57.571 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-03-09T14:44:57.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-03-09T14:44:57.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-03-09T14:44:57.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-03-09T14:44:57.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-03-09T14:44:57.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-03-09T14:44:57.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-03-09T14:44:57.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-03-09T14:44:57.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-03-09T14:44:57.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-03-09T14:44:57.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-03-09T14:44:57.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-03-09T14:44:57.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-03-09T14:44:57.571 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:44:57.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-03-09T14:44:57.572 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-03-09T14:44:57.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-03-09T14:44:57.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-03-09T14:44:57.572 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-03-09T14:44:57.572 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-03-09T14:44:57.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-03-09T14:44:57.572 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-03-09T14:44:57.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-03-09T14:44:57.572 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-03-09T14:44:57.572 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-03-09T14:44:57.572 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-03-09T14:44:57.572 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-03-09T14:44:57.572 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-03-09T14:44:57.572 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-03-09T14:44:57.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-03-09T14:44:57.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-03-09T14:44:57.573 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-03-09T14:44:57.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-03-09T14:44:57.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-03-09T14:44:57.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-03-09T14:44:57.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:44:57.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-03-09T14:44:57.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:44:57.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-03-09T14:44:57.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-03-09T14:44:57.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-03-09T14:44:57.573 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-03-09T14:44:57.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-03-09T14:44:57.573 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-03-09T14:44:57.574 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-03-09T14:44:57.574 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-03-09T14:44:57.574 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-03-09T14:44:57.574 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-03-09T14:44:57.574 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-03-09T14:44:57.574 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-03-09T14:44:57.574 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-03-09T14:44:57.574 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-03-09T14:44:57.574 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-03-09T14:44:57.574 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-03-09T14:44:57.574 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-03-09T14:44:57.574 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:44:57.574 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-03-09T14:44:57.574 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:44:57.574 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-03-09T14:44:57.575 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-03-09T14:44:57.575 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-03-09T14:44:57.575 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-03-09T14:44:57.575 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-03-09T14:44:57.575 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-03-09T14:44:57.575 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:44:57.575 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-03-09T14:44:57.575 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-03-09T14:44:57.575 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:44:57.575 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-03-09T14:44:57.575 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-03-09T14:44:57.575 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-03-09T14:44:57.575 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-03-09T14:44:57.575 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-03-09T14:44:57.575 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-03-09T14:44:57.576 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-03-09T14:44:57.576 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-03-09T14:44:57.576 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-03-09T14:44:57.576 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-03-09T14:44:57.576 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-03-09T14:44:57.576 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-03-09T14:44:57.576 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:44:57.576 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7915ffb640 / http_manager 2024-03-09T14:44:57.576 INFO:tasks.workunit.client.0.smithi099.stderr: 7f791cfe1640 / http_manager 2024-03-09T14:44:57.576 INFO:tasks.workunit.client.0.smithi099.stderr: 7f791dfe3640 / rgw_dt_lg_renew 2024-03-09T14:44:57.576 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7948ff9640 / ms_dispatch 2024-03-09T14:44:57.576 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7949ffb640 / io_context_pool 2024-03-09T14:44:57.576 INFO:tasks.workunit.client.0.smithi099.stderr: 7f794a7fc640 / io_context_pool 2024-03-09T14:44:57.576 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7950e01640 / ms_dispatch 2024-03-09T14:44:57.576 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7953606640 / ms_dispatch 2024-03-09T14:44:57.577 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7954e09640 / io_context_pool 2024-03-09T14:44:57.577 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a6649b640 / msgr-worker-2 2024-03-09T14:44:57.577 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a66c9c640 / msgr-worker-1 2024-03-09T14:44:57.577 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a6749d640 / msgr-worker-0 2024-03-09T14:44:57.577 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a67c9e640 / io_context_pool 2024-03-09T14:44:57.577 INFO:tasks.workunit.client.0.smithi099.stderr: 7f7a69184980 / radosgw-admin 2024-03-09T14:44:57.577 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-03-09T14:44:57.577 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-03-09T14:44:57.577 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/lib/ceph/crash/2024-03-09T14:44:57.463459Z_12004119-4b3c-49ac-9c1b-0edc1a1cfe11/log 2024-03-09T14:44:57.577 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-03-09T14:44:57.577 INFO:tasks.workunit.client.0.smithi099.stderr:Aborted 2024-03-09T14:44:57.577 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-03-09T14:44:57.579 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:57.579 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:57.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.540+0000 7ffbb9332980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.540+0000 7ffbb9332980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.540+0000 7ffbb9332980 20 realm 2024-03-09T14:44:57.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.540+0000 7ffbb9332980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.544+0000 7ffbb9332980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.544+0000 7ffbb9332980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:57.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.544+0000 7ffbb9332980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.544+0000 7ffbb9332980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.544+0000 7ffbb9332980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.544+0000 7ffbb9332980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:57.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.544+0000 7ffbb9332980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.548+0000 7ffbb9332980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:57.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.548+0000 7ffbb9332980 20 searching for the correct realm 2024-03-09T14:44:57.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.548+0000 7ffbb764b640 0 -- 172.21.15.99:0/3769722075 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7ffbac04c040 msgr2=0x7ffbac04e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:57.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.764+0000 7ffbb6649640 0 -- 172.21.15.99:0/3769722075 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7ffbb0036940 msgr2=0x7ffbb004f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:57.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.980+0000 7ffbb9332980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:57.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.980+0000 7ffbb9332980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:57.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.980+0000 7ffbb9332980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:57.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.980+0000 7ffbb9332980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:57.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.980+0000 7ffbb9332980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:57.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.980+0000 7ffbb9332980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:57.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.980+0000 7ffbb9332980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.980+0000 7ffbb9332980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.980+0000 7ffbb9332980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.984+0000 7ffbb9332980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:57.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.984+0000 7ffbb9332980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.984+0000 7ffbb9332980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:57.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.984+0000 7ffbb9332980 20 zone default found 2024-03-09T14:44:57.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.984+0000 7ffbb9332980 4 Realm: () 2024-03-09T14:44:57.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.984+0000 7ffbb9332980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:57.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.984+0000 7ffbb9332980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:57.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.984+0000 7ffbb9332980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:57.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.984+0000 7ffbb9332980 20 zonegroup default 2024-03-09T14:44:57.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.984+0000 7ffbb9332980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.984+0000 7ffbb9332980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.980 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.984+0000 7ffbb9332980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.984+0000 7ffbb9332980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.984+0000 7ffbb9332980 20 rados->read ofs=0 len=0 2024-03-09T14:44:57.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.988+0000 7ffbb9332980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:57.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.988+0000 7ffbb9332980 20 started sync module instance, tier type = 2024-03-09T14:44:57.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:57.988+0000 7ffbb9332980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:58.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.012+0000 7ffbb9332980 20 add_watcher() i=0 2024-03-09T14:44:58.007 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.012+0000 7ffbb9332980 20 add_watcher() i=1 2024-03-09T14:44:58.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.012+0000 7ffbb9332980 20 add_watcher() i=2 2024-03-09T14:44:58.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.012+0000 7ffbb9332980 20 add_watcher() i=3 2024-03-09T14:44:58.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.012+0000 7ffbb9332980 20 add_watcher() i=4 2024-03-09T14:44:58.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.012+0000 7ffbb9332980 20 add_watcher() i=5 2024-03-09T14:44:58.008 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.012+0000 7ffbb9332980 20 add_watcher() i=6 2024-03-09T14:44:58.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.012+0000 7ffbb9332980 20 add_watcher() i=7 2024-03-09T14:44:58.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.012+0000 7ffbb9332980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:58.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.020+0000 7ffa6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:58.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.020+0000 7ffbb9332980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:58.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.020+0000 7ffbb9332980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:58.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.020+0000 7ffbb9332980 5 note: GC not initialized 2024-03-09T14:44:58.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.020+0000 7ff9e7fff640 20 reqs_thread_entry: start 2024-03-09T14:44:58.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.020+0000 7ffbb9332980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:58.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.020+0000 7ffbb9332980 20 Filter name: none 2024-03-09T14:44:58.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.020+0000 7ff9e5ffb640 20 reqs_thread_entry: start 2024-03-09T14:44:58.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.020+0000 7ffbb9332980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.020+0000 7ffbb9332980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:44:58.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.020+0000 7ffbb9332980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.024+0000 7ffbb9332980 20 rados_obj.operate() r=0 bl.length=459 2024-03-09T14:44:58.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.024+0000 7ffbb9332980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:58.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.024+0000 7ffbb9332980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.024+0000 7ffbb9332980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:44:58.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.024+0000 7ffbb9332980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.024+0000 7ffbb9332980 20 rados_obj.operate() r=0 bl.length=459 2024-03-09T14:44:58.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.024+0000 7ffbb9332980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:44:58.023 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.028+0000 7ffbb9332980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.028+0000 7ffbb9332980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:58.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.028+0000 7ffa6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:58.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.036+0000 7ffbb9332980 20 remove_watcher() i=0 2024-03-09T14:44:58.031 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.036+0000 7ffbb9332980 2 removed watcher, disabling cache 2024-03-09T14:44:58.033 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.036+0000 7ffbb9332980 20 remove_watcher() i=1 2024-03-09T14:44:58.036 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.040+0000 7ffbb9332980 20 remove_watcher() i=2 2024-03-09T14:44:58.038 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.040+0000 7ffbb9332980 20 remove_watcher() i=3 2024-03-09T14:44:58.040 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.044+0000 7ffbb9332980 20 remove_watcher() i=4 2024-03-09T14:44:58.042 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.048+0000 7ffbb9332980 20 remove_watcher() i=5 2024-03-09T14:44:58.043 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.048+0000 7ffbb9332980 20 remove_watcher() i=6 2024-03-09T14:44:58.046 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.048+0000 7ffbb9332980 20 remove_watcher() i=7 2024-03-09T14:44:58.062 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:58.062 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:44:58.063 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-block-writes id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:44:58.063 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:44:58.063 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:58.063 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:58.078 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:44:58.078 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:44:58.123 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:44:58.159 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:44:58.159 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:44:58.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.208+0000 7f9dd2d94980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.208+0000 7f9dd2d94980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:58.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.208+0000 7f9dd2d94980 20 realm 2024-03-09T14:44:58.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.208+0000 7f9dd2d94980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.208+0000 7f9dd2d94980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:58.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.208+0000 7f9dd2d94980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:44:58.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.208+0000 7f9dd2d94980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.208+0000 7f9dd2d94980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:58.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.208+0000 7f9dd2d94980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.212+0000 7f9dd2d94980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:58.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.212+0000 7f9dd2d94980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.212+0000 7f9dd2d94980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:44:58.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.212+0000 7f9dd2d94980 20 searching for the correct realm 2024-03-09T14:44:58.214 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.220+0000 7f9dd08ac640 0 -- 172.21.15.99:0/3583828230 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x55c5a5326ca0 msgr2=0x55c5a5329160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:58.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.224+0000 7f9dd00ab640 0 -- 172.21.15.99:0/3583828230 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f9dc01300d0 msgr2=0x7f9dc0109860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:44:58.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.232+0000 7f9dd2d94980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:44:58.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.232+0000 7f9dd2d94980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:44:58.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.232+0000 7f9dd2d94980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:44:58.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.232+0000 7f9dd2d94980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:44:58.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.232+0000 7f9dd2d94980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:44:58.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.232+0000 7f9dd2d94980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:44:58.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.232+0000 7f9dd2d94980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.232+0000 7f9dd2d94980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:58.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.232+0000 7f9dd2d94980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.232+0000 7f9dd2d94980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:44:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.232+0000 7f9dd2d94980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.236+0000 7f9dd2d94980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:44:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.236+0000 7f9dd2d94980 20 zone default found 2024-03-09T14:44:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.236+0000 7f9dd2d94980 4 Realm: () 2024-03-09T14:44:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.236+0000 7f9dd2d94980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:44:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.236+0000 7f9dd2d94980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:44:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.236+0000 7f9dd2d94980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:44:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.236+0000 7f9dd2d94980 20 zonegroup default 2024-03-09T14:44:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.236+0000 7f9dd2d94980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.236+0000 7f9dd2d94980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.236+0000 7f9dd2d94980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.236+0000 7f9dd2d94980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.236+0000 7f9dd2d94980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.236+0000 7f9dd2d94980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:44:58.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.236+0000 7f9dd2d94980 20 started sync module instance, tier type = 2024-03-09T14:44:58.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.236+0000 7f9dd2d94980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:44:58.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.252+0000 7f9dd2d94980 20 add_watcher() i=0 2024-03-09T14:44:58.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.252+0000 7f9dd2d94980 20 add_watcher() i=1 2024-03-09T14:44:58.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.252+0000 7f9dd2d94980 20 add_watcher() i=2 2024-03-09T14:44:58.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.252+0000 7f9dd2d94980 20 add_watcher() i=3 2024-03-09T14:44:58.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.252+0000 7f9dd2d94980 20 add_watcher() i=4 2024-03-09T14:44:58.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.252+0000 7f9dd2d94980 20 add_watcher() i=5 2024-03-09T14:44:58.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.252+0000 7f9dd2d94980 20 add_watcher() i=6 2024-03-09T14:44:58.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.252+0000 7f9dd2d94980 20 add_watcher() i=7 2024-03-09T14:44:58.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.252+0000 7f9dd2d94980 2 all 8 watchers are set, enabling cache 2024-03-09T14:44:58.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9c86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:58.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:44:58.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:44:58.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 5 note: GC not initialized 2024-03-09T14:44:58.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9c85fe3640 20 reqs_thread_entry: start 2024-03-09T14:44:58.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 20 init_complete bucket index max shards: 11 2024-03-09T14:44:58.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 20 Filter name: none 2024-03-09T14:44:58.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9bf77fe640 20 reqs_thread_entry: start 2024-03-09T14:44:58.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-09T14:44:58.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:44:58.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-09T14:44:58.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-09T14:44:58.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 : miss 2024-03-09T14:44:58.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 20 rados->read ofs=0 len=0 2024-03-09T14:44:58.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 20 rados_obj.operate() r=0 bl.length=459 2024-03-09T14:44:58.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 info.flags=0x17 2024-03-09T14:44:58.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 to cache LRU end 2024-03-09T14:44:58.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:44:58.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:44:58.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.256+0000 7f9dd2d94980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 2024-03-09T14:44:58.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.260+0000 7f9dd2d94980 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 to be held by another RGW process; skipping for now 2024-03-09T14:44:58.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.260+0000 7f9c86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:44:58.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.264+0000 7f9dd2d94980 20 remove_watcher() i=0 2024-03-09T14:44:58.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.264+0000 7f9dd2d94980 2 removed watcher, disabling cache 2024-03-09T14:44:58.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.268+0000 7f9dd2d94980 20 remove_watcher() i=1 2024-03-09T14:44:58.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.268+0000 7f9dd2d94980 20 remove_watcher() i=2 2024-03-09T14:44:58.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.272+0000 7f9dd2d94980 20 remove_watcher() i=3 2024-03-09T14:44:58.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.272+0000 7f9dd2d94980 20 remove_watcher() i=4 2024-03-09T14:44:58.270 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.276+0000 7f9dd2d94980 20 remove_watcher() i=5 2024-03-09T14:44:58.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.276+0000 7f9dd2d94980 20 remove_watcher() i=6 2024-03-09T14:44:58.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:44:58.276+0000 7f9dd2d94980 20 remove_watcher() i=7 2024-03-09T14:44:58.286 INFO:tasks.workunit.client.0.smithi099.stderr:waiting 30 seconds for reshard lock to expire... 2024-03-09T14:45:28.316 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:45:28.351 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:45:28.351 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:45:28.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.399+0000 7f16c2e9f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.403+0000 7f16c2e9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:28.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.403+0000 7f16c2e9f980 20 realm 2024-03-09T14:45:28.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.403+0000 7f16c2e9f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.403+0000 7f16c2e9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:28.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.403+0000 7f16c2e9f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:45:28.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.403+0000 7f16c2e9f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.403+0000 7f16c2e9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:28.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.403+0000 7f16c2e9f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.403+0000 7f16c2e9f980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:28.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.403+0000 7f16c2e9f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.403+0000 7f16c2e9f980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:45:28.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.403+0000 7f16c2e9f980 20 searching for the correct realm 2024-03-09T14:45:28.404 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.407+0000 7f16c11b8640 0 -- 172.21.15.99:0/879562950 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f16a803e020 msgr2=0x7f16a8048040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:45:28.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.619+0000 7f16c01b6640 0 -- 172.21.15.99:0/879562950 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f16b8108040 msgr2=0x7f16b80f9940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:28.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.635+0000 7f16c2e9f980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:45:28.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.635+0000 7f16c2e9f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:45:28.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.635+0000 7f16c2e9f980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:45:28.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.635+0000 7f16c2e9f980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:45:28.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.635+0000 7f16c2e9f980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:45:28.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.635+0000 7f16c2e9f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:45:28.634 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.635+0000 7f16c2e9f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.639+0000 7f16c2e9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:28.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.639+0000 7f16c2e9f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.639+0000 7f16c2e9f980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:28.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.639+0000 7f16c2e9f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.639+0000 7f16c2e9f980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:45:28.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.639+0000 7f16c2e9f980 20 zone default found 2024-03-09T14:45:28.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.639+0000 7f16c2e9f980 4 Realm: () 2024-03-09T14:45:28.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.639+0000 7f16c2e9f980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:45:28.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.639+0000 7f16c2e9f980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:45:28.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.639+0000 7f16c2e9f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:45:28.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.639+0000 7f16c2e9f980 20 zonegroup default 2024-03-09T14:45:28.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.639+0000 7f16c2e9f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.639+0000 7f16c2e9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:28.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.639+0000 7f16c2e9f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.639+0000 7f16c2e9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:28.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.639+0000 7f16c2e9f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.643+0000 7f16c2e9f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:28.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.643+0000 7f16c2e9f980 20 started sync module instance, tier type = 2024-03-09T14:45:28.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.643+0000 7f16c2e9f980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:45:28.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.667+0000 7f16c2e9f980 20 add_watcher() i=0 2024-03-09T14:45:28.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.667+0000 7f16c2e9f980 20 add_watcher() i=1 2024-03-09T14:45:28.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.667+0000 7f16c2e9f980 20 add_watcher() i=2 2024-03-09T14:45:28.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.667+0000 7f16c2e9f980 20 add_watcher() i=3 2024-03-09T14:45:28.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.667+0000 7f16c2e9f980 20 add_watcher() i=4 2024-03-09T14:45:28.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.667+0000 7f16c2e9f980 20 add_watcher() i=5 2024-03-09T14:45:28.664 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.667+0000 7f16c2e9f980 20 add_watcher() i=6 2024-03-09T14:45:28.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.667+0000 7f16c2e9f980 20 add_watcher() i=7 2024-03-09T14:45:28.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.667+0000 7f16c2e9f980 2 all 8 watchers are set, enabling cache 2024-03-09T14:45:28.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.671+0000 7f15777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:28.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.671+0000 7f16c2e9f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:45:28.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.671+0000 7f16c2e9f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:45:28.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f16c2e9f980 5 note: GC not initialized 2024-03-09T14:45:28.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f15767e4640 20 reqs_thread_entry: start 2024-03-09T14:45:28.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f16c2e9f980 20 init_complete bucket index max shards: 11 2024-03-09T14:45:28.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f16c2e9f980 20 Filter name: none 2024-03-09T14:45:28.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f156f7fe640 20 reqs_thread_entry: start 2024-03-09T14:45:28.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f16c2e9f980 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-03-09T14:45:28.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f16c2e9f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f16c2e9f980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:45:28.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f16c2e9f980 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-03-09T14:45:28.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f16c2e9f980 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-03-09T14:45:28.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f16c2e9f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 : miss 2024-03-09T14:45:28.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f16c2e9f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f16c2e9f980 20 rados_obj.operate() r=0 bl.length=459 2024-03-09T14:45:28.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f16c2e9f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 info.flags=0x17 2024-03-09T14:45:28.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f16c2e9f980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 to cache LRU end 2024-03-09T14:45:28.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f16c2e9f980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:45:28.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f16c2e9f980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:28.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.675+0000 7f16c2e9f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 2024-03-09T14:45:28.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.679+0000 7f16c2e9f980 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-03-09T14:45:28.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.695+0000 7f16c2e9f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 info.flags=0x17 2024-03-09T14:45:28.691 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.695+0000 7f16c2e9f980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 to cache LRU end 2024-03-09T14:45:28.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.695+0000 7f16c2e9f980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:28.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.695+0000 7f16c2e9f980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24, ofs0, ns] 2024-03-09T14:45:28.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.695+0000 7f1597fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464346 cookie 93826890216368 notifier 6296 bl.length()=991 2024-03-09T14:45:28.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.695+0000 7f1597fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 info.flags=0x17 2024-03-09T14:45:28.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.695+0000 7f1597fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 to cache LRU end 2024-03-09T14:45:28.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.695+0000 7f1597fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:28.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.695+0000 7f16c2e9f980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): orig_sources= new_sources= 2024-03-09T14:45:28.693 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.695+0000 7f16c2e9f980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): potential sources added=[] removed=[] 2024-03-09T14:45:28.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.695+0000 7f16c2e9f980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): orig_dests= new_dests= 2024-03-09T14:45:28.694 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.695+0000 7f16c2e9f980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): potential dests added=[] removed=[] 2024-03-09T14:45:28.700 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.0 2024-03-09T14:45:28.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.0 2024-03-09T14:45:28.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.1 2024-03-09T14:45:28.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.1 2024-03-09T14:45:28.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.2 2024-03-09T14:45:28.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.2 2024-03-09T14:45:28.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.3 2024-03-09T14:45:28.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.3 2024-03-09T14:45:28.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.4 2024-03-09T14:45:28.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.4 2024-03-09T14:45:28.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.5 2024-03-09T14:45:28.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.5 2024-03-09T14:45:28.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.6 2024-03-09T14:45:28.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.6 2024-03-09T14:45:28.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.7 2024-03-09T14:45:28.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.7 2024-03-09T14:45:28.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.8 2024-03-09T14:45:28.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.8 2024-03-09T14:45:28.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.9 2024-03-09T14:45:28.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.9 2024-03-09T14:45:28.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.10 2024-03-09T14:45:28.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.10 2024-03-09T14:45:28.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.11 2024-03-09T14:45:28.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2.11 2024-03-09T14:45:28.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.0 2024-03-09T14:45:28.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.703+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.1 2024-03-09T14:45:28.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.707+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.2 2024-03-09T14:45:28.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.707+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.3 2024-03-09T14:45:28.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.707+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.4 2024-03-09T14:45:28.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.711+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.5 2024-03-09T14:45:28.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.711+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.6 2024-03-09T14:45:28.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.711+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.7 2024-03-09T14:45:28.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.711+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.8 2024-03-09T14:45:28.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.711+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.9 2024-03-09T14:45:28.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.715+0000 7f16c2e9f980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24.10 2024-03-09T14:45:28.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.723+0000 7f16c2e9f980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 : hit (requested=0x17, cached=0x17) 2024-03-09T14:45:28.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.723+0000 7f16c2e9f980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 2024-03-09T14:45:28.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.727+0000 7f16c2e9f980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 info.flags=0x17 2024-03-09T14:45:28.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.727+0000 7f16c2e9f980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 to cache LRU end 2024-03-09T14:45:28.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.727+0000 7f16c2e9f980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:28.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.727+0000 7f16c2e9f980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24, ofs0, ns] 2024-03-09T14:45:28.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.727+0000 7f15977fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464347 cookie 93826890216368 notifier 6296 bl.length()=959 2024-03-09T14:45:28.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.727+0000 7f15977fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 info.flags=0x17 2024-03-09T14:45:28.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.727+0000 7f15977fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 to cache LRU end 2024-03-09T14:45:28.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.727+0000 7f15977fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:28.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.727+0000 7f16c2e9f980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): orig_sources= new_sources= 2024-03-09T14:45:28.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.727+0000 7f16c2e9f980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): potential sources added=[] removed=[] 2024-03-09T14:45:28.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.727+0000 7f16c2e9f980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): orig_dests= new_dests= 2024-03-09T14:45:28.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.727+0000 7f16c2e9f980 20 handle_bi_update(): bucket=:abort-at-block-writes[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24]): potential dests added=[] removed=[] 2024-03-09T14:45:28.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.731+0000 7f16c2e9f980 1 execute INFO: reshard of bucket "abort-at-block-writes" completed successfully 2024-03-09T14:45:28.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.739+0000 7f15777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:28.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.743+0000 7f16c2e9f980 20 remove_watcher() i=0 2024-03-09T14:45:28.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.743+0000 7f16c2e9f980 2 removed watcher, disabling cache 2024-03-09T14:45:28.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.743+0000 7f16c2e9f980 20 remove_watcher() i=1 2024-03-09T14:45:28.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.747+0000 7f16c2e9f980 20 remove_watcher() i=2 2024-03-09T14:45:28.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.747+0000 7f16c2e9f980 20 remove_watcher() i=3 2024-03-09T14:45:28.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.751+0000 7f16c2e9f980 20 remove_watcher() i=4 2024-03-09T14:45:28.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.751+0000 7f16c2e9f980 20 remove_watcher() i=5 2024-03-09T14:45:28.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.755+0000 7f16c2e9f980 20 remove_watcher() i=6 2024-03-09T14:45:28.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.755+0000 7f16c2e9f980 20 remove_watcher() i=7 2024-03-09T14:45:28.769 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-03-09T14:45:28.799 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:45:28.799 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:45:28.844 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.847+0000 7f71fff4b980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.847+0000 7f71fff4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:28.845 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.847+0000 7f71fff4b980 20 realm 2024-03-09T14:45:28.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.847+0000 7f71fff4b980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.851+0000 7f71fff4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:28.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.851+0000 7f71fff4b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:45:28.846 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.851+0000 7f71fff4b980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.851+0000 7f71fff4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:28.847 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.851+0000 7f71fff4b980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.851+0000 7f71fff4b980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:28.848 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.851+0000 7f71fff4b980 20 rados->read ofs=0 len=0 2024-03-09T14:45:28.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.851+0000 7f71fff4b980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:45:28.849 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.851+0000 7f71fff4b980 20 searching for the correct realm 2024-03-09T14:45:28.854 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:28.859+0000 7f71fd262640 0 -- 172.21.15.99:0/3546222976 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f71f006cc20 msgr2=0x7f71f0082300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:29.063 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.067+0000 7f71fd262640 0 -- 172.21.15.99:0/3546222976 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f71f80f6490 msgr2=0x7f71f8124690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:45:29.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.283+0000 7f71fff4b980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:45:29.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.283+0000 7f71fff4b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:45:29.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.283+0000 7f71fff4b980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:45:29.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.283+0000 7f71fff4b980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:45:29.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.283+0000 7f71fff4b980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:45:29.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.283+0000 7f71fff4b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:45:29.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.283+0000 7f71fff4b980 20 rados->read ofs=0 len=0 2024-03-09T14:45:29.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.287+0000 7f71fff4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:29.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.287+0000 7f71fff4b980 20 rados->read ofs=0 len=0 2024-03-09T14:45:29.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.287+0000 7f71fff4b980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:29.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.287+0000 7f71fff4b980 20 rados->read ofs=0 len=0 2024-03-09T14:45:29.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.287+0000 7f71fff4b980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:45:29.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.287+0000 7f71fff4b980 20 zone default found 2024-03-09T14:45:29.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.287+0000 7f71fff4b980 4 Realm: () 2024-03-09T14:45:29.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.287+0000 7f71fff4b980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:45:29.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.287+0000 7f71fff4b980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:45:29.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.287+0000 7f71fff4b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:45:29.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.287+0000 7f71fff4b980 20 zonegroup default 2024-03-09T14:45:29.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.287+0000 7f71fff4b980 20 rados->read ofs=0 len=0 2024-03-09T14:45:29.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.287+0000 7f71fff4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:29.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.287+0000 7f71fff4b980 20 rados->read ofs=0 len=0 2024-03-09T14:45:29.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.287+0000 7f71fff4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:29.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.287+0000 7f71fff4b980 20 rados->read ofs=0 len=0 2024-03-09T14:45:29.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.291+0000 7f71fff4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:29.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.291+0000 7f71fff4b980 20 started sync module instance, tier type = 2024-03-09T14:45:29.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.291+0000 7f71fff4b980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:45:29.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.311+0000 7f71fff4b980 20 add_watcher() i=0 2024-03-09T14:45:29.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.315+0000 7f71fff4b980 20 add_watcher() i=1 2024-03-09T14:45:29.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.315+0000 7f71fff4b980 20 add_watcher() i=2 2024-03-09T14:45:29.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.315+0000 7f71fff4b980 20 add_watcher() i=3 2024-03-09T14:45:29.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.315+0000 7f71fff4b980 20 add_watcher() i=4 2024-03-09T14:45:29.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.315+0000 7f71fff4b980 20 add_watcher() i=5 2024-03-09T14:45:29.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.315+0000 7f71fff4b980 20 add_watcher() i=6 2024-03-09T14:45:29.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.315+0000 7f71fff4b980 20 add_watcher() i=7 2024-03-09T14:45:29.313 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.315+0000 7f71fff4b980 2 all 8 watchers are set, enabling cache 2024-03-09T14:45:29.317 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.319+0000 7f70af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:29.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.323+0000 7f71fff4b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:45:29.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.323+0000 7f71fff4b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:45:29.318 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.323+0000 7f71fff4b980 5 note: GC not initialized 2024-03-09T14:45:29.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.323+0000 7f70ae7fc640 20 reqs_thread_entry: start 2024-03-09T14:45:29.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.323+0000 7f71fff4b980 20 init_complete bucket index max shards: 11 2024-03-09T14:45:29.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.323+0000 7f71fff4b980 20 Filter name: none 2024-03-09T14:45:29.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.323+0000 7f701ffff640 20 reqs_thread_entry: start 2024-03-09T14:45:29.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.323+0000 7f71fff4b980 20 rados->read ofs=0 len=0 2024-03-09T14:45:29.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.323+0000 7f71fff4b980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:45:29.320 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.323+0000 7f71fff4b980 20 rados->read ofs=0 len=0 2024-03-09T14:45:29.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.323+0000 7f71fff4b980 20 rados_obj.operate() r=0 bl.length=427 2024-03-09T14:45:29.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.323+0000 7f71fff4b980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:45:29.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.323+0000 7f71fff4b980 20 rados->read ofs=0 len=0 2024-03-09T14:45:29.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.327+0000 7f71fff4b980 20 rados_obj.operate() r=0 bl.length=213 2024-03-09T14:45:29.322 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.327+0000 7f71fff4b980 20 rados->read ofs=0 len=0 2024-03-09T14:45:29.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.327+0000 7f71fff4b980 20 rados_obj.operate() r=0 bl.length=427 2024-03-09T14:45:29.323 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.327+0000 7f71fff4b980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:45:29.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.327+0000 7f71fff4b980 20 rados->read ofs=0 len=0 2024-03-09T14:45:29.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.327+0000 7f71fff4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:29.327 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.331+0000 7f70af7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:29.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.335+0000 7f71fff4b980 20 remove_watcher() i=0 2024-03-09T14:45:29.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.335+0000 7f71fff4b980 2 removed watcher, disabling cache 2024-03-09T14:45:29.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.339+0000 7f71fff4b980 20 remove_watcher() i=1 2024-03-09T14:45:29.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.339+0000 7f71fff4b980 20 remove_watcher() i=2 2024-03-09T14:45:29.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.343+0000 7f71fff4b980 20 remove_watcher() i=3 2024-03-09T14:45:29.341 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.343+0000 7f71fff4b980 20 remove_watcher() i=4 2024-03-09T14:45:29.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.347+0000 7f71fff4b980 20 remove_watcher() i=5 2024-03-09T14:45:29.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.347+0000 7f71fff4b980 20 remove_watcher() i=6 2024-03-09T14:45:29.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:29.347+0000 7f71fff4b980 20 remove_watcher() i=7 2024-03-09T14:45:29.360 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:29.360 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:45:29.360 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-block-writes id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-09T14:45:29.360 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:29.361 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.362 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.365 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.365 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.460 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.460 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.530 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-03-09T14:45:29.530 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:29.533 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.533 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.562 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.562 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.610 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.610 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.632 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.632 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.655 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.655 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.676 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.676 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.697 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.697 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.718 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.718 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.739 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.739 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.760 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.761 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.782 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.782 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.803 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.803 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.825 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.825 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.847 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.847 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.867 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.868 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.891 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.892 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.913 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.913 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.936 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.936 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.956 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.956 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:29.977 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:29.978 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:30.002 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:30.002 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:30.025 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:30.025 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:30.044 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-09T14:45:30.074 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:45:30.075 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:45:30.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.123+0000 7f1a782fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.127+0000 7f1a782fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.127+0000 7f1a782fe980 20 realm 2024-03-09T14:45:30.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.127+0000 7f1a782fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.127+0000 7f1a782fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.127+0000 7f1a782fe980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:45:30.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.127+0000 7f1a782fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.122 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.127+0000 7f1a782fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.123 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.127+0000 7f1a782fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.127+0000 7f1a782fe980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:30.124 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.127+0000 7f1a782fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.131+0000 7f1a782fe980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:45:30.126 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.131+0000 7f1a782fe980 20 searching for the correct realm 2024-03-09T14:45:30.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.131+0000 7f1a76617640 0 -- 172.21.15.99:0/3611439161 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f1a6c031060 msgr2=0x7f1a6c05a680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:45:30.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.139+0000 7f1a75615640 0 -- 172.21.15.99:0/3611439161 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f1a700b83f0 msgr2=0x7f1a700b8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:30.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.355+0000 7f1a782fe980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:45:30.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.355+0000 7f1a782fe980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:45:30.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.355+0000 7f1a782fe980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:45:30.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.355+0000 7f1a782fe980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:45:30.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.355+0000 7f1a782fe980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:45:30.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.355+0000 7f1a782fe980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:45:30.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.355+0000 7f1a782fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.355+0000 7f1a782fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.355+0000 7f1a782fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.355+0000 7f1a782fe980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:30.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.355+0000 7f1a782fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.359+0000 7f1a782fe980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:45:30.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.359+0000 7f1a782fe980 20 zone default found 2024-03-09T14:45:30.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.359+0000 7f1a782fe980 4 Realm: () 2024-03-09T14:45:30.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.359+0000 7f1a782fe980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:45:30.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.359+0000 7f1a782fe980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:45:30.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.359+0000 7f1a782fe980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:45:30.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.359+0000 7f1a782fe980 20 zonegroup default 2024-03-09T14:45:30.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.359+0000 7f1a782fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.359+0000 7f1a782fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.359+0000 7f1a782fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.359+0000 7f1a782fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.359+0000 7f1a782fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.359+0000 7f1a782fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.359+0000 7f1a782fe980 20 started sync module instance, tier type = 2024-03-09T14:45:30.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.359+0000 7f1a782fe980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:45:30.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.379+0000 7f1a782fe980 20 add_watcher() i=0 2024-03-09T14:45:30.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.379+0000 7f1a782fe980 20 add_watcher() i=1 2024-03-09T14:45:30.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.379+0000 7f1a782fe980 20 add_watcher() i=2 2024-03-09T14:45:30.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.379+0000 7f1a782fe980 20 add_watcher() i=3 2024-03-09T14:45:30.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.379+0000 7f1a782fe980 20 add_watcher() i=4 2024-03-09T14:45:30.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.379+0000 7f1a782fe980 20 add_watcher() i=5 2024-03-09T14:45:30.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.383+0000 7f1a782fe980 20 add_watcher() i=6 2024-03-09T14:45:30.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.383+0000 7f1a782fe980 20 add_watcher() i=7 2024-03-09T14:45:30.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.383+0000 7f1a782fe980 2 all 8 watchers are set, enabling cache 2024-03-09T14:45:30.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.387+0000 7f192bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:30.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.387+0000 7f1a782fe980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:45:30.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.387+0000 7f1a782fe980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:45:30.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.387+0000 7f1a782fe980 5 note: GC not initialized 2024-03-09T14:45:30.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.387+0000 7f192afe5640 20 reqs_thread_entry: start 2024-03-09T14:45:30.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.387+0000 7f1a782fe980 20 init_complete bucket index max shards: 11 2024-03-09T14:45:30.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.387+0000 7f1a782fe980 20 Filter name: none 2024-03-09T14:45:30.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.391+0000 7f1928fe1640 20 reqs_thread_entry: start 2024-03-09T14:45:30.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.391+0000 7f1a782fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.391+0000 7f1a782fe980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:30.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.391+0000 7f1a782fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.391+0000 7f1a782fe980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:45:30.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.391+0000 7f1a782fe980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:45:30.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.391+0000 7f1a782fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.391+0000 7f1a782fe980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:30.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.391+0000 7f1a782fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.391+0000 7f1a782fe980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:45:30.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.391+0000 7f1a782fe980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:45:30.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.395+0000 7f1a782fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.395+0000 7f1a782fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.395+0000 7f192bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:30.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.399+0000 7f1a782fe980 20 remove_watcher() i=0 2024-03-09T14:45:30.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.399+0000 7f1a782fe980 2 removed watcher, disabling cache 2024-03-09T14:45:30.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.403+0000 7f1a782fe980 20 remove_watcher() i=1 2024-03-09T14:45:30.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.407+0000 7f1a782fe980 20 remove_watcher() i=2 2024-03-09T14:45:30.405 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.407+0000 7f1a782fe980 20 remove_watcher() i=3 2024-03-09T14:45:30.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.411+0000 7f1a782fe980 20 remove_watcher() i=4 2024-03-09T14:45:30.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.411+0000 7f1a782fe980 20 remove_watcher() i=5 2024-03-09T14:45:30.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.411+0000 7f1a782fe980 20 remove_watcher() i=6 2024-03-09T14:45:30.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.415+0000 7f1a782fe980 20 remove_watcher() i=7 2024-03-09T14:45:30.426 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:30.426 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:45:30.426 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-commit-target-layout id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:45:30.426 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:30.426 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-03-09T14:45:30.458 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:45:30.458 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:45:30.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.503+0000 7fc9dd740980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.507+0000 7fc9dd740980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.507+0000 7fc9dd740980 20 realm 2024-03-09T14:45:30.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.507+0000 7fc9dd740980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.507+0000 7fc9dd740980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.507+0000 7fc9dd740980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:45:30.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.507+0000 7fc9dd740980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.507+0000 7fc9dd740980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.507+0000 7fc9dd740980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.511+0000 7fc9dd740980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:30.506 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.511+0000 7fc9dd740980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.507 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.511+0000 7fc9dd740980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:45:30.508 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.511+0000 7fc9dd740980 20 searching for the correct realm 2024-03-09T14:45:30.510 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.515+0000 7fc9dba59640 0 -- 172.21.15.99:0/1507740589 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7fc9d00c9040 msgr2=0x7fc9d00e3450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:30.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.523+0000 7fc9daa57640 0 -- 172.21.15.99:0/1507740589 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fc9d40511b0 msgr2=0x7fc9d403c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:30.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.739+0000 7fc9dd740980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:45:30.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.739+0000 7fc9dd740980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:45:30.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.739+0000 7fc9dd740980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:45:30.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.739+0000 7fc9dd740980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:45:30.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.739+0000 7fc9dd740980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:45:30.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.739+0000 7fc9dd740980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:45:30.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.739+0000 7fc9dd740980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.739+0000 7fc9dd740980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.739+0000 7fc9dd740980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.743+0000 7fc9dd740980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:30.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.743+0000 7fc9dd740980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.743+0000 7fc9dd740980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:45:30.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.743+0000 7fc9dd740980 20 zone default found 2024-03-09T14:45:30.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.743+0000 7fc9dd740980 4 Realm: () 2024-03-09T14:45:30.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.743+0000 7fc9dd740980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:45:30.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.743+0000 7fc9dd740980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:45:30.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.743+0000 7fc9dd740980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:45:30.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.743+0000 7fc9dd740980 20 zonegroup default 2024-03-09T14:45:30.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.743+0000 7fc9dd740980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.743+0000 7fc9dd740980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.740 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.743+0000 7fc9dd740980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.743+0000 7fc9dd740980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.741 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.743+0000 7fc9dd740980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.743+0000 7fc9dd740980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.743+0000 7fc9dd740980 20 started sync module instance, tier type = 2024-03-09T14:45:30.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.743+0000 7fc9dd740980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:45:30.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.767+0000 7fc9dd740980 20 add_watcher() i=0 2024-03-09T14:45:30.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.767+0000 7fc9dd740980 20 add_watcher() i=1 2024-03-09T14:45:30.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.767+0000 7fc9dd740980 20 add_watcher() i=2 2024-03-09T14:45:30.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.767+0000 7fc9dd740980 20 add_watcher() i=3 2024-03-09T14:45:30.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.767+0000 7fc9dd740980 20 add_watcher() i=4 2024-03-09T14:45:30.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.767+0000 7fc9dd740980 20 add_watcher() i=5 2024-03-09T14:45:30.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.767+0000 7fc9dd740980 20 add_watcher() i=6 2024-03-09T14:45:30.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.771+0000 7fc9dd740980 20 add_watcher() i=7 2024-03-09T14:45:30.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.771+0000 7fc9dd740980 2 all 8 watchers are set, enabling cache 2024-03-09T14:45:30.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.775+0000 7fc891fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:30.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.775+0000 7fc9dd740980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:45:30.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.775+0000 7fc9dd740980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:45:30.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.775+0000 7fc9dd740980 5 note: GC not initialized 2024-03-09T14:45:30.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.775+0000 7fc890fe1640 20 reqs_thread_entry: start 2024-03-09T14:45:30.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.775+0000 7fc9dd740980 20 init_complete bucket index max shards: 11 2024-03-09T14:45:30.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.775+0000 7fc9dd740980 20 Filter name: none 2024-03-09T14:45:30.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.775+0000 7fc80a7fc640 20 reqs_thread_entry: start 2024-03-09T14:45:30.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.775+0000 7fc9dd740980 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-03-09T14:45:30.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.775+0000 7fc9dd740980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.779+0000 7fc9dd740980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:30.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.779+0000 7fc9dd740980 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-03-09T14:45:30.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.779+0000 7fc9dd740980 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-03-09T14:45:30.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.779+0000 7fc9dd740980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 : miss 2024-03-09T14:45:30.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.779+0000 7fc9dd740980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.779+0000 7fc9dd740980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:45:30.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.779+0000 7fc9dd740980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 info.flags=0x17 2024-03-09T14:45:30.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.779+0000 7fc9dd740980 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 to cache LRU end 2024-03-09T14:45:30.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.779+0000 7fc9dd740980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:45:30.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.779+0000 7fc9dd740980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:30.777 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.779+0000 7fc9dd740980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 2024-03-09T14:45:30.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.791+0000 7fc9dd740980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 info.flags=0x17 2024-03-09T14:45:30.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.791+0000 7fc9dd740980 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 to cache LRU end 2024-03-09T14:45:30.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.791+0000 7fc9dd740980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:30.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.791+0000 7fc9dd740980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25, ofs0, ns] 2024-03-09T14:45:30.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.791+0000 7fc8beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464352 cookie 94829498483840 notifier 6633 bl.length()=1007 2024-03-09T14:45:30.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.791+0000 7fc8beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 info.flags=0x17 2024-03-09T14:45:30.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.791+0000 7fc8beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 to cache LRU end 2024-03-09T14:45:30.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.791+0000 7fc8beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:30.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.791+0000 7fc9dd740980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25]): orig_sources= new_sources= 2024-03-09T14:45:30.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.791+0000 7fc9dd740980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25]): potential sources added=[] removed=[] 2024-03-09T14:45:30.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.791+0000 7fc9dd740980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25]): orig_dests= new_dests= 2024-03-09T14:45:30.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.791+0000 7fc9dd740980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25]): potential dests added=[] removed=[] 2024-03-09T14:45:30.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.0 2024-03-09T14:45:30.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.0 2024-03-09T14:45:30.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.1 2024-03-09T14:45:30.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.1 2024-03-09T14:45:30.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.2 2024-03-09T14:45:30.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.2 2024-03-09T14:45:30.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.3 2024-03-09T14:45:30.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.3 2024-03-09T14:45:30.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.4 2024-03-09T14:45:30.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.4 2024-03-09T14:45:30.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.5 2024-03-09T14:45:30.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.5 2024-03-09T14:45:30.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.6 2024-03-09T14:45:30.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.6 2024-03-09T14:45:30.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.7 2024-03-09T14:45:30.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.7 2024-03-09T14:45:30.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.8 2024-03-09T14:45:30.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.8 2024-03-09T14:45:30.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.9 2024-03-09T14:45:30.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.9 2024-03-09T14:45:30.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.10 2024-03-09T14:45:30.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.10 2024-03-09T14:45:30.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.11 2024-03-09T14:45:30.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1.11 2024-03-09T14:45:30.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.0 2024-03-09T14:45:30.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1 2024-03-09T14:45:30.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.799+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2 2024-03-09T14:45:30.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.803+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.3 2024-03-09T14:45:30.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.803+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.4 2024-03-09T14:45:30.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.803+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.5 2024-03-09T14:45:30.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.803+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.6 2024-03-09T14:45:30.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.807+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.7 2024-03-09T14:45:30.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.807+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.8 2024-03-09T14:45:30.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.807+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.9 2024-03-09T14:45:30.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.807+0000 7fc9dd740980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.10 2024-03-09T14:45:30.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.815+0000 7fc9dd740980 -1 Injecting error=-5 at location=commit_target_layout 2024-03-09T14:45:30.813 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.815+0000 7fc9dd740980 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-03-09T14:45:30.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.823+0000 7fc891fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:30.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.827+0000 7fc9dd740980 20 remove_watcher() i=0 2024-03-09T14:45:30.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.827+0000 7fc9dd740980 2 removed watcher, disabling cache 2024-03-09T14:45:30.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.831+0000 7fc9dd740980 20 remove_watcher() i=1 2024-03-09T14:45:30.830 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.835+0000 7fc9dd740980 20 remove_watcher() i=2 2024-03-09T14:45:30.832 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.835+0000 7fc9dd740980 20 remove_watcher() i=3 2024-03-09T14:45:30.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.839+0000 7fc9dd740980 20 remove_watcher() i=4 2024-03-09T14:45:30.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.839+0000 7fc9dd740980 20 remove_watcher() i=5 2024-03-09T14:45:30.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.839+0000 7fc9dd740980 20 remove_watcher() i=6 2024-03-09T14:45:30.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.843+0000 7fc9dd740980 20 remove_watcher() i=7 2024-03-09T14:45:30.853 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-09T14:45:30.880 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:45:30.880 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:45:30.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.927+0000 7f75cdf98980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.931+0000 7f75cdf98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.931+0000 7f75cdf98980 20 realm 2024-03-09T14:45:30.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.931+0000 7f75cdf98980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.931+0000 7f75cdf98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.931+0000 7f75cdf98980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:45:30.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.931+0000 7f75cdf98980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.931+0000 7f75cdf98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:30.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.931+0000 7f75cdf98980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.931+0000 7f75cdf98980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:30.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.931+0000 7f75cdf98980 20 rados->read ofs=0 len=0 2024-03-09T14:45:30.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.931+0000 7f75cdf98980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:45:30.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.931+0000 7f75cdf98980 20 searching for the correct realm 2024-03-09T14:45:30.933 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.935+0000 7f75cc2b1640 0 -- 172.21.15.99:0/3684951174 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x562c39885af0 msgr2=0x562c39887ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:30.940 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:30.943+0000 7f75cb2af640 0 -- 172.21.15.99:0/3684951174 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f75bc0ad320 msgr2=0x7f75bc12c940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:45:31.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.159+0000 7f75cdf98980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:45:31.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.159+0000 7f75cdf98980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:45:31.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.159+0000 7f75cdf98980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:45:31.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.159+0000 7f75cdf98980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:45:31.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.159+0000 7f75cdf98980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:45:31.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.159+0000 7f75cdf98980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:45:31.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.159+0000 7f75cdf98980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.163+0000 7f75cdf98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.163+0000 7f75cdf98980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.163+0000 7f75cdf98980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:31.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.163+0000 7f75cdf98980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.163+0000 7f75cdf98980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:45:31.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.163+0000 7f75cdf98980 20 zone default found 2024-03-09T14:45:31.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.163+0000 7f75cdf98980 4 Realm: () 2024-03-09T14:45:31.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.163+0000 7f75cdf98980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:45:31.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.163+0000 7f75cdf98980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:45:31.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.163+0000 7f75cdf98980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:45:31.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.163+0000 7f75cdf98980 20 zonegroup default 2024-03-09T14:45:31.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.163+0000 7f75cdf98980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.163+0000 7f75cdf98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.163+0000 7f75cdf98980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.163+0000 7f75cdf98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.163+0000 7f75cdf98980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.167+0000 7f75cdf98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.167+0000 7f75cdf98980 20 started sync module instance, tier type = 2024-03-09T14:45:31.162 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.167+0000 7f75cdf98980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:45:31.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.191+0000 7f75cdf98980 20 add_watcher() i=0 2024-03-09T14:45:31.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.191+0000 7f75cdf98980 20 add_watcher() i=1 2024-03-09T14:45:31.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.191+0000 7f75cdf98980 20 add_watcher() i=2 2024-03-09T14:45:31.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.191+0000 7f75cdf98980 20 add_watcher() i=3 2024-03-09T14:45:31.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.191+0000 7f75cdf98980 20 add_watcher() i=4 2024-03-09T14:45:31.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.191+0000 7f75cdf98980 20 add_watcher() i=5 2024-03-09T14:45:31.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.191+0000 7f75cdf98980 20 add_watcher() i=6 2024-03-09T14:45:31.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.191+0000 7f75cdf98980 20 add_watcher() i=7 2024-03-09T14:45:31.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.191+0000 7f75cdf98980 2 all 8 watchers are set, enabling cache 2024-03-09T14:45:31.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.199+0000 7f7481fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:31.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.199+0000 7f75cdf98980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:45:31.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.199+0000 7f75cdf98980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:45:31.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.199+0000 7f75cdf98980 5 note: GC not initialized 2024-03-09T14:45:31.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.199+0000 7f7480fe1640 20 reqs_thread_entry: start 2024-03-09T14:45:31.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.199+0000 7f75cdf98980 20 init_complete bucket index max shards: 11 2024-03-09T14:45:31.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.199+0000 7f75cdf98980 20 Filter name: none 2024-03-09T14:45:31.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.199+0000 7f73fa7fc640 20 reqs_thread_entry: start 2024-03-09T14:45:31.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.199+0000 7f75cdf98980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.199+0000 7f75cdf98980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:31.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.199+0000 7f75cdf98980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.203+0000 7f75cdf98980 20 rados_obj.operate() r=0 bl.length=467 2024-03-09T14:45:31.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.203+0000 7f75cdf98980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:45:31.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.203+0000 7f75cdf98980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.203+0000 7f75cdf98980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:31.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.203+0000 7f75cdf98980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.203+0000 7f75cdf98980 20 rados_obj.operate() r=0 bl.length=467 2024-03-09T14:45:31.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.203+0000 7f75cdf98980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:45:31.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.207+0000 7f75cdf98980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.207+0000 7f75cdf98980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.207+0000 7f7481fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:31.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.211+0000 7f75cdf98980 20 remove_watcher() i=0 2024-03-09T14:45:31.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.211+0000 7f75cdf98980 2 removed watcher, disabling cache 2024-03-09T14:45:31.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.215+0000 7f75cdf98980 20 remove_watcher() i=1 2024-03-09T14:45:31.213 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.215+0000 7f75cdf98980 20 remove_watcher() i=2 2024-03-09T14:45:31.215 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.219+0000 7f75cdf98980 20 remove_watcher() i=3 2024-03-09T14:45:31.217 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.219+0000 7f75cdf98980 20 remove_watcher() i=4 2024-03-09T14:45:31.219 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.223+0000 7f75cdf98980 20 remove_watcher() i=5 2024-03-09T14:45:31.221 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.223+0000 7f75cdf98980 20 remove_watcher() i=6 2024-03-09T14:45:31.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.227+0000 7f75cdf98980 20 remove_watcher() i=7 2024-03-09T14:45:31.239 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:31.239 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:45:31.239 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-commit-target-layout id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:45:31.239 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:31.241 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:31.241 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:31.255 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:31.256 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:31.303 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:45:31.337 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:45:31.337 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:45:31.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.383+0000 7f13661fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.387+0000 7f13661fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.387+0000 7f13661fe980 20 realm 2024-03-09T14:45:31.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.387+0000 7f13661fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.387+0000 7f13661fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.387+0000 7f13661fe980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:45:31.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.387+0000 7f13661fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.387+0000 7f13661fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.384 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.387+0000 7f13661fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.387+0000 7f13661fe980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:31.386 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.387+0000 7f13661fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.391+0000 7f13661fe980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:45:31.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.391+0000 7f13661fe980 20 searching for the correct realm 2024-03-09T14:45:31.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.395+0000 7f1363d16640 0 -- 172.21.15.99:0/3396534166 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x556ce5995e60 msgr2=0x556ce5998320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:31.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.403+0000 7f1363515640 0 -- 172.21.15.99:0/3396534166 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f135c0c2040 msgr2=0x7f135c0e6940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:31.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:45:31.407 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:45:31.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:45:31.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:45:31.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:45:31.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:45:31.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.408 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.409 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:31.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:45:31.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 zone default found 2024-03-09T14:45:31.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 4 Realm: () 2024-03-09T14:45:31.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:45:31.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:45:31.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:45:31.412 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 zonegroup default 2024-03-09T14:45:31.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.413 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 started sync module instance, tier type = 2024-03-09T14:45:31.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.411+0000 7f13661fe980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:45:31.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.427+0000 7f13661fe980 20 add_watcher() i=0 2024-03-09T14:45:31.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.427+0000 7f13661fe980 20 add_watcher() i=1 2024-03-09T14:45:31.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.427+0000 7f13661fe980 20 add_watcher() i=2 2024-03-09T14:45:31.425 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.427+0000 7f13661fe980 20 add_watcher() i=3 2024-03-09T14:45:31.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.427+0000 7f13661fe980 20 add_watcher() i=4 2024-03-09T14:45:31.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.427+0000 7f13661fe980 20 add_watcher() i=5 2024-03-09T14:45:31.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.427+0000 7f13661fe980 20 add_watcher() i=6 2024-03-09T14:45:31.431 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.431+0000 7f13661fe980 20 add_watcher() i=7 2024-03-09T14:45:31.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.431+0000 7f13661fe980 2 all 8 watchers are set, enabling cache 2024-03-09T14:45:31.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.431+0000 7f121a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:31.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.431+0000 7f13661fe980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:45:31.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.431+0000 7f13661fe980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:45:31.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.431+0000 7f13661fe980 5 note: GC not initialized 2024-03-09T14:45:31.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.431+0000 7f12197e2640 20 reqs_thread_entry: start 2024-03-09T14:45:31.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.431+0000 7f13661fe980 20 init_complete bucket index max shards: 11 2024-03-09T14:45:31.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.431+0000 7f13661fe980 20 Filter name: none 2024-03-09T14:45:31.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.431+0000 7f12127fc640 20 reqs_thread_entry: start 2024-03-09T14:45:31.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.431+0000 7f13661fe980 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-03-09T14:45:31.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.431+0000 7f13661fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.435+0000 7f13661fe980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:31.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.435+0000 7f13661fe980 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-03-09T14:45:31.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.435+0000 7f13661fe980 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-03-09T14:45:31.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.435+0000 7f13661fe980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 : miss 2024-03-09T14:45:31.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.435+0000 7f13661fe980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.435+0000 7f13661fe980 20 rados_obj.operate() r=0 bl.length=467 2024-03-09T14:45:31.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.435+0000 7f13661fe980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 info.flags=0x17 2024-03-09T14:45:31.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.435+0000 7f13661fe980 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 to cache LRU end 2024-03-09T14:45:31.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.435+0000 7f13661fe980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:45:31.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.435+0000 7f13661fe980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:31.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.435+0000 7f13661fe980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 2024-03-09T14:45:31.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.435+0000 7f13661fe980 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-03-09T14:45:31.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.451+0000 7f13661fe980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 info.flags=0x17 2024-03-09T14:45:31.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.451+0000 7f13661fe980 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 to cache LRU end 2024-03-09T14:45:31.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.451+0000 7f13661fe980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:31.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.451+0000 7f13661fe980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25, ofs0, ns] 2024-03-09T14:45:31.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.451+0000 7f1242ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464353 cookie 93926196883616 notifier 6386 bl.length()=1007 2024-03-09T14:45:31.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.451+0000 7f1242ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 info.flags=0x17 2024-03-09T14:45:31.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.451+0000 7f1242ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 to cache LRU end 2024-03-09T14:45:31.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.451+0000 7f1242ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:31.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.451+0000 7f13661fe980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25]): orig_sources= new_sources= 2024-03-09T14:45:31.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.451+0000 7f13661fe980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25]): potential sources added=[] removed=[] 2024-03-09T14:45:31.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.451+0000 7f13661fe980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25]): orig_dests= new_dests= 2024-03-09T14:45:31.448 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.451+0000 7f13661fe980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25]): potential dests added=[] removed=[] 2024-03-09T14:45:31.454 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.0 2024-03-09T14:45:31.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.0 2024-03-09T14:45:31.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.1 2024-03-09T14:45:31.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.1 2024-03-09T14:45:31.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.2 2024-03-09T14:45:31.455 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.2 2024-03-09T14:45:31.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.3 2024-03-09T14:45:31.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.3 2024-03-09T14:45:31.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.4 2024-03-09T14:45:31.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.4 2024-03-09T14:45:31.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.5 2024-03-09T14:45:31.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.5 2024-03-09T14:45:31.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.6 2024-03-09T14:45:31.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.6 2024-03-09T14:45:31.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.7 2024-03-09T14:45:31.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.7 2024-03-09T14:45:31.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.8 2024-03-09T14:45:31.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.8 2024-03-09T14:45:31.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.9 2024-03-09T14:45:31.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.9 2024-03-09T14:45:31.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.10 2024-03-09T14:45:31.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.10 2024-03-09T14:45:31.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.11 2024-03-09T14:45:31.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2.11 2024-03-09T14:45:31.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.0 2024-03-09T14:45:31.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.1 2024-03-09T14:45:31.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.459+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.2 2024-03-09T14:45:31.459 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.463+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.3 2024-03-09T14:45:31.460 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.463+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.4 2024-03-09T14:45:31.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.463+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.5 2024-03-09T14:45:31.462 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.467+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.6 2024-03-09T14:45:31.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.467+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.7 2024-03-09T14:45:31.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.467+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.8 2024-03-09T14:45:31.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.467+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.9 2024-03-09T14:45:31.466 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.471+0000 7f13661fe980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25.10 2024-03-09T14:45:31.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.475+0000 7f13661fe980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 : hit (requested=0x17, cached=0x17) 2024-03-09T14:45:31.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.475+0000 7f13661fe980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 2024-03-09T14:45:31.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.479+0000 7f13661fe980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 info.flags=0x17 2024-03-09T14:45:31.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.479+0000 7f13661fe980 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 to cache LRU end 2024-03-09T14:45:31.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.479+0000 7f13661fe980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:31.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.479+0000 7f13661fe980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25, ofs0, ns] 2024-03-09T14:45:31.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.479+0000 7f12427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464354 cookie 93926196883616 notifier 6386 bl.length()=975 2024-03-09T14:45:31.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.479+0000 7f12427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 info.flags=0x17 2024-03-09T14:45:31.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.479+0000 7f12427fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 to cache LRU end 2024-03-09T14:45:31.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.479+0000 7f12427fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:31.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.479+0000 7f13661fe980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25]): orig_sources= new_sources= 2024-03-09T14:45:31.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.479+0000 7f13661fe980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25]): potential sources added=[] removed=[] 2024-03-09T14:45:31.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.479+0000 7f13661fe980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25]): orig_dests= new_dests= 2024-03-09T14:45:31.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.479+0000 7f13661fe980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25]): potential dests added=[] removed=[] 2024-03-09T14:45:31.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.487+0000 7f13661fe980 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-03-09T14:45:31.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.491+0000 7f121a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:31.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.495+0000 7f13661fe980 20 remove_watcher() i=0 2024-03-09T14:45:31.491 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.495+0000 7f13661fe980 2 removed watcher, disabling cache 2024-03-09T14:45:31.493 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.495+0000 7f13661fe980 20 remove_watcher() i=1 2024-03-09T14:45:31.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.499+0000 7f13661fe980 20 remove_watcher() i=2 2024-03-09T14:45:31.497 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.499+0000 7f13661fe980 20 remove_watcher() i=3 2024-03-09T14:45:31.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.503+0000 7f13661fe980 20 remove_watcher() i=4 2024-03-09T14:45:31.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.503+0000 7f13661fe980 20 remove_watcher() i=5 2024-03-09T14:45:31.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.507+0000 7f13661fe980 20 remove_watcher() i=6 2024-03-09T14:45:31.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.507+0000 7f13661fe980 20 remove_watcher() i=7 2024-03-09T14:45:31.518 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-09T14:45:31.544 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:45:31.544 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:45:31.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.591+0000 7fced8cc7980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.595+0000 7fced8cc7980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.595+0000 7fced8cc7980 20 realm 2024-03-09T14:45:31.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.595+0000 7fced8cc7980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.595+0000 7fced8cc7980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.595+0000 7fced8cc7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:45:31.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.595+0000 7fced8cc7980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.595+0000 7fced8cc7980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.595+0000 7fced8cc7980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.595+0000 7fced8cc7980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:31.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.595+0000 7fced8cc7980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.599+0000 7fced8cc7980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:45:31.594 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.599+0000 7fced8cc7980 20 searching for the correct realm 2024-03-09T14:45:31.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.603+0000 7fced6fe0640 0 -- 172.21.15.99:0/2539539896 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x5618e4a12700 msgr2=0x5618e4a14af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:31.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.607+0000 7fced5fde640 0 -- 172.21.15.99:0/2539539896 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fcec8064a60 msgr2=0x7fcec8061850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:31.821 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.823+0000 7fced8cc7980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:45:31.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.823+0000 7fced8cc7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:45:31.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.823+0000 7fced8cc7980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:45:31.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.823+0000 7fced8cc7980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:45:31.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.823+0000 7fced8cc7980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:45:31.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.823+0000 7fced8cc7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:45:31.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.823+0000 7fced8cc7980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.823+0000 7fced8cc7980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.823+0000 7fced8cc7980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.827+0000 7fced8cc7980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:31.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.827+0000 7fced8cc7980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.827+0000 7fced8cc7980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:45:31.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.827+0000 7fced8cc7980 20 zone default found 2024-03-09T14:45:31.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.827+0000 7fced8cc7980 4 Realm: () 2024-03-09T14:45:31.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.827+0000 7fced8cc7980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:45:31.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.827+0000 7fced8cc7980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:45:31.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.827+0000 7fced8cc7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:45:31.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.827+0000 7fced8cc7980 20 zonegroup default 2024-03-09T14:45:31.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.827+0000 7fced8cc7980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.827+0000 7fced8cc7980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.827+0000 7fced8cc7980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.827+0000 7fced8cc7980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.827+0000 7fced8cc7980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.831+0000 7fced8cc7980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.831+0000 7fced8cc7980 20 started sync module instance, tier type = 2024-03-09T14:45:31.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.831+0000 7fced8cc7980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:45:31.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.855+0000 7fced8cc7980 20 add_watcher() i=0 2024-03-09T14:45:31.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.855+0000 7fced8cc7980 20 add_watcher() i=1 2024-03-09T14:45:31.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.855+0000 7fced8cc7980 20 add_watcher() i=2 2024-03-09T14:45:31.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.855+0000 7fced8cc7980 20 add_watcher() i=3 2024-03-09T14:45:31.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.855+0000 7fced8cc7980 20 add_watcher() i=4 2024-03-09T14:45:31.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.855+0000 7fced8cc7980 20 add_watcher() i=5 2024-03-09T14:45:31.851 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.855+0000 7fced8cc7980 20 add_watcher() i=6 2024-03-09T14:45:31.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.855+0000 7fced8cc7980 20 add_watcher() i=7 2024-03-09T14:45:31.852 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.855+0000 7fced8cc7980 2 all 8 watchers are set, enabling cache 2024-03-09T14:45:31.856 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.859+0000 7fcd8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:31.857 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.859+0000 7fced8cc7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:45:31.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.859+0000 7fced8cc7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:45:31.858 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.859+0000 7fced8cc7980 5 note: GC not initialized 2024-03-09T14:45:31.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.863+0000 7fcd877fe640 20 reqs_thread_entry: start 2024-03-09T14:45:31.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.863+0000 7fced8cc7980 20 init_complete bucket index max shards: 11 2024-03-09T14:45:31.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.863+0000 7fced8cc7980 20 Filter name: none 2024-03-09T14:45:31.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.863+0000 7fcd857fa640 20 reqs_thread_entry: start 2024-03-09T14:45:31.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.863+0000 7fced8cc7980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.863+0000 7fced8cc7980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:31.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.863+0000 7fced8cc7980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.863+0000 7fced8cc7980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:45:31.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.863+0000 7fced8cc7980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:45:31.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.863+0000 7fced8cc7980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.863+0000 7fced8cc7980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:31.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.863+0000 7fced8cc7980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.867+0000 7fced8cc7980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:45:31.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.867+0000 7fced8cc7980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:45:31.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.867+0000 7fced8cc7980 20 rados->read ofs=0 len=0 2024-03-09T14:45:31.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.867+0000 7fced8cc7980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:31.865 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.867+0000 7fcd8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:31.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.875+0000 7fced8cc7980 20 remove_watcher() i=0 2024-03-09T14:45:31.870 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.875+0000 7fced8cc7980 2 removed watcher, disabling cache 2024-03-09T14:45:31.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.875+0000 7fced8cc7980 20 remove_watcher() i=1 2024-03-09T14:45:31.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.879+0000 7fced8cc7980 20 remove_watcher() i=2 2024-03-09T14:45:31.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.879+0000 7fced8cc7980 20 remove_watcher() i=3 2024-03-09T14:45:31.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.883+0000 7fced8cc7980 20 remove_watcher() i=4 2024-03-09T14:45:31.880 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.883+0000 7fced8cc7980 20 remove_watcher() i=5 2024-03-09T14:45:31.882 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.887+0000 7fced8cc7980 20 remove_watcher() i=6 2024-03-09T14:45:31.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:31.887+0000 7fced8cc7980 20 remove_watcher() i=7 2024-03-09T14:45:31.899 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:31.899 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:45:31.899 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-commit-target-layout id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-09T14:45:31.899 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:31.900 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:31.900 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:31.904 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:31.904 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:31.952 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:31.952 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:31.999 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-03-09T14:45:31.999 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:32.000 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.000 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.021 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.021 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.063 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.064 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.084 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.084 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.104 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.105 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.125 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.125 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.147 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.147 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.166 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.167 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.186 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.186 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.206 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.206 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.226 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.226 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.247 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.247 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.267 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.267 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.288 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.288 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.307 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.307 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.328 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.328 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.348 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.348 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.367 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.367 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.386 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.386 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.407 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.407 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.429 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.429 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.449 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:32.450 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:32.517 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-09T14:45:32.551 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:45:32.551 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:45:32.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.603+0000 7ff5417e9980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.603+0000 7ff5417e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:32.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.603+0000 7ff5417e9980 20 realm 2024-03-09T14:45:32.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.603+0000 7ff5417e9980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.603+0000 7ff5417e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:32.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.603+0000 7ff5417e9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:45:32.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.603+0000 7ff5417e9980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.603+0000 7ff5417e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:32.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.603+0000 7ff5417e9980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.607+0000 7ff5417e9980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:32.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.607+0000 7ff5417e9980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.607+0000 7ff5417e9980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:45:32.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.607+0000 7ff5417e9980 20 searching for the correct realm 2024-03-09T14:45:32.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.611+0000 7ff53fb02640 0 -- 172.21.15.99:0/2406623788 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x557fe2bed860 msgr2=0x557fe2befc50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:45:32.615 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.619+0000 7ff53eb00640 0 -- 172.21.15.99:0/2406623788 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7ff538028910 msgr2=0x7ff53804d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:32.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.835+0000 7ff5417e9980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:45:32.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.835+0000 7ff5417e9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:45:32.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.835+0000 7ff5417e9980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:45:32.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.835+0000 7ff5417e9980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:45:32.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.835+0000 7ff5417e9980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:45:32.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.835+0000 7ff5417e9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:45:32.833 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.835+0000 7ff5417e9980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.835+0000 7ff5417e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:32.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.835+0000 7ff5417e9980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.839+0000 7ff5417e9980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:32.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.839+0000 7ff5417e9980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.835 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.839+0000 7ff5417e9980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:45:32.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.839+0000 7ff5417e9980 20 zone default found 2024-03-09T14:45:32.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.839+0000 7ff5417e9980 4 Realm: () 2024-03-09T14:45:32.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.839+0000 7ff5417e9980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:45:32.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.839+0000 7ff5417e9980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:45:32.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.839+0000 7ff5417e9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:45:32.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.839+0000 7ff5417e9980 20 zonegroup default 2024-03-09T14:45:32.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.839+0000 7ff5417e9980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.839+0000 7ff5417e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:32.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.839+0000 7ff5417e9980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.839+0000 7ff5417e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:32.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.839+0000 7ff5417e9980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.837 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.839+0000 7ff5417e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:32.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.839+0000 7ff5417e9980 20 started sync module instance, tier type = 2024-03-09T14:45:32.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.839+0000 7ff5417e9980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:45:32.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.867+0000 7ff5417e9980 20 add_watcher() i=0 2024-03-09T14:45:32.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.867+0000 7ff5417e9980 20 add_watcher() i=1 2024-03-09T14:45:32.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.867+0000 7ff5417e9980 20 add_watcher() i=2 2024-03-09T14:45:32.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.867+0000 7ff5417e9980 20 add_watcher() i=3 2024-03-09T14:45:32.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.867+0000 7ff5417e9980 20 add_watcher() i=4 2024-03-09T14:45:32.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.867+0000 7ff5417e9980 20 add_watcher() i=5 2024-03-09T14:45:32.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.867+0000 7ff5417e9980 20 add_watcher() i=6 2024-03-09T14:45:32.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.867+0000 7ff5417e9980 20 add_watcher() i=7 2024-03-09T14:45:32.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.867+0000 7ff5417e9980 2 all 8 watchers are set, enabling cache 2024-03-09T14:45:32.871 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.871+0000 7ff3f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:32.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.875+0000 7ff5417e9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:45:32.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.875+0000 7ff5417e9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:45:32.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.875+0000 7ff5417e9980 5 note: GC not initialized 2024-03-09T14:45:32.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.875+0000 7ff3f4fe1640 20 reqs_thread_entry: start 2024-03-09T14:45:32.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.875+0000 7ff5417e9980 20 init_complete bucket index max shards: 11 2024-03-09T14:45:32.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.875+0000 7ff5417e9980 20 Filter name: none 2024-03-09T14:45:32.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.875+0000 7ff36e7fc640 20 reqs_thread_entry: start 2024-03-09T14:45:32.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.875+0000 7ff5417e9980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.872 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.875+0000 7ff5417e9980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:32.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.875+0000 7ff5417e9980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.875+0000 7ff5417e9980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:45:32.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.875+0000 7ff5417e9980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:45:32.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.875+0000 7ff5417e9980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.879+0000 7ff5417e9980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:32.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.879+0000 7ff5417e9980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.879+0000 7ff5417e9980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:45:32.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.879+0000 7ff5417e9980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:45:32.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.879+0000 7ff5417e9980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.879+0000 7ff5417e9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:32.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.883+0000 7ff3f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:32.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.887+0000 7ff5417e9980 20 remove_watcher() i=0 2024-03-09T14:45:32.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.887+0000 7ff5417e9980 2 removed watcher, disabling cache 2024-03-09T14:45:32.885 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.887+0000 7ff5417e9980 20 remove_watcher() i=1 2024-03-09T14:45:32.888 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.891+0000 7ff5417e9980 20 remove_watcher() i=2 2024-03-09T14:45:32.890 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.895+0000 7ff5417e9980 20 remove_watcher() i=3 2024-03-09T14:45:32.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.895+0000 7ff5417e9980 20 remove_watcher() i=4 2024-03-09T14:45:32.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.895+0000 7ff5417e9980 20 remove_watcher() i=5 2024-03-09T14:45:32.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.899+0000 7ff5417e9980 20 remove_watcher() i=6 2024-03-09T14:45:32.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.899+0000 7ff5417e9980 20 remove_watcher() i=7 2024-03-09T14:45:32.910 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:32.911 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:45:32.911 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-commit-target-layout id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:45:32.911 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:32.911 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-03-09T14:45:32.945 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:45:32.945 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:45:32.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.991+0000 7f82187da980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.995+0000 7f82187da980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:32.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.995+0000 7f82187da980 20 realm 2024-03-09T14:45:32.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.995+0000 7f82187da980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.995+0000 7f82187da980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:32.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.995+0000 7f82187da980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:45:32.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.995+0000 7f82187da980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.995+0000 7f82187da980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:32.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.995+0000 7f82187da980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.995+0000 7f82187da980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:32.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.995+0000 7f82187da980 20 rados->read ofs=0 len=0 2024-03-09T14:45:32.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.999+0000 7f82187da980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:45:32.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.999+0000 7f82187da980 20 searching for the correct realm 2024-03-09T14:45:32.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:32.999+0000 7f8216af3640 0 -- 172.21.15.99:0/3620711945 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f820001bba0 msgr2=0x7f82000555a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:33.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.215+0000 7f820ffff640 0 -- 172.21.15.99:0/3620711945 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f82100ce520 msgr2=0x7f8210125650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:33.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.431+0000 7f82187da980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:45:33.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.431+0000 7f82187da980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:45:33.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.431+0000 7f82187da980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:45:33.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.431+0000 7f82187da980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:45:33.429 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.431+0000 7f82187da980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:45:33.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.431+0000 7f82187da980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:45:33.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.431+0000 7f82187da980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.431+0000 7f82187da980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:33.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.431+0000 7f82187da980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.431+0000 7f82187da980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:33.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.431+0000 7f82187da980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.435+0000 7f82187da980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:45:33.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.435+0000 7f82187da980 20 zone default found 2024-03-09T14:45:33.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.435+0000 7f82187da980 4 Realm: () 2024-03-09T14:45:33.432 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.435+0000 7f82187da980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:45:33.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.435+0000 7f82187da980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:45:33.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.435+0000 7f82187da980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:45:33.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.435+0000 7f82187da980 20 zonegroup default 2024-03-09T14:45:33.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.435+0000 7f82187da980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.435+0000 7f82187da980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:33.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.435+0000 7f82187da980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.435+0000 7f82187da980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:33.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.435+0000 7f82187da980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.435+0000 7f82187da980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:33.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.435+0000 7f82187da980 20 started sync module instance, tier type = 2024-03-09T14:45:33.434 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.435+0000 7f82187da980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:45:33.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.459+0000 7f82187da980 20 add_watcher() i=0 2024-03-09T14:45:33.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.459+0000 7f82187da980 20 add_watcher() i=1 2024-03-09T14:45:33.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.459+0000 7f82187da980 20 add_watcher() i=2 2024-03-09T14:45:33.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.459+0000 7f82187da980 20 add_watcher() i=3 2024-03-09T14:45:33.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.459+0000 7f82187da980 20 add_watcher() i=4 2024-03-09T14:45:33.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.459+0000 7f82187da980 20 add_watcher() i=5 2024-03-09T14:45:33.456 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.459+0000 7f82187da980 20 add_watcher() i=6 2024-03-09T14:45:33.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.459+0000 7f82187da980 20 add_watcher() i=7 2024-03-09T14:45:33.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.459+0000 7f82187da980 2 all 8 watchers are set, enabling cache 2024-03-09T14:45:33.461 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.463+0000 7f80cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:33.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:45:33.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:45:33.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 5 note: GC not initialized 2024-03-09T14:45:33.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f80c77fe640 20 reqs_thread_entry: start 2024-03-09T14:45:33.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 20 init_complete bucket index max shards: 11 2024-03-09T14:45:33.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 20 Filter name: none 2024-03-09T14:45:33.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f80c57fa640 20 reqs_thread_entry: start 2024-03-09T14:45:33.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-03-09T14:45:33.463 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:33.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-03-09T14:45:33.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-03-09T14:45:33.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26 : miss 2024-03-09T14:45:33.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:45:33.464 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26 info.flags=0x17 2024-03-09T14:45:33.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26 to cache LRU end 2024-03-09T14:45:33.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:45:33.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:33.465 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.467+0000 7f82187da980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26 2024-03-09T14:45:33.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.475+0000 7f82187da980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26 info.flags=0x17 2024-03-09T14:45:33.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.475+0000 7f82187da980 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26 to cache LRU end 2024-03-09T14:45:33.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.475+0000 7f82187da980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:33.473 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.475+0000 7f82187da980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26, ofs0, ns] 2024-03-09T14:45:33.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.475+0000 7f80f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464359 cookie 93843720885632 notifier 6723 bl.length()=1007 2024-03-09T14:45:33.474 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.475+0000 7f80f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26 info.flags=0x17 2024-03-09T14:45:33.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.475+0000 7f80f9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26 to cache LRU end 2024-03-09T14:45:33.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.475+0000 7f80f9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:33.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.479+0000 7f82187da980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26]): orig_sources= new_sources= 2024-03-09T14:45:33.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.479+0000 7f82187da980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26]): potential sources added=[] removed=[] 2024-03-09T14:45:33.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.479+0000 7f82187da980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26]): orig_dests= new_dests= 2024-03-09T14:45:33.476 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.479+0000 7f82187da980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26]): potential dests added=[] removed=[] 2024-03-09T14:45:33.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.0 2024-03-09T14:45:33.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.0 2024-03-09T14:45:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.1 2024-03-09T14:45:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.1 2024-03-09T14:45:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.2 2024-03-09T14:45:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.2 2024-03-09T14:45:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.3 2024-03-09T14:45:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.3 2024-03-09T14:45:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.4 2024-03-09T14:45:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.4 2024-03-09T14:45:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.5 2024-03-09T14:45:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.5 2024-03-09T14:45:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.6 2024-03-09T14:45:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.6 2024-03-09T14:45:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.7 2024-03-09T14:45:33.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.7 2024-03-09T14:45:33.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.8 2024-03-09T14:45:33.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.8 2024-03-09T14:45:33.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.9 2024-03-09T14:45:33.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.9 2024-03-09T14:45:33.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.10 2024-03-09T14:45:33.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.10 2024-03-09T14:45:33.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.11 2024-03-09T14:45:33.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1.11 2024-03-09T14:45:33.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.0 2024-03-09T14:45:33.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.483+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.1 2024-03-09T14:45:33.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.487+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.2 2024-03-09T14:45:33.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.487+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.3 2024-03-09T14:45:33.484 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.487+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.4 2024-03-09T14:45:33.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.487+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.5 2024-03-09T14:45:33.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.491+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.6 2024-03-09T14:45:33.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.491+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.7 2024-03-09T14:45:33.487 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.491+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.8 2024-03-09T14:45:33.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.491+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.9 2024-03-09T14:45:33.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.495+0000 7f82187da980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26.10 2024-03-09T14:45:33.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.499+0000 7f82187da980 -1 Injecting error=-125 at location=commit_target_layout 2024-03-09T14:45:33.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.499+0000 7f82187da980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26 : hit (requested=0x17, cached=0x17) 2024-03-09T14:45:33.496 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.499+0000 7f82187da980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26 2024-03-09T14:45:33.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.503+0000 7f82187da980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26 info.flags=0x17 2024-03-09T14:45:33.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.503+0000 7f82187da980 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26 to cache LRU end 2024-03-09T14:45:33.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.503+0000 7f82187da980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:33.498 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.503+0000 7f82187da980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26, ofs0, ns] 2024-03-09T14:45:33.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.503+0000 7f80f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464360 cookie 93843720885632 notifier 6723 bl.length()=975 2024-03-09T14:45:33.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.503+0000 7f80f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26 info.flags=0x17 2024-03-09T14:45:33.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.503+0000 7f80f9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26 to cache LRU end 2024-03-09T14:45:33.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.503+0000 7f80f9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:33.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.503+0000 7f82187da980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26]): orig_sources= new_sources= 2024-03-09T14:45:33.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.503+0000 7f82187da980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26]): potential sources added=[] removed=[] 2024-03-09T14:45:33.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.503+0000 7f82187da980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26]): orig_dests= new_dests= 2024-03-09T14:45:33.500 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.503+0000 7f82187da980 20 handle_bi_update(): bucket=:error-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26]): potential dests added=[] removed=[] 2024-03-09T14:45:33.505 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.507+0000 7f82187da980 1 execute INFO: reshard of bucket "error-at-commit-target-layout" completed successfully 2024-03-09T14:45:33.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.511+0000 7f80cd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:33.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.519+0000 7f82187da980 20 remove_watcher() i=0 2024-03-09T14:45:33.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.519+0000 7f82187da980 2 removed watcher, disabling cache 2024-03-09T14:45:33.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.519+0000 7f82187da980 20 remove_watcher() i=1 2024-03-09T14:45:33.519 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.523+0000 7f82187da980 20 remove_watcher() i=2 2024-03-09T14:45:33.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.527+0000 7f82187da980 20 remove_watcher() i=3 2024-03-09T14:45:33.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.527+0000 7f82187da980 20 remove_watcher() i=4 2024-03-09T14:45:33.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.531+0000 7f82187da980 20 remove_watcher() i=5 2024-03-09T14:45:33.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.531+0000 7f82187da980 20 remove_watcher() i=6 2024-03-09T14:45:33.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.531+0000 7f82187da980 20 remove_watcher() i=7 2024-03-09T14:45:33.545 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-03-09T14:45:33.574 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:45:33.574 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:45:33.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.623+0000 7f41b5d3c980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.627+0000 7f41b5d3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:33.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.627+0000 7f41b5d3c980 20 realm 2024-03-09T14:45:33.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.627+0000 7f41b5d3c980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.627+0000 7f41b5d3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:33.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.627+0000 7f41b5d3c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:45:33.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.627+0000 7f41b5d3c980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.627+0000 7f41b5d3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:33.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.627+0000 7f41b5d3c980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.627+0000 7f41b5d3c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:33.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.627+0000 7f41b5d3c980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.631+0000 7f41b5d3c980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:45:33.627 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.631+0000 7f41b5d3c980 20 searching for the correct realm 2024-03-09T14:45:33.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.631+0000 7f41b3053640 0 -- 172.21.15.99:0/2577080052 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f419c002320 msgr2=0x7f41a401a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:33.841 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.843+0000 7f41b4055640 0 -- 172.21.15.99:0/2577080052 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f41a80bb070 msgr2=0x7f41a80b2090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:33.859 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.863+0000 7f41b5d3c980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:45:33.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.863+0000 7f41b5d3c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:45:33.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.863+0000 7f41b5d3c980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:45:33.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.863+0000 7f41b5d3c980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:45:33.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.863+0000 7f41b5d3c980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:45:33.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.863+0000 7f41b5d3c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:45:33.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.863+0000 7f41b5d3c980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.863+0000 7f41b5d3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:33.860 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.863+0000 7f41b5d3c980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.863+0000 7f41b5d3c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:33.861 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.863+0000 7f41b5d3c980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.863+0000 7f41b5d3c980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:45:33.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.867+0000 7f41b5d3c980 20 zone default found 2024-03-09T14:45:33.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.867+0000 7f41b5d3c980 4 Realm: () 2024-03-09T14:45:33.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.867+0000 7f41b5d3c980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:45:33.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.867+0000 7f41b5d3c980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:45:33.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.867+0000 7f41b5d3c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:45:33.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.867+0000 7f41b5d3c980 20 zonegroup default 2024-03-09T14:45:33.862 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.867+0000 7f41b5d3c980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.867+0000 7f41b5d3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:33.863 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.867+0000 7f41b5d3c980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.867+0000 7f41b5d3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:33.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.867+0000 7f41b5d3c980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.867+0000 7f41b5d3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:33.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.867+0000 7f41b5d3c980 20 started sync module instance, tier type = 2024-03-09T14:45:33.864 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.867+0000 7f41b5d3c980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:45:33.886 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.891+0000 7f41b5d3c980 20 add_watcher() i=0 2024-03-09T14:45:33.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.891+0000 7f41b5d3c980 20 add_watcher() i=1 2024-03-09T14:45:33.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.891+0000 7f41b5d3c980 20 add_watcher() i=2 2024-03-09T14:45:33.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.891+0000 7f41b5d3c980 20 add_watcher() i=3 2024-03-09T14:45:33.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.891+0000 7f41b5d3c980 20 add_watcher() i=4 2024-03-09T14:45:33.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.891+0000 7f41b5d3c980 20 add_watcher() i=5 2024-03-09T14:45:33.887 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.891+0000 7f41b5d3c980 20 add_watcher() i=6 2024-03-09T14:45:33.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.891+0000 7f41b5d3c980 20 add_watcher() i=7 2024-03-09T14:45:33.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.891+0000 7f41b5d3c980 2 all 8 watchers are set, enabling cache 2024-03-09T14:45:33.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.895+0000 7f4069fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:33.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.895+0000 7f41b5d3c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:45:33.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.895+0000 7f41b5d3c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:45:33.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.895+0000 7f41b5d3c980 5 note: GC not initialized 2024-03-09T14:45:33.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.899+0000 7f4068fe1640 20 reqs_thread_entry: start 2024-03-09T14:45:33.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.899+0000 7f41b5d3c980 20 init_complete bucket index max shards: 11 2024-03-09T14:45:33.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.899+0000 7f41b5d3c980 20 Filter name: none 2024-03-09T14:45:33.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.899+0000 7f3fe27fc640 20 reqs_thread_entry: start 2024-03-09T14:45:33.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.899+0000 7f41b5d3c980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.899+0000 7f41b5d3c980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:33.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.899+0000 7f41b5d3c980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.899+0000 7f41b5d3c980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:45:33.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.899+0000 7f41b5d3c980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:45:33.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.899+0000 7f41b5d3c980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.899+0000 7f41b5d3c980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:33.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.899+0000 7f41b5d3c980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.903+0000 7f41b5d3c980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:45:33.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.903+0000 7f41b5d3c980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:45:33.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.903+0000 7f41b5d3c980 20 rados->read ofs=0 len=0 2024-03-09T14:45:33.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.903+0000 7f41b5d3c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:33.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.903+0000 7f4069fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:33.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.911+0000 7f41b5d3c980 20 remove_watcher() i=0 2024-03-09T14:45:33.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.911+0000 7f41b5d3c980 2 removed watcher, disabling cache 2024-03-09T14:45:33.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.911+0000 7f41b5d3c980 20 remove_watcher() i=1 2024-03-09T14:45:33.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.915+0000 7f41b5d3c980 20 remove_watcher() i=2 2024-03-09T14:45:33.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.915+0000 7f41b5d3c980 20 remove_watcher() i=3 2024-03-09T14:45:33.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.919+0000 7f41b5d3c980 20 remove_watcher() i=4 2024-03-09T14:45:33.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.919+0000 7f41b5d3c980 20 remove_watcher() i=5 2024-03-09T14:45:33.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.923+0000 7f41b5d3c980 20 remove_watcher() i=6 2024-03-09T14:45:33.920 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:33.923+0000 7f41b5d3c980 20 remove_watcher() i=7 2024-03-09T14:45:33.937 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:33.937 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:45:33.937 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-commit-target-layout id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26 num_objects: 20 size_kb: 1 num_shards: 12 2024-03-09T14:45:33.937 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:33.938 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:33.939 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:33.941 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:33.942 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:33.998 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:33.999 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.041 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-03-09T14:45:34.041 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:34.043 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.043 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.062 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.062 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.110 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.110 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.132 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.132 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.154 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.154 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.175 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.175 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.196 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.196 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.217 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.217 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.237 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.237 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.259 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.259 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.280 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.281 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.301 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.301 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.322 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.323 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.345 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.345 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.367 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.368 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.388 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.388 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.409 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.409 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.430 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.430 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.451 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.451 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.471 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.471 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.491 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.492 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.513 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:34.513 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:45:34.531 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-03-09T14:45:34.563 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:45:34.563 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:45:34.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:34.611+0000 7f39c111f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:34.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:34.611+0000 7f39c111f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:34.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:34.611+0000 7f39c111f980 20 realm 2024-03-09T14:45:34.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:34.611+0000 7f39c111f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:34.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:34.611+0000 7f39c111f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:34.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:34.611+0000 7f39c111f980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:45:34.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:34.611+0000 7f39c111f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:34.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:34.615+0000 7f39c111f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:34.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:34.615+0000 7f39c111f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:34.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:34.615+0000 7f39c111f980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:34.612 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:34.615+0000 7f39c111f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:34.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:34.615+0000 7f39c111f980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:45:34.613 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:34.615+0000 7f39c111f980 20 searching for the correct realm 2024-03-09T14:45:34.616 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:34.619+0000 7f39bf438640 0 -- 172.21.15.99:0/1661944243 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f39b4116040 msgr2=0x7f39b40c1a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:34.831 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:34.835+0000 7f39be436640 0 -- 172.21.15.99:0/1661944243 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f39b804a410 msgr2=0x7f39b804a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:35.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.051+0000 7f39c111f980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:45:35.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.051+0000 7f39c111f980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:45:35.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.051+0000 7f39c111f980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:45:35.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.051+0000 7f39c111f980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:45:35.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.051+0000 7f39c111f980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:45:35.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.051+0000 7f39c111f980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:45:35.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.051+0000 7f39c111f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.051+0000 7f39c111f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.049 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.051+0000 7f39c111f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.055+0000 7f39c111f980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:35.050 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.055+0000 7f39c111f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.055+0000 7f39c111f980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:45:35.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.055+0000 7f39c111f980 20 zone default found 2024-03-09T14:45:35.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.055+0000 7f39c111f980 4 Realm: () 2024-03-09T14:45:35.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.055+0000 7f39c111f980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:45:35.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.055+0000 7f39c111f980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:45:35.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.055+0000 7f39c111f980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:45:35.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.055+0000 7f39c111f980 20 zonegroup default 2024-03-09T14:45:35.051 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.055+0000 7f39c111f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.055+0000 7f39c111f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.055+0000 7f39c111f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.055+0000 7f39c111f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.052 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.055+0000 7f39c111f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.055+0000 7f39c111f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.055+0000 7f39c111f980 20 started sync module instance, tier type = 2024-03-09T14:45:35.053 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.055+0000 7f39c111f980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:45:35.077 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.079+0000 7f39c111f980 20 add_watcher() i=0 2024-03-09T14:45:35.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.079+0000 7f39c111f980 20 add_watcher() i=1 2024-03-09T14:45:35.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.079+0000 7f39c111f980 20 add_watcher() i=2 2024-03-09T14:45:35.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.079+0000 7f39c111f980 20 add_watcher() i=3 2024-03-09T14:45:35.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.079+0000 7f39c111f980 20 add_watcher() i=4 2024-03-09T14:45:35.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.079+0000 7f39c111f980 20 add_watcher() i=5 2024-03-09T14:45:35.078 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.079+0000 7f39c111f980 20 add_watcher() i=6 2024-03-09T14:45:35.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.083+0000 7f39c111f980 20 add_watcher() i=7 2024-03-09T14:45:35.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.083+0000 7f39c111f980 2 all 8 watchers are set, enabling cache 2024-03-09T14:45:35.083 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.087+0000 7f38757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:35.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.087+0000 7f39c111f980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:45:35.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.087+0000 7f39c111f980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:45:35.084 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.087+0000 7f39c111f980 5 note: GC not initialized 2024-03-09T14:45:35.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.087+0000 7f37effff640 20 reqs_thread_entry: start 2024-03-09T14:45:35.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.087+0000 7f39c111f980 20 init_complete bucket index max shards: 11 2024-03-09T14:45:35.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.087+0000 7f39c111f980 20 Filter name: none 2024-03-09T14:45:35.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.087+0000 7f37edffb640 20 reqs_thread_entry: start 2024-03-09T14:45:35.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.087+0000 7f39c111f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.086 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.091+0000 7f39c111f980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:35.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.091+0000 7f39c111f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.091+0000 7f39c111f980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:45:35.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.091+0000 7f39c111f980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:45:35.088 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.091+0000 7f39c111f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.091+0000 7f39c111f980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:35.089 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.091+0000 7f39c111f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.095+0000 7f39c111f980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:45:35.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.095+0000 7f39c111f980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:45:35.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.095+0000 7f39c111f980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.095+0000 7f39c111f980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.094 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.099+0000 7f38757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:35.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.103+0000 7f39c111f980 20 remove_watcher() i=0 2024-03-09T14:45:35.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.103+0000 7f39c111f980 2 removed watcher, disabling cache 2024-03-09T14:45:35.102 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.103+0000 7f39c111f980 20 remove_watcher() i=1 2024-03-09T14:45:35.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.107+0000 7f39c111f980 20 remove_watcher() i=2 2024-03-09T14:45:35.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.111+0000 7f39c111f980 20 remove_watcher() i=3 2024-03-09T14:45:35.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.111+0000 7f39c111f980 20 remove_watcher() i=4 2024-03-09T14:45:35.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.111+0000 7f39c111f980 20 remove_watcher() i=5 2024-03-09T14:45:35.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.115+0000 7f39c111f980 20 remove_watcher() i=6 2024-03-09T14:45:35.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.115+0000 7f39c111f980 20 remove_watcher() i=7 2024-03-09T14:45:35.126 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.127 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:45:35.127 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-commit-target-layout id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:45:35.127 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.127 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-03-09T14:45:35.163 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:45:35.163 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:45:35.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.211+0000 7fe2067b5980 20 realm 2024-03-09T14:45:35.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.211+0000 7fe2067b5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:45:35.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:35.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.215+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:45:35.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.215+0000 7fe2067b5980 20 searching for the correct realm 2024-03-09T14:45:35.216 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.219+0000 7fe2042cd640 0 -- 172.21.15.99:0/1722523730 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x55bad536fee0 msgr2=0x55bad53723a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:35.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.227+0000 7fe203acc640 0 -- 172.21.15.99:0/1722523730 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fe1f4008030 msgr2=0x7fe1f407b8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:35.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:45:35.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:45:35.230 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:45:35.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:45:35.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:45:35.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:45:35.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.231 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:35.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:45:35.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 zone default found 2024-03-09T14:45:35.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 4 Realm: () 2024-03-09T14:45:35.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:45:35.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:45:35.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:45:35.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 zonegroup default 2024-03-09T14:45:35.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.232 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 started sync module instance, tier type = 2024-03-09T14:45:35.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.235+0000 7fe2067b5980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:45:35.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=0 2024-03-09T14:45:35.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=1 2024-03-09T14:45:35.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=2 2024-03-09T14:45:35.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=3 2024-03-09T14:45:35.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=4 2024-03-09T14:45:35.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=5 2024-03-09T14:45:35.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=6 2024-03-09T14:45:35.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.255+0000 7fe2067b5980 20 add_watcher() i=7 2024-03-09T14:45:35.251 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.255+0000 7fe2067b5980 2 all 8 watchers are set, enabling cache 2024-03-09T14:45:35.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.255+0000 7fe0bb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:35.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.255+0000 7fe2067b5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:45:35.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.255+0000 7fe2067b5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:45:35.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.255+0000 7fe2067b5980 5 note: GC not initialized 2024-03-09T14:45:35.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.255+0000 7fe0ba7dc640 20 reqs_thread_entry: start 2024-03-09T14:45:35.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.259+0000 7fe2067b5980 20 init_complete bucket index max shards: 11 2024-03-09T14:45:35.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.259+0000 7fe2067b5980 20 Filter name: none 2024-03-09T14:45:35.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.259+0000 7fe0b37fe640 20 reqs_thread_entry: start 2024-03-09T14:45:35.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.259+0000 7fe2067b5980 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-09T14:45:35.255 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.259+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.259+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:35.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.259+0000 7fe2067b5980 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-09T14:45:35.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.259+0000 7fe2067b5980 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-09T14:45:35.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.259+0000 7fe2067b5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 : miss 2024-03-09T14:45:35.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.259+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.259+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:45:35.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.259+0000 7fe2067b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 info.flags=0x17 2024-03-09T14:45:35.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.259+0000 7fe2067b5980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 to cache LRU end 2024-03-09T14:45:35.256 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.259+0000 7fe2067b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:45:35.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.259+0000 7fe2067b5980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:35.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.259+0000 7fe2067b5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 2024-03-09T14:45:35.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.271+0000 7fe2067b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 info.flags=0x17 2024-03-09T14:45:35.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.271+0000 7fe2067b5980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 to cache LRU end 2024-03-09T14:45:35.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.271+0000 7fe2067b5980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:35.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.271+0000 7fe2067b5980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27, ofs0, ns] 2024-03-09T14:45:35.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.271+0000 7fe0db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464293 cookie 94260929443632 notifier 6491 bl.length()=1007 2024-03-09T14:45:35.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.271+0000 7fe0db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 info.flags=0x17 2024-03-09T14:45:35.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.271+0000 7fe0db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 to cache LRU end 2024-03-09T14:45:35.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.271+0000 7fe0db7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:35.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.271+0000 7fe2067b5980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): orig_sources= new_sources= 2024-03-09T14:45:35.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.271+0000 7fe2067b5980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): potential sources added=[] removed=[] 2024-03-09T14:45:35.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.271+0000 7fe2067b5980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): orig_dests= new_dests= 2024-03-09T14:45:35.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.271+0000 7fe2067b5980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): potential dests added=[] removed=[] 2024-03-09T14:45:35.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.0 2024-03-09T14:45:35.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.0 2024-03-09T14:45:35.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.1 2024-03-09T14:45:35.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.1 2024-03-09T14:45:35.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.2 2024-03-09T14:45:35.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.2 2024-03-09T14:45:35.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.3 2024-03-09T14:45:35.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.3 2024-03-09T14:45:35.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.4 2024-03-09T14:45:35.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.4 2024-03-09T14:45:35.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.5 2024-03-09T14:45:35.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.5 2024-03-09T14:45:35.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.6 2024-03-09T14:45:35.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.6 2024-03-09T14:45:35.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.7 2024-03-09T14:45:35.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.7 2024-03-09T14:45:35.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.8 2024-03-09T14:45:35.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.8 2024-03-09T14:45:35.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.9 2024-03-09T14:45:35.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.9 2024-03-09T14:45:35.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.10 2024-03-09T14:45:35.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.10 2024-03-09T14:45:35.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.11 2024-03-09T14:45:35.276 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.11 2024-03-09T14:45:35.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.0 2024-03-09T14:45:35.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1 2024-03-09T14:45:35.277 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.2 2024-03-09T14:45:35.279 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.283+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.3 2024-03-09T14:45:35.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.283+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.4 2024-03-09T14:45:35.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.283+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.5 2024-03-09T14:45:35.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.287+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.6 2024-03-09T14:45:35.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.287+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.7 2024-03-09T14:45:35.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.287+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.8 2024-03-09T14:45:35.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.287+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.9 2024-03-09T14:45:35.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.291+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.10 2024-03-09T14:45:35.291 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe2067b5980 time 2024-03-09T14:45:35.300624+0000 2024-03-09T14:45:35.291 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:45:35.292 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:45:35.292 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe20a08ad7b] 2024-03-09T14:45:35.292 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7fe20a08af2f] 2024-03-09T14:45:35.292 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bad341dc51] 2024-03-09T14:45:35.293 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x577) [0x55bad343e557] 2024-03-09T14:45:35.293 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-03-09T14:45:35.293 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe208ef5d90] 2024-03-09T14:45:35.293 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-03-09T14:45:35.293 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-03-09T14:45:35.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.295+0000 7fe2067b5980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe2067b5980 time 2024-03-09T14:45:35.300624+0000 2024-03-09T14:45:35.293 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:45:35.293 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.293 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:45:35.293 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe20a08ad7b] 2024-03-09T14:45:35.293 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7fe20a08af2f] 2024-03-09T14:45:35.293 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bad341dc51] 2024-03-09T14:45:35.293 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x577) [0x55bad343e557] 2024-03-09T14:45:35.293 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-03-09T14:45:35.294 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe208ef5d90] 2024-03-09T14:45:35.294 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-03-09T14:45:35.294 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-03-09T14:45:35.294 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.294 INFO:tasks.workunit.client.0.smithi099.stderr:*** Caught signal (Aborted) ** 2024-03-09T14:45:35.294 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7fe2067b5980 thread_name:radosgw-admin 2024-03-09T14:45:35.310 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:45:35.310 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe208f0e520] 2024-03-09T14:45:35.310 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-03-09T14:45:35.310 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-03-09T14:45:35.310 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-03-09T14:45:35.310 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe20a08add5] 2024-03-09T14:45:35.310 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7fe20a08af2f] 2024-03-09T14:45:35.310 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bad341dc51] 2024-03-09T14:45:35.310 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x577) [0x55bad343e557] 2024-03-09T14:45:35.310 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-03-09T14:45:35.310 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe208ef5d90] 2024-03-09T14:45:35.310 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-03-09T14:45:35.311 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-03-09T14:45:35.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.295+0000 7fe2067b5980 -1 *** Caught signal (Aborted) ** 2024-03-09T14:45:35.311 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7fe2067b5980 thread_name:radosgw-admin 2024-03-09T14:45:35.311 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.311 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:45:35.311 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe208f0e520] 2024-03-09T14:45:35.311 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-03-09T14:45:35.311 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-03-09T14:45:35.311 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-03-09T14:45:35.311 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe20a08add5] 2024-03-09T14:45:35.311 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7fe20a08af2f] 2024-03-09T14:45:35.311 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bad341dc51] 2024-03-09T14:45:35.311 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x577) [0x55bad343e557] 2024-03-09T14:45:35.311 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-03-09T14:45:35.311 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe208ef5d90] 2024-03-09T14:45:35.312 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-03-09T14:45:35.312 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-03-09T14:45:35.312 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:45:35.312 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.312 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-03-09T14:45:35.312 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-03-09T14:45:35.187+0000 7fe2067b5980 5 AuthRegistry(0x55bad52a6240) adding con mode: crc 2024-03-09T14:45:35.312 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-03-09T14:45:35.187+0000 7fe2067b5980 5 AuthRegistry(0x55bad52a6240) adding con mode: crc 2024-03-09T14:45:35.312 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-03-09T14:45:35.187+0000 7fe2067b5980 5 AuthRegistry(0x55bad52a6240) adding con mode: secure 2024-03-09T14:45:35.312 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-03-09T14:45:35.187+0000 7fe2067b5980 5 AuthRegistry(0x55bad52a6240) adding con mode: crc 2024-03-09T14:45:35.312 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-03-09T14:45:35.187+0000 7fe2067b5980 5 AuthRegistry(0x55bad52a6240) adding con mode: secure 2024-03-09T14:45:35.312 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-03-09T14:45:35.187+0000 7fe2067b5980 5 AuthRegistry(0x55bad52a6240) adding con mode: crc 2024-03-09T14:45:35.312 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-03-09T14:45:35.187+0000 7fe2067b5980 5 AuthRegistry(0x55bad52a6240) adding con mode: secure 2024-03-09T14:45:35.312 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-03-09T14:45:35.191+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.312 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-03-09T14:45:35.191+0000 7fe2067b5980 1 librados: starting msgr at 2024-03-09T14:45:35.312 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-03-09T14:45:35.191+0000 7fe2067b5980 1 librados: starting objecter 2024-03-09T14:45:35.313 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command objecter_requests hook 0x55bad5137320 2024-03-09T14:45:35.313 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-03-09T14:45:35.191+0000 7fe2067b5980 1 librados: setting wanted keys 2024-03-09T14:45:35.313 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-03-09T14:45:35.191+0000 7fe2067b5980 1 librados: calling monclient init 2024-03-09T14:45:35.313 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient: init 2024-03-09T14:45:35.313 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding auth protocol: cephx 2024-03-09T14:45:35.313 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding auth protocol: cephx 2024-03-09T14:45:35.313 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding auth protocol: cephx 2024-03-09T14:45:35.313 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: secure 2024-03-09T14:45:35.313 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: crc 2024-03-09T14:45:35.313 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: secure 2024-03-09T14:45:35.313 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: crc 2024-03-09T14:45:35.313 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: secure 2024-03-09T14:45:35.313 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: crc 2024-03-09T14:45:35.313 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: crc 2024-03-09T14:45:35.313 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: secure 2024-03-09T14:45:35.314 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: crc 2024-03-09T14:45:35.314 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: secure 2024-03-09T14:45:35.314 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: crc 2024-03-09T14:45:35.314 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: secure 2024-03-09T14:45:35.314 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-03-09T14:45:35.191+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.314 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-03-09T14:45:35.191+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.314 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command rotate-key hook 0x55bad5276d68 2024-03-09T14:45:35.314 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient: _reopen_session rank -1 2024-03-09T14:45:35.314 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient: _add_conns ranks=[2,1,0] 2024-03-09T14:45:35.314 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-c con 0x55bad5127e80 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:45:35.314 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-b con 0x55bad51bd150 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:45:35.314 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-a con 0x55bad51c3220 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:45:35.314 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.314 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.314 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.315 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient(hunting): _renew_subs 2024-03-09T14:45:35.315 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient(hunting): authenticate will time out at 1988.992919s 2024-03-09T14:45:35.315 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient(hunting): get_auth_request con 0x55bad5127e80 auth_method 0 2024-03-09T14:45:35.315 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:45:35.315 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:45:35.315 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:45:35.315 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-03-09T14:45:35.191+0000 7fe204ace640 10 monclient(hunting): get_auth_request con 0x55bad51c3220 auth_method 0 2024-03-09T14:45:35.315 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-03-09T14:45:35.191+0000 7fe204ace640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:45:35.315 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-03-09T14:45:35.191+0000 7fe204ace640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:45:35.315 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-03-09T14:45:35.191+0000 7fe204ace640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:45:35.315 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:45:35.315 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:45:35.315 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:45:35.315 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-03-09T14:45:35.191+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:45:35.315 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-03-09T14:45:35.191+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:45:35.316 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-03-09T14:45:35.191+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:45:35.316 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient(hunting): handle_auth_done global_id 6482 payload 824 2024-03-09T14:45:35.316 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient: _finish_hunting 0 2024-03-09T14:45:35.316 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-03-09T14:45:35.191+0000 7fe2042cd640 1 monclient: found mon.noname-c 2024-03-09T14:45:35.316 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:45:35.316 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:45:35.316 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:45:35.316 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: dump: 2024-03-09T14:45:35.316 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:45:35.316 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:45:35.316 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.316 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.316 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:45:35.316 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.316 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:45:35.317 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:45:35.317 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:45:35.317 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.317 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: _finish_auth 0 2024-03-09T14:45:35.317 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: _check_auth_tickets 2024-03-09T14:45:35.317 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:45:35.317 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:45:35.317 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:45:35.317 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: dump: 2024-03-09T14:45:35.317 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:45:35.317 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:45:35.317 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.317 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.317 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:45:35.317 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.317 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:45:35.318 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:45:35.318 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:45:35.318 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.318 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 monclient: authenticate success, global_id 6482 2024-03-09T14:45:35.318 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-03-09T14:45:35.191+0000 7fe0f260c640 4 set_mon_vals no callback set 2024-03-09T14:45:35.318 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient: _renew_subs 2024-03-09T14:45:35.318 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:45:35.318 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient: _renew_subs 2024-03-09T14:45:35.318 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:45:35.318 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-03-09T14:45:35.191+0000 7fe2067b5980 1 librados: init done 2024-03-09T14:45:35.318 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:45:35.318 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:45:35.318 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:45:35.318 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-03-09T14:45:35.191+0000 7fe203acc640 10 monclient: get_auth_request con 0x7fe0ec066070 auth_method 0 2024-03-09T14:45:35.319 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-03-09T14:45:35.195+0000 7fe204ace640 10 monclient: get_auth_request con 0x55bad52a41c0 auth_method 0 2024-03-09T14:45:35.319 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-03-09T14:45:35.195+0000 7fe2042cd640 10 monclient: get_auth_request con 0x55bad52c1700 auth_method 0 2024-03-09T14:45:35.319 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-03-09T14:45:35.195+0000 7fe203acc640 10 monclient: get_auth_request con 0x55bad52c58f0 auth_method 0 2024-03-09T14:45:35.319 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient: get_auth_request con 0x55bad52c95d0 auth_method 0 2024-03-09T14:45:35.319 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient: build_initial_monmap 2024-03-09T14:45:35.319 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-03-09T14:45:35.199+0000 7fe2067b5980 1 build_initial for_mkfs: 0 2024-03-09T14:45:35.319 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient: monmap: 2024-03-09T14:45:35.319 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:45:35.319 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:45:35.319 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:45:35.319 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:45:35.319 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:45:35.319 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.319 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:45:35.319 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:45:35.319 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:45:35.320 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.320 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding auth protocol: cephx 2024-03-09T14:45:35.320 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding auth protocol: cephx 2024-03-09T14:45:35.320 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding auth protocol: cephx 2024-03-09T14:45:35.320 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: secure 2024-03-09T14:45:35.320 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: crc 2024-03-09T14:45:35.320 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: secure 2024-03-09T14:45:35.320 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: crc 2024-03-09T14:45:35.320 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: secure 2024-03-09T14:45:35.320 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: crc 2024-03-09T14:45:35.320 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: crc 2024-03-09T14:45:35.320 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: secure 2024-03-09T14:45:35.320 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: crc 2024-03-09T14:45:35.320 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: secure 2024-03-09T14:45:35.320 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: crc 2024-03-09T14:45:35.321 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: secure 2024-03-09T14:45:35.321 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-03-09T14:45:35.199+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.321 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command objecter_requests cmddesc objecter_requests hook 0x55bad52d2d90 EEXIST 2024-03-09T14:45:35.321 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient: init 2024-03-09T14:45:35.321 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding auth protocol: cephx 2024-03-09T14:45:35.321 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding auth protocol: cephx 2024-03-09T14:45:35.321 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding auth protocol: cephx 2024-03-09T14:45:35.321 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: secure 2024-03-09T14:45:35.321 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: crc 2024-03-09T14:45:35.321 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: secure 2024-03-09T14:45:35.321 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: crc 2024-03-09T14:45:35.321 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: secure 2024-03-09T14:45:35.321 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: crc 2024-03-09T14:45:35.321 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: crc 2024-03-09T14:45:35.321 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: secure 2024-03-09T14:45:35.322 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: crc 2024-03-09T14:45:35.322 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: secure 2024-03-09T14:45:35.322 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: crc 2024-03-09T14:45:35.322 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: secure 2024-03-09T14:45:35.322 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-03-09T14:45:35.199+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.322 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-03-09T14:45:35.199+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.322 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command rotate-key cmddesc rotate-key hook 0x55bad52cc720 EEXIST 2024-03-09T14:45:35.322 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient: _reopen_session rank -1 2024-03-09T14:45:35.322 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient: _add_conns ranks=[2,0,1] 2024-03-09T14:45:35.322 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-c con 0x55bad52f79f0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:45:35.322 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-a con 0x55bad52f7dd0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:45:35.322 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-b con 0x55bad52f2f90 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:45:35.322 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.322 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.322 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.323 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient(hunting): _renew_subs 2024-03-09T14:45:35.323 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient(hunting): authenticate will time out at 1989.003391s 2024-03-09T14:45:35.323 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient(hunting): get_auth_request con 0x55bad52f7dd0 auth_method 0 2024-03-09T14:45:35.323 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:45:35.323 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:45:35.323 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:45:35.323 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-03-09T14:45:35.199+0000 7fe203acc640 10 monclient(hunting): get_auth_request con 0x55bad52f79f0 auth_method 0 2024-03-09T14:45:35.323 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-03-09T14:45:35.199+0000 7fe203acc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:45:35.323 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-03-09T14:45:35.199+0000 7fe203acc640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:45:35.323 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-03-09T14:45:35.199+0000 7fe203acc640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:45:35.323 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:45:35.323 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:45:35.323 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:45:35.323 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-03-09T14:45:35.199+0000 7fe203acc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:45:35.323 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-03-09T14:45:35.199+0000 7fe203acc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:45:35.324 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-03-09T14:45:35.199+0000 7fe203acc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:45:35.324 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient(hunting): handle_auth_done global_id 6771 payload 824 2024-03-09T14:45:35.324 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient: _finish_hunting 0 2024-03-09T14:45:35.324 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-03-09T14:45:35.199+0000 7fe204ace640 1 monclient: found mon.noname-a 2024-03-09T14:45:35.324 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:45:35.324 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:45:35.324 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:45:35.324 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: dump: 2024-03-09T14:45:35.324 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:45:35.324 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:45:35.324 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.324 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.324 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:45:35.324 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.324 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:45:35.325 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:45:35.325 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:45:35.325 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.325 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: _finish_auth 0 2024-03-09T14:45:35.325 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: _check_auth_tickets 2024-03-09T14:45:35.325 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:45:35.325 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:45:35.325 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:45:35.325 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: dump: 2024-03-09T14:45:35.325 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:45:35.325 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:45:35.325 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.325 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.325 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:45:35.325 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.326 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:45:35.326 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:45:35.326 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:45:35.326 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.326 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 monclient: authenticate success, global_id 6771 2024-03-09T14:45:35.326 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-03-09T14:45:35.203+0000 7fe2052cf640 4 set_mon_vals no callback set 2024-03-09T14:45:35.326 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: _renew_subs 2024-03-09T14:45:35.326 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:45:35.326 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: _renew_subs 2024-03-09T14:45:35.326 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:45:35.326 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:45:35.326 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:45:35.326 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:45:35.326 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-03-09T14:45:35.203+0000 7fe203acc640 10 monclient: get_auth_request con 0x7fe0dc065f80 auth_method 0 2024-03-09T14:45:35.326 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: get_monmap_and_config 2024-03-09T14:45:35.327 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: build_initial_monmap 2024-03-09T14:45:35.327 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-03-09T14:45:35.203+0000 7fe2067b5980 1 build_initial for_mkfs: 0 2024-03-09T14:45:35.327 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: monmap: 2024-03-09T14:45:35.327 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:45:35.327 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:45:35.327 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:45:35.327 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:45:35.327 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:45:35.327 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.327 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:45:35.327 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:45:35.327 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:45:35.327 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.327 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding auth protocol: cephx 2024-03-09T14:45:35.327 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding auth protocol: cephx 2024-03-09T14:45:35.328 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding auth protocol: cephx 2024-03-09T14:45:35.328 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: secure 2024-03-09T14:45:35.328 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: crc 2024-03-09T14:45:35.328 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: secure 2024-03-09T14:45:35.328 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: crc 2024-03-09T14:45:35.328 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: secure 2024-03-09T14:45:35.328 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: crc 2024-03-09T14:45:35.328 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: crc 2024-03-09T14:45:35.328 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: secure 2024-03-09T14:45:35.328 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: crc 2024-03-09T14:45:35.328 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: secure 2024-03-09T14:45:35.328 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: crc 2024-03-09T14:45:35.328 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: secure 2024-03-09T14:45:35.328 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-03-09T14:45:35.203+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.328 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: init 2024-03-09T14:45:35.329 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding auth protocol: cephx 2024-03-09T14:45:35.329 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding auth protocol: cephx 2024-03-09T14:45:35.329 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding auth protocol: cephx 2024-03-09T14:45:35.329 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: secure 2024-03-09T14:45:35.329 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: crc 2024-03-09T14:45:35.329 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: secure 2024-03-09T14:45:35.329 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: crc 2024-03-09T14:45:35.329 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: secure 2024-03-09T14:45:35.329 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: crc 2024-03-09T14:45:35.329 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: crc 2024-03-09T14:45:35.329 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: secure 2024-03-09T14:45:35.329 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: crc 2024-03-09T14:45:35.329 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: secure 2024-03-09T14:45:35.329 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: crc 2024-03-09T14:45:35.329 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: secure 2024-03-09T14:45:35.329 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-03-09T14:45:35.203+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.330 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-03-09T14:45:35.203+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.330 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command rotate-key cmddesc rotate-key hook 0x7fff0b158a78 EEXIST 2024-03-09T14:45:35.330 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: _reopen_session rank -1 2024-03-09T14:45:35.330 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:45:35.330 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-b con 0x55bad5349ae0 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:45:35.330 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-c con 0x55bad531abc0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:45:35.330 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-a con 0x55bad5317870 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:45:35.330 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.330 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.330 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.330 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient(hunting): _renew_subs 2024-03-09T14:45:35.330 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient(hunting): authenticate will time out at 1989.007392s 2024-03-09T14:45:35.330 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient(hunting): get_auth_request con 0x55bad531abc0 auth_method 0 2024-03-09T14:45:35.330 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:45:35.330 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:45:35.331 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:45:35.331 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-03-09T14:45:35.203+0000 7fe2042cd640 10 monclient(hunting): get_auth_request con 0x55bad5317870 auth_method 0 2024-03-09T14:45:35.331 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-03-09T14:45:35.203+0000 7fe2042cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:45:35.331 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-03-09T14:45:35.203+0000 7fe2042cd640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:45:35.331 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-03-09T14:45:35.203+0000 7fe2042cd640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:45:35.331 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:45:35.331 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:45:35.331 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:45:35.331 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-03-09T14:45:35.203+0000 7fe2042cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:45:35.331 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-03-09T14:45:35.203+0000 7fe2042cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:45:35.331 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-03-09T14:45:35.203+0000 7fe2042cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:45:35.331 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient(hunting): handle_auth_done global_id 6488 payload 274 2024-03-09T14:45:35.331 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient: _finish_hunting 0 2024-03-09T14:45:35.331 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-03-09T14:45:35.203+0000 7fe204ace640 1 monclient: found mon.noname-c 2024-03-09T14:45:35.331 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:45:35.332 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:45:35.332 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:45:35.332 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: dump: 2024-03-09T14:45:35.332 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:45:35.332 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:45:35.332 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.332 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.332 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:45:35.332 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.332 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:45:35.332 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:45:35.332 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:45:35.332 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.332 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: _finish_auth 0 2024-03-09T14:45:35.332 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: _check_auth_tickets 2024-03-09T14:45:35.333 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:45:35.333 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 monclient: authenticate success, global_id 6488 2024-03-09T14:45:35.333 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: get_monmap_and_config success 2024-03-09T14:45:35.333 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-03-09T14:45:35.207+0000 7fe2067b5980 4 set_mon_vals no callback set 2024-03-09T14:45:35.333 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:45:35.333 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:45:35.333 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: dump: 2024-03-09T14:45:35.333 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:45:35.333 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:45:35.333 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.333 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.333 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:45:35.333 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.333 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:45:35.333 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:45:35.334 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:45:35.334 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.334 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: shutdown 2024-03-09T14:45:35.334 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: build_initial_monmap 2024-03-09T14:45:35.334 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-03-09T14:45:35.207+0000 7fe2067b5980 1 build_initial for_mkfs: 0 2024-03-09T14:45:35.334 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: monmap: 2024-03-09T14:45:35.334 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:45:35.334 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:45:35.334 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:45:35.334 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:45:35.334 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:45:35.334 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.334 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:45:35.335 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:45:35.335 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:45:35.335 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.335 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding auth protocol: cephx 2024-03-09T14:45:35.335 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding auth protocol: cephx 2024-03-09T14:45:35.335 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding auth protocol: cephx 2024-03-09T14:45:35.335 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: secure 2024-03-09T14:45:35.335 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: crc 2024-03-09T14:45:35.335 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: secure 2024-03-09T14:45:35.335 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: crc 2024-03-09T14:45:35.335 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: secure 2024-03-09T14:45:35.335 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: crc 2024-03-09T14:45:35.335 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: crc 2024-03-09T14:45:35.335 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: secure 2024-03-09T14:45:35.335 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: crc 2024-03-09T14:45:35.336 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: secure 2024-03-09T14:45:35.336 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: crc 2024-03-09T14:45:35.336 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: secure 2024-03-09T14:45:35.336 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-03-09T14:45:35.207+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.336 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-03-09T14:45:35.207+0000 7fe2067b5980 1 librados: starting msgr at 2024-03-09T14:45:35.336 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-03-09T14:45:35.207+0000 7fe2067b5980 1 librados: starting objecter 2024-03-09T14:45:35.336 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command objecter_requests cmddesc objecter_requests hook 0x55bad52fb260 EEXIST 2024-03-09T14:45:35.336 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-03-09T14:45:35.207+0000 7fe2067b5980 1 librados: setting wanted keys 2024-03-09T14:45:35.336 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-03-09T14:45:35.207+0000 7fe2067b5980 1 librados: calling monclient init 2024-03-09T14:45:35.336 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: init 2024-03-09T14:45:35.336 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding auth protocol: cephx 2024-03-09T14:45:35.336 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding auth protocol: cephx 2024-03-09T14:45:35.336 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding auth protocol: cephx 2024-03-09T14:45:35.336 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: secure 2024-03-09T14:45:35.336 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: crc 2024-03-09T14:45:35.336 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: secure 2024-03-09T14:45:35.337 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: crc 2024-03-09T14:45:35.337 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: secure 2024-03-09T14:45:35.337 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: crc 2024-03-09T14:45:35.337 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: crc 2024-03-09T14:45:35.337 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: secure 2024-03-09T14:45:35.337 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: crc 2024-03-09T14:45:35.337 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: secure 2024-03-09T14:45:35.337 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: crc 2024-03-09T14:45:35.337 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: secure 2024-03-09T14:45:35.337 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-03-09T14:45:35.207+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.337 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-03-09T14:45:35.207+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.337 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command rotate-key cmddesc rotate-key hook 0x55bad5314858 EEXIST 2024-03-09T14:45:35.337 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: _reopen_session rank -1 2024-03-09T14:45:35.338 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: _add_conns ranks=[2,0,1] 2024-03-09T14:45:35.338 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-c con 0x55bad5317870 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:45:35.338 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-a con 0x55bad531abc0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:45:35.338 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-b con 0x55bad5349ae0 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:45:35.338 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.338 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.338 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.338 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient(hunting): _renew_subs 2024-03-09T14:45:35.338 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient(hunting): authenticate will time out at 1989.009873s 2024-03-09T14:45:35.338 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient(hunting): get_auth_request con 0x55bad5317870 auth_method 0 2024-03-09T14:45:35.338 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:45:35.338 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:45:35.338 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:45:35.338 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-03-09T14:45:35.207+0000 7fe204ace640 10 monclient(hunting): get_auth_request con 0x55bad531abc0 auth_method 0 2024-03-09T14:45:35.339 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-03-09T14:45:35.207+0000 7fe204ace640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:45:35.339 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-03-09T14:45:35.207+0000 7fe204ace640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:45:35.339 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-03-09T14:45:35.207+0000 7fe204ace640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:45:35.339 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:45:35.339 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:45:35.339 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:45:35.339 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-03-09T14:45:35.207+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:45:35.339 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-03-09T14:45:35.207+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:45:35.339 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-03-09T14:45:35.207+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:45:35.339 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient(hunting): handle_auth_done global_id 6491 payload 824 2024-03-09T14:45:35.339 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient: _finish_hunting 0 2024-03-09T14:45:35.339 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-03-09T14:45:35.207+0000 7fe203acc640 1 monclient: found mon.noname-c 2024-03-09T14:45:35.339 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:45:35.339 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:45:35.339 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:45:35.339 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: dump: 2024-03-09T14:45:35.340 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:45:35.340 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:45:35.340 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.340 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.340 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:45:35.340 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.340 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:45:35.340 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:45:35.340 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:45:35.340 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.340 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: _finish_auth 0 2024-03-09T14:45:35.340 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: _check_auth_tickets 2024-03-09T14:45:35.341 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:45:35.341 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:45:35.341 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:45:35.341 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: dump: 2024-03-09T14:45:35.341 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:45:35.341 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:45:35.341 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.341 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.341 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:45:35.341 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.341 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:45:35.341 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:45:35.341 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:45:35.341 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.342 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 4 set_mon_vals no callback set 2024-03-09T14:45:35.342 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 monclient: authenticate success, global_id 6491 2024-03-09T14:45:35.342 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: _renew_subs 2024-03-09T14:45:35.342 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:45:35.342 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: _renew_subs 2024-03-09T14:45:35.342 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:45:35.342 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-03-09T14:45:35.207+0000 7fe2067b5980 1 librados: init done 2024-03-09T14:45:35.342 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command cr dump hook 0x55bad534bc38 2024-03-09T14:45:35.342 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.342 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-03-09T14:45:35.211+0000 7fe0d9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:45:35.342 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-03-09T14:45:35.211+0000 7fe0d9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:45:35.342 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-03-09T14:45:35.211+0000 7fe0d9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:45:35.342 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-03-09T14:45:35.211+0000 7fe204ace640 10 monclient: get_auth_request con 0x7fe0cc066040 auth_method 0 2024-03-09T14:45:35.342 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-03-09T14:45:35.211+0000 7fe2042cd640 10 monclient: get_auth_request con 0x55bad5363700 auth_method 0 2024-03-09T14:45:35.342 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.343 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 realm 2024-03-09T14:45:35.343 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.343 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.343 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-03-09T14:45:35.211+0000 7fe2067b5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:45:35.343 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.343 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.343 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.343 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-03-09T14:45:35.211+0000 7fe203acc640 10 monclient: get_auth_request con 0x55bad5367a70 auth_method 0 2024-03-09T14:45:35.343 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:35.343 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.343 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-03-09T14:45:35.215+0000 7fe204ace640 10 monclient: get_auth_request con 0x55bad536b190 auth_method 0 2024-03-09T14:45:35.343 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-03-09T14:45:35.215+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:45:35.343 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-03-09T14:45:35.215+0000 7fe2067b5980 20 searching for the correct realm 2024-03-09T14:45:35.343 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-03-09T14:45:35.215+0000 7fe2042cd640 10 monclient: get_auth_request con 0x55bad536fee0 auth_method 0 2024-03-09T14:45:35.343 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-03-09T14:45:35.215+0000 7fe203acc640 10 monclient: get_auth_request con 0x7fe1fc056be0 auth_method 0 2024-03-09T14:45:35.344 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-03-09T14:45:35.219+0000 7fe204ace640 10 monclient: get_auth_request con 0x7fe1ec0b9fb0 auth_method 0 2024-03-09T14:45:35.344 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-03-09T14:45:35.219+0000 7fe2042cd640 0 -- 172.21.15.99:0/1722523730 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x55bad536fee0 msgr2=0x55bad53723a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:35.344 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-03-09T14:45:35.219+0000 7fe0d9ffb640 1 client.6491.objecter ms_handle_reset 0x55bad536fee0 session 0x55bad536f860 osd.3 2024-03-09T14:45:35.344 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-03-09T14:45:35.219+0000 7fe0d9ffb640 10 monclient: _renew_subs 2024-03-09T14:45:35.344 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-03-09T14:45:35.219+0000 7fe0d9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:45:35.344 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-03-09T14:45:35.219+0000 7fe2042cd640 10 monclient: get_auth_request con 0x7fe0cc076660 auth_method 0 2024-03-09T14:45:35.344 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-03-09T14:45:35.219+0000 7fe2042cd640 10 monclient: get_auth_request con 0x7fe1f4013030 auth_method 0 2024-03-09T14:45:35.344 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-03-09T14:45:35.223+0000 7fe203acc640 10 monclient: get_auth_request con 0x7fe1f4008030 auth_method 0 2024-03-09T14:45:35.344 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-03-09T14:45:35.227+0000 7fe203acc640 0 -- 172.21.15.99:0/1722523730 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fe1f4008030 msgr2=0x7fe1f407b8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:35.344 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-03-09T14:45:35.227+0000 7fe0d9ffb640 1 client.6491.objecter ms_handle_reset 0x7fe1f4008030 session 0x7fe1f4063040 osd.0 2024-03-09T14:45:35.344 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-03-09T14:45:35.227+0000 7fe203acc640 10 monclient: get_auth_request con 0x55bad536fee0 auth_method 0 2024-03-09T14:45:35.344 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:45:35.344 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:45:35.344 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:45:35.344 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:45:35.345 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:45:35.345 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:45:35.345 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.345 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.345 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.345 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:35.345 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.345 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:45:35.345 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 zone default found 2024-03-09T14:45:35.345 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-03-09T14:45:35.235+0000 7fe2067b5980 4 Realm: () 2024-03-09T14:45:35.345 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-03-09T14:45:35.235+0000 7fe2067b5980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:45:35.345 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-03-09T14:45:35.235+0000 7fe2067b5980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:45:35.345 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-03-09T14:45:35.235+0000 7fe2067b5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:45:35.345 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 zonegroup default 2024-03-09T14:45:35.345 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.346 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.346 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.346 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.346 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.346 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.346 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 started sync module instance, tier type = 2024-03-09T14:45:35.346 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:45:35.346 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=0 2024-03-09T14:45:35.346 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=1 2024-03-09T14:45:35.346 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=2 2024-03-09T14:45:35.346 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=3 2024-03-09T14:45:35.347 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=4 2024-03-09T14:45:35.347 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=5 2024-03-09T14:45:35.347 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=6 2024-03-09T14:45:35.347 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-03-09T14:45:35.255+0000 7fe2067b5980 20 add_watcher() i=7 2024-03-09T14:45:35.347 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-03-09T14:45:35.255+0000 7fe2067b5980 2 all 8 watchers are set, enabling cache 2024-03-09T14:45:35.347 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding auth protocol: cephx 2024-03-09T14:45:35.347 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding auth protocol: cephx 2024-03-09T14:45:35.347 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding auth protocol: cephx 2024-03-09T14:45:35.347 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: secure 2024-03-09T14:45:35.347 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: crc 2024-03-09T14:45:35.347 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-03-09T14:45:35.255+0000 7fe0bb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:35.347 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: secure 2024-03-09T14:45:35.347 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: crc 2024-03-09T14:45:35.347 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: secure 2024-03-09T14:45:35.347 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: crc 2024-03-09T14:45:35.348 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: crc 2024-03-09T14:45:35.348 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: secure 2024-03-09T14:45:35.348 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: crc 2024-03-09T14:45:35.348 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: secure 2024-03-09T14:45:35.348 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: crc 2024-03-09T14:45:35.348 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: secure 2024-03-09T14:45:35.348 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-03-09T14:45:35.255+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.348 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-03-09T14:45:35.255+0000 7fe2067b5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:45:35.348 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-03-09T14:45:35.255+0000 7fe2067b5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:45:35.348 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command cache list hook 0x55bad533a900 2024-03-09T14:45:35.348 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command cache inspect hook 0x55bad533a900 2024-03-09T14:45:35.348 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command cache erase hook 0x55bad533a900 2024-03-09T14:45:35.348 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command cache zap hook 0x55bad533a900 2024-03-09T14:45:35.348 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 note: GC not initialized 2024-03-09T14:45:35.348 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-03-09T14:45:35.255+0000 7fe0ba7dc640 20 reqs_thread_entry: start 2024-03-09T14:45:35.349 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-03-09T14:45:35.259+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command sync trace show hook 0x7fe1ec004470 2024-03-09T14:45:35.349 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-03-09T14:45:35.259+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command sync trace history hook 0x7fe1ec004470 2024-03-09T14:45:35.349 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-03-09T14:45:35.259+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command sync trace active hook 0x7fe1ec004470 2024-03-09T14:45:35.349 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-03-09T14:45:35.259+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command sync trace active_short hook 0x7fe1ec004470 2024-03-09T14:45:35.349 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-03-09T14:45:35.259+0000 7fe2067b5980 20 init_complete bucket index max shards: 11 2024-03-09T14:45:35.349 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-03-09T14:45:35.259+0000 7fe2067b5980 20 Filter name: none 2024-03-09T14:45:35.349 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-03-09T14:45:35.259+0000 7fe0b37fe640 20 reqs_thread_entry: start 2024-03-09T14:45:35.349 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-09T14:45:35.349 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-03-09T14:45:35.259+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.349 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-03-09T14:45:35.259+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:35.349 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-09T14:45:35.349 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-09T14:45:35.349 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 : miss 2024-03-09T14:45:35.349 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-03-09T14:45:35.259+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.349 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-03-09T14:45:35.259+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:45:35.349 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 info.flags=0x17 2024-03-09T14:45:35.350 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 to cache LRU end 2024-03-09T14:45:35.350 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:45:35.350 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:35.350 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 2024-03-09T14:45:35.350 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-03-09T14:45:35.271+0000 7fe2067b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 info.flags=0x17 2024-03-09T14:45:35.350 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-03-09T14:45:35.271+0000 7fe2067b5980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 to cache LRU end 2024-03-09T14:45:35.350 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-03-09T14:45:35.271+0000 7fe2067b5980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:35.350 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-03-09T14:45:35.271+0000 7fe2067b5980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27, ofs0, ns] 2024-03-09T14:45:35.350 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-03-09T14:45:35.271+0000 7fe0db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464293 cookie 94260929443632 notifier 6491 bl.length()=1007 2024-03-09T14:45:35.350 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-03-09T14:45:35.271+0000 7fe0db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 info.flags=0x17 2024-03-09T14:45:35.350 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-03-09T14:45:35.271+0000 7fe0db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 to cache LRU end 2024-03-09T14:45:35.350 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-03-09T14:45:35.271+0000 7fe0db7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:35.350 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-03-09T14:45:35.271+0000 7fe2067b5980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): orig_sources= new_sources= 2024-03-09T14:45:35.350 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-03-09T14:45:35.271+0000 7fe2067b5980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): potential sources added=[] removed=[] 2024-03-09T14:45:35.351 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-03-09T14:45:35.271+0000 7fe2067b5980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): orig_dests= new_dests= 2024-03-09T14:45:35.351 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-03-09T14:45:35.271+0000 7fe2067b5980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): potential dests added=[] removed=[] 2024-03-09T14:45:35.351 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.0 2024-03-09T14:45:35.351 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.0 2024-03-09T14:45:35.351 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.1 2024-03-09T14:45:35.351 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.1 2024-03-09T14:45:35.351 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.2 2024-03-09T14:45:35.351 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.2 2024-03-09T14:45:35.351 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.3 2024-03-09T14:45:35.351 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.3 2024-03-09T14:45:35.351 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.4 2024-03-09T14:45:35.351 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.4 2024-03-09T14:45:35.351 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.5 2024-03-09T14:45:35.351 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.5 2024-03-09T14:45:35.351 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.6 2024-03-09T14:45:35.352 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.6 2024-03-09T14:45:35.352 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.7 2024-03-09T14:45:35.352 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.7 2024-03-09T14:45:35.352 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.8 2024-03-09T14:45:35.352 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.8 2024-03-09T14:45:35.352 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.9 2024-03-09T14:45:35.352 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.9 2024-03-09T14:45:35.352 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.10 2024-03-09T14:45:35.352 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.10 2024-03-09T14:45:35.352 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.11 2024-03-09T14:45:35.352 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.11 2024-03-09T14:45:35.352 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.0 2024-03-09T14:45:35.352 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1 2024-03-09T14:45:35.352 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.2 2024-03-09T14:45:35.352 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-03-09T14:45:35.283+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.3 2024-03-09T14:45:35.353 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-03-09T14:45:35.283+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.4 2024-03-09T14:45:35.353 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-03-09T14:45:35.283+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.5 2024-03-09T14:45:35.353 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-03-09T14:45:35.287+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.6 2024-03-09T14:45:35.353 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-03-09T14:45:35.287+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.7 2024-03-09T14:45:35.353 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-03-09T14:45:35.287+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.8 2024-03-09T14:45:35.353 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-03-09T14:45:35.287+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.9 2024-03-09T14:45:35.353 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-03-09T14:45:35.291+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.10 2024-03-09T14:45:35.353 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-03-09T14:45:35.295+0000 7fe2067b5980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe2067b5980 time 2024-03-09T14:45:35.300624+0000 2024-03-09T14:45:35.353 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:45:35.353 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.353 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:45:35.353 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe20a08ad7b] 2024-03-09T14:45:35.353 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7fe20a08af2f] 2024-03-09T14:45:35.353 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bad341dc51] 2024-03-09T14:45:35.353 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x577) [0x55bad343e557] 2024-03-09T14:45:35.354 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-03-09T14:45:35.354 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe208ef5d90] 2024-03-09T14:45:35.354 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-03-09T14:45:35.354 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-03-09T14:45:35.354 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.354 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-03-09T14:45:35.295+0000 7fe2067b5980 -1 *** Caught signal (Aborted) ** 2024-03-09T14:45:35.354 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7fe2067b5980 thread_name:radosgw-admin 2024-03-09T14:45:35.354 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.354 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:45:35.354 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe208f0e520] 2024-03-09T14:45:35.354 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-03-09T14:45:35.354 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-03-09T14:45:35.354 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-03-09T14:45:35.354 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe20a08add5] 2024-03-09T14:45:35.354 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7fe20a08af2f] 2024-03-09T14:45:35.355 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bad341dc51] 2024-03-09T14:45:35.355 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x577) [0x55bad343e557] 2024-03-09T14:45:35.355 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-03-09T14:45:35.355 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe208ef5d90] 2024-03-09T14:45:35.355 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-03-09T14:45:35.355 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-03-09T14:45:35.355 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:45:35.355 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.355 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-03-09T14:45:35.355 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-03-09T14:45:35.355 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-03-09T14:45:35.355 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-03-09T14:45:35.355 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-03-09T14:45:35.355 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-03-09T14:45:35.355 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-03-09T14:45:35.356 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-03-09T14:45:35.356 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-03-09T14:45:35.356 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-03-09T14:45:35.356 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-03-09T14:45:35.356 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-03-09T14:45:35.356 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-03-09T14:45:35.356 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-03-09T14:45:35.356 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-03-09T14:45:35.356 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-03-09T14:45:35.356 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-03-09T14:45:35.356 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-03-09T14:45:35.356 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-03-09T14:45:35.356 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-03-09T14:45:35.356 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-03-09T14:45:35.356 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-03-09T14:45:35.356 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-03-09T14:45:35.357 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:45:35.357 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-03-09T14:45:35.357 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-03-09T14:45:35.357 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-03-09T14:45:35.357 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-03-09T14:45:35.357 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-03-09T14:45:35.357 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-03-09T14:45:35.357 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-03-09T14:45:35.357 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-03-09T14:45:35.357 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-03-09T14:45:35.357 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-03-09T14:45:35.357 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-03-09T14:45:35.357 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-03-09T14:45:35.357 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-03-09T14:45:35.357 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-03-09T14:45:35.357 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-03-09T14:45:35.358 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-03-09T14:45:35.358 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-03-09T14:45:35.358 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-03-09T14:45:35.358 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-03-09T14:45:35.358 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-03-09T14:45:35.358 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-03-09T14:45:35.358 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:45:35.358 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-03-09T14:45:35.358 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:45:35.358 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-03-09T14:45:35.358 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-03-09T14:45:35.358 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-03-09T14:45:35.358 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-03-09T14:45:35.358 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-03-09T14:45:35.358 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-03-09T14:45:35.359 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-03-09T14:45:35.359 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-03-09T14:45:35.359 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-03-09T14:45:35.359 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-03-09T14:45:35.359 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-03-09T14:45:35.359 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-03-09T14:45:35.359 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-03-09T14:45:35.359 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-03-09T14:45:35.359 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-03-09T14:45:35.359 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-03-09T14:45:35.359 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-03-09T14:45:35.359 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:45:35.359 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-03-09T14:45:35.359 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:45:35.359 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-03-09T14:45:35.359 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-03-09T14:45:35.360 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-03-09T14:45:35.360 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-03-09T14:45:35.360 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-03-09T14:45:35.360 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-03-09T14:45:35.360 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:45:35.360 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-03-09T14:45:35.360 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-03-09T14:45:35.360 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:45:35.360 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-03-09T14:45:35.360 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-03-09T14:45:35.360 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-03-09T14:45:35.360 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-03-09T14:45:35.360 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-03-09T14:45:35.360 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-03-09T14:45:35.360 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-03-09T14:45:35.361 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-03-09T14:45:35.361 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-03-09T14:45:35.361 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-03-09T14:45:35.361 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-03-09T14:45:35.361 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-03-09T14:45:35.361 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:45:35.361 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe0b37fe640 / http_manager 2024-03-09T14:45:35.361 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe0ba7dc640 / http_manager 2024-03-09T14:45:35.361 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe0bb7de640 / rgw_dt_lg_renew 2024-03-09T14:45:35.361 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe0d9ffb640 / ms_dispatch 2024-03-09T14:45:35.361 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe0db7fe640 / io_context_pool 2024-03-09T14:45:35.361 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe0e9ffb640 / ms_dispatch 2024-03-09T14:45:35.361 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe0f0e09640 / ms_dispatch 2024-03-09T14:45:35.361 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe0f260c640 / io_context_pool 2024-03-09T14:45:35.361 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe203acc640 / msgr-worker-2 2024-03-09T14:45:35.362 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe2042cd640 / msgr-worker-1 2024-03-09T14:45:35.362 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe204ace640 / msgr-worker-0 2024-03-09T14:45:35.362 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe2052cf640 / io_context_pool 2024-03-09T14:45:35.362 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe2067b5980 / radosgw-admin 2024-03-09T14:45:35.362 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-03-09T14:45:35.362 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-03-09T14:45:35.362 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/log/ceph/ceph-client.admin.97361.log 2024-03-09T14:45:35.362 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-03-09T14:45:35.362 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-03-09T14:45:35.362 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-03-09T14:45:35.187+0000 7fe2067b5980 5 AuthRegistry(0x55bad52a6240) adding con mode: crc 2024-03-09T14:45:35.362 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-03-09T14:45:35.187+0000 7fe2067b5980 5 AuthRegistry(0x55bad52a6240) adding con mode: crc 2024-03-09T14:45:35.362 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-03-09T14:45:35.187+0000 7fe2067b5980 5 AuthRegistry(0x55bad52a6240) adding con mode: secure 2024-03-09T14:45:35.362 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-03-09T14:45:35.187+0000 7fe2067b5980 5 AuthRegistry(0x55bad52a6240) adding con mode: crc 2024-03-09T14:45:35.362 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-03-09T14:45:35.187+0000 7fe2067b5980 5 AuthRegistry(0x55bad52a6240) adding con mode: secure 2024-03-09T14:45:35.362 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-03-09T14:45:35.187+0000 7fe2067b5980 5 AuthRegistry(0x55bad52a6240) adding con mode: crc 2024-03-09T14:45:35.363 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-03-09T14:45:35.187+0000 7fe2067b5980 5 AuthRegistry(0x55bad52a6240) adding con mode: secure 2024-03-09T14:45:35.363 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-03-09T14:45:35.191+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.363 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-03-09T14:45:35.191+0000 7fe2067b5980 1 librados: starting msgr at 2024-03-09T14:45:35.363 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-03-09T14:45:35.191+0000 7fe2067b5980 1 librados: starting objecter 2024-03-09T14:45:35.363 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command objecter_requests hook 0x55bad5137320 2024-03-09T14:45:35.363 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-03-09T14:45:35.191+0000 7fe2067b5980 1 librados: setting wanted keys 2024-03-09T14:45:35.363 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-03-09T14:45:35.191+0000 7fe2067b5980 1 librados: calling monclient init 2024-03-09T14:45:35.363 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient: init 2024-03-09T14:45:35.363 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding auth protocol: cephx 2024-03-09T14:45:35.363 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding auth protocol: cephx 2024-03-09T14:45:35.363 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding auth protocol: cephx 2024-03-09T14:45:35.363 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: secure 2024-03-09T14:45:35.363 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: crc 2024-03-09T14:45:35.363 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: secure 2024-03-09T14:45:35.363 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: crc 2024-03-09T14:45:35.363 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: secure 2024-03-09T14:45:35.364 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: crc 2024-03-09T14:45:35.364 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: crc 2024-03-09T14:45:35.364 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: secure 2024-03-09T14:45:35.364 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: crc 2024-03-09T14:45:35.364 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: secure 2024-03-09T14:45:35.364 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: crc 2024-03-09T14:45:35.364 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 AuthRegistry(0x55bad5276c20) adding con mode: secure 2024-03-09T14:45:35.364 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-03-09T14:45:35.191+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.364 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-03-09T14:45:35.191+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.364 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command rotate-key hook 0x55bad5276d68 2024-03-09T14:45:35.364 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient: _reopen_session rank -1 2024-03-09T14:45:35.364 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient: _add_conns ranks=[2,1,0] 2024-03-09T14:45:35.364 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-c con 0x55bad5127e80 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:45:35.364 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-b con 0x55bad51bd150 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:45:35.364 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-a con 0x55bad51c3220 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:45:35.364 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.365 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.365 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.365 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient(hunting): _renew_subs 2024-03-09T14:45:35.365 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient(hunting): authenticate will time out at 1988.992919s 2024-03-09T14:45:35.365 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient(hunting): get_auth_request con 0x55bad5127e80 auth_method 0 2024-03-09T14:45:35.365 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:45:35.365 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:45:35.365 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:45:35.365 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-03-09T14:45:35.191+0000 7fe204ace640 10 monclient(hunting): get_auth_request con 0x55bad51c3220 auth_method 0 2024-03-09T14:45:35.365 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-03-09T14:45:35.191+0000 7fe204ace640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:45:35.365 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-03-09T14:45:35.191+0000 7fe204ace640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:45:35.365 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-03-09T14:45:35.191+0000 7fe204ace640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:45:35.365 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:45:35.365 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:45:35.365 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:45:35.366 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-03-09T14:45:35.191+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:45:35.366 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-03-09T14:45:35.191+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:45:35.366 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-03-09T14:45:35.191+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:45:35.366 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient(hunting): handle_auth_done global_id 6482 payload 824 2024-03-09T14:45:35.366 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient: _finish_hunting 0 2024-03-09T14:45:35.366 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-03-09T14:45:35.191+0000 7fe2042cd640 1 monclient: found mon.noname-c 2024-03-09T14:45:35.366 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-03-09T14:45:35.191+0000 7fe2042cd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:45:35.366 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:45:35.366 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:45:35.366 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: dump: 2024-03-09T14:45:35.366 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:45:35.366 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:45:35.366 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.366 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.366 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:45:35.367 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.367 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:45:35.367 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:45:35.367 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:45:35.367 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.367 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: _finish_auth 0 2024-03-09T14:45:35.367 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: _check_auth_tickets 2024-03-09T14:45:35.367 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:45:35.367 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:45:35.367 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:45:35.367 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 10 monclient: dump: 2024-03-09T14:45:35.367 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:45:35.367 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:45:35.367 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.367 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.368 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:45:35.368 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.368 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:45:35.368 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:45:35.368 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:45:35.368 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.368 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-03-09T14:45:35.191+0000 7fe2067b5980 5 monclient: authenticate success, global_id 6482 2024-03-09T14:45:35.368 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-03-09T14:45:35.191+0000 7fe0f260c640 4 set_mon_vals no callback set 2024-03-09T14:45:35.368 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient: _renew_subs 2024-03-09T14:45:35.368 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:45:35.368 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient: _renew_subs 2024-03-09T14:45:35.368 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-03-09T14:45:35.191+0000 7fe2067b5980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:45:35.368 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-03-09T14:45:35.191+0000 7fe2067b5980 1 librados: init done 2024-03-09T14:45:35.368 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:45:35.368 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:45:35.369 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-03-09T14:45:35.191+0000 7fe0f0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:45:35.369 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-03-09T14:45:35.191+0000 7fe203acc640 10 monclient: get_auth_request con 0x7fe0ec066070 auth_method 0 2024-03-09T14:45:35.369 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-03-09T14:45:35.195+0000 7fe204ace640 10 monclient: get_auth_request con 0x55bad52a41c0 auth_method 0 2024-03-09T14:45:35.369 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-03-09T14:45:35.195+0000 7fe2042cd640 10 monclient: get_auth_request con 0x55bad52c1700 auth_method 0 2024-03-09T14:45:35.369 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-03-09T14:45:35.195+0000 7fe203acc640 10 monclient: get_auth_request con 0x55bad52c58f0 auth_method 0 2024-03-09T14:45:35.369 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient: get_auth_request con 0x55bad52c95d0 auth_method 0 2024-03-09T14:45:35.369 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient: build_initial_monmap 2024-03-09T14:45:35.369 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-03-09T14:45:35.199+0000 7fe2067b5980 1 build_initial for_mkfs: 0 2024-03-09T14:45:35.369 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient: monmap: 2024-03-09T14:45:35.369 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:45:35.369 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:45:35.369 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:45:35.369 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:45:35.369 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:45:35.369 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.369 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:45:35.370 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:45:35.370 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:45:35.370 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.370 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding auth protocol: cephx 2024-03-09T14:45:35.370 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding auth protocol: cephx 2024-03-09T14:45:35.370 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding auth protocol: cephx 2024-03-09T14:45:35.370 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: secure 2024-03-09T14:45:35.370 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: crc 2024-03-09T14:45:35.370 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: secure 2024-03-09T14:45:35.370 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: crc 2024-03-09T14:45:35.370 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: secure 2024-03-09T14:45:35.370 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: crc 2024-03-09T14:45:35.370 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: crc 2024-03-09T14:45:35.370 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: secure 2024-03-09T14:45:35.371 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: crc 2024-03-09T14:45:35.371 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: secure 2024-03-09T14:45:35.371 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: crc 2024-03-09T14:45:35.371 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cd640) adding con mode: secure 2024-03-09T14:45:35.371 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-03-09T14:45:35.199+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.371 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command objecter_requests cmddesc objecter_requests hook 0x55bad52d2d90 EEXIST 2024-03-09T14:45:35.371 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient: init 2024-03-09T14:45:35.371 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding auth protocol: cephx 2024-03-09T14:45:35.371 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding auth protocol: cephx 2024-03-09T14:45:35.371 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding auth protocol: cephx 2024-03-09T14:45:35.371 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: secure 2024-03-09T14:45:35.371 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: crc 2024-03-09T14:45:35.371 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: secure 2024-03-09T14:45:35.371 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: crc 2024-03-09T14:45:35.371 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: secure 2024-03-09T14:45:35.372 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: crc 2024-03-09T14:45:35.372 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: crc 2024-03-09T14:45:35.372 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: secure 2024-03-09T14:45:35.372 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: crc 2024-03-09T14:45:35.372 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: secure 2024-03-09T14:45:35.372 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: crc 2024-03-09T14:45:35.372 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 AuthRegistry(0x55bad52cc5d8) adding con mode: secure 2024-03-09T14:45:35.372 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-03-09T14:45:35.199+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.372 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-03-09T14:45:35.199+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.372 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-03-09T14:45:35.199+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command rotate-key cmddesc rotate-key hook 0x55bad52cc720 EEXIST 2024-03-09T14:45:35.372 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient: _reopen_session rank -1 2024-03-09T14:45:35.372 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient: _add_conns ranks=[2,0,1] 2024-03-09T14:45:35.372 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-c con 0x55bad52f79f0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:45:35.372 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-a con 0x55bad52f7dd0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:45:35.372 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-b con 0x55bad52f2f90 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:45:35.372 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.373 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.373 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.373 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient(hunting): _renew_subs 2024-03-09T14:45:35.373 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-03-09T14:45:35.199+0000 7fe2067b5980 10 monclient(hunting): authenticate will time out at 1989.003391s 2024-03-09T14:45:35.373 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient(hunting): get_auth_request con 0x55bad52f7dd0 auth_method 0 2024-03-09T14:45:35.373 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:45:35.373 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:45:35.373 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:45:35.373 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-03-09T14:45:35.199+0000 7fe203acc640 10 monclient(hunting): get_auth_request con 0x55bad52f79f0 auth_method 0 2024-03-09T14:45:35.373 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-03-09T14:45:35.199+0000 7fe203acc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:45:35.373 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-03-09T14:45:35.199+0000 7fe203acc640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:45:35.373 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-03-09T14:45:35.199+0000 7fe203acc640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:45:35.373 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:45:35.373 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:45:35.374 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:45:35.374 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-03-09T14:45:35.199+0000 7fe203acc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:45:35.374 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-03-09T14:45:35.199+0000 7fe203acc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:45:35.374 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-03-09T14:45:35.199+0000 7fe203acc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:45:35.374 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient(hunting): handle_auth_done global_id 6771 payload 824 2024-03-09T14:45:35.374 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient: _finish_hunting 0 2024-03-09T14:45:35.374 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-03-09T14:45:35.199+0000 7fe204ace640 1 monclient: found mon.noname-a 2024-03-09T14:45:35.374 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-03-09T14:45:35.199+0000 7fe204ace640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:45:35.374 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:45:35.374 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:45:35.374 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: dump: 2024-03-09T14:45:35.374 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:45:35.374 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:45:35.374 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.374 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.375 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:45:35.375 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.375 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:45:35.375 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:45:35.375 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:45:35.375 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.375 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: _finish_auth 0 2024-03-09T14:45:35.375 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: _check_auth_tickets 2024-03-09T14:45:35.375 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:45:35.375 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:45:35.375 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:45:35.375 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 10 monclient: dump: 2024-03-09T14:45:35.375 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:45:35.375 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:45:35.375 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.376 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.376 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:45:35.376 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.376 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:45:35.376 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:45:35.376 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:45:35.376 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.376 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 monclient: authenticate success, global_id 6771 2024-03-09T14:45:35.376 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-03-09T14:45:35.203+0000 7fe2052cf640 4 set_mon_vals no callback set 2024-03-09T14:45:35.376 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: _renew_subs 2024-03-09T14:45:35.376 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:45:35.376 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: _renew_subs 2024-03-09T14:45:35.376 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:45:35.376 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:45:35.376 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:45:35.377 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-03-09T14:45:35.203+0000 7fe0e9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:45:35.377 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-03-09T14:45:35.203+0000 7fe203acc640 10 monclient: get_auth_request con 0x7fe0dc065f80 auth_method 0 2024-03-09T14:45:35.377 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: get_monmap_and_config 2024-03-09T14:45:35.377 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: build_initial_monmap 2024-03-09T14:45:35.377 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-03-09T14:45:35.203+0000 7fe2067b5980 1 build_initial for_mkfs: 0 2024-03-09T14:45:35.377 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: monmap: 2024-03-09T14:45:35.377 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:45:35.377 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:45:35.377 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:45:35.377 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:45:35.377 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:45:35.377 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.377 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:45:35.377 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:45:35.377 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:45:35.378 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.378 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding auth protocol: cephx 2024-03-09T14:45:35.378 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding auth protocol: cephx 2024-03-09T14:45:35.378 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding auth protocol: cephx 2024-03-09T14:45:35.378 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: secure 2024-03-09T14:45:35.378 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: crc 2024-03-09T14:45:35.378 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: secure 2024-03-09T14:45:35.378 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: crc 2024-03-09T14:45:35.378 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: secure 2024-03-09T14:45:35.378 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: crc 2024-03-09T14:45:35.378 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: crc 2024-03-09T14:45:35.378 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: secure 2024-03-09T14:45:35.378 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: crc 2024-03-09T14:45:35.378 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: secure 2024-03-09T14:45:35.378 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: crc 2024-03-09T14:45:35.379 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x55bad5315540) adding con mode: secure 2024-03-09T14:45:35.379 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-03-09T14:45:35.203+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.379 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: init 2024-03-09T14:45:35.379 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding auth protocol: cephx 2024-03-09T14:45:35.379 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding auth protocol: cephx 2024-03-09T14:45:35.379 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding auth protocol: cephx 2024-03-09T14:45:35.379 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: secure 2024-03-09T14:45:35.379 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: crc 2024-03-09T14:45:35.379 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: secure 2024-03-09T14:45:35.379 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: crc 2024-03-09T14:45:35.379 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: secure 2024-03-09T14:45:35.379 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: crc 2024-03-09T14:45:35.379 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: crc 2024-03-09T14:45:35.379 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: secure 2024-03-09T14:45:35.379 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: crc 2024-03-09T14:45:35.380 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: secure 2024-03-09T14:45:35.380 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: crc 2024-03-09T14:45:35.380 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158930) adding con mode: secure 2024-03-09T14:45:35.380 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-03-09T14:45:35.203+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.380 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-03-09T14:45:35.203+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.380 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-03-09T14:45:35.203+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command rotate-key cmddesc rotate-key hook 0x7fff0b158a78 EEXIST 2024-03-09T14:45:35.380 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: _reopen_session rank -1 2024-03-09T14:45:35.380 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient: _add_conns ranks=[1,2,0] 2024-03-09T14:45:35.380 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-b con 0x55bad5349ae0 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:45:35.380 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-c con 0x55bad531abc0 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:45:35.380 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-a con 0x55bad5317870 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:45:35.380 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.380 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.380 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.380 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient(hunting): _renew_subs 2024-03-09T14:45:35.381 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-03-09T14:45:35.203+0000 7fe2067b5980 10 monclient(hunting): authenticate will time out at 1989.007392s 2024-03-09T14:45:35.381 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient(hunting): get_auth_request con 0x55bad531abc0 auth_method 0 2024-03-09T14:45:35.381 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:45:35.381 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:45:35.381 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:45:35.381 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-03-09T14:45:35.203+0000 7fe2042cd640 10 monclient(hunting): get_auth_request con 0x55bad5317870 auth_method 0 2024-03-09T14:45:35.381 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-03-09T14:45:35.203+0000 7fe2042cd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:45:35.381 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-03-09T14:45:35.203+0000 7fe2042cd640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:45:35.381 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-03-09T14:45:35.203+0000 7fe2042cd640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:45:35.381 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:45:35.381 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:45:35.381 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:45:35.381 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-03-09T14:45:35.203+0000 7fe2042cd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:45:35.381 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-03-09T14:45:35.203+0000 7fe2042cd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:45:35.381 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-03-09T14:45:35.203+0000 7fe2042cd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:45:35.382 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient(hunting): handle_auth_done global_id 6488 payload 274 2024-03-09T14:45:35.382 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient: _finish_hunting 0 2024-03-09T14:45:35.382 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-03-09T14:45:35.203+0000 7fe204ace640 1 monclient: found mon.noname-c 2024-03-09T14:45:35.382 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-03-09T14:45:35.203+0000 7fe204ace640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:45:35.382 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:45:35.382 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:45:35.382 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: dump: 2024-03-09T14:45:35.382 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:45:35.382 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:45:35.382 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.382 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.382 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:45:35.382 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.382 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:45:35.382 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:45:35.383 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:45:35.383 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.383 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: _finish_auth 0 2024-03-09T14:45:35.383 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: _check_auth_tickets 2024-03-09T14:45:35.383 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:45:35.383 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 monclient: authenticate success, global_id 6488 2024-03-09T14:45:35.383 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: get_monmap_and_config success 2024-03-09T14:45:35.383 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-03-09T14:45:35.207+0000 7fe2067b5980 4 set_mon_vals no callback set 2024-03-09T14:45:35.383 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:45:35.383 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:45:35.383 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 10 monclient: dump: 2024-03-09T14:45:35.383 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:45:35.383 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:45:35.383 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.383 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.384 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:45:35.384 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.384 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:45:35.384 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:45:35.384 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:45:35.384 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.384 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: shutdown 2024-03-09T14:45:35.384 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: build_initial_monmap 2024-03-09T14:45:35.384 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-03-09T14:45:35.207+0000 7fe2067b5980 1 build_initial for_mkfs: 0 2024-03-09T14:45:35.384 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: monmap: 2024-03-09T14:45:35.384 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:45:35.384 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:45:35.384 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:45:35.384 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:45:35.384 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:45:35.385 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.385 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:45:35.385 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:45:35.385 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:45:35.385 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.385 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding auth protocol: cephx 2024-03-09T14:45:35.385 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding auth protocol: cephx 2024-03-09T14:45:35.385 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding auth protocol: cephx 2024-03-09T14:45:35.385 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: secure 2024-03-09T14:45:35.385 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: crc 2024-03-09T14:45:35.385 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: secure 2024-03-09T14:45:35.385 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: crc 2024-03-09T14:45:35.385 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: secure 2024-03-09T14:45:35.385 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: crc 2024-03-09T14:45:35.385 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: crc 2024-03-09T14:45:35.385 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: secure 2024-03-09T14:45:35.386 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: crc 2024-03-09T14:45:35.386 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: secure 2024-03-09T14:45:35.386 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: crc 2024-03-09T14:45:35.386 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad53453b0) adding con mode: secure 2024-03-09T14:45:35.386 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-03-09T14:45:35.207+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.386 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-03-09T14:45:35.207+0000 7fe2067b5980 1 librados: starting msgr at 2024-03-09T14:45:35.386 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-03-09T14:45:35.207+0000 7fe2067b5980 1 librados: starting objecter 2024-03-09T14:45:35.386 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command objecter_requests cmddesc objecter_requests hook 0x55bad52fb260 EEXIST 2024-03-09T14:45:35.386 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-03-09T14:45:35.207+0000 7fe2067b5980 1 librados: setting wanted keys 2024-03-09T14:45:35.386 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-03-09T14:45:35.207+0000 7fe2067b5980 1 librados: calling monclient init 2024-03-09T14:45:35.386 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: init 2024-03-09T14:45:35.386 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding auth protocol: cephx 2024-03-09T14:45:35.386 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding auth protocol: cephx 2024-03-09T14:45:35.386 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding auth protocol: cephx 2024-03-09T14:45:35.387 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: secure 2024-03-09T14:45:35.387 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: crc 2024-03-09T14:45:35.387 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: secure 2024-03-09T14:45:35.387 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: crc 2024-03-09T14:45:35.387 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: secure 2024-03-09T14:45:35.387 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: crc 2024-03-09T14:45:35.387 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: crc 2024-03-09T14:45:35.387 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: secure 2024-03-09T14:45:35.387 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: crc 2024-03-09T14:45:35.387 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: secure 2024-03-09T14:45:35.387 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: crc 2024-03-09T14:45:35.387 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 AuthRegistry(0x55bad5314710) adding con mode: secure 2024-03-09T14:45:35.387 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-03-09T14:45:35.207+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.387 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-03-09T14:45:35.207+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.387 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command rotate-key cmddesc rotate-key hook 0x55bad5314858 EEXIST 2024-03-09T14:45:35.388 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: _reopen_session rank -1 2024-03-09T14:45:35.388 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: _add_conns ranks=[2,0,1] 2024-03-09T14:45:35.388 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-c con 0x55bad5317870 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:45:35.388 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-a con 0x55bad531abc0 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:45:35.388 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient(hunting): picked mon.noname-b con 0x55bad5349ae0 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:45:35.388 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.388 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.388 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient(hunting): start opening mon connection 2024-03-09T14:45:35.388 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient(hunting): _renew_subs 2024-03-09T14:45:35.388 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient(hunting): authenticate will time out at 1989.009873s 2024-03-09T14:45:35.388 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient(hunting): get_auth_request con 0x55bad5317870 auth_method 0 2024-03-09T14:45:35.388 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:45:35.388 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:45:35.388 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:45:35.389 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-03-09T14:45:35.207+0000 7fe204ace640 10 monclient(hunting): get_auth_request con 0x55bad531abc0 auth_method 0 2024-03-09T14:45:35.389 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-03-09T14:45:35.207+0000 7fe204ace640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:45:35.389 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-03-09T14:45:35.207+0000 7fe204ace640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:45:35.389 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-03-09T14:45:35.207+0000 7fe204ace640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:45:35.389 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:45:35.389 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:45:35.389 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:45:35.389 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-03-09T14:45:35.207+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:45:35.389 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-03-09T14:45:35.207+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:45:35.389 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-03-09T14:45:35.207+0000 7fe204ace640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:45:35.389 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient(hunting): handle_auth_done global_id 6491 payload 824 2024-03-09T14:45:35.389 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient: _finish_hunting 0 2024-03-09T14:45:35.389 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-03-09T14:45:35.207+0000 7fe203acc640 1 monclient: found mon.noname-c 2024-03-09T14:45:35.389 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-03-09T14:45:35.207+0000 7fe203acc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:45:35.389 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:45:35.390 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:45:35.390 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: dump: 2024-03-09T14:45:35.390 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:45:35.390 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:45:35.390 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.390 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.390 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:45:35.390 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.390 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:45:35.390 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:45:35.390 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:45:35.390 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.390 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: _finish_auth 0 2024-03-09T14:45:35.390 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: _check_auth_tickets 2024-03-09T14:45:35.390 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:45:35.391 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:45:35.391 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:45:35.391 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-03-09T14:45:35.207+0000 7fe0d9ffb640 10 monclient: dump: 2024-03-09T14:45:35.391 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:45:35.391 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:45:35.391 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.391 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:45:35.391 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:45:35.391 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:45:35.391 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:45:35.391 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:45:35.391 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:45:35.391 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.391 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-03-09T14:45:35.207+0000 7fe0db7fe640 4 set_mon_vals no callback set 2024-03-09T14:45:35.391 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 monclient: authenticate success, global_id 6491 2024-03-09T14:45:35.392 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: _renew_subs 2024-03-09T14:45:35.392 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:45:35.392 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: _renew_subs 2024-03-09T14:45:35.392 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-03-09T14:45:35.207+0000 7fe2067b5980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:45:35.392 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-03-09T14:45:35.207+0000 7fe2067b5980 1 librados: init done 2024-03-09T14:45:35.392 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-03-09T14:45:35.207+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command cr dump hook 0x55bad534bc38 2024-03-09T14:45:35.392 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.392 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-03-09T14:45:35.211+0000 7fe0d9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:45:35.392 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-03-09T14:45:35.211+0000 7fe0d9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:45:35.392 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-03-09T14:45:35.211+0000 7fe0d9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:45:35.392 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-03-09T14:45:35.211+0000 7fe204ace640 10 monclient: get_auth_request con 0x7fe0cc066040 auth_method 0 2024-03-09T14:45:35.392 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-03-09T14:45:35.211+0000 7fe2042cd640 10 monclient: get_auth_request con 0x55bad5363700 auth_method 0 2024-03-09T14:45:35.392 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.392 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 realm 2024-03-09T14:45:35.392 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.393 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.393 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-03-09T14:45:35.211+0000 7fe2067b5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:45:35.393 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.393 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.393 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.393 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-03-09T14:45:35.211+0000 7fe203acc640 10 monclient: get_auth_request con 0x55bad5367a70 auth_method 0 2024-03-09T14:45:35.393 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:35.393 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-03-09T14:45:35.211+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.393 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-03-09T14:45:35.215+0000 7fe204ace640 10 monclient: get_auth_request con 0x55bad536b190 auth_method 0 2024-03-09T14:45:35.393 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-03-09T14:45:35.215+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:45:35.393 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-03-09T14:45:35.215+0000 7fe2067b5980 20 searching for the correct realm 2024-03-09T14:45:35.393 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-03-09T14:45:35.215+0000 7fe2042cd640 10 monclient: get_auth_request con 0x55bad536fee0 auth_method 0 2024-03-09T14:45:35.393 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-03-09T14:45:35.215+0000 7fe203acc640 10 monclient: get_auth_request con 0x7fe1fc056be0 auth_method 0 2024-03-09T14:45:35.393 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-03-09T14:45:35.219+0000 7fe204ace640 10 monclient: get_auth_request con 0x7fe1ec0b9fb0 auth_method 0 2024-03-09T14:45:35.394 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-03-09T14:45:35.219+0000 7fe2042cd640 0 -- 172.21.15.99:0/1722523730 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x55bad536fee0 msgr2=0x55bad53723a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:35.394 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-03-09T14:45:35.219+0000 7fe0d9ffb640 1 client.6491.objecter ms_handle_reset 0x55bad536fee0 session 0x55bad536f860 osd.3 2024-03-09T14:45:35.394 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-03-09T14:45:35.219+0000 7fe0d9ffb640 10 monclient: _renew_subs 2024-03-09T14:45:35.394 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-03-09T14:45:35.219+0000 7fe0d9ffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:45:35.394 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-03-09T14:45:35.219+0000 7fe2042cd640 10 monclient: get_auth_request con 0x7fe0cc076660 auth_method 0 2024-03-09T14:45:35.394 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-03-09T14:45:35.219+0000 7fe2042cd640 10 monclient: get_auth_request con 0x7fe1f4013030 auth_method 0 2024-03-09T14:45:35.394 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-03-09T14:45:35.223+0000 7fe203acc640 10 monclient: get_auth_request con 0x7fe1f4008030 auth_method 0 2024-03-09T14:45:35.394 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-03-09T14:45:35.227+0000 7fe203acc640 0 -- 172.21.15.99:0/1722523730 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fe1f4008030 msgr2=0x7fe1f407b8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:35.394 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-03-09T14:45:35.227+0000 7fe0d9ffb640 1 client.6491.objecter ms_handle_reset 0x7fe1f4008030 session 0x7fe1f4063040 osd.0 2024-03-09T14:45:35.394 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-03-09T14:45:35.227+0000 7fe203acc640 10 monclient: get_auth_request con 0x55bad536fee0 auth_method 0 2024-03-09T14:45:35.394 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:45:35.394 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:45:35.394 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:45:35.394 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:45:35.395 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:45:35.395 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:45:35.395 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.395 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.395 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.395 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:35.395 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.395 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:45:35.395 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 zone default found 2024-03-09T14:45:35.395 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-03-09T14:45:35.235+0000 7fe2067b5980 4 Realm: () 2024-03-09T14:45:35.395 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-03-09T14:45:35.235+0000 7fe2067b5980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:45:35.395 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-03-09T14:45:35.235+0000 7fe2067b5980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:45:35.395 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-03-09T14:45:35.235+0000 7fe2067b5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:45:35.395 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 zonegroup default 2024-03-09T14:45:35.396 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.396 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.396 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.396 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.396 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.396 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.396 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 started sync module instance, tier type = 2024-03-09T14:45:35.396 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-03-09T14:45:35.235+0000 7fe2067b5980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:45:35.396 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=0 2024-03-09T14:45:35.396 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=1 2024-03-09T14:45:35.396 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=2 2024-03-09T14:45:35.396 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=3 2024-03-09T14:45:35.396 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=4 2024-03-09T14:45:35.396 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=5 2024-03-09T14:45:35.396 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-03-09T14:45:35.251+0000 7fe2067b5980 20 add_watcher() i=6 2024-03-09T14:45:35.397 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-03-09T14:45:35.255+0000 7fe2067b5980 20 add_watcher() i=7 2024-03-09T14:45:35.397 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-03-09T14:45:35.255+0000 7fe2067b5980 2 all 8 watchers are set, enabling cache 2024-03-09T14:45:35.397 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding auth protocol: cephx 2024-03-09T14:45:35.397 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding auth protocol: cephx 2024-03-09T14:45:35.397 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding auth protocol: cephx 2024-03-09T14:45:35.397 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: secure 2024-03-09T14:45:35.397 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: crc 2024-03-09T14:45:35.397 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-03-09T14:45:35.255+0000 7fe0bb7de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:35.397 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: secure 2024-03-09T14:45:35.397 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: crc 2024-03-09T14:45:35.397 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: secure 2024-03-09T14:45:35.397 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: crc 2024-03-09T14:45:35.397 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: crc 2024-03-09T14:45:35.397 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: secure 2024-03-09T14:45:35.397 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: crc 2024-03-09T14:45:35.398 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: secure 2024-03-09T14:45:35.398 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: crc 2024-03-09T14:45:35.398 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 AuthRegistry(0x7fff0b158dc0) adding con mode: secure 2024-03-09T14:45:35.398 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-03-09T14:45:35.255+0000 7fe2067b5980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:45:35.398 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-03-09T14:45:35.255+0000 7fe2067b5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:45:35.398 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-03-09T14:45:35.255+0000 7fe2067b5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:45:35.398 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command cache list hook 0x55bad533a900 2024-03-09T14:45:35.398 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command cache inspect hook 0x55bad533a900 2024-03-09T14:45:35.398 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command cache erase hook 0x55bad533a900 2024-03-09T14:45:35.398 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command cache zap hook 0x55bad533a900 2024-03-09T14:45:35.398 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-03-09T14:45:35.255+0000 7fe2067b5980 5 note: GC not initialized 2024-03-09T14:45:35.398 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-03-09T14:45:35.255+0000 7fe0ba7dc640 20 reqs_thread_entry: start 2024-03-09T14:45:35.398 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-03-09T14:45:35.259+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command sync trace show hook 0x7fe1ec004470 2024-03-09T14:45:35.398 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-03-09T14:45:35.259+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command sync trace history hook 0x7fe1ec004470 2024-03-09T14:45:35.398 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-03-09T14:45:35.259+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command sync trace active hook 0x7fe1ec004470 2024-03-09T14:45:35.399 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-03-09T14:45:35.259+0000 7fe2067b5980 5 asok(0x55bad506abb0) register_command sync trace active_short hook 0x7fe1ec004470 2024-03-09T14:45:35.399 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-03-09T14:45:35.259+0000 7fe2067b5980 20 init_complete bucket index max shards: 11 2024-03-09T14:45:35.399 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-03-09T14:45:35.259+0000 7fe2067b5980 20 Filter name: none 2024-03-09T14:45:35.399 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-03-09T14:45:35.259+0000 7fe0b37fe640 20 reqs_thread_entry: start 2024-03-09T14:45:35.399 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-09T14:45:35.399 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-03-09T14:45:35.259+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.399 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-03-09T14:45:35.259+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:35.399 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-09T14:45:35.399 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-09T14:45:35.399 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 : miss 2024-03-09T14:45:35.399 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-03-09T14:45:35.259+0000 7fe2067b5980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.399 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-03-09T14:45:35.259+0000 7fe2067b5980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:45:35.399 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 info.flags=0x17 2024-03-09T14:45:35.399 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 to cache LRU end 2024-03-09T14:45:35.400 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:45:35.400 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:35.400 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-03-09T14:45:35.259+0000 7fe2067b5980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 2024-03-09T14:45:35.400 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-03-09T14:45:35.271+0000 7fe2067b5980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 info.flags=0x17 2024-03-09T14:45:35.400 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-03-09T14:45:35.271+0000 7fe2067b5980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 to cache LRU end 2024-03-09T14:45:35.400 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-03-09T14:45:35.271+0000 7fe2067b5980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:35.400 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-03-09T14:45:35.271+0000 7fe2067b5980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27, ofs0, ns] 2024-03-09T14:45:35.400 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-03-09T14:45:35.271+0000 7fe0db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464293 cookie 94260929443632 notifier 6491 bl.length()=1007 2024-03-09T14:45:35.400 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-03-09T14:45:35.271+0000 7fe0db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 info.flags=0x17 2024-03-09T14:45:35.400 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-03-09T14:45:35.271+0000 7fe0db7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 to cache LRU end 2024-03-09T14:45:35.400 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-03-09T14:45:35.271+0000 7fe0db7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:45:35.400 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-03-09T14:45:35.271+0000 7fe2067b5980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): orig_sources= new_sources= 2024-03-09T14:45:35.400 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-03-09T14:45:35.271+0000 7fe2067b5980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): potential sources added=[] removed=[] 2024-03-09T14:45:35.400 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-03-09T14:45:35.271+0000 7fe2067b5980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): orig_dests= new_dests= 2024-03-09T14:45:35.400 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-03-09T14:45:35.271+0000 7fe2067b5980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): potential dests added=[] removed=[] 2024-03-09T14:45:35.401 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.0 2024-03-09T14:45:35.401 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.0 2024-03-09T14:45:35.401 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.1 2024-03-09T14:45:35.401 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.1 2024-03-09T14:45:35.401 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.2 2024-03-09T14:45:35.401 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.2 2024-03-09T14:45:35.401 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.3 2024-03-09T14:45:35.401 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.3 2024-03-09T14:45:35.401 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.4 2024-03-09T14:45:35.401 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.4 2024-03-09T14:45:35.401 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.5 2024-03-09T14:45:35.401 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.5 2024-03-09T14:45:35.401 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.6 2024-03-09T14:45:35.401 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.6 2024-03-09T14:45:35.402 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.7 2024-03-09T14:45:35.402 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.7 2024-03-09T14:45:35.402 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.8 2024-03-09T14:45:35.402 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.8 2024-03-09T14:45:35.402 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.9 2024-03-09T14:45:35.402 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.9 2024-03-09T14:45:35.402 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.10 2024-03-09T14:45:35.403 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.10 2024-03-09T14:45:35.403 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-03-09T14:45:35.279+0000 7fe2067b5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.11 2024-03-09T14:45:35.403 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.11 2024-03-09T14:45:35.403 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.0 2024-03-09T14:45:35.403 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1 2024-03-09T14:45:35.403 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-03-09T14:45:35.279+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.2 2024-03-09T14:45:35.403 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-03-09T14:45:35.283+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.3 2024-03-09T14:45:35.403 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-03-09T14:45:35.283+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.4 2024-03-09T14:45:35.403 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-03-09T14:45:35.283+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.5 2024-03-09T14:45:35.403 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-03-09T14:45:35.287+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.6 2024-03-09T14:45:35.403 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-03-09T14:45:35.287+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.7 2024-03-09T14:45:35.403 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-03-09T14:45:35.287+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.8 2024-03-09T14:45:35.403 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-03-09T14:45:35.287+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.9 2024-03-09T14:45:35.403 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-03-09T14:45:35.291+0000 7fe2067b5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.10 2024-03-09T14:45:35.403 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-03-09T14:45:35.295+0000 7fe2067b5980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fe2067b5980 time 2024-03-09T14:45:35.300624+0000 2024-03-09T14:45:35.404 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:45:35.404 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.404 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:45:35.404 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fe20a08ad7b] 2024-03-09T14:45:35.404 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7fe20a08af2f] 2024-03-09T14:45:35.404 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bad341dc51] 2024-03-09T14:45:35.404 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x577) [0x55bad343e557] 2024-03-09T14:45:35.404 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-03-09T14:45:35.404 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe208ef5d90] 2024-03-09T14:45:35.404 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-03-09T14:45:35.404 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-03-09T14:45:35.404 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.404 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-03-09T14:45:35.295+0000 7fe2067b5980 -1 *** Caught signal (Aborted) ** 2024-03-09T14:45:35.404 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7fe2067b5980 thread_name:radosgw-admin 2024-03-09T14:45:35.405 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.405 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:45:35.405 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fe208f0e520] 2024-03-09T14:45:35.405 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-03-09T14:45:35.405 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-03-09T14:45:35.405 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-03-09T14:45:35.405 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fe20a08add5] 2024-03-09T14:45:35.405 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7fe20a08af2f] 2024-03-09T14:45:35.405 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55bad341dc51] 2024-03-09T14:45:35.405 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x577) [0x55bad343e557] 2024-03-09T14:45:35.405 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-03-09T14:45:35.405 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fe208ef5d90] 2024-03-09T14:45:35.405 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-03-09T14:45:35.405 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-03-09T14:45:35.405 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:45:35.406 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.406 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-03-09T14:45:35.406 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-03-09T14:45:35.406 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-03-09T14:45:35.406 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-03-09T14:45:35.406 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-03-09T14:45:35.406 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-03-09T14:45:35.406 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-03-09T14:45:35.406 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-03-09T14:45:35.406 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-03-09T14:45:35.406 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-03-09T14:45:35.406 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-03-09T14:45:35.406 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-03-09T14:45:35.406 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-03-09T14:45:35.406 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-03-09T14:45:35.407 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-03-09T14:45:35.407 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-03-09T14:45:35.407 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-03-09T14:45:35.407 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-03-09T14:45:35.407 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-03-09T14:45:35.407 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-03-09T14:45:35.407 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-03-09T14:45:35.407 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-03-09T14:45:35.407 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-03-09T14:45:35.407 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:45:35.407 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-03-09T14:45:35.407 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-03-09T14:45:35.407 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-03-09T14:45:35.407 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-03-09T14:45:35.407 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-03-09T14:45:35.408 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-03-09T14:45:35.408 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-03-09T14:45:35.408 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-03-09T14:45:35.408 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-03-09T14:45:35.408 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-03-09T14:45:35.408 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-03-09T14:45:35.408 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-03-09T14:45:35.408 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-03-09T14:45:35.408 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-03-09T14:45:35.408 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-03-09T14:45:35.408 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-03-09T14:45:35.408 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-03-09T14:45:35.408 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-03-09T14:45:35.408 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-03-09T14:45:35.408 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-03-09T14:45:35.408 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-03-09T14:45:35.409 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:45:35.409 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-03-09T14:45:35.409 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:45:35.409 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-03-09T14:45:35.409 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-03-09T14:45:35.409 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-03-09T14:45:35.409 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-03-09T14:45:35.409 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-03-09T14:45:35.409 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-03-09T14:45:35.409 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-03-09T14:45:35.409 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-03-09T14:45:35.409 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-03-09T14:45:35.409 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-03-09T14:45:35.409 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-03-09T14:45:35.409 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-03-09T14:45:35.409 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-03-09T14:45:35.410 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-03-09T14:45:35.410 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-03-09T14:45:35.410 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-03-09T14:45:35.410 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-03-09T14:45:35.410 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:45:35.410 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-03-09T14:45:35.410 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:45:35.410 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-03-09T14:45:35.410 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-03-09T14:45:35.410 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-03-09T14:45:35.410 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-03-09T14:45:35.410 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-03-09T14:45:35.410 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-03-09T14:45:35.410 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:45:35.410 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-03-09T14:45:35.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-03-09T14:45:35.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:45:35.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-03-09T14:45:35.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-03-09T14:45:35.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-03-09T14:45:35.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-03-09T14:45:35.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-03-09T14:45:35.411 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-03-09T14:45:35.411 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-03-09T14:45:35.411 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-03-09T14:45:35.411 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-03-09T14:45:35.411 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-03-09T14:45:35.411 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-03-09T14:45:35.411 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-03-09T14:45:35.411 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:45:35.411 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe0b37fe640 / http_manager 2024-03-09T14:45:35.412 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe0ba7dc640 / http_manager 2024-03-09T14:45:35.412 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe0bb7de640 / rgw_dt_lg_renew 2024-03-09T14:45:35.412 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe0d9ffb640 / ms_dispatch 2024-03-09T14:45:35.412 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe0db7fe640 / io_context_pool 2024-03-09T14:45:35.412 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe0e9ffb640 / ms_dispatch 2024-03-09T14:45:35.412 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe0f0e09640 / ms_dispatch 2024-03-09T14:45:35.412 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe0f260c640 / io_context_pool 2024-03-09T14:45:35.412 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe203acc640 / msgr-worker-2 2024-03-09T14:45:35.412 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe2042cd640 / msgr-worker-1 2024-03-09T14:45:35.412 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe204ace640 / msgr-worker-0 2024-03-09T14:45:35.412 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe2052cf640 / io_context_pool 2024-03-09T14:45:35.412 INFO:tasks.workunit.client.0.smithi099.stderr: 7fe2067b5980 / radosgw-admin 2024-03-09T14:45:35.412 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-03-09T14:45:35.412 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-03-09T14:45:35.412 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/lib/ceph/crash/2024-03-09T14:45:35.302576Z_16f9ae76-b58f-4377-a6f9-666cf8710076/log 2024-03-09T14:45:35.412 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-03-09T14:45:35.413 INFO:tasks.workunit.client.0.smithi099.stderr:Aborted 2024-03-09T14:45:35.413 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-03-09T14:45:35.414 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:45:35.414 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:45:35.414 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.375+0000 7f7128ae0980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.375+0000 7f7128ae0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.375+0000 7f7128ae0980 20 realm 2024-03-09T14:45:35.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.375+0000 7f7128ae0980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.375+0000 7f7128ae0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.375+0000 7f7128ae0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:45:35.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.375+0000 7f7128ae0980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.375+0000 7f7128ae0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.375+0000 7f7128ae0980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.379+0000 7f7128ae0980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:35.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.379+0000 7f7128ae0980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.379+0000 7f7128ae0980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:45:35.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.379+0000 7f7128ae0980 20 searching for the correct realm 2024-03-09T14:45:35.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.383+0000 7f7125df7640 0 -- 172.21.15.99:0/2081497434 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f7118013030 msgr2=0x7f711801e3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:35.415 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.391+0000 7f7125df7640 0 -- 172.21.15.99:0/2081497434 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f712004f450 msgr2=0x7f712004f8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:45:35.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:45:35.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:45:35.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:45:35.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:45:35.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:45:35.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:45:35.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:45:35.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:45:35.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 20 zone default found 2024-03-09T14:45:35.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 4 Realm: () 2024-03-09T14:45:35.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:45:35.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:45:35.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:45:35.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 20 zonegroup default 2024-03-09T14:45:35.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.609 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.611+0000 7f7128ae0980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.615+0000 7f7128ae0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.610 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.615+0000 7f7128ae0980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.615+0000 7f7128ae0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.615+0000 7f7128ae0980 20 started sync module instance, tier type = 2024-03-09T14:45:35.611 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.615+0000 7f7128ae0980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:45:35.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.639+0000 7f7128ae0980 20 add_watcher() i=0 2024-03-09T14:45:35.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.639+0000 7f7128ae0980 20 add_watcher() i=1 2024-03-09T14:45:35.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.639+0000 7f7128ae0980 20 add_watcher() i=2 2024-03-09T14:45:35.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.639+0000 7f7128ae0980 20 add_watcher() i=3 2024-03-09T14:45:35.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.639+0000 7f7128ae0980 20 add_watcher() i=4 2024-03-09T14:45:35.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.639+0000 7f7128ae0980 20 add_watcher() i=5 2024-03-09T14:45:35.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.639+0000 7f7128ae0980 20 add_watcher() i=6 2024-03-09T14:45:35.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.639+0000 7f7128ae0980 20 add_watcher() i=7 2024-03-09T14:45:35.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.639+0000 7f7128ae0980 2 all 8 watchers are set, enabling cache 2024-03-09T14:45:35.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.643+0000 7f6fdd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:35.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.647+0000 7f7128ae0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:45:35.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.647+0000 7f7128ae0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:45:35.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.647+0000 7f7128ae0980 5 note: GC not initialized 2024-03-09T14:45:35.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.647+0000 7f6fd77fe640 20 reqs_thread_entry: start 2024-03-09T14:45:35.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.647+0000 7f7128ae0980 20 init_complete bucket index max shards: 11 2024-03-09T14:45:35.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.647+0000 7f7128ae0980 20 Filter name: none 2024-03-09T14:45:35.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.647+0000 7f6fd57fa640 20 reqs_thread_entry: start 2024-03-09T14:45:35.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.647+0000 7f7128ae0980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.647+0000 7f7128ae0980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:35.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.647+0000 7f7128ae0980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.647+0000 7f7128ae0980 20 rados_obj.operate() r=0 bl.length=467 2024-03-09T14:45:35.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.647+0000 7f7128ae0980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:45:35.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.647+0000 7f7128ae0980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.651+0000 7f7128ae0980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:45:35.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.651+0000 7f7128ae0980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.651+0000 7f7128ae0980 20 rados_obj.operate() r=0 bl.length=467 2024-03-09T14:45:35.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.651+0000 7f7128ae0980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:45:35.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.651+0000 7f7128ae0980 20 rados->read ofs=0 len=0 2024-03-09T14:45:35.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.655+0000 7f7128ae0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:45:35.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.655+0000 7f6fdd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:45:35.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.659+0000 7f7128ae0980 20 remove_watcher() i=0 2024-03-09T14:45:35.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.659+0000 7f7128ae0980 2 removed watcher, disabling cache 2024-03-09T14:45:35.658 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.663+0000 7f7128ae0980 20 remove_watcher() i=1 2024-03-09T14:45:35.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.663+0000 7f7128ae0980 20 remove_watcher() i=2 2024-03-09T14:45:35.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.667+0000 7f7128ae0980 20 remove_watcher() i=3 2024-03-09T14:45:35.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.667+0000 7f7128ae0980 20 remove_watcher() i=4 2024-03-09T14:45:35.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.671+0000 7f7128ae0980 20 remove_watcher() i=5 2024-03-09T14:45:35.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.671+0000 7f7128ae0980 20 remove_watcher() i=6 2024-03-09T14:45:35.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:45:35.675+0000 7f7128ae0980 20 remove_watcher() i=7 2024-03-09T14:45:35.686 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.686 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:45:35.686 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-commit-target-layout id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:45:35.686 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:45:35.687 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:45:35.687 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:05.766 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:05.766 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:05.812 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:46:05.847 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:05.847 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:05.892 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:05.898+0000 7fdcd2489980 20 rados->read ofs=0 len=0 2024-03-09T14:46:05.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:05.898+0000 7fdcd2489980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:05.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:05.898+0000 7fdcd2489980 20 realm 2024-03-09T14:46:05.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:05.898+0000 7fdcd2489980 20 rados->read ofs=0 len=0 2024-03-09T14:46:05.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:05.898+0000 7fdcd2489980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:05.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:05.898+0000 7fdcd2489980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:05.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:05.898+0000 7fdcd2489980 20 rados->read ofs=0 len=0 2024-03-09T14:46:05.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:05.902+0000 7fdcd2489980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:05.894 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:05.902+0000 7fdcd2489980 20 rados->read ofs=0 len=0 2024-03-09T14:46:05.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:05.902+0000 7fdcd2489980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:05.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:05.902+0000 7fdcd2489980 20 rados->read ofs=0 len=0 2024-03-09T14:46:05.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:05.902+0000 7fdcd2489980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:05.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:05.902+0000 7fdcd2489980 20 searching for the correct realm 2024-03-09T14:46:05.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:05.906+0000 7fdcd07a2640 0 -- 172.21.15.99:0/1489022040 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7fdcb8082c20 msgr2=0x7fdcb80598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:06.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.122+0000 7fdccf7a0640 0 -- 172.21.15.99:0/1489022040 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fdcc81132c0 msgr2=0x7fdcc80b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:46:06.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.338+0000 7fdcd2489980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:06.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.338+0000 7fdcd2489980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:06.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.338+0000 7fdcd2489980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:06.332 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.338+0000 7fdcd2489980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:06.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.338+0000 7fdcd2489980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:06.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.338+0000 7fdcd2489980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:06.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.338+0000 7fdcd2489980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.338+0000 7fdcd2489980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:06.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.338+0000 7fdcd2489980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.338+0000 7fdcd2489980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:06.333 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.338+0000 7fdcd2489980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.342+0000 7fdcd2489980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:06.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.342+0000 7fdcd2489980 20 zone default found 2024-03-09T14:46:06.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.342+0000 7fdcd2489980 4 Realm: () 2024-03-09T14:46:06.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.342+0000 7fdcd2489980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:06.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.342+0000 7fdcd2489980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:06.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.342+0000 7fdcd2489980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:06.334 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.342+0000 7fdcd2489980 20 zonegroup default 2024-03-09T14:46:06.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.342+0000 7fdcd2489980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.342+0000 7fdcd2489980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:06.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.342+0000 7fdcd2489980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.342+0000 7fdcd2489980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:06.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.342+0000 7fdcd2489980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.342+0000 7fdcd2489980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:06.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.342+0000 7fdcd2489980 20 started sync module instance, tier type = 2024-03-09T14:46:06.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.342+0000 7fdcd2489980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:06.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.366+0000 7fdcd2489980 20 add_watcher() i=0 2024-03-09T14:46:06.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.366+0000 7fdcd2489980 20 add_watcher() i=1 2024-03-09T14:46:06.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.366+0000 7fdcd2489980 20 add_watcher() i=2 2024-03-09T14:46:06.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.366+0000 7fdcd2489980 20 add_watcher() i=3 2024-03-09T14:46:06.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.366+0000 7fdcd2489980 20 add_watcher() i=4 2024-03-09T14:46:06.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.366+0000 7fdcd2489980 20 add_watcher() i=5 2024-03-09T14:46:06.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.366+0000 7fdcd2489980 20 add_watcher() i=6 2024-03-09T14:46:06.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.370+0000 7fdcd2489980 20 add_watcher() i=7 2024-03-09T14:46:06.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.370+0000 7fdcd2489980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:06.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.374+0000 7fdb867e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:06.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.374+0000 7fdcd2489980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:06.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.374+0000 7fdcd2489980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:06.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.374+0000 7fdcd2489980 5 note: GC not initialized 2024-03-09T14:46:06.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.374+0000 7fdb857e2640 20 reqs_thread_entry: start 2024-03-09T14:46:06.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.374+0000 7fdcd2489980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:06.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.374+0000 7fdcd2489980 20 Filter name: none 2024-03-09T14:46:06.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.374+0000 7fdb7e7fc640 20 reqs_thread_entry: start 2024-03-09T14:46:06.370 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.374+0000 7fdcd2489980 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-03-09T14:46:06.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.374+0000 7fdcd2489980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.378+0000 7fdcd2489980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:46:06.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.378+0000 7fdcd2489980 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-03-09T14:46:06.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.378+0000 7fdcd2489980 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-03-09T14:46:06.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.378+0000 7fdcd2489980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 : miss 2024-03-09T14:46:06.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.378+0000 7fdcd2489980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.378+0000 7fdcd2489980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:46:06.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.378+0000 7fdcd2489980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 info.flags=0x17 2024-03-09T14:46:06.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.378+0000 7fdcd2489980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 to cache LRU end 2024-03-09T14:46:06.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.378+0000 7fdcd2489980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:46:06.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.378+0000 7fdcd2489980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:06.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.378+0000 7fdcd2489980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 2024-03-09T14:46:06.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.390+0000 7fdcd2489980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 info.flags=0x17 2024-03-09T14:46:06.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.390+0000 7fdcd2489980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 to cache LRU end 2024-03-09T14:46:06.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.390+0000 7fdcd2489980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:06.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.390+0000 7fdcd2489980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27, ofs0, ns] 2024-03-09T14:46:06.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.390+0000 7fdbaeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464295 cookie 94183361169680 notifier 6524 bl.length()=1007 2024-03-09T14:46:06.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.390+0000 7fdbaeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 info.flags=0x17 2024-03-09T14:46:06.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.390+0000 7fdbaeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 to cache LRU end 2024-03-09T14:46:06.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.390+0000 7fdbaeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:06.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.390+0000 7fdcd2489980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): orig_sources= new_sources= 2024-03-09T14:46:06.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.390+0000 7fdcd2489980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): potential sources added=[] removed=[] 2024-03-09T14:46:06.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.390+0000 7fdcd2489980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): orig_dests= new_dests= 2024-03-09T14:46:06.383 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.390+0000 7fdcd2489980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): potential dests added=[] removed=[] 2024-03-09T14:46:06.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.0 2024-03-09T14:46:06.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.0 2024-03-09T14:46:06.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.1 2024-03-09T14:46:06.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.1 2024-03-09T14:46:06.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.2 2024-03-09T14:46:06.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.2 2024-03-09T14:46:06.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.3 2024-03-09T14:46:06.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.3 2024-03-09T14:46:06.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.4 2024-03-09T14:46:06.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.4 2024-03-09T14:46:06.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.5 2024-03-09T14:46:06.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.5 2024-03-09T14:46:06.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.6 2024-03-09T14:46:06.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.6 2024-03-09T14:46:06.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.7 2024-03-09T14:46:06.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.7 2024-03-09T14:46:06.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.8 2024-03-09T14:46:06.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.8 2024-03-09T14:46:06.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.9 2024-03-09T14:46:06.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.9 2024-03-09T14:46:06.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.10 2024-03-09T14:46:06.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.10 2024-03-09T14:46:06.391 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.11 2024-03-09T14:46:06.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1.11 2024-03-09T14:46:06.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.394+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.0 2024-03-09T14:46:06.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.398+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.1 2024-03-09T14:46:06.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.398+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.2 2024-03-09T14:46:06.393 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.398+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.3 2024-03-09T14:46:06.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.402+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.4 2024-03-09T14:46:06.395 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.402+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.5 2024-03-09T14:46:06.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.402+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.6 2024-03-09T14:46:06.397 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.402+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.7 2024-03-09T14:46:06.398 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.406+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.8 2024-03-09T14:46:06.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.406+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.9 2024-03-09T14:46:06.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.406+0000 7fdcd2489980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27.10 2024-03-09T14:46:06.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.414+0000 7fdcd2489980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 : hit (requested=0x17, cached=0x17) 2024-03-09T14:46:06.406 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.414+0000 7fdcd2489980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 2024-03-09T14:46:06.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.418+0000 7fdcd2489980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 info.flags=0x17 2024-03-09T14:46:06.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.418+0000 7fdcd2489980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 to cache LRU end 2024-03-09T14:46:06.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.418+0000 7fdcd2489980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:06.410 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.418+0000 7fdcd2489980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27, ofs0, ns] 2024-03-09T14:46:06.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.418+0000 7fdbae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464296 cookie 94183361169680 notifier 6524 bl.length()=975 2024-03-09T14:46:06.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.418+0000 7fdbae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 info.flags=0x17 2024-03-09T14:46:06.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.418+0000 7fdbae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 to cache LRU end 2024-03-09T14:46:06.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.418+0000 7fdbae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:06.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.418+0000 7fdcd2489980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): orig_sources= new_sources= 2024-03-09T14:46:06.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.418+0000 7fdcd2489980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): potential sources added=[] removed=[] 2024-03-09T14:46:06.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.418+0000 7fdcd2489980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): orig_dests= new_dests= 2024-03-09T14:46:06.411 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.418+0000 7fdcd2489980 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27]): potential dests added=[] removed=[] 2024-03-09T14:46:06.418 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.422+0000 7fdcd2489980 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" completed successfully 2024-03-09T14:46:06.421 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.426+0000 7fdb867e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:06.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.434+0000 7fdcd2489980 20 remove_watcher() i=0 2024-03-09T14:46:06.426 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.434+0000 7fdcd2489980 2 removed watcher, disabling cache 2024-03-09T14:46:06.428 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.434+0000 7fdcd2489980 20 remove_watcher() i=1 2024-03-09T14:46:06.430 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.438+0000 7fdcd2489980 20 remove_watcher() i=2 2024-03-09T14:46:06.433 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.438+0000 7fdcd2489980 20 remove_watcher() i=3 2024-03-09T14:46:06.435 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.442+0000 7fdcd2489980 20 remove_watcher() i=4 2024-03-09T14:46:06.436 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.442+0000 7fdcd2489980 20 remove_watcher() i=5 2024-03-09T14:46:06.438 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.446+0000 7fdcd2489980 20 remove_watcher() i=6 2024-03-09T14:46:06.439 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.446+0000 7fdcd2489980 20 remove_watcher() i=7 2024-03-09T14:46:06.456 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-03-09T14:46:06.486 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:06.486 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:06.529 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.534+0000 7f3baa025980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.538+0000 7f3baa025980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:06.531 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.538+0000 7f3baa025980 20 realm 2024-03-09T14:46:06.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.538+0000 7f3baa025980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.538+0000 7f3baa025980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:06.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.538+0000 7f3baa025980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:06.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.538+0000 7f3baa025980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.538+0000 7f3baa025980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:06.532 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.538+0000 7f3baa025980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.538+0000 7f3baa025980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:06.533 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.538+0000 7f3baa025980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.542+0000 7f3baa025980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:06.535 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.542+0000 7f3baa025980 20 searching for the correct realm 2024-03-09T14:46:06.539 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.546+0000 7f3ba833e640 0 -- 172.21.15.99:0/1828681670 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55f39f9c2d20 msgr2=0x55f39f9c5110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:06.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.550+0000 7f3b9ffff640 0 -- 172.21.15.99:0/1828681670 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f3ba005b860 msgr2=0x7f3ba0073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:06.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.766+0000 7f3baa025980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:06.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.766+0000 7f3baa025980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:06.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.766+0000 7f3baa025980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:06.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.766+0000 7f3baa025980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:06.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.766+0000 7f3baa025980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:06.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.766+0000 7f3baa025980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:06.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.766+0000 7f3baa025980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.766+0000 7f3baa025980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:06.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.766+0000 7f3baa025980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.770+0000 7f3baa025980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:06.762 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.770+0000 7f3baa025980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.770+0000 7f3baa025980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:06.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.770+0000 7f3baa025980 20 zone default found 2024-03-09T14:46:06.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.770+0000 7f3baa025980 4 Realm: () 2024-03-09T14:46:06.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.770+0000 7f3baa025980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:06.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.770+0000 7f3baa025980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:06.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.770+0000 7f3baa025980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:06.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.770+0000 7f3baa025980 20 zonegroup default 2024-03-09T14:46:06.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.770+0000 7f3baa025980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.770+0000 7f3baa025980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:06.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.770+0000 7f3baa025980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.770+0000 7f3baa025980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:06.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.770+0000 7f3baa025980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.770+0000 7f3baa025980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:06.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.770+0000 7f3baa025980 20 started sync module instance, tier type = 2024-03-09T14:46:06.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.770+0000 7f3baa025980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:06.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.794+0000 7f3baa025980 20 add_watcher() i=0 2024-03-09T14:46:06.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.794+0000 7f3baa025980 20 add_watcher() i=1 2024-03-09T14:46:06.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.794+0000 7f3baa025980 20 add_watcher() i=2 2024-03-09T14:46:06.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.794+0000 7f3baa025980 20 add_watcher() i=3 2024-03-09T14:46:06.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.794+0000 7f3baa025980 20 add_watcher() i=4 2024-03-09T14:46:06.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.794+0000 7f3baa025980 20 add_watcher() i=5 2024-03-09T14:46:06.790 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.794+0000 7f3baa025980 20 add_watcher() i=6 2024-03-09T14:46:06.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.798+0000 7f3baa025980 20 add_watcher() i=7 2024-03-09T14:46:06.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.798+0000 7f3baa025980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:06.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.802+0000 7f3a5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:06.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.802+0000 7f3baa025980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:06.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.802+0000 7f3baa025980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:06.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.802+0000 7f3baa025980 5 note: GC not initialized 2024-03-09T14:46:06.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.802+0000 7f3a5cfe1640 20 reqs_thread_entry: start 2024-03-09T14:46:06.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.802+0000 7f3baa025980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:06.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.802+0000 7f3baa025980 20 Filter name: none 2024-03-09T14:46:06.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.802+0000 7f39d67fc640 20 reqs_thread_entry: start 2024-03-09T14:46:06.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.806+0000 7f3baa025980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.806+0000 7f3baa025980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:46:06.799 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.806+0000 7f3baa025980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.806+0000 7f3baa025980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:46:06.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.806+0000 7f3baa025980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:06.801 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.806+0000 7f3baa025980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.806+0000 7f3baa025980 20 rados_obj.operate() r=0 bl.length=221 2024-03-09T14:46:06.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.806+0000 7f3baa025980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.810+0000 7f3baa025980 20 rados_obj.operate() r=0 bl.length=435 2024-03-09T14:46:06.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.810+0000 7f3baa025980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:06.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.810+0000 7f3baa025980 20 rados->read ofs=0 len=0 2024-03-09T14:46:06.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.810+0000 7f3baa025980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:06.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.810+0000 7f3a5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:06.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.818+0000 7f3baa025980 20 remove_watcher() i=0 2024-03-09T14:46:06.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.818+0000 7f3baa025980 2 removed watcher, disabling cache 2024-03-09T14:46:06.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.818+0000 7f3baa025980 20 remove_watcher() i=1 2024-03-09T14:46:06.817 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.822+0000 7f3baa025980 20 remove_watcher() i=2 2024-03-09T14:46:06.819 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.826+0000 7f3baa025980 20 remove_watcher() i=3 2024-03-09T14:46:06.823 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.830+0000 7f3baa025980 20 remove_watcher() i=4 2024-03-09T14:46:06.825 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.830+0000 7f3baa025980 20 remove_watcher() i=5 2024-03-09T14:46:06.826 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.834+0000 7f3baa025980 20 remove_watcher() i=6 2024-03-09T14:46:06.828 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:06.834+0000 7f3baa025980 20 remove_watcher() i=7 2024-03-09T14:46:06.843 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:06.843 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:46:06.843 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-commit-target-layout id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-09T14:46:06.843 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:06.844 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:06.844 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:06.848 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:06.848 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:06.897 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:06.897 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:06.934 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-03-09T14:46:06.934 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:06.935 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:06.935 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:06.952 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:06.952 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:06.998 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:06.998 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.020 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.020 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.042 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.042 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.066 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.067 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.083 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.083 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.108 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.109 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.130 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.130 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.151 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.151 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.171 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.172 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.193 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.193 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.214 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.214 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.235 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.236 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.256 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.256 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.278 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.278 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.299 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.299 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.319 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.319 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.340 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.340 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.360 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.361 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.380 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.380 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.401 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:07.401 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:07.421 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-03-09T14:46:07.454 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:07.454 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:07.499 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.506+0000 7fb592bca980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.506+0000 7fb592bca980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.506+0000 7fb592bca980 20 realm 2024-03-09T14:46:07.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.506+0000 7fb592bca980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.506+0000 7fb592bca980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.506+0000 7fb592bca980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:07.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.506+0000 7fb592bca980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.501 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.506+0000 7fb592bca980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.502 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.506+0000 7fb592bca980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.510+0000 7fb592bca980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:07.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.510+0000 7fb592bca980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.510+0000 7fb592bca980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:07.504 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.510+0000 7fb592bca980 20 searching for the correct realm 2024-03-09T14:46:07.509 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.514+0000 7fb5906e2640 0 -- 172.21.15.99:0/2697571921 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x5598aa9868d0 msgr2=0x5598aa988d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:07.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.522+0000 7fb58fee1640 0 -- 172.21.15.99:0/2697571921 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fb5880263d0 msgr2=0x7fb588026830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:07.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:07.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:07.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:07.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:07.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:07.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:07.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.525 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:07.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:07.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 20 zone default found 2024-03-09T14:46:07.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 4 Realm: () 2024-03-09T14:46:07.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:07.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:07.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:07.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 20 zonegroup default 2024-03-09T14:46:07.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.526 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.530+0000 7fb592bca980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.534+0000 7fb592bca980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.534+0000 7fb592bca980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.534+0000 7fb592bca980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.534+0000 7fb592bca980 20 started sync module instance, tier type = 2024-03-09T14:46:07.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.534+0000 7fb592bca980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:07.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.550+0000 7fb592bca980 20 add_watcher() i=0 2024-03-09T14:46:07.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.550+0000 7fb592bca980 20 add_watcher() i=1 2024-03-09T14:46:07.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.550+0000 7fb592bca980 20 add_watcher() i=2 2024-03-09T14:46:07.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.550+0000 7fb592bca980 20 add_watcher() i=3 2024-03-09T14:46:07.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.550+0000 7fb592bca980 20 add_watcher() i=4 2024-03-09T14:46:07.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.550+0000 7fb592bca980 20 add_watcher() i=5 2024-03-09T14:46:07.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.550+0000 7fb592bca980 20 add_watcher() i=6 2024-03-09T14:46:07.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.550+0000 7fb592bca980 20 add_watcher() i=7 2024-03-09T14:46:07.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.550+0000 7fb592bca980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:07.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.554+0000 7fb4467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:07.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.554+0000 7fb592bca980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:07.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.554+0000 7fb592bca980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:07.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.554+0000 7fb592bca980 5 note: GC not initialized 2024-03-09T14:46:07.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.554+0000 7fb4457e2640 20 reqs_thread_entry: start 2024-03-09T14:46:07.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.554+0000 7fb592bca980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:07.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.554+0000 7fb592bca980 20 Filter name: none 2024-03-09T14:46:07.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.554+0000 7fb3b6ffd640 20 reqs_thread_entry: start 2024-03-09T14:46:07.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.554+0000 7fb592bca980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.554+0000 7fb592bca980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:07.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.554+0000 7fb592bca980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.558+0000 7fb592bca980 20 rados_obj.operate() r=0 bl.length=425 2024-03-09T14:46:07.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.558+0000 7fb592bca980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:07.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.558+0000 7fb592bca980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.558+0000 7fb592bca980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:07.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.558+0000 7fb592bca980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.558+0000 7fb592bca980 20 rados_obj.operate() r=0 bl.length=425 2024-03-09T14:46:07.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.558+0000 7fb592bca980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:07.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.558+0000 7fb592bca980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.562+0000 7fb592bca980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.562+0000 7fb4467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:07.559 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.566+0000 7fb592bca980 20 remove_watcher() i=0 2024-03-09T14:46:07.560 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.566+0000 7fb592bca980 2 removed watcher, disabling cache 2024-03-09T14:46:07.561 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.566+0000 7fb592bca980 20 remove_watcher() i=1 2024-03-09T14:46:07.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.570+0000 7fb592bca980 20 remove_watcher() i=2 2024-03-09T14:46:07.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.574+0000 7fb592bca980 20 remove_watcher() i=3 2024-03-09T14:46:07.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.578+0000 7fb592bca980 20 remove_watcher() i=4 2024-03-09T14:46:07.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.578+0000 7fb592bca980 20 remove_watcher() i=5 2024-03-09T14:46:07.574 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.582+0000 7fb592bca980 20 remove_watcher() i=6 2024-03-09T14:46:07.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.582+0000 7fb592bca980 20 remove_watcher() i=7 2024-03-09T14:46:07.589 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:07.589 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:46:07.589 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-do-reshard id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:46:07.589 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:07.589 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-03-09T14:46:07.622 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:07.622 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:07.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.670+0000 7f17c5a88980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.674+0000 7f17c5a88980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.674+0000 7f17c5a88980 20 realm 2024-03-09T14:46:07.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.674+0000 7f17c5a88980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.674+0000 7f17c5a88980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.674+0000 7f17c5a88980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:07.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.674+0000 7f17c5a88980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.674+0000 7f17c5a88980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.667 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.674+0000 7f17c5a88980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.674+0000 7f17c5a88980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:07.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.674+0000 7f17c5a88980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.678+0000 7f17c5a88980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:07.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.678+0000 7f17c5a88980 20 searching for the correct realm 2024-03-09T14:46:07.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.678+0000 7f17c3da1640 0 -- 172.21.15.99:0/977888422 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55892bb4be20 msgr2=0x55892bb4e230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:07.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.686+0000 7f17c2d9f640 0 -- 172.21.15.99:0/977888422 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f17bc0f9030 msgr2=0x7f17bc10cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:07.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.902+0000 7f17c5a88980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:07.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.902+0000 7f17c5a88980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:07.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.902+0000 7f17c5a88980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:07.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.902+0000 7f17c5a88980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:07.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.902+0000 7f17c5a88980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:07.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.902+0000 7f17c5a88980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:07.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.902+0000 7f17c5a88980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.902+0000 7f17c5a88980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.906+0000 7f17c5a88980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.906+0000 7f17c5a88980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:07.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.906+0000 7f17c5a88980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.906+0000 7f17c5a88980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:07.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.906+0000 7f17c5a88980 20 zone default found 2024-03-09T14:46:07.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.906+0000 7f17c5a88980 4 Realm: () 2024-03-09T14:46:07.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.906+0000 7f17c5a88980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:07.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.906+0000 7f17c5a88980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:07.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.906+0000 7f17c5a88980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:07.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.906+0000 7f17c5a88980 20 zonegroup default 2024-03-09T14:46:07.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.906+0000 7f17c5a88980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.906+0000 7f17c5a88980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.901 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.906+0000 7f17c5a88980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.906+0000 7f17c5a88980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.906+0000 7f17c5a88980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.910+0000 7f17c5a88980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:07.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.910+0000 7f17c5a88980 20 started sync module instance, tier type = 2024-03-09T14:46:07.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.910+0000 7f17c5a88980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:07.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.934+0000 7f17c5a88980 20 add_watcher() i=0 2024-03-09T14:46:07.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.934+0000 7f17c5a88980 20 add_watcher() i=1 2024-03-09T14:46:07.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.934+0000 7f17c5a88980 20 add_watcher() i=2 2024-03-09T14:46:07.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.934+0000 7f17c5a88980 20 add_watcher() i=3 2024-03-09T14:46:07.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.934+0000 7f17c5a88980 20 add_watcher() i=4 2024-03-09T14:46:07.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.934+0000 7f17c5a88980 20 add_watcher() i=5 2024-03-09T14:46:07.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.934+0000 7f17c5a88980 20 add_watcher() i=6 2024-03-09T14:46:07.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.938+0000 7f17c5a88980 20 add_watcher() i=7 2024-03-09T14:46:07.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.938+0000 7f17c5a88980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:07.934 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.942+0000 7f1679fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:07.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.942+0000 7f17c5a88980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:07.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.942+0000 7f17c5a88980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:07.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.942+0000 7f17c5a88980 5 note: GC not initialized 2024-03-09T14:46:07.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.942+0000 7f1678fe1640 20 reqs_thread_entry: start 2024-03-09T14:46:07.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.942+0000 7f17c5a88980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:07.936 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.942+0000 7f17c5a88980 20 Filter name: none 2024-03-09T14:46:07.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.942+0000 7f15f27fc640 20 reqs_thread_entry: start 2024-03-09T14:46:07.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.942+0000 7f17c5a88980 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-03-09T14:46:07.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.942+0000 7f17c5a88980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.942+0000 7f17c5a88980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:07.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.942+0000 7f17c5a88980 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-03-09T14:46:07.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.942+0000 7f17c5a88980 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-03-09T14:46:07.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.942+0000 7f17c5a88980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 : miss 2024-03-09T14:46:07.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.942+0000 7f17c5a88980 20 rados->read ofs=0 len=0 2024-03-09T14:46:07.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.946+0000 7f17c5a88980 20 rados_obj.operate() r=0 bl.length=425 2024-03-09T14:46:07.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.946+0000 7f17c5a88980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 info.flags=0x17 2024-03-09T14:46:07.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.946+0000 7f17c5a88980 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 to cache LRU end 2024-03-09T14:46:07.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.946+0000 7f17c5a88980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:46:07.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.946+0000 7f17c5a88980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:07.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.946+0000 7f17c5a88980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 2024-03-09T14:46:07.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.954+0000 7f17c5a88980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 info.flags=0x17 2024-03-09T14:46:07.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.954+0000 7f17c5a88980 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 to cache LRU end 2024-03-09T14:46:07.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.954+0000 7f17c5a88980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:07.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.954+0000 7f17c5a88980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28, ofs0, ns] 2024-03-09T14:46:07.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.958+0000 7f16a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464365 cookie 94047632153840 notifier 6578 bl.length()=987 2024-03-09T14:46:07.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.958+0000 7f16a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 info.flags=0x17 2024-03-09T14:46:07.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.958+0000 7f16a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 to cache LRU end 2024-03-09T14:46:07.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.958+0000 7f16a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:07.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.958+0000 7f17c5a88980 20 handle_bi_update(): bucket=:error-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28]): orig_sources= new_sources= 2024-03-09T14:46:07.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.958+0000 7f17c5a88980 20 handle_bi_update(): bucket=:error-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28]): potential sources added=[] removed=[] 2024-03-09T14:46:07.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.958+0000 7f17c5a88980 20 handle_bi_update(): bucket=:error-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28]): orig_dests= new_dests= 2024-03-09T14:46:07.952 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.958+0000 7f17c5a88980 20 handle_bi_update(): bucket=:error-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28]): potential dests added=[] removed=[] 2024-03-09T14:46:07.957 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.962+0000 7f17c5a88980 -1 Injecting error=-5 at location=do_reshard 2024-03-09T14:46:07.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.978+0000 7f17c5a88980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 : hit (requested=0x17, cached=0x17) 2024-03-09T14:46:07.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.978+0000 7f17c5a88980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 2024-03-09T14:46:07.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.982+0000 7f17c5a88980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 info.flags=0x17 2024-03-09T14:46:07.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.982+0000 7f17c5a88980 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 to cache LRU end 2024-03-09T14:46:07.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.982+0000 7f17c5a88980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:07.974 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.982+0000 7f17c5a88980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28, ofs0, ns] 2024-03-09T14:46:07.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.982+0000 7f16a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464366 cookie 94047632153840 notifier 6578 bl.length()=955 2024-03-09T14:46:07.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.982+0000 7f16a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 info.flags=0x17 2024-03-09T14:46:07.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.982+0000 7f16a6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 to cache LRU end 2024-03-09T14:46:07.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.982+0000 7f16a6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:07.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.982+0000 7f17c5a88980 20 handle_bi_update(): bucket=:error-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28]): orig_sources= new_sources= 2024-03-09T14:46:07.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.982+0000 7f17c5a88980 20 handle_bi_update(): bucket=:error-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28]): potential sources added=[] removed=[] 2024-03-09T14:46:07.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.982+0000 7f17c5a88980 20 handle_bi_update(): bucket=:error-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28]): orig_dests= new_dests= 2024-03-09T14:46:07.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.982+0000 7f17c5a88980 20 handle_bi_update(): bucket=:error-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28]): potential dests added=[] removed=[] 2024-03-09T14:46:07.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.982+0000 7f17c5a88980 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-03-09T14:46:07.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.986+0000 7f1679fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:07.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.990+0000 7f17c5a88980 20 remove_watcher() i=0 2024-03-09T14:46:07.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.990+0000 7f17c5a88980 2 removed watcher, disabling cache 2024-03-09T14:46:07.986 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.994+0000 7f17c5a88980 20 remove_watcher() i=1 2024-03-09T14:46:07.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.994+0000 7f17c5a88980 20 remove_watcher() i=2 2024-03-09T14:46:07.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.998+0000 7f17c5a88980 20 remove_watcher() i=3 2024-03-09T14:46:07.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:07.998+0000 7f17c5a88980 20 remove_watcher() i=4 2024-03-09T14:46:07.994 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.002+0000 7f17c5a88980 20 remove_watcher() i=5 2024-03-09T14:46:07.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.002+0000 7f17c5a88980 20 remove_watcher() i=6 2024-03-09T14:46:07.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.002+0000 7f17c5a88980 20 remove_watcher() i=7 2024-03-09T14:46:08.015 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-03-09T14:46:08.042 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:08.042 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:08.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.094+0000 7fc58cc4b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.094+0000 7fc58cc4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.094+0000 7fc58cc4b980 20 realm 2024-03-09T14:46:08.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.094+0000 7fc58cc4b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.094+0000 7fc58cc4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.094+0000 7fc58cc4b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:08.090 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.094+0000 7fc58cc4b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.098+0000 7fc58cc4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.098+0000 7fc58cc4b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.091 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.098+0000 7fc58cc4b980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:08.092 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.098+0000 7fc58cc4b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.098+0000 7fc58cc4b980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:08.093 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.098+0000 7fc58cc4b980 20 searching for the correct realm 2024-03-09T14:46:08.098 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.106+0000 7fc58a763640 0 -- 172.21.15.99:0/410723959 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x55f35fa80ce0 msgr2=0x55f35fa831a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:08.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.110+0000 7fc589f62640 0 -- 172.21.15.99:0/410723959 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fc584046b50 msgr2=0x7fc584003420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:08.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:08.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:08.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:08.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:08.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:08.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:08.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:08.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 20 zone default found 2024-03-09T14:46:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 4 Realm: () 2024-03-09T14:46:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 20 zonegroup default 2024-03-09T14:46:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.118+0000 7fc58cc4b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.122+0000 7fc58cc4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.122+0000 7fc58cc4b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.122+0000 7fc58cc4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.122+0000 7fc58cc4b980 20 started sync module instance, tier type = 2024-03-09T14:46:08.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.122+0000 7fc58cc4b980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:08.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.134+0000 7fc58cc4b980 20 add_watcher() i=0 2024-03-09T14:46:08.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.134+0000 7fc58cc4b980 20 add_watcher() i=1 2024-03-09T14:46:08.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.134+0000 7fc58cc4b980 20 add_watcher() i=2 2024-03-09T14:46:08.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.134+0000 7fc58cc4b980 20 add_watcher() i=3 2024-03-09T14:46:08.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.134+0000 7fc58cc4b980 20 add_watcher() i=4 2024-03-09T14:46:08.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.134+0000 7fc58cc4b980 20 add_watcher() i=5 2024-03-09T14:46:08.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.138+0000 7fc58cc4b980 20 add_watcher() i=6 2024-03-09T14:46:08.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.138+0000 7fc58cc4b980 20 add_watcher() i=7 2024-03-09T14:46:08.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.138+0000 7fc58cc4b980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:08.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.142+0000 7fc4417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:08.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.142+0000 7fc58cc4b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:08.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.142+0000 7fc58cc4b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:08.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.142+0000 7fc58cc4b980 5 note: GC not initialized 2024-03-09T14:46:08.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.142+0000 7fc43b7fe640 20 reqs_thread_entry: start 2024-03-09T14:46:08.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.142+0000 7fc58cc4b980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:08.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.146+0000 7fc58cc4b980 20 Filter name: none 2024-03-09T14:46:08.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.146+0000 7fc4397fa640 20 reqs_thread_entry: start 2024-03-09T14:46:08.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.146+0000 7fc58cc4b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.146+0000 7fc58cc4b980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:08.139 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.146+0000 7fc58cc4b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.146+0000 7fc58cc4b980 20 rados_obj.operate() r=0 bl.length=425 2024-03-09T14:46:08.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.146+0000 7fc58cc4b980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:08.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.146+0000 7fc58cc4b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.146+0000 7fc58cc4b980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:08.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.146+0000 7fc58cc4b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.146+0000 7fc58cc4b980 20 rados_obj.operate() r=0 bl.length=425 2024-03-09T14:46:08.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.146+0000 7fc58cc4b980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:08.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.150+0000 7fc58cc4b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.150+0000 7fc58cc4b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.150+0000 7fc4417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:08.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.154+0000 7fc58cc4b980 20 remove_watcher() i=0 2024-03-09T14:46:08.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.154+0000 7fc58cc4b980 2 removed watcher, disabling cache 2024-03-09T14:46:08.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.158+0000 7fc58cc4b980 20 remove_watcher() i=1 2024-03-09T14:46:08.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.158+0000 7fc58cc4b980 20 remove_watcher() i=2 2024-03-09T14:46:08.155 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.162+0000 7fc58cc4b980 20 remove_watcher() i=3 2024-03-09T14:46:08.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.162+0000 7fc58cc4b980 20 remove_watcher() i=4 2024-03-09T14:46:08.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.166+0000 7fc58cc4b980 20 remove_watcher() i=5 2024-03-09T14:46:08.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.166+0000 7fc58cc4b980 20 remove_watcher() i=6 2024-03-09T14:46:08.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.166+0000 7fc58cc4b980 20 remove_watcher() i=7 2024-03-09T14:46:08.174 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:08.175 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:46:08.175 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-do-reshard id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:46:08.175 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:08.176 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:08.176 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:08.189 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:08.189 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:08.231 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:46:08.264 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:08.264 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:08.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.314+0000 7f6d6c850980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.318+0000 7f6d6c850980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.318+0000 7f6d6c850980 20 realm 2024-03-09T14:46:08.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.318+0000 7f6d6c850980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.318+0000 7f6d6c850980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.318+0000 7f6d6c850980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:08.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.318+0000 7f6d6c850980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.318+0000 7f6d6c850980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.318+0000 7f6d6c850980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.318+0000 7f6d6c850980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:08.312 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.318+0000 7f6d6c850980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.318+0000 7f6d6c850980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:08.314 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.322+0000 7f6d6c850980 20 searching for the correct realm 2024-03-09T14:46:08.319 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.326+0000 7f6d69b67640 0 -- 172.21.15.99:0/1954535018 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f6d60059740 msgr2=0x7f6d60055b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:08.325 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.330+0000 7f6d69b67640 0 -- 172.21.15.99:0/1954535018 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f6d6408a6c0 msgr2=0x7f6d6405a330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:08.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.546+0000 7f6d6c850980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:08.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.546+0000 7f6d6c850980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:08.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.546+0000 7f6d6c850980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:08.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.546+0000 7f6d6c850980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:08.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.546+0000 7f6d6c850980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:08.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.546+0000 7f6d6c850980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:08.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.546+0000 7f6d6c850980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.546+0000 7f6d6c850980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.541 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.546+0000 7f6d6c850980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.546+0000 7f6d6c850980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:08.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.546+0000 7f6d6c850980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.550+0000 7f6d6c850980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:08.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.550+0000 7f6d6c850980 20 zone default found 2024-03-09T14:46:08.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.550+0000 7f6d6c850980 4 Realm: () 2024-03-09T14:46:08.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.550+0000 7f6d6c850980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:08.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.550+0000 7f6d6c850980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:08.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.550+0000 7f6d6c850980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:08.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.550+0000 7f6d6c850980 20 zonegroup default 2024-03-09T14:46:08.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.550+0000 7f6d6c850980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.550+0000 7f6d6c850980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.550+0000 7f6d6c850980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.550+0000 7f6d6c850980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.550+0000 7f6d6c850980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.550+0000 7f6d6c850980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.550+0000 7f6d6c850980 20 started sync module instance, tier type = 2024-03-09T14:46:08.544 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.550+0000 7f6d6c850980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:08.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.574+0000 7f6d6c850980 20 add_watcher() i=0 2024-03-09T14:46:08.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.574+0000 7f6d6c850980 20 add_watcher() i=1 2024-03-09T14:46:08.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.574+0000 7f6d6c850980 20 add_watcher() i=2 2024-03-09T14:46:08.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.574+0000 7f6d6c850980 20 add_watcher() i=3 2024-03-09T14:46:08.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.574+0000 7f6d6c850980 20 add_watcher() i=4 2024-03-09T14:46:08.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.574+0000 7f6d6c850980 20 add_watcher() i=5 2024-03-09T14:46:08.569 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.574+0000 7f6d6c850980 20 add_watcher() i=6 2024-03-09T14:46:08.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.578+0000 7f6d6c850980 20 add_watcher() i=7 2024-03-09T14:46:08.571 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.578+0000 7f6d6c850980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:08.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.582+0000 7f6c20fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:08.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.582+0000 7f6d6c850980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:08.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.582+0000 7f6d6c850980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:08.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.582+0000 7f6d6c850980 5 note: GC not initialized 2024-03-09T14:46:08.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.582+0000 7f6b9b7fe640 20 reqs_thread_entry: start 2024-03-09T14:46:08.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.582+0000 7f6d6c850980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:08.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.582+0000 7f6d6c850980 20 Filter name: none 2024-03-09T14:46:08.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.582+0000 7f6b997fa640 20 reqs_thread_entry: start 2024-03-09T14:46:08.577 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.582+0000 7f6d6c850980 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-03-09T14:46:08.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.582+0000 7f6d6c850980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.586+0000 7f6d6c850980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:08.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.586+0000 7f6d6c850980 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-03-09T14:46:08.578 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.586+0000 7f6d6c850980 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-03-09T14:46:08.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.586+0000 7f6d6c850980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 : miss 2024-03-09T14:46:08.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.586+0000 7f6d6c850980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.586+0000 7f6d6c850980 20 rados_obj.operate() r=0 bl.length=425 2024-03-09T14:46:08.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.586+0000 7f6d6c850980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 info.flags=0x17 2024-03-09T14:46:08.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.586+0000 7f6d6c850980 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 to cache LRU end 2024-03-09T14:46:08.579 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.586+0000 7f6d6c850980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:46:08.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.586+0000 7f6d6c850980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:08.580 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.586+0000 7f6d6c850980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 2024-03-09T14:46:08.589 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.594+0000 7f6d6c850980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 info.flags=0x17 2024-03-09T14:46:08.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.594+0000 7f6d6c850980 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 to cache LRU end 2024-03-09T14:46:08.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.594+0000 7f6d6c850980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:08.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.594+0000 7f6d6c850980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28, ofs0, ns] 2024-03-09T14:46:08.590 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.598+0000 7f6c4dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464367 cookie 94379269617584 notifier 6611 bl.length()=987 2024-03-09T14:46:08.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.598+0000 7f6c4dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 info.flags=0x17 2024-03-09T14:46:08.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.598+0000 7f6c4dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 to cache LRU end 2024-03-09T14:46:08.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.598+0000 7f6c4dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:08.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.598+0000 7f6d6c850980 20 handle_bi_update(): bucket=:error-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28]): orig_sources= new_sources= 2024-03-09T14:46:08.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.598+0000 7f6d6c850980 20 handle_bi_update(): bucket=:error-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28]): potential sources added=[] removed=[] 2024-03-09T14:46:08.591 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.598+0000 7f6d6c850980 20 handle_bi_update(): bucket=:error-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28]): orig_dests= new_dests= 2024-03-09T14:46:08.592 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.598+0000 7f6d6c850980 20 handle_bi_update(): bucket=:error-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28]): potential dests added=[] removed=[] 2024-03-09T14:46:08.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.0 2024-03-09T14:46:08.598 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.0 2024-03-09T14:46:08.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.1 2024-03-09T14:46:08.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.1 2024-03-09T14:46:08.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.2 2024-03-09T14:46:08.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.2 2024-03-09T14:46:08.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.3 2024-03-09T14:46:08.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.3 2024-03-09T14:46:08.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.4 2024-03-09T14:46:08.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.4 2024-03-09T14:46:08.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.5 2024-03-09T14:46:08.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.5 2024-03-09T14:46:08.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.6 2024-03-09T14:46:08.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.6 2024-03-09T14:46:08.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.7 2024-03-09T14:46:08.599 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.7 2024-03-09T14:46:08.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.8 2024-03-09T14:46:08.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.8 2024-03-09T14:46:08.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.9 2024-03-09T14:46:08.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.9 2024-03-09T14:46:08.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.10 2024-03-09T14:46:08.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.10 2024-03-09T14:46:08.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.11 2024-03-09T14:46:08.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1.11 2024-03-09T14:46:08.600 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.0 2024-03-09T14:46:08.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.1 2024-03-09T14:46:08.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.2 2024-03-09T14:46:08.601 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.606+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.3 2024-03-09T14:46:08.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.610+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.4 2024-03-09T14:46:08.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.610+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.5 2024-03-09T14:46:08.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.610+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.6 2024-03-09T14:46:08.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.610+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.7 2024-03-09T14:46:08.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.614+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.8 2024-03-09T14:46:08.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.614+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.9 2024-03-09T14:46:08.608 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.614+0000 7f6d6c850980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28.10 2024-03-09T14:46:08.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.618+0000 7f6d6c850980 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 : hit (requested=0x17, cached=0x17) 2024-03-09T14:46:08.614 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.618+0000 7f6d6c850980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 2024-03-09T14:46:08.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.622+0000 7f6d6c850980 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 info.flags=0x17 2024-03-09T14:46:08.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.622+0000 7f6d6c850980 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 to cache LRU end 2024-03-09T14:46:08.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.622+0000 7f6d6c850980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:08.617 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.622+0000 7f6d6c850980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28, ofs0, ns] 2024-03-09T14:46:08.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.626+0000 7f6c4dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464368 cookie 94379269617584 notifier 6611 bl.length()=955 2024-03-09T14:46:08.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.626+0000 7f6c4dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 info.flags=0x17 2024-03-09T14:46:08.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.626+0000 7f6c4dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 to cache LRU end 2024-03-09T14:46:08.618 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.626+0000 7f6c4dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:08.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.626+0000 7f6d6c850980 20 handle_bi_update(): bucket=:error-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28]): orig_sources= new_sources= 2024-03-09T14:46:08.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.626+0000 7f6d6c850980 20 handle_bi_update(): bucket=:error-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28]): potential sources added=[] removed=[] 2024-03-09T14:46:08.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.626+0000 7f6d6c850980 20 handle_bi_update(): bucket=:error-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28]): orig_dests= new_dests= 2024-03-09T14:46:08.619 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.626+0000 7f6d6c850980 20 handle_bi_update(): bucket=:error-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28]): potential dests added=[] removed=[] 2024-03-09T14:46:08.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.634+0000 7f6d6c850980 1 execute INFO: reshard of bucket "error-at-do-reshard" completed successfully 2024-03-09T14:46:08.629 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.634+0000 7f6c20fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:08.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.642+0000 7f6d6c850980 20 remove_watcher() i=0 2024-03-09T14:46:08.635 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.642+0000 7f6d6c850980 2 removed watcher, disabling cache 2024-03-09T14:46:08.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.642+0000 7f6d6c850980 20 remove_watcher() i=1 2024-03-09T14:46:08.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.646+0000 7f6d6c850980 20 remove_watcher() i=2 2024-03-09T14:46:08.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.646+0000 7f6d6c850980 20 remove_watcher() i=3 2024-03-09T14:46:08.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.650+0000 7f6d6c850980 20 remove_watcher() i=4 2024-03-09T14:46:08.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.650+0000 7f6d6c850980 20 remove_watcher() i=5 2024-03-09T14:46:08.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.654+0000 7f6d6c850980 20 remove_watcher() i=6 2024-03-09T14:46:08.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.654+0000 7f6d6c850980 20 remove_watcher() i=7 2024-03-09T14:46:08.663 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-03-09T14:46:08.689 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:08.689 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:08.733 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.738+0000 7fc0b7919980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.742+0000 7fc0b7919980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.742+0000 7fc0b7919980 20 realm 2024-03-09T14:46:08.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.742+0000 7fc0b7919980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.742+0000 7fc0b7919980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.742+0000 7fc0b7919980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:08.735 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.742+0000 7fc0b7919980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.742+0000 7fc0b7919980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.742+0000 7fc0b7919980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.742+0000 7fc0b7919980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:08.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.742+0000 7fc0b7919980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.746+0000 7fc0b7919980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:08.738 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.746+0000 7fc0b7919980 20 searching for the correct realm 2024-03-09T14:46:08.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.750+0000 7fc0b4c30640 0 -- 172.21.15.99:0/1844719615 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7fc0a805cd90 msgr2=0x7fc0a80539d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:08.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.754+0000 7fc0b4c30640 0 -- 172.21.15.99:0/1844719615 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fc0b0024030 msgr2=0x7fc0b0018930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:08.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.970+0000 7fc0b7919980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:08.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.970+0000 7fc0b7919980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:08.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.970+0000 7fc0b7919980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:08.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.970+0000 7fc0b7919980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:08.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.970+0000 7fc0b7919980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:08.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.970+0000 7fc0b7919980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:08.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.970+0000 7fc0b7919980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:08.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:08.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 20 zone default found 2024-03-09T14:46:08.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 4 Realm: () 2024-03-09T14:46:08.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:08.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:08.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:08.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 20 zonegroup default 2024-03-09T14:46:08.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:08.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 20 started sync module instance, tier type = 2024-03-09T14:46:08.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.974+0000 7fc0b7919980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:08.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.998+0000 7fc0b7919980 20 add_watcher() i=0 2024-03-09T14:46:08.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.998+0000 7fc0b7919980 20 add_watcher() i=1 2024-03-09T14:46:08.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.998+0000 7fc0b7919980 20 add_watcher() i=2 2024-03-09T14:46:08.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.998+0000 7fc0b7919980 20 add_watcher() i=3 2024-03-09T14:46:08.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.998+0000 7fc0b7919980 20 add_watcher() i=4 2024-03-09T14:46:08.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.998+0000 7fc0b7919980 20 add_watcher() i=5 2024-03-09T14:46:08.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.998+0000 7fc0b7919980 20 add_watcher() i=6 2024-03-09T14:46:08.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.998+0000 7fc0b7919980 20 add_watcher() i=7 2024-03-09T14:46:08.992 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:08.998+0000 7fc0b7919980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:08.995 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.002+0000 7fbf6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:08.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.002+0000 7fc0b7919980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:08.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.002+0000 7fc0b7919980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:08.996 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.002+0000 7fc0b7919980 5 note: GC not initialized 2024-03-09T14:46:08.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.002+0000 7fbf6a7e4640 20 reqs_thread_entry: start 2024-03-09T14:46:08.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.002+0000 7fc0b7919980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:08.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.002+0000 7fc0b7919980 20 Filter name: none 2024-03-09T14:46:08.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.002+0000 7fbedbfff640 20 reqs_thread_entry: start 2024-03-09T14:46:08.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.002+0000 7fc0b7919980 20 rados->read ofs=0 len=0 2024-03-09T14:46:08.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.006+0000 7fc0b7919980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:08.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.006+0000 7fc0b7919980 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.006+0000 7fc0b7919980 20 rados_obj.operate() r=0 bl.length=425 2024-03-09T14:46:09.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.006+0000 7fc0b7919980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:09.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.006+0000 7fc0b7919980 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.006+0000 7fc0b7919980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:09.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.006+0000 7fc0b7919980 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.006+0000 7fc0b7919980 20 rados_obj.operate() r=0 bl.length=425 2024-03-09T14:46:09.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.006+0000 7fc0b7919980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:09.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.010+0000 7fc0b7919980 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.010+0000 7fc0b7919980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:09.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.010+0000 7fbf6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:09.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.018+0000 7fc0b7919980 20 remove_watcher() i=0 2024-03-09T14:46:09.010 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.018+0000 7fc0b7919980 2 removed watcher, disabling cache 2024-03-09T14:46:09.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.018+0000 7fc0b7919980 20 remove_watcher() i=1 2024-03-09T14:46:09.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.022+0000 7fc0b7919980 20 remove_watcher() i=2 2024-03-09T14:46:09.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.022+0000 7fc0b7919980 20 remove_watcher() i=3 2024-03-09T14:46:09.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.026+0000 7fc0b7919980 20 remove_watcher() i=4 2024-03-09T14:46:09.019 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.026+0000 7fc0b7919980 20 remove_watcher() i=5 2024-03-09T14:46:09.021 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.026+0000 7fc0b7919980 20 remove_watcher() i=6 2024-03-09T14:46:09.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.030+0000 7fc0b7919980 20 remove_watcher() i=7 2024-03-09T14:46:09.039 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:09.039 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:46:09.039 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: error-at-do-reshard id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-09T14:46:09.039 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:09.041 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.042 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.046 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.046 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.136 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.136 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.204 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: reshard bucket with abort at do_reshard 2024-03-09T14:46:09.204 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:09.207 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.207 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.238 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.239 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.286 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.286 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.308 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.308 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.330 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.330 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.350 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.350 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.372 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.372 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.393 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.393 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.415 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.415 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.436 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.436 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.457 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.457 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.479 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.479 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.499 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.500 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.521 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.521 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.542 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.542 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.566 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.566 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.587 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.587 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.607 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.607 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.628 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.628 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.653 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.653 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.673 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.674 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.694 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:09.694 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:09.713 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-03-09T14:46:09.743 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:09.743 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:09.789 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.794+0000 7f52ac990980 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.798+0000 7f52ac990980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:09.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.798+0000 7f52ac990980 20 realm 2024-03-09T14:46:09.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.798+0000 7f52ac990980 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.798+0000 7f52ac990980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:09.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.798+0000 7f52ac990980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:09.791 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.798+0000 7f52ac990980 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.798+0000 7f52ac990980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:09.792 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.798+0000 7f52ac990980 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.793 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.798+0000 7f52ac990980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:09.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.798+0000 7f52ac990980 20 rados->read ofs=0 len=0 2024-03-09T14:46:09.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.802+0000 7f52ac990980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:09.795 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.802+0000 7f52ac990980 20 searching for the correct realm 2024-03-09T14:46:09.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:09.806+0000 7f52aaca9640 0 -- 172.21.15.99:0/4165167844 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f52a0018040 msgr2=0x7f52a005b830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:46:10.014 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.022+0000 7f52a9ca7640 0 -- 172.21.15.99:0/4165167844 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f52a40d9b50 msgr2=0x7f52a40fc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:10.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.238+0000 7f52ac990980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:10.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.238+0000 7f52ac990980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:10.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.238+0000 7f52ac990980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:10.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.238+0000 7f52ac990980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:10.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.238+0000 7f52ac990980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:10.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.238+0000 7f52ac990980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:10.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.238+0000 7f52ac990980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.238+0000 7f52ac990980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.238+0000 7f52ac990980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.242+0000 7f52ac990980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:10.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.242+0000 7f52ac990980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.242+0000 7f52ac990980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:10.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.242+0000 7f52ac990980 20 zone default found 2024-03-09T14:46:10.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.242+0000 7f52ac990980 4 Realm: () 2024-03-09T14:46:10.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.242+0000 7f52ac990980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:10.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.242+0000 7f52ac990980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:10.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.242+0000 7f52ac990980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:10.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.242+0000 7f52ac990980 20 zonegroup default 2024-03-09T14:46:10.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.242+0000 7f52ac990980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.242+0000 7f52ac990980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.242+0000 7f52ac990980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.242+0000 7f52ac990980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.242+0000 7f52ac990980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.242+0000 7f52ac990980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.242+0000 7f52ac990980 20 started sync module instance, tier type = 2024-03-09T14:46:10.237 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.242+0000 7f52ac990980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:10.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.266+0000 7f52ac990980 20 add_watcher() i=0 2024-03-09T14:46:10.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.266+0000 7f52ac990980 20 add_watcher() i=1 2024-03-09T14:46:10.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.266+0000 7f52ac990980 20 add_watcher() i=2 2024-03-09T14:46:10.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.266+0000 7f52ac990980 20 add_watcher() i=3 2024-03-09T14:46:10.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.266+0000 7f52ac990980 20 add_watcher() i=4 2024-03-09T14:46:10.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.266+0000 7f52ac990980 20 add_watcher() i=5 2024-03-09T14:46:10.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.266+0000 7f52ac990980 20 add_watcher() i=6 2024-03-09T14:46:10.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.270+0000 7f52ac990980 20 add_watcher() i=7 2024-03-09T14:46:10.262 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.270+0000 7f52ac990980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:10.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.274+0000 7f5160fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:10.267 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.274+0000 7f52ac990980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:10.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.274+0000 7f52ac990980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:10.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.274+0000 7f52ac990980 5 note: GC not initialized 2024-03-09T14:46:10.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.274+0000 7f50db7fe640 20 reqs_thread_entry: start 2024-03-09T14:46:10.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.274+0000 7f52ac990980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:10.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.274+0000 7f52ac990980 20 Filter name: none 2024-03-09T14:46:10.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.274+0000 7f50d97fa640 20 reqs_thread_entry: start 2024-03-09T14:46:10.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.274+0000 7f52ac990980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.274+0000 7f52ac990980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:10.269 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.274+0000 7f52ac990980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.278+0000 7f52ac990980 20 rados_obj.operate() r=0 bl.length=425 2024-03-09T14:46:10.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.278+0000 7f52ac990980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:10.271 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.278+0000 7f52ac990980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.278+0000 7f52ac990980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:10.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.278+0000 7f52ac990980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.278+0000 7f52ac990980 20 rados_obj.operate() r=0 bl.length=425 2024-03-09T14:46:10.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.278+0000 7f52ac990980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:10.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.278+0000 7f52ac990980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.273 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.278+0000 7f52ac990980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.282+0000 7f5160fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:10.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.286+0000 7f52ac990980 20 remove_watcher() i=0 2024-03-09T14:46:10.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.286+0000 7f52ac990980 2 removed watcher, disabling cache 2024-03-09T14:46:10.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.290+0000 7f52ac990980 20 remove_watcher() i=1 2024-03-09T14:46:10.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.290+0000 7f52ac990980 20 remove_watcher() i=2 2024-03-09T14:46:10.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.294+0000 7f52ac990980 20 remove_watcher() i=3 2024-03-09T14:46:10.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.294+0000 7f52ac990980 20 remove_watcher() i=4 2024-03-09T14:46:10.291 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.298+0000 7f52ac990980 20 remove_watcher() i=5 2024-03-09T14:46:10.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.298+0000 7f52ac990980 20 remove_watcher() i=6 2024-03-09T14:46:10.295 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.302+0000 7f52ac990980 20 remove_watcher() i=7 2024-03-09T14:46:10.312 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.312 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:46:10.312 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-do-reshard id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:46:10.312 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.312 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-03-09T14:46:10.344 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:10.344 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:10.387 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.394+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.388 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.394+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.394+0000 7f0471652980 20 realm 2024-03-09T14:46:10.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.394+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.394+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.394+0000 7f0471652980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:10.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.394+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.389 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.394+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.394+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.398+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:10.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.398+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.398+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:10.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.398+0000 7f0471652980 20 searching for the correct realm 2024-03-09T14:46:10.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.402+0000 7f046f96b640 0 -- 172.21.15.99:0/3386213582 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55a18c6f6620 msgr2=0x55a18c6f8a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:10.403 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.410+0000 7f046e969640 0 -- 172.21.15.99:0/3386213582 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f046808a590 msgr2=0x7f04680879f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:46:10.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:10.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:10.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:10.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:10.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:10.621 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:10.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.626+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.626+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.626+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.630+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:10.622 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.630+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.630+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:10.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.630+0000 7f0471652980 20 zone default found 2024-03-09T14:46:10.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.630+0000 7f0471652980 4 Realm: () 2024-03-09T14:46:10.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.630+0000 7f0471652980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:10.623 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.630+0000 7f0471652980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:10.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.630+0000 7f0471652980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:10.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.630+0000 7f0471652980 20 zonegroup default 2024-03-09T14:46:10.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.630+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.630+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.624 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.630+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.630+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.625 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.630+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.630+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.630+0000 7f0471652980 20 started sync module instance, tier type = 2024-03-09T14:46:10.626 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.630+0000 7f0471652980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:10.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=0 2024-03-09T14:46:10.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=1 2024-03-09T14:46:10.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=2 2024-03-09T14:46:10.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=3 2024-03-09T14:46:10.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=4 2024-03-09T14:46:10.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=5 2024-03-09T14:46:10.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=6 2024-03-09T14:46:10.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.658+0000 7f0471652980 20 add_watcher() i=7 2024-03-09T14:46:10.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.658+0000 7f0471652980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:10.655 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.662+0000 7f0325fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:10.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.662+0000 7f0471652980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:10.656 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.662+0000 7f0471652980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:10.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.662+0000 7f0471652980 5 note: GC not initialized 2024-03-09T14:46:10.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.662+0000 7f0324fe1640 20 reqs_thread_entry: start 2024-03-09T14:46:10.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.662+0000 7f0471652980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:10.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.662+0000 7f0471652980 20 Filter name: none 2024-03-09T14:46:10.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.662+0000 7f029e7fc640 20 reqs_thread_entry: start 2024-03-09T14:46:10.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.662+0000 7f0471652980 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-09T14:46:10.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.662+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.666+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:10.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.666+0000 7f0471652980 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-09T14:46:10.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.666+0000 7f0471652980 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-09T14:46:10.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.666+0000 7f0471652980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 : miss 2024-03-09T14:46:10.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.666+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.666+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=425 2024-03-09T14:46:10.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.666+0000 7f0471652980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 info.flags=0x17 2024-03-09T14:46:10.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.666+0000 7f0471652980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 to cache LRU end 2024-03-09T14:46:10.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.666+0000 7f0471652980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:46:10.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.666+0000 7f0471652980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:10.660 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.666+0000 7f0471652980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 2024-03-09T14:46:10.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.678+0000 7f0471652980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 info.flags=0x17 2024-03-09T14:46:10.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.678+0000 7f0471652980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 to cache LRU end 2024-03-09T14:46:10.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.678+0000 7f0471652980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:10.670 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.678+0000 7f0471652980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29, ofs0, ns] 2024-03-09T14:46:10.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.678+0000 7f0352ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464261 cookie 94152334256304 notifier 6963 bl.length()=987 2024-03-09T14:46:10.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.678+0000 7f0352ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 info.flags=0x17 2024-03-09T14:46:10.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.678+0000 7f0352ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 to cache LRU end 2024-03-09T14:46:10.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.678+0000 7f0352ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:10.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.678+0000 7f0471652980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): orig_sources= new_sources= 2024-03-09T14:46:10.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.678+0000 7f0471652980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): potential sources added=[] removed=[] 2024-03-09T14:46:10.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.678+0000 7f0471652980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): orig_dests= new_dests= 2024-03-09T14:46:10.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.678+0000 7f0471652980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): potential dests added=[] removed=[] 2024-03-09T14:46:10.675 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0471652980 time 2024-03-09T14:46:10.684534+0000 2024-03-09T14:46:10.675 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:46:10.676 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:46:10.676 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0474f27d7b] 2024-03-09T14:46:10.676 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f0474f27f2f] 2024-03-09T14:46:10.676 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a18aa93c51] 2024-03-09T14:46:10.677 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x315) [0x55a18aab42f5] 2024-03-09T14:46:10.677 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-03-09T14:46:10.677 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0473d92d90] 2024-03-09T14:46:10.677 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-03-09T14:46:10.677 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-03-09T14:46:10.677 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.682+0000 7f0471652980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0471652980 time 2024-03-09T14:46:10.684534+0000 2024-03-09T14:46:10.677 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:46:10.677 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.677 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:46:10.678 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0474f27d7b] 2024-03-09T14:46:10.678 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f0474f27f2f] 2024-03-09T14:46:10.678 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a18aa93c51] 2024-03-09T14:46:10.678 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x315) [0x55a18aab42f5] 2024-03-09T14:46:10.678 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-03-09T14:46:10.678 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0473d92d90] 2024-03-09T14:46:10.678 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-03-09T14:46:10.678 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-03-09T14:46:10.678 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.678 INFO:tasks.workunit.client.0.smithi099.stderr:*** Caught signal (Aborted) ** 2024-03-09T14:46:10.678 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f0471652980 thread_name:radosgw-admin 2024-03-09T14:46:10.684 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:46:10.685 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0473dab520] 2024-03-09T14:46:10.685 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-03-09T14:46:10.685 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-03-09T14:46:10.685 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-03-09T14:46:10.685 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0474f27dd5] 2024-03-09T14:46:10.685 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f0474f27f2f] 2024-03-09T14:46:10.685 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a18aa93c51] 2024-03-09T14:46:10.685 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x315) [0x55a18aab42f5] 2024-03-09T14:46:10.685 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-03-09T14:46:10.685 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0473d92d90] 2024-03-09T14:46:10.685 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-03-09T14:46:10.685 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-03-09T14:46:10.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.682+0000 7f0471652980 -1 *** Caught signal (Aborted) ** 2024-03-09T14:46:10.686 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f0471652980 thread_name:radosgw-admin 2024-03-09T14:46:10.686 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.686 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:46:10.686 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0473dab520] 2024-03-09T14:46:10.686 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-03-09T14:46:10.686 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-03-09T14:46:10.686 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-03-09T14:46:10.686 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0474f27dd5] 2024-03-09T14:46:10.686 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f0474f27f2f] 2024-03-09T14:46:10.686 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a18aa93c51] 2024-03-09T14:46:10.686 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x315) [0x55a18aab42f5] 2024-03-09T14:46:10.686 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-03-09T14:46:10.686 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0473d92d90] 2024-03-09T14:46:10.686 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-03-09T14:46:10.686 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-03-09T14:46:10.687 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:46:10.687 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.687 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-03-09T14:46:10.687 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-03-09T14:46:10.370+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.687 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-03-09T14:46:10.370+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.687 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-03-09T14:46:10.370+0000 7f046f96b640 10 monclient(hunting): handle_auth_done global_id 6951 payload 274 2024-03-09T14:46:10.687 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-03-09T14:46:10.370+0000 7f046f96b640 10 monclient: _finish_hunting 0 2024-03-09T14:46:10.687 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-03-09T14:46:10.370+0000 7f046f96b640 1 monclient: found mon.noname-a 2024-03-09T14:46:10.687 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-03-09T14:46:10.370+0000 7f046f96b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:46:10.687 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.687 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:46:10.687 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: dump: 2024-03-09T14:46:10.687 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.687 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.687 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.688 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.688 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.688 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.688 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.688 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.688 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.688 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.688 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: _finish_auth 0 2024-03-09T14:46:10.688 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: _check_auth_tickets 2024-03-09T14:46:10.688 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:46:10.688 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.688 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:46:10.688 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: dump: 2024-03-09T14:46:10.688 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.688 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.689 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.689 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.689 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.689 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.689 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.689 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.689 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.689 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.689 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-03-09T14:46:10.370+0000 7f0471652980 5 monclient: authenticate success, global_id 6951 2024-03-09T14:46:10.689 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-03-09T14:46:10.370+0000 7f0471652980 10 monclient: get_monmap_and_config success 2024-03-09T14:46:10.689 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-03-09T14:46:10.370+0000 7f0471652980 4 set_mon_vals no callback set 2024-03-09T14:46:10.689 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: shutdown 2024-03-09T14:46:10.689 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-03-09T14:46:10.374+0000 7f0471652980 5 asok(0x55a18c3f3bb0) unregister_commands rotate-key 2024-03-09T14:46:10.689 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: build_initial_monmap 2024-03-09T14:46:10.690 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-03-09T14:46:10.374+0000 7f0471652980 1 build_initial for_mkfs: 0 2024-03-09T14:46:10.690 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: monmap: 2024-03-09T14:46:10.690 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:46:10.690 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:46:10.690 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:46:10.690 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:46:10.690 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:46:10.690 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.690 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:46:10.690 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:46:10.690 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:46:10.690 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.690 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding auth protocol: cephx 2024-03-09T14:46:10.690 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding auth protocol: cephx 2024-03-09T14:46:10.690 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding auth protocol: cephx 2024-03-09T14:46:10.691 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: secure 2024-03-09T14:46:10.691 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: crc 2024-03-09T14:46:10.691 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: secure 2024-03-09T14:46:10.691 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: crc 2024-03-09T14:46:10.691 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: secure 2024-03-09T14:46:10.691 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: crc 2024-03-09T14:46:10.691 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: crc 2024-03-09T14:46:10.691 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: secure 2024-03-09T14:46:10.691 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: crc 2024-03-09T14:46:10.691 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: secure 2024-03-09T14:46:10.691 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: crc 2024-03-09T14:46:10.691 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: secure 2024-03-09T14:46:10.691 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-03-09T14:46:10.374+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.691 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-03-09T14:46:10.374+0000 7f0471652980 1 librados: starting msgr at 2024-03-09T14:46:10.691 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-03-09T14:46:10.374+0000 7f0471652980 1 librados: starting objecter 2024-03-09T14:46:10.692 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-03-09T14:46:10.374+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command objecter_requests hook 0x55a18c609190 2024-03-09T14:46:10.692 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-03-09T14:46:10.374+0000 7f0471652980 1 librados: setting wanted keys 2024-03-09T14:46:10.692 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-03-09T14:46:10.374+0000 7f0471652980 1 librados: calling monclient init 2024-03-09T14:46:10.692 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: init 2024-03-09T14:46:10.692 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding auth protocol: cephx 2024-03-09T14:46:10.692 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding auth protocol: cephx 2024-03-09T14:46:10.692 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding auth protocol: cephx 2024-03-09T14:46:10.692 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: secure 2024-03-09T14:46:10.692 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: crc 2024-03-09T14:46:10.692 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: secure 2024-03-09T14:46:10.692 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: crc 2024-03-09T14:46:10.693 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: secure 2024-03-09T14:46:10.693 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: crc 2024-03-09T14:46:10.693 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: crc 2024-03-09T14:46:10.693 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: secure 2024-03-09T14:46:10.693 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: crc 2024-03-09T14:46:10.693 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: secure 2024-03-09T14:46:10.693 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: crc 2024-03-09T14:46:10.694 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: secure 2024-03-09T14:46:10.694 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-03-09T14:46:10.374+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.694 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-03-09T14:46:10.374+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.694 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-03-09T14:46:10.374+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command rotate-key hook 0x55a18c601c68 2024-03-09T14:46:10.694 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: _reopen_session rank -1 2024-03-09T14:46:10.694 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: _add_conns ranks=[2,1,0] 2024-03-09T14:46:10.694 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient(hunting): picked mon.noname-c con 0x55a18c4bd070 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:46:10.694 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient(hunting): picked mon.noname-b con 0x55a18c4bd450 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:46:10.694 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient(hunting): picked mon.noname-a con 0x55a18c54ae70 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:46:10.694 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.694 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.694 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.695 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient(hunting): _renew_subs 2024-03-09T14:46:10.695 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient(hunting): authenticate will time out at 2024.173744s 2024-03-09T14:46:10.695 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient(hunting): get_auth_request con 0x55a18c4bd070 auth_method 0 2024-03-09T14:46:10.695 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.695 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.695 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.695 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-03-09T14:46:10.374+0000 7f046f96b640 10 monclient(hunting): get_auth_request con 0x55a18c54ae70 auth_method 0 2024-03-09T14:46:10.695 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-03-09T14:46:10.374+0000 7f046f96b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.695 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-03-09T14:46:10.374+0000 7f046f96b640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.695 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-03-09T14:46:10.374+0000 7f046f96b640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.695 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:46:10.695 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.695 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.695 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-03-09T14:46:10.374+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:46:10.695 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-03-09T14:46:10.374+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.696 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-03-09T14:46:10.374+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.696 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient(hunting): handle_auth_done global_id 6656 payload 824 2024-03-09T14:46:10.696 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient: _finish_hunting 0 2024-03-09T14:46:10.696 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-03-09T14:46:10.374+0000 7f046f16a640 1 monclient: found mon.noname-c 2024-03-09T14:46:10.696 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:46:10.696 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.696 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:46:10.696 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: dump: 2024-03-09T14:46:10.696 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.696 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.696 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.696 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.697 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.697 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.697 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.697 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.697 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.697 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.697 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: _finish_auth 0 2024-03-09T14:46:10.697 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: _check_auth_tickets 2024-03-09T14:46:10.697 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-03-09T14:46:10.374+0000 7f0471652980 5 monclient: authenticate success, global_id 6656 2024-03-09T14:46:10.697 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: _renew_subs 2024-03-09T14:46:10.697 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:46:10.697 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:46:10.697 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.697 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:46:10.698 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: dump: 2024-03-09T14:46:10.698 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.698 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.698 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.698 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.698 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.698 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.698 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.698 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.698 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.698 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.698 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-03-09T14:46:10.374+0000 7f035d60a640 4 set_mon_vals no callback set 2024-03-09T14:46:10.698 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: _renew_subs 2024-03-09T14:46:10.698 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:46:10.699 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-03-09T14:46:10.374+0000 7f0471652980 1 librados: init done 2024-03-09T14:46:10.699 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-03-09T14:46:10.378+0000 7f035be07640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:46:10.699 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-03-09T14:46:10.378+0000 7f035be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:46:10.699 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-03-09T14:46:10.378+0000 7f035be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:46:10.699 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-03-09T14:46:10.378+0000 7f046e969640 10 monclient: get_auth_request con 0x7f0354066070 auth_method 0 2024-03-09T14:46:10.699 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-03-09T14:46:10.378+0000 7f046f96b640 10 monclient: get_auth_request con 0x55a18c642d60 auth_method 0 2024-03-09T14:46:10.699 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-03-09T14:46:10.378+0000 7f046f16a640 10 monclient: get_auth_request con 0x55a18c64c740 auth_method 0 2024-03-09T14:46:10.699 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-03-09T14:46:10.378+0000 7f046e969640 10 monclient: get_auth_request con 0x55a18c650930 auth_method 0 2024-03-09T14:46:10.699 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-03-09T14:46:10.382+0000 7f046f96b640 10 monclient: get_auth_request con 0x55a18c64ffe0 auth_method 0 2024-03-09T14:46:10.700 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient: build_initial_monmap 2024-03-09T14:46:10.700 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-03-09T14:46:10.382+0000 7f0471652980 1 build_initial for_mkfs: 0 2024-03-09T14:46:10.700 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient: monmap: 2024-03-09T14:46:10.700 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:46:10.700 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:46:10.700 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:46:10.700 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:46:10.700 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:46:10.700 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.700 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:46:10.700 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:46:10.700 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:46:10.701 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.701 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding auth protocol: cephx 2024-03-09T14:46:10.701 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding auth protocol: cephx 2024-03-09T14:46:10.701 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding auth protocol: cephx 2024-03-09T14:46:10.701 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: secure 2024-03-09T14:46:10.701 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: crc 2024-03-09T14:46:10.701 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: secure 2024-03-09T14:46:10.701 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: crc 2024-03-09T14:46:10.701 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: secure 2024-03-09T14:46:10.701 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: crc 2024-03-09T14:46:10.701 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: crc 2024-03-09T14:46:10.701 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: secure 2024-03-09T14:46:10.701 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: crc 2024-03-09T14:46:10.701 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: secure 2024-03-09T14:46:10.702 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: crc 2024-03-09T14:46:10.702 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: secure 2024-03-09T14:46:10.702 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-03-09T14:46:10.382+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.702 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-03-09T14:46:10.382+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command objecter_requests cmddesc objecter_requests hook 0x55a18c65df20 EEXIST 2024-03-09T14:46:10.702 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient: init 2024-03-09T14:46:10.702 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding auth protocol: cephx 2024-03-09T14:46:10.702 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding auth protocol: cephx 2024-03-09T14:46:10.702 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding auth protocol: cephx 2024-03-09T14:46:10.702 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: secure 2024-03-09T14:46:10.702 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: crc 2024-03-09T14:46:10.702 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: secure 2024-03-09T14:46:10.702 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: crc 2024-03-09T14:46:10.703 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: secure 2024-03-09T14:46:10.703 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: crc 2024-03-09T14:46:10.703 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: crc 2024-03-09T14:46:10.703 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: secure 2024-03-09T14:46:10.703 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: crc 2024-03-09T14:46:10.703 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: secure 2024-03-09T14:46:10.703 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: crc 2024-03-09T14:46:10.703 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: secure 2024-03-09T14:46:10.703 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-03-09T14:46:10.382+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.703 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-03-09T14:46:10.382+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.703 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-03-09T14:46:10.382+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command rotate-key cmddesc rotate-key hook 0x55a18c6578e0 EEXIST 2024-03-09T14:46:10.703 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient: _reopen_session rank -1 2024-03-09T14:46:10.704 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:46:10.704 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient(hunting): picked mon.noname-b con 0x55a18c682b80 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:46:10.704 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient(hunting): picked mon.noname-a con 0x55a18c682f60 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:46:10.704 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient(hunting): picked mon.noname-c con 0x55a18c67e120 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:46:10.704 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.704 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.704 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.704 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient(hunting): _renew_subs 2024-03-09T14:46:10.704 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient(hunting): authenticate will time out at 2024.183709s 2024-03-09T14:46:10.704 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-03-09T14:46:10.382+0000 7f046f96b640 10 monclient(hunting): get_auth_request con 0x55a18c682f60 auth_method 0 2024-03-09T14:46:10.704 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-03-09T14:46:10.382+0000 7f046f96b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.705 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-03-09T14:46:10.382+0000 7f046f96b640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.705 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-03-09T14:46:10.382+0000 7f046f96b640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.705 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-03-09T14:46:10.382+0000 7f046f16a640 10 monclient(hunting): get_auth_request con 0x55a18c67e120 auth_method 0 2024-03-09T14:46:10.705 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-03-09T14:46:10.382+0000 7f046f16a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.705 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-03-09T14:46:10.382+0000 7f046f16a640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.705 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-03-09T14:46:10.382+0000 7f046f16a640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.705 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-03-09T14:46:10.382+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:46:10.705 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-03-09T14:46:10.382+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.705 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-03-09T14:46:10.382+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.705 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-03-09T14:46:10.382+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:46:10.705 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-03-09T14:46:10.382+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.705 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-03-09T14:46:10.382+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.706 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient(hunting): handle_auth_done global_id 6659 payload 824 2024-03-09T14:46:10.706 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient: _finish_hunting 0 2024-03-09T14:46:10.706 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-03-09T14:46:10.386+0000 7f046f16a640 1 monclient: found mon.noname-c 2024-03-09T14:46:10.706 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:46:10.706 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient: get_auth_request con 0x55a18c682b80 auth_method 0 2024-03-09T14:46:10.706 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.706 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:46:10.706 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: dump: 2024-03-09T14:46:10.706 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.706 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.706 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.707 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.707 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.707 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.707 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.707 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.707 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.707 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.707 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: _finish_auth 0 2024-03-09T14:46:10.707 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: _check_auth_tickets 2024-03-09T14:46:10.707 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:46:10.707 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.707 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:46:10.707 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: dump: 2024-03-09T14:46:10.707 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.708 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.708 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.708 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.708 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.708 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.708 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.708 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.708 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.708 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.708 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-03-09T14:46:10.386+0000 7f0471652980 5 monclient: authenticate success, global_id 6659 2024-03-09T14:46:10.708 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-03-09T14:46:10.386+0000 7f047016c640 4 set_mon_vals no callback set 2024-03-09T14:46:10.708 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: _renew_subs 2024-03-09T14:46:10.708 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:46:10.709 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: _renew_subs 2024-03-09T14:46:10.709 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:46:10.709 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-03-09T14:46:10.386+0000 7f0359602640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:46:10.709 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-03-09T14:46:10.386+0000 7f0359602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:46:10.709 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-03-09T14:46:10.386+0000 7f0359602640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:46:10.709 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient: get_auth_request con 0x7f0348065f80 auth_method 0 2024-03-09T14:46:10.709 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: get_monmap_and_config 2024-03-09T14:46:10.709 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: build_initial_monmap 2024-03-09T14:46:10.709 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-03-09T14:46:10.386+0000 7f0471652980 1 build_initial for_mkfs: 0 2024-03-09T14:46:10.709 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: monmap: 2024-03-09T14:46:10.709 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:46:10.709 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:46:10.709 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:46:10.710 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:46:10.710 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:46:10.710 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.710 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:46:10.710 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:46:10.710 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:46:10.710 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.710 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding auth protocol: cephx 2024-03-09T14:46:10.710 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding auth protocol: cephx 2024-03-09T14:46:10.710 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding auth protocol: cephx 2024-03-09T14:46:10.710 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.710 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.710 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.711 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.711 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.711 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.711 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.711 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.711 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.711 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.711 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.711 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.711 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-03-09T14:46:10.386+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.711 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: init 2024-03-09T14:46:10.711 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding auth protocol: cephx 2024-03-09T14:46:10.711 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding auth protocol: cephx 2024-03-09T14:46:10.711 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding auth protocol: cephx 2024-03-09T14:46:10.712 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: secure 2024-03-09T14:46:10.712 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: crc 2024-03-09T14:46:10.712 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: secure 2024-03-09T14:46:10.712 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: crc 2024-03-09T14:46:10.712 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: secure 2024-03-09T14:46:10.712 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: crc 2024-03-09T14:46:10.712 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: crc 2024-03-09T14:46:10.712 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: secure 2024-03-09T14:46:10.712 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: crc 2024-03-09T14:46:10.712 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: secure 2024-03-09T14:46:10.712 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: crc 2024-03-09T14:46:10.712 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: secure 2024-03-09T14:46:10.712 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-03-09T14:46:10.386+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.712 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-03-09T14:46:10.386+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.712 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-03-09T14:46:10.386+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command rotate-key cmddesc rotate-key hook 0x7fffd2451a78 EEXIST 2024-03-09T14:46:10.713 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: _reopen_session rank -1 2024-03-09T14:46:10.713 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:46:10.713 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient(hunting): picked mon.noname-a con 0x55a18c6d4c80 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:46:10.713 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient(hunting): picked mon.noname-b con 0x55a18c6d0200 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:46:10.713 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient(hunting): picked mon.noname-c con 0x55a18c6c6b00 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:46:10.713 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.713 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.713 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.713 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient(hunting): _renew_subs 2024-03-09T14:46:10.713 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient(hunting): authenticate will time out at 2024.187595s 2024-03-09T14:46:10.713 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient(hunting): get_auth_request con 0x55a18c6d4c80 auth_method 0 2024-03-09T14:46:10.713 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.713 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.713 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.713 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient(hunting): get_auth_request con 0x55a18c6c6b00 auth_method 0 2024-03-09T14:46:10.714 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.714 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.714 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.714 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:46:10.714 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.714 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.714 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:46:10.714 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.714 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.714 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient(hunting): handle_auth_done global_id 6960 payload 274 2024-03-09T14:46:10.714 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient: _finish_hunting 0 2024-03-09T14:46:10.714 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-03-09T14:46:10.386+0000 7f046e969640 1 monclient: found mon.noname-a 2024-03-09T14:46:10.714 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:46:10.714 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.715 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:46:10.715 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: dump: 2024-03-09T14:46:10.715 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.715 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.715 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.715 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.715 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.715 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.715 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.715 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.715 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.715 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.715 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: _finish_auth 0 2024-03-09T14:46:10.715 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: _check_auth_tickets 2024-03-09T14:46:10.715 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:46:10.716 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.716 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:46:10.716 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: dump: 2024-03-09T14:46:10.716 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.716 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.716 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.716 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.716 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.716 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.716 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.716 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.716 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.716 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.717 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-03-09T14:46:10.390+0000 7f0471652980 5 monclient: authenticate success, global_id 6960 2024-03-09T14:46:10.717 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: get_monmap_and_config success 2024-03-09T14:46:10.717 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-03-09T14:46:10.390+0000 7f0471652980 4 set_mon_vals no callback set 2024-03-09T14:46:10.717 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: shutdown 2024-03-09T14:46:10.717 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: build_initial_monmap 2024-03-09T14:46:10.717 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-03-09T14:46:10.390+0000 7f0471652980 1 build_initial for_mkfs: 0 2024-03-09T14:46:10.717 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: monmap: 2024-03-09T14:46:10.717 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:46:10.717 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:46:10.717 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:46:10.717 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:46:10.717 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:46:10.717 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.718 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:46:10.718 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:46:10.718 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:46:10.718 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.718 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding auth protocol: cephx 2024-03-09T14:46:10.718 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding auth protocol: cephx 2024-03-09T14:46:10.718 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding auth protocol: cephx 2024-03-09T14:46:10.718 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.718 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.718 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.718 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.718 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.718 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.718 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.719 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.719 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.719 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.719 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.719 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.719 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-03-09T14:46:10.390+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.719 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-03-09T14:46:10.390+0000 7f0471652980 1 librados: starting msgr at 2024-03-09T14:46:10.719 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-03-09T14:46:10.390+0000 7f0471652980 1 librados: starting objecter 2024-03-09T14:46:10.719 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-03-09T14:46:10.390+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command objecter_requests cmddesc objecter_requests hook 0x55a18c6cfd20 EEXIST 2024-03-09T14:46:10.719 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-03-09T14:46:10.390+0000 7f0471652980 1 librados: setting wanted keys 2024-03-09T14:46:10.719 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-03-09T14:46:10.390+0000 7f0471652980 1 librados: calling monclient init 2024-03-09T14:46:10.719 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: init 2024-03-09T14:46:10.719 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding auth protocol: cephx 2024-03-09T14:46:10.719 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding auth protocol: cephx 2024-03-09T14:46:10.719 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding auth protocol: cephx 2024-03-09T14:46:10.720 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: secure 2024-03-09T14:46:10.720 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: crc 2024-03-09T14:46:10.720 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: secure 2024-03-09T14:46:10.720 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: crc 2024-03-09T14:46:10.720 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: secure 2024-03-09T14:46:10.720 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: crc 2024-03-09T14:46:10.720 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: crc 2024-03-09T14:46:10.720 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: secure 2024-03-09T14:46:10.720 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: crc 2024-03-09T14:46:10.720 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: secure 2024-03-09T14:46:10.720 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: crc 2024-03-09T14:46:10.720 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: secure 2024-03-09T14:46:10.720 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-03-09T14:46:10.390+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.720 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-03-09T14:46:10.390+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.720 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-03-09T14:46:10.390+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command rotate-key cmddesc rotate-key hook 0x55a18c69f9e8 EEXIST 2024-03-09T14:46:10.721 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: _reopen_session rank -1 2024-03-09T14:46:10.721 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: _add_conns ranks=[2,0,1] 2024-03-09T14:46:10.721 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient(hunting): picked mon.noname-c con 0x55a18c6c6b00 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:46:10.721 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient(hunting): picked mon.noname-a con 0x55a18c6d0200 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:46:10.721 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient(hunting): picked mon.noname-b con 0x55a18c6d4c80 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:46:10.721 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.721 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.721 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.721 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient(hunting): _renew_subs 2024-03-09T14:46:10.721 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient(hunting): authenticate will time out at 2024.190144s 2024-03-09T14:46:10.721 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient(hunting): get_auth_request con 0x55a18c6d0200 auth_method 0 2024-03-09T14:46:10.721 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.721 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.721 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.721 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-03-09T14:46:10.390+0000 7f046e969640 10 monclient(hunting): get_auth_request con 0x55a18c6c6b00 auth_method 0 2024-03-09T14:46:10.722 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-03-09T14:46:10.390+0000 7f046e969640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.722 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-03-09T14:46:10.390+0000 7f046e969640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.722 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-03-09T14:46:10.390+0000 7f046e969640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.722 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:46:10.722 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.722 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.722 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-03-09T14:46:10.390+0000 7f046e969640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:46:10.722 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-03-09T14:46:10.390+0000 7f046e969640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.722 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-03-09T14:46:10.390+0000 7f046e969640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.722 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-03-09T14:46:10.390+0000 7f046f16a640 10 monclient(hunting): get_auth_request con 0x55a18c6d4c80 auth_method 0 2024-03-09T14:46:10.722 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-03-09T14:46:10.390+0000 7f046f16a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.722 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-03-09T14:46:10.390+0000 7f046f16a640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.722 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-03-09T14:46:10.390+0000 7f046f16a640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.722 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient(hunting): handle_auth_done global_id 6963 payload 824 2024-03-09T14:46:10.723 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient: _finish_hunting 0 2024-03-09T14:46:10.723 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-03-09T14:46:10.390+0000 7f046f96b640 1 monclient: found mon.noname-a 2024-03-09T14:46:10.723 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:46:10.723 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.723 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:46:10.723 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: dump: 2024-03-09T14:46:10.723 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.723 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.723 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.723 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.723 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.723 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.723 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.723 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.723 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.724 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.724 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: _finish_auth 0 2024-03-09T14:46:10.724 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: _check_auth_tickets 2024-03-09T14:46:10.724 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:46:10.724 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.724 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:46:10.724 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: dump: 2024-03-09T14:46:10.724 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.724 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.724 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.724 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.724 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.724 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.724 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.724 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.725 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.725 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.725 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-03-09T14:46:10.390+0000 7f0471652980 5 monclient: authenticate success, global_id 6963 2024-03-09T14:46:10.725 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: _renew_subs 2024-03-09T14:46:10.725 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-03-09T14:46:10.390+0000 7f0352ffd640 4 set_mon_vals no callback set 2024-03-09T14:46:10.725 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:46:10.725 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: _renew_subs 2024-03-09T14:46:10.725 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:46:10.725 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-03-09T14:46:10.390+0000 7f0471652980 1 librados: init done 2024-03-09T14:46:10.725 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-03-09T14:46:10.390+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command cr dump hook 0x55a18c6d8eb8 2024-03-09T14:46:10.725 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-03-09T14:46:10.394+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.725 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-03-09T14:46:10.394+0000 7f03517fa640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:46:10.725 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-03-09T14:46:10.394+0000 7f03517fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:46:10.725 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-03-09T14:46:10.394+0000 7f03517fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:46:10.725 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-03-09T14:46:10.394+0000 7f046e969640 10 monclient: get_auth_request con 0x7f0338066070 auth_method 0 2024-03-09T14:46:10.726 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-03-09T14:46:10.394+0000 7f046f16a640 10 monclient: get_auth_request con 0x55a18c6eebf0 auth_method 0 2024-03-09T14:46:10.726 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-03-09T14:46:10.394+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.726 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-03-09T14:46:10.394+0000 7f0471652980 20 realm 2024-03-09T14:46:10.726 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-03-09T14:46:10.394+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.726 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-03-09T14:46:10.394+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.726 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-03-09T14:46:10.394+0000 7f0471652980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:10.726 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-03-09T14:46:10.394+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.726 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-03-09T14:46:10.394+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.726 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-03-09T14:46:10.394+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.726 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-03-09T14:46:10.394+0000 7f046e969640 10 monclient: get_auth_request con 0x55a18c6f2dc0 auth_method 0 2024-03-09T14:46:10.726 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-03-09T14:46:10.398+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:10.726 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-03-09T14:46:10.398+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.726 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-03-09T14:46:10.398+0000 7f046f96b640 10 monclient: get_auth_request con 0x55a18c6f6620 auth_method 0 2024-03-09T14:46:10.726 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-03-09T14:46:10.398+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:10.726 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-03-09T14:46:10.398+0000 7f0471652980 20 searching for the correct realm 2024-03-09T14:46:10.727 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-03-09T14:46:10.398+0000 7f046f16a640 10 monclient: get_auth_request con 0x55a18c6fb390 auth_method 0 2024-03-09T14:46:10.727 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-03-09T14:46:10.398+0000 7f046e969640 10 monclient: get_auth_request con 0x7f04600ad2a0 auth_method 0 2024-03-09T14:46:10.727 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-03-09T14:46:10.402+0000 7f046f96b640 10 monclient: get_auth_request con 0x7f0464050040 auth_method 0 2024-03-09T14:46:10.727 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-03-09T14:46:10.402+0000 7f046f96b640 0 -- 172.21.15.99:0/3386213582 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55a18c6f6620 msgr2=0x55a18c6f8a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:10.727 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-03-09T14:46:10.402+0000 7f03517fa640 1 client.6963.objecter ms_handle_reset 0x55a18c6f6620 session 0x55a18c6f2150 osd.4 2024-03-09T14:46:10.727 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-03-09T14:46:10.402+0000 7f03517fa640 10 monclient: _renew_subs 2024-03-09T14:46:10.727 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-03-09T14:46:10.402+0000 7f03517fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:46:10.727 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-03-09T14:46:10.402+0000 7f046f96b640 10 monclient: get_auth_request con 0x7f0338076690 auth_method 0 2024-03-09T14:46:10.727 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-03-09T14:46:10.406+0000 7f046f16a640 10 monclient: get_auth_request con 0x7f0468064dd0 auth_method 0 2024-03-09T14:46:10.727 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-03-09T14:46:10.410+0000 7f046e969640 10 monclient: get_auth_request con 0x7f046808a590 auth_method 0 2024-03-09T14:46:10.727 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-03-09T14:46:10.410+0000 7f046e969640 0 -- 172.21.15.99:0/3386213582 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f046808a590 msgr2=0x7f04680879f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:46:10.727 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-03-09T14:46:10.614+0000 7f046e969640 10 monclient: get_auth_request con 0x7f046808a590 auth_method 0 2024-03-09T14:46:10.727 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:10.727 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:10.727 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:10.728 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:10.728 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:10.728 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:10.728 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-03-09T14:46:10.626+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.728 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-03-09T14:46:10.626+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.728 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-03-09T14:46:10.626+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.728 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:10.728 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.728 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:10.728 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-03-09T14:46:10.630+0000 7f0471652980 20 zone default found 2024-03-09T14:46:10.728 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-03-09T14:46:10.630+0000 7f0471652980 4 Realm: () 2024-03-09T14:46:10.728 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-03-09T14:46:10.630+0000 7f0471652980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:10.728 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-03-09T14:46:10.630+0000 7f0471652980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:10.728 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-03-09T14:46:10.630+0000 7f0471652980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:10.728 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-03-09T14:46:10.630+0000 7f0471652980 20 zonegroup default 2024-03-09T14:46:10.729 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.729 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.729 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.729 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.729 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.729 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.729 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-03-09T14:46:10.630+0000 7f0471652980 20 started sync module instance, tier type = 2024-03-09T14:46:10.729 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-03-09T14:46:10.630+0000 7f0471652980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:10.729 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=0 2024-03-09T14:46:10.729 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=1 2024-03-09T14:46:10.729 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=2 2024-03-09T14:46:10.729 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=3 2024-03-09T14:46:10.730 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=4 2024-03-09T14:46:10.730 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=5 2024-03-09T14:46:10.730 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=6 2024-03-09T14:46:10.730 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-03-09T14:46:10.658+0000 7f0471652980 20 add_watcher() i=7 2024-03-09T14:46:10.730 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-03-09T14:46:10.658+0000 7f0471652980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:10.730 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding auth protocol: cephx 2024-03-09T14:46:10.730 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding auth protocol: cephx 2024-03-09T14:46:10.730 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding auth protocol: cephx 2024-03-09T14:46:10.730 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: secure 2024-03-09T14:46:10.730 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: crc 2024-03-09T14:46:10.730 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: secure 2024-03-09T14:46:10.730 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: crc 2024-03-09T14:46:10.730 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: secure 2024-03-09T14:46:10.730 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: crc 2024-03-09T14:46:10.731 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: crc 2024-03-09T14:46:10.731 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: secure 2024-03-09T14:46:10.731 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: crc 2024-03-09T14:46:10.731 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: secure 2024-03-09T14:46:10.731 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: crc 2024-03-09T14:46:10.731 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: secure 2024-03-09T14:46:10.731 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-03-09T14:46:10.662+0000 7f0325fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:10.731 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-03-09T14:46:10.662+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.731 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-03-09T14:46:10.662+0000 7f0471652980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:10.731 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-03-09T14:46:10.662+0000 7f0471652980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:10.731 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-03-09T14:46:10.662+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command cache list hook 0x55a18c6d9400 2024-03-09T14:46:10.731 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-03-09T14:46:10.662+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command cache inspect hook 0x55a18c6d9400 2024-03-09T14:46:10.731 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-03-09T14:46:10.662+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command cache erase hook 0x55a18c6d9400 2024-03-09T14:46:10.731 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-03-09T14:46:10.662+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command cache zap hook 0x55a18c6d9400 2024-03-09T14:46:10.732 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-03-09T14:46:10.662+0000 7f0471652980 5 note: GC not initialized 2024-03-09T14:46:10.732 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-03-09T14:46:10.662+0000 7f0324fe1640 20 reqs_thread_entry: start 2024-03-09T14:46:10.732 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-03-09T14:46:10.662+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command sync trace show hook 0x7f04600043b0 2024-03-09T14:46:10.732 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-03-09T14:46:10.662+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command sync trace history hook 0x7f04600043b0 2024-03-09T14:46:10.732 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-03-09T14:46:10.662+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command sync trace active hook 0x7f04600043b0 2024-03-09T14:46:10.732 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-03-09T14:46:10.662+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command sync trace active_short hook 0x7f04600043b0 2024-03-09T14:46:10.732 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-03-09T14:46:10.662+0000 7f0471652980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:10.732 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-03-09T14:46:10.662+0000 7f0471652980 20 Filter name: none 2024-03-09T14:46:10.732 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-03-09T14:46:10.662+0000 7f029e7fc640 20 reqs_thread_entry: start 2024-03-09T14:46:10.732 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-03-09T14:46:10.662+0000 7f0471652980 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-09T14:46:10.732 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-03-09T14:46:10.662+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.732 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-03-09T14:46:10.666+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:10.732 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-03-09T14:46:10.666+0000 7f0471652980 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-09T14:46:10.732 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-03-09T14:46:10.666+0000 7f0471652980 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-09T14:46:10.732 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-03-09T14:46:10.666+0000 7f0471652980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 : miss 2024-03-09T14:46:10.733 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-03-09T14:46:10.666+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.733 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-03-09T14:46:10.666+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=425 2024-03-09T14:46:10.733 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-03-09T14:46:10.666+0000 7f0471652980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 info.flags=0x17 2024-03-09T14:46:10.733 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-03-09T14:46:10.666+0000 7f0471652980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 to cache LRU end 2024-03-09T14:46:10.733 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-03-09T14:46:10.666+0000 7f0471652980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:46:10.733 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-03-09T14:46:10.666+0000 7f0471652980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:10.733 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-03-09T14:46:10.666+0000 7f0471652980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 2024-03-09T14:46:10.733 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-03-09T14:46:10.678+0000 7f0471652980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 info.flags=0x17 2024-03-09T14:46:10.733 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-03-09T14:46:10.678+0000 7f0471652980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 to cache LRU end 2024-03-09T14:46:10.733 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-03-09T14:46:10.678+0000 7f0471652980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:10.733 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-03-09T14:46:10.678+0000 7f0471652980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29, ofs0, ns] 2024-03-09T14:46:10.733 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-03-09T14:46:10.678+0000 7f0352ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464261 cookie 94152334256304 notifier 6963 bl.length()=987 2024-03-09T14:46:10.733 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-03-09T14:46:10.678+0000 7f0352ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 info.flags=0x17 2024-03-09T14:46:10.733 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-03-09T14:46:10.678+0000 7f0352ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 to cache LRU end 2024-03-09T14:46:10.734 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-03-09T14:46:10.678+0000 7f0352ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:10.734 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-03-09T14:46:10.678+0000 7f0471652980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): orig_sources= new_sources= 2024-03-09T14:46:10.734 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-03-09T14:46:10.678+0000 7f0471652980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): potential sources added=[] removed=[] 2024-03-09T14:46:10.734 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-03-09T14:46:10.678+0000 7f0471652980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): orig_dests= new_dests= 2024-03-09T14:46:10.734 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-03-09T14:46:10.678+0000 7f0471652980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): potential dests added=[] removed=[] 2024-03-09T14:46:10.734 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-03-09T14:46:10.682+0000 7f0471652980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0471652980 time 2024-03-09T14:46:10.684534+0000 2024-03-09T14:46:10.734 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:46:10.734 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.734 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:46:10.734 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0474f27d7b] 2024-03-09T14:46:10.734 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f0474f27f2f] 2024-03-09T14:46:10.734 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a18aa93c51] 2024-03-09T14:46:10.734 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x315) [0x55a18aab42f5] 2024-03-09T14:46:10.735 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-03-09T14:46:10.735 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0473d92d90] 2024-03-09T14:46:10.735 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-03-09T14:46:10.735 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-03-09T14:46:10.735 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.735 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-03-09T14:46:10.682+0000 7f0471652980 -1 *** Caught signal (Aborted) ** 2024-03-09T14:46:10.735 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f0471652980 thread_name:radosgw-admin 2024-03-09T14:46:10.735 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.735 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:46:10.735 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0473dab520] 2024-03-09T14:46:10.735 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-03-09T14:46:10.735 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-03-09T14:46:10.735 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-03-09T14:46:10.735 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0474f27dd5] 2024-03-09T14:46:10.736 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f0474f27f2f] 2024-03-09T14:46:10.736 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a18aa93c51] 2024-03-09T14:46:10.736 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x315) [0x55a18aab42f5] 2024-03-09T14:46:10.736 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-03-09T14:46:10.736 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0473d92d90] 2024-03-09T14:46:10.736 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-03-09T14:46:10.736 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-03-09T14:46:10.736 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:46:10.736 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.736 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-03-09T14:46:10.736 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-03-09T14:46:10.736 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-03-09T14:46:10.736 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-03-09T14:46:10.736 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-03-09T14:46:10.736 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-03-09T14:46:10.737 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-03-09T14:46:10.737 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-03-09T14:46:10.737 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-03-09T14:46:10.737 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-03-09T14:46:10.737 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-03-09T14:46:10.737 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-03-09T14:46:10.737 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-03-09T14:46:10.737 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-03-09T14:46:10.737 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-03-09T14:46:10.737 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-03-09T14:46:10.737 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-03-09T14:46:10.737 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-03-09T14:46:10.737 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-03-09T14:46:10.737 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-03-09T14:46:10.737 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-03-09T14:46:10.737 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-03-09T14:46:10.738 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-03-09T14:46:10.738 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:46:10.738 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-03-09T14:46:10.738 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-03-09T14:46:10.738 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-03-09T14:46:10.738 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-03-09T14:46:10.738 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-03-09T14:46:10.738 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-03-09T14:46:10.738 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-03-09T14:46:10.738 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-03-09T14:46:10.738 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-03-09T14:46:10.738 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-03-09T14:46:10.738 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-03-09T14:46:10.738 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-03-09T14:46:10.738 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-03-09T14:46:10.739 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-03-09T14:46:10.739 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-03-09T14:46:10.739 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-03-09T14:46:10.739 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-03-09T14:46:10.739 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-03-09T14:46:10.739 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-03-09T14:46:10.739 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-03-09T14:46:10.739 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-03-09T14:46:10.739 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:46:10.739 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-03-09T14:46:10.739 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:46:10.739 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-03-09T14:46:10.739 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-03-09T14:46:10.739 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-03-09T14:46:10.739 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-03-09T14:46:10.739 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-03-09T14:46:10.740 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-03-09T14:46:10.740 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-03-09T14:46:10.740 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-03-09T14:46:10.740 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-03-09T14:46:10.740 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-03-09T14:46:10.740 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-03-09T14:46:10.740 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-03-09T14:46:10.740 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-03-09T14:46:10.740 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-03-09T14:46:10.740 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-03-09T14:46:10.740 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-03-09T14:46:10.740 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-03-09T14:46:10.740 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:46:10.740 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-03-09T14:46:10.740 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:46:10.741 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-03-09T14:46:10.741 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-03-09T14:46:10.741 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-03-09T14:46:10.741 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-03-09T14:46:10.741 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-03-09T14:46:10.741 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-03-09T14:46:10.741 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:46:10.741 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-03-09T14:46:10.741 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-03-09T14:46:10.741 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:46:10.741 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-03-09T14:46:10.741 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-03-09T14:46:10.741 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-03-09T14:46:10.741 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-03-09T14:46:10.742 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-03-09T14:46:10.742 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-03-09T14:46:10.742 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-03-09T14:46:10.742 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-03-09T14:46:10.742 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-03-09T14:46:10.742 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-03-09T14:46:10.742 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-03-09T14:46:10.742 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-03-09T14:46:10.742 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:46:10.742 INFO:tasks.workunit.client.0.smithi099.stderr: 7f029e7fc640 / http_manager 2024-03-09T14:46:10.743 INFO:tasks.workunit.client.0.smithi099.stderr: 7f0324fe1640 / http_manager 2024-03-09T14:46:10.743 INFO:tasks.workunit.client.0.smithi099.stderr: 7f0325fe3640 / rgw_dt_lg_renew 2024-03-09T14:46:10.743 INFO:tasks.workunit.client.0.smithi099.stderr: 7f03517fa640 / ms_dispatch 2024-03-09T14:46:10.745 INFO:tasks.workunit.client.0.smithi099.stderr: 7f0352ffd640 / io_context_pool 2024-03-09T14:46:10.745 INFO:tasks.workunit.client.0.smithi099.stderr: 7f0359602640 / ms_dispatch 2024-03-09T14:46:10.745 INFO:tasks.workunit.client.0.smithi099.stderr: 7f035be07640 / ms_dispatch 2024-03-09T14:46:10.745 INFO:tasks.workunit.client.0.smithi099.stderr: 7f035d60a640 / io_context_pool 2024-03-09T14:46:10.745 INFO:tasks.workunit.client.0.smithi099.stderr: 7f046e969640 / msgr-worker-2 2024-03-09T14:46:10.745 INFO:tasks.workunit.client.0.smithi099.stderr: 7f046f16a640 / msgr-worker-1 2024-03-09T14:46:10.745 INFO:tasks.workunit.client.0.smithi099.stderr: 7f046f96b640 / msgr-worker-0 2024-03-09T14:46:10.745 INFO:tasks.workunit.client.0.smithi099.stderr: 7f047016c640 / io_context_pool 2024-03-09T14:46:10.745 INFO:tasks.workunit.client.0.smithi099.stderr: 7f0471652980 / radosgw-admin 2024-03-09T14:46:10.745 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-03-09T14:46:10.746 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-03-09T14:46:10.746 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/log/ceph/ceph-client.admin.103262.log 2024-03-09T14:46:10.746 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-03-09T14:46:10.746 INFO:tasks.workunit.client.0.smithi099.stderr:--- begin dump of recent events --- 2024-03-09T14:46:10.746 INFO:tasks.workunit.client.0.smithi099.stderr: -499> 2024-03-09T14:46:10.370+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.746 INFO:tasks.workunit.client.0.smithi099.stderr: -498> 2024-03-09T14:46:10.370+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.746 INFO:tasks.workunit.client.0.smithi099.stderr: -497> 2024-03-09T14:46:10.370+0000 7f046f96b640 10 monclient(hunting): handle_auth_done global_id 6951 payload 274 2024-03-09T14:46:10.746 INFO:tasks.workunit.client.0.smithi099.stderr: -496> 2024-03-09T14:46:10.370+0000 7f046f96b640 10 monclient: _finish_hunting 0 2024-03-09T14:46:10.746 INFO:tasks.workunit.client.0.smithi099.stderr: -495> 2024-03-09T14:46:10.370+0000 7f046f96b640 1 monclient: found mon.noname-a 2024-03-09T14:46:10.746 INFO:tasks.workunit.client.0.smithi099.stderr: -494> 2024-03-09T14:46:10.370+0000 7f046f96b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:46:10.746 INFO:tasks.workunit.client.0.smithi099.stderr: -493> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.746 INFO:tasks.workunit.client.0.smithi099.stderr: -492> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:46:10.746 INFO:tasks.workunit.client.0.smithi099.stderr: -491> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: dump: 2024-03-09T14:46:10.747 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.747 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.747 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.747 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.747 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.747 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.747 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.747 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.747 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.747 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.747 INFO:tasks.workunit.client.0.smithi099.stderr: -490> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: _finish_auth 0 2024-03-09T14:46:10.747 INFO:tasks.workunit.client.0.smithi099.stderr: -489> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: _check_auth_tickets 2024-03-09T14:46:10.747 INFO:tasks.workunit.client.0.smithi099.stderr: -488> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:46:10.747 INFO:tasks.workunit.client.0.smithi099.stderr: -487> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.748 INFO:tasks.workunit.client.0.smithi099.stderr: -486> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:46:10.748 INFO:tasks.workunit.client.0.smithi099.stderr: -485> 2024-03-09T14:46:10.370+0000 7f035d60a640 10 monclient: dump: 2024-03-09T14:46:10.748 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.748 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.748 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.748 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.748 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.748 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.748 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.748 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.748 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.748 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.748 INFO:tasks.workunit.client.0.smithi099.stderr: -484> 2024-03-09T14:46:10.370+0000 7f0471652980 5 monclient: authenticate success, global_id 6951 2024-03-09T14:46:10.748 INFO:tasks.workunit.client.0.smithi099.stderr: -483> 2024-03-09T14:46:10.370+0000 7f0471652980 10 monclient: get_monmap_and_config success 2024-03-09T14:46:10.748 INFO:tasks.workunit.client.0.smithi099.stderr: -482> 2024-03-09T14:46:10.370+0000 7f0471652980 4 set_mon_vals no callback set 2024-03-09T14:46:10.749 INFO:tasks.workunit.client.0.smithi099.stderr: -481> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: shutdown 2024-03-09T14:46:10.749 INFO:tasks.workunit.client.0.smithi099.stderr: -480> 2024-03-09T14:46:10.374+0000 7f0471652980 5 asok(0x55a18c3f3bb0) unregister_commands rotate-key 2024-03-09T14:46:10.749 INFO:tasks.workunit.client.0.smithi099.stderr: -479> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: build_initial_monmap 2024-03-09T14:46:10.749 INFO:tasks.workunit.client.0.smithi099.stderr: -478> 2024-03-09T14:46:10.374+0000 7f0471652980 1 build_initial for_mkfs: 0 2024-03-09T14:46:10.749 INFO:tasks.workunit.client.0.smithi099.stderr: -477> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: monmap: 2024-03-09T14:46:10.749 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:46:10.749 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:46:10.749 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:46:10.749 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:46:10.749 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:46:10.749 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.749 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:46:10.749 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:46:10.749 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:46:10.749 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.750 INFO:tasks.workunit.client.0.smithi099.stderr: -476> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding auth protocol: cephx 2024-03-09T14:46:10.750 INFO:tasks.workunit.client.0.smithi099.stderr: -475> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding auth protocol: cephx 2024-03-09T14:46:10.750 INFO:tasks.workunit.client.0.smithi099.stderr: -474> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding auth protocol: cephx 2024-03-09T14:46:10.750 INFO:tasks.workunit.client.0.smithi099.stderr: -473> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: secure 2024-03-09T14:46:10.750 INFO:tasks.workunit.client.0.smithi099.stderr: -472> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: crc 2024-03-09T14:46:10.750 INFO:tasks.workunit.client.0.smithi099.stderr: -471> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: secure 2024-03-09T14:46:10.750 INFO:tasks.workunit.client.0.smithi099.stderr: -470> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: crc 2024-03-09T14:46:10.750 INFO:tasks.workunit.client.0.smithi099.stderr: -469> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: secure 2024-03-09T14:46:10.750 INFO:tasks.workunit.client.0.smithi099.stderr: -468> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: crc 2024-03-09T14:46:10.750 INFO:tasks.workunit.client.0.smithi099.stderr: -467> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: crc 2024-03-09T14:46:10.750 INFO:tasks.workunit.client.0.smithi099.stderr: -466> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: secure 2024-03-09T14:46:10.750 INFO:tasks.workunit.client.0.smithi099.stderr: -465> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: crc 2024-03-09T14:46:10.750 INFO:tasks.workunit.client.0.smithi099.stderr: -464> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: secure 2024-03-09T14:46:10.750 INFO:tasks.workunit.client.0.smithi099.stderr: -463> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: crc 2024-03-09T14:46:10.751 INFO:tasks.workunit.client.0.smithi099.stderr: -462> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c6312b0) adding con mode: secure 2024-03-09T14:46:10.751 INFO:tasks.workunit.client.0.smithi099.stderr: -461> 2024-03-09T14:46:10.374+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.751 INFO:tasks.workunit.client.0.smithi099.stderr: -460> 2024-03-09T14:46:10.374+0000 7f0471652980 1 librados: starting msgr at 2024-03-09T14:46:10.751 INFO:tasks.workunit.client.0.smithi099.stderr: -459> 2024-03-09T14:46:10.374+0000 7f0471652980 1 librados: starting objecter 2024-03-09T14:46:10.751 INFO:tasks.workunit.client.0.smithi099.stderr: -458> 2024-03-09T14:46:10.374+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command objecter_requests hook 0x55a18c609190 2024-03-09T14:46:10.751 INFO:tasks.workunit.client.0.smithi099.stderr: -457> 2024-03-09T14:46:10.374+0000 7f0471652980 1 librados: setting wanted keys 2024-03-09T14:46:10.751 INFO:tasks.workunit.client.0.smithi099.stderr: -456> 2024-03-09T14:46:10.374+0000 7f0471652980 1 librados: calling monclient init 2024-03-09T14:46:10.751 INFO:tasks.workunit.client.0.smithi099.stderr: -455> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: init 2024-03-09T14:46:10.751 INFO:tasks.workunit.client.0.smithi099.stderr: -454> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding auth protocol: cephx 2024-03-09T14:46:10.751 INFO:tasks.workunit.client.0.smithi099.stderr: -453> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding auth protocol: cephx 2024-03-09T14:46:10.751 INFO:tasks.workunit.client.0.smithi099.stderr: -452> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding auth protocol: cephx 2024-03-09T14:46:10.751 INFO:tasks.workunit.client.0.smithi099.stderr: -451> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: secure 2024-03-09T14:46:10.752 INFO:tasks.workunit.client.0.smithi099.stderr: -450> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: crc 2024-03-09T14:46:10.752 INFO:tasks.workunit.client.0.smithi099.stderr: -449> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: secure 2024-03-09T14:46:10.752 INFO:tasks.workunit.client.0.smithi099.stderr: -448> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: crc 2024-03-09T14:46:10.752 INFO:tasks.workunit.client.0.smithi099.stderr: -447> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: secure 2024-03-09T14:46:10.752 INFO:tasks.workunit.client.0.smithi099.stderr: -446> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: crc 2024-03-09T14:46:10.752 INFO:tasks.workunit.client.0.smithi099.stderr: -445> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: crc 2024-03-09T14:46:10.752 INFO:tasks.workunit.client.0.smithi099.stderr: -444> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: secure 2024-03-09T14:46:10.752 INFO:tasks.workunit.client.0.smithi099.stderr: -443> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: crc 2024-03-09T14:46:10.752 INFO:tasks.workunit.client.0.smithi099.stderr: -442> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: secure 2024-03-09T14:46:10.752 INFO:tasks.workunit.client.0.smithi099.stderr: -441> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: crc 2024-03-09T14:46:10.752 INFO:tasks.workunit.client.0.smithi099.stderr: -440> 2024-03-09T14:46:10.374+0000 7f0471652980 5 AuthRegistry(0x55a18c601b20) adding con mode: secure 2024-03-09T14:46:10.752 INFO:tasks.workunit.client.0.smithi099.stderr: -439> 2024-03-09T14:46:10.374+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.752 INFO:tasks.workunit.client.0.smithi099.stderr: -438> 2024-03-09T14:46:10.374+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.752 INFO:tasks.workunit.client.0.smithi099.stderr: -437> 2024-03-09T14:46:10.374+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command rotate-key hook 0x55a18c601c68 2024-03-09T14:46:10.753 INFO:tasks.workunit.client.0.smithi099.stderr: -436> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: _reopen_session rank -1 2024-03-09T14:46:10.753 INFO:tasks.workunit.client.0.smithi099.stderr: -435> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: _add_conns ranks=[2,1,0] 2024-03-09T14:46:10.753 INFO:tasks.workunit.client.0.smithi099.stderr: -434> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient(hunting): picked mon.noname-c con 0x55a18c4bd070 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:46:10.753 INFO:tasks.workunit.client.0.smithi099.stderr: -433> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient(hunting): picked mon.noname-b con 0x55a18c4bd450 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:46:10.753 INFO:tasks.workunit.client.0.smithi099.stderr: -432> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient(hunting): picked mon.noname-a con 0x55a18c54ae70 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:46:10.753 INFO:tasks.workunit.client.0.smithi099.stderr: -431> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.753 INFO:tasks.workunit.client.0.smithi099.stderr: -430> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.753 INFO:tasks.workunit.client.0.smithi099.stderr: -429> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.753 INFO:tasks.workunit.client.0.smithi099.stderr: -428> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient(hunting): _renew_subs 2024-03-09T14:46:10.753 INFO:tasks.workunit.client.0.smithi099.stderr: -427> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient(hunting): authenticate will time out at 2024.173744s 2024-03-09T14:46:10.753 INFO:tasks.workunit.client.0.smithi099.stderr: -426> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient(hunting): get_auth_request con 0x55a18c4bd070 auth_method 0 2024-03-09T14:46:10.753 INFO:tasks.workunit.client.0.smithi099.stderr: -425> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.753 INFO:tasks.workunit.client.0.smithi099.stderr: -424> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.753 INFO:tasks.workunit.client.0.smithi099.stderr: -423> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.754 INFO:tasks.workunit.client.0.smithi099.stderr: -422> 2024-03-09T14:46:10.374+0000 7f046f96b640 10 monclient(hunting): get_auth_request con 0x55a18c54ae70 auth_method 0 2024-03-09T14:46:10.754 INFO:tasks.workunit.client.0.smithi099.stderr: -421> 2024-03-09T14:46:10.374+0000 7f046f96b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.754 INFO:tasks.workunit.client.0.smithi099.stderr: -420> 2024-03-09T14:46:10.374+0000 7f046f96b640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.754 INFO:tasks.workunit.client.0.smithi099.stderr: -419> 2024-03-09T14:46:10.374+0000 7f046f96b640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.754 INFO:tasks.workunit.client.0.smithi099.stderr: -418> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:46:10.754 INFO:tasks.workunit.client.0.smithi099.stderr: -417> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.754 INFO:tasks.workunit.client.0.smithi099.stderr: -416> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.754 INFO:tasks.workunit.client.0.smithi099.stderr: -415> 2024-03-09T14:46:10.374+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:46:10.754 INFO:tasks.workunit.client.0.smithi099.stderr: -414> 2024-03-09T14:46:10.374+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.754 INFO:tasks.workunit.client.0.smithi099.stderr: -413> 2024-03-09T14:46:10.374+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.754 INFO:tasks.workunit.client.0.smithi099.stderr: -412> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient(hunting): handle_auth_done global_id 6656 payload 824 2024-03-09T14:46:10.754 INFO:tasks.workunit.client.0.smithi099.stderr: -411> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient: _finish_hunting 0 2024-03-09T14:46:10.754 INFO:tasks.workunit.client.0.smithi099.stderr: -410> 2024-03-09T14:46:10.374+0000 7f046f16a640 1 monclient: found mon.noname-c 2024-03-09T14:46:10.755 INFO:tasks.workunit.client.0.smithi099.stderr: -409> 2024-03-09T14:46:10.374+0000 7f046f16a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:46:10.755 INFO:tasks.workunit.client.0.smithi099.stderr: -408> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.755 INFO:tasks.workunit.client.0.smithi099.stderr: -407> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:46:10.755 INFO:tasks.workunit.client.0.smithi099.stderr: -406> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: dump: 2024-03-09T14:46:10.755 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.755 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.755 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.755 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.755 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.755 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.755 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.755 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.755 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.755 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.755 INFO:tasks.workunit.client.0.smithi099.stderr: -405> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: _finish_auth 0 2024-03-09T14:46:10.755 INFO:tasks.workunit.client.0.smithi099.stderr: -404> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: _check_auth_tickets 2024-03-09T14:46:10.756 INFO:tasks.workunit.client.0.smithi099.stderr: -403> 2024-03-09T14:46:10.374+0000 7f0471652980 5 monclient: authenticate success, global_id 6656 2024-03-09T14:46:10.756 INFO:tasks.workunit.client.0.smithi099.stderr: -402> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: _renew_subs 2024-03-09T14:46:10.756 INFO:tasks.workunit.client.0.smithi099.stderr: -401> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:46:10.756 INFO:tasks.workunit.client.0.smithi099.stderr: -400> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:46:10.756 INFO:tasks.workunit.client.0.smithi099.stderr: -399> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.756 INFO:tasks.workunit.client.0.smithi099.stderr: -398> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:46:10.756 INFO:tasks.workunit.client.0.smithi099.stderr: -397> 2024-03-09T14:46:10.374+0000 7f035be07640 10 monclient: dump: 2024-03-09T14:46:10.756 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.756 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.756 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.756 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.756 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.756 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.756 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.757 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.757 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.757 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.757 INFO:tasks.workunit.client.0.smithi099.stderr: -396> 2024-03-09T14:46:10.374+0000 7f035d60a640 4 set_mon_vals no callback set 2024-03-09T14:46:10.757 INFO:tasks.workunit.client.0.smithi099.stderr: -395> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: _renew_subs 2024-03-09T14:46:10.757 INFO:tasks.workunit.client.0.smithi099.stderr: -394> 2024-03-09T14:46:10.374+0000 7f0471652980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:46:10.757 INFO:tasks.workunit.client.0.smithi099.stderr: -393> 2024-03-09T14:46:10.374+0000 7f0471652980 1 librados: init done 2024-03-09T14:46:10.757 INFO:tasks.workunit.client.0.smithi099.stderr: -392> 2024-03-09T14:46:10.378+0000 7f035be07640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:46:10.757 INFO:tasks.workunit.client.0.smithi099.stderr: -391> 2024-03-09T14:46:10.378+0000 7f035be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:46:10.757 INFO:tasks.workunit.client.0.smithi099.stderr: -390> 2024-03-09T14:46:10.378+0000 7f035be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:46:10.757 INFO:tasks.workunit.client.0.smithi099.stderr: -389> 2024-03-09T14:46:10.378+0000 7f046e969640 10 monclient: get_auth_request con 0x7f0354066070 auth_method 0 2024-03-09T14:46:10.757 INFO:tasks.workunit.client.0.smithi099.stderr: -388> 2024-03-09T14:46:10.378+0000 7f046f96b640 10 monclient: get_auth_request con 0x55a18c642d60 auth_method 0 2024-03-09T14:46:10.757 INFO:tasks.workunit.client.0.smithi099.stderr: -387> 2024-03-09T14:46:10.378+0000 7f046f16a640 10 monclient: get_auth_request con 0x55a18c64c740 auth_method 0 2024-03-09T14:46:10.757 INFO:tasks.workunit.client.0.smithi099.stderr: -386> 2024-03-09T14:46:10.378+0000 7f046e969640 10 monclient: get_auth_request con 0x55a18c650930 auth_method 0 2024-03-09T14:46:10.757 INFO:tasks.workunit.client.0.smithi099.stderr: -385> 2024-03-09T14:46:10.382+0000 7f046f96b640 10 monclient: get_auth_request con 0x55a18c64ffe0 auth_method 0 2024-03-09T14:46:10.758 INFO:tasks.workunit.client.0.smithi099.stderr: -384> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient: build_initial_monmap 2024-03-09T14:46:10.758 INFO:tasks.workunit.client.0.smithi099.stderr: -383> 2024-03-09T14:46:10.382+0000 7f0471652980 1 build_initial for_mkfs: 0 2024-03-09T14:46:10.758 INFO:tasks.workunit.client.0.smithi099.stderr: -382> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient: monmap: 2024-03-09T14:46:10.758 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:46:10.758 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:46:10.758 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:46:10.758 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:46:10.758 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:46:10.758 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.758 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:46:10.758 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:46:10.758 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:46:10.758 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.758 INFO:tasks.workunit.client.0.smithi099.stderr: -381> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding auth protocol: cephx 2024-03-09T14:46:10.758 INFO:tasks.workunit.client.0.smithi099.stderr: -380> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding auth protocol: cephx 2024-03-09T14:46:10.759 INFO:tasks.workunit.client.0.smithi099.stderr: -379> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding auth protocol: cephx 2024-03-09T14:46:10.759 INFO:tasks.workunit.client.0.smithi099.stderr: -378> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: secure 2024-03-09T14:46:10.759 INFO:tasks.workunit.client.0.smithi099.stderr: -377> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: crc 2024-03-09T14:46:10.759 INFO:tasks.workunit.client.0.smithi099.stderr: -376> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: secure 2024-03-09T14:46:10.759 INFO:tasks.workunit.client.0.smithi099.stderr: -375> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: crc 2024-03-09T14:46:10.759 INFO:tasks.workunit.client.0.smithi099.stderr: -374> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: secure 2024-03-09T14:46:10.759 INFO:tasks.workunit.client.0.smithi099.stderr: -373> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: crc 2024-03-09T14:46:10.759 INFO:tasks.workunit.client.0.smithi099.stderr: -372> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: crc 2024-03-09T14:46:10.759 INFO:tasks.workunit.client.0.smithi099.stderr: -371> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: secure 2024-03-09T14:46:10.759 INFO:tasks.workunit.client.0.smithi099.stderr: -370> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: crc 2024-03-09T14:46:10.759 INFO:tasks.workunit.client.0.smithi099.stderr: -369> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: secure 2024-03-09T14:46:10.759 INFO:tasks.workunit.client.0.smithi099.stderr: -368> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: crc 2024-03-09T14:46:10.759 INFO:tasks.workunit.client.0.smithi099.stderr: -367> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c6588c0) adding con mode: secure 2024-03-09T14:46:10.760 INFO:tasks.workunit.client.0.smithi099.stderr: -366> 2024-03-09T14:46:10.382+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.760 INFO:tasks.workunit.client.0.smithi099.stderr: -365> 2024-03-09T14:46:10.382+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command objecter_requests cmddesc objecter_requests hook 0x55a18c65df20 EEXIST 2024-03-09T14:46:10.760 INFO:tasks.workunit.client.0.smithi099.stderr: -364> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient: init 2024-03-09T14:46:10.760 INFO:tasks.workunit.client.0.smithi099.stderr: -363> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding auth protocol: cephx 2024-03-09T14:46:10.760 INFO:tasks.workunit.client.0.smithi099.stderr: -362> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding auth protocol: cephx 2024-03-09T14:46:10.760 INFO:tasks.workunit.client.0.smithi099.stderr: -361> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding auth protocol: cephx 2024-03-09T14:46:10.760 INFO:tasks.workunit.client.0.smithi099.stderr: -360> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: secure 2024-03-09T14:46:10.760 INFO:tasks.workunit.client.0.smithi099.stderr: -359> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: crc 2024-03-09T14:46:10.760 INFO:tasks.workunit.client.0.smithi099.stderr: -358> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: secure 2024-03-09T14:46:10.760 INFO:tasks.workunit.client.0.smithi099.stderr: -357> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: crc 2024-03-09T14:46:10.760 INFO:tasks.workunit.client.0.smithi099.stderr: -356> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: secure 2024-03-09T14:46:10.760 INFO:tasks.workunit.client.0.smithi099.stderr: -355> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: crc 2024-03-09T14:46:10.760 INFO:tasks.workunit.client.0.smithi099.stderr: -354> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: crc 2024-03-09T14:46:10.760 INFO:tasks.workunit.client.0.smithi099.stderr: -353> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: secure 2024-03-09T14:46:10.760 INFO:tasks.workunit.client.0.smithi099.stderr: -352> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: crc 2024-03-09T14:46:10.761 INFO:tasks.workunit.client.0.smithi099.stderr: -351> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: secure 2024-03-09T14:46:10.761 INFO:tasks.workunit.client.0.smithi099.stderr: -350> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: crc 2024-03-09T14:46:10.761 INFO:tasks.workunit.client.0.smithi099.stderr: -349> 2024-03-09T14:46:10.382+0000 7f0471652980 5 AuthRegistry(0x55a18c657798) adding con mode: secure 2024-03-09T14:46:10.761 INFO:tasks.workunit.client.0.smithi099.stderr: -348> 2024-03-09T14:46:10.382+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.761 INFO:tasks.workunit.client.0.smithi099.stderr: -347> 2024-03-09T14:46:10.382+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.761 INFO:tasks.workunit.client.0.smithi099.stderr: -346> 2024-03-09T14:46:10.382+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command rotate-key cmddesc rotate-key hook 0x55a18c6578e0 EEXIST 2024-03-09T14:46:10.761 INFO:tasks.workunit.client.0.smithi099.stderr: -345> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient: _reopen_session rank -1 2024-03-09T14:46:10.761 INFO:tasks.workunit.client.0.smithi099.stderr: -344> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient: _add_conns ranks=[1,0,2] 2024-03-09T14:46:10.761 INFO:tasks.workunit.client.0.smithi099.stderr: -343> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient(hunting): picked mon.noname-b con 0x55a18c682b80 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:46:10.761 INFO:tasks.workunit.client.0.smithi099.stderr: -342> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient(hunting): picked mon.noname-a con 0x55a18c682f60 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:46:10.761 INFO:tasks.workunit.client.0.smithi099.stderr: -341> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient(hunting): picked mon.noname-c con 0x55a18c67e120 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:46:10.761 INFO:tasks.workunit.client.0.smithi099.stderr: -340> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.761 INFO:tasks.workunit.client.0.smithi099.stderr: -339> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.761 INFO:tasks.workunit.client.0.smithi099.stderr: -338> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.762 INFO:tasks.workunit.client.0.smithi099.stderr: -337> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient(hunting): _renew_subs 2024-03-09T14:46:10.762 INFO:tasks.workunit.client.0.smithi099.stderr: -336> 2024-03-09T14:46:10.382+0000 7f0471652980 10 monclient(hunting): authenticate will time out at 2024.183709s 2024-03-09T14:46:10.762 INFO:tasks.workunit.client.0.smithi099.stderr: -335> 2024-03-09T14:46:10.382+0000 7f046f96b640 10 monclient(hunting): get_auth_request con 0x55a18c682f60 auth_method 0 2024-03-09T14:46:10.762 INFO:tasks.workunit.client.0.smithi099.stderr: -334> 2024-03-09T14:46:10.382+0000 7f046f96b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.762 INFO:tasks.workunit.client.0.smithi099.stderr: -333> 2024-03-09T14:46:10.382+0000 7f046f96b640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.762 INFO:tasks.workunit.client.0.smithi099.stderr: -332> 2024-03-09T14:46:10.382+0000 7f046f96b640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.762 INFO:tasks.workunit.client.0.smithi099.stderr: -331> 2024-03-09T14:46:10.382+0000 7f046f16a640 10 monclient(hunting): get_auth_request con 0x55a18c67e120 auth_method 0 2024-03-09T14:46:10.762 INFO:tasks.workunit.client.0.smithi099.stderr: -330> 2024-03-09T14:46:10.382+0000 7f046f16a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.762 INFO:tasks.workunit.client.0.smithi099.stderr: -329> 2024-03-09T14:46:10.382+0000 7f046f16a640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.762 INFO:tasks.workunit.client.0.smithi099.stderr: -328> 2024-03-09T14:46:10.382+0000 7f046f16a640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.762 INFO:tasks.workunit.client.0.smithi099.stderr: -327> 2024-03-09T14:46:10.382+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:46:10.762 INFO:tasks.workunit.client.0.smithi099.stderr: -326> 2024-03-09T14:46:10.382+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.762 INFO:tasks.workunit.client.0.smithi099.stderr: -325> 2024-03-09T14:46:10.382+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.763 INFO:tasks.workunit.client.0.smithi099.stderr: -324> 2024-03-09T14:46:10.382+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:46:10.763 INFO:tasks.workunit.client.0.smithi099.stderr: -323> 2024-03-09T14:46:10.382+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.763 INFO:tasks.workunit.client.0.smithi099.stderr: -322> 2024-03-09T14:46:10.382+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.763 INFO:tasks.workunit.client.0.smithi099.stderr: -321> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient(hunting): handle_auth_done global_id 6659 payload 824 2024-03-09T14:46:10.763 INFO:tasks.workunit.client.0.smithi099.stderr: -320> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient: _finish_hunting 0 2024-03-09T14:46:10.763 INFO:tasks.workunit.client.0.smithi099.stderr: -319> 2024-03-09T14:46:10.386+0000 7f046f16a640 1 monclient: found mon.noname-c 2024-03-09T14:46:10.763 INFO:tasks.workunit.client.0.smithi099.stderr: -318> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.99:3301/0 2024-03-09T14:46:10.763 INFO:tasks.workunit.client.0.smithi099.stderr: -317> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient: get_auth_request con 0x55a18c682b80 auth_method 0 2024-03-09T14:46:10.763 INFO:tasks.workunit.client.0.smithi099.stderr: -316> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.763 INFO:tasks.workunit.client.0.smithi099.stderr: -315> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-03-09T14:46:10.763 INFO:tasks.workunit.client.0.smithi099.stderr: -314> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: dump: 2024-03-09T14:46:10.763 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.763 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.763 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.763 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.764 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.764 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.764 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.764 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.764 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.764 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.764 INFO:tasks.workunit.client.0.smithi099.stderr: -313> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: _finish_auth 0 2024-03-09T14:46:10.764 INFO:tasks.workunit.client.0.smithi099.stderr: -312> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: _check_auth_tickets 2024-03-09T14:46:10.764 INFO:tasks.workunit.client.0.smithi099.stderr: -311> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:46:10.764 INFO:tasks.workunit.client.0.smithi099.stderr: -310> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.764 INFO:tasks.workunit.client.0.smithi099.stderr: -309> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-03-09T14:46:10.764 INFO:tasks.workunit.client.0.smithi099.stderr: -308> 2024-03-09T14:46:10.386+0000 7f0359602640 10 monclient: dump: 2024-03-09T14:46:10.764 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.764 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.765 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.765 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.765 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.765 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.765 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.765 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.765 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.765 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.765 INFO:tasks.workunit.client.0.smithi099.stderr: -307> 2024-03-09T14:46:10.386+0000 7f0471652980 5 monclient: authenticate success, global_id 6659 2024-03-09T14:46:10.765 INFO:tasks.workunit.client.0.smithi099.stderr: -306> 2024-03-09T14:46:10.386+0000 7f047016c640 4 set_mon_vals no callback set 2024-03-09T14:46:10.765 INFO:tasks.workunit.client.0.smithi099.stderr: -305> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: _renew_subs 2024-03-09T14:46:10.765 INFO:tasks.workunit.client.0.smithi099.stderr: -304> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:46:10.765 INFO:tasks.workunit.client.0.smithi099.stderr: -303> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: _renew_subs 2024-03-09T14:46:10.765 INFO:tasks.workunit.client.0.smithi099.stderr: -302> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: _send_mon_message to mon.c at v2:172.21.15.99:3301/0 2024-03-09T14:46:10.766 INFO:tasks.workunit.client.0.smithi099.stderr: -301> 2024-03-09T14:46:10.386+0000 7f0359602640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:46:10.766 INFO:tasks.workunit.client.0.smithi099.stderr: -300> 2024-03-09T14:46:10.386+0000 7f0359602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:46:10.766 INFO:tasks.workunit.client.0.smithi099.stderr: -299> 2024-03-09T14:46:10.386+0000 7f0359602640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:46:10.766 INFO:tasks.workunit.client.0.smithi099.stderr: -298> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient: get_auth_request con 0x7f0348065f80 auth_method 0 2024-03-09T14:46:10.766 INFO:tasks.workunit.client.0.smithi099.stderr: -297> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: get_monmap_and_config 2024-03-09T14:46:10.766 INFO:tasks.workunit.client.0.smithi099.stderr: -296> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: build_initial_monmap 2024-03-09T14:46:10.766 INFO:tasks.workunit.client.0.smithi099.stderr: -295> 2024-03-09T14:46:10.386+0000 7f0471652980 1 build_initial for_mkfs: 0 2024-03-09T14:46:10.766 INFO:tasks.workunit.client.0.smithi099.stderr: -294> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: monmap: 2024-03-09T14:46:10.766 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:46:10.766 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:46:10.766 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:46:10.766 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:46:10.766 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:46:10.766 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.766 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:46:10.767 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:46:10.767 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:46:10.767 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.767 INFO:tasks.workunit.client.0.smithi099.stderr: -293> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding auth protocol: cephx 2024-03-09T14:46:10.767 INFO:tasks.workunit.client.0.smithi099.stderr: -292> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding auth protocol: cephx 2024-03-09T14:46:10.767 INFO:tasks.workunit.client.0.smithi099.stderr: -291> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding auth protocol: cephx 2024-03-09T14:46:10.767 INFO:tasks.workunit.client.0.smithi099.stderr: -290> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.767 INFO:tasks.workunit.client.0.smithi099.stderr: -289> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.767 INFO:tasks.workunit.client.0.smithi099.stderr: -288> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.767 INFO:tasks.workunit.client.0.smithi099.stderr: -287> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.767 INFO:tasks.workunit.client.0.smithi099.stderr: -286> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.767 INFO:tasks.workunit.client.0.smithi099.stderr: -285> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.767 INFO:tasks.workunit.client.0.smithi099.stderr: -284> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.767 INFO:tasks.workunit.client.0.smithi099.stderr: -283> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.767 INFO:tasks.workunit.client.0.smithi099.stderr: -282> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.768 INFO:tasks.workunit.client.0.smithi099.stderr: -281> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.768 INFO:tasks.workunit.client.0.smithi099.stderr: -280> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.768 INFO:tasks.workunit.client.0.smithi099.stderr: -279> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.768 INFO:tasks.workunit.client.0.smithi099.stderr: -278> 2024-03-09T14:46:10.386+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.768 INFO:tasks.workunit.client.0.smithi099.stderr: -277> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: init 2024-03-09T14:46:10.768 INFO:tasks.workunit.client.0.smithi099.stderr: -276> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding auth protocol: cephx 2024-03-09T14:46:10.768 INFO:tasks.workunit.client.0.smithi099.stderr: -275> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding auth protocol: cephx 2024-03-09T14:46:10.768 INFO:tasks.workunit.client.0.smithi099.stderr: -274> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding auth protocol: cephx 2024-03-09T14:46:10.768 INFO:tasks.workunit.client.0.smithi099.stderr: -273> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: secure 2024-03-09T14:46:10.768 INFO:tasks.workunit.client.0.smithi099.stderr: -272> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: crc 2024-03-09T14:46:10.768 INFO:tasks.workunit.client.0.smithi099.stderr: -271> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: secure 2024-03-09T14:46:10.768 INFO:tasks.workunit.client.0.smithi099.stderr: -270> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: crc 2024-03-09T14:46:10.768 INFO:tasks.workunit.client.0.smithi099.stderr: -269> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: secure 2024-03-09T14:46:10.768 INFO:tasks.workunit.client.0.smithi099.stderr: -268> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: crc 2024-03-09T14:46:10.769 INFO:tasks.workunit.client.0.smithi099.stderr: -267> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: crc 2024-03-09T14:46:10.769 INFO:tasks.workunit.client.0.smithi099.stderr: -266> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: secure 2024-03-09T14:46:10.769 INFO:tasks.workunit.client.0.smithi099.stderr: -265> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: crc 2024-03-09T14:46:10.769 INFO:tasks.workunit.client.0.smithi099.stderr: -264> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: secure 2024-03-09T14:46:10.769 INFO:tasks.workunit.client.0.smithi099.stderr: -263> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: crc 2024-03-09T14:46:10.769 INFO:tasks.workunit.client.0.smithi099.stderr: -262> 2024-03-09T14:46:10.386+0000 7f0471652980 5 AuthRegistry(0x7fffd2451930) adding con mode: secure 2024-03-09T14:46:10.769 INFO:tasks.workunit.client.0.smithi099.stderr: -261> 2024-03-09T14:46:10.386+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.769 INFO:tasks.workunit.client.0.smithi099.stderr: -260> 2024-03-09T14:46:10.386+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.769 INFO:tasks.workunit.client.0.smithi099.stderr: -259> 2024-03-09T14:46:10.386+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command rotate-key cmddesc rotate-key hook 0x7fffd2451a78 EEXIST 2024-03-09T14:46:10.769 INFO:tasks.workunit.client.0.smithi099.stderr: -258> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: _reopen_session rank -1 2024-03-09T14:46:10.769 INFO:tasks.workunit.client.0.smithi099.stderr: -257> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient: _add_conns ranks=[0,1,2] 2024-03-09T14:46:10.769 INFO:tasks.workunit.client.0.smithi099.stderr: -256> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient(hunting): picked mon.noname-a con 0x55a18c6d4c80 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:46:10.769 INFO:tasks.workunit.client.0.smithi099.stderr: -255> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient(hunting): picked mon.noname-b con 0x55a18c6d0200 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:46:10.769 INFO:tasks.workunit.client.0.smithi099.stderr: -254> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient(hunting): picked mon.noname-c con 0x55a18c6c6b00 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:46:10.769 INFO:tasks.workunit.client.0.smithi099.stderr: -253> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.770 INFO:tasks.workunit.client.0.smithi099.stderr: -252> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.770 INFO:tasks.workunit.client.0.smithi099.stderr: -251> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.770 INFO:tasks.workunit.client.0.smithi099.stderr: -250> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient(hunting): _renew_subs 2024-03-09T14:46:10.770 INFO:tasks.workunit.client.0.smithi099.stderr: -249> 2024-03-09T14:46:10.386+0000 7f0471652980 10 monclient(hunting): authenticate will time out at 2024.187595s 2024-03-09T14:46:10.770 INFO:tasks.workunit.client.0.smithi099.stderr: -248> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient(hunting): get_auth_request con 0x55a18c6d4c80 auth_method 0 2024-03-09T14:46:10.770 INFO:tasks.workunit.client.0.smithi099.stderr: -247> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.770 INFO:tasks.workunit.client.0.smithi099.stderr: -246> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.770 INFO:tasks.workunit.client.0.smithi099.stderr: -245> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.770 INFO:tasks.workunit.client.0.smithi099.stderr: -244> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient(hunting): get_auth_request con 0x55a18c6c6b00 auth_method 0 2024-03-09T14:46:10.770 INFO:tasks.workunit.client.0.smithi099.stderr: -243> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.770 INFO:tasks.workunit.client.0.smithi099.stderr: -242> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.770 INFO:tasks.workunit.client.0.smithi099.stderr: -241> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.770 INFO:tasks.workunit.client.0.smithi099.stderr: -240> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:46:10.770 INFO:tasks.workunit.client.0.smithi099.stderr: -239> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.771 INFO:tasks.workunit.client.0.smithi099.stderr: -238> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.771 INFO:tasks.workunit.client.0.smithi099.stderr: -237> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:46:10.771 INFO:tasks.workunit.client.0.smithi099.stderr: -236> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.771 INFO:tasks.workunit.client.0.smithi099.stderr: -235> 2024-03-09T14:46:10.386+0000 7f046f16a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.771 INFO:tasks.workunit.client.0.smithi099.stderr: -234> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient(hunting): handle_auth_done global_id 6960 payload 274 2024-03-09T14:46:10.771 INFO:tasks.workunit.client.0.smithi099.stderr: -233> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient: _finish_hunting 0 2024-03-09T14:46:10.771 INFO:tasks.workunit.client.0.smithi099.stderr: -232> 2024-03-09T14:46:10.386+0000 7f046e969640 1 monclient: found mon.noname-a 2024-03-09T14:46:10.771 INFO:tasks.workunit.client.0.smithi099.stderr: -231> 2024-03-09T14:46:10.386+0000 7f046e969640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:46:10.771 INFO:tasks.workunit.client.0.smithi099.stderr: -230> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.771 INFO:tasks.workunit.client.0.smithi099.stderr: -229> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:46:10.771 INFO:tasks.workunit.client.0.smithi099.stderr: -228> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: dump: 2024-03-09T14:46:10.771 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.771 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.771 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.772 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.772 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.772 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.772 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.772 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.772 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.772 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.772 INFO:tasks.workunit.client.0.smithi099.stderr: -227> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: _finish_auth 0 2024-03-09T14:46:10.772 INFO:tasks.workunit.client.0.smithi099.stderr: -226> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: _check_auth_tickets 2024-03-09T14:46:10.772 INFO:tasks.workunit.client.0.smithi099.stderr: -225> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:46:10.772 INFO:tasks.workunit.client.0.smithi099.stderr: -224> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.772 INFO:tasks.workunit.client.0.smithi099.stderr: -223> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:46:10.772 INFO:tasks.workunit.client.0.smithi099.stderr: -222> 2024-03-09T14:46:10.390+0000 7f0352ffd640 10 monclient: dump: 2024-03-09T14:46:10.773 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.773 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.773 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.773 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.773 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.773 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.773 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.773 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.773 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.773 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.773 INFO:tasks.workunit.client.0.smithi099.stderr: -221> 2024-03-09T14:46:10.390+0000 7f0471652980 5 monclient: authenticate success, global_id 6960 2024-03-09T14:46:10.773 INFO:tasks.workunit.client.0.smithi099.stderr: -220> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: get_monmap_and_config success 2024-03-09T14:46:10.773 INFO:tasks.workunit.client.0.smithi099.stderr: -219> 2024-03-09T14:46:10.390+0000 7f0471652980 4 set_mon_vals no callback set 2024-03-09T14:46:10.773 INFO:tasks.workunit.client.0.smithi099.stderr: -218> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: shutdown 2024-03-09T14:46:10.773 INFO:tasks.workunit.client.0.smithi099.stderr: -217> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: build_initial_monmap 2024-03-09T14:46:10.774 INFO:tasks.workunit.client.0.smithi099.stderr: -216> 2024-03-09T14:46:10.390+0000 7f0471652980 1 build_initial for_mkfs: 0 2024-03-09T14:46:10.774 INFO:tasks.workunit.client.0.smithi099.stderr: -215> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: monmap: 2024-03-09T14:46:10.774 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 0 2024-03-09T14:46:10.774 INFO:tasks.workunit.client.0.smithi099.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-03-09T14:46:10.774 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 0.000000 2024-03-09T14:46:10.774 INFO:tasks.workunit.client.0.smithi099.stderr:created 0.000000 2024-03-09T14:46:10.774 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 0 (unknown) 2024-03-09T14:46:10.774 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.774 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.noname-a 2024-03-09T14:46:10.774 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.noname-b 2024-03-09T14:46:10.774 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.noname-c 2024-03-09T14:46:10.774 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.774 INFO:tasks.workunit.client.0.smithi099.stderr: -214> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding auth protocol: cephx 2024-03-09T14:46:10.775 INFO:tasks.workunit.client.0.smithi099.stderr: -213> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding auth protocol: cephx 2024-03-09T14:46:10.775 INFO:tasks.workunit.client.0.smithi099.stderr: -212> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding auth protocol: cephx 2024-03-09T14:46:10.775 INFO:tasks.workunit.client.0.smithi099.stderr: -211> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.775 INFO:tasks.workunit.client.0.smithi099.stderr: -210> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.775 INFO:tasks.workunit.client.0.smithi099.stderr: -209> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.775 INFO:tasks.workunit.client.0.smithi099.stderr: -208> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.775 INFO:tasks.workunit.client.0.smithi099.stderr: -207> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.775 INFO:tasks.workunit.client.0.smithi099.stderr: -206> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.775 INFO:tasks.workunit.client.0.smithi099.stderr: -205> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.775 INFO:tasks.workunit.client.0.smithi099.stderr: -204> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.775 INFO:tasks.workunit.client.0.smithi099.stderr: -203> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.775 INFO:tasks.workunit.client.0.smithi099.stderr: -202> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.775 INFO:tasks.workunit.client.0.smithi099.stderr: -201> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: crc 2024-03-09T14:46:10.775 INFO:tasks.workunit.client.0.smithi099.stderr: -200> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c6a06d0) adding con mode: secure 2024-03-09T14:46:10.776 INFO:tasks.workunit.client.0.smithi099.stderr: -199> 2024-03-09T14:46:10.390+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.776 INFO:tasks.workunit.client.0.smithi099.stderr: -198> 2024-03-09T14:46:10.390+0000 7f0471652980 1 librados: starting msgr at 2024-03-09T14:46:10.776 INFO:tasks.workunit.client.0.smithi099.stderr: -197> 2024-03-09T14:46:10.390+0000 7f0471652980 1 librados: starting objecter 2024-03-09T14:46:10.776 INFO:tasks.workunit.client.0.smithi099.stderr: -196> 2024-03-09T14:46:10.390+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command objecter_requests cmddesc objecter_requests hook 0x55a18c6cfd20 EEXIST 2024-03-09T14:46:10.776 INFO:tasks.workunit.client.0.smithi099.stderr: -195> 2024-03-09T14:46:10.390+0000 7f0471652980 1 librados: setting wanted keys 2024-03-09T14:46:10.776 INFO:tasks.workunit.client.0.smithi099.stderr: -194> 2024-03-09T14:46:10.390+0000 7f0471652980 1 librados: calling monclient init 2024-03-09T14:46:10.776 INFO:tasks.workunit.client.0.smithi099.stderr: -193> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: init 2024-03-09T14:46:10.776 INFO:tasks.workunit.client.0.smithi099.stderr: -192> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding auth protocol: cephx 2024-03-09T14:46:10.776 INFO:tasks.workunit.client.0.smithi099.stderr: -191> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding auth protocol: cephx 2024-03-09T14:46:10.776 INFO:tasks.workunit.client.0.smithi099.stderr: -190> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding auth protocol: cephx 2024-03-09T14:46:10.776 INFO:tasks.workunit.client.0.smithi099.stderr: -189> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: secure 2024-03-09T14:46:10.776 INFO:tasks.workunit.client.0.smithi099.stderr: -188> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: crc 2024-03-09T14:46:10.776 INFO:tasks.workunit.client.0.smithi099.stderr: -187> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: secure 2024-03-09T14:46:10.777 INFO:tasks.workunit.client.0.smithi099.stderr: -186> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: crc 2024-03-09T14:46:10.777 INFO:tasks.workunit.client.0.smithi099.stderr: -185> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: secure 2024-03-09T14:46:10.777 INFO:tasks.workunit.client.0.smithi099.stderr: -184> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: crc 2024-03-09T14:46:10.777 INFO:tasks.workunit.client.0.smithi099.stderr: -183> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: crc 2024-03-09T14:46:10.777 INFO:tasks.workunit.client.0.smithi099.stderr: -182> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: secure 2024-03-09T14:46:10.777 INFO:tasks.workunit.client.0.smithi099.stderr: -181> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: crc 2024-03-09T14:46:10.777 INFO:tasks.workunit.client.0.smithi099.stderr: -180> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: secure 2024-03-09T14:46:10.777 INFO:tasks.workunit.client.0.smithi099.stderr: -179> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: crc 2024-03-09T14:46:10.777 INFO:tasks.workunit.client.0.smithi099.stderr: -178> 2024-03-09T14:46:10.390+0000 7f0471652980 5 AuthRegistry(0x55a18c69f8a0) adding con mode: secure 2024-03-09T14:46:10.777 INFO:tasks.workunit.client.0.smithi099.stderr: -177> 2024-03-09T14:46:10.390+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.777 INFO:tasks.workunit.client.0.smithi099.stderr: -176> 2024-03-09T14:46:10.390+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.777 INFO:tasks.workunit.client.0.smithi099.stderr: -175> 2024-03-09T14:46:10.390+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command rotate-key cmddesc rotate-key hook 0x55a18c69f9e8 EEXIST 2024-03-09T14:46:10.777 INFO:tasks.workunit.client.0.smithi099.stderr: -174> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: _reopen_session rank -1 2024-03-09T14:46:10.777 INFO:tasks.workunit.client.0.smithi099.stderr: -173> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: _add_conns ranks=[2,0,1] 2024-03-09T14:46:10.778 INFO:tasks.workunit.client.0.smithi099.stderr: -172> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient(hunting): picked mon.noname-c con 0x55a18c6c6b00 addr [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] 2024-03-09T14:46:10.778 INFO:tasks.workunit.client.0.smithi099.stderr: -171> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient(hunting): picked mon.noname-a con 0x55a18c6d0200 addr [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] 2024-03-09T14:46:10.778 INFO:tasks.workunit.client.0.smithi099.stderr: -170> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient(hunting): picked mon.noname-b con 0x55a18c6d4c80 addr [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] 2024-03-09T14:46:10.778 INFO:tasks.workunit.client.0.smithi099.stderr: -169> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.778 INFO:tasks.workunit.client.0.smithi099.stderr: -168> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.778 INFO:tasks.workunit.client.0.smithi099.stderr: -167> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient(hunting): start opening mon connection 2024-03-09T14:46:10.778 INFO:tasks.workunit.client.0.smithi099.stderr: -166> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient(hunting): _renew_subs 2024-03-09T14:46:10.778 INFO:tasks.workunit.client.0.smithi099.stderr: -165> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient(hunting): authenticate will time out at 2024.190144s 2024-03-09T14:46:10.778 INFO:tasks.workunit.client.0.smithi099.stderr: -164> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient(hunting): get_auth_request con 0x55a18c6d0200 auth_method 0 2024-03-09T14:46:10.778 INFO:tasks.workunit.client.0.smithi099.stderr: -163> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.778 INFO:tasks.workunit.client.0.smithi099.stderr: -162> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.778 INFO:tasks.workunit.client.0.smithi099.stderr: -161> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.778 INFO:tasks.workunit.client.0.smithi099.stderr: -160> 2024-03-09T14:46:10.390+0000 7f046e969640 10 monclient(hunting): get_auth_request con 0x55a18c6c6b00 auth_method 0 2024-03-09T14:46:10.778 INFO:tasks.workunit.client.0.smithi099.stderr: -159> 2024-03-09T14:46:10.390+0000 7f046e969640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.779 INFO:tasks.workunit.client.0.smithi099.stderr: -158> 2024-03-09T14:46:10.390+0000 7f046e969640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.779 INFO:tasks.workunit.client.0.smithi099.stderr: -157> 2024-03-09T14:46:10.390+0000 7f046e969640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.779 INFO:tasks.workunit.client.0.smithi099.stderr: -156> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:46:10.779 INFO:tasks.workunit.client.0.smithi099.stderr: -155> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.779 INFO:tasks.workunit.client.0.smithi099.stderr: -154> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.779 INFO:tasks.workunit.client.0.smithi099.stderr: -153> 2024-03-09T14:46:10.390+0000 7f046e969640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-03-09T14:46:10.779 INFO:tasks.workunit.client.0.smithi099.stderr: -152> 2024-03-09T14:46:10.390+0000 7f046e969640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-03-09T14:46:10.779 INFO:tasks.workunit.client.0.smithi099.stderr: -151> 2024-03-09T14:46:10.390+0000 7f046e969640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-03-09T14:46:10.779 INFO:tasks.workunit.client.0.smithi099.stderr: -150> 2024-03-09T14:46:10.390+0000 7f046f16a640 10 monclient(hunting): get_auth_request con 0x55a18c6d4c80 auth_method 0 2024-03-09T14:46:10.779 INFO:tasks.workunit.client.0.smithi099.stderr: -149> 2024-03-09T14:46:10.390+0000 7f046f16a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-03-09T14:46:10.779 INFO:tasks.workunit.client.0.smithi099.stderr: -148> 2024-03-09T14:46:10.390+0000 7f046f16a640 10 monclient(hunting): _init_auth method 2 2024-03-09T14:46:10.779 INFO:tasks.workunit.client.0.smithi099.stderr: -147> 2024-03-09T14:46:10.390+0000 7f046f16a640 10 monclient(hunting): _init_auth creating new auth 2024-03-09T14:46:10.779 INFO:tasks.workunit.client.0.smithi099.stderr: -146> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient(hunting): handle_auth_done global_id 6963 payload 824 2024-03-09T14:46:10.779 INFO:tasks.workunit.client.0.smithi099.stderr: -145> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient: _finish_hunting 0 2024-03-09T14:46:10.779 INFO:tasks.workunit.client.0.smithi099.stderr: -144> 2024-03-09T14:46:10.390+0000 7f046f96b640 1 monclient: found mon.noname-a 2024-03-09T14:46:10.780 INFO:tasks.workunit.client.0.smithi099.stderr: -143> 2024-03-09T14:46:10.390+0000 7f046f96b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.99:3300/0 2024-03-09T14:46:10.780 INFO:tasks.workunit.client.0.smithi099.stderr: -142> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.780 INFO:tasks.workunit.client.0.smithi099.stderr: -141> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-03-09T14:46:10.780 INFO:tasks.workunit.client.0.smithi099.stderr: -140> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: dump: 2024-03-09T14:46:10.780 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.780 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.780 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.780 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.780 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.780 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.780 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.780 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.780 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.780 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.780 INFO:tasks.workunit.client.0.smithi099.stderr: -139> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: _finish_auth 0 2024-03-09T14:46:10.781 INFO:tasks.workunit.client.0.smithi099.stderr: -138> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: _check_auth_tickets 2024-03-09T14:46:10.781 INFO:tasks.workunit.client.0.smithi099.stderr: -137> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: handle_config config(0 keys) v1 2024-03-09T14:46:10.781 INFO:tasks.workunit.client.0.smithi099.stderr: -136> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: handle_monmap mon_map magic: 0 v1 2024-03-09T14:46:10.781 INFO:tasks.workunit.client.0.smithi099.stderr: -135> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-03-09T14:46:10.781 INFO:tasks.workunit.client.0.smithi099.stderr: -134> 2024-03-09T14:46:10.390+0000 7f03517fa640 10 monclient: dump: 2024-03-09T14:46:10.781 INFO:tasks.workunit.client.0.smithi099.stderr:epoch 1 2024-03-09T14:46:10.781 INFO:tasks.workunit.client.0.smithi099.stderr:fsid c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e 2024-03-09T14:46:10.781 INFO:tasks.workunit.client.0.smithi099.stderr:last_changed 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.781 INFO:tasks.workunit.client.0.smithi099.stderr:created 2024-03-09T14:27:43.661675+0000 2024-03-09T14:46:10.781 INFO:tasks.workunit.client.0.smithi099.stderr:min_mon_release 19 (squid) 2024-03-09T14:46:10.781 INFO:tasks.workunit.client.0.smithi099.stderr:election_strategy: 1 2024-03-09T14:46:10.781 INFO:tasks.workunit.client.0.smithi099.stderr:0: [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] mon.a 2024-03-09T14:46:10.781 INFO:tasks.workunit.client.0.smithi099.stderr:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-03-09T14:46:10.781 INFO:tasks.workunit.client.0.smithi099.stderr:2: [v2:172.21.15.99:3301/0,v1:172.21.15.99:6790/0] mon.c 2024-03-09T14:46:10.781 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.781 INFO:tasks.workunit.client.0.smithi099.stderr: -133> 2024-03-09T14:46:10.390+0000 7f0471652980 5 monclient: authenticate success, global_id 6963 2024-03-09T14:46:10.782 INFO:tasks.workunit.client.0.smithi099.stderr: -132> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: _renew_subs 2024-03-09T14:46:10.782 INFO:tasks.workunit.client.0.smithi099.stderr: -131> 2024-03-09T14:46:10.390+0000 7f0352ffd640 4 set_mon_vals no callback set 2024-03-09T14:46:10.782 INFO:tasks.workunit.client.0.smithi099.stderr: -130> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:46:10.782 INFO:tasks.workunit.client.0.smithi099.stderr: -129> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: _renew_subs 2024-03-09T14:46:10.782 INFO:tasks.workunit.client.0.smithi099.stderr: -128> 2024-03-09T14:46:10.390+0000 7f0471652980 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:46:10.782 INFO:tasks.workunit.client.0.smithi099.stderr: -127> 2024-03-09T14:46:10.390+0000 7f0471652980 1 librados: init done 2024-03-09T14:46:10.782 INFO:tasks.workunit.client.0.smithi099.stderr: -126> 2024-03-09T14:46:10.390+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command cr dump hook 0x55a18c6d8eb8 2024-03-09T14:46:10.782 INFO:tasks.workunit.client.0.smithi099.stderr: -125> 2024-03-09T14:46:10.394+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.782 INFO:tasks.workunit.client.0.smithi099.stderr: -124> 2024-03-09T14:46:10.394+0000 7f03517fa640 4 mgrc handle_mgr_map Got map version 5 2024-03-09T14:46:10.782 INFO:tasks.workunit.client.0.smithi099.stderr: -123> 2024-03-09T14:46:10.394+0000 7f03517fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:46:10.782 INFO:tasks.workunit.client.0.smithi099.stderr: -122> 2024-03-09T14:46:10.394+0000 7f03517fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.99:6832/3421029566,v1:172.21.15.99:6833/3421029566] 2024-03-09T14:46:10.782 INFO:tasks.workunit.client.0.smithi099.stderr: -121> 2024-03-09T14:46:10.394+0000 7f046e969640 10 monclient: get_auth_request con 0x7f0338066070 auth_method 0 2024-03-09T14:46:10.782 INFO:tasks.workunit.client.0.smithi099.stderr: -120> 2024-03-09T14:46:10.394+0000 7f046f16a640 10 monclient: get_auth_request con 0x55a18c6eebf0 auth_method 0 2024-03-09T14:46:10.782 INFO:tasks.workunit.client.0.smithi099.stderr: -119> 2024-03-09T14:46:10.394+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.783 INFO:tasks.workunit.client.0.smithi099.stderr: -118> 2024-03-09T14:46:10.394+0000 7f0471652980 20 realm 2024-03-09T14:46:10.783 INFO:tasks.workunit.client.0.smithi099.stderr: -117> 2024-03-09T14:46:10.394+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.783 INFO:tasks.workunit.client.0.smithi099.stderr: -116> 2024-03-09T14:46:10.394+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.783 INFO:tasks.workunit.client.0.smithi099.stderr: -115> 2024-03-09T14:46:10.394+0000 7f0471652980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:10.783 INFO:tasks.workunit.client.0.smithi099.stderr: -114> 2024-03-09T14:46:10.394+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.783 INFO:tasks.workunit.client.0.smithi099.stderr: -113> 2024-03-09T14:46:10.394+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.783 INFO:tasks.workunit.client.0.smithi099.stderr: -112> 2024-03-09T14:46:10.394+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.783 INFO:tasks.workunit.client.0.smithi099.stderr: -111> 2024-03-09T14:46:10.394+0000 7f046e969640 10 monclient: get_auth_request con 0x55a18c6f2dc0 auth_method 0 2024-03-09T14:46:10.783 INFO:tasks.workunit.client.0.smithi099.stderr: -110> 2024-03-09T14:46:10.398+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:10.783 INFO:tasks.workunit.client.0.smithi099.stderr: -109> 2024-03-09T14:46:10.398+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.783 INFO:tasks.workunit.client.0.smithi099.stderr: -108> 2024-03-09T14:46:10.398+0000 7f046f96b640 10 monclient: get_auth_request con 0x55a18c6f6620 auth_method 0 2024-03-09T14:46:10.783 INFO:tasks.workunit.client.0.smithi099.stderr: -107> 2024-03-09T14:46:10.398+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:10.783 INFO:tasks.workunit.client.0.smithi099.stderr: -106> 2024-03-09T14:46:10.398+0000 7f0471652980 20 searching for the correct realm 2024-03-09T14:46:10.783 INFO:tasks.workunit.client.0.smithi099.stderr: -105> 2024-03-09T14:46:10.398+0000 7f046f16a640 10 monclient: get_auth_request con 0x55a18c6fb390 auth_method 0 2024-03-09T14:46:10.783 INFO:tasks.workunit.client.0.smithi099.stderr: -104> 2024-03-09T14:46:10.398+0000 7f046e969640 10 monclient: get_auth_request con 0x7f04600ad2a0 auth_method 0 2024-03-09T14:46:10.783 INFO:tasks.workunit.client.0.smithi099.stderr: -103> 2024-03-09T14:46:10.402+0000 7f046f96b640 10 monclient: get_auth_request con 0x7f0464050040 auth_method 0 2024-03-09T14:46:10.784 INFO:tasks.workunit.client.0.smithi099.stderr: -102> 2024-03-09T14:46:10.402+0000 7f046f96b640 0 -- 172.21.15.99:0/3386213582 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55a18c6f6620 msgr2=0x55a18c6f8a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:10.784 INFO:tasks.workunit.client.0.smithi099.stderr: -101> 2024-03-09T14:46:10.402+0000 7f03517fa640 1 client.6963.objecter ms_handle_reset 0x55a18c6f6620 session 0x55a18c6f2150 osd.4 2024-03-09T14:46:10.784 INFO:tasks.workunit.client.0.smithi099.stderr: -100> 2024-03-09T14:46:10.402+0000 7f03517fa640 10 monclient: _renew_subs 2024-03-09T14:46:10.784 INFO:tasks.workunit.client.0.smithi099.stderr: -99> 2024-03-09T14:46:10.402+0000 7f03517fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.99:3300/0 2024-03-09T14:46:10.784 INFO:tasks.workunit.client.0.smithi099.stderr: -98> 2024-03-09T14:46:10.402+0000 7f046f96b640 10 monclient: get_auth_request con 0x7f0338076690 auth_method 0 2024-03-09T14:46:10.784 INFO:tasks.workunit.client.0.smithi099.stderr: -97> 2024-03-09T14:46:10.406+0000 7f046f16a640 10 monclient: get_auth_request con 0x7f0468064dd0 auth_method 0 2024-03-09T14:46:10.784 INFO:tasks.workunit.client.0.smithi099.stderr: -96> 2024-03-09T14:46:10.410+0000 7f046e969640 10 monclient: get_auth_request con 0x7f046808a590 auth_method 0 2024-03-09T14:46:10.784 INFO:tasks.workunit.client.0.smithi099.stderr: -95> 2024-03-09T14:46:10.410+0000 7f046e969640 0 -- 172.21.15.99:0/3386213582 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f046808a590 msgr2=0x7f04680879f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:46:10.784 INFO:tasks.workunit.client.0.smithi099.stderr: -94> 2024-03-09T14:46:10.614+0000 7f046e969640 10 monclient: get_auth_request con 0x7f046808a590 auth_method 0 2024-03-09T14:46:10.784 INFO:tasks.workunit.client.0.smithi099.stderr: -93> 2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:10.784 INFO:tasks.workunit.client.0.smithi099.stderr: -92> 2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:10.784 INFO:tasks.workunit.client.0.smithi099.stderr: -91> 2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:10.784 INFO:tasks.workunit.client.0.smithi099.stderr: -90> 2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:10.785 INFO:tasks.workunit.client.0.smithi099.stderr: -89> 2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:10.785 INFO:tasks.workunit.client.0.smithi099.stderr: -88> 2024-03-09T14:46:10.626+0000 7f0471652980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:10.785 INFO:tasks.workunit.client.0.smithi099.stderr: -87> 2024-03-09T14:46:10.626+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.785 INFO:tasks.workunit.client.0.smithi099.stderr: -86> 2024-03-09T14:46:10.626+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.785 INFO:tasks.workunit.client.0.smithi099.stderr: -85> 2024-03-09T14:46:10.626+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.785 INFO:tasks.workunit.client.0.smithi099.stderr: -84> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:10.785 INFO:tasks.workunit.client.0.smithi099.stderr: -83> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.785 INFO:tasks.workunit.client.0.smithi099.stderr: -82> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:10.785 INFO:tasks.workunit.client.0.smithi099.stderr: -81> 2024-03-09T14:46:10.630+0000 7f0471652980 20 zone default found 2024-03-09T14:46:10.785 INFO:tasks.workunit.client.0.smithi099.stderr: -80> 2024-03-09T14:46:10.630+0000 7f0471652980 4 Realm: () 2024-03-09T14:46:10.785 INFO:tasks.workunit.client.0.smithi099.stderr: -79> 2024-03-09T14:46:10.630+0000 7f0471652980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:10.785 INFO:tasks.workunit.client.0.smithi099.stderr: -78> 2024-03-09T14:46:10.630+0000 7f0471652980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:10.785 INFO:tasks.workunit.client.0.smithi099.stderr: -77> 2024-03-09T14:46:10.630+0000 7f0471652980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:10.785 INFO:tasks.workunit.client.0.smithi099.stderr: -76> 2024-03-09T14:46:10.630+0000 7f0471652980 20 zonegroup default 2024-03-09T14:46:10.785 INFO:tasks.workunit.client.0.smithi099.stderr: -75> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.786 INFO:tasks.workunit.client.0.smithi099.stderr: -74> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.786 INFO:tasks.workunit.client.0.smithi099.stderr: -73> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.786 INFO:tasks.workunit.client.0.smithi099.stderr: -72> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.786 INFO:tasks.workunit.client.0.smithi099.stderr: -71> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.786 INFO:tasks.workunit.client.0.smithi099.stderr: -70> 2024-03-09T14:46:10.630+0000 7f0471652980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.786 INFO:tasks.workunit.client.0.smithi099.stderr: -69> 2024-03-09T14:46:10.630+0000 7f0471652980 20 started sync module instance, tier type = 2024-03-09T14:46:10.786 INFO:tasks.workunit.client.0.smithi099.stderr: -68> 2024-03-09T14:46:10.630+0000 7f0471652980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:10.786 INFO:tasks.workunit.client.0.smithi099.stderr: -67> 2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=0 2024-03-09T14:46:10.786 INFO:tasks.workunit.client.0.smithi099.stderr: -66> 2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=1 2024-03-09T14:46:10.786 INFO:tasks.workunit.client.0.smithi099.stderr: -65> 2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=2 2024-03-09T14:46:10.786 INFO:tasks.workunit.client.0.smithi099.stderr: -64> 2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=3 2024-03-09T14:46:10.786 INFO:tasks.workunit.client.0.smithi099.stderr: -63> 2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=4 2024-03-09T14:46:10.786 INFO:tasks.workunit.client.0.smithi099.stderr: -62> 2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=5 2024-03-09T14:46:10.786 INFO:tasks.workunit.client.0.smithi099.stderr: -61> 2024-03-09T14:46:10.654+0000 7f0471652980 20 add_watcher() i=6 2024-03-09T14:46:10.786 INFO:tasks.workunit.client.0.smithi099.stderr: -60> 2024-03-09T14:46:10.658+0000 7f0471652980 20 add_watcher() i=7 2024-03-09T14:46:10.787 INFO:tasks.workunit.client.0.smithi099.stderr: -59> 2024-03-09T14:46:10.658+0000 7f0471652980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:10.787 INFO:tasks.workunit.client.0.smithi099.stderr: -58> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding auth protocol: cephx 2024-03-09T14:46:10.787 INFO:tasks.workunit.client.0.smithi099.stderr: -57> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding auth protocol: cephx 2024-03-09T14:46:10.787 INFO:tasks.workunit.client.0.smithi099.stderr: -56> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding auth protocol: cephx 2024-03-09T14:46:10.787 INFO:tasks.workunit.client.0.smithi099.stderr: -55> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: secure 2024-03-09T14:46:10.787 INFO:tasks.workunit.client.0.smithi099.stderr: -54> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: crc 2024-03-09T14:46:10.787 INFO:tasks.workunit.client.0.smithi099.stderr: -53> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: secure 2024-03-09T14:46:10.787 INFO:tasks.workunit.client.0.smithi099.stderr: -52> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: crc 2024-03-09T14:46:10.787 INFO:tasks.workunit.client.0.smithi099.stderr: -51> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: secure 2024-03-09T14:46:10.787 INFO:tasks.workunit.client.0.smithi099.stderr: -50> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: crc 2024-03-09T14:46:10.787 INFO:tasks.workunit.client.0.smithi099.stderr: -49> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: crc 2024-03-09T14:46:10.787 INFO:tasks.workunit.client.0.smithi099.stderr: -48> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: secure 2024-03-09T14:46:10.787 INFO:tasks.workunit.client.0.smithi099.stderr: -47> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: crc 2024-03-09T14:46:10.787 INFO:tasks.workunit.client.0.smithi099.stderr: -46> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: secure 2024-03-09T14:46:10.787 INFO:tasks.workunit.client.0.smithi099.stderr: -45> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: crc 2024-03-09T14:46:10.787 INFO:tasks.workunit.client.0.smithi099.stderr: -44> 2024-03-09T14:46:10.662+0000 7f0471652980 5 AuthRegistry(0x7fffd2451dc0) adding con mode: secure 2024-03-09T14:46:10.788 INFO:tasks.workunit.client.0.smithi099.stderr: -43> 2024-03-09T14:46:10.662+0000 7f0325fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:10.788 INFO:tasks.workunit.client.0.smithi099.stderr: -42> 2024-03-09T14:46:10.662+0000 7f0471652980 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-03-09T14:46:10.788 INFO:tasks.workunit.client.0.smithi099.stderr: -41> 2024-03-09T14:46:10.662+0000 7f0471652980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:10.788 INFO:tasks.workunit.client.0.smithi099.stderr: -40> 2024-03-09T14:46:10.662+0000 7f0471652980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:10.788 INFO:tasks.workunit.client.0.smithi099.stderr: -39> 2024-03-09T14:46:10.662+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command cache list hook 0x55a18c6d9400 2024-03-09T14:46:10.788 INFO:tasks.workunit.client.0.smithi099.stderr: -38> 2024-03-09T14:46:10.662+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command cache inspect hook 0x55a18c6d9400 2024-03-09T14:46:10.788 INFO:tasks.workunit.client.0.smithi099.stderr: -37> 2024-03-09T14:46:10.662+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command cache erase hook 0x55a18c6d9400 2024-03-09T14:46:10.788 INFO:tasks.workunit.client.0.smithi099.stderr: -36> 2024-03-09T14:46:10.662+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command cache zap hook 0x55a18c6d9400 2024-03-09T14:46:10.788 INFO:tasks.workunit.client.0.smithi099.stderr: -35> 2024-03-09T14:46:10.662+0000 7f0471652980 5 note: GC not initialized 2024-03-09T14:46:10.788 INFO:tasks.workunit.client.0.smithi099.stderr: -34> 2024-03-09T14:46:10.662+0000 7f0324fe1640 20 reqs_thread_entry: start 2024-03-09T14:46:10.788 INFO:tasks.workunit.client.0.smithi099.stderr: -33> 2024-03-09T14:46:10.662+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command sync trace show hook 0x7f04600043b0 2024-03-09T14:46:10.788 INFO:tasks.workunit.client.0.smithi099.stderr: -32> 2024-03-09T14:46:10.662+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command sync trace history hook 0x7f04600043b0 2024-03-09T14:46:10.788 INFO:tasks.workunit.client.0.smithi099.stderr: -31> 2024-03-09T14:46:10.662+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command sync trace active hook 0x7f04600043b0 2024-03-09T14:46:10.788 INFO:tasks.workunit.client.0.smithi099.stderr: -30> 2024-03-09T14:46:10.662+0000 7f0471652980 5 asok(0x55a18c3f3bb0) register_command sync trace active_short hook 0x7f04600043b0 2024-03-09T14:46:10.788 INFO:tasks.workunit.client.0.smithi099.stderr: -29> 2024-03-09T14:46:10.662+0000 7f0471652980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:10.789 INFO:tasks.workunit.client.0.smithi099.stderr: -28> 2024-03-09T14:46:10.662+0000 7f0471652980 20 Filter name: none 2024-03-09T14:46:10.789 INFO:tasks.workunit.client.0.smithi099.stderr: -27> 2024-03-09T14:46:10.662+0000 7f029e7fc640 20 reqs_thread_entry: start 2024-03-09T14:46:10.789 INFO:tasks.workunit.client.0.smithi099.stderr: -26> 2024-03-09T14:46:10.662+0000 7f0471652980 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-09T14:46:10.789 INFO:tasks.workunit.client.0.smithi099.stderr: -25> 2024-03-09T14:46:10.662+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.789 INFO:tasks.workunit.client.0.smithi099.stderr: -24> 2024-03-09T14:46:10.666+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:10.789 INFO:tasks.workunit.client.0.smithi099.stderr: -23> 2024-03-09T14:46:10.666+0000 7f0471652980 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-09T14:46:10.789 INFO:tasks.workunit.client.0.smithi099.stderr: -22> 2024-03-09T14:46:10.666+0000 7f0471652980 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-09T14:46:10.789 INFO:tasks.workunit.client.0.smithi099.stderr: -21> 2024-03-09T14:46:10.666+0000 7f0471652980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 : miss 2024-03-09T14:46:10.789 INFO:tasks.workunit.client.0.smithi099.stderr: -20> 2024-03-09T14:46:10.666+0000 7f0471652980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.789 INFO:tasks.workunit.client.0.smithi099.stderr: -19> 2024-03-09T14:46:10.666+0000 7f0471652980 20 rados_obj.operate() r=0 bl.length=425 2024-03-09T14:46:10.789 INFO:tasks.workunit.client.0.smithi099.stderr: -18> 2024-03-09T14:46:10.666+0000 7f0471652980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 info.flags=0x17 2024-03-09T14:46:10.789 INFO:tasks.workunit.client.0.smithi099.stderr: -17> 2024-03-09T14:46:10.666+0000 7f0471652980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 to cache LRU end 2024-03-09T14:46:10.789 INFO:tasks.workunit.client.0.smithi099.stderr: -16> 2024-03-09T14:46:10.666+0000 7f0471652980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:46:10.789 INFO:tasks.workunit.client.0.smithi099.stderr: -15> 2024-03-09T14:46:10.666+0000 7f0471652980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:10.789 INFO:tasks.workunit.client.0.smithi099.stderr: -14> 2024-03-09T14:46:10.666+0000 7f0471652980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 2024-03-09T14:46:10.790 INFO:tasks.workunit.client.0.smithi099.stderr: -13> 2024-03-09T14:46:10.678+0000 7f0471652980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 info.flags=0x17 2024-03-09T14:46:10.790 INFO:tasks.workunit.client.0.smithi099.stderr: -12> 2024-03-09T14:46:10.678+0000 7f0471652980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 to cache LRU end 2024-03-09T14:46:10.790 INFO:tasks.workunit.client.0.smithi099.stderr: -11> 2024-03-09T14:46:10.678+0000 7f0471652980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:10.790 INFO:tasks.workunit.client.0.smithi099.stderr: -10> 2024-03-09T14:46:10.678+0000 7f0471652980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29, ofs0, ns] 2024-03-09T14:46:10.790 INFO:tasks.workunit.client.0.smithi099.stderr: -9> 2024-03-09T14:46:10.678+0000 7f0352ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464261 cookie 94152334256304 notifier 6963 bl.length()=987 2024-03-09T14:46:10.790 INFO:tasks.workunit.client.0.smithi099.stderr: -8> 2024-03-09T14:46:10.678+0000 7f0352ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 info.flags=0x17 2024-03-09T14:46:10.790 INFO:tasks.workunit.client.0.smithi099.stderr: -7> 2024-03-09T14:46:10.678+0000 7f0352ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 to cache LRU end 2024-03-09T14:46:10.790 INFO:tasks.workunit.client.0.smithi099.stderr: -6> 2024-03-09T14:46:10.678+0000 7f0352ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:10.790 INFO:tasks.workunit.client.0.smithi099.stderr: -5> 2024-03-09T14:46:10.678+0000 7f0471652980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): orig_sources= new_sources= 2024-03-09T14:46:10.790 INFO:tasks.workunit.client.0.smithi099.stderr: -4> 2024-03-09T14:46:10.678+0000 7f0471652980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): potential sources added=[] removed=[] 2024-03-09T14:46:10.790 INFO:tasks.workunit.client.0.smithi099.stderr: -3> 2024-03-09T14:46:10.678+0000 7f0471652980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): orig_dests= new_dests= 2024-03-09T14:46:10.790 INFO:tasks.workunit.client.0.smithi099.stderr: -2> 2024-03-09T14:46:10.678+0000 7f0471652980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): potential dests added=[] removed=[] 2024-03-09T14:46:10.790 INFO:tasks.workunit.client.0.smithi099.stderr: -1> 2024-03-09T14:46:10.682+0000 7f0471652980 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0471652980 time 2024-03-09T14:46:10.684534+0000 2024-03-09T14:46:10.791 INFO:tasks.workunit.client.0.smithi099.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-03-09T14:46:10.791 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.791 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:46:10.791 INFO:tasks.workunit.client.0.smithi099.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0474f27d7b] 2024-03-09T14:46:10.791 INFO:tasks.workunit.client.0.smithi099.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f0474f27f2f] 2024-03-09T14:46:10.791 INFO:tasks.workunit.client.0.smithi099.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a18aa93c51] 2024-03-09T14:46:10.791 INFO:tasks.workunit.client.0.smithi099.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x315) [0x55a18aab42f5] 2024-03-09T14:46:10.791 INFO:tasks.workunit.client.0.smithi099.stderr: 5: main() 2024-03-09T14:46:10.791 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0473d92d90] 2024-03-09T14:46:10.791 INFO:tasks.workunit.client.0.smithi099.stderr: 7: __libc_start_main() 2024-03-09T14:46:10.791 INFO:tasks.workunit.client.0.smithi099.stderr: 8: _start() 2024-03-09T14:46:10.791 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.791 INFO:tasks.workunit.client.0.smithi099.stderr: 0> 2024-03-09T14:46:10.682+0000 7f0471652980 -1 *** Caught signal (Aborted) ** 2024-03-09T14:46:10.791 INFO:tasks.workunit.client.0.smithi099.stderr: in thread 7f0471652980 thread_name:radosgw-admin 2024-03-09T14:46:10.791 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.792 INFO:tasks.workunit.client.0.smithi099.stderr: ceph version 19.0.0-2079-gc00d9c60 (c00d9c609fb42a2a25f1c196bed064ca8bb02413) squid (dev) 2024-03-09T14:46:10.792 INFO:tasks.workunit.client.0.smithi099.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0473dab520] 2024-03-09T14:46:10.792 INFO:tasks.workunit.client.0.smithi099.stderr: 2: pthread_kill() 2024-03-09T14:46:10.792 INFO:tasks.workunit.client.0.smithi099.stderr: 3: raise() 2024-03-09T14:46:10.792 INFO:tasks.workunit.client.0.smithi099.stderr: 4: abort() 2024-03-09T14:46:10.792 INFO:tasks.workunit.client.0.smithi099.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0474f27dd5] 2024-03-09T14:46:10.792 INFO:tasks.workunit.client.0.smithi099.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x180f2f) [0x7f0474f27f2f] 2024-03-09T14:46:10.792 INFO:tasks.workunit.client.0.smithi099.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a18aa93c51] 2024-03-09T14:46:10.792 INFO:tasks.workunit.client.0.smithi099.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x315) [0x55a18aab42f5] 2024-03-09T14:46:10.792 INFO:tasks.workunit.client.0.smithi099.stderr: 9: main() 2024-03-09T14:46:10.792 INFO:tasks.workunit.client.0.smithi099.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0473d92d90] 2024-03-09T14:46:10.792 INFO:tasks.workunit.client.0.smithi099.stderr: 11: __libc_start_main() 2024-03-09T14:46:10.792 INFO:tasks.workunit.client.0.smithi099.stderr: 12: _start() 2024-03-09T14:46:10.792 INFO:tasks.workunit.client.0.smithi099.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-03-09T14:46:10.792 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:10.793 INFO:tasks.workunit.client.0.smithi099.stderr:--- logging levels --- 2024-03-09T14:46:10.793 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 none 2024-03-09T14:46:10.793 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 lockdep 2024-03-09T14:46:10.793 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 context 2024-03-09T14:46:10.793 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 crush 2024-03-09T14:46:10.793 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds 2024-03-09T14:46:10.793 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_balancer 2024-03-09T14:46:10.793 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_locker 2024-03-09T14:46:10.793 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log 2024-03-09T14:46:10.793 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_log_expire 2024-03-09T14:46:10.793 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mds_migrator 2024-03-09T14:46:10.793 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 buffer 2024-03-09T14:46:10.793 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 timer 2024-03-09T14:46:10.793 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 filer 2024-03-09T14:46:10.793 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 striper 2024-03-09T14:46:10.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 1 objecter 2024-03-09T14:46:10.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rados 2024-03-09T14:46:10.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd 2024-03-09T14:46:10.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_mirror 2024-03-09T14:46:10.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_replay 2024-03-09T14:46:10.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 rbd_pwl 2024-03-09T14:46:10.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 journaler 2024-03-09T14:46:10.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objectcacher 2024-03-09T14:46:10.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 immutable_obj_cache 2024-03-09T14:46:10.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 client 2024-03-09T14:46:10.794 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 osd 2024-03-09T14:46:10.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 optracker 2024-03-09T14:46:10.794 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 objclass 2024-03-09T14:46:10.794 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 filestore 2024-03-09T14:46:10.794 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 journal 2024-03-09T14:46:10.795 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 ms 2024-03-09T14:46:10.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mon 2024-03-09T14:46:10.795 INFO:tasks.workunit.client.0.smithi099.stderr: 0/10 monc 2024-03-09T14:46:10.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 paxos 2024-03-09T14:46:10.795 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 tp 2024-03-09T14:46:10.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 auth 2024-03-09T14:46:10.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 crypto 2024-03-09T14:46:10.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 finisher 2024-03-09T14:46:10.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 reserver 2024-03-09T14:46:10.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 heartbeatmap 2024-03-09T14:46:10.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 perfcounter 2024-03-09T14:46:10.795 INFO:tasks.workunit.client.0.smithi099.stderr: 20/20 rgw 2024-03-09T14:46:10.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_sync 2024-03-09T14:46:10.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_datacache 2024-03-09T14:46:10.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_access 2024-03-09T14:46:10.795 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_dbstore 2024-03-09T14:46:10.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_flight 2024-03-09T14:46:10.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 rgw_lifecycle 2024-03-09T14:46:10.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 javaclient 2024-03-09T14:46:10.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 asok 2024-03-09T14:46:10.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 1 throttle 2024-03-09T14:46:10.796 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 0 refs 2024-03-09T14:46:10.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 compressor 2024-03-09T14:46:10.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluestore 2024-03-09T14:46:10.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 bluefs 2024-03-09T14:46:10.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 3 bdev 2024-03-09T14:46:10.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 kstore 2024-03-09T14:46:10.796 INFO:tasks.workunit.client.0.smithi099.stderr: 4/ 5 rocksdb 2024-03-09T14:46:10.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 fuse 2024-03-09T14:46:10.796 INFO:tasks.workunit.client.0.smithi099.stderr: 2/ 5 mgr 2024-03-09T14:46:10.796 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mgrc 2024-03-09T14:46:10.797 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 dpdk 2024-03-09T14:46:10.797 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 eventtrace 2024-03-09T14:46:10.797 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 prioritycache 2024-03-09T14:46:10.797 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 test 2024-03-09T14:46:10.797 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephfs_mirror 2024-03-09T14:46:10.797 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cephsqlite 2024-03-09T14:46:10.797 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 crimson_interrupt 2024-03-09T14:46:10.797 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore 2024-03-09T14:46:10.797 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_onode 2024-03-09T14:46:10.797 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_odata 2024-03-09T14:46:10.797 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_omap 2024-03-09T14:46:10.797 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_tm 2024-03-09T14:46:10.797 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_t 2024-03-09T14:46:10.797 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cleaner 2024-03-09T14:46:10.797 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_epm 2024-03-09T14:46:10.798 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_lba 2024-03-09T14:46:10.798 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_fixedkv_tree 2024-03-09T14:46:10.798 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_cache 2024-03-09T14:46:10.798 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_journal 2024-03-09T14:46:10.798 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_device 2024-03-09T14:46:10.798 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 seastore_backref 2024-03-09T14:46:10.798 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 alienstore 2024-03-09T14:46:10.798 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 mclock 2024-03-09T14:46:10.798 INFO:tasks.workunit.client.0.smithi099.stderr: 0/ 5 cyanstore 2024-03-09T14:46:10.798 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 ceph_exporter 2024-03-09T14:46:10.798 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 memstore 2024-03-09T14:46:10.798 INFO:tasks.workunit.client.0.smithi099.stderr: 1/ 5 trace 2024-03-09T14:46:10.798 INFO:tasks.workunit.client.0.smithi099.stderr: -2/-2 (syslog threshold) 2024-03-09T14:46:10.798 INFO:tasks.workunit.client.0.smithi099.stderr: 99/99 (stderr threshold) 2024-03-09T14:46:10.798 INFO:tasks.workunit.client.0.smithi099.stderr:--- pthread ID / name mapping for recent threads --- 2024-03-09T14:46:10.799 INFO:tasks.workunit.client.0.smithi099.stderr: 7f029e7fc640 / http_manager 2024-03-09T14:46:10.799 INFO:tasks.workunit.client.0.smithi099.stderr: 7f0324fe1640 / http_manager 2024-03-09T14:46:10.799 INFO:tasks.workunit.client.0.smithi099.stderr: 7f0325fe3640 / rgw_dt_lg_renew 2024-03-09T14:46:10.799 INFO:tasks.workunit.client.0.smithi099.stderr: 7f03517fa640 / ms_dispatch 2024-03-09T14:46:10.799 INFO:tasks.workunit.client.0.smithi099.stderr: 7f0352ffd640 / io_context_pool 2024-03-09T14:46:10.799 INFO:tasks.workunit.client.0.smithi099.stderr: 7f0359602640 / ms_dispatch 2024-03-09T14:46:10.799 INFO:tasks.workunit.client.0.smithi099.stderr: 7f035be07640 / ms_dispatch 2024-03-09T14:46:10.799 INFO:tasks.workunit.client.0.smithi099.stderr: 7f035d60a640 / io_context_pool 2024-03-09T14:46:10.799 INFO:tasks.workunit.client.0.smithi099.stderr: 7f046e969640 / msgr-worker-2 2024-03-09T14:46:10.799 INFO:tasks.workunit.client.0.smithi099.stderr: 7f046f16a640 / msgr-worker-1 2024-03-09T14:46:10.799 INFO:tasks.workunit.client.0.smithi099.stderr: 7f046f96b640 / msgr-worker-0 2024-03-09T14:46:10.799 INFO:tasks.workunit.client.0.smithi099.stderr: 7f047016c640 / io_context_pool 2024-03-09T14:46:10.799 INFO:tasks.workunit.client.0.smithi099.stderr: 7f0471652980 / radosgw-admin 2024-03-09T14:46:10.800 INFO:tasks.workunit.client.0.smithi099.stderr: max_recent 500 2024-03-09T14:46:10.800 INFO:tasks.workunit.client.0.smithi099.stderr: max_new 1000 2024-03-09T14:46:10.800 INFO:tasks.workunit.client.0.smithi099.stderr: log_file /var/lib/ceph/crash/2024-03-09T14:46:10.686472Z_fb7cdc99-9dd6-4fd7-af1b-4f8396162a37/log 2024-03-09T14:46:10.800 INFO:tasks.workunit.client.0.smithi099.stderr:--- end dump of recent events --- 2024-03-09T14:46:10.801 INFO:tasks.workunit.client.0.smithi099.stderr:Aborted 2024-03-09T14:46:10.802 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-03-09T14:46:10.802 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:10.802 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:10.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.770+0000 7fcbc2f56980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.770+0000 7fcbc2f56980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.770+0000 7fcbc2f56980 20 realm 2024-03-09T14:46:10.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.770+0000 7fcbc2f56980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.770+0000 7fcbc2f56980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.770+0000 7fcbc2f56980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:10.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.770+0000 7fcbc2f56980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.770+0000 7fcbc2f56980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:10.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.770+0000 7fcbc2f56980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.774+0000 7fcbc2f56980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:10.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.774+0000 7fcbc2f56980 20 rados->read ofs=0 len=0 2024-03-09T14:46:10.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.774+0000 7fcbc2f56980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:10.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.774+0000 7fcbc2f56980 20 searching for the correct realm 2024-03-09T14:46:10.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.778+0000 7fcbc126f640 0 -- 172.21.15.99:0/623417433 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7fcbb40e9040 msgr2=0x7fcbb40c2440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:10.987 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:10.994+0000 7fcbc026d640 0 -- 172.21.15.99:0/623417433 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fcbb806d000 msgr2=0x7fcbb800a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:11.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.210+0000 7fcbc2f56980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:11.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.210+0000 7fcbc2f56980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:11.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.210+0000 7fcbc2f56980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:11.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.210+0000 7fcbc2f56980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:11.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.210+0000 7fcbc2f56980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:11.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.210+0000 7fcbc2f56980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:11.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.210+0000 7fcbc2f56980 20 rados->read ofs=0 len=0 2024-03-09T14:46:11.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.210+0000 7fcbc2f56980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:11.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.210+0000 7fcbc2f56980 20 rados->read ofs=0 len=0 2024-03-09T14:46:11.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.214+0000 7fcbc2f56980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:11.206 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.214+0000 7fcbc2f56980 20 rados->read ofs=0 len=0 2024-03-09T14:46:11.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.214+0000 7fcbc2f56980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:11.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.214+0000 7fcbc2f56980 20 zone default found 2024-03-09T14:46:11.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.214+0000 7fcbc2f56980 4 Realm: () 2024-03-09T14:46:11.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.214+0000 7fcbc2f56980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:11.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.214+0000 7fcbc2f56980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:11.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.214+0000 7fcbc2f56980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:11.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.214+0000 7fcbc2f56980 20 zonegroup default 2024-03-09T14:46:11.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.214+0000 7fcbc2f56980 20 rados->read ofs=0 len=0 2024-03-09T14:46:11.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.214+0000 7fcbc2f56980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:11.208 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.214+0000 7fcbc2f56980 20 rados->read ofs=0 len=0 2024-03-09T14:46:11.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.214+0000 7fcbc2f56980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:11.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.214+0000 7fcbc2f56980 20 rados->read ofs=0 len=0 2024-03-09T14:46:11.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.214+0000 7fcbc2f56980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:11.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.214+0000 7fcbc2f56980 20 started sync module instance, tier type = 2024-03-09T14:46:11.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.214+0000 7fcbc2f56980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:11.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.238+0000 7fcbc2f56980 20 add_watcher() i=0 2024-03-09T14:46:11.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.238+0000 7fcbc2f56980 20 add_watcher() i=1 2024-03-09T14:46:11.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.238+0000 7fcbc2f56980 20 add_watcher() i=2 2024-03-09T14:46:11.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.238+0000 7fcbc2f56980 20 add_watcher() i=3 2024-03-09T14:46:11.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.238+0000 7fcbc2f56980 20 add_watcher() i=4 2024-03-09T14:46:11.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.238+0000 7fcbc2f56980 20 add_watcher() i=5 2024-03-09T14:46:11.234 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.238+0000 7fcbc2f56980 20 add_watcher() i=6 2024-03-09T14:46:11.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.242+0000 7fcbc2f56980 20 add_watcher() i=7 2024-03-09T14:46:11.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.242+0000 7fcbc2f56980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:11.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.246+0000 7fca76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:11.240 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.246+0000 7fcbc2f56980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:11.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.246+0000 7fcbc2f56980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:11.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.246+0000 7fcbc2f56980 5 note: GC not initialized 2024-03-09T14:46:11.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.246+0000 7fca75fe3640 20 reqs_thread_entry: start 2024-03-09T14:46:11.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.246+0000 7fcbc2f56980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:11.241 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.246+0000 7fcbc2f56980 20 Filter name: none 2024-03-09T14:46:11.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.246+0000 7fc9e77fe640 20 reqs_thread_entry: start 2024-03-09T14:46:11.242 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.250+0000 7fcbc2f56980 20 rados->read ofs=0 len=0 2024-03-09T14:46:11.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.250+0000 7fcbc2f56980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:11.243 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.250+0000 7fcbc2f56980 20 rados->read ofs=0 len=0 2024-03-09T14:46:11.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.250+0000 7fcbc2f56980 20 rados_obj.operate() r=0 bl.length=457 2024-03-09T14:46:11.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.250+0000 7fcbc2f56980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:11.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.250+0000 7fcbc2f56980 20 rados->read ofs=0 len=0 2024-03-09T14:46:11.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.250+0000 7fcbc2f56980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:11.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.250+0000 7fcbc2f56980 20 rados->read ofs=0 len=0 2024-03-09T14:46:11.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.250+0000 7fcbc2f56980 20 rados_obj.operate() r=0 bl.length=457 2024-03-09T14:46:11.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.250+0000 7fcbc2f56980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:11.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.254+0000 7fcbc2f56980 20 rados->read ofs=0 len=0 2024-03-09T14:46:11.248 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.254+0000 7fcbc2f56980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:11.249 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.254+0000 7fca76fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:11.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.262+0000 7fcbc2f56980 20 remove_watcher() i=0 2024-03-09T14:46:11.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.262+0000 7fcbc2f56980 2 removed watcher, disabling cache 2024-03-09T14:46:11.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.262+0000 7fcbc2f56980 20 remove_watcher() i=1 2024-03-09T14:46:11.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.266+0000 7fcbc2f56980 20 remove_watcher() i=2 2024-03-09T14:46:11.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.266+0000 7fcbc2f56980 20 remove_watcher() i=3 2024-03-09T14:46:11.263 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.270+0000 7fcbc2f56980 20 remove_watcher() i=4 2024-03-09T14:46:11.265 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.270+0000 7fcbc2f56980 20 remove_watcher() i=5 2024-03-09T14:46:11.266 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.274+0000 7fcbc2f56980 20 remove_watcher() i=6 2024-03-09T14:46:11.268 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:11.274+0000 7fcbc2f56980 20 remove_watcher() i=7 2024-03-09T14:46:11.282 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:11.282 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:46:11.282 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-do-reshard id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-03-09T14:46:11.282 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:11.284 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:11.284 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:41.358 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:41.359 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:41.403 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-03-09T14:46:41.438 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:41.439 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:41.486 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.493+0000 7f96cb97d980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.493+0000 7f96cb97d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:41.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.493+0000 7f96cb97d980 20 realm 2024-03-09T14:46:41.488 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.493+0000 7f96cb97d980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.493+0000 7f96cb97d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:41.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.493+0000 7f96cb97d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:41.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.493+0000 7f96cb97d980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.493+0000 7f96cb97d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:41.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.493+0000 7f96cb97d980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.497+0000 7f96cb97d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:41.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.497+0000 7f96cb97d980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.497+0000 7f96cb97d980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:41.492 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.497+0000 7f96cb97d980 20 searching for the correct realm 2024-03-09T14:46:41.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.501+0000 7f96c9c96640 0 -- 172.21.15.99:0/2748306381 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f96c000e040 msgr2=0x7f96c005e8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:41.503 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.509+0000 7f96c8c94640 0 -- 172.21.15.99:0/2748306381 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f96c4017020 msgr2=0x7f96c40665d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:46:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.725+0000 7f96cb97d980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:41.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.725+0000 7f96cb97d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:41.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.725+0000 7f96cb97d980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:41.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.725+0000 7f96cb97d980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:41.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.725+0000 7f96cb97d980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:41.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.725+0000 7f96cb97d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:41.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.725+0000 7f96cb97d980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.725+0000 7f96cb97d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:41.721 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.725+0000 7f96cb97d980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.725+0000 7f96cb97d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:41.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.725+0000 7f96cb97d980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.729+0000 7f96cb97d980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:41.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.729+0000 7f96cb97d980 20 zone default found 2024-03-09T14:46:41.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.729+0000 7f96cb97d980 4 Realm: () 2024-03-09T14:46:41.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.729+0000 7f96cb97d980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:41.722 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.729+0000 7f96cb97d980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:41.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.729+0000 7f96cb97d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:41.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.729+0000 7f96cb97d980 20 zonegroup default 2024-03-09T14:46:41.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.729+0000 7f96cb97d980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.729+0000 7f96cb97d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:41.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.729+0000 7f96cb97d980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.729+0000 7f96cb97d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:41.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.729+0000 7f96cb97d980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.729+0000 7f96cb97d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:41.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.729+0000 7f96cb97d980 20 started sync module instance, tier type = 2024-03-09T14:46:41.724 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.729+0000 7f96cb97d980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:41.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.753+0000 7f96cb97d980 20 add_watcher() i=0 2024-03-09T14:46:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.753+0000 7f96cb97d980 20 add_watcher() i=1 2024-03-09T14:46:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.753+0000 7f96cb97d980 20 add_watcher() i=2 2024-03-09T14:46:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.753+0000 7f96cb97d980 20 add_watcher() i=3 2024-03-09T14:46:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.753+0000 7f96cb97d980 20 add_watcher() i=4 2024-03-09T14:46:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.753+0000 7f96cb97d980 20 add_watcher() i=5 2024-03-09T14:46:41.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.753+0000 7f96cb97d980 20 add_watcher() i=6 2024-03-09T14:46:41.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.757+0000 7f96cb97d980 20 add_watcher() i=7 2024-03-09T14:46:41.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.757+0000 7f96cb97d980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:41.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.761+0000 7f957f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.761+0000 7f96cb97d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.761+0000 7f96cb97d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:41.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.761+0000 7f96cb97d980 5 note: GC not initialized 2024-03-09T14:46:41.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.761+0000 7f957e7e4640 20 reqs_thread_entry: start 2024-03-09T14:46:41.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.761+0000 7f96cb97d980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:41.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.761+0000 7f96cb97d980 20 Filter name: none 2024-03-09T14:46:41.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.761+0000 7f94effff640 20 reqs_thread_entry: start 2024-03-09T14:46:41.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.761+0000 7f96cb97d980 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-03-09T14:46:41.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.761+0000 7f96cb97d980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.765+0000 7f96cb97d980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:41.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.765+0000 7f96cb97d980 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-03-09T14:46:41.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.765+0000 7f96cb97d980 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-03-09T14:46:41.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.765+0000 7f96cb97d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 : miss 2024-03-09T14:46:41.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.765+0000 7f96cb97d980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.765+0000 7f96cb97d980 20 rados_obj.operate() r=0 bl.length=425 2024-03-09T14:46:41.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.765+0000 7f96cb97d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 info.flags=0x17 2024-03-09T14:46:41.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.765+0000 7f96cb97d980 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 to cache LRU end 2024-03-09T14:46:41.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.765+0000 7f96cb97d980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:46:41.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.765+0000 7f96cb97d980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:41.759 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.765+0000 7f96cb97d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 2024-03-09T14:46:41.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.773+0000 7f96cb97d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 info.flags=0x17 2024-03-09T14:46:41.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.773+0000 7f96cb97d980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 to cache LRU end 2024-03-09T14:46:41.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.773+0000 7f96cb97d980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:41.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.773+0000 7f96cb97d980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29, ofs0, ns] 2024-03-09T14:46:41.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.777+0000 7f95acff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464263 cookie 94239395223248 notifier 6698 bl.length()=987 2024-03-09T14:46:41.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.777+0000 7f95acff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 info.flags=0x17 2024-03-09T14:46:41.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.777+0000 7f95acff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 to cache LRU end 2024-03-09T14:46:41.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.777+0000 7f95acff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:41.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.777+0000 7f96cb97d980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): orig_sources= new_sources= 2024-03-09T14:46:41.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.777+0000 7f96cb97d980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): potential sources added=[] removed=[] 2024-03-09T14:46:41.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.777+0000 7f96cb97d980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): orig_dests= new_dests= 2024-03-09T14:46:41.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.777+0000 7f96cb97d980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): potential dests added=[] removed=[] 2024-03-09T14:46:41.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.0 2024-03-09T14:46:41.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.0 2024-03-09T14:46:41.778 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.1 2024-03-09T14:46:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.1 2024-03-09T14:46:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.2 2024-03-09T14:46:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.2 2024-03-09T14:46:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.3 2024-03-09T14:46:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.3 2024-03-09T14:46:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.4 2024-03-09T14:46:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.4 2024-03-09T14:46:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.5 2024-03-09T14:46:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.5 2024-03-09T14:46:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.6 2024-03-09T14:46:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.6 2024-03-09T14:46:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.7 2024-03-09T14:46:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.7 2024-03-09T14:46:41.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.8 2024-03-09T14:46:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.8 2024-03-09T14:46:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.9 2024-03-09T14:46:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.9 2024-03-09T14:46:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.10 2024-03-09T14:46:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.10 2024-03-09T14:46:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.11 2024-03-09T14:46:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1.11 2024-03-09T14:46:41.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.0 2024-03-09T14:46:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.1 2024-03-09T14:46:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.2 2024-03-09T14:46:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.3 2024-03-09T14:46:41.781 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.785+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.4 2024-03-09T14:46:41.782 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.789+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.5 2024-03-09T14:46:41.783 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.789+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.6 2024-03-09T14:46:41.784 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.789+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.7 2024-03-09T14:46:41.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.789+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.8 2024-03-09T14:46:41.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.789+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.9 2024-03-09T14:46:41.787 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.793+0000 7f96cb97d980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29.10 2024-03-09T14:46:41.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.801+0000 7f96cb97d980 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 : hit (requested=0x17, cached=0x17) 2024-03-09T14:46:41.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.801+0000 7f96cb97d980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 2024-03-09T14:46:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.801+0000 7f96cb97d980 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 info.flags=0x17 2024-03-09T14:46:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.801+0000 7f96cb97d980 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 to cache LRU end 2024-03-09T14:46:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.801+0000 7f96cb97d980 10 updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.801+0000 7f96cb97d980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29, ofs0, ns] 2024-03-09T14:46:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.801+0000 7f95acff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464264 cookie 94239395223248 notifier 6698 bl.length()=955 2024-03-09T14:46:41.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.801+0000 7f95acff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 info.flags=0x17 2024-03-09T14:46:41.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.801+0000 7f95acff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 to cache LRU end 2024-03-09T14:46:41.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.801+0000 7f95acff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=265 2024-03-09T14:46:41.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.801+0000 7f96cb97d980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): orig_sources= new_sources= 2024-03-09T14:46:41.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.801+0000 7f96cb97d980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): potential sources added=[] removed=[] 2024-03-09T14:46:41.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.801+0000 7f96cb97d980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): orig_dests= new_dests= 2024-03-09T14:46:41.797 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.801+0000 7f96cb97d980 20 handle_bi_update(): bucket=:abort-at-do-reshard[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29]): potential dests added=[] removed=[] 2024-03-09T14:46:41.802 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.809+0000 7f96cb97d980 1 execute INFO: reshard of bucket "abort-at-do-reshard" completed successfully 2024-03-09T14:46:41.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.809+0000 7f957f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:41.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.817+0000 7f96cb97d980 20 remove_watcher() i=0 2024-03-09T14:46:41.810 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.817+0000 7f96cb97d980 2 removed watcher, disabling cache 2024-03-09T14:46:41.812 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.817+0000 7f96cb97d980 20 remove_watcher() i=1 2024-03-09T14:46:41.814 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.821+0000 7f96cb97d980 20 remove_watcher() i=2 2024-03-09T14:46:41.816 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.821+0000 7f96cb97d980 20 remove_watcher() i=3 2024-03-09T14:46:41.818 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.825+0000 7f96cb97d980 20 remove_watcher() i=4 2024-03-09T14:46:41.820 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.825+0000 7f96cb97d980 20 remove_watcher() i=5 2024-03-09T14:46:41.822 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.829+0000 7f96cb97d980 20 remove_watcher() i=6 2024-03-09T14:46:41.824 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.829+0000 7f96cb97d980 20 remove_watcher() i=7 2024-03-09T14:46:41.840 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-03-09T14:46:41.869 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:41.869 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:41.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.917+0000 7fdb2456b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.921+0000 7fdb2456b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:41.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.921+0000 7fdb2456b980 20 realm 2024-03-09T14:46:41.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.921+0000 7fdb2456b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.921+0000 7fdb2456b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:41.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.921+0000 7fdb2456b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:41.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.921+0000 7fdb2456b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.921+0000 7fdb2456b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:41.915 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.921+0000 7fdb2456b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.916 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.921+0000 7fdb2456b980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:41.917 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.921+0000 7fdb2456b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:41.918 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.925+0000 7fdb2456b980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:41.919 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.925+0000 7fdb2456b980 20 searching for the correct realm 2024-03-09T14:46:41.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.929+0000 7fdb21882640 0 -- 172.21.15.99:0/2561634533 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7fdb14008040 msgr2=0x7fdb140313f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:41.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:41.933+0000 7fdb21882640 0 -- 172.21.15.99:0/2561634533 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fdb1c1056a0 msgr2=0x7fdb1c11d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:42.149 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.153+0000 7fdb2456b980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:42.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.153+0000 7fdb2456b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:42.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.153+0000 7fdb2456b980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:42.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.153+0000 7fdb2456b980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:42.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.153+0000 7fdb2456b980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:42.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.153+0000 7fdb2456b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:42.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.153+0000 7fdb2456b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:42.150 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:42.151 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:42.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 20 zone default found 2024-03-09T14:46:42.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 4 Realm: () 2024-03-09T14:46:42.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:42.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:42.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:42.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 20 zonegroup default 2024-03-09T14:46:42.152 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:42.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:42.153 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:42.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 20 started sync module instance, tier type = 2024-03-09T14:46:42.154 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.157+0000 7fdb2456b980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:42.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.181+0000 7fdb2456b980 20 add_watcher() i=0 2024-03-09T14:46:42.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.181+0000 7fdb2456b980 20 add_watcher() i=1 2024-03-09T14:46:42.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.181+0000 7fdb2456b980 20 add_watcher() i=2 2024-03-09T14:46:42.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.181+0000 7fdb2456b980 20 add_watcher() i=3 2024-03-09T14:46:42.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.181+0000 7fdb2456b980 20 add_watcher() i=4 2024-03-09T14:46:42.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.181+0000 7fdb2456b980 20 add_watcher() i=5 2024-03-09T14:46:42.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.181+0000 7fdb2456b980 20 add_watcher() i=6 2024-03-09T14:46:42.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.185+0000 7fdb2456b980 20 add_watcher() i=7 2024-03-09T14:46:42.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.185+0000 7fdb2456b980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:42.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.189+0000 7fd9d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:42.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.189+0000 7fdb2456b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:42.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.189+0000 7fdb2456b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:42.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.189+0000 7fdb2456b980 5 note: GC not initialized 2024-03-09T14:46:42.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.189+0000 7fd9537fe640 20 reqs_thread_entry: start 2024-03-09T14:46:42.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.189+0000 7fdb2456b980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:42.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.189+0000 7fdb2456b980 20 Filter name: none 2024-03-09T14:46:42.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.193+0000 7fd9517fa640 20 reqs_thread_entry: start 2024-03-09T14:46:42.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.193+0000 7fdb2456b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.193+0000 7fdb2456b980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:42.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.193+0000 7fdb2456b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.193+0000 7fdb2456b980 20 rados_obj.operate() r=0 bl.length=425 2024-03-09T14:46:42.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.193+0000 7fdb2456b980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:42.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.193+0000 7fdb2456b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.193+0000 7fdb2456b980 20 rados_obj.operate() r=0 bl.length=211 2024-03-09T14:46:42.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.193+0000 7fdb2456b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.193+0000 7fdb2456b980 20 rados_obj.operate() r=0 bl.length=425 2024-03-09T14:46:42.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.193+0000 7fdb2456b980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:42.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.197+0000 7fdb2456b980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.197+0000 7fdb2456b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:42.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.197+0000 7fd9d8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:42.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.205+0000 7fdb2456b980 20 remove_watcher() i=0 2024-03-09T14:46:42.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.205+0000 7fdb2456b980 2 removed watcher, disabling cache 2024-03-09T14:46:42.201 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.205+0000 7fdb2456b980 20 remove_watcher() i=1 2024-03-09T14:46:42.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.209+0000 7fdb2456b980 20 remove_watcher() i=2 2024-03-09T14:46:42.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.209+0000 7fdb2456b980 20 remove_watcher() i=3 2024-03-09T14:46:42.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.213+0000 7fdb2456b980 20 remove_watcher() i=4 2024-03-09T14:46:42.209 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.213+0000 7fdb2456b980 20 remove_watcher() i=5 2024-03-09T14:46:42.210 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.217+0000 7fdb2456b980 20 remove_watcher() i=6 2024-03-09T14:46:42.212 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.217+0000 7fdb2456b980 20 remove_watcher() i=7 2024-03-09T14:46:42.227 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:42.227 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:46:42.227 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: abort-at-do-reshard id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-03-09T14:46:42.227 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:42.229 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:42.230 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:42.233 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:42.233 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:42.325 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:42.325 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:42.401 INFO:tasks.workunit.client.0.smithi099.stderr: test: reshard versioned bucket 2024-03-09T14:46:42.402 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket myver 2024-03-09T14:46:42.433 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:42.434 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:42.479 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.485+0000 7fc68d363980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.485+0000 7fc68d363980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:42.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.485+0000 7fc68d363980 20 realm 2024-03-09T14:46:42.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.485+0000 7fc68d363980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.481 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.485+0000 7fc68d363980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:42.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.485+0000 7fc68d363980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:42.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.485+0000 7fc68d363980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.485+0000 7fc68d363980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:42.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.485+0000 7fc68d363980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.489+0000 7fc68d363980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:42.483 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.489+0000 7fc68d363980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.489+0000 7fc68d363980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:42.485 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.489+0000 7fc68d363980 20 searching for the correct realm 2024-03-09T14:46:42.489 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.493+0000 7fc68a67a640 0 -- 172.21.15.99:0/1992338604 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7fc67c027020 msgr2=0x7fc67c055a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:42.495 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.501+0000 7fc68a67a640 0 -- 172.21.15.99:0/1992338604 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fc6840d69a0 msgr2=0x7fc6840ec470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:46:42.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.717+0000 7fc68d363980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:42.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.717+0000 7fc68d363980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:42.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.717+0000 7fc68d363980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:42.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.717+0000 7fc68d363980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:42.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.717+0000 7fc68d363980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:42.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.717+0000 7fc68d363980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:42.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.717+0000 7fc68d363980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.721+0000 7fc68d363980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:42.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.721+0000 7fc68d363980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.721+0000 7fc68d363980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:42.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.721+0000 7fc68d363980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.721+0000 7fc68d363980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:42.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.721+0000 7fc68d363980 20 zone default found 2024-03-09T14:46:42.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.721+0000 7fc68d363980 4 Realm: () 2024-03-09T14:46:42.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.721+0000 7fc68d363980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:42.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.721+0000 7fc68d363980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:42.716 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.721+0000 7fc68d363980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:42.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.721+0000 7fc68d363980 20 zonegroup default 2024-03-09T14:46:42.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.721+0000 7fc68d363980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.717 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.721+0000 7fc68d363980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:42.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.721+0000 7fc68d363980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.725+0000 7fc68d363980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:42.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.725+0000 7fc68d363980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.718 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.725+0000 7fc68d363980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:42.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.725+0000 7fc68d363980 20 started sync module instance, tier type = 2024-03-09T14:46:42.719 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.725+0000 7fc68d363980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:42.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.745+0000 7fc68d363980 20 add_watcher() i=0 2024-03-09T14:46:42.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.745+0000 7fc68d363980 20 add_watcher() i=1 2024-03-09T14:46:42.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.745+0000 7fc68d363980 20 add_watcher() i=2 2024-03-09T14:46:42.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.745+0000 7fc68d363980 20 add_watcher() i=3 2024-03-09T14:46:42.742 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.745+0000 7fc68d363980 20 add_watcher() i=4 2024-03-09T14:46:42.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.745+0000 7fc68d363980 20 add_watcher() i=5 2024-03-09T14:46:42.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.745+0000 7fc68d363980 20 add_watcher() i=6 2024-03-09T14:46:42.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.749+0000 7fc68d363980 20 add_watcher() i=7 2024-03-09T14:46:42.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.749+0000 7fc68d363980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:42.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.753+0000 7fc541fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:42.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.753+0000 7fc68d363980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:42.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.753+0000 7fc68d363980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:42.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.753+0000 7fc68d363980 5 note: GC not initialized 2024-03-09T14:46:42.749 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.753+0000 7fc540fe1640 20 reqs_thread_entry: start 2024-03-09T14:46:42.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.753+0000 7fc68d363980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:42.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.753+0000 7fc68d363980 20 Filter name: none 2024-03-09T14:46:42.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.753+0000 7fc539ffb640 20 reqs_thread_entry: start 2024-03-09T14:46:42.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.753+0000 7fc68d363980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.757+0000 7fc68d363980 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:46:42.750 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.757+0000 7fc68d363980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.757+0000 7fc68d363980 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:46:42.751 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.757+0000 7fc68d363980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:42.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.757+0000 7fc68d363980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.757+0000 7fc68d363980 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:46:42.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.757+0000 7fc68d363980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.757+0000 7fc68d363980 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:46:42.752 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.757+0000 7fc68d363980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:42.754 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.761+0000 7fc68d363980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.755 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.761+0000 7fc68d363980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:42.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.761+0000 7fc541fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:42.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.765+0000 7fc68d363980 20 remove_watcher() i=0 2024-03-09T14:46:42.761 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.765+0000 7fc68d363980 2 removed watcher, disabling cache 2024-03-09T14:46:42.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.769+0000 7fc68d363980 20 remove_watcher() i=1 2024-03-09T14:46:42.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.773+0000 7fc68d363980 20 remove_watcher() i=2 2024-03-09T14:46:42.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.773+0000 7fc68d363980 20 remove_watcher() i=3 2024-03-09T14:46:42.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.777+0000 7fc68d363980 20 remove_watcher() i=4 2024-03-09T14:46:42.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.777+0000 7fc68d363980 20 remove_watcher() i=5 2024-03-09T14:46:42.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.781+0000 7fc68d363980 20 remove_watcher() i=6 2024-03-09T14:46:42.776 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.781+0000 7fc68d363980 20 remove_watcher() i=7 2024-03-09T14:46:42.795 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:42.795 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:46:42.795 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: myver id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 num_objects: 0 size_kb: 0 num_shards: 11 2024-03-09T14:46:42.795 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:42.796 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-03-09T14:46:42.828 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:42.828 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:42.873 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.877+0000 7f98834fa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.881+0000 7f98834fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:42.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.881+0000 7f98834fa980 20 realm 2024-03-09T14:46:42.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.881+0000 7f98834fa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.881+0000 7f98834fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:42.875 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.881+0000 7f98834fa980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:42.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.881+0000 7f98834fa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.881+0000 7f98834fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:42.876 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.881+0000 7f98834fa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.881+0000 7f98834fa980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:42.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.881+0000 7f98834fa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:42.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.885+0000 7f98834fa980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:42.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.885+0000 7f98834fa980 20 searching for the correct realm 2024-03-09T14:46:42.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.885+0000 7f9881813640 0 -- 172.21.15.99:0/1977066924 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f9878037070 msgr2=0x7f9878042450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:42.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:42.893+0000 7f9880811640 0 -- 172.21.15.99:0/1977066924 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f987c017020 msgr2=0x7f987c024940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:43.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.109+0000 7f98834fa980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:43.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.109+0000 7f98834fa980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:43.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.109+0000 7f98834fa980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:43.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.109+0000 7f98834fa980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:43.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.109+0000 7f98834fa980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:43.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.109+0000 7f98834fa980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:43.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.109+0000 7f98834fa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.109+0000 7f98834fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:43.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.109+0000 7f98834fa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.113+0000 7f98834fa980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:43.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.113+0000 7f98834fa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.113+0000 7f98834fa980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:43.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.113+0000 7f98834fa980 20 zone default found 2024-03-09T14:46:43.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.113+0000 7f98834fa980 4 Realm: () 2024-03-09T14:46:43.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.113+0000 7f98834fa980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:43.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.113+0000 7f98834fa980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:43.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.113+0000 7f98834fa980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:43.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.113+0000 7f98834fa980 20 zonegroup default 2024-03-09T14:46:43.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.113+0000 7f98834fa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.113+0000 7f98834fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:43.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.113+0000 7f98834fa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.113+0000 7f98834fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:43.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.113+0000 7f98834fa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.113+0000 7f98834fa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:43.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.113+0000 7f98834fa980 20 started sync module instance, tier type = 2024-03-09T14:46:43.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.117+0000 7f98834fa980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:43.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.141+0000 7f98834fa980 20 add_watcher() i=0 2024-03-09T14:46:43.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.141+0000 7f98834fa980 20 add_watcher() i=1 2024-03-09T14:46:43.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.141+0000 7f98834fa980 20 add_watcher() i=2 2024-03-09T14:46:43.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.141+0000 7f98834fa980 20 add_watcher() i=3 2024-03-09T14:46:43.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.141+0000 7f98834fa980 20 add_watcher() i=4 2024-03-09T14:46:43.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.141+0000 7f98834fa980 20 add_watcher() i=5 2024-03-09T14:46:43.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.141+0000 7f98834fa980 20 add_watcher() i=6 2024-03-09T14:46:43.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.141+0000 7f98834fa980 20 add_watcher() i=7 2024-03-09T14:46:43.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.141+0000 7f98834fa980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:43.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.145+0000 7f9737fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:43.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:43.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:43.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 5 note: GC not initialized 2024-03-09T14:46:43.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f9736fe5640 20 reqs_thread_entry: start 2024-03-09T14:46:43.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:43.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 20 Filter name: none 2024-03-09T14:46:43.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f9734fe1640 20 reqs_thread_entry: start 2024-03-09T14:46:43.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-09T14:46:43.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:46:43.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-09T14:46:43.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-09T14:46:43.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 : miss 2024-03-09T14:46:43.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:46:43.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 info.flags=0x17 2024-03-09T14:46:43.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 10 adding default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 to cache LRU end 2024-03-09T14:46:43.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:46:43.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:43.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.149+0000 7f98834fa980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 2024-03-09T14:46:43.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.161+0000 7f98834fa980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 info.flags=0x17 2024-03-09T14:46:43.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.161+0000 7f98834fa980 10 moving default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 to cache LRU end 2024-03-09T14:46:43.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.161+0000 7f98834fa980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:43.157 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.161+0000 7f98834fa980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19, ofs0, ns] 2024-03-09T14:46:43.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.165+0000 7f9764ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464371 cookie 94038666941840 notifier 7062 bl.length()=897 2024-03-09T14:46:43.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.165+0000 7f9764ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 info.flags=0x17 2024-03-09T14:46:43.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.165+0000 7f9764ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 to cache LRU end 2024-03-09T14:46:43.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.165+0000 7f9764ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:43.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.165+0000 7f98834fa980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): orig_sources= new_sources= 2024-03-09T14:46:43.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.165+0000 7f98834fa980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): potential sources added=[] removed=[] 2024-03-09T14:46:43.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.165+0000 7f98834fa980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): orig_dests= new_dests= 2024-03-09T14:46:43.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.165+0000 7f98834fa980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): potential dests added=[] removed=[] 2024-03-09T14:46:43.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.0 2024-03-09T14:46:43.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.0 2024-03-09T14:46:43.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.1 2024-03-09T14:46:43.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.1 2024-03-09T14:46:43.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.2 2024-03-09T14:46:43.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.2 2024-03-09T14:46:43.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.3 2024-03-09T14:46:43.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.3 2024-03-09T14:46:43.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.4 2024-03-09T14:46:43.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.4 2024-03-09T14:46:43.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.5 2024-03-09T14:46:43.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.5 2024-03-09T14:46:43.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.6 2024-03-09T14:46:43.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.6 2024-03-09T14:46:43.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.7 2024-03-09T14:46:43.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.7 2024-03-09T14:46:43.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.8 2024-03-09T14:46:43.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.8 2024-03-09T14:46:43.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.9 2024-03-09T14:46:43.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.9 2024-03-09T14:46:43.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.10 2024-03-09T14:46:43.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.10 2024-03-09T14:46:43.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.11 2024-03-09T14:46:43.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.11 2024-03-09T14:46:43.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.169+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.0 2024-03-09T14:46:43.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.173+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1 2024-03-09T14:46:43.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.173+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2 2024-03-09T14:46:43.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.173+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3 2024-03-09T14:46:43.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.173+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.4 2024-03-09T14:46:43.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.177+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.5 2024-03-09T14:46:43.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.177+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.6 2024-03-09T14:46:43.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.177+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.7 2024-03-09T14:46:43.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.177+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.8 2024-03-09T14:46:43.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.177+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.9 2024-03-09T14:46:43.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.181+0000 7f98834fa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.10 2024-03-09T14:46:43.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.181+0000 7f98834fa980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 : hit (requested=0x17, cached=0x17) 2024-03-09T14:46:43.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.181+0000 7f98834fa980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 2024-03-09T14:46:43.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.181+0000 7f98834fa980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 info.flags=0x17 2024-03-09T14:46:43.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.181+0000 7f98834fa980 10 moving default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 to cache LRU end 2024-03-09T14:46:43.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.181+0000 7f98834fa980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:43.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.181+0000 7f98834fa980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19, ofs0, ns] 2024-03-09T14:46:43.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.185+0000 7f9753fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464372 cookie 94038666941840 notifier 7062 bl.length()=865 2024-03-09T14:46:43.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.185+0000 7f9753fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 info.flags=0x17 2024-03-09T14:46:43.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.185+0000 7f9753fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 to cache LRU end 2024-03-09T14:46:43.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.185+0000 7f9753fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:43.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.185+0000 7f98834fa980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): orig_sources= new_sources= 2024-03-09T14:46:43.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.185+0000 7f98834fa980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): potential sources added=[] removed=[] 2024-03-09T14:46:43.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.185+0000 7f98834fa980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): orig_dests= new_dests= 2024-03-09T14:46:43.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.185+0000 7f98834fa980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): potential dests added=[] removed=[] 2024-03-09T14:46:43.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.189+0000 7f98834fa980 1 execute INFO: reshard of bucket "myver" completed successfully 2024-03-09T14:46:43.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.193+0000 7f9737fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:43.193 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.197+0000 7f98834fa980 20 remove_watcher() i=0 2024-03-09T14:46:43.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.197+0000 7f98834fa980 2 removed watcher, disabling cache 2024-03-09T14:46:43.196 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.201+0000 7f98834fa980 20 remove_watcher() i=1 2024-03-09T14:46:43.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.205+0000 7f98834fa980 20 remove_watcher() i=2 2024-03-09T14:46:43.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.205+0000 7f98834fa980 20 remove_watcher() i=3 2024-03-09T14:46:43.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.209+0000 7f98834fa980 20 remove_watcher() i=4 2024-03-09T14:46:43.204 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.209+0000 7f98834fa980 20 remove_watcher() i=5 2024-03-09T14:46:43.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.209+0000 7f98834fa980 20 remove_watcher() i=6 2024-03-09T14:46:43.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.213+0000 7f98834fa980 20 remove_watcher() i=7 2024-03-09T14:46:43.233 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket myver 2024-03-09T14:46:43.264 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:43.264 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:43.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.525+0000 7f9ab80b5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.525+0000 7f9ab80b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:43.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.525+0000 7f9ab80b5980 20 realm 2024-03-09T14:46:43.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.525+0000 7f9ab80b5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.525+0000 7f9ab80b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:43.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.525+0000 7f9ab80b5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:43.520 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.525+0000 7f9ab80b5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.525+0000 7f9ab80b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:43.521 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.525+0000 7f9ab80b5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.529+0000 7f9ab80b5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:43.522 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.529+0000 7f9ab80b5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.529+0000 7f9ab80b5980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:43.524 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.529+0000 7f9ab80b5980 20 searching for the correct realm 2024-03-09T14:46:43.527 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.533+0000 7f9ab63ce640 0 -- 172.21.15.99:0/826275022 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f9aac04b040 msgr2=0x7f9aac071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:46:43.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.749+0000 7f9ab53cc640 0 -- 172.21.15.99:0/826275022 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f9ab00cf400 msgr2=0x7f9ab00df440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:43.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.965+0000 7f9ab80b5980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:43.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.965+0000 7f9ab80b5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:43.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.965+0000 7f9ab80b5980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:43.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.965+0000 7f9ab80b5980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:43.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.965+0000 7f9ab80b5980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:43.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.965+0000 7f9ab80b5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:43.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.965+0000 7f9ab80b5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.969+0000 7f9ab80b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:43.962 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.969+0000 7f9ab80b5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.969+0000 7f9ab80b5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:43.963 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.969+0000 7f9ab80b5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.969+0000 7f9ab80b5980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:43.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.969+0000 7f9ab80b5980 20 zone default found 2024-03-09T14:46:43.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.969+0000 7f9ab80b5980 4 Realm: () 2024-03-09T14:46:43.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.969+0000 7f9ab80b5980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:43.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.969+0000 7f9ab80b5980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:43.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.969+0000 7f9ab80b5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:43.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.969+0000 7f9ab80b5980 20 zonegroup default 2024-03-09T14:46:43.964 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.969+0000 7f9ab80b5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.969+0000 7f9ab80b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:43.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.969+0000 7f9ab80b5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.969+0000 7f9ab80b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:43.965 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.969+0000 7f9ab80b5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:43.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.973+0000 7f9ab80b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:43.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.973+0000 7f9ab80b5980 20 started sync module instance, tier type = 2024-03-09T14:46:43.966 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.973+0000 7f9ab80b5980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:43.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.997+0000 7f9ab80b5980 20 add_watcher() i=0 2024-03-09T14:46:43.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.997+0000 7f9ab80b5980 20 add_watcher() i=1 2024-03-09T14:46:43.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.997+0000 7f9ab80b5980 20 add_watcher() i=2 2024-03-09T14:46:43.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.997+0000 7f9ab80b5980 20 add_watcher() i=3 2024-03-09T14:46:43.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.997+0000 7f9ab80b5980 20 add_watcher() i=4 2024-03-09T14:46:43.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.997+0000 7f9ab80b5980 20 add_watcher() i=5 2024-03-09T14:46:43.991 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.997+0000 7f9ab80b5980 20 add_watcher() i=6 2024-03-09T14:46:43.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.997+0000 7f9ab80b5980 20 add_watcher() i=7 2024-03-09T14:46:43.993 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:43.997+0000 7f9ab80b5980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:43.997 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.001+0000 7f99677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:43.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.005+0000 7f9ab80b5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:43.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.005+0000 7f9ab80b5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:43.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.005+0000 7f9ab80b5980 5 note: GC not initialized 2024-03-09T14:46:43.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.005+0000 7f99667fc640 20 reqs_thread_entry: start 2024-03-09T14:46:43.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.005+0000 7f9ab80b5980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:43.999 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.005+0000 7f9ab80b5980 20 Filter name: none 2024-03-09T14:46:44.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.005+0000 7f9ab80b5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.005+0000 7f98d7fff640 20 reqs_thread_entry: start 2024-03-09T14:46:44.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.005+0000 7f9ab80b5980 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:46:44.000 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.005+0000 7f9ab80b5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.005+0000 7f9ab80b5980 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:46:44.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.005+0000 7f9ab80b5980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:44.001 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.005+0000 7f9ab80b5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.009+0000 7f9ab80b5980 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:46:44.002 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.009+0000 7f9ab80b5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.009+0000 7f9ab80b5980 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:46:44.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.009+0000 7f9ab80b5980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:44.004 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.009+0000 7f9ab80b5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.005 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.009+0000 7f9ab80b5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:44.006 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.013+0000 7f99677fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:44.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.017+0000 7f9ab80b5980 20 remove_watcher() i=0 2024-03-09T14:46:44.011 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.017+0000 7f9ab80b5980 2 removed watcher, disabling cache 2024-03-09T14:46:44.013 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.021+0000 7f9ab80b5980 20 remove_watcher() i=1 2024-03-09T14:46:44.016 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.021+0000 7f9ab80b5980 20 remove_watcher() i=2 2024-03-09T14:46:44.018 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.025+0000 7f9ab80b5980 20 remove_watcher() i=3 2024-03-09T14:46:44.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.025+0000 7f9ab80b5980 20 remove_watcher() i=4 2024-03-09T14:46:44.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.029+0000 7f9ab80b5980 20 remove_watcher() i=5 2024-03-09T14:46:44.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.029+0000 7f9ab80b5980 20 remove_watcher() i=6 2024-03-09T14:46:44.025 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.029+0000 7f9ab80b5980 20 remove_watcher() i=7 2024-03-09T14:46:44.044 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:44.044 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:46:44.045 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: myver id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-03-09T14:46:44.045 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:44.048 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:44.048 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:44.054 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:44.054 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:44.099 INFO:tasks.workunit.client.0.smithi099.stderr: test: reshard removes olh entries with empty name 2024-03-09T14:46:44.104 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:44.104 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:44.159 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:44.159 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:44.204 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-03-09T14:46:44.235 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:44.235 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:44.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.285+0000 7f4561b3e980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.282 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.289+0000 7f4561b3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:44.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.289+0000 7f4561b3e980 20 realm 2024-03-09T14:46:44.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.289+0000 7f4561b3e980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.289+0000 7f4561b3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:44.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.289+0000 7f4561b3e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:44.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.289+0000 7f4561b3e980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.289+0000 7f4561b3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:44.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.289+0000 7f4561b3e980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.289+0000 7f4561b3e980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:44.284 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.289+0000 7f4561b3e980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.293+0000 7f4561b3e980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:44.286 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.293+0000 7f4561b3e980 20 searching for the correct realm 2024-03-09T14:46:44.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.293+0000 7f455fe57640 0 -- 172.21.15.99:0/2024668785 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f4554008070 msgr2=0x7f455405a7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:44.297 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.301+0000 7f455ee55640 0 -- 172.21.15.99:0/2024668785 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f45580db910 msgr2=0x7f45580cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:44.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.517+0000 7f4561b3e980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:44.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.517+0000 7f4561b3e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:44.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.517+0000 7f4561b3e980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:44.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.517+0000 7f4561b3e980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:44.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.517+0000 7f4561b3e980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:44.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.517+0000 7f4561b3e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:44.512 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.517+0000 7f4561b3e980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.517+0000 7f4561b3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:44.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.517+0000 7f4561b3e980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.517+0000 7f4561b3e980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:44.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.517+0000 7f4561b3e980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.521+0000 7f4561b3e980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:44.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.521+0000 7f4561b3e980 20 zone default found 2024-03-09T14:46:44.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.521+0000 7f4561b3e980 4 Realm: () 2024-03-09T14:46:44.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.521+0000 7f4561b3e980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:44.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.521+0000 7f4561b3e980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:44.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.521+0000 7f4561b3e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:44.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.521+0000 7f4561b3e980 20 zonegroup default 2024-03-09T14:46:44.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.521+0000 7f4561b3e980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.521+0000 7f4561b3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:44.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.521+0000 7f4561b3e980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.521+0000 7f4561b3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:44.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.521+0000 7f4561b3e980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.521+0000 7f4561b3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:44.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.521+0000 7f4561b3e980 20 started sync module instance, tier type = 2024-03-09T14:46:44.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.521+0000 7f4561b3e980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:44.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.545+0000 7f4561b3e980 20 add_watcher() i=0 2024-03-09T14:46:44.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.545+0000 7f4561b3e980 20 add_watcher() i=1 2024-03-09T14:46:44.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.545+0000 7f4561b3e980 20 add_watcher() i=2 2024-03-09T14:46:44.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.545+0000 7f4561b3e980 20 add_watcher() i=3 2024-03-09T14:46:44.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.545+0000 7f4561b3e980 20 add_watcher() i=4 2024-03-09T14:46:44.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.545+0000 7f4561b3e980 20 add_watcher() i=5 2024-03-09T14:46:44.540 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.545+0000 7f4561b3e980 20 add_watcher() i=6 2024-03-09T14:46:44.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.549+0000 7f4561b3e980 20 add_watcher() i=7 2024-03-09T14:46:44.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.549+0000 7f4561b3e980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:44.546 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.553+0000 7f4415fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:44.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.553+0000 7f4561b3e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:44.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.553+0000 7f4561b3e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:44.547 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.553+0000 7f4561b3e980 5 note: GC not initialized 2024-03-09T14:46:44.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.553+0000 7f4414fe1640 20 reqs_thread_entry: start 2024-03-09T14:46:44.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.553+0000 7f4561b3e980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:44.548 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.553+0000 7f4561b3e980 20 Filter name: none 2024-03-09T14:46:44.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.553+0000 7f438e7fc640 20 reqs_thread_entry: start 2024-03-09T14:46:44.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.553+0000 7f4561b3e980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.557+0000 7f4561b3e980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:46:44.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.557+0000 7f4561b3e980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.557+0000 7f4561b3e980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:46:44.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.557+0000 7f4561b3e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:44.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.557+0000 7f4561b3e980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.557+0000 7f4561b3e980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:46:44.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.557+0000 7f4561b3e980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.557+0000 7f4561b3e980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:46:44.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.557+0000 7f4561b3e980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:44.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.561+0000 7f4561b3e980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.555 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.561+0000 7f4561b3e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:44.557 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.561+0000 7f4415fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:44.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.569+0000 7f4561b3e980 20 remove_watcher() i=0 2024-03-09T14:46:44.562 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.569+0000 7f4561b3e980 2 removed watcher, disabling cache 2024-03-09T14:46:44.564 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.569+0000 7f4561b3e980 20 remove_watcher() i=1 2024-03-09T14:46:44.566 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.573+0000 7f4561b3e980 20 remove_watcher() i=2 2024-03-09T14:46:44.568 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.573+0000 7f4561b3e980 20 remove_watcher() i=3 2024-03-09T14:46:44.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.577+0000 7f4561b3e980 20 remove_watcher() i=4 2024-03-09T14:46:44.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.577+0000 7f4561b3e980 20 remove_watcher() i=5 2024-03-09T14:46:44.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.577+0000 7f4561b3e980 20 remove_watcher() i=6 2024-03-09T14:46:44.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.581+0000 7f4561b3e980 20 remove_watcher() i=7 2024-03-09T14:46:44.592 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:44.592 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:46:44.592 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: a-bucket id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 num_objects: 0 size_kb: 0 num_shards: 13 2024-03-09T14:46:44.592 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:44.592 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-03-09T14:46:44.623 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:44.623 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:44.874 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.881+0000 7f8ca6627980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.881+0000 7f8ca6627980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:44.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.881+0000 7f8ca6627980 20 realm 2024-03-09T14:46:44.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.881+0000 7f8ca6627980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.881+0000 7f8ca6627980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:44.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.881+0000 7f8ca6627980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:44.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.881+0000 7f8ca6627980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.877 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.881+0000 7f8ca6627980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:44.878 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.881+0000 7f8ca6627980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.885+0000 7f8ca6627980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:44.879 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.885+0000 7f8ca6627980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.885+0000 7f8ca6627980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:44.881 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.885+0000 7f8ca6627980 20 searching for the correct realm 2024-03-09T14:46:44.883 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.889+0000 7f8c9b93e640 0 -- 172.21.15.99:0/381459489 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f8c94024070 msgr2=0x7f8c94058040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:44.889 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.893+0000 7f8ca4940640 0 -- 172.21.15.99:0/381459489 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f8c8c01a040 msgr2=0x7f8c8c04e410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:44.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.905+0000 7f8ca6627980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:44.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.905+0000 7f8ca6627980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:44.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.905+0000 7f8ca6627980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:44.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.905+0000 7f8ca6627980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:44.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.905+0000 7f8ca6627980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:44.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.905+0000 7f8ca6627980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:44.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.905+0000 7f8ca6627980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:44.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:44.903 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:44.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 20 zone default found 2024-03-09T14:46:44.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 4 Realm: () 2024-03-09T14:46:44.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:44.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:44.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:44.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 20 zonegroup default 2024-03-09T14:46:44.904 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:44.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:44.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.905 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:44.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 20 started sync module instance, tier type = 2024-03-09T14:46:44.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.909+0000 7f8ca6627980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:44.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.929+0000 7f8ca6627980 20 add_watcher() i=0 2024-03-09T14:46:44.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.929+0000 7f8ca6627980 20 add_watcher() i=1 2024-03-09T14:46:44.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.929+0000 7f8ca6627980 20 add_watcher() i=2 2024-03-09T14:46:44.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.929+0000 7f8ca6627980 20 add_watcher() i=3 2024-03-09T14:46:44.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.929+0000 7f8ca6627980 20 add_watcher() i=4 2024-03-09T14:46:44.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.929+0000 7f8ca6627980 20 add_watcher() i=5 2024-03-09T14:46:44.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.929+0000 7f8ca6627980 20 add_watcher() i=6 2024-03-09T14:46:44.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.929+0000 7f8ca6627980 20 add_watcher() i=7 2024-03-09T14:46:44.924 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.929+0000 7f8ca6627980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:44.926 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.933+0000 7f8b5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:44.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.933+0000 7f8ca6627980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:44.927 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.933+0000 7f8ca6627980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:44.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.933+0000 7f8ca6627980 5 note: GC not initialized 2024-03-09T14:46:44.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.933+0000 7f8b59fdb640 20 reqs_thread_entry: start 2024-03-09T14:46:44.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.933+0000 7f8ca6627980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:44.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.933+0000 7f8ca6627980 20 Filter name: none 2024-03-09T14:46:44.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.933+0000 7f8acb7fe640 20 reqs_thread_entry: start 2024-03-09T14:46:44.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.933+0000 7f8ca6627980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.933+0000 7f8ca6627980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:46:44.928 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.933+0000 7f8ca6627980 20 rados->read ofs=0 len=0 2024-03-09T14:46:44.929 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.933+0000 7f8ca6627980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:46:44.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.933+0000 7f8ca6627980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:44.930 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.937+0000 7f8b5afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:44.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.941+0000 7f8ca6627980 20 remove_watcher() i=0 2024-03-09T14:46:44.935 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.941+0000 7f8ca6627980 2 removed watcher, disabling cache 2024-03-09T14:46:44.937 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.941+0000 7f8ca6627980 20 remove_watcher() i=1 2024-03-09T14:46:44.939 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.945+0000 7f8ca6627980 20 remove_watcher() i=2 2024-03-09T14:46:44.941 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.945+0000 7f8ca6627980 20 remove_watcher() i=3 2024-03-09T14:46:44.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.949+0000 7f8ca6627980 20 remove_watcher() i=4 2024-03-09T14:46:44.944 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.949+0000 7f8ca6627980 20 remove_watcher() i=5 2024-03-09T14:46:44.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.953+0000 7f8ca6627980 20 remove_watcher() i=6 2024-03-09T14:46:44.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:44.953+0000 7f8ca6627980 20 remove_watcher() i=7 2024-03-09T14:46:44.961 INFO:tasks.workunit.client.0.smithi099.stderr:rados -p default.rgw.buckets.index setomapval .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-03-09T14:46:44.987 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:44.987 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:45.004 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket a-bucket 2024-03-09T14:46:45.029 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:45.029 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:45.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.077+0000 7efc61997980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.077+0000 7efc61997980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:45.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.077+0000 7efc61997980 20 realm 2024-03-09T14:46:45.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.077+0000 7efc61997980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.077+0000 7efc61997980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:45.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.077+0000 7efc61997980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:45.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.077+0000 7efc61997980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.077+0000 7efc61997980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:45.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.077+0000 7efc61997980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.081+0000 7efc61997980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:45.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.081+0000 7efc61997980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.081+0000 7efc61997980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:45.076 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.081+0000 7efc61997980 20 searching for the correct realm 2024-03-09T14:46:45.081 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.085+0000 7efc5ecae640 0 -- 172.21.15.99:0/3753324929 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7efc500b7c10 msgr2=0x7efc500c5950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:45.087 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.093+0000 7efc5ecae640 0 -- 172.21.15.99:0/3753324929 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7efc5800aaa0 msgr2=0x7efc5807f040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:45.306 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.309+0000 7efc61997980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:45.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.309+0000 7efc61997980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:45.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.309+0000 7efc61997980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:45.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.309+0000 7efc61997980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:45.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.309+0000 7efc61997980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:45.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.309+0000 7efc61997980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:45.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.309+0000 7efc61997980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.313+0000 7efc61997980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:45.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.313+0000 7efc61997980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.307 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.313+0000 7efc61997980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:45.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.313+0000 7efc61997980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.308 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.313+0000 7efc61997980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:45.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.313+0000 7efc61997980 20 zone default found 2024-03-09T14:46:45.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.313+0000 7efc61997980 4 Realm: () 2024-03-09T14:46:45.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.313+0000 7efc61997980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:45.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.313+0000 7efc61997980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:45.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.313+0000 7efc61997980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:45.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.313+0000 7efc61997980 20 zonegroup default 2024-03-09T14:46:45.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.313+0000 7efc61997980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.309 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.313+0000 7efc61997980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:45.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.313+0000 7efc61997980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.317+0000 7efc61997980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:45.310 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.317+0000 7efc61997980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.317+0000 7efc61997980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:45.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.317+0000 7efc61997980 20 started sync module instance, tier type = 2024-03-09T14:46:45.311 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.317+0000 7efc61997980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:45.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.341+0000 7efc61997980 20 add_watcher() i=0 2024-03-09T14:46:45.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.341+0000 7efc61997980 20 add_watcher() i=1 2024-03-09T14:46:45.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.341+0000 7efc61997980 20 add_watcher() i=2 2024-03-09T14:46:45.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.341+0000 7efc61997980 20 add_watcher() i=3 2024-03-09T14:46:45.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.341+0000 7efc61997980 20 add_watcher() i=4 2024-03-09T14:46:45.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.341+0000 7efc61997980 20 add_watcher() i=5 2024-03-09T14:46:45.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.341+0000 7efc61997980 20 add_watcher() i=6 2024-03-09T14:46:45.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.345+0000 7efc61997980 20 add_watcher() i=7 2024-03-09T14:46:45.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.345+0000 7efc61997980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:45.342 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.349+0000 7efb15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:45.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.349+0000 7efc61997980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:45.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.349+0000 7efc61997980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:45.343 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.349+0000 7efc61997980 5 note: GC not initialized 2024-03-09T14:46:45.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.349+0000 7efb14fe1640 20 reqs_thread_entry: start 2024-03-09T14:46:45.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.349+0000 7efc61997980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:45.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.349+0000 7efc61997980 20 Filter name: none 2024-03-09T14:46:45.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.349+0000 7efa8e7fc640 20 reqs_thread_entry: start 2024-03-09T14:46:45.344 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.349+0000 7efc61997980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.349+0000 7efc61997980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:46:45.345 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.349+0000 7efc61997980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.353+0000 7efc61997980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:46:45.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.353+0000 7efc61997980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:45.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.353+0000 7efc61997980 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-03-09T14:46:45.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.353+0000 7efc61997980 20 INFO: main: starting shard=0 2024-03-09T14:46:45.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.353+0000 7efc61997980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.0 2024-03-09T14:46:45.347 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.353+0000 7efc61997980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.0 2024-03-09T14:46:45.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.353+0000 7efc61997980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:46:45.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.353+0000 7efc61997980 20 INFO: main: starting shard=1 2024-03-09T14:46:45.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.353+0000 7efc61997980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.1 2024-03-09T14:46:45.348 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.353+0000 7efc61997980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.1 2024-03-09T14:46:45.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.353+0000 7efc61997980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:45.349 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.353+0000 7efc61997980 20 INFO: main: starting shard=2 2024-03-09T14:46:45.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.353+0000 7efc61997980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.2 2024-03-09T14:46:45.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.353+0000 7efc61997980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.2 2024-03-09T14:46:45.350 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.357+0000 7efc61997980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:45.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.357+0000 7efc61997980 20 INFO: main: starting shard=3 2024-03-09T14:46:45.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.357+0000 7efc61997980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.3 2024-03-09T14:46:45.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.357+0000 7efc61997980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.3 2024-03-09T14:46:45.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.357+0000 7efc61997980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:45.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.357+0000 7efc61997980 20 INFO: main: starting shard=4 2024-03-09T14:46:45.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.357+0000 7efc61997980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.4 2024-03-09T14:46:45.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.357+0000 7efc61997980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.4 2024-03-09T14:46:45.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.357+0000 7efc61997980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:45.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.357+0000 7efc61997980 20 INFO: main: starting shard=5 2024-03-09T14:46:45.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.357+0000 7efc61997980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.5 2024-03-09T14:46:45.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.357+0000 7efc61997980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.5 2024-03-09T14:46:45.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:45.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 20 INFO: main: starting shard=6 2024-03-09T14:46:45.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.6 2024-03-09T14:46:45.354 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.6 2024-03-09T14:46:45.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:45.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 20 INFO: main: starting shard=7 2024-03-09T14:46:45.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.7 2024-03-09T14:46:45.355 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.7 2024-03-09T14:46:45.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:45.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 20 INFO: main: starting shard=8 2024-03-09T14:46:45.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.8 2024-03-09T14:46:45.356 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.8 2024-03-09T14:46:45.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:45.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 20 INFO: main: starting shard=9 2024-03-09T14:46:45.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.9 2024-03-09T14:46:45.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.9 2024-03-09T14:46:45.357 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:45.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 20 INFO: main: starting shard=10 2024-03-09T14:46:45.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.10 2024-03-09T14:46:45.358 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.361+0000 7efc61997980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.10 2024-03-09T14:46:45.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.365+0000 7efc61997980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:45.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.365+0000 7efc61997980 20 INFO: main: starting shard=11 2024-03-09T14:46:45.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.365+0000 7efc61997980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.11 2024-03-09T14:46:45.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.365+0000 7efc61997980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.11 2024-03-09T14:46:45.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.365+0000 7efc61997980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:45.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.365+0000 7efc61997980 20 INFO: main: starting shard=12 2024-03-09T14:46:45.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.365+0000 7efc61997980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.12 2024-03-09T14:46:45.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.365+0000 7efc61997980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.12 2024-03-09T14:46:45.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.365+0000 7efc61997980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:45.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.365+0000 7efc61997980 20 INFO: main: done 2024-03-09T14:46:45.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.369+0000 7efb15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:45.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.373+0000 7efc61997980 20 remove_watcher() i=0 2024-03-09T14:46:45.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.373+0000 7efc61997980 2 removed watcher, disabling cache 2024-03-09T14:46:45.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.377+0000 7efc61997980 20 remove_watcher() i=1 2024-03-09T14:46:45.372 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.377+0000 7efc61997980 20 remove_watcher() i=2 2024-03-09T14:46:45.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.381+0000 7efc61997980 20 remove_watcher() i=3 2024-03-09T14:46:45.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.385+0000 7efc61997980 20 remove_watcher() i=4 2024-03-09T14:46:45.379 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.385+0000 7efc61997980 20 remove_watcher() i=5 2024-03-09T14:46:45.381 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.385+0000 7efc61997980 20 remove_watcher() i=6 2024-03-09T14:46:45.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.389+0000 7efc61997980 20 remove_watcher() i=7 2024-03-09T14:46:45.398 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-03-09T14:46:45.432 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:45.432 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:45.475 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.481+0000 7f5a9a400980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.481+0000 7f5a9a400980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:45.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.481+0000 7f5a9a400980 20 realm 2024-03-09T14:46:45.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.481+0000 7f5a9a400980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.481+0000 7f5a9a400980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:45.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.481+0000 7f5a9a400980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:45.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.481+0000 7f5a9a400980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.477 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.481+0000 7f5a9a400980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:45.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.481+0000 7f5a9a400980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.485+0000 7f5a9a400980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:45.478 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.485+0000 7f5a9a400980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.485+0000 7f5a9a400980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:45.480 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.485+0000 7f5a9a400980 20 searching for the correct realm 2024-03-09T14:46:45.482 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.489+0000 7f5a98719640 0 -- 172.21.15.99:0/501636837 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f5a8c02a040 msgr2=0x7f5a8c0649c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:46:45.490 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.497+0000 7f5a97717640 0 -- 172.21.15.99:0/501636837 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f5a900fcbc0 msgr2=0x7f5a9011f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:45.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.713+0000 7f5a9a400980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:45.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.713+0000 7f5a9a400980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:45.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.713+0000 7f5a9a400980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:45.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.713+0000 7f5a9a400980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:45.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.713+0000 7f5a9a400980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:45.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.713+0000 7f5a9a400980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:45.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.713+0000 7f5a9a400980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.713+0000 7f5a9a400980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:45.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.713+0000 7f5a9a400980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.717+0000 7f5a9a400980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:45.710 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.717+0000 7f5a9a400980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.717+0000 7f5a9a400980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:45.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.717+0000 7f5a9a400980 20 zone default found 2024-03-09T14:46:45.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.717+0000 7f5a9a400980 4 Realm: () 2024-03-09T14:46:45.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.717+0000 7f5a9a400980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:45.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.717+0000 7f5a9a400980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:45.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.717+0000 7f5a9a400980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:45.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.717+0000 7f5a9a400980 20 zonegroup default 2024-03-09T14:46:45.711 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.717+0000 7f5a9a400980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.717+0000 7f5a9a400980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:45.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.717+0000 7f5a9a400980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.717+0000 7f5a9a400980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:45.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.717+0000 7f5a9a400980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.717+0000 7f5a9a400980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:45.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.717+0000 7f5a9a400980 20 started sync module instance, tier type = 2024-03-09T14:46:45.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.717+0000 7f5a9a400980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:45.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.741+0000 7f5a9a400980 20 add_watcher() i=0 2024-03-09T14:46:45.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.741+0000 7f5a9a400980 20 add_watcher() i=1 2024-03-09T14:46:45.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.741+0000 7f5a9a400980 20 add_watcher() i=2 2024-03-09T14:46:45.736 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.741+0000 7f5a9a400980 20 add_watcher() i=3 2024-03-09T14:46:45.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.741+0000 7f5a9a400980 20 add_watcher() i=4 2024-03-09T14:46:45.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.741+0000 7f5a9a400980 20 add_watcher() i=5 2024-03-09T14:46:45.737 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.741+0000 7f5a9a400980 20 add_watcher() i=6 2024-03-09T14:46:45.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.745+0000 7f5a9a400980 20 add_watcher() i=7 2024-03-09T14:46:45.739 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.745+0000 7f5a9a400980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:45.743 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.749+0000 7f594dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:45.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.749+0000 7f5a9a400980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:45.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.749+0000 7f5a9a400980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:45.744 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.749+0000 7f5a9a400980 5 note: GC not initialized 2024-03-09T14:46:45.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.749+0000 7f594cfe1640 20 reqs_thread_entry: start 2024-03-09T14:46:45.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.749+0000 7f5a9a400980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:45.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.749+0000 7f5a9a400980 20 Filter name: none 2024-03-09T14:46:45.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.749+0000 7f58c67fc640 20 reqs_thread_entry: start 2024-03-09T14:46:45.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.749+0000 7f5a9a400980 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-03-09T14:46:45.745 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.749+0000 7f5a9a400980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.753+0000 7f5a9a400980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:46:45.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.753+0000 7f5a9a400980 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-03-09T14:46:45.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.753+0000 7f5a9a400980 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-03-09T14:46:45.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.753+0000 7f5a9a400980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 : miss 2024-03-09T14:46:45.746 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.753+0000 7f5a9a400980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.753+0000 7f5a9a400980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:46:45.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.753+0000 7f5a9a400980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 info.flags=0x17 2024-03-09T14:46:45.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.753+0000 7f5a9a400980 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 to cache LRU end 2024-03-09T14:46:45.747 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.753+0000 7f5a9a400980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:46:45.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.753+0000 7f5a9a400980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:45.748 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.753+0000 7f5a9a400980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 2024-03-09T14:46:45.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.761+0000 7f5a9a400980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 info.flags=0x17 2024-03-09T14:46:45.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.761+0000 7f5a9a400980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 to cache LRU end 2024-03-09T14:46:45.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.761+0000 7f5a9a400980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:45.756 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.761+0000 7f5a9a400980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18, ofs0, ns] 2024-03-09T14:46:45.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.761+0000 7f59767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464298 cookie 94661249337712 notifier 7167 bl.length()=903 2024-03-09T14:46:45.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.761+0000 7f59767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 info.flags=0x17 2024-03-09T14:46:45.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.761+0000 7f59767fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 to cache LRU end 2024-03-09T14:46:45.757 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.761+0000 7f59767fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:45.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.761+0000 7f5a9a400980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): orig_sources= new_sources= 2024-03-09T14:46:45.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.761+0000 7f5a9a400980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): potential sources added=[] removed=[] 2024-03-09T14:46:45.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.761+0000 7f5a9a400980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): orig_dests= new_dests= 2024-03-09T14:46:45.758 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.761+0000 7f5a9a400980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): potential dests added=[] removed=[] 2024-03-09T14:46:45.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.769+0000 7f5a9a400980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.3.0 2024-03-09T14:46:45.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.769+0000 7f5a9a400980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.3.0 2024-03-09T14:46:45.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.769+0000 7f5a9a400980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.0 2024-03-09T14:46:45.763 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.769+0000 7f5a9a400980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.0 2024-03-09T14:46:45.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.769+0000 7f5a9a400980 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-03-09T14:46:45.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.769+0000 7f5a9a400980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.1 2024-03-09T14:46:45.764 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.769+0000 7f5a9a400980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.1 2024-03-09T14:46:45.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.769+0000 7f5a9a400980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.2 2024-03-09T14:46:45.765 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.769+0000 7f5a9a400980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.2 2024-03-09T14:46:45.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.773+0000 7f5a9a400980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.3 2024-03-09T14:46:45.766 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.773+0000 7f5a9a400980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.3 2024-03-09T14:46:45.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.773+0000 7f5a9a400980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.4 2024-03-09T14:46:45.767 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.773+0000 7f5a9a400980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.4 2024-03-09T14:46:45.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.773+0000 7f5a9a400980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.5 2024-03-09T14:46:45.768 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.773+0000 7f5a9a400980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.5 2024-03-09T14:46:45.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.773+0000 7f5a9a400980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.6 2024-03-09T14:46:45.769 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.773+0000 7f5a9a400980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.6 2024-03-09T14:46:45.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.777+0000 7f5a9a400980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.7 2024-03-09T14:46:45.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.777+0000 7f5a9a400980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.7 2024-03-09T14:46:45.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.777+0000 7f5a9a400980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.8 2024-03-09T14:46:45.770 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.777+0000 7f5a9a400980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.8 2024-03-09T14:46:45.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.777+0000 7f5a9a400980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.9 2024-03-09T14:46:45.771 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.777+0000 7f5a9a400980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.9 2024-03-09T14:46:45.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.777+0000 7f5a9a400980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.10 2024-03-09T14:46:45.772 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.777+0000 7f5a9a400980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.10 2024-03-09T14:46:45.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.777+0000 7f5a9a400980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.11 2024-03-09T14:46:45.773 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.777+0000 7f5a9a400980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.11 2024-03-09T14:46:45.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.781+0000 7f5a9a400980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.12 2024-03-09T14:46:45.774 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.781+0000 7f5a9a400980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.2.12 2024-03-09T14:46:45.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.781+0000 7f5a9a400980 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 : hit (requested=0x17, cached=0x17) 2024-03-09T14:46:45.775 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.781+0000 7f5a9a400980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 2024-03-09T14:46:45.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.785+0000 7f5a9a400980 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 info.flags=0x17 2024-03-09T14:46:45.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.785+0000 7f5a9a400980 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 to cache LRU end 2024-03-09T14:46:45.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.785+0000 7f5a9a400980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:45.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.785+0000 7f5a9a400980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18, ofs0, ns] 2024-03-09T14:46:45.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.785+0000 7f59767fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464299 cookie 94661249337712 notifier 7167 bl.length()=871 2024-03-09T14:46:45.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.785+0000 7f59767fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 info.flags=0x17 2024-03-09T14:46:45.779 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.785+0000 7f59767fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18 to cache LRU end 2024-03-09T14:46:45.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.785+0000 7f59767fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:45.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.785+0000 7f5a9a400980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): orig_sources= new_sources= 2024-03-09T14:46:45.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.785+0000 7f5a9a400980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): potential sources added=[] removed=[] 2024-03-09T14:46:45.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.785+0000 7f5a9a400980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): orig_dests= new_dests= 2024-03-09T14:46:45.780 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.785+0000 7f5a9a400980 20 handle_bi_update(): bucket=:a-bucket[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18]): potential dests added=[] removed=[] 2024-03-09T14:46:45.785 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.789+0000 7f5a9a400980 1 execute INFO: reshard of bucket "a-bucket" completed successfully 2024-03-09T14:46:45.788 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.793+0000 7f594dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:45.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.797+0000 7f5a9a400980 20 remove_watcher() i=0 2024-03-09T14:46:45.794 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.797+0000 7f5a9a400980 2 removed watcher, disabling cache 2024-03-09T14:46:45.796 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.801+0000 7f5a9a400980 20 remove_watcher() i=1 2024-03-09T14:46:45.798 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.805+0000 7f5a9a400980 20 remove_watcher() i=2 2024-03-09T14:46:45.800 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.805+0000 7f5a9a400980 20 remove_watcher() i=3 2024-03-09T14:46:45.803 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.809+0000 7f5a9a400980 20 remove_watcher() i=4 2024-03-09T14:46:45.804 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.809+0000 7f5a9a400980 20 remove_watcher() i=5 2024-03-09T14:46:45.805 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.809+0000 7f5a9a400980 20 remove_watcher() i=6 2024-03-09T14:46:45.807 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.813+0000 7f5a9a400980 20 remove_watcher() i=7 2024-03-09T14:46:45.821 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket a-bucket 2024-03-09T14:46:45.848 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:45.848 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:45.893 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.897+0000 7fa90eba5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.901+0000 7fa90eba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:45.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.901+0000 7fa90eba5980 20 realm 2024-03-09T14:46:45.895 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.901+0000 7fa90eba5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.901+0000 7fa90eba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:45.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.901+0000 7fa90eba5980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:45.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.901+0000 7fa90eba5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.901+0000 7fa90eba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:45.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.901+0000 7fa90eba5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.901+0000 7fa90eba5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:45.897 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.901+0000 7fa90eba5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:45.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.905+0000 7fa90eba5980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:45.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.905+0000 7fa90eba5980 20 searching for the correct realm 2024-03-09T14:46:45.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:45.905+0000 7fa90bebc640 0 -- 172.21.15.99:0/1098885153 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7fa90411f7e0 msgr2=0x7fa9040ba030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:46.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.117+0000 7fa90cebe640 0 -- 172.21.15.99:0/1098885153 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7fa8f4008070 msgr2=0x7fa8f405aa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:46.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:46.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:46.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:46.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:46.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:46.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:46.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:46.132 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:46.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 20 zone default found 2024-03-09T14:46:46.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 4 Realm: () 2024-03-09T14:46:46.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:46.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:46.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:46.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 20 zonegroup default 2024-03-09T14:46:46.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.137+0000 7fa90eba5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.141+0000 7fa90eba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.141+0000 7fa90eba5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.141+0000 7fa90eba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.141+0000 7fa90eba5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.141+0000 7fa90eba5980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.141+0000 7fa90eba5980 20 started sync module instance, tier type = 2024-03-09T14:46:46.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.141+0000 7fa90eba5980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:46.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.161+0000 7fa90eba5980 20 add_watcher() i=0 2024-03-09T14:46:46.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.161+0000 7fa90eba5980 20 add_watcher() i=1 2024-03-09T14:46:46.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.161+0000 7fa90eba5980 20 add_watcher() i=2 2024-03-09T14:46:46.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.161+0000 7fa90eba5980 20 add_watcher() i=3 2024-03-09T14:46:46.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.161+0000 7fa90eba5980 20 add_watcher() i=4 2024-03-09T14:46:46.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.161+0000 7fa90eba5980 20 add_watcher() i=5 2024-03-09T14:46:46.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.165+0000 7fa90eba5980 20 add_watcher() i=6 2024-03-09T14:46:46.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.165+0000 7fa90eba5980 20 add_watcher() i=7 2024-03-09T14:46:46.160 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.165+0000 7fa90eba5980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:46.163 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.169+0000 7fa7c37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:46.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.169+0000 7fa90eba5980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:46.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.169+0000 7fa90eba5980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:46.164 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.169+0000 7fa90eba5980 5 note: GC not initialized 2024-03-09T14:46:46.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.169+0000 7fa7c27dc640 20 reqs_thread_entry: start 2024-03-09T14:46:46.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.169+0000 7fa90eba5980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:46.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.169+0000 7fa90eba5980 20 Filter name: none 2024-03-09T14:46:46.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.169+0000 7fa7bb7fe640 20 reqs_thread_entry: start 2024-03-09T14:46:46.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.169+0000 7fa90eba5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.173+0000 7fa90eba5980 20 rados_obj.operate() r=0 bl.length=200 2024-03-09T14:46:46.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.173+0000 7fa90eba5980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.173+0000 7fa90eba5980 20 rados_obj.operate() r=0 bl.length=414 2024-03-09T14:46:46.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.173+0000 7fa90eba5980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:46.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.173+0000 7fa90eba5980 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-03-09T14:46:46.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.173+0000 7fa90eba5980 20 INFO: main: starting shard=0 2024-03-09T14:46:46.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.173+0000 7fa90eba5980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.3.0 2024-03-09T14:46:46.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.173+0000 7fa90eba5980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18.3.0 2024-03-09T14:46:46.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.173+0000 7fa90eba5980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:46.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.173+0000 7fa90eba5980 20 INFO: main: done 2024-03-09T14:46:46.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.177+0000 7fa7c37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:46.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.181+0000 7fa90eba5980 20 remove_watcher() i=0 2024-03-09T14:46:46.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.181+0000 7fa90eba5980 2 removed watcher, disabling cache 2024-03-09T14:46:46.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.185+0000 7fa90eba5980 20 remove_watcher() i=1 2024-03-09T14:46:46.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.185+0000 7fa90eba5980 20 remove_watcher() i=2 2024-03-09T14:46:46.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.189+0000 7fa90eba5980 20 remove_watcher() i=3 2024-03-09T14:46:46.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.189+0000 7fa90eba5980 20 remove_watcher() i=4 2024-03-09T14:46:46.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.193+0000 7fa90eba5980 20 remove_watcher() i=5 2024-03-09T14:46:46.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.193+0000 7fa90eba5980 20 remove_watcher() i=6 2024-03-09T14:46:46.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.197+0000 7fa90eba5980 20 remove_watcher() i=7 2024-03-09T14:46:46.206 INFO:tasks.workunit.client.0.smithi099.stderr: test: PUT succeeds during reshard 2024-03-09T14:46:46.206 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket myver 2024-03-09T14:46:46.233 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:46.233 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:46.278 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.281+0000 7fd5618d0980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.285+0000 7fd5618d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.285+0000 7fd5618d0980 20 realm 2024-03-09T14:46:46.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.285+0000 7fd5618d0980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.285+0000 7fd5618d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.285+0000 7fd5618d0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:46.280 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.285+0000 7fd5618d0980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.285+0000 7fd5618d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.285+0000 7fd5618d0980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.285+0000 7fd5618d0980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:46.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.285+0000 7fd5618d0980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.289+0000 7fd5618d0980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:46.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.289+0000 7fd5618d0980 20 searching for the correct realm 2024-03-09T14:46:46.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.293+0000 7fd55fbe9640 0 -- 172.21.15.99:0/3349061697 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x564198a06fe0 msgr2=0x564198a093d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:46.294 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.301+0000 7fd55ebe7640 0 -- 172.21.15.99:0/3349061697 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fd558078330 msgr2=0x7fd5580629a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:46:46.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.517+0000 7fd5618d0980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:46.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.517+0000 7fd5618d0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:46.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.517+0000 7fd5618d0980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:46.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.517+0000 7fd5618d0980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:46.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.517+0000 7fd5618d0980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:46.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.517+0000 7fd5618d0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:46.513 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.517+0000 7fd5618d0980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.517+0000 7fd5618d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.517+0000 7fd5618d0980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.521+0000 7fd5618d0980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:46.514 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.521+0000 7fd5618d0980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.521+0000 7fd5618d0980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:46.515 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.521+0000 7fd5618d0980 20 zone default found 2024-03-09T14:46:46.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.521+0000 7fd5618d0980 4 Realm: () 2024-03-09T14:46:46.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.521+0000 7fd5618d0980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:46.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.521+0000 7fd5618d0980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:46.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.521+0000 7fd5618d0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:46.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.521+0000 7fd5618d0980 20 zonegroup default 2024-03-09T14:46:46.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.521+0000 7fd5618d0980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.516 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.521+0000 7fd5618d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.521+0000 7fd5618d0980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.521+0000 7fd5618d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.517 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.521+0000 7fd5618d0980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.525+0000 7fd5618d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.525+0000 7fd5618d0980 20 started sync module instance, tier type = 2024-03-09T14:46:46.518 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.525+0000 7fd5618d0980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:46.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.549+0000 7fd5618d0980 20 add_watcher() i=0 2024-03-09T14:46:46.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.549+0000 7fd5618d0980 20 add_watcher() i=1 2024-03-09T14:46:46.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.549+0000 7fd5618d0980 20 add_watcher() i=2 2024-03-09T14:46:46.542 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.549+0000 7fd5618d0980 20 add_watcher() i=3 2024-03-09T14:46:46.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.549+0000 7fd5618d0980 20 add_watcher() i=4 2024-03-09T14:46:46.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.549+0000 7fd5618d0980 20 add_watcher() i=5 2024-03-09T14:46:46.543 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.549+0000 7fd5618d0980 20 add_watcher() i=6 2024-03-09T14:46:46.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.549+0000 7fd5618d0980 20 add_watcher() i=7 2024-03-09T14:46:46.545 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.549+0000 7fd5618d0980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:46.549 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.553+0000 7fd415fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:46.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.557+0000 7fd5618d0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:46.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.557+0000 7fd5618d0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:46.550 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.557+0000 7fd5618d0980 5 note: GC not initialized 2024-03-09T14:46:46.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.557+0000 7fd414fe1640 20 reqs_thread_entry: start 2024-03-09T14:46:46.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.557+0000 7fd5618d0980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:46.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.557+0000 7fd5618d0980 20 Filter name: none 2024-03-09T14:46:46.551 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.557+0000 7fd38e7fc640 20 reqs_thread_entry: start 2024-03-09T14:46:46.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.557+0000 7fd5618d0980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.557+0000 7fd5618d0980 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:46:46.552 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.557+0000 7fd5618d0980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.557+0000 7fd5618d0980 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:46:46.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.557+0000 7fd5618d0980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:46.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.557+0000 7fd5618d0980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.557+0000 7fd5618d0980 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:46:46.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.557+0000 7fd5618d0980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.553 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.557+0000 7fd5618d0980 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:46:46.554 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.557+0000 7fd5618d0980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:46.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.561+0000 7fd5618d0980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.556 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.561+0000 7fd5618d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.558 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.565+0000 7fd415fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:46.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.569+0000 7fd5618d0980 20 remove_watcher() i=0 2024-03-09T14:46:46.563 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.569+0000 7fd5618d0980 2 removed watcher, disabling cache 2024-03-09T14:46:46.565 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.569+0000 7fd5618d0980 20 remove_watcher() i=1 2024-03-09T14:46:46.567 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.573+0000 7fd5618d0980 20 remove_watcher() i=2 2024-03-09T14:46:46.570 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.577+0000 7fd5618d0980 20 remove_watcher() i=3 2024-03-09T14:46:46.572 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.577+0000 7fd5618d0980 20 remove_watcher() i=4 2024-03-09T14:46:46.573 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.577+0000 7fd5618d0980 20 remove_watcher() i=5 2024-03-09T14:46:46.575 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.581+0000 7fd5618d0980 20 remove_watcher() i=6 2024-03-09T14:46:46.576 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.581+0000 7fd5618d0980 20 remove_watcher() i=7 2024-03-09T14:46:46.598 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:46.599 INFO:tasks.workunit.client.0.smithi099.stderr:BUCKET_STATS: 2024-03-09T14:46:46.599 INFO:tasks.workunit.client.0.smithi099.stderr:bucket: myver id: 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 num_objects: 0 size_kb: 0 num_shards: 12 2024-03-09T14:46:46.599 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:46.599 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-03-09T14:46:46.631 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:46.631 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:46.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.681+0000 7fa1fdf61980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.681+0000 7fa1fdf61980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.681+0000 7fa1fdf61980 20 realm 2024-03-09T14:46:46.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.681+0000 7fa1fdf61980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.685+0000 7fa1fdf61980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.685+0000 7fa1fdf61980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:46.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.685+0000 7fa1fdf61980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.685+0000 7fa1fdf61980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.678 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.685+0000 7fa1fdf61980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.685+0000 7fa1fdf61980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:46.680 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.685+0000 7fa1fdf61980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.681 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.685+0000 7fa1fdf61980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:46.682 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.685+0000 7fa1fdf61980 20 searching for the correct realm 2024-03-09T14:46:46.685 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.689+0000 7fa1fc27a640 0 -- 172.21.15.99:0/3757913474 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55aafa0611b0 msgr2=0x55aafa0635c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:46.692 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.697+0000 7fa1fb278640 0 -- 172.21.15.99:0/3757913474 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fa1f405a960 msgr2=0x7fa1f404c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:46.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.913+0000 7fa1fdf61980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:46.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.913+0000 7fa1fdf61980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:46.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.913+0000 7fa1fdf61980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:46.909 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.913+0000 7fa1fdf61980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:46.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.913+0000 7fa1fdf61980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:46.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.913+0000 7fa1fdf61980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:46.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.913+0000 7fa1fdf61980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.910 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.913+0000 7fa1fdf61980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.913+0000 7fa1fdf61980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.917+0000 7fa1fdf61980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:46.911 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.917+0000 7fa1fdf61980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.917+0000 7fa1fdf61980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:46.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.917+0000 7fa1fdf61980 20 zone default found 2024-03-09T14:46:46.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.917+0000 7fa1fdf61980 4 Realm: () 2024-03-09T14:46:46.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.917+0000 7fa1fdf61980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:46.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.917+0000 7fa1fdf61980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:46.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.917+0000 7fa1fdf61980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:46.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.917+0000 7fa1fdf61980 20 zonegroup default 2024-03-09T14:46:46.912 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.917+0000 7fa1fdf61980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.917+0000 7fa1fdf61980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.917+0000 7fa1fdf61980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.917+0000 7fa1fdf61980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.917+0000 7fa1fdf61980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.921+0000 7fa1fdf61980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:46.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.921+0000 7fa1fdf61980 20 started sync module instance, tier type = 2024-03-09T14:46:46.914 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.921+0000 7fa1fdf61980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:46.938 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.945+0000 7fa1fdf61980 20 add_watcher() i=0 2024-03-09T14:46:46.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.945+0000 7fa1fdf61980 20 add_watcher() i=1 2024-03-09T14:46:46.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.945+0000 7fa1fdf61980 20 add_watcher() i=2 2024-03-09T14:46:46.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.945+0000 7fa1fdf61980 20 add_watcher() i=3 2024-03-09T14:46:46.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.945+0000 7fa1fdf61980 20 add_watcher() i=4 2024-03-09T14:46:46.942 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.945+0000 7fa1fdf61980 20 add_watcher() i=5 2024-03-09T14:46:46.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.945+0000 7fa1fdf61980 20 add_watcher() i=6 2024-03-09T14:46:46.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.945+0000 7fa1fdf61980 20 add_watcher() i=7 2024-03-09T14:46:46.943 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.945+0000 7fa1fdf61980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:46.945 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.949+0000 7fa0b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:46.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.949+0000 7fa1fdf61980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:46.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.949+0000 7fa1fdf61980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:46.946 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa1fdf61980 5 note: GC not initialized 2024-03-09T14:46:46.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa0b17e2640 20 reqs_thread_entry: start 2024-03-09T14:46:46.947 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa1fdf61980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:46.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa1fdf61980 20 Filter name: none 2024-03-09T14:46:46.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa0aa7fc640 20 reqs_thread_entry: start 2024-03-09T14:46:46.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa1fdf61980 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-09T14:46:46.948 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa1fdf61980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa1fdf61980 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:46:46.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa1fdf61980 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-09T14:46:46.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa1fdf61980 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-09T14:46:46.949 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa1fdf61980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 : miss 2024-03-09T14:46:46.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa1fdf61980 20 rados->read ofs=0 len=0 2024-03-09T14:46:46.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa1fdf61980 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:46:46.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa1fdf61980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 info.flags=0x17 2024-03-09T14:46:46.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa1fdf61980 10 adding default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 to cache LRU end 2024-03-09T14:46:46.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa1fdf61980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:46:46.950 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa1fdf61980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:46.951 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.953+0000 7fa1fdf61980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 2024-03-09T14:46:46.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.965+0000 7fa1fdf61980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 info.flags=0x17 2024-03-09T14:46:46.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.965+0000 7fa1fdf61980 10 moving default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 to cache LRU end 2024-03-09T14:46:46.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.965+0000 7fa1fdf61980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:46.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.965+0000 7fa1fdf61980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19, ofs0, ns] 2024-03-09T14:46:46.959 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.965+0000 7fa0da7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464373 cookie 94192827540656 notifier 7221 bl.length()=897 2024-03-09T14:46:46.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.965+0000 7fa0da7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 info.flags=0x17 2024-03-09T14:46:46.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.965+0000 7fa0da7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 to cache LRU end 2024-03-09T14:46:46.960 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.965+0000 7fa0da7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:46.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.965+0000 7fa1fdf61980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): orig_sources= new_sources= 2024-03-09T14:46:46.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.965+0000 7fa1fdf61980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): potential sources added=[] removed=[] 2024-03-09T14:46:46.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.965+0000 7fa1fdf61980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): orig_dests= new_dests= 2024-03-09T14:46:46.961 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.965+0000 7fa1fdf61980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): potential dests added=[] removed=[] 2024-03-09T14:46:46.967 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:46.973+0000 7fa1fdf61980 -1 Injecting delay=5.000000000s at location=do_reshard 2024-03-09T14:46:47.604 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:47.604 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:51.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.0 2024-03-09T14:46:51.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.0 2024-03-09T14:46:51.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.1 2024-03-09T14:46:51.968 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.1 2024-03-09T14:46:51.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.2 2024-03-09T14:46:51.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.2 2024-03-09T14:46:51.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.3 2024-03-09T14:46:51.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.3 2024-03-09T14:46:51.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.4 2024-03-09T14:46:51.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.4 2024-03-09T14:46:51.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.5 2024-03-09T14:46:51.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.5 2024-03-09T14:46:51.969 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.6 2024-03-09T14:46:51.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.6 2024-03-09T14:46:51.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.7 2024-03-09T14:46:51.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.7 2024-03-09T14:46:51.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.8 2024-03-09T14:46:51.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.8 2024-03-09T14:46:51.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.9 2024-03-09T14:46:51.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.9 2024-03-09T14:46:51.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.10 2024-03-09T14:46:51.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.10 2024-03-09T14:46:51.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.11 2024-03-09T14:46:51.970 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.11 2024-03-09T14:46:51.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.12 2024-03-09T14:46:51.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.12 2024-03-09T14:46:51.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.0 2024-03-09T14:46:51.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.0 2024-03-09T14:46:51.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.1 2024-03-09T14:46:51.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.973+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.1 2024-03-09T14:46:51.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.977+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.2 2024-03-09T14:46:51.971 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.977+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.2 2024-03-09T14:46:51.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.977+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.3 2024-03-09T14:46:51.972 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.977+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.3 2024-03-09T14:46:51.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.977+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.4 2024-03-09T14:46:51.973 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.977+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.4 2024-03-09T14:46:51.975 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.981+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.5 2024-03-09T14:46:51.976 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.981+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.5 2024-03-09T14:46:51.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.981+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.6 2024-03-09T14:46:51.977 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.981+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.6 2024-03-09T14:46:51.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.985+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.7 2024-03-09T14:46:51.978 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.985+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.7 2024-03-09T14:46:51.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.985+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.8 2024-03-09T14:46:51.979 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.985+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.8 2024-03-09T14:46:51.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.985+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.9 2024-03-09T14:46:51.981 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.985+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.9 2024-03-09T14:46:51.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.989+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.10 2024-03-09T14:46:51.982 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.989+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.10 2024-03-09T14:46:51.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.989+0000 7fa1fdf61980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.11 2024-03-09T14:46:51.984 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.989+0000 7fa1fdf61980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.1.11 2024-03-09T14:46:51.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.989+0000 7fa1fdf61980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 : hit (requested=0x17, cached=0x17) 2024-03-09T14:46:51.985 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.989+0000 7fa1fdf61980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 2024-03-09T14:46:51.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.993+0000 7fa1fdf61980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 info.flags=0x17 2024-03-09T14:46:51.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.993+0000 7fa1fdf61980 10 moving default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 to cache LRU end 2024-03-09T14:46:51.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.993+0000 7fa1fdf61980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:51.988 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.993+0000 7fa1fdf61980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19, ofs0, ns] 2024-03-09T14:46:51.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.993+0000 7fa0daffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464374 cookie 94192827540656 notifier 7221 bl.length()=865 2024-03-09T14:46:51.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.993+0000 7fa0daffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 info.flags=0x17 2024-03-09T14:46:51.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.993+0000 7fa0daffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 to cache LRU end 2024-03-09T14:46:51.989 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.993+0000 7fa0daffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:51.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.997+0000 7fa1fdf61980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): orig_sources= new_sources= 2024-03-09T14:46:51.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.997+0000 7fa1fdf61980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): potential sources added=[] removed=[] 2024-03-09T14:46:51.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.997+0000 7fa1fdf61980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): orig_dests= new_dests= 2024-03-09T14:46:51.990 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:51.997+0000 7fa1fdf61980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): potential dests added=[] removed=[] 2024-03-09T14:46:51.998 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:52.005+0000 7fa1fdf61980 1 execute INFO: reshard of bucket "myver" completed successfully 2024-03-09T14:46:52.003 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:52.009+0000 7fa0b27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:52.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:52.013+0000 7fa1fdf61980 20 remove_watcher() i=0 2024-03-09T14:46:52.009 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:52.013+0000 7fa1fdf61980 2 removed watcher, disabling cache 2024-03-09T14:46:52.012 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:52.017+0000 7fa1fdf61980 20 remove_watcher() i=1 2024-03-09T14:46:52.015 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:52.021+0000 7fa1fdf61980 20 remove_watcher() i=2 2024-03-09T14:46:52.017 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:52.021+0000 7fa1fdf61980 20 remove_watcher() i=3 2024-03-09T14:46:52.020 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:52.025+0000 7fa1fdf61980 20 remove_watcher() i=4 2024-03-09T14:46:52.022 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:52.029+0000 7fa1fdf61980 20 remove_watcher() i=5 2024-03-09T14:46:52.024 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:52.029+0000 7fa1fdf61980 20 remove_watcher() i=6 2024-03-09T14:46:52.027 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:52.033+0000 7fa1fdf61980 20 remove_watcher() i=7 2024-03-09T14:46:52.663 INFO:tasks.workunit.client.0.smithi099.stderr:put object successful 2024-03-09T14:46:52.663 INFO:tasks.workunit.client.0.smithi099.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-03-09T14:46:52.663 INFO:tasks.workunit.client.0.smithi099.stderr: 2024-03-09T14:46:52.668 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:52.668 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:52.720 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:52.720 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:52.770 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:52.770 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:52.808 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:52.808 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:52.819 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:52.819 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:52.855 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:52.855 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:52.864 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:52.864 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:52.901 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:52.901 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:52.908 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-03-09T14:46:53.326 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-03-09T14:46:54.741 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:54.742 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:54.815 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:46:54.815 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket myver --object x 2024-03-09T14:46:54.850 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:54.851 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:54.896 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:54.901+0000 7f5fe82bf980 20 rados->read ofs=0 len=0 2024-03-09T14:46:54.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:54.905+0000 7f5fe82bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:54.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:54.905+0000 7f5fe82bf980 20 realm 2024-03-09T14:46:54.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:54.905+0000 7f5fe82bf980 20 rados->read ofs=0 len=0 2024-03-09T14:46:54.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:54.905+0000 7f5fe82bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:54.898 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:54.905+0000 7f5fe82bf980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:54.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:54.905+0000 7f5fe82bf980 20 rados->read ofs=0 len=0 2024-03-09T14:46:54.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:54.905+0000 7f5fe82bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:54.899 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:54.905+0000 7f5fe82bf980 20 rados->read ofs=0 len=0 2024-03-09T14:46:54.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:54.905+0000 7f5fe82bf980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:54.900 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:54.905+0000 7f5fe82bf980 20 rados->read ofs=0 len=0 2024-03-09T14:46:54.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:54.909+0000 7f5fe82bf980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:54.902 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:54.909+0000 7f5fe82bf980 20 searching for the correct realm 2024-03-09T14:46:54.906 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:54.913+0000 7f5fe55d6640 0 -- 172.21.15.99:0/1254635062 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x5642c31ad470 msgr2=0x7f5fd80c5920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:54.913 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:54.917+0000 7f5fe55d6640 0 -- 172.21.15.99:0/1254635062 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f5fe0093140 msgr2=0x7f5fe0032020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:55.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.133+0000 7f5fe82bf980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:55.129 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.133+0000 7f5fe82bf980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:55.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.133+0000 7f5fe82bf980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:55.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.133+0000 7f5fe82bf980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:55.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.133+0000 7f5fe82bf980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:55.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.133+0000 7f5fe82bf980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:55.130 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.133+0000 7f5fe82bf980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.133+0000 7f5fe82bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:55.134 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.133+0000 7f5fe82bf980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.137+0000 7f5fe82bf980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:55.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.137+0000 7f5fe82bf980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.137+0000 7f5fe82bf980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:55.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.137+0000 7f5fe82bf980 20 zone default found 2024-03-09T14:46:55.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.137+0000 7f5fe82bf980 4 Realm: () 2024-03-09T14:46:55.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.137+0000 7f5fe82bf980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:55.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.137+0000 7f5fe82bf980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:55.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.137+0000 7f5fe82bf980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:55.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.137+0000 7f5fe82bf980 20 zonegroup default 2024-03-09T14:46:55.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.137+0000 7f5fe82bf980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.137+0000 7f5fe82bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:55.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.137+0000 7f5fe82bf980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.137+0000 7f5fe82bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:55.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.137+0000 7f5fe82bf980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.141+0000 7f5fe82bf980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:55.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.141+0000 7f5fe82bf980 20 started sync module instance, tier type = 2024-03-09T14:46:55.137 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.141+0000 7f5fe82bf980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:55.158 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.165+0000 7f5fe82bf980 20 add_watcher() i=0 2024-03-09T14:46:55.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.165+0000 7f5fe82bf980 20 add_watcher() i=1 2024-03-09T14:46:55.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.165+0000 7f5fe82bf980 20 add_watcher() i=2 2024-03-09T14:46:55.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.165+0000 7f5fe82bf980 20 add_watcher() i=3 2024-03-09T14:46:55.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.165+0000 7f5fe82bf980 20 add_watcher() i=4 2024-03-09T14:46:55.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.165+0000 7f5fe82bf980 20 add_watcher() i=5 2024-03-09T14:46:55.159 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.165+0000 7f5fe82bf980 20 add_watcher() i=6 2024-03-09T14:46:55.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.165+0000 7f5fe82bf980 20 add_watcher() i=7 2024-03-09T14:46:55.161 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.165+0000 7f5fe82bf980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:55.165 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.169+0000 7f5e977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:55.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:55.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:55.166 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 5 note: GC not initialized 2024-03-09T14:46:55.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5e967fc640 20 reqs_thread_entry: start 2024-03-09T14:46:55.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:55.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 20 Filter name: none 2024-03-09T14:46:55.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5e07fff640 20 reqs_thread_entry: start 2024-03-09T14:46:55.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:46:55.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:46:55.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:55.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-03-09T14:46:55.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 20 INFO: main: starting shard=0 2024-03-09T14:46:55.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.0 2024-03-09T14:46:55.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.0 2024-03-09T14:46:55.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 20 INFO: main: starting shard=1 2024-03-09T14:46:55.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.1 2024-03-09T14:46:55.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.173+0000 7f5fe82bf980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.1 2024-03-09T14:46:55.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.177+0000 7f5fe82bf980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.170 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.177+0000 7f5fe82bf980 20 INFO: main: starting shard=2 2024-03-09T14:46:55.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.177+0000 7f5fe82bf980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.2 2024-03-09T14:46:55.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.177+0000 7f5fe82bf980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.2 2024-03-09T14:46:55.171 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.177+0000 7f5fe82bf980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.177+0000 7f5fe82bf980 20 INFO: main: starting shard=3 2024-03-09T14:46:55.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.177+0000 7f5fe82bf980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.3 2024-03-09T14:46:55.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.177+0000 7f5fe82bf980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.3 2024-03-09T14:46:55.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.177+0000 7f5fe82bf980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.177+0000 7f5fe82bf980 20 INFO: main: starting shard=4 2024-03-09T14:46:55.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.177+0000 7f5fe82bf980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.4 2024-03-09T14:46:55.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.177+0000 7f5fe82bf980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.4 2024-03-09T14:46:55.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.177+0000 7f5fe82bf980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.177+0000 7f5fe82bf980 20 INFO: main: starting shard=5 2024-03-09T14:46:55.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.177+0000 7f5fe82bf980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.5 2024-03-09T14:46:55.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.177+0000 7f5fe82bf980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.5 2024-03-09T14:46:55.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.181+0000 7f5fe82bf980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:46:55.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.181+0000 7f5fe82bf980 20 INFO: main: starting shard=6 2024-03-09T14:46:55.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.181+0000 7f5fe82bf980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.6 2024-03-09T14:46:55.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.181+0000 7f5fe82bf980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.6 2024-03-09T14:46:55.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.181+0000 7f5fe82bf980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.181+0000 7f5fe82bf980 20 INFO: main: starting shard=7 2024-03-09T14:46:55.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.181+0000 7f5fe82bf980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.7 2024-03-09T14:46:55.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.181+0000 7f5fe82bf980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.7 2024-03-09T14:46:55.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.181+0000 7f5fe82bf980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.181+0000 7f5fe82bf980 20 INFO: main: starting shard=8 2024-03-09T14:46:55.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.181+0000 7f5fe82bf980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.8 2024-03-09T14:46:55.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.181+0000 7f5fe82bf980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.8 2024-03-09T14:46:55.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.181+0000 7f5fe82bf980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.181+0000 7f5fe82bf980 20 INFO: main: starting shard=9 2024-03-09T14:46:55.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.181+0000 7f5fe82bf980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.9 2024-03-09T14:46:55.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.181+0000 7f5fe82bf980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.9 2024-03-09T14:46:55.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.185+0000 7f5fe82bf980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.185+0000 7f5fe82bf980 20 INFO: main: starting shard=10 2024-03-09T14:46:55.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.185+0000 7f5fe82bf980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.10 2024-03-09T14:46:55.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.185+0000 7f5fe82bf980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.10 2024-03-09T14:46:55.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.185+0000 7f5fe82bf980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.185+0000 7f5fe82bf980 20 INFO: main: starting shard=11 2024-03-09T14:46:55.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.185+0000 7f5fe82bf980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.11 2024-03-09T14:46:55.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.185+0000 7f5fe82bf980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.11 2024-03-09T14:46:55.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.185+0000 7f5fe82bf980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.185+0000 7f5fe82bf980 20 INFO: main: starting shard=12 2024-03-09T14:46:55.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.185+0000 7f5fe82bf980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.12 2024-03-09T14:46:55.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.185+0000 7f5fe82bf980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.12 2024-03-09T14:46:55.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.185+0000 7f5fe82bf980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.181 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.185+0000 7f5fe82bf980 20 INFO: main: done 2024-03-09T14:46:55.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.189+0000 7f5e977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:55.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.193+0000 7f5fe82bf980 20 remove_watcher() i=0 2024-03-09T14:46:55.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.193+0000 7f5fe82bf980 2 removed watcher, disabling cache 2024-03-09T14:46:55.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.197+0000 7f5fe82bf980 20 remove_watcher() i=1 2024-03-09T14:46:55.192 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.197+0000 7f5fe82bf980 20 remove_watcher() i=2 2024-03-09T14:46:55.194 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.201+0000 7f5fe82bf980 20 remove_watcher() i=3 2024-03-09T14:46:55.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.201+0000 7f5fe82bf980 20 remove_watcher() i=4 2024-03-09T14:46:55.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.205+0000 7f5fe82bf980 20 remove_watcher() i=5 2024-03-09T14:46:55.200 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.205+0000 7f5fe82bf980 20 remove_watcher() i=6 2024-03-09T14:46:55.202 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.209+0000 7f5fe82bf980 20 remove_watcher() i=7 2024-03-09T14:46:55.220 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:55.220 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:55.225 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:55.225 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:55.287 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:46:55.287 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket myver --object y 2024-03-09T14:46:55.317 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:55.317 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:55.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.369+0000 7ff3b6114980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.369+0000 7ff3b6114980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:55.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.369+0000 7ff3b6114980 20 realm 2024-03-09T14:46:55.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.369+0000 7ff3b6114980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.373+0000 7ff3b6114980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:55.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.373+0000 7ff3b6114980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:55.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.373+0000 7ff3b6114980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.373+0000 7ff3b6114980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:55.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.373+0000 7ff3b6114980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.373+0000 7ff3b6114980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:55.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.373+0000 7ff3b6114980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.373+0000 7ff3b6114980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:55.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.373+0000 7ff3b6114980 20 searching for the correct realm 2024-03-09T14:46:55.371 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.377+0000 7ff3b342b640 0 -- 172.21.15.99:0/2816400626 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7ff3a0002320 msgr2=0x7ff3a4053000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:46:55.585 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.589+0000 7ff3b442d640 0 -- 172.21.15.99:0/2816400626 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7ff39c12d040 msgr2=0x7ff39c0b1040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:55.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:55.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:55.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:55.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:55.602 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:55.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:55.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:55.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.603 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:55.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:55.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 20 zone default found 2024-03-09T14:46:55.604 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 4 Realm: () 2024-03-09T14:46:55.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:55.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:55.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:55.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 20 zonegroup default 2024-03-09T14:46:55.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:55.605 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.609+0000 7ff3b6114980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.613+0000 7ff3b6114980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:55.606 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.613+0000 7ff3b6114980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.613+0000 7ff3b6114980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:55.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.613+0000 7ff3b6114980 20 started sync module instance, tier type = 2024-03-09T14:46:55.607 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.613+0000 7ff3b6114980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:55.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.637+0000 7ff3b6114980 20 add_watcher() i=0 2024-03-09T14:46:55.630 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.637+0000 7ff3b6114980 20 add_watcher() i=1 2024-03-09T14:46:55.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.637+0000 7ff3b6114980 20 add_watcher() i=2 2024-03-09T14:46:55.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.637+0000 7ff3b6114980 20 add_watcher() i=3 2024-03-09T14:46:55.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.637+0000 7ff3b6114980 20 add_watcher() i=4 2024-03-09T14:46:55.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.637+0000 7ff3b6114980 20 add_watcher() i=5 2024-03-09T14:46:55.631 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.637+0000 7ff3b6114980 20 add_watcher() i=6 2024-03-09T14:46:55.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.637+0000 7ff3b6114980 20 add_watcher() i=7 2024-03-09T14:46:55.632 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.637+0000 7ff3b6114980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:55.636 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.641+0000 7ff26a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:55.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.641+0000 7ff3b6114980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:55.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.641+0000 7ff3b6114980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:55.637 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.641+0000 7ff3b6114980 5 note: GC not initialized 2024-03-09T14:46:55.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.641+0000 7ff2697e2640 20 reqs_thread_entry: start 2024-03-09T14:46:55.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.641+0000 7ff3b6114980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:55.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 20 Filter name: none 2024-03-09T14:46:55.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff2627fc640 20 reqs_thread_entry: start 2024-03-09T14:46:55.638 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:46:55.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:46:55.639 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:55.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-03-09T14:46:55.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 20 INFO: main: starting shard=0 2024-03-09T14:46:55.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.0 2024-03-09T14:46:55.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.0 2024-03-09T14:46:55.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 20 INFO: main: starting shard=1 2024-03-09T14:46:55.640 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.1 2024-03-09T14:46:55.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.1 2024-03-09T14:46:55.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 20 INFO: main: starting shard=2 2024-03-09T14:46:55.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.2 2024-03-09T14:46:55.641 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.645+0000 7ff3b6114980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.2 2024-03-09T14:46:55.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 20 INFO: main: starting shard=3 2024-03-09T14:46:55.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.3 2024-03-09T14:46:55.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.3 2024-03-09T14:46:55.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 20 INFO: main: starting shard=4 2024-03-09T14:46:55.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.4 2024-03-09T14:46:55.642 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.4 2024-03-09T14:46:55.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 20 INFO: main: starting shard=5 2024-03-09T14:46:55.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.5 2024-03-09T14:46:55.643 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.5 2024-03-09T14:46:55.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 20 INFO: main: starting shard=6 2024-03-09T14:46:55.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.6 2024-03-09T14:46:55.644 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.6 2024-03-09T14:46:55.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 20 INFO: main: starting shard=7 2024-03-09T14:46:55.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.7 2024-03-09T14:46:55.645 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.649+0000 7ff3b6114980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.7 2024-03-09T14:46:55.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.653+0000 7ff3b6114980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.646 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.653+0000 7ff3b6114980 20 INFO: main: starting shard=8 2024-03-09T14:46:55.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.653+0000 7ff3b6114980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.8 2024-03-09T14:46:55.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.653+0000 7ff3b6114980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.8 2024-03-09T14:46:55.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.653+0000 7ff3b6114980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.653+0000 7ff3b6114980 20 INFO: main: starting shard=9 2024-03-09T14:46:55.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.653+0000 7ff3b6114980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.9 2024-03-09T14:46:55.647 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.653+0000 7ff3b6114980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.9 2024-03-09T14:46:55.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.653+0000 7ff3b6114980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:46:55.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.653+0000 7ff3b6114980 20 INFO: main: starting shard=10 2024-03-09T14:46:55.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.653+0000 7ff3b6114980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.10 2024-03-09T14:46:55.648 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.653+0000 7ff3b6114980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.10 2024-03-09T14:46:55.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.653+0000 7ff3b6114980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.653+0000 7ff3b6114980 20 INFO: main: starting shard=11 2024-03-09T14:46:55.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.653+0000 7ff3b6114980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.11 2024-03-09T14:46:55.649 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.653+0000 7ff3b6114980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.11 2024-03-09T14:46:55.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.657+0000 7ff3b6114980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.657+0000 7ff3b6114980 20 INFO: main: starting shard=12 2024-03-09T14:46:55.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.657+0000 7ff3b6114980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.12 2024-03-09T14:46:55.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.657+0000 7ff3b6114980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.12 2024-03-09T14:46:55.650 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.657+0000 7ff3b6114980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:55.651 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.657+0000 7ff3b6114980 20 INFO: main: done 2024-03-09T14:46:55.652 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.657+0000 7ff26a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:55.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.661+0000 7ff3b6114980 20 remove_watcher() i=0 2024-03-09T14:46:55.657 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.661+0000 7ff3b6114980 2 removed watcher, disabling cache 2024-03-09T14:46:55.659 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.665+0000 7ff3b6114980 20 remove_watcher() i=1 2024-03-09T14:46:55.661 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.665+0000 7ff3b6114980 20 remove_watcher() i=2 2024-03-09T14:46:55.663 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.669+0000 7ff3b6114980 20 remove_watcher() i=3 2024-03-09T14:46:55.665 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.669+0000 7ff3b6114980 20 remove_watcher() i=4 2024-03-09T14:46:55.666 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.673+0000 7ff3b6114980 20 remove_watcher() i=5 2024-03-09T14:46:55.668 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.673+0000 7ff3b6114980 20 remove_watcher() i=6 2024-03-09T14:46:55.669 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.673+0000 7ff3b6114980 20 remove_watcher() i=7 2024-03-09T14:46:55.686 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:55.686 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:55.690 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:55.691 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:55.755 INFO:tasks.workunit.client.0.smithi099.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-03-09T14:46:55.755 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bi list --bucket myver --object z 2024-03-09T14:46:55.789 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:55.789 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:55.834 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.841+0000 7fc2110aa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.841+0000 7fc2110aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:55.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.841+0000 7fc2110aa980 20 realm 2024-03-09T14:46:55.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.841+0000 7fc2110aa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.841+0000 7fc2110aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:55.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.841+0000 7fc2110aa980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:55.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.841+0000 7fc2110aa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.841+0000 7fc2110aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:55.836 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.841+0000 7fc2110aa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.845+0000 7fc2110aa980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:55.838 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.845+0000 7fc2110aa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:55.839 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.845+0000 7fc2110aa980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:55.840 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.845+0000 7fc2110aa980 20 searching for the correct realm 2024-03-09T14:46:55.843 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.849+0000 7fc20f3c3640 0 -- 172.21.15.99:0/399351528 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7fc1f803c030 msgr2=0x7fc1f803c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:55.850 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:55.857+0000 7fc20e3c1640 0 -- 172.21.15.99:0/399351528 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fc20812f1d0 msgr2=0x7fc20810e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:56.069 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.073+0000 7fc2110aa980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:56.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.073+0000 7fc2110aa980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:56.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.073+0000 7fc2110aa980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:56.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.073+0000 7fc2110aa980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:56.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.073+0000 7fc2110aa980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:56.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.073+0000 7fc2110aa980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:56.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.073+0000 7fc2110aa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:56.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.077+0000 7fc2110aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:56.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.077+0000 7fc2110aa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:56.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.077+0000 7fc2110aa980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:56.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.077+0000 7fc2110aa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:56.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.077+0000 7fc2110aa980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:56.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.077+0000 7fc2110aa980 20 zone default found 2024-03-09T14:46:56.071 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.077+0000 7fc2110aa980 4 Realm: () 2024-03-09T14:46:56.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.077+0000 7fc2110aa980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:56.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.077+0000 7fc2110aa980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:56.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.077+0000 7fc2110aa980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:56.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.077+0000 7fc2110aa980 20 zonegroup default 2024-03-09T14:46:56.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.077+0000 7fc2110aa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:56.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.077+0000 7fc2110aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:56.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.077+0000 7fc2110aa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:56.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.077+0000 7fc2110aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:56.073 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.077+0000 7fc2110aa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:56.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.081+0000 7fc2110aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:56.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.081+0000 7fc2110aa980 20 started sync module instance, tier type = 2024-03-09T14:46:56.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.081+0000 7fc2110aa980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:56.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.101+0000 7fc2110aa980 20 add_watcher() i=0 2024-03-09T14:46:56.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.101+0000 7fc2110aa980 20 add_watcher() i=1 2024-03-09T14:46:56.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.101+0000 7fc2110aa980 20 add_watcher() i=2 2024-03-09T14:46:56.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.101+0000 7fc2110aa980 20 add_watcher() i=3 2024-03-09T14:46:56.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.101+0000 7fc2110aa980 20 add_watcher() i=4 2024-03-09T14:46:56.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.101+0000 7fc2110aa980 20 add_watcher() i=5 2024-03-09T14:46:56.097 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.101+0000 7fc2110aa980 20 add_watcher() i=6 2024-03-09T14:46:56.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.105+0000 7fc2110aa980 20 add_watcher() i=7 2024-03-09T14:46:56.099 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.105+0000 7fc2110aa980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:56.103 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.109+0000 7fc0c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:56.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.109+0000 7fc2110aa980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:56.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.109+0000 7fc2110aa980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:56.104 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.109+0000 7fc2110aa980 5 note: GC not initialized 2024-03-09T14:46:56.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.109+0000 7fc03ffff640 20 reqs_thread_entry: start 2024-03-09T14:46:56.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.109+0000 7fc2110aa980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:56.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.109+0000 7fc2110aa980 20 Filter name: none 2024-03-09T14:46:56.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.109+0000 7fc03dffb640 20 reqs_thread_entry: start 2024-03-09T14:46:56.105 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.109+0000 7fc2110aa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:56.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:46:56.106 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 20 rados->read ofs=0 len=0 2024-03-09T14:46:56.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:46:56.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:56.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-03-09T14:46:56.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 20 INFO: main: starting shard=0 2024-03-09T14:46:56.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.0 2024-03-09T14:46:56.107 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.0 2024-03-09T14:46:56.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-03-09T14:46:56.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 20 INFO: main: starting shard=1 2024-03-09T14:46:56.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.1 2024-03-09T14:46:56.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.1 2024-03-09T14:46:56.108 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:56.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 20 INFO: main: starting shard=2 2024-03-09T14:46:56.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.2 2024-03-09T14:46:56.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.2 2024-03-09T14:46:56.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:56.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 20 INFO: main: starting shard=3 2024-03-09T14:46:56.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.3 2024-03-09T14:46:56.109 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.113+0000 7fc2110aa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.3 2024-03-09T14:46:56.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.117+0000 7fc2110aa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:56.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.117+0000 7fc2110aa980 20 INFO: main: starting shard=4 2024-03-09T14:46:56.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.117+0000 7fc2110aa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.4 2024-03-09T14:46:56.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.117+0000 7fc2110aa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.4 2024-03-09T14:46:56.110 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.117+0000 7fc2110aa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:56.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.117+0000 7fc2110aa980 20 INFO: main: starting shard=5 2024-03-09T14:46:56.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.117+0000 7fc2110aa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.5 2024-03-09T14:46:56.111 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.117+0000 7fc2110aa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.5 2024-03-09T14:46:56.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.117+0000 7fc2110aa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:56.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.117+0000 7fc2110aa980 20 INFO: main: starting shard=6 2024-03-09T14:46:56.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.117+0000 7fc2110aa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.6 2024-03-09T14:46:56.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.117+0000 7fc2110aa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.6 2024-03-09T14:46:56.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.117+0000 7fc2110aa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:56.112 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.117+0000 7fc2110aa980 20 INFO: main: starting shard=7 2024-03-09T14:46:56.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.117+0000 7fc2110aa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.7 2024-03-09T14:46:56.113 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.117+0000 7fc2110aa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.7 2024-03-09T14:46:56.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.121+0000 7fc2110aa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:56.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.121+0000 7fc2110aa980 20 INFO: main: starting shard=8 2024-03-09T14:46:56.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.121+0000 7fc2110aa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.8 2024-03-09T14:46:56.114 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.121+0000 7fc2110aa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.8 2024-03-09T14:46:56.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.121+0000 7fc2110aa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:56.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.121+0000 7fc2110aa980 20 INFO: main: starting shard=9 2024-03-09T14:46:56.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.121+0000 7fc2110aa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.9 2024-03-09T14:46:56.115 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.121+0000 7fc2110aa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.9 2024-03-09T14:46:56.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.121+0000 7fc2110aa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:56.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.121+0000 7fc2110aa980 20 INFO: main: starting shard=10 2024-03-09T14:46:56.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.121+0000 7fc2110aa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.10 2024-03-09T14:46:56.116 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.121+0000 7fc2110aa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.10 2024-03-09T14:46:56.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.121+0000 7fc2110aa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:56.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.121+0000 7fc2110aa980 20 INFO: main: starting shard=11 2024-03-09T14:46:56.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.121+0000 7fc2110aa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.11 2024-03-09T14:46:56.117 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.121+0000 7fc2110aa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.11 2024-03-09T14:46:56.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.125+0000 7fc2110aa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:56.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.125+0000 7fc2110aa980 20 INFO: main: starting shard=12 2024-03-09T14:46:56.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.125+0000 7fc2110aa980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.12 2024-03-09T14:46:56.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.125+0000 7fc2110aa980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.12 2024-03-09T14:46:56.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.125+0000 7fc2110aa980 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-03-09T14:46:56.118 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.125+0000 7fc2110aa980 20 INFO: main: done 2024-03-09T14:46:56.120 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.125+0000 7fc0c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:56.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.129+0000 7fc2110aa980 20 remove_watcher() i=0 2024-03-09T14:46:56.125 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.129+0000 7fc2110aa980 2 removed watcher, disabling cache 2024-03-09T14:46:56.128 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.133+0000 7fc2110aa980 20 remove_watcher() i=1 2024-03-09T14:46:56.131 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.137+0000 7fc2110aa980 20 remove_watcher() i=2 2024-03-09T14:46:56.133 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.137+0000 7fc2110aa980 20 remove_watcher() i=3 2024-03-09T14:46:56.135 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.141+0000 7fc2110aa980 20 remove_watcher() i=4 2024-03-09T14:46:56.136 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.141+0000 7fc2110aa980 20 remove_watcher() i=5 2024-03-09T14:46:56.138 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.145+0000 7fc2110aa980 20 remove_watcher() i=6 2024-03-09T14:46:56.140 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:56.145+0000 7fc2110aa980 20 remove_watcher() i=7 2024-03-09T14:46:56.165 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:56.165 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:56.169 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-03-09T14:46:56.584 INFO:tasks.workunit.client.0.smithi099.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-03-09T14:46:56.994 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-03-09T14:46:57.026 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:57.026 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:57.070 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.077+0000 7f80b5027980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.077+0000 7f80b5027980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:57.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.077+0000 7f80b5027980 20 realm 2024-03-09T14:46:57.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.077+0000 7f80b5027980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.077+0000 7f80b5027980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:57.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.077+0000 7f80b5027980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:57.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.077+0000 7f80b5027980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.077+0000 7f80b5027980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:57.072 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.077+0000 7f80b5027980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.081+0000 7f80b5027980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:57.074 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.081+0000 7f80b5027980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.081+0000 7f80b5027980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:57.075 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.081+0000 7f80b5027980 20 searching for the correct realm 2024-03-09T14:46:57.079 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.085+0000 7f80b233e640 0 -- 172.21.15.99:0/2171864088 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f80a40ab980 msgr2=0x7f80a4112950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:57.085 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.089+0000 7f80b233e640 0 -- 172.21.15.99:0/2171864088 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f80ac062ae0 msgr2=0x7f80ac05f8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:46:57.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.305+0000 7f80b5027980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:57.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.305+0000 7f80b5027980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:57.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.305+0000 7f80b5027980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:57.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.305+0000 7f80b5027980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:57.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.305+0000 7f80b5027980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:57.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.305+0000 7f80b5027980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:57.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.305+0000 7f80b5027980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.300 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.305+0000 7f80b5027980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:57.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.305+0000 7f80b5027980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.305+0000 7f80b5027980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:57.301 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.305+0000 7f80b5027980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.309+0000 7f80b5027980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:57.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.309+0000 7f80b5027980 20 zone default found 2024-03-09T14:46:57.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.309+0000 7f80b5027980 4 Realm: () 2024-03-09T14:46:57.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.309+0000 7f80b5027980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:57.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.309+0000 7f80b5027980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:57.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.309+0000 7f80b5027980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:57.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.309+0000 7f80b5027980 20 zonegroup default 2024-03-09T14:46:57.302 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.309+0000 7f80b5027980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.309+0000 7f80b5027980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:57.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.309+0000 7f80b5027980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.309+0000 7f80b5027980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:57.303 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.309+0000 7f80b5027980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.309+0000 7f80b5027980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:57.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.309+0000 7f80b5027980 20 started sync module instance, tier type = 2024-03-09T14:46:57.304 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.309+0000 7f80b5027980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:57.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.333+0000 7f80b5027980 20 add_watcher() i=0 2024-03-09T14:46:57.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.333+0000 7f80b5027980 20 add_watcher() i=1 2024-03-09T14:46:57.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.333+0000 7f80b5027980 20 add_watcher() i=2 2024-03-09T14:46:57.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.333+0000 7f80b5027980 20 add_watcher() i=3 2024-03-09T14:46:57.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.333+0000 7f80b5027980 20 add_watcher() i=4 2024-03-09T14:46:57.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.333+0000 7f80b5027980 20 add_watcher() i=5 2024-03-09T14:46:57.328 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.333+0000 7f80b5027980 20 add_watcher() i=6 2024-03-09T14:46:57.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.337+0000 7f80b5027980 20 add_watcher() i=7 2024-03-09T14:46:57.330 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.337+0000 7f80b5027980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:57.335 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.341+0000 7f7f697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:57.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.341+0000 7f80b5027980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:57.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.341+0000 7f80b5027980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:57.336 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.341+0000 7f80b5027980 5 note: GC not initialized 2024-03-09T14:46:57.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.341+0000 7f7ee3fff640 20 reqs_thread_entry: start 2024-03-09T14:46:57.337 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.341+0000 7f80b5027980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:57.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.341+0000 7f80b5027980 20 Filter name: none 2024-03-09T14:46:57.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.345+0000 7f7ee1ffb640 20 reqs_thread_entry: start 2024-03-09T14:46:57.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.345+0000 7f80b5027980 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-09T14:46:57.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.345+0000 7f80b5027980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.345+0000 7f80b5027980 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:46:57.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.345+0000 7f80b5027980 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-09T14:46:57.338 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.345+0000 7f80b5027980 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-09T14:46:57.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.345+0000 7f80b5027980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 : miss 2024-03-09T14:46:57.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.345+0000 7f80b5027980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.345+0000 7f80b5027980 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:46:57.339 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.345+0000 7f80b5027980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 info.flags=0x17 2024-03-09T14:46:57.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.345+0000 7f80b5027980 10 adding default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 to cache LRU end 2024-03-09T14:46:57.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.345+0000 7f80b5027980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:46:57.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.345+0000 7f80b5027980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:57.340 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.345+0000 7f80b5027980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 2024-03-09T14:46:57.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.357+0000 7f80b5027980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 info.flags=0x17 2024-03-09T14:46:57.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.357+0000 7f80b5027980 10 moving default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 to cache LRU end 2024-03-09T14:46:57.351 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.357+0000 7f80b5027980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:57.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.357+0000 7f80b5027980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19, ofs0, ns] 2024-03-09T14:46:57.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.357+0000 7f7f95ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464375 cookie 94313168745440 notifier 6986 bl.length()=897 2024-03-09T14:46:57.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.357+0000 7f7f95ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 info.flags=0x17 2024-03-09T14:46:57.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.357+0000 7f7f95ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 to cache LRU end 2024-03-09T14:46:57.352 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.357+0000 7f7f95ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:57.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.357+0000 7f80b5027980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): orig_sources= new_sources= 2024-03-09T14:46:57.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.357+0000 7f80b5027980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): potential sources added=[] removed=[] 2024-03-09T14:46:57.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.357+0000 7f80b5027980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): orig_dests= new_dests= 2024-03-09T14:46:57.353 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.357+0000 7f80b5027980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): potential dests added=[] removed=[] 2024-03-09T14:46:57.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.0 2024-03-09T14:46:57.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.0 2024-03-09T14:46:57.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.1 2024-03-09T14:46:57.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.1 2024-03-09T14:46:57.359 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.2 2024-03-09T14:46:57.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.2 2024-03-09T14:46:57.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.3 2024-03-09T14:46:57.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.3 2024-03-09T14:46:57.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.4 2024-03-09T14:46:57.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.4 2024-03-09T14:46:57.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.5 2024-03-09T14:46:57.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.5 2024-03-09T14:46:57.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.6 2024-03-09T14:46:57.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.6 2024-03-09T14:46:57.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.7 2024-03-09T14:46:57.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.7 2024-03-09T14:46:57.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.8 2024-03-09T14:46:57.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.8 2024-03-09T14:46:57.360 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:57.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:57.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.10 2024-03-09T14:46:57.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.10 2024-03-09T14:46:57.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.11 2024-03-09T14:46:57.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.11 2024-03-09T14:46:57.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.12 2024-03-09T14:46:57.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.12 2024-03-09T14:46:57.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.13 2024-03-09T14:46:57.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.13 2024-03-09T14:46:57.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.14 2024-03-09T14:46:57.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.14 2024-03-09T14:46:57.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.15 2024-03-09T14:46:57.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.15 2024-03-09T14:46:57.361 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.16 2024-03-09T14:46:57.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.16 2024-03-09T14:46:57.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.0 2024-03-09T14:46:57.362 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.0 2024-03-09T14:46:57.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.1 2024-03-09T14:46:57.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.1 2024-03-09T14:46:57.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.2 2024-03-09T14:46:57.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.2 2024-03-09T14:46:57.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.3 2024-03-09T14:46:57.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.365+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.3 2024-03-09T14:46:57.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.369+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.4 2024-03-09T14:46:57.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.369+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.4 2024-03-09T14:46:57.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.369+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.5 2024-03-09T14:46:57.363 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.369+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.5 2024-03-09T14:46:57.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.369+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.6 2024-03-09T14:46:57.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.369+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.6 2024-03-09T14:46:57.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.369+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.7 2024-03-09T14:46:57.364 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.369+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.7 2024-03-09T14:46:57.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.369+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.8 2024-03-09T14:46:57.365 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.369+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.8 2024-03-09T14:46:57.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.373+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.9 2024-03-09T14:46:57.366 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.373+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.9 2024-03-09T14:46:57.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.373+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.10 2024-03-09T14:46:57.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.373+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.10 2024-03-09T14:46:57.367 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.373+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.11 2024-03-09T14:46:57.368 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.373+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.11 2024-03-09T14:46:57.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.373+0000 7f80b5027980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.12 2024-03-09T14:46:57.369 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.373+0000 7f80b5027980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.2.12 2024-03-09T14:46:57.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.377+0000 7f80b5027980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 : hit (requested=0x17, cached=0x17) 2024-03-09T14:46:57.373 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.377+0000 7f80b5027980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 2024-03-09T14:46:57.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.381+0000 7f80b5027980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 info.flags=0x17 2024-03-09T14:46:57.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.381+0000 7f80b5027980 10 moving default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 to cache LRU end 2024-03-09T14:46:57.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.381+0000 7f80b5027980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:57.375 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.381+0000 7f80b5027980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19, ofs0, ns] 2024-03-09T14:46:57.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.381+0000 7f7f967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464376 cookie 94313168745440 notifier 6986 bl.length()=865 2024-03-09T14:46:57.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.381+0000 7f7f967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 info.flags=0x17 2024-03-09T14:46:57.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.381+0000 7f7f967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 to cache LRU end 2024-03-09T14:46:57.376 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.381+0000 7f7f967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:57.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.381+0000 7f80b5027980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): orig_sources= new_sources= 2024-03-09T14:46:57.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.381+0000 7f80b5027980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): potential sources added=[] removed=[] 2024-03-09T14:46:57.377 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.381+0000 7f80b5027980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): orig_dests= new_dests= 2024-03-09T14:46:57.378 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.381+0000 7f80b5027980 20 handle_bi_update(): bucket=:myver[160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19]): potential dests added=[] removed=[] 2024-03-09T14:46:57.382 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.389+0000 7f80b5027980 1 execute INFO: reshard of bucket "myver" completed successfully 2024-03-09T14:46:57.385 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.389+0000 7f7f697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:57.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.397+0000 7f80b5027980 20 remove_watcher() i=0 2024-03-09T14:46:57.390 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.397+0000 7f80b5027980 2 removed watcher, disabling cache 2024-03-09T14:46:57.392 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.397+0000 7f80b5027980 20 remove_watcher() i=1 2024-03-09T14:46:57.394 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.401+0000 7f80b5027980 20 remove_watcher() i=2 2024-03-09T14:46:57.396 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.401+0000 7f80b5027980 20 remove_watcher() i=3 2024-03-09T14:46:57.399 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.405+0000 7f80b5027980 20 remove_watcher() i=4 2024-03-09T14:46:57.400 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.405+0000 7f80b5027980 20 remove_watcher() i=5 2024-03-09T14:46:57.401 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.405+0000 7f80b5027980 20 remove_watcher() i=6 2024-03-09T14:46:57.402 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.409+0000 7f80b5027980 20 remove_watcher() i=7 2024-03-09T14:46:57.416 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-03-09T14:46:57.450 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:57.450 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:57.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.705+0000 7f03ed4b6980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.709+0000 7f03ed4b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:57.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.709+0000 7f03ed4b6980 20 realm 2024-03-09T14:46:57.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.709+0000 7f03ed4b6980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.709+0000 7f03ed4b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:57.702 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.709+0000 7f03ed4b6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:57.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.709+0000 7f03ed4b6980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.709+0000 7f03ed4b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:57.703 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.709+0000 7f03ed4b6980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.709+0000 7f03ed4b6980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:57.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.709+0000 7f03ed4b6980 20 rados->read ofs=0 len=0 2024-03-09T14:46:57.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.709+0000 7f03ed4b6980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:57.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.709+0000 7f03ed4b6980 20 searching for the correct realm 2024-03-09T14:46:57.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.713+0000 7f03eb7cf640 0 -- 172.21.15.99:0/119245941 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f03e0008050 msgr2=0x7f03e005f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:57.923 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:57.929+0000 7f03ea7cd640 0 -- 172.21.15.99:0/119245941 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f03e4017070 msgr2=0x7f03e402e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:46:58.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.145+0000 7f03ed4b6980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:58.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.145+0000 7f03ed4b6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:58.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.145+0000 7f03ed4b6980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:58.141 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.145+0000 7f03ed4b6980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:58.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.145+0000 7f03ed4b6980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:58.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.145+0000 7f03ed4b6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:58.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.145+0000 7f03ed4b6980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.149+0000 7f03ed4b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:58.142 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.149+0000 7f03ed4b6980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.149+0000 7f03ed4b6980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:58.143 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.149+0000 7f03ed4b6980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.149+0000 7f03ed4b6980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:58.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.149+0000 7f03ed4b6980 20 zone default found 2024-03-09T14:46:58.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.149+0000 7f03ed4b6980 4 Realm: () 2024-03-09T14:46:58.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.149+0000 7f03ed4b6980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:58.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.149+0000 7f03ed4b6980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:58.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.149+0000 7f03ed4b6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:58.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.149+0000 7f03ed4b6980 20 zonegroup default 2024-03-09T14:46:58.144 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.149+0000 7f03ed4b6980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.149+0000 7f03ed4b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:58.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.149+0000 7f03ed4b6980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.145 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.149+0000 7f03ed4b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:58.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.153+0000 7f03ed4b6980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.153+0000 7f03ed4b6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:58.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.153+0000 7f03ed4b6980 20 started sync module instance, tier type = 2024-03-09T14:46:58.146 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.153+0000 7f03ed4b6980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:58.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.173+0000 7f03ed4b6980 20 add_watcher() i=0 2024-03-09T14:46:58.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.173+0000 7f03ed4b6980 20 add_watcher() i=1 2024-03-09T14:46:58.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.173+0000 7f03ed4b6980 20 add_watcher() i=2 2024-03-09T14:46:58.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.173+0000 7f03ed4b6980 20 add_watcher() i=3 2024-03-09T14:46:58.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.173+0000 7f03ed4b6980 20 add_watcher() i=4 2024-03-09T14:46:58.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.173+0000 7f03ed4b6980 20 add_watcher() i=5 2024-03-09T14:46:58.167 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.173+0000 7f03ed4b6980 20 add_watcher() i=6 2024-03-09T14:46:58.168 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.173+0000 7f03ed4b6980 20 add_watcher() i=7 2024-03-09T14:46:58.169 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.173+0000 7f03ed4b6980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:58.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.177+0000 7f02a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:58.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.177+0000 7f03ed4b6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:58.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.177+0000 7f03ed4b6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:58.172 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.177+0000 7f03ed4b6980 5 note: GC not initialized 2024-03-09T14:46:58.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.177+0000 7f02a0fe1640 20 reqs_thread_entry: start 2024-03-09T14:46:58.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.177+0000 7f03ed4b6980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:58.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.177+0000 7f03ed4b6980 20 Filter name: none 2024-03-09T14:46:58.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.177+0000 7f0299ffb640 20 reqs_thread_entry: start 2024-03-09T14:46:58.173 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.177+0000 7f03ed4b6980 10 cache get: name=default.rgw.meta+root+myver : miss 2024-03-09T14:46:58.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.177+0000 7f03ed4b6980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:46:58.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-03-09T14:46:58.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 10 adding default.rgw.meta+root+myver to cache LRU end 2024-03-09T14:46:58.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 : miss 2024-03-09T14:46:58.174 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:46:58.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 info.flags=0x17 2024-03-09T14:46:58.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 10 adding default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 to cache LRU end 2024-03-09T14:46:58.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:46:58.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-09T14:46:58.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19 2024-03-09T14:46:58.175 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.0 2024-03-09T14:46:58.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.0 2024-03-09T14:46:58.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 1 NOTICE: finished shard 0 (0 entries removed) 2024-03-09T14:46:58.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.1 2024-03-09T14:46:58.176 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.1 2024-03-09T14:46:58.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 1 NOTICE: finished shard 1 (0 entries removed) 2024-03-09T14:46:58.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.2 2024-03-09T14:46:58.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.2 2024-03-09T14:46:58.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 1 NOTICE: finished shard 2 (0 entries removed) 2024-03-09T14:46:58.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.3 2024-03-09T14:46:58.177 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.181+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.3 2024-03-09T14:46:58.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.185+0000 7f03ed4b6980 1 NOTICE: finished shard 3 (0 entries removed) 2024-03-09T14:46:58.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.185+0000 7f03ed4b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.4 2024-03-09T14:46:58.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.185+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.4 2024-03-09T14:46:58.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.185+0000 7f03ed4b6980 1 NOTICE: finished shard 4 (0 entries removed) 2024-03-09T14:46:58.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.185+0000 7f03ed4b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.5 2024-03-09T14:46:58.178 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.185+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.5 2024-03-09T14:46:58.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.185+0000 7f03ed4b6980 1 NOTICE: finished shard 5 (0 entries removed) 2024-03-09T14:46:58.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.185+0000 7f03ed4b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.6 2024-03-09T14:46:58.179 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.185+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.6 2024-03-09T14:46:58.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.185+0000 7f03ed4b6980 1 NOTICE: finished shard 6 (0 entries removed) 2024-03-09T14:46:58.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.185+0000 7f03ed4b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.7 2024-03-09T14:46:58.180 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.185+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.7 2024-03-09T14:46:58.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.189+0000 7f03ed4b6980 1 NOTICE: finished shard 7 (0 entries removed) 2024-03-09T14:46:58.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.189+0000 7f03ed4b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.8 2024-03-09T14:46:58.182 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.189+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.8 2024-03-09T14:46:58.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.189+0000 7f03ed4b6980 1 NOTICE: finished shard 8 (0 entries removed) 2024-03-09T14:46:58.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.189+0000 7f03ed4b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.183 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.189+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.189+0000 7f03ed4b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.10 2024-03-09T14:46:58.184 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.189+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.10 2024-03-09T14:46:58.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.189+0000 7f03ed4b6980 1 NOTICE: finished shard 10 (0 entries removed) 2024-03-09T14:46:58.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.189+0000 7f03ed4b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.11 2024-03-09T14:46:58.185 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.189+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.11 2024-03-09T14:46:58.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.193+0000 7f03ed4b6980 1 NOTICE: finished shard 11 (0 entries removed) 2024-03-09T14:46:58.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.193+0000 7f03ed4b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.12 2024-03-09T14:46:58.186 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.193+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.12 2024-03-09T14:46:58.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.193+0000 7f03ed4b6980 1 NOTICE: finished shard 12 (0 entries removed) 2024-03-09T14:46:58.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.193+0000 7f03ed4b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.13 2024-03-09T14:46:58.187 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.193+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.13 2024-03-09T14:46:58.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.193+0000 7f03ed4b6980 1 NOTICE: finished shard 13 (0 entries removed) 2024-03-09T14:46:58.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.193+0000 7f03ed4b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.14 2024-03-09T14:46:58.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.193+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.14 2024-03-09T14:46:58.188 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.193+0000 7f03ed4b6980 1 NOTICE: finished shard 14 (0 entries removed) 2024-03-09T14:46:58.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.193+0000 7f03ed4b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.15 2024-03-09T14:46:58.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.193+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.15 2024-03-09T14:46:58.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.193+0000 7f03ed4b6980 1 NOTICE: finished shard 15 (0 entries removed) 2024-03-09T14:46:58.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.193+0000 7f03ed4b6980 10 bucket_obj is .dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.16 2024-03-09T14:46:58.189 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.193+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.16 2024-03-09T14:46:58.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.197+0000 7f03ed4b6980 1 NOTICE: finished shard 16 (0 entries removed) 2024-03-09T14:46:58.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.197+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.190 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.197+0000 7f03ed4b6980 20 get_obj_state: octx=0x564007977d30 obj=myver:x state=0x564007ce84c8 s->prefetch_data=0 2024-03-09T14:46:58.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.197+0000 7f03ed4b6980 20 get_obj_state: setting s->obj_tag to 1tqntpjskqo778ht1irvmivmmycdhd0g 2024-03-09T14:46:58.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.197+0000 7f03ed4b6980 20 get_obj_state_impl: setting s->olh_tag to bd1aw9odxjhotyfkmu5r21tqea0phg9r 2024-03-09T14:46:58.191 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.197+0000 7f03ed4b6980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bd1aw9odxjhotyfkmu5r21tqea0phg9r 2024-03-09T14:46:58.195 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.201+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.197 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.201+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.201+0000 7f03ed4b6980 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-03-09T14:46:58.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.201+0000 7f03ed4b6980 20 olh_log_entry: epoch=2 op=3 key=x[sXXX.bB6UCWhGALYtSKH3Y4tseJ94Q4] 2024-03-09T14:46:58.198 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.201+0000 7f03ed4b6980 20 get_obj_state: octx=0x564007977d30 obj=myver:_:sXXX.bB6UCWhGALYtSKH3Y4tseJ94Q4_x state=0x564007d18d18 s->prefetch_data=0 2024-03-09T14:46:58.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.205+0000 7f03ed4b6980 10 manifest: total_size = 11 2024-03-09T14:46:58.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.205+0000 7f03ed4b6980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14890195564705780498 2024-03-09T14:46:58.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.205+0000 7f03ed4b6980 20 get_obj_state: octx=0x564007977d30 obj=myver:_:sXXX.bB6UCWhGALYtSKH3Y4tseJ94Q4_x state=0x564007d18d18 s->prefetch_data=0 2024-03-09T14:46:58.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.205+0000 7f03ed4b6980 20 prepare_atomic_modification: state is not atomic. state=0x564007d18d18 2024-03-09T14:46:58.199 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.205+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.209+0000 7f03ed4b6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:46:58.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.209+0000 7f03ed4b6980 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-03-09T14:46:58.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.209+0000 7f03ed4b6980 0 deleting objects inline since gc isn't initialized 2024-03-09T14:46:58.203 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.209+0000 7f03ed4b6980 5 delete_objs_inline: removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19__shadow:sXXX.bB6UCWhGALYtSKH3Y4tseJ94Q4_.0sts3pKQWbqqLh2_j-YzJtLhVVdkjIN_0 2024-03-09T14:46:58.205 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.209+0000 7f02ce7fc640 20 handle_completion(): completion ok for obj=x[sXXX.bB6UCWhGALYtSKH3Y4tseJ94Q4] 2024-03-09T14:46:58.207 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.213+0000 7f03ed4b6980 5 delete_objs_inline: refcount put returned error -2 2024-03-09T14:46:58.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.217+0000 7f03ed4b6980 20 get_obj_state: octx=0x564007977d30 obj=myver:x state=0x564007ce84c8 s->prefetch_data=0 2024-03-09T14:46:58.211 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.217+0000 7f03ed4b6980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=bd1aw9odxjhotyfkmu5r21tqea0phg9r 2024-03-09T14:46:58.220 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.225+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.222 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.229+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.229+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.229+0000 7f03ed4b6980 20 get_obj_state: octx=0x564007977d30 obj=myver:y state=0x564007ce84c8 s->prefetch_data=0 2024-03-09T14:46:58.223 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.229+0000 7f03ed4b6980 20 get_obj_state: setting s->obj_tag to rxnb4yxcx3nrkpaau2r5lcf11xbu0502 2024-03-09T14:46:58.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.229+0000 7f03ed4b6980 20 get_obj_state_impl: setting s->olh_tag to 2ww9hr7fm1twnba9nfsfhuv3nnturln7 2024-03-09T14:46:58.224 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.229+0000 7f03ed4b6980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2ww9hr7fm1twnba9nfsfhuv3nnturln7 2024-03-09T14:46:58.226 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.233+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.233+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.233+0000 7f03ed4b6980 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-03-09T14:46:58.228 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.233+0000 7f03ed4b6980 20 olh_log_entry: epoch=2 op=3 key=y[Tb8GkkMIKJ525eGVOvujB8N1RcHi.WC] 2024-03-09T14:46:58.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.233+0000 7f03ed4b6980 20 get_obj_state: octx=0x564007977d30 obj=myver:_:Tb8GkkMIKJ525eGVOvujB8N1RcHi.WC_y state=0x564007d18d18 s->prefetch_data=0 2024-03-09T14:46:58.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.233+0000 7f03ed4b6980 10 manifest: total_size = 22 2024-03-09T14:46:58.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.233+0000 7f03ed4b6980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10415958775170685828 2024-03-09T14:46:58.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.233+0000 7f03ed4b6980 20 get_obj_state: octx=0x564007977d30 obj=myver:_:Tb8GkkMIKJ525eGVOvujB8N1RcHi.WC_y state=0x564007d18d18 s->prefetch_data=0 2024-03-09T14:46:58.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.233+0000 7f03ed4b6980 20 prepare_atomic_modification: state is not atomic. state=0x564007d18d18 2024-03-09T14:46:58.229 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.233+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.237+0000 7f03ed4b6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:46:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.237+0000 7f03ed4b6980 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-03-09T14:46:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.237+0000 7f03ed4b6980 0 deleting objects inline since gc isn't initialized 2024-03-09T14:46:58.233 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.237+0000 7f03ed4b6980 5 delete_objs_inline: removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19__shadow:Tb8GkkMIKJ525eGVOvujB8N1RcHi.WC_._0wJBNzWYhWQdj24hx31l4TW79GdlLZ_0 2024-03-09T14:46:58.235 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.241+0000 7f02cdffb640 20 handle_completion(): completion ok for obj=y[Tb8GkkMIKJ525eGVOvujB8N1RcHi.WC] 2024-03-09T14:46:58.236 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.241+0000 7f03ed4b6980 5 delete_objs_inline: refcount put returned error -2 2024-03-09T14:46:58.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.245+0000 7f03ed4b6980 20 get_obj_state: octx=0x564007977d30 obj=myver:y state=0x564007ce84c8 s->prefetch_data=0 2024-03-09T14:46:58.238 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.245+0000 7f03ed4b6980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2ww9hr7fm1twnba9nfsfhuv3nnturln7 2024-03-09T14:46:58.244 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.249+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.245 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.249+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.253+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.246 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.253+0000 7f03ed4b6980 20 get_obj_state: octx=0x564007977d30 obj=myver:z state=0x564007ce84c8 s->prefetch_data=0 2024-03-09T14:46:58.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.253+0000 7f03ed4b6980 20 get_obj_state: setting s->obj_tag to hpq40riwvhcxxqkh3xe3jas4i58q1kdp 2024-03-09T14:46:58.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.253+0000 7f03ed4b6980 20 get_obj_state_impl: setting s->olh_tag to oz2y1futl1z7w1u9ykaz0hgii55raunb 2024-03-09T14:46:58.247 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.253+0000 7f03ed4b6980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=oz2y1futl1z7w1u9ykaz0hgii55raunb 2024-03-09T14:46:58.250 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.257+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.252 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.257+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.257+0000 7f03ed4b6980 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-03-09T14:46:58.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.257+0000 7f03ed4b6980 20 olh_log_entry: epoch=2 op=3 key=z[glOOlkEqBZxd58ileBn7qs2LhZJNARO] 2024-03-09T14:46:58.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.257+0000 7f03ed4b6980 20 get_obj_state: octx=0x564007977d30 obj=myver:_:glOOlkEqBZxd58ileBn7qs2LhZJNARO_z state=0x564007d18d18 s->prefetch_data=0 2024-03-09T14:46:58.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.257+0000 7f03ed4b6980 10 manifest: total_size = 9 2024-03-09T14:46:58.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.257+0000 7f03ed4b6980 20 get_obj_state: setting s->obj_tag to 160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6023892098271319025 2024-03-09T14:46:58.253 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.257+0000 7f03ed4b6980 20 get_obj_state: octx=0x564007977d30 obj=myver:_:glOOlkEqBZxd58ileBn7qs2LhZJNARO_z state=0x564007d18d18 s->prefetch_data=0 2024-03-09T14:46:58.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.257+0000 7f03ed4b6980 20 prepare_atomic_modification: state is not atomic. state=0x564007d18d18 2024-03-09T14:46:58.254 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.257+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.261+0000 7f03ed4b6980 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-03-09T14:46:58.257 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.261+0000 7f03ed4b6980 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-03-09T14:46:58.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.261+0000 7f03ed4b6980 0 deleting objects inline since gc isn't initialized 2024-03-09T14:46:58.258 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.261+0000 7f03ed4b6980 5 delete_objs_inline: removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19__shadow:glOOlkEqBZxd58ileBn7qs2LhZJNARO_.1VxtLk7KXJ9kVauG4hWCWfHd4L1PbX6_0 2024-03-09T14:46:58.259 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.265+0000 7f02ce7fc640 20 handle_completion(): completion ok for obj=z[glOOlkEqBZxd58ileBn7qs2LhZJNARO] 2024-03-09T14:46:58.261 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.265+0000 7f03ed4b6980 5 delete_objs_inline: refcount put returned error -2 2024-03-09T14:46:58.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.269+0000 7f03ed4b6980 20 get_obj_state: octx=0x564007977d30 obj=myver:z state=0x564007ce84c8 s->prefetch_data=0 2024-03-09T14:46:58.264 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.269+0000 7f03ed4b6980 20 bucket_index_guard_olh_op(): olh_state.olh_tag=oz2y1futl1z7w1u9ykaz0hgii55raunb 2024-03-09T14:46:58.272 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.277+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.281+0000 7f03ed4b6980 20 bucket index object: :.dir.160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19.3.9 2024-03-09T14:46:58.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.281+0000 7f03ed4b6980 1 NOTICE: finished shard 9 (3 entries removed) 2024-03-09T14:46:58.274 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.281+0000 7f03ed4b6980 1 NOTICE: finished all shards (3 entries removed) 2024-03-09T14:46:58.275 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.281+0000 7f02a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:58.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.285+0000 7f03ed4b6980 20 remove_watcher() i=0 2024-03-09T14:46:58.281 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.285+0000 7f03ed4b6980 2 removed watcher, disabling cache 2024-03-09T14:46:58.283 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.289+0000 7f03ed4b6980 20 remove_watcher() i=1 2024-03-09T14:46:58.285 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.289+0000 7f03ed4b6980 20 remove_watcher() i=2 2024-03-09T14:46:58.287 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.293+0000 7f03ed4b6980 20 remove_watcher() i=3 2024-03-09T14:46:58.289 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.293+0000 7f03ed4b6980 20 remove_watcher() i=4 2024-03-09T14:46:58.290 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.297+0000 7f03ed4b6980 20 remove_watcher() i=5 2024-03-09T14:46:58.292 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.297+0000 7f03ed4b6980 20 remove_watcher() i=6 2024-03-09T14:46:58.293 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.301+0000 7f03ed4b6980 20 remove_watcher() i=7 2024-03-09T14:46:58.317 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:58.317 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:58.324 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:58.324 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:58.373 INFO:tasks.workunit.client.0.smithi099.stderr:radosgw-admin bucket stats --bucket myver 2024-03-09T14:46:58.400 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:46:58.401 INFO:tasks.workunit.client.0.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:46:58.442 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.445+0000 7f98a85ee980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.449+0000 7f98a85ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:58.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.449+0000 7f98a85ee980 20 realm 2024-03-09T14:46:58.443 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.449+0000 7f98a85ee980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.449+0000 7f98a85ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:58.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.449+0000 7f98a85ee980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:46:58.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.449+0000 7f98a85ee980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.449+0000 7f98a85ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:58.444 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.449+0000 7f98a85ee980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.449+0000 7f98a85ee980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:58.445 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.449+0000 7f98a85ee980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.453+0000 7f98a85ee980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:46:58.447 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.453+0000 7f98a85ee980 20 searching for the correct realm 2024-03-09T14:46:58.450 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.457+0000 7f98a6907640 0 -- 172.21.15.99:0/3253419969 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x56067357fc40 msgr2=0x560673582030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:58.457 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.461+0000 7f98a5905640 0 -- 172.21.15.99:0/3253419969 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f98a00e8400 msgr2=0x7f98a00e8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:46:58.671 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:46:58.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:46:58.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:46:58.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:46:58.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:46:58.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:46:58.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:58.672 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:46:58.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.673 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:46:58.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 20 zone default found 2024-03-09T14:46:58.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 4 Realm: () 2024-03-09T14:46:58.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:46:58.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:46:58.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:46:58.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 20 zonegroup default 2024-03-09T14:46:58.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.677+0000 7f98a85ee980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.674 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.681+0000 7f98a85ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:58.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.681+0000 7f98a85ee980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.681+0000 7f98a85ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:58.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.681+0000 7f98a85ee980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.675 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.681+0000 7f98a85ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:58.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.681+0000 7f98a85ee980 20 started sync module instance, tier type = 2024-03-09T14:46:58.676 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.681+0000 7f98a85ee980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:46:58.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.705+0000 7f98a85ee980 20 add_watcher() i=0 2024-03-09T14:46:58.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.705+0000 7f98a85ee980 20 add_watcher() i=1 2024-03-09T14:46:58.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.705+0000 7f98a85ee980 20 add_watcher() i=2 2024-03-09T14:46:58.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.705+0000 7f98a85ee980 20 add_watcher() i=3 2024-03-09T14:46:58.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.705+0000 7f98a85ee980 20 add_watcher() i=4 2024-03-09T14:46:58.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.705+0000 7f98a85ee980 20 add_watcher() i=5 2024-03-09T14:46:58.699 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.705+0000 7f98a85ee980 20 add_watcher() i=6 2024-03-09T14:46:58.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.705+0000 7f98a85ee980 20 add_watcher() i=7 2024-03-09T14:46:58.701 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.705+0000 7f98a85ee980 2 all 8 watchers are set, enabling cache 2024-03-09T14:46:58.704 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.709+0000 7f975cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:58.705 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.709+0000 7f98a85ee980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:46:58.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.709+0000 7f98a85ee980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:46:58.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.709+0000 7f98a85ee980 5 note: GC not initialized 2024-03-09T14:46:58.706 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.713+0000 7f96d77fe640 20 reqs_thread_entry: start 2024-03-09T14:46:58.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.713+0000 7f98a85ee980 20 init_complete bucket index max shards: 11 2024-03-09T14:46:58.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.713+0000 7f98a85ee980 20 Filter name: none 2024-03-09T14:46:58.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.713+0000 7f96d57fa640 20 reqs_thread_entry: start 2024-03-09T14:46:58.707 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.713+0000 7f98a85ee980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.713+0000 7f98a85ee980 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:46:58.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.713+0000 7f98a85ee980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.713+0000 7f98a85ee980 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:46:58.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.713+0000 7f98a85ee980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:58.708 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.713+0000 7f98a85ee980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.713+0000 7f98a85ee980 20 rados_obj.operate() r=0 bl.length=197 2024-03-09T14:46:58.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.713+0000 7f98a85ee980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.713+0000 7f98a85ee980 20 rados_obj.operate() r=0 bl.length=411 2024-03-09T14:46:58.709 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.713+0000 7f98a85ee980 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-09T14:46:58.713 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.717+0000 7f98a85ee980 20 rados->read ofs=0 len=0 2024-03-09T14:46:58.714 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.721+0000 7f98a85ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:46:58.715 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.721+0000 7f975cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:46:58.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.725+0000 7f98a85ee980 20 remove_watcher() i=0 2024-03-09T14:46:58.720 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.725+0000 7f98a85ee980 2 removed watcher, disabling cache 2024-03-09T14:46:58.723 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.729+0000 7f98a85ee980 20 remove_watcher() i=1 2024-03-09T14:46:58.725 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.729+0000 7f98a85ee980 20 remove_watcher() i=2 2024-03-09T14:46:58.727 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.733+0000 7f98a85ee980 20 remove_watcher() i=3 2024-03-09T14:46:58.729 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.733+0000 7f98a85ee980 20 remove_watcher() i=4 2024-03-09T14:46:58.731 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.737+0000 7f98a85ee980 20 remove_watcher() i=5 2024-03-09T14:46:58.732 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.737+0000 7f98a85ee980 20 remove_watcher() i=6 2024-03-09T14:46:58.734 INFO:tasks.workunit.client.0.smithi099.stderr:2024-03-09T14:46:58.741+0000 7f98a85ee980 20 remove_watcher() i=7 2024-03-09T14:46:58.751 INFO:tasks.workunit.client.0.smithi099.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-03-09T14:46:58.751 INFO:tasks.workunit.client.0.smithi099.stderr:Deleting bucket a-bucket 2024-03-09T14:46:58.753 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:58.753 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:58.760 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:58.760 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:58.787 INFO:tasks.workunit.client.0.smithi099.stderr:Deleting bucket myver 2024-03-09T14:46:58.788 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:58.788 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:58.837 INFO:tasks.workunit.client.0.smithi099.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages/urllib3/connectionpool.py:1100: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#tls-warnings 2024-03-09T14:46:58.837 INFO:tasks.workunit.client.0.smithi099.stderr: warnings.warn( 2024-03-09T14:46:58.932 INFO:tasks.workunit.client.0.smithi099.stderr:Completed resharding tests 2024-03-09T14:46:58.933 INFO:tasks.workunit.client.0.smithi099.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-03-09T14:46:58.933 INFO:tasks.workunit.client.0.smithi099.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-03-09T14:46:58.933 INFO:tasks.workunit.client.0.smithi099.stdout:connected to https://localhost:443 2024-03-09T14:46:59.044 INFO:tasks.workunit.client.0.smithi099.stderr:+ deactivate 2024-03-09T14:46:59.045 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-03-09T14:46:59.045 INFO:tasks.workunit.client.0.smithi099.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-03-09T14:46:59.045 INFO:tasks.workunit.client.0.smithi099.stderr:+ export PATH 2024-03-09T14:46:59.045 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset _OLD_VIRTUAL_PATH 2024-03-09T14:46:59.045 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n '' ']' 2024-03-09T14:46:59.045 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-03-09T14:46:59.045 INFO:tasks.workunit.client.0.smithi099.stderr:+ hash -r 2024-03-09T14:46:59.045 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' -n '' ']' 2024-03-09T14:46:59.045 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset VIRTUAL_ENV 2024-03-09T14:46:59.045 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-03-09T14:46:59.046 INFO:tasks.workunit.client.0.smithi099.stdout:OK. 2024-03-09T14:46:59.047 INFO:tasks.workunit.client.0.smithi099.stderr:+ '[' '!' '' = nondestructive ']' 2024-03-09T14:46:59.047 INFO:tasks.workunit.client.0.smithi099.stderr:+ unset -f deactivate 2024-03-09T14:46:59.047 INFO:tasks.workunit.client.0.smithi099.stderr:+ echo OK. 2024-03-09T14:46:59.047 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-09T14:46:59.048 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-09T14:46:59.107 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-03-09T14:46:59.107 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-09T14:46:59.525 DEBUG:teuthology.parallel:result is None 2024-03-09T14:46:59.526 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:46:59.537 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:46:59.537 DEBUG:teuthology.orchestra.run.smithi099:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-03-09T14:46:59.587 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-03-09T14:46:59.587 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-03-09T14:47:00.039 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-03-09T14:47:00.040 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-03-09T14:47:00.040 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-03-09T14:47:00.040 DEBUG:teuthology.orchestra.run.smithi099:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-03-09T14:47:00.046 INFO:teuthology.orchestra.run.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-03-09T14:47:15.887 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-03-09T14:47:15.887 DEBUG:teuthology.orchestra.run.smithi099:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-03-09T14:47:15.979 INFO:teuthology.orchestra.run.smithi099.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-03-09T14:47:16.032 INFO:teuthology.orchestra.run.smithi099.stdout:Reading package lists... 2024-03-09T14:47:16.232 INFO:teuthology.orchestra.run.smithi099.stdout:Building dependency tree... 2024-03-09T14:47:16.233 INFO:teuthology.orchestra.run.smithi099.stdout:Reading state information... 2024-03-09T14:47:16.408 INFO:teuthology.orchestra.run.smithi099.stdout:The following packages were automatically installed and are no longer required: 2024-03-09T14:47:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-03-09T14:47:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-03-09T14:47:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-03-09T14:47:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-03-09T14:47:16.409 INFO:teuthology.orchestra.run.smithi099.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-03-09T14:47:16.409 INFO:teuthology.orchestra.run.smithi099.stdout:Use 'sudo apt autoremove' to remove them. 2024-03-09T14:47:16.409 INFO:teuthology.orchestra.run.smithi099.stdout:The following additional packages will be installed: 2024-03-09T14:47:16.410 INFO:teuthology.orchestra.run.smithi099.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-03-09T14:47:16.410 INFO:teuthology.orchestra.run.smithi099.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-03-09T14:47:16.411 INFO:teuthology.orchestra.run.smithi099.stdout:Suggested packages: 2024-03-09T14:47:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-03-09T14:47:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-03-09T14:47:16.412 INFO:teuthology.orchestra.run.smithi099.stdout: fonts-wqy-zenhei fonts-indic 2024-03-09T14:47:16.443 INFO:teuthology.orchestra.run.smithi099.stdout:The following NEW packages will be installed: 2024-03-09T14:47:16.444 INFO:teuthology.orchestra.run.smithi099.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-03-09T14:47:16.444 INFO:teuthology.orchestra.run.smithi099.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-03-09T14:47:16.624 INFO:teuthology.orchestra.run.smithi099.stdout:0 upgraded, 9 newly installed, 0 to remove and 275 not upgraded. 2024-03-09T14:47:16.625 INFO:teuthology.orchestra.run.smithi099.stdout:Need to get 46.1 MB of archives. 2024-03-09T14:47:16.625 INFO:teuthology.orchestra.run.smithi099.stdout:After this operation, 155 MB of additional disk space will be used. 2024-03-09T14:47:16.625 INFO:teuthology.orchestra.run.smithi099.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2 [125 kB] 2024-03-09T14:47:16.990 INFO:teuthology.orchestra.run.smithi099.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2 [2,037 kB] 2024-03-09T14:47:17.349 INFO:teuthology.orchestra.run.smithi099.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgail18 amd64 2.24.33-2ubuntu2 [15.9 kB] 2024-03-09T14:47:17.350 INFO:teuthology.orchestra.run.smithi099.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgail-common amd64 2.24.33-2ubuntu2 [132 kB] 2024-03-09T14:47:17.357 INFO:teuthology.orchestra.run.smithi099.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2 [7,932 B] 2024-03-09T14:47:17.357 INFO:teuthology.orchestra.run.smithi099.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u392-ga-1~22.04 [30.8 MB] 2024-03-09T14:47:18.430 INFO:teuthology.orchestra.run.smithi099.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u392-ga-1~22.04 [75.5 kB] 2024-03-09T14:47:18.431 INFO:teuthology.orchestra.run.smithi099.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u392-ga-1~22.04 [8,863 kB] 2024-03-09T14:47:18.675 INFO:teuthology.orchestra.run.smithi099.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u392-ga-1~22.04 [4,006 kB] 2024-03-09T14:47:19.078 INFO:teuthology.orchestra.run.smithi099.stderr:debconf: unable to initialize frontend: Dialog 2024-03-09T14:47:19.079 INFO:teuthology.orchestra.run.smithi099.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-03-09T14:47:19.079 INFO:teuthology.orchestra.run.smithi099.stderr:debconf: falling back to frontend: Readline 2024-03-09T14:47:19.089 INFO:teuthology.orchestra.run.smithi099.stderr:debconf: unable to initialize frontend: Readline 2024-03-09T14:47:19.089 INFO:teuthology.orchestra.run.smithi099.stderr:debconf: (This frontend requires a controlling tty.) 2024-03-09T14:47:19.089 INFO:teuthology.orchestra.run.smithi099.stderr:debconf: falling back to frontend: Teletype 2024-03-09T14:47:19.092 INFO:teuthology.orchestra.run.smithi099.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-03-09T14:47:19.124 INFO:teuthology.orchestra.run.smithi099.stdout:Fetched 46.1 MB in 2s (19.7 MB/s) 2024-03-09T14:47:19.385 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libgtk2.0-common. 2024-03-09T14:47:19.486 INFO:teuthology.orchestra.run.smithi099.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174563 files and directories currently installed.) 2024-03-09T14:47:19.491 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2_all.deb ... 2024-03-09T14:47:19.541 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2) ... 2024-03-09T14:47:19.913 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-03-09T14:47:19.941 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2_amd64.deb ... 2024-03-09T14:47:20.013 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2) ... 2024-03-09T14:47:20.401 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libgail18:amd64. 2024-03-09T14:47:20.429 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2_amd64.deb ... 2024-03-09T14:47:20.467 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2) ... 2024-03-09T14:47:20.729 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libgail-common:amd64. 2024-03-09T14:47:20.745 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2_amd64.deb ... 2024-03-09T14:47:20.787 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2) ... 2024-03-09T14:47:21.056 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-03-09T14:47:21.084 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2_amd64.deb ... 2024-03-09T14:47:21.123 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2) ... 2024-03-09T14:47:21.568 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-03-09T14:47:21.596 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u392-ga-1~22.04_amd64.deb ... 2024-03-09T14:47:21.630 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u392-ga-1~22.04) ... 2024-03-09T14:47:23.350 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-03-09T14:47:23.377 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../6-openjdk-8-jre_8u392-ga-1~22.04_amd64.deb ... 2024-03-09T14:47:23.419 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking openjdk-8-jre:amd64 (8u392-ga-1~22.04) ... 2024-03-09T14:47:23.871 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-03-09T14:47:23.898 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u392-ga-1~22.04_amd64.deb ... 2024-03-09T14:47:23.941 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u392-ga-1~22.04) ... 2024-03-09T14:47:24.674 INFO:teuthology.orchestra.run.smithi099.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-03-09T14:47:24.703 INFO:teuthology.orchestra.run.smithi099.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u392-ga-1~22.04_amd64.deb ... 2024-03-09T14:47:24.744 INFO:teuthology.orchestra.run.smithi099.stdout:Unpacking openjdk-8-jdk:amd64 (8u392-ga-1~22.04) ... 2024-03-09T14:47:25.119 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up openjdk-8-jre-headless:amd64 (8u392-ga-1~22.04) ... 2024-03-09T14:47:26.191 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-03-09T14:47:26.218 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-03-09T14:47:26.243 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-03-09T14:47:26.659 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2) ... 2024-03-09T14:47:26.819 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2) ... 2024-03-09T14:47:27.154 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up openjdk-8-jre:amd64 (8u392-ga-1~22.04) ... 2024-03-09T14:47:27.247 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-03-09T14:47:27.314 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u392-ga-1~22.04) ... 2024-03-09T14:47:27.406 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-03-09T14:47:27.426 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-03-09T14:47:27.452 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-03-09T14:47:27.477 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-03-09T14:47:27.604 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-03-09T14:47:27.767 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-03-09T14:47:27.876 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-03-09T14:47:27.969 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-03-09T14:47:28.020 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-03-09T14:47:28.072 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-03-09T14:47:28.096 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-03-09T14:47:28.123 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-03-09T14:47:28.187 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2) ... 2024-03-09T14:47:28.313 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2) ... 2024-03-09T14:47:28.439 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up openjdk-8-jdk:amd64 (8u392-ga-1~22.04) ... 2024-03-09T14:47:28.532 INFO:teuthology.orchestra.run.smithi099.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-03-09T14:47:28.616 INFO:teuthology.orchestra.run.smithi099.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2) ... 2024-03-09T14:47:28.727 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-03-09T14:47:29.836 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-03-09T14:47:29.946 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-03-09T14:47:30.223 INFO:teuthology.orchestra.run.smithi099.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-03-09T14:47:30.674 INFO:teuthology.orchestra.run.smithi099.stdout: Gradle will be installed under /opt/gradle 2024-03-09T14:47:30.700 INFO:teuthology.orchestra.run.smithi099.stderr:--2024-03-09 14:47:30-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-03-09T14:47:30.703 INFO:teuthology.orchestra.run.smithi099.stderr:Resolving services.gradle.org (services.gradle.org)... 104.17.129.37, 104.17.128.37, 2606:4700::6811:8025, ... 2024-03-09T14:47:30.713 INFO:teuthology.orchestra.run.smithi099.stderr:Connecting to services.gradle.org (services.gradle.org)|104.17.129.37|:443... connected. 2024-03-09T14:47:30.768 INFO:teuthology.orchestra.run.smithi099.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-03-09T14:47:30.768 INFO:teuthology.orchestra.run.smithi099.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-03-09T14:47:30.769 INFO:teuthology.orchestra.run.smithi099.stderr:--2024-03-09 14:47:30-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-03-09T14:47:30.769 INFO:teuthology.orchestra.run.smithi099.stderr:Resolving github.com (github.com)... 140.82.114.4 2024-03-09T14:47:30.781 INFO:teuthology.orchestra.run.smithi099.stderr:Connecting to github.com (github.com)|140.82.114.4|:443... connected. 2024-03-09T14:47:30.824 INFO:teuthology.orchestra.run.smithi099.stderr:HTTP request sent, awaiting response... 302 Found 2024-03-09T14:47:30.824 INFO:teuthology.orchestra.run.smithi099.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240309%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240309T144728Z&X-Amz-Expires=300&X-Amz-Signature=4b6cc1d07c79070f75bbcd72cd37b381a2df530adf6639e5dfbc2ee9e5e895d6&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-03-09T14:47:30.825 INFO:teuthology.orchestra.run.smithi099.stderr:--2024-03-09 14:47:30-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAVCODYLSA53PQK4ZA%2F20240309%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240309T144728Z&X-Amz-Expires=300&X-Amz-Signature=4b6cc1d07c79070f75bbcd72cd37b381a2df530adf6639e5dfbc2ee9e5e895d6&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-03-09T14:47:30.827 INFO:teuthology.orchestra.run.smithi099.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.108.133, 185.199.109.133, 185.199.110.133, ... 2024-03-09T14:47:30.842 INFO:teuthology.orchestra.run.smithi099.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.108.133|:443... connected. 2024-03-09T14:47:30.940 INFO:teuthology.orchestra.run.smithi099.stderr:HTTP request sent, awaiting response... 200 OK 2024-03-09T14:47:30.940 INFO:teuthology.orchestra.run.smithi099.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-03-09T14:47:30.940 INFO:teuthology.orchestra.run.smithi099.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-03-09T14:47:30.940 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-09T14:47:30.956 INFO:teuthology.orchestra.run.smithi099.stderr: 0K .......... .......... .......... .......... .......... 0% 2.88M 32s 2024-03-09T14:47:30.970 INFO:teuthology.orchestra.run.smithi099.stderr: 50K .......... .......... .......... .......... .......... 0% 3.70M 28s 2024-03-09T14:47:30.973 INFO:teuthology.orchestra.run.smithi099.stderr: 100K .......... .......... .......... .......... .......... 0% 15.0M 21s 2024-03-09T14:47:30.976 INFO:teuthology.orchestra.run.smithi099.stderr: 150K .......... .......... .......... .......... .......... 0% 14.7M 17s 2024-03-09T14:47:30.985 INFO:teuthology.orchestra.run.smithi099.stderr: 200K .......... .......... .......... .......... .......... 0% 5.72M 17s 2024-03-09T14:47:30.988 INFO:teuthology.orchestra.run.smithi099.stderr: 250K .......... .......... .......... .......... .......... 0% 16.1M 15s 2024-03-09T14:47:30.990 INFO:teuthology.orchestra.run.smithi099.stderr: 300K .......... .......... .......... .......... .......... 0% 24.0M 13s 2024-03-09T14:47:30.992 INFO:teuthology.orchestra.run.smithi099.stderr: 350K .......... .......... .......... .......... .......... 0% 27.4M 12s 2024-03-09T14:47:30.994 INFO:teuthology.orchestra.run.smithi099.stderr: 400K .......... .......... .......... .......... .......... 0% 18.8M 11s 2024-03-09T14:47:30.995 INFO:teuthology.orchestra.run.smithi099.stderr: 450K .......... .......... .......... .......... .......... 0% 37.8M 10s 2024-03-09T14:47:31.004 INFO:teuthology.orchestra.run.smithi099.stderr: 500K .......... .......... .......... .......... .......... 0% 5.68M 11s 2024-03-09T14:47:31.006 INFO:teuthology.orchestra.run.smithi099.stderr: 550K .......... .......... .......... .......... .......... 0% 38.7M 10s 2024-03-09T14:47:31.007 INFO:teuthology.orchestra.run.smithi099.stderr: 600K .......... .......... .......... .......... .......... 0% 27.0M 10s 2024-03-09T14:47:31.011 INFO:teuthology.orchestra.run.smithi099.stderr: 650K .......... .......... .......... .......... .......... 0% 24.0M 9s 2024-03-09T14:47:31.011 INFO:teuthology.orchestra.run.smithi099.stderr: 700K .......... .......... .......... .......... .......... 0% 56.1M 9s 2024-03-09T14:47:31.012 INFO:teuthology.orchestra.run.smithi099.stderr: 750K .......... .......... .......... .......... .......... 0% 27.3M 8s 2024-03-09T14:47:31.014 INFO:teuthology.orchestra.run.smithi099.stderr: 800K .......... .......... .......... .......... .......... 0% 32.4M 8s 2024-03-09T14:47:31.016 INFO:teuthology.orchestra.run.smithi099.stderr: 850K .......... .......... .......... .......... .......... 0% 22.5M 8s 2024-03-09T14:47:31.016 INFO:teuthology.orchestra.run.smithi099.stderr: 900K .......... .......... .......... .......... .......... 1% 53.6M 7s 2024-03-09T14:47:31.017 INFO:teuthology.orchestra.run.smithi099.stderr: 950K .......... .......... .......... .......... .......... 1% 57.2M 7s 2024-03-09T14:47:31.025 INFO:teuthology.orchestra.run.smithi099.stderr: 1000K .......... .......... .......... .......... .......... 1% 6.02M 8s 2024-03-09T14:47:31.027 INFO:teuthology.orchestra.run.smithi099.stderr: 1050K .......... .......... .......... .......... .......... 1% 31.9M 7s 2024-03-09T14:47:31.050 INFO:teuthology.orchestra.run.smithi099.stderr: 1100K .......... .......... .......... .......... .......... 1% 26.4M 7s 2024-03-09T14:47:31.050 INFO:teuthology.orchestra.run.smithi099.stderr: 1150K .......... .......... .......... .......... .......... 1% 106M 7s 2024-03-09T14:47:31.050 INFO:teuthology.orchestra.run.smithi099.stderr: 1200K .......... .......... .......... .......... .......... 1% 54.3M 7s 2024-03-09T14:47:31.050 INFO:teuthology.orchestra.run.smithi099.stderr: 1250K .......... .......... .......... .......... .......... 1% 41.7M 6s 2024-03-09T14:47:31.051 INFO:teuthology.orchestra.run.smithi099.stderr: 1300K .......... .......... .......... .......... .......... 1% 40.0M 6s 2024-03-09T14:47:31.051 INFO:teuthology.orchestra.run.smithi099.stderr: 1350K .......... .......... .......... .......... .......... 1% 23.5M 6s 2024-03-09T14:47:31.051 INFO:teuthology.orchestra.run.smithi099.stderr: 1400K .......... .......... .......... .......... .......... 1% 54.5M 6s 2024-03-09T14:47:31.051 INFO:teuthology.orchestra.run.smithi099.stderr: 1450K .......... .......... .......... .......... .......... 1% 121M 6s 2024-03-09T14:47:31.051 INFO:teuthology.orchestra.run.smithi099.stderr: 1500K .......... .......... .......... .......... .......... 1% 22.5M 6s 2024-03-09T14:47:31.051 INFO:teuthology.orchestra.run.smithi099.stderr: 1550K .......... .......... .......... .......... .......... 1% 59.8M 6s 2024-03-09T14:47:31.051 INFO:teuthology.orchestra.run.smithi099.stderr: 1600K .......... .......... .......... .......... .......... 1% 26.0M 6s 2024-03-09T14:47:31.051 INFO:teuthology.orchestra.run.smithi099.stderr: 1650K .......... .......... .......... .......... .......... 1% 118M 5s 2024-03-09T14:47:31.051 INFO:teuthology.orchestra.run.smithi099.stderr: 1700K .......... .......... .......... .......... .......... 1% 61.2M 5s 2024-03-09T14:47:31.052 INFO:teuthology.orchestra.run.smithi099.stderr: 1750K .......... .......... .......... .......... .......... 1% 22.6M 5s 2024-03-09T14:47:31.052 INFO:teuthology.orchestra.run.smithi099.stderr: 1800K .......... .......... .......... .......... .......... 1% 49.8M 5s 2024-03-09T14:47:31.052 INFO:teuthology.orchestra.run.smithi099.stderr: 1850K .......... .......... .......... .......... .......... 2% 32.6M 5s 2024-03-09T14:47:31.052 INFO:teuthology.orchestra.run.smithi099.stderr: 1900K .......... .......... .......... .......... .......... 2% 110M 5s 2024-03-09T14:47:31.052 INFO:teuthology.orchestra.run.smithi099.stderr: 1950K .......... .......... .......... .......... .......... 2% 57.8M 5s 2024-03-09T14:47:31.057 INFO:teuthology.orchestra.run.smithi099.stderr: 2000K .......... .......... .......... .......... .......... 2% 5.99M 5s 2024-03-09T14:47:31.058 INFO:teuthology.orchestra.run.smithi099.stderr: 2050K .......... .......... .......... .......... .......... 2% 49.3M 5s 2024-03-09T14:47:31.058 INFO:teuthology.orchestra.run.smithi099.stderr: 2100K .......... .......... .......... .......... .......... 2% 106M 5s 2024-03-09T14:47:31.059 INFO:teuthology.orchestra.run.smithi099.stderr: 2150K .......... .......... .......... .......... .......... 2% 28.0M 5s 2024-03-09T14:47:31.065 INFO:teuthology.orchestra.run.smithi099.stderr: 2200K .......... .......... .......... .......... .......... 2% 17.2M 5s 2024-03-09T14:47:31.065 INFO:teuthology.orchestra.run.smithi099.stderr: 2250K .......... .......... .......... .......... .......... 2% 41.7M 5s 2024-03-09T14:47:31.066 INFO:teuthology.orchestra.run.smithi099.stderr: 2300K .......... .......... .......... .......... .......... 2% 33.4M 5s 2024-03-09T14:47:31.067 INFO:teuthology.orchestra.run.smithi099.stderr: 2350K .......... .......... .......... .......... .......... 2% 31.7M 5s 2024-03-09T14:47:31.067 INFO:teuthology.orchestra.run.smithi099.stderr: 2400K .......... .......... .......... .......... .......... 2% 73.1M 5s 2024-03-09T14:47:31.070 INFO:teuthology.orchestra.run.smithi099.stderr: 2450K .......... .......... .......... .......... .......... 2% 16.7M 5s 2024-03-09T14:47:31.071 INFO:teuthology.orchestra.run.smithi099.stderr: 2500K .......... .......... .......... .......... .......... 2% 36.5M 5s 2024-03-09T14:47:31.073 INFO:teuthology.orchestra.run.smithi099.stderr: 2550K .......... .......... .......... .......... .......... 2% 36.4M 5s 2024-03-09T14:47:31.074 INFO:teuthology.orchestra.run.smithi099.stderr: 2600K .......... .......... .......... .......... .......... 2% 24.8M 5s 2024-03-09T14:47:31.075 INFO:teuthology.orchestra.run.smithi099.stderr: 2650K .......... .......... .......... .......... .......... 2% 56.1M 5s 2024-03-09T14:47:31.078 INFO:teuthology.orchestra.run.smithi099.stderr: 2700K .......... .......... .......... .......... .......... 2% 20.3M 5s 2024-03-09T14:47:31.079 INFO:teuthology.orchestra.run.smithi099.stderr: 2750K .......... .......... .......... .......... .......... 3% 37.0M 4s 2024-03-09T14:47:31.081 INFO:teuthology.orchestra.run.smithi099.stderr: 2800K .......... .......... .......... .......... .......... 3% 41.3M 4s 2024-03-09T14:47:31.081 INFO:teuthology.orchestra.run.smithi099.stderr: 2850K .......... .......... .......... .......... .......... 3% 72.6M 4s 2024-03-09T14:47:31.083 INFO:teuthology.orchestra.run.smithi099.stderr: 2900K .......... .......... .......... .......... .......... 3% 19.3M 4s 2024-03-09T14:47:31.085 INFO:teuthology.orchestra.run.smithi099.stderr: 2950K .......... .......... .......... .......... .......... 3% 39.3M 4s 2024-03-09T14:47:31.087 INFO:teuthology.orchestra.run.smithi099.stderr: 3000K .......... .......... .......... .......... .......... 3% 27.8M 4s 2024-03-09T14:47:31.088 INFO:teuthology.orchestra.run.smithi099.stderr: 3050K .......... .......... .......... .......... .......... 3% 33.5M 4s 2024-03-09T14:47:31.089 INFO:teuthology.orchestra.run.smithi099.stderr: 3100K .......... .......... .......... .......... .......... 3% 55.1M 4s 2024-03-09T14:47:31.097 INFO:teuthology.orchestra.run.smithi099.stderr: 3150K .......... .......... .......... .......... .......... 3% 5.92M 4s 2024-03-09T14:47:31.099 INFO:teuthology.orchestra.run.smithi099.stderr: 3200K .......... .......... .......... .......... .......... 3% 32.4M 4s 2024-03-09T14:47:31.100 INFO:teuthology.orchestra.run.smithi099.stderr: 3250K .......... .......... .......... .......... .......... 3% 34.2M 4s 2024-03-09T14:47:31.102 INFO:teuthology.orchestra.run.smithi099.stderr: 3300K .......... .......... .......... .......... .......... 3% 27.2M 4s 2024-03-09T14:47:31.105 INFO:teuthology.orchestra.run.smithi099.stderr: 3350K .......... .......... .......... .......... .......... 3% 17.1M 4s 2024-03-09T14:47:31.106 INFO:teuthology.orchestra.run.smithi099.stderr: 3400K .......... .......... .......... .......... .......... 3% 38.8M 4s 2024-03-09T14:47:31.108 INFO:teuthology.orchestra.run.smithi099.stderr: 3450K .......... .......... .......... .......... .......... 3% 23.0M 4s 2024-03-09T14:47:31.109 INFO:teuthology.orchestra.run.smithi099.stderr: 3500K .......... .......... .......... .......... .......... 3% 55.5M 4s 2024-03-09T14:47:31.111 INFO:teuthology.orchestra.run.smithi099.stderr: 3550K .......... .......... .......... .......... .......... 3% 21.3M 4s 2024-03-09T14:47:31.115 INFO:teuthology.orchestra.run.smithi099.stderr: 3600K .......... .......... .......... .......... .......... 3% 14.0M 4s 2024-03-09T14:47:31.116 INFO:teuthology.orchestra.run.smithi099.stderr: 3650K .......... .......... .......... .......... .......... 3% 39.5M 4s 2024-03-09T14:47:31.119 INFO:teuthology.orchestra.run.smithi099.stderr: 3700K .......... .......... .......... .......... .......... 4% 18.6M 4s 2024-03-09T14:47:31.119 INFO:teuthology.orchestra.run.smithi099.stderr: 3750K .......... .......... .......... .......... .......... 4% 59.8M 4s 2024-03-09T14:47:31.122 INFO:teuthology.orchestra.run.smithi099.stderr: 3800K .......... .......... .......... .......... .......... 4% 22.0M 4s 2024-03-09T14:47:31.126 INFO:teuthology.orchestra.run.smithi099.stderr: 3850K .......... .......... .......... .......... .......... 4% 21.4M 4s 2024-03-09T14:47:31.126 INFO:teuthology.orchestra.run.smithi099.stderr: 3900K .......... .......... .......... .......... .......... 4% 25.4M 4s 2024-03-09T14:47:31.127 INFO:teuthology.orchestra.run.smithi099.stderr: 3950K .......... .......... .......... .......... .......... 4% 44.2M 4s 2024-03-09T14:47:31.129 INFO:teuthology.orchestra.run.smithi099.stderr: 4000K .......... .......... .......... .......... .......... 4% 23.1M 4s 2024-03-09T14:47:31.131 INFO:teuthology.orchestra.run.smithi099.stderr: 4050K .......... .......... .......... .......... .......... 4% 31.8M 4s 2024-03-09T14:47:31.133 INFO:teuthology.orchestra.run.smithi099.stderr: 4100K .......... .......... .......... .......... .......... 4% 22.6M 4s 2024-03-09T14:47:31.139 INFO:teuthology.orchestra.run.smithi099.stderr: 4150K .......... .......... .......... .......... .......... 4% 20.4M 4s 2024-03-09T14:47:31.139 INFO:teuthology.orchestra.run.smithi099.stderr: 4200K .......... .......... .......... .......... .......... 4% 52.7M 4s 2024-03-09T14:47:31.139 INFO:teuthology.orchestra.run.smithi099.stderr: 4250K .......... .......... .......... .......... .......... 4% 20.5M 4s 2024-03-09T14:47:31.147 INFO:teuthology.orchestra.run.smithi099.stderr: 4300K .......... .......... .......... .......... .......... 4% 6.09M 4s 2024-03-09T14:47:31.148 INFO:teuthology.orchestra.run.smithi099.stderr: 4350K .......... .......... .......... .......... .......... 4% 27.8M 4s 2024-03-09T14:47:31.149 INFO:teuthology.orchestra.run.smithi099.stderr: 4400K .......... .......... .......... .......... .......... 4% 32.9M 4s 2024-03-09T14:47:31.152 INFO:teuthology.orchestra.run.smithi099.stderr: 4450K .......... .......... .......... .......... .......... 4% 18.4M 4s 2024-03-09T14:47:31.156 INFO:teuthology.orchestra.run.smithi099.stderr: 4500K .......... .......... .......... .......... .......... 4% 13.8M 4s 2024-03-09T14:47:31.157 INFO:teuthology.orchestra.run.smithi099.stderr: 4550K .......... .......... .......... .......... .......... 4% 34.1M 4s 2024-03-09T14:47:31.159 INFO:teuthology.orchestra.run.smithi099.stderr: 4600K .......... .......... .......... .......... .......... 5% 28.2M 4s 2024-03-09T14:47:31.161 INFO:teuthology.orchestra.run.smithi099.stderr: 4650K .......... .......... .......... .......... .......... 5% 35.7M 4s 2024-03-09T14:47:31.162 INFO:teuthology.orchestra.run.smithi099.stderr: 4700K .......... .......... .......... .......... .......... 5% 22.9M 4s 2024-03-09T14:47:31.165 INFO:teuthology.orchestra.run.smithi099.stderr: 4750K .......... .......... .......... .......... .......... 5% 24.4M 4s 2024-03-09T14:47:31.171 INFO:teuthology.orchestra.run.smithi099.stderr: 4800K .......... .......... .......... .......... .......... 5% 9.23M 4s 2024-03-09T14:47:31.171 INFO:teuthology.orchestra.run.smithi099.stderr: 4850K .......... .......... .......... .......... .......... 5% 55.6M 4s 2024-03-09T14:47:31.174 INFO:teuthology.orchestra.run.smithi099.stderr: 4900K .......... .......... .......... .......... .......... 5% 15.7M 4s 2024-03-09T14:47:31.175 INFO:teuthology.orchestra.run.smithi099.stderr: 4950K .......... .......... .......... .......... .......... 5% 50.7M 4s 2024-03-09T14:47:31.178 INFO:teuthology.orchestra.run.smithi099.stderr: 5000K .......... .......... .......... .......... .......... 5% 17.7M 4s 2024-03-09T14:47:31.180 INFO:teuthology.orchestra.run.smithi099.stderr: 5050K .......... .......... .......... .......... .......... 5% 19.7M 4s 2024-03-09T14:47:31.183 INFO:teuthology.orchestra.run.smithi099.stderr: 5100K .......... .......... .......... .......... .......... 5% 18.3M 4s 2024-03-09T14:47:31.184 INFO:teuthology.orchestra.run.smithi099.stderr: 5150K .......... .......... .......... .......... .......... 5% 54.2M 4s 2024-03-09T14:47:31.186 INFO:teuthology.orchestra.run.smithi099.stderr: 5200K .......... .......... .......... .......... .......... 5% 20.8M 4s 2024-03-09T14:47:31.187 INFO:teuthology.orchestra.run.smithi099.stderr: 5250K .......... .......... .......... .......... .......... 5% 31.7M 4s 2024-03-09T14:47:31.190 INFO:teuthology.orchestra.run.smithi099.stderr: 5300K .......... .......... .......... .......... .......... 5% 17.9M 4s 2024-03-09T14:47:31.193 INFO:teuthology.orchestra.run.smithi099.stderr: 5350K .......... .......... .......... .......... .......... 5% 20.1M 4s 2024-03-09T14:47:31.195 INFO:teuthology.orchestra.run.smithi099.stderr: 5400K .......... .......... .......... .......... .......... 5% 23.8M 4s 2024-03-09T14:47:31.197 INFO:teuthology.orchestra.run.smithi099.stderr: 5450K .......... .......... .......... .......... .......... 5% 18.6M 4s 2024-03-09T14:47:31.199 INFO:teuthology.orchestra.run.smithi099.stderr: 5500K .......... .......... .......... .......... .......... 5% 34.6M 4s 2024-03-09T14:47:31.220 INFO:teuthology.orchestra.run.smithi099.stderr: 5550K .......... .......... .......... .......... .......... 6% 27.9M 4s 2024-03-09T14:47:31.220 INFO:teuthology.orchestra.run.smithi099.stderr: 5600K .......... .......... .......... .......... .......... 6% 103M 4s 2024-03-09T14:47:31.220 INFO:teuthology.orchestra.run.smithi099.stderr: 5650K .......... .......... .......... .......... .......... 6% 43.9M 4s 2024-03-09T14:47:31.220 INFO:teuthology.orchestra.run.smithi099.stderr: 5700K .......... .......... .......... .......... .......... 6% 68.0M 4s 2024-03-09T14:47:31.220 INFO:teuthology.orchestra.run.smithi099.stderr: 5750K .......... .......... .......... .......... .......... 6% 91.6M 4s 2024-03-09T14:47:31.221 INFO:teuthology.orchestra.run.smithi099.stderr: 5800K .......... .......... .......... .......... .......... 6% 78.0M 4s 2024-03-09T14:47:31.221 INFO:teuthology.orchestra.run.smithi099.stderr: 5850K .......... .......... .......... .......... .......... 6% 115M 4s 2024-03-09T14:47:31.221 INFO:teuthology.orchestra.run.smithi099.stderr: 5900K .......... .......... .......... .......... .......... 6% 106M 4s 2024-03-09T14:47:31.221 INFO:teuthology.orchestra.run.smithi099.stderr: 5950K .......... .......... .......... .......... .......... 6% 114M 4s 2024-03-09T14:47:31.221 INFO:teuthology.orchestra.run.smithi099.stderr: 6000K .......... .......... .......... .......... .......... 6% 80.9M 4s 2024-03-09T14:47:31.221 INFO:teuthology.orchestra.run.smithi099.stderr: 6050K .......... .......... .......... .......... .......... 6% 114M 4s 2024-03-09T14:47:31.221 INFO:teuthology.orchestra.run.smithi099.stderr: 6100K .......... .......... .......... .......... .......... 6% 61.5M 4s 2024-03-09T14:47:31.221 INFO:teuthology.orchestra.run.smithi099.stderr: 6150K .......... .......... .......... .......... .......... 6% 117M 4s 2024-03-09T14:47:31.221 INFO:teuthology.orchestra.run.smithi099.stderr: 6200K .......... .......... .......... .......... .......... 6% 100M 4s 2024-03-09T14:47:31.221 INFO:teuthology.orchestra.run.smithi099.stderr: 6250K .......... .......... .......... .......... .......... 6% 89.2M 4s 2024-03-09T14:47:31.221 INFO:teuthology.orchestra.run.smithi099.stderr: 6300K .......... .......... .......... .......... .......... 6% 105M 4s 2024-03-09T14:47:31.221 INFO:teuthology.orchestra.run.smithi099.stderr: 6350K .......... .......... .......... .......... .......... 6% 79.2M 4s 2024-03-09T14:47:31.222 INFO:teuthology.orchestra.run.smithi099.stderr: 6400K .......... .......... .......... .......... .......... 6% 121M 4s 2024-03-09T14:47:31.222 INFO:teuthology.orchestra.run.smithi099.stderr: 6450K .......... .......... .......... .......... .......... 6% 85.6M 4s 2024-03-09T14:47:31.222 INFO:teuthology.orchestra.run.smithi099.stderr: 6500K .......... .......... .......... .......... .......... 7% 75.1M 4s 2024-03-09T14:47:31.222 INFO:teuthology.orchestra.run.smithi099.stderr: 6550K .......... .......... .......... .......... .......... 7% 111M 4s 2024-03-09T14:47:31.222 INFO:teuthology.orchestra.run.smithi099.stderr: 6600K .......... .......... .......... .......... .......... 7% 85.0M 4s 2024-03-09T14:47:31.222 INFO:teuthology.orchestra.run.smithi099.stderr: 6650K .......... .......... .......... .......... .......... 7% 82.5M 4s 2024-03-09T14:47:31.222 INFO:teuthology.orchestra.run.smithi099.stderr: 6700K .......... .......... .......... .......... .......... 7% 86.3M 3s 2024-03-09T14:47:31.222 INFO:teuthology.orchestra.run.smithi099.stderr: 6750K .......... .......... .......... .......... .......... 7% 96.9M 3s 2024-03-09T14:47:31.222 INFO:teuthology.orchestra.run.smithi099.stderr: 6800K .......... .......... .......... .......... .......... 7% 103M 3s 2024-03-09T14:47:31.222 INFO:teuthology.orchestra.run.smithi099.stderr: 6850K .......... .......... .......... .......... .......... 7% 54.9M 3s 2024-03-09T14:47:31.222 INFO:teuthology.orchestra.run.smithi099.stderr: 6900K .......... .......... .......... .......... .......... 7% 32.1M 3s 2024-03-09T14:47:31.222 INFO:teuthology.orchestra.run.smithi099.stderr: 6950K .......... .......... .......... .......... .......... 7% 24.3M 3s 2024-03-09T14:47:31.226 INFO:teuthology.orchestra.run.smithi099.stderr: 7000K .......... .......... .......... .......... .......... 7% 27.2M 3s 2024-03-09T14:47:31.226 INFO:teuthology.orchestra.run.smithi099.stderr: 7050K .......... .......... .......... .......... .......... 7% 41.4M 3s 2024-03-09T14:47:31.226 INFO:teuthology.orchestra.run.smithi099.stderr: 7100K .......... .......... .......... .......... .......... 7% 44.6M 3s 2024-03-09T14:47:31.226 INFO:teuthology.orchestra.run.smithi099.stderr: 7150K .......... .......... .......... .......... .......... 7% 34.2M 3s 2024-03-09T14:47:31.226 INFO:teuthology.orchestra.run.smithi099.stderr: 7200K .......... .......... .......... .......... .......... 7% 47.5M 3s 2024-03-09T14:47:31.227 INFO:teuthology.orchestra.run.smithi099.stderr: 7250K .......... .......... .......... .......... .......... 7% 37.7M 3s 2024-03-09T14:47:31.227 INFO:teuthology.orchestra.run.smithi099.stderr: 7300K .......... .......... .......... .......... .......... 7% 93.0M 3s 2024-03-09T14:47:31.238 INFO:teuthology.orchestra.run.smithi099.stderr: 7350K .......... .......... .......... .......... .......... 7% 52.3M 3s 2024-03-09T14:47:31.238 INFO:teuthology.orchestra.run.smithi099.stderr: 7400K .......... .......... .......... .......... .......... 8% 59.1M 3s 2024-03-09T14:47:31.238 INFO:teuthology.orchestra.run.smithi099.stderr: 7450K .......... .......... .......... .......... .......... 8% 120M 3s 2024-03-09T14:47:31.238 INFO:teuthology.orchestra.run.smithi099.stderr: 7500K .......... .......... .......... .......... .......... 8% 62.4M 3s 2024-03-09T14:47:31.238 INFO:teuthology.orchestra.run.smithi099.stderr: 7550K .......... .......... .......... .......... .......... 8% 70.2M 3s 2024-03-09T14:47:31.238 INFO:teuthology.orchestra.run.smithi099.stderr: 7600K .......... .......... .......... .......... .......... 8% 72.6M 3s 2024-03-09T14:47:31.238 INFO:teuthology.orchestra.run.smithi099.stderr: 7650K .......... .......... .......... .......... .......... 8% 108M 3s 2024-03-09T14:47:31.238 INFO:teuthology.orchestra.run.smithi099.stderr: 7700K .......... .......... .......... .......... .......... 8% 106M 3s 2024-03-09T14:47:31.239 INFO:teuthology.orchestra.run.smithi099.stderr: 7750K .......... .......... .......... .......... .......... 8% 123M 3s 2024-03-09T14:47:31.239 INFO:teuthology.orchestra.run.smithi099.stderr: 7800K .......... .......... .......... .......... .......... 8% 96.7M 3s 2024-03-09T14:47:31.239 INFO:teuthology.orchestra.run.smithi099.stderr: 7850K .......... .......... .......... .......... .......... 8% 58.5M 3s 2024-03-09T14:47:31.239 INFO:teuthology.orchestra.run.smithi099.stderr: 7900K .......... .......... .......... .......... .......... 8% 105M 3s 2024-03-09T14:47:31.239 INFO:teuthology.orchestra.run.smithi099.stderr: 7950K .......... .......... .......... .......... .......... 8% 51.5M 3s 2024-03-09T14:47:31.239 INFO:teuthology.orchestra.run.smithi099.stderr: 8000K .......... .......... .......... .......... .......... 8% 42.9M 3s 2024-03-09T14:47:31.239 INFO:teuthology.orchestra.run.smithi099.stderr: 8050K .......... .......... .......... .......... .......... 8% 48.2M 3s 2024-03-09T14:47:31.242 INFO:teuthology.orchestra.run.smithi099.stderr: 8100K .......... .......... .......... .......... .......... 8% 51.6M 3s 2024-03-09T14:47:31.242 INFO:teuthology.orchestra.run.smithi099.stderr: 8150K .......... .......... .......... .......... .......... 8% 51.3M 3s 2024-03-09T14:47:31.242 INFO:teuthology.orchestra.run.smithi099.stderr: 8200K .......... .......... .......... .......... .......... 8% 99.5M 3s 2024-03-09T14:47:31.243 INFO:teuthology.orchestra.run.smithi099.stderr: 8250K .......... .......... .......... .......... .......... 8% 48.9M 3s 2024-03-09T14:47:31.243 INFO:teuthology.orchestra.run.smithi099.stderr: 8300K .......... .......... .......... .......... .......... 8% 54.3M 3s 2024-03-09T14:47:31.244 INFO:teuthology.orchestra.run.smithi099.stderr: 8350K .......... .......... .......... .......... .......... 9% 44.5M 3s 2024-03-09T14:47:31.244 INFO:teuthology.orchestra.run.smithi099.stderr: 8400K .......... .......... .......... .......... .......... 9% 51.0M 3s 2024-03-09T14:47:31.244 INFO:teuthology.orchestra.run.smithi099.stderr: 8450K .......... .......... .......... .......... .......... 9% 105M 3s 2024-03-09T14:47:31.245 INFO:teuthology.orchestra.run.smithi099.stderr: 8500K .......... .......... .......... .......... .......... 9% 48.1M 3s 2024-03-09T14:47:31.247 INFO:teuthology.orchestra.run.smithi099.stderr: 8550K .......... .......... .......... .......... .......... 9% 31.5M 3s 2024-03-09T14:47:31.249 INFO:teuthology.orchestra.run.smithi099.stderr: 8600K .......... .......... .......... .......... .......... 9% 34.6M 3s 2024-03-09T14:47:31.249 INFO:teuthology.orchestra.run.smithi099.stderr: 8650K .......... .......... .......... .......... .......... 9% 115M 3s 2024-03-09T14:47:31.250 INFO:teuthology.orchestra.run.smithi099.stderr: 8700K .......... .......... .......... .......... .......... 9% 34.9M 3s 2024-03-09T14:47:31.251 INFO:teuthology.orchestra.run.smithi099.stderr: 8750K .......... .......... .......... .......... .......... 9% 51.3M 3s 2024-03-09T14:47:31.253 INFO:teuthology.orchestra.run.smithi099.stderr: 8800K .......... .......... .......... .......... .......... 9% 35.7M 3s 2024-03-09T14:47:31.254 INFO:teuthology.orchestra.run.smithi099.stderr: 8850K .......... .......... .......... .......... .......... 9% 35.0M 3s 2024-03-09T14:47:31.254 INFO:teuthology.orchestra.run.smithi099.stderr: 8900K .......... .......... .......... .......... .......... 9% 120M 3s 2024-03-09T14:47:31.256 INFO:teuthology.orchestra.run.smithi099.stderr: 8950K .......... .......... .......... .......... .......... 9% 40.6M 3s 2024-03-09T14:47:31.257 INFO:teuthology.orchestra.run.smithi099.stderr: 9000K .......... .......... .......... .......... .......... 9% 47.2M 3s 2024-03-09T14:47:31.258 INFO:teuthology.orchestra.run.smithi099.stderr: 9050K .......... .......... .......... .......... .......... 9% 41.3M 3s 2024-03-09T14:47:31.259 INFO:teuthology.orchestra.run.smithi099.stderr: 9100K .......... .......... .......... .......... .......... 9% 48.2M 3s 2024-03-09T14:47:31.259 INFO:teuthology.orchestra.run.smithi099.stderr: 9150K .......... .......... .......... .......... .......... 9% 121M 3s 2024-03-09T14:47:31.260 INFO:teuthology.orchestra.run.smithi099.stderr: 9200K .......... .......... .......... .......... .......... 9% 52.4M 3s 2024-03-09T14:47:31.262 INFO:teuthology.orchestra.run.smithi099.stderr: 9250K .......... .......... .......... .......... .......... 10% 32.9M 3s 2024-03-09T14:47:31.262 INFO:teuthology.orchestra.run.smithi099.stderr: 9300K .......... .......... .......... .......... .......... 10% 119M 3s 2024-03-09T14:47:31.264 INFO:teuthology.orchestra.run.smithi099.stderr: 9350K .......... .......... .......... .......... .......... 10% 31.4M 3s 2024-03-09T14:47:31.265 INFO:teuthology.orchestra.run.smithi099.stderr: 9400K .......... .......... .......... .......... .......... 10% 34.5M 3s 2024-03-09T14:47:31.267 INFO:teuthology.orchestra.run.smithi099.stderr: 9450K .......... .......... .......... .......... .......... 10% 32.1M 3s 2024-03-09T14:47:31.268 INFO:teuthology.orchestra.run.smithi099.stderr: 9500K .......... .......... .......... .......... .......... 10% 31.2M 3s 2024-03-09T14:47:31.269 INFO:teuthology.orchestra.run.smithi099.stderr: 9550K .......... .......... .......... .......... .......... 10% 99.0M 3s 2024-03-09T14:47:31.270 INFO:teuthology.orchestra.run.smithi099.stderr: 9600K .......... .......... .......... .......... .......... 10% 32.4M 3s 2024-03-09T14:47:31.272 INFO:teuthology.orchestra.run.smithi099.stderr: 9650K .......... .......... .......... .......... .......... 10% 32.4M 3s 2024-03-09T14:47:31.273 INFO:teuthology.orchestra.run.smithi099.stderr: 9700K .......... .......... .......... .......... .......... 10% 31.9M 3s 2024-03-09T14:47:31.275 INFO:teuthology.orchestra.run.smithi099.stderr: 9750K .......... .......... .......... .......... .......... 10% 31.4M 3s 2024-03-09T14:47:31.275 INFO:teuthology.orchestra.run.smithi099.stderr: 9800K .......... .......... .......... .......... .......... 10% 103M 3s 2024-03-09T14:47:31.277 INFO:teuthology.orchestra.run.smithi099.stderr: 9850K .......... .......... .......... .......... .......... 10% 33.8M 3s 2024-03-09T14:47:31.283 INFO:teuthology.orchestra.run.smithi099.stderr: 9900K .......... .......... .......... .......... .......... 10% 34.8M 3s 2024-03-09T14:47:31.283 INFO:teuthology.orchestra.run.smithi099.stderr: 9950K .......... .......... .......... .......... .......... 10% 128M 3s 2024-03-09T14:47:31.283 INFO:teuthology.orchestra.run.smithi099.stderr: 10000K .......... .......... .......... .......... .......... 10% 114M 3s 2024-03-09T14:47:31.283 INFO:teuthology.orchestra.run.smithi099.stderr: 10050K .......... .......... .......... .......... .......... 10% 84.9M 3s 2024-03-09T14:47:31.283 INFO:teuthology.orchestra.run.smithi099.stderr: 10100K .......... .......... .......... .......... .......... 10% 112M 3s 2024-03-09T14:47:31.283 INFO:teuthology.orchestra.run.smithi099.stderr: 10150K .......... .......... .......... .......... .......... 10% 106M 3s 2024-03-09T14:47:31.283 INFO:teuthology.orchestra.run.smithi099.stderr: 10200K .......... .......... .......... .......... .......... 11% 116M 3s 2024-03-09T14:47:31.283 INFO:teuthology.orchestra.run.smithi099.stderr: 10250K .......... .......... .......... .......... .......... 11% 108M 3s 2024-03-09T14:47:31.283 INFO:teuthology.orchestra.run.smithi099.stderr: 10300K .......... .......... .......... .......... .......... 11% 58.2M 3s 2024-03-09T14:47:31.284 INFO:teuthology.orchestra.run.smithi099.stderr: 10350K .......... .......... .......... .......... .......... 11% 26.8M 3s 2024-03-09T14:47:31.286 INFO:teuthology.orchestra.run.smithi099.stderr: 10400K .......... .......... .......... .......... .......... 11% 27.8M 3s 2024-03-09T14:47:31.288 INFO:teuthology.orchestra.run.smithi099.stderr: 10450K .......... .......... .......... .......... .......... 11% 26.9M 3s 2024-03-09T14:47:31.288 INFO:teuthology.orchestra.run.smithi099.stderr: 10500K .......... .......... .......... .......... .......... 11% 108M 3s 2024-03-09T14:47:31.289 INFO:teuthology.orchestra.run.smithi099.stderr: 10550K .......... .......... .......... .......... .......... 11% 34.2M 3s 2024-03-09T14:47:31.291 INFO:teuthology.orchestra.run.smithi099.stderr: 10600K .......... .......... .......... .......... .......... 11% 32.7M 3s 2024-03-09T14:47:31.292 INFO:teuthology.orchestra.run.smithi099.stderr: 10650K .......... .......... .......... .......... .......... 11% 33.0M 3s 2024-03-09T14:47:31.294 INFO:teuthology.orchestra.run.smithi099.stderr: 10700K .......... .......... .......... .......... .......... 11% 24.4M 3s 2024-03-09T14:47:31.295 INFO:teuthology.orchestra.run.smithi099.stderr: 10750K .......... .......... .......... .......... .......... 11% 73.1M 3s 2024-03-09T14:47:31.297 INFO:teuthology.orchestra.run.smithi099.stderr: 10800K .......... .......... .......... .......... .......... 11% 25.7M 3s 2024-03-09T14:47:31.299 INFO:teuthology.orchestra.run.smithi099.stderr: 10850K .......... .......... .......... .......... .......... 11% 25.3M 3s 2024-03-09T14:47:31.301 INFO:teuthology.orchestra.run.smithi099.stderr: 10900K .......... .......... .......... .......... .......... 11% 25.9M 3s 2024-03-09T14:47:31.303 INFO:teuthology.orchestra.run.smithi099.stderr: 10950K .......... .......... .......... .......... .......... 11% 25.2M 3s 2024-03-09T14:47:31.303 INFO:teuthology.orchestra.run.smithi099.stderr: 11000K .......... .......... .......... .......... .......... 11% 91.7M 3s 2024-03-09T14:47:31.305 INFO:teuthology.orchestra.run.smithi099.stderr: 11050K .......... .......... .......... .......... .......... 11% 26.6M 3s 2024-03-09T14:47:31.307 INFO:teuthology.orchestra.run.smithi099.stderr: 11100K .......... .......... .......... .......... .......... 12% 24.4M 3s 2024-03-09T14:47:31.308 INFO:teuthology.orchestra.run.smithi099.stderr: 11150K .......... .......... .......... .......... .......... 12% 48.1M 3s 2024-03-09T14:47:31.315 INFO:teuthology.orchestra.run.smithi099.stderr: 11200K .......... .......... .......... .......... .......... 12% 90.1M 3s 2024-03-09T14:47:31.315 INFO:teuthology.orchestra.run.smithi099.stderr: 11250K .......... .......... .......... .......... .......... 12% 34.1M 3s 2024-03-09T14:47:31.315 INFO:teuthology.orchestra.run.smithi099.stderr: 11300K .......... .......... .......... .......... .......... 12% 91.7M 3s 2024-03-09T14:47:31.315 INFO:teuthology.orchestra.run.smithi099.stderr: 11350K .......... .......... .......... .......... .......... 12% 93.6M 3s 2024-03-09T14:47:31.315 INFO:teuthology.orchestra.run.smithi099.stderr: 11400K .......... .......... .......... .......... .......... 12% 92.6M 3s 2024-03-09T14:47:31.315 INFO:teuthology.orchestra.run.smithi099.stderr: 11450K .......... .......... .......... .......... .......... 12% 88.3M 3s 2024-03-09T14:47:31.316 INFO:teuthology.orchestra.run.smithi099.stderr: 11500K .......... .......... .......... .......... .......... 12% 100M 3s 2024-03-09T14:47:31.316 INFO:teuthology.orchestra.run.smithi099.stderr: 11550K .......... .......... .......... .......... .......... 12% 93.5M 3s 2024-03-09T14:47:31.316 INFO:teuthology.orchestra.run.smithi099.stderr: 11600K .......... .......... .......... .......... .......... 12% 36.8M 3s 2024-03-09T14:47:31.317 INFO:teuthology.orchestra.run.smithi099.stderr: 11650K .......... .......... .......... .......... .......... 12% 30.7M 3s 2024-03-09T14:47:31.317 INFO:teuthology.orchestra.run.smithi099.stderr: 11700K .......... .......... .......... .......... .......... 12% 87.5M 3s 2024-03-09T14:47:31.318 INFO:teuthology.orchestra.run.smithi099.stderr: 11750K .......... .......... .......... .......... .......... 12% 36.5M 3s 2024-03-09T14:47:31.320 INFO:teuthology.orchestra.run.smithi099.stderr: 11800K .......... .......... .......... .......... .......... 12% 35.9M 3s 2024-03-09T14:47:31.321 INFO:teuthology.orchestra.run.smithi099.stderr: 11850K .......... .......... .......... .......... .......... 12% 33.5M 3s 2024-03-09T14:47:31.322 INFO:teuthology.orchestra.run.smithi099.stderr: 11900K .......... .......... .......... .......... .......... 12% 95.1M 3s 2024-03-09T14:47:31.323 INFO:teuthology.orchestra.run.smithi099.stderr: 11950K .......... .......... .......... .......... .......... 12% 33.5M 3s 2024-03-09T14:47:31.325 INFO:teuthology.orchestra.run.smithi099.stderr: 12000K .......... .......... .......... .......... .......... 12% 31.1M 3s 2024-03-09T14:47:31.327 INFO:teuthology.orchestra.run.smithi099.stderr: 12050K .......... .......... .......... .......... .......... 13% 21.7M 3s 2024-03-09T14:47:31.330 INFO:teuthology.orchestra.run.smithi099.stderr: 12100K .......... .......... .......... .......... .......... 13% 26.7M 3s 2024-03-09T14:47:31.330 INFO:teuthology.orchestra.run.smithi099.stderr: 12150K .......... .......... .......... .......... .......... 13% 90.1M 3s 2024-03-09T14:47:31.632 INFO:teuthology.orchestra.run.smithi099.stderr: 12200K .......... .......... .......... .......... .......... 13% 28.7M 3s 2024-03-09T14:47:31.633 INFO:teuthology.orchestra.run.smithi099.stderr: 12250K .......... .......... .......... .......... .......... 13% 73.8M 3s 2024-03-09T14:47:31.633 INFO:teuthology.orchestra.run.smithi099.stderr: 12300K .......... .......... .......... .......... .......... 13% 81.7M 3s 2024-03-09T14:47:31.633 INFO:teuthology.orchestra.run.smithi099.stderr: 12350K .......... .......... .......... .......... .......... 13% 78.0M 3s 2024-03-09T14:47:31.633 INFO:teuthology.orchestra.run.smithi099.stderr: 12400K .......... .......... .......... .......... .......... 13% 70.0M 3s 2024-03-09T14:47:31.633 INFO:teuthology.orchestra.run.smithi099.stderr: 12450K .......... .......... .......... .......... .......... 13% 65.0M 3s 2024-03-09T14:47:31.633 INFO:teuthology.orchestra.run.smithi099.stderr: 12500K .......... .......... .......... .......... .......... 13% 83.7M 3s 2024-03-09T14:47:31.633 INFO:teuthology.orchestra.run.smithi099.stderr: 12550K .......... .......... .......... .......... .......... 13% 81.2M 3s 2024-03-09T14:47:31.633 INFO:teuthology.orchestra.run.smithi099.stderr: 12600K .......... .......... .......... .......... .......... 13% 77.9M 3s 2024-03-09T14:47:31.633 INFO:teuthology.orchestra.run.smithi099.stderr: 12650K .......... .......... .......... .......... .......... 13% 74.4M 3s 2024-03-09T14:47:31.633 INFO:teuthology.orchestra.run.smithi099.stderr: 12700K .......... .......... .......... .......... .......... 13% 81.1M 2s 2024-03-09T14:47:31.633 INFO:teuthology.orchestra.run.smithi099.stderr: 12750K .......... .......... .......... .......... .......... 13% 71.1M 2s 2024-03-09T14:47:31.633 INFO:teuthology.orchestra.run.smithi099.stderr: 12800K .......... .......... .......... .......... .......... 13% 71.8M 2s 2024-03-09T14:47:31.633 INFO:teuthology.orchestra.run.smithi099.stderr: 12850K .......... .......... .......... .......... .......... 13% 79.2M 2s 2024-03-09T14:47:31.633 INFO:teuthology.orchestra.run.smithi099.stderr: 12900K .......... .......... .......... .......... .......... 13% 79.3M 2s 2024-03-09T14:47:31.634 INFO:teuthology.orchestra.run.smithi099.stderr: 12950K .......... .......... .......... .......... .......... 13% 84.7M 2s 2024-03-09T14:47:31.634 INFO:teuthology.orchestra.run.smithi099.stderr: 13000K .......... .......... .......... .......... .......... 14% 71.6M 2s 2024-03-09T14:47:31.634 INFO:teuthology.orchestra.run.smithi099.stderr: 13050K .......... .......... .......... .......... .......... 14% 82.7M 2s 2024-03-09T14:47:31.634 INFO:teuthology.orchestra.run.smithi099.stderr: 13100K .......... .......... .......... .......... .......... 14% 86.8M 2s 2024-03-09T14:47:31.634 INFO:teuthology.orchestra.run.smithi099.stderr: 13150K .......... .......... .......... .......... .......... 14% 80.9M 2s 2024-03-09T14:47:31.634 INFO:teuthology.orchestra.run.smithi099.stderr: 13200K .......... .......... .......... .......... .......... 14% 78.0M 2s 2024-03-09T14:47:31.634 INFO:teuthology.orchestra.run.smithi099.stderr: 13250K .......... .......... .......... .......... .......... 14% 92.5M 2s 2024-03-09T14:47:31.634 INFO:teuthology.orchestra.run.smithi099.stderr: 13300K .......... .......... .......... .......... .......... 14% 80.7M 2s 2024-03-09T14:47:31.634 INFO:teuthology.orchestra.run.smithi099.stderr: 13350K .......... .......... .......... .......... .......... 14% 86.3M 2s 2024-03-09T14:47:31.634 INFO:teuthology.orchestra.run.smithi099.stderr: 13400K .......... .......... .......... .......... .......... 14% 75.6M 2s 2024-03-09T14:47:31.634 INFO:teuthology.orchestra.run.smithi099.stderr: 13450K .......... .......... .......... .......... .......... 14% 82.0M 2s 2024-03-09T14:47:31.634 INFO:teuthology.orchestra.run.smithi099.stderr: 13500K .......... .......... .......... .......... .......... 14% 29.7M 2s 2024-03-09T14:47:31.634 INFO:teuthology.orchestra.run.smithi099.stderr: 13550K .......... .......... .......... .......... .......... 14% 84.2M 2s 2024-03-09T14:47:31.634 INFO:teuthology.orchestra.run.smithi099.stderr: 13600K .......... .......... .......... .......... .......... 14% 71.6M 2s 2024-03-09T14:47:31.634 INFO:teuthology.orchestra.run.smithi099.stderr: 13650K .......... .......... .......... .......... .......... 14% 76.6M 2s 2024-03-09T14:47:31.635 INFO:teuthology.orchestra.run.smithi099.stderr: 13700K .......... .......... .......... .......... .......... 14% 81.1M 2s 2024-03-09T14:47:31.635 INFO:teuthology.orchestra.run.smithi099.stderr: 13750K .......... .......... .......... .......... .......... 14% 79.3M 2s 2024-03-09T14:47:31.635 INFO:teuthology.orchestra.run.smithi099.stderr: 13800K .......... .......... .......... .......... .......... 14% 67.5M 2s 2024-03-09T14:47:31.635 INFO:teuthology.orchestra.run.smithi099.stderr: 13850K .......... .......... .......... .......... .......... 14% 77.2M 2s 2024-03-09T14:47:31.635 INFO:teuthology.orchestra.run.smithi099.stderr: 13900K .......... .......... .......... .......... .......... 15% 82.2M 2s 2024-03-09T14:47:31.635 INFO:teuthology.orchestra.run.smithi099.stderr: 13950K .......... .......... .......... .......... .......... 15% 79.8M 2s 2024-03-09T14:47:31.635 INFO:teuthology.orchestra.run.smithi099.stderr: 14000K .......... .......... .......... .......... .......... 15% 69.3M 2s 2024-03-09T14:47:31.635 INFO:teuthology.orchestra.run.smithi099.stderr: 14050K .......... .......... .......... .......... .......... 15% 80.3M 2s 2024-03-09T14:47:31.635 INFO:teuthology.orchestra.run.smithi099.stderr: 14100K .......... .......... .......... .......... .......... 15% 77.3M 2s 2024-03-09T14:47:31.635 INFO:teuthology.orchestra.run.smithi099.stderr: 14150K .......... .......... .......... .......... .......... 15% 78.4M 2s 2024-03-09T14:47:31.635 INFO:teuthology.orchestra.run.smithi099.stderr: 14200K .......... .......... .......... .......... .......... 15% 67.6M 2s 2024-03-09T14:47:31.635 INFO:teuthology.orchestra.run.smithi099.stderr: 14250K .......... .......... .......... .......... .......... 15% 80.7M 2s 2024-03-09T14:47:31.635 INFO:teuthology.orchestra.run.smithi099.stderr: 14300K .......... .......... .......... .......... .......... 15% 80.5M 2s 2024-03-09T14:47:31.635 INFO:teuthology.orchestra.run.smithi099.stderr: 14350K .......... .......... .......... .......... .......... 15% 132M 2s 2024-03-09T14:47:31.635 INFO:teuthology.orchestra.run.smithi099.stderr: 14400K .......... .......... .......... .......... .......... 15% 122M 2s 2024-03-09T14:47:31.636 INFO:teuthology.orchestra.run.smithi099.stderr: 14450K .......... .......... .......... .......... .......... 15% 133M 2s 2024-03-09T14:47:31.636 INFO:teuthology.orchestra.run.smithi099.stderr: 14500K .......... .......... .......... .......... .......... 15% 140M 2s 2024-03-09T14:47:31.636 INFO:teuthology.orchestra.run.smithi099.stderr: 14550K .......... .......... .......... .......... .......... 15% 131M 2s 2024-03-09T14:47:31.636 INFO:teuthology.orchestra.run.smithi099.stderr: 14600K .......... .......... .......... .......... .......... 15% 101M 2s 2024-03-09T14:47:31.636 INFO:teuthology.orchestra.run.smithi099.stderr: 14650K .......... .......... .......... .......... .......... 15% 129M 2s 2024-03-09T14:47:31.636 INFO:teuthology.orchestra.run.smithi099.stderr: 14700K .......... .......... .......... .......... .......... 15% 137M 2s 2024-03-09T14:47:31.636 INFO:teuthology.orchestra.run.smithi099.stderr: 14750K .......... .......... .......... .......... .......... 15% 137M 2s 2024-03-09T14:47:31.636 INFO:teuthology.orchestra.run.smithi099.stderr: 14800K .......... .......... .......... .......... .......... 15% 121M 2s 2024-03-09T14:47:31.636 INFO:teuthology.orchestra.run.smithi099.stderr: 14850K .......... .......... .......... .......... .......... 16% 152M 2s 2024-03-09T14:47:31.636 INFO:teuthology.orchestra.run.smithi099.stderr: 14900K .......... .......... .......... .......... .......... 16% 156M 2s 2024-03-09T14:47:31.636 INFO:teuthology.orchestra.run.smithi099.stderr: 14950K .......... .......... .......... .......... .......... 16% 158M 2s 2024-03-09T14:47:31.636 INFO:teuthology.orchestra.run.smithi099.stderr: 15000K .......... .......... .......... .......... .......... 16% 129M 2s 2024-03-09T14:47:31.636 INFO:teuthology.orchestra.run.smithi099.stderr: 15050K .......... .......... .......... .......... .......... 16% 168M 2s 2024-03-09T14:47:31.636 INFO:teuthology.orchestra.run.smithi099.stderr: 15100K .......... .......... .......... .......... .......... 16% 138M 2s 2024-03-09T14:47:31.636 INFO:teuthology.orchestra.run.smithi099.stderr: 15150K .......... .......... .......... .......... .......... 16% 175M 2s 2024-03-09T14:47:31.637 INFO:teuthology.orchestra.run.smithi099.stderr: 15200K .......... .......... .......... .......... .......... 16% 157M 2s 2024-03-09T14:47:31.637 INFO:teuthology.orchestra.run.smithi099.stderr: 15250K .......... .......... .......... .......... .......... 16% 158M 2s 2024-03-09T14:47:31.637 INFO:teuthology.orchestra.run.smithi099.stderr: 15300K .......... .......... .......... .......... .......... 16% 125M 2s 2024-03-09T14:47:31.637 INFO:teuthology.orchestra.run.smithi099.stderr: 15350K .......... .......... .......... .......... .......... 16% 76.3M 2s 2024-03-09T14:47:31.637 INFO:teuthology.orchestra.run.smithi099.stderr: 15400K .......... .......... .......... .......... .......... 16% 116M 2s 2024-03-09T14:47:31.637 INFO:teuthology.orchestra.run.smithi099.stderr: 15450K .......... .......... .......... .......... .......... 16% 81.1M 2s 2024-03-09T14:47:31.637 INFO:teuthology.orchestra.run.smithi099.stderr: 15500K .......... .......... .......... .......... .......... 16% 84.9M 2s 2024-03-09T14:47:31.637 INFO:teuthology.orchestra.run.smithi099.stderr: 15550K .......... .......... .......... .......... .......... 16% 97.9M 2s 2024-03-09T14:47:31.637 INFO:teuthology.orchestra.run.smithi099.stderr: 15600K .......... .......... .......... .......... .......... 16% 97.5M 2s 2024-03-09T14:47:31.637 INFO:teuthology.orchestra.run.smithi099.stderr: 15650K .......... .......... .......... .......... .......... 16% 114M 2s 2024-03-09T14:47:31.637 INFO:teuthology.orchestra.run.smithi099.stderr: 15700K .......... .......... .......... .......... .......... 16% 88.4M 2s 2024-03-09T14:47:31.637 INFO:teuthology.orchestra.run.smithi099.stderr: 15750K .......... .......... .......... .......... .......... 17% 103M 2s 2024-03-09T14:47:31.637 INFO:teuthology.orchestra.run.smithi099.stderr: 15800K .......... .......... .......... .......... .......... 17% 113M 2s 2024-03-09T14:47:31.637 INFO:teuthology.orchestra.run.smithi099.stderr: 15850K .......... .......... .......... .......... .......... 17% 117M 2s 2024-03-09T14:47:31.637 INFO:teuthology.orchestra.run.smithi099.stderr: 15900K .......... .......... .......... .......... .......... 17% 109M 2s 2024-03-09T14:47:31.638 INFO:teuthology.orchestra.run.smithi099.stderr: 15950K .......... .......... .......... .......... .......... 17% 114M 2s 2024-03-09T14:47:31.638 INFO:teuthology.orchestra.run.smithi099.stderr: 16000K .......... .......... .......... .......... .......... 17% 126M 2s 2024-03-09T14:47:31.638 INFO:teuthology.orchestra.run.smithi099.stderr: 16050K .......... .......... .......... .......... .......... 17% 101M 2s 2024-03-09T14:47:31.638 INFO:teuthology.orchestra.run.smithi099.stderr: 16100K .......... .......... .......... .......... .......... 17% 85.9M 2s 2024-03-09T14:47:31.638 INFO:teuthology.orchestra.run.smithi099.stderr: 16150K .......... .......... .......... .......... .......... 17% 127M 2s 2024-03-09T14:47:31.638 INFO:teuthology.orchestra.run.smithi099.stderr: 16200K .......... .......... .......... .......... .......... 17% 108M 2s 2024-03-09T14:47:31.638 INFO:teuthology.orchestra.run.smithi099.stderr: 16250K .......... .......... .......... .......... .......... 17% 137M 2s 2024-03-09T14:47:31.638 INFO:teuthology.orchestra.run.smithi099.stderr: 16300K .......... .......... .......... .......... .......... 17% 81.1M 2s 2024-03-09T14:47:31.638 INFO:teuthology.orchestra.run.smithi099.stderr: 16350K .......... .......... .......... .......... .......... 17% 155M 2s 2024-03-09T14:47:31.638 INFO:teuthology.orchestra.run.smithi099.stderr: 16400K .......... .......... .......... .......... .......... 17% 113M 2s 2024-03-09T14:47:31.638 INFO:teuthology.orchestra.run.smithi099.stderr: 16450K .......... .......... .......... .......... .......... 17% 123M 2s 2024-03-09T14:47:31.638 INFO:teuthology.orchestra.run.smithi099.stderr: 16500K .......... .......... .......... .......... .......... 17% 92.0M 2s 2024-03-09T14:47:31.638 INFO:teuthology.orchestra.run.smithi099.stderr: 16550K .......... .......... .......... .......... .......... 17% 114M 2s 2024-03-09T14:47:31.638 INFO:teuthology.orchestra.run.smithi099.stderr: 16600K .......... .......... .......... .......... .......... 17% 127M 2s 2024-03-09T14:47:31.639 INFO:teuthology.orchestra.run.smithi099.stderr: 16650K .......... .......... .......... .......... .......... 17% 111M 2s 2024-03-09T14:47:31.639 INFO:teuthology.orchestra.run.smithi099.stderr: 16700K .......... .......... .......... .......... .......... 18% 113M 2s 2024-03-09T14:47:31.639 INFO:teuthology.orchestra.run.smithi099.stderr: 16750K .......... .......... .......... .......... .......... 18% 110M 2s 2024-03-09T14:47:31.639 INFO:teuthology.orchestra.run.smithi099.stderr: 16800K .......... .......... .......... .......... .......... 18% 113M 2s 2024-03-09T14:47:31.639 INFO:teuthology.orchestra.run.smithi099.stderr: 16850K .......... .......... .......... .......... .......... 18% 116M 2s 2024-03-09T14:47:31.639 INFO:teuthology.orchestra.run.smithi099.stderr: 16900K .......... .......... .......... .......... .......... 18% 72.5M 2s 2024-03-09T14:47:31.639 INFO:teuthology.orchestra.run.smithi099.stderr: 16950K .......... .......... .......... .......... .......... 18% 55.7M 2s 2024-03-09T14:47:31.639 INFO:teuthology.orchestra.run.smithi099.stderr: 17000K .......... .......... .......... .......... .......... 18% 52.5M 2s 2024-03-09T14:47:31.639 INFO:teuthology.orchestra.run.smithi099.stderr: 17050K .......... .......... .......... .......... .......... 18% 101M 2s 2024-03-09T14:47:31.639 INFO:teuthology.orchestra.run.smithi099.stderr: 17100K .......... .......... .......... .......... .......... 18% 48.9M 2s 2024-03-09T14:47:31.639 INFO:teuthology.orchestra.run.smithi099.stderr: 17150K .......... .......... .......... .......... .......... 18% 41.4M 2s 2024-03-09T14:47:31.639 INFO:teuthology.orchestra.run.smithi099.stderr: 17200K .......... .......... .......... .......... .......... 18% 44.2M 2s 2024-03-09T14:47:31.639 INFO:teuthology.orchestra.run.smithi099.stderr: 17250K .......... .......... .......... .......... .......... 18% 40.6M 2s 2024-03-09T14:47:31.639 INFO:teuthology.orchestra.run.smithi099.stderr: 17300K .......... .......... .......... .......... .......... 18% 104M 2s 2024-03-09T14:47:31.639 INFO:teuthology.orchestra.run.smithi099.stderr: 17350K .......... .......... .......... .......... .......... 18% 48.3M 2s 2024-03-09T14:47:31.640 INFO:teuthology.orchestra.run.smithi099.stderr: 17400K .......... .......... .......... .......... .......... 18% 46.9M 2s 2024-03-09T14:47:31.640 INFO:teuthology.orchestra.run.smithi099.stderr: 17450K .......... .......... .......... .......... .......... 18% 49.3M 2s 2024-03-09T14:47:31.640 INFO:teuthology.orchestra.run.smithi099.stderr: 17500K .......... .......... .......... .......... .......... 18% 105M 2s 2024-03-09T14:47:31.640 INFO:teuthology.orchestra.run.smithi099.stderr: 17550K .......... .......... .......... .......... .......... 18% 50.5M 2s 2024-03-09T14:47:31.640 INFO:teuthology.orchestra.run.smithi099.stderr: 17600K .......... .......... .......... .......... .......... 18% 59.3M 2s 2024-03-09T14:47:31.640 INFO:teuthology.orchestra.run.smithi099.stderr: 17650K .......... .......... .......... .......... .......... 19% 43.2M 2s 2024-03-09T14:47:31.640 INFO:teuthology.orchestra.run.smithi099.stderr: 17700K .......... .......... .......... .......... .......... 19% 55.2M 2s 2024-03-09T14:47:31.640 INFO:teuthology.orchestra.run.smithi099.stderr: 17750K .......... .......... .......... .......... .......... 19% 117M 2s 2024-03-09T14:47:31.640 INFO:teuthology.orchestra.run.smithi099.stderr: 17800K .......... .......... .......... .......... .......... 19% 49.4M 2s 2024-03-09T14:47:31.640 INFO:teuthology.orchestra.run.smithi099.stderr: 17850K .......... .......... .......... .......... .......... 19% 43.1M 2s 2024-03-09T14:47:31.640 INFO:teuthology.orchestra.run.smithi099.stderr: 17900K .......... .......... .......... .......... .......... 19% 57.9M 2s 2024-03-09T14:47:31.640 INFO:teuthology.orchestra.run.smithi099.stderr: 17950K .......... .......... .......... .......... .......... 19% 105M 2s 2024-03-09T14:47:31.640 INFO:teuthology.orchestra.run.smithi099.stderr: 18000K .......... .......... .......... .......... .......... 19% 52.4M 2s 2024-03-09T14:47:31.640 INFO:teuthology.orchestra.run.smithi099.stderr: 18050K .......... .......... .......... .......... .......... 19% 34.4M 2s 2024-03-09T14:47:31.641 INFO:teuthology.orchestra.run.smithi099.stderr: 18100K .......... .......... .......... .......... .......... 19% 74.9M 2s 2024-03-09T14:47:31.641 INFO:teuthology.orchestra.run.smithi099.stderr: 18150K .......... .......... .......... .......... .......... 19% 53.8M 2s 2024-03-09T14:47:31.641 INFO:teuthology.orchestra.run.smithi099.stderr: 18200K .......... .......... .......... .......... .......... 19% 107M 2s 2024-03-09T14:47:31.641 INFO:teuthology.orchestra.run.smithi099.stderr: 18250K .......... .......... .......... .......... .......... 19% 55.1M 2s 2024-03-09T14:47:31.641 INFO:teuthology.orchestra.run.smithi099.stderr: 18300K .......... .......... .......... .......... .......... 19% 48.7M 2s 2024-03-09T14:47:31.641 INFO:teuthology.orchestra.run.smithi099.stderr: 18350K .......... .......... .......... .......... .......... 19% 44.9M 2s 2024-03-09T14:47:31.641 INFO:teuthology.orchestra.run.smithi099.stderr: 18400K .......... .......... .......... .......... .......... 19% 105M 2s 2024-03-09T14:47:31.641 INFO:teuthology.orchestra.run.smithi099.stderr: 18450K .......... .......... .......... .......... .......... 19% 49.6M 2s 2024-03-09T14:47:31.641 INFO:teuthology.orchestra.run.smithi099.stderr: 18500K .......... .......... .......... .......... .......... 19% 48.3M 2s 2024-03-09T14:47:31.641 INFO:teuthology.orchestra.run.smithi099.stderr: 18550K .......... .......... .......... .......... .......... 20% 52.2M 2s 2024-03-09T14:47:31.641 INFO:teuthology.orchestra.run.smithi099.stderr: 18600K .......... .......... .......... .......... .......... 20% 48.8M 2s 2024-03-09T14:47:31.641 INFO:teuthology.orchestra.run.smithi099.stderr: 18650K .......... .......... .......... .......... .......... 20% 89.6M 2s 2024-03-09T14:47:31.641 INFO:teuthology.orchestra.run.smithi099.stderr: 18700K .......... .......... .......... .......... .......... 20% 38.9M 2s 2024-03-09T14:47:31.641 INFO:teuthology.orchestra.run.smithi099.stderr: 18750K .......... .......... .......... .......... .......... 20% 49.9M 2s 2024-03-09T14:47:31.641 INFO:teuthology.orchestra.run.smithi099.stderr: 18800K .......... .......... .......... .......... .......... 20% 35.3M 2s 2024-03-09T14:47:31.642 INFO:teuthology.orchestra.run.smithi099.stderr: 18850K .......... .......... .......... .......... .......... 20% 30.5M 2s 2024-03-09T14:47:31.642 INFO:teuthology.orchestra.run.smithi099.stderr: 18900K .......... .......... .......... .......... .......... 20% 36.2M 2s 2024-03-09T14:47:31.642 INFO:teuthology.orchestra.run.smithi099.stderr: 18950K .......... .......... .......... .......... .......... 20% 95.7M 2s 2024-03-09T14:47:31.642 INFO:teuthology.orchestra.run.smithi099.stderr: 19000K .......... .......... .......... .......... .......... 20% 26.8M 2s 2024-03-09T14:47:31.642 INFO:teuthology.orchestra.run.smithi099.stderr: 19050K .......... .......... .......... .......... .......... 20% 28.5M 2s 2024-03-09T14:47:31.642 INFO:teuthology.orchestra.run.smithi099.stderr: 19100K .......... .......... .......... .......... .......... 20% 34.3M 2s 2024-03-09T14:47:31.642 INFO:teuthology.orchestra.run.smithi099.stderr: 19150K .......... .......... .......... .......... .......... 20% 97.4M 2s 2024-03-09T14:47:31.642 INFO:teuthology.orchestra.run.smithi099.stderr: 19200K .......... .......... .......... .......... .......... 20% 32.3M 2s 2024-03-09T14:47:31.642 INFO:teuthology.orchestra.run.smithi099.stderr: 19250K .......... .......... .......... .......... .......... 20% 27.0M 2s 2024-03-09T14:47:31.642 INFO:teuthology.orchestra.run.smithi099.stderr: 19300K .......... .......... .......... .......... .......... 20% 54.9M 2s 2024-03-09T14:47:31.642 INFO:teuthology.orchestra.run.smithi099.stderr: 19350K .......... .......... .......... .......... .......... 20% 32.0M 2s 2024-03-09T14:47:31.642 INFO:teuthology.orchestra.run.smithi099.stderr: 19400K .......... .......... .......... .......... .......... 20% 99.3M 2s 2024-03-09T14:47:31.642 INFO:teuthology.orchestra.run.smithi099.stderr: 19450K .......... .......... .......... .......... .......... 20% 34.8M 2s 2024-03-09T14:47:31.642 INFO:teuthology.orchestra.run.smithi099.stderr: 19500K .......... .......... .......... .......... .......... 21% 100M 2s 2024-03-09T14:47:31.642 INFO:teuthology.orchestra.run.smithi099.stderr: 19550K .......... .......... .......... .......... .......... 21% 103M 2s 2024-03-09T14:47:31.643 INFO:teuthology.orchestra.run.smithi099.stderr: 19600K .......... .......... .......... .......... .......... 21% 105M 2s 2024-03-09T14:47:31.643 INFO:teuthology.orchestra.run.smithi099.stderr: 19650K .......... .......... .......... .......... .......... 21% 52.3M 2s 2024-03-09T14:47:31.643 INFO:teuthology.orchestra.run.smithi099.stderr: 19700K .......... .......... .......... .......... .......... 21% 110M 2s 2024-03-09T14:47:31.643 INFO:teuthology.orchestra.run.smithi099.stderr: 19750K .......... .......... .......... .......... .......... 21% 93.7M 2s 2024-03-09T14:47:31.643 INFO:teuthology.orchestra.run.smithi099.stderr: 19800K .......... .......... .......... .......... .......... 21% 105M 2s 2024-03-09T14:47:31.643 INFO:teuthology.orchestra.run.smithi099.stderr: 19850K .......... .......... .......... .......... .......... 21% 84.7M 2s 2024-03-09T14:47:31.643 INFO:teuthology.orchestra.run.smithi099.stderr: 19900K .......... .......... .......... .......... .......... 21% 97.1M 2s 2024-03-09T14:47:31.643 INFO:teuthology.orchestra.run.smithi099.stderr: 19950K .......... .......... .......... .......... .......... 21% 96.1M 2s 2024-03-09T14:47:31.643 INFO:teuthology.orchestra.run.smithi099.stderr: 20000K .......... .......... .......... .......... .......... 21% 95.7M 2s 2024-03-09T14:47:31.643 INFO:teuthology.orchestra.run.smithi099.stderr: 20050K .......... .......... .......... .......... .......... 21% 135M 2s 2024-03-09T14:47:31.643 INFO:teuthology.orchestra.run.smithi099.stderr: 20100K .......... .......... .......... .......... .......... 21% 155M 2s 2024-03-09T14:47:31.643 INFO:teuthology.orchestra.run.smithi099.stderr: 20150K .......... .......... .......... .......... .......... 21% 95.2M 2s 2024-03-09T14:47:31.643 INFO:teuthology.orchestra.run.smithi099.stderr: 20200K .......... .......... .......... .......... .......... 21% 33.4M 2s 2024-03-09T14:47:31.643 INFO:teuthology.orchestra.run.smithi099.stderr: 20250K .......... .......... .......... .......... .......... 21% 26.8M 2s 2024-03-09T14:47:31.643 INFO:teuthology.orchestra.run.smithi099.stderr: 20300K .......... .......... .......... .......... .......... 21% 97.5M 2s 2024-03-09T14:47:31.644 INFO:teuthology.orchestra.run.smithi099.stderr: 20350K .......... .......... .......... .......... .......... 21% 70.7M 2s 2024-03-09T14:47:31.644 INFO:teuthology.orchestra.run.smithi099.stderr: 20400K .......... .......... .......... .......... .......... 22% 40.8M 2s 2024-03-09T14:47:31.644 INFO:teuthology.orchestra.run.smithi099.stderr: 20450K .......... .......... .......... .......... .......... 22% 29.8M 2s 2024-03-09T14:47:31.644 INFO:teuthology.orchestra.run.smithi099.stderr: 20500K .......... .......... .......... .......... .......... 22% 47.4M 2s 2024-03-09T14:47:31.644 INFO:teuthology.orchestra.run.smithi099.stderr: 20550K .......... .......... .......... .......... .......... 22% 97.5M 2s 2024-03-09T14:47:31.644 INFO:teuthology.orchestra.run.smithi099.stderr: 20600K .......... .......... .......... .......... .......... 22% 36.3M 2s 2024-03-09T14:47:31.644 INFO:teuthology.orchestra.run.smithi099.stderr: 20650K .......... .......... .......... .......... .......... 22% 33.9M 2s 2024-03-09T14:47:31.644 INFO:teuthology.orchestra.run.smithi099.stderr: 20700K .......... .......... .......... .......... .......... 22% 36.4M 2s 2024-03-09T14:47:31.644 INFO:teuthology.orchestra.run.smithi099.stderr: 20750K .......... .......... .......... .......... .......... 22% 111M 2s 2024-03-09T14:47:31.644 INFO:teuthology.orchestra.run.smithi099.stderr: 20800K .......... .......... .......... .......... .......... 22% 31.9M 2s 2024-03-09T14:47:31.644 INFO:teuthology.orchestra.run.smithi099.stderr: 20850K .......... .......... .......... .......... .......... 22% 51.0M 2s 2024-03-09T14:47:31.644 INFO:teuthology.orchestra.run.smithi099.stderr: 20900K .......... .......... .......... .......... .......... 22% 47.0M 2s 2024-03-09T14:47:31.644 INFO:teuthology.orchestra.run.smithi099.stderr: 20950K .......... .......... .......... .......... .......... 22% 31.5M 2s 2024-03-09T14:47:31.644 INFO:teuthology.orchestra.run.smithi099.stderr: 21000K .......... .......... .......... .......... .......... 22% 54.0M 2s 2024-03-09T14:47:31.644 INFO:teuthology.orchestra.run.smithi099.stderr: 21050K .......... .......... .......... .......... .......... 22% 39.9M 2s 2024-03-09T14:47:31.645 INFO:teuthology.orchestra.run.smithi099.stderr: 21100K .......... .......... .......... .......... .......... 22% 56.1M 2s 2024-03-09T14:47:31.645 INFO:teuthology.orchestra.run.smithi099.stderr: 21150K .......... .......... .......... .......... .......... 22% 81.8M 2s 2024-03-09T14:47:31.645 INFO:teuthology.orchestra.run.smithi099.stderr: 21200K .......... .......... .......... .......... .......... 22% 34.0M 2s 2024-03-09T14:47:31.645 INFO:teuthology.orchestra.run.smithi099.stderr: 21250K .......... .......... .......... .......... .......... 22% 95.7M 2s 2024-03-09T14:47:31.645 INFO:teuthology.orchestra.run.smithi099.stderr: 21300K .......... .......... .......... .......... .......... 22% 103M 2s 2024-03-09T14:47:31.645 INFO:teuthology.orchestra.run.smithi099.stderr: 21350K .......... .......... .......... .......... .......... 23% 35.7M 2s 2024-03-09T14:47:31.645 INFO:teuthology.orchestra.run.smithi099.stderr: 21400K .......... .......... .......... .......... .......... 23% 35.1M 2s 2024-03-09T14:47:31.645 INFO:teuthology.orchestra.run.smithi099.stderr: 21450K .......... .......... .......... .......... .......... 23% 99.0M 2s 2024-03-09T14:47:31.645 INFO:teuthology.orchestra.run.smithi099.stderr: 21500K .......... .......... .......... .......... .......... 23% 68.6M 2s 2024-03-09T14:47:31.645 INFO:teuthology.orchestra.run.smithi099.stderr: 21550K .......... .......... .......... .......... .......... 23% 45.7M 2s 2024-03-09T14:47:31.645 INFO:teuthology.orchestra.run.smithi099.stderr: 21600K .......... .......... .......... .......... .......... 23% 86.1M 2s 2024-03-09T14:47:31.645 INFO:teuthology.orchestra.run.smithi099.stderr: 21650K .......... .......... .......... .......... .......... 23% 58.3M 2s 2024-03-09T14:47:31.645 INFO:teuthology.orchestra.run.smithi099.stderr: 21700K .......... .......... .......... .......... .......... 23% 107M 2s 2024-03-09T14:47:31.645 INFO:teuthology.orchestra.run.smithi099.stderr: 21750K .......... .......... .......... .......... .......... 23% 75.3M 2s 2024-03-09T14:47:31.645 INFO:teuthology.orchestra.run.smithi099.stderr: 21800K .......... .......... .......... .......... .......... 23% 60.1M 2s 2024-03-09T14:47:31.646 INFO:teuthology.orchestra.run.smithi099.stderr: 21850K .......... .......... .......... .......... .......... 23% 43.5M 2s 2024-03-09T14:47:31.646 INFO:teuthology.orchestra.run.smithi099.stderr: 21900K .......... .......... .......... .......... .......... 23% 35.9M 2s 2024-03-09T14:47:31.646 INFO:teuthology.orchestra.run.smithi099.stderr: 21950K .......... .......... .......... .......... .......... 23% 96.3M 2s 2024-03-09T14:47:31.646 INFO:teuthology.orchestra.run.smithi099.stderr: 22000K .......... .......... .......... .......... .......... 23% 45.2M 2s 2024-03-09T14:47:31.646 INFO:teuthology.orchestra.run.smithi099.stderr: 22050K .......... .......... .......... .......... .......... 23% 47.8M 2s 2024-03-09T14:47:31.646 INFO:teuthology.orchestra.run.smithi099.stderr: 22100K .......... .......... .......... .......... .......... 23% 46.8M 2s 2024-03-09T14:47:31.646 INFO:teuthology.orchestra.run.smithi099.stderr: 22150K .......... .......... .......... .......... .......... 23% 100M 2s 2024-03-09T14:47:31.646 INFO:teuthology.orchestra.run.smithi099.stderr: 22200K .......... .......... .......... .......... .......... 23% 37.9M 2s 2024-03-09T14:47:31.646 INFO:teuthology.orchestra.run.smithi099.stderr: 22250K .......... .......... .......... .......... .......... 24% 34.4M 2s 2024-03-09T14:47:31.646 INFO:teuthology.orchestra.run.smithi099.stderr: 22300K .......... .......... .......... .......... .......... 24% 67.6M 2s 2024-03-09T14:47:31.646 INFO:teuthology.orchestra.run.smithi099.stderr: 22350K .......... .......... .......... .......... .......... 24% 97.5M 2s 2024-03-09T14:47:31.646 INFO:teuthology.orchestra.run.smithi099.stderr: 22400K .......... .......... .......... .......... .......... 24% 90.0M 2s 2024-03-09T14:47:31.646 INFO:teuthology.orchestra.run.smithi099.stderr: 22450K .......... .......... .......... .......... .......... 24% 88.0M 2s 2024-03-09T14:47:31.646 INFO:teuthology.orchestra.run.smithi099.stderr: 22500K .......... .......... .......... .......... .......... 24% 107M 2s 2024-03-09T14:47:31.646 INFO:teuthology.orchestra.run.smithi099.stderr: 22550K .......... .......... .......... .......... .......... 24% 96.5M 2s 2024-03-09T14:47:31.647 INFO:teuthology.orchestra.run.smithi099.stderr: 22600K .......... .......... .......... .......... .......... 24% 99.7M 2s 2024-03-09T14:47:31.647 INFO:teuthology.orchestra.run.smithi099.stderr: 22650K .......... .......... .......... .......... .......... 24% 81.3M 2s 2024-03-09T14:47:31.647 INFO:teuthology.orchestra.run.smithi099.stderr: 22700K .......... .......... .......... .......... .......... 24% 105M 2s 2024-03-09T14:47:31.647 INFO:teuthology.orchestra.run.smithi099.stderr: 22750K .......... .......... .......... .......... .......... 24% 105M 2s 2024-03-09T14:47:31.647 INFO:teuthology.orchestra.run.smithi099.stderr: 22800K .......... .......... .......... .......... .......... 24% 82.7M 2s 2024-03-09T14:47:31.647 INFO:teuthology.orchestra.run.smithi099.stderr: 22850K .......... .......... .......... .......... .......... 24% 81.4M 2s 2024-03-09T14:47:31.647 INFO:teuthology.orchestra.run.smithi099.stderr: 22900K .......... .......... .......... .......... .......... 24% 85.3M 2s 2024-03-09T14:47:31.647 INFO:teuthology.orchestra.run.smithi099.stderr: 22950K .......... .......... .......... .......... .......... 24% 86.6M 2s 2024-03-09T14:47:31.647 INFO:teuthology.orchestra.run.smithi099.stderr: 23000K .......... .......... .......... .......... .......... 24% 80.2M 2s 2024-03-09T14:47:31.647 INFO:teuthology.orchestra.run.smithi099.stderr: 23050K .......... .......... .......... .......... .......... 24% 85.5M 2s 2024-03-09T14:47:31.647 INFO:teuthology.orchestra.run.smithi099.stderr: 23100K .......... .......... .......... .......... .......... 24% 90.3M 2s 2024-03-09T14:47:31.647 INFO:teuthology.orchestra.run.smithi099.stderr: 23150K .......... .......... .......... .......... .......... 24% 135M 2s 2024-03-09T14:47:31.647 INFO:teuthology.orchestra.run.smithi099.stderr: 23200K .......... .......... .......... .......... .......... 25% 173M 2s 2024-03-09T14:47:31.647 INFO:teuthology.orchestra.run.smithi099.stderr: 23250K .......... .......... .......... .......... .......... 25% 45.8M 2s 2024-03-09T14:47:31.648 INFO:teuthology.orchestra.run.smithi099.stderr: 23300K .......... .......... .......... .......... .......... 25% 50.8M 2s 2024-03-09T14:47:31.648 INFO:teuthology.orchestra.run.smithi099.stderr: 23350K .......... .......... .......... .......... .......... 25% 104M 2s 2024-03-09T14:47:31.648 INFO:teuthology.orchestra.run.smithi099.stderr: 23400K .......... .......... .......... .......... .......... 25% 42.9M 2s 2024-03-09T14:47:31.648 INFO:teuthology.orchestra.run.smithi099.stderr: 23450K .......... .......... .......... .......... .......... 25% 26.3M 2s 2024-03-09T14:47:31.648 INFO:teuthology.orchestra.run.smithi099.stderr: 23500K .......... .......... .......... .......... .......... 25% 23.9M 2s 2024-03-09T14:47:31.648 INFO:teuthology.orchestra.run.smithi099.stderr: 23550K .......... .......... .......... .......... .......... 25% 39.7M 2s 2024-03-09T14:47:31.648 INFO:teuthology.orchestra.run.smithi099.stderr: 23600K .......... .......... .......... .......... .......... 25% 93.0M 2s 2024-03-09T14:47:31.648 INFO:teuthology.orchestra.run.smithi099.stderr: 23650K .......... .......... .......... .......... .......... 25% 32.1M 2s 2024-03-09T14:47:31.648 INFO:teuthology.orchestra.run.smithi099.stderr: 23700K .......... .......... .......... .......... .......... 25% 59.5M 2s 2024-03-09T14:47:31.648 INFO:teuthology.orchestra.run.smithi099.stderr: 23750K .......... .......... .......... .......... .......... 25% 38.0M 2s 2024-03-09T14:47:31.649 INFO:teuthology.orchestra.run.smithi099.stderr: 23800K .......... .......... .......... .......... .......... 25% 37.3M 2s 2024-03-09T14:47:31.649 INFO:teuthology.orchestra.run.smithi099.stderr: 23850K .......... .......... .......... .......... .......... 25% 98.2M 2s 2024-03-09T14:47:31.649 INFO:teuthology.orchestra.run.smithi099.stderr: 23900K .......... .......... .......... .......... .......... 25% 31.6M 2s 2024-03-09T14:47:31.649 INFO:teuthology.orchestra.run.smithi099.stderr: 23950K .......... .......... .......... .......... .......... 25% 31.4M 2s 2024-03-09T14:47:31.649 INFO:teuthology.orchestra.run.smithi099.stderr: 24000K .......... .......... .......... .......... .......... 25% 74.4M 2s 2024-03-09T14:47:31.649 INFO:teuthology.orchestra.run.smithi099.stderr: 24050K .......... .......... .......... .......... .......... 25% 83.8M 2s 2024-03-09T14:47:31.649 INFO:teuthology.orchestra.run.smithi099.stderr: 24100K .......... .......... .......... .......... .......... 25% 82.1M 2s 2024-03-09T14:47:31.649 INFO:teuthology.orchestra.run.smithi099.stderr: 24150K .......... .......... .......... .......... .......... 26% 85.2M 2s 2024-03-09T14:47:31.649 INFO:teuthology.orchestra.run.smithi099.stderr: 24200K .......... .......... .......... .......... .......... 26% 86.0M 2s 2024-03-09T14:47:31.649 INFO:teuthology.orchestra.run.smithi099.stderr: 24250K .......... .......... .......... .......... .......... 26% 97.5M 2s 2024-03-09T14:47:31.649 INFO:teuthology.orchestra.run.smithi099.stderr: 24300K .......... .......... .......... .......... .......... 26% 161M 2s 2024-03-09T14:47:31.649 INFO:teuthology.orchestra.run.smithi099.stderr: 24350K .......... .......... .......... .......... .......... 26% 91.3M 2s 2024-03-09T14:47:31.649 INFO:teuthology.orchestra.run.smithi099.stderr: 24400K .......... .......... .......... .......... .......... 26% 33.7M 2s 2024-03-09T14:47:31.649 INFO:teuthology.orchestra.run.smithi099.stderr: 24450K .......... .......... .......... .......... .......... 26% 55.9M 2s 2024-03-09T14:47:31.649 INFO:teuthology.orchestra.run.smithi099.stderr: 24500K .......... .......... .......... .......... .......... 26% 111M 2s 2024-03-09T14:47:31.650 INFO:teuthology.orchestra.run.smithi099.stderr: 24550K .......... .......... .......... .......... .......... 26% 40.4M 2s 2024-03-09T14:47:31.650 INFO:teuthology.orchestra.run.smithi099.stderr: 24600K .......... .......... .......... .......... .......... 26% 36.7M 2s 2024-03-09T14:47:31.650 INFO:teuthology.orchestra.run.smithi099.stderr: 24650K .......... .......... .......... .......... .......... 26% 39.6M 2s 2024-03-09T14:47:31.650 INFO:teuthology.orchestra.run.smithi099.stderr: 24700K .......... .......... .......... .......... .......... 26% 36.4M 2s 2024-03-09T14:47:31.650 INFO:teuthology.orchestra.run.smithi099.stderr: 24750K .......... .......... .......... .......... .......... 26% 109M 2s 2024-03-09T14:47:31.650 INFO:teuthology.orchestra.run.smithi099.stderr: 24800K .......... .......... .......... .......... .......... 26% 33.2M 2s 2024-03-09T14:47:31.650 INFO:teuthology.orchestra.run.smithi099.stderr: 24850K .......... .......... .......... .......... .......... 26% 33.5M 2s 2024-03-09T14:47:31.650 INFO:teuthology.orchestra.run.smithi099.stderr: 24900K .......... .......... .......... .......... .......... 26% 37.6M 2s 2024-03-09T14:47:31.650 INFO:teuthology.orchestra.run.smithi099.stderr: 24950K .......... .......... .......... .......... .......... 26% 98.7M 2s 2024-03-09T14:47:31.650 INFO:teuthology.orchestra.run.smithi099.stderr: 25000K .......... .......... .......... .......... .......... 26% 37.5M 2s 2024-03-09T14:47:31.650 INFO:teuthology.orchestra.run.smithi099.stderr: 25050K .......... .......... .......... .......... .......... 27% 38.3M 2s 2024-03-09T14:47:31.650 INFO:teuthology.orchestra.run.smithi099.stderr: 25100K .......... .......... .......... .......... .......... 27% 43.8M 2s 2024-03-09T14:47:31.650 INFO:teuthology.orchestra.run.smithi099.stderr: 25150K .......... .......... .......... .......... .......... 27% 47.5M 2s 2024-03-09T14:47:31.650 INFO:teuthology.orchestra.run.smithi099.stderr: 25200K .......... .......... .......... .......... .......... 27% 92.5M 2s 2024-03-09T14:47:31.651 INFO:teuthology.orchestra.run.smithi099.stderr: 25250K .......... .......... .......... .......... .......... 27% 46.2M 2s 2024-03-09T14:47:31.651 INFO:teuthology.orchestra.run.smithi099.stderr: 25300K .......... .......... .......... .......... .......... 27% 46.3M 2s 2024-03-09T14:47:31.651 INFO:teuthology.orchestra.run.smithi099.stderr: 25350K .......... .......... .......... .......... .......... 27% 118M 2s 2024-03-09T14:47:31.651 INFO:teuthology.orchestra.run.smithi099.stderr: 25400K .......... .......... .......... .......... .......... 27% 77.5M 2s 2024-03-09T14:47:31.651 INFO:teuthology.orchestra.run.smithi099.stderr: 25450K .......... .......... .......... .......... .......... 27% 114M 2s 2024-03-09T14:47:31.651 INFO:teuthology.orchestra.run.smithi099.stderr: 25500K .......... .......... .......... .......... .......... 27% 82.0M 2s 2024-03-09T14:47:31.651 INFO:teuthology.orchestra.run.smithi099.stderr: 25550K .......... .......... .......... .......... .......... 27% 118M 2s 2024-03-09T14:47:31.651 INFO:teuthology.orchestra.run.smithi099.stderr: 25600K .......... .......... .......... .......... .......... 27% 107M 2s 2024-03-09T14:47:31.651 INFO:teuthology.orchestra.run.smithi099.stderr: 25650K .......... .......... .......... .......... .......... 27% 110M 2s 2024-03-09T14:47:31.651 INFO:teuthology.orchestra.run.smithi099.stderr: 25700K .......... .......... .......... .......... .......... 27% 120M 2s 2024-03-09T14:47:31.651 INFO:teuthology.orchestra.run.smithi099.stderr: 25750K .......... .......... .......... .......... .......... 27% 115M 2s 2024-03-09T14:47:31.651 INFO:teuthology.orchestra.run.smithi099.stderr: 25800K .......... .......... .......... .......... .......... 27% 91.4M 2s 2024-03-09T14:47:31.651 INFO:teuthology.orchestra.run.smithi099.stderr: 25850K .......... .......... .......... .......... .......... 27% 114M 2s 2024-03-09T14:47:31.651 INFO:teuthology.orchestra.run.smithi099.stderr: 25900K .......... .......... .......... .......... .......... 27% 120M 2s 2024-03-09T14:47:31.651 INFO:teuthology.orchestra.run.smithi099.stderr: 25950K .......... .......... .......... .......... .......... 27% 79.9M 2s 2024-03-09T14:47:31.652 INFO:teuthology.orchestra.run.smithi099.stderr: 26000K .......... .......... .......... .......... .......... 28% 108M 2s 2024-03-09T14:47:31.652 INFO:teuthology.orchestra.run.smithi099.stderr: 26050K .......... .......... .......... .......... .......... 28% 51.4M 2s 2024-03-09T14:47:31.652 INFO:teuthology.orchestra.run.smithi099.stderr: 26100K .......... .......... .......... .......... .......... 28% 118M 2s 2024-03-09T14:47:31.652 INFO:teuthology.orchestra.run.smithi099.stderr: 26150K .......... .......... .......... .......... .......... 28% 21.1M 2s 2024-03-09T14:47:31.652 INFO:teuthology.orchestra.run.smithi099.stderr: 26200K .......... .......... .......... .......... .......... 28% 102M 2s 2024-03-09T14:47:31.652 INFO:teuthology.orchestra.run.smithi099.stderr: 26250K .......... .......... .......... .......... .......... 28% 119M 2s 2024-03-09T14:47:31.652 INFO:teuthology.orchestra.run.smithi099.stderr: 26300K .......... .......... .......... .......... .......... 28% 122M 2s 2024-03-09T14:47:31.652 INFO:teuthology.orchestra.run.smithi099.stderr: 26350K .......... .......... .......... .......... .......... 28% 93.5M 2s 2024-03-09T14:47:31.652 INFO:teuthology.orchestra.run.smithi099.stderr: 26400K .......... .......... .......... .......... .......... 28% 115M 2s 2024-03-09T14:47:31.652 INFO:teuthology.orchestra.run.smithi099.stderr: 26450K .......... .......... .......... .......... .......... 28% 107M 2s 2024-03-09T14:47:31.652 INFO:teuthology.orchestra.run.smithi099.stderr: 26500K .......... .......... .......... .......... .......... 28% 139M 2s 2024-03-09T14:47:31.652 INFO:teuthology.orchestra.run.smithi099.stderr: 26550K .......... .......... .......... .......... .......... 28% 79.6M 2s 2024-03-09T14:47:31.652 INFO:teuthology.orchestra.run.smithi099.stderr: 26600K .......... .......... .......... .......... .......... 28% 132M 2s 2024-03-09T14:47:31.652 INFO:teuthology.orchestra.run.smithi099.stderr: 26650K .......... .......... .......... .......... .......... 28% 91.3M 2s 2024-03-09T14:47:31.652 INFO:teuthology.orchestra.run.smithi099.stderr: 26700K .......... .......... .......... .......... .......... 28% 36.8M 2s 2024-03-09T14:47:31.653 INFO:teuthology.orchestra.run.smithi099.stderr: 26750K .......... .......... .......... .......... .......... 28% 34.1M 2s 2024-03-09T14:47:31.653 INFO:teuthology.orchestra.run.smithi099.stderr: 26800K .......... .......... .......... .......... .......... 28% 29.2M 2s 2024-03-09T14:47:31.653 INFO:teuthology.orchestra.run.smithi099.stderr: 26850K .......... .......... .......... .......... .......... 28% 130M 2s 2024-03-09T14:47:31.653 INFO:teuthology.orchestra.run.smithi099.stderr: 26900K .......... .......... .......... .......... .......... 29% 28.6M 2s 2024-03-09T14:47:31.653 INFO:teuthology.orchestra.run.smithi099.stderr: 26950K .......... .......... .......... .......... .......... 29% 25.4M 2s 2024-03-09T14:47:31.653 INFO:teuthology.orchestra.run.smithi099.stderr: 27000K .......... .......... .......... .......... .......... 29% 25.1M 2s 2024-03-09T14:47:31.653 INFO:teuthology.orchestra.run.smithi099.stderr: 27050K .......... .......... .......... .......... .......... 29% 28.4M 2s 2024-03-09T14:47:31.653 INFO:teuthology.orchestra.run.smithi099.stderr: 27100K .......... .......... .......... .......... .......... 29% 118M 2s 2024-03-09T14:47:31.653 INFO:teuthology.orchestra.run.smithi099.stderr: 27150K .......... .......... .......... .......... .......... 29% 25.2M 2s 2024-03-09T14:47:31.653 INFO:teuthology.orchestra.run.smithi099.stderr: 27200K .......... .......... .......... .......... .......... 29% 27.6M 2s 2024-03-09T14:47:31.653 INFO:teuthology.orchestra.run.smithi099.stderr: 27250K .......... .......... .......... .......... .......... 29% 27.2M 2s 2024-03-09T14:47:31.653 INFO:teuthology.orchestra.run.smithi099.stderr: 27300K .......... .......... .......... .......... .......... 29% 123M 2s 2024-03-09T14:47:31.653 INFO:teuthology.orchestra.run.smithi099.stderr: 27350K .......... .......... .......... .......... .......... 29% 39.3M 2s 2024-03-09T14:47:31.653 INFO:teuthology.orchestra.run.smithi099.stderr: 27400K .......... .......... .......... .......... .......... 29% 28.5M 2s 2024-03-09T14:47:31.653 INFO:teuthology.orchestra.run.smithi099.stderr: 27450K .......... .......... .......... .......... .......... 29% 27.0M 2s 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi099.stderr: 27500K .......... .......... .......... .......... .......... 29% 32.7M 2s 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi099.stderr: 27550K .......... .......... .......... .......... .......... 29% 102M 1s 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi099.stderr: 27600K .......... .......... .......... .......... .......... 29% 27.0M 1s 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi099.stderr: 27650K .......... .......... .......... .......... .......... 29% 70.1M 1s 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi099.stderr: 27700K .......... .......... .......... .......... .......... 29% 35.1M 1s 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi099.stderr: 27750K .......... .......... .......... .......... .......... 29% 34.8M 1s 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi099.stderr: 27800K .......... .......... .......... .......... .......... 29% 102M 1s 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi099.stderr: 27850K .......... .......... .......... .......... .......... 30% 37.7M 1s 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi099.stderr: 27900K .......... .......... .......... .......... .......... 30% 36.5M 1s 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi099.stderr: 27950K .......... .......... .......... .......... .......... 30% 34.4M 1s 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi099.stderr: 28000K .......... .......... .......... .......... .......... 30% 121M 1s 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi099.stderr: 28050K .......... .......... .......... .......... .......... 30% 37.7M 1s 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi099.stderr: 28100K .......... .......... .......... .......... .......... 30% 39.6M 1s 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi099.stderr: 28150K .......... .......... .......... .......... .......... 30% 33.1M 1s 2024-03-09T14:47:31.654 INFO:teuthology.orchestra.run.smithi099.stderr: 28200K .......... .......... .......... .......... .......... 30% 41.5M 1s 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi099.stderr: 28250K .......... .......... .......... .......... .......... 30% 101M 1s 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi099.stderr: 28300K .......... .......... .......... .......... .......... 30% 36.4M 1s 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi099.stderr: 28350K .......... .......... .......... .......... .......... 30% 39.4M 1s 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi099.stderr: 28400K .......... .......... .......... .......... .......... 30% 38.6M 1s 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi099.stderr: 28450K .......... .......... .......... .......... .......... 30% 110M 1s 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi099.stderr: 28500K .......... .......... .......... .......... .......... 30% 38.7M 1s 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi099.stderr: 28550K .......... .......... .......... .......... .......... 30% 37.4M 1s 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi099.stderr: 28600K .......... .......... .......... .......... .......... 30% 41.4M 1s 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi099.stderr: 28650K .......... .......... .......... .......... .......... 30% 39.9M 1s 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi099.stderr: 28700K .......... .......... .......... .......... .......... 30% 108M 1s 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi099.stderr: 28750K .......... .......... .......... .......... .......... 31% 39.2M 1s 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi099.stderr: 28800K .......... .......... .......... .......... .......... 31% 43.8M 1s 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi099.stderr: 28850K .......... .......... .......... .......... .......... 31% 42.1M 1s 2024-03-09T14:47:31.655 INFO:teuthology.orchestra.run.smithi099.stderr: 28900K .......... .......... .......... .......... .......... 31% 42.0M 1s 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi099.stderr: 28950K .......... .......... .......... .......... .......... 31% 35.6M 1s 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi099.stderr: 29000K .......... .......... .......... .......... .......... 31% 119M 1s 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi099.stderr: 29050K .......... .......... .......... .......... .......... 31% 43.0M 1s 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi099.stderr: 29100K .......... .......... .......... .......... .......... 31% 41.5M 1s 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi099.stderr: 29150K .......... .......... .......... .......... .......... 31% 40.2M 1s 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi099.stderr: 29200K .......... .......... .......... .......... .......... 31% 128M 1s 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi099.stderr: 29250K .......... .......... .......... .......... .......... 31% 35.9M 1s 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi099.stderr: 29300K .......... .......... .......... .......... .......... 31% 23.3M 1s 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi099.stderr: 29350K .......... .......... .......... .......... .......... 31% 21.3M 1s 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi099.stderr: 29400K .......... .......... .......... .......... .......... 31% 23.0M 1s 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi099.stderr: 29450K .......... .......... .......... .......... .......... 31% 46.4M 1s 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi099.stderr: 29500K .......... .......... .......... .......... .......... 31% 30.1M 1s 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi099.stderr: 29550K .......... .......... .......... .......... .......... 31% 100M 1s 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi099.stderr: 29600K .......... .......... .......... .......... .......... 31% 119M 1s 2024-03-09T14:47:31.656 INFO:teuthology.orchestra.run.smithi099.stderr: 29650K .......... .......... .......... .......... .......... 31% 89.8M 1s 2024-03-09T14:47:31.657 INFO:teuthology.orchestra.run.smithi099.stderr: 29700K .......... .......... .......... .......... .......... 32% 118M 1s 2024-03-09T14:47:31.657 INFO:teuthology.orchestra.run.smithi099.stderr: 29750K .......... .......... .......... .......... .......... 32% 108M 1s 2024-03-09T14:47:31.657 INFO:teuthology.orchestra.run.smithi099.stderr: 29800K .......... .......... .......... .......... .......... 32% 118M 1s 2024-03-09T14:47:31.657 INFO:teuthology.orchestra.run.smithi099.stderr: 29850K .......... .......... .......... .......... .......... 32% 93.7M 1s 2024-03-09T14:47:31.657 INFO:teuthology.orchestra.run.smithi099.stderr: 29900K .......... .......... .......... .......... .......... 32% 122M 1s 2024-03-09T14:47:31.657 INFO:teuthology.orchestra.run.smithi099.stderr: 29950K .......... .......... .......... .......... .......... 32% 121M 1s 2024-03-09T14:47:31.657 INFO:teuthology.orchestra.run.smithi099.stderr: 30000K .......... .......... .......... .......... .......... 32% 59.1M 1s 2024-03-09T14:47:31.657 INFO:teuthology.orchestra.run.smithi099.stderr: 30050K .......... .......... .......... .......... .......... 32% 36.2M 1s 2024-03-09T14:47:31.657 INFO:teuthology.orchestra.run.smithi099.stderr: 30100K .......... .......... .......... .......... .......... 32% 26.0M 1s 2024-03-09T14:47:31.657 INFO:teuthology.orchestra.run.smithi099.stderr: 30150K .......... .......... .......... .......... .......... 32% 111M 1s 2024-03-09T14:47:31.657 INFO:teuthology.orchestra.run.smithi099.stderr: 30200K .......... .......... .......... .......... .......... 32% 25.8M 1s 2024-03-09T14:47:31.657 INFO:teuthology.orchestra.run.smithi099.stderr: 30250K .......... .......... .......... .......... .......... 32% 26.8M 1s 2024-03-09T14:47:32.509 INFO:teuthology.orchestra.run.smithi099.stderr: 30300K .......... .......... .......... .......... .......... 32% 26.6M 1s 2024-03-09T14:47:32.509 INFO:teuthology.orchestra.run.smithi099.stderr: 30350K .......... .......... .......... .......... .......... 32% 113M 1s 2024-03-09T14:47:32.509 INFO:teuthology.orchestra.run.smithi099.stderr: 30400K .......... .......... .......... .......... .......... 32% 28.9M 1s 2024-03-09T14:47:32.509 INFO:teuthology.orchestra.run.smithi099.stderr: 30450K .......... .......... .......... .......... .......... 32% 27.0M 1s 2024-03-09T14:47:32.509 INFO:teuthology.orchestra.run.smithi099.stderr: 30500K .......... .......... .......... .......... .......... 32% 25.9M 1s 2024-03-09T14:47:32.509 INFO:teuthology.orchestra.run.smithi099.stderr: 30550K .......... .......... .......... .......... .......... 32% 26.0M 1s 2024-03-09T14:47:32.509 INFO:teuthology.orchestra.run.smithi099.stderr: 30600K .......... .......... .......... .......... .......... 32% 57.2M 1s 2024-03-09T14:47:32.509 INFO:teuthology.orchestra.run.smithi099.stderr: 30650K .......... .......... .......... .......... .......... 33% 30.2M 1s 2024-03-09T14:47:32.509 INFO:teuthology.orchestra.run.smithi099.stderr: 30700K .......... .......... .......... .......... .......... 33% 32.5M 1s 2024-03-09T14:47:32.509 INFO:teuthology.orchestra.run.smithi099.stderr: 30750K .......... .......... .......... .......... .......... 33% 31.1M 1s 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi099.stderr: 30800K .......... .......... .......... .......... .......... 33% 79.7M 1s 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi099.stderr: 30850K .......... .......... .......... .......... .......... 33% 32.8M 1s 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi099.stderr: 30900K .......... .......... .......... .......... .......... 33% 80.1M 1s 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi099.stderr: 30950K .......... .......... .......... .......... .......... 33% 76.9M 1s 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi099.stderr: 31000K .......... .......... .......... .......... .......... 33% 78.8M 1s 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi099.stderr: 31050K .......... .......... .......... .......... .......... 33% 78.7M 1s 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi099.stderr: 31100K .......... .......... .......... .......... .......... 33% 97.3M 1s 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi099.stderr: 31150K .......... .......... .......... .......... .......... 33% 132M 1s 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi099.stderr: 31200K .......... .......... .......... .......... .......... 33% 131M 1s 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi099.stderr: 31250K .......... .......... .......... .......... .......... 33% 133M 1s 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi099.stderr: 31300K .......... .......... .......... .......... .......... 33% 114M 1s 2024-03-09T14:47:32.510 INFO:teuthology.orchestra.run.smithi099.stderr: 31350K .......... .......... .......... .......... .......... 33% 124M 1s 2024-03-09T14:47:32.511 INFO:teuthology.orchestra.run.smithi099.stderr: 31400K .......... .......... .......... .......... .......... 33% 131M 1s 2024-03-09T14:47:32.511 INFO:teuthology.orchestra.run.smithi099.stderr: 31450K .......... .......... .......... .......... .......... 33% 133M 1s 2024-03-09T14:47:32.511 INFO:teuthology.orchestra.run.smithi099.stderr: 31500K .......... .......... .......... .......... .......... 33% 108M 1s 2024-03-09T14:47:32.511 INFO:teuthology.orchestra.run.smithi099.stderr: 31550K .......... .......... .......... .......... .......... 34% 131M 1s 2024-03-09T14:47:32.511 INFO:teuthology.orchestra.run.smithi099.stderr: 31600K .......... .......... .......... .......... .......... 34% 132M 1s 2024-03-09T14:47:32.511 INFO:teuthology.orchestra.run.smithi099.stderr: 31650K .......... .......... .......... .......... .......... 34% 137M 1s 2024-03-09T14:47:32.511 INFO:teuthology.orchestra.run.smithi099.stderr: 31700K .......... .......... .......... .......... .......... 34% 122M 1s 2024-03-09T14:47:32.511 INFO:teuthology.orchestra.run.smithi099.stderr: 31750K .......... .......... .......... .......... .......... 34% 110M 1s 2024-03-09T14:47:32.511 INFO:teuthology.orchestra.run.smithi099.stderr: 31800K .......... .......... .......... .......... .......... 34% 19.9M 1s 2024-03-09T14:47:32.511 INFO:teuthology.orchestra.run.smithi099.stderr: 31850K .......... .......... .......... .......... .......... 34% 21.1M 1s 2024-03-09T14:47:32.511 INFO:teuthology.orchestra.run.smithi099.stderr: 31900K .......... .......... .......... .......... .......... 34% 18.0M 1s 2024-03-09T14:47:32.511 INFO:teuthology.orchestra.run.smithi099.stderr: 31950K .......... .......... .......... .......... .......... 34% 17.7M 1s 2024-03-09T14:47:32.511 INFO:teuthology.orchestra.run.smithi099.stderr: 32000K .......... .......... .......... .......... .......... 34% 60.5M 1s 2024-03-09T14:47:32.512 INFO:teuthology.orchestra.run.smithi099.stderr: 32050K .......... .......... .......... .......... .......... 34% 54.1M 1s 2024-03-09T14:47:32.512 INFO:teuthology.orchestra.run.smithi099.stderr: 32100K .......... .......... .......... .......... .......... 34% 30.2M 1s 2024-03-09T14:47:32.512 INFO:teuthology.orchestra.run.smithi099.stderr: 32150K .......... .......... .......... .......... .......... 34% 30.5M 1s 2024-03-09T14:47:32.512 INFO:teuthology.orchestra.run.smithi099.stderr: 32200K .......... .......... .......... .......... .......... 34% 102M 1s 2024-03-09T14:47:32.512 INFO:teuthology.orchestra.run.smithi099.stderr: 32250K .......... .......... .......... .......... .......... 34% 94.6M 1s 2024-03-09T14:47:32.512 INFO:teuthology.orchestra.run.smithi099.stderr: 32300K .......... .......... .......... .......... .......... 34% 116M 1s 2024-03-09T14:47:32.512 INFO:teuthology.orchestra.run.smithi099.stderr: 32350K .......... .......... .......... .......... .......... 34% 104M 1s 2024-03-09T14:47:32.512 INFO:teuthology.orchestra.run.smithi099.stderr: 32400K .......... .......... .......... .......... .......... 34% 121M 1s 2024-03-09T14:47:32.512 INFO:teuthology.orchestra.run.smithi099.stderr: 32450K .......... .......... .......... .......... .......... 34% 111M 1s 2024-03-09T14:47:32.512 INFO:teuthology.orchestra.run.smithi099.stderr: 32500K .......... .......... .......... .......... .......... 35% 117M 1s 2024-03-09T14:47:32.512 INFO:teuthology.orchestra.run.smithi099.stderr: 32550K .......... .......... .......... .......... .......... 35% 116M 1s 2024-03-09T14:47:32.512 INFO:teuthology.orchestra.run.smithi099.stderr: 32600K .......... .......... .......... .......... .......... 35% 112M 1s 2024-03-09T14:47:32.512 INFO:teuthology.orchestra.run.smithi099.stderr: 32650K .......... .......... .......... .......... .......... 35% 90.7M 1s 2024-03-09T14:47:32.512 INFO:teuthology.orchestra.run.smithi099.stderr: 32700K .......... .......... .......... .......... .......... 35% 110M 1s 2024-03-09T14:47:32.513 INFO:teuthology.orchestra.run.smithi099.stderr: 32750K .......... .......... .......... .......... .......... 35% 112M 1s 2024-03-09T14:47:32.513 INFO:teuthology.orchestra.run.smithi099.stderr: 32800K .......... .......... .......... .......... .......... 35% 102M 1s 2024-03-09T14:47:32.513 INFO:teuthology.orchestra.run.smithi099.stderr: 32850K .......... .......... .......... .......... .......... 35% 85.3M 1s 2024-03-09T14:47:32.513 INFO:teuthology.orchestra.run.smithi099.stderr: 32900K .......... .......... .......... .......... .......... 35% 141M 1s 2024-03-09T14:47:32.513 INFO:teuthology.orchestra.run.smithi099.stderr: 32950K .......... .......... .......... .......... .......... 35% 117M 1s 2024-03-09T14:47:32.513 INFO:teuthology.orchestra.run.smithi099.stderr: 33000K .......... .......... .......... .......... .......... 35% 91.9M 1s 2024-03-09T14:47:32.513 INFO:teuthology.orchestra.run.smithi099.stderr: 33050K .......... .......... .......... .......... .......... 35% 119M 1s 2024-03-09T14:47:32.513 INFO:teuthology.orchestra.run.smithi099.stderr: 33100K .......... .......... .......... .......... .......... 35% 109M 1s 2024-03-09T14:47:32.513 INFO:teuthology.orchestra.run.smithi099.stderr: 33150K .......... .......... .......... .......... .......... 35% 111M 1s 2024-03-09T14:47:32.513 INFO:teuthology.orchestra.run.smithi099.stderr: 33200K .......... .......... .......... .......... .......... 35% 106M 1s 2024-03-09T14:47:32.513 INFO:teuthology.orchestra.run.smithi099.stderr: 33250K .......... .......... .......... .......... .......... 35% 104M 1s 2024-03-09T14:47:32.513 INFO:teuthology.orchestra.run.smithi099.stderr: 33300K .......... .......... .......... .......... .......... 35% 92.4M 1s 2024-03-09T14:47:32.513 INFO:teuthology.orchestra.run.smithi099.stderr: 33350K .......... .......... .......... .......... .......... 35% 136M 1s 2024-03-09T14:47:32.513 INFO:teuthology.orchestra.run.smithi099.stderr: 33400K .......... .......... .......... .......... .......... 36% 86.2M 1s 2024-03-09T14:47:32.513 INFO:teuthology.orchestra.run.smithi099.stderr: 33450K .......... .......... .......... .......... .......... 36% 120M 1s 2024-03-09T14:47:32.514 INFO:teuthology.orchestra.run.smithi099.stderr: 33500K .......... .......... .......... .......... .......... 36% 108M 1s 2024-03-09T14:47:32.514 INFO:teuthology.orchestra.run.smithi099.stderr: 33550K .......... .......... .......... .......... .......... 36% 66.8M 1s 2024-03-09T14:47:32.514 INFO:teuthology.orchestra.run.smithi099.stderr: 33600K .......... .......... .......... .......... .......... 36% 109M 1s 2024-03-09T14:47:32.514 INFO:teuthology.orchestra.run.smithi099.stderr: 33650K .......... .......... .......... .......... .......... 36% 113M 1s 2024-03-09T14:47:32.514 INFO:teuthology.orchestra.run.smithi099.stderr: 33700K .......... .......... .......... .......... .......... 36% 113M 1s 2024-03-09T14:47:32.514 INFO:teuthology.orchestra.run.smithi099.stderr: 33750K .......... .......... .......... .......... .......... 36% 117M 1s 2024-03-09T14:47:32.514 INFO:teuthology.orchestra.run.smithi099.stderr: 33800K .......... .......... .......... .......... .......... 36% 92.0M 1s 2024-03-09T14:47:32.514 INFO:teuthology.orchestra.run.smithi099.stderr: 33850K .......... .......... .......... .......... .......... 36% 106M 1s 2024-03-09T14:47:32.514 INFO:teuthology.orchestra.run.smithi099.stderr: 33900K .......... .......... .......... .......... .......... 36% 108M 1s 2024-03-09T14:47:32.514 INFO:teuthology.orchestra.run.smithi099.stderr: 33950K .......... .......... .......... .......... .......... 36% 116M 1s 2024-03-09T14:47:32.514 INFO:teuthology.orchestra.run.smithi099.stderr: 34000K .......... .......... .......... .......... .......... 36% 107M 1s 2024-03-09T14:47:32.514 INFO:teuthology.orchestra.run.smithi099.stderr: 34050K .......... .......... .......... .......... .......... 36% 125M 1s 2024-03-09T14:47:32.514 INFO:teuthology.orchestra.run.smithi099.stderr: 34100K .......... .......... .......... .......... .......... 36% 113M 1s 2024-03-09T14:47:32.514 INFO:teuthology.orchestra.run.smithi099.stderr: 34150K .......... .......... .......... .......... .......... 36% 119M 1s 2024-03-09T14:47:32.515 INFO:teuthology.orchestra.run.smithi099.stderr: 34200K .......... .......... .......... .......... .......... 36% 90.2M 1s 2024-03-09T14:47:32.515 INFO:teuthology.orchestra.run.smithi099.stderr: 34250K .......... .......... .......... .......... .......... 36% 121M 1s 2024-03-09T14:47:32.515 INFO:teuthology.orchestra.run.smithi099.stderr: 34300K .......... .......... .......... .......... .......... 36% 112M 1s 2024-03-09T14:47:32.515 INFO:teuthology.orchestra.run.smithi099.stderr: 34350K .......... .......... .......... .......... .......... 37% 119M 1s 2024-03-09T14:47:32.515 INFO:teuthology.orchestra.run.smithi099.stderr: 34400K .......... .......... .......... .......... .......... 37% 102M 1s 2024-03-09T14:47:32.515 INFO:teuthology.orchestra.run.smithi099.stderr: 34450K .......... .......... .......... .......... .......... 37% 122M 1s 2024-03-09T14:47:32.515 INFO:teuthology.orchestra.run.smithi099.stderr: 34500K .......... .......... .......... .......... .......... 37% 110M 1s 2024-03-09T14:47:32.515 INFO:teuthology.orchestra.run.smithi099.stderr: 34550K .......... .......... .......... .......... .......... 37% 118M 1s 2024-03-09T14:47:32.515 INFO:teuthology.orchestra.run.smithi099.stderr: 34600K .......... .......... .......... .......... .......... 37% 94.0M 1s 2024-03-09T14:47:32.515 INFO:teuthology.orchestra.run.smithi099.stderr: 34650K .......... .......... .......... .......... .......... 37% 113M 1s 2024-03-09T14:47:32.515 INFO:teuthology.orchestra.run.smithi099.stderr: 34700K .......... .......... .......... .......... .......... 37% 114M 1s 2024-03-09T14:47:32.515 INFO:teuthology.orchestra.run.smithi099.stderr: 34750K .......... .......... .......... .......... .......... 37% 104M 1s 2024-03-09T14:47:32.515 INFO:teuthology.orchestra.run.smithi099.stderr: 34800K .......... .......... .......... .......... .......... 37% 108M 1s 2024-03-09T14:47:32.515 INFO:teuthology.orchestra.run.smithi099.stderr: 34850K .......... .......... .......... .......... .......... 37% 118M 1s 2024-03-09T14:47:32.515 INFO:teuthology.orchestra.run.smithi099.stderr: 34900K .......... .......... .......... .......... .......... 37% 120M 1s 2024-03-09T14:47:32.516 INFO:teuthology.orchestra.run.smithi099.stderr: 34950K .......... .......... .......... .......... .......... 37% 102M 1s 2024-03-09T14:47:32.516 INFO:teuthology.orchestra.run.smithi099.stderr: 35000K .......... .......... .......... .......... .......... 37% 95.0M 1s 2024-03-09T14:47:32.516 INFO:teuthology.orchestra.run.smithi099.stderr: 35050K .......... .......... .......... .......... .......... 37% 111M 1s 2024-03-09T14:47:32.516 INFO:teuthology.orchestra.run.smithi099.stderr: 35100K .......... .......... .......... .......... .......... 37% 118M 1s 2024-03-09T14:47:32.516 INFO:teuthology.orchestra.run.smithi099.stderr: 35150K .......... .......... .......... .......... .......... 37% 112M 1s 2024-03-09T14:47:32.516 INFO:teuthology.orchestra.run.smithi099.stderr: 35200K .......... .......... .......... .......... .......... 37% 104M 1s 2024-03-09T14:47:32.516 INFO:teuthology.orchestra.run.smithi099.stderr: 35250K .......... .......... .......... .......... .......... 37% 115M 1s 2024-03-09T14:47:32.516 INFO:teuthology.orchestra.run.smithi099.stderr: 35300K .......... .......... .......... .......... .......... 38% 108M 1s 2024-03-09T14:47:32.516 INFO:teuthology.orchestra.run.smithi099.stderr: 35350K .......... .......... .......... .......... .......... 38% 87.6M 1s 2024-03-09T14:47:32.516 INFO:teuthology.orchestra.run.smithi099.stderr: 35400K .......... .......... .......... .......... .......... 38% 104M 1s 2024-03-09T14:47:32.516 INFO:teuthology.orchestra.run.smithi099.stderr: 35450K .......... .......... .......... .......... .......... 38% 122M 1s 2024-03-09T14:47:32.516 INFO:teuthology.orchestra.run.smithi099.stderr: 35500K .......... .......... .......... .......... .......... 38% 118M 1s 2024-03-09T14:47:32.516 INFO:teuthology.orchestra.run.smithi099.stderr: 35550K .......... .......... .......... .......... .......... 38% 103M 1s 2024-03-09T14:47:32.516 INFO:teuthology.orchestra.run.smithi099.stderr: 35600K .......... .......... .......... .......... .......... 38% 99.0M 1s 2024-03-09T14:47:32.516 INFO:teuthology.orchestra.run.smithi099.stderr: 35650K .......... .......... .......... .......... .......... 38% 116M 1s 2024-03-09T14:47:32.517 INFO:teuthology.orchestra.run.smithi099.stderr: 35700K .......... .......... .......... .......... .......... 38% 124M 1s 2024-03-09T14:47:32.517 INFO:teuthology.orchestra.run.smithi099.stderr: 35750K .......... .......... .......... .......... .......... 38% 101M 1s 2024-03-09T14:47:32.517 INFO:teuthology.orchestra.run.smithi099.stderr: 35800K .......... .......... .......... .......... .......... 38% 107M 1s 2024-03-09T14:47:32.517 INFO:teuthology.orchestra.run.smithi099.stderr: 35850K .......... .......... .......... .......... .......... 38% 108M 1s 2024-03-09T14:47:32.517 INFO:teuthology.orchestra.run.smithi099.stderr: 35900K .......... .......... .......... .......... .......... 38% 119M 1s 2024-03-09T14:47:32.517 INFO:teuthology.orchestra.run.smithi099.stderr: 35950K .......... .......... .......... .......... .......... 38% 110M 1s 2024-03-09T14:47:32.517 INFO:teuthology.orchestra.run.smithi099.stderr: 36000K .......... .......... .......... .......... .......... 38% 104M 1s 2024-03-09T14:47:32.517 INFO:teuthology.orchestra.run.smithi099.stderr: 36050K .......... .......... .......... .......... .......... 38% 122M 1s 2024-03-09T14:47:32.517 INFO:teuthology.orchestra.run.smithi099.stderr: 36100K .......... .......... .......... .......... .......... 38% 115M 1s 2024-03-09T14:47:32.517 INFO:teuthology.orchestra.run.smithi099.stderr: 36150K .......... .......... .......... .......... .......... 38% 79.4M 1s 2024-03-09T14:47:32.517 INFO:teuthology.orchestra.run.smithi099.stderr: 36200K .......... .......... .......... .......... .......... 39% 137M 1s 2024-03-09T14:47:32.517 INFO:teuthology.orchestra.run.smithi099.stderr: 36250K .......... .......... .......... .......... .......... 39% 124M 1s 2024-03-09T14:47:32.517 INFO:teuthology.orchestra.run.smithi099.stderr: 36300K .......... .......... .......... .......... .......... 39% 59.4M 1s 2024-03-09T14:47:32.518 INFO:teuthology.orchestra.run.smithi099.stderr: 36350K .......... .......... .......... .......... .......... 39% 68.3M 1s 2024-03-09T14:47:32.518 INFO:teuthology.orchestra.run.smithi099.stderr: 36400K .......... .......... .......... .......... .......... 39% 115M 1s 2024-03-09T14:47:32.518 INFO:teuthology.orchestra.run.smithi099.stderr: 36450K .......... .......... .......... .......... .......... 39% 108M 1s 2024-03-09T14:47:32.518 INFO:teuthology.orchestra.run.smithi099.stderr: 36500K .......... .......... .......... .......... .......... 39% 59.9M 1s 2024-03-09T14:47:32.518 INFO:teuthology.orchestra.run.smithi099.stderr: 36550K .......... .......... .......... .......... .......... 39% 45.4M 1s 2024-03-09T14:47:32.518 INFO:teuthology.orchestra.run.smithi099.stderr: 36600K .......... .......... .......... .......... .......... 39% 52.6M 1s 2024-03-09T14:47:32.518 INFO:teuthology.orchestra.run.smithi099.stderr: 36650K .......... .......... .......... .......... .......... 39% 105M 1s 2024-03-09T14:47:32.518 INFO:teuthology.orchestra.run.smithi099.stderr: 36700K .......... .......... .......... .......... .......... 39% 82.8M 1s 2024-03-09T14:47:32.518 INFO:teuthology.orchestra.run.smithi099.stderr: 36750K .......... .......... .......... .......... .......... 39% 101M 1s 2024-03-09T14:47:32.518 INFO:teuthology.orchestra.run.smithi099.stderr: 36800K .......... .......... .......... .......... .......... 39% 112M 1s 2024-03-09T14:47:32.518 INFO:teuthology.orchestra.run.smithi099.stderr: 36850K .......... .......... .......... .......... .......... 39% 118M 1s 2024-03-09T14:47:32.518 INFO:teuthology.orchestra.run.smithi099.stderr: 36900K .......... .......... .......... .......... .......... 39% 110M 1s 2024-03-09T14:47:32.518 INFO:teuthology.orchestra.run.smithi099.stderr: 36950K .......... .......... .......... .......... .......... 39% 87.6M 1s 2024-03-09T14:47:32.518 INFO:teuthology.orchestra.run.smithi099.stderr: 37000K .......... .......... .......... .......... .......... 39% 129M 1s 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi099.stderr: 37050K .......... .......... .......... .......... .......... 39% 118M 1s 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi099.stderr: 37100K .......... .......... .......... .......... .......... 39% 114M 1s 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi099.stderr: 37150K .......... .......... .......... .......... .......... 40% 110M 1s 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi099.stderr: 37200K .......... .......... .......... .......... .......... 40% 110M 1s 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi099.stderr: 37250K .......... .......... .......... .......... .......... 40% 113M 1s 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi099.stderr: 37300K .......... .......... .......... .......... .......... 40% 118M 1s 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi099.stderr: 37350K .......... .......... .......... .......... .......... 40% 90.7M 1s 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi099.stderr: 37400K .......... .......... .......... .......... .......... 40% 124M 1s 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi099.stderr: 37450K .......... .......... .......... .......... .......... 40% 112M 1s 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi099.stderr: 37500K .......... .......... .......... .......... .......... 40% 118M 1s 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi099.stderr: 37550K .......... .......... .......... .......... .......... 40% 97.1M 1s 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi099.stderr: 37600K .......... .......... .......... .......... .......... 40% 121M 1s 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi099.stderr: 37650K .......... .......... .......... .......... .......... 40% 123M 1s 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi099.stderr: 37700K .......... .......... .......... .......... .......... 40% 119M 1s 2024-03-09T14:47:32.519 INFO:teuthology.orchestra.run.smithi099.stderr: 37750K .......... .......... .......... .......... .......... 40% 77.8M 1s 2024-03-09T14:47:32.520 INFO:teuthology.orchestra.run.smithi099.stderr: 37800K .......... .......... .......... .......... .......... 40% 89.2M 1s 2024-03-09T14:47:32.520 INFO:teuthology.orchestra.run.smithi099.stderr: 37850K .......... .......... .......... .......... .......... 40% 86.3M 1s 2024-03-09T14:47:32.520 INFO:teuthology.orchestra.run.smithi099.stderr: 37900K .......... .......... .......... .......... .......... 40% 87.4M 1s 2024-03-09T14:47:32.520 INFO:teuthology.orchestra.run.smithi099.stderr: 37950K .......... .......... .......... .......... .......... 40% 78.6M 1s 2024-03-09T14:47:32.520 INFO:teuthology.orchestra.run.smithi099.stderr: 38000K .......... .......... .......... .......... .......... 40% 85.1M 1s 2024-03-09T14:47:32.520 INFO:teuthology.orchestra.run.smithi099.stderr: 38050K .......... .......... .......... .......... .......... 41% 87.8M 1s 2024-03-09T14:47:32.520 INFO:teuthology.orchestra.run.smithi099.stderr: 38100K .......... .......... .......... .......... .......... 41% 89.5M 1s 2024-03-09T14:47:32.520 INFO:teuthology.orchestra.run.smithi099.stderr: 38150K .......... .......... .......... .......... .......... 41% 72.7M 1s 2024-03-09T14:47:32.520 INFO:teuthology.orchestra.run.smithi099.stderr: 38200K .......... .......... .......... .......... .......... 41% 87.2M 1s 2024-03-09T14:47:32.520 INFO:teuthology.orchestra.run.smithi099.stderr: 38250K .......... .......... .......... .......... .......... 41% 95.7M 1s 2024-03-09T14:47:32.520 INFO:teuthology.orchestra.run.smithi099.stderr: 38300K .......... .......... .......... .......... .......... 41% 97.6M 1s 2024-03-09T14:47:32.520 INFO:teuthology.orchestra.run.smithi099.stderr: 38350K .......... .......... .......... .......... .......... 41% 85.9M 1s 2024-03-09T14:47:32.520 INFO:teuthology.orchestra.run.smithi099.stderr: 38400K .......... .......... .......... .......... .......... 41% 94.1M 1s 2024-03-09T14:47:32.520 INFO:teuthology.orchestra.run.smithi099.stderr: 38450K .......... .......... .......... .......... .......... 41% 89.8M 1s 2024-03-09T14:47:32.520 INFO:teuthology.orchestra.run.smithi099.stderr: 38500K .......... .......... .......... .......... .......... 41% 90.9M 1s 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi099.stderr: 38550K .......... .......... .......... .......... .......... 41% 81.9M 1s 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi099.stderr: 38600K .......... .......... .......... .......... .......... 41% 93.0M 1s 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi099.stderr: 38650K .......... .......... .......... .......... .......... 41% 99.6M 1s 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi099.stderr: 38700K .......... .......... .......... .......... .......... 41% 99.6M 1s 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi099.stderr: 38750K .......... .......... .......... .......... .......... 41% 98.0M 1s 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi099.stderr: 38800K .......... .......... .......... .......... .......... 41% 108M 1s 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi099.stderr: 38850K .......... .......... .......... .......... .......... 41% 89.3M 1s 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi099.stderr: 38900K .......... .......... .......... .......... .......... 41% 44.2M 1s 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi099.stderr: 38950K .......... .......... .......... .......... .......... 41% 104M 1s 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi099.stderr: 39000K .......... .......... .......... .......... .......... 42% 106M 1s 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi099.stderr: 39050K .......... .......... .......... .......... .......... 42% 101M 1s 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi099.stderr: 39100K .......... .......... .......... .......... .......... 42% 93.1M 1s 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi099.stderr: 39150K .......... .......... .......... .......... .......... 42% 101M 1s 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi099.stderr: 39200K .......... .......... .......... .......... .......... 42% 104M 1s 2024-03-09T14:47:32.521 INFO:teuthology.orchestra.run.smithi099.stderr: 39250K .......... .......... .......... .......... .......... 42% 109M 1s 2024-03-09T14:47:32.522 INFO:teuthology.orchestra.run.smithi099.stderr: 39300K .......... .......... .......... .......... .......... 42% 84.3M 1s 2024-03-09T14:47:32.522 INFO:teuthology.orchestra.run.smithi099.stderr: 39350K .......... .......... .......... .......... .......... 42% 105M 1s 2024-03-09T14:47:32.522 INFO:teuthology.orchestra.run.smithi099.stderr: 39400K .......... .......... .......... .......... .......... 42% 37.3M 1s 2024-03-09T14:47:32.522 INFO:teuthology.orchestra.run.smithi099.stderr: 39450K .......... .......... .......... .......... .......... 42% 92.4M 1s 2024-03-09T14:47:32.522 INFO:teuthology.orchestra.run.smithi099.stderr: 39500K .......... .......... .......... .......... .......... 42% 44.4M 1s 2024-03-09T14:47:32.522 INFO:teuthology.orchestra.run.smithi099.stderr: 39550K .......... .......... .......... .......... .......... 42% 50.3M 1s 2024-03-09T14:47:32.522 INFO:teuthology.orchestra.run.smithi099.stderr: 39600K .......... .......... .......... .......... .......... 42% 50.6M 1s 2024-03-09T14:47:32.522 INFO:teuthology.orchestra.run.smithi099.stderr: 39650K .......... .......... .......... .......... .......... 42% 53.2M 1s 2024-03-09T14:47:32.522 INFO:teuthology.orchestra.run.smithi099.stderr: 39700K .......... .......... .......... .......... .......... 42% 53.7M 1s 2024-03-09T14:47:32.522 INFO:teuthology.orchestra.run.smithi099.stderr: 39750K .......... .......... .......... .......... .......... 42% 92.4M 1s 2024-03-09T14:47:32.522 INFO:teuthology.orchestra.run.smithi099.stderr: 39800K .......... .......... .......... .......... .......... 42% 51.8M 1s 2024-03-09T14:47:32.522 INFO:teuthology.orchestra.run.smithi099.stderr: 39850K .......... .......... .......... .......... .......... 42% 91.7M 1s 2024-03-09T14:47:32.522 INFO:teuthology.orchestra.run.smithi099.stderr: 39900K .......... .......... .......... .......... .......... 43% 81.9M 1s 2024-03-09T14:47:32.522 INFO:teuthology.orchestra.run.smithi099.stderr: 39950K .......... .......... .......... .......... .......... 43% 92.7M 1s 2024-03-09T14:47:32.523 INFO:teuthology.orchestra.run.smithi099.stderr: 40000K .......... .......... .......... .......... .......... 43% 91.3M 1s 2024-03-09T14:47:32.523 INFO:teuthology.orchestra.run.smithi099.stderr: 40050K .......... .......... .......... .......... .......... 43% 90.9M 1s 2024-03-09T14:47:32.523 INFO:teuthology.orchestra.run.smithi099.stderr: 40100K .......... .......... .......... .......... .......... 43% 72.2M 1s 2024-03-09T14:47:32.523 INFO:teuthology.orchestra.run.smithi099.stderr: 40150K .......... .......... .......... .......... .......... 43% 94.0M 1s 2024-03-09T14:47:32.523 INFO:teuthology.orchestra.run.smithi099.stderr: 40200K .......... .......... .......... .......... .......... 43% 98.4M 1s 2024-03-09T14:47:32.523 INFO:teuthology.orchestra.run.smithi099.stderr: 40250K .......... .......... .......... .......... .......... 43% 93.9M 1s 2024-03-09T14:47:32.523 INFO:teuthology.orchestra.run.smithi099.stderr: 40300K .......... .......... .......... .......... .......... 43% 89.5M 1s 2024-03-09T14:47:32.523 INFO:teuthology.orchestra.run.smithi099.stderr: 40350K .......... .......... .......... .......... .......... 43% 99.5M 1s 2024-03-09T14:47:32.523 INFO:teuthology.orchestra.run.smithi099.stderr: 40400K .......... .......... .......... .......... .......... 43% 97.4M 1s 2024-03-09T14:47:32.523 INFO:teuthology.orchestra.run.smithi099.stderr: 40450K .......... .......... .......... .......... .......... 43% 95.2M 1s 2024-03-09T14:47:32.523 INFO:teuthology.orchestra.run.smithi099.stderr: 40500K .......... .......... .......... .......... .......... 43% 78.1M 1s 2024-03-09T14:47:32.523 INFO:teuthology.orchestra.run.smithi099.stderr: 40550K .......... .......... .......... .......... .......... 43% 106M 1s 2024-03-09T14:47:32.523 INFO:teuthology.orchestra.run.smithi099.stderr: 40600K .......... .......... .......... .......... .......... 43% 103M 1s 2024-03-09T14:47:32.523 INFO:teuthology.orchestra.run.smithi099.stderr: 40650K .......... .......... .......... .......... .......... 43% 106M 1s 2024-03-09T14:47:32.523 INFO:teuthology.orchestra.run.smithi099.stderr: 40700K .......... .......... .......... .......... .......... 43% 91.1M 1s 2024-03-09T14:47:32.524 INFO:teuthology.orchestra.run.smithi099.stderr: 40750K .......... .......... .......... .......... .......... 43% 105M 1s 2024-03-09T14:47:32.524 INFO:teuthology.orchestra.run.smithi099.stderr: 40800K .......... .......... .......... .......... .......... 43% 109M 1s 2024-03-09T14:47:32.524 INFO:teuthology.orchestra.run.smithi099.stderr: 40850K .......... .......... .......... .......... .......... 44% 108M 1s 2024-03-09T14:47:32.524 INFO:teuthology.orchestra.run.smithi099.stderr: 40900K .......... .......... .......... .......... .......... 44% 88.1M 1s 2024-03-09T14:47:32.524 INFO:teuthology.orchestra.run.smithi099.stderr: 40950K .......... .......... .......... .......... .......... 44% 103M 1s 2024-03-09T14:47:32.524 INFO:teuthology.orchestra.run.smithi099.stderr: 41000K .......... .......... .......... .......... .......... 44% 111M 1s 2024-03-09T14:47:32.524 INFO:teuthology.orchestra.run.smithi099.stderr: 41050K .......... .......... .......... .......... .......... 44% 92.4M 1s 2024-03-09T14:47:32.524 INFO:teuthology.orchestra.run.smithi099.stderr: 41100K .......... .......... .......... .......... .......... 44% 97.9M 1s 2024-03-09T14:47:32.524 INFO:teuthology.orchestra.run.smithi099.stderr: 41150K .......... .......... .......... .......... .......... 44% 107M 1s 2024-03-09T14:47:32.524 INFO:teuthology.orchestra.run.smithi099.stderr: 41200K .......... .......... .......... .......... .......... 44% 107M 1s 2024-03-09T14:47:32.524 INFO:teuthology.orchestra.run.smithi099.stderr: 41250K .......... .......... .......... .......... .......... 44% 106M 1s 2024-03-09T14:47:32.524 INFO:teuthology.orchestra.run.smithi099.stderr: 41300K .......... .......... .......... .......... .......... 44% 90.0M 1s 2024-03-09T14:47:32.524 INFO:teuthology.orchestra.run.smithi099.stderr: 41350K .......... .......... .......... .......... .......... 44% 112M 1s 2024-03-09T14:47:32.524 INFO:teuthology.orchestra.run.smithi099.stderr: 41400K .......... .......... .......... .......... .......... 44% 118M 1s 2024-03-09T14:47:32.525 INFO:teuthology.orchestra.run.smithi099.stderr: 41450K .......... .......... .......... .......... .......... 44% 122M 1s 2024-03-09T14:47:32.525 INFO:teuthology.orchestra.run.smithi099.stderr: 41500K .......... .......... .......... .......... .......... 44% 103M 1s 2024-03-09T14:47:32.525 INFO:teuthology.orchestra.run.smithi099.stderr: 41550K .......... .......... .......... .......... .......... 44% 126M 1s 2024-03-09T14:47:32.525 INFO:teuthology.orchestra.run.smithi099.stderr: 41600K .......... .......... .......... .......... .......... 44% 37.2M 1s 2024-03-09T14:47:32.525 INFO:teuthology.orchestra.run.smithi099.stderr: 41650K .......... .......... .......... .......... .......... 44% 47.5M 1s 2024-03-09T14:47:32.525 INFO:teuthology.orchestra.run.smithi099.stderr: 41700K .......... .......... .......... .......... .......... 44% 24.5M 1s 2024-03-09T14:47:32.525 INFO:teuthology.orchestra.run.smithi099.stderr: 41750K .......... .......... .......... .......... .......... 44% 36.8M 1s 2024-03-09T14:47:32.525 INFO:teuthology.orchestra.run.smithi099.stderr: 41800K .......... .......... .......... .......... .......... 45% 96.1M 1s 2024-03-09T14:47:32.525 INFO:teuthology.orchestra.run.smithi099.stderr: 41850K .......... .......... .......... .......... .......... 45% 30.0M 1s 2024-03-09T14:47:32.525 INFO:teuthology.orchestra.run.smithi099.stderr: 41900K .......... .......... .......... .......... .......... 45% 47.5M 1s 2024-03-09T14:47:32.525 INFO:teuthology.orchestra.run.smithi099.stderr: 41950K .......... .......... .......... .......... .......... 45% 54.8M 1s 2024-03-09T14:47:32.525 INFO:teuthology.orchestra.run.smithi099.stderr: 42000K .......... .......... .......... .......... .......... 45% 94.2M 1s 2024-03-09T14:47:32.525 INFO:teuthology.orchestra.run.smithi099.stderr: 42050K .......... .......... .......... .......... .......... 45% 58.5M 1s 2024-03-09T14:47:32.525 INFO:teuthology.orchestra.run.smithi099.stderr: 42100K .......... .......... .......... .......... .......... 45% 43.7M 1s 2024-03-09T14:47:32.526 INFO:teuthology.orchestra.run.smithi099.stderr: 42150K .......... .......... .......... .......... .......... 45% 58.3M 1s 2024-03-09T14:47:32.526 INFO:teuthology.orchestra.run.smithi099.stderr: 42200K .......... .......... .......... .......... .......... 45% 54.3M 1s 2024-03-09T14:47:32.526 INFO:teuthology.orchestra.run.smithi099.stderr: 42250K .......... .......... .......... .......... .......... 45% 106M 1s 2024-03-09T14:47:32.526 INFO:teuthology.orchestra.run.smithi099.stderr: 42300K .......... .......... .......... .......... .......... 45% 95.6M 1s 2024-03-09T14:47:32.526 INFO:teuthology.orchestra.run.smithi099.stderr: 42350K .......... .......... .......... .......... .......... 45% 113M 1s 2024-03-09T14:47:32.526 INFO:teuthology.orchestra.run.smithi099.stderr: 42400K .......... .......... .......... .......... .......... 45% 90.9M 1s 2024-03-09T14:47:32.526 INFO:teuthology.orchestra.run.smithi099.stderr: 42450K .......... .......... .......... .......... .......... 45% 104M 1s 2024-03-09T14:47:32.526 INFO:teuthology.orchestra.run.smithi099.stderr: 42500K .......... .......... .......... .......... .......... 45% 112M 1s 2024-03-09T14:47:32.526 INFO:teuthology.orchestra.run.smithi099.stderr: 42550K .......... .......... .......... .......... .......... 45% 106M 1s 2024-03-09T14:47:32.526 INFO:teuthology.orchestra.run.smithi099.stderr: 42600K .......... .......... .......... .......... .......... 45% 97.7M 1s 2024-03-09T14:47:32.526 INFO:teuthology.orchestra.run.smithi099.stderr: 42650K .......... .......... .......... .......... .......... 45% 106M 1s 2024-03-09T14:47:32.526 INFO:teuthology.orchestra.run.smithi099.stderr: 42700K .......... .......... .......... .......... .......... 46% 107M 1s 2024-03-09T14:47:32.526 INFO:teuthology.orchestra.run.smithi099.stderr: 42750K .......... .......... .......... .......... .......... 46% 109M 1s 2024-03-09T14:47:32.526 INFO:teuthology.orchestra.run.smithi099.stderr: 42800K .......... .......... .......... .......... .......... 46% 87.7M 1s 2024-03-09T14:47:32.527 INFO:teuthology.orchestra.run.smithi099.stderr: 42850K .......... .......... .......... .......... .......... 46% 108M 1s 2024-03-09T14:47:32.527 INFO:teuthology.orchestra.run.smithi099.stderr: 42900K .......... .......... .......... .......... .......... 46% 92.0M 1s 2024-03-09T14:47:32.527 INFO:teuthology.orchestra.run.smithi099.stderr: 42950K .......... .......... .......... .......... .......... 46% 103M 1s 2024-03-09T14:47:32.527 INFO:teuthology.orchestra.run.smithi099.stderr: 43000K .......... .......... .......... .......... .......... 46% 55.6M 1s 2024-03-09T14:47:32.527 INFO:teuthology.orchestra.run.smithi099.stderr: 43050K .......... .......... .......... .......... .......... 46% 40.0M 1s 2024-03-09T14:47:32.527 INFO:teuthology.orchestra.run.smithi099.stderr: 43100K .......... .......... .......... .......... .......... 46% 64.1M 1s 2024-03-09T14:47:32.527 INFO:teuthology.orchestra.run.smithi099.stderr: 43150K .......... .......... .......... .......... .......... 46% 106M 1s 2024-03-09T14:47:32.527 INFO:teuthology.orchestra.run.smithi099.stderr: 43200K .......... .......... .......... .......... .......... 46% 42.6M 1s 2024-03-09T14:47:32.527 INFO:teuthology.orchestra.run.smithi099.stderr: 43250K .......... .......... .......... .......... .......... 46% 48.6M 1s 2024-03-09T14:47:32.527 INFO:teuthology.orchestra.run.smithi099.stderr: 43300K .......... .......... .......... .......... .......... 46% 47.7M 1s 2024-03-09T14:47:32.527 INFO:teuthology.orchestra.run.smithi099.stderr: 43350K .......... .......... .......... .......... .......... 46% 48.1M 1s 2024-03-09T14:47:32.527 INFO:teuthology.orchestra.run.smithi099.stderr: 43400K .......... .......... .......... .......... .......... 46% 42.1M 1s 2024-03-09T14:47:32.527 INFO:teuthology.orchestra.run.smithi099.stderr: 43450K .......... .......... .......... .......... .......... 46% 100M 1s 2024-03-09T14:47:32.527 INFO:teuthology.orchestra.run.smithi099.stderr: 43500K .......... .......... .......... .......... .......... 46% 52.9M 1s 2024-03-09T14:47:32.527 INFO:teuthology.orchestra.run.smithi099.stderr: 43550K .......... .......... .......... .......... .......... 46% 45.6M 1s 2024-03-09T14:47:32.528 INFO:teuthology.orchestra.run.smithi099.stderr: 43600K .......... .......... .......... .......... .......... 46% 40.1M 1s 2024-03-09T14:47:32.528 INFO:teuthology.orchestra.run.smithi099.stderr: 43650K .......... .......... .......... .......... .......... 47% 97.3M 1s 2024-03-09T14:47:32.528 INFO:teuthology.orchestra.run.smithi099.stderr: 43700K .......... .......... .......... .......... .......... 47% 49.6M 1s 2024-03-09T14:47:32.528 INFO:teuthology.orchestra.run.smithi099.stderr: 43750K .......... .......... .......... .......... .......... 47% 50.1M 1s 2024-03-09T14:47:32.528 INFO:teuthology.orchestra.run.smithi099.stderr: 43800K .......... .......... .......... .......... .......... 47% 45.0M 1s 2024-03-09T14:47:32.528 INFO:teuthology.orchestra.run.smithi099.stderr: 43850K .......... .......... .......... .......... .......... 47% 24.3M 1s 2024-03-09T14:47:32.528 INFO:teuthology.orchestra.run.smithi099.stderr: 43900K .......... .......... .......... .......... .......... 47% 68.1M 1s 2024-03-09T14:47:32.528 INFO:teuthology.orchestra.run.smithi099.stderr: 43950K .......... .......... .......... .......... .......... 47% 97.6M 1s 2024-03-09T14:47:32.528 INFO:teuthology.orchestra.run.smithi099.stderr: 44000K .......... .......... .......... .......... .......... 47% 46.2M 1s 2024-03-09T14:47:32.528 INFO:teuthology.orchestra.run.smithi099.stderr: 44050K .......... .......... .......... .......... .......... 47% 61.4M 1s 2024-03-09T14:47:32.528 INFO:teuthology.orchestra.run.smithi099.stderr: 44100K .......... .......... .......... .......... .......... 47% 48.8M 1s 2024-03-09T14:47:32.528 INFO:teuthology.orchestra.run.smithi099.stderr: 44150K .......... .......... .......... .......... .......... 47% 95.6M 1s 2024-03-09T14:47:32.528 INFO:teuthology.orchestra.run.smithi099.stderr: 44200K .......... .......... .......... .......... .......... 47% 46.2M 1s 2024-03-09T14:47:32.528 INFO:teuthology.orchestra.run.smithi099.stderr: 44250K .......... .......... .......... .......... .......... 47% 49.4M 1s 2024-03-09T14:47:32.528 INFO:teuthology.orchestra.run.smithi099.stderr: 44300K .......... .......... .......... .......... .......... 47% 47.3M 1s 2024-03-09T14:47:32.529 INFO:teuthology.orchestra.run.smithi099.stderr: 44350K .......... .......... .......... .......... .......... 47% 54.7M 1s 2024-03-09T14:47:32.529 INFO:teuthology.orchestra.run.smithi099.stderr: 44400K .......... .......... .......... .......... .......... 47% 99.3M 1s 2024-03-09T14:47:32.529 INFO:teuthology.orchestra.run.smithi099.stderr: 44450K .......... .......... .......... .......... .......... 47% 37.5M 1s 2024-03-09T14:47:32.529 INFO:teuthology.orchestra.run.smithi099.stderr: 44500K .......... .......... .......... .......... .......... 47% 62.7M 1s 2024-03-09T14:47:32.529 INFO:teuthology.orchestra.run.smithi099.stderr: 44550K .......... .......... .......... .......... .......... 48% 29.5M 1s 2024-03-09T14:47:32.529 INFO:teuthology.orchestra.run.smithi099.stderr: 44600K .......... .......... .......... .......... .......... 48% 42.3M 1s 2024-03-09T14:47:32.529 INFO:teuthology.orchestra.run.smithi099.stderr: 44650K .......... .......... .......... .......... .......... 48% 97.0M 1s 2024-03-09T14:47:32.529 INFO:teuthology.orchestra.run.smithi099.stderr: 44700K .......... .......... .......... .......... .......... 48% 31.1M 1s 2024-03-09T14:47:32.529 INFO:teuthology.orchestra.run.smithi099.stderr: 44750K .......... .......... .......... .......... .......... 48% 29.5M 1s 2024-03-09T14:47:32.529 INFO:teuthology.orchestra.run.smithi099.stderr: 44800K .......... .......... .......... .......... .......... 48% 85.0M 1s 2024-03-09T14:47:32.529 INFO:teuthology.orchestra.run.smithi099.stderr: 44850K .......... .......... .......... .......... .......... 48% 96.7M 1s 2024-03-09T14:47:32.529 INFO:teuthology.orchestra.run.smithi099.stderr: 44900K .......... .......... .......... .......... .......... 48% 92.9M 1s 2024-03-09T14:47:32.529 INFO:teuthology.orchestra.run.smithi099.stderr: 44950K .......... .......... .......... .......... .......... 48% 91.3M 1s 2024-03-09T14:47:32.529 INFO:teuthology.orchestra.run.smithi099.stderr: 45000K .......... .......... .......... .......... .......... 48% 80.4M 1s 2024-03-09T14:47:32.529 INFO:teuthology.orchestra.run.smithi099.stderr: 45050K .......... .......... .......... .......... .......... 48% 97.8M 1s 2024-03-09T14:47:32.530 INFO:teuthology.orchestra.run.smithi099.stderr: 45100K .......... .......... .......... .......... .......... 48% 97.1M 1s 2024-03-09T14:47:32.530 INFO:teuthology.orchestra.run.smithi099.stderr: 45150K .......... .......... .......... .......... .......... 48% 88.7M 1s 2024-03-09T14:47:32.530 INFO:teuthology.orchestra.run.smithi099.stderr: 45200K .......... .......... .......... .......... .......... 48% 87.9M 1s 2024-03-09T14:47:32.530 INFO:teuthology.orchestra.run.smithi099.stderr: 45250K .......... .......... .......... .......... .......... 48% 96.7M 1s 2024-03-09T14:47:32.530 INFO:teuthology.orchestra.run.smithi099.stderr: 45300K .......... .......... .......... .......... .......... 48% 101M 1s 2024-03-09T14:47:32.530 INFO:teuthology.orchestra.run.smithi099.stderr: 45350K .......... .......... .......... .......... .......... 48% 98.2M 1s 2024-03-09T14:47:32.530 INFO:teuthology.orchestra.run.smithi099.stderr: 45400K .......... .......... .......... .......... .......... 48% 79.8M 1s 2024-03-09T14:47:32.530 INFO:teuthology.orchestra.run.smithi099.stderr: 45450K .......... .......... .......... .......... .......... 48% 99.2M 1s 2024-03-09T14:47:32.530 INFO:teuthology.orchestra.run.smithi099.stderr: 45500K .......... .......... .......... .......... .......... 49% 97.7M 1s 2024-03-09T14:47:32.530 INFO:teuthology.orchestra.run.smithi099.stderr: 45550K .......... .......... .......... .......... .......... 49% 96.6M 1s 2024-03-09T14:47:32.530 INFO:teuthology.orchestra.run.smithi099.stderr: 45600K .......... .......... .......... .......... .......... 49% 88.5M 1s 2024-03-09T14:47:32.530 INFO:teuthology.orchestra.run.smithi099.stderr: 45650K .......... .......... .......... .......... .......... 49% 96.0M 1s 2024-03-09T14:47:32.530 INFO:teuthology.orchestra.run.smithi099.stderr: 45700K .......... .......... .......... .......... .......... 49% 104M 1s 2024-03-09T14:47:32.530 INFO:teuthology.orchestra.run.smithi099.stderr: 45750K .......... .......... .......... .......... .......... 49% 104M 1s 2024-03-09T14:47:32.530 INFO:teuthology.orchestra.run.smithi099.stderr: 45800K .......... .......... .......... .......... .......... 49% 85.9M 1s 2024-03-09T14:47:32.531 INFO:teuthology.orchestra.run.smithi099.stderr: 45850K .......... .......... .......... .......... .......... 49% 103M 1s 2024-03-09T14:47:32.531 INFO:teuthology.orchestra.run.smithi099.stderr: 45900K .......... .......... .......... .......... .......... 49% 104M 1s 2024-03-09T14:47:32.531 INFO:teuthology.orchestra.run.smithi099.stderr: 45950K .......... .......... .......... .......... .......... 49% 98.8M 1s 2024-03-09T14:47:32.531 INFO:teuthology.orchestra.run.smithi099.stderr: 46000K .......... .......... .......... .......... .......... 49% 92.7M 1s 2024-03-09T14:47:32.531 INFO:teuthology.orchestra.run.smithi099.stderr: 46050K .......... .......... .......... .......... .......... 49% 102M 1s 2024-03-09T14:47:32.531 INFO:teuthology.orchestra.run.smithi099.stderr: 46100K .......... .......... .......... .......... .......... 49% 108M 1s 2024-03-09T14:47:32.531 INFO:teuthology.orchestra.run.smithi099.stderr: 46150K .......... .......... .......... .......... .......... 49% 107M 1s 2024-03-09T14:47:32.531 INFO:teuthology.orchestra.run.smithi099.stderr: 46200K .......... .......... .......... .......... .......... 49% 88.4M 1s 2024-03-09T14:47:32.531 INFO:teuthology.orchestra.run.smithi099.stderr: 46250K .......... .......... .......... .......... .......... 49% 108M 1s 2024-03-09T14:47:32.531 INFO:teuthology.orchestra.run.smithi099.stderr: 46300K .......... .......... .......... .......... .......... 49% 109M 1s 2024-03-09T14:47:32.531 INFO:teuthology.orchestra.run.smithi099.stderr: 46350K .......... .......... .......... .......... .......... 49% 107M 1s 2024-03-09T14:47:32.531 INFO:teuthology.orchestra.run.smithi099.stderr: 46400K .......... .......... .......... .......... .......... 49% 98.9M 1s 2024-03-09T14:47:32.531 INFO:teuthology.orchestra.run.smithi099.stderr: 46450K .......... .......... .......... .......... .......... 50% 118M 1s 2024-03-09T14:47:32.531 INFO:teuthology.orchestra.run.smithi099.stderr: 46500K .......... .......... .......... .......... .......... 50% 112M 1s 2024-03-09T14:47:32.532 INFO:teuthology.orchestra.run.smithi099.stderr: 46550K .......... .......... .......... .......... .......... 50% 113M 1s 2024-03-09T14:47:32.532 INFO:teuthology.orchestra.run.smithi099.stderr: 46600K .......... .......... .......... .......... .......... 50% 93.2M 1s 2024-03-09T14:47:32.532 INFO:teuthology.orchestra.run.smithi099.stderr: 46650K .......... .......... .......... .......... .......... 50% 117M 1s 2024-03-09T14:47:32.532 INFO:teuthology.orchestra.run.smithi099.stderr: 46700K .......... .......... .......... .......... .......... 50% 121M 1s 2024-03-09T14:47:32.532 INFO:teuthology.orchestra.run.smithi099.stderr: 46750K .......... .......... .......... .......... .......... 50% 102M 1s 2024-03-09T14:47:32.532 INFO:teuthology.orchestra.run.smithi099.stderr: 46800K .......... .......... .......... .......... .......... 50% 102M 1s 2024-03-09T14:47:32.532 INFO:teuthology.orchestra.run.smithi099.stderr: 46850K .......... .......... .......... .......... .......... 50% 115M 1s 2024-03-09T14:47:32.532 INFO:teuthology.orchestra.run.smithi099.stderr: 46900K .......... .......... .......... .......... .......... 50% 109M 1s 2024-03-09T14:47:32.532 INFO:teuthology.orchestra.run.smithi099.stderr: 46950K .......... .......... .......... .......... .......... 50% 96.2M 1s 2024-03-09T14:47:32.532 INFO:teuthology.orchestra.run.smithi099.stderr: 47000K .......... .......... .......... .......... .......... 50% 119M 1s 2024-03-09T14:47:32.532 INFO:teuthology.orchestra.run.smithi099.stderr: 47050K .......... .......... .......... .......... .......... 50% 123M 1s 2024-03-09T14:47:32.532 INFO:teuthology.orchestra.run.smithi099.stderr: 47100K .......... .......... .......... .......... .......... 50% 123M 1s 2024-03-09T14:47:32.532 INFO:teuthology.orchestra.run.smithi099.stderr: 47150K .......... .......... .......... .......... .......... 50% 109M 1s 2024-03-09T14:47:32.532 INFO:teuthology.orchestra.run.smithi099.stderr: 47200K .......... .......... .......... .......... .......... 50% 122M 1s 2024-03-09T14:47:32.533 INFO:teuthology.orchestra.run.smithi099.stderr: 47250K .......... .......... .......... .......... .......... 50% 124M 1s 2024-03-09T14:47:32.533 INFO:teuthology.orchestra.run.smithi099.stderr: 47300K .......... .......... .......... .......... .......... 50% 124M 1s 2024-03-09T14:47:32.533 INFO:teuthology.orchestra.run.smithi099.stderr: 47350K .......... .......... .......... .......... .......... 51% 102M 1s 2024-03-09T14:47:32.533 INFO:teuthology.orchestra.run.smithi099.stderr: 47400K .......... .......... .......... .......... .......... 51% 134M 1s 2024-03-09T14:47:32.533 INFO:teuthology.orchestra.run.smithi099.stderr: 47450K .......... .......... .......... .......... .......... 51% 146M 1s 2024-03-09T14:47:32.533 INFO:teuthology.orchestra.run.smithi099.stderr: 47500K .......... .......... .......... .......... .......... 51% 67.6M 1s 2024-03-09T14:47:32.533 INFO:teuthology.orchestra.run.smithi099.stderr: 47550K .......... .......... .......... .......... .......... 51% 30.8M 1s 2024-03-09T14:47:32.533 INFO:teuthology.orchestra.run.smithi099.stderr: 47600K .......... .......... .......... .......... .......... 51% 134M 1s 2024-03-09T14:47:32.533 INFO:teuthology.orchestra.run.smithi099.stderr: 47650K .......... .......... .......... .......... .......... 51% 51.4M 1s 2024-03-09T14:47:32.533 INFO:teuthology.orchestra.run.smithi099.stderr: 47700K .......... .......... .......... .......... .......... 51% 29.3M 1s 2024-03-09T14:47:32.533 INFO:teuthology.orchestra.run.smithi099.stderr: 47750K .......... .......... .......... .......... .......... 51% 27.7M 1s 2024-03-09T14:47:32.533 INFO:teuthology.orchestra.run.smithi099.stderr: 47800K .......... .......... .......... .......... .......... 51% 18.4M 1s 2024-03-09T14:47:32.533 INFO:teuthology.orchestra.run.smithi099.stderr: 47850K .......... .......... .......... .......... .......... 51% 40.6M 1s 2024-03-09T14:47:32.533 INFO:teuthology.orchestra.run.smithi099.stderr: 47900K .......... .......... .......... .......... .......... 51% 110M 1s 2024-03-09T14:47:32.533 INFO:teuthology.orchestra.run.smithi099.stderr: 47950K .......... .......... .......... .......... .......... 51% 43.7M 1s 2024-03-09T14:47:32.534 INFO:teuthology.orchestra.run.smithi099.stderr: 48000K .......... .......... .......... .......... .......... 51% 38.4M 1s 2024-03-09T14:47:32.534 INFO:teuthology.orchestra.run.smithi099.stderr: 48050K .......... .......... .......... .......... .......... 51% 38.3M 1s 2024-03-09T14:47:32.534 INFO:teuthology.orchestra.run.smithi099.stderr: 48100K .......... .......... .......... .......... .......... 51% 111M 1s 2024-03-09T14:47:32.534 INFO:teuthology.orchestra.run.smithi099.stderr: 48150K .......... .......... .......... .......... .......... 51% 37.5M 1s 2024-03-09T14:47:32.534 INFO:teuthology.orchestra.run.smithi099.stderr: 48200K .......... .......... .......... .......... .......... 51% 40.1M 1s 2024-03-09T14:47:32.534 INFO:teuthology.orchestra.run.smithi099.stderr: 48250K .......... .......... .......... .......... .......... 51% 40.0M 1s 2024-03-09T14:47:32.534 INFO:teuthology.orchestra.run.smithi099.stderr: 48300K .......... .......... .......... .......... .......... 52% 36.4M 1s 2024-03-09T14:47:32.534 INFO:teuthology.orchestra.run.smithi099.stderr: 48350K .......... .......... .......... .......... .......... 52% 129M 1s 2024-03-09T14:47:32.534 INFO:teuthology.orchestra.run.smithi099.stderr: 48400K .......... .......... .......... .......... .......... 52% 43.3M 1s 2024-03-09T14:47:32.534 INFO:teuthology.orchestra.run.smithi099.stderr: 48450K .......... .......... .......... .......... .......... 52% 33.1M 1s 2024-03-09T14:47:32.534 INFO:teuthology.orchestra.run.smithi099.stderr: 48500K .......... .......... .......... .......... .......... 52% 36.9M 1s 2024-03-09T14:47:32.534 INFO:teuthology.orchestra.run.smithi099.stderr: 48550K .......... .......... .......... .......... .......... 52% 41.5M 1s 2024-03-09T14:47:32.534 INFO:teuthology.orchestra.run.smithi099.stderr: 48600K .......... .......... .......... .......... .......... 52% 103M 1s 2024-03-09T14:47:32.534 INFO:teuthology.orchestra.run.smithi099.stderr: 48650K .......... .......... .......... .......... .......... 52% 42.4M 1s 2024-03-09T14:47:32.535 INFO:teuthology.orchestra.run.smithi099.stderr: 48700K .......... .......... .......... .......... .......... 52% 40.1M 1s 2024-03-09T14:47:32.535 INFO:teuthology.orchestra.run.smithi099.stderr: 48750K .......... .......... .......... .......... .......... 52% 34.5M 1s 2024-03-09T14:47:32.535 INFO:teuthology.orchestra.run.smithi099.stderr: 48800K .......... .......... .......... .......... .......... 52% 101M 1s 2024-03-09T14:47:32.535 INFO:teuthology.orchestra.run.smithi099.stderr: 48850K .......... .......... .......... .......... .......... 52% 43.1M 1s 2024-03-09T14:47:32.535 INFO:teuthology.orchestra.run.smithi099.stderr: 48900K .......... .......... .......... .......... .......... 52% 37.8M 1s 2024-03-09T14:47:32.535 INFO:teuthology.orchestra.run.smithi099.stderr: 48950K .......... .......... .......... .......... .......... 52% 44.2M 1s 2024-03-09T14:47:32.535 INFO:teuthology.orchestra.run.smithi099.stderr: 49000K .......... .......... .......... .......... .......... 52% 42.9M 1s 2024-03-09T14:47:32.535 INFO:teuthology.orchestra.run.smithi099.stderr: 49050K .......... .......... .......... .......... .......... 52% 95.7M 1s 2024-03-09T14:47:32.535 INFO:teuthology.orchestra.run.smithi099.stderr: 49100K .......... .......... .......... .......... .......... 52% 47.1M 1s 2024-03-09T14:47:32.535 INFO:teuthology.orchestra.run.smithi099.stderr: 49150K .......... .......... .......... .......... .......... 52% 42.9M 1s 2024-03-09T14:47:32.535 INFO:teuthology.orchestra.run.smithi099.stderr: 49200K .......... .......... .......... .......... .......... 53% 42.5M 1s 2024-03-09T14:47:32.535 INFO:teuthology.orchestra.run.smithi099.stderr: 49250K .......... .......... .......... .......... .......... 53% 97.6M 1s 2024-03-09T14:47:32.535 INFO:teuthology.orchestra.run.smithi099.stderr: 49300K .......... .......... .......... .......... .......... 53% 41.6M 1s 2024-03-09T14:47:32.535 INFO:teuthology.orchestra.run.smithi099.stderr: 49350K .......... .......... .......... .......... .......... 53% 135M 1s 2024-03-09T14:47:32.535 INFO:teuthology.orchestra.run.smithi099.stderr: 49400K .......... .......... .......... .......... .......... 53% 130M 1s 2024-03-09T14:47:32.536 INFO:teuthology.orchestra.run.smithi099.stderr: 49450K .......... .......... .......... .......... .......... 53% 107M 1s 2024-03-09T14:47:32.536 INFO:teuthology.orchestra.run.smithi099.stderr: 49500K .......... .......... .......... .......... .......... 53% 104M 1s 2024-03-09T14:47:32.536 INFO:teuthology.orchestra.run.smithi099.stderr: 49550K .......... .......... .......... .......... .......... 53% 101M 1s 2024-03-09T14:47:32.536 INFO:teuthology.orchestra.run.smithi099.stderr: 49600K .......... .......... .......... .......... .......... 53% 98.9M 1s 2024-03-09T14:47:32.536 INFO:teuthology.orchestra.run.smithi099.stderr: 49650K .......... .......... .......... .......... .......... 53% 101M 1s 2024-03-09T14:47:32.536 INFO:teuthology.orchestra.run.smithi099.stderr: 49700K .......... .......... .......... .......... .......... 53% 84.0M 1s 2024-03-09T14:47:32.536 INFO:teuthology.orchestra.run.smithi099.stderr: 49750K .......... .......... .......... .......... .......... 53% 102M 1s 2024-03-09T14:47:32.536 INFO:teuthology.orchestra.run.smithi099.stderr: 49800K .......... .......... .......... .......... .......... 53% 103M 1s 2024-03-09T14:47:32.536 INFO:teuthology.orchestra.run.smithi099.stderr: 49850K .......... .......... .......... .......... .......... 53% 106M 1s 2024-03-09T14:47:32.536 INFO:teuthology.orchestra.run.smithi099.stderr: 49900K .......... .......... .......... .......... .......... 53% 91.7M 1s 2024-03-09T14:47:32.536 INFO:teuthology.orchestra.run.smithi099.stderr: 49950K .......... .......... .......... .......... .......... 53% 103M 1s 2024-03-09T14:47:32.536 INFO:teuthology.orchestra.run.smithi099.stderr: 50000K .......... .......... .......... .......... .......... 53% 98.8M 1s 2024-03-09T14:47:32.536 INFO:teuthology.orchestra.run.smithi099.stderr: 50050K .......... .......... .......... .......... .......... 53% 100M 1s 2024-03-09T14:47:32.537 INFO:teuthology.orchestra.run.smithi099.stderr: 50100K .......... .......... .......... .......... .......... 53% 85.5M 1s 2024-03-09T14:47:32.537 INFO:teuthology.orchestra.run.smithi099.stderr: 50150K .......... .......... .......... .......... .......... 54% 105M 1s 2024-03-09T14:47:32.537 INFO:teuthology.orchestra.run.smithi099.stderr: 50200K .......... .......... .......... .......... .......... 54% 105M 1s 2024-03-09T14:47:32.537 INFO:teuthology.orchestra.run.smithi099.stderr: 50250K .......... .......... .......... .......... .......... 54% 101M 1s 2024-03-09T14:47:32.537 INFO:teuthology.orchestra.run.smithi099.stderr: 50300K .......... .......... .......... .......... .......... 54% 101M 1s 2024-03-09T14:47:32.537 INFO:teuthology.orchestra.run.smithi099.stderr: 50350K .......... .......... .......... .......... .......... 54% 105M 1s 2024-03-09T14:47:32.537 INFO:teuthology.orchestra.run.smithi099.stderr: 50400K .......... .......... .......... .......... .......... 54% 103M 1s 2024-03-09T14:47:32.537 INFO:teuthology.orchestra.run.smithi099.stderr: 50450K .......... .......... .......... .......... .......... 54% 56.2M 1s 2024-03-09T14:47:32.537 INFO:teuthology.orchestra.run.smithi099.stderr: 50500K .......... .......... .......... .......... .......... 54% 46.9M 1s 2024-03-09T14:47:32.537 INFO:teuthology.orchestra.run.smithi099.stderr: 50550K .......... .......... .......... .......... .......... 54% 51.0M 1s 2024-03-09T14:47:32.537 INFO:teuthology.orchestra.run.smithi099.stderr: 50600K .......... .......... .......... .......... .......... 54% 47.6M 1s 2024-03-09T14:47:32.537 INFO:teuthology.orchestra.run.smithi099.stderr: 50650K .......... .......... .......... .......... .......... 54% 50.3M 1s 2024-03-09T14:47:32.537 INFO:teuthology.orchestra.run.smithi099.stderr: 50700K .......... .......... .......... .......... .......... 54% 93.3M 1s 2024-03-09T14:47:32.537 INFO:teuthology.orchestra.run.smithi099.stderr: 50750K .......... .......... .......... .......... .......... 54% 49.4M 1s 2024-03-09T14:47:32.538 INFO:teuthology.orchestra.run.smithi099.stderr: 50800K .......... .......... .......... .......... .......... 54% 20.1M 1s 2024-03-09T14:47:32.538 INFO:teuthology.orchestra.run.smithi099.stderr: 50850K .......... .......... .......... .......... .......... 54% 26.0M 1s 2024-03-09T14:47:32.538 INFO:teuthology.orchestra.run.smithi099.stderr: 50900K .......... .......... .......... .......... .......... 54% 25.4M 1s 2024-03-09T14:47:32.538 INFO:teuthology.orchestra.run.smithi099.stderr: 50950K .......... .......... .......... .......... .......... 54% 104M 1s 2024-03-09T14:47:32.538 INFO:teuthology.orchestra.run.smithi099.stderr: 51000K .......... .......... .......... .......... .......... 54% 29.1M 1s 2024-03-09T14:47:32.538 INFO:teuthology.orchestra.run.smithi099.stderr: 51050K .......... .......... .......... .......... .......... 55% 27.1M 1s 2024-03-09T14:47:32.538 INFO:teuthology.orchestra.run.smithi099.stderr: 51100K .......... .......... .......... .......... .......... 55% 27.4M 1s 2024-03-09T14:47:32.538 INFO:teuthology.orchestra.run.smithi099.stderr: 51150K .......... .......... .......... .......... .......... 55% 91.8M 1s 2024-03-09T14:47:32.538 INFO:teuthology.orchestra.run.smithi099.stderr: 51200K .......... .......... .......... .......... .......... 55% 29.2M 1s 2024-03-09T14:47:32.538 INFO:teuthology.orchestra.run.smithi099.stderr: 51250K .......... .......... .......... .......... .......... 55% 31.0M 1s 2024-03-09T14:47:32.538 INFO:teuthology.orchestra.run.smithi099.stderr: 51300K .......... .......... .......... .......... .......... 55% 25.4M 1s 2024-03-09T14:47:32.538 INFO:teuthology.orchestra.run.smithi099.stderr: 51350K .......... .......... .......... .......... .......... 55% 38.2M 1s 2024-03-09T14:47:32.538 INFO:teuthology.orchestra.run.smithi099.stderr: 51400K .......... .......... .......... .......... .......... 55% 107M 1s 2024-03-09T14:47:32.538 INFO:teuthology.orchestra.run.smithi099.stderr: 51450K .......... .......... .......... .......... .......... 55% 54.9M 1s 2024-03-09T14:47:32.539 INFO:teuthology.orchestra.run.smithi099.stderr: 51500K .......... .......... .......... .......... .......... 55% 73.4M 1s 2024-03-09T14:47:32.539 INFO:teuthology.orchestra.run.smithi099.stderr: 51550K .......... .......... .......... .......... .......... 55% 42.2M 1s 2024-03-09T14:47:32.539 INFO:teuthology.orchestra.run.smithi099.stderr: 51600K .......... .......... .......... .......... .......... 55% 101M 1s 2024-03-09T14:47:32.539 INFO:teuthology.orchestra.run.smithi099.stderr: 51650K .......... .......... .......... .......... .......... 55% 67.0M 1s 2024-03-09T14:47:32.539 INFO:teuthology.orchestra.run.smithi099.stderr: 51700K .......... .......... .......... .......... .......... 55% 46.6M 1s 2024-03-09T14:47:32.539 INFO:teuthology.orchestra.run.smithi099.stderr: 51750K .......... .......... .......... .......... .......... 55% 85.1M 1s 2024-03-09T14:47:32.539 INFO:teuthology.orchestra.run.smithi099.stderr: 51800K .......... .......... .......... .......... .......... 55% 57.0M 1s 2024-03-09T14:47:32.539 INFO:teuthology.orchestra.run.smithi099.stderr: 51850K .......... .......... .......... .......... .......... 55% 106M 1s 2024-03-09T14:47:32.539 INFO:teuthology.orchestra.run.smithi099.stderr: 51900K .......... .......... .......... .......... .......... 55% 90.6M 1s 2024-03-09T14:47:32.539 INFO:teuthology.orchestra.run.smithi099.stderr: 51950K .......... .......... .......... .......... .......... 55% 58.6M 1s 2024-03-09T14:47:32.539 INFO:teuthology.orchestra.run.smithi099.stderr: 52000K .......... .......... .......... .......... .......... 56% 92.4M 1s 2024-03-09T14:47:32.539 INFO:teuthology.orchestra.run.smithi099.stderr: 52050K .......... .......... .......... .......... .......... 56% 68.8M 1s 2024-03-09T14:47:32.540 INFO:teuthology.orchestra.run.smithi099.stderr: 52100K .......... .......... .......... .......... .......... 56% 105M 1s 2024-03-09T14:47:32.540 INFO:teuthology.orchestra.run.smithi099.stderr: 52150K .......... .......... .......... .......... .......... 56% 61.5M 1s 2024-03-09T14:47:32.540 INFO:teuthology.orchestra.run.smithi099.stderr: 52200K .......... .......... .......... .......... .......... 56% 107M 1s 2024-03-09T14:47:32.540 INFO:teuthology.orchestra.run.smithi099.stderr: 52250K .......... .......... .......... .......... .......... 56% 59.1M 1s 2024-03-09T14:47:32.540 INFO:teuthology.orchestra.run.smithi099.stderr: 52300K .......... .......... .......... .......... .......... 56% 115M 1s 2024-03-09T14:47:32.540 INFO:teuthology.orchestra.run.smithi099.stderr: 52350K .......... .......... .......... .......... .......... 56% 70.4M 1s 2024-03-09T14:47:32.540 INFO:teuthology.orchestra.run.smithi099.stderr: 52400K .......... .......... .......... .......... .......... 56% 60.3M 1s 2024-03-09T14:47:32.540 INFO:teuthology.orchestra.run.smithi099.stderr: 52450K .......... .......... .......... .......... .......... 56% 119M 1s 2024-03-09T14:47:32.540 INFO:teuthology.orchestra.run.smithi099.stderr: 52500K .......... .......... .......... .......... .......... 56% 77.1M 1s 2024-03-09T14:47:32.540 INFO:teuthology.orchestra.run.smithi099.stderr: 52550K .......... .......... .......... .......... .......... 56% 131M 1s 2024-03-09T14:47:32.540 INFO:teuthology.orchestra.run.smithi099.stderr: 52600K .......... .......... .......... .......... .......... 56% 94.3M 1s 2024-03-09T14:47:32.540 INFO:teuthology.orchestra.run.smithi099.stderr: 52650K .......... .......... .......... .......... .......... 56% 61.2M 1s 2024-03-09T14:47:32.540 INFO:teuthology.orchestra.run.smithi099.stderr: 52700K .......... .......... .......... .......... .......... 56% 103M 1s 2024-03-09T14:47:32.541 INFO:teuthology.orchestra.run.smithi099.stderr: 52750K .......... .......... .......... .......... .......... 56% 111M 1s 2024-03-09T14:47:32.541 INFO:teuthology.orchestra.run.smithi099.stderr: 52800K .......... .......... .......... .......... .......... 56% 74.1M 1s 2024-03-09T14:47:32.541 INFO:teuthology.orchestra.run.smithi099.stderr: 52850K .......... .......... .......... .......... .......... 56% 61.2M 1s 2024-03-09T14:47:32.541 INFO:teuthology.orchestra.run.smithi099.stderr: 52900K .......... .......... .......... .......... .......... 56% 116M 1s 2024-03-09T14:47:32.541 INFO:teuthology.orchestra.run.smithi099.stderr: 52950K .......... .......... .......... .......... .......... 57% 112M 1s 2024-03-09T14:47:32.541 INFO:teuthology.orchestra.run.smithi099.stderr: 53000K .......... .......... .......... .......... .......... 57% 92.7M 1s 2024-03-09T14:47:32.541 INFO:teuthology.orchestra.run.smithi099.stderr: 53050K .......... .......... .......... .......... .......... 57% 92.3M 1s 2024-03-09T14:47:32.541 INFO:teuthology.orchestra.run.smithi099.stderr: 53100K .......... .......... .......... .......... .......... 57% 58.3M 1s 2024-03-09T14:47:32.541 INFO:teuthology.orchestra.run.smithi099.stderr: 53150K .......... .......... .......... .......... .......... 57% 117M 1s 2024-03-09T14:47:32.541 INFO:teuthology.orchestra.run.smithi099.stderr: 53200K .......... .......... .......... .......... .......... 57% 86.3M 1s 2024-03-09T14:47:32.541 INFO:teuthology.orchestra.run.smithi099.stderr: 53250K .......... .......... .......... .......... .......... 57% 123M 1s 2024-03-09T14:47:32.541 INFO:teuthology.orchestra.run.smithi099.stderr: 53300K .......... .......... .......... .......... .......... 57% 110M 1s 2024-03-09T14:47:32.541 INFO:teuthology.orchestra.run.smithi099.stderr: 53350K .......... .......... .......... .......... .......... 57% 110M 1s 2024-03-09T14:47:32.541 INFO:teuthology.orchestra.run.smithi099.stderr: 53400K .......... .......... .......... .......... .......... 57% 106M 1s 2024-03-09T14:47:32.541 INFO:teuthology.orchestra.run.smithi099.stderr: 53450K .......... .......... .......... .......... .......... 57% 123M 1s 2024-03-09T14:47:32.542 INFO:teuthology.orchestra.run.smithi099.stderr: 53500K .......... .......... .......... .......... .......... 57% 106M 1s 2024-03-09T14:47:32.542 INFO:teuthology.orchestra.run.smithi099.stderr: 53550K .......... .......... .......... .......... .......... 57% 79.1M 1s 2024-03-09T14:47:32.542 INFO:teuthology.orchestra.run.smithi099.stderr: 53600K .......... .......... .......... .......... .......... 57% 37.4M 1s 2024-03-09T14:47:32.542 INFO:teuthology.orchestra.run.smithi099.stderr: 53650K .......... .......... .......... .......... .......... 57% 39.5M 1s 2024-03-09T14:47:32.542 INFO:teuthology.orchestra.run.smithi099.stderr: 53700K .......... .......... .......... .......... .......... 57% 113M 1s 2024-03-09T14:47:32.542 INFO:teuthology.orchestra.run.smithi099.stderr: 53750K .......... .......... .......... .......... .......... 57% 38.1M 1s 2024-03-09T14:47:32.542 INFO:teuthology.orchestra.run.smithi099.stderr: 53800K .......... .......... .......... .......... .......... 57% 64.8M 1s 2024-03-09T14:47:32.542 INFO:teuthology.orchestra.run.smithi099.stderr: 53850K .......... .......... .......... .......... .......... 58% 103M 1s 2024-03-09T14:47:32.542 INFO:teuthology.orchestra.run.smithi099.stderr: 53900K .......... .......... .......... .......... .......... 58% 121M 1s 2024-03-09T14:47:32.542 INFO:teuthology.orchestra.run.smithi099.stderr: 53950K .......... .......... .......... .......... .......... 58% 108M 1s 2024-03-09T14:47:32.542 INFO:teuthology.orchestra.run.smithi099.stderr: 54000K .......... .......... .......... .......... .......... 58% 91.8M 1s 2024-03-09T14:47:32.542 INFO:teuthology.orchestra.run.smithi099.stderr: 54050K .......... .......... .......... .......... .......... 58% 111M 1s 2024-03-09T14:47:32.542 INFO:teuthology.orchestra.run.smithi099.stderr: 54100K .......... .......... .......... .......... .......... 58% 108M 1s 2024-03-09T14:47:32.543 INFO:teuthology.orchestra.run.smithi099.stderr: 54150K .......... .......... .......... .......... .......... 58% 90.3M 1s 2024-03-09T14:47:32.543 INFO:teuthology.orchestra.run.smithi099.stderr: 54200K .......... .......... .......... .......... .......... 58% 93.8M 1s 2024-03-09T14:47:32.543 INFO:teuthology.orchestra.run.smithi099.stderr: 54250K .......... .......... .......... .......... .......... 58% 104M 1s 2024-03-09T14:47:32.543 INFO:teuthology.orchestra.run.smithi099.stderr: 54300K .......... .......... .......... .......... .......... 58% 105M 1s 2024-03-09T14:47:32.543 INFO:teuthology.orchestra.run.smithi099.stderr: 54350K .......... .......... .......... .......... .......... 58% 123M 1s 2024-03-09T14:47:32.543 INFO:teuthology.orchestra.run.smithi099.stderr: 54400K .......... .......... .......... .......... .......... 58% 94.1M 1s 2024-03-09T14:47:32.543 INFO:teuthology.orchestra.run.smithi099.stderr: 54450K .......... .......... .......... .......... .......... 58% 112M 1s 2024-03-09T14:47:32.543 INFO:teuthology.orchestra.run.smithi099.stderr: 54500K .......... .......... .......... .......... .......... 58% 115M 1s 2024-03-09T14:47:32.543 INFO:teuthology.orchestra.run.smithi099.stderr: 54550K .......... .......... .......... .......... .......... 58% 108M 1s 2024-03-09T14:47:32.543 INFO:teuthology.orchestra.run.smithi099.stderr: 54600K .......... .......... .......... .......... .......... 58% 104M 1s 2024-03-09T14:47:32.543 INFO:teuthology.orchestra.run.smithi099.stderr: 54650K .......... .......... .......... .......... .......... 58% 114M 1s 2024-03-09T14:47:32.543 INFO:teuthology.orchestra.run.smithi099.stderr: 54700K .......... .......... .......... .......... .......... 58% 106M 1s 2024-03-09T14:47:32.543 INFO:teuthology.orchestra.run.smithi099.stderr: 54750K .......... .......... .......... .......... .......... 58% 123M 1s 2024-03-09T14:47:32.544 INFO:teuthology.orchestra.run.smithi099.stderr: 54800K .......... .......... .......... .......... .......... 59% 93.1M 1s 2024-03-09T14:47:32.544 INFO:teuthology.orchestra.run.smithi099.stderr: 54850K .......... .......... .......... .......... .......... 59% 116M 1s 2024-03-09T14:47:32.544 INFO:teuthology.orchestra.run.smithi099.stderr: 54900K .......... .......... .......... .......... .......... 59% 110M 1s 2024-03-09T14:47:32.544 INFO:teuthology.orchestra.run.smithi099.stderr: 54950K .......... .......... .......... .......... .......... 59% 117M 1s 2024-03-09T14:47:32.544 INFO:teuthology.orchestra.run.smithi099.stderr: 55000K .......... .......... .......... .......... .......... 59% 107M 1s 2024-03-09T14:47:32.544 INFO:teuthology.orchestra.run.smithi099.stderr: 55050K .......... .......... .......... .......... .......... 59% 116M 1s 2024-03-09T14:47:32.544 INFO:teuthology.orchestra.run.smithi099.stderr: 55100K .......... .......... .......... .......... .......... 59% 109M 1s 2024-03-09T14:47:32.544 INFO:teuthology.orchestra.run.smithi099.stderr: 55150K .......... .......... .......... .......... .......... 59% 103M 1s 2024-03-09T14:47:32.544 INFO:teuthology.orchestra.run.smithi099.stderr: 55200K .......... .......... .......... .......... .......... 59% 111M 1s 2024-03-09T14:47:32.544 INFO:teuthology.orchestra.run.smithi099.stderr: 55250K .......... .......... .......... .......... .......... 59% 112M 1s 2024-03-09T14:47:32.544 INFO:teuthology.orchestra.run.smithi099.stderr: 55300K .......... .......... .......... .......... .......... 59% 106M 1s 2024-03-09T14:47:32.545 INFO:teuthology.orchestra.run.smithi099.stderr: 55350K .......... .......... .......... .......... .......... 59% 121M 1s 2024-03-09T14:47:32.545 INFO:teuthology.orchestra.run.smithi099.stderr: 55400K .......... .......... .......... .......... .......... 59% 113M 1s 2024-03-09T14:47:32.545 INFO:teuthology.orchestra.run.smithi099.stderr: 55450K .......... .......... .......... .......... .......... 59% 111M 1s 2024-03-09T14:47:32.545 INFO:teuthology.orchestra.run.smithi099.stderr: 55500K .......... .......... .......... .......... .......... 59% 91.8M 1s 2024-03-09T14:47:32.545 INFO:teuthology.orchestra.run.smithi099.stderr: 55550K .......... .......... .......... .......... .......... 59% 77.1M 1s 2024-03-09T14:47:32.545 INFO:teuthology.orchestra.run.smithi099.stderr: 55600K .......... .......... .......... .......... .......... 59% 106M 1s 2024-03-09T14:47:32.545 INFO:teuthology.orchestra.run.smithi099.stderr: 55650K .......... .......... .......... .......... .......... 59% 39.3M 1s 2024-03-09T14:47:32.545 INFO:teuthology.orchestra.run.smithi099.stderr: 55700K .......... .......... .......... .......... .......... 60% 36.8M 1s 2024-03-09T14:47:32.545 INFO:teuthology.orchestra.run.smithi099.stderr: 55750K .......... .......... .......... .......... .......... 60% 41.2M 1s 2024-03-09T14:47:32.545 INFO:teuthology.orchestra.run.smithi099.stderr: 55800K .......... .......... .......... .......... .......... 60% 120M 1s 2024-03-09T14:47:32.545 INFO:teuthology.orchestra.run.smithi099.stderr: 55850K .......... .......... .......... .......... .......... 60% 39.4M 1s 2024-03-09T14:47:32.545 INFO:teuthology.orchestra.run.smithi099.stderr: 55900K .......... .......... .......... .......... .......... 60% 36.8M 1s 2024-03-09T14:47:32.545 INFO:teuthology.orchestra.run.smithi099.stderr: 55950K .......... .......... .......... .......... .......... 60% 41.8M 1s 2024-03-09T14:47:32.545 INFO:teuthology.orchestra.run.smithi099.stderr: 56000K .......... .......... .......... .......... .......... 60% 39.2M 1s 2024-03-09T14:47:32.546 INFO:teuthology.orchestra.run.smithi099.stderr: 56050K .......... .......... .......... .......... .......... 60% 109M 1s 2024-03-09T14:47:32.546 INFO:teuthology.orchestra.run.smithi099.stderr: 56100K .......... .......... .......... .......... .......... 60% 39.0M 1s 2024-03-09T14:47:32.546 INFO:teuthology.orchestra.run.smithi099.stderr: 56150K .......... .......... .......... .......... .......... 60% 45.7M 1s 2024-03-09T14:47:32.546 INFO:teuthology.orchestra.run.smithi099.stderr: 56200K .......... .......... .......... .......... .......... 60% 91.1M 1s 2024-03-09T14:47:32.546 INFO:teuthology.orchestra.run.smithi099.stderr: 56250K .......... .......... .......... .......... .......... 60% 114M 1s 2024-03-09T14:47:32.546 INFO:teuthology.orchestra.run.smithi099.stderr: 56300K .......... .......... .......... .......... .......... 60% 38.8M 1s 2024-03-09T14:47:32.546 INFO:teuthology.orchestra.run.smithi099.stderr: 56350K .......... .......... .......... .......... .......... 60% 118M 1s 2024-03-09T14:47:32.546 INFO:teuthology.orchestra.run.smithi099.stderr: 56400K .......... .......... .......... .......... .......... 60% 119M 1s 2024-03-09T14:47:32.546 INFO:teuthology.orchestra.run.smithi099.stderr: 56450K .......... .......... .......... .......... .......... 60% 110M 1s 2024-03-09T14:47:32.546 INFO:teuthology.orchestra.run.smithi099.stderr: 56500K .......... .......... .......... .......... .......... 60% 105M 1s 2024-03-09T14:47:32.546 INFO:teuthology.orchestra.run.smithi099.stderr: 56550K .......... .......... .......... .......... .......... 60% 116M 1s 2024-03-09T14:47:32.546 INFO:teuthology.orchestra.run.smithi099.stderr: 56600K .......... .......... .......... .......... .......... 60% 117M 1s 2024-03-09T14:47:32.546 INFO:teuthology.orchestra.run.smithi099.stderr: 56650K .......... .......... .......... .......... .......... 61% 96.6M 1s 2024-03-09T14:47:32.547 INFO:teuthology.orchestra.run.smithi099.stderr: 56700K .......... .......... .......... .......... .......... 61% 125M 1s 2024-03-09T14:47:32.547 INFO:teuthology.orchestra.run.smithi099.stderr: 56750K .......... .......... .......... .......... .......... 61% 115M 1s 2024-03-09T14:47:32.547 INFO:teuthology.orchestra.run.smithi099.stderr: 56800K .......... .......... .......... .......... .......... 61% 97.0M 1s 2024-03-09T14:47:32.547 INFO:teuthology.orchestra.run.smithi099.stderr: 56850K .......... .......... .......... .......... .......... 61% 119M 1s 2024-03-09T14:47:32.547 INFO:teuthology.orchestra.run.smithi099.stderr: 56900K .......... .......... .......... .......... .......... 61% 121M 1s 2024-03-09T14:47:32.547 INFO:teuthology.orchestra.run.smithi099.stderr: 56950K .......... .......... .......... .......... .......... 61% 109M 1s 2024-03-09T14:47:32.547 INFO:teuthology.orchestra.run.smithi099.stderr: 57000K .......... .......... .......... .......... .......... 61% 96.0M 1s 2024-03-09T14:47:32.547 INFO:teuthology.orchestra.run.smithi099.stderr: 57050K .......... .......... .......... .......... .......... 61% 119M 1s 2024-03-09T14:47:32.547 INFO:teuthology.orchestra.run.smithi099.stderr: 57100K .......... .......... .......... .......... .......... 61% 115M 1s 2024-03-09T14:47:32.547 INFO:teuthology.orchestra.run.smithi099.stderr: 57150K .......... .......... .......... .......... .......... 61% 106M 1s 2024-03-09T14:47:32.547 INFO:teuthology.orchestra.run.smithi099.stderr: 57200K .......... .......... .......... .......... .......... 61% 107M 1s 2024-03-09T14:47:32.547 INFO:teuthology.orchestra.run.smithi099.stderr: 57250K .......... .......... .......... .......... .......... 61% 105M 1s 2024-03-09T14:47:32.547 INFO:teuthology.orchestra.run.smithi099.stderr: 57300K .......... .......... .......... .......... .......... 61% 120M 1s 2024-03-09T14:47:32.547 INFO:teuthology.orchestra.run.smithi099.stderr: 57350K .......... .......... .......... .......... .......... 61% 119M 1s 2024-03-09T14:47:32.548 INFO:teuthology.orchestra.run.smithi099.stderr: 57400K .......... .......... .......... .......... .......... 61% 92.8M 1s 2024-03-09T14:47:32.548 INFO:teuthology.orchestra.run.smithi099.stderr: 57450K .......... .......... .......... .......... .......... 61% 107M 1s 2024-03-09T14:47:32.548 INFO:teuthology.orchestra.run.smithi099.stderr: 57500K .......... .......... .......... .......... .......... 61% 121M 1s 2024-03-09T14:47:32.548 INFO:teuthology.orchestra.run.smithi099.stderr: 57550K .......... .......... .......... .......... .......... 62% 115M 1s 2024-03-09T14:47:32.548 INFO:teuthology.orchestra.run.smithi099.stderr: 57600K .......... .......... .......... .......... .......... 62% 102M 1s 2024-03-09T14:47:32.548 INFO:teuthology.orchestra.run.smithi099.stderr: 57650K .......... .......... .......... .......... .......... 62% 124M 1s 2024-03-09T14:47:32.548 INFO:teuthology.orchestra.run.smithi099.stderr: 57700K .......... .......... .......... .......... .......... 62% 69.2M 1s 2024-03-09T14:47:32.548 INFO:teuthology.orchestra.run.smithi099.stderr: 57750K .......... .......... .......... .......... .......... 62% 83.7M 1s 2024-03-09T14:47:32.548 INFO:teuthology.orchestra.run.smithi099.stderr: 57800K .......... .......... .......... .......... .......... 62% 108M 1s 2024-03-09T14:47:32.548 INFO:teuthology.orchestra.run.smithi099.stderr: 57850K .......... .......... .......... .......... .......... 62% 121M 1s 2024-03-09T14:47:32.548 INFO:teuthology.orchestra.run.smithi099.stderr: 57900K .......... .......... .......... .......... .......... 62% 125M 1s 2024-03-09T14:47:32.548 INFO:teuthology.orchestra.run.smithi099.stderr: 57950K .......... .......... .......... .......... .......... 62% 123M 1s 2024-03-09T14:47:32.548 INFO:teuthology.orchestra.run.smithi099.stderr: 58000K .......... .......... .......... .......... .......... 62% 107M 1s 2024-03-09T14:47:32.548 INFO:teuthology.orchestra.run.smithi099.stderr: 58050K .......... .......... .......... .......... .......... 62% 124M 1s 2024-03-09T14:47:32.549 INFO:teuthology.orchestra.run.smithi099.stderr: 58100K .......... .......... .......... .......... .......... 62% 126M 1s 2024-03-09T14:47:32.549 INFO:teuthology.orchestra.run.smithi099.stderr: 58150K .......... .......... .......... .......... .......... 62% 109M 1s 2024-03-09T14:47:32.549 INFO:teuthology.orchestra.run.smithi099.stderr: 58200K .......... .......... .......... .......... .......... 62% 109M 1s 2024-03-09T14:47:32.549 INFO:teuthology.orchestra.run.smithi099.stderr: 58250K .......... .......... .......... .......... .......... 62% 127M 1s 2024-03-09T14:47:32.549 INFO:teuthology.orchestra.run.smithi099.stderr: 58300K .......... .......... .......... .......... .......... 62% 124M 1s 2024-03-09T14:47:32.549 INFO:teuthology.orchestra.run.smithi099.stderr: 58350K .......... .......... .......... .......... .......... 62% 125M 1s 2024-03-09T14:47:32.549 INFO:teuthology.orchestra.run.smithi099.stderr: 58400K .......... .......... .......... .......... .......... 62% 106M 1s 2024-03-09T14:47:32.549 INFO:teuthology.orchestra.run.smithi099.stderr: 58450K .......... .......... .......... .......... .......... 62% 112M 1s 2024-03-09T14:47:32.549 INFO:teuthology.orchestra.run.smithi099.stderr: 58500K .......... .......... .......... .......... .......... 63% 115M 1s 2024-03-09T14:47:32.549 INFO:teuthology.orchestra.run.smithi099.stderr: 58550K .......... .......... .......... .......... .......... 63% 110M 1s 2024-03-09T14:47:32.549 INFO:teuthology.orchestra.run.smithi099.stderr: 58600K .......... .......... .......... .......... .......... 63% 93.9M 1s 2024-03-09T14:47:32.549 INFO:teuthology.orchestra.run.smithi099.stderr: 58650K .......... .......... .......... .......... .......... 63% 122M 1s 2024-03-09T14:47:32.549 INFO:teuthology.orchestra.run.smithi099.stderr: 58700K .......... .......... .......... .......... .......... 63% 108M 1s 2024-03-09T14:47:32.549 INFO:teuthology.orchestra.run.smithi099.stderr: 58750K .......... .......... .......... .......... .......... 63% 125M 1s 2024-03-09T14:47:32.549 INFO:teuthology.orchestra.run.smithi099.stderr: 58800K .......... .......... .......... .......... .......... 63% 93.1M 1s 2024-03-09T14:47:32.550 INFO:teuthology.orchestra.run.smithi099.stderr: 58850K .......... .......... .......... .......... .......... 63% 115M 1s 2024-03-09T14:47:32.550 INFO:teuthology.orchestra.run.smithi099.stderr: 58900K .......... .......... .......... .......... .......... 63% 121M 1s 2024-03-09T14:47:32.550 INFO:teuthology.orchestra.run.smithi099.stderr: 58950K .......... .......... .......... .......... .......... 63% 117M 1s 2024-03-09T14:47:32.550 INFO:teuthology.orchestra.run.smithi099.stderr: 59000K .......... .......... .......... .......... .......... 63% 90.4M 1s 2024-03-09T14:47:32.550 INFO:teuthology.orchestra.run.smithi099.stderr: 59050K .......... .......... .......... .......... .......... 63% 99.4M 1s 2024-03-09T14:47:32.550 INFO:teuthology.orchestra.run.smithi099.stderr: 59100K .......... .......... .......... .......... .......... 63% 116M 1s 2024-03-09T14:47:32.550 INFO:teuthology.orchestra.run.smithi099.stderr: 59150K .......... .......... .......... .......... .......... 63% 30.3M 1s 2024-03-09T14:47:32.550 INFO:teuthology.orchestra.run.smithi099.stderr: 59200K .......... .......... .......... .......... .......... 63% 85.0M 1s 2024-03-09T14:47:32.550 INFO:teuthology.orchestra.run.smithi099.stderr: 59250K .......... .......... .......... .......... .......... 63% 113M 1s 2024-03-09T14:47:32.550 INFO:teuthology.orchestra.run.smithi099.stderr: 59300K .......... .......... .......... .......... .......... 63% 115M 1s 2024-03-09T14:47:32.550 INFO:teuthology.orchestra.run.smithi099.stderr: 59350K .......... .......... .......... .......... .......... 63% 123M 1s 2024-03-09T14:47:32.550 INFO:teuthology.orchestra.run.smithi099.stderr: 59400K .......... .......... .......... .......... .......... 63% 92.4M 1s 2024-03-09T14:47:32.550 INFO:teuthology.orchestra.run.smithi099.stderr: 59450K .......... .......... .......... .......... .......... 64% 113M 1s 2024-03-09T14:47:32.551 INFO:teuthology.orchestra.run.smithi099.stderr: 59500K .......... .......... .......... .......... .......... 64% 107M 1s 2024-03-09T14:47:32.551 INFO:teuthology.orchestra.run.smithi099.stderr: 59550K .......... .......... .......... .......... .......... 64% 116M 1s 2024-03-09T14:47:32.551 INFO:teuthology.orchestra.run.smithi099.stderr: 59600K .......... .......... .......... .......... .......... 64% 101M 1s 2024-03-09T14:47:32.551 INFO:teuthology.orchestra.run.smithi099.stderr: 59650K .......... .......... .......... .......... .......... 64% 124M 1s 2024-03-09T14:47:32.551 INFO:teuthology.orchestra.run.smithi099.stderr: 59700K .......... .......... .......... .......... .......... 64% 118M 1s 2024-03-09T14:47:32.551 INFO:teuthology.orchestra.run.smithi099.stderr: 59750K .......... .......... .......... .......... .......... 64% 115M 1s 2024-03-09T14:47:32.551 INFO:teuthology.orchestra.run.smithi099.stderr: 59800K .......... .......... .......... .......... .......... 64% 91.8M 1s 2024-03-09T14:47:32.551 INFO:teuthology.orchestra.run.smithi099.stderr: 59850K .......... .......... .......... .......... .......... 64% 120M 1s 2024-03-09T14:47:32.551 INFO:teuthology.orchestra.run.smithi099.stderr: 59900K .......... .......... .......... .......... .......... 64% 111M 1s 2024-03-09T14:47:32.551 INFO:teuthology.orchestra.run.smithi099.stderr: 59950K .......... .......... .......... .......... .......... 64% 110M 1s 2024-03-09T14:47:32.551 INFO:teuthology.orchestra.run.smithi099.stderr: 60000K .......... .......... .......... .......... .......... 64% 121M 1s 2024-03-09T14:47:32.551 INFO:teuthology.orchestra.run.smithi099.stderr: 60050K .......... .......... .......... .......... .......... 64% 108M 1s 2024-03-09T14:47:32.551 INFO:teuthology.orchestra.run.smithi099.stderr: 60100K .......... .......... .......... .......... .......... 64% 113M 1s 2024-03-09T14:47:32.552 INFO:teuthology.orchestra.run.smithi099.stderr: 60150K .......... .......... .......... .......... .......... 64% 116M 1s 2024-03-09T14:47:32.552 INFO:teuthology.orchestra.run.smithi099.stderr: 60200K .......... .......... .......... .......... .......... 64% 91.8M 1s 2024-03-09T14:47:32.552 INFO:teuthology.orchestra.run.smithi099.stderr: 60250K .......... .......... .......... .......... .......... 64% 108M 1s 2024-03-09T14:47:32.552 INFO:teuthology.orchestra.run.smithi099.stderr: 60300K .......... .......... .......... .......... .......... 64% 123M 1s 2024-03-09T14:47:32.552 INFO:teuthology.orchestra.run.smithi099.stderr: 60350K .......... .......... .......... .......... .......... 65% 115M 1s 2024-03-09T14:47:32.552 INFO:teuthology.orchestra.run.smithi099.stderr: 60400K .......... .......... .......... .......... .......... 65% 82.0M 1s 2024-03-09T14:47:32.552 INFO:teuthology.orchestra.run.smithi099.stderr: 60450K .......... .......... .......... .......... .......... 65% 126M 1s 2024-03-09T14:47:32.552 INFO:teuthology.orchestra.run.smithi099.stderr: 60500K .......... .......... .......... .......... .......... 65% 113M 1s 2024-03-09T14:47:32.552 INFO:teuthology.orchestra.run.smithi099.stderr: 60550K .......... .......... .......... .......... .......... 65% 113M 1s 2024-03-09T14:47:32.552 INFO:teuthology.orchestra.run.smithi099.stderr: 60600K .......... .......... .......... .......... .......... 65% 92.1M 1s 2024-03-09T14:47:32.552 INFO:teuthology.orchestra.run.smithi099.stderr: 60650K .......... .......... .......... .......... .......... 65% 113M 1s 2024-03-09T14:47:32.552 INFO:teuthology.orchestra.run.smithi099.stderr: 60700K .......... .......... .......... .......... .......... 65% 115M 1s 2024-03-09T14:47:32.552 INFO:teuthology.orchestra.run.smithi099.stderr: 60750K .......... .......... .......... .......... .......... 65% 109M 1s 2024-03-09T14:47:32.553 INFO:teuthology.orchestra.run.smithi099.stderr: 60800K .......... .......... .......... .......... .......... 65% 108M 1s 2024-03-09T14:47:32.553 INFO:teuthology.orchestra.run.smithi099.stderr: 60850K .......... .......... .......... .......... .......... 65% 111M 1s 2024-03-09T14:47:32.553 INFO:teuthology.orchestra.run.smithi099.stderr: 60900K .......... .......... .......... .......... .......... 65% 114M 1s 2024-03-09T14:47:32.553 INFO:teuthology.orchestra.run.smithi099.stderr: 60950K .......... .......... .......... .......... .......... 65% 97.6M 1s 2024-03-09T14:47:32.553 INFO:teuthology.orchestra.run.smithi099.stderr: 61000K .......... .......... .......... .......... .......... 65% 112M 1s 2024-03-09T14:47:32.553 INFO:teuthology.orchestra.run.smithi099.stderr: 61050K .......... .......... .......... .......... .......... 65% 120M 1s 2024-03-09T14:47:32.553 INFO:teuthology.orchestra.run.smithi099.stderr: 61100K .......... .......... .......... .......... .......... 65% 110M 1s 2024-03-09T14:47:32.553 INFO:teuthology.orchestra.run.smithi099.stderr: 61150K .......... .......... .......... .......... .......... 65% 104M 1s 2024-03-09T14:47:32.553 INFO:teuthology.orchestra.run.smithi099.stderr: 61200K .......... .......... .......... .......... .......... 65% 130M 1s 2024-03-09T14:47:32.553 INFO:teuthology.orchestra.run.smithi099.stderr: 61250K .......... .......... .......... .......... .......... 65% 112M 1s 2024-03-09T14:47:32.553 INFO:teuthology.orchestra.run.smithi099.stderr: 61300K .......... .......... .......... .......... .......... 66% 114M 1s 2024-03-09T14:47:32.553 INFO:teuthology.orchestra.run.smithi099.stderr: 61350K .......... .......... .......... .......... .......... 66% 89.8M 1s 2024-03-09T14:47:32.553 INFO:teuthology.orchestra.run.smithi099.stderr: 61400K .......... .......... .......... .......... .......... 66% 118M 1s 2024-03-09T14:47:32.553 INFO:teuthology.orchestra.run.smithi099.stderr: 61450K .......... .......... .......... .......... .......... 66% 110M 1s 2024-03-09T14:47:32.554 INFO:teuthology.orchestra.run.smithi099.stderr: 61500K .......... .......... .......... .......... .......... 66% 118M 1s 2024-03-09T14:47:32.554 INFO:teuthology.orchestra.run.smithi099.stderr: 61550K .......... .......... .......... .......... .......... 66% 108M 1s 2024-03-09T14:47:32.554 INFO:teuthology.orchestra.run.smithi099.stderr: 61600K .......... .......... .......... .......... .......... 66% 101M 1s 2024-03-09T14:47:32.554 INFO:teuthology.orchestra.run.smithi099.stderr: 61650K .......... .......... .......... .......... .......... 66% 129M 1s 2024-03-09T14:47:32.554 INFO:teuthology.orchestra.run.smithi099.stderr: 61700K .......... .......... .......... .......... .......... 66% 115M 1s 2024-03-09T14:47:32.554 INFO:teuthology.orchestra.run.smithi099.stderr: 61750K .......... .......... .......... .......... .......... 66% 93.4M 1s 2024-03-09T14:47:32.554 INFO:teuthology.orchestra.run.smithi099.stderr: 61800K .......... .......... .......... .......... .......... 66% 115M 1s 2024-03-09T14:47:32.554 INFO:teuthology.orchestra.run.smithi099.stderr: 61850K .......... .......... .......... .......... .......... 66% 110M 1s 2024-03-09T14:47:32.554 INFO:teuthology.orchestra.run.smithi099.stderr: 61900K .......... .......... .......... .......... .......... 66% 126M 1s 2024-03-09T14:47:32.554 INFO:teuthology.orchestra.run.smithi099.stderr: 61950K .......... .......... .......... .......... .......... 66% 106M 1s 2024-03-09T14:47:32.554 INFO:teuthology.orchestra.run.smithi099.stderr: 62000K .......... .......... .......... .......... .......... 66% 108M 1s 2024-03-09T14:47:32.554 INFO:teuthology.orchestra.run.smithi099.stderr: 62050K .......... .......... .......... .......... .......... 66% 104M 1s 2024-03-09T14:47:32.554 INFO:teuthology.orchestra.run.smithi099.stderr: 62100K .......... .......... .......... .......... .......... 66% 130M 1s 2024-03-09T14:47:32.555 INFO:teuthology.orchestra.run.smithi099.stderr: 62150K .......... .......... .......... .......... .......... 66% 85.8M 1s 2024-03-09T14:47:32.555 INFO:teuthology.orchestra.run.smithi099.stderr: 62200K .......... .......... .......... .......... .......... 67% 126M 1s 2024-03-09T14:47:32.555 INFO:teuthology.orchestra.run.smithi099.stderr: 62250K .......... .......... .......... .......... .......... 67% 107M 1s 2024-03-09T14:47:32.555 INFO:teuthology.orchestra.run.smithi099.stderr: 62300K .......... .......... .......... .......... .......... 67% 117M 1s 2024-03-09T14:47:32.555 INFO:teuthology.orchestra.run.smithi099.stderr: 62350K .......... .......... .......... .......... .......... 67% 109M 1s 2024-03-09T14:47:32.555 INFO:teuthology.orchestra.run.smithi099.stderr: 62400K .......... .......... .......... .......... .......... 67% 111M 1s 2024-03-09T14:47:32.555 INFO:teuthology.orchestra.run.smithi099.stderr: 62450K .......... .......... .......... .......... .......... 67% 119M 1s 2024-03-09T14:47:32.555 INFO:teuthology.orchestra.run.smithi099.stderr: 62500K .......... .......... .......... .......... .......... 67% 107M 1s 2024-03-09T14:47:32.555 INFO:teuthology.orchestra.run.smithi099.stderr: 62550K .......... .......... .......... .......... .......... 67% 96.6M 1s 2024-03-09T14:47:32.555 INFO:teuthology.orchestra.run.smithi099.stderr: 62600K .......... .......... .......... .......... .......... 67% 110M 1s 2024-03-09T14:47:32.555 INFO:teuthology.orchestra.run.smithi099.stderr: 62650K .......... .......... .......... .......... .......... 67% 113M 1s 2024-03-09T14:47:32.555 INFO:teuthology.orchestra.run.smithi099.stderr: 62700K .......... .......... .......... .......... .......... 67% 120M 1s 2024-03-09T14:47:32.555 INFO:teuthology.orchestra.run.smithi099.stderr: 62750K .......... .......... .......... .......... .......... 67% 102M 1s 2024-03-09T14:47:32.556 INFO:teuthology.orchestra.run.smithi099.stderr: 62800K .......... .......... .......... .......... .......... 67% 121M 1s 2024-03-09T14:47:32.556 INFO:teuthology.orchestra.run.smithi099.stderr: 62850K .......... .......... .......... .......... .......... 67% 114M 1s 2024-03-09T14:47:32.556 INFO:teuthology.orchestra.run.smithi099.stderr: 62900K .......... .......... .......... .......... .......... 67% 114M 1s 2024-03-09T14:47:32.556 INFO:teuthology.orchestra.run.smithi099.stderr: 62950K .......... .......... .......... .......... .......... 67% 65.1M 1s 2024-03-09T14:47:32.556 INFO:teuthology.orchestra.run.smithi099.stderr: 63000K .......... .......... .......... .......... .......... 67% 83.8M 1s 2024-03-09T14:47:32.556 INFO:teuthology.orchestra.run.smithi099.stderr: 63050K .......... .......... .......... .......... .......... 67% 132M 1s 2024-03-09T14:47:32.556 INFO:teuthology.orchestra.run.smithi099.stderr: 63100K .......... .......... .......... .......... .......... 67% 139M 1s 2024-03-09T14:47:32.556 INFO:teuthology.orchestra.run.smithi099.stderr: 63150K .......... .......... .......... .......... .......... 68% 126M 1s 2024-03-09T14:47:32.556 INFO:teuthology.orchestra.run.smithi099.stderr: 63200K .......... .......... .......... .......... .......... 68% 147M 1s 2024-03-09T14:47:32.556 INFO:teuthology.orchestra.run.smithi099.stderr: 63250K .......... .......... .......... .......... .......... 68% 120M 1s 2024-03-09T14:47:32.556 INFO:teuthology.orchestra.run.smithi099.stderr: 63300K .......... .......... .......... .......... .......... 68% 118M 1s 2024-03-09T14:47:32.556 INFO:teuthology.orchestra.run.smithi099.stderr: 63350K .......... .......... .......... .......... .......... 68% 118M 1s 2024-03-09T14:47:32.556 INFO:teuthology.orchestra.run.smithi099.stderr: 63400K .......... .......... .......... .......... .......... 68% 115M 1s 2024-03-09T14:47:32.556 INFO:teuthology.orchestra.run.smithi099.stderr: 63450K .......... .......... .......... .......... .......... 68% 107M 1s 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi099.stderr: 63500K .......... .......... .......... .......... .......... 68% 112M 1s 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi099.stderr: 63550K .......... .......... .......... .......... .......... 68% 112M 1s 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi099.stderr: 63600K .......... .......... .......... .......... .......... 68% 129M 1s 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi099.stderr: 63650K .......... .......... .......... .......... .......... 68% 87.0M 1s 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi099.stderr: 63700K .......... .......... .......... .......... .......... 68% 118M 1s 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi099.stderr: 63750K .......... .......... .......... .......... .......... 68% 113M 1s 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi099.stderr: 63800K .......... .......... .......... .......... .......... 68% 119M 1s 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi099.stderr: 63850K .......... .......... .......... .......... .......... 68% 92.7M 1s 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi099.stderr: 63900K .......... .......... .......... .......... .......... 68% 141M 1s 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi099.stderr: 63950K .......... .......... .......... .......... .......... 68% 114M 1s 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi099.stderr: 64000K .......... .......... .......... .......... .......... 68% 116M 1s 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi099.stderr: 64050K .......... .......... .......... .......... .......... 68% 92.6M 1s 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi099.stderr: 64100K .......... .......... .......... .......... .......... 69% 108M 1s 2024-03-09T14:47:32.557 INFO:teuthology.orchestra.run.smithi099.stderr: 64150K .......... .......... .......... .......... .......... 69% 127M 1s 2024-03-09T14:47:32.558 INFO:teuthology.orchestra.run.smithi099.stderr: 64200K .......... .......... .......... .......... .......... 69% 108M 0s 2024-03-09T14:47:32.558 INFO:teuthology.orchestra.run.smithi099.stderr: 64250K .......... .......... .......... .......... .......... 69% 102M 0s 2024-03-09T14:47:32.558 INFO:teuthology.orchestra.run.smithi099.stderr: 64300K .......... .......... .......... .......... .......... 69% 119M 0s 2024-03-09T14:47:32.558 INFO:teuthology.orchestra.run.smithi099.stderr: 64350K .......... .......... .......... .......... .......... 69% 51.3M 0s 2024-03-09T14:47:32.558 INFO:teuthology.orchestra.run.smithi099.stderr: 64400K .......... .......... .......... .......... .......... 69% 127M 0s 2024-03-09T14:47:32.558 INFO:teuthology.orchestra.run.smithi099.stderr: 64450K .......... .......... .......... .......... .......... 69% 82.6M 0s 2024-03-09T14:47:32.558 INFO:teuthology.orchestra.run.smithi099.stderr: 64500K .......... .......... .......... .......... .......... 69% 116M 0s 2024-03-09T14:47:32.558 INFO:teuthology.orchestra.run.smithi099.stderr: 64550K .......... .......... .......... .......... .......... 69% 115M 0s 2024-03-09T14:47:32.558 INFO:teuthology.orchestra.run.smithi099.stderr: 64600K .......... .......... .......... .......... .......... 69% 115M 0s 2024-03-09T14:47:32.558 INFO:teuthology.orchestra.run.smithi099.stderr: 64650K .......... .......... .......... .......... .......... 69% 92.2M 0s 2024-03-09T14:47:32.558 INFO:teuthology.orchestra.run.smithi099.stderr: 64700K .......... .......... .......... .......... .......... 69% 113M 0s 2024-03-09T14:47:32.558 INFO:teuthology.orchestra.run.smithi099.stderr: 64750K .......... .......... .......... .......... .......... 69% 42.8M 0s 2024-03-09T14:47:32.558 INFO:teuthology.orchestra.run.smithi099.stderr: 64800K .......... .......... .......... .......... .......... 69% 50.5M 0s 2024-03-09T14:47:32.558 INFO:teuthology.orchestra.run.smithi099.stderr: 64850K .......... .......... .......... .......... .......... 69% 93.1M 0s 2024-03-09T14:47:32.559 INFO:teuthology.orchestra.run.smithi099.stderr: 64900K .......... .......... .......... .......... .......... 69% 113M 0s 2024-03-09T14:47:32.559 INFO:teuthology.orchestra.run.smithi099.stderr: 64950K .......... .......... .......... .......... .......... 69% 120M 0s 2024-03-09T14:47:32.559 INFO:teuthology.orchestra.run.smithi099.stderr: 65000K .......... .......... .......... .......... .......... 70% 91.5M 0s 2024-03-09T14:47:32.559 INFO:teuthology.orchestra.run.smithi099.stderr: 65050K .......... .......... .......... .......... .......... 70% 104M 0s 2024-03-09T14:47:32.559 INFO:teuthology.orchestra.run.smithi099.stderr: 65100K .......... .......... .......... .......... .......... 70% 119M 0s 2024-03-09T14:47:32.559 INFO:teuthology.orchestra.run.smithi099.stderr: 65150K .......... .......... .......... .......... .......... 70% 121M 0s 2024-03-09T14:47:32.559 INFO:teuthology.orchestra.run.smithi099.stderr: 65200K .......... .......... .......... .......... .......... 70% 115M 0s 2024-03-09T14:47:32.559 INFO:teuthology.orchestra.run.smithi099.stderr: 65250K .......... .......... .......... .......... .......... 70% 92.1M 0s 2024-03-09T14:47:32.559 INFO:teuthology.orchestra.run.smithi099.stderr: 65300K .......... .......... .......... .......... .......... 70% 114M 0s 2024-03-09T14:47:32.559 INFO:teuthology.orchestra.run.smithi099.stderr: 65350K .......... .......... .......... .......... .......... 70% 111M 0s 2024-03-09T14:47:32.559 INFO:teuthology.orchestra.run.smithi099.stderr: 65400K .......... .......... .......... .......... .......... 70% 123M 0s 2024-03-09T14:47:32.559 INFO:teuthology.orchestra.run.smithi099.stderr: 65450K .......... .......... .......... .......... .......... 70% 97.4M 0s 2024-03-09T14:47:32.559 INFO:teuthology.orchestra.run.smithi099.stderr: 65500K .......... .......... .......... .......... .......... 70% 131M 0s 2024-03-09T14:47:32.559 INFO:teuthology.orchestra.run.smithi099.stderr: 65550K .......... .......... .......... .......... .......... 70% 111M 0s 2024-03-09T14:47:32.559 INFO:teuthology.orchestra.run.smithi099.stderr: 65600K .......... .......... .......... .......... .......... 70% 113M 0s 2024-03-09T14:47:32.560 INFO:teuthology.orchestra.run.smithi099.stderr: 65650K .......... .......... .......... .......... .......... 70% 98.8M 0s 2024-03-09T14:47:32.560 INFO:teuthology.orchestra.run.smithi099.stderr: 65700K .......... .......... .......... .......... .......... 70% 108M 0s 2024-03-09T14:47:32.560 INFO:teuthology.orchestra.run.smithi099.stderr: 65750K .......... .......... .......... .......... .......... 70% 116M 0s 2024-03-09T14:47:32.560 INFO:teuthology.orchestra.run.smithi099.stderr: 65800K .......... .......... .......... .......... .......... 70% 116M 0s 2024-03-09T14:47:32.560 INFO:teuthology.orchestra.run.smithi099.stderr: 65850K .......... .......... .......... .......... .......... 70% 105M 0s 2024-03-09T14:47:32.560 INFO:teuthology.orchestra.run.smithi099.stderr: 65900K .......... .......... .......... .......... .......... 70% 97.2M 0s 2024-03-09T14:47:32.560 INFO:teuthology.orchestra.run.smithi099.stderr: 65950K .......... .......... .......... .......... .......... 71% 42.0M 0s 2024-03-09T14:47:32.560 INFO:teuthology.orchestra.run.smithi099.stderr: 66000K .......... .......... .......... .......... .......... 71% 41.2M 0s 2024-03-09T14:47:32.560 INFO:teuthology.orchestra.run.smithi099.stderr: 66050K .......... .......... .......... .......... .......... 71% 86.5M 0s 2024-03-09T14:47:32.560 INFO:teuthology.orchestra.run.smithi099.stderr: 66100K .......... .......... .......... .......... .......... 71% 108M 0s 2024-03-09T14:47:32.560 INFO:teuthology.orchestra.run.smithi099.stderr: 66150K .......... .......... .......... .......... .......... 71% 109M 0s 2024-03-09T14:47:32.560 INFO:teuthology.orchestra.run.smithi099.stderr: 66200K .......... .......... .......... .......... .......... 71% 116M 0s 2024-03-09T14:47:32.560 INFO:teuthology.orchestra.run.smithi099.stderr: 66250K .......... .......... .......... .......... .......... 71% 115M 0s 2024-03-09T14:47:32.560 INFO:teuthology.orchestra.run.smithi099.stderr: 66300K .......... .......... .......... .......... .......... 71% 95.1M 0s 2024-03-09T14:47:32.560 INFO:teuthology.orchestra.run.smithi099.stderr: 66350K .......... .......... .......... .......... .......... 71% 114M 0s 2024-03-09T14:47:32.561 INFO:teuthology.orchestra.run.smithi099.stderr: 66400K .......... .......... .......... .......... .......... 71% 119M 0s 2024-03-09T14:47:32.561 INFO:teuthology.orchestra.run.smithi099.stderr: 66450K .......... .......... .......... .......... .......... 71% 115M 0s 2024-03-09T14:47:32.561 INFO:teuthology.orchestra.run.smithi099.stderr: 66500K .......... .......... .......... .......... .......... 71% 104M 0s 2024-03-09T14:47:32.561 INFO:teuthology.orchestra.run.smithi099.stderr: 66550K .......... .......... .......... .......... .......... 71% 119M 0s 2024-03-09T14:47:32.561 INFO:teuthology.orchestra.run.smithi099.stderr: 66600K .......... .......... .......... .......... .......... 71% 112M 0s 2024-03-09T14:47:32.561 INFO:teuthology.orchestra.run.smithi099.stderr: 66650K .......... .......... .......... .......... .......... 71% 111M 0s 2024-03-09T14:47:32.561 INFO:teuthology.orchestra.run.smithi099.stderr: 66700K .......... .......... .......... .......... .......... 71% 95.0M 0s 2024-03-09T14:47:32.561 INFO:teuthology.orchestra.run.smithi099.stderr: 66750K .......... .......... .......... .......... .......... 71% 115M 0s 2024-03-09T14:47:32.561 INFO:teuthology.orchestra.run.smithi099.stderr: 66800K .......... .......... .......... .......... .......... 71% 111M 0s 2024-03-09T14:47:32.561 INFO:teuthology.orchestra.run.smithi099.stderr: 66850K .......... .......... .......... .......... .......... 72% 111M 0s 2024-03-09T14:47:32.561 INFO:teuthology.orchestra.run.smithi099.stderr: 66900K .......... .......... .......... .......... .......... 72% 107M 0s 2024-03-09T14:47:32.561 INFO:teuthology.orchestra.run.smithi099.stderr: 66950K .......... .......... .......... .......... .......... 72% 116M 0s 2024-03-09T14:47:32.561 INFO:teuthology.orchestra.run.smithi099.stderr: 67000K .......... .......... .......... .......... .......... 72% 115M 0s 2024-03-09T14:47:32.561 INFO:teuthology.orchestra.run.smithi099.stderr: 67050K .......... .......... .......... .......... .......... 72% 114M 0s 2024-03-09T14:47:32.562 INFO:teuthology.orchestra.run.smithi099.stderr: 67100K .......... .......... .......... .......... .......... 72% 91.3M 0s 2024-03-09T14:47:32.562 INFO:teuthology.orchestra.run.smithi099.stderr: 67150K .......... .......... .......... .......... .......... 72% 115M 0s 2024-03-09T14:47:32.562 INFO:teuthology.orchestra.run.smithi099.stderr: 67200K .......... .......... .......... .......... .......... 72% 117M 0s 2024-03-09T14:47:32.562 INFO:teuthology.orchestra.run.smithi099.stderr: 67250K .......... .......... .......... .......... .......... 72% 119M 0s 2024-03-09T14:47:32.562 INFO:teuthology.orchestra.run.smithi099.stderr: 67300K .......... .......... .......... .......... .......... 72% 107M 0s 2024-03-09T14:47:32.562 INFO:teuthology.orchestra.run.smithi099.stderr: 67350K .......... .......... .......... .......... .......... 72% 108M 0s 2024-03-09T14:47:32.562 INFO:teuthology.orchestra.run.smithi099.stderr: 67400K .......... .......... .......... .......... .......... 72% 121M 0s 2024-03-09T14:47:32.562 INFO:teuthology.orchestra.run.smithi099.stderr: 67450K .......... .......... .......... .......... .......... 72% 120M 0s 2024-03-09T14:47:32.562 INFO:teuthology.orchestra.run.smithi099.stderr: 67500K .......... .......... .......... .......... .......... 72% 93.7M 0s 2024-03-09T14:47:32.562 INFO:teuthology.orchestra.run.smithi099.stderr: 67550K .......... .......... .......... .......... .......... 72% 109M 0s 2024-03-09T14:47:32.562 INFO:teuthology.orchestra.run.smithi099.stderr: 67600K .......... .......... .......... .......... .......... 72% 117M 0s 2024-03-09T14:47:32.562 INFO:teuthology.orchestra.run.smithi099.stderr: 67650K .......... .......... .......... .......... .......... 72% 66.8M 0s 2024-03-09T14:47:32.562 INFO:teuthology.orchestra.run.smithi099.stderr: 67700K .......... .......... .......... .......... .......... 72% 104M 0s 2024-03-09T14:47:32.562 INFO:teuthology.orchestra.run.smithi099.stderr: 67750K .......... .......... .......... .......... .......... 72% 44.5M 0s 2024-03-09T14:47:32.562 INFO:teuthology.orchestra.run.smithi099.stderr: 67800K .......... .......... .......... .......... .......... 73% 29.7M 0s 2024-03-09T14:47:32.563 INFO:teuthology.orchestra.run.smithi099.stderr: 67850K .......... .......... .......... .......... .......... 73% 34.2M 0s 2024-03-09T14:47:32.563 INFO:teuthology.orchestra.run.smithi099.stderr: 67900K .......... .......... .......... .......... .......... 73% 53.9M 0s 2024-03-09T14:47:32.563 INFO:teuthology.orchestra.run.smithi099.stderr: 67950K .......... .......... .......... .......... .......... 73% 110M 0s 2024-03-09T14:47:32.563 INFO:teuthology.orchestra.run.smithi099.stderr: 68000K .......... .......... .......... .......... .......... 73% 50.3M 0s 2024-03-09T14:47:32.563 INFO:teuthology.orchestra.run.smithi099.stderr: 68050K .......... .......... .......... .......... .......... 73% 50.4M 0s 2024-03-09T14:47:32.563 INFO:teuthology.orchestra.run.smithi099.stderr: 68100K .......... .......... .......... .......... .......... 73% 43.6M 0s 2024-03-09T14:47:32.563 INFO:teuthology.orchestra.run.smithi099.stderr: 68150K .......... .......... .......... .......... .......... 73% 53.5M 0s 2024-03-09T14:47:32.563 INFO:teuthology.orchestra.run.smithi099.stderr: 68200K .......... .......... .......... .......... .......... 73% 100M 0s 2024-03-09T14:47:32.563 INFO:teuthology.orchestra.run.smithi099.stderr: 68250K .......... .......... .......... .......... .......... 73% 74.6M 0s 2024-03-09T14:47:32.563 INFO:teuthology.orchestra.run.smithi099.stderr: 68300K .......... .......... .......... .......... .......... 73% 44.2M 0s 2024-03-09T14:47:32.563 INFO:teuthology.orchestra.run.smithi099.stderr: 68350K .......... .......... .......... .......... .......... 73% 50.0M 0s 2024-03-09T14:47:32.563 INFO:teuthology.orchestra.run.smithi099.stderr: 68400K .......... .......... .......... .......... .......... 73% 107M 0s 2024-03-09T14:47:32.564 INFO:teuthology.orchestra.run.smithi099.stderr: 68450K .......... .......... .......... .......... .......... 73% 50.5M 0s 2024-03-09T14:47:32.564 INFO:teuthology.orchestra.run.smithi099.stderr: 68500K .......... .......... .......... .......... .......... 73% 43.8M 0s 2024-03-09T14:47:32.564 INFO:teuthology.orchestra.run.smithi099.stderr: 68550K .......... .......... .......... .......... .......... 73% 57.7M 0s 2024-03-09T14:47:32.564 INFO:teuthology.orchestra.run.smithi099.stderr: 68600K .......... .......... .......... .......... .......... 73% 46.8M 0s 2024-03-09T14:47:32.564 INFO:teuthology.orchestra.run.smithi099.stderr: 68650K .......... .......... .......... .......... .......... 73% 59.7M 0s 2024-03-09T14:47:32.564 INFO:teuthology.orchestra.run.smithi099.stderr: 68700K .......... .......... .......... .......... .......... 74% 101M 0s 2024-03-09T14:47:32.564 INFO:teuthology.orchestra.run.smithi099.stderr: 68750K .......... .......... .......... .......... .......... 74% 56.7M 0s 2024-03-09T14:47:32.564 INFO:teuthology.orchestra.run.smithi099.stderr: 68800K .......... .......... .......... .......... .......... 74% 45.0M 0s 2024-03-09T14:47:32.564 INFO:teuthology.orchestra.run.smithi099.stderr: 68850K .......... .......... .......... .......... .......... 74% 47.9M 0s 2024-03-09T14:47:32.564 INFO:teuthology.orchestra.run.smithi099.stderr: 68900K .......... .......... .......... .......... .......... 74% 115M 0s 2024-03-09T14:47:32.564 INFO:teuthology.orchestra.run.smithi099.stderr: 68950K .......... .......... .......... .......... .......... 74% 103M 0s 2024-03-09T14:47:32.564 INFO:teuthology.orchestra.run.smithi099.stderr: 69000K .......... .......... .......... .......... .......... 74% 86.0M 0s 2024-03-09T14:47:32.564 INFO:teuthology.orchestra.run.smithi099.stderr: 69050K .......... .......... .......... .......... .......... 74% 116M 0s 2024-03-09T14:47:32.564 INFO:teuthology.orchestra.run.smithi099.stderr: 69100K .......... .......... .......... .......... .......... 74% 113M 0s 2024-03-09T14:47:32.565 INFO:teuthology.orchestra.run.smithi099.stderr: 69150K .......... .......... .......... .......... .......... 74% 119M 0s 2024-03-09T14:47:32.565 INFO:teuthology.orchestra.run.smithi099.stderr: 69200K .......... .......... .......... .......... .......... 74% 108M 0s 2024-03-09T14:47:32.565 INFO:teuthology.orchestra.run.smithi099.stderr: 69250K .......... .......... .......... .......... .......... 74% 117M 0s 2024-03-09T14:47:32.565 INFO:teuthology.orchestra.run.smithi099.stderr: 69300K .......... .......... .......... .......... .......... 74% 116M 0s 2024-03-09T14:47:32.565 INFO:teuthology.orchestra.run.smithi099.stderr: 69350K .......... .......... .......... .......... .......... 74% 115M 0s 2024-03-09T14:47:32.565 INFO:teuthology.orchestra.run.smithi099.stderr: 69400K .......... .......... .......... .......... .......... 74% 90.5M 0s 2024-03-09T14:47:32.565 INFO:teuthology.orchestra.run.smithi099.stderr: 69450K .......... .......... .......... .......... .......... 74% 111M 0s 2024-03-09T14:47:32.565 INFO:teuthology.orchestra.run.smithi099.stderr: 69500K .......... .......... .......... .......... .......... 74% 116M 0s 2024-03-09T14:47:32.565 INFO:teuthology.orchestra.run.smithi099.stderr: 69550K .......... .......... .......... .......... .......... 74% 120M 0s 2024-03-09T14:47:32.565 INFO:teuthology.orchestra.run.smithi099.stderr: 69600K .......... .......... .......... .......... .......... 74% 106M 0s 2024-03-09T14:47:32.565 INFO:teuthology.orchestra.run.smithi099.stderr: 69650K .......... .......... .......... .......... .......... 75% 94.6M 0s 2024-03-09T14:47:32.565 INFO:teuthology.orchestra.run.smithi099.stderr: 69700K .......... .......... .......... .......... .......... 75% 113M 0s 2024-03-09T14:47:32.565 INFO:teuthology.orchestra.run.smithi099.stderr: 69750K .......... .......... .......... .......... .......... 75% 134M 0s 2024-03-09T14:47:32.565 INFO:teuthology.orchestra.run.smithi099.stderr: 69800K .......... .......... .......... .......... .......... 75% 86.5M 0s 2024-03-09T14:47:32.566 INFO:teuthology.orchestra.run.smithi099.stderr: 69850K .......... .......... .......... .......... .......... 75% 116M 0s 2024-03-09T14:47:32.566 INFO:teuthology.orchestra.run.smithi099.stderr: 69900K .......... .......... .......... .......... .......... 75% 113M 0s 2024-03-09T14:47:32.566 INFO:teuthology.orchestra.run.smithi099.stderr: 69950K .......... .......... .......... .......... .......... 75% 115M 0s 2024-03-09T14:47:32.566 INFO:teuthology.orchestra.run.smithi099.stderr: 70000K .......... .......... .......... .......... .......... 75% 104M 0s 2024-03-09T14:47:32.566 INFO:teuthology.orchestra.run.smithi099.stderr: 70050K .......... .......... .......... .......... .......... 75% 121M 0s 2024-03-09T14:47:32.566 INFO:teuthology.orchestra.run.smithi099.stderr: 70100K .......... .......... .......... .......... .......... 75% 124M 0s 2024-03-09T14:47:32.566 INFO:teuthology.orchestra.run.smithi099.stderr: 70150K .......... .......... .......... .......... .......... 75% 109M 0s 2024-03-09T14:47:32.566 INFO:teuthology.orchestra.run.smithi099.stderr: 70200K .......... .......... .......... .......... .......... 75% 92.3M 0s 2024-03-09T14:47:32.566 INFO:teuthology.orchestra.run.smithi099.stderr: 70250K .......... .......... .......... .......... .......... 75% 112M 0s 2024-03-09T14:47:32.566 INFO:teuthology.orchestra.run.smithi099.stderr: 70300K .......... .......... .......... .......... .......... 75% 116M 0s 2024-03-09T14:47:32.566 INFO:teuthology.orchestra.run.smithi099.stderr: 70350K .......... .......... .......... .......... .......... 75% 110M 0s 2024-03-09T14:47:32.566 INFO:teuthology.orchestra.run.smithi099.stderr: 70400K .......... .......... .......... .......... .......... 75% 51.6M 0s 2024-03-09T14:47:32.567 INFO:teuthology.orchestra.run.smithi099.stderr: 70450K .......... .......... .......... .......... .......... 75% 53.4M 0s 2024-03-09T14:47:32.567 INFO:teuthology.orchestra.run.smithi099.stderr: 70500K .......... .......... .......... .......... .......... 75% 109M 0s 2024-03-09T14:47:32.567 INFO:teuthology.orchestra.run.smithi099.stderr: 70550K .......... .......... .......... .......... .......... 75% 56.2M 0s 2024-03-09T14:47:32.567 INFO:teuthology.orchestra.run.smithi099.stderr: 70600K .......... .......... .......... .......... .......... 76% 45.2M 0s 2024-03-09T14:47:32.567 INFO:teuthology.orchestra.run.smithi099.stderr: 70650K .......... .......... .......... .......... .......... 76% 55.7M 0s 2024-03-09T14:47:32.567 INFO:teuthology.orchestra.run.smithi099.stderr: 70700K .......... .......... .......... .......... .......... 76% 45.6M 0s 2024-03-09T14:47:32.567 INFO:teuthology.orchestra.run.smithi099.stderr: 70750K .......... .......... .......... .......... .......... 76% 110M 0s 2024-03-09T14:47:32.567 INFO:teuthology.orchestra.run.smithi099.stderr: 70800K .......... .......... .......... .......... .......... 76% 60.9M 0s 2024-03-09T14:47:32.567 INFO:teuthology.orchestra.run.smithi099.stderr: 70850K .......... .......... .......... .......... .......... 76% 25.7M 0s 2024-03-09T14:47:32.567 INFO:teuthology.orchestra.run.smithi099.stderr: 70900K .......... .......... .......... .......... .......... 76% 23.6M 0s 2024-03-09T14:47:32.567 INFO:teuthology.orchestra.run.smithi099.stderr: 70950K .......... .......... .......... .......... .......... 76% 32.1M 0s 2024-03-09T14:47:32.567 INFO:teuthology.orchestra.run.smithi099.stderr: 71000K .......... .......... .......... .......... .......... 76% 111M 0s 2024-03-09T14:47:32.567 INFO:teuthology.orchestra.run.smithi099.stderr: 71050K .......... .......... .......... .......... .......... 76% 109M 0s 2024-03-09T14:47:32.568 INFO:teuthology.orchestra.run.smithi099.stderr: 71100K .......... .......... .......... .......... .......... 76% 91.5M 0s 2024-03-09T14:47:32.568 INFO:teuthology.orchestra.run.smithi099.stderr: 71150K .......... .......... .......... .......... .......... 76% 114M 0s 2024-03-09T14:47:32.568 INFO:teuthology.orchestra.run.smithi099.stderr: 71200K .......... .......... .......... .......... .......... 76% 116M 0s 2024-03-09T14:47:32.568 INFO:teuthology.orchestra.run.smithi099.stderr: 71250K .......... .......... .......... .......... .......... 76% 119M 0s 2024-03-09T14:47:32.568 INFO:teuthology.orchestra.run.smithi099.stderr: 71300K .......... .......... .......... .......... .......... 76% 89.4M 0s 2024-03-09T14:47:32.568 INFO:teuthology.orchestra.run.smithi099.stderr: 71350K .......... .......... .......... .......... .......... 76% 115M 0s 2024-03-09T14:47:32.568 INFO:teuthology.orchestra.run.smithi099.stderr: 71400K .......... .......... .......... .......... .......... 76% 103M 0s 2024-03-09T14:47:32.568 INFO:teuthology.orchestra.run.smithi099.stderr: 71450K .......... .......... .......... .......... .......... 76% 126M 0s 2024-03-09T14:47:32.568 INFO:teuthology.orchestra.run.smithi099.stderr: 71500K .......... .......... .......... .......... .......... 77% 107M 0s 2024-03-09T14:47:32.568 INFO:teuthology.orchestra.run.smithi099.stderr: 71550K .......... .......... .......... .......... .......... 77% 113M 0s 2024-03-09T14:47:32.568 INFO:teuthology.orchestra.run.smithi099.stderr: 71600K .......... .......... .......... .......... .......... 77% 117M 0s 2024-03-09T14:47:32.568 INFO:teuthology.orchestra.run.smithi099.stderr: 71650K .......... .......... .......... .......... .......... 77% 113M 0s 2024-03-09T14:47:32.568 INFO:teuthology.orchestra.run.smithi099.stderr: 71700K .......... .......... .......... .......... .......... 77% 45.0M 0s 2024-03-09T14:47:32.568 INFO:teuthology.orchestra.run.smithi099.stderr: 71750K .......... .......... .......... .......... .......... 77% 99.1M 0s 2024-03-09T14:47:32.569 INFO:teuthology.orchestra.run.smithi099.stderr: 71800K .......... .......... .......... .......... .......... 77% 101M 0s 2024-03-09T14:47:32.569 INFO:teuthology.orchestra.run.smithi099.stderr: 71850K .......... .......... .......... .......... .......... 77% 110M 0s 2024-03-09T14:47:32.569 INFO:teuthology.orchestra.run.smithi099.stderr: 71900K .......... .......... .......... .......... .......... 77% 103M 0s 2024-03-09T14:47:32.569 INFO:teuthology.orchestra.run.smithi099.stderr: 71950K .......... .......... .......... .......... .......... 77% 107M 0s 2024-03-09T14:47:32.569 INFO:teuthology.orchestra.run.smithi099.stderr: 72000K .......... .......... .......... .......... .......... 77% 111M 0s 2024-03-09T14:47:32.569 INFO:teuthology.orchestra.run.smithi099.stderr: 72050K .......... .......... .......... .......... .......... 77% 103M 0s 2024-03-09T14:47:32.569 INFO:teuthology.orchestra.run.smithi099.stderr: 72100K .......... .......... .......... .......... .......... 77% 89.1M 0s 2024-03-09T14:47:32.569 INFO:teuthology.orchestra.run.smithi099.stderr: 72150K .......... .......... .......... .......... .......... 77% 112M 0s 2024-03-09T14:47:32.569 INFO:teuthology.orchestra.run.smithi099.stderr: 72200K .......... .......... .......... .......... .......... 77% 112M 0s 2024-03-09T14:47:32.569 INFO:teuthology.orchestra.run.smithi099.stderr: 72250K .......... .......... .......... .......... .......... 77% 120M 0s 2024-03-09T14:47:32.569 INFO:teuthology.orchestra.run.smithi099.stderr: 72300K .......... .......... .......... .......... .......... 77% 105M 0s 2024-03-09T14:47:32.569 INFO:teuthology.orchestra.run.smithi099.stderr: 72350K .......... .......... .......... .......... .......... 77% 104M 0s 2024-03-09T14:47:32.569 INFO:teuthology.orchestra.run.smithi099.stderr: 72400K .......... .......... .......... .......... .......... 77% 113M 0s 2024-03-09T14:47:32.570 INFO:teuthology.orchestra.run.smithi099.stderr: 72450K .......... .......... .......... .......... .......... 78% 113M 0s 2024-03-09T14:47:32.570 INFO:teuthology.orchestra.run.smithi099.stderr: 72500K .......... .......... .......... .......... .......... 78% 93.7M 0s 2024-03-09T14:47:32.570 INFO:teuthology.orchestra.run.smithi099.stderr: 72550K .......... .......... .......... .......... .......... 78% 113M 0s 2024-03-09T14:47:32.570 INFO:teuthology.orchestra.run.smithi099.stderr: 72600K .......... .......... .......... .......... .......... 78% 124M 0s 2024-03-09T14:47:32.570 INFO:teuthology.orchestra.run.smithi099.stderr: 72650K .......... .......... .......... .......... .......... 78% 108M 0s 2024-03-09T14:47:32.570 INFO:teuthology.orchestra.run.smithi099.stderr: 72700K .......... .......... .......... .......... .......... 78% 113M 0s 2024-03-09T14:47:32.570 INFO:teuthology.orchestra.run.smithi099.stderr: 72750K .......... .......... .......... .......... .......... 78% 123M 0s 2024-03-09T14:47:32.570 INFO:teuthology.orchestra.run.smithi099.stderr: 72800K .......... .......... .......... .......... .......... 78% 114M 0s 2024-03-09T14:47:32.570 INFO:teuthology.orchestra.run.smithi099.stderr: 72850K .......... .......... .......... .......... .......... 78% 122M 0s 2024-03-09T14:47:32.570 INFO:teuthology.orchestra.run.smithi099.stderr: 72900K .......... .......... .......... .......... .......... 78% 98.0M 0s 2024-03-09T14:47:32.570 INFO:teuthology.orchestra.run.smithi099.stderr: 72950K .......... .......... .......... .......... .......... 78% 107M 0s 2024-03-09T14:47:32.570 INFO:teuthology.orchestra.run.smithi099.stderr: 73000K .......... .......... .......... .......... .......... 78% 125M 0s 2024-03-09T14:47:32.570 INFO:teuthology.orchestra.run.smithi099.stderr: 73050K .......... .......... .......... .......... .......... 78% 124M 0s 2024-03-09T14:47:32.570 INFO:teuthology.orchestra.run.smithi099.stderr: 73100K .......... .......... .......... .......... .......... 78% 108M 0s 2024-03-09T14:47:32.570 INFO:teuthology.orchestra.run.smithi099.stderr: 73150K .......... .......... .......... .......... .......... 78% 124M 0s 2024-03-09T14:47:32.571 INFO:teuthology.orchestra.run.smithi099.stderr: 73200K .......... .......... .......... .......... .......... 78% 120M 0s 2024-03-09T14:47:32.571 INFO:teuthology.orchestra.run.smithi099.stderr: 73250K .......... .......... .......... .......... .......... 78% 119M 0s 2024-03-09T14:47:32.571 INFO:teuthology.orchestra.run.smithi099.stderr: 73300K .......... .......... .......... .......... .......... 78% 103M 0s 2024-03-09T14:47:32.571 INFO:teuthology.orchestra.run.smithi099.stderr: 73350K .......... .......... .......... .......... .......... 79% 135M 0s 2024-03-09T14:47:32.571 INFO:teuthology.orchestra.run.smithi099.stderr: 73400K .......... .......... .......... .......... .......... 79% 119M 0s 2024-03-09T14:47:32.571 INFO:teuthology.orchestra.run.smithi099.stderr: 73450K .......... .......... .......... .......... .......... 79% 15.6M 0s 2024-03-09T14:47:32.571 INFO:teuthology.orchestra.run.smithi099.stderr: 73500K .......... .......... .......... .......... .......... 79% 53.3M 0s 2024-03-09T14:47:32.571 INFO:teuthology.orchestra.run.smithi099.stderr: 73550K .......... .......... .......... .......... .......... 79% 138M 0s 2024-03-09T14:47:32.571 INFO:teuthology.orchestra.run.smithi099.stderr: 73600K .......... .......... .......... .......... .......... 79% 139M 0s 2024-03-09T14:47:32.571 INFO:teuthology.orchestra.run.smithi099.stderr: 73650K .......... .......... .......... .......... .......... 79% 106M 0s 2024-03-09T14:47:32.571 INFO:teuthology.orchestra.run.smithi099.stderr: 73700K .......... .......... .......... .......... .......... 79% 135M 0s 2024-03-09T14:47:32.571 INFO:teuthology.orchestra.run.smithi099.stderr: 73750K .......... .......... .......... .......... .......... 79% 144M 0s 2024-03-09T14:47:32.571 INFO:teuthology.orchestra.run.smithi099.stderr: 73800K .......... .......... .......... .......... .......... 79% 132M 0s 2024-03-09T14:47:32.571 INFO:teuthology.orchestra.run.smithi099.stderr: 73850K .......... .......... .......... .......... .......... 79% 103M 0s 2024-03-09T14:47:32.572 INFO:teuthology.orchestra.run.smithi099.stderr: 73900K .......... .......... .......... .......... .......... 79% 144M 0s 2024-03-09T14:47:32.572 INFO:teuthology.orchestra.run.smithi099.stderr: 73950K .......... .......... .......... .......... .......... 79% 135M 0s 2024-03-09T14:47:32.572 INFO:teuthology.orchestra.run.smithi099.stderr: 74000K .......... .......... .......... .......... .......... 79% 115M 0s 2024-03-09T14:47:32.572 INFO:teuthology.orchestra.run.smithi099.stderr: 74050K .......... .......... .......... .......... .......... 79% 124M 0s 2024-03-09T14:47:32.572 INFO:teuthology.orchestra.run.smithi099.stderr: 74100K .......... .......... .......... .......... .......... 79% 143M 0s 2024-03-09T14:47:32.572 INFO:teuthology.orchestra.run.smithi099.stderr: 74150K .......... .......... .......... .......... .......... 79% 125M 0s 2024-03-09T14:47:32.572 INFO:teuthology.orchestra.run.smithi099.stderr: 74200K .......... .......... .......... .......... .......... 79% 135M 0s 2024-03-09T14:47:32.572 INFO:teuthology.orchestra.run.smithi099.stderr: 74250K .......... .......... .......... .......... .......... 79% 143M 0s 2024-03-09T14:47:32.572 INFO:teuthology.orchestra.run.smithi099.stderr: 74300K .......... .......... .......... .......... .......... 80% 152M 0s 2024-03-09T14:47:32.572 INFO:teuthology.orchestra.run.smithi099.stderr: 74350K .......... .......... .......... .......... .......... 80% 104M 0s 2024-03-09T14:47:32.572 INFO:teuthology.orchestra.run.smithi099.stderr: 74400K .......... .......... .......... .......... .......... 80% 136M 0s 2024-03-09T14:47:32.572 INFO:teuthology.orchestra.run.smithi099.stderr: 74450K .......... .......... .......... .......... .......... 80% 150M 0s 2024-03-09T14:47:32.572 INFO:teuthology.orchestra.run.smithi099.stderr: 74500K .......... .......... .......... .......... .......... 80% 137M 0s 2024-03-09T14:47:32.572 INFO:teuthology.orchestra.run.smithi099.stderr: 74550K .......... .......... .......... .......... .......... 80% 129M 0s 2024-03-09T14:47:32.572 INFO:teuthology.orchestra.run.smithi099.stderr: 74600K .......... .......... .......... .......... .......... 80% 137M 0s 2024-03-09T14:47:32.572 INFO:teuthology.orchestra.run.smithi099.stderr: 74650K .......... .......... .......... .......... .......... 80% 115M 0s 2024-03-09T14:47:32.573 INFO:teuthology.orchestra.run.smithi099.stderr: 74700K .......... .......... .......... .......... .......... 80% 106M 0s 2024-03-09T14:47:32.573 INFO:teuthology.orchestra.run.smithi099.stderr: 74750K .......... .......... .......... .......... .......... 80% 42.6M 0s 2024-03-09T14:47:32.573 INFO:teuthology.orchestra.run.smithi099.stderr: 74800K .......... .......... .......... .......... .......... 80% 48.1M 0s 2024-03-09T14:47:32.573 INFO:teuthology.orchestra.run.smithi099.stderr: 74850K .......... .......... .......... .......... .......... 80% 46.4M 0s 2024-03-09T14:47:32.573 INFO:teuthology.orchestra.run.smithi099.stderr: 74900K .......... .......... .......... .......... .......... 80% 47.6M 0s 2024-03-09T14:47:32.573 INFO:teuthology.orchestra.run.smithi099.stderr: 74950K .......... .......... .......... .......... .......... 80% 105M 0s 2024-03-09T14:47:32.573 INFO:teuthology.orchestra.run.smithi099.stderr: 75000K .......... .......... .......... .......... .......... 80% 50.2M 0s 2024-03-09T14:47:32.573 INFO:teuthology.orchestra.run.smithi099.stderr: 75050K .......... .......... .......... .......... .......... 80% 48.4M 0s 2024-03-09T14:47:32.573 INFO:teuthology.orchestra.run.smithi099.stderr: 75100K .......... .......... .......... .......... .......... 80% 50.1M 0s 2024-03-09T14:47:32.573 INFO:teuthology.orchestra.run.smithi099.stderr: 75150K .......... .......... .......... .......... .......... 80% 42.5M 0s 2024-03-09T14:47:32.573 INFO:teuthology.orchestra.run.smithi099.stderr: 75200K .......... .......... .......... .......... .......... 81% 95.6M 0s 2024-03-09T14:47:32.573 INFO:teuthology.orchestra.run.smithi099.stderr: 75250K .......... .......... .......... .......... .......... 81% 50.9M 0s 2024-03-09T14:47:32.573 INFO:teuthology.orchestra.run.smithi099.stderr: 75300K .......... .......... .......... .......... .......... 81% 42.5M 0s 2024-03-09T14:47:32.573 INFO:teuthology.orchestra.run.smithi099.stderr: 75350K .......... .......... .......... .......... .......... 81% 53.2M 0s 2024-03-09T14:47:32.574 INFO:teuthology.orchestra.run.smithi099.stderr: 75400K .......... .......... .......... .......... .......... 81% 113M 0s 2024-03-09T14:47:32.574 INFO:teuthology.orchestra.run.smithi099.stderr: 75450K .......... .......... .......... .......... .......... 81% 51.3M 0s 2024-03-09T14:47:32.574 INFO:teuthology.orchestra.run.smithi099.stderr: 75500K .......... .......... .......... .......... .......... 81% 89.0M 0s 2024-03-09T14:47:32.574 INFO:teuthology.orchestra.run.smithi099.stderr: 75550K .......... .......... .......... .......... .......... 81% 92.8M 0s 2024-03-09T14:47:32.574 INFO:teuthology.orchestra.run.smithi099.stderr: 75600K .......... .......... .......... .......... .......... 81% 107M 0s 2024-03-09T14:47:32.574 INFO:teuthology.orchestra.run.smithi099.stderr: 75650K .......... .......... .......... .......... .......... 81% 119M 0s 2024-03-09T14:47:32.574 INFO:teuthology.orchestra.run.smithi099.stderr: 75700K .......... .......... .......... .......... .......... 81% 118M 0s 2024-03-09T14:47:32.574 INFO:teuthology.orchestra.run.smithi099.stderr: 75750K .......... .......... .......... .......... .......... 81% 104M 0s 2024-03-09T14:47:32.574 INFO:teuthology.orchestra.run.smithi099.stderr: 75800K .......... .......... .......... .......... .......... 81% 106M 0s 2024-03-09T14:47:32.574 INFO:teuthology.orchestra.run.smithi099.stderr: 75850K .......... .......... .......... .......... .......... 81% 101M 0s 2024-03-09T14:47:32.574 INFO:teuthology.orchestra.run.smithi099.stderr: 75900K .......... .......... .......... .......... .......... 81% 104M 0s 2024-03-09T14:47:32.574 INFO:teuthology.orchestra.run.smithi099.stderr: 75950K .......... .......... .......... .......... .......... 81% 85.4M 0s 2024-03-09T14:47:32.574 INFO:teuthology.orchestra.run.smithi099.stderr: 76000K .......... .......... .......... .......... .......... 81% 117M 0s 2024-03-09T14:47:32.574 INFO:teuthology.orchestra.run.smithi099.stderr: 76050K .......... .......... .......... .......... .......... 81% 117M 0s 2024-03-09T14:47:32.574 INFO:teuthology.orchestra.run.smithi099.stderr: 76100K .......... .......... .......... .......... .......... 81% 109M 0s 2024-03-09T14:47:32.575 INFO:teuthology.orchestra.run.smithi099.stderr: 76150K .......... .......... .......... .......... .......... 82% 112M 0s 2024-03-09T14:47:32.575 INFO:teuthology.orchestra.run.smithi099.stderr: 76200K .......... .......... .......... .......... .......... 82% 112M 0s 2024-03-09T14:47:32.575 INFO:teuthology.orchestra.run.smithi099.stderr: 76250K .......... .......... .......... .......... .......... 82% 94.5M 0s 2024-03-09T14:47:32.575 INFO:teuthology.orchestra.run.smithi099.stderr: 76300K .......... .......... .......... .......... .......... 82% 126M 0s 2024-03-09T14:47:32.575 INFO:teuthology.orchestra.run.smithi099.stderr: 76350K .......... .......... .......... .......... .......... 82% 91.3M 0s 2024-03-09T14:47:32.575 INFO:teuthology.orchestra.run.smithi099.stderr: 76400K .......... .......... .......... .......... .......... 82% 112M 0s 2024-03-09T14:47:32.575 INFO:teuthology.orchestra.run.smithi099.stderr: 76450K .......... .......... .......... .......... .......... 82% 85.2M 0s 2024-03-09T14:47:32.575 INFO:teuthology.orchestra.run.smithi099.stderr: 76500K .......... .......... .......... .......... .......... 82% 113M 0s 2024-03-09T14:47:32.575 INFO:teuthology.orchestra.run.smithi099.stderr: 76550K .......... .......... .......... .......... .......... 82% 108M 0s 2024-03-09T14:47:32.575 INFO:teuthology.orchestra.run.smithi099.stderr: 76600K .......... .......... .......... .......... .......... 82% 112M 0s 2024-03-09T14:47:32.575 INFO:teuthology.orchestra.run.smithi099.stderr: 76650K .......... .......... .......... .......... .......... 82% 100M 0s 2024-03-09T14:47:32.575 INFO:teuthology.orchestra.run.smithi099.stderr: 76700K .......... .......... .......... .......... .......... 82% 46.4M 0s 2024-03-09T14:47:32.575 INFO:teuthology.orchestra.run.smithi099.stderr: 76750K .......... .......... .......... .......... .......... 82% 86.6M 0s 2024-03-09T14:47:32.575 INFO:teuthology.orchestra.run.smithi099.stderr: 76800K .......... .......... .......... .......... .......... 82% 95.7M 0s 2024-03-09T14:47:32.575 INFO:teuthology.orchestra.run.smithi099.stderr: 76850K .......... .......... .......... .......... .......... 82% 124M 0s 2024-03-09T14:47:32.576 INFO:teuthology.orchestra.run.smithi099.stderr: 76900K .......... .......... .......... .......... .......... 82% 133M 0s 2024-03-09T14:47:32.576 INFO:teuthology.orchestra.run.smithi099.stderr: 76950K .......... .......... .......... .......... .......... 82% 109M 0s 2024-03-09T14:47:32.576 INFO:teuthology.orchestra.run.smithi099.stderr: 77000K .......... .......... .......... .......... .......... 82% 116M 0s 2024-03-09T14:47:32.576 INFO:teuthology.orchestra.run.smithi099.stderr: 77050K .......... .......... .......... .......... .......... 82% 120M 0s 2024-03-09T14:47:32.576 INFO:teuthology.orchestra.run.smithi099.stderr: 77100K .......... .......... .......... .......... .......... 83% 114M 0s 2024-03-09T14:47:32.576 INFO:teuthology.orchestra.run.smithi099.stderr: 77150K .......... .......... .......... .......... .......... 83% 89.8M 0s 2024-03-09T14:47:32.576 INFO:teuthology.orchestra.run.smithi099.stderr: 77200K .......... .......... .......... .......... .......... 83% 119M 0s 2024-03-09T14:47:32.576 INFO:teuthology.orchestra.run.smithi099.stderr: 77250K .......... .......... .......... .......... .......... 83% 114M 0s 2024-03-09T14:47:32.576 INFO:teuthology.orchestra.run.smithi099.stderr: 77300K .......... .......... .......... .......... .......... 83% 116M 0s 2024-03-09T14:47:32.576 INFO:teuthology.orchestra.run.smithi099.stderr: 77350K .......... .......... .......... .......... .......... 83% 107M 0s 2024-03-09T14:47:32.576 INFO:teuthology.orchestra.run.smithi099.stderr: 77400K .......... .......... .......... .......... .......... 83% 120M 0s 2024-03-09T14:47:32.576 INFO:teuthology.orchestra.run.smithi099.stderr: 77450K .......... .......... .......... .......... .......... 83% 110M 0s 2024-03-09T14:47:32.576 INFO:teuthology.orchestra.run.smithi099.stderr: 77500K .......... .......... .......... .......... .......... 83% 120M 0s 2024-03-09T14:47:32.576 INFO:teuthology.orchestra.run.smithi099.stderr: 77550K .......... .......... .......... .......... .......... 83% 92.3M 0s 2024-03-09T14:47:32.576 INFO:teuthology.orchestra.run.smithi099.stderr: 77600K .......... .......... .......... .......... .......... 83% 111M 0s 2024-03-09T14:47:32.577 INFO:teuthology.orchestra.run.smithi099.stderr: 77650K .......... .......... .......... .......... .......... 83% 112M 0s 2024-03-09T14:47:32.577 INFO:teuthology.orchestra.run.smithi099.stderr: 77700K .......... .......... .......... .......... .......... 83% 129M 0s 2024-03-09T14:47:32.577 INFO:teuthology.orchestra.run.smithi099.stderr: 77750K .......... .......... .......... .......... .......... 83% 113M 0s 2024-03-09T14:47:32.577 INFO:teuthology.orchestra.run.smithi099.stderr: 77800K .......... .......... .......... .......... .......... 83% 113M 0s 2024-03-09T14:47:32.577 INFO:teuthology.orchestra.run.smithi099.stderr: 77850K .......... .......... .......... .......... .......... 83% 95.6M 0s 2024-03-09T14:47:32.577 INFO:teuthology.orchestra.run.smithi099.stderr: 77900K .......... .......... .......... .......... .......... 83% 113M 0s 2024-03-09T14:47:32.577 INFO:teuthology.orchestra.run.smithi099.stderr: 77950K .......... .......... .......... .......... .......... 83% 111M 0s 2024-03-09T14:47:32.577 INFO:teuthology.orchestra.run.smithi099.stderr: 78000K .......... .......... .......... .......... .......... 84% 118M 0s 2024-03-09T14:47:32.577 INFO:teuthology.orchestra.run.smithi099.stderr: 78050K .......... .......... .......... .......... .......... 84% 101M 0s 2024-03-09T14:47:32.577 INFO:teuthology.orchestra.run.smithi099.stderr: 78100K .......... .......... .......... .......... .......... 84% 117M 0s 2024-03-09T14:47:32.577 INFO:teuthology.orchestra.run.smithi099.stderr: 78150K .......... .......... .......... .......... .......... 84% 108M 0s 2024-03-09T14:47:32.577 INFO:teuthology.orchestra.run.smithi099.stderr: 78200K .......... .......... .......... .......... .......... 84% 116M 0s 2024-03-09T14:47:32.577 INFO:teuthology.orchestra.run.smithi099.stderr: 78250K .......... .......... .......... .......... .......... 84% 95.2M 0s 2024-03-09T14:47:32.577 INFO:teuthology.orchestra.run.smithi099.stderr: 78300K .......... .......... .......... .......... .......... 84% 105M 0s 2024-03-09T14:47:32.578 INFO:teuthology.orchestra.run.smithi099.stderr: 78350K .......... .......... .......... .......... .......... 84% 123M 0s 2024-03-09T14:47:32.578 INFO:teuthology.orchestra.run.smithi099.stderr: 78400K .......... .......... .......... .......... .......... 84% 101M 0s 2024-03-09T14:47:32.578 INFO:teuthology.orchestra.run.smithi099.stderr: 78450K .......... .......... .......... .......... .......... 84% 108M 0s 2024-03-09T14:47:32.578 INFO:teuthology.orchestra.run.smithi099.stderr: 78500K .......... .......... .......... .......... .......... 84% 78.2M 0s 2024-03-09T14:47:32.578 INFO:teuthology.orchestra.run.smithi099.stderr: 78550K .......... .......... .......... .......... .......... 84% 114M 0s 2024-03-09T14:47:32.578 INFO:teuthology.orchestra.run.smithi099.stderr: 78600K .......... .......... .......... .......... .......... 84% 92.9M 0s 2024-03-09T14:47:32.578 INFO:teuthology.orchestra.run.smithi099.stderr: 78650K .......... .......... .......... .......... .......... 84% 115M 0s 2024-03-09T14:47:32.578 INFO:teuthology.orchestra.run.smithi099.stderr: 78700K .......... .......... .......... .......... .......... 84% 112M 0s 2024-03-09T14:47:32.578 INFO:teuthology.orchestra.run.smithi099.stderr: 78750K .......... .......... .......... .......... .......... 84% 115M 0s 2024-03-09T14:47:32.578 INFO:teuthology.orchestra.run.smithi099.stderr: 78800K .......... .......... .......... .......... .......... 84% 99.9M 0s 2024-03-09T14:47:32.578 INFO:teuthology.orchestra.run.smithi099.stderr: 78850K .......... .......... .......... .......... .......... 84% 115M 0s 2024-03-09T14:47:32.578 INFO:teuthology.orchestra.run.smithi099.stderr: 78900K .......... .......... .......... .......... .......... 84% 110M 0s 2024-03-09T14:47:32.578 INFO:teuthology.orchestra.run.smithi099.stderr: 78950K .......... .......... .......... .......... .......... 85% 116M 0s 2024-03-09T14:47:32.579 INFO:teuthology.orchestra.run.smithi099.stderr: 79000K .......... .......... .......... .......... .......... 85% 88.1M 0s 2024-03-09T14:47:32.579 INFO:teuthology.orchestra.run.smithi099.stderr: 79050K .......... .......... .......... .......... .......... 85% 116M 0s 2024-03-09T14:47:32.579 INFO:teuthology.orchestra.run.smithi099.stderr: 79100K .......... .......... .......... .......... .......... 85% 123M 0s 2024-03-09T14:47:32.579 INFO:teuthology.orchestra.run.smithi099.stderr: 79150K .......... .......... .......... .......... .......... 85% 114M 0s 2024-03-09T14:47:32.579 INFO:teuthology.orchestra.run.smithi099.stderr: 79200K .......... .......... .......... .......... .......... 85% 107M 0s 2024-03-09T14:47:32.579 INFO:teuthology.orchestra.run.smithi099.stderr: 79250K .......... .......... .......... .......... .......... 85% 117M 0s 2024-03-09T14:47:32.579 INFO:teuthology.orchestra.run.smithi099.stderr: 79300K .......... .......... .......... .......... .......... 85% 117M 0s 2024-03-09T14:47:32.579 INFO:teuthology.orchestra.run.smithi099.stderr: 79350K .......... .......... .......... .......... .......... 85% 109M 0s 2024-03-09T14:47:32.579 INFO:teuthology.orchestra.run.smithi099.stderr: 79400K .......... .......... .......... .......... .......... 85% 92.3M 0s 2024-03-09T14:47:32.579 INFO:teuthology.orchestra.run.smithi099.stderr: 79450K .......... .......... .......... .......... .......... 85% 118M 0s 2024-03-09T14:47:32.579 INFO:teuthology.orchestra.run.smithi099.stderr: 79500K .......... .......... .......... .......... .......... 85% 95.7M 0s 2024-03-09T14:47:32.579 INFO:teuthology.orchestra.run.smithi099.stderr: 79550K .......... .......... .......... .......... .......... 85% 108M 0s 2024-03-09T14:47:32.579 INFO:teuthology.orchestra.run.smithi099.stderr: 79600K .......... .......... .......... .......... .......... 85% 111M 0s 2024-03-09T14:47:32.579 INFO:teuthology.orchestra.run.smithi099.stderr: 79650K .......... .......... .......... .......... .......... 85% 113M 0s 2024-03-09T14:47:32.580 INFO:teuthology.orchestra.run.smithi099.stderr: 79700K .......... .......... .......... .......... .......... 85% 119M 0s 2024-03-09T14:47:32.580 INFO:teuthology.orchestra.run.smithi099.stderr: 79750K .......... .......... .......... .......... .......... 85% 110M 0s 2024-03-09T14:47:32.580 INFO:teuthology.orchestra.run.smithi099.stderr: 79800K .......... .......... .......... .......... .......... 85% 93.7M 0s 2024-03-09T14:47:32.580 INFO:teuthology.orchestra.run.smithi099.stderr: 79850K .......... .......... .......... .......... .......... 86% 113M 0s 2024-03-09T14:47:32.580 INFO:teuthology.orchestra.run.smithi099.stderr: 79900K .......... .......... .......... .......... .......... 86% 114M 0s 2024-03-09T14:47:32.580 INFO:teuthology.orchestra.run.smithi099.stderr: 79950K .......... .......... .......... .......... .......... 86% 110M 0s 2024-03-09T14:47:32.580 INFO:teuthology.orchestra.run.smithi099.stderr: 80000K .......... .......... .......... .......... .......... 86% 108M 0s 2024-03-09T14:47:32.580 INFO:teuthology.orchestra.run.smithi099.stderr: 80050K .......... .......... .......... .......... .......... 86% 117M 0s 2024-03-09T14:47:32.580 INFO:teuthology.orchestra.run.smithi099.stderr: 80100K .......... .......... .......... .......... .......... 86% 117M 0s 2024-03-09T14:47:32.580 INFO:teuthology.orchestra.run.smithi099.stderr: 80150K .......... .......... .......... .......... .......... 86% 123M 0s 2024-03-09T14:47:32.580 INFO:teuthology.orchestra.run.smithi099.stderr: 80200K .......... .......... .......... .......... .......... 86% 90.2M 0s 2024-03-09T14:47:32.580 INFO:teuthology.orchestra.run.smithi099.stderr: 80250K .......... .......... .......... .......... .......... 86% 112M 0s 2024-03-09T14:47:32.580 INFO:teuthology.orchestra.run.smithi099.stderr: 80300K .......... .......... .......... .......... .......... 86% 117M 0s 2024-03-09T14:47:32.580 INFO:teuthology.orchestra.run.smithi099.stderr: 80350K .......... .......... .......... .......... .......... 86% 111M 0s 2024-03-09T14:47:32.581 INFO:teuthology.orchestra.run.smithi099.stderr: 80400K .......... .......... .......... .......... .......... 86% 110M 0s 2024-03-09T14:47:32.581 INFO:teuthology.orchestra.run.smithi099.stderr: 80450K .......... .......... .......... .......... .......... 86% 88.3M 0s 2024-03-09T14:47:32.581 INFO:teuthology.orchestra.run.smithi099.stderr: 80500K .......... .......... .......... .......... .......... 86% 105M 0s 2024-03-09T14:47:32.581 INFO:teuthology.orchestra.run.smithi099.stderr: 80550K .......... .......... .......... .......... .......... 86% 125M 0s 2024-03-09T14:47:32.581 INFO:teuthology.orchestra.run.smithi099.stderr: 80600K .......... .......... .......... .......... .......... 86% 91.1M 0s 2024-03-09T14:47:32.581 INFO:teuthology.orchestra.run.smithi099.stderr: 80650K .......... .......... .......... .......... .......... 86% 117M 0s 2024-03-09T14:47:32.581 INFO:teuthology.orchestra.run.smithi099.stderr: 80700K .......... .......... .......... .......... .......... 86% 116M 0s 2024-03-09T14:47:32.581 INFO:teuthology.orchestra.run.smithi099.stderr: 80750K .......... .......... .......... .......... .......... 86% 83.6M 0s 2024-03-09T14:47:32.581 INFO:teuthology.orchestra.run.smithi099.stderr: 80800K .......... .......... .......... .......... .......... 87% 118M 0s 2024-03-09T14:47:32.581 INFO:teuthology.orchestra.run.smithi099.stderr: 80850K .......... .......... .......... .......... .......... 87% 91.8M 0s 2024-03-09T14:47:32.581 INFO:teuthology.orchestra.run.smithi099.stderr: 80900K .......... .......... .......... .......... .......... 87% 97.8M 0s 2024-03-09T14:47:32.581 INFO:teuthology.orchestra.run.smithi099.stderr: 80950K .......... .......... .......... .......... .......... 87% 109M 0s 2024-03-09T14:47:32.581 INFO:teuthology.orchestra.run.smithi099.stderr: 81000K .......... .......... .......... .......... .......... 87% 119M 0s 2024-03-09T14:47:32.581 INFO:teuthology.orchestra.run.smithi099.stderr: 81050K .......... .......... .......... .......... .......... 87% 104M 0s 2024-03-09T14:47:32.581 INFO:teuthology.orchestra.run.smithi099.stderr: 81100K .......... .......... .......... .......... .......... 87% 122M 0s 2024-03-09T14:47:32.581 INFO:teuthology.orchestra.run.smithi099.stderr: 81150K .......... .......... .......... .......... .......... 87% 99.1M 0s 2024-03-09T14:47:32.582 INFO:teuthology.orchestra.run.smithi099.stderr: 81200K .......... .......... .......... .......... .......... 87% 97.3M 0s 2024-03-09T14:47:32.582 INFO:teuthology.orchestra.run.smithi099.stderr: 81250K .......... .......... .......... .......... .......... 87% 139M 0s 2024-03-09T14:47:32.582 INFO:teuthology.orchestra.run.smithi099.stderr: 81300K .......... .......... .......... .......... .......... 87% 121M 0s 2024-03-09T14:47:32.582 INFO:teuthology.orchestra.run.smithi099.stderr: 81350K .......... .......... .......... .......... .......... 87% 116M 0s 2024-03-09T14:47:32.582 INFO:teuthology.orchestra.run.smithi099.stderr: 81400K .......... .......... .......... .......... .......... 87% 86.7M 0s 2024-03-09T14:47:32.582 INFO:teuthology.orchestra.run.smithi099.stderr: 81450K .......... .......... .......... .......... .......... 87% 58.5M 0s 2024-03-09T14:47:32.582 INFO:teuthology.orchestra.run.smithi099.stderr: 81500K .......... .......... .......... .......... .......... 87% 114M 0s 2024-03-09T14:47:32.582 INFO:teuthology.orchestra.run.smithi099.stderr: 81550K .......... .......... .......... .......... .......... 87% 119M 0s 2024-03-09T14:47:32.582 INFO:teuthology.orchestra.run.smithi099.stderr: 81600K .......... .......... .......... .......... .......... 87% 111M 0s 2024-03-09T14:47:32.582 INFO:teuthology.orchestra.run.smithi099.stderr: 81650K .......... .......... .......... .......... .......... 87% 89.9M 0s 2024-03-09T14:47:32.582 INFO:teuthology.orchestra.run.smithi099.stderr: 81700K .......... .......... .......... .......... .......... 87% 124M 0s 2024-03-09T14:47:32.582 INFO:teuthology.orchestra.run.smithi099.stderr: 81750K .......... .......... .......... .......... .......... 88% 116M 0s 2024-03-09T14:47:32.582 INFO:teuthology.orchestra.run.smithi099.stderr: 81800K .......... .......... .......... .......... .......... 88% 112M 0s 2024-03-09T14:47:32.582 INFO:teuthology.orchestra.run.smithi099.stderr: 81850K .......... .......... .......... .......... .......... 88% 114M 0s 2024-03-09T14:47:32.582 INFO:teuthology.orchestra.run.smithi099.stderr: 81900K .......... .......... .......... .......... .......... 88% 86.3M 0s 2024-03-09T14:47:32.583 INFO:teuthology.orchestra.run.smithi099.stderr: 81950K .......... .......... .......... .......... .......... 88% 132M 0s 2024-03-09T14:47:32.583 INFO:teuthology.orchestra.run.smithi099.stderr: 82000K .......... .......... .......... .......... .......... 88% 112M 0s 2024-03-09T14:47:32.583 INFO:teuthology.orchestra.run.smithi099.stderr: 82050K .......... .......... .......... .......... .......... 88% 118M 0s 2024-03-09T14:47:32.583 INFO:teuthology.orchestra.run.smithi099.stderr: 82100K .......... .......... .......... .......... .......... 88% 62.9M 0s 2024-03-09T14:47:32.583 INFO:teuthology.orchestra.run.smithi099.stderr: 82150K .......... .......... .......... .......... .......... 88% 91.9M 0s 2024-03-09T14:47:32.583 INFO:teuthology.orchestra.run.smithi099.stderr: 82200K .......... .......... .......... .......... .......... 88% 112M 0s 2024-03-09T14:47:32.583 INFO:teuthology.orchestra.run.smithi099.stderr: 82250K .......... .......... .......... .......... .......... 88% 115M 0s 2024-03-09T14:47:32.583 INFO:teuthology.orchestra.run.smithi099.stderr: 82300K .......... .......... .......... .......... .......... 88% 110M 0s 2024-03-09T14:47:32.583 INFO:teuthology.orchestra.run.smithi099.stderr: 82350K .......... .......... .......... .......... .......... 88% 104M 0s 2024-03-09T14:47:32.583 INFO:teuthology.orchestra.run.smithi099.stderr: 82400K .......... .......... .......... .......... .......... 88% 111M 0s 2024-03-09T14:47:32.583 INFO:teuthology.orchestra.run.smithi099.stderr: 82450K .......... .......... .......... .......... .......... 88% 127M 0s 2024-03-09T14:47:32.583 INFO:teuthology.orchestra.run.smithi099.stderr: 82500K .......... .......... .......... .......... .......... 88% 103M 0s 2024-03-09T14:47:32.583 INFO:teuthology.orchestra.run.smithi099.stderr: 82550K .......... .......... .......... .......... .......... 88% 54.6M 0s 2024-03-09T14:47:32.583 INFO:teuthology.orchestra.run.smithi099.stderr: 82600K .......... .......... .......... .......... .......... 88% 49.9M 0s 2024-03-09T14:47:32.583 INFO:teuthology.orchestra.run.smithi099.stderr: 82650K .......... .......... .......... .......... .......... 89% 112M 0s 2024-03-09T14:47:32.584 INFO:teuthology.orchestra.run.smithi099.stderr: 82700K .......... .......... .......... .......... .......... 89% 110M 0s 2024-03-09T14:47:32.584 INFO:teuthology.orchestra.run.smithi099.stderr: 82750K .......... .......... .......... .......... .......... 89% 116M 0s 2024-03-09T14:47:32.584 INFO:teuthology.orchestra.run.smithi099.stderr: 82800K .......... .......... .......... .......... .......... 89% 90.3M 0s 2024-03-09T14:47:32.584 INFO:teuthology.orchestra.run.smithi099.stderr: 82850K .......... .......... .......... .......... .......... 89% 112M 0s 2024-03-09T14:47:32.584 INFO:teuthology.orchestra.run.smithi099.stderr: 82900K .......... .......... .......... .......... .......... 89% 118M 0s 2024-03-09T14:47:32.584 INFO:teuthology.orchestra.run.smithi099.stderr: 82950K .......... .......... .......... .......... .......... 89% 112M 0s 2024-03-09T14:47:32.584 INFO:teuthology.orchestra.run.smithi099.stderr: 83000K .......... .......... .......... .......... .......... 89% 98.2M 0s 2024-03-09T14:47:32.584 INFO:teuthology.orchestra.run.smithi099.stderr: 83050K .......... .......... .......... .......... .......... 89% 102M 0s 2024-03-09T14:47:32.584 INFO:teuthology.orchestra.run.smithi099.stderr: 83100K .......... .......... .......... .......... .......... 89% 93.3M 0s 2024-03-09T14:47:32.584 INFO:teuthology.orchestra.run.smithi099.stderr: 83150K .......... .......... .......... .......... .......... 89% 116M 0s 2024-03-09T14:47:32.584 INFO:teuthology.orchestra.run.smithi099.stderr: 83200K .......... .......... .......... .......... .......... 89% 93.8M 0s 2024-03-09T14:47:32.584 INFO:teuthology.orchestra.run.smithi099.stderr: 83250K .......... .......... .......... .......... .......... 89% 74.0M 0s 2024-03-09T14:47:32.584 INFO:teuthology.orchestra.run.smithi099.stderr: 83300K .......... .......... .......... .......... .......... 89% 112M 0s 2024-03-09T14:47:32.584 INFO:teuthology.orchestra.run.smithi099.stderr: 83350K .......... .......... .......... .......... .......... 89% 120M 0s 2024-03-09T14:47:32.584 INFO:teuthology.orchestra.run.smithi099.stderr: 83400K .......... .......... .......... .......... .......... 89% 113M 0s 2024-03-09T14:47:32.584 INFO:teuthology.orchestra.run.smithi099.stderr: 83450K .......... .......... .......... .......... .......... 89% 110M 0s 2024-03-09T14:47:32.585 INFO:teuthology.orchestra.run.smithi099.stderr: 83500K .......... .......... .......... .......... .......... 89% 89.7M 0s 2024-03-09T14:47:32.585 INFO:teuthology.orchestra.run.smithi099.stderr: 83550K .......... .......... .......... .......... .......... 89% 110M 0s 2024-03-09T14:47:32.585 INFO:teuthology.orchestra.run.smithi099.stderr: 83600K .......... .......... .......... .......... .......... 90% 113M 0s 2024-03-09T14:47:32.585 INFO:teuthology.orchestra.run.smithi099.stderr: 83650K .......... .......... .......... .......... .......... 90% 120M 0s 2024-03-09T14:47:32.585 INFO:teuthology.orchestra.run.smithi099.stderr: 83700K .......... .......... .......... .......... .......... 90% 102M 0s 2024-03-09T14:47:32.585 INFO:teuthology.orchestra.run.smithi099.stderr: 83750K .......... .......... .......... .......... .......... 90% 116M 0s 2024-03-09T14:47:32.585 INFO:teuthology.orchestra.run.smithi099.stderr: 83800K .......... .......... .......... .......... .......... 90% 118M 0s 2024-03-09T14:47:32.585 INFO:teuthology.orchestra.run.smithi099.stderr: 83850K .......... .......... .......... .......... .......... 90% 103M 0s 2024-03-09T14:47:32.585 INFO:teuthology.orchestra.run.smithi099.stderr: 83900K .......... .......... .......... .......... .......... 90% 90.8M 0s 2024-03-09T14:47:32.585 INFO:teuthology.orchestra.run.smithi099.stderr: 83950K .......... .......... .......... .......... .......... 90% 107M 0s 2024-03-09T14:47:32.585 INFO:teuthology.orchestra.run.smithi099.stderr: 84000K .......... .......... .......... .......... .......... 90% 106M 0s 2024-03-09T14:47:32.585 INFO:teuthology.orchestra.run.smithi099.stderr: 84050K .......... .......... .......... .......... .......... 90% 129M 0s 2024-03-09T14:47:32.585 INFO:teuthology.orchestra.run.smithi099.stderr: 84100K .......... .......... .......... .......... .......... 90% 103M 0s 2024-03-09T14:47:32.585 INFO:teuthology.orchestra.run.smithi099.stderr: 84150K .......... .......... .......... .......... .......... 90% 128M 0s 2024-03-09T14:47:32.585 INFO:teuthology.orchestra.run.smithi099.stderr: 84200K .......... .......... .......... .......... .......... 90% 102M 0s 2024-03-09T14:47:32.586 INFO:teuthology.orchestra.run.smithi099.stderr: 84250K .......... .......... .......... .......... .......... 90% 118M 0s 2024-03-09T14:47:32.586 INFO:teuthology.orchestra.run.smithi099.stderr: 84300K .......... .......... .......... .......... .......... 90% 78.9M 0s 2024-03-09T14:47:32.586 INFO:teuthology.orchestra.run.smithi099.stderr: 84350K .......... .......... .......... .......... .......... 90% 119M 0s 2024-03-09T14:47:32.586 INFO:teuthology.orchestra.run.smithi099.stderr: 84400K .......... .......... .......... .......... .......... 90% 112M 0s 2024-03-09T14:47:32.586 INFO:teuthology.orchestra.run.smithi099.stderr: 84450K .......... .......... .......... .......... .......... 90% 118M 0s 2024-03-09T14:47:32.586 INFO:teuthology.orchestra.run.smithi099.stderr: 84500K .......... .......... .......... .......... .......... 91% 109M 0s 2024-03-09T14:47:32.586 INFO:teuthology.orchestra.run.smithi099.stderr: 84550K .......... .......... .......... .......... .......... 91% 115M 0s 2024-03-09T14:47:32.586 INFO:teuthology.orchestra.run.smithi099.stderr: 84600K .......... .......... .......... .......... .......... 91% 115M 0s 2024-03-09T14:47:32.586 INFO:teuthology.orchestra.run.smithi099.stderr: 84650K .......... .......... .......... .......... .......... 91% 102M 0s 2024-03-09T14:47:32.586 INFO:teuthology.orchestra.run.smithi099.stderr: 84700K .......... .......... .......... .......... .......... 91% 88.4M 0s 2024-03-09T14:47:32.586 INFO:teuthology.orchestra.run.smithi099.stderr: 84750K .......... .......... .......... .......... .......... 91% 119M 0s 2024-03-09T14:47:32.586 INFO:teuthology.orchestra.run.smithi099.stderr: 84800K .......... .......... .......... .......... .......... 91% 105M 0s 2024-03-09T14:47:32.586 INFO:teuthology.orchestra.run.smithi099.stderr: 84850K .......... .......... .......... .......... .......... 91% 142M 0s 2024-03-09T14:47:32.586 INFO:teuthology.orchestra.run.smithi099.stderr: 84900K .......... .......... .......... .......... .......... 91% 111M 0s 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi099.stderr: 84950K .......... .......... .......... .......... .......... 91% 116M 0s 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi099.stderr: 85000K .......... .......... .......... .......... .......... 91% 118M 0s 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi099.stderr: 85050K .......... .......... .......... .......... .......... 91% 112M 0s 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi099.stderr: 85100K .......... .......... .......... .......... .......... 91% 87.9M 0s 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi099.stderr: 85150K .......... .......... .......... .......... .......... 91% 111M 0s 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi099.stderr: 85200K .......... .......... .......... .......... .......... 91% 109M 0s 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi099.stderr: 85250K .......... .......... .......... .......... .......... 91% 120M 0s 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi099.stderr: 85300K .......... .......... .......... .......... .......... 91% 108M 0s 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi099.stderr: 85350K .......... .......... .......... .......... .......... 91% 115M 0s 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi099.stderr: 85400K .......... .......... .......... .......... .......... 91% 108M 0s 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi099.stderr: 85450K .......... .......... .......... .......... .......... 92% 113M 0s 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi099.stderr: 85500K .......... .......... .......... .......... .......... 92% 90.4M 0s 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi099.stderr: 85550K .......... .......... .......... .......... .......... 92% 121M 0s 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi099.stderr: 85600K .......... .......... .......... .......... .......... 92% 82.3M 0s 2024-03-09T14:47:32.587 INFO:teuthology.orchestra.run.smithi099.stderr: 85650K .......... .......... .......... .......... .......... 92% 82.3M 0s 2024-03-09T14:47:32.588 INFO:teuthology.orchestra.run.smithi099.stderr: 85700K .......... .......... .......... .......... .......... 92% 116M 0s 2024-03-09T14:47:32.588 INFO:teuthology.orchestra.run.smithi099.stderr: 85750K .......... .......... .......... .......... .......... 92% 56.2M 0s 2024-03-09T14:47:32.588 INFO:teuthology.orchestra.run.smithi099.stderr: 85800K .......... .......... .......... .......... .......... 92% 89.3M 0s 2024-03-09T14:47:32.588 INFO:teuthology.orchestra.run.smithi099.stderr: 85850K .......... .......... .......... .......... .......... 92% 113M 0s 2024-03-09T14:47:32.588 INFO:teuthology.orchestra.run.smithi099.stderr: 85900K .......... .......... .......... .......... .......... 92% 115M 0s 2024-03-09T14:47:32.588 INFO:teuthology.orchestra.run.smithi099.stderr: 85950K .......... .......... .......... .......... .......... 92% 118M 0s 2024-03-09T14:47:32.588 INFO:teuthology.orchestra.run.smithi099.stderr: 86000K .......... .......... .......... .......... .......... 92% 106M 0s 2024-03-09T14:47:32.588 INFO:teuthology.orchestra.run.smithi099.stderr: 86050K .......... .......... .......... .......... .......... 92% 109M 0s 2024-03-09T14:47:32.588 INFO:teuthology.orchestra.run.smithi099.stderr: 86100K .......... .......... .......... .......... .......... 92% 106M 0s 2024-03-09T14:47:32.588 INFO:teuthology.orchestra.run.smithi099.stderr: 86150K .......... .......... .......... .......... .......... 92% 138M 0s 2024-03-09T14:47:32.588 INFO:teuthology.orchestra.run.smithi099.stderr: 86200K .......... .......... .......... .......... .......... 92% 88.4M 0s 2024-03-09T14:47:32.588 INFO:teuthology.orchestra.run.smithi099.stderr: 86250K .......... .......... .......... .......... .......... 92% 111M 0s 2024-03-09T14:47:32.588 INFO:teuthology.orchestra.run.smithi099.stderr: 86300K .......... .......... .......... .......... .......... 92% 113M 0s 2024-03-09T14:47:32.588 INFO:teuthology.orchestra.run.smithi099.stderr: 86350K .......... .......... .......... .......... .......... 93% 113M 0s 2024-03-09T14:47:32.588 INFO:teuthology.orchestra.run.smithi099.stderr: 86400K .......... .......... .......... .......... .......... 93% 99.6M 0s 2024-03-09T14:47:32.589 INFO:teuthology.orchestra.run.smithi099.stderr: 86450K .......... .......... .......... .......... .......... 93% 115M 0s 2024-03-09T14:47:32.589 INFO:teuthology.orchestra.run.smithi099.stderr: 86500K .......... .......... .......... .......... .......... 93% 126M 0s 2024-03-09T14:47:32.589 INFO:teuthology.orchestra.run.smithi099.stderr: 86550K .......... .......... .......... .......... .......... 93% 116M 0s 2024-03-09T14:47:32.589 INFO:teuthology.orchestra.run.smithi099.stderr: 86600K .......... .......... .......... .......... .......... 93% 89.3M 0s 2024-03-09T14:47:32.589 INFO:teuthology.orchestra.run.smithi099.stderr: 86650K .......... .......... .......... .......... .......... 93% 116M 0s 2024-03-09T14:47:32.589 INFO:teuthology.orchestra.run.smithi099.stderr: 86700K .......... .......... .......... .......... .......... 93% 106M 0s 2024-03-09T14:47:32.589 INFO:teuthology.orchestra.run.smithi099.stderr: 86750K .......... .......... .......... .......... .......... 93% 81.5M 0s 2024-03-09T14:47:32.589 INFO:teuthology.orchestra.run.smithi099.stderr: 86800K .......... .......... .......... .......... .......... 93% 53.6M 0s 2024-03-09T14:47:32.589 INFO:teuthology.orchestra.run.smithi099.stderr: 86850K .......... .......... .......... .......... .......... 93% 120M 0s 2024-03-09T14:47:32.589 INFO:teuthology.orchestra.run.smithi099.stderr: 86900K .......... .......... .......... .......... .......... 93% 105M 0s 2024-03-09T14:47:32.589 INFO:teuthology.orchestra.run.smithi099.stderr: 86950K .......... .......... .......... .......... .......... 93% 121M 0s 2024-03-09T14:47:32.589 INFO:teuthology.orchestra.run.smithi099.stderr: 87000K .......... .......... .......... .......... .......... 93% 89.0M 0s 2024-03-09T14:47:32.589 INFO:teuthology.orchestra.run.smithi099.stderr: 87050K .......... .......... .......... .......... .......... 93% 106M 0s 2024-03-09T14:47:32.589 INFO:teuthology.orchestra.run.smithi099.stderr: 87100K .......... .......... .......... .......... .......... 93% 118M 0s 2024-03-09T14:47:32.589 INFO:teuthology.orchestra.run.smithi099.stderr: 87150K .......... .......... .......... .......... .......... 93% 100M 0s 2024-03-09T14:47:32.589 INFO:teuthology.orchestra.run.smithi099.stderr: 87200K .......... .......... .......... .......... .......... 93% 121M 0s 2024-03-09T14:47:32.590 INFO:teuthology.orchestra.run.smithi099.stderr: 87250K .......... .......... .......... .......... .......... 93% 108M 0s 2024-03-09T14:47:32.590 INFO:teuthology.orchestra.run.smithi099.stderr: 87300K .......... .......... .......... .......... .......... 94% 120M 0s 2024-03-09T14:47:32.590 INFO:teuthology.orchestra.run.smithi099.stderr: 87350K .......... .......... .......... .......... .......... 94% 114M 0s 2024-03-09T14:47:32.590 INFO:teuthology.orchestra.run.smithi099.stderr: 87400K .......... .......... .......... .......... .......... 94% 90.6M 0s 2024-03-09T14:47:32.590 INFO:teuthology.orchestra.run.smithi099.stderr: 87450K .......... .......... .......... .......... .......... 94% 105M 0s 2024-03-09T14:47:32.590 INFO:teuthology.orchestra.run.smithi099.stderr: 87500K .......... .......... .......... .......... .......... 94% 126M 0s 2024-03-09T14:47:32.590 INFO:teuthology.orchestra.run.smithi099.stderr: 87550K .......... .......... .......... .......... .......... 94% 119M 0s 2024-03-09T14:47:32.590 INFO:teuthology.orchestra.run.smithi099.stderr: 87600K .......... .......... .......... .......... .......... 94% 116M 0s 2024-03-09T14:47:32.590 INFO:teuthology.orchestra.run.smithi099.stderr: 87650K .......... .......... .......... .......... .......... 94% 92.6M 0s 2024-03-09T14:47:32.590 INFO:teuthology.orchestra.run.smithi099.stderr: 87700K .......... .......... .......... .......... .......... 94% 109M 0s 2024-03-09T14:47:32.590 INFO:teuthology.orchestra.run.smithi099.stderr: 87750K .......... .......... .......... .......... .......... 94% 118M 0s 2024-03-09T14:47:32.590 INFO:teuthology.orchestra.run.smithi099.stderr: 87800K .......... .......... .......... .......... .......... 94% 115M 0s 2024-03-09T14:47:32.590 INFO:teuthology.orchestra.run.smithi099.stderr: 87850K .......... .......... .......... .......... .......... 94% 107M 0s 2024-03-09T14:47:32.590 INFO:teuthology.orchestra.run.smithi099.stderr: 87900K .......... .......... .......... .......... .......... 94% 110M 0s 2024-03-09T14:47:32.590 INFO:teuthology.orchestra.run.smithi099.stderr: 87950K .......... .......... .......... .......... .......... 94% 115M 0s 2024-03-09T14:47:32.591 INFO:teuthology.orchestra.run.smithi099.stderr: 88000K .......... .......... .......... .......... .......... 94% 110M 0s 2024-03-09T14:47:32.591 INFO:teuthology.orchestra.run.smithi099.stderr: 88050K .......... .......... .......... .......... .......... 94% 72.8M 0s 2024-03-09T14:47:32.591 INFO:teuthology.orchestra.run.smithi099.stderr: 88100K .......... .......... .......... .......... .......... 94% 120M 0s 2024-03-09T14:47:32.591 INFO:teuthology.orchestra.run.smithi099.stderr: 88150K .......... .......... .......... .......... .......... 94% 115M 0s 2024-03-09T14:47:32.591 INFO:teuthology.orchestra.run.smithi099.stderr: 88200K .......... .......... .......... .......... .......... 94% 103M 0s 2024-03-09T14:47:32.591 INFO:teuthology.orchestra.run.smithi099.stderr: 88250K .......... .......... .......... .......... .......... 95% 118M 0s 2024-03-09T14:47:32.591 INFO:teuthology.orchestra.run.smithi099.stderr: 88300K .......... .......... .......... .......... .......... 95% 109M 0s 2024-03-09T14:47:32.591 INFO:teuthology.orchestra.run.smithi099.stderr: 88350K .......... .......... .......... .......... .......... 95% 120M 0s 2024-03-09T14:47:32.591 INFO:teuthology.orchestra.run.smithi099.stderr: 88400K .......... .......... .......... .......... .......... 95% 91.5M 0s 2024-03-09T14:47:32.591 INFO:teuthology.orchestra.run.smithi099.stderr: 88450K .......... .......... .......... .......... .......... 95% 117M 0s 2024-03-09T14:47:32.591 INFO:teuthology.orchestra.run.smithi099.stderr: 88500K .......... .......... .......... .......... .......... 95% 119M 0s 2024-03-09T14:47:32.591 INFO:teuthology.orchestra.run.smithi099.stderr: 88550K .......... .......... .......... .......... .......... 95% 112M 0s 2024-03-09T14:47:32.591 INFO:teuthology.orchestra.run.smithi099.stderr: 88600K .......... .......... .......... .......... .......... 95% 108M 0s 2024-03-09T14:47:32.591 INFO:teuthology.orchestra.run.smithi099.stderr: 88650K .......... .......... .......... .......... .......... 95% 113M 0s 2024-03-09T14:47:32.591 INFO:teuthology.orchestra.run.smithi099.stderr: 88700K .......... .......... .......... .......... .......... 95% 119M 0s 2024-03-09T14:47:32.592 INFO:teuthology.orchestra.run.smithi099.stderr: 88750K .......... .......... .......... .......... .......... 95% 113M 0s 2024-03-09T14:47:32.592 INFO:teuthology.orchestra.run.smithi099.stderr: 88800K .......... .......... .......... .......... .......... 95% 88.7M 0s 2024-03-09T14:47:32.592 INFO:teuthology.orchestra.run.smithi099.stderr: 88850K .......... .......... .......... .......... .......... 95% 121M 0s 2024-03-09T14:47:32.592 INFO:teuthology.orchestra.run.smithi099.stderr: 88900K .......... .......... .......... .......... .......... 95% 104M 0s 2024-03-09T14:47:32.592 INFO:teuthology.orchestra.run.smithi099.stderr: 88950K .......... .......... .......... .......... .......... 95% 119M 0s 2024-03-09T14:47:32.592 INFO:teuthology.orchestra.run.smithi099.stderr: 89000K .......... .......... .......... .......... .......... 95% 113M 0s 2024-03-09T14:47:32.592 INFO:teuthology.orchestra.run.smithi099.stderr: 89050K .......... .......... .......... .......... .......... 95% 114M 0s 2024-03-09T14:47:32.592 INFO:teuthology.orchestra.run.smithi099.stderr: 89100K .......... .......... .......... .......... .......... 95% 119M 0s 2024-03-09T14:47:32.592 INFO:teuthology.orchestra.run.smithi099.stderr: 89150K .......... .......... .......... .......... .......... 96% 117M 0s 2024-03-09T14:47:32.592 INFO:teuthology.orchestra.run.smithi099.stderr: 89200K .......... .......... .......... .......... .......... 96% 85.3M 0s 2024-03-09T14:47:32.592 INFO:teuthology.orchestra.run.smithi099.stderr: 89250K .......... .......... .......... .......... .......... 96% 118M 0s 2024-03-09T14:47:32.592 INFO:teuthology.orchestra.run.smithi099.stderr: 89300K .......... .......... .......... .......... .......... 96% 120M 0s 2024-03-09T14:47:32.592 INFO:teuthology.orchestra.run.smithi099.stderr: 89350K .......... .......... .......... .......... .......... 96% 114M 0s 2024-03-09T14:47:32.592 INFO:teuthology.orchestra.run.smithi099.stderr: 89400K .......... .......... .......... .......... .......... 96% 114M 0s 2024-03-09T14:47:32.592 INFO:teuthology.orchestra.run.smithi099.stderr: 89450K .......... .......... .......... .......... .......... 96% 113M 0s 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi099.stderr: 89500K .......... .......... .......... .......... .......... 96% 116M 0s 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi099.stderr: 89550K .......... .......... .......... .......... .......... 96% 107M 0s 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi099.stderr: 89600K .......... .......... .......... .......... .......... 96% 94.1M 0s 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi099.stderr: 89650K .......... .......... .......... .......... .......... 96% 114M 0s 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi099.stderr: 89700K .......... .......... .......... .......... .......... 96% 119M 0s 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi099.stderr: 89750K .......... .......... .......... .......... .......... 96% 116M 0s 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi099.stderr: 89800K .......... .......... .......... .......... .......... 96% 106M 0s 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi099.stderr: 89850K .......... .......... .......... .......... .......... 96% 106M 0s 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi099.stderr: 89900K .......... .......... .......... .......... .......... 96% 115M 0s 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi099.stderr: 89950K .......... .......... .......... .......... .......... 96% 113M 0s 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi099.stderr: 90000K .......... .......... .......... .......... .......... 96% 88.8M 0s 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi099.stderr: 90050K .......... .......... .......... .......... .......... 96% 105M 0s 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi099.stderr: 90100K .......... .......... .......... .......... .......... 97% 130M 0s 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi099.stderr: 90150K .......... .......... .......... .......... .......... 97% 115M 0s 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi099.stderr: 90200K .......... .......... .......... .......... .......... 97% 104M 0s 2024-03-09T14:47:32.593 INFO:teuthology.orchestra.run.smithi099.stderr: 90250K .......... .......... .......... .......... .......... 97% 117M 0s 2024-03-09T14:47:32.594 INFO:teuthology.orchestra.run.smithi099.stderr: 90300K .......... .......... .......... .......... .......... 97% 93.9M 0s 2024-03-09T14:47:32.594 INFO:teuthology.orchestra.run.smithi099.stderr: 90350K .......... .......... .......... .......... .......... 97% 117M 0s 2024-03-09T14:47:32.594 INFO:teuthology.orchestra.run.smithi099.stderr: 90400K .......... .......... .......... .......... .......... 97% 77.0M 0s 2024-03-09T14:47:32.594 INFO:teuthology.orchestra.run.smithi099.stderr: 90450K .......... .......... .......... .......... .......... 97% 102M 0s 2024-03-09T14:47:32.594 INFO:teuthology.orchestra.run.smithi099.stderr: 90500K .......... .......... .......... .......... .......... 97% 128M 0s 2024-03-09T14:47:32.594 INFO:teuthology.orchestra.run.smithi099.stderr: 90550K .......... .......... .......... .......... .......... 97% 94.3M 0s 2024-03-09T14:47:32.594 INFO:teuthology.orchestra.run.smithi099.stderr: 90600K .......... .......... .......... .......... .......... 97% 119M 0s 2024-03-09T14:47:32.594 INFO:teuthology.orchestra.run.smithi099.stderr: 90650K .......... .......... .......... .......... .......... 97% 127M 0s 2024-03-09T14:47:32.594 INFO:teuthology.orchestra.run.smithi099.stderr: 90700K .......... .......... .......... .......... .......... 97% 99.5M 0s 2024-03-09T14:47:32.594 INFO:teuthology.orchestra.run.smithi099.stderr: 90750K .......... .......... .......... .......... .......... 97% 105M 0s 2024-03-09T14:47:32.594 INFO:teuthology.orchestra.run.smithi099.stderr: 90800K .......... .......... .......... .......... .......... 97% 121M 0s 2024-03-09T14:47:32.594 INFO:teuthology.orchestra.run.smithi099.stderr: 90850K .......... .......... .......... .......... .......... 97% 121M 0s 2024-03-09T14:47:32.594 INFO:teuthology.orchestra.run.smithi099.stderr: 90900K .......... .......... .......... .......... .......... 97% 104M 0s 2024-03-09T14:47:32.594 INFO:teuthology.orchestra.run.smithi099.stderr: 90950K .......... .......... .......... .......... .......... 97% 113M 0s 2024-03-09T14:47:32.594 INFO:teuthology.orchestra.run.smithi099.stderr: 91000K .......... .......... .......... .......... .......... 98% 128M 0s 2024-03-09T14:47:32.595 INFO:teuthology.orchestra.run.smithi099.stderr: 91050K .......... .......... .......... .......... .......... 98% 112M 0s 2024-03-09T14:47:32.595 INFO:teuthology.orchestra.run.smithi099.stderr: 91100K .......... .......... .......... .......... .......... 98% 88.9M 0s 2024-03-09T14:47:32.595 INFO:teuthology.orchestra.run.smithi099.stderr: 91150K .......... .......... .......... .......... .......... 98% 107M 0s 2024-03-09T14:47:32.595 INFO:teuthology.orchestra.run.smithi099.stderr: 91200K .......... .......... .......... .......... .......... 98% 109M 0s 2024-03-09T14:47:32.595 INFO:teuthology.orchestra.run.smithi099.stderr: 91250K .......... .......... .......... .......... .......... 98% 124M 0s 2024-03-09T14:47:32.595 INFO:teuthology.orchestra.run.smithi099.stderr: 91300K .......... .......... .......... .......... .......... 98% 107M 0s 2024-03-09T14:47:32.595 INFO:teuthology.orchestra.run.smithi099.stderr: 91350K .......... .......... .......... .......... .......... 98% 120M 0s 2024-03-09T14:47:32.595 INFO:teuthology.orchestra.run.smithi099.stderr: 91400K .......... .......... .......... .......... .......... 98% 110M 0s 2024-03-09T14:47:32.595 INFO:teuthology.orchestra.run.smithi099.stderr: 91450K .......... .......... .......... .......... .......... 98% 106M 0s 2024-03-09T14:47:32.595 INFO:teuthology.orchestra.run.smithi099.stderr: 91500K .......... .......... .......... .......... .......... 98% 90.9M 0s 2024-03-09T14:47:32.595 INFO:teuthology.orchestra.run.smithi099.stderr: 91550K .......... .......... .......... .......... .......... 98% 131M 0s 2024-03-09T14:47:32.595 INFO:teuthology.orchestra.run.smithi099.stderr: 91600K .......... .......... .......... .......... .......... 98% 46.2M 0s 2024-03-09T14:47:32.595 INFO:teuthology.orchestra.run.smithi099.stderr: 91650K .......... .......... .......... .......... .......... 98% 110M 0s 2024-03-09T14:47:32.596 INFO:teuthology.orchestra.run.smithi099.stderr: 91700K .......... .......... .......... .......... .......... 98% 105M 0s 2024-03-09T14:47:32.596 INFO:teuthology.orchestra.run.smithi099.stderr: 91750K .......... .......... .......... .......... .......... 98% 126M 0s 2024-03-09T14:47:32.596 INFO:teuthology.orchestra.run.smithi099.stderr: 91800K .......... .......... .......... .......... .......... 98% 108M 0s 2024-03-09T14:47:32.596 INFO:teuthology.orchestra.run.smithi099.stderr: 91850K .......... .......... .......... .......... .......... 98% 97.1M 0s 2024-03-09T14:47:32.596 INFO:teuthology.orchestra.run.smithi099.stderr: 91900K .......... .......... .......... .......... .......... 98% 119M 0s 2024-03-09T14:47:32.596 INFO:teuthology.orchestra.run.smithi099.stderr: 91950K .......... .......... .......... .......... .......... 99% 101M 0s 2024-03-09T14:47:32.596 INFO:teuthology.orchestra.run.smithi099.stderr: 92000K .......... .......... .......... .......... .......... 99% 122M 0s 2024-03-09T14:47:32.596 INFO:teuthology.orchestra.run.smithi099.stderr: 92050K .......... .......... .......... .......... .......... 99% 104M 0s 2024-03-09T14:47:32.596 INFO:teuthology.orchestra.run.smithi099.stderr: 92100K .......... .......... .......... .......... .......... 99% 115M 0s 2024-03-09T14:47:32.596 INFO:teuthology.orchestra.run.smithi099.stderr: 92150K .......... .......... .......... .......... .......... 99% 114M 0s 2024-03-09T14:47:32.596 INFO:teuthology.orchestra.run.smithi099.stderr: 92200K .......... .......... .......... .......... .......... 99% 124M 0s 2024-03-09T14:47:32.596 INFO:teuthology.orchestra.run.smithi099.stderr: 92250K .......... .......... .......... .......... .......... 99% 91.5M 0s 2024-03-09T14:47:32.596 INFO:teuthology.orchestra.run.smithi099.stderr: 92300K .......... .......... .......... .......... .......... 99% 110M 0s 2024-03-09T14:47:32.596 INFO:teuthology.orchestra.run.smithi099.stderr: 92350K .......... .......... .......... .......... .......... 99% 61.8M 0s 2024-03-09T14:47:32.597 INFO:teuthology.orchestra.run.smithi099.stderr: 92400K .......... .......... .......... .......... .......... 99% 57.4M 0s 2024-03-09T14:47:32.597 INFO:teuthology.orchestra.run.smithi099.stderr: 92450K .......... .......... .......... .......... .......... 99% 103M 0s 2024-03-09T14:47:32.597 INFO:teuthology.orchestra.run.smithi099.stderr: 92500K .......... .......... .......... .......... .......... 99% 67.7M 0s 2024-03-09T14:47:32.597 INFO:teuthology.orchestra.run.smithi099.stderr: 92550K .......... .......... .......... .......... .......... 99% 39.4M 0s 2024-03-09T14:47:32.597 INFO:teuthology.orchestra.run.smithi099.stderr: 92600K .......... .......... .......... .......... .......... 99% 75.2M 0s 2024-03-09T14:47:32.597 INFO:teuthology.orchestra.run.smithi099.stderr: 92650K .......... .......... .......... .......... .......... 99% 36.4M 0s 2024-03-09T14:47:32.597 INFO:teuthology.orchestra.run.smithi099.stderr: 92700K .......... .......... .......... .......... .......... 99% 67.4M 0s 2024-03-09T14:47:32.597 INFO:teuthology.orchestra.run.smithi099.stderr: 92750K .......... .......... .......... .......... .......... 99% 106M 0s 2024-03-09T14:47:32.597 INFO:teuthology.orchestra.run.smithi099.stderr: 92800K .......... .......... .......... .......... .......... 99% 49.5M 0s 2024-03-09T14:47:32.597 INFO:teuthology.orchestra.run.smithi099.stderr: 92850K .......... .......... .......... .......... .......... 99% 54.0M 0s 2024-03-09T14:47:32.597 INFO:teuthology.orchestra.run.smithi099.stderr: 92900K 100% 134G=1.4s 2024-03-09T14:47:32.597 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-09T14:47:32.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09 14:47:32 (64.0 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-03-09T14:47:32.597 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-09T14:47:32.603 INFO:teuthology.orchestra.run.smithi099.stdout:Archive: gradle-6.0.1-bin.zip 2024-03-09T14:47:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-03-09T14:47:32.603 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-03-09T14:47:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-03-09T14:47:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-03-09T14:47:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-03-09T14:47:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-03-09T14:47:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-03-09T14:47:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-03-09T14:47:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-03-09T14:47:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-03-09T14:47:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-03-09T14:47:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-03-09T14:47:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-03-09T14:47:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-03-09T14:47:32.604 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-03-09T14:47:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-03-09T14:47:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-03-09T14:47:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-03-09T14:47:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-03-09T14:47:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-03-09T14:47:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-03-09T14:47:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-03-09T14:47:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-03-09T14:47:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-03-09T14:47:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-03-09T14:47:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-03-09T14:47:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-03-09T14:47:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-03-09T14:47:32.605 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-03-09T14:47:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-03-09T14:47:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-03-09T14:47:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-03-09T14:47:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-03-09T14:47:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-03-09T14:47:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-03-09T14:47:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-03-09T14:47:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-03-09T14:47:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-03-09T14:47:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-03-09T14:47:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-03-09T14:47:32.606 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-03-09T14:47:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-03-09T14:47:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-03-09T14:47:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-03-09T14:47:32.679 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-03-09T14:47:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-03-09T14:47:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-03-09T14:47:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-03-09T14:47:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-03-09T14:47:32.735 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-03-09T14:47:32.752 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-03-09T14:47:32.754 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-03-09T14:47:32.756 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-03-09T14:47:32.756 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-03-09T14:47:32.756 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-03-09T14:47:32.757 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-03-09T14:47:32.758 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-03-09T14:47:32.773 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-03-09T14:47:32.774 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-03-09T14:47:32.774 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-03-09T14:47:32.774 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-03-09T14:47:32.778 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-03-09T14:47:32.778 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-03-09T14:47:32.778 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-03-09T14:47:32.780 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-03-09T14:47:32.780 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-03-09T14:47:32.796 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-03-09T14:47:32.800 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-03-09T14:47:32.803 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-03-09T14:47:32.805 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-03-09T14:47:32.805 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-03-09T14:47:32.807 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-03-09T14:47:32.808 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-03-09T14:47:32.809 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-03-09T14:47:32.813 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-03-09T14:47:32.814 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-03-09T14:47:32.833 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-03-09T14:47:32.834 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-03-09T14:47:32.843 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-03-09T14:47:32.843 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-03-09T14:47:32.843 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-03-09T14:47:32.843 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-03-09T14:47:32.843 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-03-09T14:47:32.851 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-03-09T14:47:32.851 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-03-09T14:47:32.854 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-03-09T14:47:32.855 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-03-09T14:47:32.855 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-03-09T14:47:32.855 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-03-09T14:47:32.855 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-03-09T14:47:32.855 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-03-09T14:47:32.855 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-03-09T14:47:32.855 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-03-09T14:47:32.855 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-03-09T14:47:32.855 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-03-09T14:47:32.855 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-03-09T14:47:32.855 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-03-09T14:47:32.858 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-03-09T14:47:32.858 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-03-09T14:47:32.858 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-03-09T14:47:32.858 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-03-09T14:47:32.858 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-03-09T14:47:32.858 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-03-09T14:47:32.858 INFO:teuthology.orchestra.run.smithi099.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-03-09T14:47:32.858 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-03-09T14:47:32.858 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-03-09T14:47:32.859 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-03-09T14:47:32.859 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-03-09T14:47:32.859 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-03-09T14:47:32.860 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-03-09T14:47:32.862 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-03-09T14:47:32.864 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-03-09T14:47:32.864 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-03-09T14:47:32.866 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-03-09T14:47:32.866 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-03-09T14:47:32.869 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-03-09T14:47:32.869 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-03-09T14:47:32.869 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-03-09T14:47:32.871 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-03-09T14:47:32.872 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-03-09T14:47:32.872 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-03-09T14:47:32.873 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-03-09T14:47:32.875 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-03-09T14:47:32.876 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-03-09T14:47:32.878 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-03-09T14:47:32.878 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-03-09T14:47:32.878 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-03-09T14:47:32.879 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-03-09T14:47:32.879 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-03-09T14:47:32.880 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-03-09T14:47:32.880 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-03-09T14:47:32.883 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-03-09T14:47:32.883 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-03-09T14:47:32.884 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-03-09T14:47:32.887 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-03-09T14:47:32.889 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-03-09T14:47:32.890 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-03-09T14:47:32.891 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-03-09T14:47:32.893 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-03-09T14:47:32.893 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-03-09T14:47:32.900 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-03-09T14:47:32.900 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-03-09T14:47:32.915 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-03-09T14:47:32.915 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-03-09T14:47:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-03-09T14:47:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-03-09T14:47:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-03-09T14:47:32.916 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-03-09T14:47:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-03-09T14:47:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-03-09T14:47:32.917 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-03-09T14:47:32.918 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-03-09T14:47:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-03-09T14:47:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-03-09T14:47:32.937 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-03-09T14:47:32.938 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-03-09T14:47:32.939 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-03-09T14:47:32.939 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-03-09T14:47:32.948 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-03-09T14:47:32.949 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-03-09T14:47:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-03-09T14:47:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-03-09T14:47:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-03-09T14:47:32.954 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-03-09T14:47:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-03-09T14:47:32.956 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-03-09T14:47:32.958 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-03-09T14:47:32.966 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-03-09T14:47:32.968 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-03-09T14:47:32.970 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-03-09T14:47:32.970 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-03-09T14:47:32.970 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-03-09T14:47:32.971 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-03-09T14:47:32.971 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-03-09T14:47:32.973 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-03-09T14:47:32.977 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-03-09T14:47:32.979 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-03-09T14:47:32.980 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-03-09T14:47:32.982 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-03-09T14:47:32.985 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-03-09T14:47:32.986 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-03-09T14:47:32.992 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-03-09T14:47:32.996 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-03-09T14:47:33.002 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-03-09T14:47:33.008 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-03-09T14:47:33.010 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-03-09T14:47:33.011 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-03-09T14:47:33.020 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-03-09T14:47:33.022 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-03-09T14:47:33.029 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-03-09T14:47:33.030 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-03-09T14:47:33.039 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-03-09T14:47:33.041 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-03-09T14:47:33.041 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-03-09T14:47:33.045 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-03-09T14:47:33.051 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-03-09T14:47:33.082 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-03-09T14:47:33.084 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-03-09T14:47:33.084 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-03-09T14:47:33.085 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-03-09T14:47:33.087 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-03-09T14:47:33.087 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-03-09T14:47:33.087 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-03-09T14:47:33.088 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-03-09T14:47:33.089 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-03-09T14:47:33.090 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-03-09T14:47:33.090 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-03-09T14:47:33.091 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-03-09T14:47:33.092 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-03-09T14:47:33.098 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-03-09T14:47:33.098 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-03-09T14:47:33.098 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-03-09T14:47:33.099 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-03-09T14:47:33.099 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-03-09T14:47:33.099 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-03-09T14:47:33.099 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-03-09T14:47:33.099 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-03-09T14:47:33.100 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-03-09T14:47:33.100 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-03-09T14:47:33.100 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-03-09T14:47:33.101 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-03-09T14:47:33.102 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-03-09T14:47:33.103 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-03-09T14:47:33.104 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-03-09T14:47:33.104 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-03-09T14:47:33.104 INFO:teuthology.orchestra.run.smithi099.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-03-09T14:47:33.139 INFO:teuthology.orchestra.run.smithi099.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-03-09T14:47:33.542 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:47:33.542 INFO:teuthology.orchestra.run.smithi099.stdout:Welcome to Gradle 6.0.1! 2024-03-09T14:47:33.542 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:47:33.542 INFO:teuthology.orchestra.run.smithi099.stdout:Here are the highlights of this release: 2024-03-09T14:47:33.542 INFO:teuthology.orchestra.run.smithi099.stdout: - Substantial improvements in dependency management, including 2024-03-09T14:47:33.542 INFO:teuthology.orchestra.run.smithi099.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-03-09T14:47:33.542 INFO:teuthology.orchestra.run.smithi099.stdout: - Advanced control of transitive versions 2024-03-09T14:47:33.543 INFO:teuthology.orchestra.run.smithi099.stdout: - Support for optional features and dependencies 2024-03-09T14:47:33.543 INFO:teuthology.orchestra.run.smithi099.stdout: - Rules to tweak published metadata 2024-03-09T14:47:33.543 INFO:teuthology.orchestra.run.smithi099.stdout: - Support for Java 13 2024-03-09T14:47:33.543 INFO:teuthology.orchestra.run.smithi099.stdout: - Faster incremental Java and Groovy compilation 2024-03-09T14:47:33.543 INFO:teuthology.orchestra.run.smithi099.stdout: - New Zinc compiler for Scala 2024-03-09T14:47:33.543 INFO:teuthology.orchestra.run.smithi099.stdout: - VS2019 support 2024-03-09T14:47:33.543 INFO:teuthology.orchestra.run.smithi099.stdout: - Support for Gradle Enterprise plugin 3.0 2024-03-09T14:47:33.543 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:47:33.543 INFO:teuthology.orchestra.run.smithi099.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-03-09T14:47:33.543 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:47:33.543 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:47:33.543 INFO:teuthology.orchestra.run.smithi099.stdout:------------------------------------------------------------ 2024-03-09T14:47:33.543 INFO:teuthology.orchestra.run.smithi099.stdout:Gradle 6.0.1 2024-03-09T14:47:33.543 INFO:teuthology.orchestra.run.smithi099.stdout:------------------------------------------------------------ 2024-03-09T14:47:33.544 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:47:33.544 INFO:teuthology.orchestra.run.smithi099.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-03-09T14:47:33.544 INFO:teuthology.orchestra.run.smithi099.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-03-09T14:47:33.544 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:47:33.544 INFO:teuthology.orchestra.run.smithi099.stdout:Kotlin: 1.3.50 2024-03-09T14:47:33.544 INFO:teuthology.orchestra.run.smithi099.stdout:Groovy: 2.5.8 2024-03-09T14:47:33.544 INFO:teuthology.orchestra.run.smithi099.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-03-09T14:47:33.544 INFO:teuthology.orchestra.run.smithi099.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-03-09T14:47:33.544 INFO:teuthology.orchestra.run.smithi099.stdout:OS: Linux 5.15.0-100-generic amd64 2024-03-09T14:47:33.544 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:47:33.550 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-03-09T14:47:33.550 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-03-09T14:47:33.550 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi099.front.sepia.ceph.com 2024-03-09T14:47:33.551 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-03-09T14:47:33.551 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi179.front.sepia.ceph.com 2024-03-09T14:47:33.551 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-03-09T14:47:33.747 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-03-09T14:47:33.747 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-03-09T14:47:33.747 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'OXTLWLMNVQCGJNZNFAON', 'access_secret': 'KqajhcQDo5hGaA+E0XE89VuF8YAYCARq9y+jKhf71SYn0xgC/hhVHQ==', 'region': 'mexico', 'endpoint': 'smithi099.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi099.front.sepia.ceph.com'} 2024-03-09T14:47:33.747 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-03-09T14:47:33.748 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'OXTLWLMNVQCGJNZNFAON', '--secret', 'KqajhcQDo5hGaA+E0XE89VuF8YAYCARq9y+jKhf71SYn0xgC/hhVHQ==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-03-09T14:47:33.748 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key OXTLWLMNVQCGJNZNFAON --secret KqajhcQDo5hGaA+E0XE89VuF8YAYCARq9y+jKhf71SYn0xgC/hhVHQ== --email tester.client.0_test@test.test --cluster ceph 2024-03-09T14:47:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:47:33.784 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:47:33.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:33.824+0000 7fbf49aab980 20 rados->read ofs=0 len=0 2024-03-09T14:47:33.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:33.828+0000 7fbf49aab980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:33.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:33.828+0000 7fbf49aab980 20 realm 2024-03-09T14:47:33.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:33.828+0000 7fbf49aab980 20 rados->read ofs=0 len=0 2024-03-09T14:47:33.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:33.828+0000 7fbf49aab980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:33.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:33.828+0000 7fbf49aab980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:47:33.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:33.828+0000 7fbf49aab980 20 rados->read ofs=0 len=0 2024-03-09T14:47:33.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:33.828+0000 7fbf49aab980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:33.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:33.828+0000 7fbf49aab980 20 rados->read ofs=0 len=0 2024-03-09T14:47:33.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:33.828+0000 7fbf49aab980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:33.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:33.828+0000 7fbf49aab980 20 rados->read ofs=0 len=0 2024-03-09T14:47:33.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:33.832+0000 7fbf49aab980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:47:33.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:33.832+0000 7fbf49aab980 20 searching for the correct realm 2024-03-09T14:47:33.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:33.836+0000 7fbf46dc2640 0 -- 172.21.15.99:0/2137980541 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7fbf380b2910 msgr2=0x7fbf380cc3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:47:33.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:33.840+0000 7fbf46dc2640 0 -- 172.21.15.99:0/2137980541 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fbf40001c20 msgr2=0x7fbf4007c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:47:34.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.056+0000 7fbf49aab980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:47:34.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.056+0000 7fbf49aab980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:47:34.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.056+0000 7fbf49aab980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:47:34.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.056+0000 7fbf49aab980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:47:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.056+0000 7fbf49aab980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:47:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.056+0000 7fbf49aab980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:47:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.056+0000 7fbf49aab980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.056+0000 7fbf49aab980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.056+0000 7fbf49aab980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.056+0000 7fbf49aab980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.056+0000 7fbf49aab980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.060+0000 7fbf49aab980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:47:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.060+0000 7fbf49aab980 20 zone default found 2024-03-09T14:47:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.060+0000 7fbf49aab980 4 Realm: () 2024-03-09T14:47:34.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.060+0000 7fbf49aab980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:47:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.060+0000 7fbf49aab980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:47:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.060+0000 7fbf49aab980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:47:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.060+0000 7fbf49aab980 20 zonegroup default 2024-03-09T14:47:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.060+0000 7fbf49aab980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.060+0000 7fbf49aab980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:34.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.060+0000 7fbf49aab980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.060+0000 7fbf49aab980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:34.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.060+0000 7fbf49aab980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.060+0000 7fbf49aab980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:34.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.060+0000 7fbf49aab980 20 started sync module instance, tier type = 2024-03-09T14:47:34.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.060+0000 7fbf49aab980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:47:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.084+0000 7fbf49aab980 20 add_watcher() i=0 2024-03-09T14:47:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.084+0000 7fbf49aab980 20 add_watcher() i=1 2024-03-09T14:47:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.084+0000 7fbf49aab980 20 add_watcher() i=2 2024-03-09T14:47:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.084+0000 7fbf49aab980 20 add_watcher() i=3 2024-03-09T14:47:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.084+0000 7fbf49aab980 20 add_watcher() i=4 2024-03-09T14:47:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.084+0000 7fbf49aab980 20 add_watcher() i=5 2024-03-09T14:47:34.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.084+0000 7fbf49aab980 20 add_watcher() i=6 2024-03-09T14:47:34.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.088+0000 7fbf49aab980 20 add_watcher() i=7 2024-03-09T14:47:34.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.088+0000 7fbf49aab980 2 all 8 watchers are set, enabling cache 2024-03-09T14:47:34.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.092+0000 7fbdfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.092+0000 7fbf49aab980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:47:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.092+0000 7fbf49aab980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:47:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.092+0000 7fbf49aab980 5 note: GC not initialized 2024-03-09T14:47:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.092+0000 7fbdfcfe1640 20 reqs_thread_entry: start 2024-03-09T14:47:34.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.092+0000 7fbf49aab980 20 init_complete bucket index max shards: 11 2024-03-09T14:47:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.092+0000 7fbf49aab980 20 Filter name: none 2024-03-09T14:47:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.092+0000 7fbd767fc640 20 reqs_thread_entry: start 2024-03-09T14:47:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.092+0000 7fbf49aab980 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-03-09T14:47:34.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.092+0000 7fbf49aab980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.092+0000 7fbf49aab980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:34.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.092+0000 7fbf49aab980 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-03-09T14:47:34.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.092+0000 7fbf49aab980 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-09T14:47:34.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.092+0000 7fbf49aab980 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-03-09T14:47:34.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.092+0000 7fbf49aab980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.096+0000 7fbf49aab980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:34.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.096+0000 7fbf49aab980 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-03-09T14:47:34.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.096+0000 7fbf49aab980 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-03-09T14:47:34.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.096+0000 7fbf49aab980 10 cache get: name=default.rgw.meta+users.keys+OXTLWLMNVQCGJNZNFAON : miss 2024-03-09T14:47:34.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.096+0000 7fbf49aab980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.096+0000 7fbf49aab980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:34.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.096+0000 7fbf49aab980 10 cache put: name=default.rgw.meta+users.keys+OXTLWLMNVQCGJNZNFAON info.flags=0x0 2024-03-09T14:47:34.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.096+0000 7fbf49aab980 10 adding default.rgw.meta+users.keys+OXTLWLMNVQCGJNZNFAON to cache LRU end 2024-03-09T14:47:34.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.096+0000 7fbf49aab980 10 cache get: name=default.rgw.meta+users.keys+OXTLWLMNVQCGJNZNFAON : hit (negative entry) 2024-03-09T14:47:34.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.096+0000 7fbf49aab980 10 cache get: name=default.rgw.meta+users.keys+OXTLWLMNVQCGJNZNFAON : hit (negative entry) 2024-03-09T14:47:34.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.100+0000 7fbf49aab980 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-03-09T14:47:34.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.100+0000 7fbf49aab980 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-09T14:47:34.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.100+0000 7fbf49aab980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-03-09T14:47:34.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.100+0000 7fbe2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464304 cookie 94480519201120 notifier 7383 bl.length()=670 2024-03-09T14:47:34.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.100+0000 7fbe2affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-03-09T14:47:34.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.100+0000 7fbe2affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-09T14:47:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.100+0000 7fbf49aab980 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-03-09T14:47:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.100+0000 7fbf49aab980 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-03-09T14:47:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.100+0000 7fbf49aab980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-03-09T14:47:34.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.100+0000 7fbe2affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464302 cookie 94480519189824 notifier 7383 bl.length()=200 2024-03-09T14:47:34.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.100+0000 7fbe2affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-03-09T14:47:34.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.100+0000 7fbe2affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-03-09T14:47:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.104+0000 7fbf49aab980 10 cache put: name=default.rgw.meta+users.keys+OXTLWLMNVQCGJNZNFAON info.flags=0x7 2024-03-09T14:47:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.104+0000 7fbf49aab980 10 moving default.rgw.meta+users.keys+OXTLWLMNVQCGJNZNFAON to cache LRU end 2024-03-09T14:47:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.104+0000 7fbf49aab980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:OXTLWLMNVQCGJNZNFAON, ofs0, ns] 2024-03-09T14:47:34.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.104+0000 7fbe2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464266 cookie 94480519204672 notifier 7383 bl.length()=189 2024-03-09T14:47:34.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.104+0000 7fbe2a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OXTLWLMNVQCGJNZNFAON info.flags=0x7 2024-03-09T14:47:34.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.104+0000 7fbe2a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OXTLWLMNVQCGJNZNFAON to cache LRU end 2024-03-09T14:47:34.102 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T14:47:34.102 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "tester.client.0", 2024-03-09T14:47:34.102 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Ms. tester.client.0", 2024-03-09T14:47:34.102 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "tester.client.0_test@test.test", 2024-03-09T14:47:34.102 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-03-09T14:47:34.102 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-03-09T14:47:34.102 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-03-09T14:47:34.103 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-03-09T14:47:34.103 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-09T14:47:34.103 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "tester.client.0", 2024-03-09T14:47:34.103 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "OXTLWLMNVQCGJNZNFAON", 2024-03-09T14:47:34.103 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "KqajhcQDo5hGaA+E0XE89VuF8YAYCARq9y+jKhf71SYn0xgC/hhVHQ==", 2024-03-09T14:47:34.103 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-03-09T14:47:34.103 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:47:34.099675Z" 2024-03-09T14:47:34.103 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-09T14:47:34.103 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-09T14:47:34.103 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-03-09T14:47:34.103 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-03-09T14:47:34.103 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-03-09T14:47:34.103 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-03-09T14:47:34.103 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-03-09T14:47:34.103 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-03-09T14:47:34.104 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-03-09T14:47:34.104 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:47:34.104 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:47:34.104 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:47:34.104 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:47:34.104 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:47:34.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:47:34.104 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-03-09T14:47:34.104 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:47:34.104 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:47:34.104 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:47:34.104 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:47:34.104 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:47:34.104 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:47:34.104 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-03-09T14:47:34.105 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "rgw", 2024-03-09T14:47:34.105 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-03-09T14:47:34.105 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "", 2024-03-09T14:47:34.105 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-09T14:47:34.105 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:47:34.099619Z", 2024-03-09T14:47:34.105 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-03-09T14:47:34.105 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-03-09T14:47:34.105 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T14:47:34.105 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:47:34.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.108+0000 7fbdfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.112+0000 7fbf49aab980 20 remove_watcher() i=0 2024-03-09T14:47:34.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.112+0000 7fbf49aab980 2 removed watcher, disabling cache 2024-03-09T14:47:34.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.116+0000 7fbf49aab980 20 remove_watcher() i=1 2024-03-09T14:47:34.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.116+0000 7fbf49aab980 20 remove_watcher() i=2 2024-03-09T14:47:34.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.120+0000 7fbf49aab980 20 remove_watcher() i=3 2024-03-09T14:47:34.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.120+0000 7fbf49aab980 20 remove_watcher() i=4 2024-03-09T14:47:34.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.124+0000 7fbf49aab980 20 remove_watcher() i=5 2024-03-09T14:47:34.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.124+0000 7fbf49aab980 20 remove_watcher() i=6 2024-03-09T14:47:34.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.124+0000 7fbf49aab980 20 remove_watcher() i=7 2024-03-09T14:47:34.136 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:47:34.136 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-03-09T14:47:34.189 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-03-09T14:47:34.189 DEBUG:teuthology.orchestra.run.smithi099:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-03-09T14:47:34.235 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-03-09T14:47:34.308 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:47:34.308 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:47:34.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.356+0000 7f3187f75980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.360+0000 7f3187f75980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.360+0000 7f3187f75980 20 realm 2024-03-09T14:47:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.360+0000 7f3187f75980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.360+0000 7f3187f75980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:34.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.360+0000 7f3187f75980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:47:34.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.360+0000 7f3187f75980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.360+0000 7f3187f75980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:34.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.360+0000 7f3187f75980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.360+0000 7f3187f75980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:34.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.360+0000 7f3187f75980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.364+0000 7f3187f75980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:47:34.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.364+0000 7f3187f75980 20 searching for the correct realm 2024-03-09T14:47:34.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.368+0000 7f318628e640 0 -- 172.21.15.99:0/750365676 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55c0b0306250 msgr2=0x55c0b0308660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:47:34.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.376+0000 7f318528c640 0 -- 172.21.15.99:0/750365676 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f317808cbd0 msgr2=0x7f317807ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:47:34.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.592+0000 7f3187f75980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:47:34.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.592+0000 7f3187f75980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:47:34.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.592+0000 7f3187f75980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:47:34.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.592+0000 7f3187f75980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:47:34.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.592+0000 7f3187f75980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:47:34.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.592+0000 7f3187f75980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:47:34.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.592+0000 7f3187f75980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.592+0000 7f3187f75980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:34.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.592+0000 7f3187f75980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.596+0000 7f3187f75980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.596+0000 7f3187f75980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.596+0000 7f3187f75980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:47:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.596+0000 7f3187f75980 20 zone default found 2024-03-09T14:47:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.596+0000 7f3187f75980 4 Realm: () 2024-03-09T14:47:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.596+0000 7f3187f75980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:47:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.596+0000 7f3187f75980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:47:34.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.596+0000 7f3187f75980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:47:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.596+0000 7f3187f75980 20 zonegroup default 2024-03-09T14:47:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.596+0000 7f3187f75980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.596+0000 7f3187f75980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.596+0000 7f3187f75980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.596+0000 7f3187f75980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:34.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.596+0000 7f3187f75980 20 rados->read ofs=0 len=0 2024-03-09T14:47:34.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.596+0000 7f3187f75980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:34.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.596+0000 7f3187f75980 20 started sync module instance, tier type = 2024-03-09T14:47:34.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.596+0000 7f3187f75980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:47:34.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.620+0000 7f3187f75980 20 add_watcher() i=0 2024-03-09T14:47:34.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.620+0000 7f3187f75980 20 add_watcher() i=1 2024-03-09T14:47:34.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.620+0000 7f3187f75980 20 add_watcher() i=2 2024-03-09T14:47:34.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.620+0000 7f3187f75980 20 add_watcher() i=3 2024-03-09T14:47:34.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.620+0000 7f3187f75980 20 add_watcher() i=4 2024-03-09T14:47:34.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.620+0000 7f3187f75980 20 add_watcher() i=5 2024-03-09T14:47:34.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.620+0000 7f3187f75980 20 add_watcher() i=6 2024-03-09T14:47:34.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.624+0000 7f3187f75980 20 add_watcher() i=7 2024-03-09T14:47:34.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.624+0000 7f3187f75980 2 all 8 watchers are set, enabling cache 2024-03-09T14:47:34.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.628+0000 7f30377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:34.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.628+0000 7f3187f75980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:47:34.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.628+0000 7f3187f75980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:47:34.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.720+0000 7f30367fc640 20 reqs_thread_entry: start 2024-03-09T14:47:34.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.720+0000 7f3187f75980 20 init_complete bucket index max shards: 11 2024-03-09T14:47:34.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.720+0000 7f3187f75980 20 Filter name: none 2024-03-09T14:47:34.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.724+0000 7f2fa7fff640 20 reqs_thread_entry: start 2024-03-09T14:47:34.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.724+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:47:34.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:34.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:34.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-03-09T14:47:34.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7234337851937919698', time=2024-03-09T16:42:31.688076+0000, chain.objs.size()=1 2024-03-09T14:47:34.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.Kn9IM7i6NjKBwQzNPrBfxa9c33vdkFo_0 2024-03-09T14:47:34.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='_qqym9ZaEfp-bDGgOXE4f2Nie4cq5tIe', time=2024-03-09T16:42:32.156554+0000, chain.objs.size()=2 2024-03-09T14:47:34.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.9u4xjTafESix_BrJVCKl3sB52eRS9N0_0 2024-03-09T14:47:34.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.9u4xjTafESix_BrJVCKl3sB52eRS9N0_1 2024-03-09T14:47:34.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='_AKQhXHQ43ZpQtbluO5udnX4jWWxmk0i', time=2024-03-09T16:42:32.176841+0000, chain.objs.size()=2 2024-03-09T14:47:34.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.uVDwWC-3QQS7FLto-ehUdb8EC5kZh-V_0 2024-03-09T14:47:34.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.uVDwWC-3QQS7FLto-ehUdb8EC5kZh-V_1 2024-03-09T14:47:34.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1038073593230360963', time=2024-03-09T16:42:32.303906+0000, chain.objs.size()=3 2024-03-09T14:47:34.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-LUKEWARM.2~AIT3qrJUMOeFauuHGfDY6cdVkK2ILUx.1 2024-03-09T14:47:34.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-LUKEWARM.2~AIT3qrJUMOeFauuHGfDY6cdVkK2ILUx.2 2024-03-09T14:47:34.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-LUKEWARM.2~AIT3qrJUMOeFauuHGfDY6cdVkK2ILUx.3 2024-03-09T14:47:34.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17415080818724578311', time=2024-03-09T16:44:19.418980+0000, chain.objs.size()=1 2024-03-09T14:47:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.BTtLBv3ojIjmu9qPcVKXsxPQoWnWl-B_0 2024-03-09T14:47:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6685759797495655206', time=2024-03-09T16:44:20.975799+0000, chain.objs.size()=1 2024-03-09T14:47:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.x8EPHMICgZw2UWKulaHdB-0SFA_EEQ0_0 2024-03-09T14:47:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11420302622468912005', time=2024-03-09T16:44:20.979063+0000, chain.objs.size()=1 2024-03-09T14:47:34.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.728+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.SYd6THAQokHd-zQMLiJODRWR8t980Ea_0 2024-03-09T14:47:34.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.732+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6956001802130344631', time=2024-03-09T16:44:56.060880+0000, chain.objs.size()=1 2024-03-09T14:47:34.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.732+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.2F2zPET5DvC09eMC_0b8V14f_zPGGFb_0 2024-03-09T14:47:34.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.736+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18445315180595804800', time=2024-03-09T16:44:56.072133+0000, chain.objs.size()=1 2024-03-09T14:47:34.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.736+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.xTHNBDbeDHXlIOzXUietr34zASvbbWV_0 2024-03-09T14:47:34.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.736+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4956356201141812435', time=2024-03-09T16:45:29.385394+0000, chain.objs.size()=1 2024-03-09T14:47:34.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.736+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.lxAJ9w7Ow8_fdv3qsokS36zTEGPyjhZ_0 2024-03-09T14:47:34.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.740+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11800589518961030621', time=2024-03-09T16:45:31.936217+0000, chain.objs.size()=1 2024-03-09T14:47:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.740+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.tYfcjDu8D4beDDnm2-SeCryVuVEzQLB_0 2024-03-09T14:47:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.740+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12696035976236452210', time=2024-03-09T16:45:33.982337+0000, chain.objs.size()=1 2024-03-09T14:47:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.740+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.7ghDrDBxQDY7XdYIYGYA0uT1Vw3Tz27_0 2024-03-09T14:47:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.740+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15405968357128490757', time=2024-03-09T16:45:33.986460+0000, chain.objs.size()=1 2024-03-09T14:47:34.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.740+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.eijaGsfd-6nfhYSyDRYIHbopfKXGmEk_0 2024-03-09T14:47:34.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.740+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14428967829934807952', time=2024-03-09T16:45:33.988637+0000, chain.objs.size()=1 2024-03-09T14:47:34.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.740+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.4jW2qkQADbfa3OnPZ31URo-hoIdhKPZ_0 2024-03-09T14:47:34.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.744+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14701316901884102741', time=2024-03-09T16:46:06.872486+0000, chain.objs.size()=1 2024-03-09T14:47:34.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.744+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.CR7XVtC1cMpe_v6PtaqvZ4beob-m5_3_0 2024-03-09T14:47:34.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.744+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1824846788662773021', time=2024-03-09T16:46:42.279941+0000, chain.objs.size()=1 2024-03-09T14:47:34.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.744+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.lKbwAp_bfbM25qWF0aejxuh-i1eTBzD_0 2024-03-09T14:47:34.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.752+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:34.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.756+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:47:34.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.760+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:34.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.760+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:34.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.760+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-09T14:47:34.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.760+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11337754820338479604', time=2024-03-09T16:42:32.517416+0000, chain.objs.size()=1 2024-03-09T14:47:34.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.760+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8__shadow_.RmMIq0OCKfLx011_fbD3V7x6_4hA8im_0 2024-03-09T14:47:34.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.760+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14138818904124684565', time=2024-03-09T16:42:32.551716+0000, chain.objs.size()=1 2024-03-09T14:47:34.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.760+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8__shadow_.Xg5NA4dkixtEpzO8M1LeIQCCxx_JPEB_0 2024-03-09T14:47:34.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.760+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7638000662379950193', time=2024-03-09T16:44:53.629542+0000, chain.objs.size()=1 2024-03-09T14:47:34.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.760+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.5skABxeKJdeEGXRzV5eLrDHUbsDbgr6_0 2024-03-09T14:47:34.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.760+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14742954294244753257', time=2024-03-09T16:46:09.076330+0000, chain.objs.size()=1 2024-03-09T14:47:34.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.760+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.FDm1cytdT7vCNNnga32Dd49ZruxE9_O_0 2024-03-09T14:47:34.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.760+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8072749536173764505', time=2024-03-09T16:46:42.270120+0000, chain.objs.size()=1 2024-03-09T14:47:34.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.760+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.0y1M1lYQLEJt613fBmL4m-RQTBul3As_0 2024-03-09T14:47:34.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.768+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:34.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.772+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:47:34.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.776+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:34.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.780+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:34.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.780+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-09T14:47:34.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.780+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='_0-O90LsW7P5tpIso8O2o71Kr_m6uXYL', time=2024-03-09T16:42:32.114206+0000, chain.objs.size()=1 2024-03-09T14:47:34.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.780+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.y3wEfYzWsvMmIEJrHje1xeAGNwETvix_0 2024-03-09T14:47:34.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.780+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11738370591780073952', time=2024-03-09T16:44:20.987413+0000, chain.objs.size()=1 2024-03-09T14:47:34.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.780+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.UXEX0XiCdHdHpjlJxBZm1OvnwSa9R1v_0 2024-03-09T14:47:34.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.780+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.770151344355142022', time=2024-03-09T16:45:29.413726+0000, chain.objs.size()=1 2024-03-09T14:47:34.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.780+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.yGElpKTkXh4By68_Og5gEwFJs_wHzQc_0 2024-03-09T14:47:34.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.780+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18183507387353273476', time=2024-03-09T16:45:33.971492+0000, chain.objs.size()=1 2024-03-09T14:47:34.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.780+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.FlV2PnrxNu-_yM4FtG3UY7svp8anlSJ_0 2024-03-09T14:47:34.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.780+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11124050837528547201', time=2024-03-09T16:45:33.996577+0000, chain.objs.size()=1 2024-03-09T14:47:34.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.780+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.7O1mii0NV6JJJ8YZ1oPkfVwVrb1pqKV_0 2024-03-09T14:47:34.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.780+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16622717424060100420', time=2024-03-09T16:46:06.880352+0000, chain.objs.size()=1 2024-03-09T14:47:34.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.780+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.gFBP9cTtiT9f4GQ4bazGBTJ4K10tTF-_0 2024-03-09T14:47:34.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.780+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4940754144342211192', time=2024-03-09T16:46:06.898284+0000, chain.objs.size()=1 2024-03-09T14:47:34.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.780+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.NfFKgynUoKIUYBlMBvRXLvYXjZCFTBj_0 2024-03-09T14:47:34.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.788+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:34.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.796+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:47:34.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.796+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:34.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:34.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-03-09T14:47:34.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13428238659694273952', time=2024-03-09T16:42:31.668377+0000, chain.objs.size()=1 2024-03-09T14:47:34.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.7Hqy97EzjsAqsgDgJgett9O498bsUm4_0 2024-03-09T14:47:34.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='_gSz5HmO_k4scKep43UWh2A4fd9u3fjk', time=2024-03-09T16:42:31.952122+0000, chain.objs.size()=1 2024-03-09T14:47:34.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.IN3mjvWg9_2qAlUOOcVA2deKKJ3hrkV_0 2024-03-09T14:47:34.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18041660524212994346', time=2024-03-09T16:44:22.535920+0000, chain.objs.size()=1 2024-03-09T14:47:34.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.VvIFJJb1doZC6-nKrWQWH8jF-kVPUFo_0 2024-03-09T14:47:34.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17677971246403050920', time=2024-03-09T16:44:53.625706+0000, chain.objs.size()=1 2024-03-09T14:47:34.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.lkXsGu77IK2Szd4tcG9dKvVJNLjPzPw_0 2024-03-09T14:47:34.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1931954018012838261', time=2024-03-09T16:44:53.637558+0000, chain.objs.size()=1 2024-03-09T14:47:34.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.q0cMr-COo7NjHdJtWUEitwiKZ2ZA_2y_0 2024-03-09T14:47:34.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9386878915985543916', time=2024-03-09T16:44:56.073989+0000, chain.objs.size()=1 2024-03-09T14:47:34.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.G8-UtHYincWbGAPRcuqJK-AzFCdXnox_0 2024-03-09T14:47:34.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17863100551676092992', time=2024-03-09T16:45:29.424377+0000, chain.objs.size()=1 2024-03-09T14:47:34.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.gV3Ze7acWiZsrenLQDXh-6xR41LQtFA_0 2024-03-09T14:47:34.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8901807988346056702', time=2024-03-09T16:45:31.954458+0000, chain.objs.size()=1 2024-03-09T14:47:34.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.800+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.91_406_CGrxSSjumBnZrsIOSxDpCxZF_0 2024-03-09T14:47:34.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.808+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:34.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.812+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:47:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.816+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.816+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.816+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-09T14:47:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.816+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12485284061366922482', time=2024-03-09T16:44:19.408079+0000, chain.objs.size()=1 2024-03-09T14:47:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.816+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.zQKCC3oHy8fbDpt10tf_l6s4bNvVUJC_0 2024-03-09T14:47:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.816+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8318691690558577013', time=2024-03-09T16:44:53.639292+0000, chain.objs.size()=1 2024-03-09T14:47:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.816+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.AGbaNTw_XMJkpkotoZxYGa_sxw15l_i_0 2024-03-09T14:47:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.816+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13348605331361314008', time=2024-03-09T16:45:33.968650+0000, chain.objs.size()=1 2024-03-09T14:47:34.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.816+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.LMP-1yoIu3r2qSNhkjO2g38jy5eB3Ri_0 2024-03-09T14:47:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.816+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13413169709144661306', time=2024-03-09T16:45:33.969803+0000, chain.objs.size()=1 2024-03-09T14:47:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.816+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.zClKF5ulhNkvAz-sDp-d7tpio18rzeZ_0 2024-03-09T14:47:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.816+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3965577631018392020', time=2024-03-09T16:45:33.987892+0000, chain.objs.size()=1 2024-03-09T14:47:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.816+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.HmgS5N1XeiOa9su-tO8GUQ0EVTsBGCo_0 2024-03-09T14:47:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.816+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12724115747261411908', time=2024-03-09T16:46:06.902088+0000, chain.objs.size()=1 2024-03-09T14:47:34.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.816+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.vQINyCLrkksrEzgc76QAGMSYf-Cxs4G_0 2024-03-09T14:47:34.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.824+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:34.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.828+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:47:34.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.828+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:34.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.832+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.832+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-09T14:47:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.832+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9964923659522895867', time=2024-03-09T16:44:20.973053+0000, chain.objs.size()=1 2024-03-09T14:47:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.832+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.up2EVfsT31aCXC_XrxPQSsO1zCunczY_0 2024-03-09T14:47:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.832+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7102597244042588499', time=2024-03-09T16:44:20.977365+0000, chain.objs.size()=1 2024-03-09T14:47:34.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.832+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.nonznOSapXFmviDBWb9DRM9p8rHbB8P_0 2024-03-09T14:47:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.832+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12132780209319654389', time=2024-03-09T16:44:56.056821+0000, chain.objs.size()=1 2024-03-09T14:47:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.832+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.AUmqgFQvmkJu8gqydgk_TJ5Ztz8KhnF_0 2024-03-09T14:47:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.832+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1696394540836316550', time=2024-03-09T16:45:29.384691+0000, chain.objs.size()=1 2024-03-09T14:47:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.832+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.WS5YA-SO9ftCroB8nBDYe5_fiFb-WwW_0 2024-03-09T14:47:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.832+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12310418234142010183', time=2024-03-09T16:45:31.941702+0000, chain.objs.size()=1 2024-03-09T14:47:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.832+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.ZOZNpDZ1nlr9UN9Cr3f9EcgUnyBQ8Gn_0 2024-03-09T14:47:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.832+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15391604613515170128', time=2024-03-09T16:45:31.944807+0000, chain.objs.size()=1 2024-03-09T14:47:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.832+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.U9T6DY10oj_gT4lH6Ky8CZwaZsTzLl0_0 2024-03-09T14:47:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.832+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7761690157931435320', time=2024-03-09T16:46:09.073430+0000, chain.objs.size()=1 2024-03-09T14:47:34.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.832+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.jAHhtZvO-7mi56TcTXsHkbcSh6J0DhB_0 2024-03-09T14:47:34.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.840+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:34.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.844+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:47:34.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.844+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:34.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.848+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.848+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-09T14:47:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.848+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14650624206640228858', time=2024-03-09T16:45:31.945763+0000, chain.objs.size()=1 2024-03-09T14:47:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.848+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.LXhe1pKWL5d20O3_hRANNOJoOEJXHgL_0 2024-03-09T14:47:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.848+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10163249715860522537', time=2024-03-09T16:46:06.900707+0000, chain.objs.size()=1 2024-03-09T14:47:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.848+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.2nBV5MxUjTYYxy9nrgJZ3pS6BouKkfN_0 2024-03-09T14:47:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.848+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10590059654144187297', time=2024-03-09T16:46:09.072250+0000, chain.objs.size()=1 2024-03-09T14:47:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.848+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.7SSPYPi3hiQHUlXy7TtuNfT3zGzyV2v_0 2024-03-09T14:47:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.848+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17425737682348223595', time=2024-03-09T16:46:42.283828+0000, chain.objs.size()=1 2024-03-09T14:47:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.848+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.PhmS3g8Vj0BDUq8M74dKkmp4OisL4vK_0 2024-03-09T14:47:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.848+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12417168424361743743', time=2024-03-09T16:46:44.189166+0000, chain.objs.size()=1 2024-03-09T14:47:34.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.848+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18__shadow_.JN8wZPRouUQynhxBHIh5rJh2qsCLADO_0 2024-03-09T14:47:34.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.852+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:34.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.856+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:47:34.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.860+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:34.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.860+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.860+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-09T14:47:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.860+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10844710715294119754', time=2024-03-09T16:45:29.400663+0000, chain.objs.size()=1 2024-03-09T14:47:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.860+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.aLd4jlhArFFkLB1AyAM1RZY7luVnCcE_0 2024-03-09T14:47:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.860+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4754627889901285729', time=2024-03-09T16:45:29.402459+0000, chain.objs.size()=1 2024-03-09T14:47:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.860+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.8AzcGm92XM_0tr518Jd1m9wrjxY_85b_0 2024-03-09T14:47:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.860+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9052025342245035711', time=2024-03-09T16:45:29.406552+0000, chain.objs.size()=1 2024-03-09T14:47:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.860+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.e_7hXzPCQLBqamt29vBTCK46ZwFCdqQ_0 2024-03-09T14:47:34.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.860+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18133449418080840956', time=2024-03-09T16:45:31.939412+0000, chain.objs.size()=1 2024-03-09T14:47:34.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.860+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.ASqxhBCBfQqnHHXYeOEcL9E9bqkLCCr_0 2024-03-09T14:47:34.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.860+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.522289885062848105', time=2024-03-09T16:46:06.887025+0000, chain.objs.size()=1 2024-03-09T14:47:34.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.860+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.V3ttopTnvr0bVEztxI27NEQKRyAFYgP_0 2024-03-09T14:47:34.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.860+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.841495817011622429', time=2024-03-09T16:46:42.258901+0000, chain.objs.size()=1 2024-03-09T14:47:34.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.860+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.crhfAr4LP-3o2SNBpRHEFouU-HVzB5b_0 2024-03-09T14:47:34.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.860+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9300309195548981070', time=2024-03-09T16:46:44.197235+0000, chain.objs.size()=1 2024-03-09T14:47:34.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.860+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18__shadow_.kg9osJImUDdvzayGYKlR-cU-9VyYkcd_0 2024-03-09T14:47:34.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.868+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:34.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.872+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:47:34.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.872+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:34.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:34.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-03-09T14:47:34.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16492511991223704355', time=2024-03-09T16:42:31.698727+0000, chain.objs.size()=1 2024-03-09T14:47:34.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.za1hVEV8Gnp2qBw26sEUXshXnkZ6UH-_0 2024-03-09T14:47:34.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3133844827811813173', time=2024-03-09T16:44:19.420227+0000, chain.objs.size()=1 2024-03-09T14:47:34.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.Gq7qgPWxEWuwv6NFkfAZthraX7EU28L_0 2024-03-09T14:47:34.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.882343979333256850', time=2024-03-09T16:44:56.055407+0000, chain.objs.size()=1 2024-03-09T14:47:34.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.rRIcxb6dCYYXYuEn5xRfI1GxCBxh_ig_0 2024-03-09T14:47:34.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17150540230222915136', time=2024-03-09T16:45:31.954203+0000, chain.objs.size()=1 2024-03-09T14:47:34.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.BKSwMM0rkxPXifMI1Wjw3J6mbJuvfs__0 2024-03-09T14:47:34.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.374527414094343699', time=2024-03-09T16:45:33.973360+0000, chain.objs.size()=1 2024-03-09T14:47:34.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.-q8yRGzjS4LbPZ_mEWYHMBivkyeedNd_0 2024-03-09T14:47:34.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3219729121938756585', time=2024-03-09T16:46:09.083681+0000, chain.objs.size()=1 2024-03-09T14:47:34.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.rVJQ7Q0E_606pC6Z9kzLm_B21Xo5Lw__0 2024-03-09T14:47:34.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5947111887500372069', time=2024-03-09T16:46:09.085468+0000, chain.objs.size()=1 2024-03-09T14:47:34.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.oX5BpBFIb0CcNl07Bg0iXNk-cjBRgs3_0 2024-03-09T14:47:34.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3626582239726444669', time=2024-03-09T16:46:44.186843+0000, chain.objs.size()=1 2024-03-09T14:47:34.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.876+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18__shadow_.BIYDxyRPnPl-vfOyXVSBb6VMJhrIMS-_0 2024-03-09T14:47:34.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.884+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:34.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.888+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:47:34.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.888+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:34.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.892+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:34.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.892+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-09T14:47:34.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.892+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.QzgAzUREowEtpj_EF8yRc4KzJtjo2vz_1_db0b5b883935ab4c04e42ea52d021cbf', time=2024-03-09T16:42:32.063666+0000, chain.objs.size()=1 2024-03-09T14:47:34.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.892+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.QzgAzUREowEtpj_EF8yRc4KzJtjo2vz_0 2024-03-09T14:47:34.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.892+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13141793555833164032', time=2024-03-09T16:42:32.292362+0000, chain.objs.size()=3 2024-03-09T14:47:34.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.892+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-STANDARD.2~X7wW1pA6uFxnUQwgTOMCwAvUYspw9-C.1 2024-03-09T14:47:34.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.892+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-STANDARD.2~X7wW1pA6uFxnUQwgTOMCwAvUYspw9-C.2 2024-03-09T14:47:34.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.892+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-STANDARD.2~X7wW1pA6uFxnUQwgTOMCwAvUYspw9-C.3 2024-03-09T14:47:34.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.892+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3610344806262781610', time=2024-03-09T16:44:55.379292+0000, chain.objs.size()=1 2024-03-09T14:47:34.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.892+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.Ocmz3RtuQZZ4y4aqM3p3czFQhXjtYYY_0 2024-03-09T14:47:34.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.892+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13379669700663521619', time=2024-03-09T16:45:29.388362+0000, chain.objs.size()=1 2024-03-09T14:47:34.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.892+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.OJJQjlbQ2Mffvpbdam94O9NsYI7eqWZ_0 2024-03-09T14:47:34.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.892+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8251715437836310537', time=2024-03-09T16:45:33.974790+0000, chain.objs.size()=1 2024-03-09T14:47:34.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.892+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.mGZY3pBB-3FD0HeonEYe9wUci4XL1w0_0 2024-03-09T14:47:34.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.892+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4954973704775100595', time=2024-03-09T16:46:44.188041+0000, chain.objs.size()=1 2024-03-09T14:47:34.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.892+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18__shadow_.L4viiikCPXKuEhAUhUGudM-e1A9UqEL_0 2024-03-09T14:47:34.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.896+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:34.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.904+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:47:34.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.904+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:34.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.904+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:34.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-03-09T14:47:34.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16656033103987340499', time=2024-03-09T16:42:31.997189+0000, chain.objs.size()=1 2024-03-09T14:47:34.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.ZVXFgPTvPTok0u5XpsbTJUj6CWamAGE_0 2024-03-09T14:47:34.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='_5uB0r0ACi23ZUhU7PAX6lB1TkLDjIxY', time=2024-03-09T16:42:32.053282+0000, chain.objs.size()=1 2024-03-09T14:47:34.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.b1iHL0cE016ico8KojL_fCsyADxl0Ss_0 2024-03-09T14:47:34.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15880555619203367589', time=2024-03-09T16:42:32.187792+0000, chain.objs.size()=3 2024-03-09T14:47:34.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-LUKEWARM.2~CCSvct-ww4j6v5AoPJGm3f8T1gxZdaO.1 2024-03-09T14:47:34.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-LUKEWARM.2~CCSvct-ww4j6v5AoPJGm3f8T1gxZdaO.2 2024-03-09T14:47:34.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-LUKEWARM.2~CCSvct-ww4j6v5AoPJGm3f8T1gxZdaO.3 2024-03-09T14:47:34.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7631120914895796072', time=2024-03-09T16:42:32.540801+0000, chain.objs.size()=1 2024-03-09T14:47:34.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8__shadow_.A5CLBoMZCUQEj8HH9uUIV88X39q_3S0_0 2024-03-09T14:47:34.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1785604922320076188', time=2024-03-09T16:42:32.629642+0000, chain.objs.size()=1 2024-03-09T14:47:34.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9__shadow_.dIPhjKPecdH5UW1dq-324GincVKg6Ax_0 2024-03-09T14:47:34.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18229475839300316017', time=2024-03-09T16:44:53.643739+0000, chain.objs.size()=1 2024-03-09T14:47:34.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.7-SXM8kqIppzpvSv24_-5JTbqUchUNi_0 2024-03-09T14:47:34.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16912225823500075697', time=2024-03-09T16:44:56.047151+0000, chain.objs.size()=1 2024-03-09T14:47:34.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.K_MhcuDnIm6MTFwZyxznDj9jVXoY-RC_0 2024-03-09T14:47:34.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8311383559684041646', time=2024-03-09T16:45:31.939353+0000, chain.objs.size()=1 2024-03-09T14:47:34.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.5Jxoqry8yGyyt8vw_CMlKRGYwb08HlC_0 2024-03-09T14:47:34.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3761853233139187343', time=2024-03-09T16:45:33.965391+0000, chain.objs.size()=1 2024-03-09T14:47:34.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.tHJc49mKuogWkuRnhqiIevQnaX6acqa_0 2024-03-09T14:47:34.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5211929935861426760', time=2024-03-09T16:45:33.972305+0000, chain.objs.size()=1 2024-03-09T14:47:34.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.908+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.LbqfNmRUuVX9dTfzHS_df0uSGiiAQg6_0 2024-03-09T14:47:34.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.912+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4533967438005998520', time=2024-03-09T16:46:05.765888+0000, chain.objs.size()=1 2024-03-09T14:47:34.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.912+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.yl87yYs50tzF_kjXruzZ22UaYVEvs0P_0 2024-03-09T14:47:34.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.912+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17388894657764179877', time=2024-03-09T16:46:09.071279+0000, chain.objs.size()=1 2024-03-09T14:47:34.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.912+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.CKeP8Ks2O4-77d4vQOQ8QgT3TOaYj08_0 2024-03-09T14:47:34.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.916+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:34.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.920+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:47:34.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:34.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:34.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-03-09T14:47:34.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18091906517887606087', time=2024-03-09T16:42:31.962982+0000, chain.objs.size()=1 2024-03-09T14:47:34.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.QzgAzUREowEtpj_EF8yRc4KzJtjo2vz_0 2024-03-09T14:47:34.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17993468294744244056', time=2024-03-09T16:44:53.650963+0000, chain.objs.size()=1 2024-03-09T14:47:34.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.g9iESn4LExghJN4iAIjn-IIryz2-M5z_0 2024-03-09T14:47:34.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1909262119464765001', time=2024-03-09T16:44:58.079941+0000, chain.objs.size()=1 2024-03-09T14:47:34.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.jhJ4p22a3ZyW4PJz7HuZ5mcVrvpa1Iz_0 2024-03-09T14:47:34.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3987147797737276677', time=2024-03-09T16:45:31.942048+0000, chain.objs.size()=1 2024-03-09T14:47:34.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_._R9U149k0nfO0MULSrdrblmSGT-mydc_0 2024-03-09T14:47:34.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7104258799503199489', time=2024-03-09T16:46:09.091993+0000, chain.objs.size()=1 2024-03-09T14:47:34.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.q6Dh_Zr9jWyifWv5WXZpuK9FYQ3VutC_0 2024-03-09T14:47:34.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.554044847560781874', time=2024-03-09T16:46:42.284434+0000, chain.objs.size()=1 2024-03-09T14:47:34.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.QCHzvgK2kvyIkm1MlvUTh96tqkhJ_ww_0 2024-03-09T14:47:34.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13116568882365651794', time=2024-03-09T16:46:42.290536+0000, chain.objs.size()=1 2024-03-09T14:47:34.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.-3Rg5XhAEJzWK5ruTij9rf2y95P5ZQJ_0 2024-03-09T14:47:34.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9183199845398400709', time=2024-03-09T16:46:44.185874+0000, chain.objs.size()=1 2024-03-09T14:47:34.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.924+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18__shadow_.Kza3c68q-pSQrK29M7bZJtRU3qGpJqw_0 2024-03-09T14:47:34.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.928+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:34.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.936+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:47:34.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.936+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:34.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.940+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:34.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.940+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-09T14:47:34.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.940+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.hd-Z1ASaPkdg1FOVsqPBrP0QIqivd5D_1_6143e565ee763cb2428b7f2ba99732ea', time=2024-03-09T16:42:32.043917+0000, chain.objs.size()=1 2024-03-09T14:47:34.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.940+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.hd-Z1ASaPkdg1FOVsqPBrP0QIqivd5D_0 2024-03-09T14:47:34.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.940+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17437219682218459134', time=2024-03-09T16:44:20.979363+0000, chain.objs.size()=1 2024-03-09T14:47:34.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.940+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.GbQV_jK43r1HLQqUDzbR9ER18ABXdnk_0 2024-03-09T14:47:34.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.940+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17362673823261484111', time=2024-03-09T16:44:53.629262+0000, chain.objs.size()=1 2024-03-09T14:47:34.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.940+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.9DN7OkMt_TX_kbIg10E0fSdjJRaYyrh_0 2024-03-09T14:47:34.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.940+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5684631052583333762', time=2024-03-09T16:44:56.061502+0000, chain.objs.size()=1 2024-03-09T14:47:34.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.940+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.F51q4QuzMa56Rp7K76o9pDKvkrSPuaU_0 2024-03-09T14:47:34.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.940+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1106355455360620520', time=2024-03-09T16:45:31.939325+0000, chain.objs.size()=1 2024-03-09T14:47:34.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.940+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.q40nJzy6CeUXY-8_aLoRaT49dwKJ6-Q_0 2024-03-09T14:47:34.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.940+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.430432513848056684', time=2024-03-09T16:46:09.083480+0000, chain.objs.size()=1 2024-03-09T14:47:34.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.940+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.QbHMQtNXeN2M1S3hKkkmFlVULH_Uq30_0 2024-03-09T14:47:34.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.940+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12056820408146817441', time=2024-03-09T16:46:42.264685+0000, chain.objs.size()=1 2024-03-09T14:47:34.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.940+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.n0YmEo2zhVLKs46VJPAnELSBlfhM01M_0 2024-03-09T14:47:34.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.944+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:34.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.948+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:47:34.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.948+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:34.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-03-09T14:47:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3878556563969087193', time=2024-03-09T16:42:31.642972+0000, chain.objs.size()=1 2024-03-09T14:47:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.5ETKPwS8uXItWmrA0lBnLmVgXGlX0CO_0 2024-03-09T14:47:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7712252492017385009', time=2024-03-09T16:42:31.779845+0000, chain.objs.size()=4 2024-03-09T14:47:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13__multipart_foo.2~5pX1dHf4xZ5tA-V4Dr_OMorqc9cmfIP.1 2024-03-09T14:47:34.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13__multipart_foo.2~5pX1dHf4xZ5tA-V4Dr_OMorqc9cmfIP.2 2024-03-09T14:47:34.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13__multipart_foo.2~5pX1dHf4xZ5tA-V4Dr_OMorqc9cmfIP.3 2024-03-09T14:47:34.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13__multipart_foo.2~5pX1dHf4xZ5tA-V4Dr_OMorqc9cmfIP.4 2024-03-09T14:47:34.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13413091151430590113', time=2024-03-09T16:42:31.890903+0000, chain.objs.size()=4 2024-03-09T14:47:34.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10__multipart_foo.2~hYMZWuLVsT9nQQzbtE8M1MyUem3ommB.1 2024-03-09T14:47:34.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10__multipart_foo.2~hYMZWuLVsT9nQQzbtE8M1MyUem3ommB.2 2024-03-09T14:47:34.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10__multipart_foo.2~hYMZWuLVsT9nQQzbtE8M1MyUem3ommB.3 2024-03-09T14:47:34.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10__multipart_foo.2~hYMZWuLVsT9nQQzbtE8M1MyUem3ommB.4 2024-03-09T14:47:34.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8758169255122677636', time=2024-03-09T16:42:32.607549+0000, chain.objs.size()=1 2024-03-09T14:47:34.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9__shadow_.f49KCqiNAmzvossn9TjElJVEGnML1lB_0 2024-03-09T14:47:34.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9041241305792064220', time=2024-03-09T16:44:19.406431+0000, chain.objs.size()=1 2024-03-09T14:47:34.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.AxiGmQVGxM8YEx9MYZONhKOpb0QGZKm_0 2024-03-09T14:47:34.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16047775732777517021', time=2024-03-09T16:44:20.983667+0000, chain.objs.size()=1 2024-03-09T14:47:34.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.952+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.leK5zo_2-K5oK3lEtS6qdvUMQUd2LxT_0 2024-03-09T14:47:34.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.956+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2066319069031928390', time=2024-03-09T16:44:53.631293+0000, chain.objs.size()=1 2024-03-09T14:47:34.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.956+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.imZrosD9czocmxiXmdjQMsqjJx6nxYD_0 2024-03-09T14:47:34.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.956+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2166270936394683777', time=2024-03-09T16:44:53.658735+0000, chain.objs.size()=1 2024-03-09T14:47:34.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.956+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.IWznuRdQypJVyYbU5k7KNqqrPFNVTjC_0 2024-03-09T14:47:34.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.956+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7864730491725882483', time=2024-03-09T16:44:53.661307+0000, chain.objs.size()=1 2024-03-09T14:47:34.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.956+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.qRwF9KSvQ__hgYvfdEh8D7XjMCUQ5dT_0 2024-03-09T14:47:34.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.960+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10970585709171771517', time=2024-03-09T16:46:42.261660+0000, chain.objs.size()=1 2024-03-09T14:47:34.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.960+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.lLJEiLr2aFOq-lhE6SsOQQ8VY6No5cQ_0 2024-03-09T14:47:34.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.964+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:34.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.968+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:47:34.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:34.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:34.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-03-09T14:47:34.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4509385844286689815', time=2024-03-09T16:42:31.679485+0000, chain.objs.size()=1 2024-03-09T14:47:34.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.U3oehVO2zRbJpXHTk6MBOf39FIntC4R_0 2024-03-09T14:47:34.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10582183140029721902', time=2024-03-09T16:44:19.392275+0000, chain.objs.size()=1 2024-03-09T14:47:34.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.38LbJOOgIZDpqZa_2-LNlR5n3cT_ffg_0 2024-03-09T14:47:34.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10373669519784979009', time=2024-03-09T16:44:19.395371+0000, chain.objs.size()=1 2024-03-09T14:47:34.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.xL61yHvZ660qve9_vz5HSZVDGsEF-UI_0 2024-03-09T14:47:34.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16647670640585333934', time=2024-03-09T16:44:20.971953+0000, chain.objs.size()=1 2024-03-09T14:47:34.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.2LvyEF49CIFODDPlVPFdpvWMUbHMreM_0 2024-03-09T14:47:34.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3230946073008065152', time=2024-03-09T16:44:53.635392+0000, chain.objs.size()=1 2024-03-09T14:47:34.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.37vzg1OQhf85UJrEzy9NOyPJmLgwa6V_0 2024-03-09T14:47:34.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14052087567098996233', time=2024-03-09T16:46:06.882174+0000, chain.objs.size()=1 2024-03-09T14:47:34.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.vraCp7HXLBaESZfNHrQXkzADgRSpGjR_0 2024-03-09T14:47:34.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15701516453415367009', time=2024-03-09T16:46:09.074060+0000, chain.objs.size()=1 2024-03-09T14:47:34.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.ICiYPQ7YFn9NcbahdUndTzwsWnchhXF_0 2024-03-09T14:47:34.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8853119714190118883', time=2024-03-09T16:46:42.261583+0000, chain.objs.size()=1 2024-03-09T14:47:34.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.972+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.DWxLHfFlzO5FRthCFd_KaSV3xSliBNM_0 2024-03-09T14:47:34.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.980+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:34.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:47:34.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:34.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:34.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-03-09T14:47:34.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8044039954805917167', time=2024-03-09T16:42:31.661379+0000, chain.objs.size()=1 2024-03-09T14:47:34.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.aqfTHyXUhiw82ixN-CMLrv4MDYB1tkm_0 2024-03-09T14:47:34.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5223028780848338492', time=2024-03-09T16:44:19.388015+0000, chain.objs.size()=1 2024-03-09T14:47:34.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.1csneBRwL4gT8ex5Wm7F8iOmJPYleOX_0 2024-03-09T14:47:34.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8334493067612740257', time=2024-03-09T16:44:19.396014+0000, chain.objs.size()=1 2024-03-09T14:47:34.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.sDtRyjhl0fH5xJKQKPRFFIvXWl4Yy51_0 2024-03-09T14:47:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15376237121747565522', time=2024-03-09T16:44:20.972792+0000, chain.objs.size()=1 2024-03-09T14:47:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.grO4UeE_0gVMU_971zDaQS6k6mgmJik_0 2024-03-09T14:47:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14651901374552205601', time=2024-03-09T16:44:53.634516+0000, chain.objs.size()=1 2024-03-09T14:47:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.amYNxQktiEYFEIYjK4ox0UxYF8HLO21_0 2024-03-09T14:47:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.452497269248821736', time=2024-03-09T16:44:53.653157+0000, chain.objs.size()=1 2024-03-09T14:47:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.5qtimMSL7tfVyzNri7CJuRREe_k-E3f_0 2024-03-09T14:47:34.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11154218691964090937', time=2024-03-09T16:44:56.070002+0000, chain.objs.size()=1 2024-03-09T14:47:34.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.sbzkrdWpk37BvVISk89szp3n1MTlLdH_0 2024-03-09T14:47:34.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.556657490169551569', time=2024-03-09T16:46:09.072309+0000, chain.objs.size()=1 2024-03-09T14:47:34.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.984+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.Si6xjx0vcqakS9gS1hgvkPdqelahBWC_0 2024-03-09T14:47:34.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.992+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:34.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.992+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:47:34.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:34.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:34.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-03-09T14:47:34.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5172718757300203297', time=2024-03-09T16:42:31.736222+0000, chain.objs.size()=4 2024-03-09T14:47:34.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12__multipart_foo.2~GetD61F8Kt2MwWSRmIeATGVty1lEErh.1 2024-03-09T14:47:34.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12__multipart_foo.2~GetD61F8Kt2MwWSRmIeATGVty1lEErh.2 2024-03-09T14:47:34.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12__multipart_foo.2~GetD61F8Kt2MwWSRmIeATGVty1lEErh.3 2024-03-09T14:47:34.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12__multipart_foo.2~GetD61F8Kt2MwWSRmIeATGVty1lEErh.4 2024-03-09T14:47:34.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='_MftkGW7YieZc8Is2FmVQJQBjXmNjDDW', time=2024-03-09T16:42:31.987239+0000, chain.objs.size()=1 2024-03-09T14:47:34.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.dJg8ZmJR7zo21dgKiVKKLudFpJDtl6h_0 2024-03-09T14:47:34.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-STANDARD.2~E70XJhn5n-V7ByeAc2hn6q-eOLkOFeV.2_a1bda6bf6fb99a565fec9bcee685e37c', time=2024-03-09T16:42:32.197816+0000, chain.objs.size()=3 2024-03-09T14:47:34.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-STANDARD.2~E70XJhn5n-V7ByeAc2hn6q-eOLkOFeV.1 2024-03-09T14:47:34.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-STANDARD.2~E70XJhn5n-V7ByeAc2hn6q-eOLkOFeV.2 2024-03-09T14:47:34.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-STANDARD.2~E70XJhn5n-V7ByeAc2hn6q-eOLkOFeV.3 2024-03-09T14:47:34.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12561061919858879911', time=2024-03-09T16:42:32.529313+0000, chain.objs.size()=1 2024-03-09T14:47:34.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8__shadow_.mvyNjEtkX0W9lx7ydirgcWTqTivs-we_0 2024-03-09T14:47:34.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10231957354315613398', time=2024-03-09T16:44:20.971447+0000, chain.objs.size()=1 2024-03-09T14:47:34.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.hwQPsFCJGIhuE2TZZ4DK08WToisyvK0_0 2024-03-09T14:47:34.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12491749663388698747', time=2024-03-09T16:46:06.880041+0000, chain.objs.size()=1 2024-03-09T14:47:34.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.FBJy5uRqjSF5U-SXTfnF7MvwmBItc3z_0 2024-03-09T14:47:34.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11723337435768011910', time=2024-03-09T16:46:09.070713+0000, chain.objs.size()=1 2024-03-09T14:47:34.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:34.996+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.H-XPiaO9nAdOZbsZlN1xb9xg4zHuteo_0 2024-03-09T14:47:34.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.000+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16549410851107111220', time=2024-03-09T16:46:42.260166+0000, chain.objs.size()=1 2024-03-09T14:47:34.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.000+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.RHOvd4BHkRC3OCVfsCcm7lTeP4ZUyvk_0 2024-03-09T14:47:34.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.004+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16894757827179250095', time=2024-03-09T16:46:42.268920+0000, chain.objs.size()=1 2024-03-09T14:47:34.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.004+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.G5jB45ZbyQWkuzwc8mkK81fy5NJRH-8_0 2024-03-09T14:47:34.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.004+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2096025610305127772', time=2024-03-09T16:46:42.289761+0000, chain.objs.size()=1 2024-03-09T14:47:34.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.004+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.Cwvo3UtVSVmp9MVNM10mLTcM37RyqBq_0 2024-03-09T14:47:34.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.004+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1341131663959366858', time=2024-03-09T16:46:44.190703+0000, chain.objs.size()=1 2024-03-09T14:47:34.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.004+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18__shadow_.swNOEuRdWqNxd-BnKUnzgz2wEaIuMCJ_0 2024-03-09T14:47:35.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.008+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:35.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.012+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:47:35.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.012+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.012+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.012+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:47:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.012+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17956324609359261267', time=2024-03-09T16:44:18.502005+0000, chain.objs.size()=1 2024-03-09T14:47:35.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.012+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.devcSmypX9-0QipaD6YNRCsXHaVsRgS_0 2024-03-09T14:47:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.012+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1800992755211971610', time=2024-03-09T16:46:09.079365+0000, chain.objs.size()=1 2024-03-09T14:47:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.012+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.zv9AAffUHUHDy4bUr69E-pS3wrzVqEd_0 2024-03-09T14:47:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.012+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8478700626461142669', time=2024-03-09T16:46:42.268553+0000, chain.objs.size()=1 2024-03-09T14:47:35.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.012+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.7OYltO6MtSq08Xs94m6-_BHrPXfcI_x_0 2024-03-09T14:47:35.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.016+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:35.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.020+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:47:35.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.020+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.020+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-03-09T14:47:35.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='_BlwWKAg-0WhjUkvSJtjyCBTBf1c9QRD', time=2024-03-09T16:42:31.939755+0000, chain.objs.size()=1 2024-03-09T14:47:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.sx7akAxfVCUOLfOGPtrdWvvMw4XC3F7_0 2024-03-09T14:47:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.ZVXFgPTvPTok0u5XpsbTJUj6CWamAGE_1_1b0dafb776485298dcc174c71be51d25', time=2024-03-09T16:42:32.030226+0000, chain.objs.size()=1 2024-03-09T14:47:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.ZVXFgPTvPTok0u5XpsbTJUj6CWamAGE_0 2024-03-09T14:47:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-LUKEWARM.2~CCSvct-ww4j6v5AoPJGm3f8T1gxZdaO.2_4fa87d455cd83b51fe58b555400e7d9a', time=2024-03-09T16:42:32.206695+0000, chain.objs.size()=3 2024-03-09T14:47:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-LUKEWARM.2~CCSvct-ww4j6v5AoPJGm3f8T1gxZdaO.1 2024-03-09T14:47:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-LUKEWARM.2~CCSvct-ww4j6v5AoPJGm3f8T1gxZdaO.2 2024-03-09T14:47:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-LUKEWARM.2~CCSvct-ww4j6v5AoPJGm3f8T1gxZdaO.3 2024-03-09T14:47:35.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5766413470519763374', time=2024-03-09T16:44:19.414343+0000, chain.objs.size()=1 2024-03-09T14:47:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.v08Zr1dGDFUBszX7zqT0RQZs99gNhQL_0 2024-03-09T14:47:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17585073089093645825', time=2024-03-09T16:44:20.983698+0000, chain.objs.size()=1 2024-03-09T14:47:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.7aKItyjzA7kanE5jdtWe3A-kvJKGpMM_0 2024-03-09T14:47:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9716032546778336628', time=2024-03-09T16:44:20.985633+0000, chain.objs.size()=1 2024-03-09T14:47:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.VEK-M40q5EAoNdFkeNrHVIyON7sP3i3_0 2024-03-09T14:47:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17029986549193075917', time=2024-03-09T16:44:21.000178+0000, chain.objs.size()=1 2024-03-09T14:47:35.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.toXsfvJGNtlf4NndGUwHS3qZUyD5yt8_0 2024-03-09T14:47:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8273654585935562813', time=2024-03-09T16:44:56.047453+0000, chain.objs.size()=1 2024-03-09T14:47:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.KkuJIh34o1-Ju4neQANj3CivZbwJHTP_0 2024-03-09T14:47:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9899384853408932595', time=2024-03-09T16:45:31.930927+0000, chain.objs.size()=1 2024-03-09T14:47:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.-W1BfQgVGus9jmGlb2m6BIkWCbD4f7i_0 2024-03-09T14:47:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7822650630519362688', time=2024-03-09T16:46:58.361913+0000, chain.objs.size()=1 2024-03-09T14:47:35.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.024+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19__shadow:ZFTMj9t3AnGAQyLMyOMbE4hN8jP21vJ_.a2vR4Vsgem2adZ2MQY2gMdhfZW6hEGR_0 2024-03-09T14:47:35.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.028+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:35.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.032+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:47:35.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.032+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.032+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.032+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-03-09T14:47:35.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.032+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12762894921746473561', time=2024-03-09T16:42:31.624505+0000, chain.objs.size()=1 2024-03-09T14:47:35.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.032+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.xfL7hlHYt0iBjOK1pGfoN0ICGQBbrln_0 2024-03-09T14:47:35.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.032+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13804327044622994221', time=2024-03-09T16:42:32.384356+0000, chain.objs.size()=2 2024-03-09T14:47:35.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.032+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14__shadow_.oHPjwmpINUccgfqBrOnnFegYnI-g-pM_0 2024-03-09T14:47:35.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.032+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14__shadow_.oHPjwmpINUccgfqBrOnnFegYnI-g-pM_1 2024-03-09T14:47:35.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.032+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14312579432193874617', time=2024-03-09T16:44:19.401822+0000, chain.objs.size()=1 2024-03-09T14:47:35.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.032+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.N4kvm43WQ2mEyKGf-xWqRhNUAMnXUVc_0 2024-03-09T14:47:35.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.036+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17297798532510018314', time=2024-03-09T16:44:53.637433+0000, chain.objs.size()=1 2024-03-09T14:47:35.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.036+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.XDkmMGu7ZuTlMN5rdUMbWf0koC62QdY_0 2024-03-09T14:47:35.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.036+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7508495235233765785', time=2024-03-09T16:44:56.048571+0000, chain.objs.size()=1 2024-03-09T14:47:35.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.036+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.CioErSHBG5FFLITbMGeWsGQHHlzBXCJ_0 2024-03-09T14:47:35.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.036+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15080763505071400216', time=2024-03-09T16:45:31.929931+0000, chain.objs.size()=1 2024-03-09T14:47:35.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.036+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.xgABFfSFPBvXtTY89flbEagv4Tj6ruN_0 2024-03-09T14:47:35.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.036+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3240869155054390801', time=2024-03-09T16:45:31.946828+0000, chain.objs.size()=1 2024-03-09T14:47:35.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.036+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.RYoztrUY3Ivcdlixmy2iXmw1IvX8RDb_0 2024-03-09T14:47:35.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.036+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9944915000513484224', time=2024-03-09T16:45:33.972236+0000, chain.objs.size()=1 2024-03-09T14:47:35.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.036+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.UxVUK8Ls8mP-96vYnzzqiFHZPHma8ss_0 2024-03-09T14:47:35.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.036+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9923624960196207052', time=2024-03-09T16:45:33.977483+0000, chain.objs.size()=1 2024-03-09T14:47:35.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.036+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.URrZCRlPavtkT4ReYuN3sMp00Edk66D_0 2024-03-09T14:47:35.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.036+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10344362312663533142', time=2024-03-09T16:45:34.002715+0000, chain.objs.size()=1 2024-03-09T14:47:35.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.036+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.1bQUf3Xmh7xyOH-5EL93qT0EUfG3z6Q_0 2024-03-09T14:47:35.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.036+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17458100078234307938', time=2024-03-09T16:46:09.085346+0000, chain.objs.size()=1 2024-03-09T14:47:35.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.036+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.2R09unI5LoJiu4uKTx3H12P7nGZH77f_0 2024-03-09T14:47:35.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.040+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:35.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.044+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:47:35.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.048+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.048+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.048+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-09T14:47:35.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.048+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='_551Sms9dm7encro--MVyfedLLaq9igk', time=2024-03-09T16:42:32.006385+0000, chain.objs.size()=1 2024-03-09T14:47:35.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.048+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.uPWQ9JxWy6PdvixXMMIUHFaAHv49wFF_0 2024-03-09T14:47:35.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.048+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='_XVuHmLfYOykk5krFvYVYZAsDoEd6Hr_', time=2024-03-09T16:42:32.217103+0000, chain.objs.size()=1 2024-03-09T14:47:35.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.048+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.Mun_Aphhxp5CFDUo3aSXDXJ0Cj3wocd_0 2024-03-09T14:47:35.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.048+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10885492899959336656', time=2024-03-09T16:44:19.418482+0000, chain.objs.size()=1 2024-03-09T14:47:35.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.048+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.bYvpwDfCweagqsj76X-wybLcE9yo8Mx_0 2024-03-09T14:47:35.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.048+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.604214939979382783', time=2024-03-09T16:44:53.632215+0000, chain.objs.size()=1 2024-03-09T14:47:35.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.048+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.M5iRyrQ1amD-EFhbalvjiWYf5xxLLxS_0 2024-03-09T14:47:35.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.048+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4605810744952738097', time=2024-03-09T16:44:56.064547+0000, chain.objs.size()=1 2024-03-09T14:47:35.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.048+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.l0GFE-MA1VsU4l4FniIo2v3IT1vjco1_0 2024-03-09T14:47:35.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.048+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10704505156685163018', time=2024-03-09T16:46:06.886274+0000, chain.objs.size()=1 2024-03-09T14:47:35.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.048+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.XNKeIJ8Jkxapc2ZMqPnQOc2CSv3a8f5_0 2024-03-09T14:47:35.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.048+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13751338314909636886', time=2024-03-09T16:46:08.191478+0000, chain.objs.size()=1 2024-03-09T14:47:35.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.048+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.x4G3W7t-4jdXeYdGFkI-5WPptPsvNxh_0 2024-03-09T14:47:35.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.052+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:35.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.056+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:47:35.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.056+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.060+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.060+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-09T14:47:35.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.060+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6771451508076974484', time=2024-03-09T16:42:32.020918+0000, chain.objs.size()=1 2024-03-09T14:47:35.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.060+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.hd-Z1ASaPkdg1FOVsqPBrP0QIqivd5D_0 2024-03-09T14:47:35.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.060+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4932823654951343289', time=2024-03-09T16:42:32.642069+0000, chain.objs.size()=1 2024-03-09T14:47:35.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.060+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9__shadow_.i-fu7AJ7B2ecP1a1PE4dsVUg3aWy0_y_0 2024-03-09T14:47:35.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.060+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3817132980760953116', time=2024-03-09T16:44:19.406521+0000, chain.objs.size()=1 2024-03-09T14:47:35.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.060+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.mYJPlT1ft3lAqnTedji6MRZYOzC8w_E_0 2024-03-09T14:47:35.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.060+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6998810093343071991', time=2024-03-09T16:44:20.982124+0000, chain.objs.size()=1 2024-03-09T14:47:35.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.060+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.BLHoL_cGe_qmPgdvKRBSlilkmvKJjfv_0 2024-03-09T14:47:35.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.060+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11854129297290644562', time=2024-03-09T16:46:06.889469+0000, chain.objs.size()=1 2024-03-09T14:47:35.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.060+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.nkRZ082mb3X-I18D-ixzRA0k28qSC_v_0 2024-03-09T14:47:35.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.060+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12248619766074779996', time=2024-03-09T16:46:09.091893+0000, chain.objs.size()=1 2024-03-09T14:47:35.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.060+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.2mGtGkJYEWC9_-I8YLnQ5YFrB5ZsOv8_0 2024-03-09T14:47:35.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.060+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:35.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.064+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:47:35.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.068+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.068+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.068+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-09T14:47:35.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.068+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10792633427723108709', time=2024-03-09T16:44:56.059154+0000, chain.objs.size()=1 2024-03-09T14:47:35.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.068+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.SKpA0EemNNYdPBh_oQEW3xIyGZ5LtNZ_0 2024-03-09T14:47:35.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.068+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4447452710761036098', time=2024-03-09T16:45:29.391158+0000, chain.objs.size()=1 2024-03-09T14:47:35.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.068+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.WgV69NWuZCc6pCutnmWtaONFX7vddIv_0 2024-03-09T14:47:35.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.068+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.278253802687725620', time=2024-03-09T16:45:31.943845+0000, chain.objs.size()=1 2024-03-09T14:47:35.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.068+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.8786ZuewD7SDXOTJv6soRjbowGuLVe1_0 2024-03-09T14:47:35.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.068+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9152919927946718074', time=2024-03-09T16:46:06.867574+0000, chain.objs.size()=1 2024-03-09T14:47:35.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.068+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.88fWtEHxhxfM4sk7ZcfgrCGBNTlQrMe_0 2024-03-09T14:47:35.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.068+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9579360899882551999', time=2024-03-09T16:46:06.884454+0000, chain.objs.size()=1 2024-03-09T14:47:35.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.068+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.ZMOk4LESQy8zbIlcON4YQ8-pxGZgtiY_0 2024-03-09T14:47:35.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.068+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14137779651345394333', time=2024-03-09T16:46:06.886496+0000, chain.objs.size()=1 2024-03-09T14:47:35.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.068+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.NE9ernoTG5JzTFNT9taG5BdGmvuphRK_0 2024-03-09T14:47:35.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.068+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10611241868463736145', time=2024-03-09T16:46:41.358724+0000, chain.objs.size()=1 2024-03-09T14:47:35.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.068+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.7UXG5lEh5zn4duSQhfbh6K8mqAyD32h_0 2024-03-09T14:47:35.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.072+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:35.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.076+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:47:35.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-09T14:47:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6124823075515677926', time=2024-03-09T16:42:31.833579+0000, chain.objs.size()=4 2024-03-09T14:47:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11__multipart_foo.2~rXypnLeKOGnv1Oxr9loXVrfmtDr8Bqr.1 2024-03-09T14:47:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11__multipart_foo.2~rXypnLeKOGnv1Oxr9loXVrfmtDr8Bqr.2 2024-03-09T14:47:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11__multipart_foo.2~rXypnLeKOGnv1Oxr9loXVrfmtDr8Bqr.3 2024-03-09T14:47:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11__multipart_foo.2~rXypnLeKOGnv1Oxr9loXVrfmtDr8Bqr.4 2024-03-09T14:47:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12515559357397647067', time=2024-03-09T16:44:19.404514+0000, chain.objs.size()=1 2024-03-09T14:47:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.2QJlX5RZI5xsvVeSyK1RsolBdUuHCmM_0 2024-03-09T14:47:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5441513915717106737', time=2024-03-09T16:44:53.637348+0000, chain.objs.size()=1 2024-03-09T14:47:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.LkwVV3pz9sAlRS6MTIhWAm306LKtwiV_0 2024-03-09T14:47:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5537756624592222952', time=2024-03-09T16:45:33.968111+0000, chain.objs.size()=1 2024-03-09T14:47:35.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.sLN2CeCw_FDc7NrwIccFymEOSR23qp4_0 2024-03-09T14:47:35.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16085426153106908761', time=2024-03-09T16:46:06.878736+0000, chain.objs.size()=1 2024-03-09T14:47:35.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.-8halDu9AoV-nSV98nqfaJzg_0tWhPk_0 2024-03-09T14:47:35.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4645238544032189736', time=2024-03-09T16:46:06.891110+0000, chain.objs.size()=1 2024-03-09T14:47:35.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.Vh3v1RMb97RZPeST89-8qStnxPN_3df_0 2024-03-09T14:47:35.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5773539776825944137', time=2024-03-09T16:46:09.094047+0000, chain.objs.size()=1 2024-03-09T14:47:35.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.080+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.hx6yVS9nIPNSVF-mSkQbYPOL_DyDb7W_0 2024-03-09T14:47:35.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.084+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:35.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.088+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:47:35.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-03-09T14:47:35.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='_c6rh76dHR8RitBxfARQh0GLrx_kHpYc', time=2024-03-09T16:42:31.974064+0000, chain.objs.size()=1 2024-03-09T14:47:35.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16__shadow_.052cmxGJ_5aun4ZdJu_N63j6vL_2aYr_0 2024-03-09T14:47:35.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16264664694984483120', time=2024-03-09T16:42:32.135432+0000, chain.objs.size()=3 2024-03-09T14:47:35.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-FROZEN.2~YGuMzAqEpEjqOYbyxSVmKI39QB9SADO.1 2024-03-09T14:47:35.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-FROZEN.2~YGuMzAqEpEjqOYbyxSVmKI39QB9SADO.2 2024-03-09T14:47:35.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-FROZEN.2~YGuMzAqEpEjqOYbyxSVmKI39QB9SADO.3 2024-03-09T14:47:35.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='_MMmm3_m4vPFdfWJj8ICqp3MqibYWvrk', time=2024-03-09T16:42:32.145549+0000, chain.objs.size()=2 2024-03-09T14:47:35.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.yznCBwSlUz1nYvXF-R7BqKBLjqaeRGk_0 2024-03-09T14:47:35.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.yznCBwSlUz1nYvXF-R7BqKBLjqaeRGk_1 2024-03-09T14:47:35.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1015650765751546338', time=2024-03-09T16:42:32.371419+0000, chain.objs.size()=2 2024-03-09T14:47:35.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14__shadow_.aj2FjCarhq4TxUFsWoNwl8LK_6mQ4Bh_0 2024-03-09T14:47:35.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14__shadow_.aj2FjCarhq4TxUFsWoNwl8LK_6mQ4Bh_1 2024-03-09T14:47:35.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4817913160579747225', time=2024-03-09T16:44:21.004524+0000, chain.objs.size()=1 2024-03-09T14:47:35.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.tDZ4HlQLj977RIxV_JA9kKK7QZ7SDgc_0 2024-03-09T14:47:35.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15952395908911970701', time=2024-03-09T16:44:53.642238+0000, chain.objs.size()=1 2024-03-09T14:47:35.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.uScLll1oBEDttrvu6wAqLjjcspOsRTW_0 2024-03-09T14:47:35.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5965138455131557942', time=2024-03-09T16:44:53.653786+0000, chain.objs.size()=1 2024-03-09T14:47:35.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.srdIMkAkRSqTSnlN2HQYReueLDugVn__0 2024-03-09T14:47:35.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17708764253252999739', time=2024-03-09T16:44:56.065915+0000, chain.objs.size()=1 2024-03-09T14:47:35.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.092+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.pb8bkdtryLQ2wkKAyQWCpE6BF1dB0qW_0 2024-03-09T14:47:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.096+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15585510596372644729', time=2024-03-09T16:45:29.401222+0000, chain.objs.size()=1 2024-03-09T14:47:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.096+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.NBYtGbekKz9q5T9vA7xFoHfdgwXJj_C_0 2024-03-09T14:47:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.096+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15490907701663536526', time=2024-03-09T16:45:33.991937+0000, chain.objs.size()=1 2024-03-09T14:47:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.096+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.3mO9gdYfz2bp1d-KTWSPCU-gFQXyYZG_0 2024-03-09T14:47:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.096+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2589081945364567457', time=2024-03-09T16:46:42.273842+0000, chain.objs.size()=1 2024-03-09T14:47:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.096+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.putptGvYJlbfREn39w5ToccrBNLUGSq_0 2024-03-09T14:47:35.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.096+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2904837683757846232', time=2024-03-09T16:46:42.275689+0000, chain.objs.size()=1 2024-03-09T14:47:35.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.096+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.nWaMQ-HbrID04zmymxQOXELjgioj60e_0 2024-03-09T14:47:35.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.096+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17509250345694737049', time=2024-03-09T16:46:44.190016+0000, chain.objs.size()=1 2024-03-09T14:47:35.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.100+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18__shadow_.StZiyCMAoWktVdWnKPlJmLALpRQbx30_0 2024-03-09T14:47:35.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.104+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:35.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.104+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:47:35.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-03-09T14:47:35.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18211660871331282399', time=2024-03-09T16:42:32.167642+0000, chain.objs.size()=3 2024-03-09T14:47:35.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-STANDARD.2~E70XJhn5n-V7ByeAc2hn6q-eOLkOFeV.1 2024-03-09T14:47:35.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-STANDARD.2~E70XJhn5n-V7ByeAc2hn6q-eOLkOFeV.2 2024-03-09T14:47:35.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-STANDARD.2~E70XJhn5n-V7ByeAc2hn6q-eOLkOFeV.3 2024-03-09T14:47:35.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7530222633345834096', time=2024-03-09T16:44:19.400556+0000, chain.objs.size()=1 2024-03-09T14:47:35.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.DhSL7DcylCShnLpU-fKT3jZ6ZiuPIZM_0 2024-03-09T14:47:35.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17221795057620468705', time=2024-03-09T16:44:53.631718+0000, chain.objs.size()=1 2024-03-09T14:47:35.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.22__shadow_.Ktq7mf5VvlZ8-j9eVvjV2cR0G_eRNmZ_0 2024-03-09T14:47:35.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1262303223091242638', time=2024-03-09T16:44:56.062817+0000, chain.objs.size()=1 2024-03-09T14:47:35.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.-S9p_ieZilOR-DmlgBR289p-zaS5AFU_0 2024-03-09T14:47:35.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8164995063800451576', time=2024-03-09T16:45:29.413676+0000, chain.objs.size()=1 2024-03-09T14:47:35.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.lkJW7r4jb-Vue_bBKBJsCOIOnJXSM-T_0 2024-03-09T14:47:35.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.609213537196603946', time=2024-03-09T16:46:42.257225+0000, chain.objs.size()=1 2024-03-09T14:47:35.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.l4_CPpTCALcqHiOdIH14h7WMKn2-5_G_0 2024-03-09T14:47:35.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14062314700849476240', time=2024-03-09T16:46:44.194550+0000, chain.objs.size()=1 2024-03-09T14:47:35.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18__shadow_.mtBd14ifDkZoOJPT6ffw48UCSnekhSn_0 2024-03-09T14:47:35.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2828425487992063045', time=2024-03-09T16:46:58.360549+0000, chain.objs.size()=1 2024-03-09T14:47:35.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.108+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19__shadow:-jCrdm9yBWGJdTVfWc1KL3bvQjDlQcC_.LORcN4x0-em7w4TdFnHgmJgWwq4l7Pa_0 2024-03-09T14:47:35.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.112+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:35.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.116+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:47:35.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.116+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-03-09T14:47:35.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8869842491346195366', time=2024-03-09T16:44:19.405214+0000, chain.objs.size()=1 2024-03-09T14:47:35.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.9egnv7Dij6BH7bPHZNOP_-CuDbAdUsm_0 2024-03-09T14:47:35.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13853416534141082384', time=2024-03-09T16:45:29.402993+0000, chain.objs.size()=1 2024-03-09T14:47:35.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.KBrKI7cPLLOXMSDm3BE-fwVpQLx3S4b_0 2024-03-09T14:47:35.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3851266282830715209', time=2024-03-09T16:45:31.257287+0000, chain.objs.size()=1 2024-03-09T14:47:35.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.sb8UHyTw39a1pkmCJmBY1hUM0D0mfho_0 2024-03-09T14:47:35.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9229937532007758269', time=2024-03-09T16:45:33.998401+0000, chain.objs.size()=1 2024-03-09T14:47:35.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.lCG9e1UO36qjrfd5VWdUehxH_Yi0xEn_0 2024-03-09T14:47:35.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.952571820474124529', time=2024-03-09T16:46:06.886298+0000, chain.objs.size()=1 2024-03-09T14:47:35.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.GG8JVcWEULwnf52GtPn0cO8wlpkRXUY_0 2024-03-09T14:47:35.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9689534442049619061', time=2024-03-09T16:46:06.895795+0000, chain.objs.size()=1 2024-03-09T14:47:35.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.tPMCRwQTYIB4pXa-Uez7VUGXTmW-EPn_0 2024-03-09T14:47:35.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.842110558343848174', time=2024-03-09T16:46:42.279998+0000, chain.objs.size()=1 2024-03-09T14:47:35.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.twwUg_T5E3p8XyBCGyd2gycY5hVYec6_0 2024-03-09T14:47:35.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15195451434643531007', time=2024-03-09T16:46:52.750505+0000, chain.objs.size()=1 2024-03-09T14:47:35.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.120+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19__shadow:-KavcK1LJMUsXkHxyf2fFfO21dNuZpK_.ugskKqE_3p5oNkdsULcE8vD0QJR9oms_0 2024-03-09T14:47:35.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.124+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:35.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.128+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:47:35.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.128+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.128+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.132+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T14:47:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.132+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13506226817995096102', time=2024-03-09T16:42:32.361659+0000, chain.objs.size()=2 2024-03-09T14:47:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.132+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14__shadow_.ScEt0p2NbbES_tFsyJgRxMOy3KifhcT_0 2024-03-09T14:47:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.132+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14__shadow_.ScEt0p2NbbES_tFsyJgRxMOy3KifhcT_1 2024-03-09T14:47:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.132+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7623548231292921570', time=2024-03-09T16:44:56.052733+0000, chain.objs.size()=1 2024-03-09T14:47:35.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.132+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.YQWBQoy6GC_gng9c0z1ZGdXQphB-7PF_0 2024-03-09T14:47:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.132+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18382383150119390433', time=2024-03-09T16:45:29.420905+0000, chain.objs.size()=1 2024-03-09T14:47:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.132+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.ypbFdNl2PDLvAohKz6RqtSY5J_xdmHZ_0 2024-03-09T14:47:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.132+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2686270772071810941', time=2024-03-09T16:46:42.263329+0000, chain.objs.size()=1 2024-03-09T14:47:35.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.132+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.2K5d06kduL_mQvnaWEt3o7SbqcEyWB0_0 2024-03-09T14:47:35.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.136+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:35.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.136+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:47:35.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-03-09T14:47:35.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='_D-Pr25k93dwxxxe9jzokvzzCr0A_QfW', time=2024-03-09T16:42:32.126065+0000, chain.objs.size()=2 2024-03-09T14:47:35.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.k7fFj-wCizJcryngNXa94z7qrsLvbNg_0 2024-03-09T14:47:35.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__shadow_.k7fFj-wCizJcryngNXa94z7qrsLvbNg_1 2024-03-09T14:47:35.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.508356846287915221', time=2024-03-09T16:44:19.394003+0000, chain.objs.size()=1 2024-03-09T14:47:35.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.Oqx5ncn93TlUF0xhDUyYPwmkEq7Pxhx_0 2024-03-09T14:47:35.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8219200157097959412', time=2024-03-09T16:44:20.985330+0000, chain.objs.size()=1 2024-03-09T14:47:35.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.GCvAPM1Bc-zMdIzokNm9ugavIkeccqL_0 2024-03-09T14:47:35.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14475437710352640081', time=2024-03-09T16:44:20.992801+0000, chain.objs.size()=1 2024-03-09T14:47:35.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.T4a7qFqX4xmgRn4rvZ-gR8wgWy7WUFI_0 2024-03-09T14:47:35.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3642874827444258933', time=2024-03-09T16:45:29.414411+0000, chain.objs.size()=1 2024-03-09T14:47:35.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.bXD1oIqQAfBC0Tz_j-3dfqJ1v2DgnFP_0 2024-03-09T14:47:35.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11522722062342335578', time=2024-03-09T16:45:31.925355+0000, chain.objs.size()=1 2024-03-09T14:47:35.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.Ef3hxc-OzCD4v_FCR1tZHek2dDECXzp_0 2024-03-09T14:47:35.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1486198081253989790', time=2024-03-09T16:45:33.966775+0000, chain.objs.size()=1 2024-03-09T14:47:35.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.ikbb43pcF85ZKnXWIx2JYLna8XB3WTI_0 2024-03-09T14:47:35.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12207319428205228736', time=2024-03-09T16:46:06.877714+0000, chain.objs.size()=1 2024-03-09T14:47:35.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.tKQP4-ld9_glmRneJhfyITWvU3Yq1Ik_0 2024-03-09T14:47:35.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17134898837657516292', time=2024-03-09T16:46:09.074394+0000, chain.objs.size()=1 2024-03-09T14:47:35.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.140+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.6HI0vzDpzpZ5PEsmWiv7XuPjcFDB6Ed_0 2024-03-09T14:47:35.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.144+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:35.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.148+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:47:35.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-03-09T14:47:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2490990294434329184', time=2024-03-09T16:44:19.395466+0000, chain.objs.size()=1 2024-03-09T14:47:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.mtfj1rxAJVM_CjtMGsianx_xPV0QK_p_0 2024-03-09T14:47:35.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5459987816282671128', time=2024-03-09T16:44:20.976762+0000, chain.objs.size()=1 2024-03-09T14:47:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.g0p2Mr5pcrmnscvFCc9Ul8YS5E57s5p_0 2024-03-09T14:47:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10280111519338851069', time=2024-03-09T16:45:31.931538+0000, chain.objs.size()=1 2024-03-09T14:47:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.BA8id1FW2Vo6p54xNjijzEW4E2_fiIn_0 2024-03-09T14:47:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4670058082949208100', time=2024-03-09T16:45:31.937193+0000, chain.objs.size()=1 2024-03-09T14:47:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.TXelzTaYqVMgFi71S6RVq_s7IUlTlK__0 2024-03-09T14:47:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13777196685695873500', time=2024-03-09T16:45:31.952881+0000, chain.objs.size()=1 2024-03-09T14:47:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.UICdRGHuEupYQv57K9Bh89OjTlJcG3k_0 2024-03-09T14:47:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10627909673903199928', time=2024-03-09T16:46:09.075998+0000, chain.objs.size()=1 2024-03-09T14:47:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.qJdAFDmO-5ueuXgCISSmwn75rrTLJXY_0 2024-03-09T14:47:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5870402789059442561', time=2024-03-09T16:46:09.083462+0000, chain.objs.size()=1 2024-03-09T14:47:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.PR8IfbamDFumQdR3bBOJnNRzwLImiRk_0 2024-03-09T14:47:35.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.857456128426811750', time=2024-03-09T16:46:42.258765+0000, chain.objs.size()=1 2024-03-09T14:47:35.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.152+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.29__shadow_.F178LIDJunNtzgmDgyGrJr_pzkYQ3-j_0 2024-03-09T14:47:35.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.160+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:35.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:47:35.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-03-09T14:47:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1313143874673826862', time=2024-03-09T16:42:31.633353+0000, chain.objs.size()=1 2024-03-09T14:47:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.On3SrxHAtKikFGqfYgPM2ppi4umTO9W_0 2024-03-09T14:47:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12219736868535372840', time=2024-03-09T16:42:31.650779+0000, chain.objs.size()=1 2024-03-09T14:47:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5__shadow_.IrWBPzKAy30FBDDTyfTstmABh-lBq8A_0 2024-03-09T14:47:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-FROZEN.2~YGuMzAqEpEjqOYbyxSVmKI39QB9SADO.2_299479feca2d8079602e341650dd5730', time=2024-03-09T16:42:32.228109+0000, chain.objs.size()=3 2024-03-09T14:47:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-FROZEN.2~YGuMzAqEpEjqOYbyxSVmKI39QB9SADO.1 2024-03-09T14:47:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-FROZEN.2~YGuMzAqEpEjqOYbyxSVmKI39QB9SADO.2 2024-03-09T14:47:35.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17__multipart_foo-FROZEN.2~YGuMzAqEpEjqOYbyxSVmKI39QB9SADO.3 2024-03-09T14:47:35.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9203501908804720736', time=2024-03-09T16:42:32.279985+0000, chain.objs.size()=3 2024-03-09T14:47:35.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-FROZEN.2~Aay9Lf6A2AvHb4BujpaPJwheBqNiQtd.1 2024-03-09T14:47:35.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-FROZEN.2~Aay9Lf6A2AvHb4BujpaPJwheBqNiQtd.2 2024-03-09T14:47:35.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15__multipart_foo-FROZEN.2~Aay9Lf6A2AvHb4BujpaPJwheBqNiQtd.3 2024-03-09T14:47:35.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2442905826538310434', time=2024-03-09T16:44:19.410852+0000, chain.objs.size()=1 2024-03-09T14:47:35.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.MJzoCJZE4f6wE7VfhRtbFBhdxvwhbS__0 2024-03-09T14:47:35.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1611584039885949422', time=2024-03-09T16:44:19.416587+0000, chain.objs.size()=1 2024-03-09T14:47:35.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.20__shadow_.ufG_XG-itcZNf6sLHQugMHQDlmYb5Lc_0 2024-03-09T14:47:35.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3600199812257145206', time=2024-03-09T16:44:20.996420+0000, chain.objs.size()=1 2024-03-09T14:47:35.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.CoFZ7F3ZPtLnPDTzoEDG5T1pAZein-2_0 2024-03-09T14:47:35.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3862592739243139958', time=2024-03-09T16:44:21.002663+0000, chain.objs.size()=1 2024-03-09T14:47:35.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.164+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.21__shadow_.9kTleQzF7eGKZeQhMIYRHtckc3xeOby_0 2024-03-09T14:47:35.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.168+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16042622354465129077', time=2024-03-09T16:45:29.398411+0000, chain.objs.size()=1 2024-03-09T14:47:35.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.168+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.WiCMFJ7SWtVgzpON8w2gMusSw2ESFPY_0 2024-03-09T14:47:35.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.168+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9565996094022517433', time=2024-03-09T16:45:29.416712+0000, chain.objs.size()=1 2024-03-09T14:47:35.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.168+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.rwO8cOnNS8viMb-mZWUoTeJ51nbHuaE_0 2024-03-09T14:47:35.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.168+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6783695743905548714', time=2024-03-09T16:45:29.427216+0000, chain.objs.size()=1 2024-03-09T14:47:35.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.168+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.3TBnUShiXlocr-w_L9RSHitFWekttss_0 2024-03-09T14:47:35.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.168+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14491409053477673269', time=2024-03-09T16:46:06.876140+0000, chain.objs.size()=1 2024-03-09T14:47:35.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.168+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.27__shadow_.s7Jz4LGKYb3pRA6zrhrPcQaU0uWQWmg_0 2024-03-09T14:47:35.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.172+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:35.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.176+0000 7f3187f75980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:47:35.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.176+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.176+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-03-09T14:47:35.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16190395723998415652', time=2024-03-09T16:42:32.618845+0000, chain.objs.size()=1 2024-03-09T14:47:35.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9__shadow_.zB4CT-6HFmvo21jhPbzPKcN7OWb4QH6_0 2024-03-09T14:47:35.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4254303715370793056', time=2024-03-09T16:44:56.044846+0000, chain.objs.size()=1 2024-03-09T14:47:35.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.1mMRccjjR_lNY_eghCOmXQvfCobEvHf_0 2024-03-09T14:47:35.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3342970236575642130', time=2024-03-09T16:44:56.046596+0000, chain.objs.size()=1 2024-03-09T14:47:35.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.u4lDq9I5E5F5Xezs-d5-cgNV2wYmt9k_0 2024-03-09T14:47:35.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10752688014461953222', time=2024-03-09T16:44:56.048740+0000, chain.objs.size()=1 2024-03-09T14:47:35.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.zYg-BJ5MU1znHNOH08ttX1oxRWnrISb_0 2024-03-09T14:47:35.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13074944314877689788', time=2024-03-09T16:44:56.056836+0000, chain.objs.size()=1 2024-03-09T14:47:35.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.23__shadow_.9ugzUOwFHTxFW9DDowkqFbVU3rwwIbd_0 2024-03-09T14:47:35.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17710071166193767791', time=2024-03-09T16:45:29.400758+0000, chain.objs.size()=1 2024-03-09T14:47:35.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.B4gqNGVL2_DAxA1hlIPmT7Kem1TVw5s_0 2024-03-09T14:47:35.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4895378990935354385', time=2024-03-09T16:45:29.414022+0000, chain.objs.size()=1 2024-03-09T14:47:35.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.24__shadow_.dllVflERNW2CWVyWO-xNKUQLZ-6tEbh_0 2024-03-09T14:47:35.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3305786113757129351', time=2024-03-09T16:45:31.930732+0000, chain.objs.size()=1 2024-03-09T14:47:35.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.25__shadow_.RwgeoVO8tGuVmHRHCVjjK0ceyH862uP_0 2024-03-09T14:47:35.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.895464706734287989', time=2024-03-09T16:45:33.976865+0000, chain.objs.size()=1 2024-03-09T14:47:35.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26__shadow_.qtiYAiw73cK4GlBd14R7b1gbX3ZaTJQ_0 2024-03-09T14:47:35.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.313734199579231848', time=2024-03-09T16:46:09.078437+0000, chain.objs.size()=1 2024-03-09T14:47:35.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.28__shadow_.Y9olHURTG2SIwkKYmU59KCMpTlB28kM_0 2024-03-09T14:47:35.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8952298876529844010', time=2024-03-09T16:46:58.358978+0000, chain.objs.size()=1 2024-03-09T14:47:35.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.180+0000 7f3187f75980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.19__shadow:GkcG5LBK-oBoMYqdnOVU0PMTNCcfXcv_.jG3KmiNMnAfzGvgqOHChgYeD07U7GC2_0 2024-03-09T14:47:35.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.184+0000 7f3187f75980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:47:35.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.188+0000 7f30377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:35.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.188+0000 7f3187f75980 20 remove_watcher() i=0 2024-03-09T14:47:35.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.188+0000 7f3187f75980 2 removed watcher, disabling cache 2024-03-09T14:47:35.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.192+0000 7f3187f75980 20 remove_watcher() i=1 2024-03-09T14:47:35.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.192+0000 7f3187f75980 20 remove_watcher() i=2 2024-03-09T14:47:35.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.192+0000 7f3187f75980 20 remove_watcher() i=3 2024-03-09T14:47:35.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.196+0000 7f3187f75980 20 remove_watcher() i=4 2024-03-09T14:47:35.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.196+0000 7f3187f75980 20 remove_watcher() i=5 2024-03-09T14:47:35.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.196+0000 7f3187f75980 20 remove_watcher() i=6 2024-03-09T14:47:35.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.196+0000 7f3187f75980 20 remove_watcher() i=7 2024-03-09T14:47:35.206 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-03-09T14:47:35.278 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:47:35.278 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:47:35.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.324+0000 7f6483487980 20 rados->read ofs=0 len=0 2024-03-09T14:47:35.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.328+0000 7f6483487980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:35.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.328+0000 7f6483487980 20 realm 2024-03-09T14:47:35.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.328+0000 7f6483487980 20 rados->read ofs=0 len=0 2024-03-09T14:47:35.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.328+0000 7f6483487980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:35.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.328+0000 7f6483487980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:47:35.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.328+0000 7f6483487980 20 rados->read ofs=0 len=0 2024-03-09T14:47:35.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.328+0000 7f6483487980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:35.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.328+0000 7f6483487980 20 rados->read ofs=0 len=0 2024-03-09T14:47:35.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.328+0000 7f6483487980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:35.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.328+0000 7f6483487980 20 rados->read ofs=0 len=0 2024-03-09T14:47:35.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.332+0000 7f6483487980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:47:35.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.332+0000 7f6483487980 20 searching for the correct realm 2024-03-09T14:47:35.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.336+0000 7f6480f9f640 0 -- 172.21.15.99:0/2319659283 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x5636e5ea4d80 msgr2=0x5636e5ea7240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:47:35.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.340+0000 7f648079e640 0 -- 172.21.15.99:0/2319659283 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f6470085770 msgr2=0x7f647005d220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:47:35.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.556+0000 7f6483487980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:47:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.556+0000 7f6483487980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:47:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.556+0000 7f6483487980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:47:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.556+0000 7f6483487980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:47:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.556+0000 7f6483487980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:47:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.556+0000 7f6483487980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:47:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.556+0000 7f6483487980 20 rados->read ofs=0 len=0 2024-03-09T14:47:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.556+0000 7f6483487980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:35.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.556+0000 7f6483487980 20 rados->read ofs=0 len=0 2024-03-09T14:47:35.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.560+0000 7f6483487980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:47:35.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.560+0000 7f6483487980 20 rados->read ofs=0 len=0 2024-03-09T14:47:35.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.560+0000 7f6483487980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:47:35.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.560+0000 7f6483487980 20 zone default found 2024-03-09T14:47:35.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.560+0000 7f6483487980 4 Realm: () 2024-03-09T14:47:35.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.560+0000 7f6483487980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:47:35.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.560+0000 7f6483487980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:47:35.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.560+0000 7f6483487980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:47:35.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.560+0000 7f6483487980 20 zonegroup default 2024-03-09T14:47:35.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.560+0000 7f6483487980 20 rados->read ofs=0 len=0 2024-03-09T14:47:35.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.560+0000 7f6483487980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:35.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.560+0000 7f6483487980 20 rados->read ofs=0 len=0 2024-03-09T14:47:35.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.560+0000 7f6483487980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:35.557 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.560+0000 7f6483487980 20 rados->read ofs=0 len=0 2024-03-09T14:47:35.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.564+0000 7f6483487980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:47:35.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.564+0000 7f6483487980 20 started sync module instance, tier type = 2024-03-09T14:47:35.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.564+0000 7f6483487980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:47:35.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.584+0000 7f6483487980 20 add_watcher() i=0 2024-03-09T14:47:35.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.584+0000 7f6483487980 20 add_watcher() i=1 2024-03-09T14:47:35.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.584+0000 7f6483487980 20 add_watcher() i=2 2024-03-09T14:47:35.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.584+0000 7f6483487980 20 add_watcher() i=3 2024-03-09T14:47:35.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.584+0000 7f6483487980 20 add_watcher() i=4 2024-03-09T14:47:35.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.584+0000 7f6483487980 20 add_watcher() i=5 2024-03-09T14:47:35.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.584+0000 7f6483487980 20 add_watcher() i=6 2024-03-09T14:47:35.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.588+0000 7f6483487980 20 add_watcher() i=7 2024-03-09T14:47:35.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.588+0000 7f6483487980 2 all 8 watchers are set, enabling cache 2024-03-09T14:47:35.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.592+0000 7f6336fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:35.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.592+0000 7f6483487980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:47:35.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.592+0000 7f6483487980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:47:35.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.680+0000 7f6335fe3640 20 reqs_thread_entry: start 2024-03-09T14:47:35.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.680+0000 7f6483487980 20 init_complete bucket index max shards: 11 2024-03-09T14:47:35.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.680+0000 7f6483487980 20 Filter name: none 2024-03-09T14:47:35.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.680+0000 7f62a77fe640 20 reqs_thread_entry: start 2024-03-09T14:47:35.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.680+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:47:35.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.684+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.684+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.684+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.688+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:47:35.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.692+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.692+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.696+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.696+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:47:35.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.700+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.704+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.704+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.708+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:47:35.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.708+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.708+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.708+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.712+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:47:35.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.716+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.716+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.716+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.720+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:47:35.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.720+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.720+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.724+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.724+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:47:35.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.724+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.728+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.728+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.728+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:47:35.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.732+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.732+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.732+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.736+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:47:35.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.740+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.744+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.744+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.748+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:47:35.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.748+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.748+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.748+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.752+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:47:35.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.756+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.756+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.756+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.760+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:47:35.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.764+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.764+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.764+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.768+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:47:35.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.772+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.772+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.776+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.776+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:47:35.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.780+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.784+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.784+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.788+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:47:35.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.788+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.788+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.792+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.792+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:47:35.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.796+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.796+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.796+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.800+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:47:35.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.800+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.800+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.804+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.804+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:47:35.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.808+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.808+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.808+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.812+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:47:35.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.812+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.812+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.816+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.816+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:47:35.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.820+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.820+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.824+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.824+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:47:35.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.828+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.832+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.832+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.836+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:47:35.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.840+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.840+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.840+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.844+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:47:35.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.848+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.848+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.848+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.852+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:47:35.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.852+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.856+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.856+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.856+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:47:35.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.860+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.860+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.864+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.864+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:47:35.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.868+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.868+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.868+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.872+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:47:35.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.876+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.876+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.876+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.876+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:47:35.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.880+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.880+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.880+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.884+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:47:35.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.888+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.888+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.892+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.892+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:47:35.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.896+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.896+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.900+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.900+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:47:35.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.904+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.908+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.908+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.908+0000 7f6483487980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:47:35.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.912+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.912+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:47:35.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.912+0000 7f6483487980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:47:35.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.916+0000 7f6336fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:47:35.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.924+0000 7f6483487980 20 remove_watcher() i=0 2024-03-09T14:47:35.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.924+0000 7f6483487980 2 removed watcher, disabling cache 2024-03-09T14:47:35.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.924+0000 7f6483487980 20 remove_watcher() i=1 2024-03-09T14:47:35.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.928+0000 7f6483487980 20 remove_watcher() i=2 2024-03-09T14:47:35.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.928+0000 7f6483487980 20 remove_watcher() i=3 2024-03-09T14:47:35.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.932+0000 7f6483487980 20 remove_watcher() i=4 2024-03-09T14:47:35.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.932+0000 7f6483487980 20 remove_watcher() i=5 2024-03-09T14:47:35.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.936+0000 7f6483487980 20 remove_watcher() i=6 2024-03-09T14:47:35.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:47:35.936+0000 7f6483487980 20 remove_watcher() i=7 2024-03-09T14:47:35.949 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-03-09T14:47:36.553 INFO:teuthology.orchestra.run.smithi099.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-03-09T14:47:41.254 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :clean UP-TO-DATE 2024-03-09T14:48:00.752 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :compileJava 2024-03-09T14:48:00.752 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :processResources 2024-03-09T14:48:00.752 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :classes 2024-03-09T14:48:01.652 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:01.652 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :compileTestJava 2024-03-09T14:48:01.652 INFO:teuthology.orchestra.run.smithi099.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-03-09T14:48:01.653 INFO:teuthology.orchestra.run.smithi099.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-03-09T14:48:01.653 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:01.653 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :processTestResources NO-SOURCE 2024-03-09T14:48:01.653 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :testClasses 2024-03-09T14:48:08.252 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:08.252 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :test 2024-03-09T14:48:08.252 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:08.352 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-03-09T14:48:09.252 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:09.252 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-03-09T14:48:09.452 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:09.452 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-03-09T14:48:09.552 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:09.552 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-03-09T14:48:09.851 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:09.852 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-03-09T14:48:10.551 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:10.551 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-03-09T14:48:10.852 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:10.852 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-03-09T14:48:10.852 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:10.852 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-03-09T14:48:10.951 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:10.952 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-03-09T14:48:11.051 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:11.052 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-03-09T14:48:11.351 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:11.352 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-03-09T14:48:11.856 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:11.856 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-03-09T14:48:12.352 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:12.352 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-03-09T14:48:12.652 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:12.652 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-03-09T14:48:12.652 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09 14:48:12,558 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-03-09T14:48:18.652 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:18.653 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-03-09T14:48:19.151 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:19.151 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-03-09T14:48:19.152 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:19.152 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-03-09T14:48:19.452 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:19.452 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-03-09T14:48:19.552 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:19.552 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-03-09T14:48:19.951 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:19.952 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-03-09T14:48:20.452 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:20.452 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-03-09T14:48:20.752 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:20.752 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-03-09T14:48:20.752 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:20.752 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-03-09T14:48:20.951 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:20.952 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-03-09T14:48:23.552 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:23.552 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-03-09T14:48:23.851 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:23.851 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-03-09T14:48:24.451 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:24.452 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-03-09T14:48:24.751 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:24.752 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-03-09T14:48:25.652 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:25.652 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-03-09T14:48:25.951 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:25.952 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-03-09T14:48:37.852 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:37.852 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-03-09T14:48:38.151 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:38.151 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-03-09T14:48:39.452 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:39.452 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-03-09T14:48:39.751 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:39.752 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-03-09T14:48:40.451 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:40.451 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-03-09T14:48:40.751 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:40.751 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-03-09T14:48:41.251 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:41.251 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-03-09T14:48:41.552 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:41.552 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-03-09T14:48:41.552 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:41.552 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-03-09T14:48:41.851 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:41.851 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-03-09T14:48:41.951 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:41.951 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-03-09T14:48:42.252 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:42.252 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-03-09T14:48:42.252 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:42.252 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-03-09T14:48:42.552 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:42.552 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-03-09T14:48:42.552 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:42.552 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-03-09T14:48:42.852 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:42.852 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-03-09T14:48:42.951 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:42.951 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-03-09T14:48:43.251 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:43.251 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-03-09T14:48:43.252 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:43.252 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-03-09T14:48:43.551 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:43.551 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-03-09T14:48:43.651 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:43.652 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-03-09T14:48:43.851 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:43.851 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-03-09T14:48:44.552 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:44.552 INFO:teuthology.orchestra.run.smithi099.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-03-09T14:48:44.947 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:44.947 INFO:teuthology.orchestra.run.smithi099.stdout:---------------------------------------------------------------------- 2024-03-09T14:48:44.947 INFO:teuthology.orchestra.run.smithi099.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-03-09T14:48:44.947 INFO:teuthology.orchestra.run.smithi099.stdout:---------------------------------------------------------------------- 2024-03-09T14:48:44.947 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:44.947 INFO:teuthology.orchestra.run.smithi099.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-03-09T14:48:44.947 INFO:teuthology.orchestra.run.smithi099.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-03-09T14:48:44.947 INFO:teuthology.orchestra.run.smithi099.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-03-09T14:48:44.947 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:44.947 INFO:teuthology.orchestra.run.smithi099.stdout:BUILD SUCCESSFUL in 1m 8s 2024-03-09T14:48:44.947 INFO:teuthology.orchestra.run.smithi099.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-03-09T14:48:45.271 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-03-09T14:48:45.302 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:48:45.302 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:48:45.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.351+0000 7fa2d84bd980 20 rados->read ofs=0 len=0 2024-03-09T14:48:45.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.351+0000 7fa2d84bd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:45.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.351+0000 7fa2d84bd980 20 realm 2024-03-09T14:48:45.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.351+0000 7fa2d84bd980 20 rados->read ofs=0 len=0 2024-03-09T14:48:45.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.351+0000 7fa2d84bd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:45.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.351+0000 7fa2d84bd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:48:45.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.351+0000 7fa2d84bd980 20 rados->read ofs=0 len=0 2024-03-09T14:48:45.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.351+0000 7fa2d84bd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:45.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.351+0000 7fa2d84bd980 20 rados->read ofs=0 len=0 2024-03-09T14:48:45.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.355+0000 7fa2d84bd980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:48:45.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.355+0000 7fa2d84bd980 20 rados->read ofs=0 len=0 2024-03-09T14:48:45.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.355+0000 7fa2d84bd980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:48:45.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.355+0000 7fa2d84bd980 20 searching for the correct realm 2024-03-09T14:48:45.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.359+0000 7fa2d57d4640 0 -- 172.21.15.99:0/550748691 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7fa2c80732c0 msgr2=0x7fa2c8053ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:48:45.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.367+0000 7fa2d57d4640 0 -- 172.21.15.99:0/550748691 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fa2d005e5a0 msgr2=0x7fa2d008c720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:48:45.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.583+0000 7fa2d84bd980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:48:45.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.583+0000 7fa2d84bd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:48:45.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.583+0000 7fa2d84bd980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:48:45.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.583+0000 7fa2d84bd980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:48:45.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.583+0000 7fa2d84bd980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:48:45.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.583+0000 7fa2d84bd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:48:45.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.583+0000 7fa2d84bd980 20 rados->read ofs=0 len=0 2024-03-09T14:48:45.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:45.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 20 rados->read ofs=0 len=0 2024-03-09T14:48:45.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:48:45.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 20 rados->read ofs=0 len=0 2024-03-09T14:48:45.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:48:45.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 20 zone default found 2024-03-09T14:48:45.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 4 Realm: () 2024-03-09T14:48:45.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:48:45.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:48:45.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:48:45.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 20 zonegroup default 2024-03-09T14:48:45.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 20 rados->read ofs=0 len=0 2024-03-09T14:48:45.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:45.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 20 rados->read ofs=0 len=0 2024-03-09T14:48:45.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:45.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 20 rados->read ofs=0 len=0 2024-03-09T14:48:45.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:45.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 20 started sync module instance, tier type = 2024-03-09T14:48:45.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.587+0000 7fa2d84bd980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:48:45.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.615+0000 7fa2d84bd980 20 add_watcher() i=0 2024-03-09T14:48:45.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.615+0000 7fa2d84bd980 20 add_watcher() i=1 2024-03-09T14:48:45.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.615+0000 7fa2d84bd980 20 add_watcher() i=2 2024-03-09T14:48:45.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.615+0000 7fa2d84bd980 20 add_watcher() i=3 2024-03-09T14:48:45.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.615+0000 7fa2d84bd980 20 add_watcher() i=4 2024-03-09T14:48:45.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.615+0000 7fa2d84bd980 20 add_watcher() i=5 2024-03-09T14:48:45.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.615+0000 7fa2d84bd980 20 add_watcher() i=6 2024-03-09T14:48:45.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.619+0000 7fa2d84bd980 20 add_watcher() i=7 2024-03-09T14:48:45.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.619+0000 7fa2d84bd980 2 all 8 watchers are set, enabling cache 2024-03-09T14:48:45.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.623+0000 7fa1877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:48:45.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.623+0000 7fa2d84bd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:48:45.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.623+0000 7fa2d84bd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:48:45.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.719+0000 7fa1867fc640 20 reqs_thread_entry: start 2024-03-09T14:48:45.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.719+0000 7fa2d84bd980 20 init_complete bucket index max shards: 11 2024-03-09T14:48:45.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.719+0000 7fa2d84bd980 20 Filter name: none 2024-03-09T14:48:45.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.719+0000 7fa0f7fff640 20 reqs_thread_entry: start 2024-03-09T14:48:45.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.719+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:48:45.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.723+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.723+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.723+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:48:45.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.723+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8051074277225194581', time=2024-03-09T16:48:42.973518+0000, chain.objs.size()=1 2024-03-09T14:48:45.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.723+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.53__shadow_.nQfTJM5wWeClANaeakQOaMkOChEOAxX_0 2024-03-09T14:48:45.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.727+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:45.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.731+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:48:45.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.735+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.735+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.735+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:48:45.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.735+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14548441945306836417', time=2024-03-09T16:48:32.207236+0000, chain.objs.size()=11 2024-03-09T14:48:45.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.735+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~qMG8b-MfnSj2KlgEv-KUrcZUTNQKEif.1 2024-03-09T14:48:45.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.735+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~qMG8b-MfnSj2KlgEv-KUrcZUTNQKEif.2 2024-03-09T14:48:45.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.735+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~qMG8b-MfnSj2KlgEv-KUrcZUTNQKEif.3 2024-03-09T14:48:45.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.735+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~qMG8b-MfnSj2KlgEv-KUrcZUTNQKEif.4 2024-03-09T14:48:45.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.735+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~qMG8b-MfnSj2KlgEv-KUrcZUTNQKEif.5 2024-03-09T14:48:45.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.735+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~qMG8b-MfnSj2KlgEv-KUrcZUTNQKEif.6 2024-03-09T14:48:45.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.735+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~qMG8b-MfnSj2KlgEv-KUrcZUTNQKEif.7 2024-03-09T14:48:45.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.735+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~qMG8b-MfnSj2KlgEv-KUrcZUTNQKEif.8 2024-03-09T14:48:45.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.735+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~qMG8b-MfnSj2KlgEv-KUrcZUTNQKEif.9 2024-03-09T14:48:45.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.735+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~qMG8b-MfnSj2KlgEv-KUrcZUTNQKEif.10 2024-03-09T14:48:45.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.739+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~qMG8b-MfnSj2KlgEv-KUrcZUTNQKEif.11 2024-03-09T14:48:45.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.751+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:45.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.759+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:48:45.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.763+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.763+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.763+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.763+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:48:45.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.767+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T14:48:45.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1439785710898289001', time=2024-03-09T16:48:20.524278+0000, chain.objs.size()=5 2024-03-09T14:48:45.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.41__multipart_key1.2~QOjOphHsTzr7Xnwfuf5zYKXgjo3wB1Q.1 2024-03-09T14:48:45.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.41__multipart_key1.2~QOjOphHsTzr7Xnwfuf5zYKXgjo3wB1Q.2 2024-03-09T14:48:45.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.41__multipart_key1.2~QOjOphHsTzr7Xnwfuf5zYKXgjo3wB1Q.3 2024-03-09T14:48:45.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.41__multipart_key1.2~QOjOphHsTzr7Xnwfuf5zYKXgjo3wB1Q.4 2024-03-09T14:48:45.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.41__multipart_key1.2~QOjOphHsTzr7Xnwfuf5zYKXgjo3wB1Q.5 2024-03-09T14:48:45.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14524121590722651062', time=2024-03-09T16:48:38.871971+0000, chain.objs.size()=1 2024-03-09T14:48:45.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.46__shadow_.q6p6Vg9gYH1VBsxSslf89wnwKWsQB-3_0 2024-03-09T14:48:45.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6083537647741788651', time=2024-03-09T16:48:40.547260+0000, chain.objs.size()=5 2024-03-09T14:48:45.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.47__multipart_key1.2~U9aawRjTQYC4AJ4g01GZ-JH7PqrsWEj.1 2024-03-09T14:48:45.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.47__multipart_key1.2~U9aawRjTQYC4AJ4g01GZ-JH7PqrsWEj.2 2024-03-09T14:48:45.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.47__multipart_key1.2~U9aawRjTQYC4AJ4g01GZ-JH7PqrsWEj.3 2024-03-09T14:48:45.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.47__multipart_key1.2~U9aawRjTQYC4AJ4g01GZ-JH7PqrsWEj.4 2024-03-09T14:48:45.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.47__multipart_key1.2~U9aawRjTQYC4AJ4g01GZ-JH7PqrsWEj.5 2024-03-09T14:48:45.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1922225939745180889', time=2024-03-09T16:48:44.600121+0000, chain.objs.size()=11 2024-03-09T14:48:45.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.771+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.56__multipart_key1.2~OOXiUwCNuGqk79AODvFFyW-I9mU_vJr.1 2024-03-09T14:48:45.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.783+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.56__multipart_key1.2~OOXiUwCNuGqk79AODvFFyW-I9mU_vJr.2 2024-03-09T14:48:45.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.783+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.56__multipart_key1.2~OOXiUwCNuGqk79AODvFFyW-I9mU_vJr.3 2024-03-09T14:48:45.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.783+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.56__multipart_key1.2~OOXiUwCNuGqk79AODvFFyW-I9mU_vJr.4 2024-03-09T14:48:45.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.783+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.56__multipart_key1.2~OOXiUwCNuGqk79AODvFFyW-I9mU_vJr.5 2024-03-09T14:48:45.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.783+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.56__multipart_key1.2~OOXiUwCNuGqk79AODvFFyW-I9mU_vJr.6 2024-03-09T14:48:45.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.787+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.56__multipart_key1.2~OOXiUwCNuGqk79AODvFFyW-I9mU_vJr.7 2024-03-09T14:48:45.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.787+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.56__multipart_key1.2~OOXiUwCNuGqk79AODvFFyW-I9mU_vJr.8 2024-03-09T14:48:45.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.787+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.56__multipart_key1.2~OOXiUwCNuGqk79AODvFFyW-I9mU_vJr.9 2024-03-09T14:48:45.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.787+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.56__multipart_key1.2~OOXiUwCNuGqk79AODvFFyW-I9mU_vJr.10 2024-03-09T14:48:45.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.787+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.56__multipart_key1.2~OOXiUwCNuGqk79AODvFFyW-I9mU_vJr.11 2024-03-09T14:48:45.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.799+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:45.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.807+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:48:45.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.807+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.811+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.811+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:48:45.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.811+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12496274674478486661', time=2024-03-09T16:48:23.626662+0000, chain.objs.size()=5 2024-03-09T14:48:45.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.811+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.42__multipart_key1.2~EY7xPXWYTEgyvD7DkEUeXvcjUz7mXW2.1 2024-03-09T14:48:45.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.811+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.42__multipart_key1.2~EY7xPXWYTEgyvD7DkEUeXvcjUz7mXW2.2 2024-03-09T14:48:45.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.811+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.42__multipart_key1.2~EY7xPXWYTEgyvD7DkEUeXvcjUz7mXW2.3 2024-03-09T14:48:45.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.811+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.42__multipart_key1.2~EY7xPXWYTEgyvD7DkEUeXvcjUz7mXW2.4 2024-03-09T14:48:45.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.811+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.42__multipart_key1.2~EY7xPXWYTEgyvD7DkEUeXvcjUz7mXW2.5 2024-03-09T14:48:45.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.819+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:45.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.819+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:48:45.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.823+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.823+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.823+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.823+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:48:45.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.827+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.827+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.831+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:48:45.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.831+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='2~XyXIFClmsgPxNVV8IB29CokJT9v454s', time=2024-03-09T16:48:41.393481+0000, chain.objs.size()=62 2024-03-09T14:48:45.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.831+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.1 2024-03-09T14:48:45.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.831+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.2 2024-03-09T14:48:45.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.831+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.3 2024-03-09T14:48:45.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.831+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.4 2024-03-09T14:48:45.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.831+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.5 2024-03-09T14:48:45.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.831+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.6 2024-03-09T14:48:45.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.831+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.7 2024-03-09T14:48:45.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.831+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.8 2024-03-09T14:48:45.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.831+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.9 2024-03-09T14:48:45.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.831+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.10 2024-03-09T14:48:45.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.831+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.11 2024-03-09T14:48:45.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.831+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.12 2024-03-09T14:48:45.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.835+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.13 2024-03-09T14:48:45.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.835+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.14 2024-03-09T14:48:45.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.835+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.15 2024-03-09T14:48:45.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.835+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.16 2024-03-09T14:48:45.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.839+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.17 2024-03-09T14:48:45.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.839+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.18 2024-03-09T14:48:45.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.839+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.19 2024-03-09T14:48:45.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.839+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.20 2024-03-09T14:48:45.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.839+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.21 2024-03-09T14:48:45.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.839+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.22 2024-03-09T14:48:45.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.843+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.23 2024-03-09T14:48:45.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.843+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.24 2024-03-09T14:48:45.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.851+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.25 2024-03-09T14:48:45.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.851+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.26 2024-03-09T14:48:45.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.851+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.27 2024-03-09T14:48:45.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.851+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.28 2024-03-09T14:48:45.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.851+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.29 2024-03-09T14:48:45.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.851+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.30 2024-03-09T14:48:45.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.851+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.31 2024-03-09T14:48:45.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.851+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.32 2024-03-09T14:48:45.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.851+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.33 2024-03-09T14:48:45.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.851+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.34 2024-03-09T14:48:45.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.851+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.35 2024-03-09T14:48:45.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.855+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.36 2024-03-09T14:48:45.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.859+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.37 2024-03-09T14:48:45.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.863+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.38 2024-03-09T14:48:45.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.863+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.39 2024-03-09T14:48:45.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.863+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.40 2024-03-09T14:48:45.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.863+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.41 2024-03-09T14:48:45.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.863+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.42 2024-03-09T14:48:45.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.863+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.43 2024-03-09T14:48:45.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.863+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.44 2024-03-09T14:48:45.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.863+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.45 2024-03-09T14:48:45.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.863+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.46 2024-03-09T14:48:45.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.863+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.47 2024-03-09T14:48:45.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.863+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.48 2024-03-09T14:48:45.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.871+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.49 2024-03-09T14:48:45.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.871+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.50 2024-03-09T14:48:45.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.871+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.51 2024-03-09T14:48:45.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.871+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.52 2024-03-09T14:48:45.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.871+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.53 2024-03-09T14:48:45.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.871+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.54 2024-03-09T14:48:45.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.871+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.55 2024-03-09T14:48:45.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.871+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.56 2024-03-09T14:48:45.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.871+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.57 2024-03-09T14:48:45.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.871+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.58 2024-03-09T14:48:45.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.871+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.59 2024-03-09T14:48:45.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.875+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.60 2024-03-09T14:48:45.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.875+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.61 2024-03-09T14:48:45.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.875+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.48__multipart_key1.2~XyXIFClmsgPxNVV8IB29CokJT9v454s.62 2024-03-09T14:48:45.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.875+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12965117213926218851', time=2024-03-09T16:48:41.656389+0000, chain.objs.size()=1 2024-03-09T14:48:45.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.875+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.49__shadow_.s4LlIYGH3oJoZP19HR77oxHw8PKG2uM_0 2024-03-09T14:48:45.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.883+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:45.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.883+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:48:45.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.887+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.887+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.887+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:48:45.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.887+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.34__multipart_key1.2~shc65QlcYNkue9aLmeQVB4-VdDtG1IX.2_80a825162638c31a1fe453fff2dd2533', time=2024-03-09T16:48:12.127771+0000, chain.objs.size()=5 2024-03-09T14:48:45.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.887+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.34__multipart_key1.2~shc65QlcYNkue9aLmeQVB4-VdDtG1IX.1 2024-03-09T14:48:45.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.887+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.34__multipart_key1.2~shc65QlcYNkue9aLmeQVB4-VdDtG1IX.2 2024-03-09T14:48:45.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.887+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.34__multipart_key1.2~shc65QlcYNkue9aLmeQVB4-VdDtG1IX.3 2024-03-09T14:48:45.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.887+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.34__multipart_key1.2~shc65QlcYNkue9aLmeQVB4-VdDtG1IX.4 2024-03-09T14:48:45.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.887+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.34__multipart_key1.2~shc65QlcYNkue9aLmeQVB4-VdDtG1IX.5 2024-03-09T14:48:45.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.887+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10950362033826986896', time=2024-03-09T16:48:37.725539+0000, chain.objs.size()=11 2024-03-09T14:48:45.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.887+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~iYPb0GhOTbHEtM2NvDccaRbqI3yJxay.1 2024-03-09T14:48:45.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.887+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__shadow_key1.2~iYPb0GhOTbHEtM2NvDccaRbqI3yJxay.1_1 2024-03-09T14:48:45.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.887+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~iYPb0GhOTbHEtM2NvDccaRbqI3yJxay.2 2024-03-09T14:48:45.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.887+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__shadow_key1.2~iYPb0GhOTbHEtM2NvDccaRbqI3yJxay.2_1 2024-03-09T14:48:45.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.887+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~iYPb0GhOTbHEtM2NvDccaRbqI3yJxay.3 2024-03-09T14:48:45.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.887+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__shadow_key1.2~iYPb0GhOTbHEtM2NvDccaRbqI3yJxay.3_1 2024-03-09T14:48:45.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.887+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~iYPb0GhOTbHEtM2NvDccaRbqI3yJxay.4 2024-03-09T14:48:45.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.891+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__shadow_key1.2~iYPb0GhOTbHEtM2NvDccaRbqI3yJxay.4_1 2024-03-09T14:48:45.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.891+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~iYPb0GhOTbHEtM2NvDccaRbqI3yJxay.5 2024-03-09T14:48:45.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.891+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__shadow_key1.2~iYPb0GhOTbHEtM2NvDccaRbqI3yJxay.5_1 2024-03-09T14:48:45.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.895+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~iYPb0GhOTbHEtM2NvDccaRbqI3yJxay.6 2024-03-09T14:48:45.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.895+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13752952021912637777', time=2024-03-09T16:48:41.997530+0000, chain.objs.size()=1 2024-03-09T14:48:45.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.895+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.50__shadow_.nZf5crBQBmZl7HQ_uRjC-de44RmzEe6_0 2024-03-09T14:48:45.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.899+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:45.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.903+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:48:45.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.903+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.903+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.903+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.907+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:48:45.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.907+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.907+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.907+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.907+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:48:45.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.911+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.911+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.911+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:48:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.911+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9723429828986694643', time=2024-03-09T16:48:18.761240+0000, chain.objs.size()=5 2024-03-09T14:48:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.911+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~xmGuazoSQU56eFevbpG_UtYBeuxXj0p.1 2024-03-09T14:48:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.911+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__shadow_key1.2~xmGuazoSQU56eFevbpG_UtYBeuxXj0p.1_1 2024-03-09T14:48:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.911+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~xmGuazoSQU56eFevbpG_UtYBeuxXj0p.2 2024-03-09T14:48:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.911+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__shadow_key1.2~xmGuazoSQU56eFevbpG_UtYBeuxXj0p.2_1 2024-03-09T14:48:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.911+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~xmGuazoSQU56eFevbpG_UtYBeuxXj0p.3 2024-03-09T14:48:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.911+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10675426338384410960', time=2024-03-09T16:48:36.453423+0000, chain.objs.size()=11 2024-03-09T14:48:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.911+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~4-HI6qfhdGkX1U15ZEtRyA3NSL4j9f9.1 2024-03-09T14:48:45.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.911+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__shadow_key1.2~4-HI6qfhdGkX1U15ZEtRyA3NSL4j9f9.1_1 2024-03-09T14:48:45.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.911+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~4-HI6qfhdGkX1U15ZEtRyA3NSL4j9f9.2 2024-03-09T14:48:45.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.911+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__shadow_key1.2~4-HI6qfhdGkX1U15ZEtRyA3NSL4j9f9.2_1 2024-03-09T14:48:45.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.911+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~4-HI6qfhdGkX1U15ZEtRyA3NSL4j9f9.3 2024-03-09T14:48:45.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.911+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__shadow_key1.2~4-HI6qfhdGkX1U15ZEtRyA3NSL4j9f9.3_1 2024-03-09T14:48:45.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.911+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~4-HI6qfhdGkX1U15ZEtRyA3NSL4j9f9.4 2024-03-09T14:48:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.915+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__shadow_key1.2~4-HI6qfhdGkX1U15ZEtRyA3NSL4j9f9.4_1 2024-03-09T14:48:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.915+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~4-HI6qfhdGkX1U15ZEtRyA3NSL4j9f9.5 2024-03-09T14:48:45.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.915+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__shadow_key1.2~4-HI6qfhdGkX1U15ZEtRyA3NSL4j9f9.5_1 2024-03-09T14:48:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.919+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~4-HI6qfhdGkX1U15ZEtRyA3NSL4j9f9.6 2024-03-09T14:48:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.919+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9169408745665925666', time=2024-03-09T16:48:37.892019+0000, chain.objs.size()=11 2024-03-09T14:48:45.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.919+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~zFN0ZRzyZd1n1a6jWRNL9HZVGLxA6BW.1 2024-03-09T14:48:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.919+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__shadow_key1.2~zFN0ZRzyZd1n1a6jWRNL9HZVGLxA6BW.1_1 2024-03-09T14:48:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.919+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~zFN0ZRzyZd1n1a6jWRNL9HZVGLxA6BW.2 2024-03-09T14:48:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.919+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__shadow_key1.2~zFN0ZRzyZd1n1a6jWRNL9HZVGLxA6BW.2_1 2024-03-09T14:48:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.919+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~zFN0ZRzyZd1n1a6jWRNL9HZVGLxA6BW.3 2024-03-09T14:48:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.919+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__shadow_key1.2~zFN0ZRzyZd1n1a6jWRNL9HZVGLxA6BW.3_1 2024-03-09T14:48:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.919+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~zFN0ZRzyZd1n1a6jWRNL9HZVGLxA6BW.4 2024-03-09T14:48:45.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.919+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__shadow_key1.2~zFN0ZRzyZd1n1a6jWRNL9HZVGLxA6BW.4_1 2024-03-09T14:48:45.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.923+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~zFN0ZRzyZd1n1a6jWRNL9HZVGLxA6BW.5 2024-03-09T14:48:45.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.923+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__shadow_key1.2~zFN0ZRzyZd1n1a6jWRNL9HZVGLxA6BW.5_1 2024-03-09T14:48:45.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.923+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~zFN0ZRzyZd1n1a6jWRNL9HZVGLxA6BW.6 2024-03-09T14:48:45.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.931+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:45.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.935+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:48:45.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.935+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.935+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.935+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:48:45.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.935+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5174063945141545168', time=2024-03-09T16:48:17.130692+0000, chain.objs.size()=5 2024-03-09T14:48:45.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.935+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~7dFlpbQAGCRoNwd-VagebCYtyUEawhO.1 2024-03-09T14:48:45.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.935+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~7dFlpbQAGCRoNwd-VagebCYtyUEawhO.2 2024-03-09T14:48:45.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.935+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~7dFlpbQAGCRoNwd-VagebCYtyUEawhO.3 2024-03-09T14:48:45.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.935+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~7dFlpbQAGCRoNwd-VagebCYtyUEawhO.4 2024-03-09T14:48:45.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.935+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~7dFlpbQAGCRoNwd-VagebCYtyUEawhO.5 2024-03-09T14:48:45.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.939+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:45.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.943+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:48:45.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.943+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.943+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.947+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.947+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:48:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.947+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.947+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.947+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:48:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.947+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1327630416658050937', time=2024-03-09T16:48:43.314704+0000, chain.objs.size()=1 2024-03-09T14:48:45.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.947+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.54__shadow_.iWoZUHB9ps7BN0Aw-aelGh8uopXXCPc_0 2024-03-09T14:48:45.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.951+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:45.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.951+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:48:45.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.955+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.955+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.955+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.955+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:48:45.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.959+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.959+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.959+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.959+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:48:45.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.963+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.963+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.963+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.963+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:48:45.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.963+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.967+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.967+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:48:45.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.967+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3161089038622950142', time=2024-03-09T16:48:16.397970+0000, chain.objs.size()=5 2024-03-09T14:48:45.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.967+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~k3GmHR0jGvIazYiAK81bxdMK5bU_v4w.1 2024-03-09T14:48:45.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.967+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~k3GmHR0jGvIazYiAK81bxdMK5bU_v4w.2 2024-03-09T14:48:45.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.967+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~k3GmHR0jGvIazYiAK81bxdMK5bU_v4w.3 2024-03-09T14:48:45.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.967+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~k3GmHR0jGvIazYiAK81bxdMK5bU_v4w.4 2024-03-09T14:48:45.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.967+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~k3GmHR0jGvIazYiAK81bxdMK5bU_v4w.5 2024-03-09T14:48:45.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.967+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17015671339090009894', time=2024-03-09T16:48:30.891963+0000, chain.objs.size()=11 2024-03-09T14:48:45.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.967+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~gDmZ0bmYyIv9OlXtvnU-QwieUIdvfzW.1 2024-03-09T14:48:45.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.967+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~gDmZ0bmYyIv9OlXtvnU-QwieUIdvfzW.2 2024-03-09T14:48:45.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.967+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~gDmZ0bmYyIv9OlXtvnU-QwieUIdvfzW.3 2024-03-09T14:48:45.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.967+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~gDmZ0bmYyIv9OlXtvnU-QwieUIdvfzW.4 2024-03-09T14:48:45.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.967+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~gDmZ0bmYyIv9OlXtvnU-QwieUIdvfzW.5 2024-03-09T14:48:45.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.967+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~gDmZ0bmYyIv9OlXtvnU-QwieUIdvfzW.6 2024-03-09T14:48:45.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.967+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~gDmZ0bmYyIv9OlXtvnU-QwieUIdvfzW.7 2024-03-09T14:48:45.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.971+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~gDmZ0bmYyIv9OlXtvnU-QwieUIdvfzW.8 2024-03-09T14:48:45.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.971+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~gDmZ0bmYyIv9OlXtvnU-QwieUIdvfzW.9 2024-03-09T14:48:45.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.971+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~gDmZ0bmYyIv9OlXtvnU-QwieUIdvfzW.10 2024-03-09T14:48:45.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.975+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~gDmZ0bmYyIv9OlXtvnU-QwieUIdvfzW.11 2024-03-09T14:48:45.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.979+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:45.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.979+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:48:45.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.983+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.983+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.983+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:48:45.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.983+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2050614604378224936', time=2024-03-09T16:48:24.554692+0000, chain.objs.size()=1 2024-03-09T14:48:45.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.983+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.43__shadow_.LqnE51YajIBmOzSyGWRPhptkOKmsNx8_0 2024-03-09T14:48:45.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.983+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:45.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.987+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:48:45.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.987+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.991+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.991+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:48:45.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.991+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6156809579364970508', time=2024-03-09T16:48:24.542464+0000, chain.objs.size()=1 2024-03-09T14:48:45.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.991+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.43__shadow_.kRKiGNeg7w-7jh4HtYCkzwKf6qVrQ2g_0 2024-03-09T14:48:45.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.991+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:45.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:48:45.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:45.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:45.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T14:48:45.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='2~6IYQErhlu-VXq5QzptHAR1zMs19IpmS', time=2024-03-09T16:48:09.152828+0000, chain.objs.size()=5 2024-03-09T14:48:45.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.30__multipart_key1.2~6IYQErhlu-VXq5QzptHAR1zMs19IpmS.1 2024-03-09T14:48:45.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.30__multipart_key1.2~6IYQErhlu-VXq5QzptHAR1zMs19IpmS.2 2024-03-09T14:48:45.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.30__multipart_key1.2~6IYQErhlu-VXq5QzptHAR1zMs19IpmS.3 2024-03-09T14:48:45.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.30__multipart_key1.2~6IYQErhlu-VXq5QzptHAR1zMs19IpmS.4 2024-03-09T14:48:45.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.30__multipart_key1.2~6IYQErhlu-VXq5QzptHAR1zMs19IpmS.5 2024-03-09T14:48:45.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16605354930141546608', time=2024-03-09T16:48:15.462452+0000, chain.objs.size()=5 2024-03-09T14:48:45.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~oHXkdO1MtEqWES2UPhdRfPva-hitwfk.1 2024-03-09T14:48:45.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~oHXkdO1MtEqWES2UPhdRfPva-hitwfk.2 2024-03-09T14:48:45.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~oHXkdO1MtEqWES2UPhdRfPva-hitwfk.3 2024-03-09T14:48:45.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~oHXkdO1MtEqWES2UPhdRfPva-hitwfk.4 2024-03-09T14:48:45.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~oHXkdO1MtEqWES2UPhdRfPva-hitwfk.5 2024-03-09T14:48:45.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16024366227625502510', time=2024-03-09T16:48:18.590386+0000, chain.objs.size()=5 2024-03-09T14:48:45.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~EsLKhX8VY6KzQYPrArpvg__EDTrdjNf.1 2024-03-09T14:48:45.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.995+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__shadow_key1.2~EsLKhX8VY6KzQYPrArpvg__EDTrdjNf.1_1 2024-03-09T14:48:45.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:45.999+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~EsLKhX8VY6KzQYPrArpvg__EDTrdjNf.2 2024-03-09T14:48:45.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.003+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__shadow_key1.2~EsLKhX8VY6KzQYPrArpvg__EDTrdjNf.2_1 2024-03-09T14:48:45.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.003+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~EsLKhX8VY6KzQYPrArpvg__EDTrdjNf.3 2024-03-09T14:48:45.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.003+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12665463987985642504', time=2024-03-09T16:48:39.562086+0000, chain.objs.size()=5 2024-03-09T14:48:45.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.003+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.46__multipart_key1.2~dDbZoYwzBOFH6ourlp6iae7aG6Kd-uq.1 2024-03-09T14:48:45.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.003+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.46__multipart_key1.2~dDbZoYwzBOFH6ourlp6iae7aG6Kd-uq.2 2024-03-09T14:48:46.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.003+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.46__multipart_key1.2~dDbZoYwzBOFH6ourlp6iae7aG6Kd-uq.3 2024-03-09T14:48:46.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.003+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.46__multipart_key1.2~dDbZoYwzBOFH6ourlp6iae7aG6Kd-uq.4 2024-03-09T14:48:46.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.003+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.46__multipart_key1.2~dDbZoYwzBOFH6ourlp6iae7aG6Kd-uq.5 2024-03-09T14:48:46.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.011+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:46.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.011+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:48:46.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.015+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.015+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.015+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:48:46.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.015+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.498982416247374242', time=2024-03-09T16:48:33.381253+0000, chain.objs.size()=10 2024-03-09T14:48:46.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.015+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~R0Kd8V9ZRl72PUWgjGUFqJ062eg_Ao6.1 2024-03-09T14:48:46.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.015+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~R0Kd8V9ZRl72PUWgjGUFqJ062eg_Ao6.2 2024-03-09T14:48:46.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.015+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~R0Kd8V9ZRl72PUWgjGUFqJ062eg_Ao6.3 2024-03-09T14:48:46.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.015+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~R0Kd8V9ZRl72PUWgjGUFqJ062eg_Ao6.4 2024-03-09T14:48:46.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.015+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~R0Kd8V9ZRl72PUWgjGUFqJ062eg_Ao6.5 2024-03-09T14:48:46.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.015+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~R0Kd8V9ZRl72PUWgjGUFqJ062eg_Ao6.6 2024-03-09T14:48:46.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.015+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~R0Kd8V9ZRl72PUWgjGUFqJ062eg_Ao6.7 2024-03-09T14:48:46.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.015+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~R0Kd8V9ZRl72PUWgjGUFqJ062eg_Ao6.8 2024-03-09T14:48:46.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.015+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~R0Kd8V9ZRl72PUWgjGUFqJ062eg_Ao6.9 2024-03-09T14:48:46.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.015+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.45__multipart_key1.2~R0Kd8V9ZRl72PUWgjGUFqJ062eg_Ao6.10 2024-03-09T14:48:46.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.023+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:46.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.023+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:48:46.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.027+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.027+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.027+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.027+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:48:46.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.031+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.031+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.031+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:48:46.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.031+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18333400741416390210', time=2024-03-09T16:48:17.867414+0000, chain.objs.size()=5 2024-03-09T14:48:46.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.031+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~vsTmXGa8oAioUwgKf-ldDg0RU9TqFaM.1 2024-03-09T14:48:46.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.031+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__shadow_key1.2~vsTmXGa8oAioUwgKf-ldDg0RU9TqFaM.1_1 2024-03-09T14:48:46.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.031+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~vsTmXGa8oAioUwgKf-ldDg0RU9TqFaM.2 2024-03-09T14:48:46.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.031+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__shadow_key1.2~vsTmXGa8oAioUwgKf-ldDg0RU9TqFaM.2_1 2024-03-09T14:48:46.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.031+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.37__multipart_key1.2~vsTmXGa8oAioUwgKf-ldDg0RU9TqFaM.3 2024-03-09T14:48:46.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.031+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14934484944031016928', time=2024-03-09T16:48:18.954760+0000, chain.objs.size()=4 2024-03-09T14:48:46.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.031+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.36__shadow_.AyfU8b1ixJ_bOWtA3zWxadXnMGkjQxM_0 2024-03-09T14:48:46.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.031+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.36__shadow_.AyfU8b1ixJ_bOWtA3zWxadXnMGkjQxM_1 2024-03-09T14:48:46.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.031+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.36__shadow_.AyfU8b1ixJ_bOWtA3zWxadXnMGkjQxM_2 2024-03-09T14:48:46.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.031+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.36__shadow_.AyfU8b1ixJ_bOWtA3zWxadXnMGkjQxM_3 2024-03-09T14:48:46.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.035+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:46.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.039+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:48:46.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.043+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.043+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.043+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:48:46.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.043+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18093864952400841609', time=2024-03-09T16:48:11.926408+0000, chain.objs.size()=5 2024-03-09T14:48:46.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.043+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.34__multipart_key1.2~shc65QlcYNkue9aLmeQVB4-VdDtG1IX.1 2024-03-09T14:48:46.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.043+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.34__multipart_key1.2~shc65QlcYNkue9aLmeQVB4-VdDtG1IX.2 2024-03-09T14:48:46.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.043+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.34__multipart_key1.2~shc65QlcYNkue9aLmeQVB4-VdDtG1IX.3 2024-03-09T14:48:46.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.043+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.34__multipart_key1.2~shc65QlcYNkue9aLmeQVB4-VdDtG1IX.4 2024-03-09T14:48:46.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.043+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.34__multipart_key1.2~shc65QlcYNkue9aLmeQVB4-VdDtG1IX.5 2024-03-09T14:48:46.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.043+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9768856112231820121', time=2024-03-09T16:48:42.326891+0000, chain.objs.size()=1 2024-03-09T14:48:46.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.043+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.51__shadow_.Mwebk8vSFQsRvN70ibD5FXey4k1Wc0y_0 2024-03-09T14:48:46.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.043+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:46.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.047+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:48:46.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.047+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.047+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.051+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:48:46.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.051+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9624968481558437902', time=2024-03-09T16:48:24.494615+0000, chain.objs.size()=5 2024-03-09T14:48:46.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.051+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.43__multipart_file.mpg.2~VmblXOew9rQ0vYudFdCrq4bH1z4iqgC.1 2024-03-09T14:48:46.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.051+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.43__multipart_file.mpg.2~VmblXOew9rQ0vYudFdCrq4bH1z4iqgC.2 2024-03-09T14:48:46.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.051+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.43__multipart_file.mpg.2~VmblXOew9rQ0vYudFdCrq4bH1z4iqgC.3 2024-03-09T14:48:46.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.051+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.43__multipart_file.mpg.2~VmblXOew9rQ0vYudFdCrq4bH1z4iqgC.4 2024-03-09T14:48:46.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.051+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.43__multipart_file.mpg.2~VmblXOew9rQ0vYudFdCrq4bH1z4iqgC.5 2024-03-09T14:48:46.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.055+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:46.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.055+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:48:46.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.059+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.059+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.059+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:48:46.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.059+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4977312236418616805', time=2024-03-09T16:48:10.645706+0000, chain.objs.size()=5 2024-03-09T14:48:46.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.059+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.32__multipart_key1.2~jAGrEn45ANr_Ekt3UgvBlrbwS3Tzuyf.1 2024-03-09T14:48:46.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.059+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.32__multipart_key1.2~jAGrEn45ANr_Ekt3UgvBlrbwS3Tzuyf.2 2024-03-09T14:48:46.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.059+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.32__multipart_key1.2~jAGrEn45ANr_Ekt3UgvBlrbwS3Tzuyf.3 2024-03-09T14:48:46.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.059+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.32__multipart_key1.2~jAGrEn45ANr_Ekt3UgvBlrbwS3Tzuyf.4 2024-03-09T14:48:46.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.059+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.32__multipart_key1.2~jAGrEn45ANr_Ekt3UgvBlrbwS3Tzuyf.5 2024-03-09T14:48:46.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.059+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5219381070938644656', time=2024-03-09T16:48:42.648348+0000, chain.objs.size()=1 2024-03-09T14:48:46.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.059+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.52__shadow_.BK3VsOqLDlj3JaB6Tpe9TNf7Na1q258_0 2024-03-09T14:48:46.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.063+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:46.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.067+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:48:46.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.067+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.071+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.071+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:48:46.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.071+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3616671673312775910', time=2024-03-09T16:48:24.525138+0000, chain.objs.size()=5 2024-03-09T14:48:46.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.071+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.43__multipart_file2.mpg.2~2qJ8RkPk0jW2ohngTVQ37pq1Q31FUkF.1 2024-03-09T14:48:46.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.071+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.43__multipart_file2.mpg.2~2qJ8RkPk0jW2ohngTVQ37pq1Q31FUkF.2 2024-03-09T14:48:46.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.071+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.43__multipart_file2.mpg.2~2qJ8RkPk0jW2ohngTVQ37pq1Q31FUkF.3 2024-03-09T14:48:46.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.071+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.43__multipart_file2.mpg.2~2qJ8RkPk0jW2ohngTVQ37pq1Q31FUkF.4 2024-03-09T14:48:46.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.071+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.43__multipart_file2.mpg.2~2qJ8RkPk0jW2ohngTVQ37pq1Q31FUkF.5 2024-03-09T14:48:46.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.075+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:46.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.079+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:48:46.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.079+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.079+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.079+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:48:46.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.079+0000 7fa2d84bd980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5865854909237313844', time=2024-03-09T16:48:24.511098+0000, chain.objs.size()=1 2024-03-09T14:48:46.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.079+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.43__shadow_.iwQ6KEliFd_80083dQaIKlHOkpmpuv0_0 2024-03-09T14:48:46.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.083+0000 7fa2d84bd980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:46.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.083+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:48:46.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.087+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.087+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.087+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.087+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:48:46.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.087+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.091+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.091+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.091+0000 7fa2d84bd980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:48:46.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.091+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.091+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.095+0000 7fa2d84bd980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.095+0000 7fa1877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:48:46.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.099+0000 7fa2d84bd980 20 remove_watcher() i=0 2024-03-09T14:48:46.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.099+0000 7fa2d84bd980 2 removed watcher, disabling cache 2024-03-09T14:48:46.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.099+0000 7fa2d84bd980 20 remove_watcher() i=1 2024-03-09T14:48:46.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.099+0000 7fa2d84bd980 20 remove_watcher() i=2 2024-03-09T14:48:46.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.103+0000 7fa2d84bd980 20 remove_watcher() i=3 2024-03-09T14:48:46.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.103+0000 7fa2d84bd980 20 remove_watcher() i=4 2024-03-09T14:48:46.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.103+0000 7fa2d84bd980 20 remove_watcher() i=5 2024-03-09T14:48:46.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.107+0000 7fa2d84bd980 20 remove_watcher() i=6 2024-03-09T14:48:46.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.107+0000 7fa2d84bd980 20 remove_watcher() i=7 2024-03-09T14:48:46.116 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-03-09T14:48:46.182 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:48:46.182 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:48:46.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.231+0000 7f3a315a7980 20 rados->read ofs=0 len=0 2024-03-09T14:48:46.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.231+0000 7f3a315a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:46.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.231+0000 7f3a315a7980 20 realm 2024-03-09T14:48:46.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.231+0000 7f3a315a7980 20 rados->read ofs=0 len=0 2024-03-09T14:48:46.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.231+0000 7f3a315a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:46.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.231+0000 7f3a315a7980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:48:46.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.231+0000 7f3a315a7980 20 rados->read ofs=0 len=0 2024-03-09T14:48:46.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.235+0000 7f3a315a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:46.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.235+0000 7f3a315a7980 20 rados->read ofs=0 len=0 2024-03-09T14:48:46.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.235+0000 7f3a315a7980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:48:46.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.235+0000 7f3a315a7980 20 rados->read ofs=0 len=0 2024-03-09T14:48:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.235+0000 7f3a315a7980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:48:46.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.235+0000 7f3a315a7980 20 searching for the correct realm 2024-03-09T14:48:46.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.239+0000 7f3a2e8be640 0 -- 172.21.15.99:0/3391844666 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f3a200c5040 msgr2=0x7f3a200fc5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:48:46.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.455+0000 7f3a2f8c0640 0 -- 172.21.15.99:0/3391844666 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f3a18008050 msgr2=0x7f3a18083040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:48:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.471+0000 7f3a315a7980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:48:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.471+0000 7f3a315a7980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:48:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.471+0000 7f3a315a7980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:48:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.471+0000 7f3a315a7980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:48:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.471+0000 7f3a315a7980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:48:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.471+0000 7f3a315a7980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:48:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.471+0000 7f3a315a7980 20 rados->read ofs=0 len=0 2024-03-09T14:48:46.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.471+0000 7f3a315a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.471+0000 7f3a315a7980 20 rados->read ofs=0 len=0 2024-03-09T14:48:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.471+0000 7f3a315a7980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:48:46.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.475+0000 7f3a315a7980 20 rados->read ofs=0 len=0 2024-03-09T14:48:46.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.475+0000 7f3a315a7980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:48:46.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.475+0000 7f3a315a7980 20 zone default found 2024-03-09T14:48:46.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.475+0000 7f3a315a7980 4 Realm: () 2024-03-09T14:48:46.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.475+0000 7f3a315a7980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:48:46.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.475+0000 7f3a315a7980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:48:46.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.475+0000 7f3a315a7980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:48:46.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.475+0000 7f3a315a7980 20 zonegroup default 2024-03-09T14:48:46.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.475+0000 7f3a315a7980 20 rados->read ofs=0 len=0 2024-03-09T14:48:46.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.475+0000 7f3a315a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:46.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.475+0000 7f3a315a7980 20 rados->read ofs=0 len=0 2024-03-09T14:48:46.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.475+0000 7f3a315a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:46.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.475+0000 7f3a315a7980 20 rados->read ofs=0 len=0 2024-03-09T14:48:46.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.475+0000 7f3a315a7980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:46.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.475+0000 7f3a315a7980 20 started sync module instance, tier type = 2024-03-09T14:48:46.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.475+0000 7f3a315a7980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:48:46.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.499+0000 7f3a315a7980 20 add_watcher() i=0 2024-03-09T14:48:46.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.499+0000 7f3a315a7980 20 add_watcher() i=1 2024-03-09T14:48:46.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.499+0000 7f3a315a7980 20 add_watcher() i=2 2024-03-09T14:48:46.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.499+0000 7f3a315a7980 20 add_watcher() i=3 2024-03-09T14:48:46.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.499+0000 7f3a315a7980 20 add_watcher() i=4 2024-03-09T14:48:46.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.499+0000 7f3a315a7980 20 add_watcher() i=5 2024-03-09T14:48:46.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.499+0000 7f3a315a7980 20 add_watcher() i=6 2024-03-09T14:48:46.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.503+0000 7f3a315a7980 20 add_watcher() i=7 2024-03-09T14:48:46.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.503+0000 7f3a315a7980 2 all 8 watchers are set, enabling cache 2024-03-09T14:48:46.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.507+0000 7f38e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:48:46.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.507+0000 7f3a315a7980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:48:46.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.507+0000 7f3a315a7980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:48:46.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.599+0000 7f38e57e2640 20 reqs_thread_entry: start 2024-03-09T14:48:46.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.599+0000 7f3a315a7980 20 init_complete bucket index max shards: 11 2024-03-09T14:48:46.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.599+0000 7f3a315a7980 20 Filter name: none 2024-03-09T14:48:46.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.599+0000 7f38de7fc640 20 reqs_thread_entry: start 2024-03-09T14:48:46.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.599+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:48:46.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.603+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.603+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.603+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.607+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:48:46.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.607+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.611+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.611+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.615+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:48:46.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.615+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.615+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.615+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.619+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:48:46.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.623+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.623+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.623+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.623+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:48:46.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.627+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.627+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.627+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.631+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:48:46.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.635+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.635+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.635+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.639+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:48:46.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.643+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.643+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.643+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.647+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:48:46.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.647+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.651+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.651+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.655+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:48:46.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.655+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.655+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.655+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.659+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:48:46.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.663+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.663+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.667+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.667+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:48:46.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.671+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.675+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.675+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.679+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:48:46.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.683+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.683+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.683+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.687+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:48:46.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.687+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.691+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.691+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.695+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:48:46.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.699+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.699+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.699+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.703+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:48:46.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.707+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.707+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.707+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.711+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:48:46.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.715+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.715+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.715+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.719+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:48:46.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.723+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.727+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.727+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.731+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:48:46.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.735+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.735+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.735+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.739+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:48:46.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.743+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.743+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.743+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.747+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:48:46.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.751+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.755+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.755+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.759+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:48:46.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.763+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.763+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.763+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.767+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:48:46.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.771+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.775+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.775+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.779+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:48:46.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.779+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.783+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.783+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.787+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:48:46.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.791+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.791+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.791+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.795+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:48:46.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.799+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.799+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.799+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.803+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:48:46.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.807+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.807+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.811+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.811+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:48:46.812 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.815+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.815+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.819+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.819+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:48:46.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.823+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.827+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.827+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.831+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:48:46.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.831+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.835+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.835+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.839+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:48:46.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.843+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.843+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.843+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.847+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:48:46.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.851+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.851+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.851+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.855+0000 7f3a315a7980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:48:46.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.859+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.859+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:46.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.859+0000 7f3a315a7980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:46.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.867+0000 7f38e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:48:46.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.871+0000 7f3a315a7980 20 remove_watcher() i=0 2024-03-09T14:48:46.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.871+0000 7f3a315a7980 2 removed watcher, disabling cache 2024-03-09T14:48:46.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.875+0000 7f3a315a7980 20 remove_watcher() i=1 2024-03-09T14:48:46.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.875+0000 7f3a315a7980 20 remove_watcher() i=2 2024-03-09T14:48:46.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.879+0000 7f3a315a7980 20 remove_watcher() i=3 2024-03-09T14:48:46.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.879+0000 7f3a315a7980 20 remove_watcher() i=4 2024-03-09T14:48:46.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.883+0000 7f3a315a7980 20 remove_watcher() i=5 2024-03-09T14:48:46.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.883+0000 7f3a315a7980 20 remove_watcher() i=6 2024-03-09T14:48:46.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:46.887+0000 7f3a315a7980 20 remove_watcher() i=7 2024-03-09T14:48:46.901 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-03-09T14:48:46.972 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:48:46.972 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:48:47.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.023+0000 7f33d7e67980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.023+0000 7f33d7e67980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:47.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.023+0000 7f33d7e67980 20 realm 2024-03-09T14:48:47.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.023+0000 7f33d7e67980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.023+0000 7f33d7e67980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:47.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.023+0000 7f33d7e67980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:48:47.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.023+0000 7f33d7e67980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.023+0000 7f33d7e67980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:47.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.023+0000 7f33d7e67980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.027+0000 7f33d7e67980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:48:47.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.027+0000 7f33d7e67980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.027+0000 7f33d7e67980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:48:47.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.027+0000 7f33d7e67980 20 searching for the correct realm 2024-03-09T14:48:47.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.035+0000 7f33d597f640 0 -- 172.21.15.99:0/462813412 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x557e2884a7d0 msgr2=0x557e2884cc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:48:47.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.039+0000 7f33d517e640 0 -- 172.21.15.99:0/462813412 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f33c81256d0 msgr2=0x7f33c81142b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:48:47.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:48:47.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:48:47.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:48:47.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:48:47.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:48:47.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:48:47.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:47.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:48:47.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:48:47.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 20 zone default found 2024-03-09T14:48:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 4 Realm: () 2024-03-09T14:48:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:48:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:48:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:48:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 20 zonegroup default 2024-03-09T14:48:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.047+0000 7f33d7e67980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.051+0000 7f33d7e67980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:47.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.051+0000 7f33d7e67980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.051+0000 7f33d7e67980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:47.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.051+0000 7f33d7e67980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.051+0000 7f33d7e67980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:47.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.051+0000 7f33d7e67980 20 started sync module instance, tier type = 2024-03-09T14:48:47.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.051+0000 7f33d7e67980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:48:47.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.067+0000 7f33d7e67980 20 add_watcher() i=0 2024-03-09T14:48:47.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.067+0000 7f33d7e67980 20 add_watcher() i=1 2024-03-09T14:48:47.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.067+0000 7f33d7e67980 20 add_watcher() i=2 2024-03-09T14:48:47.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.067+0000 7f33d7e67980 20 add_watcher() i=3 2024-03-09T14:48:47.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.067+0000 7f33d7e67980 20 add_watcher() i=4 2024-03-09T14:48:47.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.067+0000 7f33d7e67980 20 add_watcher() i=5 2024-03-09T14:48:47.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.067+0000 7f33d7e67980 20 add_watcher() i=6 2024-03-09T14:48:47.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.067+0000 7f33d7e67980 20 add_watcher() i=7 2024-03-09T14:48:47.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.067+0000 7f33d7e67980 2 all 8 watchers are set, enabling cache 2024-03-09T14:48:47.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.071+0000 7f32877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:48:47.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.071+0000 7f33d7e67980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:48:47.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.071+0000 7f33d7e67980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:48:47.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.147+0000 7f32867fc640 20 reqs_thread_entry: start 2024-03-09T14:48:47.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.147+0000 7f33d7e67980 20 init_complete bucket index max shards: 11 2024-03-09T14:48:47.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.147+0000 7f33d7e67980 20 Filter name: none 2024-03-09T14:48:47.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.147+0000 7f31f7fff640 20 reqs_thread_entry: start 2024-03-09T14:48:47.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.147+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:48:47.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.151+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.151+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.151+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.155+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:48:47.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.155+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.159+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.159+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.159+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:48:47.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.163+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.167+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.167+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.167+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:48:47.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.171+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.171+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.171+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.175+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:48:47.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.175+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.179+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.179+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.179+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:48:47.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.183+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.183+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.187+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.187+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:48:47.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.191+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.191+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.191+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.195+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:48:47.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.199+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.199+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.199+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.203+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:48:47.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.203+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.207+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.207+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.211+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:48:47.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.215+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.215+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.215+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.215+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:48:47.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.219+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.219+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.223+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.223+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:48:47.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.227+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.227+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.227+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.231+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:48:47.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.231+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.231+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.231+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.235+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:48:47.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.239+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.239+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.239+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.243+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:48:47.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.247+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.247+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.247+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.251+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:48:47.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.251+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.255+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.255+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.255+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:48:47.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.259+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.259+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.259+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.263+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:48:47.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.267+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.267+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.271+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.271+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:48:47.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.275+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.279+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.279+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.283+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:48:47.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.283+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.287+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.287+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.291+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:48:47.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.295+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.295+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.295+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.299+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:48:47.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.303+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.303+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.303+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.307+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:48:47.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.311+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.311+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.311+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.315+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:48:47.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.319+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.319+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.323+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.323+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:48:47.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.327+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.327+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.331+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.331+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:48:47.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.335+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.339+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.339+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.343+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:48:47.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.347+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.347+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.347+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.351+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:48:47.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.355+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.355+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.355+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.359+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:48:47.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.359+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.363+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.363+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.367+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:48:47.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.371+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.371+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.371+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.375+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:48:47.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.379+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.379+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.379+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.383+0000 7f33d7e67980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:48:47.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.387+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.387+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.387+0000 7f33d7e67980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.391+0000 7f32877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:48:47.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.399+0000 7f33d7e67980 20 remove_watcher() i=0 2024-03-09T14:48:47.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.399+0000 7f33d7e67980 2 removed watcher, disabling cache 2024-03-09T14:48:47.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.399+0000 7f33d7e67980 20 remove_watcher() i=1 2024-03-09T14:48:47.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.403+0000 7f33d7e67980 20 remove_watcher() i=2 2024-03-09T14:48:47.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.407+0000 7f33d7e67980 20 remove_watcher() i=3 2024-03-09T14:48:47.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.411+0000 7f33d7e67980 20 remove_watcher() i=4 2024-03-09T14:48:47.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.411+0000 7f33d7e67980 20 remove_watcher() i=5 2024-03-09T14:48:47.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.415+0000 7f33d7e67980 20 remove_watcher() i=6 2024-03-09T14:48:47.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.415+0000 7f33d7e67980 20 remove_watcher() i=7 2024-03-09T14:48:47.432 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-03-09T14:48:47.505 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:48:47.506 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:48:47.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.551+0000 7f7f58403980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.555+0000 7f7f58403980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:47.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.555+0000 7f7f58403980 20 realm 2024-03-09T14:48:47.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.555+0000 7f7f58403980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.555+0000 7f7f58403980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:47.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.555+0000 7f7f58403980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:48:47.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.555+0000 7f7f58403980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.555+0000 7f7f58403980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:47.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.555+0000 7f7f58403980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.559+0000 7f7f58403980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:48:47.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.559+0000 7f7f58403980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.559+0000 7f7f58403980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:48:47.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.559+0000 7f7f58403980 20 searching for the correct realm 2024-03-09T14:48:47.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.563+0000 7f7f5671c640 0 -- 172.21.15.99:0/3689508752 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x5650dca44790 msgr2=0x5650dca46b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:48:47.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.571+0000 7f7f5571a640 0 -- 172.21.15.99:0/3689508752 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f7f50004040 msgr2=0x7f7f500cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:48:47.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.787+0000 7f7f58403980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:48:47.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.787+0000 7f7f58403980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:48:47.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.787+0000 7f7f58403980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:48:47.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.787+0000 7f7f58403980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:48:47.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.787+0000 7f7f58403980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:48:47.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.787+0000 7f7f58403980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:48:47.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.787+0000 7f7f58403980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.787+0000 7f7f58403980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:47.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.787+0000 7f7f58403980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.791+0000 7f7f58403980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:48:47.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.791+0000 7f7f58403980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.791+0000 7f7f58403980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:48:47.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.791+0000 7f7f58403980 20 zone default found 2024-03-09T14:48:47.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.791+0000 7f7f58403980 4 Realm: () 2024-03-09T14:48:47.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.791+0000 7f7f58403980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:48:47.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.791+0000 7f7f58403980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:48:47.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.791+0000 7f7f58403980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:48:47.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.791+0000 7f7f58403980 20 zonegroup default 2024-03-09T14:48:47.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.791+0000 7f7f58403980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.791+0000 7f7f58403980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:47.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.791+0000 7f7f58403980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.791+0000 7f7f58403980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:47.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.791+0000 7f7f58403980 20 rados->read ofs=0 len=0 2024-03-09T14:48:47.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.791+0000 7f7f58403980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:47.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.791+0000 7f7f58403980 20 started sync module instance, tier type = 2024-03-09T14:48:47.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.791+0000 7f7f58403980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:48:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.819+0000 7f7f58403980 20 add_watcher() i=0 2024-03-09T14:48:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.819+0000 7f7f58403980 20 add_watcher() i=1 2024-03-09T14:48:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.819+0000 7f7f58403980 20 add_watcher() i=2 2024-03-09T14:48:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.819+0000 7f7f58403980 20 add_watcher() i=3 2024-03-09T14:48:47.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.819+0000 7f7f58403980 20 add_watcher() i=4 2024-03-09T14:48:47.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.819+0000 7f7f58403980 20 add_watcher() i=5 2024-03-09T14:48:47.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.819+0000 7f7f58403980 20 add_watcher() i=6 2024-03-09T14:48:47.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.823+0000 7f7f58403980 20 add_watcher() i=7 2024-03-09T14:48:47.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.823+0000 7f7f58403980 2 all 8 watchers are set, enabling cache 2024-03-09T14:48:47.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.823+0000 7f7e077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:48:47.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.827+0000 7f7f58403980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:48:47.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.827+0000 7f7f58403980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:48:47.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.923+0000 7f7e067fc640 20 reqs_thread_entry: start 2024-03-09T14:48:47.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.923+0000 7f7f58403980 20 init_complete bucket index max shards: 11 2024-03-09T14:48:47.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.923+0000 7f7f58403980 20 Filter name: none 2024-03-09T14:48:47.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.923+0000 7f7d77fff640 20 reqs_thread_entry: start 2024-03-09T14:48:47.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.923+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:48:47.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.927+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.931+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.931+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.931+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:48:47.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.935+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.935+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.935+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.939+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:48:47.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.943+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.943+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.943+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.947+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:48:47.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.951+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.955+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.955+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.959+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:48:47.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.959+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.959+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.963+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.963+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:48:47.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.967+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.967+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.967+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.971+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:48:47.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.971+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.975+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.975+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.975+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:48:47.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.979+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.979+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.979+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.983+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:48:47.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.983+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.987+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.987+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.991+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:48:47.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.991+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.995+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.995+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.999+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:48:47.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.999+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:47.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:47.999+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:47.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.003+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.007+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:48:48.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.007+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.011+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.011+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.011+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:48:48.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.015+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.015+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.015+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.019+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:48:48.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.019+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.019+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.019+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.023+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:48:48.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.027+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.027+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.027+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.031+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:48:48.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.031+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.035+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.035+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.035+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:48:48.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.039+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.039+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.039+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.043+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:48:48.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.047+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.047+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.047+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.047+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:48:48.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.051+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.055+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.055+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.059+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:48:48.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.063+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.063+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.063+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.067+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:48:48.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.071+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.071+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.075+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.075+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:48:48.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.079+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.079+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.079+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.083+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:48:48.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.087+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.087+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.091+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.091+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:48:48.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.095+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.095+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.099+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.099+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:48:48.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.103+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.107+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.107+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.111+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:48:48.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.111+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.115+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.115+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.119+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:48:48.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.123+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.123+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.123+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.127+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:48:48.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.131+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.131+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.135+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.135+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:48:48.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.139+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.139+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.143+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.143+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:48:48.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.147+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.151+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.151+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.155+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:48:48.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.159+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.159+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.159+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.163+0000 7f7f58403980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:48:48.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.167+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.167+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:48.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.167+0000 7f7f58403980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:48.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.171+0000 7f7e077fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:48:48.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.179+0000 7f7f58403980 20 remove_watcher() i=0 2024-03-09T14:48:48.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.179+0000 7f7f58403980 2 removed watcher, disabling cache 2024-03-09T14:48:48.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.179+0000 7f7f58403980 20 remove_watcher() i=1 2024-03-09T14:48:48.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.183+0000 7f7f58403980 20 remove_watcher() i=2 2024-03-09T14:48:48.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.187+0000 7f7f58403980 20 remove_watcher() i=3 2024-03-09T14:48:48.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.191+0000 7f7f58403980 20 remove_watcher() i=4 2024-03-09T14:48:48.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.195+0000 7f7f58403980 20 remove_watcher() i=5 2024-03-09T14:48:48.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.195+0000 7f7f58403980 20 remove_watcher() i=6 2024-03-09T14:48:48.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:48.199+0000 7f7f58403980 20 remove_watcher() i=7 2024-03-09T14:48:48.216 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-03-09T14:48:48.921 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :clean 2024-03-09T14:48:49.718 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :compileJava 2024-03-09T14:48:49.718 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :processResources 2024-03-09T14:48:49.719 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :classes 2024-03-09T14:48:50.318 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:50.318 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :compileTestJava 2024-03-09T14:48:50.319 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:50.319 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :processTestResources NO-SOURCE 2024-03-09T14:48:50.319 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :testClasses 2024-03-09T14:48:50.319 INFO:teuthology.orchestra.run.smithi099.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-03-09T14:48:50.320 INFO:teuthology.orchestra.run.smithi099.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-03-09T14:48:52.318 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:52.319 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :test 2024-03-09T14:48:52.319 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:52.319 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests STANDARD_OUT 2024-03-09T14:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09 14:48:51,724 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-03-09T14:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-03-09T14:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-03-09T14:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-03-09T14:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:52.321 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-03-09T14:48:52.618 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:52.618 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-03-09T14:48:52.719 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:52.719 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-03-09T14:48:52.918 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:52.919 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-03-09T14:48:53.118 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:53.119 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-03-09T14:48:53.218 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:53.219 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-03-09T14:48:53.320 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:53.321 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-03-09T14:48:53.618 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:53.618 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-03-09T14:48:53.718 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:53.718 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-03-09T14:48:53.819 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:53.819 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-03-09T14:48:53.918 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:53.919 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-03-09T14:48:54.418 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:54.418 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-03-09T14:48:54.518 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:54.518 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-03-09T14:48:54.718 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:54.718 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-03-09T14:48:54.818 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:54.818 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-03-09T14:48:54.919 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:54.919 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------- 2024-03-09T14:48:54.919 INFO:teuthology.orchestra.run.smithi099.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-03-09T14:48:54.919 INFO:teuthology.orchestra.run.smithi099.stdout:-------------------------------------------------------------------- 2024-03-09T14:48:54.943 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:54.943 INFO:teuthology.orchestra.run.smithi099.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-03-09T14:48:54.943 INFO:teuthology.orchestra.run.smithi099.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-03-09T14:48:54.943 INFO:teuthology.orchestra.run.smithi099.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-03-09T14:48:54.943 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:54.944 INFO:teuthology.orchestra.run.smithi099.stdout:BUILD SUCCESSFUL in 6s 2024-03-09T14:48:54.944 INFO:teuthology.orchestra.run.smithi099.stdout:5 actionable tasks: 5 executed 2024-03-09T14:48:54.950 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-03-09T14:48:54.980 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:48:54.980 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:48:55.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.027+0000 7f616b942980 20 rados->read ofs=0 len=0 2024-03-09T14:48:55.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.027+0000 7f616b942980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:55.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.031+0000 7f616b942980 20 realm 2024-03-09T14:48:55.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.031+0000 7f616b942980 20 rados->read ofs=0 len=0 2024-03-09T14:48:55.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.031+0000 7f616b942980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:55.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.031+0000 7f616b942980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:48:55.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.031+0000 7f616b942980 20 rados->read ofs=0 len=0 2024-03-09T14:48:55.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.031+0000 7f616b942980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:55.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.031+0000 7f616b942980 20 rados->read ofs=0 len=0 2024-03-09T14:48:55.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.031+0000 7f616b942980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:48:55.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.031+0000 7f616b942980 20 rados->read ofs=0 len=0 2024-03-09T14:48:55.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.031+0000 7f616b942980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:48:55.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.031+0000 7f616b942980 20 searching for the correct realm 2024-03-09T14:48:55.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.039+0000 7f6168c59640 0 -- 172.21.15.99:0/1900179652 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f615c015070 msgr2=0x7f615c026410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:48:55.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.043+0000 7f6168c59640 0 -- 172.21.15.99:0/1900179652 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f61640e4320 msgr2=0x7f61641013a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:48:55.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.259+0000 7f616b942980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:48:55.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.259+0000 7f616b942980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:48:55.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.259+0000 7f616b942980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:48:55.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.259+0000 7f616b942980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:48:55.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.259+0000 7f616b942980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:48:55.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.259+0000 7f616b942980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:48:55.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.259+0000 7f616b942980 20 rados->read ofs=0 len=0 2024-03-09T14:48:55.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.259+0000 7f616b942980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:55.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.259+0000 7f616b942980 20 rados->read ofs=0 len=0 2024-03-09T14:48:55.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.263+0000 7f616b942980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:48:55.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.263+0000 7f616b942980 20 rados->read ofs=0 len=0 2024-03-09T14:48:55.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.263+0000 7f616b942980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:48:55.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.263+0000 7f616b942980 20 zone default found 2024-03-09T14:48:55.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.263+0000 7f616b942980 4 Realm: () 2024-03-09T14:48:55.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.263+0000 7f616b942980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:48:55.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.263+0000 7f616b942980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:48:55.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.263+0000 7f616b942980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:48:55.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.263+0000 7f616b942980 20 zonegroup default 2024-03-09T14:48:55.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.263+0000 7f616b942980 20 rados->read ofs=0 len=0 2024-03-09T14:48:55.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.263+0000 7f616b942980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:55.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.263+0000 7f616b942980 20 rados->read ofs=0 len=0 2024-03-09T14:48:55.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.263+0000 7f616b942980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:55.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.263+0000 7f616b942980 20 rados->read ofs=0 len=0 2024-03-09T14:48:55.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.263+0000 7f616b942980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:55.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.263+0000 7f616b942980 20 started sync module instance, tier type = 2024-03-09T14:48:55.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.263+0000 7f616b942980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:48:55.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.287+0000 7f616b942980 20 add_watcher() i=0 2024-03-09T14:48:55.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.287+0000 7f616b942980 20 add_watcher() i=1 2024-03-09T14:48:55.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.287+0000 7f616b942980 20 add_watcher() i=2 2024-03-09T14:48:55.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.287+0000 7f616b942980 20 add_watcher() i=3 2024-03-09T14:48:55.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.287+0000 7f616b942980 20 add_watcher() i=4 2024-03-09T14:48:55.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.287+0000 7f616b942980 20 add_watcher() i=5 2024-03-09T14:48:55.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.287+0000 7f616b942980 20 add_watcher() i=6 2024-03-09T14:48:55.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.291+0000 7f616b942980 20 add_watcher() i=7 2024-03-09T14:48:55.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.291+0000 7f616b942980 2 all 8 watchers are set, enabling cache 2024-03-09T14:48:55.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.295+0000 7f601f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:48:55.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.295+0000 7f616b942980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:48:55.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.295+0000 7f616b942980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:48:55.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.387+0000 7f601e7e4640 20 reqs_thread_entry: start 2024-03-09T14:48:55.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.387+0000 7f616b942980 20 init_complete bucket index max shards: 11 2024-03-09T14:48:55.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.387+0000 7f616b942980 20 Filter name: none 2024-03-09T14:48:55.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.387+0000 7f5f8ffff640 20 reqs_thread_entry: start 2024-03-09T14:48:55.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.387+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:48:55.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.391+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.391+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.391+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.395+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:48:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.395+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.399+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.399+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.399+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:48:55.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.403+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.403+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.403+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:48:55.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.403+0000 7f616b942980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13534984080315501399', time=2024-03-09T16:48:53.408392+0000, chain.objs.size()=1 2024-03-09T14:48:55.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.403+0000 7f616b942980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.61__shadow_.x0xuEiWxkb4I93Hc6lX9mnphgiClnLr_0 2024-03-09T14:48:55.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.407+0000 7f616b942980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.411+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:48:55.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.415+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.415+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.415+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:48:55.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.415+0000 7f616b942980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13193284330965437629', time=2024-03-09T16:48:54.164842+0000, chain.objs.size()=1 2024-03-09T14:48:55.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.415+0000 7f616b942980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.62__shadow_.rfnYemEdTTgqI9Gf92Jva_SmwETh_F__0 2024-03-09T14:48:55.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.419+0000 7f616b942980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:48:55.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.423+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:48:55.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.427+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.431+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.431+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.435+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:48:55.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.435+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.439+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.439+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.439+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:48:55.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.443+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.443+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.447+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.447+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:48:55.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.451+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.451+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.451+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.455+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:48:55.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.459+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.459+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.459+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.463+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:48:55.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.467+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.467+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.467+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.471+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:48:55.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.479+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.479+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.483+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.483+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:48:55.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.487+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.491+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.491+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.495+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:48:55.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.495+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.499+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.499+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.503+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:48:55.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.503+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.507+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.507+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.507+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:48:55.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.511+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.515+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.515+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.519+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:48:55.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.523+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.523+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.523+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.527+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:48:55.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.531+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.535+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.535+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.539+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:48:55.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.539+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.539+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.543+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.543+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:48:55.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.547+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.547+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.551+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.551+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:48:55.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.555+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.555+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.555+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.559+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:48:55.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.563+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.563+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.567+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.567+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:48:55.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.571+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.575+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.575+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.579+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:48:55.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.583+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.583+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.583+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.583+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:48:55.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.587+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.591+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.591+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.595+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:48:55.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.595+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.599+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.599+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.603+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:48:55.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.603+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.607+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.607+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.607+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:48:55.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.611+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.615+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.615+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.619+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:48:55.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.619+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.623+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.623+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.627+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:48:55.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.631+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.631+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.631+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.635+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:48:55.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.639+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.639+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.639+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.643+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:48:55.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.647+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.647+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.647+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.651+0000 7f616b942980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:48:55.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.651+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.655+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:55.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.655+0000 7f616b942980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:55.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.659+0000 7f601f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:48:55.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.663+0000 7f616b942980 20 remove_watcher() i=0 2024-03-09T14:48:55.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.663+0000 7f616b942980 2 removed watcher, disabling cache 2024-03-09T14:48:55.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.667+0000 7f616b942980 20 remove_watcher() i=1 2024-03-09T14:48:55.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.667+0000 7f616b942980 20 remove_watcher() i=2 2024-03-09T14:48:55.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.675+0000 7f616b942980 20 remove_watcher() i=3 2024-03-09T14:48:55.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.675+0000 7f616b942980 20 remove_watcher() i=4 2024-03-09T14:48:55.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.675+0000 7f616b942980 20 remove_watcher() i=5 2024-03-09T14:48:55.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.679+0000 7f616b942980 20 remove_watcher() i=6 2024-03-09T14:48:55.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.683+0000 7f616b942980 20 remove_watcher() i=7 2024-03-09T14:48:55.701 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-03-09T14:48:55.775 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:48:55.775 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:48:55.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.823+0000 7f359d926980 20 rados->read ofs=0 len=0 2024-03-09T14:48:55.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.827+0000 7f359d926980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:55.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.827+0000 7f359d926980 20 realm 2024-03-09T14:48:55.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.827+0000 7f359d926980 20 rados->read ofs=0 len=0 2024-03-09T14:48:55.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.827+0000 7f359d926980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:55.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.827+0000 7f359d926980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:48:55.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.827+0000 7f359d926980 20 rados->read ofs=0 len=0 2024-03-09T14:48:55.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.827+0000 7f359d926980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:55.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.827+0000 7f359d926980 20 rados->read ofs=0 len=0 2024-03-09T14:48:55.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.827+0000 7f359d926980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:48:55.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.827+0000 7f359d926980 20 rados->read ofs=0 len=0 2024-03-09T14:48:55.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.827+0000 7f359d926980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:48:55.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.827+0000 7f359d926980 20 searching for the correct realm 2024-03-09T14:48:55.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.831+0000 7f359bc3f640 0 -- 172.21.15.99:0/2945317352 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x5566c45f49d0 msgr2=0x5566c45f6dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:48:55.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:55.839+0000 7f359ac3d640 0 -- 172.21.15.99:0/2945317352 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f35940f4450 msgr2=0x7f35940f48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:48:56.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.055+0000 7f359d926980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:48:56.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.055+0000 7f359d926980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:48:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.055+0000 7f359d926980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:48:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.055+0000 7f359d926980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:48:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.055+0000 7f359d926980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:48:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.055+0000 7f359d926980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:48:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.055+0000 7f359d926980 20 rados->read ofs=0 len=0 2024-03-09T14:48:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.055+0000 7f359d926980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:56.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.055+0000 7f359d926980 20 rados->read ofs=0 len=0 2024-03-09T14:48:56.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.059+0000 7f359d926980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:48:56.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.059+0000 7f359d926980 20 rados->read ofs=0 len=0 2024-03-09T14:48:56.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.059+0000 7f359d926980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:48:56.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.059+0000 7f359d926980 20 zone default found 2024-03-09T14:48:56.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.059+0000 7f359d926980 4 Realm: () 2024-03-09T14:48:56.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.059+0000 7f359d926980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:48:56.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.059+0000 7f359d926980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:48:56.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.059+0000 7f359d926980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:48:56.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.059+0000 7f359d926980 20 zonegroup default 2024-03-09T14:48:56.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.059+0000 7f359d926980 20 rados->read ofs=0 len=0 2024-03-09T14:48:56.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.059+0000 7f359d926980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:56.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.059+0000 7f359d926980 20 rados->read ofs=0 len=0 2024-03-09T14:48:56.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.059+0000 7f359d926980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:56.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.059+0000 7f359d926980 20 rados->read ofs=0 len=0 2024-03-09T14:48:56.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.063+0000 7f359d926980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:56.057 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.063+0000 7f359d926980 20 started sync module instance, tier type = 2024-03-09T14:48:56.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.063+0000 7f359d926980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:48:56.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.087+0000 7f359d926980 20 add_watcher() i=0 2024-03-09T14:48:56.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.087+0000 7f359d926980 20 add_watcher() i=1 2024-03-09T14:48:56.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.087+0000 7f359d926980 20 add_watcher() i=2 2024-03-09T14:48:56.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.087+0000 7f359d926980 20 add_watcher() i=3 2024-03-09T14:48:56.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.087+0000 7f359d926980 20 add_watcher() i=4 2024-03-09T14:48:56.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.087+0000 7f359d926980 20 add_watcher() i=5 2024-03-09T14:48:56.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.087+0000 7f359d926980 20 add_watcher() i=6 2024-03-09T14:48:56.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.087+0000 7f359d926980 20 add_watcher() i=7 2024-03-09T14:48:56.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.087+0000 7f359d926980 2 all 8 watchers are set, enabling cache 2024-03-09T14:48:56.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.091+0000 7f3451fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:48:56.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.095+0000 7f359d926980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:48:56.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.095+0000 7f359d926980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:48:56.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.187+0000 7f3450fe1640 20 reqs_thread_entry: start 2024-03-09T14:48:56.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.187+0000 7f359d926980 20 init_complete bucket index max shards: 11 2024-03-09T14:48:56.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.187+0000 7f359d926980 20 Filter name: none 2024-03-09T14:48:56.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.187+0000 7f33ca7fc640 20 reqs_thread_entry: start 2024-03-09T14:48:56.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.187+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:48:56.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.191+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.191+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.191+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.195+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:48:56.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.199+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.199+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.199+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.203+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:48:56.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.207+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.207+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.207+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.211+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:48:56.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.215+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.215+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.215+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.219+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:48:56.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.219+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.219+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.223+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.223+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:48:56.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.227+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.227+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.227+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.231+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:48:56.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.231+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.235+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.235+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.235+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:48:56.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.239+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.239+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.239+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.243+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:48:56.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.243+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.247+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.247+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.247+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:48:56.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.251+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.255+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.255+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.255+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:48:56.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.259+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.259+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.259+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.263+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:48:56.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.267+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.267+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.267+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.271+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:48:56.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.271+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.275+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.275+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.275+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:48:56.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.279+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.279+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.279+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.283+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:48:56.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.283+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.287+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.287+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.291+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:48:56.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.291+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.295+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.295+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.295+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:48:56.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.299+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.299+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.299+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.303+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:48:56.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.307+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.307+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.311+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.311+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:48:56.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.315+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.319+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.319+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.323+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:48:56.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.323+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.327+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.327+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.327+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:48:56.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.331+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.335+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.335+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.335+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:48:56.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.339+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.343+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.343+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.343+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:48:56.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.347+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.351+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.351+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.355+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:48:56.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.355+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.359+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.359+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.363+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:48:56.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.367+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.367+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.367+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.371+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:48:56.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.375+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.375+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.379+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.379+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:48:56.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.383+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.387+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.387+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.387+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:48:56.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.391+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.395+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.395+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.395+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:48:56.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.399+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.403+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.403+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.407+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:48:56.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.407+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.411+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.411+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.415+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:48:56.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.419+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.419+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.419+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.423+0000 7f359d926980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:48:56.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.427+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.427+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.427+0000 7f359d926980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.431+0000 7f3451fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:48:56.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.435+0000 7f359d926980 20 remove_watcher() i=0 2024-03-09T14:48:56.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.435+0000 7f359d926980 2 removed watcher, disabling cache 2024-03-09T14:48:56.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.439+0000 7f359d926980 20 remove_watcher() i=1 2024-03-09T14:48:56.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.443+0000 7f359d926980 20 remove_watcher() i=2 2024-03-09T14:48:56.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.443+0000 7f359d926980 20 remove_watcher() i=3 2024-03-09T14:48:56.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.447+0000 7f359d926980 20 remove_watcher() i=4 2024-03-09T14:48:56.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.447+0000 7f359d926980 20 remove_watcher() i=5 2024-03-09T14:48:56.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.451+0000 7f359d926980 20 remove_watcher() i=6 2024-03-09T14:48:56.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.451+0000 7f359d926980 20 remove_watcher() i=7 2024-03-09T14:48:56.467 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-03-09T14:48:56.541 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:48:56.541 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:48:56.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.591+0000 7f46358d2980 20 rados->read ofs=0 len=0 2024-03-09T14:48:56.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.591+0000 7f46358d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:56.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.591+0000 7f46358d2980 20 realm 2024-03-09T14:48:56.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.591+0000 7f46358d2980 20 rados->read ofs=0 len=0 2024-03-09T14:48:56.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.591+0000 7f46358d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:56.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.591+0000 7f46358d2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:48:56.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.591+0000 7f46358d2980 20 rados->read ofs=0 len=0 2024-03-09T14:48:56.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.595+0000 7f46358d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:56.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.595+0000 7f46358d2980 20 rados->read ofs=0 len=0 2024-03-09T14:48:56.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.595+0000 7f46358d2980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:48:56.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.595+0000 7f46358d2980 20 rados->read ofs=0 len=0 2024-03-09T14:48:56.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.595+0000 7f46358d2980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:48:56.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.595+0000 7f46358d2980 20 searching for the correct realm 2024-03-09T14:48:56.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.599+0000 7f4632be9640 0 -- 172.21.15.99:0/2631124637 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f46240d7040 msgr2=0x7f46240c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:48:56.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.811+0000 7f4633beb640 0 -- 172.21.15.99:0/2631124637 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f4628008040 msgr2=0x7f462805a4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:48:56.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:48:56.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:48:56.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:48:56.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:48:56.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:48:56.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:48:56.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 20 rados->read ofs=0 len=0 2024-03-09T14:48:56.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:56.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 20 rados->read ofs=0 len=0 2024-03-09T14:48:56.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:48:56.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 20 rados->read ofs=0 len=0 2024-03-09T14:48:56.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:48:56.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 20 zone default found 2024-03-09T14:48:56.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 4 Realm: () 2024-03-09T14:48:56.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:48:56.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:48:56.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:48:56.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 20 zonegroup default 2024-03-09T14:48:56.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 20 rados->read ofs=0 len=0 2024-03-09T14:48:56.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:56.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.831+0000 7f46358d2980 20 rados->read ofs=0 len=0 2024-03-09T14:48:56.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.835+0000 7f46358d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:56.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.835+0000 7f46358d2980 20 rados->read ofs=0 len=0 2024-03-09T14:48:56.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.835+0000 7f46358d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:56.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.835+0000 7f46358d2980 20 started sync module instance, tier type = 2024-03-09T14:48:56.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.835+0000 7f46358d2980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:48:56.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.855+0000 7f46358d2980 20 add_watcher() i=0 2024-03-09T14:48:56.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.855+0000 7f46358d2980 20 add_watcher() i=1 2024-03-09T14:48:56.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.855+0000 7f46358d2980 20 add_watcher() i=2 2024-03-09T14:48:56.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.855+0000 7f46358d2980 20 add_watcher() i=3 2024-03-09T14:48:56.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.855+0000 7f46358d2980 20 add_watcher() i=4 2024-03-09T14:48:56.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.855+0000 7f46358d2980 20 add_watcher() i=5 2024-03-09T14:48:56.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.855+0000 7f46358d2980 20 add_watcher() i=6 2024-03-09T14:48:56.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.855+0000 7f46358d2980 20 add_watcher() i=7 2024-03-09T14:48:56.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.855+0000 7f46358d2980 2 all 8 watchers are set, enabling cache 2024-03-09T14:48:56.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.859+0000 7f44ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:48:56.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.859+0000 7f46358d2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:48:56.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.859+0000 7f46358d2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:48:56.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.947+0000 7f44e97e2640 20 reqs_thread_entry: start 2024-03-09T14:48:56.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.947+0000 7f46358d2980 20 init_complete bucket index max shards: 11 2024-03-09T14:48:56.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.947+0000 7f46358d2980 20 Filter name: none 2024-03-09T14:48:56.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.947+0000 7f44e27fc640 20 reqs_thread_entry: start 2024-03-09T14:48:56.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.947+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:48:56.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.947+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.951+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.951+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.951+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:48:56.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.955+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.955+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.959+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.959+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:48:56.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.963+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.963+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.963+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.967+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:48:56.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.971+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.971+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.971+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.975+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:48:56.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.979+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.979+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.979+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.983+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:48:56.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.983+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.987+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.987+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.991+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:48:56.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.991+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.995+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:56.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.995+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:56.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:56.999+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:48:56.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.003+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.003+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.003+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.007+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:48:57.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.011+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.011+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.015+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.015+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:48:57.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.019+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.023+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.023+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.027+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:48:57.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.031+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.031+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.031+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.035+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:48:57.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.039+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.039+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.039+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.043+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:48:57.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.043+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.047+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.047+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.047+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:48:57.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.051+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.055+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.055+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.059+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:48:57.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.063+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.063+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.063+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.067+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:48:57.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.071+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.071+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.071+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.075+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:48:57.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.079+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.079+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.079+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.083+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:48:57.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.087+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.087+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.087+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.091+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:48:57.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.095+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.095+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.095+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.099+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:48:57.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.099+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.103+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.103+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.103+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:48:57.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.107+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.107+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.111+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.111+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:48:57.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.115+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.119+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.119+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.123+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:48:57.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.127+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.127+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.124 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.127+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.131+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:48:57.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.135+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.135+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.135+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.135+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:48:57.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.143+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.143+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.143+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.147+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:48:57.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.151+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.151+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.151+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.155+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:48:57.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.155+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.159+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.159+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.159+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:48:57.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.163+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.163+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.167+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.167+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:48:57.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.171+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.171+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.167 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.171+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.175+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:48:57.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.175+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.179+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.179+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.183+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:48:57.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.183+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.183+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.187+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.187+0000 7f46358d2980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:48:57.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.191+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.191+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.195+0000 7f46358d2980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.199+0000 7f44ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:48:57.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.203+0000 7f46358d2980 20 remove_watcher() i=0 2024-03-09T14:48:57.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.203+0000 7f46358d2980 2 removed watcher, disabling cache 2024-03-09T14:48:57.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.207+0000 7f46358d2980 20 remove_watcher() i=1 2024-03-09T14:48:57.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.207+0000 7f46358d2980 20 remove_watcher() i=2 2024-03-09T14:48:57.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.211+0000 7f46358d2980 20 remove_watcher() i=3 2024-03-09T14:48:57.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.211+0000 7f46358d2980 20 remove_watcher() i=4 2024-03-09T14:48:57.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.215+0000 7f46358d2980 20 remove_watcher() i=5 2024-03-09T14:48:57.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.219+0000 7f46358d2980 20 remove_watcher() i=6 2024-03-09T14:48:57.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.219+0000 7f46358d2980 20 remove_watcher() i=7 2024-03-09T14:48:57.234 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-03-09T14:48:57.311 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:48:57.311 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:48:57.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.359+0000 7f17b8fe9980 20 rados->read ofs=0 len=0 2024-03-09T14:48:57.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.363+0000 7f17b8fe9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:57.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.363+0000 7f17b8fe9980 20 realm 2024-03-09T14:48:57.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.363+0000 7f17b8fe9980 20 rados->read ofs=0 len=0 2024-03-09T14:48:57.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.363+0000 7f17b8fe9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:57.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.363+0000 7f17b8fe9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:48:57.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.363+0000 7f17b8fe9980 20 rados->read ofs=0 len=0 2024-03-09T14:48:57.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.363+0000 7f17b8fe9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:57.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.363+0000 7f17b8fe9980 20 rados->read ofs=0 len=0 2024-03-09T14:48:57.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.363+0000 7f17b8fe9980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:48:57.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.363+0000 7f17b8fe9980 20 rados->read ofs=0 len=0 2024-03-09T14:48:57.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.367+0000 7f17b8fe9980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:48:57.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.367+0000 7f17b8fe9980 20 searching for the correct realm 2024-03-09T14:48:57.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.371+0000 7f17b7302640 0 -- 172.21.15.99:0/604175507 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x5566b0d631e0 msgr2=0x5566b0d655f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:48:57.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.379+0000 7f17b6300640 0 -- 172.21.15.99:0/604175507 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f17b005c240 msgr2=0x7f17b005c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:48:57.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.595+0000 7f17b8fe9980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:48:57.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.595+0000 7f17b8fe9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:48:57.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.595+0000 7f17b8fe9980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:48:57.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.595+0000 7f17b8fe9980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:48:57.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.595+0000 7f17b8fe9980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:48:57.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.595+0000 7f17b8fe9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:48:57.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.595+0000 7f17b8fe9980 20 rados->read ofs=0 len=0 2024-03-09T14:48:57.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.595+0000 7f17b8fe9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:57.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.595+0000 7f17b8fe9980 20 rados->read ofs=0 len=0 2024-03-09T14:48:57.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.599+0000 7f17b8fe9980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:48:57.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.599+0000 7f17b8fe9980 20 rados->read ofs=0 len=0 2024-03-09T14:48:57.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.599+0000 7f17b8fe9980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:48:57.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.599+0000 7f17b8fe9980 20 zone default found 2024-03-09T14:48:57.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.599+0000 7f17b8fe9980 4 Realm: () 2024-03-09T14:48:57.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.599+0000 7f17b8fe9980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:48:57.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.599+0000 7f17b8fe9980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:48:57.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.599+0000 7f17b8fe9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:48:57.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.599+0000 7f17b8fe9980 20 zonegroup default 2024-03-09T14:48:57.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.599+0000 7f17b8fe9980 20 rados->read ofs=0 len=0 2024-03-09T14:48:57.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.599+0000 7f17b8fe9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:57.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.599+0000 7f17b8fe9980 20 rados->read ofs=0 len=0 2024-03-09T14:48:57.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.599+0000 7f17b8fe9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:57.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.599+0000 7f17b8fe9980 20 rados->read ofs=0 len=0 2024-03-09T14:48:57.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.599+0000 7f17b8fe9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:48:57.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.599+0000 7f17b8fe9980 20 started sync module instance, tier type = 2024-03-09T14:48:57.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.599+0000 7f17b8fe9980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:48:57.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.623+0000 7f17b8fe9980 20 add_watcher() i=0 2024-03-09T14:48:57.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.623+0000 7f17b8fe9980 20 add_watcher() i=1 2024-03-09T14:48:57.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.623+0000 7f17b8fe9980 20 add_watcher() i=2 2024-03-09T14:48:57.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.623+0000 7f17b8fe9980 20 add_watcher() i=3 2024-03-09T14:48:57.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.623+0000 7f17b8fe9980 20 add_watcher() i=4 2024-03-09T14:48:57.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.623+0000 7f17b8fe9980 20 add_watcher() i=5 2024-03-09T14:48:57.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.623+0000 7f17b8fe9980 20 add_watcher() i=6 2024-03-09T14:48:57.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.623+0000 7f17b8fe9980 20 add_watcher() i=7 2024-03-09T14:48:57.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.623+0000 7f17b8fe9980 2 all 8 watchers are set, enabling cache 2024-03-09T14:48:57.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.627+0000 7f166d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:48:57.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.627+0000 7f17b8fe9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:48:57.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.627+0000 7f17b8fe9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:48:57.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.707+0000 7f15e7fff640 20 reqs_thread_entry: start 2024-03-09T14:48:57.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.707+0000 7f17b8fe9980 20 init_complete bucket index max shards: 11 2024-03-09T14:48:57.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.707+0000 7f17b8fe9980 20 Filter name: none 2024-03-09T14:48:57.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.707+0000 7f15e5ffb640 20 reqs_thread_entry: start 2024-03-09T14:48:57.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.707+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:48:57.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.711+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.711+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.711+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.715+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:48:57.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.719+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.719+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.719+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.723+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:48:57.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.727+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.727+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.727+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.731+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:48:57.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.735+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.735+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.735+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.735+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:48:57.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.739+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.739+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.739+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.743+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:48:57.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.747+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.747+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.747+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.747+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:48:57.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.751+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.755+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.755+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.755+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:48:57.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.759+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.763+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.763+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.767+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:48:57.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.767+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.767+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.771+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.771+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:48:57.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.775+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.775+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.775+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.779+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:48:57.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.783+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.783+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.783+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.787+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:48:57.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.791+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.791+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.787 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.791+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.795+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:48:57.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.795+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.799+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.799+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.799+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:48:57.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.803+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.807+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.807+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.807+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:48:57.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.811+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.811+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.811+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.815+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:48:57.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.819+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.819+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.819+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.823+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:48:57.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.827+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.827+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.827+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.831+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:48:57.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.835+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.835+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.835+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.839+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:48:57.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.839+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.843+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.843+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.843+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:48:57.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.847+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.851+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.851+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.855+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:48:57.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.855+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.859+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.859+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.859+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:48:57.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.863+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.863+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.863+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.867+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:48:57.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.871+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.871+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.871+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.875+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:48:57.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.879+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.879+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.879+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.883+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:48:57.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.887+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.887+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.887+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.891+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:48:57.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.895+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.895+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.895+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.899+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:48:57.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.903+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.903+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.903+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.907+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:48:57.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.911+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.911+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.911+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.915+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:48:57.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.919+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.919+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.919+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.923+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:48:57.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.927+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.927+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.927+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.931+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:48:57.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.935+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.935+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.935+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.939+0000 7f17b8fe9980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:48:57.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.943+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.943+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:48:57.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.943+0000 7f17b8fe9980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:48:57.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.947+0000 7f166d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:48:57.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.955+0000 7f17b8fe9980 20 remove_watcher() i=0 2024-03-09T14:48:57.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.955+0000 7f17b8fe9980 2 removed watcher, disabling cache 2024-03-09T14:48:57.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.959+0000 7f17b8fe9980 20 remove_watcher() i=1 2024-03-09T14:48:57.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.959+0000 7f17b8fe9980 20 remove_watcher() i=2 2024-03-09T14:48:57.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.963+0000 7f17b8fe9980 20 remove_watcher() i=3 2024-03-09T14:48:57.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.963+0000 7f17b8fe9980 20 remove_watcher() i=4 2024-03-09T14:48:57.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.967+0000 7f17b8fe9980 20 remove_watcher() i=5 2024-03-09T14:48:57.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.967+0000 7f17b8fe9980 20 remove_watcher() i=6 2024-03-09T14:48:57.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:48:57.971+0000 7f17b8fe9980 20 remove_watcher() i=7 2024-03-09T14:48:57.987 DEBUG:teuthology.orchestra.run.smithi099:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-03-09T14:48:58.684 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :clean 2024-03-09T14:48:59.381 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :compileJava 2024-03-09T14:48:59.381 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :processResources 2024-03-09T14:48:59.382 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :classes 2024-03-09T14:48:59.882 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:59.882 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :compileTestJava 2024-03-09T14:48:59.882 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:48:59.883 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :processTestResources NO-SOURCE 2024-03-09T14:48:59.883 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :testClasses 2024-03-09T14:48:59.883 INFO:teuthology.orchestra.run.smithi099.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-03-09T14:48:59.883 INFO:teuthology.orchestra.run.smithi099.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-03-09T14:49:01.884 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:01.885 INFO:teuthology.orchestra.run.smithi099.stdout:> Task :test 2024-03-09T14:49:01.885 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:01.885 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests STANDARD_OUT 2024-03-09T14:49:01.885 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09 14:49:01,240 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-03-09T14:49:01.885 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:01.885 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-03-09T14:49:01.886 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:01.886 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-03-09T14:49:02.081 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:02.082 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-03-09T14:49:02.381 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:02.382 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-03-09T14:49:02.682 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:02.682 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-03-09T14:49:02.682 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:02.682 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-03-09T14:49:02.981 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:02.982 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-03-09T14:49:04.882 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:04.882 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-03-09T14:49:05.182 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:05.182 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-03-09T14:49:05.182 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:05.182 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-03-09T14:49:05.482 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:05.482 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-03-09T14:49:05.681 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:05.681 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-03-09T14:49:05.982 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:05.982 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-03-09T14:49:05.982 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:05.982 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-03-09T14:49:06.082 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:06.082 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-03-09T14:49:06.082 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:06.082 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-03-09T14:49:06.382 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:06.382 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-03-09T14:49:06.781 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:06.781 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-03-09T14:49:07.081 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:07.082 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-03-09T14:49:07.181 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:07.181 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-03-09T14:49:07.482 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:07.482 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-03-09T14:49:07.582 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:07.582 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-03-09T14:49:07.782 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:07.782 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-03-09T14:49:07.881 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:07.882 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-03-09T14:49:08.181 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:08.182 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-03-09T14:49:08.281 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:08.282 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-03-09T14:49:08.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:08.481 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-03-09T14:49:08.581 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:08.581 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-03-09T14:49:08.881 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:08.881 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-03-09T14:49:08.982 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:09.111 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-03-09T14:49:09.182 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:09.182 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-03-09T14:49:09.381 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:09.382 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-03-09T14:49:09.681 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:09.682 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-03-09T14:49:10.281 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:10.281 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-03-09T14:49:10.681 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:10.682 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-03-09T14:49:16.881 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:16.882 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-03-09T14:49:17.382 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:17.382 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-03-09T14:49:17.382 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:17.382 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-03-09T14:49:17.682 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:17.684 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-03-09T14:49:17.684 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:17.684 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-03-09T14:49:18.181 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:18.182 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-03-09T14:49:18.682 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:19.521 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-03-09T14:49:19.523 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:19.523 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-03-09T14:49:19.523 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:19.523 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-03-09T14:49:19.523 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:19.523 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-03-09T14:49:19.881 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:19.881 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-03-09T14:49:20.181 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:20.182 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-03-09T14:49:20.581 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:20.581 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-03-09T14:49:20.981 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:20.981 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-03-09T14:49:21.681 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:21.681 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-03-09T14:49:21.881 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:21.881 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-03-09T14:49:27.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:27.481 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-03-09T14:49:27.781 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:27.781 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-03-09T14:49:29.181 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:29.181 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-03-09T14:49:29.381 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:29.381 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-03-09T14:49:30.281 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:30.282 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-03-09T14:49:30.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:30.481 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-03-09T14:49:30.981 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:30.981 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-03-09T14:49:31.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:31.481 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-03-09T14:49:31.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:31.481 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-03-09T14:49:31.581 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:31.581 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-03-09T14:49:31.581 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:31.581 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-03-09T14:49:31.881 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:31.881 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-03-09T14:49:31.882 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:31.882 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-03-09T14:49:32.181 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:32.181 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-03-09T14:49:32.281 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:32.281 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-03-09T14:49:32.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:32.481 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-03-09T14:49:32.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:32.481 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-03-09T14:49:32.781 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:32.781 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-03-09T14:49:32.881 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:32.881 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-03-09T14:49:33.181 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:33.181 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-03-09T14:49:33.181 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:33.182 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-03-09T14:49:33.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:33.481 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-03-09T14:49:33.581 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:33.581 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-03-09T14:49:33.881 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:33.881 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-03-09T14:49:34.081 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:34.081 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-03-09T14:49:34.381 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:34.381 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-03-09T14:49:34.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:34.481 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-03-09T14:49:34.881 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:34.881 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-03-09T14:49:34.981 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:34.981 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-03-09T14:49:35.281 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:35.281 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-03-09T14:49:35.381 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:35.481 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-03-09T14:49:35.781 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:35.782 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-03-09T14:49:35.881 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:35.881 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-03-09T14:49:36.181 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:36.181 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-03-09T14:49:36.381 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:36.381 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-03-09T14:49:36.681 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:36.681 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-03-09T14:49:36.781 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:36.781 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-03-09T14:49:37.181 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:37.181 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-03-09T14:49:37.281 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:37.281 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-03-09T14:49:37.581 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:37.581 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-03-09T14:49:37.781 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:37.782 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-03-09T14:49:38.081 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:38.081 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-03-09T14:49:38.181 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:38.181 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-03-09T14:49:38.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:38.481 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-03-09T14:49:38.681 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:38.681 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-03-09T14:49:38.981 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:38.982 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-03-09T14:49:39.081 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:39.081 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-03-09T14:49:39.581 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:39.581 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-03-09T14:49:39.681 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:39.682 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-03-09T14:49:39.981 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:39.981 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-03-09T14:49:40.181 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:40.181 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-03-09T14:49:40.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:40.481 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-03-09T14:49:40.681 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:40.681 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-03-09T14:49:40.981 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:40.981 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-03-09T14:49:41.081 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:41.081 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-03-09T14:49:41.381 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:41.381 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-03-09T14:49:41.581 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:41.581 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-03-09T14:49:41.881 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:41.881 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-03-09T14:49:41.981 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:41.981 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-03-09T14:49:42.281 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:42.281 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-03-09T14:49:42.381 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:42.381 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-03-09T14:49:42.681 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:42.681 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-03-09T14:49:42.781 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:42.781 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-03-09T14:49:43.081 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:43.081 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-03-09T14:49:43.281 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:43.281 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-03-09T14:49:43.581 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:43.581 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-03-09T14:49:43.581 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:43.581 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-03-09T14:49:43.881 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:43.881 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-03-09T14:49:43.981 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:43.981 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-03-09T14:49:44.282 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:44.282 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-03-09T14:49:44.282 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:44.282 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-03-09T14:49:44.581 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:44.581 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-03-09T14:49:44.681 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:44.681 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-03-09T14:49:44.881 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:44.881 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-03-09T14:49:45.181 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:45.181 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-03-09T14:49:45.381 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:45.381 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-03-09T14:49:45.481 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:45.481 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-03-09T14:49:45.581 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:45.581 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-03-09T14:49:45.681 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:45.681 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-03-09T14:49:45.881 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:45.881 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-03-09T14:49:45.981 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:45.981 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-03-09T14:49:46.281 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:46.281 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-03-09T14:49:46.381 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:46.381 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-03-09T14:49:46.681 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:46.681 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-03-09T14:49:46.681 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:46.681 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-03-09T14:49:46.981 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:46.981 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-03-09T14:49:47.381 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:47.381 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-03-09T14:49:47.681 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:47.681 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-03-09T14:49:48.081 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:48.081 INFO:teuthology.orchestra.run.smithi099.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-03-09T14:49:48.414 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:48.414 INFO:teuthology.orchestra.run.smithi099.stdout:---------------------------------------------------------------------- 2024-03-09T14:49:48.414 INFO:teuthology.orchestra.run.smithi099.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-03-09T14:49:48.414 INFO:teuthology.orchestra.run.smithi099.stdout:---------------------------------------------------------------------- 2024-03-09T14:49:48.414 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:48.414 INFO:teuthology.orchestra.run.smithi099.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-03-09T14:49:48.414 INFO:teuthology.orchestra.run.smithi099.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-03-09T14:49:48.415 INFO:teuthology.orchestra.run.smithi099.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-03-09T14:49:48.415 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:48.415 INFO:teuthology.orchestra.run.smithi099.stdout:BUILD SUCCESSFUL in 50s 2024-03-09T14:49:48.415 INFO:teuthology.orchestra.run.smithi099.stdout:5 actionable tasks: 5 executed 2024-03-09T14:49:48.432 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-03-09T14:49:48.457 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:49:48.457 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:49:48.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.510+0000 7f9a43c43980 20 rados->read ofs=0 len=0 2024-03-09T14:49:48.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.510+0000 7f9a43c43980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:48.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.510+0000 7f9a43c43980 20 realm 2024-03-09T14:49:48.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.510+0000 7f9a43c43980 20 rados->read ofs=0 len=0 2024-03-09T14:49:48.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.510+0000 7f9a43c43980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:48.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.510+0000 7f9a43c43980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:49:48.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.510+0000 7f9a43c43980 20 rados->read ofs=0 len=0 2024-03-09T14:49:48.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.510+0000 7f9a43c43980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:48.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.510+0000 7f9a43c43980 20 rados->read ofs=0 len=0 2024-03-09T14:49:48.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.514+0000 7f9a43c43980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:48.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.514+0000 7f9a43c43980 20 rados->read ofs=0 len=0 2024-03-09T14:49:48.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.514+0000 7f9a43c43980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:49:48.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.514+0000 7f9a43c43980 20 searching for the correct realm 2024-03-09T14:49:48.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.514+0000 7f9a40f5a640 0 -- 172.21.15.99:0/719488478 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f9a340a7050 msgr2=0x7f9a340ee250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:48.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.726+0000 7f9a41f5c640 0 -- 172.21.15.99:0/719488478 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f9a3804e040 msgr2=0x7f9a3804d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:48.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:49:48.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:49:48.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:49:48.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:49:48.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:49:48.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:49:48.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 20 rados->read ofs=0 len=0 2024-03-09T14:49:48.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:48.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 20 rados->read ofs=0 len=0 2024-03-09T14:49:48.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:48.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 20 rados->read ofs=0 len=0 2024-03-09T14:49:48.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:49:48.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 20 zone default found 2024-03-09T14:49:48.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 4 Realm: () 2024-03-09T14:49:48.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:49:48.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:49:48.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:49:48.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 20 zonegroup default 2024-03-09T14:49:48.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 20 rados->read ofs=0 len=0 2024-03-09T14:49:48.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:48.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.746+0000 7f9a43c43980 20 rados->read ofs=0 len=0 2024-03-09T14:49:48.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.750+0000 7f9a43c43980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:48.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.750+0000 7f9a43c43980 20 rados->read ofs=0 len=0 2024-03-09T14:49:48.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.750+0000 7f9a43c43980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:48.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.750+0000 7f9a43c43980 20 started sync module instance, tier type = 2024-03-09T14:49:48.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.750+0000 7f9a43c43980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:49:48.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.770+0000 7f9a43c43980 20 add_watcher() i=0 2024-03-09T14:49:48.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.770+0000 7f9a43c43980 20 add_watcher() i=1 2024-03-09T14:49:48.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.770+0000 7f9a43c43980 20 add_watcher() i=2 2024-03-09T14:49:48.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.770+0000 7f9a43c43980 20 add_watcher() i=3 2024-03-09T14:49:48.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.770+0000 7f9a43c43980 20 add_watcher() i=4 2024-03-09T14:49:48.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.770+0000 7f9a43c43980 20 add_watcher() i=5 2024-03-09T14:49:48.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.770+0000 7f9a43c43980 20 add_watcher() i=6 2024-03-09T14:49:48.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.770+0000 7f9a43c43980 20 add_watcher() i=7 2024-03-09T14:49:48.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.770+0000 7f9a43c43980 2 all 8 watchers are set, enabling cache 2024-03-09T14:49:48.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.774+0000 7f98f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:48.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.774+0000 7f9a43c43980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:49:48.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.774+0000 7f9a43c43980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:49:48.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.862+0000 7f98f67e4640 20 reqs_thread_entry: start 2024-03-09T14:49:48.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.862+0000 7f9a43c43980 20 init_complete bucket index max shards: 11 2024-03-09T14:49:48.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.862+0000 7f9a43c43980 20 Filter name: none 2024-03-09T14:49:48.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.862+0000 7f9867fff640 20 reqs_thread_entry: start 2024-03-09T14:49:48.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.862+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:49:48.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.866+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:48.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.866+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:48.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.866+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:49:48.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.866+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2346296936623417312', time=2024-03-09T16:49:35.040610+0000, chain.objs.size()=1 2024-03-09T14:49:48.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.866+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.105__shadow_.bgDUnHebmZl1zQxtc1nBYtkT7F0lLh-_0 2024-03-09T14:49:48.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.870+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:48.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.874+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:49:48.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.878+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:48.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.878+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:48.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.878+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:49:48.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.878+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4193762110598756497', time=2024-03-09T16:49:07.225561+0000, chain.objs.size()=1 2024-03-09T14:49:48.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.878+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.74__shadow_.dxWFEnoK6Pldx34LvRlVLYC9XgPaIpe_0 2024-03-09T14:49:48.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.878+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10333296927881196409', time=2024-03-09T16:49:40.731214+0000, chain.objs.size()=1 2024-03-09T14:49:48.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.878+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.117__shadow_._9V6J0YvBwzKiR2rGFpZUi4AlKJsBTC_0 2024-03-09T14:49:48.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.878+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4664114806725163178', time=2024-03-09T16:49:41.149164+0000, chain.objs.size()=1 2024-03-09T14:49:48.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.878+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.118__shadow_.IGJ3X6mwqpuw4NXk4ocBBkQYEc4JAqz_0 2024-03-09T14:49:48.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.882+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:48.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.886+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:49:48.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.890+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:48.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.890+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:48.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.890+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:49:48.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.890+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1284102545288482825', time=2024-03-09T16:49:36.937535+0000, chain.objs.size()=1 2024-03-09T14:49:48.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.890+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.109__shadow_.71ANz0Bq1HOC6V1QcIPmSIVWZVgAD4p_0 2024-03-09T14:49:48.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.890+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16602811321082322245', time=2024-03-09T16:49:42.444626+0000, chain.objs.size()=1 2024-03-09T14:49:48.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.890+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.121__shadow_.Q00nn6e_-OLhoUu7ovAq42MoTCGgc6-_0 2024-03-09T14:49:48.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.894+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:48.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.902+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:49:48.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.902+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:48.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.906+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:48.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.906+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-09T14:49:48.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.906+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18315478310377188019', time=2024-03-09T16:49:20.743754+0000, chain.objs.size()=1 2024-03-09T14:49:48.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.906+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.90__shadow_.JUrDDzya8BgZkqxNH0yCILekxjJ-dvh_0 2024-03-09T14:49:48.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.906+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10885635094554348404', time=2024-03-09T16:49:34.606715+0000, chain.objs.size()=1 2024-03-09T14:49:48.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.906+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.104__shadow_.EQFUYbn1zRNeeYw3ONla8EfSMMmxbXA_0 2024-03-09T14:49:48.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.906+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9992267799972629091', time=2024-03-09T16:49:35.050756+0000, chain.objs.size()=1 2024-03-09T14:49:48.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.906+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.105__shadow_.tv_BQcil3aiAackY9Xikjo9kn9mO9TQ_0 2024-03-09T14:49:48.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.906+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7266819477049171407', time=2024-03-09T16:49:35.997634+0000, chain.objs.size()=1 2024-03-09T14:49:48.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.906+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.107__shadow_.XvCcg-spZTrgr7WBv9VJ6WRR_4I2ThB_0 2024-03-09T14:49:48.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.906+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17657983924958140285', time=2024-03-09T16:49:38.299734+0000, chain.objs.size()=1 2024-03-09T14:49:48.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.906+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.112__shadow_.ZXGpXmzy-4DwaCS490BEZoh_JO7oK95_0 2024-03-09T14:49:48.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.914+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:48.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.918+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:49:48.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.922+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:48.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.922+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:48.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.922+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:49:48.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.922+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13101762281208896699', time=2024-03-09T16:49:35.507323+0000, chain.objs.size()=1 2024-03-09T14:49:48.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.922+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.106__shadow_.YJGHXZEbTuCu_HUaxfgNMfVYi5VxYQJ_0 2024-03-09T14:49:48.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.922+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18094553655796169127', time=2024-03-09T16:49:37.349133+0000, chain.objs.size()=1 2024-03-09T14:49:48.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.922+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.110__shadow_.fFYZLO46oMPRVirquNRoQ_H8YkfUF7J_0 2024-03-09T14:49:48.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.922+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13096852712917955557', time=2024-03-09T16:49:43.335400+0000, chain.objs.size()=1 2024-03-09T14:49:48.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.922+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.123__shadow_.j8egyGvZXltkubUJImIoqu7W7_NyKq1_0 2024-03-09T14:49:48.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.926+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:48.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.930+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:49:48.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.934+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:48.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.934+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:48.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.938+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-09T14:49:48.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.938+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14513344338223593792', time=2024-03-09T16:49:26.901274+0000, chain.objs.size()=5 2024-03-09T14:49:48.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.938+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~NOakBgt0Tbe3iMnb_w8w6SO0U7fEqvz.1 2024-03-09T14:49:48.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.938+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__shadow_key1.2~NOakBgt0Tbe3iMnb_w8w6SO0U7fEqvz.1_1 2024-03-09T14:49:48.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.938+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~NOakBgt0Tbe3iMnb_w8w6SO0U7fEqvz.2 2024-03-09T14:49:48.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.938+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__shadow_key1.2~NOakBgt0Tbe3iMnb_w8w6SO0U7fEqvz.2_1 2024-03-09T14:49:48.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.938+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~NOakBgt0Tbe3iMnb_w8w6SO0U7fEqvz.3 2024-03-09T14:49:48.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.938+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11964400582940846725', time=2024-03-09T16:49:38.253776+0000, chain.objs.size()=1 2024-03-09T14:49:48.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.938+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.112__shadow_.EVu_82-S7iKvhLU3f8EKkAAVCMoxlUJ_0 2024-03-09T14:49:48.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.938+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.482310524114531594', time=2024-03-09T16:49:40.685895+0000, chain.objs.size()=1 2024-03-09T14:49:48.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.938+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.117__shadow_.zA1QIGa9xZP02ox5ndoyXAY9HekHrIV_0 2024-03-09T14:49:48.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.938+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2474668028260254460', time=2024-03-09T16:49:41.653098+0000, chain.objs.size()=1 2024-03-09T14:49:48.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.938+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.119__shadow_.0Enk7v2RQwVRpBczgt6leBUrSKtU3gH_0 2024-03-09T14:49:48.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.938+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6266414508509559071', time=2024-03-09T16:49:42.455786+0000, chain.objs.size()=1 2024-03-09T14:49:48.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.938+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.121__shadow_.0ZbmR0piU3HrslzUXuBGuWU1Ut_DH5R_0 2024-03-09T14:49:48.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.938+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17397082982501953125', time=2024-03-09T16:49:45.051928+0000, chain.objs.size()=1 2024-03-09T14:49:48.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.938+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.128__shadow_.tvXzXsinS7B22kYsx2j7lYd77cVVAWG_0 2024-03-09T14:49:48.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.950+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:48.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.958+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:49:48.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.958+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:48.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.958+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:48.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.962+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T14:49:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.962+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16961342120266318658', time=2024-03-09T16:49:20.716714+0000, chain.objs.size()=5 2024-03-09T14:49:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.962+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.90__multipart_file2.mpg.2~b_q0msQsEdKk6vFmA40hkAWb_81Jhql.1 2024-03-09T14:49:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.962+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.90__multipart_file2.mpg.2~b_q0msQsEdKk6vFmA40hkAWb_81Jhql.2 2024-03-09T14:49:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.962+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.90__multipart_file2.mpg.2~b_q0msQsEdKk6vFmA40hkAWb_81Jhql.3 2024-03-09T14:49:48.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.962+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.90__multipart_file2.mpg.2~b_q0msQsEdKk6vFmA40hkAWb_81Jhql.4 2024-03-09T14:49:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.962+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.90__multipart_file2.mpg.2~b_q0msQsEdKk6vFmA40hkAWb_81Jhql.5 2024-03-09T14:49:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.962+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16137616772866843234', time=2024-03-09T16:49:35.986597+0000, chain.objs.size()=1 2024-03-09T14:49:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.962+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.107__shadow_.MUXQBM5XGBhN-Y-2-Nh1AIvK60-eqke_0 2024-03-09T14:49:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.962+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1558278757868317622', time=2024-03-09T16:49:37.819229+0000, chain.objs.size()=1 2024-03-09T14:49:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.962+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.111__shadow_.uayfvAJOJFtdKWdKLLMTlCRNjSCGLFL_0 2024-03-09T14:49:48.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.962+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6272988713924244452', time=2024-03-09T16:49:45.707676+0000, chain.objs.size()=1 2024-03-09T14:49:48.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.962+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.129__shadow_.tYAFdPfquOyhZIekoFWeMbrFCvahBP1_0 2024-03-09T14:49:48.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.970+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:48.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.978+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:49:48.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.978+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:48.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:48.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-09T14:49:48.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8032508212382671983', time=2024-03-09T16:49:19.926814+0000, chain.objs.size()=5 2024-03-09T14:49:48.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.89__multipart_key1.2~bzBd4jGd8f5xFMA8ycFYpENw6BF1HpT.1 2024-03-09T14:49:48.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.89__multipart_key1.2~bzBd4jGd8f5xFMA8ycFYpENw6BF1HpT.2 2024-03-09T14:49:48.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.89__multipart_key1.2~bzBd4jGd8f5xFMA8ycFYpENw6BF1HpT.3 2024-03-09T14:49:48.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.89__multipart_key1.2~bzBd4jGd8f5xFMA8ycFYpENw6BF1HpT.4 2024-03-09T14:49:48.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.89__multipart_key1.2~bzBd4jGd8f5xFMA8ycFYpENw6BF1HpT.5 2024-03-09T14:49:48.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15146022646496353398', time=2024-03-09T16:49:34.635923+0000, chain.objs.size()=1 2024-03-09T14:49:48.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.104__shadow_.Xxc0r5QMBEDq0yb60HNeB8mroRYINXS_0 2024-03-09T14:49:48.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9620411376074363097', time=2024-03-09T16:49:38.707324+0000, chain.objs.size()=1 2024-03-09T14:49:48.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.113__shadow_.IBibBTUXpsQOMVL3QswMYB_U9aYv2wH_0 2024-03-09T14:49:48.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.945533248151450628', time=2024-03-09T16:49:41.159852+0000, chain.objs.size()=1 2024-03-09T14:49:48.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.118__shadow_.EXCRW6iu_AWLNz2F1ECErCQbl3KGMaR_0 2024-03-09T14:49:48.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17606385643805689055', time=2024-03-09T16:49:42.041296+0000, chain.objs.size()=1 2024-03-09T14:49:48.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.120__shadow_.bvYgwQa_m5B87Nkz1VHrCkVjk2A7z33_0 2024-03-09T14:49:48.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3173870164597311155', time=2024-03-09T16:49:46.068012+0000, chain.objs.size()=1 2024-03-09T14:49:48.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.982+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.130__shadow_.6pMP5FpozkCExo-Qj0JGIR9mCt4MwEu_0 2024-03-09T14:49:48.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.994+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:48.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:48.998+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:49:48.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:48.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-09T14:49:49.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11132449952320801923', time=2024-03-09T16:49:24.140741+0000, chain.objs.size()=5 2024-03-09T14:49:49.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~dDw4oSnY5SppFtpCtEM_xA-U0njb3WH.1 2024-03-09T14:49:49.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~dDw4oSnY5SppFtpCtEM_xA-U0njb3WH.2 2024-03-09T14:49:49.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~dDw4oSnY5SppFtpCtEM_xA-U0njb3WH.3 2024-03-09T14:49:49.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~dDw4oSnY5SppFtpCtEM_xA-U0njb3WH.4 2024-03-09T14:49:49.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~dDw4oSnY5SppFtpCtEM_xA-U0njb3WH.5 2024-03-09T14:49:49.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9540362106968646589', time=2024-03-09T16:49:31.652018+0000, chain.objs.size()=1 2024-03-09T14:49:49.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.96__shadow_.ffJ2LpFxcNEvJAXFHTsyBqm74O3454y_0 2024-03-09T14:49:49.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.867385163344393115', time=2024-03-09T16:49:33.674014+0000, chain.objs.size()=1 2024-03-09T14:49:49.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.102__shadow_.Uy8NYKsri1NzI8Xf_7NKHWdbfz3npTv_0 2024-03-09T14:49:49.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1995915072723885221', time=2024-03-09T16:49:34.621358+0000, chain.objs.size()=1 2024-03-09T14:49:49.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.104__shadow_.4Q1totPDHR095dSenib0NAY4dbJVwVh_0 2024-03-09T14:49:49.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8408879156831012986', time=2024-03-09T16:49:36.460486+0000, chain.objs.size()=1 2024-03-09T14:49:49.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.108__shadow_.2XZq56OBxYJ23HhzJQOIslRB3J_kr3C_0 2024-03-09T14:49:49.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10656404674878266247', time=2024-03-09T16:49:37.801771+0000, chain.objs.size()=1 2024-03-09T14:49:49.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.111__shadow_.C5fpFPwZi4oKIx1u2gv1IwDqY87Z9kZ_0 2024-03-09T14:49:49.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5321703147436530115', time=2024-03-09T16:49:41.619214+0000, chain.objs.size()=1 2024-03-09T14:49:49.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.006+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.119__shadow_.vvFC0dV012cKHxhON8FnBlQC6PMujBN_0 2024-03-09T14:49:49.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.018+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.022+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:49:49.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.026+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.026+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.026+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:49:49.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.026+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16297838414394277634', time=2024-03-09T16:49:20.683467+0000, chain.objs.size()=5 2024-03-09T14:49:49.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.026+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.90__multipart_file.mpg.2~U8eBMIO8ckLRhmsFKiZgC6jqouUU71m.1 2024-03-09T14:49:49.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.026+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.90__multipart_file.mpg.2~U8eBMIO8ckLRhmsFKiZgC6jqouUU71m.2 2024-03-09T14:49:49.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.026+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.90__multipart_file.mpg.2~U8eBMIO8ckLRhmsFKiZgC6jqouUU71m.3 2024-03-09T14:49:49.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.026+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.90__multipart_file.mpg.2~U8eBMIO8ckLRhmsFKiZgC6jqouUU71m.4 2024-03-09T14:49:49.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.026+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.90__multipart_file.mpg.2~U8eBMIO8ckLRhmsFKiZgC6jqouUU71m.5 2024-03-09T14:49:49.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.026+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1051184802909367600', time=2024-03-09T16:49:35.065171+0000, chain.objs.size()=1 2024-03-09T14:49:49.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.026+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.105__shadow_.g1wSe0vRHn6cmV8pETiJszil_OZ3I1j_0 2024-03-09T14:49:49.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.026+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9847283531012834768', time=2024-03-09T16:49:40.241156+0000, chain.objs.size()=1 2024-03-09T14:49:49.022 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.026+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.116__shadow_.Hecgmg2C_xwcxkXQg7VKJVPfGZcTkob_0 2024-03-09T14:49:49.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.038+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.042+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:49:49.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-09T14:49:49.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='2~aO23BZGtT9_uty8hWDTZGj_4nONYMBQ', time=2024-03-09T16:49:04.803291+0000, chain.objs.size()=5 2024-03-09T14:49:49.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.69__multipart_key1.2~aO23BZGtT9_uty8hWDTZGj_4nONYMBQ.1 2024-03-09T14:49:49.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.69__multipart_key1.2~aO23BZGtT9_uty8hWDTZGj_4nONYMBQ.2 2024-03-09T14:49:49.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.69__multipart_key1.2~aO23BZGtT9_uty8hWDTZGj_4nONYMBQ.3 2024-03-09T14:49:49.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.69__multipart_key1.2~aO23BZGtT9_uty8hWDTZGj_4nONYMBQ.4 2024-03-09T14:49:49.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.69__multipart_key1.2~aO23BZGtT9_uty8hWDTZGj_4nONYMBQ.5 2024-03-09T14:49:49.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1912402226839833262', time=2024-03-09T16:49:24.795926+0000, chain.objs.size()=5 2024-03-09T14:49:49.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~0yj1hKGF1UsAAyfM2mARF13HDo5Nxez.1 2024-03-09T14:49:49.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~0yj1hKGF1UsAAyfM2mARF13HDo5Nxez.2 2024-03-09T14:49:49.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~0yj1hKGF1UsAAyfM2mARF13HDo5Nxez.3 2024-03-09T14:49:49.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~0yj1hKGF1UsAAyfM2mARF13HDo5Nxez.4 2024-03-09T14:49:49.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~0yj1hKGF1UsAAyfM2mARF13HDo5Nxez.5 2024-03-09T14:49:49.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8458915494331382437', time=2024-03-09T16:49:34.126977+0000, chain.objs.size()=1 2024-03-09T14:49:49.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.103__shadow_.0jAMUN7s9jCLG5a_qPGfPW3D1PeODAO_0 2024-03-09T14:49:49.042 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12966517706346726831', time=2024-03-09T16:49:35.521618+0000, chain.objs.size()=1 2024-03-09T14:49:49.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.046+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.106__shadow_.lo3ed60YPeUh1qSDMY67u5BgMjzkuQe_0 2024-03-09T14:49:49.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.054+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15388634684813499852', time=2024-03-09T16:49:38.724185+0000, chain.objs.size()=1 2024-03-09T14:49:49.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.054+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.113__shadow_.0z0ZFr0yDCK0gLdZKzrj3k4ykA8kebd_0 2024-03-09T14:49:49.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.062+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.066+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:49:49.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.070+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.070+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.070+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:49:49.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.070+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16447837041077117687', time=2024-03-09T16:49:39.798891+0000, chain.objs.size()=1 2024-03-09T14:49:49.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.070+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.115__shadow_._fMH3OCoeZnATuxFLr2C2_08D41oOFM_0 2024-03-09T14:49:49.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.070+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5255146535630317528', time=2024-03-09T16:49:40.269310+0000, chain.objs.size()=1 2024-03-09T14:49:49.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.070+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.116__shadow_.RoUtCh4ZRVnLly5oe99B3vNzXGQ2lUc_0 2024-03-09T14:49:49.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.074+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.078+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:49:49.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.082+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.082+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.082+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T14:49:49.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.082+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9942220797984993236', time=2024-03-09T16:49:35.082351+0000, chain.objs.size()=1 2024-03-09T14:49:49.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.082+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.105__shadow_.qTp9lZwPALQlHeQNRiuqtxZQECix2NI_0 2024-03-09T14:49:49.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.082+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14880363641906201052', time=2024-03-09T16:49:37.376504+0000, chain.objs.size()=1 2024-03-09T14:49:49.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.082+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.110__shadow_.rK2GWhfW2_8AZFppIVJFZXWP3l23iq4_0 2024-03-09T14:49:49.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.082+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13216605513718804350', time=2024-03-09T16:49:41.177259+0000, chain.objs.size()=1 2024-03-09T14:49:49.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.082+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.118__shadow_.2n-1hIEEBvD4H-xUMadRX8TRL8jeM_O_0 2024-03-09T14:49:49.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.082+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5176479584648758455', time=2024-03-09T16:49:41.191435+0000, chain.objs.size()=1 2024-03-09T14:49:49.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.082+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.118__shadow_.4RT4TaQTB74bDrg3Ex1TXFyGr7gHUAq_0 2024-03-09T14:49:49.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.086+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.090+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:49:49.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.090+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.090+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.094+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-09T14:49:49.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.094+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.422915315214403149', time=2024-03-09T16:49:06.838850+0000, chain.objs.size()=2 2024-03-09T14:49:49.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.094+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.73__shadow_.JB7m39ZkMsZ9btm9UG51MtINpdJl7QK_0 2024-03-09T14:49:49.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.094+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.73__shadow_.JB7m39ZkMsZ9btm9UG51MtINpdJl7QK_1 2024-03-09T14:49:49.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.094+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1606223294634802086', time=2024-03-09T16:49:16.955849+0000, chain.objs.size()=4 2024-03-09T14:49:49.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.094+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.83__shadow_.OaerGV42A4zswbhzkJ-HoDb3gger2is_0 2024-03-09T14:49:49.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.094+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.83__shadow_.OaerGV42A4zswbhzkJ-HoDb3gger2is_1 2024-03-09T14:49:49.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.094+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.83__shadow_.OaerGV42A4zswbhzkJ-HoDb3gger2is_2 2024-03-09T14:49:49.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.094+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.83__shadow_.OaerGV42A4zswbhzkJ-HoDb3gger2is_3 2024-03-09T14:49:49.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.094+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.703675354010935961', time=2024-03-09T16:49:38.695811+0000, chain.objs.size()=1 2024-03-09T14:49:49.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.094+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.113__shadow_.bcK5sJ1pS7TV3vDsjWWs5HakBURaxx3_0 2024-03-09T14:49:49.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.094+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4604940554146627096', time=2024-03-09T16:49:39.772948+0000, chain.objs.size()=1 2024-03-09T14:49:49.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.094+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.115__shadow_.LoNZLL8C6Iz_-4tJ7YFVXyPp6x6u5J4_0 2024-03-09T14:49:49.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.094+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13830771180517810639', time=2024-03-09T16:49:41.641988+0000, chain.objs.size()=1 2024-03-09T14:49:49.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.094+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.119__shadow_.pn5uAE3zhaMSiUNBijDqTKerQEZgY2e_0 2024-03-09T14:49:49.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.102+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.106+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:49:49.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.110+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.110+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.110+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:49:49.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.110+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13533883295205731358', time=2024-03-09T16:49:37.359618+0000, chain.objs.size()=1 2024-03-09T14:49:49.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.110+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.110__shadow_.vHsel8jFq2CfHxe31jknjtKW0Kv7VeA_0 2024-03-09T14:49:49.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.110+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11058092618133594864', time=2024-03-09T16:49:39.136069+0000, chain.objs.size()=1 2024-03-09T14:49:49.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.110+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.114__shadow_.iruhym-P7tsQpPg8Komz4SoFpiDQdTz_0 2024-03-09T14:49:49.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.110+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10641958589655076239', time=2024-03-09T16:49:42.901970+0000, chain.objs.size()=1 2024-03-09T14:49:49.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.110+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.122__shadow_.8PyTbDiv0F1Qu-_duHQXtx0ZykaZvRX_0 2024-03-09T14:49:49.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.114+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.118+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:49:49.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.122+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.122+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.122+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-03-09T14:49:49.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.122+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7503796942332408495', time=2024-03-09T16:49:35.489601+0000, chain.objs.size()=1 2024-03-09T14:49:49.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.122+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.106__shadow_.tDXgW6wfw1P2L1eazLqapQWtBsZvfPk_0 2024-03-09T14:49:49.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.122+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4067962710884567593', time=2024-03-09T16:49:44.987399+0000, chain.objs.size()=1 2024-03-09T14:49:49.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.122+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.128__shadow_.UG1zvMA87y0goXud05mld6lce6cpjxv_0 2024-03-09T14:49:49.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.126+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.130+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:49:49.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.130+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.130+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.134+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T14:49:49.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.134+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.81__multipart_key1.2~ho-0Rgw_TdNnhBrg2GcE1K6pqCteSfm.2_cb5cc253c85ce2b9b75e4fdb38a1ded5', time=2024-03-09T16:49:10.301792+0000, chain.objs.size()=5 2024-03-09T14:49:49.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.134+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.81__multipart_key1.2~ho-0Rgw_TdNnhBrg2GcE1K6pqCteSfm.1 2024-03-09T14:49:49.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.134+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.81__multipart_key1.2~ho-0Rgw_TdNnhBrg2GcE1K6pqCteSfm.2 2024-03-09T14:49:49.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.134+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.81__multipart_key1.2~ho-0Rgw_TdNnhBrg2GcE1K6pqCteSfm.3 2024-03-09T14:49:49.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.134+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.81__multipart_key1.2~ho-0Rgw_TdNnhBrg2GcE1K6pqCteSfm.4 2024-03-09T14:49:49.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.134+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.81__multipart_key1.2~ho-0Rgw_TdNnhBrg2GcE1K6pqCteSfm.5 2024-03-09T14:49:49.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.134+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1113625541117130539', time=2024-03-09T16:49:13.709029+0000, chain.objs.size()=5 2024-03-09T14:49:49.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.134+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~Y9qZJaGKllcJeVnVjGVY7lBpeuxAnHB.1 2024-03-09T14:49:49.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.134+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~Y9qZJaGKllcJeVnVjGVY7lBpeuxAnHB.2 2024-03-09T14:49:49.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.134+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~Y9qZJaGKllcJeVnVjGVY7lBpeuxAnHB.3 2024-03-09T14:49:49.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.134+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~Y9qZJaGKllcJeVnVjGVY7lBpeuxAnHB.4 2024-03-09T14:49:49.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.134+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~Y9qZJaGKllcJeVnVjGVY7lBpeuxAnHB.5 2024-03-09T14:49:49.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.134+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14955891365987860788', time=2024-03-09T16:49:25.422279+0000, chain.objs.size()=5 2024-03-09T14:49:49.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.134+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~wO-SfqjH_39CxTwHtetm5vy4osYmMhW.1 2024-03-09T14:49:49.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.134+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~wO-SfqjH_39CxTwHtetm5vy4osYmMhW.2 2024-03-09T14:49:49.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.138+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~wO-SfqjH_39CxTwHtetm5vy4osYmMhW.3 2024-03-09T14:49:49.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.138+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~wO-SfqjH_39CxTwHtetm5vy4osYmMhW.4 2024-03-09T14:49:49.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.138+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~wO-SfqjH_39CxTwHtetm5vy4osYmMhW.5 2024-03-09T14:49:49.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.138+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1482619256716343641', time=2024-03-09T16:49:29.192459+0000, chain.objs.size()=5 2024-03-09T14:49:49.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.138+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.93__multipart_key1.2~z0sss7BP8pNbLCjRQLfnrW7S_psiDzD.1 2024-03-09T14:49:49.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.142+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.93__multipart_key1.2~z0sss7BP8pNbLCjRQLfnrW7S_psiDzD.2 2024-03-09T14:49:49.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.142+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.93__multipart_key1.2~z0sss7BP8pNbLCjRQLfnrW7S_psiDzD.3 2024-03-09T14:49:49.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.142+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.93__multipart_key1.2~z0sss7BP8pNbLCjRQLfnrW7S_psiDzD.4 2024-03-09T14:49:49.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.142+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.93__multipart_key1.2~z0sss7BP8pNbLCjRQLfnrW7S_psiDzD.5 2024-03-09T14:49:49.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.150+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.154+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:49:49.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.158+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.158+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.158+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:49:49.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.158+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4186726920589312877', time=2024-03-09T16:49:05.732535+0000, chain.objs.size()=1 2024-03-09T14:49:49.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.158+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.71__shadow_.lLC78urKpFtnWwXvq4vThuKbAsPSor0_0 2024-03-09T14:49:49.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.158+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4617671265400370288', time=2024-03-09T16:49:20.698614+0000, chain.objs.size()=1 2024-03-09T14:49:49.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.158+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.90__shadow_.nnijJwIOb9TE-4ANhrzJVDHTnbBQ43w_0 2024-03-09T14:49:49.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.158+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4972781605320126584', time=2024-03-09T16:49:44.378337+0000, chain.objs.size()=1 2024-03-09T14:49:49.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.158+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.126__shadow_.RnUOaiLN2A5-R4i-pZkYfmfTbkRsBUP_0 2024-03-09T14:49:49.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.162+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.166+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:49:49.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.166+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.170+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.170+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-09T14:49:49.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.170+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6242861646964804545', time=2024-03-09T16:49:33.646265+0000, chain.objs.size()=1 2024-03-09T14:49:49.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.170+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.102__shadow_.7DHatHg8K5dlgSB10M_rqW4iCCN__vq_0 2024-03-09T14:49:49.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.170+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13282282346129383291', time=2024-03-09T16:49:34.168105+0000, chain.objs.size()=1 2024-03-09T14:49:49.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.170+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.103__shadow_.X1q19lRxK4dzt25lMDN-uzqEu3u6wa9_0 2024-03-09T14:49:49.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.170+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7563925432442267832', time=2024-03-09T16:49:37.389687+0000, chain.objs.size()=1 2024-03-09T14:49:49.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.170+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.110__shadow_.wr6XR7Dci0XEcGx5nug0KD4kZ9n-xue_0 2024-03-09T14:49:49.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.170+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12985195628045344840', time=2024-03-09T16:49:38.286509+0000, chain.objs.size()=1 2024-03-09T14:49:49.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.170+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.112__shadow_.Nd3J86gENUoH7HpAFN1kj6qedM_UlG5_0 2024-03-09T14:49:49.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.170+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7413136188435102240', time=2024-03-09T16:49:40.703195+0000, chain.objs.size()=1 2024-03-09T14:49:49.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.170+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.117__shadow_.FQz86suG8TR_PwKIBB6AwOEIwv4eGXy_0 2024-03-09T14:49:49.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.170+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6184060404477502717', time=2024-03-09T16:49:43.317295+0000, chain.objs.size()=1 2024-03-09T14:49:49.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.170+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.123__shadow_.-gdDFkx-ORZI91cLykFEHfYbCgVf_SQ_0 2024-03-09T14:49:49.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.174+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:49:49.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T14:49:49.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16290123802486464362', time=2024-03-09T16:49:12.774614+0000, chain.objs.size()=5 2024-03-09T14:49:49.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~8OzTQutM5WAl-4Fs99qZLPbJrhQAxyx.1 2024-03-09T14:49:49.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~8OzTQutM5WAl-4Fs99qZLPbJrhQAxyx.2 2024-03-09T14:49:49.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~8OzTQutM5WAl-4Fs99qZLPbJrhQAxyx.3 2024-03-09T14:49:49.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~8OzTQutM5WAl-4Fs99qZLPbJrhQAxyx.4 2024-03-09T14:49:49.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~8OzTQutM5WAl-4Fs99qZLPbJrhQAxyx.5 2024-03-09T14:49:49.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.462947998598967650', time=2024-03-09T16:49:30.298467+0000, chain.objs.size()=5 2024-03-09T14:49:49.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.94__multipart_key1.2~9JtXwGcUdRAvRJU33XYQyG1rsok146Y.1 2024-03-09T14:49:49.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.94__multipart_key1.2~9JtXwGcUdRAvRJU33XYQyG1rsok146Y.2 2024-03-09T14:49:49.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.94__multipart_key1.2~9JtXwGcUdRAvRJU33XYQyG1rsok146Y.3 2024-03-09T14:49:49.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.94__multipart_key1.2~9JtXwGcUdRAvRJU33XYQyG1rsok146Y.4 2024-03-09T14:49:49.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.94__multipart_key1.2~9JtXwGcUdRAvRJU33XYQyG1rsok146Y.5 2024-03-09T14:49:49.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7478254047952753005', time=2024-03-09T16:49:35.533242+0000, chain.objs.size()=1 2024-03-09T14:49:49.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.106__shadow_.YunwPn5dJPfKL2mmF1C83d3kGsAkBJ9_0 2024-03-09T14:49:49.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12860316200345267930', time=2024-03-09T16:49:48.167687+0000, chain.objs.size()=1 2024-03-09T14:49:49.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.178+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.134__shadow_.72pqJMhmig2K_J_rL-n9_cxTAqOZi1D_0 2024-03-09T14:49:49.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.190+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.194+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:49:49.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.194+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-09T14:49:49.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1480340013552919002', time=2024-03-09T16:49:16.786652+0000, chain.objs.size()=5 2024-03-09T14:49:49.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~iOnkVlvYPzhKtVZn4J4CzfQNivvgP6X.1 2024-03-09T14:49:49.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__shadow_key1.2~iOnkVlvYPzhKtVZn4J4CzfQNivvgP6X.1_1 2024-03-09T14:49:49.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~iOnkVlvYPzhKtVZn4J4CzfQNivvgP6X.2 2024-03-09T14:49:49.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__shadow_key1.2~iOnkVlvYPzhKtVZn4J4CzfQNivvgP6X.2_1 2024-03-09T14:49:49.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~iOnkVlvYPzhKtVZn4J4CzfQNivvgP6X.3 2024-03-09T14:49:49.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3164954024038476706', time=2024-03-09T16:49:27.395107+0000, chain.objs.size()=5 2024-03-09T14:49:49.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~SwdZyrUrA3jJTgoPrQP5gXid7S7dizg.1 2024-03-09T14:49:49.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__shadow_key1.2~SwdZyrUrA3jJTgoPrQP5gXid7S7dizg.1_1 2024-03-09T14:49:49.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~SwdZyrUrA3jJTgoPrQP5gXid7S7dizg.2 2024-03-09T14:49:49.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__shadow_key1.2~SwdZyrUrA3jJTgoPrQP5gXid7S7dizg.2_1 2024-03-09T14:49:49.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~SwdZyrUrA3jJTgoPrQP5gXid7S7dizg.3 2024-03-09T14:49:49.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8393470602707246567', time=2024-03-09T16:49:28.551014+0000, chain.objs.size()=1 2024-03-09T14:49:49.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.93__shadow_.JkXbcNrDW6Q1vp3h5Dz9mnpE6QAodG3_0 2024-03-09T14:49:49.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1815961443260434592', time=2024-03-09T16:49:34.150354+0000, chain.objs.size()=1 2024-03-09T14:49:49.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.198+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.103__shadow_.tulN91NjcLd-5tEIrXaEJh1vU84mXzT_0 2024-03-09T14:49:49.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.206+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5677997870363707642', time=2024-03-09T16:49:36.446657+0000, chain.objs.size()=1 2024-03-09T14:49:49.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.206+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.108__shadow_.KtqS0XHsNXJsCF5f1WN19KyHLhJC_wK_0 2024-03-09T14:49:49.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.206+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13224172358267930339', time=2024-03-09T16:49:40.255313+0000, chain.objs.size()=1 2024-03-09T14:49:49.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.206+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.116__shadow_.ECTin96FjHDbXkNtNIJ-AVTk1Dr1egj_0 2024-03-09T14:49:49.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.210+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.214+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:49:49.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.214+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.214+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.214+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:49:49.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.214+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12070936648037895302', time=2024-03-09T16:49:10.489992+0000, chain.objs.size()=5 2024-03-09T14:49:49.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.214+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.81__multipart_key1.2~ho-0Rgw_TdNnhBrg2GcE1K6pqCteSfm.1 2024-03-09T14:49:49.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.214+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.81__multipart_key1.2~ho-0Rgw_TdNnhBrg2GcE1K6pqCteSfm.2 2024-03-09T14:49:49.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.214+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.81__multipart_key1.2~ho-0Rgw_TdNnhBrg2GcE1K6pqCteSfm.3 2024-03-09T14:49:49.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.214+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.81__multipart_key1.2~ho-0Rgw_TdNnhBrg2GcE1K6pqCteSfm.4 2024-03-09T14:49:49.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.214+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.81__multipart_key1.2~ho-0Rgw_TdNnhBrg2GcE1K6pqCteSfm.5 2024-03-09T14:49:49.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.214+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10441528343653468031', time=2024-03-09T16:49:42.057713+0000, chain.objs.size()=1 2024-03-09T14:49:49.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.214+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.120__shadow_.ADrLRzy-lU3byvqk_8VFSag5GLW6BVa_0 2024-03-09T14:49:49.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.214+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16041573957628909971', time=2024-03-09T16:49:43.301292+0000, chain.objs.size()=1 2024-03-09T14:49:49.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.214+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.123__shadow_.P_CHxgGfHCnOil74aAeCfZ8TkRNyfah_0 2024-03-09T14:49:49.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.218+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.222+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:49:49.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.222+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.222+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.226+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T14:49:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.226+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.787909809439756757', time=2024-03-09T16:49:20.728683+0000, chain.objs.size()=1 2024-03-09T14:49:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.226+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.90__shadow_.OTgVLsNExCqDyicHzV6MPKY58ORPVIE_0 2024-03-09T14:49:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.226+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15947661175075426454', time=2024-03-09T16:49:36.431917+0000, chain.objs.size()=1 2024-03-09T14:49:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.226+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.108__shadow_.-f0IO6QBQHyfWW8kmBDfCrcQZmOGFuO_0 2024-03-09T14:49:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.226+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7341169335787301573', time=2024-03-09T16:49:36.919190+0000, chain.objs.size()=1 2024-03-09T14:49:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.226+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.109__shadow_.8pw9-u79C81M5nyyfBjvzNaVKfWk_nK_0 2024-03-09T14:49:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.226+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10102366993526512840', time=2024-03-09T16:49:48.155442+0000, chain.objs.size()=5 2024-03-09T14:49:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.226+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.134__multipart_key1/data/file.mpg.2~uZOV5eYMue5QFObpcdqXpiqK7m_AqQp.1 2024-03-09T14:49:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.226+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.134__multipart_key1/data/file.mpg.2~uZOV5eYMue5QFObpcdqXpiqK7m_AqQp.2 2024-03-09T14:49:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.226+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.134__multipart_key1/data/file.mpg.2~uZOV5eYMue5QFObpcdqXpiqK7m_AqQp.3 2024-03-09T14:49:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.226+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.134__multipart_key1/data/file.mpg.2~uZOV5eYMue5QFObpcdqXpiqK7m_AqQp.4 2024-03-09T14:49:49.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.226+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.134__multipart_key1/data/file.mpg.2~uZOV5eYMue5QFObpcdqXpiqK7m_AqQp.5 2024-03-09T14:49:49.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.230+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.234+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:49:49.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.238+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.238+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.238+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-09T14:49:49.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.238+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4183606842950952941', time=2024-03-09T16:49:02.447560+0000, chain.objs.size()=1 2024-03-09T14:49:49.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.238+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.67__shadow_.u1ltpUyfgp0xBLH5PI52G8KI9-J5uYR_0 2024-03-09T14:49:49.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.238+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5108535324622230475', time=2024-03-09T16:49:07.611412+0000, chain.objs.size()=1 2024-03-09T14:49:49.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.238+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.75__shadow_.3bEmRO3wZNbUHEIuciQ2CmsqIj2hdHX_0 2024-03-09T14:49:49.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.238+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16967198360444503943', time=2024-03-09T16:49:34.140414+0000, chain.objs.size()=1 2024-03-09T14:49:49.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.238+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.103__shadow_.uWoTZnsAeHoFAYr9tvLqe-ROQg5Waq6_0 2024-03-09T14:49:49.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.238+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4539521950075536399', time=2024-03-09T16:49:38.271684+0000, chain.objs.size()=1 2024-03-09T14:49:49.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.238+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.112__shadow_.KVY0KjPop8wviXOkAPprNOay4wpc0Z-_0 2024-03-09T14:49:49.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.238+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2130499609026791021', time=2024-03-09T16:49:42.474767+0000, chain.objs.size()=1 2024-03-09T14:49:49.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.238+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.121__shadow_.WBmkKKfPERhPu70kJKQv8v0nu2l474R_0 2024-03-09T14:49:49.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.242+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.246+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:49:49.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.246+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.246+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.246+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-09T14:49:49.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.246+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1430042930842513585', time=2024-03-09T16:49:41.608727+0000, chain.objs.size()=1 2024-03-09T14:49:49.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.246+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.119__shadow_.DTojzRInAX3ImB6agaFTJsRsOsifpMC_0 2024-03-09T14:49:49.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.250+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.250+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:49:49.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.254+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.254+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.254+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:49:49.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.254+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16714325904267373241', time=2024-03-09T16:49:35.955882+0000, chain.objs.size()=1 2024-03-09T14:49:49.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.254+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.107__shadow_.vnMWVr9ABh4Mci-rJaIoUzIf8PmHsF5_0 2024-03-09T14:49:49.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.254+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3704236575524332522', time=2024-03-09T16:49:40.229404+0000, chain.objs.size()=1 2024-03-09T14:49:49.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.254+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.116__shadow_.73xRgQMJiyMVU1YmelBF4IUWrkzQ5mq_0 2024-03-09T14:49:49.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.254+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4035691435590187687', time=2024-03-09T16:49:44.709111+0000, chain.objs.size()=1 2024-03-09T14:49:49.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.254+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.127__shadow_.pxGw0XmmZV9mPe6waPoUeV2GRTA25SG_0 2024-03-09T14:49:49.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.254+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.258+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:49:49.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.262+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.262+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.262+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:49:49.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.262+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7147440966249810049', time=2024-03-09T16:49:17.142313+0000, chain.objs.size()=5 2024-03-09T14:49:49.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.262+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~ymMd5fSqoglzCRpzPQUWv-dX4XqIPkf.1 2024-03-09T14:49:49.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.262+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__shadow_key1.2~ymMd5fSqoglzCRpzPQUWv-dX4XqIPkf.1_1 2024-03-09T14:49:49.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.262+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~ymMd5fSqoglzCRpzPQUWv-dX4XqIPkf.2 2024-03-09T14:49:49.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.262+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__shadow_key1.2~ymMd5fSqoglzCRpzPQUWv-dX4XqIPkf.2_1 2024-03-09T14:49:49.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.262+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~ymMd5fSqoglzCRpzPQUWv-dX4XqIPkf.3 2024-03-09T14:49:49.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.262+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7913476503578999660', time=2024-03-09T16:49:33.657466+0000, chain.objs.size()=1 2024-03-09T14:49:49.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.262+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.102__shadow_.q_Uk5hkbrk-MJ5m9iRQIZedqPS3obE-_0 2024-03-09T14:49:49.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.262+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7180139110946751836', time=2024-03-09T16:49:34.592538+0000, chain.objs.size()=1 2024-03-09T14:49:49.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.262+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.104__shadow_.Iggt-mqa7F-SVQZthF1i6oyZqSNjNXV_0 2024-03-09T14:49:49.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.266+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.270+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:49:49.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-03-09T14:49:49.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1412022625322665466', time=2024-03-09T16:49:14.452696+0000, chain.objs.size()=5 2024-03-09T14:49:49.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~f__bPbujenDkmMwBginggcnucJAWICG.1 2024-03-09T14:49:49.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~f__bPbujenDkmMwBginggcnucJAWICG.2 2024-03-09T14:49:49.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~f__bPbujenDkmMwBginggcnucJAWICG.3 2024-03-09T14:49:49.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~f__bPbujenDkmMwBginggcnucJAWICG.4 2024-03-09T14:49:49.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~f__bPbujenDkmMwBginggcnucJAWICG.5 2024-03-09T14:49:49.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3501044515089971074', time=2024-03-09T16:49:33.694336+0000, chain.objs.size()=1 2024-03-09T14:49:49.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.102__shadow_.7JxEvsetA6V0INxioLrEPiAG3GqNAxW_0 2024-03-09T14:49:49.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5100389567638453399', time=2024-03-09T16:49:36.421393+0000, chain.objs.size()=1 2024-03-09T14:49:49.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.108__shadow_.Ersnp-3KntM1JqWlGlNHIjly7vK55oK_0 2024-03-09T14:49:49.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3550118939892381441', time=2024-03-09T16:49:37.832727+0000, chain.objs.size()=1 2024-03-09T14:49:49.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.111__shadow_._GcZT2JR8H1t9ZDrrY_mUC83U46I4ZZ_0 2024-03-09T14:49:49.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16469970797814921276', time=2024-03-09T16:49:39.815853+0000, chain.objs.size()=1 2024-03-09T14:49:49.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.115__shadow_.3TqdmT9aHrrcKVenld1oTNy1M47BZrq_0 2024-03-09T14:49:49.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9429907441959745044', time=2024-03-09T16:49:40.717015+0000, chain.objs.size()=1 2024-03-09T14:49:49.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.274+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.117__shadow_.9dn8iUHKTNwPTVR06NaHPbeKRnnAwy1_0 2024-03-09T14:49:49.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.282+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.282+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:49:49.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.286+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.286+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.286+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-03-09T14:49:49.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.286+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.295320684578905364', time=2024-03-09T16:49:36.904115+0000, chain.objs.size()=1 2024-03-09T14:49:49.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.286+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.109__shadow_.q0bif4OmzUDp46E44jRb_ZvYpQbY95m_0 2024-03-09T14:49:49.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.286+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13615623055193162578', time=2024-03-09T16:49:37.843553+0000, chain.objs.size()=1 2024-03-09T14:49:49.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.286+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.111__shadow_.16SKy3HI37OLhg2PEqnnMDA7X5wNssS_0 2024-03-09T14:49:49.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.286+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4121284930238272204', time=2024-03-09T16:49:39.121720+0000, chain.objs.size()=1 2024-03-09T14:49:49.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.286+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.114__shadow_.ktN74iwekKV05lIZxlC8NyZGKXxvaPr_0 2024-03-09T14:49:49.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.286+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14265927115170126', time=2024-03-09T16:49:39.150210+0000, chain.objs.size()=1 2024-03-09T14:49:49.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.286+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.114__shadow_.pYL1knQjwLju4Kf0Z-_IC_Iy13hCvUu_0 2024-03-09T14:49:49.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.286+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9766271172378894126', time=2024-03-09T16:49:47.437682+0000, chain.objs.size()=5 2024-03-09T14:49:49.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.286+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.133__multipart_key1.2~NWRzmCcHvepg1-dBWRd8pxJstRzbd1-.1 2024-03-09T14:49:49.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.286+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.133__multipart_key1.2~NWRzmCcHvepg1-dBWRd8pxJstRzbd1-.2 2024-03-09T14:49:49.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.286+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.133__multipart_key1.2~NWRzmCcHvepg1-dBWRd8pxJstRzbd1-.3 2024-03-09T14:49:49.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.286+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.133__multipart_key1.2~NWRzmCcHvepg1-dBWRd8pxJstRzbd1-.4 2024-03-09T14:49:49.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.286+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.133__multipart_key1.2~NWRzmCcHvepg1-dBWRd8pxJstRzbd1-.5 2024-03-09T14:49:49.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.290+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.294+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:49:49.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T14:49:49.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12491103701694904094', time=2024-03-09T16:49:09.231790+0000, chain.objs.size()=1 2024-03-09T14:49:49.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.80__shadow_.rOHa5T4O36dis8xLw-gUUZjndNTwWv7_0 2024-03-09T14:49:49.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2102158016894102016', time=2024-03-09T16:49:18.713708+0000, chain.objs.size()=5 2024-03-09T14:49:49.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.88__multipart_key1.2~hE_D-wDoNgixnrIfcg5ZF24QTrMYAVA.1 2024-03-09T14:49:49.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.88__multipart_key1.2~hE_D-wDoNgixnrIfcg5ZF24QTrMYAVA.2 2024-03-09T14:49:49.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.88__multipart_key1.2~hE_D-wDoNgixnrIfcg5ZF24QTrMYAVA.3 2024-03-09T14:49:49.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.88__multipart_key1.2~hE_D-wDoNgixnrIfcg5ZF24QTrMYAVA.4 2024-03-09T14:49:49.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.88__multipart_key1.2~hE_D-wDoNgixnrIfcg5ZF24QTrMYAVA.5 2024-03-09T14:49:49.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10370069469352855408', time=2024-03-09T16:49:27.561715+0000, chain.objs.size()=5 2024-03-09T14:49:49.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~rIRnkOlmQxVQxU2s_IWbQnPyYIH4pDs.1 2024-03-09T14:49:49.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__shadow_key1.2~rIRnkOlmQxVQxU2s_IWbQnPyYIH4pDs.1_1 2024-03-09T14:49:49.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~rIRnkOlmQxVQxU2s_IWbQnPyYIH4pDs.2 2024-03-09T14:49:49.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__shadow_key1.2~rIRnkOlmQxVQxU2s_IWbQnPyYIH4pDs.2_1 2024-03-09T14:49:49.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.92__multipart_key1.2~rIRnkOlmQxVQxU2s_IWbQnPyYIH4pDs.3 2024-03-09T14:49:49.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16098073590735569165', time=2024-03-09T16:49:42.876116+0000, chain.objs.size()=1 2024-03-09T14:49:49.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.298+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.122__shadow_.R9rJqXFnWNY41hKqrLQMMykrBmLbOrB_0 2024-03-09T14:49:49.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.310+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.314+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:49:49.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.314+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.314+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.314+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-03-09T14:49:49.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.314+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA', time=2024-03-09T16:49:31.256836+0000, chain.objs.size()=63 2024-03-09T14:49:49.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.314+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.1 2024-03-09T14:49:49.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.314+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.2 2024-03-09T14:49:49.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.314+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.3 2024-03-09T14:49:49.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.314+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.4 2024-03-09T14:49:49.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.314+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.5 2024-03-09T14:49:49.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.314+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.6 2024-03-09T14:49:49.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.314+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.7 2024-03-09T14:49:49.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.314+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.8 2024-03-09T14:49:49.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.314+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.9 2024-03-09T14:49:49.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.314+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.10 2024-03-09T14:49:49.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.314+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.11 2024-03-09T14:49:49.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.314+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.12 2024-03-09T14:49:49.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.318+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.13 2024-03-09T14:49:49.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.318+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.14 2024-03-09T14:49:49.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.318+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.15 2024-03-09T14:49:49.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.318+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.16 2024-03-09T14:49:49.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.318+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.17 2024-03-09T14:49:49.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.322+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.18 2024-03-09T14:49:49.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.322+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.19 2024-03-09T14:49:49.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.322+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.20 2024-03-09T14:49:49.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.322+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.21 2024-03-09T14:49:49.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.322+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.22 2024-03-09T14:49:49.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.322+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.23 2024-03-09T14:49:49.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.326+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.24 2024-03-09T14:49:49.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.326+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.25 2024-03-09T14:49:49.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.326+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.26 2024-03-09T14:49:49.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.326+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.27 2024-03-09T14:49:49.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.326+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.28 2024-03-09T14:49:49.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.326+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.29 2024-03-09T14:49:49.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.330+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.30 2024-03-09T14:49:49.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.330+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.31 2024-03-09T14:49:49.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.330+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.32 2024-03-09T14:49:49.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.330+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.33 2024-03-09T14:49:49.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.330+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.34 2024-03-09T14:49:49.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.330+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.35 2024-03-09T14:49:49.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.330+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.36 2024-03-09T14:49:49.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.330+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.37 2024-03-09T14:49:49.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.330+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.38 2024-03-09T14:49:49.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.330+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.39 2024-03-09T14:49:49.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.334+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.40 2024-03-09T14:49:49.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.334+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.41 2024-03-09T14:49:49.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.334+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.42 2024-03-09T14:49:49.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.334+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.43 2024-03-09T14:49:49.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.334+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.44 2024-03-09T14:49:49.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.334+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.45 2024-03-09T14:49:49.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.334+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.46 2024-03-09T14:49:49.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.334+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.47 2024-03-09T14:49:49.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.334+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.48 2024-03-09T14:49:49.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.334+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.49 2024-03-09T14:49:49.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.334+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.50 2024-03-09T14:49:49.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.338+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.51 2024-03-09T14:49:49.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.338+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.52 2024-03-09T14:49:49.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.342+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.53 2024-03-09T14:49:49.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.342+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.54 2024-03-09T14:49:49.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.342+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.55 2024-03-09T14:49:49.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.342+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.56 2024-03-09T14:49:49.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.342+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.57 2024-03-09T14:49:49.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.342+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.58 2024-03-09T14:49:49.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.342+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.59 2024-03-09T14:49:49.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.342+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.60 2024-03-09T14:49:49.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.342+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.61 2024-03-09T14:49:49.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.342+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.62 2024-03-09T14:49:49.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.342+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.95__multipart_key1.2~GUx7mgDG_9Hf-3ayI1AM4wENSxN1CYA.63 2024-03-09T14:49:49.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.346+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8782448085638120589', time=2024-03-09T16:49:36.889804+0000, chain.objs.size()=1 2024-03-09T14:49:49.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.346+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.109__shadow_.HyXaYIN-XSn5d8PGjJKmhxQ1OCnhaGA_0 2024-03-09T14:49:49.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.346+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10282076879541047516', time=2024-03-09T16:49:42.070603+0000, chain.objs.size()=1 2024-03-09T14:49:49.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.346+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.120__shadow_.nmCNEmLx6GpOsgnbjLB1SJiQtojQUOF_0 2024-03-09T14:49:49.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.350+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.354+0000 7f9a43c43980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:49:49.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.354+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.354+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.358+0000 7f9a43c43980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-03-09T14:49:49.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.358+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9074807178112097417', time=2024-03-09T16:49:15.176200+0000, chain.objs.size()=5 2024-03-09T14:49:49.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.358+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~30Jpijh1A62BNBoyqlA146-al-HR82x.1 2024-03-09T14:49:49.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.358+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__shadow_key1.2~30Jpijh1A62BNBoyqlA146-al-HR82x.1_1 2024-03-09T14:49:49.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.358+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~30Jpijh1A62BNBoyqlA146-al-HR82x.2 2024-03-09T14:49:49.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.358+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__shadow_key1.2~30Jpijh1A62BNBoyqlA146-al-HR82x.2_1 2024-03-09T14:49:49.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.358+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.84__multipart_key1.2~30Jpijh1A62BNBoyqlA146-al-HR82x.3 2024-03-09T14:49:49.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.358+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15555737594255409097', time=2024-03-09T16:49:35.968396+0000, chain.objs.size()=1 2024-03-09T14:49:49.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.358+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.107__shadow_.3ReYFNcf4S_CDzo62egHmN-uXk_e26c_0 2024-03-09T14:49:49.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.358+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3719758180514463026', time=2024-03-09T16:49:39.785003+0000, chain.objs.size()=1 2024-03-09T14:49:49.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.358+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.115__shadow_.-0Cs9EwgoZlEvfowUFKJ05qHSqYfDXo_0 2024-03-09T14:49:49.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.358+0000 7f9a43c43980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6653372986676903900', time=2024-03-09T16:49:42.887583+0000, chain.objs.size()=1 2024-03-09T14:49:49.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.358+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.122__shadow_.GQYCptLAYIWS5EN_aHmz3pXctKxqI-m_0 2024-03-09T14:49:49.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.358+0000 7f9a43c43980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T14:49:49.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.366+0000 7f98f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:49.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.366+0000 7f9a43c43980 20 remove_watcher() i=0 2024-03-09T14:49:49.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.366+0000 7f9a43c43980 2 removed watcher, disabling cache 2024-03-09T14:49:49.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.366+0000 7f9a43c43980 20 remove_watcher() i=1 2024-03-09T14:49:49.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.370+0000 7f9a43c43980 20 remove_watcher() i=2 2024-03-09T14:49:49.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.370+0000 7f9a43c43980 20 remove_watcher() i=3 2024-03-09T14:49:49.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.370+0000 7f9a43c43980 20 remove_watcher() i=4 2024-03-09T14:49:49.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.374+0000 7f9a43c43980 20 remove_watcher() i=5 2024-03-09T14:49:49.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.374+0000 7f9a43c43980 20 remove_watcher() i=6 2024-03-09T14:49:49.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.374+0000 7f9a43c43980 20 remove_watcher() i=7 2024-03-09T14:49:49.382 DEBUG:teuthology.orchestra.run.smithi099:> radosgw-admin gc process --include-all 2024-03-09T14:49:49.452 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:49:49.452 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:49:49.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.502+0000 7fe7f468e980 20 rados->read ofs=0 len=0 2024-03-09T14:49:49.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.506+0000 7fe7f468e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:49.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.506+0000 7fe7f468e980 20 realm 2024-03-09T14:49:49.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.506+0000 7fe7f468e980 20 rados->read ofs=0 len=0 2024-03-09T14:49:49.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.506+0000 7fe7f468e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:49.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.506+0000 7fe7f468e980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:49:49.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.506+0000 7fe7f468e980 20 rados->read ofs=0 len=0 2024-03-09T14:49:49.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.506+0000 7fe7f468e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:49.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.506+0000 7fe7f468e980 20 rados->read ofs=0 len=0 2024-03-09T14:49:49.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.506+0000 7fe7f468e980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:49.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.506+0000 7fe7f468e980 20 rados->read ofs=0 len=0 2024-03-09T14:49:49.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.510+0000 7fe7f468e980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:49:49.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.510+0000 7fe7f468e980 20 searching for the correct realm 2024-03-09T14:49:49.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.510+0000 7fe7f19a5640 0 -- 172.21.15.99:0/2293263879 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7fe7e402c060 msgr2=0x7fe7e400dab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:49.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.722+0000 7fe7f29a7640 0 -- 172.21.15.99:0/2293263879 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7fe7dc0d9040 msgr2=0x7fe7dc0c7940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:49.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:49:49.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:49:49.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:49:49.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:49:49.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:49:49.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:49:49.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 20 rados->read ofs=0 len=0 2024-03-09T14:49:49.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:49.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 20 rados->read ofs=0 len=0 2024-03-09T14:49:49.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:49.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 20 rados->read ofs=0 len=0 2024-03-09T14:49:49.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:49:49.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 20 zone default found 2024-03-09T14:49:49.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 4 Realm: () 2024-03-09T14:49:49.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:49:49.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:49:49.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:49:49.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 20 zonegroup default 2024-03-09T14:49:49.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 20 rados->read ofs=0 len=0 2024-03-09T14:49:49.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:49.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.742+0000 7fe7f468e980 20 rados->read ofs=0 len=0 2024-03-09T14:49:49.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.746+0000 7fe7f468e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:49.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.746+0000 7fe7f468e980 20 rados->read ofs=0 len=0 2024-03-09T14:49:49.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.746+0000 7fe7f468e980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:49.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.746+0000 7fe7f468e980 20 started sync module instance, tier type = 2024-03-09T14:49:49.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.746+0000 7fe7f468e980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:49:49.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.766+0000 7fe7f468e980 20 add_watcher() i=0 2024-03-09T14:49:49.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.766+0000 7fe7f468e980 20 add_watcher() i=1 2024-03-09T14:49:49.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.766+0000 7fe7f468e980 20 add_watcher() i=2 2024-03-09T14:49:49.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.766+0000 7fe7f468e980 20 add_watcher() i=3 2024-03-09T14:49:49.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.766+0000 7fe7f468e980 20 add_watcher() i=4 2024-03-09T14:49:49.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.766+0000 7fe7f468e980 20 add_watcher() i=5 2024-03-09T14:49:49.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.766+0000 7fe7f468e980 20 add_watcher() i=6 2024-03-09T14:49:49.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.770+0000 7fe7f468e980 20 add_watcher() i=7 2024-03-09T14:49:49.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.770+0000 7fe7f468e980 2 all 8 watchers are set, enabling cache 2024-03-09T14:49:49.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.774+0000 7fe6a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:49.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.774+0000 7fe7f468e980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:49:49.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.774+0000 7fe7f468e980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:49:49.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.862+0000 7fe6a67e4640 20 reqs_thread_entry: start 2024-03-09T14:49:49.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.862+0000 7fe7f468e980 20 init_complete bucket index max shards: 11 2024-03-09T14:49:49.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.862+0000 7fe7f468e980 20 Filter name: none 2024-03-09T14:49:49.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.862+0000 7fe617fff640 20 reqs_thread_entry: start 2024-03-09T14:49:49.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.862+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T14:49:49.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.866+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.860 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.866+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.870+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.870+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T14:49:49.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.874+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.874+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.874+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.874+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T14:49:49.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.878+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.878+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.878+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.882+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T14:49:49.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.886+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.890+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.890+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.894+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T14:49:49.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.894+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.898+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.898+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.898+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T14:49:49.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.902+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.902+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.902+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.902+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T14:49:49.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.906+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.906+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.906+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.910+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T14:49:49.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.914+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.914+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.914+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.918+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T14:49:49.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.922+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.922+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.922+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.926+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T14:49:49.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.930+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.930+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.930+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.934+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T14:49:49.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.934+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.934+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.934+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.938+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T14:49:49.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.942+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.942+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.942+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.946+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T14:49:49.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.950+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.950+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.950+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.954+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T14:49:49.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.958+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.958+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.962+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.962+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T14:49:49.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.966+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.970+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.970+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.970+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T14:49:49.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.978+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.978+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.978+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.982+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T14:49:49.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.986+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.986+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.986+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.990+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T14:49:49.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.994+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.994+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:49.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.998+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:49.998+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T14:49:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.006+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:49.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.006+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:50.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.006+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.010+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T14:49:50.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.014+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.014+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:50.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.018+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.018+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T14:49:50.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.022+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.026+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:50.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.026+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.021 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.030+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T14:49:50.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.034+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.034+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:50.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.034+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.038+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T14:49:50.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.042+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.042+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:50.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.042+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.046+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T14:49:50.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.050+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.050+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:50.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.054+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.054+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T14:49:50.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.058+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.062+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:50.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.062+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.066+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T14:49:50.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.070+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.070+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:50.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.070+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.074+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T14:49:50.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.078+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.078+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:50.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.082+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.082+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T14:49:50.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.086+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.090+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:50.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.090+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.094+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T14:49:50.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.098+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.098+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:50.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.098+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.102+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T14:49:50.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.106+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.106+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:50.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.106+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.110+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T14:49:50.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.114+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.114+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:50.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.114+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.118+0000 7fe7f468e980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T14:49:50.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.122+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.122+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T14:49:50.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.126+0000 7fe7f468e980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T14:49:50.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.130+0000 7fe6a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.134+0000 7fe7f468e980 20 remove_watcher() i=0 2024-03-09T14:49:50.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.134+0000 7fe7f468e980 2 removed watcher, disabling cache 2024-03-09T14:49:50.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.134+0000 7fe7f468e980 20 remove_watcher() i=1 2024-03-09T14:49:50.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.138+0000 7fe7f468e980 20 remove_watcher() i=2 2024-03-09T14:49:50.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.142+0000 7fe7f468e980 20 remove_watcher() i=3 2024-03-09T14:49:50.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.142+0000 7fe7f468e980 20 remove_watcher() i=4 2024-03-09T14:49:50.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.146+0000 7fe7f468e980 20 remove_watcher() i=5 2024-03-09T14:49:50.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.146+0000 7fe7f468e980 20 remove_watcher() i=6 2024-03-09T14:49:50.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:50.146+0000 7fe7f468e980 20 remove_watcher() i=7 2024-03-09T14:49:50.162 INFO:teuthology.run_tasks:Running task s3tests... 2024-03-09T14:49:50.183 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'wip-iam-user-apis', 'git_remote': 'https://github.com/cbodley/', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-03-09T14:49:50.183 INFO:tasks.s3tests:Downloading s3-tests... 2024-03-09T14:49:50.183 INFO:tasks.s3tests:Using branch 'wip-iam-user-apis' for s3tests 2024-03-09T14:49:50.184 DEBUG:teuthology.orchestra.run.smithi099:> git clone -b wip-iam-user-apis https://github.com/cbodley/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-03-09T14:49:50.210 INFO:teuthology.orchestra.run.smithi099.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-03-09T14:49:51.230 INFO:tasks.s3tests:Creating rgw users... 2024-03-09T14:49:51.231 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-03-09T14:49:51.231 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key FJGCGPITHQUYFNCEVEVB --secret weu10Vo/0KEszFvfKGRkuPto9a2/rDqlgczMJEZaA84j6IVUMZ32Uw== --cluster ceph 2024-03-09T14:49:51.317 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:49:51.317 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:49:51.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.366+0000 7f99fd500980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.366+0000 7f99fd500980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:51.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.366+0000 7f99fd500980 20 realm 2024-03-09T14:49:51.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.366+0000 7f99fd500980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.366+0000 7f99fd500980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:51.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.366+0000 7f99fd500980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:49:51.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.366+0000 7f99fd500980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.366+0000 7f99fd500980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:51.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.366+0000 7f99fd500980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.370+0000 7f99fd500980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:51.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.370+0000 7f99fd500980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.370+0000 7f99fd500980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:49:51.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.370+0000 7f99fd500980 20 searching for the correct realm 2024-03-09T14:49:51.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.374+0000 7f99fb819640 0 -- 172.21.15.99:0/3819733858 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f99f0018070 msgr2=0x7f99f004d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:51.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.590+0000 7f99fa817640 0 -- 172.21.15.99:0/3819733858 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f99f405d9a0 msgr2=0x7f99f4053450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:49:51.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.806+0000 7f99fd500980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:49:51.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.806+0000 7f99fd500980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:49:51.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.806+0000 7f99fd500980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:49:51.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.806+0000 7f99fd500980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:49:51.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.806+0000 7f99fd500980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:49:51.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.806+0000 7f99fd500980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:49:51.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.806+0000 7f99fd500980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.810+0000 7f99fd500980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:51.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.810+0000 7f99fd500980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.810+0000 7f99fd500980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:51.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.810+0000 7f99fd500980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.810+0000 7f99fd500980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:49:51.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.810+0000 7f99fd500980 20 zone default found 2024-03-09T14:49:51.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.810+0000 7f99fd500980 4 Realm: () 2024-03-09T14:49:51.803 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.810+0000 7f99fd500980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:49:51.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.810+0000 7f99fd500980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:49:51.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.810+0000 7f99fd500980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:49:51.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.810+0000 7f99fd500980 20 zonegroup default 2024-03-09T14:49:51.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.810+0000 7f99fd500980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.810+0000 7f99fd500980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:51.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.810+0000 7f99fd500980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.814+0000 7f99fd500980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:51.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.814+0000 7f99fd500980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.814+0000 7f99fd500980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:51.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.814+0000 7f99fd500980 20 started sync module instance, tier type = 2024-03-09T14:49:51.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.814+0000 7f99fd500980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:49:51.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.838+0000 7f99fd500980 20 add_watcher() i=0 2024-03-09T14:49:51.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.838+0000 7f99fd500980 20 add_watcher() i=1 2024-03-09T14:49:51.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.838+0000 7f99fd500980 20 add_watcher() i=2 2024-03-09T14:49:51.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.838+0000 7f99fd500980 20 add_watcher() i=3 2024-03-09T14:49:51.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.838+0000 7f99fd500980 20 add_watcher() i=4 2024-03-09T14:49:51.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.838+0000 7f99fd500980 20 add_watcher() i=5 2024-03-09T14:49:51.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.838+0000 7f99fd500980 20 add_watcher() i=6 2024-03-09T14:49:51.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.838+0000 7f99fd500980 20 add_watcher() i=7 2024-03-09T14:49:51.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.838+0000 7f99fd500980 2 all 8 watchers are set, enabling cache 2024-03-09T14:49:51.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.842+0000 7f98b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:51.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.842+0000 7f99fd500980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:49:51.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.842+0000 7f99fd500980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:49:51.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.842+0000 7f99fd500980 5 note: GC not initialized 2024-03-09T14:49:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.842+0000 7f98b0fe1640 20 reqs_thread_entry: start 2024-03-09T14:49:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 20 init_complete bucket index max shards: 11 2024-03-09T14:49:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 20 Filter name: none 2024-03-09T14:49:51.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f982a7fc640 20 reqs_thread_entry: start 2024-03-09T14:49:51.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-03-09T14:49:51.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:51.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-03-09T14:49:51.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:49:51.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-03-09T14:49:51.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:51.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-03-09T14:49:51.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-03-09T14:49:51.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 10 cache get: name=default.rgw.meta+users.keys+FJGCGPITHQUYFNCEVEVB : miss 2024-03-09T14:49:51.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 10 cache put: name=default.rgw.meta+users.keys+FJGCGPITHQUYFNCEVEVB info.flags=0x0 2024-03-09T14:49:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 10 adding default.rgw.meta+users.keys+FJGCGPITHQUYFNCEVEVB to cache LRU end 2024-03-09T14:49:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 10 cache get: name=default.rgw.meta+users.keys+FJGCGPITHQUYFNCEVEVB : hit (negative entry) 2024-03-09T14:49:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 10 cache get: name=default.rgw.meta+users.keys+FJGCGPITHQUYFNCEVEVB : hit (negative entry) 2024-03-09T14:49:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-09T14:49:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:49:51.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.846+0000 7f99fd500980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-03-09T14:49:51.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.850+0000 7f98deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464509 cookie 93913415725520 notifier 7256 bl.length()=645 2024-03-09T14:49:51.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.850+0000 7f98deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-09T14:49:51.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.850+0000 7f98deffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:49:51.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.850+0000 7f99fd500980 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-03-09T14:49:51.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.850+0000 7f99fd500980 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-03-09T14:49:51.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.850+0000 7f99fd500980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-03-09T14:49:51.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.854+0000 7f98de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464510 cookie 93913415723312 notifier 7256 bl.length()=185 2024-03-09T14:49:51.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.854+0000 7f98de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-03-09T14:49:51.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.854+0000 7f98de7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-03-09T14:49:51.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.854+0000 7f99fd500980 10 cache put: name=default.rgw.meta+users.keys+FJGCGPITHQUYFNCEVEVB info.flags=0x7 2024-03-09T14:49:51.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.854+0000 7f99fd500980 10 moving default.rgw.meta+users.keys+FJGCGPITHQUYFNCEVEVB to cache LRU end 2024-03-09T14:49:51.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.854+0000 7f99fd500980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:FJGCGPITHQUYFNCEVEVB, ofs0, ns] 2024-03-09T14:49:51.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.858+0000 7f98de7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464511 cookie 93913415723312 notifier 7256 bl.length()=186 2024-03-09T14:49:51.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.858+0000 7f98de7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FJGCGPITHQUYFNCEVEVB info.flags=0x7 2024-03-09T14:49:51.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.858+0000 7f98de7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FJGCGPITHQUYFNCEVEVB to cache LRU end 2024-03-09T14:49:51.850 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T14:49:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "foo.client.0", 2024-03-09T14:49:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr.foo.client.0", 2024-03-09T14:49:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "foo+test@test.test", 2024-03-09T14:49:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-03-09T14:49:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-03-09T14:49:51.850 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-03-09T14:49:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-03-09T14:49:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-09T14:49:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "foo.client.0", 2024-03-09T14:49:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "FJGCGPITHQUYFNCEVEVB", 2024-03-09T14:49:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "weu10Vo/0KEszFvfKGRkuPto9a2/rDqlgczMJEZaA84j6IVUMZ32Uw==", 2024-03-09T14:49:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-03-09T14:49:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:49:51.848972Z" 2024-03-09T14:49:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-09T14:49:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-09T14:49:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-03-09T14:49:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-03-09T14:49:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-03-09T14:49:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-03-09T14:49:51.851 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-03-09T14:49:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-03-09T14:49:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-03-09T14:49:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:49:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:49:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:49:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:49:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:49:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-03-09T14:49:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:49:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:49:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:49:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:49:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:49:51.852 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-03-09T14:49:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "rgw", 2024-03-09T14:49:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-03-09T14:49:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "", 2024-03-09T14:49:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-09T14:49:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:49:51.848941Z", 2024-03-09T14:49:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-03-09T14:49:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-03-09T14:49:51.853 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T14:49:51.853 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:51.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.858+0000 7f98b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:51.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.862+0000 7f99fd500980 20 remove_watcher() i=0 2024-03-09T14:49:51.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.862+0000 7f99fd500980 2 removed watcher, disabling cache 2024-03-09T14:49:51.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.866+0000 7f99fd500980 20 remove_watcher() i=1 2024-03-09T14:49:51.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.870+0000 7f99fd500980 20 remove_watcher() i=2 2024-03-09T14:49:51.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.870+0000 7f99fd500980 20 remove_watcher() i=3 2024-03-09T14:49:51.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.874+0000 7f99fd500980 20 remove_watcher() i=4 2024-03-09T14:49:51.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.874+0000 7f99fd500980 20 remove_watcher() i=5 2024-03-09T14:49:51.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.874+0000 7f99fd500980 20 remove_watcher() i=6 2024-03-09T14:49:51.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.878+0000 7f99fd500980 20 remove_watcher() i=7 2024-03-09T14:49:51.888 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 8592698354 --totp-seed P3EN2ECTLITW4AR2BE35VUAP5CM5Q5B2OHCWMDFVZDAO2ZHGNHBHP7MHBNFXYUDM --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:49:51.931 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:49:51.931 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:49:51.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.978+0000 7f099dc8b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.982+0000 7f099dc8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:51.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.982+0000 7f099dc8b980 20 realm 2024-03-09T14:49:51.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.982+0000 7f099dc8b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.982+0000 7f099dc8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:51.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.982+0000 7f099dc8b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:49:51.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.982+0000 7f099dc8b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.982+0000 7f099dc8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:51.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.982+0000 7f099dc8b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.982+0000 7f099dc8b980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:51.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.982+0000 7f099dc8b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:51.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.986+0000 7f099dc8b980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:49:51.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.986+0000 7f099dc8b980 20 searching for the correct realm 2024-03-09T14:49:51.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.990+0000 7f099bfa4640 0 -- 172.21.15.99:0/1953829130 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x5577023f97a0 msgr2=0x5577023fbb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:51.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:51.994+0000 7f099afa2640 0 -- 172.21.15.99:0/1953829130 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f099407bd00 msgr2=0x7f09940799f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:52.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.210+0000 7f099dc8b980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:49:52.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.210+0000 7f099dc8b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:49:52.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.210+0000 7f099dc8b980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:49:52.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.210+0000 7f099dc8b980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:49:52.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.210+0000 7f099dc8b980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:49:52.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.210+0000 7f099dc8b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:49:52.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.210+0000 7f099dc8b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:52.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.210+0000 7f099dc8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:52.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.210+0000 7f099dc8b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:52.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.214+0000 7f099dc8b980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:52.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.214+0000 7f099dc8b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:52.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.214+0000 7f099dc8b980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:49:52.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.214+0000 7f099dc8b980 20 zone default found 2024-03-09T14:49:52.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.214+0000 7f099dc8b980 4 Realm: () 2024-03-09T14:49:52.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.214+0000 7f099dc8b980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:49:52.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.214+0000 7f099dc8b980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:49:52.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.214+0000 7f099dc8b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:49:52.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.214+0000 7f099dc8b980 20 zonegroup default 2024-03-09T14:49:52.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.214+0000 7f099dc8b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:52.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.214+0000 7f099dc8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:52.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.214+0000 7f099dc8b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:52.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.214+0000 7f099dc8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:52.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.214+0000 7f099dc8b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:52.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.214+0000 7f099dc8b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:52.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.214+0000 7f099dc8b980 20 started sync module instance, tier type = 2024-03-09T14:49:52.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.214+0000 7f099dc8b980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:49:52.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.238+0000 7f099dc8b980 20 add_watcher() i=0 2024-03-09T14:49:52.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.238+0000 7f099dc8b980 20 add_watcher() i=1 2024-03-09T14:49:52.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.238+0000 7f099dc8b980 20 add_watcher() i=2 2024-03-09T14:49:52.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.238+0000 7f099dc8b980 20 add_watcher() i=3 2024-03-09T14:49:52.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.238+0000 7f099dc8b980 20 add_watcher() i=4 2024-03-09T14:49:52.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.238+0000 7f099dc8b980 20 add_watcher() i=5 2024-03-09T14:49:52.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.238+0000 7f099dc8b980 20 add_watcher() i=6 2024-03-09T14:49:52.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.242+0000 7f099dc8b980 20 add_watcher() i=7 2024-03-09T14:49:52.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.242+0000 7f099dc8b980 2 all 8 watchers are set, enabling cache 2024-03-09T14:49:52.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.246+0000 7f08527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:52.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.246+0000 7f099dc8b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:49:52.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.246+0000 7f099dc8b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:49:52.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.246+0000 7f099dc8b980 5 note: GC not initialized 2024-03-09T14:49:52.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.246+0000 7f08517e2640 20 reqs_thread_entry: start 2024-03-09T14:49:52.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.246+0000 7f099dc8b980 20 init_complete bucket index max shards: 11 2024-03-09T14:49:52.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.250+0000 7f099dc8b980 20 Filter name: none 2024-03-09T14:49:52.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.250+0000 7f084affd640 20 reqs_thread_entry: start 2024-03-09T14:49:52.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.250+0000 7f099dc8b980 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-03-09T14:49:52.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.250+0000 7f099dc8b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:52.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.250+0000 7f099dc8b980 20 rados_obj.operate() r=0 bl.length=460 2024-03-09T14:49:52.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.250+0000 7f099dc8b980 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-03-09T14:49:52.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.250+0000 7f099dc8b980 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:49:52.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:52.250+0000 7f099dc8b980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:49:53.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.690+0000 7f099dc8b980 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-09T14:49:53.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.690+0000 7f099dc8b980 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:49:53.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.690+0000 7f099dc8b980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-03-09T14:49:53.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.690+0000 7f087e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399104 cookie 93969627199008 notifier 7641 bl.length()=659 2024-03-09T14:49:53.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.690+0000 7f087e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-03-09T14:49:53.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.690+0000 7f087e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-03-09T14:49:53.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.690+0000 7f08527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:53.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.698+0000 7f099dc8b980 20 remove_watcher() i=0 2024-03-09T14:49:53.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.698+0000 7f099dc8b980 2 removed watcher, disabling cache 2024-03-09T14:49:53.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.698+0000 7f099dc8b980 20 remove_watcher() i=1 2024-03-09T14:49:53.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.702+0000 7f099dc8b980 20 remove_watcher() i=2 2024-03-09T14:49:53.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.702+0000 7f099dc8b980 20 remove_watcher() i=3 2024-03-09T14:49:53.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.706+0000 7f099dc8b980 20 remove_watcher() i=4 2024-03-09T14:49:53.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.706+0000 7f099dc8b980 20 remove_watcher() i=5 2024-03-09T14:49:53.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.710+0000 7f099dc8b980 20 remove_watcher() i=6 2024-03-09T14:49:53.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.710+0000 7f099dc8b980 20 remove_watcher() i=7 2024-03-09T14:49:53.722 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-03-09T14:49:53.723 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key NJPDFJSDTEUAJRTOSTYT --secret 5Zi1Hrgs0hIjwhGIg9RIAVESDdRvUbmoXMwC96BHM3kaLc4e4bwkaw== --cluster ceph 2024-03-09T14:49:53.809 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:49:53.809 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:49:53.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.858+0000 7f9837c50980 20 rados->read ofs=0 len=0 2024-03-09T14:49:53.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.858+0000 7f9837c50980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:53.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.858+0000 7f9837c50980 20 realm 2024-03-09T14:49:53.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.858+0000 7f9837c50980 20 rados->read ofs=0 len=0 2024-03-09T14:49:53.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.858+0000 7f9837c50980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:53.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.858+0000 7f9837c50980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:49:53.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.858+0000 7f9837c50980 20 rados->read ofs=0 len=0 2024-03-09T14:49:53.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.858+0000 7f9837c50980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:53.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.858+0000 7f9837c50980 20 rados->read ofs=0 len=0 2024-03-09T14:49:53.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.862+0000 7f9837c50980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:53.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.862+0000 7f9837c50980 20 rados->read ofs=0 len=0 2024-03-09T14:49:53.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.862+0000 7f9837c50980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:49:53.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.862+0000 7f9837c50980 20 searching for the correct realm 2024-03-09T14:49:53.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.866+0000 7f9835f69640 0 -- 172.21.15.99:0/52179977 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f982c035070 msgr2=0x7f982c05bb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:53.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:53.874+0000 7f9834f67640 0 -- 172.21.15.99:0/52179977 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f98300c0020 msgr2=0x7f98300e0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.090+0000 7f9837c50980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:49:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.090+0000 7f9837c50980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:49:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.090+0000 7f9837c50980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:49:54.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.090+0000 7f9837c50980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:49:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.090+0000 7f9837c50980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:49:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.090+0000 7f9837c50980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:49:54.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.090+0000 7f9837c50980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.090+0000 7f9837c50980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:54.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.090+0000 7f9837c50980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.094+0000 7f9837c50980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:54.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.094+0000 7f9837c50980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.094+0000 7f9837c50980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:49:54.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.094+0000 7f9837c50980 20 zone default found 2024-03-09T14:49:54.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.094+0000 7f9837c50980 4 Realm: () 2024-03-09T14:49:54.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.094+0000 7f9837c50980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:49:54.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.094+0000 7f9837c50980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:49:54.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.094+0000 7f9837c50980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:49:54.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.094+0000 7f9837c50980 20 zonegroup default 2024-03-09T14:49:54.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.094+0000 7f9837c50980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.094+0000 7f9837c50980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:54.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.094+0000 7f9837c50980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.094+0000 7f9837c50980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:54.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.094+0000 7f9837c50980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.094+0000 7f9837c50980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:54.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.094+0000 7f9837c50980 20 started sync module instance, tier type = 2024-03-09T14:49:54.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.094+0000 7f9837c50980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:49:54.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.118+0000 7f9837c50980 20 add_watcher() i=0 2024-03-09T14:49:54.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.118+0000 7f9837c50980 20 add_watcher() i=1 2024-03-09T14:49:54.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.118+0000 7f9837c50980 20 add_watcher() i=2 2024-03-09T14:49:54.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.118+0000 7f9837c50980 20 add_watcher() i=3 2024-03-09T14:49:54.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.118+0000 7f9837c50980 20 add_watcher() i=4 2024-03-09T14:49:54.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.118+0000 7f9837c50980 20 add_watcher() i=5 2024-03-09T14:49:54.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.118+0000 7f9837c50980 20 add_watcher() i=6 2024-03-09T14:49:54.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.118+0000 7f9837c50980 20 add_watcher() i=7 2024-03-09T14:49:54.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.118+0000 7f9837c50980 2 all 8 watchers are set, enabling cache 2024-03-09T14:49:54.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.122+0000 7f96ebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:54.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.122+0000 7f9837c50980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:49:54.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.122+0000 7f9837c50980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:49:54.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.122+0000 7f9837c50980 5 note: GC not initialized 2024-03-09T14:49:54.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.122+0000 7f96eafe5640 20 reqs_thread_entry: start 2024-03-09T14:49:54.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.122+0000 7f9837c50980 20 init_complete bucket index max shards: 11 2024-03-09T14:49:54.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.122+0000 7f9837c50980 20 Filter name: none 2024-03-09T14:49:54.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.122+0000 7f96e8fe1640 20 reqs_thread_entry: start 2024-03-09T14:49:54.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.122+0000 7f9837c50980 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-03-09T14:49:54.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.122+0000 7f9837c50980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.126+0000 7f9837c50980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:54.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.126+0000 7f9837c50980 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-03-09T14:49:54.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.126+0000 7f9837c50980 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:49:54.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.126+0000 7f9837c50980 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-03-09T14:49:54.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.126+0000 7f9837c50980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.126+0000 7f9837c50980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:54.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.126+0000 7f9837c50980 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-03-09T14:49:54.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.126+0000 7f9837c50980 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-03-09T14:49:54.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.126+0000 7f9837c50980 10 cache get: name=default.rgw.meta+users.keys+NJPDFJSDTEUAJRTOSTYT : miss 2024-03-09T14:49:54.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.126+0000 7f9837c50980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.126+0000 7f9837c50980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:54.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.126+0000 7f9837c50980 10 cache put: name=default.rgw.meta+users.keys+NJPDFJSDTEUAJRTOSTYT info.flags=0x0 2024-03-09T14:49:54.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.126+0000 7f9837c50980 10 adding default.rgw.meta+users.keys+NJPDFJSDTEUAJRTOSTYT to cache LRU end 2024-03-09T14:49:54.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.126+0000 7f9837c50980 10 cache get: name=default.rgw.meta+users.keys+NJPDFJSDTEUAJRTOSTYT : hit (negative entry) 2024-03-09T14:49:54.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.126+0000 7f9837c50980 10 cache get: name=default.rgw.meta+users.keys+NJPDFJSDTEUAJRTOSTYT : hit (negative entry) 2024-03-09T14:49:54.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.130+0000 7f9837c50980 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-09T14:49:54.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.130+0000 7f9837c50980 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:49:54.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.130+0000 7f9837c50980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-03-09T14:49:54.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.130+0000 7f9718ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398953 cookie 94838694460640 notifier 7286 bl.length()=645 2024-03-09T14:49:54.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.130+0000 7f9718ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-09T14:49:54.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.130+0000 7f9718ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:49:54.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.134+0000 7f9837c50980 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-03-09T14:49:54.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.134+0000 7f9837c50980 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-03-09T14:49:54.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.134+0000 7f9837c50980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-03-09T14:49:54.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.134+0000 7f9707fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399013 cookie 94838694474048 notifier 7286 bl.length()=185 2024-03-09T14:49:54.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.134+0000 7f9707fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-03-09T14:49:54.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.134+0000 7f9707fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-03-09T14:49:54.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.134+0000 7f9837c50980 10 cache put: name=default.rgw.meta+users.keys+NJPDFJSDTEUAJRTOSTYT info.flags=0x7 2024-03-09T14:49:54.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.134+0000 7f9837c50980 10 moving default.rgw.meta+users.keys+NJPDFJSDTEUAJRTOSTYT to cache LRU end 2024-03-09T14:49:54.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.134+0000 7f9837c50980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NJPDFJSDTEUAJRTOSTYT, ofs0, ns] 2024-03-09T14:49:54.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.134+0000 7f9707fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399014 cookie 94838694474048 notifier 7286 bl.length()=186 2024-03-09T14:49:54.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.134+0000 7f9707fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NJPDFJSDTEUAJRTOSTYT info.flags=0x7 2024-03-09T14:49:54.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.134+0000 7f9707fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NJPDFJSDTEUAJRTOSTYT to cache LRU end 2024-03-09T14:49:54.129 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T14:49:54.129 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "bar.client.0", 2024-03-09T14:49:54.129 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr.bar.client.0", 2024-03-09T14:49:54.129 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "bar+test@test.test", 2024-03-09T14:49:54.129 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-03-09T14:49:54.129 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-03-09T14:49:54.129 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-03-09T14:49:54.129 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-03-09T14:49:54.129 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-09T14:49:54.129 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "bar.client.0", 2024-03-09T14:49:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "NJPDFJSDTEUAJRTOSTYT", 2024-03-09T14:49:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "5Zi1Hrgs0hIjwhGIg9RIAVESDdRvUbmoXMwC96BHM3kaLc4e4bwkaw==", 2024-03-09T14:49:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-03-09T14:49:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:49:54.128108Z" 2024-03-09T14:49:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-09T14:49:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-09T14:49:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-03-09T14:49:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-03-09T14:49:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-03-09T14:49:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-03-09T14:49:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-03-09T14:49:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-03-09T14:49:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-03-09T14:49:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:49:54.130 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:49:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:49:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:49:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:49:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-03-09T14:49:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:49:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:49:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:49:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:49:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:49:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-03-09T14:49:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "rgw", 2024-03-09T14:49:54.131 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-03-09T14:49:54.132 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "", 2024-03-09T14:49:54.132 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-09T14:49:54.132 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:49:54.128087Z", 2024-03-09T14:49:54.132 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-03-09T14:49:54.132 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-03-09T14:49:54.132 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T14:49:54.132 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:54.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.138+0000 7f96ebfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:54.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.142+0000 7f9837c50980 20 remove_watcher() i=0 2024-03-09T14:49:54.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.142+0000 7f9837c50980 2 removed watcher, disabling cache 2024-03-09T14:49:54.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.142+0000 7f9837c50980 20 remove_watcher() i=1 2024-03-09T14:49:54.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.146+0000 7f9837c50980 20 remove_watcher() i=2 2024-03-09T14:49:54.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.150+0000 7f9837c50980 20 remove_watcher() i=3 2024-03-09T14:49:54.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.150+0000 7f9837c50980 20 remove_watcher() i=4 2024-03-09T14:49:54.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.154+0000 7f9837c50980 20 remove_watcher() i=5 2024-03-09T14:49:54.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.154+0000 7f9837c50980 20 remove_watcher() i=6 2024-03-09T14:49:54.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.154+0000 7f9837c50980 20 remove_watcher() i=7 2024-03-09T14:49:54.164 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 6616364353 --totp-seed VFCQULBJG7HW3UHX4JOD2YVV75CUOBLQFVLBGL4JMCYTJDXKHQE6ZNFZWB3X3AJP --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:49:54.208 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:49:54.209 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:49:54.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.466+0000 7fa76a9ee980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.466+0000 7fa76a9ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:54.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.466+0000 7fa76a9ee980 20 realm 2024-03-09T14:49:54.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.466+0000 7fa76a9ee980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.466+0000 7fa76a9ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:54.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.466+0000 7fa76a9ee980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:49:54.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.466+0000 7fa76a9ee980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.466+0000 7fa76a9ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:54.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.466+0000 7fa76a9ee980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.470+0000 7fa76a9ee980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:54.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.470+0000 7fa76a9ee980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.470+0000 7fa76a9ee980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:49:54.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.470+0000 7fa76a9ee980 20 searching for the correct realm 2024-03-09T14:49:54.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.474+0000 7fa768d07640 0 -- 172.21.15.99:0/2246347171 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7fa75c01b040 msgr2=0x7fa75c037910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:54.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.722+0000 7fa768d07640 0 -- 172.21.15.99:0/2246347171 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x555a66219750 msgr2=0x555a6621bb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:54.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:49:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:49:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:49:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:49:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:49:54.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:49:54.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:54.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:54.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:49:54.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 20 zone default found 2024-03-09T14:49:54.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 4 Realm: () 2024-03-09T14:49:54.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:49:54.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:49:54.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:49:54.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 20 zonegroup default 2024-03-09T14:49:54.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.746+0000 7fa76a9ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:54.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.750+0000 7fa76a9ee980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.750+0000 7fa76a9ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:54.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.750+0000 7fa76a9ee980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.750+0000 7fa76a9ee980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:54.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.750+0000 7fa76a9ee980 20 started sync module instance, tier type = 2024-03-09T14:49:54.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.750+0000 7fa76a9ee980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:49:54.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.774+0000 7fa76a9ee980 20 add_watcher() i=0 2024-03-09T14:49:54.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.774+0000 7fa76a9ee980 20 add_watcher() i=1 2024-03-09T14:49:54.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.774+0000 7fa76a9ee980 20 add_watcher() i=2 2024-03-09T14:49:54.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.774+0000 7fa76a9ee980 20 add_watcher() i=3 2024-03-09T14:49:54.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.774+0000 7fa76a9ee980 20 add_watcher() i=4 2024-03-09T14:49:54.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.774+0000 7fa76a9ee980 20 add_watcher() i=5 2024-03-09T14:49:54.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.774+0000 7fa76a9ee980 20 add_watcher() i=6 2024-03-09T14:49:54.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.774+0000 7fa76a9ee980 20 add_watcher() i=7 2024-03-09T14:49:54.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.774+0000 7fa76a9ee980 2 all 8 watchers are set, enabling cache 2024-03-09T14:49:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.778+0000 7fa61efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.778+0000 7fa76a9ee980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:49:54.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.778+0000 7fa76a9ee980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:49:54.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.782+0000 7fa76a9ee980 5 note: GC not initialized 2024-03-09T14:49:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.782+0000 7fa61dfdb640 20 reqs_thread_entry: start 2024-03-09T14:49:54.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.782+0000 7fa76a9ee980 20 init_complete bucket index max shards: 11 2024-03-09T14:49:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.782+0000 7fa76a9ee980 20 Filter name: none 2024-03-09T14:49:54.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.782+0000 7fa58f7fe640 20 reqs_thread_entry: start 2024-03-09T14:49:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.782+0000 7fa76a9ee980 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-03-09T14:49:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.782+0000 7fa76a9ee980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.782+0000 7fa76a9ee980 20 rados_obj.operate() r=0 bl.length=460 2024-03-09T14:49:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.782+0000 7fa76a9ee980 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-03-09T14:49:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.782+0000 7fa76a9ee980 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:49:54.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.782+0000 7fa76a9ee980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:49:54.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.790+0000 7fa76a9ee980 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-09T14:49:54.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.790+0000 7fa76a9ee980 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:49:54.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.790+0000 7fa76a9ee980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-03-09T14:49:54.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.790+0000 7fa63f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366250 cookie 93846748927040 notifier 7304 bl.length()=659 2024-03-09T14:49:54.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.790+0000 7fa63f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-03-09T14:49:54.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.790+0000 7fa63f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-03-09T14:49:54.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.790+0000 7fa61efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:54.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.798+0000 7fa76a9ee980 20 remove_watcher() i=0 2024-03-09T14:49:54.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.798+0000 7fa76a9ee980 2 removed watcher, disabling cache 2024-03-09T14:49:54.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.798+0000 7fa76a9ee980 20 remove_watcher() i=1 2024-03-09T14:49:54.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.802+0000 7fa76a9ee980 20 remove_watcher() i=2 2024-03-09T14:49:54.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.802+0000 7fa76a9ee980 20 remove_watcher() i=3 2024-03-09T14:49:54.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.806+0000 7fa76a9ee980 20 remove_watcher() i=4 2024-03-09T14:49:54.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.806+0000 7fa76a9ee980 20 remove_watcher() i=5 2024-03-09T14:49:54.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.810+0000 7fa76a9ee980 20 remove_watcher() i=6 2024-03-09T14:49:54.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.810+0000 7fa76a9ee980 20 remove_watcher() i=7 2024-03-09T14:49:54.819 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-03-09T14:49:54.825 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key OLRHEESBUJFXQYHOPKLI --secret sQ+02naXXgpj9y38wm1OczeWDpA7em9B4qtXJhWN+GBQu1zcwDD3eQ== --cluster ceph 2024-03-09T14:49:54.907 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:49:54.908 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:49:54.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.958+0000 7fcedc0f6980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.958+0000 7fcedc0f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:54.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.958+0000 7fcedc0f6980 20 realm 2024-03-09T14:49:54.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.958+0000 7fcedc0f6980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.958+0000 7fcedc0f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:54.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.958+0000 7fcedc0f6980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:49:54.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.958+0000 7fcedc0f6980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.958+0000 7fcedc0f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:54.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.958+0000 7fcedc0f6980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.962+0000 7fcedc0f6980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:54.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.962+0000 7fcedc0f6980 20 rados->read ofs=0 len=0 2024-03-09T14:49:54.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.962+0000 7fcedc0f6980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:49:54.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.962+0000 7fcedc0f6980 20 searching for the correct realm 2024-03-09T14:49:54.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.966+0000 7fceda40f640 0 -- 172.21.15.99:0/323178393 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7fced0037030 msgr2=0x7fced003b9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:54.965 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:54.974+0000 7fced940d640 0 -- 172.21.15.99:0/323178393 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fced411eb00 msgr2=0x7fced4009be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:55.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.190+0000 7fcedc0f6980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:49:55.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.190+0000 7fcedc0f6980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:49:55.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.190+0000 7fcedc0f6980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:49:55.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.190+0000 7fcedc0f6980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:49:55.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.190+0000 7fcedc0f6980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:49:55.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.190+0000 7fcedc0f6980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:49:55.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.190+0000 7fcedc0f6980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.190+0000 7fcedc0f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:55.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.194+0000 7fcedc0f6980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.194+0000 7fcedc0f6980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:55.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.194+0000 7fcedc0f6980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.194+0000 7fcedc0f6980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:49:55.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.194+0000 7fcedc0f6980 20 zone default found 2024-03-09T14:49:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.194+0000 7fcedc0f6980 4 Realm: () 2024-03-09T14:49:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.194+0000 7fcedc0f6980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:49:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.194+0000 7fcedc0f6980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:49:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.194+0000 7fcedc0f6980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:49:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.194+0000 7fcedc0f6980 20 zonegroup default 2024-03-09T14:49:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.194+0000 7fcedc0f6980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.194+0000 7fcedc0f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:55.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.194+0000 7fcedc0f6980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.194+0000 7fcedc0f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.194+0000 7fcedc0f6980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.198+0000 7fcedc0f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.198+0000 7fcedc0f6980 20 started sync module instance, tier type = 2024-03-09T14:49:55.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.198+0000 7fcedc0f6980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:49:55.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.218+0000 7fcedc0f6980 20 add_watcher() i=0 2024-03-09T14:49:55.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.218+0000 7fcedc0f6980 20 add_watcher() i=1 2024-03-09T14:49:55.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.218+0000 7fcedc0f6980 20 add_watcher() i=2 2024-03-09T14:49:55.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.218+0000 7fcedc0f6980 20 add_watcher() i=3 2024-03-09T14:49:55.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.218+0000 7fcedc0f6980 20 add_watcher() i=4 2024-03-09T14:49:55.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.218+0000 7fcedc0f6980 20 add_watcher() i=5 2024-03-09T14:49:55.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.218+0000 7fcedc0f6980 20 add_watcher() i=6 2024-03-09T14:49:55.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.218+0000 7fcedc0f6980 20 add_watcher() i=7 2024-03-09T14:49:55.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.218+0000 7fcedc0f6980 2 all 8 watchers are set, enabling cache 2024-03-09T14:49:55.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.222+0000 7fcd8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:55.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.222+0000 7fcedc0f6980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:49:55.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.222+0000 7fcedc0f6980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:49:55.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.222+0000 7fcedc0f6980 5 note: GC not initialized 2024-03-09T14:49:55.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcd8a7fc640 20 reqs_thread_entry: start 2024-03-09T14:49:55.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 20 init_complete bucket index max shards: 11 2024-03-09T14:49:55.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 20 Filter name: none 2024-03-09T14:49:55.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fccfbfff640 20 reqs_thread_entry: start 2024-03-09T14:49:55.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-03-09T14:49:55.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:55.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-03-09T14:49:55.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:49:55.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-03-09T14:49:55.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:55.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-03-09T14:49:55.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-03-09T14:49:55.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 10 cache get: name=default.rgw.meta+users.keys+OLRHEESBUJFXQYHOPKLI : miss 2024-03-09T14:49:55.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:55.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 10 cache put: name=default.rgw.meta+users.keys+OLRHEESBUJFXQYHOPKLI info.flags=0x0 2024-03-09T14:49:55.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 10 adding default.rgw.meta+users.keys+OLRHEESBUJFXQYHOPKLI to cache LRU end 2024-03-09T14:49:55.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 10 cache get: name=default.rgw.meta+users.keys+OLRHEESBUJFXQYHOPKLI : hit (negative entry) 2024-03-09T14:49:55.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.226+0000 7fcedc0f6980 10 cache get: name=default.rgw.meta+users.keys+OLRHEESBUJFXQYHOPKLI : hit (negative entry) 2024-03-09T14:49:55.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.230+0000 7fcedc0f6980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-09T14:49:55.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.230+0000 7fcedc0f6980 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:49:55.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.230+0000 7fcedc0f6980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-03-09T14:49:55.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.230+0000 7fcdbd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366311 cookie 94259801981168 notifier 7701 bl.length()=719 2024-03-09T14:49:55.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.230+0000 7fcdbd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-09T14:49:55.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.230+0000 7fcdbd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:49:55.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.234+0000 7fcedc0f6980 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-03-09T14:49:55.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.234+0000 7fcedc0f6980 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-03-09T14:49:55.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.234+0000 7fcedc0f6980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-03-09T14:49:55.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.234+0000 7fcdbd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366215 cookie 94259801984800 notifier 7701 bl.length()=215 2024-03-09T14:49:55.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.234+0000 7fcdbd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-03-09T14:49:55.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.234+0000 7fcdbd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-03-09T14:49:55.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.238+0000 7fcedc0f6980 10 cache put: name=default.rgw.meta+users.keys+OLRHEESBUJFXQYHOPKLI info.flags=0x7 2024-03-09T14:49:55.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.238+0000 7fcedc0f6980 10 moving default.rgw.meta+users.keys+OLRHEESBUJFXQYHOPKLI to cache LRU end 2024-03-09T14:49:55.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.238+0000 7fcedc0f6980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OLRHEESBUJFXQYHOPKLI, ofs0, ns] 2024-03-09T14:49:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.238+0000 7fcdbcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366401 cookie 94259801964896 notifier 7701 bl.length()=201 2024-03-09T14:49:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.238+0000 7fcdbcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OLRHEESBUJFXQYHOPKLI info.flags=0x7 2024-03-09T14:49:55.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.238+0000 7fcdbcff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OLRHEESBUJFXQYHOPKLI to cache LRU end 2024-03-09T14:49:55.232 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T14:49:55.232 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "testx$tenanteduser.client.0", 2024-03-09T14:49:55.232 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-03-09T14:49:55.232 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "testx$tenanteduser+test@test.test", 2024-03-09T14:49:55.232 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-03-09T14:49:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-03-09T14:49:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-03-09T14:49:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-03-09T14:49:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-09T14:49:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "testx$tenanteduser.client.0", 2024-03-09T14:49:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "OLRHEESBUJFXQYHOPKLI", 2024-03-09T14:49:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "sQ+02naXXgpj9y38wm1OczeWDpA7em9B4qtXJhWN+GBQu1zcwDD3eQ==", 2024-03-09T14:49:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-03-09T14:49:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:49:55.229872Z" 2024-03-09T14:49:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-09T14:49:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-09T14:49:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-03-09T14:49:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-03-09T14:49:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-03-09T14:49:55.233 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-03-09T14:49:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-03-09T14:49:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-03-09T14:49:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-03-09T14:49:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:49:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:49:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:49:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:49:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:49:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-03-09T14:49:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:49:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:49:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:49:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:49:55.234 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:49:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-03-09T14:49:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "rgw", 2024-03-09T14:49:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-03-09T14:49:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "", 2024-03-09T14:49:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-09T14:49:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:49:55.229844Z", 2024-03-09T14:49:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-03-09T14:49:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-03-09T14:49:55.235 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T14:49:55.235 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:55.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.242+0000 7fcd8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:55.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.246+0000 7fcedc0f6980 20 remove_watcher() i=0 2024-03-09T14:49:55.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.246+0000 7fcedc0f6980 2 removed watcher, disabling cache 2024-03-09T14:49:55.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.250+0000 7fcedc0f6980 20 remove_watcher() i=1 2024-03-09T14:49:55.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.250+0000 7fcedc0f6980 20 remove_watcher() i=2 2024-03-09T14:49:55.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.254+0000 7fcedc0f6980 20 remove_watcher() i=3 2024-03-09T14:49:55.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.254+0000 7fcedc0f6980 20 remove_watcher() i=4 2024-03-09T14:49:55.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.258+0000 7fcedc0f6980 20 remove_watcher() i=5 2024-03-09T14:49:55.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.258+0000 7fcedc0f6980 20 remove_watcher() i=6 2024-03-09T14:49:55.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.262+0000 7fcedc0f6980 20 remove_watcher() i=7 2024-03-09T14:49:55.270 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 0536600565 --totp-seed YVWMLONMFOOSJZFW7KF5JH3MDEUYB5ARKKDI5JMLRO37K7RRMU7Q3BTNON2J7LQZ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:49:55.358 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:49:55.358 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:49:55.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.406+0000 7f6dabc8c980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.410+0000 7f6dabc8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:55.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.410+0000 7f6dabc8c980 20 realm 2024-03-09T14:49:55.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.410+0000 7f6dabc8c980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.410+0000 7f6dabc8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:55.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.410+0000 7f6dabc8c980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:49:55.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.410+0000 7f6dabc8c980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.410+0000 7f6dabc8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:55.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.410+0000 7f6dabc8c980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.410+0000 7f6dabc8c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:55.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.410+0000 7f6dabc8c980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.414+0000 7f6dabc8c980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:49:55.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.414+0000 7f6dabc8c980 20 searching for the correct realm 2024-03-09T14:49:55.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.414+0000 7f6da9fa5640 0 -- 172.21.15.99:0/3409630628 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f6d940d1070 msgr2=0x7f6d940eb410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:55.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.422+0000 7f6da8fa3640 0 -- 172.21.15.99:0/3409630628 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f6da4047040 msgr2=0x7f6da4034540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:55.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:49:55.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:49:55.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:49:55.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:49:55.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:49:55.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:49:55.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:55.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:55.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:49:55.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 20 zone default found 2024-03-09T14:49:55.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 4 Realm: () 2024-03-09T14:49:55.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:49:55.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:49:55.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:49:55.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 20 zonegroup default 2024-03-09T14:49:55.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.638+0000 7f6dabc8c980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.642+0000 7f6dabc8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:55.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.642+0000 7f6dabc8c980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.642+0000 7f6dabc8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:55.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.642+0000 7f6dabc8c980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.642+0000 7f6dabc8c980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:55.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.642+0000 7f6dabc8c980 20 started sync module instance, tier type = 2024-03-09T14:49:55.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.642+0000 7f6dabc8c980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:49:55.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.666+0000 7f6dabc8c980 20 add_watcher() i=0 2024-03-09T14:49:55.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.666+0000 7f6dabc8c980 20 add_watcher() i=1 2024-03-09T14:49:55.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.666+0000 7f6dabc8c980 20 add_watcher() i=2 2024-03-09T14:49:55.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.666+0000 7f6dabc8c980 20 add_watcher() i=3 2024-03-09T14:49:55.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.666+0000 7f6dabc8c980 20 add_watcher() i=4 2024-03-09T14:49:55.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.666+0000 7f6dabc8c980 20 add_watcher() i=5 2024-03-09T14:49:55.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.670+0000 7f6dabc8c980 20 add_watcher() i=6 2024-03-09T14:49:55.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.670+0000 7f6dabc8c980 20 add_watcher() i=7 2024-03-09T14:49:55.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.670+0000 7f6dabc8c980 2 all 8 watchers are set, enabling cache 2024-03-09T14:49:55.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.678+0000 7f6c5ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:55.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.678+0000 7f6dabc8c980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:49:55.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.678+0000 7f6dabc8c980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:49:55.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.678+0000 7f6dabc8c980 5 note: GC not initialized 2024-03-09T14:49:55.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.678+0000 7f6c5efe5640 20 reqs_thread_entry: start 2024-03-09T14:49:55.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.678+0000 7f6dabc8c980 20 init_complete bucket index max shards: 11 2024-03-09T14:49:55.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.678+0000 7f6dabc8c980 20 Filter name: none 2024-03-09T14:49:55.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.678+0000 7f6c5cfe1640 20 reqs_thread_entry: start 2024-03-09T14:49:55.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.678+0000 7f6dabc8c980 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-03-09T14:49:55.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.678+0000 7f6dabc8c980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.678+0000 7f6dabc8c980 20 rados_obj.operate() r=0 bl.length=519 2024-03-09T14:49:55.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.678+0000 7f6dabc8c980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-03-09T14:49:55.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.678+0000 7f6dabc8c980 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:49:55.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.678+0000 7f6dabc8c980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:49:55.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.682+0000 7f6dabc8c980 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-09T14:49:55.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.682+0000 7f6dabc8c980 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:49:55.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.682+0000 7f6dabc8c980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-03-09T14:49:55.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.682+0000 7f6c8cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366312 cookie 94685711253360 notifier 7340 bl.length()=733 2024-03-09T14:49:55.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.682+0000 7f6c8cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-03-09T14:49:55.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.682+0000 7f6c8cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-03-09T14:49:55.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.686+0000 7f6c5ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.690+0000 7f6dabc8c980 20 remove_watcher() i=0 2024-03-09T14:49:55.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.690+0000 7f6dabc8c980 2 removed watcher, disabling cache 2024-03-09T14:49:55.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.694+0000 7f6dabc8c980 20 remove_watcher() i=1 2024-03-09T14:49:55.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.694+0000 7f6dabc8c980 20 remove_watcher() i=2 2024-03-09T14:49:55.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.698+0000 7f6dabc8c980 20 remove_watcher() i=3 2024-03-09T14:49:55.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.698+0000 7f6dabc8c980 20 remove_watcher() i=4 2024-03-09T14:49:55.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.702+0000 7f6dabc8c980 20 remove_watcher() i=5 2024-03-09T14:49:55.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.702+0000 7f6dabc8c980 20 remove_watcher() i=6 2024-03-09T14:49:55.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.702+0000 7f6dabc8c980 20 remove_watcher() i=7 2024-03-09T14:49:55.713 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-03-09T14:49:55.714 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key QFUMZRCEGDYSXQAUPRMN --secret aC9wvLkmazbhlYHKcTTBEWy7nOhCQR8PHV+LiJIRLC5EouwJ+Ajt6Q== --cluster ceph 2024-03-09T14:49:55.752 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:49:55.752 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:49:55.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.802+0000 7f0c5322d980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.802+0000 7f0c5322d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:55.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.802+0000 7f0c5322d980 20 realm 2024-03-09T14:49:55.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.802+0000 7f0c5322d980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.802+0000 7f0c5322d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:55.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.802+0000 7f0c5322d980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:49:55.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.802+0000 7f0c5322d980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.802+0000 7f0c5322d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:55.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.802+0000 7f0c5322d980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.806+0000 7f0c5322d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:55.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.806+0000 7f0c5322d980 20 rados->read ofs=0 len=0 2024-03-09T14:49:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.806+0000 7f0c5322d980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:49:55.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.806+0000 7f0c5322d980 20 searching for the correct realm 2024-03-09T14:49:55.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.810+0000 7f0c51546640 0 -- 172.21.15.99:0/2657919482 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55bc722c6310 msgr2=0x55bc722c8700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:55.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:55.818+0000 7f0c50544640 0 -- 172.21.15.99:0/2657919482 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f0c40060520 msgr2=0x7f0c4005e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:56.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.034+0000 7f0c5322d980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:49:56.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.034+0000 7f0c5322d980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:49:56.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.034+0000 7f0c5322d980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:49:56.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.034+0000 7f0c5322d980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:49:56.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.034+0000 7f0c5322d980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:49:56.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.034+0000 7f0c5322d980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:49:56.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.034+0000 7f0c5322d980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.034+0000 7f0c5322d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:56.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.034+0000 7f0c5322d980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.034+0000 7f0c5322d980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:56.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.034+0000 7f0c5322d980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.038+0000 7f0c5322d980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:49:56.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.038+0000 7f0c5322d980 20 zone default found 2024-03-09T14:49:56.029 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.038+0000 7f0c5322d980 4 Realm: () 2024-03-09T14:49:56.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.038+0000 7f0c5322d980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:49:56.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.038+0000 7f0c5322d980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:49:56.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.038+0000 7f0c5322d980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:49:56.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.038+0000 7f0c5322d980 20 zonegroup default 2024-03-09T14:49:56.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.038+0000 7f0c5322d980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.038+0000 7f0c5322d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:56.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.038+0000 7f0c5322d980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.038+0000 7f0c5322d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:56.031 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.038+0000 7f0c5322d980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.038+0000 7f0c5322d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:56.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.038+0000 7f0c5322d980 20 started sync module instance, tier type = 2024-03-09T14:49:56.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.038+0000 7f0c5322d980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:49:56.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.062+0000 7f0c5322d980 20 add_watcher() i=0 2024-03-09T14:49:56.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.062+0000 7f0c5322d980 20 add_watcher() i=1 2024-03-09T14:49:56.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.062+0000 7f0c5322d980 20 add_watcher() i=2 2024-03-09T14:49:56.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.062+0000 7f0c5322d980 20 add_watcher() i=3 2024-03-09T14:49:56.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.062+0000 7f0c5322d980 20 add_watcher() i=4 2024-03-09T14:49:56.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.062+0000 7f0c5322d980 20 add_watcher() i=5 2024-03-09T14:49:56.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.062+0000 7f0c5322d980 20 add_watcher() i=6 2024-03-09T14:49:56.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.066+0000 7f0c5322d980 20 add_watcher() i=7 2024-03-09T14:49:56.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.066+0000 7f0c5322d980 2 all 8 watchers are set, enabling cache 2024-03-09T14:49:56.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.070+0000 7f0b06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:56.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.070+0000 7f0c5322d980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:49:56.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.070+0000 7f0c5322d980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:49:56.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.070+0000 7f0c5322d980 5 note: GC not initialized 2024-03-09T14:49:56.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.070+0000 7f0b05fe3640 20 reqs_thread_entry: start 2024-03-09T14:49:56.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.070+0000 7f0c5322d980 20 init_complete bucket index max shards: 11 2024-03-09T14:49:56.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.070+0000 7f0c5322d980 20 Filter name: none 2024-03-09T14:49:56.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.070+0000 7f0a777fe640 20 reqs_thread_entry: start 2024-03-09T14:49:56.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.070+0000 7f0c5322d980 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-03-09T14:49:56.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.070+0000 7f0c5322d980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:56.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-03-09T14:49:56.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:49:56.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-03-09T14:49:56.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:56.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-03-09T14:49:56.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-03-09T14:49:56.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 10 cache get: name=default.rgw.meta+users.keys+QFUMZRCEGDYSXQAUPRMN : miss 2024-03-09T14:49:56.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:56.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 10 cache put: name=default.rgw.meta+users.keys+QFUMZRCEGDYSXQAUPRMN info.flags=0x0 2024-03-09T14:49:56.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 10 adding default.rgw.meta+users.keys+QFUMZRCEGDYSXQAUPRMN to cache LRU end 2024-03-09T14:49:56.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 10 cache get: name=default.rgw.meta+users.keys+QFUMZRCEGDYSXQAUPRMN : hit (negative entry) 2024-03-09T14:49:56.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 10 cache get: name=default.rgw.meta+users.keys+QFUMZRCEGDYSXQAUPRMN : hit (negative entry) 2024-03-09T14:49:56.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:49:56.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:49:56.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.074+0000 7f0c5322d980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-03-09T14:49:56.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.078+0000 7f0b27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366216 cookie 94267857773120 notifier 7355 bl.length()=660 2024-03-09T14:49:56.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.078+0000 7f0b27fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:49:56.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.078+0000 7f0b27fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:49:56.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.078+0000 7f0c5322d980 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-03-09T14:49:56.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.078+0000 7f0c5322d980 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-03-09T14:49:56.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.078+0000 7f0c5322d980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-03-09T14:49:56.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.082+0000 7f0b27fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366251 cookie 94267857756160 notifier 7355 bl.length()=191 2024-03-09T14:49:56.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.082+0000 7f0b27fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-03-09T14:49:56.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.082+0000 7f0b27fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-03-09T14:49:56.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.086+0000 7f0c5322d980 10 cache put: name=default.rgw.meta+users.keys+QFUMZRCEGDYSXQAUPRMN info.flags=0x7 2024-03-09T14:49:56.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.086+0000 7f0c5322d980 10 moving default.rgw.meta+users.keys+QFUMZRCEGDYSXQAUPRMN to cache LRU end 2024-03-09T14:49:56.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.086+0000 7f0c5322d980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:QFUMZRCEGDYSXQAUPRMN, ofs0, ns] 2024-03-09T14:49:56.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.086+0000 7f0b277fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366207 cookie 94267857758656 notifier 7355 bl.length()=189 2024-03-09T14:49:56.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.086+0000 7f0b277fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QFUMZRCEGDYSXQAUPRMN info.flags=0x7 2024-03-09T14:49:56.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.086+0000 7f0b277fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QFUMZRCEGDYSXQAUPRMN to cache LRU end 2024-03-09T14:49:56.079 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T14:49:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "foobar.client.0", 2024-03-09T14:49:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr.foobar.client.0", 2024-03-09T14:49:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "foobar+test@test.test", 2024-03-09T14:49:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-03-09T14:49:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-03-09T14:49:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-03-09T14:49:56.079 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-03-09T14:49:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-09T14:49:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "foobar.client.0", 2024-03-09T14:49:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "QFUMZRCEGDYSXQAUPRMN", 2024-03-09T14:49:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "aC9wvLkmazbhlYHKcTTBEWy7nOhCQR8PHV+LiJIRLC5EouwJ+Ajt6Q==", 2024-03-09T14:49:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-03-09T14:49:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:49:56.076469Z" 2024-03-09T14:49:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-09T14:49:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-09T14:49:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-03-09T14:49:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-03-09T14:49:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-03-09T14:49:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-03-09T14:49:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-03-09T14:49:56.080 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-03-09T14:49:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-03-09T14:49:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:49:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:49:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:49:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:49:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:49:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-03-09T14:49:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:49:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:49:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:49:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:49:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:49:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:56.081 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-03-09T14:49:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "rgw", 2024-03-09T14:49:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-03-09T14:49:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "", 2024-03-09T14:49:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-09T14:49:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:49:56.076424Z", 2024-03-09T14:49:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-03-09T14:49:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-03-09T14:49:56.082 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T14:49:56.082 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:56.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.086+0000 7f0b06fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:56.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.094+0000 7f0c5322d980 20 remove_watcher() i=0 2024-03-09T14:49:56.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.094+0000 7f0c5322d980 2 removed watcher, disabling cache 2024-03-09T14:49:56.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.094+0000 7f0c5322d980 20 remove_watcher() i=1 2024-03-09T14:49:56.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.098+0000 7f0c5322d980 20 remove_watcher() i=2 2024-03-09T14:49:56.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.102+0000 7f0c5322d980 20 remove_watcher() i=3 2024-03-09T14:49:56.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.102+0000 7f0c5322d980 20 remove_watcher() i=4 2024-03-09T14:49:56.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.102+0000 7f0c5322d980 20 remove_watcher() i=5 2024-03-09T14:49:56.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.106+0000 7f0c5322d980 20 remove_watcher() i=6 2024-03-09T14:49:56.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.106+0000 7f0c5322d980 20 remove_watcher() i=7 2024-03-09T14:49:56.117 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 6084975904 --totp-seed ZG3T5URIC5SJJUM5FTJL5FAVLBNPFXASDDG5AD54SRRNALP456MME2NPYSIHAOMW --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:49:56.206 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:49:56.206 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:49:56.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.254+0000 7f44abefd980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.254+0000 7f44abefd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:56.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.254+0000 7f44abefd980 20 realm 2024-03-09T14:49:56.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.254+0000 7f44abefd980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.258+0000 7f44abefd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:56.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.258+0000 7f44abefd980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:49:56.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.258+0000 7f44abefd980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.258+0000 7f44abefd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:56.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.258+0000 7f44abefd980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.258+0000 7f44abefd980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:56.252 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.258+0000 7f44abefd980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.262+0000 7f44abefd980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:49:56.253 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.262+0000 7f44abefd980 20 searching for the correct realm 2024-03-09T14:49:56.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.262+0000 7f44aa216640 0 -- 172.21.15.99:0/503976164 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f44940e9bc0 msgr2=0x7f44940e8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:49:56.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.478+0000 7f44a9214640 0 -- 172.21.15.99:0/503976164 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f44a402a030 msgr2=0x7f44a40717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:56.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.694+0000 7f44abefd980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:49:56.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.694+0000 7f44abefd980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:49:56.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.694+0000 7f44abefd980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:49:56.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.694+0000 7f44abefd980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:49:56.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.694+0000 7f44abefd980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:49:56.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.694+0000 7f44abefd980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:49:56.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.694+0000 7f44abefd980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.694+0000 7f44abefd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:56.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.694+0000 7f44abefd980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.698+0000 7f44abefd980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:56.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.698+0000 7f44abefd980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.698+0000 7f44abefd980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:49:56.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.698+0000 7f44abefd980 20 zone default found 2024-03-09T14:49:56.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.698+0000 7f44abefd980 4 Realm: () 2024-03-09T14:49:56.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.698+0000 7f44abefd980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:49:56.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.698+0000 7f44abefd980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:49:56.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.698+0000 7f44abefd980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:49:56.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.698+0000 7f44abefd980 20 zonegroup default 2024-03-09T14:49:56.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.698+0000 7f44abefd980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.698+0000 7f44abefd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:56.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.698+0000 7f44abefd980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.698+0000 7f44abefd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:56.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.698+0000 7f44abefd980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.698+0000 7f44abefd980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:56.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.698+0000 7f44abefd980 20 started sync module instance, tier type = 2024-03-09T14:49:56.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.698+0000 7f44abefd980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:49:56.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.722+0000 7f44abefd980 20 add_watcher() i=0 2024-03-09T14:49:56.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.722+0000 7f44abefd980 20 add_watcher() i=1 2024-03-09T14:49:56.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.722+0000 7f44abefd980 20 add_watcher() i=2 2024-03-09T14:49:56.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.722+0000 7f44abefd980 20 add_watcher() i=3 2024-03-09T14:49:56.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.722+0000 7f44abefd980 20 add_watcher() i=4 2024-03-09T14:49:56.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.722+0000 7f44abefd980 20 add_watcher() i=5 2024-03-09T14:49:56.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.722+0000 7f44abefd980 20 add_watcher() i=6 2024-03-09T14:49:56.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.722+0000 7f44abefd980 20 add_watcher() i=7 2024-03-09T14:49:56.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.722+0000 7f44abefd980 2 all 8 watchers are set, enabling cache 2024-03-09T14:49:56.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.726+0000 7f435b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:56.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.726+0000 7f44abefd980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:49:56.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.726+0000 7f44abefd980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:49:56.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.726+0000 7f44abefd980 5 note: GC not initialized 2024-03-09T14:49:56.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.726+0000 7f435a7fc640 20 reqs_thread_entry: start 2024-03-09T14:49:56.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.726+0000 7f44abefd980 20 init_complete bucket index max shards: 11 2024-03-09T14:49:56.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.730+0000 7f44abefd980 20 Filter name: none 2024-03-09T14:49:56.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.730+0000 7f42cbfff640 20 reqs_thread_entry: start 2024-03-09T14:49:56.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.730+0000 7f44abefd980 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-03-09T14:49:56.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.730+0000 7f44abefd980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.730+0000 7f44abefd980 20 rados_obj.operate() r=0 bl.length=472 2024-03-09T14:49:56.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.730+0000 7f44abefd980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-03-09T14:49:56.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.730+0000 7f44abefd980 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:49:56.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.730+0000 7f44abefd980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:49:56.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.734+0000 7f44abefd980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:49:56.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.734+0000 7f44abefd980 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:49:56.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.734+0000 7f44abefd980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-03-09T14:49:56.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.734+0000 7f438d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366217 cookie 94545917708928 notifier 7370 bl.length()=674 2024-03-09T14:49:56.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.734+0000 7f438d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:49:56.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.734+0000 7f438d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:49:56.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.738+0000 7f435b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:56.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.742+0000 7f44abefd980 20 remove_watcher() i=0 2024-03-09T14:49:56.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.742+0000 7f44abefd980 2 removed watcher, disabling cache 2024-03-09T14:49:56.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.746+0000 7f44abefd980 20 remove_watcher() i=1 2024-03-09T14:49:56.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.746+0000 7f44abefd980 20 remove_watcher() i=2 2024-03-09T14:49:56.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.750+0000 7f44abefd980 20 remove_watcher() i=3 2024-03-09T14:49:56.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.750+0000 7f44abefd980 20 remove_watcher() i=4 2024-03-09T14:49:56.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.754+0000 7f44abefd980 20 remove_watcher() i=5 2024-03-09T14:49:56.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.754+0000 7f44abefd980 20 remove_watcher() i=6 2024-03-09T14:49:56.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.758+0000 7f44abefd980 20 remove_watcher() i=7 2024-03-09T14:49:56.768 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-03-09T14:49:56.804 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:49:56.804 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:49:56.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.854+0000 7f629d654980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.854+0000 7f629d654980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:56.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.854+0000 7f629d654980 20 realm 2024-03-09T14:49:56.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.854+0000 7f629d654980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.854+0000 7f629d654980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:56.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.854+0000 7f629d654980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:49:56.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.854+0000 7f629d654980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.854+0000 7f629d654980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:56.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.854+0000 7f629d654980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.858+0000 7f629d654980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:56.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.858+0000 7f629d654980 20 rados->read ofs=0 len=0 2024-03-09T14:49:56.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.858+0000 7f629d654980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:49:56.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.858+0000 7f629d654980 20 searching for the correct realm 2024-03-09T14:49:56.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.862+0000 7f629b96d640 0 -- 172.21.15.99:0/2447107922 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55ccd16c23e0 msgr2=0x55ccd16c47d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:49:56.862 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:56.870+0000 7f629a96b640 0 -- 172.21.15.99:0/2447107922 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f62940cb070 msgr2=0x7f62940a5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:49:57.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.086+0000 7f629d654980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:49:57.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.086+0000 7f629d654980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:49:57.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.086+0000 7f629d654980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:49:57.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.086+0000 7f629d654980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:49:57.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.086+0000 7f629d654980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:49:57.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.086+0000 7f629d654980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:49:57.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.086+0000 7f629d654980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.086+0000 7f629d654980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:57.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.086+0000 7f629d654980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.090+0000 7f629d654980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:57.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.090+0000 7f629d654980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.090+0000 7f629d654980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:49:57.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.090+0000 7f629d654980 20 zone default found 2024-03-09T14:49:57.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.090+0000 7f629d654980 4 Realm: () 2024-03-09T14:49:57.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.090+0000 7f629d654980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:49:57.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.090+0000 7f629d654980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:49:57.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.090+0000 7f629d654980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:49:57.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.090+0000 7f629d654980 20 zonegroup default 2024-03-09T14:49:57.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.090+0000 7f629d654980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.090+0000 7f629d654980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:57.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.090+0000 7f629d654980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.090+0000 7f629d654980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:57.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.090+0000 7f629d654980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.090+0000 7f629d654980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:57.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.090+0000 7f629d654980 20 started sync module instance, tier type = 2024-03-09T14:49:57.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.090+0000 7f629d654980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:49:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.114+0000 7f629d654980 20 add_watcher() i=0 2024-03-09T14:49:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.114+0000 7f629d654980 20 add_watcher() i=1 2024-03-09T14:49:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.114+0000 7f629d654980 20 add_watcher() i=2 2024-03-09T14:49:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.114+0000 7f629d654980 20 add_watcher() i=3 2024-03-09T14:49:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.114+0000 7f629d654980 20 add_watcher() i=4 2024-03-09T14:49:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.114+0000 7f629d654980 20 add_watcher() i=5 2024-03-09T14:49:57.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.114+0000 7f629d654980 20 add_watcher() i=6 2024-03-09T14:49:57.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.114+0000 7f629d654980 20 add_watcher() i=7 2024-03-09T14:49:57.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.114+0000 7f629d654980 2 all 8 watchers are set, enabling cache 2024-03-09T14:49:57.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.118+0000 7f6150fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:57.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.118+0000 7f629d654980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:49:57.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.118+0000 7f629d654980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:49:57.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.118+0000 7f629d654980 5 note: GC not initialized 2024-03-09T14:49:57.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.118+0000 7f60cb7fe640 20 reqs_thread_entry: start 2024-03-09T14:49:57.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.118+0000 7f629d654980 20 init_complete bucket index max shards: 11 2024-03-09T14:49:57.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.118+0000 7f629d654980 20 Filter name: none 2024-03-09T14:49:57.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.118+0000 7f60c97fa640 20 reqs_thread_entry: start 2024-03-09T14:49:57.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.122+0000 7f629d654980 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-03-09T14:49:57.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.122+0000 7f629d654980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.122+0000 7f629d654980 20 rados_obj.operate() r=0 bl.length=486 2024-03-09T14:49:57.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.122+0000 7f629d654980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-03-09T14:49:57.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.122+0000 7f629d654980 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:49:57.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.122+0000 7f629d654980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:49:57.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.122+0000 7f629d654980 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:49:57.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.122+0000 7f629d654980 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:49:57.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.122+0000 7f629d654980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-03-09T14:49:57.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.122+0000 7f617dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366218 cookie 94338175265248 notifier 7782 bl.length()=727 2024-03-09T14:49:57.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.122+0000 7f617dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-03-09T14:49:57.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.122+0000 7f617dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-03-09T14:49:57.116 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T14:49:57.116 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "foobar.client.0", 2024-03-09T14:49:57.116 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr.foobar.client.0", 2024-03-09T14:49:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "foobar+test@test.test", 2024-03-09T14:49:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-03-09T14:49:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-03-09T14:49:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-03-09T14:49:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-03-09T14:49:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-09T14:49:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "foobar.client.0", 2024-03-09T14:49:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "QFUMZRCEGDYSXQAUPRMN", 2024-03-09T14:49:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "aC9wvLkmazbhlYHKcTTBEWy7nOhCQR8PHV+LiJIRLC5EouwJ+Ajt6Q==", 2024-03-09T14:49:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-03-09T14:49:57.117 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:49:56.076469Z" 2024-03-09T14:49:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-09T14:49:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-09T14:49:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-03-09T14:49:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [ 2024-03-09T14:49:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-09T14:49:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "oidc-provider", 2024-03-09T14:49:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: "perm": "*" 2024-03-09T14:49:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-09T14:49:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "roles", 2024-03-09T14:49:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: "perm": "*" 2024-03-09T14:49:57.118 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-09T14:49:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "user-policy", 2024-03-09T14:49:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "perm": "*" 2024-03-09T14:49:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-09T14:49:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-09T14:49:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-03-09T14:49:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-03-09T14:49:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-03-09T14:49:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-03-09T14:49:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-03-09T14:49:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:49:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:49:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:49:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:49:57.119 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:49:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-03-09T14:49:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:49:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:49:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:49:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:49:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:49:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-03-09T14:49:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "rgw", 2024-03-09T14:49:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [ 2024-03-09T14:49:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "6084975904" 2024-03-09T14:49:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-09T14:49:57.120 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "", 2024-03-09T14:49:57.121 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-09T14:49:57.121 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:49:56.076424Z", 2024-03-09T14:49:57.121 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-03-09T14:49:57.121 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-03-09T14:49:57.121 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T14:49:57.121 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:57.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.126+0000 7f6150fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:57.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.130+0000 7f629d654980 20 remove_watcher() i=0 2024-03-09T14:49:57.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.130+0000 7f629d654980 2 removed watcher, disabling cache 2024-03-09T14:49:57.125 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.134+0000 7f629d654980 20 remove_watcher() i=1 2024-03-09T14:49:57.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.134+0000 7f629d654980 20 remove_watcher() i=2 2024-03-09T14:49:57.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.138+0000 7f629d654980 20 remove_watcher() i=3 2024-03-09T14:49:57.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.138+0000 7f629d654980 20 remove_watcher() i=4 2024-03-09T14:49:57.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.142+0000 7f629d654980 20 remove_watcher() i=5 2024-03-09T14:49:57.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.142+0000 7f629d654980 20 remove_watcher() i=6 2024-03-09T14:49:57.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.142+0000 7f629d654980 20 remove_watcher() i=7 2024-03-09T14:49:57.151 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name 'Mr. RGW88888888888888888' --email RGW88888888888888888+test@test.test 2024-03-09T14:49:57.231 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:49:57.232 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:49:57.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.490+0000 7f3ba0a9b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.494+0000 7f3ba0a9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:57.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.494+0000 7f3ba0a9b980 20 realm 2024-03-09T14:49:57.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.494+0000 7f3ba0a9b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.494+0000 7f3ba0a9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:57.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.494+0000 7f3ba0a9b980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:49:57.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.494+0000 7f3ba0a9b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.494+0000 7f3ba0a9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:57.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.494+0000 7f3ba0a9b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.494+0000 7f3ba0a9b980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:57.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.494+0000 7f3ba0a9b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.498+0000 7f3ba0a9b980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:49:57.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.498+0000 7f3ba0a9b980 20 searching for the correct realm 2024-03-09T14:49:57.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.502+0000 7f3b9edb4640 0 -- 172.21.15.99:0/996746688 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f3b8801e060 msgr2=0x7f3b88083940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:57.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.718+0000 7f3b9ddb2640 0 -- 172.21.15.99:0/996746688 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f3b980e0040 msgr2=0x7f3b980f2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:49:57.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.934+0000 7f3ba0a9b980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:49:57.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.934+0000 7f3ba0a9b980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:49:57.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.934+0000 7f3ba0a9b980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:49:57.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.934+0000 7f3ba0a9b980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:49:57.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.934+0000 7f3ba0a9b980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:49:57.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.934+0000 7f3ba0a9b980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:49:57.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.934+0000 7f3ba0a9b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.938+0000 7f3ba0a9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:57.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.938+0000 7f3ba0a9b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.938+0000 7f3ba0a9b980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:57.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.938+0000 7f3ba0a9b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.938+0000 7f3ba0a9b980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:49:57.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.938+0000 7f3ba0a9b980 20 zone default found 2024-03-09T14:49:57.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.938+0000 7f3ba0a9b980 4 Realm: () 2024-03-09T14:49:57.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.938+0000 7f3ba0a9b980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:49:57.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.938+0000 7f3ba0a9b980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:49:57.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.938+0000 7f3ba0a9b980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:49:57.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.938+0000 7f3ba0a9b980 20 zonegroup default 2024-03-09T14:49:57.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.938+0000 7f3ba0a9b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.938+0000 7f3ba0a9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:57.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.938+0000 7f3ba0a9b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.938+0000 7f3ba0a9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:57.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.938+0000 7f3ba0a9b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.942+0000 7f3ba0a9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:57.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.942+0000 7f3ba0a9b980 20 started sync module instance, tier type = 2024-03-09T14:49:57.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.942+0000 7f3ba0a9b980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:49:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.962+0000 7f3ba0a9b980 20 add_watcher() i=0 2024-03-09T14:49:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.962+0000 7f3ba0a9b980 20 add_watcher() i=1 2024-03-09T14:49:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.962+0000 7f3ba0a9b980 20 add_watcher() i=2 2024-03-09T14:49:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.962+0000 7f3ba0a9b980 20 add_watcher() i=3 2024-03-09T14:49:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.962+0000 7f3ba0a9b980 20 add_watcher() i=4 2024-03-09T14:49:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.962+0000 7f3ba0a9b980 20 add_watcher() i=5 2024-03-09T14:49:57.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.962+0000 7f3ba0a9b980 20 add_watcher() i=6 2024-03-09T14:49:57.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.962+0000 7f3ba0a9b980 20 add_watcher() i=7 2024-03-09T14:49:57.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.962+0000 7f3ba0a9b980 2 all 8 watchers are set, enabling cache 2024-03-09T14:49:57.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.966+0000 7f3a54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:57.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.966+0000 7f3ba0a9b980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:49:57.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.966+0000 7f3ba0a9b980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:49:57.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.966+0000 7f3ba0a9b980 5 note: GC not initialized 2024-03-09T14:49:57.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.966+0000 7f39cf7fe640 20 reqs_thread_entry: start 2024-03-09T14:49:57.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.970+0000 7f3ba0a9b980 20 init_complete bucket index max shards: 11 2024-03-09T14:49:57.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.970+0000 7f3ba0a9b980 20 Filter name: none 2024-03-09T14:49:57.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.970+0000 7f39cd7fa640 20 reqs_thread_entry: start 2024-03-09T14:49:57.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.970+0000 7f3ba0a9b980 10 cache get: name=default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 : miss 2024-03-09T14:49:57.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.970+0000 7f3ba0a9b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.970+0000 7f3ba0a9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:57.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.970+0000 7f3ba0a9b980 10 cache put: name=default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 info.flags=0x0 2024-03-09T14:49:57.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.970+0000 7f3ba0a9b980 10 adding default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 to cache LRU end 2024-03-09T14:49:57.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.970+0000 7f3ba0a9b980 20 failed to read name.$Mr. RGW88888888888888888 with: (2) No such file or directory 2024-03-09T14:49:57.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.970+0000 7f3ba0a9b980 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-03-09T14:49:57.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.970+0000 7f3ba0a9b980 20 rados->read ofs=0 len=0 2024-03-09T14:49:57.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.970+0000 7f3ba0a9b980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:57.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.970+0000 7f3ba0a9b980 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-03-09T14:49:57.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.970+0000 7f3ba0a9b980 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-03-09T14:49:57.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.970+0000 7f3ba0a9b980 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-03-09T14:49:57.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.974+0000 7f3ba0a9b980 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-03-09T14:49:57.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.974+0000 7f3ba0a9b980 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-03-09T14:49:57.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.974+0000 7f3ba0a9b980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-03-09T14:49:57.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.974+0000 7f3a81ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366252 cookie 94344151191760 notifier 7800 bl.length()=353 2024-03-09T14:49:57.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.974+0000 7f3a81ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-03-09T14:49:57.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.974+0000 7f3a81ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-03-09T14:49:57.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.978+0000 7f3ba0a9b980 10 cache put: name=default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 info.flags=0x17 2024-03-09T14:49:57.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.978+0000 7f3ba0a9b980 10 moving default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 to cache LRU end 2024-03-09T14:49:57.970 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.978+0000 7f3ba0a9b980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr. RGW88888888888888888, ofs0, ns] 2024-03-09T14:49:57.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.978+0000 7f3a81ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366402 cookie 94344151203168 notifier 7800 bl.length()=226 2024-03-09T14:49:57.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.978+0000 7f3a81ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 info.flags=0x17 2024-03-09T14:49:57.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.978+0000 7f3a81ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr. RGW88888888888888888 to cache LRU end 2024-03-09T14:49:57.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.982+0000 7f3ba0a9b980 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-03-09T14:49:57.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.982+0000 7f3ba0a9b980 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-03-09T14:49:57.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.982+0000 7f3ba0a9b980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-03-09T14:49:57.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.982+0000 7f3a817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366225 cookie 94344151186096 notifier 7800 bl.length()=234 2024-03-09T14:49:57.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.982+0000 7f3a817fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-03-09T14:49:57.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.982+0000 7f3a817fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-03-09T14:49:57.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.986+0000 7f3a54fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.990+0000 7f3ba0a9b980 20 remove_watcher() i=0 2024-03-09T14:49:57.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.990+0000 7f3ba0a9b980 2 removed watcher, disabling cache 2024-03-09T14:49:57.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.990+0000 7f3ba0a9b980 20 remove_watcher() i=1 2024-03-09T14:49:57.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.994+0000 7f3ba0a9b980 20 remove_watcher() i=2 2024-03-09T14:49:57.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.998+0000 7f3ba0a9b980 20 remove_watcher() i=3 2024-03-09T14:49:57.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.998+0000 7f3ba0a9b980 20 remove_watcher() i=4 2024-03-09T14:49:57.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:57.998+0000 7f3ba0a9b980 20 remove_watcher() i=5 2024-03-09T14:49:57.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.002+0000 7f3ba0a9b980 20 remove_watcher() i=6 2024-03-09T14:49:57.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.002+0000 7f3ba0a9b980 20 remove_watcher() i=7 2024-03-09T14:49:58.010 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T14:49:58.010 INFO:teuthology.orchestra.run.smithi099.stdout: "id": "RGW88888888888888888", 2024-03-09T14:49:58.010 INFO:teuthology.orchestra.run.smithi099.stdout: "tenant": "", 2024-03-09T14:49:58.010 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "Mr. RGW88888888888888888", 2024-03-09T14:49:58.010 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "RGW88888888888888888+test@test.test", 2024-03-09T14:49:58.011 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-09T14:49:58.011 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:49:58.011 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:49:58.011 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:49:58.011 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:49:58.011 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:49:58.011 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:58.011 INFO:teuthology.orchestra.run.smithi099.stdout: "max_users": 1000, 2024-03-09T14:49:58.011 INFO:teuthology.orchestra.run.smithi099.stdout: "max_roles": 1000, 2024-03-09T14:49:58.011 INFO:teuthology.orchestra.run.smithi099.stdout: "max_groups": 1000, 2024-03-09T14:49:58.011 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-03-09T14:49:58.011 INFO:teuthology.orchestra.run.smithi099.stdout: "max_access_keys": 4 2024-03-09T14:49:58.012 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T14:49:58.013 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-03-09T14:49:58.013 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key XWUVBFUFDZDASHWTPRBJ --secret SaJfSYwEKxC4Lq3GHD9vNIcvfIl6qKfigoezOlCMBW9+N0jOVdeDVw== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-03-09T14:49:58.105 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:49:58.105 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:49:58.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.350+0000 7f9f848e9640 0 --2- 172.21.15.99:0/1594002912 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x560cfef775b0 0x560cfef77a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-03-09T14:49:58.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.358+0000 7f9f865d0980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.358+0000 7f9f865d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.358+0000 7f9f865d0980 20 realm 2024-03-09T14:49:58.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.358+0000 7f9f865d0980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.358+0000 7f9f865d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.358+0000 7f9f865d0980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:49:58.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.358+0000 7f9f865d0980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.358+0000 7f9f865d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.358+0000 7f9f865d0980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.362+0000 7f9f865d0980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:58.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.362+0000 7f9f865d0980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.362+0000 7f9f865d0980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:49:58.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.362+0000 7f9f865d0980 20 searching for the correct realm 2024-03-09T14:49:58.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.366+0000 7f9f838e7640 0 -- 172.21.15.99:0/2937648686 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f9f74033040 msgr2=0x7f9f74064390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:58.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.370+0000 7f9f838e7640 0 -- 172.21.15.99:0/2937648686 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f9e4c078470 msgr2=0x7f9e4c07a8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:49:58.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:49:58.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:49:58.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:49:58.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:49:58.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:49:58.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:49:58.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:58.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:49:58.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 zone default found 2024-03-09T14:49:58.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 4 Realm: () 2024-03-09T14:49:58.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:49:58.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:49:58.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:49:58.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 zonegroup default 2024-03-09T14:49:58.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 started sync module instance, tier type = 2024-03-09T14:49:58.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.386+0000 7f9f865d0980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:49:58.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.406+0000 7f9f865d0980 20 add_watcher() i=0 2024-03-09T14:49:58.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.406+0000 7f9f865d0980 20 add_watcher() i=1 2024-03-09T14:49:58.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.406+0000 7f9f865d0980 20 add_watcher() i=2 2024-03-09T14:49:58.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.406+0000 7f9f865d0980 20 add_watcher() i=3 2024-03-09T14:49:58.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.406+0000 7f9f865d0980 20 add_watcher() i=4 2024-03-09T14:49:58.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.406+0000 7f9f865d0980 20 add_watcher() i=5 2024-03-09T14:49:58.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.406+0000 7f9f865d0980 20 add_watcher() i=6 2024-03-09T14:49:58.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.406+0000 7f9f865d0980 20 add_watcher() i=7 2024-03-09T14:49:58.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.406+0000 7f9f865d0980 2 all 8 watchers are set, enabling cache 2024-03-09T14:49:58.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9e3afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:58.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:49:58.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:49:58.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 5 note: GC not initialized 2024-03-09T14:49:58.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9e39fdb640 20 reqs_thread_entry: start 2024-03-09T14:49:58.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 20 init_complete bucket index max shards: 11 2024-03-09T14:49:58.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 20 Filter name: none 2024-03-09T14:49:58.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9dab7fe640 20 reqs_thread_entry: start 2024-03-09T14:49:58.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-03-09T14:49:58.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-03-09T14:49:58.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:49:58.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-03-09T14:49:58.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-03-09T14:49:58.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-03-09T14:49:58.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 10 cache get: name=default.rgw.meta+users.keys+XWUVBFUFDZDASHWTPRBJ : miss 2024-03-09T14:49:58.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 10 cache put: name=default.rgw.meta+users.keys+XWUVBFUFDZDASHWTPRBJ info.flags=0x0 2024-03-09T14:49:58.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 10 adding default.rgw.meta+users.keys+XWUVBFUFDZDASHWTPRBJ to cache LRU end 2024-03-09T14:49:58.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-03-09T14:49:58.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.410+0000 7f9f865d0980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.414+0000 7f9f865d0980 20 rados_obj.operate() r=0 bl.length=153 2024-03-09T14:49:58.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.414+0000 7f9f865d0980 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-03-09T14:49:58.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.414+0000 7f9f865d0980 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-03-09T14:49:58.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.414+0000 7f9f865d0980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:49:58.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.414+0000 7f9f865d0980 10 cache get: name=default.rgw.meta+users.keys+XWUVBFUFDZDASHWTPRBJ : hit (negative entry) 2024-03-09T14:49:58.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.414+0000 7f9f865d0980 10 cache get: name=default.rgw.meta+users.keys+XWUVBFUFDZDASHWTPRBJ : hit (negative entry) 2024-03-09T14:49:58.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.414+0000 7f9f865d0980 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-03-09T14:49:58.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.414+0000 7f9f865d0980 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:49:58.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.414+0000 7f9f865d0980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-03-09T14:49:58.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.418+0000 7f9e5affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366253 cookie 94613817394672 notifier 7818 bl.length()=681 2024-03-09T14:49:58.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.418+0000 7f9e5affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-03-09T14:49:58.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.418+0000 7f9e5affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:49:58.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.418+0000 7f9f865d0980 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-03-09T14:49:58.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.418+0000 7f9f865d0980 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-03-09T14:49:58.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.418+0000 7f9f865d0980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-03-09T14:49:58.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.418+0000 7f9e5b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366313 cookie 94613817390176 notifier 7818 bl.length()=189 2024-03-09T14:49:58.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.418+0000 7f9e5b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-03-09T14:49:58.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.418+0000 7f9e5b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-03-09T14:49:58.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.422+0000 7f9f865d0980 10 cache put: name=default.rgw.meta+users.keys+XWUVBFUFDZDASHWTPRBJ info.flags=0x7 2024-03-09T14:49:58.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.422+0000 7f9f865d0980 10 moving default.rgw.meta+users.keys+XWUVBFUFDZDASHWTPRBJ to cache LRU end 2024-03-09T14:49:58.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.422+0000 7f9f865d0980 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:XWUVBFUFDZDASHWTPRBJ, ofs0, ns] 2024-03-09T14:49:58.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.422+0000 7f9e5b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366208 cookie 94613817398896 notifier 7818 bl.length()=188 2024-03-09T14:49:58.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.422+0000 7f9e5b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XWUVBFUFDZDASHWTPRBJ info.flags=0x7 2024-03-09T14:49:58.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.422+0000 7f9e5b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XWUVBFUFDZDASHWTPRBJ to cache LRU end 2024-03-09T14:49:58.419 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.426+0000 7f9f865d0980 20 linked user root1.client.0 to account RGW88888888888888888 2024-03-09T14:49:58.419 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T14:49:58.419 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "root1.client.0", 2024-03-09T14:49:58.419 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr.RGW88888888888888888", 2024-03-09T14:49:58.419 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "root1+test@test.test", 2024-03-09T14:49:58.420 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-03-09T14:49:58.420 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-03-09T14:49:58.420 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-03-09T14:49:58.420 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-03-09T14:49:58.420 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-09T14:49:58.420 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "root1.client.0", 2024-03-09T14:49:58.420 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "XWUVBFUFDZDASHWTPRBJ", 2024-03-09T14:49:58.420 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "SaJfSYwEKxC4Lq3GHD9vNIcvfIl6qKfigoezOlCMBW9+N0jOVdeDVw==", 2024-03-09T14:49:58.420 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-03-09T14:49:58.420 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:49:58.415608Z" 2024-03-09T14:49:58.420 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-09T14:49:58.420 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-09T14:49:58.420 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-03-09T14:49:58.420 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-03-09T14:49:58.421 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-03-09T14:49:58.421 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-03-09T14:49:58.421 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-03-09T14:49:58.421 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-03-09T14:49:58.421 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-03-09T14:49:58.421 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:49:58.421 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:49:58.421 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:49:58.421 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:49:58.421 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:49:58.421 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:58.421 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-03-09T14:49:58.421 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:49:58.421 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:49:58.421 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:49:58.422 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:49:58.422 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:49:58.422 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:58.422 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-03-09T14:49:58.422 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "root", 2024-03-09T14:49:58.422 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-03-09T14:49:58.422 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "RGW88888888888888888", 2024-03-09T14:49:58.422 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-09T14:49:58.422 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:49:58.415586Z", 2024-03-09T14:49:58.422 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-03-09T14:49:58.422 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-03-09T14:49:58.422 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T14:49:58.422 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:58.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.426+0000 7f9e3afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:58.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.434+0000 7f9f865d0980 20 remove_watcher() i=0 2024-03-09T14:49:58.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.434+0000 7f9f865d0980 2 removed watcher, disabling cache 2024-03-09T14:49:58.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.434+0000 7f9f865d0980 20 remove_watcher() i=1 2024-03-09T14:49:58.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.438+0000 7f9f865d0980 20 remove_watcher() i=2 2024-03-09T14:49:58.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.438+0000 7f9f865d0980 20 remove_watcher() i=3 2024-03-09T14:49:58.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.442+0000 7f9f865d0980 20 remove_watcher() i=4 2024-03-09T14:49:58.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.446+0000 7f9f865d0980 20 remove_watcher() i=5 2024-03-09T14:49:58.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.446+0000 7f9f865d0980 20 remove_watcher() i=6 2024-03-09T14:49:58.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.446+0000 7f9f865d0980 20 remove_watcher() i=7 2024-03-09T14:49:58.455 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 3546859767 --totp-seed G6WQCRO7L4OBRJP5BGLO7SSES5YTSUKON5RZQ5A5XOHTOIZJOBMFI3H3XRQIWQH7 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:49:58.542 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:49:58.543 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:49:58.585 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.594+0000 7ff0433e3980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.594+0000 7ff0433e3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.594+0000 7ff0433e3980 20 realm 2024-03-09T14:49:58.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.594+0000 7ff0433e3980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.594+0000 7ff0433e3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.594+0000 7ff0433e3980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:49:58.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.594+0000 7ff0433e3980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.594+0000 7ff0433e3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.594+0000 7ff0433e3980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.598+0000 7ff0433e3980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:58.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.598+0000 7ff0433e3980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.598+0000 7ff0433e3980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:49:58.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.598+0000 7ff0433e3980 20 searching for the correct realm 2024-03-09T14:49:58.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.602+0000 7ff040efb640 0 -- 172.21.15.99:0/11332571 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x55bc50286d50 msgr2=0x55bc50289210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:58.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.610+0000 7ff0406fa640 0 -- 172.21.15.99:0/11332571 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7ff038008040 msgr2=0x7ff038060840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:58.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:49:58.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:49:58.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:49:58.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:49:58.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:49:58.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:49:58.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:58.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:49:58.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 20 zone default found 2024-03-09T14:49:58.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 4 Realm: () 2024-03-09T14:49:58.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:49:58.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:49:58.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:49:58.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 20 zonegroup default 2024-03-09T14:49:58.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.618+0000 7ff0433e3980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.622+0000 7ff0433e3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.622+0000 7ff0433e3980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.622+0000 7ff0433e3980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.622+0000 7ff0433e3980 20 started sync module instance, tier type = 2024-03-09T14:49:58.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.622+0000 7ff0433e3980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:49:58.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.638+0000 7ff0433e3980 20 add_watcher() i=0 2024-03-09T14:49:58.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.638+0000 7ff0433e3980 20 add_watcher() i=1 2024-03-09T14:49:58.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.638+0000 7ff0433e3980 20 add_watcher() i=2 2024-03-09T14:49:58.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.638+0000 7ff0433e3980 20 add_watcher() i=3 2024-03-09T14:49:58.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.638+0000 7ff0433e3980 20 add_watcher() i=4 2024-03-09T14:49:58.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.638+0000 7ff0433e3980 20 add_watcher() i=5 2024-03-09T14:49:58.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.638+0000 7ff0433e3980 20 add_watcher() i=6 2024-03-09T14:49:58.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.638+0000 7ff0433e3980 20 add_watcher() i=7 2024-03-09T14:49:58.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.638+0000 7ff0433e3980 2 all 8 watchers are set, enabling cache 2024-03-09T14:49:58.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.642+0000 7feef77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:58.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.642+0000 7ff0433e3980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:49:58.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.642+0000 7ff0433e3980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:49:58.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.642+0000 7ff0433e3980 5 note: GC not initialized 2024-03-09T14:49:58.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.642+0000 7feef67e4640 20 reqs_thread_entry: start 2024-03-09T14:49:58.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.642+0000 7ff0433e3980 20 init_complete bucket index max shards: 11 2024-03-09T14:49:58.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.642+0000 7ff0433e3980 20 Filter name: none 2024-03-09T14:49:58.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.642+0000 7feef47e0640 20 reqs_thread_entry: start 2024-03-09T14:49:58.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.642+0000 7ff0433e3980 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-03-09T14:49:58.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.642+0000 7ff0433e3980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.642+0000 7ff0433e3980 20 rados_obj.operate() r=0 bl.length=494 2024-03-09T14:49:58.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.642+0000 7ff0433e3980 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-03-09T14:49:58.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.642+0000 7ff0433e3980 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:49:58.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.642+0000 7ff0433e3980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:49:58.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.646+0000 7ff0433e3980 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-03-09T14:49:58.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.646+0000 7ff0433e3980 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:49:58.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.646+0000 7ff0433e3980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-03-09T14:49:58.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.646+0000 7fef17fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366254 cookie 94267287051472 notifier 7836 bl.length()=695 2024-03-09T14:49:58.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.646+0000 7fef17fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-03-09T14:49:58.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.646+0000 7fef17fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-03-09T14:49:58.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.650+0000 7feef77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:58.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.654+0000 7ff0433e3980 20 remove_watcher() i=0 2024-03-09T14:49:58.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.654+0000 7ff0433e3980 2 removed watcher, disabling cache 2024-03-09T14:49:58.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.658+0000 7ff0433e3980 20 remove_watcher() i=1 2024-03-09T14:49:58.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.658+0000 7ff0433e3980 20 remove_watcher() i=2 2024-03-09T14:49:58.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.662+0000 7ff0433e3980 20 remove_watcher() i=3 2024-03-09T14:49:58.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.662+0000 7ff0433e3980 20 remove_watcher() i=4 2024-03-09T14:49:58.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.662+0000 7ff0433e3980 20 remove_watcher() i=5 2024-03-09T14:49:58.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.666+0000 7ff0433e3980 20 remove_watcher() i=6 2024-03-09T14:49:58.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.666+0000 7ff0433e3980 20 remove_watcher() i=7 2024-03-09T14:49:58.675 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name 'Mr. RGW99999999999999999' --email RGW99999999999999999+test@test.test 2024-03-09T14:49:58.707 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:49:58.707 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:49:58.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.754+0000 7f0eb6965980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.754+0000 7f0eb6965980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.754+0000 7f0eb6965980 20 realm 2024-03-09T14:49:58.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.754+0000 7f0eb6965980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.758+0000 7f0eb6965980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.758+0000 7f0eb6965980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:49:58.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.758+0000 7f0eb6965980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.758+0000 7f0eb6965980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.758+0000 7f0eb6965980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.758+0000 7f0eb6965980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:58.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.758+0000 7f0eb6965980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.758+0000 7f0eb6965980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:49:58.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.758+0000 7f0eb6965980 20 searching for the correct realm 2024-03-09T14:49:58.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.766+0000 7f0eb447d640 0 -- 172.21.15.99:0/4262307806 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x557f7dc69110 msgr2=0x557f7dc6b5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:58.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.770+0000 7f0eb3c7c640 0 -- 172.21.15.99:0/4262307806 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f0eac029040 msgr2=0x7f0eac068220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:58.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.778+0000 7f0eb6965980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:49:58.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.778+0000 7f0eb6965980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:49:58.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.778+0000 7f0eb6965980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:49:58.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.778+0000 7f0eb6965980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:49:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.778+0000 7f0eb6965980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:49:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.778+0000 7f0eb6965980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:49:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.778+0000 7f0eb6965980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.778+0000 7f0eb6965980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.778+0000 7f0eb6965980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.782+0000 7f0eb6965980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:58.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.782+0000 7f0eb6965980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.782+0000 7f0eb6965980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:49:58.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.782+0000 7f0eb6965980 20 zone default found 2024-03-09T14:49:58.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.782+0000 7f0eb6965980 4 Realm: () 2024-03-09T14:49:58.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.782+0000 7f0eb6965980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:49:58.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.782+0000 7f0eb6965980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:49:58.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.782+0000 7f0eb6965980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:49:58.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.782+0000 7f0eb6965980 20 zonegroup default 2024-03-09T14:49:58.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.782+0000 7f0eb6965980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.782+0000 7f0eb6965980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.782+0000 7f0eb6965980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.782+0000 7f0eb6965980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.782+0000 7f0eb6965980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.782+0000 7f0eb6965980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.782+0000 7f0eb6965980 20 started sync module instance, tier type = 2024-03-09T14:49:58.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.782+0000 7f0eb6965980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:49:58.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.798+0000 7f0eb6965980 20 add_watcher() i=0 2024-03-09T14:49:58.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.798+0000 7f0eb6965980 20 add_watcher() i=1 2024-03-09T14:49:58.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.798+0000 7f0eb6965980 20 add_watcher() i=2 2024-03-09T14:49:58.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.798+0000 7f0eb6965980 20 add_watcher() i=3 2024-03-09T14:49:58.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.798+0000 7f0eb6965980 20 add_watcher() i=4 2024-03-09T14:49:58.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.798+0000 7f0eb6965980 20 add_watcher() i=5 2024-03-09T14:49:58.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.798+0000 7f0eb6965980 20 add_watcher() i=6 2024-03-09T14:49:58.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.798+0000 7f0eb6965980 20 add_watcher() i=7 2024-03-09T14:49:58.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.798+0000 7f0eb6965980 2 all 8 watchers are set, enabling cache 2024-03-09T14:49:58.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0d6afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:58.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0eb6965980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:49:58.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0eb6965980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:49:58.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0eb6965980 5 note: GC not initialized 2024-03-09T14:49:58.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0d69fdb640 20 reqs_thread_entry: start 2024-03-09T14:49:58.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0eb6965980 20 init_complete bucket index max shards: 11 2024-03-09T14:49:58.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0eb6965980 20 Filter name: none 2024-03-09T14:49:58.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0cdb7fe640 20 reqs_thread_entry: start 2024-03-09T14:49:58.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0eb6965980 10 cache get: name=default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 : miss 2024-03-09T14:49:58.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0eb6965980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0eb6965980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0eb6965980 10 cache put: name=default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 info.flags=0x0 2024-03-09T14:49:58.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0eb6965980 10 adding default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 to cache LRU end 2024-03-09T14:49:58.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0eb6965980 20 failed to read name.$Mr. RGW99999999999999999 with: (2) No such file or directory 2024-03-09T14:49:58.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0eb6965980 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-03-09T14:49:58.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0eb6965980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0eb6965980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0eb6965980 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-03-09T14:49:58.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0eb6965980 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-03-09T14:49:58.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.802+0000 7f0eb6965980 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-03-09T14:49:58.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.806+0000 7f0eb6965980 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-03-09T14:49:58.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.806+0000 7f0eb6965980 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-03-09T14:49:58.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.806+0000 7f0eb6965980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-03-09T14:49:58.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.806+0000 7f0d8b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366255 cookie 94006059379152 notifier 7454 bl.length()=353 2024-03-09T14:49:58.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.806+0000 7f0d8b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-03-09T14:49:58.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.806+0000 7f0d8b7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-03-09T14:49:58.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.814+0000 7f0eb6965980 10 cache put: name=default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 info.flags=0x17 2024-03-09T14:49:58.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.814+0000 7f0eb6965980 10 moving default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 to cache LRU end 2024-03-09T14:49:58.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.814+0000 7f0eb6965980 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr. RGW99999999999999999, ofs0, ns] 2024-03-09T14:49:58.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.814+0000 7f0d8b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366403 cookie 94006059377584 notifier 7454 bl.length()=226 2024-03-09T14:49:58.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.814+0000 7f0d8b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 info.flags=0x17 2024-03-09T14:49:58.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.814+0000 7f0d8b7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr. RGW99999999999999999 to cache LRU end 2024-03-09T14:49:58.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.818+0000 7f0eb6965980 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-03-09T14:49:58.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.818+0000 7f0eb6965980 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-03-09T14:49:58.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.818+0000 7f0eb6965980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-03-09T14:49:58.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.818+0000 7f0d8b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366226 cookie 94006059391632 notifier 7454 bl.length()=234 2024-03-09T14:49:58.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.818+0000 7f0d8b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-03-09T14:49:58.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.818+0000 7f0d8b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-03-09T14:49:58.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.818+0000 7f0d6afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:58.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.822+0000 7f0eb6965980 20 remove_watcher() i=0 2024-03-09T14:49:58.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.822+0000 7f0eb6965980 2 removed watcher, disabling cache 2024-03-09T14:49:58.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.826+0000 7f0eb6965980 20 remove_watcher() i=1 2024-03-09T14:49:58.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.826+0000 7f0eb6965980 20 remove_watcher() i=2 2024-03-09T14:49:58.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.830+0000 7f0eb6965980 20 remove_watcher() i=3 2024-03-09T14:49:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.830+0000 7f0eb6965980 20 remove_watcher() i=4 2024-03-09T14:49:58.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.834+0000 7f0eb6965980 20 remove_watcher() i=5 2024-03-09T14:49:58.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.834+0000 7f0eb6965980 20 remove_watcher() i=6 2024-03-09T14:49:58.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.834+0000 7f0eb6965980 20 remove_watcher() i=7 2024-03-09T14:49:58.840 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T14:49:58.840 INFO:teuthology.orchestra.run.smithi099.stdout: "id": "RGW99999999999999999", 2024-03-09T14:49:58.840 INFO:teuthology.orchestra.run.smithi099.stdout: "tenant": "", 2024-03-09T14:49:58.840 INFO:teuthology.orchestra.run.smithi099.stdout: "name": "Mr. RGW99999999999999999", 2024-03-09T14:49:58.840 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "RGW99999999999999999+test@test.test", 2024-03-09T14:49:58.840 INFO:teuthology.orchestra.run.smithi099.stdout: "quota": { 2024-03-09T14:49:58.840 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:49:58.840 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:49:58.840 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:49:58.840 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:49:58.840 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:49:58.840 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:58.841 INFO:teuthology.orchestra.run.smithi099.stdout: "max_users": 1000, 2024-03-09T14:49:58.841 INFO:teuthology.orchestra.run.smithi099.stdout: "max_roles": 1000, 2024-03-09T14:49:58.841 INFO:teuthology.orchestra.run.smithi099.stdout: "max_groups": 1000, 2024-03-09T14:49:58.841 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-03-09T14:49:58.841 INFO:teuthology.orchestra.run.smithi099.stdout: "max_access_keys": 4 2024-03-09T14:49:58.841 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T14:49:58.842 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-03-09T14:49:58.842 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key XJOCMYQYEMGJZGFCVMTN --secret Pgp+4uRPT/BzKM1HFNqSaATDsfmBw3hDsEO4TihuDHODxVZO4EVUjQ== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-03-09T14:49:58.931 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:49:58.931 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:49:58.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.982+0000 7f39ac0d9980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.982+0000 7f39ac0d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.982+0000 7f39ac0d9980 20 realm 2024-03-09T14:49:58.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.982+0000 7f39ac0d9980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.982+0000 7f39ac0d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.982+0000 7f39ac0d9980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:49:58.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.982+0000 7f39ac0d9980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.982+0000 7f39ac0d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:58.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.982+0000 7f39ac0d9980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.986+0000 7f39ac0d9980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:58.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.986+0000 7f39ac0d9980 20 rados->read ofs=0 len=0 2024-03-09T14:49:58.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.986+0000 7f39ac0d9980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:49:58.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.986+0000 7f39ac0d9980 20 searching for the correct realm 2024-03-09T14:49:58.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.990+0000 7f39aa3f2640 0 -- 172.21.15.99:0/330638691 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55ef12a61d80 msgr2=0x55ef12a64190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:58.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:58.998+0000 7f39a93f0640 0 -- 172.21.15.99:0/330638691 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f39a405e0f0 msgr2=0x7f39a40862d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T14:49:59.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.214+0000 7f39ac0d9980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:49:59.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.214+0000 7f39ac0d9980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:49:59.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.214+0000 7f39ac0d9980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:49:59.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.214+0000 7f39ac0d9980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:49:59.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.214+0000 7f39ac0d9980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:49:59.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.214+0000 7f39ac0d9980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:49:59.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.214+0000 7f39ac0d9980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.214+0000 7f39ac0d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:59.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.214+0000 7f39ac0d9980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.218+0000 7f39ac0d9980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:59.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.218+0000 7f39ac0d9980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.218+0000 7f39ac0d9980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:49:59.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.218+0000 7f39ac0d9980 20 zone default found 2024-03-09T14:49:59.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.218+0000 7f39ac0d9980 4 Realm: () 2024-03-09T14:49:59.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.218+0000 7f39ac0d9980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:49:59.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.218+0000 7f39ac0d9980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:49:59.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.218+0000 7f39ac0d9980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:49:59.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.218+0000 7f39ac0d9980 20 zonegroup default 2024-03-09T14:49:59.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.218+0000 7f39ac0d9980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.218+0000 7f39ac0d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:59.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.218+0000 7f39ac0d9980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.218+0000 7f39ac0d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:59.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.218+0000 7f39ac0d9980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.218+0000 7f39ac0d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:59.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.218+0000 7f39ac0d9980 20 started sync module instance, tier type = 2024-03-09T14:49:59.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.218+0000 7f39ac0d9980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:49:59.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.242+0000 7f39ac0d9980 20 add_watcher() i=0 2024-03-09T14:49:59.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.242+0000 7f39ac0d9980 20 add_watcher() i=1 2024-03-09T14:49:59.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.242+0000 7f39ac0d9980 20 add_watcher() i=2 2024-03-09T14:49:59.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.242+0000 7f39ac0d9980 20 add_watcher() i=3 2024-03-09T14:49:59.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.242+0000 7f39ac0d9980 20 add_watcher() i=4 2024-03-09T14:49:59.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.242+0000 7f39ac0d9980 20 add_watcher() i=5 2024-03-09T14:49:59.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.242+0000 7f39ac0d9980 20 add_watcher() i=6 2024-03-09T14:49:59.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.246+0000 7f39ac0d9980 20 add_watcher() i=7 2024-03-09T14:49:59.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.246+0000 7f39ac0d9980 2 all 8 watchers are set, enabling cache 2024-03-09T14:49:59.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.250+0000 7f385bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:59.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.250+0000 7f39ac0d9980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:49:59.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.250+0000 7f39ac0d9980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:49:59.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.250+0000 7f39ac0d9980 5 note: GC not initialized 2024-03-09T14:49:59.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.250+0000 7f385affd640 20 reqs_thread_entry: start 2024-03-09T14:49:59.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.250+0000 7f39ac0d9980 20 init_complete bucket index max shards: 11 2024-03-09T14:49:59.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.250+0000 7f39ac0d9980 20 Filter name: none 2024-03-09T14:49:59.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.250+0000 7f3858ff9640 20 reqs_thread_entry: start 2024-03-09T14:49:59.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.250+0000 7f39ac0d9980 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-03-09T14:49:59.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.250+0000 7f39ac0d9980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:59.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-03-09T14:49:59.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:49:59.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-03-09T14:49:59.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:59.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-03-09T14:49:59.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-03-09T14:49:59.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 10 cache get: name=default.rgw.meta+users.keys+XJOCMYQYEMGJZGFCVMTN : miss 2024-03-09T14:49:59.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:59.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 10 cache put: name=default.rgw.meta+users.keys+XJOCMYQYEMGJZGFCVMTN info.flags=0x0 2024-03-09T14:49:59.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 10 adding default.rgw.meta+users.keys+XJOCMYQYEMGJZGFCVMTN to cache LRU end 2024-03-09T14:49:59.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-03-09T14:49:59.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 20 rados_obj.operate() r=0 bl.length=153 2024-03-09T14:49:59.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-03-09T14:49:59.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-03-09T14:49:59.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:49:59.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 10 cache get: name=default.rgw.meta+users.keys+XJOCMYQYEMGJZGFCVMTN : hit (negative entry) 2024-03-09T14:49:59.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.254+0000 7f39ac0d9980 10 cache get: name=default.rgw.meta+users.keys+XJOCMYQYEMGJZGFCVMTN : hit (negative entry) 2024-03-09T14:49:59.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.258+0000 7f39ac0d9980 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-03-09T14:49:59.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.258+0000 7f39ac0d9980 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:49:59.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.258+0000 7f39ac0d9980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-03-09T14:49:59.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.258+0000 7f388d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366256 cookie 94485298454224 notifier 7472 bl.length()=681 2024-03-09T14:49:59.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.258+0000 7f388d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-03-09T14:49:59.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.258+0000 7f388d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:49:59.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.262+0000 7f39ac0d9980 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-03-09T14:49:59.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.262+0000 7f39ac0d9980 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-03-09T14:49:59.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.262+0000 7f39ac0d9980 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-03-09T14:49:59.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.262+0000 7f388d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366314 cookie 94485298466176 notifier 7472 bl.length()=189 2024-03-09T14:49:59.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.262+0000 7f388d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-03-09T14:49:59.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.262+0000 7f388d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-03-09T14:49:59.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.266+0000 7f39ac0d9980 10 cache put: name=default.rgw.meta+users.keys+XJOCMYQYEMGJZGFCVMTN info.flags=0x7 2024-03-09T14:49:59.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.266+0000 7f39ac0d9980 10 moving default.rgw.meta+users.keys+XJOCMYQYEMGJZGFCVMTN to cache LRU end 2024-03-09T14:49:59.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.266+0000 7f39ac0d9980 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:XJOCMYQYEMGJZGFCVMTN, ofs0, ns] 2024-03-09T14:49:59.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.266+0000 7f388d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366404 cookie 94485298429968 notifier 7472 bl.length()=188 2024-03-09T14:49:59.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.266+0000 7f388d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XJOCMYQYEMGJZGFCVMTN info.flags=0x7 2024-03-09T14:49:59.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.266+0000 7f388d7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XJOCMYQYEMGJZGFCVMTN to cache LRU end 2024-03-09T14:49:59.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.270+0000 7f39ac0d9980 20 linked user root2.client.0 to account RGW99999999999999999 2024-03-09T14:49:59.262 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T14:49:59.263 INFO:teuthology.orchestra.run.smithi099.stdout: "user_id": "root2.client.0", 2024-03-09T14:49:59.263 INFO:teuthology.orchestra.run.smithi099.stdout: "display_name": "Mr.RGW99999999999999999", 2024-03-09T14:49:59.263 INFO:teuthology.orchestra.run.smithi099.stdout: "email": "root2+test@test.test", 2024-03-09T14:49:59.263 INFO:teuthology.orchestra.run.smithi099.stdout: "suspended": 0, 2024-03-09T14:49:59.263 INFO:teuthology.orchestra.run.smithi099.stdout: "max_buckets": 1000, 2024-03-09T14:49:59.263 INFO:teuthology.orchestra.run.smithi099.stdout: "subusers": [], 2024-03-09T14:49:59.263 INFO:teuthology.orchestra.run.smithi099.stdout: "keys": [ 2024-03-09T14:49:59.263 INFO:teuthology.orchestra.run.smithi099.stdout: { 2024-03-09T14:49:59.263 INFO:teuthology.orchestra.run.smithi099.stdout: "user": "root2.client.0", 2024-03-09T14:49:59.263 INFO:teuthology.orchestra.run.smithi099.stdout: "access_key": "XJOCMYQYEMGJZGFCVMTN", 2024-03-09T14:49:59.263 INFO:teuthology.orchestra.run.smithi099.stdout: "secret_key": "Pgp+4uRPT/BzKM1HFNqSaATDsfmBw3hDsEO4TihuDHODxVZO4EVUjQ==", 2024-03-09T14:49:59.263 INFO:teuthology.orchestra.run.smithi099.stdout: "active": true, 2024-03-09T14:49:59.263 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:49:59.257569Z" 2024-03-09T14:49:59.264 INFO:teuthology.orchestra.run.smithi099.stdout: } 2024-03-09T14:49:59.264 INFO:teuthology.orchestra.run.smithi099.stdout: ], 2024-03-09T14:49:59.264 INFO:teuthology.orchestra.run.smithi099.stdout: "swift_keys": [], 2024-03-09T14:49:59.264 INFO:teuthology.orchestra.run.smithi099.stdout: "caps": [], 2024-03-09T14:49:59.264 INFO:teuthology.orchestra.run.smithi099.stdout: "op_mask": "read, write, delete", 2024-03-09T14:49:59.264 INFO:teuthology.orchestra.run.smithi099.stdout: "default_placement": "", 2024-03-09T14:49:59.264 INFO:teuthology.orchestra.run.smithi099.stdout: "default_storage_class": "", 2024-03-09T14:49:59.264 INFO:teuthology.orchestra.run.smithi099.stdout: "placement_tags": [], 2024-03-09T14:49:59.264 INFO:teuthology.orchestra.run.smithi099.stdout: "bucket_quota": { 2024-03-09T14:49:59.264 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:49:59.264 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:49:59.264 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:49:59.264 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:49:59.264 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:49:59.264 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:59.264 INFO:teuthology.orchestra.run.smithi099.stdout: "user_quota": { 2024-03-09T14:49:59.265 INFO:teuthology.orchestra.run.smithi099.stdout: "enabled": false, 2024-03-09T14:49:59.265 INFO:teuthology.orchestra.run.smithi099.stdout: "check_on_raw": false, 2024-03-09T14:49:59.265 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size": -1, 2024-03-09T14:49:59.265 INFO:teuthology.orchestra.run.smithi099.stdout: "max_size_kb": 0, 2024-03-09T14:49:59.265 INFO:teuthology.orchestra.run.smithi099.stdout: "max_objects": -1 2024-03-09T14:49:59.265 INFO:teuthology.orchestra.run.smithi099.stdout: }, 2024-03-09T14:49:59.265 INFO:teuthology.orchestra.run.smithi099.stdout: "temp_url_keys": [], 2024-03-09T14:49:59.265 INFO:teuthology.orchestra.run.smithi099.stdout: "type": "root", 2024-03-09T14:49:59.265 INFO:teuthology.orchestra.run.smithi099.stdout: "mfa_ids": [], 2024-03-09T14:49:59.265 INFO:teuthology.orchestra.run.smithi099.stdout: "account_id": "RGW99999999999999999", 2024-03-09T14:49:59.265 INFO:teuthology.orchestra.run.smithi099.stdout: "path": "/", 2024-03-09T14:49:59.266 INFO:teuthology.orchestra.run.smithi099.stdout: "create_date": "2024-03-09T14:49:59.257540Z", 2024-03-09T14:49:59.266 INFO:teuthology.orchestra.run.smithi099.stdout: "tags": [], 2024-03-09T14:49:59.266 INFO:teuthology.orchestra.run.smithi099.stdout: "group_ids": [] 2024-03-09T14:49:59.266 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T14:49:59.266 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:49:59.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.270+0000 7f385bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:59.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.274+0000 7f39ac0d9980 20 remove_watcher() i=0 2024-03-09T14:49:59.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.274+0000 7f39ac0d9980 2 removed watcher, disabling cache 2024-03-09T14:49:59.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.278+0000 7f39ac0d9980 20 remove_watcher() i=1 2024-03-09T14:49:59.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.282+0000 7f39ac0d9980 20 remove_watcher() i=2 2024-03-09T14:49:59.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.282+0000 7f39ac0d9980 20 remove_watcher() i=3 2024-03-09T14:49:59.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.286+0000 7f39ac0d9980 20 remove_watcher() i=4 2024-03-09T14:49:59.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.286+0000 7f39ac0d9980 20 remove_watcher() i=5 2024-03-09T14:49:59.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.286+0000 7f39ac0d9980 20 remove_watcher() i=6 2024-03-09T14:49:59.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.290+0000 7f39ac0d9980 20 remove_watcher() i=7 2024-03-09T14:49:59.298 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 1770044477 --totp-seed 7D7XSRJ5S53FD4AKX37PUY6NHIKQ2SHYBCSRXKBBWR57ECXQ7S4OVTWSKBLOFSPU --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-03-09T14:49:59.386 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T14:49:59.386 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T14:49:59.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.434+0000 7fd6df0aa980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.434+0000 7fd6df0aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.434+0000 7fd6df0aa980 20 realm 2024-03-09T14:49:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.434+0000 7fd6df0aa980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.438+0000 7fd6df0aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.438+0000 7fd6df0aa980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T14:49:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.438+0000 7fd6df0aa980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.438+0000 7fd6df0aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:59.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.438+0000 7fd6df0aa980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.438+0000 7fd6df0aa980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:59.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.438+0000 7fd6df0aa980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.438+0000 7fd6df0aa980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T14:49:59.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.438+0000 7fd6df0aa980 20 searching for the correct realm 2024-03-09T14:49:59.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.442+0000 7fd6dd3c3640 0 -- 172.21.15.99:0/3346618919 >> [v2:172.21.15.179:6800/2461929152,v1:172.21.15.179:6801/2461929152] conn(0x55a305591aa0 msgr2=0x55a305593e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:49:59.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.450+0000 7fd6dc3c1640 0 -- 172.21.15.99:0/3346618919 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fd6cc05d7f0 msgr2=0x7fd6cc053500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-03-09T14:49:59.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.666+0000 7fd6df0aa980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T14:49:59.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.666+0000 7fd6df0aa980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T14:49:59.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.666+0000 7fd6df0aa980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T14:49:59.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.666+0000 7fd6df0aa980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T14:49:59.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.666+0000 7fd6df0aa980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T14:49:59.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.666+0000 7fd6df0aa980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T14:49:59.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.666+0000 7fd6df0aa980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.666+0000 7fd6df0aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:59.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.666+0000 7fd6df0aa980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.666+0000 7fd6df0aa980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T14:49:59.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.666+0000 7fd6df0aa980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.670+0000 7fd6df0aa980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T14:49:59.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.670+0000 7fd6df0aa980 20 zone default found 2024-03-09T14:49:59.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.670+0000 7fd6df0aa980 4 Realm: () 2024-03-09T14:49:59.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.670+0000 7fd6df0aa980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T14:49:59.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.670+0000 7fd6df0aa980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T14:49:59.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.670+0000 7fd6df0aa980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T14:49:59.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.670+0000 7fd6df0aa980 20 zonegroup default 2024-03-09T14:49:59.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.670+0000 7fd6df0aa980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.670+0000 7fd6df0aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:59.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.670+0000 7fd6df0aa980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.670+0000 7fd6df0aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:59.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.670+0000 7fd6df0aa980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.670+0000 7fd6df0aa980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T14:49:59.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.670+0000 7fd6df0aa980 20 started sync module instance, tier type = 2024-03-09T14:49:59.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.670+0000 7fd6df0aa980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T14:49:59.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.690+0000 7fd6df0aa980 20 add_watcher() i=0 2024-03-09T14:49:59.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.690+0000 7fd6df0aa980 20 add_watcher() i=1 2024-03-09T14:49:59.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.690+0000 7fd6df0aa980 20 add_watcher() i=2 2024-03-09T14:49:59.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.690+0000 7fd6df0aa980 20 add_watcher() i=3 2024-03-09T14:49:59.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.690+0000 7fd6df0aa980 20 add_watcher() i=4 2024-03-09T14:49:59.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.690+0000 7fd6df0aa980 20 add_watcher() i=5 2024-03-09T14:49:59.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.690+0000 7fd6df0aa980 20 add_watcher() i=6 2024-03-09T14:49:59.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.694+0000 7fd6df0aa980 20 add_watcher() i=7 2024-03-09T14:49:59.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.694+0000 7fd6df0aa980 2 all 8 watchers are set, enabling cache 2024-03-09T14:49:59.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.698+0000 7fd591fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:59.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.698+0000 7fd6df0aa980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T14:49:59.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.698+0000 7fd6df0aa980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T14:49:59.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.698+0000 7fd6df0aa980 5 note: GC not initialized 2024-03-09T14:49:59.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.698+0000 7fd590fe1640 20 reqs_thread_entry: start 2024-03-09T14:49:59.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.698+0000 7fd6df0aa980 20 init_complete bucket index max shards: 11 2024-03-09T14:49:59.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.698+0000 7fd6df0aa980 20 Filter name: none 2024-03-09T14:49:59.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.698+0000 7fd50a7fc640 20 reqs_thread_entry: start 2024-03-09T14:49:59.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.698+0000 7fd6df0aa980 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-03-09T14:49:59.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.698+0000 7fd6df0aa980 20 rados->read ofs=0 len=0 2024-03-09T14:49:59.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.698+0000 7fd6df0aa980 20 rados_obj.operate() r=0 bl.length=494 2024-03-09T14:49:59.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.698+0000 7fd6df0aa980 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-03-09T14:49:59.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.698+0000 7fd6df0aa980 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:49:59.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.698+0000 7fd6df0aa980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T14:49:59.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.702+0000 7fd6df0aa980 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-03-09T14:49:59.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.702+0000 7fd6df0aa980 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:49:59.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.702+0000 7fd6df0aa980 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-03-09T14:49:59.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.706+0000 7fd5baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366257 cookie 94158657787760 notifier 7487 bl.length()=695 2024-03-09T14:49:59.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.706+0000 7fd5baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-03-09T14:49:59.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.706+0000 7fd5baffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-03-09T14:49:59.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.706+0000 7fd591fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T14:49:59.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.714+0000 7fd6df0aa980 20 remove_watcher() i=0 2024-03-09T14:49:59.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.714+0000 7fd6df0aa980 2 removed watcher, disabling cache 2024-03-09T14:49:59.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.714+0000 7fd6df0aa980 20 remove_watcher() i=1 2024-03-09T14:49:59.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.718+0000 7fd6df0aa980 20 remove_watcher() i=2 2024-03-09T14:49:59.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.718+0000 7fd6df0aa980 20 remove_watcher() i=3 2024-03-09T14:49:59.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.722+0000 7fd6df0aa980 20 remove_watcher() i=4 2024-03-09T14:49:59.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.722+0000 7fd6df0aa980 20 remove_watcher() i=5 2024-03-09T14:49:59.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.726+0000 7fd6df0aa980 20 remove_watcher() i=6 2024-03-09T14:49:59.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T14:49:59.726+0000 7fd6df0aa980 20 remove_watcher() i=7 2024-03-09T14:49:59.734 INFO:tasks.s3tests:Configuring s3-tests... 2024-03-09T14:49:59.735 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:49:59.735 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-03-09T14:49:59.740 INFO:tasks.s3tests:Configuring boto... 2024-03-09T14:49:59.740 DEBUG:teuthology.orchestra.run.smithi099:> set -ex 2024-03-09T14:49:59.740 DEBUG:teuthology.orchestra.run.smithi099:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-03-09T14:49:59.786 DEBUG:teuthology.orchestra.run.smithi099:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-03-09T14:49:59.947 INFO:teuthology.orchestra.run.smithi099.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-03-09T14:50:00.152 INFO:teuthology.orchestra.run.smithi099.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-03-09T14:50:00.411 INFO:teuthology.orchestra.run.smithi099.stdout:py installdeps: -rrequirements.txt 2024-03-09T14:51:37.187 INFO:teuthology.orchestra.run.smithi099.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-03-09T14:51:39.160 INFO:teuthology.orchestra.run.smithi099.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.3.3,certifi==2024.2.2,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.0,filelock==3.13.1,gevent==24.2.1,greenlet==3.0.3,httplib2==0.22.0,idna==3.6,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.1.0,munch==4.0.0,packaging==23.2,platformdirs==4.2.0,pluggy==1.4.0,pyparsing==3.1.2,pyproject-api==1.6.1,pytest==8.1.1,python-dateutil==2.9.0.post0,pytz==2024.1,PyYAML==6.0.1,requests==2.31.0,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=1daaecdb2e745c2c4d08f678373e6a60f56331152cc20b9b1dabc4414e06a043,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.14.1,urllib3==1.26.18,virtualenv==20.25.1,zope.event==5.0,zope.interface==6.2 2024-03-09T14:51:39.160 INFO:teuthology.orchestra.run.smithi099.stdout:py run-test-pre: PYTHONHASHSEED='356721058' 2024-03-09T14:51:39.160 INFO:teuthology.orchestra.run.smithi099.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-03-09T14:51:39.362 INFO:teuthology.orchestra.run.smithi099.stdout:============================= test session starts ============================== 2024-03-09T14:51:39.362 INFO:teuthology.orchestra.run.smithi099.stdout:platform linux -- Python 3.10.6, pytest-8.1.1, pluggy-1.4.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-03-09T14:51:39.362 INFO:teuthology.orchestra.run.smithi099.stdout:cachedir: .tox/py/.pytest_cache 2024-03-09T14:51:39.362 INFO:teuthology.orchestra.run.smithi099.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-03-09T14:51:39.362 INFO:teuthology.orchestra.run.smithi099.stdout:configfile: pytest.ini 2024-03-09T14:51:41.043 INFO:teuthology.orchestra.run.smithi099.stdout:collecting ... collected 850 items / 124 deselected / 726 selected 2024-03-09T14:51:41.043 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T14:51:41.490 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none FAILED [ 0%] 2024-03-09T14:51:41.779 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty FAILED [ 0%] 2024-03-09T14:51:42.040 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-03-09T14:51:42.299 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-03-09T14:51:42.580 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none FAILED [ 0%] 2024-03-09T14:51:42.779 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-03-09T14:51:43.047 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-03-09T14:51:43.244 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-03-09T14:51:43.473 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty FAILED [ 1%] 2024-03-09T14:51:43.704 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none FAILED [ 1%] 2024-03-09T14:51:43.991 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 FAILED [ 1%] 2024-03-09T14:51:44.283 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 FAILED [ 1%] 2024-03-09T14:51:44.568 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 FAILED [ 1%] 2024-03-09T14:51:44.857 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 FAILED [ 1%] 2024-03-09T14:51:45.086 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 FAILED [ 2%] 2024-03-09T14:51:45.313 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 FAILED [ 2%] 2024-03-09T14:51:45.373 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-03-09T14:51:45.428 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-03-09T14:51:45.484 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-03-09T14:51:45.541 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-03-09T14:51:45.601 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-03-09T14:51:45.657 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 3%] 2024-03-09T14:51:45.712 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-03-09T14:51:45.769 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-03-09T14:51:45.824 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-03-09T14:51:45.880 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-03-09T14:51:45.936 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-03-09T14:51:45.992 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-03-09T14:51:46.048 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-03-09T14:51:46.105 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-03-09T14:51:46.160 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-03-09T14:51:46.217 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-03-09T14:51:46.272 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-03-09T14:51:46.330 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-03-09T14:51:46.385 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-03-09T14:51:46.441 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-03-09T14:51:46.501 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 5%] 2024-03-09T14:51:46.557 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-03-09T14:51:46.613 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-03-09T14:51:46.668 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-03-09T14:51:46.725 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-03-09T14:51:46.781 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-03-09T14:51:46.837 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-03-09T14:51:46.893 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 6%] 2024-03-09T14:51:46.949 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-03-09T14:51:47.005 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-03-09T14:51:47.061 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-03-09T14:51:47.117 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-03-09T14:51:47.173 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-03-09T14:51:47.229 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-03-09T14:51:47.285 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 7%] 2024-03-09T14:51:47.344 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 7%] 2024-03-09T14:51:47.402 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-03-09T14:51:47.946 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-03-09T14:51:48.981 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-03-09T14:51:50.878 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-03-09T14:51:52.566 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-03-09T14:51:55.325 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-03-09T14:51:56.307 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 8%] 2024-03-09T14:51:57.503 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-03-09T14:51:57.977 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-03-09T14:51:58.201 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-03-09T14:51:58.580 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-03-09T14:51:58.972 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-03-09T14:51:59.423 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-03-09T14:51:59.723 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 9%] 2024-03-09T14:52:00.031 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 9%] 2024-03-09T14:52:00.033 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-03-09T14:52:00.040 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-03-09T14:52:00.042 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-03-09T14:52:00.044 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-03-09T14:52:00.047 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-03-09T14:52:00.049 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 10%] 2024-03-09T14:52:00.052 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-03-09T14:52:00.054 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-03-09T14:52:00.057 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-03-09T14:52:00.059 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-03-09T14:52:00.062 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-03-09T14:52:00.064 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-03-09T14:52:00.066 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 11%] 2024-03-09T14:52:00.068 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 11%] 2024-03-09T14:52:00.071 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 11%] 2024-03-09T14:52:00.073 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-03-09T14:52:00.075 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-03-09T14:52:00.077 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-03-09T14:52:00.079 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-03-09T14:52:00.081 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-03-09T14:52:00.084 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 12%] 2024-03-09T14:52:00.086 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 12%] 2024-03-09T14:52:00.088 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-03-09T14:52:00.089 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-03-09T14:52:00.091 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-03-09T14:52:00.093 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-03-09T14:52:00.094 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-03-09T14:52:00.188 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 13%] 2024-03-09T14:52:00.197 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 13%] 2024-03-09T14:52:01.018 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-03-09T14:52:08.178 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-03-09T14:52:09.005 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-03-09T14:52:09.873 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-03-09T14:52:10.684 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-03-09T14:52:11.520 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 14%] 2024-03-09T14:52:12.389 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 14%] 2024-03-09T14:52:13.121 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 14%] 2024-03-09T14:52:14.072 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-03-09T14:52:14.876 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-03-09T14:52:15.705 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-03-09T14:52:16.525 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-03-09T14:52:17.253 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 15%] 2024-03-09T14:52:17.961 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 15%] 2024-03-09T14:52:18.630 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 15%] 2024-03-09T14:52:19.413 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-03-09T14:52:20.257 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-03-09T14:52:21.085 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-03-09T14:52:21.885 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-03-09T14:52:22.669 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-03-09T14:52:23.505 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-03-09T14:52:24.289 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-03-09T14:52:25.053 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 16%] 2024-03-09T14:52:25.761 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-03-09T14:52:26.453 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-03-09T14:52:27.045 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-03-09T14:52:27.709 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-03-09T14:52:28.329 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 17%] 2024-03-09T14:52:28.917 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 17%] 2024-03-09T14:52:29.513 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 17%] 2024-03-09T14:52:30.233 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-03-09T14:52:30.825 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-03-09T14:52:31.521 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-03-09T14:52:32.481 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-03-09T14:52:33.217 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 18%] 2024-03-09T14:52:33.841 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 18%] 2024-03-09T14:52:34.541 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 18%] 2024-03-09T14:52:35.261 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 18%] 2024-03-09T14:52:36.093 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-03-09T14:52:36.841 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-03-09T14:52:37.565 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-03-09T14:52:38.273 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 19%] 2024-03-09T14:52:39.273 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 19%] 2024-03-09T14:52:40.201 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:52:41.077 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:52:41.985 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:52:42.978 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:52:43.997 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:52:45.029 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-03-09T14:52:46.029 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 20%] 2024-03-09T14:52:47.033 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 20%] 2024-03-09T14:52:47.909 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 20%] 2024-03-09T14:52:48.897 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 20%] 2024-03-09T14:52:49.701 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-03-09T14:52:51.106 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-03-09T14:52:52.266 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-03-09T14:52:53.502 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 21%] 2024-03-09T14:52:55.738 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 21%] 2024-03-09T14:52:58.578 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 21%] 2024-03-09T14:53:00.294 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 21%] 2024-03-09T14:53:01.930 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-03-09T14:53:03.262 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-03-09T14:53:04.226 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-03-09T14:53:05.706 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 22%] 2024-03-09T14:53:06.874 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 22%] 2024-03-09T14:53:08.306 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 22%] 2024-03-09T14:53:09.474 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 22%] 2024-03-09T14:53:11.214 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 22%] 2024-03-09T14:53:12.667 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-03-09T14:53:14.546 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-03-09T14:53:16.350 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 23%] 2024-03-09T14:53:17.707 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 23%] 2024-03-09T14:53:19.031 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 23%] 2024-03-09T14:53:20.147 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 23%] 2024-03-09T14:53:22.354 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 23%] 2024-03-09T14:53:24.023 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-03-09T14:53:25.934 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-03-09T14:53:27.803 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-03-09T14:53:29.507 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 24%] 2024-03-09T14:53:31.223 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 24%] 2024-03-09T14:53:32.631 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 24%] 2024-03-09T14:53:33.735 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 24%] 2024-03-09T14:53:34.951 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 24%] 2024-03-09T14:53:37.047 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-03-09T14:53:39.619 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-03-09T14:53:40.891 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 25%] 2024-03-09T14:53:42.623 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 25%] 2024-03-09T14:53:44.347 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 25%] 2024-03-09T14:53:46.063 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 25%] 2024-03-09T14:53:47.799 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 25%] 2024-03-09T14:53:49.636 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-03-09T14:53:51.444 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-03-09T14:53:53.200 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 26%] 2024-03-09T14:53:54.451 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 26%] 2024-03-09T14:53:56.104 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-03-09T14:53:57.768 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-03-09T14:53:59.487 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-03-09T14:54:01.108 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-03-09T14:54:02.810 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-03-09T14:54:04.472 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-03-09T14:54:06.136 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 27%] 2024-03-09T14:54:07.876 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 27%] 2024-03-09T14:54:09.548 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-03-09T14:54:11.212 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-03-09T14:54:12.856 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-03-09T14:54:14.548 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-03-09T14:54:15.736 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-03-09T14:54:16.968 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 28%] 2024-03-09T14:54:18.152 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 28%] 2024-03-09T14:54:19.381 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-03-09T14:54:20.179 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-03-09T14:54:21.223 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-03-09T14:54:22.167 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-03-09T14:54:23.120 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-03-09T14:54:24.108 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 29%] 2024-03-09T14:54:25.067 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 29%] 2024-03-09T14:54:26.003 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 29%] 2024-03-09T14:54:26.935 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-03-09T14:54:27.867 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-03-09T14:54:29.335 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-03-09T14:54:30.764 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-03-09T14:54:31.655 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 30%] 2024-03-09T14:54:32.511 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 30%] 2024-03-09T14:54:33.463 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 30%] 2024-03-09T14:54:34.391 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-03-09T14:54:35.808 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-03-09T14:54:37.279 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-03-09T14:54:38.207 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-03-09T14:54:39.111 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-03-09T14:54:40.031 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 31%] 2024-03-09T14:54:40.963 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 31%] 2024-03-09T14:54:41.903 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 31%] 2024-03-09T14:54:42.912 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-03-09T14:54:43.828 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-03-09T14:54:44.744 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-03-09T14:54:45.700 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-03-09T14:54:46.656 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 32%] 2024-03-09T14:54:47.616 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 32%] 2024-03-09T14:54:48.560 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 32%] 2024-03-09T14:54:49.448 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-03-09T14:54:50.400 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-03-09T14:54:51.340 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-03-09T14:54:52.316 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-03-09T14:54:53.220 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 33%] 2024-03-09T14:55:17.116 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 33%] 2024-03-09T14:55:18.048 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 33%] 2024-03-09T14:55:18.928 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 33%] 2024-03-09T14:55:19.856 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-03-09T14:55:20.816 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-03-09T14:55:21.732 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-03-09T14:55:22.644 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 34%] 2024-03-09T14:55:23.540 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 34%] 2024-03-09T14:55:24.460 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 34%] 2024-03-09T14:55:25.428 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 34%] 2024-03-09T14:55:26.324 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-03-09T14:55:27.224 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-03-09T14:55:28.140 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-03-09T14:55:29.104 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-03-09T14:55:30.120 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 35%] 2024-03-09T14:55:31.024 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 35%] 2024-03-09T14:55:31.944 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 35%] 2024-03-09T14:55:32.844 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-03-09T14:55:33.764 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-03-09T14:55:34.744 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-03-09T14:55:35.708 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-03-09T14:55:36.708 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 36%] 2024-03-09T14:55:37.680 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 36%] 2024-03-09T14:55:38.732 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 36%] 2024-03-09T14:55:39.696 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 36%] 2024-03-09T14:55:40.652 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-03-09T14:55:41.568 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-03-09T14:55:42.476 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-03-09T14:55:43.488 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 37%] 2024-03-09T14:55:44.092 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 37%] 2024-03-09T14:55:44.937 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 37%] 2024-03-09T14:55:46.540 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 37%] 2024-03-09T14:55:48.201 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 37%] 2024-03-09T14:55:49.108 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-03-09T14:55:50.064 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-03-09T14:55:50.992 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 38%] 2024-03-09T14:55:51.961 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 38%] 2024-03-09T14:55:53.005 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 38%] 2024-03-09T14:55:53.957 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 38%] 2024-03-09T14:55:54.884 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 38%] 2024-03-09T14:55:55.833 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-03-09T14:55:56.780 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-03-09T14:55:57.740 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-03-09T14:55:58.724 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 39%] 2024-03-09T14:55:59.688 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 39%] 2024-03-09T14:56:00.764 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 39%] 2024-03-09T14:56:02.164 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 39%] 2024-03-09T14:56:02.989 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-03-09T14:56:03.824 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-03-09T14:56:04.616 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-03-09T14:56:05.401 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 40%] 2024-03-09T14:56:05.992 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 40%] 2024-03-09T14:56:06.660 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 40%] 2024-03-09T14:56:07.293 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 40%] 2024-03-09T14:56:08.185 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 40%] 2024-03-09T14:56:09.152 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-03-09T14:56:09.781 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-03-09T14:56:10.604 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 41%] 2024-03-09T14:56:11.425 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 41%] 2024-03-09T14:56:12.193 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 41%] 2024-03-09T14:56:13.005 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 41%] 2024-03-09T14:56:14.313 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 41%] 2024-03-09T14:56:15.345 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-03-09T14:56:16.460 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-03-09T14:56:39.997 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 42%] 2024-03-09T14:57:03.949 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 42%] 2024-03-09T14:57:04.821 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 42%] 2024-03-09T14:57:05.621 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 42%] 2024-03-09T14:57:06.465 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 42%] 2024-03-09T14:57:07.297 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 42%] 2024-03-09T14:57:08.245 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-03-09T14:57:09.189 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-03-09T14:57:10.065 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 43%] 2024-03-09T14:57:10.989 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 43%] 2024-03-09T14:57:11.853 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 43%] 2024-03-09T14:57:12.733 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 43%] 2024-03-09T14:57:13.621 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 43%] 2024-03-09T14:57:14.489 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-03-09T14:57:15.329 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-03-09T14:57:16.109 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 44%] 2024-03-09T14:57:16.969 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 44%] 2024-03-09T14:57:17.797 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 44%] 2024-03-09T14:57:18.713 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 44%] 2024-03-09T14:57:19.678 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 44%] 2024-03-09T14:57:20.505 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 44%] 2024-03-09T14:57:21.337 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-03-09T14:57:22.197 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 45%] 2024-03-09T14:57:23.061 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 45%] 2024-03-09T14:57:23.857 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 45%] 2024-03-09T14:57:24.713 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 45%] 2024-03-09T14:57:25.473 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 45%] 2024-03-09T14:57:26.245 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 45%] 2024-03-09T14:57:27.042 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-03-09T14:57:27.833 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 46%] 2024-03-09T14:57:28.682 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 46%] 2024-03-09T14:57:29.525 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 46%] 2024-03-09T14:57:30.321 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 46%] 2024-03-09T14:57:31.114 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 46%] 2024-03-09T14:57:31.906 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 46%] 2024-03-09T14:57:32.921 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 46%] 2024-03-09T14:57:33.714 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-03-09T14:57:34.546 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 47%] 2024-03-09T14:57:35.345 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 47%] 2024-03-09T14:57:36.134 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 47%] 2024-03-09T14:57:36.922 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 47%] 2024-03-09T14:57:37.706 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 47%] 2024-03-09T14:57:38.478 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 47%] 2024-03-09T14:57:39.465 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-03-09T14:57:40.270 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 48%] 2024-03-09T14:57:42.277 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 48%] 2024-03-09T14:57:43.189 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 48%] 2024-03-09T14:57:44.075 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 48%] 2024-03-09T14:57:44.970 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 48%] 2024-03-09T14:57:45.910 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 48%] 2024-03-09T14:57:47.778 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 48%] 2024-03-09T14:57:48.694 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 49%] 2024-03-09T14:57:49.538 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 49%] 2024-03-09T14:57:50.490 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 49%] 2024-03-09T14:57:51.478 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 49%] 2024-03-09T14:57:52.534 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 49%] 2024-03-09T14:57:53.434 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 49%] 2024-03-09T14:57:54.422 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 49%] 2024-03-09T14:57:55.470 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 50%] 2024-03-09T14:57:56.366 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 50%] 2024-03-09T14:57:57.402 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 50%] 2024-03-09T14:57:58.330 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 50%] 2024-03-09T14:57:59.122 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 50%] 2024-03-09T14:57:59.922 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 50%] 2024-03-09T14:58:00.834 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 50%] 2024-03-09T14:58:01.642 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-03-09T14:58:02.278 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 51%] 2024-03-09T14:58:03.298 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 51%] 2024-03-09T14:58:04.146 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 51%] 2024-03-09T14:58:05.010 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 51%] 2024-03-09T14:58:08.190 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 51%] 2024-03-09T14:58:09.050 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 51%] 2024-03-09T14:58:09.951 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 51%] 2024-03-09T14:58:10.778 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 52%] 2024-03-09T14:58:11.630 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 52%] 2024-03-09T14:58:12.454 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 52%] 2024-03-09T14:58:13.302 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 52%] 2024-03-09T14:58:14.242 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 52%] 2024-03-09T14:58:15.206 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 52%] 2024-03-09T14:58:16.038 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 52%] 2024-03-09T14:58:16.890 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 53%] 2024-03-09T14:58:17.726 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 53%] 2024-03-09T14:58:18.622 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 53%] 2024-03-09T14:58:19.434 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 53%] 2024-03-09T14:58:20.346 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 53%] 2024-03-09T14:58:21.211 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 53%] 2024-03-09T14:58:22.070 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 53%] 2024-03-09T14:58:22.986 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 53%] 2024-03-09T14:58:23.578 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 54%] 2024-03-09T14:58:24.178 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 54%] 2024-03-09T14:58:24.846 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 54%] 2024-03-09T14:58:25.578 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 54%] 2024-03-09T14:58:26.303 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 54%] 2024-03-09T14:58:27.026 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 54%] 2024-03-09T14:58:27.743 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 54%] 2024-03-09T14:58:28.530 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 55%] 2024-03-09T14:58:29.126 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 55%] 2024-03-09T14:58:29.806 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 55%] 2024-03-09T14:58:30.506 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 55%] 2024-03-09T14:58:31.134 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 55%] 2024-03-09T14:58:31.731 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 55%] 2024-03-09T14:58:32.330 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 55%] 2024-03-09T14:58:32.934 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 56%] 2024-03-09T14:58:33.730 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 56%] 2024-03-09T14:58:34.498 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 56%] 2024-03-09T14:58:35.290 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 56%] 2024-03-09T14:58:36.066 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 56%] 2024-03-09T14:58:36.839 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 56%] 2024-03-09T14:58:37.622 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 56%] 2024-03-09T14:58:38.435 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 57%] 2024-03-09T14:58:39.518 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 57%] 2024-03-09T14:58:40.291 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 57%] 2024-03-09T14:58:41.054 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 57%] 2024-03-09T14:58:41.966 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 57%] 2024-03-09T14:58:42.866 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 57%] 2024-03-09T14:58:43.818 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 57%] 2024-03-09T14:58:44.759 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 57%] 2024-03-09T14:58:45.627 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 58%] 2024-03-09T14:58:46.571 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 58%] 2024-03-09T14:58:47.528 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 58%] 2024-03-09T14:58:48.411 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 58%] 2024-03-09T14:58:49.406 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 58%] 2024-03-09T14:58:50.174 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 58%] 2024-03-09T14:58:51.143 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 58%] 2024-03-09T14:58:52.062 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 59%] 2024-03-09T14:58:53.026 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 59%] 2024-03-09T14:58:53.971 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 59%] 2024-03-09T14:58:54.955 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 59%] 2024-03-09T14:58:56.255 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 59%] 2024-03-09T14:58:57.379 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 59%] 2024-03-09T14:58:58.527 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 59%] 2024-03-09T14:58:59.831 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 60%] 2024-03-09T14:59:00.907 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 60%] 2024-03-09T14:59:01.763 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 60%] 2024-03-09T14:59:02.623 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 60%] 2024-03-09T14:59:03.523 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 60%] 2024-03-09T14:59:04.463 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 60%] 2024-03-09T14:59:05.299 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 60%] 2024-03-09T14:59:06.231 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 61%] 2024-03-09T14:59:07.435 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 61%] 2024-03-09T14:59:08.699 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 61%] 2024-03-09T14:59:09.991 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 61%] 2024-03-09T14:59:11.227 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 61%] 2024-03-09T14:59:12.503 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 61%] 2024-03-09T14:59:13.806 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 61%] 2024-03-09T14:59:15.023 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 61%] 2024-03-09T14:59:16.251 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 62%] 2024-03-09T14:59:17.523 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 62%] 2024-03-09T14:59:18.695 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 62%] 2024-03-09T14:59:19.911 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 62%] 2024-03-09T14:59:21.043 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 62%] 2024-03-09T14:59:22.475 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 62%] 2024-03-09T14:59:23.887 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 62%] 2024-03-09T14:59:24.471 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 63%] 2024-03-09T14:59:25.073 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 63%] 2024-03-09T14:59:25.759 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 63%] 2024-03-09T14:59:26.599 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 63%] 2024-03-09T14:59:27.447 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 63%] 2024-03-09T14:59:28.175 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 63%] 2024-03-09T14:59:28.867 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 63%] 2024-03-09T14:59:29.875 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 64%] 2024-03-09T14:59:31.815 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 64%] 2024-03-09T14:59:32.867 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 64%] 2024-03-09T14:59:33.799 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 64%] 2024-03-09T14:59:34.995 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 64%] 2024-03-09T14:59:36.003 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 64%] 2024-03-09T14:59:36.955 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 64%] 2024-03-09T14:59:37.859 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 65%] 2024-03-09T14:59:38.787 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 65%] 2024-03-09T14:59:39.939 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 65%] 2024-03-09T14:59:40.911 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 65%] 2024-03-09T14:59:42.059 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 65%] 2024-03-09T14:59:43.091 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 65%] 2024-03-09T14:59:44.399 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 65%] 2024-03-09T14:59:45.684 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 65%] 2024-03-09T14:59:46.530 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 66%] 2024-03-09T14:59:47.311 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 66%] 2024-03-09T14:59:49.423 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 66%] 2024-03-09T14:59:50.487 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 66%] 2024-03-09T14:59:53.895 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 66%] 2024-03-09T14:59:54.787 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 66%] 2024-03-09T14:59:55.779 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 66%] 2024-03-09T14:59:57.403 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 67%] 2024-03-09T14:59:58.379 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 67%] 2024-03-09T14:59:59.879 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 67%] 2024-03-09T15:00:03.307 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 67%] 2024-03-09T15:00:06.791 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 67%] 2024-03-09T15:00:11.603 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 67%] 2024-03-09T15:00:28.339 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 67%] 2024-03-09T15:00:31.203 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 68%] 2024-03-09T15:00:36.292 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 68%] 2024-03-09T15:00:37.411 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 68%] 2024-03-09T15:00:38.936 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 68%] 2024-03-09T15:00:40.387 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 68%] 2024-03-09T15:00:41.507 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 68%] 2024-03-09T15:00:42.404 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 68%] 2024-03-09T15:00:43.964 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 69%] 2024-03-09T15:00:44.995 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 69%] 2024-03-09T15:00:45.879 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 69%] 2024-03-09T15:00:46.749 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 69%] 2024-03-09T15:01:02.031 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 69%] 2024-03-09T15:01:03.079 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 69%] 2024-03-09T15:01:03.944 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 69%] 2024-03-09T15:01:04.880 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 69%] 2024-03-09T15:01:10.575 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 70%] 2024-03-09T15:01:14.475 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 70%] 2024-03-09T15:01:18.375 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 70%] 2024-03-09T15:01:19.379 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 70%] 2024-03-09T15:01:20.328 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 70%] 2024-03-09T15:01:21.224 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 70%] 2024-03-09T15:01:22.176 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 70%] 2024-03-09T15:01:23.088 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 71%] 2024-03-09T15:01:24.004 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 71%] 2024-03-09T15:01:24.964 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 71%] 2024-03-09T15:01:26.115 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 71%] 2024-03-09T15:01:27.344 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 71%] 2024-03-09T15:01:28.552 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 71%] 2024-03-09T15:01:29.940 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 71%] 2024-03-09T15:01:31.344 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 72%] 2024-03-09T15:01:33.000 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 72%] 2024-03-09T15:01:34.016 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 72%] 2024-03-09T15:01:35.376 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 72%] 2024-03-09T15:01:36.944 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 72%] 2024-03-09T15:01:38.152 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 72%] 2024-03-09T15:01:39.168 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 72%] 2024-03-09T15:01:40.443 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 73%] 2024-03-09T15:01:41.347 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 73%] 2024-03-09T15:01:46.295 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 73%] 2024-03-09T15:01:47.156 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 73%] 2024-03-09T15:01:48.059 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 73%] 2024-03-09T15:01:48.992 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 73%] 2024-03-09T15:01:49.879 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 73%] 2024-03-09T15:01:51.123 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 73%] 2024-03-09T15:02:00.045 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 74%] 2024-03-09T15:02:01.255 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 74%] 2024-03-09T15:02:02.376 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 74%] 2024-03-09T15:02:03.676 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 74%] 2024-03-09T15:02:04.968 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 74%] 2024-03-09T15:02:09.048 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 74%] 2024-03-09T15:02:10.332 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 74%] 2024-03-09T15:02:15.168 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 75%] 2024-03-09T15:02:31.716 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 75%] 2024-03-09T15:02:36.064 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 75%] 2024-03-09T15:02:37.924 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 75%] 2024-03-09T15:02:39.988 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 75%] 2024-03-09T15:02:41.168 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 75%] 2024-03-09T15:02:42.368 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 75%] 2024-03-09T15:02:43.396 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 76%] 2024-03-09T15:02:44.692 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 76%] 2024-03-09T15:02:45.904 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 76%] 2024-03-09T15:02:47.096 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 76%] 2024-03-09T15:02:47.928 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 76%] 2024-03-09T15:02:48.775 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 76%] 2024-03-09T15:02:49.587 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 76%] 2024-03-09T15:02:50.383 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 76%] 2024-03-09T15:02:51.230 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 77%] 2024-03-09T15:02:52.120 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 77%] 2024-03-09T15:02:52.892 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 77%] 2024-03-09T15:02:53.713 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 77%] 2024-03-09T15:02:54.600 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 77%] 2024-03-09T15:02:55.412 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 77%] 2024-03-09T15:02:56.308 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 77%] 2024-03-09T15:02:57.060 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 78%] 2024-03-09T15:02:57.856 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 78%] 2024-03-09T15:02:58.624 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 78%] 2024-03-09T15:02:59.520 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 78%] 2024-03-09T15:03:00.416 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 78%] 2024-03-09T15:03:01.363 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 78%] 2024-03-09T15:03:02.280 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 78%] 2024-03-09T15:03:03.128 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 79%] 2024-03-09T15:03:04.036 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 79%] 2024-03-09T15:03:04.940 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 79%] 2024-03-09T15:03:05.780 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 79%] 2024-03-09T15:03:06.536 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 79%] 2024-03-09T15:03:07.308 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 79%] 2024-03-09T15:03:08.103 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 79%] 2024-03-09T15:03:13.780 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 80%] 2024-03-09T15:03:19.504 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 80%] 2024-03-09T15:03:21.564 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 80%] 2024-03-09T15:03:22.492 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 80%] 2024-03-09T15:03:23.456 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 80%] 2024-03-09T15:03:24.359 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 80%] 2024-03-09T15:03:25.135 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 80%] 2024-03-09T15:03:25.924 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 80%] 2024-03-09T15:03:30.168 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 81%] 2024-03-09T15:03:31.980 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 81%] 2024-03-09T15:03:33.808 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 81%] 2024-03-09T15:03:34.712 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 81%] 2024-03-09T15:03:35.592 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 81%] 2024-03-09T15:03:36.474 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 81%] 2024-03-09T15:03:37.368 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 81%] 2024-03-09T15:03:38.336 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 82%] 2024-03-09T15:03:39.232 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 82%] 2024-03-09T15:03:40.124 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 82%] 2024-03-09T15:03:41.040 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 82%] 2024-03-09T15:03:42.044 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 82%] 2024-03-09T15:03:43.047 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 82%] 2024-03-09T15:03:44.356 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 82%] 2024-03-09T15:03:45.620 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 83%] 2024-03-09T15:03:46.720 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 83%] 2024-03-09T15:03:47.804 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 83%] 2024-03-09T15:03:48.872 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 83%] 2024-03-09T15:03:50.096 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 83%] 2024-03-09T15:03:51.172 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 83%] 2024-03-09T15:03:52.275 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 83%] 2024-03-09T15:03:53.435 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 84%] 2024-03-09T15:03:54.556 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 84%] 2024-03-09T15:03:55.696 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 84%] 2024-03-09T15:03:56.595 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 84%] 2024-03-09T15:03:57.487 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 84%] 2024-03-09T15:03:58.536 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 84%] 2024-03-09T15:03:59.708 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 84%] 2024-03-09T15:04:00.812 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 84%] 2024-03-09T15:04:01.944 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 85%] 2024-03-09T15:04:03.583 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 85%] 2024-03-09T15:04:07.872 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 85%] 2024-03-09T15:04:09.004 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 85%] 2024-03-09T15:04:10.172 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 85%] 2024-03-09T15:04:11.297 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 85%] 2024-03-09T15:04:12.740 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 85%] 2024-03-09T15:04:14.156 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 86%] 2024-03-09T15:04:15.023 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 86%] 2024-03-09T15:04:16.291 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 86%] 2024-03-09T15:04:17.064 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 86%] 2024-03-09T15:04:17.892 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 86%] 2024-03-09T15:04:18.776 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 86%] 2024-03-09T15:04:19.539 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 86%] 2024-03-09T15:04:20.448 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 87%] 2024-03-09T15:04:21.288 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 87%] 2024-03-09T15:04:22.492 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 87%] 2024-03-09T15:04:23.276 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 87%] 2024-03-09T15:04:24.111 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 87%] 2024-03-09T15:04:24.880 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 87%] 2024-03-09T15:04:25.640 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 87%] 2024-03-09T15:04:26.456 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 88%] 2024-03-09T15:04:27.296 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 88%] 2024-03-09T15:04:28.076 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 88%] 2024-03-09T15:04:28.952 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 88%] 2024-03-09T15:04:29.732 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 88%] 2024-03-09T15:04:30.548 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 88%] 2024-03-09T15:04:31.436 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 88%] 2024-03-09T15:04:32.324 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 88%] 2024-03-09T15:04:33.232 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 89%] 2024-03-09T15:04:34.180 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 89%] 2024-03-09T15:04:35.044 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 89%] 2024-03-09T15:04:35.888 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 89%] 2024-03-09T15:04:36.852 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 89%] 2024-03-09T15:04:37.748 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 89%] 2024-03-09T15:04:38.632 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 89%] 2024-03-09T15:04:39.592 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 90%] 2024-03-09T15:04:40.512 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 90%] 2024-03-09T15:04:41.396 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 90%] 2024-03-09T15:04:42.396 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 90%] 2024-03-09T15:04:43.312 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 90%] 2024-03-09T15:04:44.152 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 90%] 2024-03-09T15:04:44.988 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 90%] 2024-03-09T15:04:45.912 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 91%] 2024-03-09T15:04:46.888 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 91%] 2024-03-09T15:04:47.740 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 91%] 2024-03-09T15:04:48.636 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 91%] 2024-03-09T15:04:49.462 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 91%] 2024-03-09T15:04:50.352 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 91%] 2024-03-09T15:04:51.256 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 91%] 2024-03-09T15:05:01.912 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 92%] 2024-03-09T15:05:02.784 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 92%] 2024-03-09T15:05:13.392 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 92%] 2024-03-09T15:05:14.363 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 92%] 2024-03-09T15:05:15.320 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 92%] 2024-03-09T15:05:16.168 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 92%] 2024-03-09T15:05:17.016 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 92%] 2024-03-09T15:05:17.883 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 92%] 2024-03-09T15:05:18.776 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 93%] 2024-03-09T15:05:19.615 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 93%] 2024-03-09T15:05:20.511 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_deny_bucket_policy_status PASSED [ 93%] 2024-03-09T15:05:21.448 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 93%] 2024-03-09T15:05:22.347 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 93%] 2024-03-09T15:05:23.219 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 93%] 2024-03-09T15:05:24.191 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 93%] 2024-03-09T15:05:25.107 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 94%] 2024-03-09T15:05:25.956 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 94%] 2024-03-09T15:05:27.151 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 94%] 2024-03-09T15:05:29.267 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 94%] 2024-03-09T15:05:30.088 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 94%] 2024-03-09T15:05:30.939 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 94%] 2024-03-09T15:05:31.791 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 94%] 2024-03-09T15:05:32.852 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 95%] 2024-03-09T15:05:33.876 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 95%] 2024-03-09T15:05:41.456 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 95%] 2024-03-09T15:05:49.160 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-03-09T15:05:50.168 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-03-09T15:05:51.416 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-03-09T15:05:54.315 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-03-09T15:05:56.567 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 96%] 2024-03-09T15:05:58.947 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 96%] 2024-03-09T15:06:00.663 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 96%] 2024-03-09T15:06:02.076 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 96%] 2024-03-09T15:06:03.423 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-03-09T15:06:04.516 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-03-09T15:06:06.324 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-03-09T15:06:08.647 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-03-09T15:06:17.332 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 97%] 2024-03-09T15:06:19.671 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 97%] 2024-03-09T15:06:20.979 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 97%] 2024-03-09T15:06:22.144 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-03-09T15:06:23.259 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-03-09T15:06:24.656 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-03-09T15:06:26.056 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-03-09T15:06:27.367 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 98%] 2024-03-09T15:06:28.552 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 98%] 2024-03-09T15:06:29.907 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 98%] 2024-03-09T15:06:31.260 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 98%] 2024-03-09T15:06:32.803 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-03-09T15:06:34.095 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-03-09T15:06:34.723 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-03-09T15:06:36.472 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 99%] 2024-03-09T15:06:38.655 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 99%] 2024-03-09T15:06:40.200 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 99%] 2024-03-09T15:06:41.567 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 99%] 2024-03-09T15:06:42.719 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-03-09T15:06:53.796 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-03-09T15:06:54.360 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-03-09T15:06:54.515 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-03-09T15:06:54.515 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.515 INFO:teuthology.orchestra.run.smithi099.stdout:=================================== FAILURES =================================== 2024-03-09T15:06:54.515 INFO:teuthology.orchestra.run.smithi099.stdout:__________________ test_object_create_bad_contentlength_none ___________________ 2024-03-09T15:06:54.516 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.516 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.auth_common 2024-03-09T15:06:54.516 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:06:54.516 INFO:teuthology.orchestra.run.smithi099.stdout: def test_object_create_bad_contentlength_none(): 2024-03-09T15:06:54.516 INFO:teuthology.orchestra.run.smithi099.stdout: key = _setup_bad_object(remove=('Content-Length',)) 2024-03-09T15:06:54.516 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.516 INFO:teuthology.orchestra.run.smithi099.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:06:54.516 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.516 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py:180: 2024-03-09T15:06:54.516 INFO:teuthology.orchestra.run.smithi099.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:06:54.516 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.516 INFO:teuthology.orchestra.run.smithi099.stdout:excClass = 2024-03-09T15:06:54.516 INFO:teuthology.orchestra.run.smithi099.stdout:callableObj = > 2024-03-09T15:06:54.516 INFO:teuthology.orchestra.run.smithi099.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:06:54.516 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:06:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:06:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: try: 2024-03-09T15:06:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: callableObj(*args, **kwargs) 2024-03-09T15:06:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: except excClass as e: 2024-03-09T15:06:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: return e 2024-03-09T15:06:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:06:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: excName = excClass.__name__ 2024-03-09T15:06:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.517 INFO:teuthology.orchestra.run.smithi099.stdout: excName = str(excClass) 2024-03-09T15:06:54.517 INFO:teuthology.orchestra.run.smithi099.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:06:54.517 INFO:teuthology.orchestra.run.smithi099.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:06:54.518 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.518 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:06:54.518 INFO:teuthology.orchestra.run.smithi099.stdout:---------------------------- Captured stdout setup ----------------------------- 2024-03-09T15:06:54.518 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on main 2024-03-09T15:06:54.518 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection main prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.518 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on alt 2024-03-09T15:06:54.518 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.518 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on tenant 2024-03-09T15:06:54.518 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.518 INFO:teuthology.orchestra.run.smithi099.stdout:Done with cleanup of test buckets. 2024-03-09T15:06:54.518 INFO:teuthology.orchestra.run.smithi099.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:06:54.518 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on main 2024-03-09T15:06:54.518 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection main prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.518 INFO:teuthology.orchestra.run.smithi099.stdout:prefix= test-client.0-x09e1w6g2vq992f- 2024-03-09T15:06:54.519 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket 2024-03-09T15:06:54.519 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket key 2024-03-09T15:06:54.519 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on alt 2024-03-09T15:06:54.519 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.519 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on tenant 2024-03-09T15:06:54.519 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.519 INFO:teuthology.orchestra.run.smithi099.stdout:Done with cleanup of test buckets. 2024-03-09T15:06:54.519 INFO:teuthology.orchestra.run.smithi099.stdout:__________________ test_object_create_bad_authorization_empty __________________ 2024-03-09T15:06:54.519 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.519 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.auth_common 2024-03-09T15:06:54.519 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:06:54.519 INFO:teuthology.orchestra.run.smithi099.stdout: def test_object_create_bad_authorization_empty(): 2024-03-09T15:06:54.519 INFO:teuthology.orchestra.run.smithi099.stdout: key = _setup_bad_object({'Authorization': ''}) 2024-03-09T15:06:54.519 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.519 INFO:teuthology.orchestra.run.smithi099.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:06:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.520 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py:210: 2024-03-09T15:06:54.520 INFO:teuthology.orchestra.run.smithi099.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:06:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.520 INFO:teuthology.orchestra.run.smithi099.stdout:excClass = 2024-03-09T15:06:54.520 INFO:teuthology.orchestra.run.smithi099.stdout:callableObj = > 2024-03-09T15:06:54.520 INFO:teuthology.orchestra.run.smithi099.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:06:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:06:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:06:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: try: 2024-03-09T15:06:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: callableObj(*args, **kwargs) 2024-03-09T15:06:54.520 INFO:teuthology.orchestra.run.smithi099.stdout: except excClass as e: 2024-03-09T15:06:54.521 INFO:teuthology.orchestra.run.smithi099.stdout: return e 2024-03-09T15:06:54.521 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.521 INFO:teuthology.orchestra.run.smithi099.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:06:54.521 INFO:teuthology.orchestra.run.smithi099.stdout: excName = excClass.__name__ 2024-03-09T15:06:54.521 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.521 INFO:teuthology.orchestra.run.smithi099.stdout: excName = str(excClass) 2024-03-09T15:06:54.521 INFO:teuthology.orchestra.run.smithi099.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:06:54.521 INFO:teuthology.orchestra.run.smithi099.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:06:54.521 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.521 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:06:54.521 INFO:teuthology.orchestra.run.smithi099.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:06:54.521 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on main 2024-03-09T15:06:54.521 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection main prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.522 INFO:teuthology.orchestra.run.smithi099.stdout:prefix= test-client.0-x09e1w6g2vq992f- 2024-03-09T15:06:54.522 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket 2024-03-09T15:06:54.522 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket key 2024-03-09T15:06:54.522 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on alt 2024-03-09T15:06:54.522 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.522 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on tenant 2024-03-09T15:06:54.522 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.522 INFO:teuthology.orchestra.run.smithi099.stdout:Done with cleanup of test buckets. 2024-03-09T15:06:54.522 INFO:teuthology.orchestra.run.smithi099.stdout:__________________ test_object_create_bad_authorization_none ___________________ 2024-03-09T15:06:54.522 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.522 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.auth_common 2024-03-09T15:06:54.522 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:06:54.523 INFO:teuthology.orchestra.run.smithi099.stdout: def test_object_create_bad_authorization_none(): 2024-03-09T15:06:54.523 INFO:teuthology.orchestra.run.smithi099.stdout: key = _setup_bad_object(remove=('Authorization',)) 2024-03-09T15:06:54.523 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.523 INFO:teuthology.orchestra.run.smithi099.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:06:54.523 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.523 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py:236: 2024-03-09T15:06:54.523 INFO:teuthology.orchestra.run.smithi099.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:06:54.523 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.523 INFO:teuthology.orchestra.run.smithi099.stdout:excClass = 2024-03-09T15:06:54.523 INFO:teuthology.orchestra.run.smithi099.stdout:callableObj = > 2024-03-09T15:06:54.523 INFO:teuthology.orchestra.run.smithi099.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:06:54.523 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.523 INFO:teuthology.orchestra.run.smithi099.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:06:54.523 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:06:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: try: 2024-03-09T15:06:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: callableObj(*args, **kwargs) 2024-03-09T15:06:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: except excClass as e: 2024-03-09T15:06:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: return e 2024-03-09T15:06:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:06:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: excName = excClass.__name__ 2024-03-09T15:06:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: excName = str(excClass) 2024-03-09T15:06:54.524 INFO:teuthology.orchestra.run.smithi099.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:06:54.524 INFO:teuthology.orchestra.run.smithi099.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:06:54.524 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.525 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:06:54.525 INFO:teuthology.orchestra.run.smithi099.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:06:54.525 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on main 2024-03-09T15:06:54.525 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection main prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.525 INFO:teuthology.orchestra.run.smithi099.stdout:prefix= test-client.0-x09e1w6g2vq992f- 2024-03-09T15:06:54.525 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket 2024-03-09T15:06:54.525 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket key 2024-03-09T15:06:54.525 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on alt 2024-03-09T15:06:54.525 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.525 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on tenant 2024-03-09T15:06:54.525 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.525 INFO:teuthology.orchestra.run.smithi099.stdout:Done with cleanup of test buckets. 2024-03-09T15:06:54.526 INFO:teuthology.orchestra.run.smithi099.stdout:__________________ test_bucket_create_bad_authorization_empty __________________ 2024-03-09T15:06:54.526 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.526 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.auth_common 2024-03-09T15:06:54.526 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:06:54.526 INFO:teuthology.orchestra.run.smithi099.stdout: def test_bucket_create_bad_authorization_empty(): 2024-03-09T15:06:54.526 INFO:teuthology.orchestra.run.smithi099.stdout: _add_custom_headers({'Authorization': ''}) 2024-03-09T15:06:54.526 INFO:teuthology.orchestra.run.smithi099.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-09T15:06:54.526 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.526 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py:294: 2024-03-09T15:06:54.526 INFO:teuthology.orchestra.run.smithi099.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:06:54.526 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.526 INFO:teuthology.orchestra.run.smithi099.stdout:excClass = 2024-03-09T15:06:54.526 INFO:teuthology.orchestra.run.smithi099.stdout:callableObj = , args = () 2024-03-09T15:06:54.526 INFO:teuthology.orchestra.run.smithi099.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:06:54.526 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:06:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:06:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: try: 2024-03-09T15:06:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: callableObj(*args, **kwargs) 2024-03-09T15:06:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: except excClass as e: 2024-03-09T15:06:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: return e 2024-03-09T15:06:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:06:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: excName = excClass.__name__ 2024-03-09T15:06:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.527 INFO:teuthology.orchestra.run.smithi099.stdout: excName = str(excClass) 2024-03-09T15:06:54.527 INFO:teuthology.orchestra.run.smithi099.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:06:54.528 INFO:teuthology.orchestra.run.smithi099.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:06:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.528 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:06:54.528 INFO:teuthology.orchestra.run.smithi099.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:06:54.528 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on main 2024-03-09T15:06:54.528 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection main prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.528 INFO:teuthology.orchestra.run.smithi099.stdout:prefix= test-client.0-x09e1w6g2vq992f- 2024-03-09T15:06:54.528 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket 2024-03-09T15:06:54.528 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on alt 2024-03-09T15:06:54.528 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.528 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on tenant 2024-03-09T15:06:54.528 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.528 INFO:teuthology.orchestra.run.smithi099.stdout:Done with cleanup of test buckets. 2024-03-09T15:06:54.528 INFO:teuthology.orchestra.run.smithi099.stdout:__________________ test_bucket_create_bad_authorization_none ___________________ 2024-03-09T15:06:54.528 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.529 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.auth_common 2024-03-09T15:06:54.529 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:06:54.529 INFO:teuthology.orchestra.run.smithi099.stdout: def test_bucket_create_bad_authorization_none(): 2024-03-09T15:06:54.529 INFO:teuthology.orchestra.run.smithi099.stdout: _add_custom_headers(remove=('Authorization',)) 2024-03-09T15:06:54.529 INFO:teuthology.orchestra.run.smithi099.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-09T15:06:54.529 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.530 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py:305: 2024-03-09T15:06:54.530 INFO:teuthology.orchestra.run.smithi099.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:06:54.530 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.530 INFO:teuthology.orchestra.run.smithi099.stdout:excClass = 2024-03-09T15:06:54.530 INFO:teuthology.orchestra.run.smithi099.stdout:callableObj = , args = () 2024-03-09T15:06:54.530 INFO:teuthology.orchestra.run.smithi099.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:06:54.530 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.530 INFO:teuthology.orchestra.run.smithi099.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:06:54.530 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.530 INFO:teuthology.orchestra.run.smithi099.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:06:54.530 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.530 INFO:teuthology.orchestra.run.smithi099.stdout: try: 2024-03-09T15:06:54.530 INFO:teuthology.orchestra.run.smithi099.stdout: callableObj(*args, **kwargs) 2024-03-09T15:06:54.530 INFO:teuthology.orchestra.run.smithi099.stdout: except excClass as e: 2024-03-09T15:06:54.531 INFO:teuthology.orchestra.run.smithi099.stdout: return e 2024-03-09T15:06:54.531 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.531 INFO:teuthology.orchestra.run.smithi099.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:06:54.531 INFO:teuthology.orchestra.run.smithi099.stdout: excName = excClass.__name__ 2024-03-09T15:06:54.531 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.531 INFO:teuthology.orchestra.run.smithi099.stdout: excName = str(excClass) 2024-03-09T15:06:54.531 INFO:teuthology.orchestra.run.smithi099.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:06:54.531 INFO:teuthology.orchestra.run.smithi099.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:06:54.531 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.531 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:06:54.531 INFO:teuthology.orchestra.run.smithi099.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:06:54.531 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on main 2024-03-09T15:06:54.531 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection main prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.531 INFO:teuthology.orchestra.run.smithi099.stdout:prefix= test-client.0-x09e1w6g2vq992f- 2024-03-09T15:06:54.532 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket 2024-03-09T15:06:54.532 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on alt 2024-03-09T15:06:54.532 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.532 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on tenant 2024-03-09T15:06:54.532 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.532 INFO:teuthology.orchestra.run.smithi099.stdout:Done with cleanup of test buckets. 2024-03-09T15:06:54.532 INFO:teuthology.orchestra.run.smithi099.stdout:___________ test_object_create_bad_contentlength_mismatch_below_aws2 ___________ 2024-03-09T15:06:54.532 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.532 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.auth_aws2 2024-03-09T15:06:54.532 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:06:54.532 INFO:teuthology.orchestra.run.smithi099.stdout: def test_object_create_bad_contentlength_mismatch_below_aws2(): 2024-03-09T15:06:54.532 INFO:teuthology.orchestra.run.smithi099.stdout: check_aws2_support() 2024-03-09T15:06:54.532 INFO:teuthology.orchestra.run.smithi099.stdout: content = 'bar' 2024-03-09T15:06:54.532 INFO:teuthology.orchestra.run.smithi099.stdout: length = len(content) - 1 2024-03-09T15:06:54.532 INFO:teuthology.orchestra.run.smithi099.stdout: key = _setup_bad_object({'Content-Length': length}) 2024-03-09T15:06:54.532 INFO:teuthology.orchestra.run.smithi099.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, content) 2024-03-09T15:06:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.533 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py:321: 2024-03-09T15:06:54.533 INFO:teuthology.orchestra.run.smithi099.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:06:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.533 INFO:teuthology.orchestra.run.smithi099.stdout:excClass = 2024-03-09T15:06:54.533 INFO:teuthology.orchestra.run.smithi099.stdout:callableObj = > 2024-03-09T15:06:54.533 INFO:teuthology.orchestra.run.smithi099.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:06:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:06:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:06:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: try: 2024-03-09T15:06:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: callableObj(*args, **kwargs) 2024-03-09T15:06:54.533 INFO:teuthology.orchestra.run.smithi099.stdout: except excClass as e: 2024-03-09T15:06:54.534 INFO:teuthology.orchestra.run.smithi099.stdout: return e 2024-03-09T15:06:54.534 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.534 INFO:teuthology.orchestra.run.smithi099.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:06:54.534 INFO:teuthology.orchestra.run.smithi099.stdout: excName = excClass.__name__ 2024-03-09T15:06:54.534 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.534 INFO:teuthology.orchestra.run.smithi099.stdout: excName = str(excClass) 2024-03-09T15:06:54.534 INFO:teuthology.orchestra.run.smithi099.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:06:54.534 INFO:teuthology.orchestra.run.smithi099.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:06:54.534 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.534 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:06:54.534 INFO:teuthology.orchestra.run.smithi099.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:06:54.534 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on main 2024-03-09T15:06:54.534 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection main prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.534 INFO:teuthology.orchestra.run.smithi099.stdout:prefix= test-client.0-x09e1w6g2vq992f- 2024-03-09T15:06:54.535 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket 2024-03-09T15:06:54.535 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket key 2024-03-09T15:06:54.535 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on alt 2024-03-09T15:06:54.535 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.535 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on tenant 2024-03-09T15:06:54.535 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.535 INFO:teuthology.orchestra.run.smithi099.stdout:Done with cleanup of test buckets. 2024-03-09T15:06:54.535 INFO:teuthology.orchestra.run.smithi099.stdout:_____________ test_object_create_bad_authorization_incorrect_aws2 ______________ 2024-03-09T15:06:54.535 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.535 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.auth_aws2 2024-03-09T15:06:54.535 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:06:54.535 INFO:teuthology.orchestra.run.smithi099.stdout: def test_object_create_bad_authorization_incorrect_aws2(): 2024-03-09T15:06:54.535 INFO:teuthology.orchestra.run.smithi099.stdout: check_aws2_support() 2024-03-09T15:06:54.535 INFO:teuthology.orchestra.run.smithi099.stdout: key = _setup_bad_object({'Authorization': 'AWS AKIAIGR7ZNNBHC5BKSUB:FWeDfwojDSdS2Ztmpfeubhd9isU='}) 2024-03-09T15:06:54.535 INFO:teuthology.orchestra.run.smithi099.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:06:54.535 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.535 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py:332: 2024-03-09T15:06:54.536 INFO:teuthology.orchestra.run.smithi099.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:06:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.536 INFO:teuthology.orchestra.run.smithi099.stdout:excClass = 2024-03-09T15:06:54.536 INFO:teuthology.orchestra.run.smithi099.stdout:callableObj = > 2024-03-09T15:06:54.536 INFO:teuthology.orchestra.run.smithi099.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:06:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:06:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:06:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: try: 2024-03-09T15:06:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: callableObj(*args, **kwargs) 2024-03-09T15:06:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: except excClass as e: 2024-03-09T15:06:54.536 INFO:teuthology.orchestra.run.smithi099.stdout: return e 2024-03-09T15:06:54.537 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.537 INFO:teuthology.orchestra.run.smithi099.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:06:54.537 INFO:teuthology.orchestra.run.smithi099.stdout: excName = excClass.__name__ 2024-03-09T15:06:54.537 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.537 INFO:teuthology.orchestra.run.smithi099.stdout: excName = str(excClass) 2024-03-09T15:06:54.537 INFO:teuthology.orchestra.run.smithi099.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:06:54.537 INFO:teuthology.orchestra.run.smithi099.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:06:54.537 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.537 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:06:54.537 INFO:teuthology.orchestra.run.smithi099.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:06:54.537 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on main 2024-03-09T15:06:54.537 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection main prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.537 INFO:teuthology.orchestra.run.smithi099.stdout:prefix= test-client.0-x09e1w6g2vq992f- 2024-03-09T15:06:54.537 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket 2024-03-09T15:06:54.538 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket key 2024-03-09T15:06:54.538 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on alt 2024-03-09T15:06:54.538 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.538 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on tenant 2024-03-09T15:06:54.538 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.538 INFO:teuthology.orchestra.run.smithi099.stdout:Done with cleanup of test buckets. 2024-03-09T15:06:54.538 INFO:teuthology.orchestra.run.smithi099.stdout:______________ test_object_create_bad_authorization_invalid_aws2 _______________ 2024-03-09T15:06:54.538 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.538 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.auth_aws2 2024-03-09T15:06:54.538 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:06:54.538 INFO:teuthology.orchestra.run.smithi099.stdout: def test_object_create_bad_authorization_invalid_aws2(): 2024-03-09T15:06:54.538 INFO:teuthology.orchestra.run.smithi099.stdout: check_aws2_support() 2024-03-09T15:06:54.538 INFO:teuthology.orchestra.run.smithi099.stdout: key = _setup_bad_object({'Authorization': 'AWS HAHAHA'}) 2024-03-09T15:06:54.538 INFO:teuthology.orchestra.run.smithi099.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:06:54.538 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.539 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py:343: 2024-03-09T15:06:54.539 INFO:teuthology.orchestra.run.smithi099.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:06:54.539 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.539 INFO:teuthology.orchestra.run.smithi099.stdout:excClass = 2024-03-09T15:06:54.539 INFO:teuthology.orchestra.run.smithi099.stdout:callableObj = > 2024-03-09T15:06:54.539 INFO:teuthology.orchestra.run.smithi099.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:06:54.539 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.539 INFO:teuthology.orchestra.run.smithi099.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:06:54.539 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.539 INFO:teuthology.orchestra.run.smithi099.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:06:54.539 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.539 INFO:teuthology.orchestra.run.smithi099.stdout: try: 2024-03-09T15:06:54.539 INFO:teuthology.orchestra.run.smithi099.stdout: callableObj(*args, **kwargs) 2024-03-09T15:06:54.539 INFO:teuthology.orchestra.run.smithi099.stdout: except excClass as e: 2024-03-09T15:06:54.540 INFO:teuthology.orchestra.run.smithi099.stdout: return e 2024-03-09T15:06:54.540 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.540 INFO:teuthology.orchestra.run.smithi099.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:06:54.540 INFO:teuthology.orchestra.run.smithi099.stdout: excName = excClass.__name__ 2024-03-09T15:06:54.540 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.540 INFO:teuthology.orchestra.run.smithi099.stdout: excName = str(excClass) 2024-03-09T15:06:54.540 INFO:teuthology.orchestra.run.smithi099.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:06:54.540 INFO:teuthology.orchestra.run.smithi099.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:06:54.540 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.540 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:06:54.540 INFO:teuthology.orchestra.run.smithi099.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:06:54.540 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on main 2024-03-09T15:06:54.540 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection main prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.540 INFO:teuthology.orchestra.run.smithi099.stdout:prefix= test-client.0-x09e1w6g2vq992f- 2024-03-09T15:06:54.540 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket 2024-03-09T15:06:54.541 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket key 2024-03-09T15:06:54.541 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on alt 2024-03-09T15:06:54.541 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.541 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on tenant 2024-03-09T15:06:54.541 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.541 INFO:teuthology.orchestra.run.smithi099.stdout:Done with cleanup of test buckets. 2024-03-09T15:06:54.541 INFO:teuthology.orchestra.run.smithi099.stdout:____________________ test_object_create_bad_date_none_aws2 _____________________ 2024-03-09T15:06:54.541 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.541 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.auth_aws2 2024-03-09T15:06:54.541 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:06:54.541 INFO:teuthology.orchestra.run.smithi099.stdout: def test_object_create_bad_date_none_aws2(): 2024-03-09T15:06:54.541 INFO:teuthology.orchestra.run.smithi099.stdout: check_aws2_support() 2024-03-09T15:06:54.541 INFO:teuthology.orchestra.run.smithi099.stdout: key = _setup_bad_object(remove=('Date',)) 2024-03-09T15:06:54.541 INFO:teuthology.orchestra.run.smithi099.stdout:> e = assert_raises(boto.exception.S3ResponseError, key.set_contents_from_string, 'bar') 2024-03-09T15:06:54.541 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.542 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py:353: 2024-03-09T15:06:54.542 INFO:teuthology.orchestra.run.smithi099.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:06:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.542 INFO:teuthology.orchestra.run.smithi099.stdout:excClass = 2024-03-09T15:06:54.542 INFO:teuthology.orchestra.run.smithi099.stdout:callableObj = > 2024-03-09T15:06:54.542 INFO:teuthology.orchestra.run.smithi099.stdout:args = ('bar',), kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:06:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:06:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:06:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: try: 2024-03-09T15:06:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: callableObj(*args, **kwargs) 2024-03-09T15:06:54.542 INFO:teuthology.orchestra.run.smithi099.stdout: except excClass as e: 2024-03-09T15:06:54.543 INFO:teuthology.orchestra.run.smithi099.stdout: return e 2024-03-09T15:06:54.543 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.543 INFO:teuthology.orchestra.run.smithi099.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:06:54.543 INFO:teuthology.orchestra.run.smithi099.stdout: excName = excClass.__name__ 2024-03-09T15:06:54.543 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.543 INFO:teuthology.orchestra.run.smithi099.stdout: excName = str(excClass) 2024-03-09T15:06:54.543 INFO:teuthology.orchestra.run.smithi099.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:06:54.543 INFO:teuthology.orchestra.run.smithi099.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:06:54.543 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.543 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:06:54.543 INFO:teuthology.orchestra.run.smithi099.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:06:54.543 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on main 2024-03-09T15:06:54.543 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection main prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.543 INFO:teuthology.orchestra.run.smithi099.stdout:prefix= test-client.0-x09e1w6g2vq992f- 2024-03-09T15:06:54.543 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket 2024-03-09T15:06:54.544 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket key 2024-03-09T15:06:54.544 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on alt 2024-03-09T15:06:54.544 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.544 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on tenant 2024-03-09T15:06:54.544 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.544 INFO:teuthology.orchestra.run.smithi099.stdout:Done with cleanup of test buckets. 2024-03-09T15:06:54.544 INFO:teuthology.orchestra.run.smithi099.stdout:______________ test_bucket_create_bad_authorization_invalid_aws2 _______________ 2024-03-09T15:06:54.544 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.544 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.auth_aws2 2024-03-09T15:06:54.544 INFO:teuthology.orchestra.run.smithi099.stdout: def test_bucket_create_bad_authorization_invalid_aws2(): 2024-03-09T15:06:54.544 INFO:teuthology.orchestra.run.smithi099.stdout: check_aws2_support() 2024-03-09T15:06:54.544 INFO:teuthology.orchestra.run.smithi099.stdout: _add_custom_headers({'Authorization': 'AWS HAHAHA'}) 2024-03-09T15:06:54.544 INFO:teuthology.orchestra.run.smithi099.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-09T15:06:54.544 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.545 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py:363: 2024-03-09T15:06:54.545 INFO:teuthology.orchestra.run.smithi099.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:06:54.545 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.545 INFO:teuthology.orchestra.run.smithi099.stdout:excClass = 2024-03-09T15:06:54.545 INFO:teuthology.orchestra.run.smithi099.stdout:callableObj = , args = () 2024-03-09T15:06:54.545 INFO:teuthology.orchestra.run.smithi099.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:06:54.545 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.545 INFO:teuthology.orchestra.run.smithi099.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:06:54.545 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.545 INFO:teuthology.orchestra.run.smithi099.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:06:54.545 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.545 INFO:teuthology.orchestra.run.smithi099.stdout: try: 2024-03-09T15:06:54.545 INFO:teuthology.orchestra.run.smithi099.stdout: callableObj(*args, **kwargs) 2024-03-09T15:06:54.545 INFO:teuthology.orchestra.run.smithi099.stdout: except excClass as e: 2024-03-09T15:06:54.546 INFO:teuthology.orchestra.run.smithi099.stdout: return e 2024-03-09T15:06:54.546 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.546 INFO:teuthology.orchestra.run.smithi099.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:06:54.546 INFO:teuthology.orchestra.run.smithi099.stdout: excName = excClass.__name__ 2024-03-09T15:06:54.546 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.546 INFO:teuthology.orchestra.run.smithi099.stdout: excName = str(excClass) 2024-03-09T15:06:54.546 INFO:teuthology.orchestra.run.smithi099.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:06:54.546 INFO:teuthology.orchestra.run.smithi099.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:06:54.546 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.546 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:06:54.546 INFO:teuthology.orchestra.run.smithi099.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:06:54.546 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on main 2024-03-09T15:06:54.546 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection main prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.546 INFO:teuthology.orchestra.run.smithi099.stdout:prefix= test-client.0-x09e1w6g2vq992f- 2024-03-09T15:06:54.547 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket 2024-03-09T15:06:54.547 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on alt 2024-03-09T15:06:54.547 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.547 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on tenant 2024-03-09T15:06:54.547 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.547 INFO:teuthology.orchestra.run.smithi099.stdout:Done with cleanup of test buckets. 2024-03-09T15:06:54.547 INFO:teuthology.orchestra.run.smithi099.stdout:____________________ test_bucket_create_bad_date_none_aws2 _____________________ 2024-03-09T15:06:54.547 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.547 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.auth_aws2 2024-03-09T15:06:54.547 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.fails_on_dbstore 2024-03-09T15:06:54.547 INFO:teuthology.orchestra.run.smithi099.stdout: def test_bucket_create_bad_date_none_aws2(): 2024-03-09T15:06:54.547 INFO:teuthology.orchestra.run.smithi099.stdout: check_aws2_support() 2024-03-09T15:06:54.547 INFO:teuthology.orchestra.run.smithi099.stdout: _add_custom_headers(remove=('Date',)) 2024-03-09T15:06:54.547 INFO:teuthology.orchestra.run.smithi099.stdout:> e = assert_raises(boto.exception.S3ResponseError, get_new_bucket) 2024-03-09T15:06:54.547 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.548 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py:373: 2024-03-09T15:06:54.548 INFO:teuthology.orchestra.run.smithi099.stdout:_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2024-03-09T15:06:54.548 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.548 INFO:teuthology.orchestra.run.smithi099.stdout:excClass = 2024-03-09T15:06:54.548 INFO:teuthology.orchestra.run.smithi099.stdout:callableObj = , args = () 2024-03-09T15:06:54.548 INFO:teuthology.orchestra.run.smithi099.stdout:kwargs = {}, excName = 'S3ResponseError' 2024-03-09T15:06:54.548 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.548 INFO:teuthology.orchestra.run.smithi099.stdout: def assert_raises(excClass, callableObj, *args, **kwargs): 2024-03-09T15:06:54.548 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.548 INFO:teuthology.orchestra.run.smithi099.stdout: Like unittest.TestCase.assertRaises, but returns the exception. 2024-03-09T15:06:54.548 INFO:teuthology.orchestra.run.smithi099.stdout: """ 2024-03-09T15:06:54.548 INFO:teuthology.orchestra.run.smithi099.stdout: try: 2024-03-09T15:06:54.548 INFO:teuthology.orchestra.run.smithi099.stdout: callableObj(*args, **kwargs) 2024-03-09T15:06:54.548 INFO:teuthology.orchestra.run.smithi099.stdout: except excClass as e: 2024-03-09T15:06:54.549 INFO:teuthology.orchestra.run.smithi099.stdout: return e 2024-03-09T15:06:54.549 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.549 INFO:teuthology.orchestra.run.smithi099.stdout: if hasattr(excClass, '__name__'): 2024-03-09T15:06:54.549 INFO:teuthology.orchestra.run.smithi099.stdout: excName = excClass.__name__ 2024-03-09T15:06:54.549 INFO:teuthology.orchestra.run.smithi099.stdout: else: 2024-03-09T15:06:54.549 INFO:teuthology.orchestra.run.smithi099.stdout: excName = str(excClass) 2024-03-09T15:06:54.549 INFO:teuthology.orchestra.run.smithi099.stdout:> raise AssertionError("%s not raised" % excName) 2024-03-09T15:06:54.549 INFO:teuthology.orchestra.run.smithi099.stdout:E AssertionError: S3ResponseError not raised 2024-03-09T15:06:54.549 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.549 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/utils.py:19: AssertionError 2024-03-09T15:06:54.549 INFO:teuthology.orchestra.run.smithi099.stdout:--------------------------- Captured stdout teardown --------------------------- 2024-03-09T15:06:54.549 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on main 2024-03-09T15:06:54.549 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection main prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.549 INFO:teuthology.orchestra.run.smithi099.stdout:prefix= test-client.0-x09e1w6g2vq992f- 2024-03-09T15:06:54.549 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning bucket 2024-03-09T15:06:54.550 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on alt 2024-03-09T15:06:54.550 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection alt prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.550 INFO:teuthology.orchestra.run.smithi099.stdout:Deleting buckets on tenant 2024-03-09T15:06:54.550 INFO:teuthology.orchestra.run.smithi099.stdout:Cleaning buckets from connection tenant prefix 'test-client.0-x09e1w6g2vq992f-'. 2024-03-09T15:06:54.550 INFO:teuthology.orchestra.run.smithi099.stdout:Done with cleanup of test buckets. 2024-03-09T15:06:54.550 INFO:teuthology.orchestra.run.smithi099.stdout:=============================== warnings summary =============================== 2024-03-09T15:06:54.550 INFO:teuthology.orchestra.run.smithi099.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-03-09T15:06:54.550 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-03-09T15:06:54.550 INFO:teuthology.orchestra.run.smithi099.stdout: import imp 2024-03-09T15:06:54.550 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.550 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py:124 2024-03-09T15:06:54.550 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-03-09T15:06:54.550 INFO:teuthology.orchestra.run.smithi099.stdout: if boto_type is 'S3Connection': 2024-03-09T15:06:54.550 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.551 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_headers.py:129 2024-03-09T15:06:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:129: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-03-09T15:06:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: elif boto_type is 'HTTPRequest': 2024-03-09T15:06:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.551 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3.py:359 2024-03-09T15:06:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-03-09T15:06:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-03-09T15:06:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.551 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py:176 2024-03-09T15:06:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-03-09T15:06:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: if k is 'BucketName': 2024-03-09T15:06:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.551 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py:253 2024-03-09T15:06:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-03-09T15:06:54.551 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.timeout(10) 2024-03-09T15:06:54.552 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.552 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests/functional/test_s3_website.py:1077 2024-03-09T15:06:54.552 INFO:teuthology.orchestra.run.smithi099.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-03-09T15:06:54.552 INFO:teuthology.orchestra.run.smithi099.stdout: @pytest.mark.s3website_routing_rules 2024-03-09T15:06:54.552 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.552 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2212 2024-03-09T15:06:54.552 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2212: DeprecationWarning: invalid escape sequence '\$' 2024-03-09T15:06:54.552 INFO:teuthology.orchestra.run.smithi099.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:06:54.552 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.552 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2227 2024-03-09T15:06:54.552 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2227: DeprecationWarning: invalid escape sequence '\$' 2024-03-09T15:06:54.552 INFO:teuthology.orchestra.run.smithi099.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-03-09T15:06:54.552 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.552 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2233 2024-03-09T15:06:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2233: DeprecationWarning: invalid escape sequence '\$' 2024-03-09T15:06:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-03-09T15:06:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.553 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2290 2024-03-09T15:06:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2290: DeprecationWarning: invalid escape sequence '\$' 2024-03-09T15:06:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:06:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.553 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2305 2024-03-09T15:06:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2305: DeprecationWarning: invalid escape sequence '\$' 2024-03-09T15:06:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-03-09T15:06:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.553 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2323 2024-03-09T15:06:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2323: DeprecationWarning: invalid escape sequence '\$' 2024-03-09T15:06:54.553 INFO:teuthology.orchestra.run.smithi099.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:06:54.554 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.554 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2338 2024-03-09T15:06:54.554 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2338: DeprecationWarning: invalid escape sequence '\$' 2024-03-09T15:06:54.554 INFO:teuthology.orchestra.run.smithi099.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-03-09T15:06:54.554 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.554 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2356 2024-03-09T15:06:54.554 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2356: DeprecationWarning: invalid escape sequence '\$' 2024-03-09T15:06:54.554 INFO:teuthology.orchestra.run.smithi099.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:06:54.554 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.555 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2371 2024-03-09T15:06:54.555 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2371: DeprecationWarning: invalid escape sequence '\$' 2024-03-09T15:06:54.555 INFO:teuthology.orchestra.run.smithi099.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-03-09T15:06:54.555 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.555 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2421 2024-03-09T15:06:54.555 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2421: DeprecationWarning: invalid escape sequence '\$' 2024-03-09T15:06:54.555 INFO:teuthology.orchestra.run.smithi099.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:06:54.555 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.555 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py:2453 2024-03-09T15:06:54.555 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2453: DeprecationWarning: invalid escape sequence '\$' 2024-03-09T15:06:54.555 INFO:teuthology.orchestra.run.smithi099.stdout: ["starts-with", "$key", "\$foo"],\ 2024-03-09T15:06:54.555 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.555 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-03-09T15:06:54.555 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_iam.py: 79 warnings 2024-03-09T15:06:54.555 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py: 484 warnings 2024-03-09T15:06:54.556 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-03-09T15:06:54.556 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/urllib3/connectionpool.py:1061: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi099.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-03-09T15:06:54.556 INFO:teuthology.orchestra.run.smithi099.stdout: warnings.warn( 2024-03-09T15:06:54.556 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.556 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-03-09T15:06:54.556 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-03-09T15:06:54.556 INFO:teuthology.orchestra.run.smithi099.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:6491: DeprecationWarning: ssl.wrap_socket() is deprecated, use SSLContext.wrap_socket() 2024-03-09T15:06:54.556 INFO:teuthology.orchestra.run.smithi099.stdout: s = ssl.wrap_socket(s); 2024-03-09T15:06:54.556 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.556 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-03-09T15:06:54.556 INFO:teuthology.orchestra.run.smithi099.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue 2024-03-09T15:06:54.556 INFO:teuthology.orchestra.run.smithi099.stdout: /usr/lib/python3.10/ssl.py:1434: DeprecationWarning: ssl.PROTOCOL_TLS is deprecated 2024-03-09T15:06:54.556 INFO:teuthology.orchestra.run.smithi099.stdout: context = SSLContext(ssl_version) 2024-03-09T15:06:54.556 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:06:54.556 INFO:teuthology.orchestra.run.smithi099.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-03-09T15:06:54.557 INFO:teuthology.orchestra.run.smithi099.stdout:=========================== short test summary info ============================ 2024-03-09T15:06:54.557 INFO:teuthology.orchestra.run.smithi099.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none 2024-03-09T15:06:54.557 INFO:teuthology.orchestra.run.smithi099.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty 2024-03-09T15:06:54.557 INFO:teuthology.orchestra.run.smithi099.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_none 2024-03-09T15:06:54.557 INFO:teuthology.orchestra.run.smithi099.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty 2024-03-09T15:06:54.557 INFO:teuthology.orchestra.run.smithi099.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none 2024-03-09T15:06:54.557 INFO:teuthology.orchestra.run.smithi099.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 2024-03-09T15:06:54.557 INFO:teuthology.orchestra.run.smithi099.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 2024-03-09T15:06:54.557 INFO:teuthology.orchestra.run.smithi099.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 2024-03-09T15:06:54.557 INFO:teuthology.orchestra.run.smithi099.stdout:FAILED s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 2024-03-09T15:06:54.557 INFO:teuthology.orchestra.run.smithi099.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 2024-03-09T15:06:54.557 INFO:teuthology.orchestra.run.smithi099.stdout:FAILED s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 2024-03-09T15:06:54.557 INFO:teuthology.orchestra.run.smithi099.stdout:= 11 failed, 649 passed, 65 skipped, 124 deselected, 1 xfailed, 647 warnings in 915.16s (0:15:15) = 2024-03-09T15:06:54.720 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: InvocationError for command /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' (exited with code 1) 2024-03-09T15:06:54.720 INFO:teuthology.orchestra.run.smithi099.stdout:___________________________________ summary ____________________________________ 2024-03-09T15:06:54.720 INFO:teuthology.orchestra.run.smithi099.stdout:ERROR: py: commands failed 2024-03-09T15:06:54.752 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T15:06:54.753 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 462, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 405, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi099 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-03-09T15:06:54.754 INFO:tasks.s3tests:Cleaning up boto... 2024-03-09T15:06:54.755 DEBUG:teuthology.orchestra.run.smithi099:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-03-09T15:06:54.760 INFO:tasks.s3tests:Removing s3-tests... 2024-03-09T15:06:54.760 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-03-09T15:06:54.949 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 736, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 61, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 462, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 405, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi099 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-03-09T15:06:55.165 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5e5e2f2a1f2e464c9eb7403579015849 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 736, in task with contextutil.nested( File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 61, in download yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 30, in nested vars.append(enter()) File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 462, in run_tests toxvenv_sh(ctx, remote, args, label="s3 tests against rgw") File "/home/teuthworker/src/git.ceph.com_ceph-c_c00d9c609fb42a2a25f1c196bed064ca8bb02413/qa/tasks/s3tests.py", line 405, in toxvenv_sh return remote.sh(['source', activate, run.Raw('&&')] + args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (s3 tests against rgw) on smithi099 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3'" 2024-03-09T15:06:55.169 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-03-09T15:06:55.180 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-03-09T15:06:55.189 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-03-09T15:06:55.189 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-03-09T15:06:55.189 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-03-09T15:06:55.246 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-03-09T15:06:55.246 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-03-09T15:06:55.327 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T15:06:55.328 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T15:06:55.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.370+0000 7fa7ae9d2980 20 rados->read ofs=0 len=0 2024-03-09T15:06:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.370+0000 7fa7ae9d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:06:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.370+0000 7fa7ae9d2980 20 realm 2024-03-09T15:06:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.370+0000 7fa7ae9d2980 20 rados->read ofs=0 len=0 2024-03-09T15:06:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.370+0000 7fa7ae9d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:06:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.370+0000 7fa7ae9d2980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T15:06:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.370+0000 7fa7ae9d2980 20 rados->read ofs=0 len=0 2024-03-09T15:06:55.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.370+0000 7fa7ae9d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:06:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.370+0000 7fa7ae9d2980 20 rados->read ofs=0 len=0 2024-03-09T15:06:55.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.370+0000 7fa7ae9d2980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T15:06:55.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.370+0000 7fa7ae9d2980 20 rados->read ofs=0 len=0 2024-03-09T15:06:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.374+0000 7fa7ae9d2980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T15:06:55.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.374+0000 7fa7ae9d2980 20 searching for the correct realm 2024-03-09T15:06:55.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.378+0000 7fa7ac4ea640 0 -- 172.21.15.99:0/2138136377 >> [v2:172.21.15.99:6800/643519472,v1:172.21.15.99:6801/643519472] conn(0x562ddce2b4c0 msgr2=0x562ddce2d980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T15:06:55.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.386+0000 7fa7abce9640 0 -- 172.21.15.99:0/2138136377 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7fa79c002ab0 msgr2=0x7fa79c0579a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T15:06:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T15:06:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T15:06:55.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T15:06:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T15:06:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T15:06:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T15:06:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 rados->read ofs=0 len=0 2024-03-09T15:06:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:06:55.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 rados->read ofs=0 len=0 2024-03-09T15:06:55.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T15:06:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 rados->read ofs=0 len=0 2024-03-09T15:06:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T15:06:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 zone default found 2024-03-09T15:06:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 4 Realm: () 2024-03-09T15:06:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T15:06:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T15:06:55.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T15:06:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 zonegroup default 2024-03-09T15:06:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 rados->read ofs=0 len=0 2024-03-09T15:06:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:06:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 rados->read ofs=0 len=0 2024-03-09T15:06:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:06:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 rados->read ofs=0 len=0 2024-03-09T15:06:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:06:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 started sync module instance, tier type = 2024-03-09T15:06:55.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.394+0000 7fa7ae9d2980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T15:06:55.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.410+0000 7fa7ae9d2980 20 add_watcher() i=0 2024-03-09T15:06:55.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.410+0000 7fa7ae9d2980 20 add_watcher() i=1 2024-03-09T15:06:55.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.410+0000 7fa7ae9d2980 20 add_watcher() i=2 2024-03-09T15:06:55.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.410+0000 7fa7ae9d2980 20 add_watcher() i=3 2024-03-09T15:06:55.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.410+0000 7fa7ae9d2980 20 add_watcher() i=4 2024-03-09T15:06:55.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.410+0000 7fa7ae9d2980 20 add_watcher() i=5 2024-03-09T15:06:55.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.410+0000 7fa7ae9d2980 20 add_watcher() i=6 2024-03-09T15:06:55.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.414+0000 7fa7ae9d2980 20 add_watcher() i=7 2024-03-09T15:06:55.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.414+0000 7fa7ae9d2980 2 all 8 watchers are set, enabling cache 2024-03-09T15:06:55.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.414+0000 7fa6637de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T15:06:55.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.414+0000 7fa7ae9d2980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T15:06:55.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.414+0000 7fa7ae9d2980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T15:06:55.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.498+0000 7fa6627dc640 20 reqs_thread_entry: start 2024-03-09T15:06:55.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.498+0000 7fa7ae9d2980 20 init_complete bucket index max shards: 11 2024-03-09T15:06:55.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.498+0000 7fa7ae9d2980 20 Filter name: none 2024-03-09T15:06:55.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.498+0000 7fa65b7fe640 20 reqs_thread_entry: start 2024-03-09T15:06:55.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.498+0000 7fa7ae9d2980 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-03-09T15:06:55.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.498+0000 7fa7ae9d2980 20 rados->read ofs=0 len=0 2024-03-09T15:06:55.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.498+0000 7fa7ae9d2980 20 rados_obj.operate() r=0 bl.length=482 2024-03-09T15:06:55.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.498+0000 7fa7ae9d2980 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-03-09T15:06:55.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.498+0000 7fa7ae9d2980 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-03-09T15:06:55.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.498+0000 7fa7ae9d2980 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-09T15:06:55.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.502+0000 7fa7ae9d2980 10 removing key index: OXTLWLMNVQCGJNZNFAON 2024-03-09T15:06:55.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.502+0000 7fa7ae9d2980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:OXTLWLMNVQCGJNZNFAON, ofs0, ns] 2024-03-09T15:06:55.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.502+0000 7fa6837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366413 cookie 94754979388848 notifier 7911 bl.length()=170 2024-03-09T15:06:55.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.506+0000 7fa7ae9d2980 10 removing email index: tester.client.0_test@test.test 2024-03-09T15:06:55.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.506+0000 7fa7ae9d2980 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-03-09T15:06:55.506 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.506+0000 7fa6837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367431 cookie 94754979380976 notifier 7911 bl.length()=181 2024-03-09T15:06:55.507 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.506+0000 7fa7ae9d2980 10 removing user buckets index 2024-03-09T15:06:55.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.510+0000 7fa7ae9d2980 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-03-09T15:06:55.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.510+0000 7fa682ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366414 cookie 94754979388848 notifier 7911 bl.length()=172 2024-03-09T15:06:55.511 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.510+0000 7fa7ae9d2980 10 removing user index: tester.client.0 2024-03-09T15:06:55.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.514+0000 7fa7ae9d2980 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-03-09T15:06:55.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.514+0000 7fa7ae9d2980 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-03-09T15:06:55.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.514+0000 7fa682ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366653 cookie 94754979384528 notifier 7911 bl.length()=164 2024-03-09T15:06:55.516 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.518+0000 7fa6637de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T15:06:55.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.522+0000 7fa7ae9d2980 20 remove_watcher() i=0 2024-03-09T15:06:55.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.522+0000 7fa7ae9d2980 2 removed watcher, disabling cache 2024-03-09T15:06:55.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.526+0000 7fa7ae9d2980 20 remove_watcher() i=1 2024-03-09T15:06:55.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.526+0000 7fa7ae9d2980 20 remove_watcher() i=2 2024-03-09T15:06:55.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.530+0000 7fa7ae9d2980 20 remove_watcher() i=3 2024-03-09T15:06:55.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.530+0000 7fa7ae9d2980 20 remove_watcher() i=4 2024-03-09T15:06:55.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.534+0000 7fa7ae9d2980 20 remove_watcher() i=5 2024-03-09T15:06:55.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.534+0000 7fa7ae9d2980 20 remove_watcher() i=6 2024-03-09T15:06:55.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:06:55.534+0000 7fa7ae9d2980 20 remove_watcher() i=7 2024-03-09T15:06:55.551 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-03-09T15:06:55.605 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-03-09T15:06:55.615 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-03-09T15:06:55.662 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-03-09T15:06:55.673 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-03-09T15:06:55.673 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:06:55.673 INFO:tasks.rgw.client.0.smithi099.stdout:2024-03-09T15:06:55.674+0000 7f28a6a4b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 38357) UID: 0 2024-03-09T15:06:55.674 INFO:tasks.rgw.client.0.smithi099.stdout:2024-03-09T15:06:55.674+0000 7f28aa293a40 -1 shutting down 2024-03-09T15:06:58.649 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-03-09T15:07:01.774 INFO:tasks.rgw.client.0:Stopped 2024-03-09T15:07:01.774 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-03-09T15:07:01.781 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /etc/ceph/vault-root-token 2024-03-09T15:07:01.837 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-03-09T15:07:01.893 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-03-09T15:07:01.893 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-03-09T15:07:01.893 DEBUG:teuthology.orchestra.run.smithi099:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-03-09T15:07:01.971 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setuser ceph since I am not root 2024-03-09T15:07:01.971 INFO:teuthology.orchestra.run.smithi099.stderr:ignoring --setgroup ceph since I am not root 2024-03-09T15:07:02.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.014+0000 7f933ec68980 20 rados->read ofs=0 len=0 2024-03-09T15:07:02.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.014+0000 7f933ec68980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:07:02.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.014+0000 7f933ec68980 20 realm 2024-03-09T15:07:02.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.014+0000 7f933ec68980 20 rados->read ofs=0 len=0 2024-03-09T15:07:02.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.018+0000 7f933ec68980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:07:02.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.018+0000 7f933ec68980 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-09T15:07:02.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.018+0000 7f933ec68980 20 rados->read ofs=0 len=0 2024-03-09T15:07:02.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.018+0000 7f933ec68980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:07:02.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.018+0000 7f933ec68980 20 rados->read ofs=0 len=0 2024-03-09T15:07:02.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.018+0000 7f933ec68980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T15:07:02.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.018+0000 7f933ec68980 20 rados->read ofs=0 len=0 2024-03-09T15:07:02.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.018+0000 7f933ec68980 20 rados_obj.operate() r=0 bl.length=1103 2024-03-09T15:07:02.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.018+0000 7f933ec68980 20 searching for the correct realm 2024-03-09T15:07:02.023 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.022+0000 7f933cf81640 0 -- 172.21.15.99:0/3110485063 >> [v2:172.21.15.99:6824/3618878900,v1:172.21.15.99:6825/3618878900] conn(0x7f9324071020 msgr2=0x7f932407ae60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T15:07:02.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.238+0000 7f9333fff640 0 -- 172.21.15.99:0/3110485063 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f9334001720 msgr2=0x7f933403b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T15:07:02.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.454+0000 7f933ec68980 20 RGWRados::pool_iterate: got zonegroup_info.b0d8e376-3d7a-4261-8885-ca728fb25a0f 2024-03-09T15:07:02.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.454+0000 7f933ec68980 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-09T15:07:02.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.454+0000 7f933ec68980 20 RGWRados::pool_iterate: got zone_info.160105e3-abe0-4c80-8c65-b187bbe6d91d 2024-03-09T15:07:02.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.454+0000 7f933ec68980 20 RGWRados::pool_iterate: got default.zone. 2024-03-09T15:07:02.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.454+0000 7f933ec68980 20 RGWRados::pool_iterate: got zone_names.default 2024-03-09T15:07:02.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.454+0000 7f933ec68980 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-09T15:07:02.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.454+0000 7f933ec68980 20 rados->read ofs=0 len=0 2024-03-09T15:07:02.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.458+0000 7f933ec68980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:07:02.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.458+0000 7f933ec68980 20 rados->read ofs=0 len=0 2024-03-09T15:07:02.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.458+0000 7f933ec68980 20 rados_obj.operate() r=0 bl.length=46 2024-03-09T15:07:02.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.458+0000 7f933ec68980 20 rados->read ofs=0 len=0 2024-03-09T15:07:02.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.458+0000 7f933ec68980 20 rados_obj.operate() r=0 bl.length=432 2024-03-09T15:07:02.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.458+0000 7f933ec68980 20 zone default found 2024-03-09T15:07:02.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.458+0000 7f933ec68980 4 Realm: () 2024-03-09T15:07:02.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.458+0000 7f933ec68980 4 ZoneGroup: default (b0d8e376-3d7a-4261-8885-ca728fb25a0f) 2024-03-09T15:07:02.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.458+0000 7f933ec68980 4 Zone: default (160105e3-abe0-4c80-8c65-b187bbe6d91d) 2024-03-09T15:07:02.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.458+0000 7f933ec68980 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-09T15:07:02.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.458+0000 7f933ec68980 20 zonegroup default 2024-03-09T15:07:02.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.458+0000 7f933ec68980 20 rados->read ofs=0 len=0 2024-03-09T15:07:02.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.458+0000 7f933ec68980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:07:02.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.458+0000 7f933ec68980 20 rados->read ofs=0 len=0 2024-03-09T15:07:02.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.462+0000 7f933ec68980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:07:02.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.462+0000 7f933ec68980 20 rados->read ofs=0 len=0 2024-03-09T15:07:02.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.462+0000 7f933ec68980 20 rados_obj.operate() r=-2 bl.length=0 2024-03-09T15:07:02.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.462+0000 7f933ec68980 20 started sync module instance, tier type = 2024-03-09T15:07:02.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.462+0000 7f933ec68980 20 started zone id=160105e3-abe0-4c80-8c65-b187bbe6d91d (name=default) with tier type = 2024-03-09T15:07:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.486+0000 7f933ec68980 20 add_watcher() i=0 2024-03-09T15:07:02.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.486+0000 7f933ec68980 20 add_watcher() i=1 2024-03-09T15:07:02.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.486+0000 7f933ec68980 20 add_watcher() i=2 2024-03-09T15:07:02.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.486+0000 7f933ec68980 20 add_watcher() i=3 2024-03-09T15:07:02.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.486+0000 7f933ec68980 20 add_watcher() i=4 2024-03-09T15:07:02.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.486+0000 7f933ec68980 20 add_watcher() i=5 2024-03-09T15:07:02.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.486+0000 7f933ec68980 20 add_watcher() i=6 2024-03-09T15:07:02.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.486+0000 7f933ec68980 20 add_watcher() i=7 2024-03-09T15:07:02.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.486+0000 7f933ec68980 2 all 8 watchers are set, enabling cache 2024-03-09T15:07:02.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.490+0000 7f91f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T15:07:02.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.490+0000 7f933ec68980 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-09T15:07:02.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.490+0000 7f933ec68980 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-09T15:07:02.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.582+0000 7f91f1fdb640 20 reqs_thread_entry: start 2024-03-09T15:07:02.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.582+0000 7f933ec68980 20 init_complete bucket index max shards: 11 2024-03-09T15:07:02.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.582+0000 7f933ec68980 20 Filter name: none 2024-03-09T15:07:02.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.582+0000 7f91637fe640 20 reqs_thread_entry: start 2024-03-09T15:07:02.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.582+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-09T15:07:02.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.586+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:02.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:02.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46990' 2024-03-09T15:07:02.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14710852622093666738', time=2024-03-09T16:51:41.414230+0000, chain.objs.size()=1 2024-03-09T15:07:02.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.135__shadow_.pniko7UrmCI6rPF7YEWtUdimSsafHlE_0 2024-03-09T15:07:02.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='_-fIB0NS9SxWuCQzqRq09tIuidbx2eoX', time=2024-03-09T16:51:55.024149+0000, chain.objs.size()=2 2024-03-09T15:07:02.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__shadow_.EW9KsS9PV2vNhPKQ1-E6zPXEXCTiEoB_0 2024-03-09T15:07:02.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__shadow_.EW9KsS9PV2vNhPKQ1-E6zPXEXCTiEoB_1 2024-03-09T15:07:02.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13842622449533491306', time=2024-03-09T16:54:25.610291+0000, chain.objs.size()=1 2024-03-09T15:07:02.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.228__shadow_.o4fa4Iol9P7sebo48NXH9d7ML7_2f7z_0 2024-03-09T15:07:02.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15189316382334015473', time=2024-03-09T16:54:32.161281+0000, chain.objs.size()=1 2024-03-09T15:07:02.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.234__shadow_.5xESRaZvAbO4Urx7wWfGpo0vrl2VSNm_0 2024-03-09T15:07:02.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9150765308529581931', time=2024-03-09T16:54:50.946002+0000, chain.objs.size()=1 2024-03-09T15:07:02.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.253__shadow_.cL9sTbaDzWgEs6OKXvgmzcquCvb4jOk_0 2024-03-09T15:07:02.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10933574848837324037', time=2024-03-09T16:55:14.875866+0000, chain.objs.size()=1 2024-03-09T15:07:02.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.NLe1zppabHiJ1_IYVl1xjUrzr_uPICe_0 2024-03-09T15:07:02.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16570454034099798783', time=2024-03-09T16:55:14.909353+0000, chain.objs.size()=1 2024-03-09T15:07:02.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.RvuydCwpK8GsxVXkkNsbseJHQAds1nA_0 2024-03-09T15:07:02.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6749880787302956147', time=2024-03-09T16:55:14.945656+0000, chain.objs.size()=1 2024-03-09T15:07:02.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.eHf_gbVaaEyXjGg94cteQSdA71HnAjo_0 2024-03-09T15:07:02.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2725893967922480143', time=2024-03-09T16:55:14.970016+0000, chain.objs.size()=1 2024-03-09T15:07:02.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.QhINJbJ3UHRsL9QlUeJfQro3KFoQZu4_0 2024-03-09T15:07:02.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3179173423408832134', time=2024-03-09T16:55:15.004537+0000, chain.objs.size()=1 2024-03-09T15:07:02.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.8o451ao1gnWCbMRwq7w0u7EqGWp4UdS_0 2024-03-09T15:07:02.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.594+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7392206533053862522', time=2024-03-09T16:55:15.140854+0000, chain.objs.size()=1 2024-03-09T15:07:02.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.594+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.gCWzwoTb4f5Cgg6S92eE7vF8CSWvKhf_0 2024-03-09T15:07:02.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16925939550938729603', time=2024-03-09T16:55:15.178463+0000, chain.objs.size()=1 2024-03-09T15:07:02.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6aP5Hx9iJTb8Jcnm6Xf6OGdqMs6T8dO_0 2024-03-09T15:07:02.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11456025626781611355', time=2024-03-09T16:55:15.199129+0000, chain.objs.size()=1 2024-03-09T15:07:02.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.QefehefFnfNw5K8qxegkl6QbGRrQzt4_0 2024-03-09T15:07:02.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12701730651365556493', time=2024-03-09T16:55:15.231281+0000, chain.objs.size()=1 2024-03-09T15:07:02.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.9g6iie2tvqQR6EEyjU--FaBvVQF5g9g_0 2024-03-09T15:07:02.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7260971427437713864', time=2024-03-09T16:55:15.492539+0000, chain.objs.size()=1 2024-03-09T15:07:02.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.1cJvfNFdLfpBHtqwTlCwwqyUAPtvIiV_0 2024-03-09T15:07:02.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14594915845845533368', time=2024-03-09T16:55:15.510323+0000, chain.objs.size()=1 2024-03-09T15:07:02.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.hIVuxiMKuOxXP8dtKhm-EXgGLHd9qq7_0 2024-03-09T15:07:02.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1687245699275878668', time=2024-03-09T16:55:15.524581+0000, chain.objs.size()=1 2024-03-09T15:07:02.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.645yPYCgVX49afsmJVwurP015S6dKpq_0 2024-03-09T15:07:02.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.602+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16740785493575449447', time=2024-03-09T16:55:15.724330+0000, chain.objs.size()=1 2024-03-09T15:07:02.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.602+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.m0t9VaYUlMZ437q02OjFcHMW7NUm9Rq_0 2024-03-09T15:07:02.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10494490687028742549', time=2024-03-09T16:55:15.750211+0000, chain.objs.size()=1 2024-03-09T15:07:02.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.5li21kL4jW0Pb_2Wh8ke9JdhugATs7z_0 2024-03-09T15:07:02.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3030097382248155376', time=2024-03-09T16:55:15.775867+0000, chain.objs.size()=1 2024-03-09T15:07:02.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.WOwi5LqAg3fpZD4fQAjCE7r29Zz3MNZ_0 2024-03-09T15:07:02.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12850097237834028394', time=2024-03-09T16:55:15.820262+0000, chain.objs.size()=1 2024-03-09T15:07:02.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ddOsVdwK3naAajb1y9xus5Ey5PJEYlN_0 2024-03-09T15:07:02.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5818363578818946853', time=2024-03-09T16:55:15.973442+0000, chain.objs.size()=1 2024-03-09T15:07:02.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.om2HIVvz9Wv2KR49N5wFZRNkJa7ogbS_0 2024-03-09T15:07:02.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4355570001188399730', time=2024-03-09T16:55:16.241395+0000, chain.objs.size()=1 2024-03-09T15:07:02.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.BQi7YJPZ-XwP3LdY9DNrk3XYzJJHkzh_0 2024-03-09T15:07:02.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11968466434811261450', time=2024-03-09T16:55:16.472981+0000, chain.objs.size()=1 2024-03-09T15:07:02.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.0FzBIYQwFUSRKDMl9RCe3jJ683_Lx3O_0 2024-03-09T15:07:02.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.614+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7935806170340645886', time=2024-03-09T16:55:16.501244+0000, chain.objs.size()=1 2024-03-09T15:07:02.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.614+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.8Y4CF0jlXOakjQmp1_EzQHyO1KXE7ph_0 2024-03-09T15:07:02.620 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.618+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5867887902818793879', time=2024-03-09T16:55:16.543425+0000, chain.objs.size()=1 2024-03-09T15:07:02.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.618+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.j1M-bDEPnsKWCZ4fT2dRu9aWZUcami-_0 2024-03-09T15:07:02.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.618+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11307205410907432740', time=2024-03-09T16:55:16.555147+0000, chain.objs.size()=1 2024-03-09T15:07:02.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.618+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qcu-yl_g6zCvZjGO-VQ7egmVMaHNbZK_0 2024-03-09T15:07:02.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7533611425568377469', time=2024-03-09T16:55:16.603515+0000, chain.objs.size()=1 2024-03-09T15:07:02.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ELSPt_KcAgdAZvfibxGAZ6axMoJbRPj_0 2024-03-09T15:07:02.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15019885157195830086', time=2024-03-09T16:55:16.608858+0000, chain.objs.size()=1 2024-03-09T15:07:02.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.eX8MRjePXpjC4ykI5xQL3f_MJciVs7p_0 2024-03-09T15:07:02.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.144255102360931379', time=2024-03-09T16:55:16.773627+0000, chain.objs.size()=1 2024-03-09T15:07:02.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.4Hu3ZjS1Atmb-pF0NLHmuSKFMI-2ZGe_0 2024-03-09T15:07:02.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12768152428060826569', time=2024-03-09T16:55:16.791155+0000, chain.objs.size()=1 2024-03-09T15:07:02.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.TEpvg_02FgGUHqk4ccr-e-oL2xz-QrR_0 2024-03-09T15:07:02.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14207931095157629731', time=2024-03-09T16:55:16.839098+0000, chain.objs.size()=1 2024-03-09T15:07:02.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Cr1kMzjGLz5pB6AOc7X7IXQuIDpLREK_0 2024-03-09T15:07:02.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5045766995957847845', time=2024-03-09T16:55:33.406633+0000, chain.objs.size()=1 2024-03-09T15:07:02.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.274__shadow_.DkzLP6h7_ea-lkoV7PzIYNcE33KSpMN_0 2024-03-09T15:07:02.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8828771764225095672', time=2024-03-09T16:55:34.385974+0000, chain.objs.size()=1 2024-03-09T15:07:02.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.275__shadow_.eLu9A1NWuIiyt-cDMDN71JlwfegAu1M_0 2024-03-09T15:07:02.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.626+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11000808507406405258', time=2024-03-09T16:55:35.311931+0000, chain.objs.size()=1 2024-03-09T15:07:02.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.626+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.276__shadow_.1d28Udfkf6kRD_5ow1gnYIvnvX-fGiL_0 2024-03-09T15:07:02.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10355152085090214596', time=2024-03-09T16:55:38.302336+0000, chain.objs.size()=1 2024-03-09T15:07:02.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.279__shadow_.hK_YXg-r5g5o6aMu42OkTu7QKPfJn34_0 2024-03-09T15:07:02.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16508195015232901863', time=2024-03-09T16:55:46.210338+0000, chain.objs.size()=1 2024-03-09T15:07:02.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.fTgWUYE_ZvXdGIKhe_VI84zQALwPJ2x_0 2024-03-09T15:07:02.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11882797592962282975', time=2024-03-09T16:55:46.218163+0000, chain.objs.size()=1 2024-03-09T15:07:02.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.u0B-hGCiybSweHwk8z32nD4dnCXhblu_0 2024-03-09T15:07:02.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17869602826563105138', time=2024-03-09T16:55:46.241187+0000, chain.objs.size()=1 2024-03-09T15:07:02.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.PYu1pJGsRS5IoaTaArcCXMlCbDVF8FI_0 2024-03-09T15:07:02.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7828714731561411555', time=2024-03-09T16:55:47.878144+0000, chain.objs.size()=1 2024-03-09T15:07:02.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.Ng1pnsih0z2XT42bmOLH2T1MVXfK4yD_0 2024-03-09T15:07:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9064475555579576242', time=2024-03-09T16:55:54.529071+0000, chain.objs.size()=1 2024-03-09T15:07:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.294__shadow_.s8DCQUTYLCVn7Jje6bnxakdQDRZwd7Y_0 2024-03-09T15:07:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9657667341373030538', time=2024-03-09T16:56:13.693002+0000, chain.objs.size()=1 2024-03-09T15:07:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.313__shadow:QmyyRW7GZzdhtj1AzfIS5jG6lyqtMah_.5vslH5E646XHJwvgyFuPyH-tgApv0xz_0 2024-03-09T15:07:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14051464502055031466', time=2024-03-09T16:56:37.779595+0000, chain.objs.size()=1 2024-03-09T15:07:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.O8Nj7GjvogWK4dpc6kfucF5xnmCH_Vx_0 2024-03-09T15:07:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2946891525848877479', time=2024-03-09T16:56:37.781551+0000, chain.objs.size()=1 2024-03-09T15:07:02.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.4KYVerqi6kaFJYuTzd3Zyi8B-wZiHew_0 2024-03-09T15:07:02.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15796522715282079461', time=2024-03-09T16:56:37.845333+0000, chain.objs.size()=1 2024-03-09T15:07:02.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.uf3K4-uNvNsm3imixPiVLPY6cJwLhim_0 2024-03-09T15:07:02.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6111455359792529545', time=2024-03-09T16:56:37.864835+0000, chain.objs.size()=1 2024-03-09T15:07:02.641 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.uB63rR0oBjKQreTI-v8FlAruTCzkPyJ_0 2024-03-09T15:07:02.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.646+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2613855190614337306', time=2024-03-09T16:56:37.977496+0000, chain.objs.size()=1 2024-03-09T15:07:02.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.smEPy323cCq7ZiraLs3v2PKrakwXVQE_0 2024-03-09T15:07:02.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.646+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10659222652890366796', time=2024-03-09T16:56:38.019488+0000, chain.objs.size()=1 2024-03-09T15:07:02.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.LZGvN_Vut1NwR-GMC2X-s8u0TK2wqQz_0 2024-03-09T15:07:02.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18390985450667005750', time=2024-03-09T16:56:38.249586+0000, chain.objs.size()=1 2024-03-09T15:07:02.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ftr5icnBSprN1kbAKe9Rxr041pmDx2g_0 2024-03-09T15:07:02.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1711340901322552885', time=2024-03-09T16:56:38.299787+0000, chain.objs.size()=1 2024-03-09T15:07:02.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.GphXhabRP3etyv1mcAU7vSaf3MMFdG2_0 2024-03-09T15:07:02.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13070987394967770294', time=2024-03-09T16:56:38.353041+0000, chain.objs.size()=1 2024-03-09T15:07:02.653 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.bvuQhldjbZRt9xf1P1UigTLvM4xtxq0_0 2024-03-09T15:07:02.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6706631410234651240', time=2024-03-09T16:56:38.562514+0000, chain.objs.size()=1 2024-03-09T15:07:02.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Db-YpmqBrgDYnZ0aL2t5SNTnVOYNaSI_0 2024-03-09T15:07:02.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11707564263984815174', time=2024-03-09T16:56:38.603680+0000, chain.objs.size()=1 2024-03-09T15:07:02.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0cnVP1XXG14XPL6FNAgM01qu8BhoAHr_0 2024-03-09T15:07:02.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8589639241434646835', time=2024-03-09T16:56:38.772560+0000, chain.objs.size()=1 2024-03-09T15:07:02.654 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.eEXkwUBl5TNIImlX0mw5bUo8dlOD-Sc_0 2024-03-09T15:07:02.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12613706119632010679', time=2024-03-09T16:56:38.778023+0000, chain.objs.size()=1 2024-03-09T15:07:02.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.c7WqqxwUXagnegjdmmB0i5H6GlhtDKt_0 2024-03-09T15:07:02.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5295351998311328597', time=2024-03-09T16:56:38.779754+0000, chain.objs.size()=1 2024-03-09T15:07:02.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6XsMz_Szd7PwKpQihZ53PVXfYymfWwJ_0 2024-03-09T15:07:02.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3725240377653729777', time=2024-03-09T16:56:38.828344+0000, chain.objs.size()=1 2024-03-09T15:07:02.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Tkc-NNZ79EBLeUzFE_Ej5lpoZ6Zae1c_0 2024-03-09T15:07:02.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9840545945911185600', time=2024-03-09T16:56:38.837817+0000, chain.objs.size()=1 2024-03-09T15:07:02.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.YOCNEzqSbNOQJaMkSX9hf7q-5cDOrdD_0 2024-03-09T15:07:02.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4924226465454806112', time=2024-03-09T16:56:38.933441+0000, chain.objs.size()=1 2024-03-09T15:07:02.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.GzAtaiFWrXmPsmq7z_m48FbeGaxQMbP_0 2024-03-09T15:07:02.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5559842968815025207', time=2024-03-09T16:56:39.041747+0000, chain.objs.size()=1 2024-03-09T15:07:02.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.jRQ4BH3R_eUyaFQR0XFaypv4xPG5fGh_0 2024-03-09T15:07:02.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10175807757340325457', time=2024-03-09T16:56:39.089048+0000, chain.objs.size()=1 2024-03-09T15:07:02.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.GOnJnlX08bQEnBd2VDQWjZdQYnbfrcD_0 2024-03-09T15:07:02.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.658+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8585948274423328220', time=2024-03-09T16:56:39.095656+0000, chain.objs.size()=1 2024-03-09T15:07:02.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.658+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-82BV27Q6iTBRc3WVU-fa7Gm7o9F9Dn_0 2024-03-09T15:07:02.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.662+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5452116647296816444', time=2024-03-09T16:56:39.123328+0000, chain.objs.size()=1 2024-03-09T15:07:02.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.662+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.jUtAiMi-7y7oGglRFQpnw_2tOlfbJgA_0 2024-03-09T15:07:02.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16916575660830411948', time=2024-03-09T16:56:39.145505+0000, chain.objs.size()=1 2024-03-09T15:07:02.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-mSnvM4m4Qlb0siB2kwBgtrVTbnC4_o_0 2024-03-09T15:07:02.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10379651500409688350', time=2024-03-09T16:56:39.165924+0000, chain.objs.size()=1 2024-03-09T15:07:02.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.detMkPbZXilL5s3GjLYSSl6KipMDAJY_0 2024-03-09T15:07:02.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3950437497271263783', time=2024-03-09T16:56:39.301472+0000, chain.objs.size()=1 2024-03-09T15:07:02.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.dCxv-wcmyVPHteD6oa_Mn1yxbn42KPY_0 2024-03-09T15:07:02.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7820980240241904862', time=2024-03-09T16:56:39.304748+0000, chain.objs.size()=1 2024-03-09T15:07:02.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.QXrn52VeIt6AQXybBq5C4jzMHQ_lXec_0 2024-03-09T15:07:02.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11769316715412338477', time=2024-03-09T16:56:39.337068+0000, chain.objs.size()=1 2024-03-09T15:07:02.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.p3mO4rzGxT2tQ298gccLAlMSz8Se5C9_0 2024-03-09T15:07:02.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1843256234149741070', time=2024-03-09T16:56:39.364251+0000, chain.objs.size()=1 2024-03-09T15:07:02.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.CHNLA13BQSKqwzcIkQ2T9l0exoX5zrm_0 2024-03-09T15:07:02.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8495964882971473996', time=2024-03-09T16:56:39.386670+0000, chain.objs.size()=1 2024-03-09T15:07:02.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.jNPeSDrcBu8mIuH9EdMn2YRvNw7vnZe_0 2024-03-09T15:07:02.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7656643674311204234', time=2024-03-09T16:56:39.389152+0000, chain.objs.size()=1 2024-03-09T15:07:02.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.8rkZlPUj2bHw7jyazgO_wUdgRB0RtIF_0 2024-03-09T15:07:02.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8856993021169900822', time=2024-03-09T16:56:39.571707+0000, chain.objs.size()=1 2024-03-09T15:07:02.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.PLoPz9WpsV4UVhd8f3SaT-AbEDBvub4_0 2024-03-09T15:07:02.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11544485708114566882', time=2024-03-09T16:56:39.627076+0000, chain.objs.size()=1 2024-03-09T15:07:02.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.1dMPXdSgJ1XoBVvTyZ4K1UDNaGbFk7M_0 2024-03-09T15:07:02.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9226778691986238489', time=2024-03-09T16:57:01.433634+0000, chain.objs.size()=1 2024-03-09T15:07:02.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.XTps0Cd1fJntg1i96lbYWKRc0zGl0DC_0 2024-03-09T15:07:02.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.670+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18276492142618445796', time=2024-03-09T16:57:01.508405+0000, chain.objs.size()=1 2024-03-09T15:07:02.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.670+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.jGPTLzynhK-LKC_BcuDtl4yh-L_LsLt_0 2024-03-09T15:07:02.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.670+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3957277885367115320', time=2024-03-09T16:57:01.544028+0000, chain.objs.size()=1 2024-03-09T15:07:02.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.670+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.j2p4nsUeKIqKwslUm-mIG5HhSDiiEH7_0 2024-03-09T15:07:02.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.670+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4295363951952179845', time=2024-03-09T16:57:01.588600+0000, chain.objs.size()=1 2024-03-09T15:07:02.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.670+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.IM6HUf04f0Lbdwwq6sIfbBEvVN4CpEu_0 2024-03-09T15:07:02.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5243318517602041493', time=2024-03-09T16:57:01.799547+0000, chain.objs.size()=1 2024-03-09T15:07:02.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Bh6RYhmA5dfUN1vTmNed8i5iV3g_SbP_0 2024-03-09T15:07:02.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10558636437516266580', time=2024-03-09T16:57:01.819137+0000, chain.objs.size()=1 2024-03-09T15:07:02.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.mt66QPWQytXxzDhy3OA8AcfsQ_pocKx_0 2024-03-09T15:07:02.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8351440823358791185', time=2024-03-09T16:57:01.837751+0000, chain.objs.size()=1 2024-03-09T15:07:02.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.n22mgfi0S-JUzL3owB443vQ0oPOOzCE_0 2024-03-09T15:07:02.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16405785638546584242', time=2024-03-09T16:57:01.967688+0000, chain.objs.size()=1 2024-03-09T15:07:02.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DNIHGdMmS_33jCa60Vc8i_W7DKnvW2K_0 2024-03-09T15:07:02.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16809662243396229958', time=2024-03-09T16:57:01.970625+0000, chain.objs.size()=1 2024-03-09T15:07:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.BqbGG0-44MklJetGhnoiY875OC-7xmK_0 2024-03-09T15:07:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14313058823015032325', time=2024-03-09T16:57:02.000088+0000, chain.objs.size()=1 2024-03-09T15:07:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.KcTPIblRFy7ZZm_lqiW-4RBM-QV5w1w_0 2024-03-09T15:07:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14295228826837828613', time=2024-03-09T16:57:02.079191+0000, chain.objs.size()=1 2024-03-09T15:07:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.87hgDccBZI7VrIfcSSgln6TG_kfeux5_0 2024-03-09T15:07:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8032804664082739980', time=2024-03-09T16:57:02.297004+0000, chain.objs.size()=1 2024-03-09T15:07:02.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.vXS0ovfCTp6VLQP_KGbzTsZ-RPn5QhF_0 2024-03-09T15:07:02.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5980601409736799757', time=2024-03-09T16:57:02.303745+0000, chain.objs.size()=1 2024-03-09T15:07:02.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Qv1RT1k__efmFRONIWgtJlI6EGZvMpO_0 2024-03-09T15:07:02.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4610631464707437270', time=2024-03-09T16:57:02.308063+0000, chain.objs.size()=1 2024-03-09T15:07:02.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.pI4jEnjdm6uLru5rOqCLIzzdVR2X3gW_0 2024-03-09T15:07:02.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7136853870620881829', time=2024-03-09T16:57:02.339181+0000, chain.objs.size()=1 2024-03-09T15:07:02.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ck_gDe-lkHGG38Q3eC6mArGXizp_PXn_0 2024-03-09T15:07:02.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.682+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15974115365567363818', time=2024-03-09T16:57:02.351262+0000, chain.objs.size()=1 2024-03-09T15:07:02.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.682+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.-yhIrY76RDrqWFmDCN_WzfjwqbeRaGg_0 2024-03-09T15:07:02.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.682+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2845428894064836209', time=2024-03-09T16:57:02.368927+0000, chain.objs.size()=1 2024-03-09T15:07:02.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.682+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.6LVVvmjba8y_898B47aaBHzFuzjLfM8_0 2024-03-09T15:07:02.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.682+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17653751854405146101', time=2024-03-09T16:57:02.509362+0000, chain.objs.size()=1 2024-03-09T15:07:02.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.682+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ecAP-LoIcqftUOsDTh5YqTFekfmxsrL_0 2024-03-09T15:07:02.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5506549274709837795', time=2024-03-09T16:57:02.555020+0000, chain.objs.size()=1 2024-03-09T15:07:02.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DAYDTnfXKLSjYEwi5wZaHusztEzriSJ_0 2024-03-09T15:07:02.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6930324439862324093', time=2024-03-09T16:57:02.566595+0000, chain.objs.size()=1 2024-03-09T15:07:02.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.9I24GyX6o3RQU4bA44GWqAY_e8Hpc_F_0 2024-03-09T15:07:02.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12859472247699691683', time=2024-03-09T16:57:02.610390+0000, chain.objs.size()=1 2024-03-09T15:07:02.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oz1zcC878Eo90Uo1L_YaG3GSGeEyQD9_0 2024-03-09T15:07:02.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12671867548719314793', time=2024-03-09T16:57:02.619927+0000, chain.objs.size()=1 2024-03-09T15:07:02.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.690+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.6D5czEB1-AVZBFeb_49LIf9UIa-0SuZ_0 2024-03-09T15:07:02.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.690+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15807336243358772001', time=2024-03-09T16:57:02.730596+0000, chain.objs.size()=1 2024-03-09T15:07:02.689 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.690+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xR2wcHzlZEOUCO5GwR2qoivwe7R4xms_0 2024-03-09T15:07:02.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.690+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9532776862635622490', time=2024-03-09T16:57:02.734314+0000, chain.objs.size()=1 2024-03-09T15:07:02.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.690+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ZhD55zubY7r4OXhBylReay74QznAK5f_0 2024-03-09T15:07:02.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.690+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17557579452547377459', time=2024-03-09T16:57:02.798099+0000, chain.objs.size()=1 2024-03-09T15:07:02.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.690+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.VRTnXSElpnQUD8QSUM7IsclukHw79Vn_0 2024-03-09T15:07:02.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.690+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9011581180593655980', time=2024-03-09T16:57:02.820625+0000, chain.objs.size()=1 2024-03-09T15:07:02.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.690+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.4MjZUb8dvcbjxBkH_-lRWd8f2ceSNIU_0 2024-03-09T15:07:02.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.694+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13147083669794395392', time=2024-03-09T16:57:02.845729+0000, chain.objs.size()=1 2024-03-09T15:07:02.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.694+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.0vzxMY3gmPjIc9WkjKrkkMbL0rQb-GD_0 2024-03-09T15:07:02.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.698+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/46990 2024-03-09T15:07:02.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-03-09T15:07:02.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1341977356080310035', time=2024-03-09T16:57:02.849557+0000, chain.objs.size()=1 2024-03-09T15:07:02.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.b-ioqpYwOHNZeGDtya7vd9SYotXdeJ1_0 2024-03-09T15:07:02.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7604138288967338580', time=2024-03-09T16:57:02.875644+0000, chain.objs.size()=1 2024-03-09T15:07:02.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.mTz0datdoEH4zOlnbsqjB4fLXWH02nb_0 2024-03-09T15:07:02.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6983013713522479684', time=2024-03-09T16:57:02.971341+0000, chain.objs.size()=1 2024-03-09T15:07:02.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.JnIE2MgH-zpeB0cN-6KhH5ln-LLdBMc_0 2024-03-09T15:07:02.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16425757051308139053', time=2024-03-09T16:57:03.003641+0000, chain.objs.size()=1 2024-03-09T15:07:02.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.4Lwk14iWe4-Uzob5uMQIUiDfEe38Vkj_0 2024-03-09T15:07:02.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1289671643181097480', time=2024-03-09T16:57:03.034101+0000, chain.objs.size()=1 2024-03-09T15:07:02.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.fias_fr29iuGNO9m2ZsxgWNIVwCfHbn_0 2024-03-09T15:07:02.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9147443584893686201', time=2024-03-09T16:57:03.042219+0000, chain.objs.size()=1 2024-03-09T15:07:02.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.YcpqlVN7aptubWSwEgIdw9SXmf1IBnE_0 2024-03-09T15:07:02.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3192570257090622742', time=2024-03-09T16:57:03.055301+0000, chain.objs.size()=1 2024-03-09T15:07:02.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.dZmtKpjGX3A3R5Sm49QsqCCX9csh6o4_0 2024-03-09T15:07:02.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10077643248162201447', time=2024-03-09T16:57:03.061925+0000, chain.objs.size()=1 2024-03-09T15:07:02.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DhqxUpEyrLi30W7-HudwYsNfuJlWYn9_0 2024-03-09T15:07:02.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4089342825960862203', time=2024-03-09T16:57:03.085091+0000, chain.objs.size()=1 2024-03-09T15:07:02.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.dulGlRf3gJeUc0EMx6xYm7pEFhtur8m_0 2024-03-09T15:07:02.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7294192797735059995', time=2024-03-09T16:57:03.093722+0000, chain.objs.size()=1 2024-03-09T15:07:02.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.HclPbGvVyFtMJmv1b_gVS38bO_-rkbd_0 2024-03-09T15:07:02.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15693818615633592120', time=2024-03-09T16:57:03.117989+0000, chain.objs.size()=1 2024-03-09T15:07:02.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.mVGPSSiHoaQ6rslzFzyJrQsLs0Kv_ye_0 2024-03-09T15:07:02.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17624196821436423128', time=2024-03-09T16:57:03.308643+0000, chain.objs.size()=1 2024-03-09T15:07:02.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.o1-zlIkJgmwrdE7brxw7zQPSKflfDAo_0 2024-03-09T15:07:02.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.710+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12779714372930442745', time=2024-03-09T16:57:03.354508+0000, chain.objs.size()=1 2024-03-09T15:07:02.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.710+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Wvbxu5UxVCkZCqtKnGVKIKfdNZAnPkF_0 2024-03-09T15:07:02.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4262209830631519409', time=2024-03-09T16:57:56.011788+0000, chain.objs.size()=1 2024-03-09T15:07:02.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.377__shadow_.9eYjHUnhiEATc6FpHEpaF-6vVN4A8Pi_0 2024-03-09T15:07:02.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14413557293668123414', time=2024-03-09T16:58:07.847377+0000, chain.objs.size()=1 2024-03-09T15:07:02.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.388__shadow:NYpYvlO2jLjvGINAgRTommFbPkBTaXa_.pe4XOvAqFUaDLvUnmD6OakEmffMmkXP_0 2024-03-09T15:07:02.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5483099312796789217', time=2024-03-09T16:59:07.068445+0000, chain.objs.size()=1 2024-03-09T15:07:02.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.449__shadow_.vbJMezvqJvVsjdzYzVHRoGUv4biXR61_0 2024-03-09T15:07:02.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7685864266296862446', time=2024-03-09T16:59:09.620017+0000, chain.objs.size()=1 2024-03-09T15:07:02.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.451__shadow_.7LRYxDRwmPEWqN-wttFYusN7ZzT9zSN_0 2024-03-09T15:07:02.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12892315421692243178', time=2024-03-09T16:59:14.629179+0000, chain.objs.size()=1 2024-03-09T15:07:02.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.455__shadow_.8CTT-DkJZgCHWKWTTfmqh3dBCxWJFfR_0 2024-03-09T15:07:02.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6947846048531942034', time=2024-03-09T16:59:17.126184+0000, chain.objs.size()=1 2024-03-09T15:07:02.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.457__shadow_.OwS1Is5_HfBfSmdjvR_makF9RTNQFMb_0 2024-03-09T15:07:02.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16456275367080126930', time=2024-03-09T16:59:19.206531+0000, chain.objs.size()=1 2024-03-09T15:07:02.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.459__shadow_.9xXIRySopxgTOo_INPlo85SyZQAIzcr_0 2024-03-09T15:07:02.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9350566633253506848', time=2024-03-09T16:59:36.590955+0000, chain.objs.size()=1 2024-03-09T15:07:02.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.482__shadow_.R5Ib_LKvYLgaW9sTiW1RmCZG6OKCZMB_0 2024-03-09T15:07:02.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~64kNynbrnjpvi-TzlJ5QhR05dWLpIfu', time=2024-03-09T17:00:12.777602+0000, chain.objs.size()=1 2024-03-09T15:07:02.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~64kNynbrnjpvi-TzlJ5QhR05dWLpIfu.1 2024-03-09T15:07:02.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~70t2_SpA9jow2HOOrdUhyu0QBf12FFh', time=2024-03-09T17:00:22.253275+0000, chain.objs.size()=1 2024-03-09T15:07:02.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~70t2_SpA9jow2HOOrdUhyu0QBf12FFh.2 2024-03-09T15:07:02.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.718+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~70t2_SpA9jow2HOOrdUhyu0QBf12FFh', time=2024-03-09T17:00:22.257076+0000, chain.objs.size()=1 2024-03-09T15:07:02.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.718+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~70t2_SpA9jow2HOOrdUhyu0QBf12FFh.3 2024-03-09T15:07:02.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.722+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15268306622328786878', time=2024-03-09T17:01:27.998392+0000, chain.objs.size()=1 2024-03-09T15:07:02.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.722+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.545__shadow_.qHfBVZj-lCelDeaFm1TtW9T3AblN3al_0 2024-03-09T15:07:02.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.722+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4696149431764589778', time=2024-03-09T17:01:53.894018+0000, chain.objs.size()=1 2024-03-09T15:07:02.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.722+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:zQaPeQTzISAtqi94AkSkkjA-87cNY-._.0LTHN8cL8LGaQCbwdzvMMujP6z-SAPc_0 2024-03-09T15:07:02.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.722+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15255284175285987284', time=2024-03-09T17:02:00.541436+0000, chain.objs.size()=1 2024-03-09T15:07:02.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.722+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.563__shadow:kCzPYmkbP9ma7TFjG8ytrfR8EG7NHDs_.0LOdtrM3qb4kjP5o8dQz-tJVYrmYiWv_0 2024-03-09T15:07:02.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.722+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7859147770090410802', time=2024-03-09T17:02:00.705821+0000, chain.objs.size()=1 2024-03-09T15:07:02.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.722+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.563__shadow:yzQho6JtJlfMj0yqEynm7J4NfoAX9V7_.bWauOiTDsKKC1yhdDp-uaNu1C4a_Ia8_0 2024-03-09T15:07:02.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.722+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16247136899366043280', time=2024-03-09T17:02:18.754107+0000, chain.objs.size()=1 2024-03-09T15:07:02.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.722+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:bIC6lStPIyIk3v79j.72fODfisX9ovF_.bt0Huz3xK2IxRb7bReptl_3V-9odkOO_0 2024-03-09T15:07:02.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.722+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1494744664902352022', time=2024-03-09T17:02:46.459213+0000, chain.objs.size()=1 2024-03-09T15:07:02.723 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.722+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.580__shadow:jNOlG8twUiVSy.BfPuDzdv-rsBn47vi_.vvqFiwdghsSC_tlBkEYqnvE_xYb-Ene_0 2024-03-09T15:07:02.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.726+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17494141400096687731', time=2024-03-09T17:03:29.767293+0000, chain.objs.size()=6 2024-03-09T15:07:02.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.614__multipart_multipart_enc.2~gCwMd68CUDiUwdzP5sVWER_GLdQ5Wai.1 2024-03-09T15:07:02.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.614__multipart_multipart_enc.2~gCwMd68CUDiUwdzP5sVWER_GLdQ5Wai.2 2024-03-09T15:07:02.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.614__multipart_multipart_enc.2~gCwMd68CUDiUwdzP5sVWER_GLdQ5Wai.3 2024-03-09T15:07:02.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.614__multipart_multipart_enc.2~gCwMd68CUDiUwdzP5sVWER_GLdQ5Wai.4 2024-03-09T15:07:02.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.614__multipart_multipart_enc.2~gCwMd68CUDiUwdzP5sVWER_GLdQ5Wai.5 2024-03-09T15:07:02.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.614__multipart_multipart_enc.2~gCwMd68CUDiUwdzP5sVWER_GLdQ5Wai.6 2024-03-09T15:07:02.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13070436391449006395', time=2024-03-09T17:03:39.779033+0000, chain.objs.size()=1 2024-03-09T15:07:02.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.623__shadow_.jl-IRkHYJFwh5c4Fp3iYxgX1MzuIa-J_0 2024-03-09T15:07:02.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6397652981406418033', time=2024-03-09T17:04:07.177350+0000, chain.objs.size()=6 2024-03-09T15:07:02.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.649__multipart_bar.2~nzX6b1lUPL_x9uBfoCyO6dHfvmTx-m4.1 2024-03-09T15:07:02.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.649__multipart_bar.2~nzX6b1lUPL_x9uBfoCyO6dHfvmTx-m4.2 2024-03-09T15:07:02.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.649__multipart_bar.2~nzX6b1lUPL_x9uBfoCyO6dHfvmTx-m4.3 2024-03-09T15:07:02.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.649__multipart_bar.2~nzX6b1lUPL_x9uBfoCyO6dHfvmTx-m4.4 2024-03-09T15:07:02.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.649__multipart_bar.2~nzX6b1lUPL_x9uBfoCyO6dHfvmTx-m4.5 2024-03-09T15:07:02.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.649__multipart_bar.2~nzX6b1lUPL_x9uBfoCyO6dHfvmTx-m4.6 2024-03-09T15:07:02.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.734+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7249883328543068944', time=2024-03-09T17:05:13.999129+0000, chain.objs.size()=1 2024-03-09T15:07:02.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.705__shadow_.hFPOrblmHCCFX0y8B0_jaJKD15vFCFd_0 2024-03-09T15:07:02.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.734+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1087201976129153408', time=2024-03-09T17:05:41.101990+0000, chain.objs.size()=1 2024-03-09T15:07:02.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.726__shadow_.duPRuOi89nnIKRBossd77_jgHiG4Uh9_0 2024-03-09T15:07:02.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.734+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17569865944742382176', time=2024-03-09T17:06:36.069716+0000, chain.objs.size()=1 2024-03-09T15:07:02.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.755__shadow_.axdfLcL0LW5qFFQkXEVcLWaTYOBn9nr_0 2024-03-09T15:07:02.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.738+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5397200026969183412', time=2024-03-09T17:06:39.834128+0000, chain.objs.size()=1 2024-03-09T15:07:02.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.738+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.757__shadow_.L4VPwBEzFPxcFhv9-6dCnQhJBNzRNbI_0 2024-03-09T15:07:02.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:02.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-09T15:07:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:02.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:02.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/41654' 2024-03-09T15:07:02.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11198229083062976778', time=2024-03-09T16:54:25.611708+0000, chain.objs.size()=1 2024-03-09T15:07:02.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.228__shadow_.zhfY516VyKzUQAMRMW0PRfNgQe6RRX__0 2024-03-09T15:07:02.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14305725205605103948', time=2024-03-09T16:54:33.116456+0000, chain.objs.size()=1 2024-03-09T15:07:02.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.235__shadow_.hdI9wyZcszew90K5LNerAcUoeKnlSE3_0 2024-03-09T15:07:02.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1362778266661891950', time=2024-03-09T16:54:39.680963+0000, chain.objs.size()=1 2024-03-09T15:07:02.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.241__shadow_.Rs82VGF4p24vBJ0VEtW7qiI8WnCK5IJ_0 2024-03-09T15:07:02.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8801892602720980073', time=2024-03-09T16:54:47.260423+0000, chain.objs.size()=1 2024-03-09T15:07:02.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.249__shadow_.AMpBKYK9qup7ia4bkxDwomsvZzWnD41_0 2024-03-09T15:07:02.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5853904988345840070', time=2024-03-09T16:55:14.927175+0000, chain.objs.size()=1 2024-03-09T15:07:02.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_._a15gqPDOrxVKbljeL3Bj2IGKLJGIvk_0 2024-03-09T15:07:02.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4966127409808567859', time=2024-03-09T16:55:14.959859+0000, chain.objs.size()=1 2024-03-09T15:07:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.hED0Y4IKLm4SV9IeTdJRNgL1Jd_yzgJ_0 2024-03-09T15:07:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7957091919952034770', time=2024-03-09T16:55:15.021648+0000, chain.objs.size()=1 2024-03-09T15:07:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.VxaYaypbhXrcTM8cwOTjWOj1Bl_d1vK_0 2024-03-09T15:07:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10815985448582980510', time=2024-03-09T16:55:15.170208+0000, chain.objs.size()=1 2024-03-09T15:07:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.tMwkDztRtARxLU8__jl0SC8LPzThajv_0 2024-03-09T15:07:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7530094519911292669', time=2024-03-09T16:55:15.287085+0000, chain.objs.size()=1 2024-03-09T15:07:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.QJEAEYTegNdm_NJM3Ft-fEpUCMGym7n_0 2024-03-09T15:07:02.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.108977528297225995', time=2024-03-09T16:55:15.466066+0000, chain.objs.size()=1 2024-03-09T15:07:02.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.HU3h6csBefYsEZnEZHL2XjOKfYnE0jG_0 2024-03-09T15:07:02.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7607077877782608872', time=2024-03-09T16:55:15.468040+0000, chain.objs.size()=1 2024-03-09T15:07:02.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.rAfF9UYKkTcXJOChiQnNNQ4rGDaXQl5_0 2024-03-09T15:07:02.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11737800763272339055', time=2024-03-09T16:55:15.470973+0000, chain.objs.size()=1 2024-03-09T15:07:02.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.UfRfdehrWEDeTlMASCpgFFPUpAYAxCh_0 2024-03-09T15:07:02.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14311880867476466923', time=2024-03-09T16:55:15.498086+0000, chain.objs.size()=1 2024-03-09T15:07:02.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.affRPahRa56NFjdRk-tiSglzRSfGgS-_0 2024-03-09T15:07:02.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5342325669450465420', time=2024-03-09T16:55:15.527397+0000, chain.objs.size()=1 2024-03-09T15:07:02.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.RjsfpOOyW7uqJIPXtH-QAvZjAEAIQOr_0 2024-03-09T15:07:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3811073380879853737', time=2024-03-09T16:55:15.939318+0000, chain.objs.size()=1 2024-03-09T15:07:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.p9YoROhvBIF6qoY583CG5Sg_smw0E_5_0 2024-03-09T15:07:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5016675423651905420', time=2024-03-09T16:55:15.940528+0000, chain.objs.size()=1 2024-03-09T15:07:02.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.cmEoFf5bavZPNL85bWKn72MiNEMOFCz_0 2024-03-09T15:07:02.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13629346470006359967', time=2024-03-09T16:55:16.020594+0000, chain.objs.size()=1 2024-03-09T15:07:02.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.-ZeEbglr35bU9Hnkm7AZJhq8Y8y1X3R_0 2024-03-09T15:07:02.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4058892089880629783', time=2024-03-09T16:55:16.034927+0000, chain.objs.size()=1 2024-03-09T15:07:02.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Ot4eTuoynFiWkVb9j8zmDA4e8YyhVc0_0 2024-03-09T15:07:02.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3571078447677418312', time=2024-03-09T16:55:16.239918+0000, chain.objs.size()=1 2024-03-09T15:07:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.FBbdcWz02l7JhFsUZbcH9nCD6nslmot_0 2024-03-09T15:07:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14464951323904972555', time=2024-03-09T16:55:16.300596+0000, chain.objs.size()=1 2024-03-09T15:07:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.YIEfu9A5nAP2jVWkR03ZNfp1HGZQ39P_0 2024-03-09T15:07:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15768079522755441767', time=2024-03-09T16:55:16.315169+0000, chain.objs.size()=1 2024-03-09T15:07:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.DLhGj6LJPbQc0OytjQo1q9X4EQozJem_0 2024-03-09T15:07:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10261491702559989881', time=2024-03-09T16:55:16.353757+0000, chain.objs.size()=1 2024-03-09T15:07:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.4k1a0GYkgJOQ__c24JmYIdfcDGZLUZ__0 2024-03-09T15:07:02.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16851492814160163701', time=2024-03-09T16:55:16.474935+0000, chain.objs.size()=1 2024-03-09T15:07:02.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.PFwx-GW1mptJyY1BzaJak3dGVLt2_9h_0 2024-03-09T15:07:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3691995992594028845', time=2024-03-09T16:55:16.494304+0000, chain.objs.size()=1 2024-03-09T15:07:02.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Q354iiecDki45Iurvvi6Vpe0d1DTgvZ_0 2024-03-09T15:07:02.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18264495290252055354', time=2024-03-09T16:55:16.498636+0000, chain.objs.size()=1 2024-03-09T15:07:02.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6XWi37whbrSgN_C6ve6XUOdnVreGM7C_0 2024-03-09T15:07:02.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9441344494645516099', time=2024-03-09T16:55:16.598888+0000, chain.objs.size()=1 2024-03-09T15:07:02.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.tX_CFFkJlU71osomf9EbBljxilhLPWn_0 2024-03-09T15:07:02.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14577866929943143422', time=2024-03-09T16:55:16.775101+0000, chain.objs.size()=1 2024-03-09T15:07:02.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.oaT8WeqqdpYmZpCGDISGXbJeVGopkm-_0 2024-03-09T15:07:02.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10851801501942807897', time=2024-03-09T16:55:16.817749+0000, chain.objs.size()=1 2024-03-09T15:07:02.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.vRjmjyCHKHyOHB1AJqc0DmkGjbpyQaR_0 2024-03-09T15:07:02.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2961649928505465442', time=2024-03-09T16:55:16.843759+0000, chain.objs.size()=1 2024-03-09T15:07:02.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ll3qswWIlWM4n0lgg5MlTOcjNktcE2R_0 2024-03-09T15:07:02.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3024667895507524316', time=2024-03-09T16:55:19.467964+0000, chain.objs.size()=1 2024-03-09T15:07:02.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.259__shadow_.Q_KlaI7FKfaCLpNSvGqiWz-kNbInBP5_0 2024-03-09T15:07:02.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12787440403098181424', time=2024-03-09T16:55:20.465049+0000, chain.objs.size()=1 2024-03-09T15:07:02.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.260__shadow_.upfCyuSJtlZzaoLjr0Z8Kk-tLWxLFzH_0 2024-03-09T15:07:02.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10181462495403488493', time=2024-03-09T16:55:41.221450+0000, chain.objs.size()=1 2024-03-09T15:07:02.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.282__shadow_.cOb5a3BKasNhj8QWbnIiJ8Y_rAhf5zo_0 2024-03-09T15:07:02.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18010744869317173791', time=2024-03-09T16:55:47.840448+0000, chain.objs.size()=1 2024-03-09T15:07:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.M4OCd93SLiYpygPblsnNOuJ4TK0Etr__0 2024-03-09T15:07:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15822908896582170768', time=2024-03-09T16:55:54.533620+0000, chain.objs.size()=1 2024-03-09T15:07:02.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.766+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.294__shadow_.TWSGb16fdAOSYO8SnKLGRZejdzgBmev_0 2024-03-09T15:07:02.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.770+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.394528554704669389', time=2024-03-09T16:56:15.819369+0000, chain.objs.size()=1 2024-03-09T15:07:02.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.770+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.316__shadow_.t2Yr2TqGzYXaA_3EQeW9-03DvkN7l77_0 2024-03-09T15:07:02.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.770+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1498741105263124881', time=2024-03-09T16:56:37.732953+0000, chain.objs.size()=1 2024-03-09T15:07:02.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.770+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.hlf3EiTrsmi-GzHXOGkcWo-zTDjyV3J_0 2024-03-09T15:07:02.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6096044443418264826', time=2024-03-09T16:56:37.768741+0000, chain.objs.size()=1 2024-03-09T15:07:02.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6ukxzqf_vxCvQgF64xm4kNeHsggFrok_0 2024-03-09T15:07:02.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2646405067584986261', time=2024-03-09T16:56:37.835153+0000, chain.objs.size()=1 2024-03-09T15:07:02.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.UgxkCIVJeABlrw_noPN4CzFNpZxmJvh_0 2024-03-09T15:07:02.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16449039579053351774', time=2024-03-09T16:56:37.865385+0000, chain.objs.size()=1 2024-03-09T15:07:02.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.a3Wz_nHSyRGZzP3yzb-fMtwGeEXYMv3_0 2024-03-09T15:07:02.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8578666781144411865', time=2024-03-09T16:56:38.022892+0000, chain.objs.size()=1 2024-03-09T15:07:02.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.vUwJCYEG8NcoUz6tbIdZfi8kTjxkiBE_0 2024-03-09T15:07:02.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3605091408116795191', time=2024-03-09T16:56:38.033315+0000, chain.objs.size()=1 2024-03-09T15:07:02.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.wKLtXwpKtKO_n3vlXOMolqZW4Mu-lbk_0 2024-03-09T15:07:02.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9925672479470734373', time=2024-03-09T16:56:38.035940+0000, chain.objs.size()=1 2024-03-09T15:07:02.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.7tnbRAdNlKYxcXGipu44IWsGSBKAczs_0 2024-03-09T15:07:02.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6803875103430985227', time=2024-03-09T16:56:38.065448+0000, chain.objs.size()=1 2024-03-09T15:07:02.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.5NdYDdGCIx2MnMgOBpz3Bg9hQqdUxVa_0 2024-03-09T15:07:02.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4204470776228329047', time=2024-03-09T16:56:38.066878+0000, chain.objs.size()=1 2024-03-09T15:07:02.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.1k_eodOc9Vy_R5ZSqI6xpMqvxW3y4TC_0 2024-03-09T15:07:02.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2147818828663716430', time=2024-03-09T16:56:38.129093+0000, chain.objs.size()=1 2024-03-09T15:07:02.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.1SZAij_0Hc5jm41bQegw0zzw-fWqDWo_0 2024-03-09T15:07:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.778+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13247660434019018761', time=2024-03-09T16:56:38.381947+0000, chain.objs.size()=1 2024-03-09T15:07:02.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.778+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ZwP5P2bX82uEg-QVUmoHiIv8v_0UAeP_0 2024-03-09T15:07:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.778+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13873668105516751475', time=2024-03-09T16:56:38.392965+0000, chain.objs.size()=1 2024-03-09T15:07:02.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.778+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.3X0mLFkYyFq2WH0RiWG3BYBJfPqCMhf_0 2024-03-09T15:07:02.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.778+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6996427720765392933', time=2024-03-09T16:56:38.540869+0000, chain.objs.size()=1 2024-03-09T15:07:02.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.778+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.icL6JmKBXF2LJ3Spvdqa1U6SB7wLmL6_0 2024-03-09T15:07:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.778+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5977710914929402304', time=2024-03-09T16:56:38.571933+0000, chain.objs.size()=1 2024-03-09T15:07:02.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.778+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.m4QvwSulTSdtG8z74Vn11eJxXlV9HgY_0 2024-03-09T15:07:02.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.782+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5946060913663626169', time=2024-03-09T16:56:38.604117+0000, chain.objs.size()=1 2024-03-09T15:07:02.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6k4AfiSJZ44EPQ-OQ3www_mJa92FRKD_0 2024-03-09T15:07:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.782+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14451697414968347715', time=2024-03-09T16:56:38.619476+0000, chain.objs.size()=1 2024-03-09T15:07:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ySHNly7rdmxUvJX_6ipiLuk-UxViRk__0 2024-03-09T15:07:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.782+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17335909928844183287', time=2024-03-09T16:56:38.620193+0000, chain.objs.size()=1 2024-03-09T15:07:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.j1wJwUl7nuyCRuKZCLVAtCJxZLJFaxo_0 2024-03-09T15:07:02.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.782+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1343599442630078532', time=2024-03-09T16:56:38.642055+0000, chain.objs.size()=1 2024-03-09T15:07:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_._qppsv0fM9dim-ZGlL971_aS3MSo36I_0 2024-03-09T15:07:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.782+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7451173472381133730', time=2024-03-09T16:56:38.775659+0000, chain.objs.size()=1 2024-03-09T15:07:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.LN7wnh8uShgDTUpKpzIka1hYjKc8Ngl_0 2024-03-09T15:07:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.782+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13051860229059353791', time=2024-03-09T16:56:38.833781+0000, chain.objs.size()=1 2024-03-09T15:07:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lPkiUUTKrrca5T81IIPoATKBOzgFGps_0 2024-03-09T15:07:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.782+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5130015201832086006', time=2024-03-09T16:56:38.884212+0000, chain.objs.size()=1 2024-03-09T15:07:02.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.AfGqv3d0gEQcVDghZBMv3T2P65aaTjA_0 2024-03-09T15:07:02.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.786+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15052639834842197098', time=2024-03-09T16:56:38.888673+0000, chain.objs.size()=1 2024-03-09T15:07:02.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.weHdLF769uorW1PGDqtzbbtE_I_I7ir_0 2024-03-09T15:07:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.786+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8886722693170496273', time=2024-03-09T16:56:38.897324+0000, chain.objs.size()=1 2024-03-09T15:07:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.rFx0ezPNhtWMlMTjE_Skx3ZRSXoMt6U_0 2024-03-09T15:07:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.786+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18254723576922693475', time=2024-03-09T16:56:38.898049+0000, chain.objs.size()=1 2024-03-09T15:07:02.785 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.NA0waJFm2lNVV4U2M-RUP49uRVU-8jB_0 2024-03-09T15:07:02.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.786+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10824897062210860035', time=2024-03-09T16:56:38.909927+0000, chain.objs.size()=1 2024-03-09T15:07:02.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.2uQnzHdzv4toh1Nv1Jgy69BQ3QQlWz1_0 2024-03-09T15:07:02.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.786+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15197862287372234557', time=2024-03-09T16:56:39.072006+0000, chain.objs.size()=1 2024-03-09T15:07:02.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ukaAGigNhaDrGkgWCRpHtkTzUP-XoaF_0 2024-03-09T15:07:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4609712635163549466', time=2024-03-09T16:56:39.076949+0000, chain.objs.size()=1 2024-03-09T15:07:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.rVnGUelOBsBFuycUPIciN8qMa3NOzWr_0 2024-03-09T15:07:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14685725840286820858', time=2024-03-09T16:56:39.130081+0000, chain.objs.size()=1 2024-03-09T15:07:02.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.xUVD-fzNjoja-MRECF3G0zReXHmF0xQ_0 2024-03-09T15:07:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11025648726752802818', time=2024-03-09T16:56:39.353212+0000, chain.objs.size()=1 2024-03-09T15:07:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lr5VNaNeEOovwH1OC0bJaJ0MW3_nUNr_0 2024-03-09T15:07:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7622879896939407563', time=2024-03-09T16:56:39.370457+0000, chain.objs.size()=1 2024-03-09T15:07:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.yCLvabeg45vbyg-r5fbhjxd9b-nZY6R_0 2024-03-09T15:07:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16747789407388312381', time=2024-03-09T16:56:39.394484+0000, chain.objs.size()=1 2024-03-09T15:07:02.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.z_MAyEM20luXFf8MKLK7ASMtxJJXHt6_0 2024-03-09T15:07:02.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1951170150570021648', time=2024-03-09T16:56:39.436097+0000, chain.objs.size()=1 2024-03-09T15:07:02.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.BRL6hg7KDpDKQH7EX8kfTBEoiL8dNvp_0 2024-03-09T15:07:02.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3049468364620520040', time=2024-03-09T16:56:39.445755+0000, chain.objs.size()=1 2024-03-09T15:07:02.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.YKXfTlnRFDRNIbtQc9S6Oe5gNUnzs2Y_0 2024-03-09T15:07:02.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4555642660447060743', time=2024-03-09T16:56:39.456926+0000, chain.objs.size()=1 2024-03-09T15:07:02.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-G95CxFwmAmAAOZzF9MIzgPgLHUnq-F_0 2024-03-09T15:07:02.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16944399095463765689', time=2024-03-09T16:56:39.617438+0000, chain.objs.size()=1 2024-03-09T15:07:02.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.790+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.fTTkd-fiPVmYXdVGjzipvVodqJ-dJAZ_0 2024-03-09T15:07:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.794+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7874510294689467619', time=2024-03-09T16:56:39.624660+0000, chain.objs.size()=1 2024-03-09T15:07:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.794+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.nTBerxjbGA5brq8cuxnYf3VXo9KhFm6_0 2024-03-09T15:07:02.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.794+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1799651675538996328', time=2024-03-09T16:56:39.671455+0000, chain.objs.size()=1 2024-03-09T15:07:02.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.794+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.UcGrboKwQE_hQU_f5IEAANlQ8z0TOO-_0 2024-03-09T15:07:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.794+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2030337550762180547', time=2024-03-09T16:57:01.492149+0000, chain.objs.size()=1 2024-03-09T15:07:02.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.794+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.AX6DOiaEd2BDR5Frbnh2dEtf_TxGEZ6_0 2024-03-09T15:07:02.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.393643765190478894', time=2024-03-09T16:57:01.593932+0000, chain.objs.size()=1 2024-03-09T15:07:02.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.y-exnVje0vGZNQo52ryIum8A-lF-a_4_0 2024-03-09T15:07:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9985188794511426106', time=2024-03-09T16:57:01.719870+0000, chain.objs.size()=1 2024-03-09T15:07:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.YY-MnT0dRwQNiZlkpb4BbGTmzQeJ0w7_0 2024-03-09T15:07:02.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15133267271199924308', time=2024-03-09T16:57:01.734924+0000, chain.objs.size()=1 2024-03-09T15:07:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Qo5bzBzG6Yef3GhghxG7izBQHeDflqJ_0 2024-03-09T15:07:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13215442910660977445', time=2024-03-09T16:57:01.802986+0000, chain.objs.size()=1 2024-03-09T15:07:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.8ZP1o2FEo-rHXdquYFiWQRtl2uYOhNw_0 2024-03-09T15:07:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14229357860386281666', time=2024-03-09T16:57:01.863524+0000, chain.objs.size()=1 2024-03-09T15:07:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.CjJvg_KwTotH2E3ZAfUULqcVHkXUJmZ_0 2024-03-09T15:07:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9262552493274653101', time=2024-03-09T16:57:02.032195+0000, chain.objs.size()=1 2024-03-09T15:07:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.9fbnpx0ZEJTAeUBR3cot2nLRCo69hk8_0 2024-03-09T15:07:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1458793641139036779', time=2024-03-09T16:57:02.245233+0000, chain.objs.size()=1 2024-03-09T15:07:02.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.CUhXrDCHZQvsrjO-68cVBlPnroBcS9P_0 2024-03-09T15:07:02.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.616676397626295222', time=2024-03-09T16:57:02.270618+0000, chain.objs.size()=1 2024-03-09T15:07:02.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.TCSA528CVmiQcQFOTA_ATbg10N6OMvR_0 2024-03-09T15:07:02.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8454927225209850049', time=2024-03-09T16:57:02.318630+0000, chain.objs.size()=1 2024-03-09T15:07:02.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.eKdVySUeuqbFyX9-8wlyAQRtbSV1tCo_0 2024-03-09T15:07:02.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2647825452302190380', time=2024-03-09T16:57:02.475594+0000, chain.objs.size()=1 2024-03-09T15:07:02.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.RHSAjheIXW8NKwJaxAcj_LsFaRod9Ny_0 2024-03-09T15:07:02.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12464207559904706624', time=2024-03-09T16:57:02.522863+0000, chain.objs.size()=1 2024-03-09T15:07:02.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.X1CWGhlpi-NqMC5U0_tqlHV-HVBzstO_0 2024-03-09T15:07:02.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.802+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.982114166010187984', time=2024-03-09T16:57:02.551501+0000, chain.objs.size()=1 2024-03-09T15:07:02.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.802+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.1FDBTJ_VJ4wfnBZeMjCFacjlli8uh93_0 2024-03-09T15:07:02.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.802+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18400466525580059515', time=2024-03-09T16:57:02.568448+0000, chain.objs.size()=1 2024-03-09T15:07:02.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.802+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.61wIfFNTIg4PQ3l-8Z7C2F1URY7Zu4o_0 2024-03-09T15:07:02.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7631972005832878091', time=2024-03-09T16:57:02.626305+0000, chain.objs.size()=1 2024-03-09T15:07:02.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.He7k4j-gaehrg4IPYBX-Yr6XCrWkYqc_0 2024-03-09T15:07:02.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12539570386016565496', time=2024-03-09T16:57:02.760741+0000, chain.objs.size()=1 2024-03-09T15:07:02.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.70D55qKbgD9RxDEMQOgJuZGah3fVwRl_0 2024-03-09T15:07:02.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14056865585954687954', time=2024-03-09T16:57:02.794038+0000, chain.objs.size()=1 2024-03-09T15:07:02.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.8Z-1lHqL32vN_n5mgIOdKaGdyO4h4Kn_0 2024-03-09T15:07:02.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11940514214575724493', time=2024-03-09T16:57:02.973658+0000, chain.objs.size()=1 2024-03-09T15:07:02.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.BEmiQNESnTp2XV6wUKwPZp-50O_b3yP_0 2024-03-09T15:07:02.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6508783106175336639', time=2024-03-09T16:57:02.999355+0000, chain.objs.size()=1 2024-03-09T15:07:02.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.cVwprbWUsUASULRMGVRwkm_F-Ja6t-x_0 2024-03-09T15:07:02.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.951637260489435306', time=2024-03-09T16:57:03.025100+0000, chain.objs.size()=1 2024-03-09T15:07:02.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.KNtOyLWX1xOw-qSqf4oLlS5y46xRlwm_0 2024-03-09T15:07:02.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15363195834683308565', time=2024-03-09T16:57:03.039581+0000, chain.objs.size()=1 2024-03-09T15:07:02.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.QyIIjQQNKNZPQ4SFFYxg0ALgH9i4lmK_0 2024-03-09T15:07:02.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4233289253049147109', time=2024-03-09T16:57:03.046716+0000, chain.objs.size()=1 2024-03-09T15:07:02.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.W4EmSPWASdxCrLTDfmA1AeM3jAmnKjD_0 2024-03-09T15:07:02.806 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8303947104919920458', time=2024-03-09T16:57:03.095632+0000, chain.objs.size()=1 2024-03-09T15:07:02.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.-EUPSdRJdkdLE0N3N0bqhFmoBWZFwzV_0 2024-03-09T15:07:02.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.810+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17701879201442726708', time=2024-03-09T16:58:42.513054+0000, chain.objs.size()=1 2024-03-09T15:07:02.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.810+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.424__shadow_.-tlx7h2iZ_axGVImxF3zIXg1GVPKyEh_0 2024-03-09T15:07:02.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.810+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16007696384208108830', time=2024-03-09T16:59:09.620478+0000, chain.objs.size()=1 2024-03-09T15:07:02.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.810+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.451__shadow_.Br7cFByE5d0G1lWRB2L9GE3xttzCbEx_0 2024-03-09T15:07:02.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.810+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13865378770947670919', time=2024-03-09T16:59:17.126273+0000, chain.objs.size()=1 2024-03-09T15:07:02.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.810+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.457__shadow_.o15Nsc2354fHr1RLj-WdiFt2A8oiO51_0 2024-03-09T15:07:02.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.810+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14274928401974354225', time=2024-03-09T16:59:34.591116+0000, chain.objs.size()=1 2024-03-09T15:07:02.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.810+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.480__shadow_.b8dc2ZNHh-6yAEqw_MHHwCBOvwTz0B6_0 2024-03-09T15:07:02.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.810+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.887000718100848590', time=2024-03-09T17:00:02.743122+0000, chain.objs.size()=1 2024-03-09T15:07:02.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.810+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.511__shadow_.4soXGKovmQ6souPlfk7JdzK_xRDestj_0 2024-03-09T15:07:02.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/41654 2024-03-09T15:07:02.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-03-09T15:07:02.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2286907356321976180', time=2024-03-09T17:01:26.696757+0000, chain.objs.size()=1 2024-03-09T15:07:02.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.544__shadow_.RCaZI27Nld8wmdhy0flWH7SIB6iEY59_0 2024-03-09T15:07:02.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15303710551024162682', time=2024-03-09T17:02:11.767713+0000, chain.objs.size()=1 2024-03-09T15:07:02.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.569__shadow:BKNr3QcH8AgxkJob6cQAZ1gmIJy7ydk_.Cow1FQtfKkRD5btJ4wScKffpbul1IsM_0 2024-03-09T15:07:02.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8155704656862634675', time=2024-03-09T17:02:25.430380+0000, chain.objs.size()=1 2024-03-09T15:07:02.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:Gdr1IvdSyap7a0O..TBO.I-YZhZaTp7_.awpBDedfU0ggC8QlyZZ4NQrLOLnz4U6_0 2024-03-09T15:07:02.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2737496324455620873', time=2024-03-09T17:02:29.791047+0000, chain.objs.size()=1 2024-03-09T15:07:02.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:QRnxfInYb8dT4VFCWDAKSkvxhP4Rolr_.o2ftsFlwVJcEQQeH2p11ZSIAgK-1qIN_0 2024-03-09T15:07:02.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17162875075538119601', time=2024-03-09T17:03:13.381911+0000, chain.objs.size()=6 2024-03-09T15:07:02.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.606__multipart_multipart_enc.2~MERvrQzFVbxcy3TyBOCwGeAzr0UmKk2.1 2024-03-09T15:07:02.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.606__multipart_multipart_enc.2~MERvrQzFVbxcy3TyBOCwGeAzr0UmKk2.2 2024-03-09T15:07:02.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.606__multipart_multipart_enc.2~MERvrQzFVbxcy3TyBOCwGeAzr0UmKk2.3 2024-03-09T15:07:02.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.606__multipart_multipart_enc.2~MERvrQzFVbxcy3TyBOCwGeAzr0UmKk2.4 2024-03-09T15:07:02.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.606__multipart_multipart_enc.2~MERvrQzFVbxcy3TyBOCwGeAzr0UmKk2.5 2024-03-09T15:07:02.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.606__multipart_multipart_enc.2~MERvrQzFVbxcy3TyBOCwGeAzr0UmKk2.6 2024-03-09T15:07:02.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6900301576067365105', time=2024-03-09T17:04:10.926717+0000, chain.objs.size()=1 2024-03-09T15:07:02.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.654__shadow_.C6ojWOvyIo9hVYaEtvGA7p_El9AP89E_0 2024-03-09T15:07:02.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11185028054177506610', time=2024-03-09T17:04:30.913848+0000, chain.objs.size()=1 2024-03-09T15:07:02.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.679__shadow:ovhxkNBnaBL.YB7vqGULi477z6fWNgD_.XviPeVWUNATtmDdM8FwJ7PCaRoRxU-u_0 2024-03-09T15:07:02.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.822+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17344753883322790594', time=2024-03-09T17:04:32.883854+0000, chain.objs.size()=1 2024-03-09T15:07:02.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.822+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.681__shadow:7uPBtmcXWUgd0TXE7cU4DvTAIsItibY_.HvKciegNHVZKoVOh3sdEAjX-DqfEta__0 2024-03-09T15:07:02.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1561953418908679802', time=2024-03-09T17:05:28.909657+0000, chain.objs.size()=10 2024-03-09T15:07:02.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.720__multipart_foo.2~rCKUjO1TAis9cZECQ5zEYT-r5Gb4Wt-.1 2024-03-09T15:07:02.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.720__multipart_foo.2~rCKUjO1TAis9cZECQ5zEYT-r5Gb4Wt-.2 2024-03-09T15:07:02.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.720__multipart_foo.2~rCKUjO1TAis9cZECQ5zEYT-r5Gb4Wt-.3 2024-03-09T15:07:02.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.720__multipart_foo.2~rCKUjO1TAis9cZECQ5zEYT-r5Gb4Wt-.4 2024-03-09T15:07:02.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.720__multipart_foo.2~rCKUjO1TAis9cZECQ5zEYT-r5Gb4Wt-.5 2024-03-09T15:07:02.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.720__multipart_foo.2~rCKUjO1TAis9cZECQ5zEYT-r5Gb4Wt-.6 2024-03-09T15:07:02.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.720__multipart_foo.2~rCKUjO1TAis9cZECQ5zEYT-r5Gb4Wt-.7 2024-03-09T15:07:02.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.720__multipart_foo.2~rCKUjO1TAis9cZECQ5zEYT-r5Gb4Wt-.8 2024-03-09T15:07:02.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.720__multipart_foo.2~rCKUjO1TAis9cZECQ5zEYT-r5Gb4Wt-.9 2024-03-09T15:07:02.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.720__multipart_foo.2~rCKUjO1TAis9cZECQ5zEYT-r5Gb4Wt-.10 2024-03-09T15:07:02.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.830+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:02.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.834+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-09T15:07:02.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:02.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:02.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48936' 2024-03-09T15:07:02.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17615860424394898271', time=2024-03-09T16:52:09.509127+0000, chain.objs.size()=1 2024-03-09T15:07:02.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.170__shadow_.NJcKuBALaisiW7D2wZP143U_25gGdvH_0 2024-03-09T15:07:02.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17087294273835246711', time=2024-03-09T16:52:45.563247+0000, chain.objs.size()=1 2024-03-09T15:07:02.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.197__shadow_.ftKDpdXYrr9vKft0bfrmnFWf6HRoLeC_0 2024-03-09T15:07:02.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11417933392593988501', time=2024-03-09T16:54:48.175261+0000, chain.objs.size()=1 2024-03-09T15:07:02.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.250__shadow_.n3ug54jbDv8q4EXyg-PK4ug8DHO6Qo3_0 2024-03-09T15:07:02.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5148347942897856995', time=2024-03-09T16:54:51.966977+0000, chain.objs.size()=1 2024-03-09T15:07:02.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.254__shadow_.CUecuO3c4wtrcIdRM13Z3dpvlNB6PtL_0 2024-03-09T15:07:02.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7990612591682533223', time=2024-03-09T16:55:14.840027+0000, chain.objs.size()=1 2024-03-09T15:07:02.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.RQWr-ycFF8epjEDZ_p--HB5SxU75_1E_0 2024-03-09T15:07:02.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17102075405636629226', time=2024-03-09T16:55:14.844771+0000, chain.objs.size()=1 2024-03-09T15:07:02.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.PoQfzcKo9UuwkiEZRlHVvXIdzBb8c8l_0 2024-03-09T15:07:02.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18115392343058219765', time=2024-03-09T16:55:14.883821+0000, chain.objs.size()=1 2024-03-09T15:07:02.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.v2Hhv2h-hpb4ieThwE8bSoooH6bt7Xq_0 2024-03-09T15:07:02.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16796617853193818416', time=2024-03-09T16:55:14.895778+0000, chain.objs.size()=1 2024-03-09T15:07:02.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.clMnTp8cZBQRWSVgWPA1hd05nAsPiww_0 2024-03-09T15:07:02.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14657984223273225964', time=2024-03-09T16:55:14.896795+0000, chain.objs.size()=1 2024-03-09T15:07:02.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.9MH0tPRCeSbNxCcKAAwMK1mxV-jXvAp_0 2024-03-09T15:07:02.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8020601155600240089', time=2024-03-09T16:55:14.955222+0000, chain.objs.size()=1 2024-03-09T15:07:02.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.kVVN-G6v4SH0j_kopEPkp0ccHQfralX_0 2024-03-09T15:07:02.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1124751161139690275', time=2024-03-09T16:55:15.224962+0000, chain.objs.size()=1 2024-03-09T15:07:02.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.SoSW2YDIsibDaLVoLEtqf6rt8vbxGCB_0 2024-03-09T15:07:02.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18210109413923912619', time=2024-03-09T16:55:15.236747+0000, chain.objs.size()=1 2024-03-09T15:07:02.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.xartt-qr3G4HfcweZ21HKu-diKK3bzz_0 2024-03-09T15:07:02.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2197468480790000536', time=2024-03-09T16:55:15.241192+0000, chain.objs.size()=1 2024-03-09T15:07:02.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.vwSOzXsXNNoKG38-r8qUhNJafn-l2pE_0 2024-03-09T15:07:02.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8199423563430017114', time=2024-03-09T16:55:15.243072+0000, chain.objs.size()=1 2024-03-09T15:07:02.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.oKo9bHE3MqWvxIw6LsPXTrZg4igdnb6_0 2024-03-09T15:07:02.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11207334457066745487', time=2024-03-09T16:55:15.266174+0000, chain.objs.size()=1 2024-03-09T15:07:02.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6krElkW2f_u7i1LyGFYhYFwEvhKs1DD_0 2024-03-09T15:07:02.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16491842821492514131', time=2024-03-09T16:55:15.286565+0000, chain.objs.size()=1 2024-03-09T15:07:02.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.zz1gaS4ZHknUSzYK-XgPnJFsdPOD_JI_0 2024-03-09T15:07:02.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2851713715203461222', time=2024-03-09T16:55:15.294439+0000, chain.objs.size()=1 2024-03-09T15:07:02.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.cVG_q08f33Z0RE9_S4QXkxfw0_XH-27_0 2024-03-09T15:07:02.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8893302278073816419', time=2024-03-09T16:55:15.509445+0000, chain.objs.size()=1 2024-03-09T15:07:02.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.gLb2vcUUlUBdzAwSJXDKRAn2ZSCtdWk_0 2024-03-09T15:07:02.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10902144676455436053', time=2024-03-09T16:55:15.526324+0000, chain.objs.size()=1 2024-03-09T15:07:02.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.LYR0YQiibDhD7hDocWKo6QO7HMtjQ3F_0 2024-03-09T15:07:02.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16046947407492737255', time=2024-03-09T16:55:15.527056+0000, chain.objs.size()=1 2024-03-09T15:07:02.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.sbAjqpyF465agka_HK2Rc3oNg1dUTge_0 2024-03-09T15:07:02.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7854967613213367440', time=2024-03-09T16:55:15.544044+0000, chain.objs.size()=1 2024-03-09T15:07:02.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.lH2Z3w7FQh3ykzWNdZJrjpUs9sUZeyz_0 2024-03-09T15:07:02.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5961241285126742267', time=2024-03-09T16:55:15.677498+0000, chain.objs.size()=1 2024-03-09T15:07:02.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Yl-EFtuyx1DE-Sgcjco9e8k-qv6NVHc_0 2024-03-09T15:07:02.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5625568302523351959', time=2024-03-09T16:55:16.006786+0000, chain.objs.size()=1 2024-03-09T15:07:02.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ACD7LGv310bnp114iqNK38bps9icDkC_0 2024-03-09T15:07:02.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1190266548761196776', time=2024-03-09T16:55:16.007845+0000, chain.objs.size()=1 2024-03-09T15:07:02.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.BtZuZAbMUsGw67VLnSjuH-_Gn1cw9x4_0 2024-03-09T15:07:02.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.544533353303811364', time=2024-03-09T16:55:16.097738+0000, chain.objs.size()=1 2024-03-09T15:07:02.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.b2QWDdXvCny3pOP6x4YRUTWSCUCUGh7_0 2024-03-09T15:07:02.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18314717178234082170', time=2024-03-09T16:55:16.259748+0000, chain.objs.size()=1 2024-03-09T15:07:02.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.91TUWb26L5hbp36NmBN_0LKmfVSg_gc_0 2024-03-09T15:07:02.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5908419416198599838', time=2024-03-09T16:55:16.264683+0000, chain.objs.size()=1 2024-03-09T15:07:02.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.unx8Jwk0QdsqGK6Uy00-EVGqUkafeoG_0 2024-03-09T15:07:02.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14194874934505235296', time=2024-03-09T16:55:16.302958+0000, chain.objs.size()=1 2024-03-09T15:07:02.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.IxDTfFKLshzHRhtEoI6tJqKKGtfN6JM_0 2024-03-09T15:07:02.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14752342058115606913', time=2024-03-09T16:55:16.333833+0000, chain.objs.size()=1 2024-03-09T15:07:02.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.OoAPf9hUtXzS7txwMDXKQ-khedziy-v_0 2024-03-09T15:07:02.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13477394427518843053', time=2024-03-09T16:55:16.336606+0000, chain.objs.size()=1 2024-03-09T15:07:02.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.piu5WaFtdbzHeDnmFtkUpz7PQf-gkMn_0 2024-03-09T15:07:02.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2046444332445783539', time=2024-03-09T16:55:16.532508+0000, chain.objs.size()=1 2024-03-09T15:07:02.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.obxllR6ecHJSHvv3coRqGCMEjUID8Ao_0 2024-03-09T15:07:02.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.194163693649353672', time=2024-03-09T16:55:16.551902+0000, chain.objs.size()=1 2024-03-09T15:07:02.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.M-6UJuoOBJOeJKmijrIYfjJF7hv36c__0 2024-03-09T15:07:02.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7844887035631336030', time=2024-03-09T16:55:16.557428+0000, chain.objs.size()=1 2024-03-09T15:07:02.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.yBD2nOb35lPvR8Vcs9KZw5rPWyUd2t8_0 2024-03-09T15:07:02.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17066300693808022542', time=2024-03-09T16:55:16.600947+0000, chain.objs.size()=1 2024-03-09T15:07:02.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.BPJrfrobU5RjvIuSNK3A0x7Vlul57Qd_0 2024-03-09T15:07:02.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.854+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10850244244136731370', time=2024-03-09T16:55:16.726717+0000, chain.objs.size()=1 2024-03-09T15:07:02.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.854+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.bV5UORN4IRzhIhiQu1b7-wNiqqBsILS_0 2024-03-09T15:07:02.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.854+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.437244688082956707', time=2024-03-09T16:55:16.740465+0000, chain.objs.size()=1 2024-03-09T15:07:02.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.854+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.87cB3OI_29K05J1Qavj0ChIfW59a8hV_0 2024-03-09T15:07:02.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.854+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6640206579793736998', time=2024-03-09T16:55:16.772436+0000, chain.objs.size()=1 2024-03-09T15:07:02.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.854+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.fuKQz5Rpv6ipjfTeze-3hzyqypGfb6X_0 2024-03-09T15:07:02.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.854+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7722445978730750606', time=2024-03-09T16:55:16.777528+0000, chain.objs.size()=1 2024-03-09T15:07:02.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.854+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.RisrQwGeq5dS0yQVgP5LoyktNp5shkp_0 2024-03-09T15:07:02.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.854+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17102010181752870710', time=2024-03-09T16:55:16.785252+0000, chain.objs.size()=1 2024-03-09T15:07:02.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.854+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.DyRJj_09GOJXVzvmAgCHXGMAc1NovRH_0 2024-03-09T15:07:02.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.854+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14271315412851984493', time=2024-03-09T16:55:16.823681+0000, chain.objs.size()=1 2024-03-09T15:07:02.856 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.854+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.H3XhtwlPi8rBqG4qoF6HcR1xASoo-zG_0 2024-03-09T15:07:02.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.858+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13298636927890274759', time=2024-03-09T16:55:16.846444+0000, chain.objs.size()=1 2024-03-09T15:07:02.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.858+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.To9XA45JO0QHjA6bfkw1XgU79iP4lfl_0 2024-03-09T15:07:02.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.858+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16397274243840644868', time=2024-03-09T16:55:40.262022+0000, chain.objs.size()=1 2024-03-09T15:07:02.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.858+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.281__shadow_.wlNobFPAIc39XAjNxzYOFoA3XSBOvuT_0 2024-03-09T15:07:02.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.858+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9833669608657750843', time=2024-03-09T16:55:46.198505+0000, chain.objs.size()=1 2024-03-09T15:07:02.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.858+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.GyqQ8EFmjglm7jkZYfOQNaahohRFhMe_0 2024-03-09T15:07:02.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.858+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3966360100725998877', time=2024-03-09T16:55:57.381663+0000, chain.objs.size()=1 2024-03-09T15:07:02.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.858+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.297__shadow_.t-9wtaTbALP4SUEbRInQiTp9HrAKHvw_0 2024-03-09T15:07:02.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.858+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5233409521011203877', time=2024-03-09T16:55:58.322067+0000, chain.objs.size()=1 2024-03-09T15:07:02.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.858+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.298__shadow_.4jaZCKeZCeiiQdxVUTodHe5-5KoU9jv_0 2024-03-09T15:07:02.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.858+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6422744385290817997', time=2024-03-09T16:56:37.712715+0000, chain.objs.size()=1 2024-03-09T15:07:02.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.858+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.AYbhZwJvYWX6AsPMcvys2JJgO-w2GsB_0 2024-03-09T15:07:02.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.858+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8501621547342543373', time=2024-03-09T16:56:37.723284+0000, chain.objs.size()=1 2024-03-09T15:07:02.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.858+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.5HYtMvxlugRuzvUSzGZ4biEosYOaOyf_0 2024-03-09T15:07:02.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9467248903546447321', time=2024-03-09T16:56:37.769211+0000, chain.objs.size()=1 2024-03-09T15:07:02.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.KPyH6iPvn-bl4Rq_NDO8BZBQ-cOhRy6_0 2024-03-09T15:07:02.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9110404212195724240', time=2024-03-09T16:56:37.786309+0000, chain.objs.size()=1 2024-03-09T15:07:02.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.VRcG4Nw7zFyQVV_j6xpTqmBckGIF9-R_0 2024-03-09T15:07:02.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12468863652274645205', time=2024-03-09T16:56:37.799333+0000, chain.objs.size()=1 2024-03-09T15:07:02.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kF_dLCTXYm4BoLZY-4rprUIrj5mNjYc_0 2024-03-09T15:07:02.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.866+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2343318029222369849', time=2024-03-09T16:56:38.019384+0000, chain.objs.size()=1 2024-03-09T15:07:02.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.866+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.KFTPlYGlPC0LsYg-_rFR3MInk11e-vD_0 2024-03-09T15:07:02.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.866+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4086560603831304104', time=2024-03-09T16:56:38.039307+0000, chain.objs.size()=1 2024-03-09T15:07:02.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.866+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.JvuUG-2NZqHfiVOwM2gs3HSIMFTGMw3_0 2024-03-09T15:07:02.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.866+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12655874011177116656', time=2024-03-09T16:56:38.042632+0000, chain.objs.size()=1 2024-03-09T15:07:02.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.866+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.QKODCD37lfvSSvOjsxCIOEbuemt77Vb_0 2024-03-09T15:07:02.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.866+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10060190275754545033', time=2024-03-09T16:56:38.077572+0000, chain.objs.size()=1 2024-03-09T15:07:02.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.866+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.qAnhzcKRf0KROeVgJjRTc1fkDcjNhEu_0 2024-03-09T15:07:02.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.866+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4048650978049718005', time=2024-03-09T16:56:38.244025+0000, chain.objs.size()=1 2024-03-09T15:07:02.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.866+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.A9NXMVih2RBYxePMddIPMY4DQh0Uced_0 2024-03-09T15:07:02.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.866+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7115150129373803766', time=2024-03-09T16:56:38.332748+0000, chain.objs.size()=1 2024-03-09T15:07:02.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.866+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.mnDvKcCHoIqAdv_uoi2ZU4T8h0x8ms2_0 2024-03-09T15:07:02.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.866+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14536397929535497189', time=2024-03-09T16:56:38.351915+0000, chain.objs.size()=1 2024-03-09T15:07:02.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.866+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.AhL1hglJzbx9oJA-nbeCi5CDPlYQH1y_0 2024-03-09T15:07:02.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.866+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8652035036752912584', time=2024-03-09T16:56:38.373286+0000, chain.objs.size()=1 2024-03-09T15:07:02.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.866+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.dvEpW3chC3yDBh3EMP4OykssM6rpGlG_0 2024-03-09T15:07:02.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8613630646194425750', time=2024-03-09T16:56:38.530272+0000, chain.objs.size()=1 2024-03-09T15:07:02.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.qBvvmDpCpS0GJQxZ0gwC-N6pdZ5BdRP_0 2024-03-09T15:07:02.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15655531525844849052', time=2024-03-09T16:56:38.565025+0000, chain.objs.size()=1 2024-03-09T15:07:02.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.cgikRJRV5SJx9WcN7qr0NxMRkUNNGkw_0 2024-03-09T15:07:02.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1848714162386388468', time=2024-03-09T16:56:38.609300+0000, chain.objs.size()=1 2024-03-09T15:07:02.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.A8wFwdj5RmbyIDUhnsjziSlNmc1egZi_0 2024-03-09T15:07:02.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8037611259726942966', time=2024-03-09T16:56:38.782273+0000, chain.objs.size()=1 2024-03-09T15:07:02.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Xn4NZ9Ktbjal6tai6P91cs24vxwt392_0 2024-03-09T15:07:02.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16796759014841095465', time=2024-03-09T16:56:38.801837+0000, chain.objs.size()=1 2024-03-09T15:07:02.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_._1eZxy1oH3upHG8jTeRiFTESR1f1PhD_0 2024-03-09T15:07:02.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8425136319381337756', time=2024-03-09T16:56:38.844577+0000, chain.objs.size()=1 2024-03-09T15:07:02.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.eYOC8h0WSJScnwXreSsjiueHXpQkqev_0 2024-03-09T15:07:02.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16637993125215842447', time=2024-03-09T16:56:38.866073+0000, chain.objs.size()=1 2024-03-09T15:07:02.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.aUSFCUHfuosSkbPz9q7_1cUOgdnnJ4h_0 2024-03-09T15:07:02.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.760268323929783894', time=2024-03-09T16:56:38.875977+0000, chain.objs.size()=1 2024-03-09T15:07:02.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.S9cyGWXAa-EuqjI6YthBDaJ_5CPLzff_0 2024-03-09T15:07:02.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10247809150385412176', time=2024-03-09T16:56:38.882017+0000, chain.objs.size()=1 2024-03-09T15:07:02.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.jwQDbutxvqLdI3dQTsQ8hOi_gCwjAy8_0 2024-03-09T15:07:02.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2525173092094532021', time=2024-03-09T16:56:38.931192+0000, chain.objs.size()=1 2024-03-09T15:07:02.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lOxkL2W5E01dDcpJWSjB_4Qx-xA-Gfd_0 2024-03-09T15:07:02.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14346477028908899530', time=2024-03-09T16:56:39.066679+0000, chain.objs.size()=1 2024-03-09T15:07:02.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.X6hQlq1xWw7-6KHgZTgTCm5pH98CqRa_0 2024-03-09T15:07:02.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.649413433556440839', time=2024-03-09T16:56:39.151834+0000, chain.objs.size()=1 2024-03-09T15:07:02.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kGnftULd6rvJlnCuIV6dlxhpe1Rmwod_0 2024-03-09T15:07:02.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8740957462048413099', time=2024-03-09T16:56:39.310718+0000, chain.objs.size()=1 2024-03-09T15:07:02.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Slt2f5Nc0aDy9KGGxe5OQA6zzcPG7_v_0 2024-03-09T15:07:02.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14911930947224533063', time=2024-03-09T16:56:39.342521+0000, chain.objs.size()=1 2024-03-09T15:07:02.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.fRDm1Kgc6DgDWZV3TjMSHsnUrhriylg_0 2024-03-09T15:07:02.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8442737651857806481', time=2024-03-09T16:56:39.345299+0000, chain.objs.size()=1 2024-03-09T15:07:02.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ORFTjKJEodOU4cYbwf5iJ-PXejI5qv7_0 2024-03-09T15:07:02.882 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9689938262329835699', time=2024-03-09T16:56:39.406381+0000, chain.objs.size()=1 2024-03-09T15:07:02.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Wt7wwkSOVq6Zcx7XI5IGVZHw33Edcrv_0 2024-03-09T15:07:02.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1527712544246209227', time=2024-03-09T16:56:39.456222+0000, chain.objs.size()=1 2024-03-09T15:07:02.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.grOTNbIU3-071VNJnBOCnjoKaSIZ7Ij_0 2024-03-09T15:07:02.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7697149780613150750', time=2024-03-09T16:56:39.463579+0000, chain.objs.size()=1 2024-03-09T15:07:02.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.HJzOJvgLBeeSnATXYeVRpwEPxw_mkSr_0 2024-03-09T15:07:02.883 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14063572936397459335', time=2024-03-09T16:56:39.602379+0000, chain.objs.size()=1 2024-03-09T15:07:02.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.C9t3QrXR2hYcbzihMFFthtRCKhXWbP8_0 2024-03-09T15:07:02.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5910954130310947875', time=2024-03-09T16:56:39.620426+0000, chain.objs.size()=1 2024-03-09T15:07:02.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.f6Nmi2ZkvxuQUFuX1gGIhhrH22WKkwV_0 2024-03-09T15:07:02.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1296577353945728371', time=2024-03-09T16:57:01.549973+0000, chain.objs.size()=1 2024-03-09T15:07:02.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.gpDegDnTIw69CE-4U1Wbmie8jTGwD9y_0 2024-03-09T15:07:02.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3166402734286655895', time=2024-03-09T16:57:01.722825+0000, chain.objs.size()=1 2024-03-09T15:07:02.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Mcn0aVuOgsIYOjWVoVgHAjs3sOhfH0g_0 2024-03-09T15:07:02.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6303710264844120149', time=2024-03-09T16:57:01.726968+0000, chain.objs.size()=1 2024-03-09T15:07:02.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.6WI8jDzZ0pSg-k9bDyAShmoAMEBCIn5_0 2024-03-09T15:07:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13543752133538097874', time=2024-03-09T16:57:01.751300+0000, chain.objs.size()=1 2024-03-09T15:07:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.TlnbsLdJeudO8sHt2-69zYZR-9KOpux_0 2024-03-09T15:07:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10083186754291900895', time=2024-03-09T16:57:01.766224+0000, chain.objs.size()=1 2024-03-09T15:07:02.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.882+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.u-0Dl8z_tB2WcbG7iMFID4MFWeadnc5_0 2024-03-09T15:07:02.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16370205808089103208', time=2024-03-09T16:57:01.769988+0000, chain.objs.size()=1 2024-03-09T15:07:02.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Bp07t3SsjGRiQHWRL7HkwcfK754yBmF_0 2024-03-09T15:07:02.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11283010665772243808', time=2024-03-09T16:57:01.823349+0000, chain.objs.size()=1 2024-03-09T15:07:02.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.9dOJWsZYW8co0aRqauBibpbTYP7boow_0 2024-03-09T15:07:02.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7904379002311891649', time=2024-03-09T16:57:01.831568+0000, chain.objs.size()=1 2024-03-09T15:07:02.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.8rD-swCS44wNGgWVfYtVijpQXdMxz8j_0 2024-03-09T15:07:02.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18205462212205832652', time=2024-03-09T16:57:01.964964+0000, chain.objs.size()=1 2024-03-09T15:07:02.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oNxO1oOP83DKLrt2I6HPs4vCqZAK3tY_0 2024-03-09T15:07:02.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9841274852662476925', time=2024-03-09T16:57:01.970363+0000, chain.objs.size()=1 2024-03-09T15:07:02.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.4JEh-zSth6KUGhkLWXdEqxOjvMYmo3D_0 2024-03-09T15:07:02.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.225688012451117982', time=2024-03-09T16:57:01.986402+0000, chain.objs.size()=1 2024-03-09T15:07:02.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.diTEYnwj-n8En8xGtVcOHpca7s9GwhG_0 2024-03-09T15:07:02.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10839452822429685206', time=2024-03-09T16:57:01.999121+0000, chain.objs.size()=1 2024-03-09T15:07:02.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.z5o0U3YYQVV3GF3zDcrl33HrLGfRUm9_0 2024-03-09T15:07:02.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3486059121635484205', time=2024-03-09T16:57:02.008363+0000, chain.objs.size()=1 2024-03-09T15:07:02.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.NpAJQT8Ke1gAbsUKzuvd6WmzILPvGX6_0 2024-03-09T15:07:02.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5804342221940383891', time=2024-03-09T16:57:02.024937+0000, chain.objs.size()=1 2024-03-09T15:07:02.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.uEgL7AV_D0QCN6atu75ofdXZi-NJrM0_0 2024-03-09T15:07:02.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5403119405808204156', time=2024-03-09T16:57:02.046354+0000, chain.objs.size()=1 2024-03-09T15:07:02.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Ole2WsWLVGB55fumTQHi0BpEwYqRMFZ_0 2024-03-09T15:07:02.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10921214800456803164', time=2024-03-09T16:57:02.065790+0000, chain.objs.size()=1 2024-03-09T15:07:02.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.joKreuzDSXtjnRvAU73wuYkZ7VpQWe4_0 2024-03-09T15:07:02.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.894+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17749159037426463641', time=2024-03-09T16:57:02.080661+0000, chain.objs.size()=1 2024-03-09T15:07:02.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.894+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.KUYrqlzZEob1aWi7AU8-OsEVwlee_R6_0 2024-03-09T15:07:02.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.898+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13743365143947265608', time=2024-03-09T16:57:02.280523+0000, chain.objs.size()=1 2024-03-09T15:07:02.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.898+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.bT44nrWAl5BRZnhccqQpO4cCcGKz8Sq_0 2024-03-09T15:07:02.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.898+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9399404448603489322', time=2024-03-09T16:57:02.297315+0000, chain.objs.size()=1 2024-03-09T15:07:02.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.898+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.wbXm7TxckN-SykwSwBfIMEwAMZmp6i__0 2024-03-09T15:07:02.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.898+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13202710326786856044', time=2024-03-09T16:57:02.364855+0000, chain.objs.size()=1 2024-03-09T15:07:02.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.898+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.MS4ciiStWE2lAOodcjTB_Ju8A-tO-zW_0 2024-03-09T15:07:02.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.898+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10349944024973791913', time=2024-03-09T16:57:02.368006+0000, chain.objs.size()=1 2024-03-09T15:07:02.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.898+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.g4oapCaORHAkF9M8pjAR-GXzgkRt93v_0 2024-03-09T15:07:02.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.898+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1885187153314842597', time=2024-03-09T16:57:02.517107+0000, chain.objs.size()=1 2024-03-09T15:07:02.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.898+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.gYrxlSWf5yl-75cA-inLpQuJoIbEWBJ_0 2024-03-09T15:07:02.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/48936 2024-03-09T15:07:02.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-03-09T15:07:02.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4931483298986020668', time=2024-03-09T16:57:02.592939+0000, chain.objs.size()=1 2024-03-09T15:07:02.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.c9fQSjY4cp8s-UjI2lf5BqkV4FWBRkc_0 2024-03-09T15:07:02.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10339464482610068098', time=2024-03-09T16:57:02.633169+0000, chain.objs.size()=1 2024-03-09T15:07:02.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.BjIeIIfiYgEos91y81WXf7xrP551Z-j_0 2024-03-09T15:07:02.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5909188534895890394', time=2024-03-09T16:57:02.782431+0000, chain.objs.size()=1 2024-03-09T15:07:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.-6G_Y2l1UcRTTyx_AeKMAYtB8jcNrvV_0 2024-03-09T15:07:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17029434654461624023', time=2024-03-09T16:57:02.876375+0000, chain.objs.size()=1 2024-03-09T15:07:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.BcC9pWOV8YrTH-3rE-Ow53TYELpQv92_0 2024-03-09T15:07:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4216168812496669545', time=2024-03-09T16:57:03.001417+0000, chain.objs.size()=1 2024-03-09T15:07:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.zIoYQTAXt_86y7uZLiixwY5HKu4WsBu_0 2024-03-09T15:07:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3755402259890513720', time=2024-03-09T16:57:03.008918+0000, chain.objs.size()=1 2024-03-09T15:07:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.mJ1bIkXLIsb2FHpQN1ipFcW0ORjOyWZ_0 2024-03-09T15:07:02.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13916522570136718788', time=2024-03-09T16:57:03.117778+0000, chain.objs.size()=1 2024-03-09T15:07:02.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.a3v85_GPbW8a5ThIW6KuMyN8AdYnmJy_0 2024-03-09T15:07:02.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11207758551898722092', time=2024-03-09T16:57:03.279965+0000, chain.objs.size()=1 2024-03-09T15:07:02.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.aCn-0YFvKoAPpfBQRp_bUSdDeWFXNlz_0 2024-03-09T15:07:02.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.595960259625095482', time=2024-03-09T16:57:03.293153+0000, chain.objs.size()=1 2024-03-09T15:07:02.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.1RSHeWmg-QFxKmji2Oeq5reDclhEWY2_0 2024-03-09T15:07:02.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17202194589054695555', time=2024-03-09T16:57:03.322906+0000, chain.objs.size()=1 2024-03-09T15:07:02.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.YsOsn1XGcN3iqS8Tsj97ScF1jE7Xqil_0 2024-03-09T15:07:02.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12209093763947129927', time=2024-03-09T16:57:03.362924+0000, chain.objs.size()=1 2024-03-09T15:07:02.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.tf6-Wys2o20aidfRYk12XKZoAQr0Lpo_0 2024-03-09T15:07:02.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5055470779552897234', time=2024-03-09T16:57:03.392803+0000, chain.objs.size()=1 2024-03-09T15:07:02.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.pvOVDOFSyIi01761cHzX_4RHJxvW_S3_0 2024-03-09T15:07:02.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13600524314517265916', time=2024-03-09T16:57:03.570501+0000, chain.objs.size()=1 2024-03-09T15:07:02.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.biIAPUvswH0Xu2LMn8XqoqKFHs9UMW4_0 2024-03-09T15:07:02.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1976200956286638858', time=2024-03-09T16:57:21.850930+0000, chain.objs.size()=1 2024-03-09T15:07:02.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.339__shadow_.4S8pQPeP7gmkV8hEoZUHi-5MgQuJQGF_0 2024-03-09T15:07:02.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2829407155546689276', time=2024-03-09T16:58:45.241132+0000, chain.objs.size()=1 2024-03-09T15:07:02.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.427__shadow_.fo-BAuKM74jKWlYkPPHC6Hgc3Dl8Keq_0 2024-03-09T15:07:02.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13764502696699876609', time=2024-03-09T16:59:10.866273+0000, chain.objs.size()=1 2024-03-09T15:07:02.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.452__shadow_.OM5Bl8AhHYEb7biWZBRNVrwESvIvxaH_0 2024-03-09T15:07:02.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11026879278872446290', time=2024-03-09T16:59:31.475800+0000, chain.objs.size()=1 2024-03-09T15:07:02.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.477__shadow_.sGpqWJDbgtnoD1eLPNHvFK2brhgPXZx_0 2024-03-09T15:07:02.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5356412958887953194', time=2024-03-09T16:59:32.474249+0000, chain.objs.size()=1 2024-03-09T15:07:02.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.478__shadow_.3TGufnr06UcRS8Lb7Rf0XsWvlp-OGK1_0 2024-03-09T15:07:02.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.497__shadow:sTyMyf-pYbnbXvdieipjbZDtyAqnZAv_.YDOx1qoYlCKjXydeFP7D4JWYzcC9wbk_1_afc21b840df3bd0777a400fea348faeb', time=2024-03-09T16:59:49.031495+0000, chain.objs.size()=1 2024-03-09T15:07:02.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.497__shadow:sTyMyf-pYbnbXvdieipjbZDtyAqnZAv_.YDOx1qoYlCKjXydeFP7D4JWYzcC9wbk_0 2024-03-09T15:07:02.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~yZ7LdSHX-h7mxsWXGVTmn8d4ESeE1HV', time=2024-03-09T17:00:25.769864+0000, chain.objs.size()=1 2024-03-09T15:07:02.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~yZ7LdSHX-h7mxsWXGVTmn8d4ESeE1HV.1 2024-03-09T15:07:02.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~yZ7LdSHX-h7mxsWXGVTmn8d4ESeE1HV', time=2024-03-09T17:00:25.773622+0000, chain.objs.size()=1 2024-03-09T15:07:02.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~yZ7LdSHX-h7mxsWXGVTmn8d4ESeE1HV.2 2024-03-09T15:07:02.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~yZ7LdSHX-h7mxsWXGVTmn8d4ESeE1HV', time=2024-03-09T17:00:25.777501+0000, chain.objs.size()=1 2024-03-09T15:07:02.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~yZ7LdSHX-h7mxsWXGVTmn8d4ESeE1HV.3 2024-03-09T15:07:02.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~yZ7LdSHX-h7mxsWXGVTmn8d4ESeE1HV', time=2024-03-09T17:00:25.781260+0000, chain.objs.size()=1 2024-03-09T15:07:02.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~yZ7LdSHX-h7mxsWXGVTmn8d4ESeE1HV.4 2024-03-09T15:07:02.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~yZ7LdSHX-h7mxsWXGVTmn8d4ESeE1HV', time=2024-03-09T17:00:25.785194+0000, chain.objs.size()=1 2024-03-09T15:07:02.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~yZ7LdSHX-h7mxsWXGVTmn8d4ESeE1HV.5 2024-03-09T15:07:02.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~yZ7LdSHX-h7mxsWXGVTmn8d4ESeE1HV', time=2024-03-09T17:00:25.788593+0000, chain.objs.size()=1 2024-03-09T15:07:02.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~yZ7LdSHX-h7mxsWXGVTmn8d4ESeE1HV.6 2024-03-09T15:07:02.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~USA5O44DXfsroGqfrQDQD722xCRr3gv', time=2024-03-09T17:00:43.491471+0000, chain.objs.size()=1 2024-03-09T15:07:02.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.525__multipart_mymultipart2.2~USA5O44DXfsroGqfrQDQD722xCRr3gv.1 2024-03-09T15:07:02.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10192981110156464488', time=2024-03-09T17:01:25.725576+0000, chain.objs.size()=1 2024-03-09T15:07:02.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.543__shadow_.P4ivEJ-Eyfe1TPhxtfAKDgWscynlCvj_0 2024-03-09T15:07:02.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5135087943649947447', time=2024-03-09T17:01:37.536606+0000, chain.objs.size()=1 2024-03-09T15:07:02.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.552__shadow_.eEqwaWebzrWGDgSgl6uYJPyIRkHOPHv_0 2024-03-09T15:07:02.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6621352500780459852', time=2024-03-09T17:01:54.397654+0000, chain.objs.size()=1 2024-03-09T15:07:02.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:XLdshXZ4I1WodJXZVB8Cz82gdeYvldb_._NdIvjk9vsQZ5cfFqkHR2UrqMUW4jjm_0 2024-03-09T15:07:02.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.918+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9156691847135096171', time=2024-03-09T17:01:56.584674+0000, chain.objs.size()=1 2024-03-09T15:07:02.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.918+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:7Ivq0izH6N0YwSD0loNnjc4BSxqNWVR_.SbXHE9lThFcNFvk52fravMUr8bBs1G4_0 2024-03-09T15:07:02.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.918+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13293255579519781341', time=2024-03-09T17:02:06.188130+0000, chain.objs.size()=1 2024-03-09T15:07:02.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.918+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.567__shadow:BaepX8bfk7Lr2mQWuGmeFzxEaBgT.Er_.bcVh_y4NcRE3kRWshEmg9zzv1XurfMt_0 2024-03-09T15:07:02.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.918+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4592305857638154341', time=2024-03-09T17:02:11.181758+0000, chain.objs.size()=1 2024-03-09T15:07:02.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.918+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.569__shadow:MtBdG9dUD1ubvLYTiy8iXx.qZp300aT_.HthheCGl3cMrCAKx9IsYBcKvA-owKls_0 2024-03-09T15:07:02.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.918+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18067369145497625558', time=2024-03-09T17:02:13.612448+0000, chain.objs.size()=1 2024-03-09T15:07:02.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.918+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.569__shadow:dZwD8IhAik6.x3Mf4beRKooLA2gx3N8_.qcaux-_g0hvWDFx90-tzZTDR_TDv4TS_0 2024-03-09T15:07:02.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.918+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15031511022416429807', time=2024-03-09T17:02:13.946547+0000, chain.objs.size()=1 2024-03-09T15:07:02.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.918+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.569__shadow:rs2iuX6OadWcG8s3pPXoZp9SA3T.JXe_.FjcejkI0HJNrlA53i_CA6S0bBvx2JIw_0 2024-03-09T15:07:02.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15281185833238855019', time=2024-03-09T17:02:24.951622+0000, chain.objs.size()=1 2024-03-09T15:07:02.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:8C9iND555kdhX-vNaLil.EEmQ2TKmNo_.SHpsnVggWfPFZnGUdflE4Cb61xu4SW2_0 2024-03-09T15:07:02.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14943758632677807224', time=2024-03-09T17:02:46.561580+0000, chain.objs.size()=1 2024-03-09T15:07:02.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.580__shadow:ko4Lu49Ao1h06RUw7qs.XQph-DRREfz_.3Qhz3ysa_-ftFM-tAtTbVD5Qjl6ZTL2_0 2024-03-09T15:07:02.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7918850322812888054', time=2024-03-09T17:04:08.602110+0000, chain.objs.size()=1 2024-03-09T15:07:02.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.652__shadow_.dfIjI2r-l3Tfe336OysPjaawRf5ADQ1_0 2024-03-09T15:07:02.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1081602869065208531', time=2024-03-09T17:04:40.906350+0000, chain.objs.size()=1 2024-03-09T15:07:02.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.690__shadow:ETPBu8TDkrK8zVekCQzWfKFhoWK2kdf_.nn0tkTNktaEhjPbAIGP2f5FYGD3aF_R_0 2024-03-09T15:07:02.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.930+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:02.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.934+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-09T15:07:02.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:02.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:02.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/41975' 2024-03-09T15:07:02.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3817675911825514188', time=2024-03-09T16:51:44.787065+0000, chain.objs.size()=1 2024-03-09T15:07:02.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.148__shadow_.-lol4azlpQvT8V_OxE82IvRse2PQmLS_0 2024-03-09T15:07:02.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.758416259409003174', time=2024-03-09T16:51:54.888669+0000, chain.objs.size()=3 2024-03-09T15:07:02.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__multipart_foo-FROZEN.2~9DK97AvMoQA4LwDl-As-QrKXLf-xXH2.1 2024-03-09T15:07:02.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__multipart_foo-FROZEN.2~9DK97AvMoQA4LwDl-As-QrKXLf-xXH2.2 2024-03-09T15:07:02.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__multipart_foo-FROZEN.2~9DK97AvMoQA4LwDl-As-QrKXLf-xXH2.3 2024-03-09T15:07:02.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13525353161410839106', time=2024-03-09T16:51:57.907772+0000, chain.objs.size()=1 2024-03-09T15:07:02.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.160__shadow_.hKOuO8o9z3QHDz3rM4aICHnW-l4-WKH_0 2024-03-09T15:07:02.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11965446106421459717', time=2024-03-09T16:52:13.691579+0000, chain.objs.size()=1 2024-03-09T15:07:02.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.175__shadow_.BK_8sWSKbejpxELbbfLsYTPpwn9knny_0 2024-03-09T15:07:02.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1044510672151103676', time=2024-03-09T16:54:25.615129+0000, chain.objs.size()=1 2024-03-09T15:07:02.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.228__shadow_.ZLD93pNV3u_Ww4B7dgzcZ94wlQYjMis_0 2024-03-09T15:07:02.941 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.561675648968399109', time=2024-03-09T16:54:35.460028+0000, chain.objs.size()=1 2024-03-09T15:07:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.237__shadow_.vCGhOiBFael2sOm8sTfXUm9v9tt2i-B_0 2024-03-09T15:07:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1380847273197030009', time=2024-03-09T16:54:36.865520+0000, chain.objs.size()=1 2024-03-09T15:07:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.238__shadow_.of0E555lijc868dELCaUuz6n9oKgsZl_0 2024-03-09T15:07:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5454736868434701582', time=2024-03-09T16:55:14.878789+0000, chain.objs.size()=1 2024-03-09T15:07:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.LmOnd81TWtrdAKVBYJtu9UxeM_4aOTg_0 2024-03-09T15:07:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7430573857754530576', time=2024-03-09T16:55:14.943536+0000, chain.objs.size()=1 2024-03-09T15:07:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.E1G7FMMBiKU0mbUR12I-2KYXPYhhLh5_0 2024-03-09T15:07:02.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10227197286416225110', time=2024-03-09T16:55:14.966342+0000, chain.objs.size()=1 2024-03-09T15:07:02.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.938+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.xoYVy3MYdpfl0nC8p49MjY5Ecyp50dy_0 2024-03-09T15:07:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15884048799275447645', time=2024-03-09T16:55:15.140030+0000, chain.objs.size()=1 2024-03-09T15:07:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.FGLBwVEk8hpswLFjESkRHsT97XM_I0i_0 2024-03-09T15:07:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16518447871743791098', time=2024-03-09T16:55:15.143583+0000, chain.objs.size()=1 2024-03-09T15:07:02.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.mariQwzXxhKjsdW3R0qLdnozO1Mrnlh_0 2024-03-09T15:07:02.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16325156080458426274', time=2024-03-09T16:55:15.145687+0000, chain.objs.size()=1 2024-03-09T15:07:02.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qfCeTIhbvqJT65TLHodRqBIHveRKweB_0 2024-03-09T15:07:02.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14630255834862421550', time=2024-03-09T16:55:15.148398+0000, chain.objs.size()=1 2024-03-09T15:07:02.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.1TW8up5c172TkV_Zn93u9f3mV4hC1nv_0 2024-03-09T15:07:02.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7690249324782128350', time=2024-03-09T16:55:15.243977+0000, chain.objs.size()=1 2024-03-09T15:07:02.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.I2b8AyI2F1oHbeS4UE68Rp9Mi3OrAgH_0 2024-03-09T15:07:02.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10673010284409627050', time=2024-03-09T16:55:15.292221+0000, chain.objs.size()=1 2024-03-09T15:07:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.uvIxXT4v07aw2dIW0RwemfCm1hAdr4e_0 2024-03-09T15:07:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15246414594684474328', time=2024-03-09T16:55:15.448976+0000, chain.objs.size()=1 2024-03-09T15:07:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.YEp4OE6Vqu6JgXyNlDGa_mAuStZdTyf_0 2024-03-09T15:07:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2412479700813269394', time=2024-03-09T16:55:15.460808+0000, chain.objs.size()=1 2024-03-09T15:07:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qdVHoHjNdLaXY_bpyPPHersszJkE7vc_0 2024-03-09T15:07:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10657236167726214188', time=2024-03-09T16:55:15.488893+0000, chain.objs.size()=1 2024-03-09T15:07:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.RzzDAKbOhvQGmy_pThQ7Ga81bpHt24V_0 2024-03-09T15:07:02.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3692147969053587202', time=2024-03-09T16:55:15.498641+0000, chain.objs.size()=1 2024-03-09T15:07:02.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.UUFpYR9KFNKKWQQpYz6YeeVcwNKuiUP_0 2024-03-09T15:07:02.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4908549518871890594', time=2024-03-09T16:55:15.737023+0000, chain.objs.size()=1 2024-03-09T15:07:02.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.868nz1jnRZFVBQonRfh0Mo6VNVxugMH_0 2024-03-09T15:07:02.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1549279854789508200', time=2024-03-09T16:55:15.776339+0000, chain.objs.size()=1 2024-03-09T15:07:02.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.-ViNGT96ywhhFFlxMOW_YS41ozy0HHs_0 2024-03-09T15:07:02.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14260604784406997901', time=2024-03-09T16:55:15.939563+0000, chain.objs.size()=1 2024-03-09T15:07:02.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.9JRlDz0x6oY_Mqh1Hr8tgQ8dzBSS5nn_0 2024-03-09T15:07:02.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13643478025870668624', time=2024-03-09T16:55:15.964427+0000, chain.objs.size()=1 2024-03-09T15:07:02.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.cIdPSGAF1XLePI8G-SxwDcqRR_7XsiV_0 2024-03-09T15:07:02.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12727643579400801572', time=2024-03-09T16:55:15.969441+0000, chain.objs.size()=1 2024-03-09T15:07:02.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.YUB0fpWl88TrFE3ae44fNHQxdbUcUUX_0 2024-03-09T15:07:02.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1178726602886221132', time=2024-03-09T16:55:15.970739+0000, chain.objs.size()=1 2024-03-09T15:07:02.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.JstiPbgA2GvlgBmSUCjKDwkXdyQSPu-_0 2024-03-09T15:07:02.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4117166159661694653', time=2024-03-09T16:55:16.032377+0000, chain.objs.size()=1 2024-03-09T15:07:02.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Uo1wKcN3z3kDniPV5fMxbmJw8L2SPMo_0 2024-03-09T15:07:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4866841177391257058', time=2024-03-09T16:55:16.040229+0000, chain.objs.size()=1 2024-03-09T15:07:02.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.-tX9ec6tQbQ36F6Al_QDVeYF_jFP9Ia_0 2024-03-09T15:07:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1291022584176152938', time=2024-03-09T16:55:16.362683+0000, chain.objs.size()=1 2024-03-09T15:07:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Rn2WjOf-ZWD6ijhWatP1cHDw0oabe4P_0 2024-03-09T15:07:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17376795088303621992', time=2024-03-09T16:55:16.486788+0000, chain.objs.size()=1 2024-03-09T15:07:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.QEFc-I10mTPH6Nh-5cxExNUxr5Ubo6W_0 2024-03-09T15:07:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5896580375050515360', time=2024-03-09T16:55:16.515218+0000, chain.objs.size()=1 2024-03-09T15:07:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.hUgXj0zVJrNTI2H5BDa4d7h02FdIwjS_0 2024-03-09T15:07:02.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5358206894866472110', time=2024-03-09T16:55:16.524913+0000, chain.objs.size()=1 2024-03-09T15:07:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.1yl_qxtWQjq9D8mcUGsU5b4cg2JI4zV_0 2024-03-09T15:07:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16209648192263280605', time=2024-03-09T16:55:16.555590+0000, chain.objs.size()=1 2024-03-09T15:07:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.AIuN12O_WPouQRxGeft58jxCBFPRbKP_0 2024-03-09T15:07:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14618606029306754979', time=2024-03-09T16:55:16.757300+0000, chain.objs.size()=1 2024-03-09T15:07:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Uou_l0ocFe2DBytUdLojnOe4obnxSoU_0 2024-03-09T15:07:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16219935900559021577', time=2024-03-09T16:55:16.785596+0000, chain.objs.size()=1 2024-03-09T15:07:02.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.xC1-lQkzkHuEQh2MFOTNAARhaIGY4s3_0 2024-03-09T15:07:02.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12477365628043597721', time=2024-03-09T16:55:25.969285+0000, chain.objs.size()=1 2024-03-09T15:07:02.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.266__shadow_.JJuqiSs5mSEp7WqaHIjtDUfqk8hZ0gm_0 2024-03-09T15:07:02.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5617501659456246597', time=2024-03-09T16:55:25.971151+0000, chain.objs.size()=1 2024-03-09T15:07:02.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.266__shadow_.6hvT_EHQjHFTyP3xq7sCxGPxjyJ60fz_0 2024-03-09T15:07:02.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9746948019136635484', time=2024-03-09T16:55:26.881192+0000, chain.objs.size()=1 2024-03-09T15:07:02.966 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.267__shadow_.T4Eg2LSxEe0YkVYEqQF8zkpTp6xooMq_0 2024-03-09T15:07:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2660873781020449530', time=2024-03-09T16:55:31.591942+0000, chain.objs.size()=1 2024-03-09T15:07:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.272__shadow_.VDhVSPR_EHlwMDxKuedKrNmdke65cel_0 2024-03-09T15:07:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17362402709919277867', time=2024-03-09T16:55:34.389136+0000, chain.objs.size()=1 2024-03-09T15:07:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.275__shadow_.7LYo8gpXVZJPRVdwDCSFBtyYfOA9ycG_0 2024-03-09T15:07:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15706765369727908017', time=2024-03-09T16:55:46.200615+0000, chain.objs.size()=1 2024-03-09T15:07:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.k3jn8rQI19LaO_tRVEsjCTvC8eyXK-8_0 2024-03-09T15:07:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5490288744878802721', time=2024-03-09T16:55:47.847940+0000, chain.objs.size()=1 2024-03-09T15:07:02.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.HbzA6lsQmZdycvryRHGh0SRGJ4QMUJG_0 2024-03-09T15:07:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5391894901979785582', time=2024-03-09T16:55:53.606456+0000, chain.objs.size()=1 2024-03-09T15:07:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.293__shadow_.yCp7fL6qUnf4EqNKOoTFVKieAHrEqDS_0 2024-03-09T15:07:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16142280293440865548', time=2024-03-09T16:56:01.752253+0000, chain.objs.size()=1 2024-03-09T15:07:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.301__shadow:ZKo2DUlYvcqfwNEB44C71w4Bb2hhWIX_.rYGu7xs1BhqhvflVvIImq7GFLYdr_kR_0 2024-03-09T15:07:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1413781765351344423', time=2024-03-09T16:56:37.738815+0000, chain.objs.size()=1 2024-03-09T15:07:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Zi6qOFUTUjgxmZhOTbmCjhhoZIoxlou_0 2024-03-09T15:07:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11400735547535183005', time=2024-03-09T16:56:37.749797+0000, chain.objs.size()=1 2024-03-09T15:07:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ukC43lvPLgKaKu97i2Z0tEeTWM_68DG_0 2024-03-09T15:07:02.968 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5791216969755898281', time=2024-03-09T16:56:37.824269+0000, chain.objs.size()=1 2024-03-09T15:07:02.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.966+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_._Af8lO30QZzyCfJPVqBUXCvJuf-by56_0 2024-03-09T15:07:02.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6935902548666822730', time=2024-03-09T16:56:37.970837+0000, chain.objs.size()=1 2024-03-09T15:07:02.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.qzExoUid3cw1CQBq8CjcoJtYi37nMaA_0 2024-03-09T15:07:02.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12308873951533653876', time=2024-03-09T16:56:38.004871+0000, chain.objs.size()=1 2024-03-09T15:07:02.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.gIhgpx31Wie-9i2vunW2z9Hwrg5jWsA_0 2024-03-09T15:07:02.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16294782136846892681', time=2024-03-09T16:56:38.021619+0000, chain.objs.size()=1 2024-03-09T15:07:02.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.WT4kEKABVoGby9TR5DU32XhpZkbAClV_0 2024-03-09T15:07:02.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14075471564240630010', time=2024-03-09T16:56:38.105071+0000, chain.objs.size()=1 2024-03-09T15:07:02.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.uyrSy1tXOy7vbYtqkTtHttIQsVpaTC7_0 2024-03-09T15:07:02.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13541886344341905225', time=2024-03-09T16:56:38.264776+0000, chain.objs.size()=1 2024-03-09T15:07:02.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.O8KJCRLfd0Kg2KJJAAxTunbGjt_rgGC_0 2024-03-09T15:07:02.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6526411175032445214', time=2024-03-09T16:56:38.312197+0000, chain.objs.size()=1 2024-03-09T15:07:02.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.vTHGpqJ-q_4Vz42fgWrlgAjgWi_h_VG_0 2024-03-09T15:07:02.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16236612542962866261', time=2024-03-09T16:56:38.330671+0000, chain.objs.size()=1 2024-03-09T15:07:02.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-hh-gaArgmePOwMfCav7nxs2MWxKcFp_0 2024-03-09T15:07:02.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4314033500546531607', time=2024-03-09T16:56:38.379371+0000, chain.objs.size()=1 2024-03-09T15:07:02.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.esdQLSvEJB59y7-3diEzlvvm3RmQRiJ_0 2024-03-09T15:07:02.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5392517443033639817', time=2024-03-09T16:56:38.391512+0000, chain.objs.size()=1 2024-03-09T15:07:02.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.xhNrJsBNBuDjlilCfynb8eYgVYrrSjP_0 2024-03-09T15:07:02.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7275460819155022264', time=2024-03-09T16:56:38.535160+0000, chain.objs.size()=1 2024-03-09T15:07:02.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.LlJmpGabcTptzNQOaBts9-dmz7TMSQz_0 2024-03-09T15:07:02.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2915315411483687262', time=2024-03-09T16:56:38.783407+0000, chain.objs.size()=1 2024-03-09T15:07:02.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.1KXITBYRgmpibwyEKGY8WlROSYD7jGl_0 2024-03-09T15:07:02.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2540693157326837724', time=2024-03-09T16:56:38.930287+0000, chain.objs.size()=1 2024-03-09T15:07:02.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.FcXyQ5SPdihL_nHK92TM8AfCWWeU788_0 2024-03-09T15:07:02.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1930058543917883793', time=2024-03-09T16:56:38.931040+0000, chain.objs.size()=1 2024-03-09T15:07:02.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.CgY8L61N8ZplwHwR4iYmo6-UxI-wfNb_0 2024-03-09T15:07:02.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1592822752219729147', time=2024-03-09T16:56:39.052683+0000, chain.objs.size()=1 2024-03-09T15:07:02.981 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.d3Ffx63C7-E0R6KFE79fbBmcEfpkvGI_0 2024-03-09T15:07:02.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17558427290021273183', time=2024-03-09T16:56:39.085070+0000, chain.objs.size()=1 2024-03-09T15:07:02.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.S42HZaYJfBDT2m2yd4zbdTKlkxbNTVs_0 2024-03-09T15:07:02.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.894484997700058088', time=2024-03-09T16:56:39.127062+0000, chain.objs.size()=1 2024-03-09T15:07:02.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6VHiKQ9GKHD7UEOwKgyW0oA54IljbiW_0 2024-03-09T15:07:02.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16857503435998431509', time=2024-03-09T16:56:39.388666+0000, chain.objs.size()=1 2024-03-09T15:07:02.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.UlJFUJBWG6WuEaaV0d9q19wofoHCK_F_0 2024-03-09T15:07:02.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14819464132561150254', time=2024-03-09T16:56:39.425342+0000, chain.objs.size()=1 2024-03-09T15:07:02.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.NsF3o1Xd3PLUIIKEzO06Y6ROF_CqzNU_0 2024-03-09T15:07:02.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14010432745624669169', time=2024-03-09T16:56:39.629615+0000, chain.objs.size()=1 2024-03-09T15:07:02.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.X-S-nzD0cI_WMMidImUpNNpnO2pJRRX_0 2024-03-09T15:07:02.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17993243734916857946', time=2024-03-09T16:57:01.430633+0000, chain.objs.size()=1 2024-03-09T15:07:02.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Qtgcs_AcOgBYK1DB8n31SL-yU_UxtsI_0 2024-03-09T15:07:02.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14661896037083630646', time=2024-03-09T16:57:01.450791+0000, chain.objs.size()=1 2024-03-09T15:07:02.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.WBM2yb2zMZDRx7eylxHOvCM2b4ZIwh8_0 2024-03-09T15:07:02.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17155348372067444282', time=2024-03-09T16:57:01.485335+0000, chain.objs.size()=1 2024-03-09T15:07:02.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oD7ke_Hhe-BXfcunizlEiInyxF_3yAY_0 2024-03-09T15:07:02.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7465750645326975764', time=2024-03-09T16:57:01.491124+0000, chain.objs.size()=1 2024-03-09T15:07:02.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.VuFWH64rbyubNpDogYKFO5o3agmZM_Z_0 2024-03-09T15:07:02.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10447115147687300865', time=2024-03-09T16:57:01.534636+0000, chain.objs.size()=1 2024-03-09T15:07:02.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xHqfeYMpPwJmn0wnDcZ6h6nGNGaEoSt_0 2024-03-09T15:07:02.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9661214082253908867', time=2024-03-09T16:57:01.543655+0000, chain.objs.size()=1 2024-03-09T15:07:02.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.zGxd42qJkAup7O6K_BY5i2b6x_K1WhK_0 2024-03-09T15:07:02.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16513914616399747311', time=2024-03-09T16:57:01.720247+0000, chain.objs.size()=1 2024-03-09T15:07:02.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.FMwohRGO0Q2uEB6pvGdMXu-qWwOH1-l_0 2024-03-09T15:07:02.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17063766117135703497', time=2024-03-09T16:57:01.805292+0000, chain.objs.size()=1 2024-03-09T15:07:02.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_._-4vtL2etUVInk-CgjwJ7d9Zj0heY0j_0 2024-03-09T15:07:02.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.123191812321485571', time=2024-03-09T16:57:01.843986+0000, chain.objs.size()=1 2024-03-09T15:07:02.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Q8vIBcVRlGhj2KF50IsJQ5xUDJngTa__0 2024-03-09T15:07:02.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13027495036813193443', time=2024-03-09T16:57:01.844986+0000, chain.objs.size()=1 2024-03-09T15:07:02.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.NqXpsc9ZQ9EJADyL1KSXqjI0GA6ZCig_0 2024-03-09T15:07:02.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15701993091140927165', time=2024-03-09T16:57:02.014522+0000, chain.objs.size()=1 2024-03-09T15:07:02.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.MAPO58QW41cn1MG4S9eyTIuaibNa6Sd_0 2024-03-09T15:07:02.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13459232238791548871', time=2024-03-09T16:57:02.057175+0000, chain.objs.size()=1 2024-03-09T15:07:02.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.MsvXagVsudJJhBnCs1AMcUp9ruu48uy_0 2024-03-09T15:07:02.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.994+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.922302700654719578', time=2024-03-09T16:57:02.258600+0000, chain.objs.size()=1 2024-03-09T15:07:02.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.994+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Sb09B4KDE2s1yiiW5U2ieXyIDAFxhy7_0 2024-03-09T15:07:02.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.994+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.187549555463744756', time=2024-03-09T16:57:02.348341+0000, chain.objs.size()=1 2024-03-09T15:07:02.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.994+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.tJHLrKiH_bIeAm-gA3IWinGnCfdQioh_0 2024-03-09T15:07:02.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.994+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8712000222338323989', time=2024-03-09T16:57:02.510807+0000, chain.objs.size()=1 2024-03-09T15:07:02.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.994+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_._pG4jW2n576_Nd8rd1nj4f1o8rcQedQ_0 2024-03-09T15:07:02.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.994+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16273238345728554964', time=2024-03-09T16:57:02.551058+0000, chain.objs.size()=1 2024-03-09T15:07:02.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.994+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DQKQLiX_jAQBuaG8wm2FSNyr0uPoYZJ_0 2024-03-09T15:07:02.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.994+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9482135151200020086', time=2024-03-09T16:57:02.553838+0000, chain.objs.size()=1 2024-03-09T15:07:02.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.994+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.I28I4qJt5hm3nuLUPhPNjF9Aw2x07s7_0 2024-03-09T15:07:02.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.994+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1170829026087312713', time=2024-03-09T16:57:02.583907+0000, chain.objs.size()=1 2024-03-09T15:07:02.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.994+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.rsDpXYg3iAZvchRMq_Zorm6cs3n_XYf_0 2024-03-09T15:07:02.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1926442921959975489', time=2024-03-09T16:57:02.595304+0000, chain.objs.size()=1 2024-03-09T15:07:02.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.CEjXpuvxKluShMGFzFOEwTGI68PejuG_0 2024-03-09T15:07:02.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10597332542388805287', time=2024-03-09T16:57:02.836291+0000, chain.objs.size()=1 2024-03-09T15:07:02.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.kOZWGXerAntN-6ud9h_L4T5ImX3fn64_0 2024-03-09T15:07:02.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11884927017904087716', time=2024-03-09T16:57:03.012721+0000, chain.objs.size()=1 2024-03-09T15:07:02.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.FTJbEIxyKKKY2KveYjOCrs5pFIvjEZM_0 2024-03-09T15:07:02.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16613825146526299707', time=2024-03-09T16:57:03.033552+0000, chain.objs.size()=1 2024-03-09T15:07:02.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.VXhE72JFh1WmyaCRvVne1wW_LkeE1jM_0 2024-03-09T15:07:02.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16224846634942708698', time=2024-03-09T16:57:03.111091+0000, chain.objs.size()=1 2024-03-09T15:07:02.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_._sOcknASv5OYKwPvKMrindb61ll3SkC_0 2024-03-09T15:07:02.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4772044028381172287', time=2024-03-09T16:57:03.267091+0000, chain.objs.size()=1 2024-03-09T15:07:03.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.1Y0JyiLDZIacLhrIecqSU4Ew_JgukqT_0 2024-03-09T15:07:03.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8965852555054719926', time=2024-03-09T16:57:03.320304+0000, chain.objs.size()=1 2024-03-09T15:07:03.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:02.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Ck8n3jedpm5srzdc_019snA3ydYgW25_0 2024-03-09T15:07:03.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.002+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11179054167481987820', time=2024-03-09T16:57:03.374801+0000, chain.objs.size()=1 2024-03-09T15:07:03.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.002+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.kSh4iSoHBUX_UMrLHZlJtid3-GLf8wD_0 2024-03-09T15:07:03.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.002+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4681513586958871331', time=2024-03-09T16:57:03.402579+0000, chain.objs.size()=1 2024-03-09T15:07:03.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.002+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.cGMlnXTVzPRejnHjYBB-ZXd6Ytrj1FH_0 2024-03-09T15:07:03.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.002+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17578312865042221131', time=2024-03-09T16:57:51.125446+0000, chain.objs.size()=1 2024-03-09T15:07:03.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.002+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.372__shadow_.BoWdMCc7ZRRiLLeVU9u0QAw-fxnt3A-_0 2024-03-09T15:07:03.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.002+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7558770976084652482', time=2024-03-09T16:59:18.295654+0000, chain.objs.size()=1 2024-03-09T15:07:03.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.002+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.458__shadow_.HAU4JjPOJDYohXKjtDBcCl31YW1l7KB_0 2024-03-09T15:07:03.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10111505338104736458', time=2024-03-09T16:59:19.519724+0000, chain.objs.size()=1 2024-03-09T15:07:03.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.459__shadow_.z-fwLd67l_jLK6f5N-SfHFIyUnkjrkn_0 2024-03-09T15:07:03.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6980979753565795799', time=2024-03-09T16:59:31.482667+0000, chain.objs.size()=1 2024-03-09T15:07:03.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.477__shadow_.Q7G3ygnr6Z-9tULVA5vKQ8GcNDBD_wG_0 2024-03-09T15:07:03.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14523152086610573817', time=2024-03-09T16:59:32.471436+0000, chain.objs.size()=1 2024-03-09T15:07:03.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.478__shadow_.GkQJ-S_QFyslb-YWDgn9mQVXxUgL1Q9_0 2024-03-09T15:07:03.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2708858965675525184', time=2024-03-09T16:59:45.126870+0000, chain.objs.size()=1 2024-03-09T15:07:03.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.493__shadow_.Ujmc3mZsgCmDrUvQR3zInXsAXOB7hXc_0 2024-03-09T15:07:03.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8249979475795684', time=2024-03-09T17:00:40.025670+0000, chain.objs.size()=2 2024-03-09T15:07:03.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.522__multipart_mymultipart.2~yq8FvDzVIw3YsfPBQOJvNU8fiD784lH.1 2024-03-09T15:07:03.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.522__multipart_mymultipart.2~yq8FvDzVIw3YsfPBQOJvNU8fiD784lH.2 2024-03-09T15:07:03.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.014+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/41975 2024-03-09T15:07:03.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.018+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-03-09T15:07:03.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='6pnfgfyf0afgo3saipffh4699f2b0wwx', time=2024-03-09T17:02:09.821738+0000, chain.objs.size()=1 2024-03-09T15:07:03.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.568__shadow_.y7Q5juzCKf6UzLPrH49T9rLe1JWcPCW_0 2024-03-09T15:07:03.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5512458626869226676', time=2024-03-09T17:03:00.064238+0000, chain.objs.size()=1 2024-03-09T15:07:03.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.596__shadow_.nNXtI2hEEicKQXfscixhssdSBCIkup0_0 2024-03-09T15:07:03.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2845235923969130535', time=2024-03-09T17:03:04.536776+0000, chain.objs.size()=1 2024-03-09T15:07:03.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.601__shadow_.6r6p0bX3QXwF3Xa-Cz0O-tGZKWdcxQf_0 2024-03-09T15:07:03.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7126259454162926138', time=2024-03-09T17:03:45.266380+0000, chain.objs.size()=1 2024-03-09T15:07:03.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.630__shadow_.K5ejtBgrLVQMinc8rnenoERYSL9AbzO_0 2024-03-09T15:07:03.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14318514223643629736', time=2024-03-09T17:04:10.927400+0000, chain.objs.size()=1 2024-03-09T15:07:03.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.654__shadow_.d_Y85vQ0htKv183hHtJHcu7yhmJA-vg_0 2024-03-09T15:07:03.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3961598894651353693', time=2024-03-09T17:04:48.278000+0000, chain.objs.size()=1 2024-03-09T15:07:03.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.698__shadow:iOH.KkGdxNb4nbY7UIUCB2CP.m-4Rw1_.3cwxs7pNhqeEAU3a-wTo_urv6O0niSg_0 2024-03-09T15:07:03.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1053833038190662123', time=2024-03-09T17:05:56.205196+0000, chain.objs.size()=1 2024-03-09T15:07:03.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.733__shadow_.VQjc5m2YwtnTXvpkqrcuyKknDBa5hv__0 2024-03-09T15:07:03.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.026+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:03.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.034+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-09T15:07:03.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.034+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:03.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.034+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/40850' 2024-03-09T15:07:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2197485673678627254', time=2024-03-09T16:51:52.151773+0000, chain.objs.size()=2 2024-03-09T15:07:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.154__shadow_.Qk0oQigqzi5KmS9Nj73pPtY-bDGF5bc_0 2024-03-09T15:07:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.154__shadow_.Qk0oQigqzi5KmS9Nj73pPtY-bDGF5bc_1 2024-03-09T15:07:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5782781244375920815', time=2024-03-09T16:54:37.854857+0000, chain.objs.size()=1 2024-03-09T15:07:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.239__shadow_.u-3PqirfwQQNnjJ6jLo9v1ncv31bnSz_0 2024-03-09T15:07:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16253357194558557002', time=2024-03-09T16:55:14.891610+0000, chain.objs.size()=1 2024-03-09T15:07:03.037 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Q4Qy0kCtmc3Mgc8qTDaUivgfOoLyXoH_0 2024-03-09T15:07:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9804027075783053579', time=2024-03-09T16:55:14.898787+0000, chain.objs.size()=1 2024-03-09T15:07:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.LxaKbSGCWK6A-gUQltmrY2CrO-tyXae_0 2024-03-09T15:07:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4460197052200137674', time=2024-03-09T16:55:14.922197+0000, chain.objs.size()=1 2024-03-09T15:07:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.-QNEXTYGlrO4jPcwNIzrvKK-MJCaK7T_0 2024-03-09T15:07:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6381697557702259740', time=2024-03-09T16:55:14.989428+0000, chain.objs.size()=1 2024-03-09T15:07:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.C8AReIWrYOo-fkJWUSNVxyNpmKTl84k_0 2024-03-09T15:07:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10249476916417316436', time=2024-03-09T16:55:14.991493+0000, chain.objs.size()=1 2024-03-09T15:07:03.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.X-o2YZY5yaZuLU2kess0D-0TujuT0yd_0 2024-03-09T15:07:03.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11745049857211937805', time=2024-03-09T16:55:15.012061+0000, chain.objs.size()=1 2024-03-09T15:07:03.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.tQeQlwyulyrigt3La95bsABrGmfYbEu_0 2024-03-09T15:07:03.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11000659434367459357', time=2024-03-09T16:55:15.171328+0000, chain.objs.size()=1 2024-03-09T15:07:03.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.7Hl6sxls91unvACuSPU16GAJffQYvSB_0 2024-03-09T15:07:03.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2409652237291651138', time=2024-03-09T16:55:15.191889+0000, chain.objs.size()=1 2024-03-09T15:07:03.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.X42LEKAPOyOuwYP1gdGCjhHHcZMenZV_0 2024-03-09T15:07:03.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2272112811232764227', time=2024-03-09T16:55:15.195165+0000, chain.objs.size()=1 2024-03-09T15:07:03.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.uI_pNstniFk0bxIjgxjeTtaEe10qT-z_0 2024-03-09T15:07:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12019494642640926141', time=2024-03-09T16:55:15.206175+0000, chain.objs.size()=1 2024-03-09T15:07:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.wvBqOx7GMLCvpmvOn_b_DtjtJcmUTuV_0 2024-03-09T15:07:03.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15098520243565650739', time=2024-03-09T16:55:15.240528+0000, chain.objs.size()=1 2024-03-09T15:07:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.3fclv1-r49DHl9uVkgJnUc_kNezWq_7_0 2024-03-09T15:07:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.769363967609000060', time=2024-03-09T16:55:15.257407+0000, chain.objs.size()=1 2024-03-09T15:07:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.SLlssUzYJPkSJsJ4biw8ag17cEGCly1_0 2024-03-09T15:07:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1369457553568743527', time=2024-03-09T16:55:15.259232+0000, chain.objs.size()=1 2024-03-09T15:07:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.JKv6hym9Yr4SGnDfqvDwMTxTxa_09qr_0 2024-03-09T15:07:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12113090288769995171', time=2024-03-09T16:55:15.284563+0000, chain.objs.size()=1 2024-03-09T15:07:03.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.KjVNc7geNi1IlSLHe_P1bh56BoZP63a_0 2024-03-09T15:07:03.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1101124245189297691', time=2024-03-09T16:55:15.452056+0000, chain.objs.size()=1 2024-03-09T15:07:03.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.X7gwc2VZn5wBisNRYMpOIyE6YypwPiH_0 2024-03-09T15:07:03.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7559918376986755794', time=2024-03-09T16:55:15.525477+0000, chain.objs.size()=1 2024-03-09T15:07:03.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.JIKeboKZ_yPSHOkRXmm-es2RnpwJAEH_0 2024-03-09T15:07:03.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16246839940855885181', time=2024-03-09T16:55:15.538708+0000, chain.objs.size()=1 2024-03-09T15:07:03.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.WZ2vf_2Z82JCsmHgKSgcwe-GYcKFbRh_0 2024-03-09T15:07:03.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16479073498180626000', time=2024-03-09T16:55:15.735409+0000, chain.objs.size()=1 2024-03-09T15:07:03.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.RSr3i_jCxZUCprN-5Xw8_VrFc75shLD_0 2024-03-09T15:07:03.047 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3299968577979608485', time=2024-03-09T16:55:15.764327+0000, chain.objs.size()=1 2024-03-09T15:07:03.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.s9Vr0rDFaUTtF38ceaR88aH8UiNPwVM_0 2024-03-09T15:07:03.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7861217238967068236', time=2024-03-09T16:55:15.772444+0000, chain.objs.size()=1 2024-03-09T15:07:03.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.UNEvFIiWDns0Ez66TCvOKg8xMjyqJ_t_0 2024-03-09T15:07:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14961153528083195900', time=2024-03-09T16:55:15.805424+0000, chain.objs.size()=1 2024-03-09T15:07:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.MlgWgAPFocbqCxT0AfQbT6QkKxxWstw_0 2024-03-09T15:07:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13355468141509395318', time=2024-03-09T16:55:15.941416+0000, chain.objs.size()=1 2024-03-09T15:07:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qIKxZBqEpJEZC1VHMXFdTPlzTGbBPxc_0 2024-03-09T15:07:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3424839396350369318', time=2024-03-09T16:55:16.004081+0000, chain.objs.size()=1 2024-03-09T15:07:03.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qE8X-kPoGL9k1-rhVTCnkpUnFDTSh-Q_0 2024-03-09T15:07:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1421287313795040433', time=2024-03-09T16:55:16.006232+0000, chain.objs.size()=1 2024-03-09T15:07:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.NlT23lrF2bMBSCdqz9GbwjZGXva1ZhP_0 2024-03-09T15:07:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14195420801202915619', time=2024-03-09T16:55:16.029455+0000, chain.objs.size()=1 2024-03-09T15:07:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_._zVpzBWlJ6g0Il7KjMvjcReQVjAGCC-_0 2024-03-09T15:07:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7408334884232015446', time=2024-03-09T16:55:16.063875+0000, chain.objs.size()=1 2024-03-09T15:07:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_._v9EcVzPYyaEd12XohEh1YtSQOgeWgl_0 2024-03-09T15:07:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.263125976265676720', time=2024-03-09T16:55:16.067064+0000, chain.objs.size()=1 2024-03-09T15:07:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.1oWvYqytCqx-t5Tn5ztOJO57MsWYo6L_0 2024-03-09T15:07:03.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1805370488573192331', time=2024-03-09T16:55:16.079704+0000, chain.objs.size()=1 2024-03-09T15:07:03.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.dbSnayhtIICI2opkFRF2ZVRsbVL9Rxn_0 2024-03-09T15:07:03.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12766849573895914687', time=2024-03-09T16:55:16.082846+0000, chain.objs.size()=1 2024-03-09T15:07:03.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.A76xdzoG4-anlhXzCELP5FzDigveFaB_0 2024-03-09T15:07:03.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.054+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7771224735670775127', time=2024-03-09T16:55:16.097213+0000, chain.objs.size()=1 2024-03-09T15:07:03.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.054+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.dm6hr3v7XSTm1jQ_e2xQLpVpbdTzcYU_0 2024-03-09T15:07:03.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.054+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14614696964296930137', time=2024-03-09T16:55:16.201451+0000, chain.objs.size()=1 2024-03-09T15:07:03.054 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.054+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.m6ya9x5kvoZkbReNmzmz7K4p8GxJ1A9_0 2024-03-09T15:07:03.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12722018197668814240', time=2024-03-09T16:55:16.218446+0000, chain.objs.size()=1 2024-03-09T15:07:03.056 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.DvF2kkb9PtPgge8mZbmgea2S2rCdv0s_0 2024-03-09T15:07:03.059 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6985252899359954514', time=2024-03-09T16:55:16.241080+0000, chain.objs.size()=1 2024-03-09T15:07:03.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.YSfxSj3J9inNSPhETM2wcrDrKf7k78e_0 2024-03-09T15:07:03.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10643212223109605361', time=2024-03-09T16:55:16.320026+0000, chain.objs.size()=1 2024-03-09T15:07:03.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.HPf7VXP0uM6fJHsYtWfZ_UoBfzK7CIV_0 2024-03-09T15:07:03.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.755653538731041962', time=2024-03-09T16:55:16.539178+0000, chain.objs.size()=1 2024-03-09T15:07:03.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.WN0xHTUfSTiaNKly6eaHXCe3Qsfq2_P_0 2024-03-09T15:07:03.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10853074952531517303', time=2024-03-09T16:55:16.566899+0000, chain.objs.size()=1 2024-03-09T15:07:03.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.x1HgVfuJm-iHca1eI6r9j-0wnc7JD1w_0 2024-03-09T15:07:03.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6764582532455092611', time=2024-03-09T16:55:16.795824+0000, chain.objs.size()=1 2024-03-09T15:07:03.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.sm2XcEGYXgDmpGo3CigD1kKdqCF342K_0 2024-03-09T15:07:03.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6547382863440051501', time=2024-03-09T16:55:16.800203+0000, chain.objs.size()=1 2024-03-09T15:07:03.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.foRJLKaSvrqYLZcKkb2f1aTBsXXbpHY_0 2024-03-09T15:07:03.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8668727231355037894', time=2024-03-09T16:55:16.834697+0000, chain.objs.size()=1 2024-03-09T15:07:03.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ZDeLLJWPNVxreQDq6-wdp6rXG2CT-qR_0 2024-03-09T15:07:03.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7729554587485698196', time=2024-03-09T16:55:16.839946+0000, chain.objs.size()=1 2024-03-09T15:07:03.061 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.XR_k3h_mCaR2pNUq4zgsgA52f-XBFTk_0 2024-03-09T15:07:03.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12728707988000381440', time=2024-03-09T16:55:20.462454+0000, chain.objs.size()=1 2024-03-09T15:07:03.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.260__shadow_.FFNt-wjG4qweuu_CIieNWmnFKVqlmpR_0 2024-03-09T15:07:03.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16061589149334699640', time=2024-03-09T16:55:27.778276+0000, chain.objs.size()=1 2024-03-09T15:07:03.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.058+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.268__shadow_.kl23bUDIMEirstR0shdsE1iYm-gAS2s_0 2024-03-09T15:07:03.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5708835130755491432', time=2024-03-09T16:55:30.670813+0000, chain.objs.size()=1 2024-03-09T15:07:03.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.271__shadow_.jFAsN0b0XmWCjTZCxuL2WNRULzWOsHm_0 2024-03-09T15:07:03.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14302314809527986589', time=2024-03-09T16:55:46.212022+0000, chain.objs.size()=1 2024-03-09T15:07:03.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.llN8oU1foowhzKGpEjujeWE3hXwJ4wB_0 2024-03-09T15:07:03.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12022550546523232272', time=2024-03-09T16:55:52.655149+0000, chain.objs.size()=1 2024-03-09T15:07:03.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.292__shadow_.J4PnuqKtGn7-BrCpU7_bNjuhkXwxkaH_0 2024-03-09T15:07:03.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7701756480472687137', time=2024-03-09T16:55:56.389873+0000, chain.objs.size()=1 2024-03-09T15:07:03.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.296__shadow_.-YsGZXB7n4WwJEnDsnotz_HwunriInX_0 2024-03-09T15:07:03.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10114939135494290158', time=2024-03-09T16:56:07.821441+0000, chain.objs.size()=1 2024-03-09T15:07:03.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.307__shadow_.kmxS6rfdYTMd7gSE532JqgTIThQopLW_0 2024-03-09T15:07:03.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11504783288824686057', time=2024-03-09T16:56:37.779559+0000, chain.objs.size()=1 2024-03-09T15:07:03.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.bvV6TXp-Q6K8mHcb8z56e9E87_wLnWF_0 2024-03-09T15:07:03.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15731033978141177884', time=2024-03-09T16:56:37.792802+0000, chain.objs.size()=1 2024-03-09T15:07:03.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.E3mk8suBqfP3EJs5Lw-jPmXu9l7cxEK_0 2024-03-09T15:07:03.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1262835045135960341', time=2024-03-09T16:56:37.806789+0000, chain.objs.size()=1 2024-03-09T15:07:03.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_._F02prY-oAGWBut-HTzlGVcdZaNGtVj_0 2024-03-09T15:07:03.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8683290434810433163', time=2024-03-09T16:56:37.809124+0000, chain.objs.size()=1 2024-03-09T15:07:03.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.dm_9CO3bQNdmDMHB8Ic4bBMs_zfXH-2_0 2024-03-09T15:07:03.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16892735272597488899', time=2024-03-09T16:56:37.818183+0000, chain.objs.size()=1 2024-03-09T15:07:03.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kFi0r81qr755rW4GRsMqTgUYaGvM1s__0 2024-03-09T15:07:03.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7547288660531833546', time=2024-03-09T16:56:37.830074+0000, chain.objs.size()=1 2024-03-09T15:07:03.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.TfwHImcWSXh99Lwyal9xPA46EUmW0YS_0 2024-03-09T15:07:03.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17178723931679781416', time=2024-03-09T16:56:37.862816+0000, chain.objs.size()=1 2024-03-09T15:07:03.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.VvWxIW0C3ffJuBulydCdf5UdzmBJ3wI_0 2024-03-09T15:07:03.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.074+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3005499985073013044', time=2024-03-09T16:56:38.034801+0000, chain.objs.size()=1 2024-03-09T15:07:03.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.074+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.sUsY_odf2jDpGQVjrLL6QYyXWTVpiyN_0 2024-03-09T15:07:03.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.074+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11729380753300676643', time=2024-03-09T16:56:38.051794+0000, chain.objs.size()=1 2024-03-09T15:07:03.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.074+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.KYmVNj1PGfQW-qKMVHqXqy2uwIdl_Yp_0 2024-03-09T15:07:03.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.074+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14362902368662216895', time=2024-03-09T16:56:38.297770+0000, chain.objs.size()=1 2024-03-09T15:07:03.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.074+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.z7G1EO7ZSWJCKrQPoqhdQ73m8kbsLkb_0 2024-03-09T15:07:03.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.074+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10510621737614964894', time=2024-03-09T16:56:38.305878+0000, chain.objs.size()=1 2024-03-09T15:07:03.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.074+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.J7x2CXXaGSwHfRbLJIbLmpgIYjoS_T1_0 2024-03-09T15:07:03.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.074+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9215123141866843336', time=2024-03-09T16:56:38.349304+0000, chain.objs.size()=1 2024-03-09T15:07:03.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.074+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.BelILkSX44ae7LCLJcK5kDx7afjRXbW_0 2024-03-09T15:07:03.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.074+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1541064688443572905', time=2024-03-09T16:56:38.358145+0000, chain.objs.size()=1 2024-03-09T15:07:03.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.074+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.jteMT3KpbdBRptpUt_kf_8-FWfr8GBV_0 2024-03-09T15:07:03.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.074+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2237985187154199866', time=2024-03-09T16:56:38.636667+0000, chain.objs.size()=1 2024-03-09T15:07:03.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.074+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.UJvX1yNQML4GX-gV-neuMhFkIZqIz_x_0 2024-03-09T15:07:03.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14378312125386236994', time=2024-03-09T16:56:38.654358+0000, chain.objs.size()=1 2024-03-09T15:07:03.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.OFUfDlV9-sqDKkmVriqRT1sD5ZaxjDH_0 2024-03-09T15:07:03.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13386111261417709743', time=2024-03-09T16:56:38.801863+0000, chain.objs.size()=1 2024-03-09T15:07:03.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.u6ghOIzP1xfSfwz-wFWccDTP2zi3N5P_0 2024-03-09T15:07:03.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16129033310193201633', time=2024-03-09T16:56:38.872031+0000, chain.objs.size()=1 2024-03-09T15:07:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.bOaUKhXO6vdUErxks3YxkfYHWJwaTv0_0 2024-03-09T15:07:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3836278492765739598', time=2024-03-09T16:56:38.900725+0000, chain.objs.size()=1 2024-03-09T15:07:03.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.LPf5vymMIfYhq2Z16cDevyQoF2FKF_b_0 2024-03-09T15:07:03.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3543576519631900913', time=2024-03-09T16:56:38.923329+0000, chain.objs.size()=1 2024-03-09T15:07:03.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.COD7nWuPfYR1H5snbxckPWTNk_V7bnP_0 2024-03-09T15:07:03.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3622525954970564865', time=2024-03-09T16:56:39.070726+0000, chain.objs.size()=1 2024-03-09T15:07:03.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.MQAuhN25PRLYwOS3gUtw1AHkvwpc3FS_0 2024-03-09T15:07:03.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11604697385949474080', time=2024-03-09T16:56:39.109990+0000, chain.objs.size()=1 2024-03-09T15:07:03.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.tuRLB_OXXSGLEJZvqkO3eEZnHBNZTXu_0 2024-03-09T15:07:03.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16379522882687545463', time=2024-03-09T16:56:39.112702+0000, chain.objs.size()=1 2024-03-09T15:07:03.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.f_or5nKtlFHK5h4WlwJliTJCC3V5mfi_0 2024-03-09T15:07:03.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7765991017218940000', time=2024-03-09T16:56:39.132706+0000, chain.objs.size()=1 2024-03-09T15:07:03.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.fVZP6mx3aCGypi6DyorVn6OG0yvx_X7_0 2024-03-09T15:07:03.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3804710968402361381', time=2024-03-09T16:56:39.136012+0000, chain.objs.size()=1 2024-03-09T15:07:03.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Q2KE8xhRR3IuHfJ6gouZNbZaW3mQVZI_0 2024-03-09T15:07:03.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5841076170681402027', time=2024-03-09T16:56:39.164200+0000, chain.objs.size()=1 2024-03-09T15:07:03.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.w_PQBHNnFWLPIb1P34XhwqPmB-s2NjK_0 2024-03-09T15:07:03.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12219683168139028316', time=2024-03-09T16:56:39.179711+0000, chain.objs.size()=1 2024-03-09T15:07:03.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.2tawzjOz6AIRHoQc8Amcu2eMNbMcrhW_0 2024-03-09T15:07:03.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2349497790343816390', time=2024-03-09T16:56:39.202370+0000, chain.objs.size()=1 2024-03-09T15:07:03.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.tKOnTrq8IOoHFlsND_eQnkyDzfycQ3T_0 2024-03-09T15:07:03.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2245863110028962429', time=2024-03-09T16:56:39.462738+0000, chain.objs.size()=1 2024-03-09T15:07:03.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.LxYD5EHEl7khujGb8w-CTqlVY_X0AI4_0 2024-03-09T15:07:03.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14474196635480776909', time=2024-03-09T16:56:39.465244+0000, chain.objs.size()=1 2024-03-09T15:07:03.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.CoK_AwL8FBWTQF71r8370lBEu4PR2tg_0 2024-03-09T15:07:03.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.086+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5180513140259860513', time=2024-03-09T16:56:39.560707+0000, chain.objs.size()=1 2024-03-09T15:07:03.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.086+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.5JUrbq-hnTPVd3JCjGz7QGaNwqi-h0U_0 2024-03-09T15:07:03.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.086+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9190271132742975612', time=2024-03-09T16:56:39.586709+0000, chain.objs.size()=1 2024-03-09T15:07:03.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.086+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Lg2ljU0qIJ3LrSyONE1UuJy6lylCegi_0 2024-03-09T15:07:03.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.090+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1974079202216435427', time=2024-03-09T16:56:39.598924+0000, chain.objs.size()=1 2024-03-09T15:07:03.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.090+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.SnzzRu4cnhYdUA7lLlDLLARUHQzQBfN_0 2024-03-09T15:07:03.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.090+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11793653792582568149', time=2024-03-09T16:56:39.605229+0000, chain.objs.size()=1 2024-03-09T15:07:03.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.090+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0MMJhom7WNx8p-tvfUNk9PG_w6wJ_NL_0 2024-03-09T15:07:03.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.090+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6782557555780388772', time=2024-03-09T16:56:39.646121+0000, chain.objs.size()=1 2024-03-09T15:07:03.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.090+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.OBlvZ412TuOd6o3g3Gz0HLExThf0SiW_0 2024-03-09T15:07:03.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.090+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15146863788063836668', time=2024-03-09T16:56:39.660416+0000, chain.objs.size()=1 2024-03-09T15:07:03.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.090+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.L0TgwoPT4UHPdEWVZYxPy3d00RkHVzH_0 2024-03-09T15:07:03.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.090+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7834227436092113624', time=2024-03-09T16:56:39.672844+0000, chain.objs.size()=1 2024-03-09T15:07:03.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.090+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.IL60F4oZF7Mah9WUaOSa37lIl4ntW9F_0 2024-03-09T15:07:03.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7521198415531684710', time=2024-03-09T16:56:39.687557+0000, chain.objs.size()=1 2024-03-09T15:07:03.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.xr8Ama2M3Nw0v51BvqKu3rhix0mVgP2_0 2024-03-09T15:07:03.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17578066355612704908', time=2024-03-09T16:57:01.431794+0000, chain.objs.size()=1 2024-03-09T15:07:03.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.l9y_dXDap00UzHv2gzcuvZK3SBW4h9A_0 2024-03-09T15:07:03.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12301111682295787628', time=2024-03-09T16:57:01.545526+0000, chain.objs.size()=1 2024-03-09T15:07:03.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.eWy-SiMhGyNze3odlwkOQdrqw6xVkJk_0 2024-03-09T15:07:03.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4629291648052330306', time=2024-03-09T16:57:01.568270+0000, chain.objs.size()=1 2024-03-09T15:07:03.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.7dJrJr_NewPH8keHlYa_l59nFS4FVBY_0 2024-03-09T15:07:03.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7418261402279049089', time=2024-03-09T16:57:01.571765+0000, chain.objs.size()=1 2024-03-09T15:07:03.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.aZxUGua3OSsvehgvSdUgkLTnpuXedyw_0 2024-03-09T15:07:03.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3626729695697566267', time=2024-03-09T16:57:01.572448+0000, chain.objs.size()=1 2024-03-09T15:07:03.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.B0pMRaARXDxfIDebNlL2OM9B53RLVrW_0 2024-03-09T15:07:03.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15382546914021458019', time=2024-03-09T16:57:01.810493+0000, chain.objs.size()=1 2024-03-09T15:07:03.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.0BAiSMOSzeqO0xlMbDqq3iZe0UWJBr2_0 2024-03-09T15:07:03.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12047687056507147048', time=2024-03-09T16:57:01.820465+0000, chain.objs.size()=1 2024-03-09T15:07:03.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.tkyCA03jfknSch3txE1WFe6djfWQcY-_0 2024-03-09T15:07:03.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14005695619472603474', time=2024-03-09T16:57:01.878724+0000, chain.objs.size()=1 2024-03-09T15:07:03.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.UuygNmZXlJ-mM-wg2WUwqiM6BTQ_zX1_0 2024-03-09T15:07:03.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10192178067394517891', time=2024-03-09T16:57:01.968784+0000, chain.objs.size()=1 2024-03-09T15:07:03.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.9w_WFJw25fnW_YrzYfUEigZWJfV1xKJ_0 2024-03-09T15:07:03.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10285651258752755955', time=2024-03-09T16:57:02.330685+0000, chain.objs.size()=1 2024-03-09T15:07:03.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.LgM2mwAj1KlYLGSWc2S60_o-uoQWZdU_0 2024-03-09T15:07:03.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5101516584466256835', time=2024-03-09T16:57:02.340524+0000, chain.objs.size()=1 2024-03-09T15:07:03.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.1mmqjCz6qAL8Nx6MmnIpTlDOGCvfJb8_0 2024-03-09T15:07:03.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.756521489694197290', time=2024-03-09T16:57:02.372667+0000, chain.objs.size()=1 2024-03-09T15:07:03.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.GPZFxj0GnGYBWQbCIRiIfuehR26QoUA_0 2024-03-09T15:07:03.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5611502065032804944', time=2024-03-09T16:57:02.599373+0000, chain.objs.size()=1 2024-03-09T15:07:03.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.faRmNAKp8SSPG2ID9F72QA2Wo2ySe72_0 2024-03-09T15:07:03.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13737071228144222140', time=2024-03-09T16:57:02.609161+0000, chain.objs.size()=1 2024-03-09T15:07:03.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.AxlQvKZAwSootYzVF6z_ndfYZylA_iO_0 2024-03-09T15:07:03.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/40850 2024-03-09T15:07:03.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-03-09T15:07:03.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8384155392139197516', time=2024-03-09T16:57:02.860646+0000, chain.objs.size()=1 2024-03-09T15:07:03.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Y103tMXrrwn2zuFYb4LgGmBPrPNMe9F_0 2024-03-09T15:07:03.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4210782134030051781', time=2024-03-09T16:57:02.870339+0000, chain.objs.size()=1 2024-03-09T15:07:03.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.gyYUV9_ym_pyNnErGM2mN_AcwpSuA2u_0 2024-03-09T15:07:03.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5086066929331303643', time=2024-03-09T16:57:02.874575+0000, chain.objs.size()=1 2024-03-09T15:07:03.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Ku51Fx0M8VzjYbqKy8Pjc0g2BEcgibt_0 2024-03-09T15:07:03.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14188779359696547261', time=2024-03-09T16:57:03.023885+0000, chain.objs.size()=1 2024-03-09T15:07:03.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.uhZ9Yqbi9ec9x6u0_1h93f3yMrc3SyK_0 2024-03-09T15:07:03.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12506927971103879512', time=2024-03-09T16:57:03.068136+0000, chain.objs.size()=1 2024-03-09T15:07:03.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.r3urxj8rlJojYZi5wC85jSxbclDGYaW_0 2024-03-09T15:07:03.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2128557008034395468', time=2024-03-09T16:57:03.068970+0000, chain.objs.size()=1 2024-03-09T15:07:03.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.85TOKvr3c83acmZAD2nre1e5f5d73yA_0 2024-03-09T15:07:03.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10005334326609710157', time=2024-03-09T16:57:03.265626+0000, chain.objs.size()=1 2024-03-09T15:07:03.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.2kwBaHErwksUorcnRxbZdbBLw7Jy7bQ_0 2024-03-09T15:07:03.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9730890526883429748', time=2024-03-09T16:57:03.294312+0000, chain.objs.size()=1 2024-03-09T15:07:03.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.QxJBLvZk4Z92QpMXaaY5DK-x1OrZW-D_0 2024-03-09T15:07:03.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4663041986366292103', time=2024-03-09T16:57:06.943937+0000, chain.objs.size()=1 2024-03-09T15:07:03.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.322__shadow_.nEGVzcwt5kjE35xfGOMfs6bW0cVrYV3_0 2024-03-09T15:07:03.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1082455955030211387', time=2024-03-09T16:59:02.261093+0000, chain.objs.size()=1 2024-03-09T15:07:03.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.444__shadow_.GUikEn8jO5LjFdUsJXoBnBNWCQ3tHow_0 2024-03-09T15:07:03.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10249554911486268943', time=2024-03-09T16:59:32.469114+0000, chain.objs.size()=1 2024-03-09T15:07:03.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.478__shadow_.2HqJEU70yDl51nL5npVtetNjU5uH_oa_0 2024-03-09T15:07:03.115 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12512628912639305649', time=2024-03-09T16:59:37.499609+0000, chain.objs.size()=1 2024-03-09T15:07:03.116 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.483__shadow_.PeZy_TlGh9KIH0PrkSuHW_NLl9cjnHd_0 2024-03-09T15:07:03.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.118+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6765797755716502569', time=2024-03-09T16:59:39.411884+0000, chain.objs.size()=1 2024-03-09T15:07:03.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.485__shadow_.dPdBCjunLwHJKlhy4oSRYDA6i8Vvc50_0 2024-03-09T15:07:03.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.118+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13933416872448994093', time=2024-03-09T17:00:11.073007+0000, chain.objs.size()=1 2024-03-09T15:07:03.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.514__shadow:ePV-jIAdnlwtQt6-F6VQJagy-k8nst4_.U-9sskF0qd3xdK2Q-Lp34mrIGUw8sRl_0 2024-03-09T15:07:03.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.118+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5826605730655574546', time=2024-03-09T17:01:30.989907+0000, chain.objs.size()=1 2024-03-09T15:07:03.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.547__shadow_.48zG4TgAfC5Ng5ifWDawGGQRZ9rU37V_0 2024-03-09T15:07:03.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.118+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11039901195482633993', time=2024-03-09T17:01:33.411086+0000, chain.objs.size()=1 2024-03-09T15:07:03.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.549__shadow_.yRxM_kJo24fNvmRaJNG5ICz01rcykWh_0 2024-03-09T15:07:03.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18404091566474954677', time=2024-03-09T17:01:58.158652+0000, chain.objs.size()=1 2024-03-09T15:07:03.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:X3k0VNVlIb2CNXj2EKG6Hztf.XK0-qb_.MPDACXdnvdTF0DHhB7m5BMjgVvC-ORp_0 2024-03-09T15:07:03.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10453528498875555187', time=2024-03-09T17:02:14.472011+0000, chain.objs.size()=1 2024-03-09T15:07:03.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.569__shadow:XNFh0uVmhqQWzV2Vea1tePpOF4lSxKO_.4lQdL9INvVZ-AEQxn5jT6GKSoFXBxJ8_0 2024-03-09T15:07:03.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8021157076895041358', time=2024-03-09T17:02:20.482485+0000, chain.objs.size()=1 2024-03-09T15:07:03.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:TgFiaN3xCeD-dOiJdlYbKhj1LX0Jvao_.vRh2ovbxZS-fwjH74LR4eOCvJeWZWCP_0 2024-03-09T15:07:03.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7653524700488077140', time=2024-03-09T17:02:21.955545+0000, chain.objs.size()=1 2024-03-09T15:07:03.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:J6kcg.02xZaFU1wzYGniH56knw0awpR_.J3LCLPGI2gpsOs50LlRj-pOzD6kQY90_0 2024-03-09T15:07:03.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9520242933290905854', time=2024-03-09T17:02:28.870574+0000, chain.objs.size()=1 2024-03-09T15:07:03.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:jZ8DkpWnr9EHDDJXpZmmxdKmlyLocHG_.lWeuRdYRzVbtl11A04zMTzb-SEt53l0_0 2024-03-09T15:07:03.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5325388696304205811', time=2024-03-09T17:02:41.721893+0000, chain.objs.size()=1 2024-03-09T15:07:03.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.576__shadow:cZV-sB5P79C3ybteCS0hRyeWOC9fVsk_.Wvha3kPn8jg7TpafUA8HeICktvsVKr7_0 2024-03-09T15:07:03.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15393084202672379810', time=2024-03-09T17:03:03.670316+0000, chain.objs.size()=1 2024-03-09T15:07:03.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.600__shadow_.Drx2t1ZU3w3o8_YEUXzbxYqwuBRy_SZ_0 2024-03-09T15:07:03.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~xSwJr9g44fmHAW9OilCfju2RxSVr2L1', time=2024-03-09T17:03:31.638651+0000, chain.objs.size()=6 2024-03-09T15:07:03.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.615__multipart_multipart_enc.2~xSwJr9g44fmHAW9OilCfju2RxSVr2L1.1 2024-03-09T15:07:03.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.615__multipart_multipart_enc.2~xSwJr9g44fmHAW9OilCfju2RxSVr2L1.2 2024-03-09T15:07:03.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.122+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.615__multipart_multipart_enc.2~xSwJr9g44fmHAW9OilCfju2RxSVr2L1.3 2024-03-09T15:07:03.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.126+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.615__multipart_multipart_enc.2~xSwJr9g44fmHAW9OilCfju2RxSVr2L1.4 2024-03-09T15:07:03.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.126+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.615__multipart_multipart_enc.2~xSwJr9g44fmHAW9OilCfju2RxSVr2L1.5 2024-03-09T15:07:03.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.126+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.615__multipart_multipart_enc.2~xSwJr9g44fmHAW9OilCfju2RxSVr2L1.6 2024-03-09T15:07:03.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.126+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11345280639038968287', time=2024-03-09T17:03:48.512175+0000, chain.objs.size()=1 2024-03-09T15:07:03.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.126+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.633__shadow_.hj7QVfnkQh061YhvmacnZ3Vd--zF7Z-_0 2024-03-09T15:07:03.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.126+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17729185642521990711', time=2024-03-09T17:04:08.605241+0000, chain.objs.size()=1 2024-03-09T15:07:03.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.126+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.652__shadow_.YgQJmriLkBIIkgDahqe5sqmoTrzMVQu_0 2024-03-09T15:07:03.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.126+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7791259171128124129', time=2024-03-09T17:04:09.778740+0000, chain.objs.size()=1 2024-03-09T15:07:03.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.126+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.653__shadow_.6DbPmo_J04G2ep6gJN7Uh-3Hea2-gZE_0 2024-03-09T15:07:03.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.126+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13944697325106714676', time=2024-03-09T17:04:14.662420+0000, chain.objs.size()=1 2024-03-09T15:07:03.127 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.126+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.659__shadow_.3Vlrn72b6dAR2jPixQDKZeX_aOG0hvk_0 2024-03-09T15:07:03.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.126+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6451491560801595553', time=2024-03-09T17:04:15.717055+0000, chain.objs.size()=1 2024-03-09T15:07:03.128 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.126+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.660__shadow_.eimYbRRxhdPiZshPJeA8XKNgQSjx-rh_0 2024-03-09T15:07:03.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2988420437224161506', time=2024-03-09T17:06:24.256655+0000, chain.objs.size()=1 2024-03-09T15:07:03.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.747__shadow_.hKSdYUC5Nq4vm-y1tEQIgZWiyV21Onn_0 2024-03-09T15:07:03.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1837269161801440860', time=2024-03-09T17:06:38.296342+0000, chain.objs.size()=1 2024-03-09T15:07:03.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.756__shadow_.auM5QQpqSWynOvzVFxM69L1DdDHdJzQ_0 2024-03-09T15:07:03.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12173025024946466683', time=2024-03-09T17:06:42.357693+0000, chain.objs.size()=1 2024-03-09T15:07:03.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.759__shadow_.vt1SoioudEDRBmiD8frFqhxIaTdQRER_0 2024-03-09T15:07:03.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.138+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:03.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.138+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-09T15:07:03.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:03.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:03.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/41630' 2024-03-09T15:07:03.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3301589479109126926', time=2024-03-09T16:51:59.651113+0000, chain.objs.size()=1 2024-03-09T15:07:03.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.165__shadow_.5OrZ9PqArwtJgJxbLVgg-R89sgdo6dW_0 2024-03-09T15:07:03.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12056145337084365567', time=2024-03-09T16:54:30.417480+0000, chain.objs.size()=1 2024-03-09T15:07:03.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.232__shadow_.Co-Wt6RJqZid7pZ-Y34Mmut_ZjuOxpn_0 2024-03-09T15:07:03.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17278857071703291792', time=2024-03-09T16:54:33.112100+0000, chain.objs.size()=1 2024-03-09T15:07:03.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.235__shadow_.ojTc_PZKJ9gnYPk_SBKwT3l-tJL1Wc4_0 2024-03-09T15:07:03.144 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4617178525716413538', time=2024-03-09T16:54:33.116840+0000, chain.objs.size()=1 2024-03-09T15:07:03.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.235__shadow_.A-iO79YDrQQ-enlqs8woIsM93gBf3Qp_0 2024-03-09T15:07:03.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2846145031778450802', time=2024-03-09T16:55:14.844168+0000, chain.objs.size()=1 2024-03-09T15:07:03.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.XvBOC-8OPZdY1BlcD8Bn26quEdIExov_0 2024-03-09T15:07:03.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1360942280476986035', time=2024-03-09T16:55:14.985446+0000, chain.objs.size()=1 2024-03-09T15:07:03.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.JKltjrPuyY-x7GIcr3OTOw6PaBGbgyz_0 2024-03-09T15:07:03.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15732814515864387339', time=2024-03-09T16:55:14.987631+0000, chain.objs.size()=1 2024-03-09T15:07:03.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.3CLZs_8oTgNimNCKqDzcKCVoVI60e4D_0 2024-03-09T15:07:03.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13281806084216385604', time=2024-03-09T16:55:15.170735+0000, chain.objs.size()=1 2024-03-09T15:07:03.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.VGGpOY0u3SWB5c511uV2rrg07e1HQk3_0 2024-03-09T15:07:03.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2902837969990903144', time=2024-03-09T16:55:15.188111+0000, chain.objs.size()=1 2024-03-09T15:07:03.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.nw2MY02Jeo8-TTfo0utDLWh9Rog-H-U_0 2024-03-09T15:07:03.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15882882118114277299', time=2024-03-09T16:55:15.230072+0000, chain.objs.size()=1 2024-03-09T15:07:03.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.3wS_57jFnxqT_POvPgLXDmfIGjZ88Lh_0 2024-03-09T15:07:03.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13816409129134863780', time=2024-03-09T16:55:15.251553+0000, chain.objs.size()=1 2024-03-09T15:07:03.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ULS2I5JwOwwbJVqX1wjGkV3a7ViVbCX_0 2024-03-09T15:07:03.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.846049033372376851', time=2024-03-09T16:55:15.265165+0000, chain.objs.size()=1 2024-03-09T15:07:03.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.IGGQbT4d9OlomGaR2iiKbWAl3-Yv6Cp_0 2024-03-09T15:07:03.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.146+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2922750545535029855', time=2024-03-09T16:55:15.296022+0000, chain.objs.size()=1 2024-03-09T15:07:03.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.146+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.WCpzW4I0LzgOWh1zXXUSPykMZwruXVr_0 2024-03-09T15:07:03.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.146+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10404456910921243233', time=2024-03-09T16:55:15.444493+0000, chain.objs.size()=1 2024-03-09T15:07:03.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.146+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.HMzeuV-YX8Fj34XpK-1FtFdXMw_kvCB_0 2024-03-09T15:07:03.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.146+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17498413991835712766', time=2024-03-09T16:55:15.445217+0000, chain.objs.size()=1 2024-03-09T15:07:03.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.146+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.JmUkzclrSPSCQMI-EElo9B0v2lBLvpv_0 2024-03-09T15:07:03.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.146+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5520489282123740664', time=2024-03-09T16:55:15.489752+0000, chain.objs.size()=1 2024-03-09T15:07:03.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.146+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.R8zNR2yeXiNAgHhahpUQRQzYkSuyaja_0 2024-03-09T15:07:03.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.150+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3436518369257188535', time=2024-03-09T16:55:15.549904+0000, chain.objs.size()=1 2024-03-09T15:07:03.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.150+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.FGj2KazfMZIMg5XAz6pwGeYjtOhZs23_0 2024-03-09T15:07:03.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.150+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3050032551644564906', time=2024-03-09T16:55:15.553120+0000, chain.objs.size()=1 2024-03-09T15:07:03.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.150+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.O_Ay_7fxNxtVqO2eUKlcS-WdgBkZ5Xa_0 2024-03-09T15:07:03.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.150+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9184037514457651478', time=2024-03-09T16:55:15.696108+0000, chain.objs.size()=1 2024-03-09T15:07:03.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.150+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.nWdz3PbqJdLelUNXXV5CYLQJRqY9ngq_0 2024-03-09T15:07:03.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.150+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17813231062075935729', time=2024-03-09T16:55:15.752407+0000, chain.objs.size()=1 2024-03-09T15:07:03.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.150+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.caKeQUL1B_ziQtWkrXZZFjasWo8mPfN_0 2024-03-09T15:07:03.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.150+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10504137128066679126', time=2024-03-09T16:55:15.818379+0000, chain.objs.size()=1 2024-03-09T15:07:03.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.150+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.paEHwukfr07qgJmBojyi87MI4X8nEQ8_0 2024-03-09T15:07:03.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.150+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14586904013432506731', time=2024-03-09T16:55:15.947178+0000, chain.objs.size()=1 2024-03-09T15:07:03.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.150+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.1DYxq828uUKFXrqPSKb_k3SP8ldBtcX_0 2024-03-09T15:07:03.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.150+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4453608029032326593', time=2024-03-09T16:55:15.950304+0000, chain.objs.size()=1 2024-03-09T15:07:03.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.150+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Ob40SFKY1yx_OKqWkBKgoPej69VvlWj_0 2024-03-09T15:07:03.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5799470191957361189', time=2024-03-09T16:55:15.990020+0000, chain.objs.size()=1 2024-03-09T15:07:03.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.9WFH0FeHNzmKhOX_ZZLDIY0veJ6SL29_0 2024-03-09T15:07:03.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8919865029008653839', time=2024-03-09T16:55:16.045196+0000, chain.objs.size()=1 2024-03-09T15:07:03.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.0f4_UXmPQr6oRz-oNtLXXEuEyDPBEV8_0 2024-03-09T15:07:03.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4971786603935187676', time=2024-03-09T16:55:16.059604+0000, chain.objs.size()=1 2024-03-09T15:07:03.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.fJXWk68VEqHwWJKZdG6-iB5PHZKQyrN_0 2024-03-09T15:07:03.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13294362959603442545', time=2024-03-09T16:55:16.071622+0000, chain.objs.size()=1 2024-03-09T15:07:03.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.k2PMdo95z3BhnVvB-yVivK_Ft65DpFi_0 2024-03-09T15:07:03.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9012235047236618126', time=2024-03-09T16:55:16.240837+0000, chain.objs.size()=1 2024-03-09T15:07:03.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.I1TPMaGdB9J8am4nEcv7DKTaoHNi6BZ_0 2024-03-09T15:07:03.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7898530768015378342', time=2024-03-09T16:55:16.248563+0000, chain.objs.size()=1 2024-03-09T15:07:03.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Hm_VAkgbwYCMoNBoRntn7px49A5-kol_0 2024-03-09T15:07:03.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14096367475947251739', time=2024-03-09T16:55:16.273088+0000, chain.objs.size()=1 2024-03-09T15:07:03.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.d5DoYhb31IBrH7q4LT_hDuT8h866G-A_0 2024-03-09T15:07:03.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7602959545296123733', time=2024-03-09T16:55:16.289096+0000, chain.objs.size()=1 2024-03-09T15:07:03.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.BL2lnqOHb_YgS_ro7m5YBrradYZLiaB_0 2024-03-09T15:07:03.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9631690241729265719', time=2024-03-09T16:55:16.295869+0000, chain.objs.size()=1 2024-03-09T15:07:03.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.2SXb0X7uNmICXKtELoXJY67u_LxFhfv_0 2024-03-09T15:07:03.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16167699549776940469', time=2024-03-09T16:55:16.362704+0000, chain.objs.size()=1 2024-03-09T15:07:03.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.kCIDXYlnd9_tydgVH82Fld2mNUq25KO_0 2024-03-09T15:07:03.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18374484521045243238', time=2024-03-09T16:55:16.517189+0000, chain.objs.size()=1 2024-03-09T15:07:03.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.x2zqjzmxUoY_WzlZdMngPlTYm5Y9Law_0 2024-03-09T15:07:03.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11505812710346902455', time=2024-03-09T16:55:16.541189+0000, chain.objs.size()=1 2024-03-09T15:07:03.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.RmHVFdLj5LMjcyzwkA2mKyK8pGrWzBV_0 2024-03-09T15:07:03.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13926735148129128361', time=2024-03-09T16:55:16.720439+0000, chain.objs.size()=1 2024-03-09T15:07:03.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.dCtnSU3DFpjOiux9tbMbwDbafXZ_wSZ_0 2024-03-09T15:07:03.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8739654193415930594', time=2024-03-09T16:55:16.756252+0000, chain.objs.size()=1 2024-03-09T15:07:03.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.TmKtiZHQpATBRhGZPGgfblgqkNzzKrW_0 2024-03-09T15:07:03.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.914808231165843789', time=2024-03-09T16:55:16.768536+0000, chain.objs.size()=1 2024-03-09T15:07:03.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.zTnM9-nklFypVyYkocNIW4WfuAtNtE4_0 2024-03-09T15:07:03.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13890938969885976683', time=2024-03-09T16:55:16.833556+0000, chain.objs.size()=1 2024-03-09T15:07:03.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.158+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.-bef66KzksWD7O5aPLeSpsvC7ywRQxG_0 2024-03-09T15:07:03.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11991276901154362552', time=2024-03-09T16:55:16.834257+0000, chain.objs.size()=1 2024-03-09T15:07:03.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.R-W_cW2e-B4TYq0jgmUG4TEC_zva-9J_0 2024-03-09T15:07:03.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7066010463507631259', time=2024-03-09T16:55:36.261044+0000, chain.objs.size()=1 2024-03-09T15:07:03.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.277__shadow_.CzfJKFUEDr-ULr9X1TJhfuds5azQLFU_0 2024-03-09T15:07:03.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5095715107697123503', time=2024-03-09T16:55:39.347376+0000, chain.objs.size()=1 2024-03-09T15:07:03.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.280__shadow_.qZ3gXbL8J-1q5m-6fTDJxzhGvPLBoqj_0 2024-03-09T15:07:03.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13095095162039611820', time=2024-03-09T16:55:47.890077+0000, chain.objs.size()=1 2024-03-09T15:07:03.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.x8MKc2l3gXbgKtp8WvFqr8tqYmH6_zB_0 2024-03-09T15:07:03.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9850316269807754388', time=2024-03-09T16:56:37.695842+0000, chain.objs.size()=1 2024-03-09T15:07:03.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.odHVtRP4A_eKWY54jgoBEV3FNdt3-nf_0 2024-03-09T15:07:03.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11066570969250063927', time=2024-03-09T16:56:37.733515+0000, chain.objs.size()=1 2024-03-09T15:07:03.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.MxAprVCoNoMWeAuUGxfGkdZyF1GhnB-_0 2024-03-09T15:07:03.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12531231057636939100', time=2024-03-09T16:56:37.805297+0000, chain.objs.size()=1 2024-03-09T15:07:03.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.JxXrp9md61YDZD4vTifToeqFFwofh99_0 2024-03-09T15:07:03.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.681071842286507275', time=2024-03-09T16:56:37.820086+0000, chain.objs.size()=1 2024-03-09T15:07:03.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.AdrcwwOvOBc5UaQCe54-A7IiUvlcbqY_0 2024-03-09T15:07:03.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6768948527578837234', time=2024-03-09T16:56:37.852560+0000, chain.objs.size()=1 2024-03-09T15:07:03.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.CaqfivQf_zYiIVdbKmr_07LvR_EH_Gg_0 2024-03-09T15:07:03.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18266575404288475115', time=2024-03-09T16:56:37.872361+0000, chain.objs.size()=1 2024-03-09T15:07:03.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.knFAaSZ_Y_9AmEMXamMTzFbj3dzJgvB_0 2024-03-09T15:07:03.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12022786851030595839', time=2024-03-09T16:56:38.019709+0000, chain.objs.size()=1 2024-03-09T15:07:03.166 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.1KsgoYgxsrT59Iusu1bvD7qmDSHyWuS_0 2024-03-09T15:07:03.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10017843914036792038', time=2024-03-09T16:56:38.066017+0000, chain.objs.size()=1 2024-03-09T15:07:03.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.o8iVfl21TU6Aa974zhFtbqzq2HkFRRr_0 2024-03-09T15:07:03.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4102336773525133228', time=2024-03-09T16:56:38.071852+0000, chain.objs.size()=1 2024-03-09T15:07:03.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.tQrYB55ILTA04ugBYJj-bANbf5b6u_P_0 2024-03-09T15:07:03.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10297597071475863140', time=2024-03-09T16:56:38.324093+0000, chain.objs.size()=1 2024-03-09T15:07:03.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.XC_nU2pKfLiF7EW03yAKcIzk-AfYUyF_0 2024-03-09T15:07:03.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10462632945173699', time=2024-03-09T16:56:38.377675+0000, chain.objs.size()=1 2024-03-09T15:07:03.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.35EzEklMgj5EXVHDeqSMFVciGQCtbyl_0 2024-03-09T15:07:03.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13475644388597083910', time=2024-03-09T16:56:38.538193+0000, chain.objs.size()=1 2024-03-09T15:07:03.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.8Mcm38o8Dxf2qDlvHaGErZLLwv84zdk_0 2024-03-09T15:07:03.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14784688075015753031', time=2024-03-09T16:56:38.543359+0000, chain.objs.size()=1 2024-03-09T15:07:03.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.jZanSsITp4M2WKl3tflKm8dDJhdJmo-_0 2024-03-09T15:07:03.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9741823159630263380', time=2024-03-09T16:56:38.617572+0000, chain.objs.size()=1 2024-03-09T15:07:03.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.N41QKwjxCTKNQUrr3bZ84RdoBA9Ffpd_0 2024-03-09T15:07:03.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9079393339277301312', time=2024-03-09T16:56:38.647677+0000, chain.objs.size()=1 2024-03-09T15:07:03.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-LLH-bFEJmMIRm5LWt_I2soXODRlBZe_0 2024-03-09T15:07:03.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4171199517347959273', time=2024-03-09T16:56:38.651215+0000, chain.objs.size()=1 2024-03-09T15:07:03.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.z9GjgiewV6gxEVFaB18kMgz1QtA2QyV_0 2024-03-09T15:07:03.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16217484971176864141', time=2024-03-09T16:56:38.663519+0000, chain.objs.size()=1 2024-03-09T15:07:03.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ZtIp96O9W_-g5S5YtLCxhr5wC7EZYfM_0 2024-03-09T15:07:03.174 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10118479360858794085', time=2024-03-09T16:56:38.877014+0000, chain.objs.size()=1 2024-03-09T15:07:03.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kzf9R5tOZ0a8_flCBVWk0Yk0rrhXrGK_0 2024-03-09T15:07:03.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18065319053517538737', time=2024-03-09T16:56:39.154820+0000, chain.objs.size()=1 2024-03-09T15:07:03.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.174+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.z4U_KPa1KJgM-i0abLMolW8s1JoIQ2k_0 2024-03-09T15:07:03.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15973323307270234316', time=2024-03-09T16:56:39.195367+0000, chain.objs.size()=1 2024-03-09T15:07:03.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.m3RqvHCpDpxl78fDTYN4vQqyjOgZhax_0 2024-03-09T15:07:03.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16439794703420139379', time=2024-03-09T16:56:39.205344+0000, chain.objs.size()=1 2024-03-09T15:07:03.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.D0WFk_vXwsShEZ2YfcKwkSe5XP_fPZ1_0 2024-03-09T15:07:03.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12397712963616558965', time=2024-03-09T16:56:39.318470+0000, chain.objs.size()=1 2024-03-09T15:07:03.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Sslud8pgeX7sw_mkE7fTPBda3ig-DoY_0 2024-03-09T15:07:03.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2092425746705543582', time=2024-03-09T16:56:39.369113+0000, chain.objs.size()=1 2024-03-09T15:07:03.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.FDUGSc28Js4O_1pNJK5fH70kYEcedIm_0 2024-03-09T15:07:03.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2690157979822041955', time=2024-03-09T16:56:39.441948+0000, chain.objs.size()=1 2024-03-09T15:07:03.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.7zhvBWn5-1tn9mE8jQ90bfkW9Wpn3Sa_0 2024-03-09T15:07:03.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7184190643284145957', time=2024-03-09T16:56:39.446823+0000, chain.objs.size()=1 2024-03-09T15:07:03.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.S17pNeecAGAtEJdVgHwmr0O-hIfWqfL_0 2024-03-09T15:07:03.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16562388666647979309', time=2024-03-09T16:56:39.452477+0000, chain.objs.size()=1 2024-03-09T15:07:03.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.vHFlVhYqHFoM1Jnjba9zoG6_YfJeatB_0 2024-03-09T15:07:03.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4920806912435757161', time=2024-03-09T16:56:39.465643+0000, chain.objs.size()=1 2024-03-09T15:07:03.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.RGGN1cQwZ1xM0wEi1VDOyevKB4SHs-X_0 2024-03-09T15:07:03.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9021337142007195104', time=2024-03-09T16:56:39.468759+0000, chain.objs.size()=1 2024-03-09T15:07:03.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.gJ7Le6YgUB2YdNCQVhvfjB4dEodBAcv_0 2024-03-09T15:07:03.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5012153734745318297', time=2024-03-09T16:56:39.562389+0000, chain.objs.size()=1 2024-03-09T15:07:03.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.sDZm6Iht89WyjSlH-hkK0Cn_pbYiCT7_0 2024-03-09T15:07:03.182 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15678850782290309432', time=2024-03-09T16:56:39.569176+0000, chain.objs.size()=1 2024-03-09T15:07:03.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.HyWoOWIbHwj5612Y4WRCUkynj_ScbEL_0 2024-03-09T15:07:03.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15885008905925525756', time=2024-03-09T16:56:39.588131+0000, chain.objs.size()=1 2024-03-09T15:07:03.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.qsjZsPYDxyMw3nyY1zq_HxrW4084v-__0 2024-03-09T15:07:03.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4014571636223821637', time=2024-03-09T16:56:39.655022+0000, chain.objs.size()=1 2024-03-09T15:07:03.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.zSm6YZHKVHylVeESgqiKDZ-4wacYoU7_0 2024-03-09T15:07:03.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4250842664052990333', time=2024-03-09T16:57:01.435593+0000, chain.objs.size()=1 2024-03-09T15:07:03.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.71yKxg2B3-AoD0N5I-HpLDfQfaDvo2s_0 2024-03-09T15:07:03.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12211016397480313486', time=2024-03-09T16:57:01.453757+0000, chain.objs.size()=1 2024-03-09T15:07:03.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.gDER_Kd-rGf451O97Y3-0NbPgK7FTYJ_0 2024-03-09T15:07:03.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4032631878809611003', time=2024-03-09T16:57:01.564315+0000, chain.objs.size()=1 2024-03-09T15:07:03.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.tHgrXQaPd9hp5NyFTKaunN_5pngP6jx_0 2024-03-09T15:07:03.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9359181726461320686', time=2024-03-09T16:57:01.727179+0000, chain.objs.size()=1 2024-03-09T15:07:03.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.cT4M2u2_B6L6tmW-91NY2ybVN7JjwSd_0 2024-03-09T15:07:03.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13217906082943217434', time=2024-03-09T16:57:01.833638+0000, chain.objs.size()=1 2024-03-09T15:07:03.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.GQ5LUACosgIz_NsyGGsMut5S3YwRpN0_0 2024-03-09T15:07:03.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.681778956203201556', time=2024-03-09T16:57:01.971707+0000, chain.objs.size()=1 2024-03-09T15:07:03.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.NItdRiBrLf_utk04TbWM8gudhUIw-9T_0 2024-03-09T15:07:03.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3275138237135311531', time=2024-03-09T16:57:02.044663+0000, chain.objs.size()=1 2024-03-09T15:07:03.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_._ClI2Pq3mvscLqt0LL6fnZWyuIQCO7h_0 2024-03-09T15:07:03.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.190+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10666965152239079532', time=2024-03-09T16:57:02.088105+0000, chain.objs.size()=1 2024-03-09T15:07:03.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.190+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ZXMw9i9klVGcqOMfEEEpVJFJTBI_2n7_0 2024-03-09T15:07:03.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.190+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2988001687520795612', time=2024-03-09T16:57:02.108640+0000, chain.objs.size()=1 2024-03-09T15:07:03.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.190+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.uxL2YxFcuvV0fU1K7MvTF7C1jc7yUTw_0 2024-03-09T15:07:03.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.194+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9067546822680139941', time=2024-03-09T16:57:02.240724+0000, chain.objs.size()=1 2024-03-09T15:07:03.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.194+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.YIERGWOu0L_967H6r2WRqpJCVONrDhy_0 2024-03-09T15:07:03.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.194+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7734695087237869499', time=2024-03-09T16:57:02.322432+0000, chain.objs.size()=1 2024-03-09T15:07:03.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.194+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.lEx0DXsY4sd4cv9FUqFx0lax2ngmt7M_0 2024-03-09T15:07:03.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.194+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.74673837099004717', time=2024-03-09T16:57:02.357241+0000, chain.objs.size()=1 2024-03-09T15:07:03.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.194+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.LXcA4UKPmNh2yq31M3FlvUQZmdavrOu_0 2024-03-09T15:07:03.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.194+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10590817015276497678', time=2024-03-09T16:57:02.358648+0000, chain.objs.size()=1 2024-03-09T15:07:03.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.194+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.fojiQnhd3BKGMDyqhxHEhpIO7OhPrzE_0 2024-03-09T15:07:03.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.194+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10542784935654029863', time=2024-03-09T16:57:02.484058+0000, chain.objs.size()=1 2024-03-09T15:07:03.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.194+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.aL6SFFpWqwEGHbx5okWeS4ijrucgX6e_0 2024-03-09T15:07:03.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.194+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8535709556480251243', time=2024-03-09T16:57:02.512320+0000, chain.objs.size()=1 2024-03-09T15:07:03.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.194+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.GUSeouGznTSZvXr78S_I1X8okLxHm65_0 2024-03-09T15:07:03.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16247658866531182166', time=2024-03-09T16:57:02.566657+0000, chain.objs.size()=1 2024-03-09T15:07:03.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.h_Ogxa1QiekTo4iv-ptEjfZQLNQfxBq_0 2024-03-09T15:07:03.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5618357326716793959', time=2024-03-09T16:57:02.623743+0000, chain.objs.size()=1 2024-03-09T15:07:03.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.OIOaAWTrWppIYgktaMVYmWsZHGIpgH4_0 2024-03-09T15:07:03.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9253184153545396830', time=2024-03-09T16:57:02.637946+0000, chain.objs.size()=1 2024-03-09T15:07:03.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.8IBXsEkpS4HLgIAPmtbkGGsWDfUNsHY_0 2024-03-09T15:07:03.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13532654173321372778', time=2024-03-09T16:57:02.809370+0000, chain.objs.size()=1 2024-03-09T15:07:03.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.3SfSNPUm4sxzEQDPA-qiCyha5nuxdGm_0 2024-03-09T15:07:03.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13236328980373023075', time=2024-03-09T16:57:02.823815+0000, chain.objs.size()=1 2024-03-09T15:07:03.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.aqiNoe6ZyAyEo6GeFrTq7mQIroKK8Fk_0 2024-03-09T15:07:03.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6813096000074122618', time=2024-03-09T16:57:02.829858+0000, chain.objs.size()=1 2024-03-09T15:07:03.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xTWaJNIcmHnn750D6lB0JLV2sXORt4k_0 2024-03-09T15:07:03.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17453192657443836602', time=2024-03-09T16:57:02.842154+0000, chain.objs.size()=1 2024-03-09T15:07:03.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.OBImkaDJoYRfuT1XY4AsRtwI6wKx8Sn_0 2024-03-09T15:07:03.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13514119861420565044', time=2024-03-09T16:57:02.854999+0000, chain.objs.size()=1 2024-03-09T15:07:03.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.lUfXYns0sOBSn349YyALIsT0Y6iC60v_0 2024-03-09T15:07:03.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14403197375669633511', time=2024-03-09T16:57:02.864694+0000, chain.objs.size()=1 2024-03-09T15:07:03.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.rqL3TWWNCSoOgIyTdCLBHXZiDP8N_YY_0 2024-03-09T15:07:03.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.202+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5371947444585783986', time=2024-03-09T16:57:03.027363+0000, chain.objs.size()=1 2024-03-09T15:07:03.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.202+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.pMY_Xs25RBJbvDMqz8MiYhB8jWen0A1_0 2024-03-09T15:07:03.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.210+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/41630 2024-03-09T15:07:03.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-03-09T15:07:03.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7869084319112060408', time=2024-03-09T16:57:03.046054+0000, chain.objs.size()=1 2024-03-09T15:07:03.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.03XpIWIFSXOR2KOoOgJqq3qrb1nhEuH_0 2024-03-09T15:07:03.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16492743869732634289', time=2024-03-09T16:57:03.079399+0000, chain.objs.size()=1 2024-03-09T15:07:03.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.45RoNB3_5V8e_pS5Lg3ADIPmYHQ4tcB_0 2024-03-09T15:07:03.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15266315092686070173', time=2024-03-09T16:57:03.103104+0000, chain.objs.size()=1 2024-03-09T15:07:03.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.88uuxYfDwRMQ85EjuCbj90eX8BSoss1_0 2024-03-09T15:07:03.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16709303300142587991', time=2024-03-09T16:57:03.268394+0000, chain.objs.size()=1 2024-03-09T15:07:03.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.mdLIYC9vCk_JYP96oSMlzDwWT1Qkak1_0 2024-03-09T15:07:03.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11296114943319788161', time=2024-03-09T16:57:03.357659+0000, chain.objs.size()=1 2024-03-09T15:07:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.BRSKvu_WudZj4ENAk_ZBoYJFzI11yS1_0 2024-03-09T15:07:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.820997710436448485', time=2024-03-09T16:57:03.373979+0000, chain.objs.size()=1 2024-03-09T15:07:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.J25RRdDs92LZIjK64JJBJx62VqzO_uG_0 2024-03-09T15:07:03.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12604950410242018048', time=2024-03-09T16:57:03.379608+0000, chain.objs.size()=1 2024-03-09T15:07:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.58fYEqGUDJpQqco3Scfum9KfXwmC7aR_0 2024-03-09T15:07:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13031799256938907068', time=2024-03-09T16:57:03.578856+0000, chain.objs.size()=1 2024-03-09T15:07:03.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oWwI_tTaoTMVucNvJEdSvH028IsBI_e_0 2024-03-09T15:07:03.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3647951104047866012', time=2024-03-09T16:57:18.359926+0000, chain.objs.size()=1 2024-03-09T15:07:03.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.335__shadow_.3kufjTzqwzM1cQV7sOq-mQMWaYqdgyd_0 2024-03-09T15:07:03.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14171650112244695138', time=2024-03-09T16:59:17.991936+0000, chain.objs.size()=1 2024-03-09T15:07:03.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.458__shadow_.kQE4_p0GCfHLQeXB3Dmx-60g35BABEU_0 2024-03-09T15:07:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18234124361731174579', time=2024-03-09T16:59:58.013530+0000, chain.objs.size()=1 2024-03-09T15:07:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.508__shadow_.O2NB5cjIFcX42QHiqDNtjSgnc_YuPRc_0 2024-03-09T15:07:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15697266423316084386', time=2024-03-09T17:00:18.831342+0000, chain.objs.size()=6 2024-03-09T15:07:03.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~Tg2eq-o6xQtgQobBC-iMjW2gnayS4nE.1 2024-03-09T15:07:03.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.gLDL2LkhpSczYImjtUBmDlFtSyjWLTiW.2 2024-03-09T15:07:03.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~Tg2eq-o6xQtgQobBC-iMjW2gnayS4nE.3 2024-03-09T15:07:03.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~Tg2eq-o6xQtgQobBC-iMjW2gnayS4nE.4 2024-03-09T15:07:03.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~Tg2eq-o6xQtgQobBC-iMjW2gnayS4nE.5 2024-03-09T15:07:03.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~Tg2eq-o6xQtgQobBC-iMjW2gnayS4nE.6 2024-03-09T15:07:03.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1840775826028865303', time=2024-03-09T17:00:35.341714+0000, chain.objs.size()=3 2024-03-09T15:07:03.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.519__multipart_mymultipart.2~XPifb3n2tAAkP1_wjjUiMZS8FZQ2q-s.1 2024-03-09T15:07:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.519__multipart_mymultipart.2~XPifb3n2tAAkP1_wjjUiMZS8FZQ2q-s.2 2024-03-09T15:07:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.519__multipart_mymultipart.2~XPifb3n2tAAkP1_wjjUiMZS8FZQ2q-s.3 2024-03-09T15:07:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~6U1M6hGcgnBFBI-vqGjuIncgIAJPtoI', time=2024-03-09T17:00:43.471536+0000, chain.objs.size()=2 2024-03-09T15:07:03.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.525__multipart_mymultipart.2~6U1M6hGcgnBFBI-vqGjuIncgIAJPtoI.1 2024-03-09T15:07:03.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.525__multipart_mymultipart.2~6U1M6hGcgnBFBI-vqGjuIncgIAJPtoI.2 2024-03-09T15:07:03.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1848325213546825661', time=2024-03-09T17:01:33.451685+0000, chain.objs.size()=1 2024-03-09T15:07:03.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.549__shadow_.TFaLBfTk5nfRfy6Gejb4lYc8PVjW7_t_0 2024-03-09T15:07:03.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.222+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14537141851609972696', time=2024-03-09T17:01:36.267223+0000, chain.objs.size()=1 2024-03-09T15:07:03.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.222+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.551__shadow_.L0e-MeDp84Iz-q5ei75mtbxrwhnoynl_0 2024-03-09T15:07:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.226+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9803750147009620611', time=2024-03-09T17:01:37.776200+0000, chain.objs.size()=1 2024-03-09T15:07:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.226+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.552__shadow_.fnMm0tzWjbjjr70Ui63r7nI9qP_1zKK_0 2024-03-09T15:07:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.226+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7129154774403841482', time=2024-03-09T17:01:47.668239+0000, chain.objs.size()=1 2024-03-09T15:07:03.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.226+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.558__shadow_.NEpfgyQeKiT3sWrJdy73vIkSTv1A8Yg_0 2024-03-09T15:07:03.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.226+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11443239344658662689', time=2024-03-09T17:01:58.475338+0000, chain.objs.size()=1 2024-03-09T15:07:03.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.226+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:dxm8bQmtlpllZKQTVd7jPaaVX1ZQNOP_.Jwp8esWi7JaaTu6kHKC3IkfbBYDQOg7_0 2024-03-09T15:07:03.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.226+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13267406868190599127', time=2024-03-09T17:02:00.738611+0000, chain.objs.size()=1 2024-03-09T15:07:03.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.226+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.563__shadow:TTgZ.IMBxAYxe59wmc95rNtOPo5AY1d_.0dYErkTJr5szYIU5jkcNMtvbZYY6pLX_0 2024-03-09T15:07:03.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.226+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17815417541809792580', time=2024-03-09T17:02:21.023607+0000, chain.objs.size()=1 2024-03-09T15:07:03.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.226+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:TZiFJTQXfmLqz0h0BtG8O6ITAxBMARn_.JtJKxv2oND1d0X21zU8yq--LzDAkvL6_0 2024-03-09T15:07:03.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.226+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3080705137406611750', time=2024-03-09T17:02:39.481027+0000, chain.objs.size()=1 2024-03-09T15:07:03.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.226+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.573__shadow:MfJmlB2qzbbM5BVYhjWeizee4Czmi8m_.9OZvTSdS9Hkz2yUS1Dt2DaHzpXpaSrB_0 2024-03-09T15:07:03.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.226+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5954656307849784638', time=2024-03-09T17:02:54.190624+0000, chain.objs.size()=1 2024-03-09T15:07:03.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.226+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.589__shadow_.fsk5Vlz8vXPy_kacfeviAElh6N7VsSI_0 2024-03-09T15:07:03.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.226+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15075546481288086711', time=2024-03-09T17:03:23.968113+0000, chain.objs.size()=1 2024-03-09T15:07:03.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.226+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.611__shadow_._2ytUKvPYHyzOq9IDb9eckHzp-sQwCw_0 2024-03-09T15:07:03.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.230+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14880572518537778903', time=2024-03-09T17:03:36.120954+0000, chain.objs.size()=1 2024-03-09T15:07:03.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.230+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.619__shadow_.ouEK6xcDo_Z6jdy5BE6bm89TV_5TTpC_0 2024-03-09T15:07:03.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.230+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11993956685364812098', time=2024-03-09T17:03:45.097272+0000, chain.objs.size()=1 2024-03-09T15:07:03.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.230+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.629__shadow_.3q3w_9_IttKXgtEoEBvLNbu5pm4rbNI_0 2024-03-09T15:07:03.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.230+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.657__shadow_.2pCKxLiLdTbNGPjwxskbvHHgmOrsKiR_1_cea0d5efadbc2b8fdffab7e646ac1691', time=2024-03-09T17:04:13.755119+0000, chain.objs.size()=1 2024-03-09T15:07:03.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.230+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.657__shadow_.2pCKxLiLdTbNGPjwxskbvHHgmOrsKiR_0 2024-03-09T15:07:03.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.230+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17573781441516063753', time=2024-03-09T17:04:37.228808+0000, chain.objs.size()=1 2024-03-09T15:07:03.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.230+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.686__shadow:OY.u9NIwb6q.x0CZ58IkQN6SO11NEyP_.pS7Cnb03iQVuxVHtvJ_m_dbvYV4CVu9_0 2024-03-09T15:07:03.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.230+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17978950485153424301', time=2024-03-09T17:05:58.556066+0000, chain.objs.size()=1 2024-03-09T15:07:03.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.230+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.734__shadow_.SX2GhVB7Kmj6yti81StY4YOxa3BvIm3_0 2024-03-09T15:07:03.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:03.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.242+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-09T15:07:03.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:03.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45957' 2024-03-09T15:07:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7922671168504103656', time=2024-03-09T16:54:51.966941+0000, chain.objs.size()=1 2024-03-09T15:07:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.254__shadow_.hrIYf_ZyPtsgDiPf5thJrfDYeLS25L5_0 2024-03-09T15:07:03.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11441245192917876065', time=2024-03-09T16:55:14.936692+0000, chain.objs.size()=1 2024-03-09T15:07:03.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.iEsGwZWXrjGz9LOgCeKm7NLDdrTfAYR_0 2024-03-09T15:07:03.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13062871911297862353', time=2024-03-09T16:55:14.948035+0000, chain.objs.size()=1 2024-03-09T15:07:03.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.SF68cIgdBUvHPnd_zQLHK4dWI_MSvbL_0 2024-03-09T15:07:03.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.336414039912278319', time=2024-03-09T16:55:15.003079+0000, chain.objs.size()=1 2024-03-09T15:07:03.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.UKLPySJ8Pvh0P3v-Gpl6eq15qyJdLs3_0 2024-03-09T15:07:03.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12327085650883908779', time=2024-03-09T16:55:15.003759+0000, chain.objs.size()=1 2024-03-09T15:07:03.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.9PR0YPIzzGD8WBVibR05doh8BTC2_kF_0 2024-03-09T15:07:03.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4741196689769745762', time=2024-03-09T16:55:15.184047+0000, chain.objs.size()=1 2024-03-09T15:07:03.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.HvnXcCP2QzICS2srX6PGCpe1Gr-9AMR_0 2024-03-09T15:07:03.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8414256253150609464', time=2024-03-09T16:55:15.229602+0000, chain.objs.size()=1 2024-03-09T15:07:03.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.MdAqa7HYojphhUeMJhGbt6bR2j1n3XO_0 2024-03-09T15:07:03.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4499607905353497883', time=2024-03-09T16:55:15.232804+0000, chain.objs.size()=1 2024-03-09T15:07:03.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qbqBFg_JPuub43TtChI340rS_0rOb5M_0 2024-03-09T15:07:03.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2474407768385337678', time=2024-03-09T16:55:15.234571+0000, chain.objs.size()=1 2024-03-09T15:07:03.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.lwn4aasvNgN6nKHPJyrQQWItp7sihDc_0 2024-03-09T15:07:03.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18123499530933860961', time=2024-03-09T16:55:15.401570+0000, chain.objs.size()=1 2024-03-09T15:07:03.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.SV-3sbGlLcpXWrMR7PditbARnpCTI20_0 2024-03-09T15:07:03.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14268210294701796961', time=2024-03-09T16:55:15.483706+0000, chain.objs.size()=1 2024-03-09T15:07:03.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.RnUmw9Aa3Uhc7y-SulNSOhdXpUwmcZa_0 2024-03-09T15:07:03.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1438041203937679980', time=2024-03-09T16:55:15.524629+0000, chain.objs.size()=1 2024-03-09T15:07:03.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Pj7DT7-kzlv4lpgBwuwK_gcN2vKi90u_0 2024-03-09T15:07:03.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.250+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6111734670143964890', time=2024-03-09T16:55:15.682845+0000, chain.objs.size()=1 2024-03-09T15:07:03.251 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.250+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Rs-mLYvgJUmNBS1_62LDJfryBEMOkZQ_0 2024-03-09T15:07:03.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2156321259702764982', time=2024-03-09T16:55:15.722280+0000, chain.objs.size()=1 2024-03-09T15:07:03.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.0Mb0k6bvHrOasPG5HOlqAPY9qfC8aO7_0 2024-03-09T15:07:03.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17255766646463618539', time=2024-03-09T16:55:15.742174+0000, chain.objs.size()=1 2024-03-09T15:07:03.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.yn23t6ImIJhJwI6CnNoT0y0F2eVLibf_0 2024-03-09T15:07:03.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.691428483199289094', time=2024-03-09T16:55:15.995335+0000, chain.objs.size()=1 2024-03-09T15:07:03.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.AunNtylXAFHThqHNzkqKdUqPxvZw8f5_0 2024-03-09T15:07:03.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10637560515169564702', time=2024-03-09T16:55:16.051223+0000, chain.objs.size()=1 2024-03-09T15:07:03.256 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.8zTYDQeBArdrCSRO2rlYaXF9iAicM7p_0 2024-03-09T15:07:03.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12170525323681521164', time=2024-03-09T16:55:16.295832+0000, chain.objs.size()=1 2024-03-09T15:07:03.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.msxEb4fUACA82q-CLOf8jJHwsOhmj1z_0 2024-03-09T15:07:03.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1018137107416173744', time=2024-03-09T16:55:16.298533+0000, chain.objs.size()=1 2024-03-09T15:07:03.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.K-AWp68GN7P6K2n1jRlgbWcLJU1s4Jl_0 2024-03-09T15:07:03.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15634012854039326882', time=2024-03-09T16:55:16.325947+0000, chain.objs.size()=1 2024-03-09T15:07:03.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qrbh-znM8t05gfGyf8UPCaBindYhXBR_0 2024-03-09T15:07:03.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1876310391471814809', time=2024-03-09T16:55:16.356631+0000, chain.objs.size()=1 2024-03-09T15:07:03.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.-M0VfZh8nVpkyjPdTU_mX6AOIYzmP4n_0 2024-03-09T15:07:03.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.567406337680100202', time=2024-03-09T16:55:16.469823+0000, chain.objs.size()=1 2024-03-09T15:07:03.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.FpcSriVuoPvFm69iwtpH61fPE4Sp696_0 2024-03-09T15:07:03.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9504911388533400821', time=2024-03-09T16:55:16.557821+0000, chain.objs.size()=1 2024-03-09T15:07:03.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.asCQeoxMuegPjCl2ZJyOTjJZD0VRZ5V_0 2024-03-09T15:07:03.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3712513995760916640', time=2024-03-09T16:55:16.583792+0000, chain.objs.size()=1 2024-03-09T15:07:03.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.254+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Fl_OSXIpGmHgmFDX2jEIY5LCb-PxrAd_0 2024-03-09T15:07:03.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16961595529614790370', time=2024-03-09T16:55:16.722547+0000, chain.objs.size()=1 2024-03-09T15:07:03.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Pike6zMELQ16VoKY2mBDadg-uW3CoiV_0 2024-03-09T15:07:03.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17619813682816562206', time=2024-03-09T16:55:16.735350+0000, chain.objs.size()=1 2024-03-09T15:07:03.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.1-RZVAbVyXoH8jDs3EVZIZE90NYtU8m_0 2024-03-09T15:07:03.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1213617802963406856', time=2024-03-09T16:55:31.584218+0000, chain.objs.size()=1 2024-03-09T15:07:03.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.272__shadow_.apmPiidv4bJI484RcN2FgswdqPxbKe9_0 2024-03-09T15:07:03.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16591849913976918866', time=2024-03-09T16:55:32.490862+0000, chain.objs.size()=1 2024-03-09T15:07:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.273__shadow_.5nDgl4WmZbhhgLSBytvNVCq8G8VwGwl_0 2024-03-09T15:07:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9810846873644561752', time=2024-03-09T16:55:46.208852+0000, chain.objs.size()=1 2024-03-09T15:07:03.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.k3V-x-H-o9IV6RbjyES5BOEFm-oYb0X_0 2024-03-09T15:07:03.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9830080224860377293', time=2024-03-09T16:55:47.875595+0000, chain.objs.size()=1 2024-03-09T15:07:03.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.E5Cp23ApgTeIRVy-KE6LWjCuEdh9WcA_0 2024-03-09T15:07:03.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7100999978303072582', time=2024-03-09T16:55:48.751848+0000, chain.objs.size()=1 2024-03-09T15:07:03.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.288__shadow_.pAQP9UG3oY7-sbONL6-6y7Dwir2IFsJ_0 2024-03-09T15:07:03.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1422655752623786935', time=2024-03-09T16:56:00.409549+0000, chain.objs.size()=1 2024-03-09T15:07:03.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.300__shadow_.Wc5l8MOBrLlKjB7A7C4b_3Pmatioeet_0 2024-03-09T15:07:03.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4750526567765888803', time=2024-03-09T16:56:13.686423+0000, chain.objs.size()=1 2024-03-09T15:07:03.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.313__shadow:qlfLgsgpHu1lvSCtCc.MOQ0mez3KzTG_.sQVivdF0_gWJj3MO4KQ8PgNyRT8KcYM_0 2024-03-09T15:07:03.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7404004769545839547', time=2024-03-09T16:56:15.820294+0000, chain.objs.size()=1 2024-03-09T15:07:03.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.316__shadow_.ro3PZRGwibJAtR0I5gwXlJ9QRxbKntt_0 2024-03-09T15:07:03.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13758414801352808502', time=2024-03-09T16:56:37.704513+0000, chain.objs.size()=1 2024-03-09T15:07:03.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.262+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.P3vGhBXuR94KZebIYQZnFXKHo-Uafoi_0 2024-03-09T15:07:03.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10111704196646701064', time=2024-03-09T16:56:37.745010+0000, chain.objs.size()=1 2024-03-09T15:07:03.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.mGPexHlwv5y_FXexqbwEpLOJIup1EaT_0 2024-03-09T15:07:03.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16906015707459709195', time=2024-03-09T16:56:37.827958+0000, chain.objs.size()=1 2024-03-09T15:07:03.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.BQqLm72VIamoyK1IC2JaN68pj1HbL1m_0 2024-03-09T15:07:03.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9228572222087171788', time=2024-03-09T16:56:37.847577+0000, chain.objs.size()=1 2024-03-09T15:07:03.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6LhTfbxMZNUUIzXrQ35Vg7jwIdwPz3W_0 2024-03-09T15:07:03.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13079257436392781098', time=2024-03-09T16:56:37.971083+0000, chain.objs.size()=1 2024-03-09T15:07:03.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.M_6-3Uh3YaJqC425KdMUwzAuZNJ4MMH_0 2024-03-09T15:07:03.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10101196116149457332', time=2024-03-09T16:56:37.972628+0000, chain.objs.size()=1 2024-03-09T15:07:03.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.dGTI_0wWPUwlsXbKyGcqni9P6AAaAZ__0 2024-03-09T15:07:03.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5709156948730893459', time=2024-03-09T16:56:38.027656+0000, chain.objs.size()=1 2024-03-09T15:07:03.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.k3NjVSCNuDojpBeZoiuidhmWqH5Tv4Z_0 2024-03-09T15:07:03.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2946336738434315394', time=2024-03-09T16:56:38.047831+0000, chain.objs.size()=1 2024-03-09T15:07:03.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.1gHNLnnBUPO1xd8lRxv3Tc0SGYnlMhh_0 2024-03-09T15:07:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9547789385463332108', time=2024-03-09T16:56:38.263713+0000, chain.objs.size()=1 2024-03-09T15:07:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.2JD6e3AsDPYtSSvPiVASJVyPPnTJ8ph_0 2024-03-09T15:07:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16527256624394972829', time=2024-03-09T16:56:38.302520+0000, chain.objs.size()=1 2024-03-09T15:07:03.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.OeUWHOaooQ31uDigv3RMoeUD30Z2gA2_0 2024-03-09T15:07:03.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9121862926718564706', time=2024-03-09T16:56:38.333969+0000, chain.objs.size()=1 2024-03-09T15:07:03.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.SPFDgQimwJNNoDAj9IeLLNY2mfhgLqL_0 2024-03-09T15:07:03.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6262691582396498910', time=2024-03-09T16:56:38.343037+0000, chain.objs.size()=1 2024-03-09T15:07:03.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Jt_v0eMpUdapm1M6lrgLtaNgSwUnpgp_0 2024-03-09T15:07:03.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14550181347658868657', time=2024-03-09T16:56:38.354996+0000, chain.objs.size()=1 2024-03-09T15:07:03.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.A9w2PyVsBeNAB21a05mV8te7h1i7oqG_0 2024-03-09T15:07:03.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8980402899277402631', time=2024-03-09T16:56:38.358223+0000, chain.objs.size()=1 2024-03-09T15:07:03.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.TDgJobrj8BvciL2PxaMg0rXr-q73tlf_0 2024-03-09T15:07:03.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6557951164145015065', time=2024-03-09T16:56:38.631373+0000, chain.objs.size()=1 2024-03-09T15:07:03.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.5dL9-q16AaMwkVcUGZ7NxNviuX-GISq_0 2024-03-09T15:07:03.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3573522189375559557', time=2024-03-09T16:56:38.798797+0000, chain.objs.size()=1 2024-03-09T15:07:03.280 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.S2NQlycoS88uYQg3Xq-4OJdPOz8xjnC_0 2024-03-09T15:07:03.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9873307087533916142', time=2024-03-09T16:56:38.824753+0000, chain.objs.size()=1 2024-03-09T15:07:03.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.EnLEAhFZ48ITdjcgyoa2kS3YTMG9XCq_0 2024-03-09T15:07:03.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10249325225575318328', time=2024-03-09T16:56:38.839030+0000, chain.objs.size()=1 2024-03-09T15:07:03.281 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.AVs71gw5ayaygAgtQkpxaJPM86Sun4X_0 2024-03-09T15:07:03.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11170965849692810329', time=2024-03-09T16:56:38.848556+0000, chain.objs.size()=1 2024-03-09T15:07:03.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.W0PgWgH4eqeUuYtZE3iTL6x9kj8EApC_0 2024-03-09T15:07:03.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6232971415232925243', time=2024-03-09T16:56:38.892417+0000, chain.objs.size()=1 2024-03-09T15:07:03.282 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-kZMimzkp7IxZZn1JAXLOP_jOInBxlx_0 2024-03-09T15:07:03.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3397037043728962678', time=2024-03-09T16:56:39.138458+0000, chain.objs.size()=1 2024-03-09T15:07:03.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.QBp-7iO1PHTSqxavT8aYIZQ0pdW-Fpv_0 2024-03-09T15:07:03.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8597122099388556447', time=2024-03-09T16:56:39.163543+0000, chain.objs.size()=1 2024-03-09T15:07:03.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.8D08GLYer8p7kgzdU5uO80jMNFzP2_5_0 2024-03-09T15:07:03.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16405279453362291259', time=2024-03-09T16:56:39.192800+0000, chain.objs.size()=1 2024-03-09T15:07:03.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.sH_BE4GvD5oXylwTgNnc2fPCg8Attal_0 2024-03-09T15:07:03.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11386942873684859107', time=2024-03-09T16:56:39.197485+0000, chain.objs.size()=1 2024-03-09T15:07:03.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.iltD1PYNJNEicKvb3_RCE6L2mBr3uxY_0 2024-03-09T15:07:03.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4071973275355819833', time=2024-03-09T16:56:39.377921+0000, chain.objs.size()=1 2024-03-09T15:07:03.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.aGThmXWrxO3MY_QLKYjTMblWUIt_12e_0 2024-03-09T15:07:03.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3619977670802854321', time=2024-03-09T16:56:39.648227+0000, chain.objs.size()=1 2024-03-09T15:07:03.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-y5hz6ymVWIU_XbpDDH1jT0r0W0Oo-8_0 2024-03-09T15:07:03.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1740195170533437904', time=2024-03-09T16:56:39.688319+0000, chain.objs.size()=1 2024-03-09T15:07:03.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.tWZycU1ijq5HFRhivt3vNC53TQHLXUY_0 2024-03-09T15:07:03.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14157644052011858895', time=2024-03-09T16:57:01.445608+0000, chain.objs.size()=1 2024-03-09T15:07:03.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Fm1zJidSvLF6fYdFnRvmM91pVRoGgYW_0 2024-03-09T15:07:03.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3682674760434709582', time=2024-03-09T16:57:01.473608+0000, chain.objs.size()=1 2024-03-09T15:07:03.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.X7jDYuris7oTLXHl9K-6jxUO-_McmQp_0 2024-03-09T15:07:03.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9353734205011885332', time=2024-03-09T16:57:01.494013+0000, chain.objs.size()=1 2024-03-09T15:07:03.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Tqtva5ruVGFMdh-7HIYasriVBk4b8wu_0 2024-03-09T15:07:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4977934921355001391', time=2024-03-09T16:57:01.496407+0000, chain.objs.size()=1 2024-03-09T15:07:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.1NsiilIVlpqOT7wus9SgTTKZ6So2LSx_0 2024-03-09T15:07:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8121089837946266404', time=2024-03-09T16:57:01.544823+0000, chain.objs.size()=1 2024-03-09T15:07:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.CGgFmaXk3CkIyeEy_4kCdGo0MVka-Jw_0 2024-03-09T15:07:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.63411288152560795', time=2024-03-09T16:57:01.559601+0000, chain.objs.size()=1 2024-03-09T15:07:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Ao9MTwnU2zVgax9hZqj-Uq_qw8sEzlu_0 2024-03-09T15:07:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.157712308722957176', time=2024-03-09T16:57:01.782338+0000, chain.objs.size()=1 2024-03-09T15:07:03.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.F_9uH8zWKoKkU0ng9csJxtxgqyIW7aZ_0 2024-03-09T15:07:03.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1743956049421987128', time=2024-03-09T16:57:01.853123+0000, chain.objs.size()=1 2024-03-09T15:07:03.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DqGHs00Kd-XK6oUpJfnOh-kk1Uy26NX_0 2024-03-09T15:07:03.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.290+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18389275396056181014', time=2024-03-09T16:57:02.254057+0000, chain.objs.size()=1 2024-03-09T15:07:03.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.290+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.bedrLNCceeu7jLVEiqFevEH4U3Eebkq_0 2024-03-09T15:07:03.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.290+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16169603757756237288', time=2024-03-09T16:57:02.264431+0000, chain.objs.size()=1 2024-03-09T15:07:03.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.290+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.p0qUWrwQjepZ5Cl-GBavrmWIpL9W0oy_0 2024-03-09T15:07:03.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.290+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9938327903653579484', time=2024-03-09T16:57:02.298318+0000, chain.objs.size()=1 2024-03-09T15:07:03.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.290+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.7DJOI3EOxKJSawrbSGO8dyFpGugj7KG_0 2024-03-09T15:07:03.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11961929656034470953', time=2024-03-09T16:57:02.314387+0000, chain.objs.size()=1 2024-03-09T15:07:03.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.lznSoZITIp3GcP6XfKAK09rVcHM5BRc_0 2024-03-09T15:07:03.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10693885880761963399', time=2024-03-09T16:57:02.330592+0000, chain.objs.size()=1 2024-03-09T15:07:03.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.tgIa7CxxgOdbQ_kSBf0DUUvkVE-NLy0_0 2024-03-09T15:07:03.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8392801750806123387', time=2024-03-09T16:57:02.574076+0000, chain.objs.size()=1 2024-03-09T15:07:03.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.2iXV4-TzGgt_g000kN9e88eBf2ON-PF_0 2024-03-09T15:07:03.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16199850885023503066', time=2024-03-09T16:57:02.581922+0000, chain.objs.size()=1 2024-03-09T15:07:03.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.jx_uklFD6p32XAqm7jxf0ROXhD4ttjZ_0 2024-03-09T15:07:03.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7531145723530603846', time=2024-03-09T16:57:02.634101+0000, chain.objs.size()=1 2024-03-09T15:07:03.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.-KpBcwbdUJI4UmhecsukRfZikVuZS9J_0 2024-03-09T15:07:03.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1701398399429647563', time=2024-03-09T16:57:02.755361+0000, chain.objs.size()=1 2024-03-09T15:07:03.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.lRrtYUgGMZzf9GT-6PiAn442Te4NyUx_0 2024-03-09T15:07:03.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16400629316011092041', time=2024-03-09T16:57:02.773441+0000, chain.objs.size()=1 2024-03-09T15:07:03.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.QvdHF8jWwTHCpNGUkXclVaMhnyrCJON_0 2024-03-09T15:07:03.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14292098956597402997', time=2024-03-09T16:57:02.809306+0000, chain.objs.size()=1 2024-03-09T15:07:03.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.hakSr07e_webTqro9ywfldv5stvSZfQ_0 2024-03-09T15:07:03.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3848563683575452991', time=2024-03-09T16:57:02.813640+0000, chain.objs.size()=1 2024-03-09T15:07:03.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.fzddHupaKF_rfIfO-Xvju8AZCF3i7pQ_0 2024-03-09T15:07:03.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17847628944791526040', time=2024-03-09T16:57:02.838128+0000, chain.objs.size()=1 2024-03-09T15:07:03.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.SYrnkIzV0U4UqFc-TRphAMtnCzpEBKH_0 2024-03-09T15:07:03.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10830008250729348341', time=2024-03-09T16:57:02.974963+0000, chain.objs.size()=1 2024-03-09T15:07:03.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.etjZfuWSAycsAuCn6-OFvKHrGQqITfd_0 2024-03-09T15:07:03.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14130804305731057658', time=2024-03-09T16:57:02.988767+0000, chain.objs.size()=1 2024-03-09T15:07:03.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.IjHDnq52UXC3EHYT2sMTho90r16dkid_0 2024-03-09T15:07:03.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4315338420606862469', time=2024-03-09T16:57:03.091079+0000, chain.objs.size()=1 2024-03-09T15:07:03.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.RgtBsiKSWW1UZ2d0xk6aYcGypNwCqfP_0 2024-03-09T15:07:03.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9221147883520589619', time=2024-03-09T16:57:03.298114+0000, chain.objs.size()=1 2024-03-09T15:07:03.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.5kP_OrbIxI3_JGfFrGFA58_ZOfH81kn_0 2024-03-09T15:07:03.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3427214690766572094', time=2024-03-09T16:57:03.300182+0000, chain.objs.size()=1 2024-03-09T15:07:03.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.3udeQnzWGmsT2v-5JTYq_pNnzPzQmpe_0 2024-03-09T15:07:03.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8443603947098095740', time=2024-03-09T16:57:03.322763+0000, chain.objs.size()=1 2024-03-09T15:07:03.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.FtrBrpwzD4WGcve3ngDnQMwRlKB2ssT_0 2024-03-09T15:07:03.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3866996764452423564', time=2024-03-09T16:57:10.627300+0000, chain.objs.size()=1 2024-03-09T15:07:03.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.326__shadow_.DPNraltYMWLgFe2ghsN8DTqVk2eAeXT_0 2024-03-09T15:07:03.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7375356731245991089', time=2024-03-09T16:58:54.597045+0000, chain.objs.size()=1 2024-03-09T15:07:03.304 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.437__shadow_.-SJ0wMexjxlRHk83YhpzAE_Kn0Taj9-_0 2024-03-09T15:07:03.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14912392934702019659', time=2024-03-09T16:59:31.487806+0000, chain.objs.size()=1 2024-03-09T15:07:03.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.477__shadow_.sSU0aTNUoIGdILcNXSR4w946W7CvlvQ_0 2024-03-09T15:07:03.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9220983026353314168', time=2024-03-09T16:59:59.483730+0000, chain.objs.size()=1 2024-03-09T15:07:03.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.510__multipart_mymultipartcopy.2~iiZVFcK1oOuWFD_RTqAIKkDWdfiRJT2.1 2024-03-09T15:07:03.305 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14389151034770800347', time=2024-03-09T17:00:11.239636+0000, chain.objs.size()=3 2024-03-09T15:07:03.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.515__multipart_mymultipart.2~pxhu_FTpBJf03Azs09-Pfg8Ko4NTDMK.1 2024-03-09T15:07:03.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.515__multipart_mymultipart.2~pxhu_FTpBJf03Azs09-Pfg8Ko4NTDMK.2 2024-03-09T15:07:03.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.515__multipart_mymultipart.2~pxhu_FTpBJf03Azs09-Pfg8Ko4NTDMK.3 2024-03-09T15:07:03.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.306+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17480301350238870200', time=2024-03-09T17:00:35.766203+0000, chain.objs.size()=1 2024-03-09T15:07:03.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.306+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.518__shadow_.vO-eBRRpRceRQ4u_j_mNViwtlJK22zb_0 2024-03-09T15:07:03.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.306+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17705758044678676481', time=2024-03-09T17:01:33.641367+0000, chain.objs.size()=1 2024-03-09T15:07:03.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.306+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.549__shadow_.iMSHWnpeP5ziNeD7-2CAGmnFr8hETaO_0 2024-03-09T15:07:03.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5857451054911576157', time=2024-03-09T17:01:34.978172+0000, chain.objs.size()=1 2024-03-09T15:07:03.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.550__shadow_.SwXsxw7vDm2P2u-X8jr387qMOt5oTv0_0 2024-03-09T15:07:03.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4287289030270828168', time=2024-03-09T17:01:59.092498+0000, chain.objs.size()=1 2024-03-09T15:07:03.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:MGgFMq6XKVFAigBeShHTqSnD2b6KXvE_.V8mIMZFqiUceXyGeYZMo7rAbYZpqXGo_0 2024-03-09T15:07:03.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15271634255885929264', time=2024-03-09T17:02:05.918926+0000, chain.objs.size()=1 2024-03-09T15:07:03.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.567__shadow_.BrkPPabckZLM-L3YB3a8dSvB4852ewH_0 2024-03-09T15:07:03.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18275703773727094548', time=2024-03-09T17:02:09.738290+0000, chain.objs.size()=1 2024-03-09T15:07:03.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.568__shadow_.y7Q5juzCKf6UzLPrH49T9rLe1JWcPCW_0 2024-03-09T15:07:03.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8417093107691691883', time=2024-03-09T17:02:14.241235+0000, chain.objs.size()=1 2024-03-09T15:07:03.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.569__shadow:VCO8RmfWS5jjRSHIjcDEh2IQrIBmHDg_.PHGKp3_t5R6JJRVTyYVY6gc6qomtl2g_0 2024-03-09T15:07:03.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.314+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/45957 2024-03-09T15:07:03.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.322+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-03-09T15:07:03.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.322+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14643573951915090637', time=2024-03-09T17:02:26.273311+0000, chain.objs.size()=1 2024-03-09T15:07:03.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.322+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:Z7vTttGzxxeDfhGaioariko2fNpR3Ph_.lprHH0MhCWWtFbMpcW8MIE_KS5sLrJI_0 2024-03-09T15:07:03.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.322+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5766004513418463160', time=2024-03-09T17:02:26.605627+0000, chain.objs.size()=1 2024-03-09T15:07:03.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.322+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:t..zQNU3Zm7d.i00dYP9.X70gvslzdy_.4efvkvZc_Mbz_kkl2_VPKWPdxlGNpxP_0 2024-03-09T15:07:03.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.322+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1396260800931845576', time=2024-03-09T17:02:30.525765+0000, chain.objs.size()=1 2024-03-09T15:07:03.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.322+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:-QmnH.rZN7O1IzzHyAacxWy-mMUoTFJ_.T9mnLVTw3gqKuhL3MYoJtwX2WnRBkjL_0 2024-03-09T15:07:03.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.322+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7751552903517448334', time=2024-03-09T17:02:37.548342+0000, chain.objs.size()=1 2024-03-09T15:07:03.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.322+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.572__shadow:bajOzFAfoWShhBCQNzbpWS2HzWnHL6M_.W2KmjtL3u1-5qTwjp2ktSfaGKSBCAxp_0 2024-03-09T15:07:03.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.322+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14219301278974295272', time=2024-03-09T17:02:46.422256+0000, chain.objs.size()=1 2024-03-09T15:07:03.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.322+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.580__shadow:e3vF3Jl7Y6e7nje1x0BjpXzzqYPIg8j_.ozLp7vs3jbv5FH74sa0lg8s-m6-uDZc_0 2024-03-09T15:07:03.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.322+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3906167973735198985', time=2024-03-09T17:02:46.465193+0000, chain.objs.size()=1 2024-03-09T15:07:03.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.322+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.580__shadow:CcxusmMr.vvpu8NXjATUMzYzFEjggFZ_.ZVbX_HMyiW7DGgEZt9VAHg-V5a05whm_0 2024-03-09T15:07:03.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.322+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18371363071154110641', time=2024-03-09T17:02:59.160137+0000, chain.objs.size()=1 2024-03-09T15:07:03.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.322+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.595__shadow_.xkX9WzX9NlyN5jkX3U3dqw2dITLsQSq_0 2024-03-09T15:07:03.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.322+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4401056362906215142', time=2024-03-09T17:04:36.497395+0000, chain.objs.size()=1 2024-03-09T15:07:03.323 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.322+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.685__shadow:HuVPAoXqqt3oDz40gS8ABVmd4CntcXZ_.fc6yNPhLibjoxI5pfiWNcc9kMaA8XX1_0 2024-03-09T15:07:03.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:03.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.334+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-09T15:07:03.336 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:03.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:03.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45196' 2024-03-09T15:07:03.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3563838171374696386', time=2024-03-09T16:51:57.662491+0000, chain.objs.size()=1 2024-03-09T15:07:03.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.160__shadow_.ld8qB6E2vr5imchllUJ6SHMqNNDLPPK_0 2024-03-09T15:07:03.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.554000875341506246', time=2024-03-09T16:54:22.776730+0000, chain.objs.size()=1 2024-03-09T15:07:03.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.225__shadow_.87n5QWWekxZ7ISmxk43HdvKwTDgA7Dg_0 2024-03-09T15:07:03.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13123322721898246525', time=2024-03-09T16:54:26.581630+0000, chain.objs.size()=1 2024-03-09T15:07:03.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.229__shadow_.fm0hM_UAY0YTVqdmJQlyim057JxaTw-_0 2024-03-09T15:07:03.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.304397900556734337', time=2024-03-09T16:54:28.981390+0000, chain.objs.size()=1 2024-03-09T15:07:03.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.231__shadow_.cFvrvwh7vB796TzlvMpKqMbDZ9TRSxw_0 2024-03-09T15:07:03.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16039243698444723864', time=2024-03-09T16:54:30.413817+0000, chain.objs.size()=1 2024-03-09T15:07:03.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.232__shadow_.G5CbHfAyfbYZEzK-ieRfKPhQi5FfAq8_0 2024-03-09T15:07:03.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12483813027851534358', time=2024-03-09T16:54:43.476417+0000, chain.objs.size()=1 2024-03-09T15:07:03.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.245__shadow_.0UC6UBj_pr4vuTHBu8otzyBakdbC6OW_0 2024-03-09T15:07:03.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3279204009548192689', time=2024-03-09T16:54:44.395636+0000, chain.objs.size()=1 2024-03-09T15:07:03.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.246__shadow_.6LIgSF9a1-5GPGNS0KU-I2QwA27jd1j_0 2024-03-09T15:07:03.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562166230414417400', time=2024-03-09T16:55:14.837262+0000, chain.objs.size()=1 2024-03-09T15:07:03.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.QM-JYUSJ46pDQavCnoZ5ay3nggaVSKO_0 2024-03-09T15:07:03.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10076462896013147303', time=2024-03-09T16:55:14.955724+0000, chain.objs.size()=1 2024-03-09T15:07:03.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.L1m--oVuRJxRtyAbTMwsQhFUW7EpxGl_0 2024-03-09T15:07:03.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17530119228960657320', time=2024-03-09T16:55:14.961273+0000, chain.objs.size()=1 2024-03-09T15:07:03.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.NqgB_qgErY7FwHCvBK9RwOHdzBxOOYX_0 2024-03-09T15:07:03.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14986335045381604650', time=2024-03-09T16:55:14.964870+0000, chain.objs.size()=1 2024-03-09T15:07:03.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.eowjH7vyhaLnGY7qwr3b8Jqiy6Wsb8O_0 2024-03-09T15:07:03.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9709597407050502974', time=2024-03-09T16:55:15.402439+0000, chain.objs.size()=1 2024-03-09T15:07:03.341 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.zg6fH5TMnztwCRNTpW87-_2WDCSwKFm_0 2024-03-09T15:07:03.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.342+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17453355418650669925', time=2024-03-09T16:55:15.407241+0000, chain.objs.size()=1 2024-03-09T15:07:03.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.3_COFNUojKNWMFhSP0lwZ_onr4YIgDz_0 2024-03-09T15:07:03.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.342+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1209615856411489311', time=2024-03-09T16:55:15.410256+0000, chain.objs.size()=1 2024-03-09T15:07:03.342 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.i7v_Q3fQzfJjowOrhis_j7NX6vWl29C_0 2024-03-09T15:07:03.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.342+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16379292101551347012', time=2024-03-09T16:55:15.413762+0000, chain.objs.size()=1 2024-03-09T15:07:03.343 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.7yfvUxl_GSqqjkRZSJfH37VgqTQMPi3_0 2024-03-09T15:07:03.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.342+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13415311392019068577', time=2024-03-09T16:55:15.432427+0000, chain.objs.size()=1 2024-03-09T15:07:03.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.b2SFCXyrZ9g-5XvB45ryI7fyg1m6tr8_0 2024-03-09T15:07:03.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13528019618233477334', time=2024-03-09T16:55:15.546163+0000, chain.objs.size()=1 2024-03-09T15:07:03.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.J8TSLy7_odqOTqghgU8SEmAqcXIb7zi_0 2024-03-09T15:07:03.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8207945231778123640', time=2024-03-09T16:55:15.559944+0000, chain.objs.size()=1 2024-03-09T15:07:03.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.tNLO7ptgXY9Zs80uaQCt6UlppWXXckp_0 2024-03-09T15:07:03.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9350394828922249136', time=2024-03-09T16:55:15.769156+0000, chain.objs.size()=1 2024-03-09T15:07:03.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.bgvyxXJ3IpCOdwcGa39o12ZzsoQgCkG_0 2024-03-09T15:07:03.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11220730118213288757', time=2024-03-09T16:55:15.813534+0000, chain.objs.size()=1 2024-03-09T15:07:03.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.JZW-Fey0_juwdghSyT_kL2sddfgC2p-_0 2024-03-09T15:07:03.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13002270949613304874', time=2024-03-09T16:55:15.827224+0000, chain.objs.size()=1 2024-03-09T15:07:03.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.e1_Z6AfbaYt2BMm_cgHcP81XWuwGK2x_0 2024-03-09T15:07:03.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.637865745942332130', time=2024-03-09T16:55:15.946018+0000, chain.objs.size()=1 2024-03-09T15:07:03.354 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.zfrFwaW47U8j8usXXyR9Ds4qBtCJQel_0 2024-03-09T15:07:03.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1338653761971519742', time=2024-03-09T16:55:15.970021+0000, chain.objs.size()=1 2024-03-09T15:07:03.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.SRTkuvBzMtot3SSBBgPTBpJDgro_QyH_0 2024-03-09T15:07:03.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8107326148909573453', time=2024-03-09T16:55:16.034723+0000, chain.objs.size()=1 2024-03-09T15:07:03.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Xf4MDcJ2k9QOSO7tDwDI2tjsU39_Vqq_0 2024-03-09T15:07:03.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13792363480661125732', time=2024-03-09T16:55:16.061845+0000, chain.objs.size()=1 2024-03-09T15:07:03.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.lznCFu9FcnVAHnnvkUeHEv0ULVAjCPX_0 2024-03-09T15:07:03.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7726449830115586768', time=2024-03-09T16:55:16.071262+0000, chain.objs.size()=1 2024-03-09T15:07:03.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.4Y9db6r_wArndizpfcGCs3Fpd2vaNdw_0 2024-03-09T15:07:03.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18089423043136083436', time=2024-03-09T16:55:16.079580+0000, chain.objs.size()=1 2024-03-09T15:07:03.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.R6E6oX4EFAGlCxUsTgHyVYWznRDJYam_0 2024-03-09T15:07:03.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6110016461473920113', time=2024-03-09T16:55:16.232722+0000, chain.objs.size()=1 2024-03-09T15:07:03.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Z6yq5CqmnqDItYysSz1ZqI8xfv5Zdx9_0 2024-03-09T15:07:03.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12282973388806033977', time=2024-03-09T16:55:16.282063+0000, chain.objs.size()=1 2024-03-09T15:07:03.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.9gXZcwh3rCSze_xdi4HcN_8fQmX-mcV_0 2024-03-09T15:07:03.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12518276929026067601', time=2024-03-09T16:55:16.340567+0000, chain.objs.size()=1 2024-03-09T15:07:03.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_._7DHAtCcmEp35OEMTESoCLVgngXupah_0 2024-03-09T15:07:03.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4974939110977871559', time=2024-03-09T16:55:16.351644+0000, chain.objs.size()=1 2024-03-09T15:07:03.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.OQhMUOcaHQpQXDpat_qWmnrpi1jVtVT_0 2024-03-09T15:07:03.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9527215959604753289', time=2024-03-09T16:55:16.477822+0000, chain.objs.size()=1 2024-03-09T15:07:03.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.LG8arf4jf-va-_7PKSp9TXOE3b-tlAs_0 2024-03-09T15:07:03.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15842440189863351882', time=2024-03-09T16:55:16.576759+0000, chain.objs.size()=1 2024-03-09T15:07:03.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Vp7afxoo-PF6ycpGeMNQNDCJr1VBMMB_0 2024-03-09T15:07:03.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18089528944973439484', time=2024-03-09T16:55:16.580806+0000, chain.objs.size()=1 2024-03-09T15:07:03.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.0rHrNu4TqdZJrr4Y1nBGKHMu9mhpOfq_0 2024-03-09T15:07:03.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5488038939651571000', time=2024-03-09T16:55:16.585230+0000, chain.objs.size()=1 2024-03-09T15:07:03.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.wgNCyKgGob43ViDjMW-yNQwOUPjFp4h_0 2024-03-09T15:07:03.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10758955039264324224', time=2024-03-09T16:55:16.589782+0000, chain.objs.size()=1 2024-03-09T15:07:03.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.XLrg9EREA6ICligIY6wRVt9o-yoG6yJ_0 2024-03-09T15:07:03.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17197085893784233182', time=2024-03-09T16:55:16.598815+0000, chain.objs.size()=1 2024-03-09T15:07:03.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.4ZIfaLbC4xaN3fjrqUGQGfBS6PIoYyR_0 2024-03-09T15:07:03.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10552110849364336666', time=2024-03-09T16:55:16.628236+0000, chain.objs.size()=1 2024-03-09T15:07:03.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.XDqVXmmk8s5Gb71WVUHHMh7OM0aSv76_0 2024-03-09T15:07:03.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3877388443982596531', time=2024-03-09T16:55:16.629036+0000, chain.objs.size()=1 2024-03-09T15:07:03.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.kSJFXiGUUpkRP123Y67lwVXPWwuebQf_0 2024-03-09T15:07:03.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.672691859575788330', time=2024-03-09T16:55:16.756135+0000, chain.objs.size()=1 2024-03-09T15:07:03.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.20Lf7EsDkH0l6sEtdMu8KFurPQ7TK-a_0 2024-03-09T15:07:03.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11230999912060250803', time=2024-03-09T16:55:16.756952+0000, chain.objs.size()=1 2024-03-09T15:07:03.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6QtTKGbsfJrQjWO6gkNrvJ7BNXQxvFo_0 2024-03-09T15:07:03.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9920762000639601159', time=2024-03-09T16:55:16.792088+0000, chain.objs.size()=1 2024-03-09T15:07:03.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qQrz98gPnOftxFM_fr9uxPsThoBMv8z_0 2024-03-09T15:07:03.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6831742677788649930', time=2024-03-09T16:55:16.809831+0000, chain.objs.size()=1 2024-03-09T15:07:03.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.f9-3zhpluxYXgTVO3U0rgEyFEzVj0VI_0 2024-03-09T15:07:03.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16633264533230576974', time=2024-03-09T16:55:16.815991+0000, chain.objs.size()=1 2024-03-09T15:07:03.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.354+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.iO8QVSZU2PaStlRAlOhfMmbGLPfARqq_0 2024-03-09T15:07:03.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.358+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15272458174499779474', time=2024-03-09T16:55:16.823517+0000, chain.objs.size()=1 2024-03-09T15:07:03.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.358+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.O9xCPjjEZ02-uRMqF6SB4I21iRbNKBm_0 2024-03-09T15:07:03.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.358+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16438315142180452392', time=2024-03-09T16:55:16.851269+0000, chain.objs.size()=1 2024-03-09T15:07:03.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.358+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.FJ_PIERHbVq_spQGFYp3XEnDe9FpQDW_0 2024-03-09T15:07:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.358+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11447331814797192349', time=2024-03-09T16:55:23.191091+0000, chain.objs.size()=1 2024-03-09T15:07:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.358+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.263__shadow_.-ao8ZWfB5PgMysmM0Z3T_yGU5cgDdKW_0 2024-03-09T15:07:03.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.358+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16815910554879653518', time=2024-03-09T16:55:38.298133+0000, chain.objs.size()=1 2024-03-09T15:07:03.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.358+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.279__shadow_.17gIslHtvW_WuQJXDjG8C1vpFwh7lcX_0 2024-03-09T15:07:03.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4966252729345019933', time=2024-03-09T16:55:47.889252+0000, chain.objs.size()=1 2024-03-09T15:07:03.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.VIEJixsmqdke7bn4CDCuqBZS-TaZPOh_0 2024-03-09T15:07:03.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17708538913882949190', time=2024-03-09T16:55:49.678543+0000, chain.objs.size()=1 2024-03-09T15:07:03.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.289__shadow_.6U4CAJriTWDvh0MHUr3gnlKgFlXUoeX_0 2024-03-09T15:07:03.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9299706563971826598', time=2024-03-09T16:55:53.603472+0000, chain.objs.size()=1 2024-03-09T15:07:03.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.293__shadow_.YZKvFepKNaNeEDheC_tqYomi6vhYwJE_0 2024-03-09T15:07:03.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6972129996540964486', time=2024-03-09T16:55:57.384972+0000, chain.objs.size()=1 2024-03-09T15:07:03.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.297__shadow_.pNA1aCFAAeh27nDoaVRtLZX7PLcWHik_0 2024-03-09T15:07:03.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17631089441038292531', time=2024-03-09T16:56:37.695838+0000, chain.objs.size()=1 2024-03-09T15:07:03.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Ilb37_CK5XoN375SchB96VRSDJDmfYa_0 2024-03-09T15:07:03.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4111626413805288408', time=2024-03-09T16:56:37.816126+0000, chain.objs.size()=1 2024-03-09T15:07:03.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.vOyMbQU_-72vbecwwH1zitq4DOqNR8P_0 2024-03-09T15:07:03.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8697540148297183139', time=2024-03-09T16:56:37.837718+0000, chain.objs.size()=1 2024-03-09T15:07:03.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.aVtsqeN2kk-D-sBldAZgi9xTJTQeoCJ_0 2024-03-09T15:07:03.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16586379004100049889', time=2024-03-09T16:56:37.853035+0000, chain.objs.size()=1 2024-03-09T15:07:03.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.MPYCH7afrd0z9dFF74Xjsy7WHgK4ztz_0 2024-03-09T15:07:03.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4838358404283786927', time=2024-03-09T16:56:37.968579+0000, chain.objs.size()=1 2024-03-09T15:07:03.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ILC_YuJSS6aBm3BIgMAAI7g2ypua7x8_0 2024-03-09T15:07:03.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.366+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.39156956322285666', time=2024-03-09T16:56:38.053990+0000, chain.objs.size()=1 2024-03-09T15:07:03.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.366+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.UmJYnKlJvYDUTd4ot8MNnxW-ChRys-3_0 2024-03-09T15:07:03.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.366+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17487511028955154588', time=2024-03-09T16:56:38.234668+0000, chain.objs.size()=1 2024-03-09T15:07:03.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.366+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.RFhXLimeok1Cdw8oW7hTkYvFrEiyGuM_0 2024-03-09T15:07:03.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.366+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3616011997681088399', time=2024-03-09T16:56:38.276232+0000, chain.objs.size()=1 2024-03-09T15:07:03.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.366+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.e1cl-1LAqWHenNsWV9XUsriKsQM1COA_0 2024-03-09T15:07:03.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.366+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4981024989822031105', time=2024-03-09T16:56:38.288648+0000, chain.objs.size()=1 2024-03-09T15:07:03.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.366+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.iiTZKcZAMDLdhyliRD8OBPuWtSbBRKN_0 2024-03-09T15:07:03.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2623393541511956228', time=2024-03-09T16:56:38.314982+0000, chain.objs.size()=1 2024-03-09T15:07:03.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.xkig9xPUT8JxVs5K--bCxmJ_2M1uVVO_0 2024-03-09T15:07:03.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1554371466693850152', time=2024-03-09T16:56:38.316823+0000, chain.objs.size()=1 2024-03-09T15:07:03.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.CsYg5im0DCNJGwSrkYaebLqJqKVvzzX_0 2024-03-09T15:07:03.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10926298505264493976', time=2024-03-09T16:56:38.344994+0000, chain.objs.size()=1 2024-03-09T15:07:03.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.c1jdr274JLbw085PcLxSZnFcu6NpISD_0 2024-03-09T15:07:03.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8648725822307155579', time=2024-03-09T16:56:38.360271+0000, chain.objs.size()=1 2024-03-09T15:07:03.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.mgCwmlLDrUcIvrB7zV0zjAzsyP5VkMt_0 2024-03-09T15:07:03.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12677703602393258684', time=2024-03-09T16:56:38.392075+0000, chain.objs.size()=1 2024-03-09T15:07:03.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.vwNNWGxpeSz49YpUYtasapGrh1F5Mgo_0 2024-03-09T15:07:03.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7470018166817448072', time=2024-03-09T16:56:38.395058+0000, chain.objs.size()=1 2024-03-09T15:07:03.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.QGyqARNORpc4di0rORszAtYhbfHHzNf_0 2024-03-09T15:07:03.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16981164137863842812', time=2024-03-09T16:56:38.503083+0000, chain.objs.size()=1 2024-03-09T15:07:03.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ID8ROnFJTFVM_IZFsPXT41EKqGjMgF4_0 2024-03-09T15:07:03.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14872165468731350346', time=2024-03-09T16:56:38.504387+0000, chain.objs.size()=1 2024-03-09T15:07:03.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.WsJFEPy72bbk5X9ssUd5rPLPQCjeodC_0 2024-03-09T15:07:03.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3560355327222296619', time=2024-03-09T16:56:38.512090+0000, chain.objs.size()=1 2024-03-09T15:07:03.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.VGbyK5hXvTrJMT7pvkaXpGg62f-6jmL_0 2024-03-09T15:07:03.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17440238494472941049', time=2024-03-09T16:56:38.574925+0000, chain.objs.size()=1 2024-03-09T15:07:03.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.fciHf-VI4ELzfwCPYqfShR3cRqjUmHZ_0 2024-03-09T15:07:03.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9177268627389382576', time=2024-03-09T16:56:38.628753+0000, chain.objs.size()=1 2024-03-09T15:07:03.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.h_r5LdKIAohpgvQs9mddz6hv6EfGqBO_0 2024-03-09T15:07:03.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16241241604744619737', time=2024-03-09T16:56:38.769472+0000, chain.objs.size()=1 2024-03-09T15:07:03.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.4eGtL0VYpf6LoeexBy3607f4HBBVpYq_0 2024-03-09T15:07:03.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4368440727324178068', time=2024-03-09T16:56:38.804278+0000, chain.objs.size()=1 2024-03-09T15:07:03.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.xgL8LjRhvUYqmXW8CdAOJfj6M3DU83F_0 2024-03-09T15:07:03.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2844986478906495061', time=2024-03-09T16:56:38.808647+0000, chain.objs.size()=1 2024-03-09T15:07:03.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.P1PkCtSRw58dr-1V5oj2ahCrLRU0HRf_0 2024-03-09T15:07:03.407 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3056831261051624619', time=2024-03-09T16:56:38.824352+0000, chain.objs.size()=1 2024-03-09T15:07:03.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.YZH862LXguhRrPrHoO0xsmUf3o4_CVQ_0 2024-03-09T15:07:03.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15151077787400518857', time=2024-03-09T16:56:39.049341+0000, chain.objs.size()=1 2024-03-09T15:07:03.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.aW3dJkJFAa29oTwH-d6cPJn_s9frqsX_0 2024-03-09T15:07:03.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10580384200375130690', time=2024-03-09T16:56:39.068847+0000, chain.objs.size()=1 2024-03-09T15:07:03.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.RJWqudZmIEHfeUifgU3d6wAkAPRYPZX_0 2024-03-09T15:07:03.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7425681443697207998', time=2024-03-09T16:56:39.078316+0000, chain.objs.size()=1 2024-03-09T15:07:03.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.LntP4t-mSPGm_yN0MzrNURVRHNBQuu3_0 2024-03-09T15:07:03.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.378+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15610738991458442016', time=2024-03-09T16:56:39.157346+0000, chain.objs.size()=1 2024-03-09T15:07:03.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.378+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lw_1w_2TlubWVDWU9bxfu1dZiVX3s-U_0 2024-03-09T15:07:03.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.378+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1966848325523196282', time=2024-03-09T16:56:39.165322+0000, chain.objs.size()=1 2024-03-09T15:07:03.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.378+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.EkiS3jHvN7osfT_3ugSmL5K8nCCeHTo_0 2024-03-09T15:07:03.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.378+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17443493600497284266', time=2024-03-09T16:56:39.173838+0000, chain.objs.size()=1 2024-03-09T15:07:03.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.378+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.EEywnjaMB2mC8JReRMgmJBkcmTDvOgI_0 2024-03-09T15:07:03.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.378+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16647404670506712625', time=2024-03-09T16:56:39.204086+0000, chain.objs.size()=1 2024-03-09T15:07:03.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.378+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.gDajsKJ0n33p4IGB2j8etDMClPv4XZq_0 2024-03-09T15:07:03.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.378+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8302511649044520379', time=2024-03-09T16:56:39.342374+0000, chain.objs.size()=1 2024-03-09T15:07:03.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.378+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.usOZ53HastGYcbtDCjNrqJ-hpNz2m1n_0 2024-03-09T15:07:03.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11843543621159532581', time=2024-03-09T16:56:39.421612+0000, chain.objs.size()=1 2024-03-09T15:07:03.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.9X6wWZrHSXRKgUUPLTsGmCFRu1rbyED_0 2024-03-09T15:07:03.412 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.564209016597963115', time=2024-03-09T16:56:39.426612+0000, chain.objs.size()=1 2024-03-09T15:07:03.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.WVYeelTUFLcG53uySy_iS-sEjK_ODSt_0 2024-03-09T15:07:03.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8687560239093887010', time=2024-03-09T16:56:39.471157+0000, chain.objs.size()=1 2024-03-09T15:07:03.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.RFUiLfGAYXMQiE9SJKzLR04G2xzM78J_0 2024-03-09T15:07:03.413 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16755485542202228041', time=2024-03-09T16:56:39.560239+0000, chain.objs.size()=1 2024-03-09T15:07:03.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.RRsDYoX4Q5t31Dl0GTaTHiVifZMC5-p_0 2024-03-09T15:07:03.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7707695908375937089', time=2024-03-09T16:56:39.580617+0000, chain.objs.size()=1 2024-03-09T15:07:03.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.s6YnwH9rRJAYLnOLYnDLmQHqoMekiyM_0 2024-03-09T15:07:03.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7796018332782338057', time=2024-03-09T16:56:39.591947+0000, chain.objs.size()=1 2024-03-09T15:07:03.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.SDdhfrRyawITmt_qpDvF7_5D2D4R0hs_0 2024-03-09T15:07:03.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10573121377465152717', time=2024-03-09T16:56:39.648128+0000, chain.objs.size()=1 2024-03-09T15:07:03.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0Yzk3F8UcTc5B8fKeus0C4EeqdCG3BM_0 2024-03-09T15:07:03.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5868337312386110448', time=2024-03-09T16:56:39.666251+0000, chain.objs.size()=1 2024-03-09T15:07:03.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.TIubLgvK8m4CBpw7UzwqYhNdDl16w3A_0 2024-03-09T15:07:03.420 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3099337721075666023', time=2024-03-09T16:56:39.682001+0000, chain.objs.size()=1 2024-03-09T15:07:03.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kzuU2SNmfAKugGWiGbfKXVcajMMQL49_0 2024-03-09T15:07:03.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14033452219596875755', time=2024-03-09T16:57:01.408610+0000, chain.objs.size()=1 2024-03-09T15:07:03.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.reFCq4ygquBg1AwlBrN5HPdA85uX92I_0 2024-03-09T15:07:03.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11425499917165563799', time=2024-03-09T16:57:01.511195+0000, chain.objs.size()=1 2024-03-09T15:07:03.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Z7futNfUF4Wowu6OnozmLhyoNVXbGt3_0 2024-03-09T15:07:03.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16374285150557363679', time=2024-03-09T16:57:01.526207+0000, chain.objs.size()=1 2024-03-09T15:07:03.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.cw5vPCq-N3nLz87ocjy8_CHXTYYrJXT_0 2024-03-09T15:07:03.422 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18179947924679711575', time=2024-03-09T16:57:01.537565+0000, chain.objs.size()=1 2024-03-09T15:07:03.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oQb60ELkm4qBSsVhtDhmW7Ou6auFsuV_0 2024-03-09T15:07:03.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12439298345663755080', time=2024-03-09T16:57:01.579361+0000, chain.objs.size()=1 2024-03-09T15:07:03.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.kh9uODYpztooR29FqLaCUU_AHnz38IM_0 2024-03-09T15:07:03.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14082433876674700622', time=2024-03-09T16:57:01.584404+0000, chain.objs.size()=1 2024-03-09T15:07:03.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.3VV0MNwUcKbZtt8fnF2Il7viEX03OhH_0 2024-03-09T15:07:03.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3410305203478593626', time=2024-03-09T16:57:01.720117+0000, chain.objs.size()=1 2024-03-09T15:07:03.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.FbTOWpX2eZeNwD9pcg9OlesyIuX3lHZ_0 2024-03-09T15:07:03.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/45196 2024-03-09T15:07:03.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=41, truncated=0, next_marker='' 2024-03-09T15:07:03.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14504181477780198726', time=2024-03-09T16:57:01.756948+0000, chain.objs.size()=1 2024-03-09T15:07:03.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.1Jj3V_DPQbCZcWtFkXJb1jc1wNiU0pm_0 2024-03-09T15:07:03.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11478381372788775619', time=2024-03-09T16:57:01.791284+0000, chain.objs.size()=1 2024-03-09T15:07:03.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.OTWziXsUwZAC8fENdXcYjMhxKjTx7Eq_0 2024-03-09T15:07:03.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8569807048979976367', time=2024-03-09T16:57:01.855134+0000, chain.objs.size()=1 2024-03-09T15:07:03.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DyoYAariEPC1FxfkX8ko7lyTKely1GZ_0 2024-03-09T15:07:03.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14487251642925428083', time=2024-03-09T16:57:01.863520+0000, chain.objs.size()=1 2024-03-09T15:07:03.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.m92dByXZpKWPWowzvAbb5qdjuUR0eOV_0 2024-03-09T15:07:03.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8312443376927669806', time=2024-03-09T16:57:01.874945+0000, chain.objs.size()=1 2024-03-09T15:07:03.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.vo8zyrwl8faJrBTIpbrb9bZj3P3AcyR_0 2024-03-09T15:07:03.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16864369630607226747', time=2024-03-09T16:57:01.978802+0000, chain.objs.size()=1 2024-03-09T15:07:03.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.s9e4LXsj-GedVR19UW_0X2U5TTtLk4P_0 2024-03-09T15:07:03.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16881453905104575338', time=2024-03-09T16:57:01.999356+0000, chain.objs.size()=1 2024-03-09T15:07:03.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.m16Q--ZRhWOuA56NEPzzBtQIwnxjSht_0 2024-03-09T15:07:03.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7793855971626068849', time=2024-03-09T16:57:02.035787+0000, chain.objs.size()=1 2024-03-09T15:07:03.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Nz3fZYZjK3QhZy5N3v0k1hmNpg6mlr7_0 2024-03-09T15:07:03.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9221253635032913957', time=2024-03-09T16:57:02.040903+0000, chain.objs.size()=1 2024-03-09T15:07:03.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.v5ofH1XKoInxOzGP6QqDAGRK_APB7pt_0 2024-03-09T15:07:03.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7226361545624887040', time=2024-03-09T16:57:02.047218+0000, chain.objs.size()=1 2024-03-09T15:07:03.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.f5PP2Y15zAdNh_Pv6beDkWDPFwox4LW_0 2024-03-09T15:07:03.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10947169351345828289', time=2024-03-09T16:57:02.101828+0000, chain.objs.size()=1 2024-03-09T15:07:03.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.dz2XUDgVkWSXt7287dRgQi0aPQ63r1Z_0 2024-03-09T15:07:03.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4541699829070062179', time=2024-03-09T16:57:02.219471+0000, chain.objs.size()=1 2024-03-09T15:07:03.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.9r52ZNLLly9XNoeKo-YATcHcIrLnfnB_0 2024-03-09T15:07:03.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4364726148545378718', time=2024-03-09T16:57:02.266356+0000, chain.objs.size()=1 2024-03-09T15:07:03.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.C5Hw7zMsMrukDf_GLDUenRz-oEYIwI8_0 2024-03-09T15:07:03.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16644498462438483765', time=2024-03-09T16:57:02.493036+0000, chain.objs.size()=1 2024-03-09T15:07:03.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ljpD8UhL4yHoMSdx1anoTHcdu6F8m6U_0 2024-03-09T15:07:03.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8352841322221800524', time=2024-03-09T16:57:02.523177+0000, chain.objs.size()=1 2024-03-09T15:07:03.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.LsMv3iAV0XetWRNaK2p-BlESOd_nuQX_0 2024-03-09T15:07:03.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9770928596199130373', time=2024-03-09T16:57:02.603456+0000, chain.objs.size()=1 2024-03-09T15:07:03.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.0754LKmENFF9kftl7VFiNVt91HnqpNn_0 2024-03-09T15:07:03.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11305965399048276997', time=2024-03-09T16:57:02.745455+0000, chain.objs.size()=1 2024-03-09T15:07:03.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.tttnEUkrQRVACQZHsnAsd7MUXgwxm6c_0 2024-03-09T15:07:03.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8940080606129230197', time=2024-03-09T16:57:02.789816+0000, chain.objs.size()=1 2024-03-09T15:07:03.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Q9TEvMN3Rg0SiaiWSfqFfZEOInHmdLo_0 2024-03-09T15:07:03.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5897648739345946460', time=2024-03-09T16:57:02.800066+0000, chain.objs.size()=1 2024-03-09T15:07:03.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.XrULqsOcj1Y4SyMrhQhLxvNsJ8lU-CT_0 2024-03-09T15:07:03.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1665088530488119667', time=2024-03-09T16:57:02.802100+0000, chain.objs.size()=1 2024-03-09T15:07:03.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.pYYTM6gaq-hq-oJDgGmXUu7SNZpc2Bd_0 2024-03-09T15:07:03.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1332054609044071860', time=2024-03-09T16:57:02.835336+0000, chain.objs.size()=1 2024-03-09T15:07:03.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.U_Dcch6_Jtc96Tu-nNTWA3OWQxmV87i_0 2024-03-09T15:07:03.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4736712403878548540', time=2024-03-09T16:57:02.849464+0000, chain.objs.size()=1 2024-03-09T15:07:03.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.A20VtICtC9xUmyzSGfzzB2Hu3wBfpSX_0 2024-03-09T15:07:03.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5968389639820073981', time=2024-03-09T16:57:02.877519+0000, chain.objs.size()=1 2024-03-09T15:07:03.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.diI9InyB_eQI2L0SLkAkJnDST6lCjjF_0 2024-03-09T15:07:03.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9454435068992686665', time=2024-03-09T16:57:03.058604+0000, chain.objs.size()=1 2024-03-09T15:07:03.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.WJPpn8g0xQxdmnwNRWAFgOlVLre-YtP_0 2024-03-09T15:07:03.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15630201266222564163', time=2024-03-09T16:57:03.059476+0000, chain.objs.size()=1 2024-03-09T15:07:03.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.HCDIZLJ3vo5ad3zbfWJ9MJn-PmA000__0 2024-03-09T15:07:03.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4323199915103176388', time=2024-03-09T16:57:03.111599+0000, chain.objs.size()=1 2024-03-09T15:07:03.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.7yDECn0ljCApCJhpaRK9yKe8yc9Z4n1_0 2024-03-09T15:07:03.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11609182457825837100', time=2024-03-09T16:57:03.561765+0000, chain.objs.size()=1 2024-03-09T15:07:03.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.9i8EvGCQ0VpDEj0vt0a71Y6ePe8EEDt_0 2024-03-09T15:07:03.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2918965580281382977', time=2024-03-09T16:57:17.433512+0000, chain.objs.size()=1 2024-03-09T15:07:03.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.334__shadow_.J12odd3M6ajGteQuU-FB24y0XE0CfW3_0 2024-03-09T15:07:03.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17923974720515798390', time=2024-03-09T16:57:55.080031+0000, chain.objs.size()=1 2024-03-09T15:07:03.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.376__shadow_.wVloBrsEPMPxnwkiqFs9fPyRzwe-J0__0 2024-03-09T15:07:03.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1435373119309715184', time=2024-03-09T16:59:03.168743+0000, chain.objs.size()=1 2024-03-09T15:07:03.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.445__shadow_.w3mdgFRZqogUjBWMITbt8qHtbpFHrbS_0 2024-03-09T15:07:03.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11968237816208019170', time=2024-03-09T16:59:29.513305+0000, chain.objs.size()=1 2024-03-09T15:07:03.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.475__shadow_.qnPri3JdkbmCELlM7rbNt9U0vYiG2n7_0 2024-03-09T15:07:03.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15491849148682195326', time=2024-03-09T16:59:31.475677+0000, chain.objs.size()=1 2024-03-09T15:07:03.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.477__shadow_.hQ3uKm9yKJPoIOWpK9Mh7_4TgEa7-2h_0 2024-03-09T15:07:03.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1278839272935413512', time=2024-03-09T17:00:11.090622+0000, chain.objs.size()=1 2024-03-09T15:07:03.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.514__shadow:amP8SglTHn5SLJJicmnLeazzH0.QI6A_.iP5ZYY8sHYziKpeUeAG8w7Z2HJt6G6E_0 2024-03-09T15:07:03.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.184410644246428816', time=2024-03-09T17:00:25.803658+0000, chain.objs.size()=6 2024-03-09T15:07:03.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~70t2_SpA9jow2HOOrdUhyu0QBf12FFh.1 2024-03-09T15:07:03.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.410+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.cJhn9u5Sm08eui0-AgnstesOD8zMvnFK.2 2024-03-09T15:07:03.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.sGYS7yyHo3i7LB_nvR1lE8WabjelaxTe.3 2024-03-09T15:07:03.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~70t2_SpA9jow2HOOrdUhyu0QBf12FFh.4 2024-03-09T15:07:03.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~70t2_SpA9jow2HOOrdUhyu0QBf12FFh.5 2024-03-09T15:07:03.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~70t2_SpA9jow2HOOrdUhyu0QBf12FFh.6 2024-03-09T15:07:03.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2052217372013918245', time=2024-03-09T17:00:29.798109+0000, chain.objs.size()=2 2024-03-09T15:07:03.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.517__multipart_mymultipart.2~FOLJAmQpmUy5Wfc75nsngpN4b2MBiP1.1 2024-03-09T15:07:03.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.517__multipart_mymultipart.2~FOLJAmQpmUy5Wfc75nsngpN4b2MBiP1.2 2024-03-09T15:07:03.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4871691637879729828', time=2024-03-09T17:00:39.750696+0000, chain.objs.size()=1 2024-03-09T15:07:03.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.522__shadow_.0Xq9JOikaazBkNX3_ZtbKJ2T7Xjq_sf_0 2024-03-09T15:07:03.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4236148789490030920', time=2024-03-09T17:01:02.684135+0000, chain.objs.size()=1 2024-03-09T15:07:03.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.530__shadow_.TIMRsYo2uxSIxpF11ablIZeFBoWfN5Z_0 2024-03-09T15:07:03.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9423157141507913663', time=2024-03-09T17:02:04.258368+0000, chain.objs.size()=1 2024-03-09T15:07:03.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.566__shadow_.SZgLUCuV57-pjMjbrDWFyETNDu4DpQb_0 2024-03-09T15:07:03.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5335948097767275337', time=2024-03-09T17:02:12.302928+0000, chain.objs.size()=1 2024-03-09T15:07:03.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.569__shadow:K0VtGF0F09WWj--ifTqUNVOkjArspKK_.oAmxOZvAzGivORd7QkXw-hcndlAgygh_0 2024-03-09T15:07:03.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.418+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1607919081252617090', time=2024-03-09T17:03:50.810156+0000, chain.objs.size()=2 2024-03-09T15:07:03.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.418+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.635__shadow_.xBjK5jDfRGFpPiIUAAc3DEuE9xOsEIa_0 2024-03-09T15:07:03.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.418+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.635__shadow_.xBjK5jDfRGFpPiIUAAc3DEuE9xOsEIa_1 2024-03-09T15:07:03.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.418+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11503770029390878937', time=2024-03-09T17:06:16.966762+0000, chain.objs.size()=1 2024-03-09T15:07:03.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.418+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.742__shadow_.UIE5BGTR7GhT5-rsjNQ6HLL1PUn-OGy_0 2024-03-09T15:07:03.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.426+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:03.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.426+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-09T15:07:03.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.426+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:03.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:03.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48509' 2024-03-09T15:07:03.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2037022092602640615', time=2024-03-09T16:51:42.498575+0000, chain.objs.size()=1 2024-03-09T15:07:03.438 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.139__shadow_.p6EDVpQjUzlWNt40qOIMyjs849-o9aP_0 2024-03-09T15:07:03.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5726300371833235835', time=2024-03-09T16:54:38.756314+0000, chain.objs.size()=1 2024-03-09T15:07:03.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.240__shadow_.DZi05NHp1b_K700SUy5RBYMHvAn4nEp_0 2024-03-09T15:07:03.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5023144734406964016', time=2024-03-09T16:54:41.505357+0000, chain.objs.size()=1 2024-03-09T15:07:03.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.243__shadow_.Et4KHwLFlCl6cLpt3NPw1eqxvwaJlcU_0 2024-03-09T15:07:03.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9713203659463934839', time=2024-03-09T16:54:49.091352+0000, chain.objs.size()=1 2024-03-09T15:07:03.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.251__shadow_.atSol0R1Os0b8nlD2lynDIC9cu_ATvz_0 2024-03-09T15:07:03.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13474851625919805824', time=2024-03-09T16:54:50.005835+0000, chain.objs.size()=1 2024-03-09T15:07:03.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.252__shadow_.41SpAN7U9CMy9-nfHaTqty5b6W7Q7HA_0 2024-03-09T15:07:03.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10378228802834496350', time=2024-03-09T16:55:14.877171+0000, chain.objs.size()=1 2024-03-09T15:07:03.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.HXDZGZSx_vArIb50_WPwZCQ4piztI1s_0 2024-03-09T15:07:03.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10891821113492114987', time=2024-03-09T16:55:14.916175+0000, chain.objs.size()=1 2024-03-09T15:07:03.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.S9J9XX4-6YEimKcyqmPequPotdq7n4B_0 2024-03-09T15:07:03.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3431594867983308329', time=2024-03-09T16:55:14.969128+0000, chain.objs.size()=1 2024-03-09T15:07:03.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6n0p55IZHQ-Oa0ptRZjzsxtmYrh2AlW_0 2024-03-09T15:07:03.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3504126513250281608', time=2024-03-09T16:55:15.138806+0000, chain.objs.size()=1 2024-03-09T15:07:03.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.5ATVxe_E4HIBc60xhOh70v0UcI5CLeD_0 2024-03-09T15:07:03.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4166223099515416694', time=2024-03-09T16:55:15.219962+0000, chain.objs.size()=1 2024-03-09T15:07:03.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.zzwwpdu_tw8Zhh5bHGmSs4n6HisLqPl_0 2024-03-09T15:07:03.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7942749120910632250', time=2024-03-09T16:55:15.278850+0000, chain.objs.size()=1 2024-03-09T15:07:03.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.nhHvWfIlRVerxP8GSQSr_bdlq9GBKIz_0 2024-03-09T15:07:03.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9754221839396433270', time=2024-03-09T16:55:15.296343+0000, chain.objs.size()=1 2024-03-09T15:07:03.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.G1U-OVuwlSzkva1CpUJfM2CLklURH8X_0 2024-03-09T15:07:03.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.434+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2256655491668711084', time=2024-03-09T16:55:15.462980+0000, chain.objs.size()=1 2024-03-09T15:07:03.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.434+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.EDYog4psdL5Rf5XyTLK9TbVYKGagcZX_0 2024-03-09T15:07:03.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.434+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5664620044208426537', time=2024-03-09T16:55:15.470610+0000, chain.objs.size()=1 2024-03-09T15:07:03.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.434+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ypgzZvns_7WlJxDybWLd_LYguurmost_0 2024-03-09T15:07:03.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.434+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6621346541466702777', time=2024-03-09T16:55:15.684049+0000, chain.objs.size()=1 2024-03-09T15:07:03.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.434+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.8C3Azxnf8sx4RJdWTJL5Ob07YjtfkBq_0 2024-03-09T15:07:03.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.434+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10665004538012867409', time=2024-03-09T16:55:15.750277+0000, chain.objs.size()=1 2024-03-09T15:07:03.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.434+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.VqGp4lSRDrVJg5XkHzIhxwuVf92tdBE_0 2024-03-09T15:07:03.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.434+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11029879004142901941', time=2024-03-09T16:55:15.760214+0000, chain.objs.size()=1 2024-03-09T15:07:03.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.434+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.xQiQuAIZ0oe9AcL_gbIDTKEj4XpzWLI_0 2024-03-09T15:07:03.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.434+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3460763720240552412', time=2024-03-09T16:55:15.786458+0000, chain.objs.size()=1 2024-03-09T15:07:03.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.434+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.KR8MKYOpZqrHjmyOxMDZNa5Te6Y5Pbd_0 2024-03-09T15:07:03.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.438+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10451297336099772765', time=2024-03-09T16:55:15.802750+0000, chain.objs.size()=1 2024-03-09T15:07:03.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.438+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.TacxNIY7zLPASL_vpVjF6Tj6L7p4R-k_0 2024-03-09T15:07:03.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.438+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7953844843431885320', time=2024-03-09T16:55:15.982317+0000, chain.objs.size()=1 2024-03-09T15:07:03.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.438+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.lV0k1OABuVBYwf525u4b-AXDL4T-Fv6_0 2024-03-09T15:07:03.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.438+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11070908976000404601', time=2024-03-09T16:55:16.079338+0000, chain.objs.size()=1 2024-03-09T15:07:03.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.438+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.YTMRu7ewOVYliHOlGskfAUnbhgoIbqG_0 2024-03-09T15:07:03.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.438+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2699956279207011974', time=2024-03-09T16:55:16.080038+0000, chain.objs.size()=1 2024-03-09T15:07:03.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.438+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.sIEcnZ3rxtiTfo9sKX6On-a77WO49_t_0 2024-03-09T15:07:03.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.438+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15937113445277302177', time=2024-03-09T16:55:16.205407+0000, chain.objs.size()=1 2024-03-09T15:07:03.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.438+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.sKMSaqwuGDgmpshccK3eGQZteOFkWAG_0 2024-03-09T15:07:03.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3307138381907464763', time=2024-03-09T16:55:16.216914+0000, chain.objs.size()=1 2024-03-09T15:07:03.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.SKvkZ9fAxKJOfnZ-_4LV7Jvk1UKX0Rt_0 2024-03-09T15:07:03.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9238517807790744424', time=2024-03-09T16:55:16.249125+0000, chain.objs.size()=1 2024-03-09T15:07:03.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.T4g7kW65yQSMwJ3zQIF4SrReIyaWnSF_0 2024-03-09T15:07:03.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11964605394354067047', time=2024-03-09T16:55:16.297744+0000, chain.objs.size()=1 2024-03-09T15:07:03.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.r8qoPle14gVDtTvedmsGvItARAKOTai_0 2024-03-09T15:07:03.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10714339877677832723', time=2024-03-09T16:55:16.307915+0000, chain.objs.size()=1 2024-03-09T15:07:03.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.5pvr5AdBsb4ffsxNxfKQwNjWVDUzLEP_0 2024-03-09T15:07:03.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17369028661504878736', time=2024-03-09T16:55:16.344330+0000, chain.objs.size()=1 2024-03-09T15:07:03.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.nCYkjZkCqSGr_xI4GPXf5E2fAWcbJ8Y_0 2024-03-09T15:07:03.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1987905989111438424', time=2024-03-09T16:55:16.492974+0000, chain.objs.size()=1 2024-03-09T15:07:03.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.YddB1fglbxfxmLTvKxRP0BP1Coxf0-v_0 2024-03-09T15:07:03.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15593059687535525767', time=2024-03-09T16:55:16.744933+0000, chain.objs.size()=1 2024-03-09T15:07:03.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.aDQ1sGGomnR17hHsnTMFRN7qVf00nQm_0 2024-03-09T15:07:03.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12635677190325496800', time=2024-03-09T16:55:16.789508+0000, chain.objs.size()=1 2024-03-09T15:07:03.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Pw8BQ9EOcM0X5SC1FqKF1kc85P8G1MW_0 2024-03-09T15:07:03.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16314371747650375463', time=2024-03-09T16:55:16.790602+0000, chain.objs.size()=1 2024-03-09T15:07:03.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.R3HAqu63u6SfuoXKbfdHPlcTvcHyQbq_0 2024-03-09T15:07:03.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8892331165483899877', time=2024-03-09T16:55:19.464342+0000, chain.objs.size()=1 2024-03-09T15:07:03.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.259__shadow_.QiKf0dwCEOG9C4kk9RgLWepraf8BdLt_0 2024-03-09T15:07:03.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3598976215891469001', time=2024-03-09T16:55:37.289410+0000, chain.objs.size()=1 2024-03-09T15:07:03.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.442+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.278__shadow_.x7MGnLojCgsfct8DwWbzMSSKlWnrRyE_0 2024-03-09T15:07:03.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.446+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2429313613265289080', time=2024-03-09T16:55:39.346822+0000, chain.objs.size()=1 2024-03-09T15:07:03.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.446+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.280__shadow_.GUnP5zpna4KV8nPrfHYrXeKE4UPSkeR_0 2024-03-09T15:07:03.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.446+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10894954707498309299', time=2024-03-09T16:55:43.096519+0000, chain.objs.size()=1 2024-03-09T15:07:03.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.446+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.284__shadow_.Z0vG2VgAEovV2tXjb94TIdeSyR9cIos_0 2024-03-09T15:07:03.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.446+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7645893134570281831', time=2024-03-09T16:55:46.206756+0000, chain.objs.size()=1 2024-03-09T15:07:03.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.446+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.G_llcX5cgYZZZNTp3sPWnvLGMu11Tt5_0 2024-03-09T15:07:03.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.446+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5270970893086811519', time=2024-03-09T16:55:49.675120+0000, chain.objs.size()=1 2024-03-09T15:07:03.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.446+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.289__shadow_.nbP59NryTYOc99GtIGypi-4ChnMv8uZ_0 2024-03-09T15:07:03.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.446+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6426255767576737681', time=2024-03-09T16:55:55.450568+0000, chain.objs.size()=1 2024-03-09T15:07:03.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.446+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.295__shadow_.YuKiiaqoew4iVbM2OsEsxdT6H_lTwb8_0 2024-03-09T15:07:03.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.450+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17283286619955442497', time=2024-03-09T16:55:58.318951+0000, chain.objs.size()=1 2024-03-09T15:07:03.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.450+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.298__shadow_.hqk9bSBz3bc5Xq5yFH_zScnDno9lewY_0 2024-03-09T15:07:03.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.450+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1177255932298409565', time=2024-03-09T16:56:37.772808+0000, chain.objs.size()=1 2024-03-09T15:07:03.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.450+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lV1n7cy826FEVJHluSFAMgT0maPvno2_0 2024-03-09T15:07:03.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.450+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17795821475619931274', time=2024-03-09T16:56:37.779612+0000, chain.objs.size()=1 2024-03-09T15:07:03.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.450+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.jQ6118kpAK8R_X_ONThJt95aMf0Ytdg_0 2024-03-09T15:07:03.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.450+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14022957606074955980', time=2024-03-09T16:56:37.780616+0000, chain.objs.size()=1 2024-03-09T15:07:03.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.450+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.aow7ZzA_b2uKUVUVhFnUmWK3HppyPJD_0 2024-03-09T15:07:03.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.450+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2368052333846408643', time=2024-03-09T16:56:37.830238+0000, chain.objs.size()=1 2024-03-09T15:07:03.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.450+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.KLdONE8PGQiqKBToaylaoY9xCAQDli3_0 2024-03-09T15:07:03.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.450+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5536242905210313741', time=2024-03-09T16:56:37.845303+0000, chain.objs.size()=1 2024-03-09T15:07:03.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.450+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.TyQTrURINZFxdIPmk4hgx5SX0dElQsv_0 2024-03-09T15:07:03.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.454+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6789976368828288565', time=2024-03-09T16:56:37.858674+0000, chain.objs.size()=1 2024-03-09T15:07:03.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.454+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.g2y4pg7GYwK-lj7q4bj6e568_tDxK_r_0 2024-03-09T15:07:03.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11461418032631937270', time=2024-03-09T16:56:37.863783+0000, chain.objs.size()=1 2024-03-09T15:07:03.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.a_d7CwZ7cjK6TkNtnTGaLuNfTlfrvEU_0 2024-03-09T15:07:03.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16275909939372276768', time=2024-03-09T16:56:38.003701+0000, chain.objs.size()=1 2024-03-09T15:07:03.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.WfViy_cLeljEE74xOAvXPozalrg5Gdp_0 2024-03-09T15:07:03.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1363953550709877014', time=2024-03-09T16:56:38.035553+0000, chain.objs.size()=1 2024-03-09T15:07:03.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.MOKiHtIT1VSx6l_UHgiG4XZqYqPO4jn_0 2024-03-09T15:07:03.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7346467335370196349', time=2024-03-09T16:56:38.054776+0000, chain.objs.size()=1 2024-03-09T15:07:03.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.NGbQJEzZ5CPmHaB6RGNwpM9d7HqHG1I_0 2024-03-09T15:07:03.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5690766180055365151', time=2024-03-09T16:56:38.100191+0000, chain.objs.size()=1 2024-03-09T15:07:03.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.QP3lmOgy0yDRzHnPb_1mprkNNoDH6mA_0 2024-03-09T15:07:03.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12769698594027080157', time=2024-03-09T16:56:38.112333+0000, chain.objs.size()=1 2024-03-09T15:07:03.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.mWQawbQPhV9TDKR8vD0k71lshLiXRVk_0 2024-03-09T15:07:03.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8168295263039306887', time=2024-03-09T16:56:38.326837+0000, chain.objs.size()=1 2024-03-09T15:07:03.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.7bWqUa4yzDmpjYBmW9FvPV5lOIVHNqt_0 2024-03-09T15:07:03.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12127392439922806501', time=2024-03-09T16:56:38.381388+0000, chain.objs.size()=1 2024-03-09T15:07:03.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Tf6Phbmnf8SyqyujFwCjsb3f-N9lLqp_0 2024-03-09T15:07:03.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18051818173438800279', time=2024-03-09T16:56:38.382545+0000, chain.objs.size()=1 2024-03-09T15:07:03.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.nJAUxor1JjwGNBtMJkMPtB0MFG1i1Li_0 2024-03-09T15:07:03.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6760806182973263169', time=2024-03-09T16:56:38.388760+0000, chain.objs.size()=1 2024-03-09T15:07:03.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.FQTqc949ClIopVVbMBvNgojH6LojIDl_0 2024-03-09T15:07:03.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.462+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15562375619088573538', time=2024-03-09T16:56:38.512826+0000, chain.objs.size()=1 2024-03-09T15:07:03.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.462+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.dHkrn9P8yH9hnG3afitU75i2jGOPagJ_0 2024-03-09T15:07:03.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.462+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13140538127068256202', time=2024-03-09T16:56:38.520507+0000, chain.objs.size()=1 2024-03-09T15:07:03.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.462+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.yEqAVlb_pioOZKYyKPi0Fwjx6SYgnlH_0 2024-03-09T15:07:03.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.462+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3030477489828369988', time=2024-03-09T16:56:38.586326+0000, chain.objs.size()=1 2024-03-09T15:07:03.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.462+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.tWva7VMg5p72FZA9JBP7MskgLm3giFY_0 2024-03-09T15:07:03.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.462+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13276797101686973733', time=2024-03-09T16:56:38.779038+0000, chain.objs.size()=1 2024-03-09T15:07:03.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.462+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.skQCxGvv-Myu6Awp-ODsQ3MJSOyOGt5_0 2024-03-09T15:07:03.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.462+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11922695943750994161', time=2024-03-09T16:56:39.305290+0000, chain.objs.size()=1 2024-03-09T15:07:03.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.462+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.nHwaoKGnCLVkrf8rh52_Xs7V9VCAQaN_0 2024-03-09T15:07:03.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.462+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13796184762294933293', time=2024-03-09T16:56:39.308875+0000, chain.objs.size()=1 2024-03-09T15:07:03.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.462+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Rk2_4Pcnb72IrhSb3qz84NdtqQCNGdp_0 2024-03-09T15:07:03.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.466+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14211981536564793728', time=2024-03-09T16:56:39.340614+0000, chain.objs.size()=1 2024-03-09T15:07:03.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.466+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.S6IB1nI-IGJYKyyqbfC0avVI0bkwA49_0 2024-03-09T15:07:03.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6484138451105225589', time=2024-03-09T16:56:39.426260+0000, chain.objs.size()=1 2024-03-09T15:07:03.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.A659uNEq6UfeTloYzpCpV1xmjYQ-ABT_0 2024-03-09T15:07:03.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8464502040665177717', time=2024-03-09T16:56:39.604976+0000, chain.objs.size()=1 2024-03-09T15:07:03.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.D_Hn2pj02v9rmnoutuEq_Iovmb0zddl_0 2024-03-09T15:07:03.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5964941411227476121', time=2024-03-09T16:56:39.625114+0000, chain.objs.size()=1 2024-03-09T15:07:03.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6oUylhTXVrZ0R-46h66VlQ8z1HP2V_3_0 2024-03-09T15:07:03.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15227623993637087409', time=2024-03-09T16:56:39.672224+0000, chain.objs.size()=1 2024-03-09T15:07:03.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.5jMa3wenP2BIzF1AVdpjshg7Fu8aCkz_0 2024-03-09T15:07:03.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6456916080373678824', time=2024-03-09T16:57:01.420161+0000, chain.objs.size()=1 2024-03-09T15:07:03.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.QzHU6K2tMs7ywcGxXgfSU2Qby3oVX7y_0 2024-03-09T15:07:03.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11931965410411893859', time=2024-03-09T16:57:01.540665+0000, chain.objs.size()=1 2024-03-09T15:07:03.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.pbU3Ht2RXkZEbE0skXoPQax2QAWt2QQ_0 2024-03-09T15:07:03.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2731315036461352249', time=2024-03-09T16:57:01.559165+0000, chain.objs.size()=1 2024-03-09T15:07:03.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.816LlGjj1kZ0stQVZO8HlsUbmawRq-E_0 2024-03-09T15:07:03.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8212784860274294672', time=2024-03-09T16:57:01.570647+0000, chain.objs.size()=1 2024-03-09T15:07:03.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Tt_eVucQHs02DNGsXPtyliWH1ljFFM2_0 2024-03-09T15:07:03.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18272256633917243165', time=2024-03-09T16:57:01.741877+0000, chain.objs.size()=1 2024-03-09T15:07:03.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.rkQTyAehrNGCoAqJCHX-tiXog8ZYhL__0 2024-03-09T15:07:03.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13217295073966795809', time=2024-03-09T16:57:01.777458+0000, chain.objs.size()=1 2024-03-09T15:07:03.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.o5X4L7lzzQAypUoQ3-6P5SqqwAuYXag_0 2024-03-09T15:07:03.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13107986111187156059', time=2024-03-09T16:57:01.797100+0000, chain.objs.size()=1 2024-03-09T15:07:03.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.z7lH0bnf0k6Ib2CTJmbTmCYbu4HXmNl_0 2024-03-09T15:07:03.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.478+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8223517393223918670', time=2024-03-09T16:57:01.798909+0000, chain.objs.size()=1 2024-03-09T15:07:03.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.478+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.k5LBFR_-GHkzS-VS5cvbfnfb8Icgxwn_0 2024-03-09T15:07:03.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.478+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7149342749701095431', time=2024-03-09T16:57:01.808828+0000, chain.objs.size()=1 2024-03-09T15:07:03.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.478+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.6iYZulpRahnxXuft7r2jGiV7vU09wV1_0 2024-03-09T15:07:03.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.478+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11305838531164015116', time=2024-03-09T16:57:01.837530+0000, chain.objs.size()=1 2024-03-09T15:07:03.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.478+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.nvGMpdFJW7_LoIdnLy-fS4hTlehI_iW_0 2024-03-09T15:07:03.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.478+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1663993560809576350', time=2024-03-09T16:57:01.867676+0000, chain.objs.size()=1 2024-03-09T15:07:03.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.478+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.PV0FaH8fLR75QGCaMEmAHLHAh0aCelw_0 2024-03-09T15:07:03.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.478+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6145999538828996834', time=2024-03-09T16:57:01.994954+0000, chain.objs.size()=1 2024-03-09T15:07:03.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.478+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.a0mE9MF-WvQDwF8anRHSr5Pr5D8dIhg_0 2024-03-09T15:07:03.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.478+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4122415020139223883', time=2024-03-09T16:57:02.283288+0000, chain.objs.size()=1 2024-03-09T15:07:03.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.478+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ggQyciFHVwnwPfguMl090V0-ZMEtbXS_0 2024-03-09T15:07:03.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6484278049372172854', time=2024-03-09T16:57:02.292609+0000, chain.objs.size()=1 2024-03-09T15:07:03.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.AZnsTCGyKVFCOfZEM3CjXeWvBo6zkqO_0 2024-03-09T15:07:03.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.968686526434399091', time=2024-03-09T16:57:02.344070+0000, chain.objs.size()=1 2024-03-09T15:07:03.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.9ZcKbfQ4KNEkiGS7qsel1ijKTwNpcYb_0 2024-03-09T15:07:03.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9497298130056967337', time=2024-03-09T16:57:02.352426+0000, chain.objs.size()=1 2024-03-09T15:07:03.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Kzn5c5uhLM4XMnOiird7sfigJgnQ4G9_0 2024-03-09T15:07:03.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18374818594805730536', time=2024-03-09T16:57:02.476583+0000, chain.objs.size()=1 2024-03-09T15:07:03.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.OSSVqRWFQ5PRlTI7CFUNNJ-TOjTrXDm_0 2024-03-09T15:07:03.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12548481960989453673', time=2024-03-09T16:57:02.483470+0000, chain.objs.size()=1 2024-03-09T15:07:03.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.pYXmvwPC8v5BdQk2g3icQKkYlgF18uB_0 2024-03-09T15:07:03.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16989579927997115079', time=2024-03-09T16:57:02.513505+0000, chain.objs.size()=1 2024-03-09T15:07:03.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.BUwDUeYUb70lvucfc3RZnWvc6N6jLTy_0 2024-03-09T15:07:03.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3227919218364386752', time=2024-03-09T16:57:02.541134+0000, chain.objs.size()=1 2024-03-09T15:07:03.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.swL16o07GhG-MCuzngMLvI86AGve1Ra_0 2024-03-09T15:07:03.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16882919962861413861', time=2024-03-09T16:57:02.551111+0000, chain.objs.size()=1 2024-03-09T15:07:03.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.dI5p3QziKsDsKW_2GSSs69sznhY7uVe_0 2024-03-09T15:07:03.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6365903471412151237', time=2024-03-09T16:57:02.592052+0000, chain.objs.size()=1 2024-03-09T15:07:03.483 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_._kxDu4aRTBI4_4fuyx9BbVB7UnuyD0i_0 2024-03-09T15:07:03.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10187782219866976115', time=2024-03-09T16:57:02.610892+0000, chain.objs.size()=1 2024-03-09T15:07:03.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.482+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.4t3nmUknZ5H29-9dAhnrHMgjEHpk67T_0 2024-03-09T15:07:03.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14129456886636745120', time=2024-03-09T16:57:02.617352+0000, chain.objs.size()=1 2024-03-09T15:07:03.484 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.LMfbkeHZYNlhg15kaMn7mRNzdXcG26Z_0 2024-03-09T15:07:03.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12359928902186459776', time=2024-03-09T16:57:02.623954+0000, chain.objs.size()=1 2024-03-09T15:07:03.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.HhMuMk4K9YuLnNHF4H3Fxv85olGVS0a_0 2024-03-09T15:07:03.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5036037367194863407', time=2024-03-09T16:57:02.761311+0000, chain.objs.size()=1 2024-03-09T15:07:03.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.iglmD-gItz75oN0FO9RuXXfTu_5YUq8_0 2024-03-09T15:07:03.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4354013630299993486', time=2024-03-09T16:57:02.766573+0000, chain.objs.size()=1 2024-03-09T15:07:03.485 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Lba4A5wrbjAZOYDW-Trq6_fgFB0ODR0_0 2024-03-09T15:07:03.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17734691384856224154', time=2024-03-09T16:57:02.860961+0000, chain.objs.size()=1 2024-03-09T15:07:03.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.64f2gE0EnNXy38O_Nt3E5YJgvS17trp_0 2024-03-09T15:07:03.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12638384464689245199', time=2024-03-09T16:57:02.969329+0000, chain.objs.size()=1 2024-03-09T15:07:03.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Zqts9KE7gV6_hqPCXAFmOit7FX4bJJ9_0 2024-03-09T15:07:03.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12926137346933805730', time=2024-03-09T16:57:03.028054+0000, chain.objs.size()=1 2024-03-09T15:07:03.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.JwE0q08wm490JENKIG-oQodd5RHwtTm_0 2024-03-09T15:07:03.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14860449597471747683', time=2024-03-09T16:57:03.086128+0000, chain.objs.size()=1 2024-03-09T15:07:03.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.igFemYC6YEigyEImSlkoZI-62TGYgEF_0 2024-03-09T15:07:03.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2012195011664031315', time=2024-03-09T16:57:03.086850+0000, chain.objs.size()=1 2024-03-09T15:07:03.488 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.486+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DTsDZxR8xJJKSQ8SldTKu72l-yK_-LK_0 2024-03-09T15:07:03.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.490+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9524830621328931832', time=2024-03-09T16:57:03.307760+0000, chain.objs.size()=1 2024-03-09T15:07:03.489 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.490+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.rNHO-Gd3CaZTjLVrLVXFfWTa8hxQsSN_0 2024-03-09T15:07:03.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/48509 2024-03-09T15:07:03.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-03-09T15:07:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6286148744878566397', time=2024-03-09T16:57:03.350905+0000, chain.objs.size()=1 2024-03-09T15:07:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.UBQbGMrWCYdhEfAjFTWZTEVCWx-bFxd_0 2024-03-09T15:07:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3445697780486574872', time=2024-03-09T16:57:05.275296+0000, chain.objs.size()=1 2024-03-09T15:07:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.320__shadow_.nHZi2HCmlK0_hZTyRG9ekiSctElYVEq_0 2024-03-09T15:07:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18421333007940473332', time=2024-03-09T16:58:55.865323+0000, chain.objs.size()=1 2024-03-09T15:07:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.438__shadow_.ucqycD-Z0YmdwVMJ3CYCznkGhWaW54t_0 2024-03-09T15:07:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8652656216291496423', time=2024-03-09T16:59:15.897971+0000, chain.objs.size()=1 2024-03-09T15:07:03.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.456__shadow_.SLeW0fsM3glUuDPXn8HetBDasEdTkDg_0 2024-03-09T15:07:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9883311830432467569', time=2024-03-09T16:59:31.469415+0000, chain.objs.size()=1 2024-03-09T15:07:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.477__shadow_.VI8l1VmMSNfRYnbHU8Wc7nHevApNG4Z_0 2024-03-09T15:07:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.2_7a72bb35c4378339d0059bf86200c0d7', time=2024-03-09T16:59:53.533000+0000, chain.objs.size()=6 2024-03-09T15:07:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.1 2024-03-09T15:07:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.2 2024-03-09T15:07:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.3 2024-03-09T15:07:03.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.4 2024-03-09T15:07:03.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.5 2024-03-09T15:07:03.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.6 2024-03-09T15:07:03.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4933083511096174907', time=2024-03-09T17:00:01.148859+0000, chain.objs.size()=1 2024-03-09T15:07:03.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.512__multipart_mymultipart.2~OqBeyLR6IfZuNh04ZYigMwTwiFGBs41.1 2024-03-09T15:07:03.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.498+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9460223823969136425', time=2024-03-09T17:00:11.058109+0000, chain.objs.size()=3 2024-03-09T15:07:03.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.498+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.514__shadow:DXczMq-gFGyEAqG9aCLn6gn7fvHyZ3S_.JdV7My62bMbCXthRVUyuqnVmL-XAKJC_0 2024-03-09T15:07:03.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.498+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.514__shadow:DXczMq-gFGyEAqG9aCLn6gn7fvHyZ3S_.JdV7My62bMbCXthRVUyuqnVmL-XAKJC_1 2024-03-09T15:07:03.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.502+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.514__shadow:DXczMq-gFGyEAqG9aCLn6gn7fvHyZ3S_.JdV7My62bMbCXthRVUyuqnVmL-XAKJC_2 2024-03-09T15:07:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.502+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4980520988645682017', time=2024-03-09T17:01:53.660553+0000, chain.objs.size()=1 2024-03-09T15:07:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.502+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:Kdv-JTtAEkJehsQUZQiXiJBKiqMcW5c_.o7nMrt65qVwaZTKnn5QPFfxYg4JYIHh_0 2024-03-09T15:07:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.502+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8901593178170727212', time=2024-03-09T17:02:04.393097+0000, chain.objs.size()=1 2024-03-09T15:07:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.502+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.566__shadow_.EGgRiT-Cj_Qblo-IBYDo01LBknzxvcB_0 2024-03-09T15:07:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.502+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5822164719046005727', time=2024-03-09T17:02:31.232611+0000, chain.objs.size()=1 2024-03-09T15:07:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.502+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:ZePIeogYELKY.-r6tnfoAal8YZ.-Rk-_.XvMGzEvYkIFtrUj0uTcwbhFg3MzBCHN_0 2024-03-09T15:07:03.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.502+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.573__shadow:NXIu.VdKj05M0i-97WKic33r1NAgFAg_.R8k3JtSuw9OOrQ4ThdQBWUaWmxKaNJS_1_ffcc7da75252b9282a5ce8d7f9934180', time=2024-03-09T17:02:39.631767+0000, chain.objs.size()=1 2024-03-09T15:07:03.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.502+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.573__shadow:NXIu.VdKj05M0i-97WKic33r1NAgFAg_.R8k3JtSuw9OOrQ4ThdQBWUaWmxKaNJS_0 2024-03-09T15:07:03.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.502+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5291629774430933373', time=2024-03-09T17:02:40.484064+0000, chain.objs.size()=1 2024-03-09T15:07:03.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.502+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.575__shadow:RI03lvqJDw0wbA6yuSe5idskKWTV7dH_.lZyYgDz0VWMEJTV4TgzfMMkzwhgBLxW_0 2024-03-09T15:07:03.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.502+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4508547307637256034', time=2024-03-09T17:03:19.146771+0000, chain.objs.size()=6 2024-03-09T15:07:03.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.502+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.607__multipart_multipart_enc.2~8OSw9frH5nbJwvynG3n9tGeLHsK8vK7.1 2024-03-09T15:07:03.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.502+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.607__multipart_multipart_enc.2~8OSw9frH5nbJwvynG3n9tGeLHsK8vK7.2 2024-03-09T15:07:03.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.502+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.607__multipart_multipart_enc.2~8OSw9frH5nbJwvynG3n9tGeLHsK8vK7.3 2024-03-09T15:07:03.505 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.506+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.607__multipart_multipart_enc.2~8OSw9frH5nbJwvynG3n9tGeLHsK8vK7.4 2024-03-09T15:07:03.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.506+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.607__multipart_multipart_enc.2~8OSw9frH5nbJwvynG3n9tGeLHsK8vK7.5 2024-03-09T15:07:03.508 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.506+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.607__multipart_multipart_enc.2~8OSw9frH5nbJwvynG3n9tGeLHsK8vK7.6 2024-03-09T15:07:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.510+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9072993571029412215', time=2024-03-09T17:04:13.583237+0000, chain.objs.size()=1 2024-03-09T15:07:03.509 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.510+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.657__shadow_.2pCKxLiLdTbNGPjwxskbvHHgmOrsKiR_0 2024-03-09T15:07:03.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.510+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12491347769416388450', time=2024-03-09T17:05:48.796845+0000, chain.objs.size()=1 2024-03-09T15:07:03.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.510+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.727__shadow_.nFzL9bT_lkTT0Irz9i7Wi1yeoyFd9GW_0 2024-03-09T15:07:03.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.510+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16764601638675758579', time=2024-03-09T17:05:50.727015+0000, chain.objs.size()=1 2024-03-09T15:07:03.510 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.510+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.729__shadow_.Br8_FWqcqe9P6Fzg_lGbNwEjUdrHWev_0 2024-03-09T15:07:03.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.518+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:03.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-09T15:07:03.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:03.522 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:03.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45732' 2024-03-09T15:07:03.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3377588714832782313', time=2024-03-09T16:51:50.800470+0000, chain.objs.size()=3 2024-03-09T15:07:03.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.153__multipart_mymultipart-STANDARD.2~Xk0CHmFKRvP4iPSYC9iYMzUVxuNwRuu.1 2024-03-09T15:07:03.524 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.153__multipart_mymultipart-STANDARD.2~Xk0CHmFKRvP4iPSYC9iYMzUVxuNwRuu.2 2024-03-09T15:07:03.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.153__multipart_mymultipart-STANDARD.2~Xk0CHmFKRvP4iPSYC9iYMzUVxuNwRuu.3 2024-03-09T15:07:03.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3975287717527254158', time=2024-03-09T16:54:24.676408+0000, chain.objs.size()=1 2024-03-09T15:07:03.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.227__shadow_.aCflBzgpMCjgRLE6BoXyLjYFhE6Xvjc_0 2024-03-09T15:07:03.525 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3987165452338500790', time=2024-03-09T16:54:37.852555+0000, chain.objs.size()=1 2024-03-09T15:07:03.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.239__shadow_.E5vgWibzaWfhJJMRqdVSUvezx70bExD_0 2024-03-09T15:07:03.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9840132932181529669', time=2024-03-09T16:54:39.686160+0000, chain.objs.size()=1 2024-03-09T15:07:03.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.241__shadow_.uN5K9M212CPZ41MPZFAdTC6FyOdXpny_0 2024-03-09T15:07:03.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10750651048004651943', time=2024-03-09T16:54:42.524490+0000, chain.objs.size()=1 2024-03-09T15:07:03.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.244__shadow_.StetIPdDp1UNjGYxAfK4AJ4XR88OjHQ_0 2024-03-09T15:07:03.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16946214897291913857', time=2024-03-09T16:54:43.473838+0000, chain.objs.size()=1 2024-03-09T15:07:03.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.245__shadow_.hsUJI04EumlxY4SEC1dErB5xtGwNQmE_0 2024-03-09T15:07:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9768234606273184232', time=2024-03-09T16:54:44.396783+0000, chain.objs.size()=1 2024-03-09T15:07:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.246__shadow_.cvPlC8z-Vzdu_iO9nJBxyuAGWjJx8zu_0 2024-03-09T15:07:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9942677740983915735', time=2024-03-09T16:54:45.314796+0000, chain.objs.size()=1 2024-03-09T15:07:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.247__shadow_.VrZZP0EzlxgcSvXutqyJ4B0O8iDar4q_0 2024-03-09T15:07:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1984017084835866346', time=2024-03-09T16:54:46.271741+0000, chain.objs.size()=1 2024-03-09T15:07:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.248__shadow_.Zje_SpwWryNcgsomHFqqxy8dku-UWTg_0 2024-03-09T15:07:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.385299785324871300', time=2024-03-09T16:54:50.006833+0000, chain.objs.size()=1 2024-03-09T15:07:03.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.252__shadow_.hE-PEvOkM9qz_ODKBIjll3zBp4RpA7Z_0 2024-03-09T15:07:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1329077106108303853', time=2024-03-09T16:54:50.948180+0000, chain.objs.size()=1 2024-03-09T15:07:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.253__shadow_.toZJIDssZAp3OOIPwei6kUTcaPiG68r_0 2024-03-09T15:07:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15309869597356239585', time=2024-03-09T16:55:14.972081+0000, chain.objs.size()=1 2024-03-09T15:07:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6FJfUZXvx7bKYe5WeFYzf1a8c2jCiKK_0 2024-03-09T15:07:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10219344519361752183', time=2024-03-09T16:55:14.983529+0000, chain.objs.size()=1 2024-03-09T15:07:03.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.k10rKmRpKCoCZVECqdwRzwE5PTZ4r88_0 2024-03-09T15:07:03.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1470415355241260851', time=2024-03-09T16:55:15.224773+0000, chain.objs.size()=1 2024-03-09T15:07:03.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.7R9-J5rJSazKOHd8HDHdPo8XYfwYM98_0 2024-03-09T15:07:03.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13450416910493980054', time=2024-03-09T16:55:15.228853+0000, chain.objs.size()=1 2024-03-09T15:07:03.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.bnGZlkJsQLP63jbbCMP7PC4U6YicPpH_0 2024-03-09T15:07:03.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10846973772746646938', time=2024-03-09T16:55:15.253334+0000, chain.objs.size()=1 2024-03-09T15:07:03.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.k5aUNVOeq9BIDgbGUumjooTivyQG3wW_0 2024-03-09T15:07:03.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10141522697856034407', time=2024-03-09T16:55:15.274313+0000, chain.objs.size()=1 2024-03-09T15:07:03.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.RJwn22Xda8qF716b9ouMbq3a6zn5fXP_0 2024-03-09T15:07:03.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4991373365005569327', time=2024-03-09T16:55:15.485714+0000, chain.objs.size()=1 2024-03-09T15:07:03.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.UxT6E8EVRKekc9ZMGa3pt4sAgvnwIze_0 2024-03-09T15:07:03.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14824603341665549304', time=2024-03-09T16:55:15.519540+0000, chain.objs.size()=1 2024-03-09T15:07:03.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.AenrLnd_lR2jbJM48xqnet-lhqBURBC_0 2024-03-09T15:07:03.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13150323322405478821', time=2024-03-09T16:55:15.680410+0000, chain.objs.size()=1 2024-03-09T15:07:03.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.HQBrXrh3AFxkatoZXDnjWC59YwFTeSc_0 2024-03-09T15:07:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12103731355092723040', time=2024-03-09T16:55:15.720825+0000, chain.objs.size()=1 2024-03-09T15:07:03.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.tG-k4Q1l4ukbeqNc-XM83Xz90-41CRz_0 2024-03-09T15:07:03.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5583512493321888958', time=2024-03-09T16:55:15.776891+0000, chain.objs.size()=1 2024-03-09T15:07:03.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.xtxZZhh4oFRjg8qCZa5LXJwpN4-yHrA_0 2024-03-09T15:07:03.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16222435582496463019', time=2024-03-09T16:55:15.777837+0000, chain.objs.size()=1 2024-03-09T15:07:03.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.WU6p_w0HoNP2LaMPgd6-wofTkQ4QkKZ_0 2024-03-09T15:07:03.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1877421817446329465', time=2024-03-09T16:55:15.801896+0000, chain.objs.size()=1 2024-03-09T15:07:03.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Aj-5imFEsyzIZHtn2lQ3KBYNYBHIfJs_0 2024-03-09T15:07:03.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10646280986224624056', time=2024-03-09T16:55:15.816110+0000, chain.objs.size()=1 2024-03-09T15:07:03.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.wA7A2pv6f07dPSucZFp-N4cnVQedqlX_0 2024-03-09T15:07:03.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16853252957071554209', time=2024-03-09T16:55:15.950445+0000, chain.objs.size()=1 2024-03-09T15:07:03.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.UvErgdyinwRhtqEiBiUuNkaFLw3jnVq_0 2024-03-09T15:07:03.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7134401607640943080', time=2024-03-09T16:55:15.967589+0000, chain.objs.size()=1 2024-03-09T15:07:03.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.dWjXuSXepnCBsSVT3SMzFr_7uaIAqbE_0 2024-03-09T15:07:03.544 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17253132062842703737', time=2024-03-09T16:55:15.985986+0000, chain.objs.size()=1 2024-03-09T15:07:03.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.xvIsNm5Kf36BpzRwJ6C-zknQpGvADbF_0 2024-03-09T15:07:03.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8877022644078734651', time=2024-03-09T16:55:16.034481+0000, chain.objs.size()=1 2024-03-09T15:07:03.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.t1NM7tDp6sWDAhMrtnt8UrbF_ZkUFt2_0 2024-03-09T15:07:03.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18263628340024127930', time=2024-03-09T16:55:16.053442+0000, chain.objs.size()=1 2024-03-09T15:07:03.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.lkDxyE5MBBpppsgcJTY-s_RICS_OU-r_0 2024-03-09T15:07:03.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8421261247156183451', time=2024-03-09T16:55:16.259468+0000, chain.objs.size()=1 2024-03-09T15:07:03.545 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.fY66c1EhlvZpK7tQz6d1mMNq4Im82-F_0 2024-03-09T15:07:03.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7669071976698622806', time=2024-03-09T16:55:16.283668+0000, chain.objs.size()=1 2024-03-09T15:07:03.546 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Z1MesMHmV0wUHfSv_z-Yz8FzPBmGWjM_0 2024-03-09T15:07:03.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.546+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16833356339603293741', time=2024-03-09T16:55:16.321386+0000, chain.objs.size()=1 2024-03-09T15:07:03.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.546+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.itPJEQZ9iI_NBPG6fnf71namvHSo0qR_0 2024-03-09T15:07:03.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7088761143438120841', time=2024-03-09T16:55:16.340641+0000, chain.objs.size()=1 2024-03-09T15:07:03.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.0cgF_hh2ydiB7Q4nc4e1n7GxA0zkeoz_0 2024-03-09T15:07:03.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13070732321306447507', time=2024-03-09T16:55:16.355298+0000, chain.objs.size()=1 2024-03-09T15:07:03.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6EcPeF7UQ7IHHGQygZdNlBzhIaHDd4G_0 2024-03-09T15:07:03.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4638676620172595062', time=2024-03-09T16:55:16.471447+0000, chain.objs.size()=1 2024-03-09T15:07:03.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.sRda16SefNa9xJHqHY8tDM3MInRSIpL_0 2024-03-09T15:07:03.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8432626238316753638', time=2024-03-09T16:55:16.512921+0000, chain.objs.size()=1 2024-03-09T15:07:03.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Wc_vf5k1UGpUyk1Za4F2i5tpAYgp-lK_0 2024-03-09T15:07:03.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15057425217476925350', time=2024-03-09T16:55:16.552374+0000, chain.objs.size()=1 2024-03-09T15:07:03.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.8sSIfjKAoxym4AIOHHF4Wq-WYGyy8qP_0 2024-03-09T15:07:03.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10177937605339719439', time=2024-03-09T16:55:16.620107+0000, chain.objs.size()=1 2024-03-09T15:07:03.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.xBf5GQ4DiQ3QFwkXTJQH04T2-gnVHAC_0 2024-03-09T15:07:03.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2668959601266583376', time=2024-03-09T16:55:16.630029+0000, chain.objs.size()=1 2024-03-09T15:07:03.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.eLPLBBReXv_TG4W1D--c-WHWvzo-h2D_0 2024-03-09T15:07:03.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5399832871114731284', time=2024-03-09T16:55:16.729402+0000, chain.objs.size()=1 2024-03-09T15:07:03.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.tTVvroMeDOEKJbxA1_qzR6G_PW5YDQ4_0 2024-03-09T15:07:03.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7796097912706624878', time=2024-03-09T16:55:16.734403+0000, chain.objs.size()=1 2024-03-09T15:07:03.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.hsa2FAJXSPvVrTiBRUH9vQ6Y_v6Ic70_0 2024-03-09T15:07:03.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3102332335295043534', time=2024-03-09T16:55:16.824331+0000, chain.objs.size()=1 2024-03-09T15:07:03.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.550+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Hc7Zv63X6aqFWjqb8fib92ATfd6Pnv1_0 2024-03-09T15:07:03.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.554+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13453217010564809378', time=2024-03-09T16:55:16.827676+0000, chain.objs.size()=1 2024-03-09T15:07:03.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.554+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.krndwoI90w2YQ8JhZFKZWq8RBmBQjzA_0 2024-03-09T15:07:03.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.554+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14756866667622826922', time=2024-03-09T16:55:16.828706+0000, chain.objs.size()=1 2024-03-09T15:07:03.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.554+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.J_ntZhljJ8OzRIYfIS3U2Zyed1JgrBb_0 2024-03-09T15:07:03.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.554+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2148105202144141692', time=2024-03-09T16:55:18.576841+0000, chain.objs.size()=1 2024-03-09T15:07:03.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.554+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.258__shadow_.QWyhX-V5nVOrOgoiZ_rNmg1byQwLOkA_0 2024-03-09T15:07:03.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.554+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13394275368792874510', time=2024-03-09T16:55:21.348238+0000, chain.objs.size()=1 2024-03-09T15:07:03.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.554+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.261__shadow_.CQrhlDlL1tIDPOnJ8EsX3aTpe1XpJ5J_0 2024-03-09T15:07:03.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17505761535786078848', time=2024-03-09T16:55:26.878225+0000, chain.objs.size()=1 2024-03-09T15:07:03.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.267__shadow_.N88Cp9ejrNUeeLOZcFZM7VGNrYy4Hyq_0 2024-03-09T15:07:03.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6663218698576892059', time=2024-03-09T16:55:46.197474+0000, chain.objs.size()=1 2024-03-09T15:07:03.558 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.OAl-f-lBmRVLhFTl98Ss8Iw236hK1VN_0 2024-03-09T15:07:03.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4312526575856055688', time=2024-03-09T16:56:00.410442+0000, chain.objs.size()=1 2024-03-09T15:07:03.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.300__shadow_.hFKWqNrPryON62t3yhOwyPAsgqLysSM_0 2024-03-09T15:07:03.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3141786194292475521', time=2024-03-09T16:56:13.680597+0000, chain.objs.size()=1 2024-03-09T15:07:03.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.313__shadow:MRXexyYkZay-6APIY17hQ5vkofX9-rR_.8IQzF85RLpCo8n4gJRp9D9qkDdldVjG_0 2024-03-09T15:07:03.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2881971799018055012', time=2024-03-09T16:56:14.709306+0000, chain.objs.size()=1 2024-03-09T15:07:03.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.315__shadow_.lIlGhwXhCixGmdhL3RjZtw-jXcf-Mau_0 2024-03-09T15:07:03.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15740724408578410519', time=2024-03-09T16:56:15.819145+0000, chain.objs.size()=1 2024-03-09T15:07:03.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.316__shadow_.K7EgDjodPWENUve6F16yU99hhM3X8cR_0 2024-03-09T15:07:03.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12487746372501480818', time=2024-03-09T16:56:37.751627+0000, chain.objs.size()=1 2024-03-09T15:07:03.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.9BhHVpdChhsKczXbMvRQE9zlcHPUOS0_0 2024-03-09T15:07:03.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.562+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12028319602478026663', time=2024-03-09T16:56:37.760716+0000, chain.objs.size()=1 2024-03-09T15:07:03.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.562+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.puNvI1YWlwLKv-d1o9iGEu1AKxqhiaz_0 2024-03-09T15:07:03.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.562+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17128647983533556380', time=2024-03-09T16:56:37.818568+0000, chain.objs.size()=1 2024-03-09T15:07:03.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.562+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.iTMuD3QGZQpUhg6SjnAPuxs4YRYz-Iy_0 2024-03-09T15:07:03.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.562+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.965640041489079818', time=2024-03-09T16:56:37.984741+0000, chain.objs.size()=1 2024-03-09T15:07:03.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.562+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.DUvzEfh4M331olZt8jc-6_OhYgh33UE_0 2024-03-09T15:07:03.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.562+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15962378805288396953', time=2024-03-09T16:56:38.001698+0000, chain.objs.size()=1 2024-03-09T15:07:03.563 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.562+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.SqqvjI28pmtBfgZp3YGg_yCU4pqoRAm_0 2024-03-09T15:07:03.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.562+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14996102225337527052', time=2024-03-09T16:56:38.006105+0000, chain.objs.size()=1 2024-03-09T15:07:03.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.562+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Q2iVlVPs7kObcXMsPL8QXa10Qp4ahJo_0 2024-03-09T15:07:03.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.562+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.382109759301756248', time=2024-03-09T16:56:38.040997+0000, chain.objs.size()=1 2024-03-09T15:07:03.564 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.562+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.u8khFMwGr-iBM5FZy8cGgLLSxVXu9Md_0 2024-03-09T15:07:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9970587384875471514', time=2024-03-09T16:56:38.084032+0000, chain.objs.size()=1 2024-03-09T15:07:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.h63MWvMTNdYFQPf5K3fTeTwy2YvSyb0_0 2024-03-09T15:07:03.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14825604085466699534', time=2024-03-09T16:56:38.236268+0000, chain.objs.size()=1 2024-03-09T15:07:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.J1yZuZ3Zjy_3LIW_g2wb7Zx_RGN1BZx_0 2024-03-09T15:07:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7131537544269121151', time=2024-03-09T16:56:38.306143+0000, chain.objs.size()=1 2024-03-09T15:07:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6efEvMNGWHIZqAGO9YdgxuyOZvtnasN_0 2024-03-09T15:07:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6133977122617213880', time=2024-03-09T16:56:38.353772+0000, chain.objs.size()=1 2024-03-09T15:07:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.3MRvg0-5XPoxC52s6t6hPvwt415XhQ2_0 2024-03-09T15:07:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16395409268547140712', time=2024-03-09T16:56:38.388798+0000, chain.objs.size()=1 2024-03-09T15:07:03.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.oSGaSnBVJ1ra3f0A1_n-Ly4xM0y-9-L_0 2024-03-09T15:07:03.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13224906736850392714', time=2024-03-09T16:56:38.523300+0000, chain.objs.size()=1 2024-03-09T15:07:03.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.L0axK-uwljBX-G-nTPjE7PGWUeWhaiZ_0 2024-03-09T15:07:03.568 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9192793891720284992', time=2024-03-09T16:56:38.533595+0000, chain.objs.size()=1 2024-03-09T15:07:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.5xsplevXL3BEnpXAGExSLE0vKYBkHE0_0 2024-03-09T15:07:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5501274607719364864', time=2024-03-09T16:56:38.571647+0000, chain.objs.size()=1 2024-03-09T15:07:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.STWl0cLKpeXSqCRsDMHmjhM77Oq1lWx_0 2024-03-09T15:07:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12193916723257199626', time=2024-03-09T16:56:38.577395+0000, chain.objs.size()=1 2024-03-09T15:07:03.569 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.566+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.opPhbVfAslvHECIiXcT3xcSujqhVnVM_0 2024-03-09T15:07:03.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.570+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5571338343318098836', time=2024-03-09T16:56:38.584486+0000, chain.objs.size()=1 2024-03-09T15:07:03.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.570+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.7QEC6fFzhW6zit8xI8UzXkuSoVNTRVu_0 2024-03-09T15:07:03.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.570+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17556612205458276317', time=2024-03-09T16:56:38.592392+0000, chain.objs.size()=1 2024-03-09T15:07:03.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.570+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.3mJ4dGVvE6b5fTFPeUcQKf-g8BeUPwe_0 2024-03-09T15:07:03.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.570+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.614965164037721789', time=2024-03-09T16:56:38.595466+0000, chain.objs.size()=1 2024-03-09T15:07:03.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.570+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.qLQqLTQP8HqEeabgvfmMIszG7iBtAvr_0 2024-03-09T15:07:03.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.570+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11364119788629096177', time=2024-03-09T16:56:38.599552+0000, chain.objs.size()=1 2024-03-09T15:07:03.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.570+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.CVcNl4PEQlgjW__ecHeX9wM4RgbNHSw_0 2024-03-09T15:07:03.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.570+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8871221639759700979', time=2024-03-09T16:56:38.611917+0000, chain.objs.size()=1 2024-03-09T15:07:03.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.570+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.SFLHXF5W3MxBWZt-NKhu2lHR9qzbAwp_0 2024-03-09T15:07:03.571 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.570+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1637107535894012963', time=2024-03-09T16:56:38.612861+0000, chain.objs.size()=1 2024-03-09T15:07:03.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.570+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.MmphfsPX3ox5b_E3rbDbt1uPZSBfkuG_0 2024-03-09T15:07:03.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17089912532157717807', time=2024-03-09T16:56:38.776377+0000, chain.objs.size()=1 2024-03-09T15:07:03.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kcgHnMDgX2J66v0RoQt11xp6MIHvQRP_0 2024-03-09T15:07:03.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12204048160092476241', time=2024-03-09T16:56:38.803513+0000, chain.objs.size()=1 2024-03-09T15:07:03.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.YTPzVWGb3L6_lwKHmE1ntDUACJynPki_0 2024-03-09T15:07:03.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16575982743951393867', time=2024-03-09T16:56:38.856923+0000, chain.objs.size()=1 2024-03-09T15:07:03.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.K4DTN9o7Nag7Y9q5Ux8AYXklknlPk8k_0 2024-03-09T15:07:03.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3879467086981205987', time=2024-03-09T16:56:38.934010+0000, chain.objs.size()=1 2024-03-09T15:07:03.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Y-zxhaKKiyrpIVICTnitGPj6k5WyYiO_0 2024-03-09T15:07:03.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14087560911599031615', time=2024-03-09T16:56:39.160506+0000, chain.objs.size()=1 2024-03-09T15:07:03.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.gqg4FiiSy_Gtw-lcD2OpPlfjxajIcDV_0 2024-03-09T15:07:03.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15882724974768612218', time=2024-03-09T16:56:39.188818+0000, chain.objs.size()=1 2024-03-09T15:07:03.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.9-MvMlWdpjOOu7wj6l2i9hZ7PtPx8xn_0 2024-03-09T15:07:03.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12255553321330284485', time=2024-03-09T16:56:39.367925+0000, chain.objs.size()=1 2024-03-09T15:07:03.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.2Ug_9TjkXzjrMxawCzD3It76boJYvW1_0 2024-03-09T15:07:03.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8317531204936213572', time=2024-03-09T16:56:39.418738+0000, chain.objs.size()=1 2024-03-09T15:07:03.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.TwvdIwOOqD-3monfHd7PSlz_wREcAdH_0 2024-03-09T15:07:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14101376028976573010', time=2024-03-09T16:56:39.425321+0000, chain.objs.size()=1 2024-03-09T15:07:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.jfrz15KKhsmniotk4b_Ctd9fCSZCE5I_0 2024-03-09T15:07:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.894083120907768221', time=2024-03-09T16:56:39.461683+0000, chain.objs.size()=1 2024-03-09T15:07:03.576 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.PudzhxBJdhMrAB8ytw46-qP4Dy1T6dv_0 2024-03-09T15:07:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.578+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8456709036400811327', time=2024-03-09T16:56:39.469660+0000, chain.objs.size()=1 2024-03-09T15:07:03.578 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.578+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.S-fR6KjHVBsKo1KaJXf2x-OaqDBOm8v_0 2024-03-09T15:07:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.578+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2599631683075615289', time=2024-03-09T16:56:39.560894+0000, chain.objs.size()=1 2024-03-09T15:07:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.578+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.bExNpI1HwPyASrzJHYRbqefgAOVHVDL_0 2024-03-09T15:07:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.578+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11351035770600825426', time=2024-03-09T16:56:39.639681+0000, chain.objs.size()=1 2024-03-09T15:07:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.578+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.YE2UdeBBNlUDcITf9Taq5cP1DgN0E2J_0 2024-03-09T15:07:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.578+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6793244589637898253', time=2024-03-09T16:56:39.655274+0000, chain.objs.size()=1 2024-03-09T15:07:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.578+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6Kq_jMBIwbbjaMPvsKWGplK9xbfPdVj_0 2024-03-09T15:07:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.578+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13958971953893720358', time=2024-03-09T16:57:01.467884+0000, chain.objs.size()=1 2024-03-09T15:07:03.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.578+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.GlOjQrgS_A1LtYDHfYw3jwBc1o2ya01_0 2024-03-09T15:07:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.578+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3448625519394345510', time=2024-03-09T16:57:01.493939+0000, chain.objs.size()=1 2024-03-09T15:07:03.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.578+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.h4l_3eUzPlb0rhbNBG0D2kCJ-38dWaZ_0 2024-03-09T15:07:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.578+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6354193903066378129', time=2024-03-09T16:57:01.503448+0000, chain.objs.size()=1 2024-03-09T15:07:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.578+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.uQ-5GEaJYLR3nBPd-xERUtZaY3Ntcjs_0 2024-03-09T15:07:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.578+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.139389119739184325', time=2024-03-09T16:57:01.507893+0000, chain.objs.size()=1 2024-03-09T15:07:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.578+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.umOYwSQ3TnT0cwf6l6ebCvDBGM7gQyR_0 2024-03-09T15:07:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.582+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1728900183592634611', time=2024-03-09T16:57:01.570883+0000, chain.objs.size()=1 2024-03-09T15:07:03.581 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.582+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.WYYMiEahaVvbwn3kDkWGT2RPXmdWexT_0 2024-03-09T15:07:03.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.582+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13542605928793746883', time=2024-03-09T16:57:01.726554+0000, chain.objs.size()=1 2024-03-09T15:07:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.582+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Gw5CQyMU_45vnOWJ67rJ8D4ODStQFeK_0 2024-03-09T15:07:03.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.582+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1907960772845171125', time=2024-03-09T16:57:01.761177+0000, chain.objs.size()=1 2024-03-09T15:07:03.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.582+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.qe13JTlRrZHnMsVtdYdZDq40UrISYwp_0 2024-03-09T15:07:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.586+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4782047738331989015', time=2024-03-09T16:57:02.007939+0000, chain.objs.size()=1 2024-03-09T15:07:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.586+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.r_RNW2qaMonqMjbeu77p4eTrmP4q1QQ_0 2024-03-09T15:07:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.586+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3344498065035510745', time=2024-03-09T16:57:02.012732+0000, chain.objs.size()=1 2024-03-09T15:07:03.586 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.586+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.jFM4gkxTA0pcJjSpvYLBBRiCXNb_4GW_0 2024-03-09T15:07:03.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.586+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2713545438734389162', time=2024-03-09T16:57:02.019831+0000, chain.objs.size()=1 2024-03-09T15:07:03.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.586+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.zr4gD_cj5Vp5SiVh7_fe2kJrJmblnw-_0 2024-03-09T15:07:03.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.586+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7360361132869351564', time=2024-03-09T16:57:02.032179+0000, chain.objs.size()=1 2024-03-09T15:07:03.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.586+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.1bn9uNIAK2tzNbFzh7XWtuZ9gYy0Yj1_0 2024-03-09T15:07:03.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.594+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/45732 2024-03-09T15:07:03.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.594+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-03-09T15:07:03.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.594+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4948267571965069259', time=2024-03-09T16:57:02.037790+0000, chain.objs.size()=1 2024-03-09T15:07:03.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.594+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.PKGttMtgxJLwWRocjUSuZoURP4BhLy7_0 2024-03-09T15:07:03.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.594+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17991198672382832051', time=2024-03-09T16:57:02.061817+0000, chain.objs.size()=1 2024-03-09T15:07:03.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.594+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.J9NSibLiBsnpYAKVP_KibY1hzBw2wpL_0 2024-03-09T15:07:03.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.594+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5632599727964501470', time=2024-03-09T16:57:02.064818+0000, chain.objs.size()=1 2024-03-09T15:07:03.599 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.gxBzAoBX57y7c52UU4-JUUGbZH2BSev_0 2024-03-09T15:07:03.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562166430131959529', time=2024-03-09T16:57:02.071435+0000, chain.objs.size()=1 2024-03-09T15:07:03.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DejF4fqOIeIfV7MP-VLxUBT_3YdOfbw_0 2024-03-09T15:07:03.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17760963445834742588', time=2024-03-09T16:57:02.115903+0000, chain.objs.size()=1 2024-03-09T15:07:03.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.igLpY3jNFYq7tr_AaVFQDw3AV_YYAqY_0 2024-03-09T15:07:03.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7527884690405010349', time=2024-03-09T16:57:02.226268+0000, chain.objs.size()=1 2024-03-09T15:07:03.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.lvX7oDBcVOAAQ-Hk3lTr9Qgq6uYayBt_0 2024-03-09T15:07:03.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2601003083307486478', time=2024-03-09T16:57:02.247924+0000, chain.objs.size()=1 2024-03-09T15:07:03.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.iQgb0VSgpcExnneDhv6bwLBNJQ0H8Xr_0 2024-03-09T15:07:03.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17115445726277827096', time=2024-03-09T16:57:02.497912+0000, chain.objs.size()=1 2024-03-09T15:07:03.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.NueFBU-ct8Nx6oxeQMg5gzmPy_DIrW5_0 2024-03-09T15:07:03.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10412664964745678192', time=2024-03-09T16:57:02.508689+0000, chain.objs.size()=1 2024-03-09T15:07:03.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.s2S80zNMydPej9sBsTOLK4jvT3VvBVK_0 2024-03-09T15:07:03.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15354916279831290971', time=2024-03-09T16:57:02.573823+0000, chain.objs.size()=1 2024-03-09T15:07:03.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.S8Co8eH6NPpplo6N-tXHSHzvS5aTOsU_0 2024-03-09T15:07:03.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3577223442914031236', time=2024-03-09T16:57:02.592354+0000, chain.objs.size()=1 2024-03-09T15:07:03.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.qTz84iEqv6uRfYlhgwkieQ85CMUei-b_0 2024-03-09T15:07:03.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15857201616200577669', time=2024-03-09T16:57:02.638051+0000, chain.objs.size()=1 2024-03-09T15:07:03.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.qBoMDDh78tgKIr_76AODfCzqBbi0rYN_0 2024-03-09T15:07:03.604 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7117827800443807560', time=2024-03-09T16:57:02.751130+0000, chain.objs.size()=1 2024-03-09T15:07:03.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.wHdtQccCElRYWBDEjIKdwCRuo7Mik8D_0 2024-03-09T15:07:03.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4315135982181659518', time=2024-03-09T16:57:02.757556+0000, chain.objs.size()=1 2024-03-09T15:07:03.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.eiMQ7m9yo5bTwkmuJ_-sR3CQ3vqJ5aK_0 2024-03-09T15:07:03.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15862949691075946250', time=2024-03-09T16:57:02.818824+0000, chain.objs.size()=1 2024-03-09T15:07:03.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.pRcojTeL0LygvUGWEcMfbdL_Wf_X_1P_0 2024-03-09T15:07:03.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13537956147927622863', time=2024-03-09T16:57:02.856536+0000, chain.objs.size()=1 2024-03-09T15:07:03.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Wdp8mh1eLLmsrpk3GKNRd2f5Ztva1ea_0 2024-03-09T15:07:03.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3201465008544945311', time=2024-03-09T16:57:02.967784+0000, chain.objs.size()=1 2024-03-09T15:07:03.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.7dcQjQ9qNtkKYecxb9GPzM7g5H96Mew_0 2024-03-09T15:07:03.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16869608174492579765', time=2024-03-09T16:57:02.975084+0000, chain.objs.size()=1 2024-03-09T15:07:03.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.q6phbLR-zfoX_2AZLr3w4grWeJQ8nFj_0 2024-03-09T15:07:03.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11065208627175103492', time=2024-03-09T16:57:03.061276+0000, chain.objs.size()=1 2024-03-09T15:07:03.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.mDbfBFCyO2N1TphFWRfuns1LD-cqyUo_0 2024-03-09T15:07:03.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4319691612332906306', time=2024-03-09T16:57:03.077539+0000, chain.objs.size()=1 2024-03-09T15:07:03.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Uhwd0zkCwS998gt3oawskfx6iWI8gHW_0 2024-03-09T15:07:03.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2175653761014512339', time=2024-03-09T16:57:03.081783+0000, chain.objs.size()=1 2024-03-09T15:07:03.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.lJsLbxANd8SyxBUnk89HXAU0FV3Ayjg_0 2024-03-09T15:07:03.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12550576819763966926', time=2024-03-09T16:57:03.098409+0000, chain.objs.size()=1 2024-03-09T15:07:03.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.LW1zj5Rgny5WJZiAgkoqgglHC2ZXHV-_0 2024-03-09T15:07:03.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11992707553071232464', time=2024-03-09T16:57:03.261272+0000, chain.objs.size()=1 2024-03-09T15:07:03.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.74SYBdmoA9fHhvfBsDuSRfevnBXULEf_0 2024-03-09T15:07:03.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11556940695342614432', time=2024-03-09T16:57:03.269745+0000, chain.objs.size()=1 2024-03-09T15:07:03.609 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Lmh3Wnyj7bz8wBSLaGJ9Z4cFmvEeRN1_0 2024-03-09T15:07:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3374013661305931632', time=2024-03-09T16:57:03.322918+0000, chain.objs.size()=1 2024-03-09T15:07:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.vmsRAX9v6P6msHAK6T4d_-D8oBESLC-_0 2024-03-09T15:07:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16003663545862158074', time=2024-03-09T16:57:03.391905+0000, chain.objs.size()=1 2024-03-09T15:07:03.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.abvNmPASkzdSNpHeol7VeMbVtA4JXtW_0 2024-03-09T15:07:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4653953461651077632', time=2024-03-09T16:57:03.400735+0000, chain.objs.size()=1 2024-03-09T15:07:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.rK2uBKYIgs3WZLCS9iZkBs0SH9Dqjv5_0 2024-03-09T15:07:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2462763969388454954', time=2024-03-09T16:57:14.972170+0000, chain.objs.size()=1 2024-03-09T15:07:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.331__shadow_.FL7hWLGfEOI6WPhjdiC41Eg5EyX01Te_0 2024-03-09T15:07:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4272955012358794771', time=2024-03-09T16:58:02.938127+0000, chain.objs.size()=1 2024-03-09T15:07:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.384__shadow_.gmdrDFIo2_2UNqnQCA2XlmIJckHXDTP_0 2024-03-09T15:07:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13299171582488073163', time=2024-03-09T16:58:51.708193+0000, chain.objs.size()=1 2024-03-09T15:07:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.434__shadow_.5k6RhIFzjkQVDc3hqp7UR9eQ-XoxgNO_0 2024-03-09T15:07:03.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9749882934990903242', time=2024-03-09T17:01:26.981637+0000, chain.objs.size()=1 2024-03-09T15:07:03.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.544__shadow_.oD2E44jkItrCaWgG1Lzg0lTFS_yKqLJ_0 2024-03-09T15:07:03.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.694235581974111551', time=2024-03-09T17:01:32.312153+0000, chain.objs.size()=1 2024-03-09T15:07:03.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.548__shadow_.m6kiusTvzZYbxeKvTBUV-rAWvkr_Sjt_0 2024-03-09T15:07:03.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6192131705473073830', time=2024-03-09T17:02:03.063556+0000, chain.objs.size()=1 2024-03-09T15:07:03.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.565__shadow_.dsLWoWCGRG1cmEpB85065e6OPtNMuml_0 2024-03-09T15:07:03.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7870679014293550890', time=2024-03-09T17:02:19.039739+0000, chain.objs.size()=1 2024-03-09T15:07:03.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:oa8SH10V2lfz9KmiCGPrfGWJYublucQ_.NhGO_Dd8qH95e4XF2aTBeV3r6bWwVCc_0 2024-03-09T15:07:03.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.618+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8480173173964350158', time=2024-03-09T17:02:25.878640+0000, chain.objs.size()=1 2024-03-09T15:07:03.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.618+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:XJwS.L9eUlxCu2NA6JWGHCQgfiu65oI_.kcb4RLYXnvv38Xpe6ABoTPfERS-6r6R_0 2024-03-09T15:07:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6828971833116491825', time=2024-03-09T17:02:45.542649+0000, chain.objs.size()=1 2024-03-09T15:07:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.579__shadow:rPV16DGzFrjXsBYyeWTjNC6PzY-BrjY_.vXXmSiSFbGm3GvBSGJv9c9wuQqGHcqx_0 2024-03-09T15:07:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12411978130516568729', time=2024-03-09T17:03:58.141334+0000, chain.objs.size()=1 2024-03-09T15:07:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.642__shadow_.CMaxDZ52bsd1sVoVo1MsNVvItBpHtzU_0 2024-03-09T15:07:03.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13665593977682233196', time=2024-03-09T17:06:01.718312+0000, chain.objs.size()=1 2024-03-09T15:07:03.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.737__shadow_.APrRpFoPeAikdt675KffRbUPEao7quE_0 2024-03-09T15:07:03.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.626+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:03.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-09T15:07:03.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:03.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:03.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/59017' 2024-03-09T15:07:03.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='_FlxLTwL0VdkhXYfwZbqkiX1517L5ZFh', time=2024-03-09T16:51:56.220519+0000, chain.objs.size()=1 2024-03-09T15:07:03.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.157__shadow_.D04xyYYzcN1VRmnleAOuXQy7nAuMJqX_0 2024-03-09T15:07:03.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9937857613939341590', time=2024-03-09T16:52:10.331375+0000, chain.objs.size()=1 2024-03-09T15:07:03.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.171__shadow_.1GqEbQD7nHkCSnw3Ftcucd1a9oYZmbB_0 2024-03-09T15:07:03.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12822147828676584414', time=2024-03-09T16:54:24.682780+0000, chain.objs.size()=1 2024-03-09T15:07:03.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.227__shadow_.Wp4FwdSn2bEW0pRZWsT2K4xUS-ZwyMn_0 2024-03-09T15:07:03.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1776297816418736759', time=2024-03-09T16:54:45.316176+0000, chain.objs.size()=1 2024-03-09T15:07:03.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.247__shadow_.qAyISpLvZ0wccod88WDw4nV1Zmnc9uh_0 2024-03-09T15:07:03.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12231630892137555477', time=2024-03-09T16:54:47.259029+0000, chain.objs.size()=1 2024-03-09T15:07:03.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.249__shadow_.SLnKyVz5e8r-EF0hjvW1vr5ovLFPh1h_0 2024-03-09T15:07:03.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15482437150268712759', time=2024-03-09T16:54:47.263107+0000, chain.objs.size()=1 2024-03-09T15:07:03.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.249__shadow_.k3bhtCJtG-L2bQTIc5ForGCemj5Hb6Q_0 2024-03-09T15:07:03.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3990426354466566654', time=2024-03-09T16:54:49.090525+0000, chain.objs.size()=1 2024-03-09T15:07:03.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.251__shadow_.xTmvcZcyoQcemCLHsulNAwOiSIvZyhK_0 2024-03-09T15:07:03.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4592436633973240682', time=2024-03-09T16:55:14.840453+0000, chain.objs.size()=1 2024-03-09T15:07:03.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.s-NlD5BhuJDCuv_bhqeAxZzfo1r2XSm_0 2024-03-09T15:07:03.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2843987931998291444', time=2024-03-09T16:55:14.878230+0000, chain.objs.size()=1 2024-03-09T15:07:03.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.spib21KQTHxdbrWu-8ASHg9sseApjXJ_0 2024-03-09T15:07:03.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14552827944397300735', time=2024-03-09T16:55:14.887950+0000, chain.objs.size()=1 2024-03-09T15:07:03.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.a3SgdJszzOmQCocUebVHQD3W5LV_eG4_0 2024-03-09T15:07:03.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13611059728400275432', time=2024-03-09T16:55:14.988238+0000, chain.objs.size()=1 2024-03-09T15:07:03.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.wp3mPdI40VeibfFiLs74nIn6QEF8Jb-_0 2024-03-09T15:07:03.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.768057570068357534', time=2024-03-09T16:55:15.017786+0000, chain.objs.size()=1 2024-03-09T15:07:03.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.KwCW1sbMq8WrRUzL0N1eFhX0c36Nwuv_0 2024-03-09T15:07:03.635 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.634+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11539324119907947119', time=2024-03-09T16:55:15.024194+0000, chain.objs.size()=1 2024-03-09T15:07:03.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.634+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.kfxlHeC5lYupo3Pq5uV9q06P5fSucz1_0 2024-03-09T15:07:03.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.634+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7345463793375955860', time=2024-03-09T16:55:15.024813+0000, chain.objs.size()=1 2024-03-09T15:07:03.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.634+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.xLQ_AQqTvNe63NMOdSmvGMxr1uMRYEU_0 2024-03-09T15:07:03.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.634+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.367898333600582809', time=2024-03-09T16:55:15.140685+0000, chain.objs.size()=1 2024-03-09T15:07:03.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.634+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.joRZwNM8TOpSyA3ANtVtfKPXPfDLJle_0 2024-03-09T15:07:03.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.634+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3163489430876947129', time=2024-03-09T16:55:15.166537+0000, chain.objs.size()=1 2024-03-09T15:07:03.636 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.634+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.HgXP2y2MT1BSnfF2DkHZUU6Mqu8mqq__0 2024-03-09T15:07:03.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.634+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16645615306556641340', time=2024-03-09T16:55:15.199658+0000, chain.objs.size()=1 2024-03-09T15:07:03.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.634+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.FrCVbWyTVcFsNj0ncmlij5GLyyPEfVV_0 2024-03-09T15:07:03.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3203207784620172408', time=2024-03-09T16:55:15.500187+0000, chain.objs.size()=1 2024-03-09T15:07:03.637 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.sqU55b3zikldgJFiJUfRhZDbl1uQTHX_0 2024-03-09T15:07:03.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7210898835834680061', time=2024-03-09T16:55:15.539208+0000, chain.objs.size()=1 2024-03-09T15:07:03.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.p4iii1zomU_njMWaDSiDyAbt2twPQ_c_0 2024-03-09T15:07:03.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14866302850476819651', time=2024-03-09T16:55:15.713289+0000, chain.objs.size()=1 2024-03-09T15:07:03.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.4MpM5YMMA6e1V_2ladgM4EUkRzchvS2_0 2024-03-09T15:07:03.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8695598844395061198', time=2024-03-09T16:55:15.728202+0000, chain.objs.size()=1 2024-03-09T15:07:03.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Lhv79Td6RMCaE4mzdPpAEFN8RfHN_Jo_0 2024-03-09T15:07:03.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5948372315646334483', time=2024-03-09T16:55:15.805531+0000, chain.objs.size()=1 2024-03-09T15:07:03.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.bVSvdro-gzzyrPLPtWKVWwh7_B7x-OZ_0 2024-03-09T15:07:03.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.385661024966089048', time=2024-03-09T16:55:15.812919+0000, chain.objs.size()=1 2024-03-09T15:07:03.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ORykBr1nl8Iujar0WXYos1It-9AKrbm_0 2024-03-09T15:07:03.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9560349565853586216', time=2024-03-09T16:55:15.996791+0000, chain.objs.size()=1 2024-03-09T15:07:03.640 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6UeFKgHZRvUvaYTaX_hGiG2VqiU2YKk_0 2024-03-09T15:07:03.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5575608416039092502', time=2024-03-09T16:55:16.000646+0000, chain.objs.size()=1 2024-03-09T15:07:03.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_._KtL03YPGo91wzSsH0EeGBPSrZE4PUY_0 2024-03-09T15:07:03.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10433449773368863513', time=2024-03-09T16:55:16.037696+0000, chain.objs.size()=1 2024-03-09T15:07:03.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.truvjKq9D_7MHRZ4AuvzFVk0AKljEPE_0 2024-03-09T15:07:03.643 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1505492253977635197', time=2024-03-09T16:55:16.096963+0000, chain.objs.size()=1 2024-03-09T15:07:03.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.pJ1Q3CCUQCBUe6gHw39tnB469L7IC9-_0 2024-03-09T15:07:03.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18002797917187833190', time=2024-03-09T16:55:16.233604+0000, chain.objs.size()=1 2024-03-09T15:07:03.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.a6MQOUa2F7gg-9SHqdmoVCnPMOHWRYp_0 2024-03-09T15:07:03.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.160441313643789482', time=2024-03-09T16:55:16.324940+0000, chain.objs.size()=1 2024-03-09T15:07:03.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.WvPqasxT-T8vXPUYMMnlnzm636NxuMO_0 2024-03-09T15:07:03.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18422572717002048396', time=2024-03-09T16:55:16.345141+0000, chain.objs.size()=1 2024-03-09T15:07:03.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.bImwsiisxYUfcasVx_Rblsft4My31Ji_0 2024-03-09T15:07:03.644 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7879227324532277334', time=2024-03-09T16:55:16.474334+0000, chain.objs.size()=1 2024-03-09T15:07:03.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6mzcn9G6GVRl7wS3ubkIznBasx-IiVx_0 2024-03-09T15:07:03.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17892424595201090379', time=2024-03-09T16:55:16.477774+0000, chain.objs.size()=1 2024-03-09T15:07:03.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.jpwqQkOFpe6JMC3nPXJ-a_nDmx6y6W7_0 2024-03-09T15:07:03.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17585782195890777296', time=2024-03-09T16:55:16.515078+0000, chain.objs.size()=1 2024-03-09T15:07:03.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.642+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.udE17KaSyITn4EHCZope4o2oHpHWSZe_0 2024-03-09T15:07:03.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.646+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12493349413786255591', time=2024-03-09T16:55:16.542403+0000, chain.objs.size()=1 2024-03-09T15:07:03.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.9dMuERFgBGC4Qbn2FYBSX7DwgK2kg3K_0 2024-03-09T15:07:03.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.646+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1421829534036951562', time=2024-03-09T16:55:16.602930+0000, chain.objs.size()=1 2024-03-09T15:07:03.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.DzXw9Fbtz9nfirqGu9xRg_HoisN0Lwd_0 2024-03-09T15:07:03.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.646+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15615296249415032178', time=2024-03-09T16:55:16.611347+0000, chain.objs.size()=1 2024-03-09T15:07:03.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6Lpw8GOUDBfz5WWNumvTd4raMsMWFqr_0 2024-03-09T15:07:03.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.646+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4636172791411778877', time=2024-03-09T16:55:16.619822+0000, chain.objs.size()=1 2024-03-09T15:07:03.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.sAvCb6Ei7oE6iAun1h9XNJWAbHntIXi_0 2024-03-09T15:07:03.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.646+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11565181981736559566', time=2024-03-09T16:55:16.729242+0000, chain.objs.size()=1 2024-03-09T15:07:03.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.8XZ5wzwxrcvsqyN4Hdm_GORWMQZzm0W_0 2024-03-09T15:07:03.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13430373927984828112', time=2024-03-09T16:55:16.780994+0000, chain.objs.size()=1 2024-03-09T15:07:03.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.B-SyxQki0_J_PcEK3rqTncsPjF3iLN-_0 2024-03-09T15:07:03.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9351002077625394364', time=2024-03-09T16:55:17.665055+0000, chain.objs.size()=1 2024-03-09T15:07:03.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.257__shadow_.SS0Xa9Z6D2xF-p_jy-ToIu7z_DK16lD_0 2024-03-09T15:07:03.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14657084824313436904', time=2024-03-09T16:55:34.389871+0000, chain.objs.size()=1 2024-03-09T15:07:03.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.275__shadow_.0BZow9D0T2k9lmmxj7yrrKyHL5415IF_0 2024-03-09T15:07:03.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17788797562135366357', time=2024-03-09T16:55:51.563002+0000, chain.objs.size()=1 2024-03-09T15:07:03.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.291__shadow_.lKdt0bjZfUbfpdIAfYKVPBZ0bJybGav_0 2024-03-09T15:07:03.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10646315110006822226', time=2024-03-09T16:55:55.451808+0000, chain.objs.size()=1 2024-03-09T15:07:03.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.295__shadow_.ZAzRsdZV5NvM28A9Ebs1FrKyPSuOY-h_0 2024-03-09T15:07:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10683120815327976904', time=2024-03-09T16:55:58.321689+0000, chain.objs.size()=1 2024-03-09T15:07:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.298__shadow_.rRMjIh-EqMMDyeksnswTWdcvZrpFGOE_0 2024-03-09T15:07:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4981538293970325783', time=2024-03-09T16:56:37.718115+0000, chain.objs.size()=1 2024-03-09T15:07:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.uJ1UeeQRkaG9Lszy0w3paZI7wVAt5OA_0 2024-03-09T15:07:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6814939311383073716', time=2024-03-09T16:56:37.775163+0000, chain.objs.size()=1 2024-03-09T15:07:03.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.yDajLh27o5tk73avIa-cq0l68dA5Mvg_0 2024-03-09T15:07:03.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4337042621419054280', time=2024-03-09T16:56:37.814621+0000, chain.objs.size()=1 2024-03-09T15:07:03.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.LZQrtCOjGfzbwYKPk6jtDKK1f8snY2__0 2024-03-09T15:07:03.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13337966377891446744', time=2024-03-09T16:56:38.014307+0000, chain.objs.size()=1 2024-03-09T15:07:03.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_._hQ8bMLRfzt5iJub0Gru0Xo-RTD3SdZ_0 2024-03-09T15:07:03.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14197784653736688005', time=2024-03-09T16:56:38.097799+0000, chain.objs.size()=1 2024-03-09T15:07:03.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.jp_45xRIQGOhtbFU259vXxXXCflQKOL_0 2024-03-09T15:07:03.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10293217811241820336', time=2024-03-09T16:56:38.103456+0000, chain.objs.size()=1 2024-03-09T15:07:03.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.HueaA8QuvsoxI3OjYobT1ZohKSiXclA_0 2024-03-09T15:07:03.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17355014915367921206', time=2024-03-09T16:56:38.112820+0000, chain.objs.size()=1 2024-03-09T15:07:03.656 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.xKVn9PC1XK0S2bMwBXVJ0GCMr_r1pke_0 2024-03-09T15:07:03.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4821990052749990823', time=2024-03-09T16:56:38.332844+0000, chain.objs.size()=1 2024-03-09T15:07:03.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kojuxmm5bwmJwNZe7ELPupWurmsgxVR_0 2024-03-09T15:07:03.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2392045428689044069', time=2024-03-09T16:56:38.537085+0000, chain.objs.size()=1 2024-03-09T15:07:03.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.hVoeoBx4v11cS4IF9NeB9bQTzfb8ZQy_0 2024-03-09T15:07:03.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16214284959276642639', time=2024-03-09T16:56:38.556725+0000, chain.objs.size()=1 2024-03-09T15:07:03.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.EVm4exJpsz_lRxRLhgHNieVjvODliZI_0 2024-03-09T15:07:03.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6853878060184313246', time=2024-03-09T16:56:38.557729+0000, chain.objs.size()=1 2024-03-09T15:07:03.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.8sf33FRV7qdzSdjn-PJfvwjNefibDVH_0 2024-03-09T15:07:03.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.658+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1834422727260837608', time=2024-03-09T16:56:38.589039+0000, chain.objs.size()=1 2024-03-09T15:07:03.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.658+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.GQGeVE_GcbBYWGcsgHctt2vF2UpFBia_0 2024-03-09T15:07:03.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.658+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8966741609504810079', time=2024-03-09T16:56:38.609842+0000, chain.objs.size()=1 2024-03-09T15:07:03.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.658+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.fK0eFzVP3SEqGixIsaX2hl1fortUFnj_0 2024-03-09T15:07:03.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4008756999571912321', time=2024-03-09T16:56:38.646793+0000, chain.objs.size()=1 2024-03-09T15:07:03.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.PNxuECp1z8YlIGCWT4rnSC9BQkcNaLs_0 2024-03-09T15:07:03.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16863905817754355101', time=2024-03-09T16:56:38.775338+0000, chain.objs.size()=1 2024-03-09T15:07:03.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-LesVPkaSCKrE-X15NM9-odC7BLDzBD_0 2024-03-09T15:07:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10706804463945336842', time=2024-03-09T16:56:38.804502+0000, chain.objs.size()=1 2024-03-09T15:07:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.N5glveirdhLVxxDzmKW5cVDjOrH-N7V_0 2024-03-09T15:07:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13617322956421845530', time=2024-03-09T16:56:38.823743+0000, chain.objs.size()=1 2024-03-09T15:07:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.8Zp_oeZZKgsHPlyrqb3SwC3tmpWNrwW_0 2024-03-09T15:07:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.685335601356169121', time=2024-03-09T16:56:38.834154+0000, chain.objs.size()=1 2024-03-09T15:07:03.664 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.nk45fkD0y_N6AXrQWUecwIj_N8owKjl_0 2024-03-09T15:07:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15488533266247514950', time=2024-03-09T16:56:38.854104+0000, chain.objs.size()=1 2024-03-09T15:07:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.hLldOe5DBlQt6XXoEWbWEkWenl9oa6q_0 2024-03-09T15:07:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5194404758046039127', time=2024-03-09T16:56:39.148175+0000, chain.objs.size()=1 2024-03-09T15:07:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Yxda9noFMwoOGZLkhne2BQz3O5vLMFJ_0 2024-03-09T15:07:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18146996183801758665', time=2024-03-09T16:56:39.197530+0000, chain.objs.size()=1 2024-03-09T15:07:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.XPvh2M7G_ozR0gy2lr2ohwy7PrtrzWd_0 2024-03-09T15:07:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4238294930575378619', time=2024-03-09T16:56:39.356632+0000, chain.objs.size()=1 2024-03-09T15:07:03.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.662+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.O6ON1SPGfqbCAlfm8VOO82cgF5ILPs6_0 2024-03-09T15:07:03.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4041854362455599967', time=2024-03-09T16:56:39.357533+0000, chain.objs.size()=1 2024-03-09T15:07:03.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.NCiJ709-f3sTk4F0KAeiMWn-igLdfPw_0 2024-03-09T15:07:03.666 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3895584086471964353', time=2024-03-09T16:56:39.407303+0000, chain.objs.size()=1 2024-03-09T15:07:03.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lYVgbLkAY0_eKwbtMmjTDUEEcJlaVQB_0 2024-03-09T15:07:03.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8736752529458660282', time=2024-03-09T16:56:39.432078+0000, chain.objs.size()=1 2024-03-09T15:07:03.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.1sOAIhxbkp1mzDo4aq74oe7t7w3njrb_0 2024-03-09T15:07:03.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18190534932261121222', time=2024-03-09T16:56:39.438148+0000, chain.objs.size()=1 2024-03-09T15:07:03.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.CKaScGQsOo-ztjvGIehP5AA9ZQMUuDl_0 2024-03-09T15:07:03.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.670+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5167858429047148992', time=2024-03-09T16:56:39.682022+0000, chain.objs.size()=1 2024-03-09T15:07:03.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.670+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.y9XKf4d6W-NgMsY5fqCaIolCpYf4x8V_0 2024-03-09T15:07:03.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.670+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11120449571611167202', time=2024-03-09T16:56:39.685135+0000, chain.objs.size()=1 2024-03-09T15:07:03.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.670+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.3yTSKExj67qZHG1EiKjEK4taBkRtuPr_0 2024-03-09T15:07:03.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.670+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3920966715040296100', time=2024-03-09T16:57:01.447319+0000, chain.objs.size()=1 2024-03-09T15:07:03.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.670+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ydTDyEdoijNlWzGq2tZgDfgfAUq3Uye_0 2024-03-09T15:07:03.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.670+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6269780648897324200', time=2024-03-09T16:57:01.485886+0000, chain.objs.size()=1 2024-03-09T15:07:03.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.670+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xcrehKKpytBpLphBPkq0hJr1vX2Qfrg_0 2024-03-09T15:07:03.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.670+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12271244334041150347', time=2024-03-09T16:57:01.514093+0000, chain.objs.size()=1 2024-03-09T15:07:03.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.670+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.GFv8E-fV4POvRK-d8_jMS-ySUDPhFfj_0 2024-03-09T15:07:03.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.674+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6098594226541274758', time=2024-03-09T16:57:01.519815+0000, chain.objs.size()=1 2024-03-09T15:07:03.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.674+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.du2mme5sdt_fVsoUnYZeLqZIrkJ1N3l_0 2024-03-09T15:07:03.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.674+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6008731966999972452', time=2024-03-09T16:57:01.579503+0000, chain.objs.size()=1 2024-03-09T15:07:03.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.674+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.wcOQM6vUfzE6EsKcd5nMPQMuaDlPLxP_0 2024-03-09T15:07:03.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.674+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18432091074670466694', time=2024-03-09T16:57:01.805478+0000, chain.objs.size()=1 2024-03-09T15:07:03.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.674+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.G5HOKL6ckVGJuwhlwdx0vvWemezk6KH_0 2024-03-09T15:07:03.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.674+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11074528886516717546', time=2024-03-09T16:57:01.821369+0000, chain.objs.size()=1 2024-03-09T15:07:03.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.674+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.XmVyJm0fZtHdI1aZpVBJVrJv30lrjX9_0 2024-03-09T15:07:03.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.674+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17492430765660740685', time=2024-03-09T16:57:01.853337+0000, chain.objs.size()=1 2024-03-09T15:07:03.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.674+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.diAee-nUFNHlr1AWUnFtu9qqLeK2Vp__0 2024-03-09T15:07:03.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.674+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15404700324683424270', time=2024-03-09T16:57:01.988302+0000, chain.objs.size()=1 2024-03-09T15:07:03.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.674+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.k1ROCeUgTkrTu8juOh5vQadlvSpyCY5_0 2024-03-09T15:07:03.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4714030188410001051', time=2024-03-09T16:57:02.263638+0000, chain.objs.size()=1 2024-03-09T15:07:03.676 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.NWc7sCgqGq4sh-JvxCGowKS5rGhY5m-_0 2024-03-09T15:07:03.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3774666616717869675', time=2024-03-09T16:57:02.338095+0000, chain.objs.size()=1 2024-03-09T15:07:03.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.FeO3KBtPprczxIE5ntaUFPdQVbdrYsz_0 2024-03-09T15:07:03.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8474500459174878253', time=2024-03-09T16:57:02.510746+0000, chain.objs.size()=1 2024-03-09T15:07:03.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.kHi1clzigO9ESd0yxe5b_hJSQ5-Q6MR_0 2024-03-09T15:07:03.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11136416471557746327', time=2024-03-09T16:57:02.578511+0000, chain.objs.size()=1 2024-03-09T15:07:03.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.AwFfua2IWO3OgPVEVTq5i5No3pQxeuB_0 2024-03-09T15:07:03.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4439800561051398784', time=2024-03-09T16:57:02.581972+0000, chain.objs.size()=1 2024-03-09T15:07:03.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.y8OxLrsGzd8en6uhR8_iOjZ7QvXoB4g_0 2024-03-09T15:07:03.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9476557798315664099', time=2024-03-09T16:57:02.732884+0000, chain.objs.size()=1 2024-03-09T15:07:03.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.SOuVczy9epkEFNM66GC9Cpb14KLDeqG_0 2024-03-09T15:07:03.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6308947043484100801', time=2024-03-09T16:57:02.805994+0000, chain.objs.size()=1 2024-03-09T15:07:03.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DzmSCk_TTnNP8Z04R4-mJ-Ey4NFBDKY_0 2024-03-09T15:07:03.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1491187079144186043', time=2024-03-09T16:57:02.841704+0000, chain.objs.size()=1 2024-03-09T15:07:03.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Hox5_8jB3TO2YajY6o-99N36cbzoyOQ_0 2024-03-09T15:07:03.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.682+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4037098834372152515', time=2024-03-09T16:57:02.857153+0000, chain.objs.size()=1 2024-03-09T15:07:03.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.682+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.VRWkNF_thwT_aC7F6iNfsr94FG_u-vo_0 2024-03-09T15:07:03.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.682+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1527814282080186908', time=2024-03-09T16:57:02.993276+0000, chain.objs.size()=1 2024-03-09T15:07:03.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.682+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.NxeB4JWsS2-5H7VHDouYJznU_p46MeV_0 2024-03-09T15:07:03.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.682+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15761927838054917748', time=2024-03-09T16:57:03.059621+0000, chain.objs.size()=1 2024-03-09T15:07:03.682 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.682+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.E5s4q0ssJkfHtqZAlgywFm2m3U-p9XP_0 2024-03-09T15:07:03.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.682+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16530777556615407004', time=2024-03-09T16:57:53.849492+0000, chain.objs.size()=1 2024-03-09T15:07:03.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.682+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.375__shadow_.Bzzzf66PIQr8h35KIe5CvCiQS_Kz_gW_0 2024-03-09T15:07:03.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.682+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8480029358006496395', time=2024-03-09T16:58:02.935433+0000, chain.objs.size()=1 2024-03-09T15:07:03.683 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.682+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.384__shadow_.FmEAqumEeoFH9S22o7yjBlTCI30aP4N_0 2024-03-09T15:07:03.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8165645561015219771', time=2024-03-09T16:58:19.080365+0000, chain.objs.size()=1 2024-03-09T15:07:03.684 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.401__shadow_.93yw1DwSz8B9ryII8CQSRT79WtWCHcn_0 2024-03-09T15:07:03.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14697781089633029729', time=2024-03-09T16:58:53.593942+0000, chain.objs.size()=1 2024-03-09T15:07:03.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.436__shadow_.l2HDkwT_mbJW8_iG9MjHoUxazhKSdgB_0 2024-03-09T15:07:03.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14662589636779974198', time=2024-03-09T16:59:56.876685+0000, chain.objs.size()=1 2024-03-09T15:07:03.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.506__shadow_.3Ryc-aZyAwCUHtpfOVxe8asyVq2372H_0 2024-03-09T15:07:03.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5615322131181356107', time=2024-03-09T17:00:02.910667+0000, chain.objs.size()=1 2024-03-09T15:07:03.685 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.512__multipart_mymultipart.2~gQiL9Y8P2CbL3GSuBXYR5o9RNkMImto.1 2024-03-09T15:07:03.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~Tg2eq-o6xQtgQobBC-iMjW2gnayS4nE', time=2024-03-09T17:00:15.886371+0000, chain.objs.size()=1 2024-03-09T15:07:03.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~Tg2eq-o6xQtgQobBC-iMjW2gnayS4nE.2 2024-03-09T15:07:03.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~Z803wEmCouIUDOhRKG7xQzFqV81iUDB', time=2024-03-09T17:00:18.814897+0000, chain.objs.size()=1 2024-03-09T15:07:03.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~Z803wEmCouIUDOhRKG7xQzFqV81iUDB.3 2024-03-09T15:07:03.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/59017 2024-03-09T15:07:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-03-09T15:07:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~ZBP0MRM9y_X7768mcXQQDTmoCUc8E_9', time=2024-03-09T17:00:43.453044+0000, chain.objs.size()=1 2024-03-09T15:07:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.525__multipart_mymultipart.2~ZBP0MRM9y_X7768mcXQQDTmoCUc8E_9.1 2024-03-09T15:07:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1287904520893217916', time=2024-03-09T17:01:38.770060+0000, chain.objs.size()=1 2024-03-09T15:07:03.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.553__shadow_.cj4h0XuuI5tmXjJB1eK8Wivj3kSMQAS_0 2024-03-09T15:07:03.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12793481656882910824', time=2024-03-09T17:01:52.308186+0000, chain.objs.size()=1 2024-03-09T15:07:03.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:0wFhkdpqe0jWV1bYAJYMgfT97zqdrxO_.cVBO3-u0jcD3Hh5ZjiLt0HXlsAUOHIP_0 2024-03-09T15:07:03.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1318932767090305614', time=2024-03-09T17:01:54.726479+0000, chain.objs.size()=1 2024-03-09T15:07:03.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:VafSA3W3NGysSv5CGsCsxKikYzXWFHp_.G9v-D9XdHHOmYfiO4uoLs4go2oXmUeI_0 2024-03-09T15:07:03.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12562638614691556541', time=2024-03-09T17:02:06.671003+0000, chain.objs.size()=1 2024-03-09T15:07:03.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.567__shadow:.uNSZpb5Voyf0lsaR.Ll-OIs1lT2phr_.SIXtFr5ea8HO2kfOKEGIHK44Ez5fwOv_0 2024-03-09T15:07:03.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1921171757542741401', time=2024-03-09T17:02:07.099726+0000, chain.objs.size()=1 2024-03-09T15:07:03.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.567__shadow:J8I2Omm.nE11jSmUaLipe96mZvS9zGE_.B0ztMAbZ_Wq7a7RU88zVD9BrIlFL2fa_0 2024-03-09T15:07:03.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18144682780348628155', time=2024-03-09T17:02:09.885452+0000, chain.objs.size()=1 2024-03-09T15:07:03.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.568__shadow:HftqdqZ5U7.Nc4PocNdlcEtr6QPbLI7_.A1qMK9IdAaWAr1qDoGgR1bzCax0cNJh_0 2024-03-09T15:07:03.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.573__shadow:L3zT9mlDs1Azn.Si9K6gXUUJ2V4J8Cp_.Rq6OYpoFcPbS3fRQl_gx5DKyzgLj9sV_1_0e6b67e876ac323f0a2ee9d2a8bc3ef3', time=2024-03-09T17:02:39.631235+0000, chain.objs.size()=1 2024-03-09T15:07:03.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.573__shadow:L3zT9mlDs1Azn.Si9K6gXUUJ2V4J8Cp_.Rq6OYpoFcPbS3fRQl_gx5DKyzgLj9sV_0 2024-03-09T15:07:03.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8279476932114115205', time=2024-03-09T17:02:45.528850+0000, chain.objs.size()=1 2024-03-09T15:07:03.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.579__shadow:Jal1QC0jmtVrooGL0LOAwylmsFb6f81_.Js1iYV1exj12IngFrcZk3RbbRfjlOU9_0 2024-03-09T15:07:03.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3026028261882067991', time=2024-03-09T17:03:01.893327+0000, chain.objs.size()=1 2024-03-09T15:07:03.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.598__shadow_.D2Z3mm0G19dhlUU1zBpsu8ngZYImY9v_0 2024-03-09T15:07:03.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8746275856443126822', time=2024-03-09T17:04:15.891370+0000, chain.objs.size()=1 2024-03-09T15:07:03.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.661__shadow_.4-mXvAr5D5QjUORS5N1iEAi7xcY8o-6_0 2024-03-09T15:07:03.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9057768529409373264', time=2024-03-09T17:05:32.408764+0000, chain.objs.size()=1 2024-03-09T15:07:03.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.694+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.724__shadow_.ssL5tjqcjeRQyILgYvopbJ52T18f0P8_0 2024-03-09T15:07:03.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.698+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9686683736130614792', time=2024-03-09T17:06:05.924640+0000, chain.objs.size()=1 2024-03-09T15:07:03.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.698+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.740__shadow_.3Q_MXl8wVYECveyaVVPZrJ3L_hZ5aN0_0 2024-03-09T15:07:03.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.702+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:03.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.702+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-09T15:07:03.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:03.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:03.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/58554' 2024-03-09T15:07:03.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15537323299712418174', time=2024-03-09T16:51:47.856681+0000, chain.objs.size()=1 2024-03-09T15:07:03.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.151__shadow:apBn6ds71DOyMoj6jalgioEte84M7qY_.gO1ho7X4iwOG4cC4s7Yt1LG0BlwbM1Y_0 2024-03-09T15:07:03.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='_F_lHKAA4xGsByDwlp-SKruF_RlVTpbH', time=2024-03-09T16:51:53.268745+0000, chain.objs.size()=1 2024-03-09T15:07:03.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__shadow_.ak1Dnz-NvRuXbPxMt1gKgxbzGjBqfc0_0 2024-03-09T15:07:03.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7288022532860599814', time=2024-03-09T16:52:12.028860+0000, chain.objs.size()=1 2024-03-09T15:07:03.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.173__shadow_.ygqcwGv4p4q8f7nr7WtNMaXMNgUwE6Q_0 2024-03-09T15:07:03.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5463359260996555167', time=2024-03-09T16:54:21.807355+0000, chain.objs.size()=1 2024-03-09T15:07:03.708 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.224__shadow_.v_75X6UgpTkIvreHZ8w5YvCjDwOHKoC_0 2024-03-09T15:07:03.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8050912718618614938', time=2024-03-09T16:54:30.407788+0000, chain.objs.size()=1 2024-03-09T15:07:03.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.232__shadow_.wIrG6v2Ejjwt-qi3_QI1zYbnnTEoq0t_0 2024-03-09T15:07:03.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3967441487464176969', time=2024-03-09T16:54:34.033665+0000, chain.objs.size()=1 2024-03-09T15:07:03.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.236__shadow_.p2r7fTP5OJOn11u0Dd8R8GMhMr8DfIm_0 2024-03-09T15:07:03.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13403528903147913401', time=2024-03-09T16:54:35.455111+0000, chain.objs.size()=1 2024-03-09T15:07:03.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.237__shadow_.lYjHTXGj1exXsA_G5vbEd8JH5jhP_1U_0 2024-03-09T15:07:03.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6764963346562939454', time=2024-03-09T16:54:37.850405+0000, chain.objs.size()=1 2024-03-09T15:07:03.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.239__shadow_.d-A6bFMhRS_CRvvYsfBjUI2RQg2o3RK_0 2024-03-09T15:07:03.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13868720511435289062', time=2024-03-09T16:54:41.505428+0000, chain.objs.size()=1 2024-03-09T15:07:03.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.243__shadow_.RpbozWjUbAWrP3XDiu2tLpju2bZ0spI_0 2024-03-09T15:07:03.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9583573342281388957', time=2024-03-09T16:54:45.313685+0000, chain.objs.size()=1 2024-03-09T15:07:03.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.247__shadow_.PkvFJY1UBmhvou550yie4_aJZXijHmt_0 2024-03-09T15:07:03.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12286114108218731343', time=2024-03-09T16:54:46.265331+0000, chain.objs.size()=1 2024-03-09T15:07:03.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.248__shadow_.m5AP8UvT7A4q1HJXHU97fNHNS9ivL4O_0 2024-03-09T15:07:03.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18191566829851359929', time=2024-03-09T16:54:48.174196+0000, chain.objs.size()=1 2024-03-09T15:07:03.711 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.250__shadow_.fiMwzRjT0Am0tu7B_Ir77XBPX2ImwO2_0 2024-03-09T15:07:03.712 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2049481054854043474', time=2024-03-09T16:54:50.007404+0000, chain.objs.size()=1 2024-03-09T15:07:03.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.252__shadow_.QpXg0t7SwqhAlhwlIlLmaQzpad4sC6f_0 2024-03-09T15:07:03.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10805533353422546488', time=2024-03-09T16:55:14.884240+0000, chain.objs.size()=1 2024-03-09T15:07:03.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.aFra0A-V5abwThRih3mzSlfU3NA5N1p_0 2024-03-09T15:07:03.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14520949668128354800', time=2024-03-09T16:55:14.920029+0000, chain.objs.size()=1 2024-03-09T15:07:03.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Qn8l35Wfhx6axU7OgWkBSumG2K3n2_U_0 2024-03-09T15:07:03.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5810729487440618816', time=2024-03-09T16:55:15.137677+0000, chain.objs.size()=1 2024-03-09T15:07:03.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ixu4coI0_tGb45sJ49IYJ8w5xQqZfnh_0 2024-03-09T15:07:03.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17232009278450708017', time=2024-03-09T16:55:15.142835+0000, chain.objs.size()=1 2024-03-09T15:07:03.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Y9-Wl1mRQUslTVFwaNK6l9JYuTQryoQ_0 2024-03-09T15:07:03.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5398501478816299485', time=2024-03-09T16:55:15.148162+0000, chain.objs.size()=1 2024-03-09T15:07:03.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.BlNojGSDNlH-XtwMisr23ioOzcpeD1m_0 2024-03-09T15:07:03.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.32679135022948637', time=2024-03-09T16:55:15.248555+0000, chain.objs.size()=1 2024-03-09T15:07:03.714 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.-gfw2jpE_0eWP1VoVYC2RCWeen_97e-_0 2024-03-09T15:07:03.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8508485667465901013', time=2024-03-09T16:55:15.448355+0000, chain.objs.size()=1 2024-03-09T15:07:03.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.y3Oe3N3AoGhQqqrRszxq6rQLNkFkBAP_0 2024-03-09T15:07:03.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8312974270369', time=2024-03-09T16:55:15.475562+0000, chain.objs.size()=1 2024-03-09T15:07:03.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.710+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.HYDTgM1t3MiD7CSouadfFDyb9BOLtGx_0 2024-03-09T15:07:03.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15367125513549981754', time=2024-03-09T16:55:15.510256+0000, chain.objs.size()=1 2024-03-09T15:07:03.715 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.f6r0-ZSOEld_c_uyz_RdYMA1j3dhewu_0 2024-03-09T15:07:03.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4945530245479981578', time=2024-03-09T16:55:15.546389+0000, chain.objs.size()=1 2024-03-09T15:07:03.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ZdzTlKLgJBt69fZNd06Fe_sgiKag6JA_0 2024-03-09T15:07:03.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13844791019113570137', time=2024-03-09T16:55:15.553001+0000, chain.objs.size()=1 2024-03-09T15:07:03.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.VZWnPWcLgjoR2VPQ0gXI8oYX9dN6qsc_0 2024-03-09T15:07:03.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2050257397742857922', time=2024-03-09T16:55:15.673329+0000, chain.objs.size()=1 2024-03-09T15:07:03.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.oFOgb9FNuk-juPm_EVSK1QabfdYE4b__0 2024-03-09T15:07:03.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1461998553635292027', time=2024-03-09T16:55:15.728390+0000, chain.objs.size()=1 2024-03-09T15:07:03.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.R5bGO771czbXUG37yg6glEuVEVPeY9E_0 2024-03-09T15:07:03.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6485307621219420962', time=2024-03-09T16:55:15.978917+0000, chain.objs.size()=1 2024-03-09T15:07:03.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.IlJzjqYaxUUX5jyzK7c0Jl3BpcFv7-m_0 2024-03-09T15:07:03.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9056680335094759162', time=2024-03-09T16:55:16.038225+0000, chain.objs.size()=1 2024-03-09T15:07:03.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.YRVfaRJXOQWmdmf4s45mFKtoBykq1nT_0 2024-03-09T15:07:03.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5561748933449692580', time=2024-03-09T16:55:16.060121+0000, chain.objs.size()=1 2024-03-09T15:07:03.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.I8eEeA0qaCDNdKM9lf8S_XAb36Hm2VQ_0 2024-03-09T15:07:03.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.990316447353405279', time=2024-03-09T16:55:16.205246+0000, chain.objs.size()=1 2024-03-09T15:07:03.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.wW7gkFUw6r2F_VZa6Y79QKQeVNYM_Ua_0 2024-03-09T15:07:03.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7240167873283074306', time=2024-03-09T16:55:16.214556+0000, chain.objs.size()=1 2024-03-09T15:07:03.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.X9rPUb1J-q-5UJP-h63QuibXWd9BWmd_0 2024-03-09T15:07:03.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14658115991753521591', time=2024-03-09T16:55:16.349231+0000, chain.objs.size()=1 2024-03-09T15:07:03.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.pwJb8rB6mmBYeMcuzZ4A9-LmwnbDO_Y_0 2024-03-09T15:07:03.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7382100780324003787', time=2024-03-09T16:55:16.519131+0000, chain.objs.size()=1 2024-03-09T15:07:03.720 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.iQZnsFMETCaI9OWScE9nzhRJ85SSuxo_0 2024-03-09T15:07:03.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11590685703560451883', time=2024-03-09T16:55:16.564563+0000, chain.objs.size()=1 2024-03-09T15:07:03.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.67aTPHNSHV3tFupdX5rNpseMwMN8OGI_0 2024-03-09T15:07:03.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14369718195795387471', time=2024-03-09T16:55:16.574639+0000, chain.objs.size()=1 2024-03-09T15:07:03.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.718+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.9WCj29m2YKFUNEJbdFJldc7pzUJ5FeS_0 2024-03-09T15:07:03.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.722+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3713494054837703574', time=2024-03-09T16:55:16.580058+0000, chain.objs.size()=1 2024-03-09T15:07:03.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.722+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.09ZJOoGnjsX_eTKzPwQQkFIqFaArw1j_0 2024-03-09T15:07:03.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5415623714679155757', time=2024-03-09T16:55:16.727134+0000, chain.objs.size()=1 2024-03-09T15:07:03.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.iITkLY4J0bMIZZ7RFapzi5D9WLqWE-P_0 2024-03-09T15:07:03.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.47151284459119900', time=2024-03-09T16:55:42.125189+0000, chain.objs.size()=1 2024-03-09T15:07:03.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.283__shadow_.X8GCK_I-EgIJ5DR2y-IE1EtBLNGI8oc_0 2024-03-09T15:07:03.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12252251507171088518', time=2024-03-09T16:55:47.853103+0000, chain.objs.size()=1 2024-03-09T15:07:03.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.ciK2np5l9hCzUtD84pMawU0e0cBsAOW_0 2024-03-09T15:07:03.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15748419776734664458', time=2024-03-09T16:55:47.878926+0000, chain.objs.size()=1 2024-03-09T15:07:03.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.XtUQeAV88l1yoEIKijTuPlP1uvH-lk2_0 2024-03-09T15:07:03.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15811679442765208029', time=2024-03-09T16:55:47.880593+0000, chain.objs.size()=1 2024-03-09T15:07:03.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.soDi6YxP-hmSExaGiQ8b6gnW--4tlzU_0 2024-03-09T15:07:03.725 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3112867798570563469', time=2024-03-09T16:56:37.794682+0000, chain.objs.size()=1 2024-03-09T15:07:03.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.dn6fBNRKrCzAFHFn1GKLX3I7lv1yodT_0 2024-03-09T15:07:03.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4953672066095445111', time=2024-03-09T16:56:37.870773+0000, chain.objs.size()=1 2024-03-09T15:07:03.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.nHYO0qXGR8gWIXMYl3R8v4u-F-ItrVg_0 2024-03-09T15:07:03.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5095462258846270024', time=2024-03-09T16:56:37.970549+0000, chain.objs.size()=1 2024-03-09T15:07:03.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.gqLiTZGJJk83ughOpFpkmRYACGqirSA_0 2024-03-09T15:07:03.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11970847720753728096', time=2024-03-09T16:56:37.972123+0000, chain.objs.size()=1 2024-03-09T15:07:03.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.tCixyKO3rPlXyzQ_cZJycYYAjH-wyLh_0 2024-03-09T15:07:03.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9929268559174520377', time=2024-03-09T16:56:37.991319+0000, chain.objs.size()=1 2024-03-09T15:07:03.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.fNEhQBwH8mVisSIX_ngVqEBy3_atZj1_0 2024-03-09T15:07:03.727 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.563002391928350163', time=2024-03-09T16:56:37.997784+0000, chain.objs.size()=1 2024-03-09T15:07:03.728 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6ohTuLaey_wMDj7NYJLA0tPVI2wuSqW_0 2024-03-09T15:07:03.729 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3432894552437534777', time=2024-03-09T16:56:38.030070+0000, chain.objs.size()=1 2024-03-09T15:07:03.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.UutBzLkS5aDBj7WxrvWiofyONG7q31o_0 2024-03-09T15:07:03.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13369750239302976534', time=2024-03-09T16:56:38.051635+0000, chain.objs.size()=1 2024-03-09T15:07:03.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.s06rAV9B7C64ID-DclExMfnn0V6neBY_0 2024-03-09T15:07:03.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12686184882700345639', time=2024-03-09T16:56:38.053433+0000, chain.objs.size()=1 2024-03-09T15:07:03.730 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kG10OfcwckmlQmPP8eTFOcB8Hsj176Z_0 2024-03-09T15:07:03.731 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3805220501539860591', time=2024-03-09T16:56:38.060843+0000, chain.objs.size()=1 2024-03-09T15:07:03.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.IaduNF2i_elVjBvz9UX2Zga1kPRS2IU_0 2024-03-09T15:07:03.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16480838320495520401', time=2024-03-09T16:56:38.070319+0000, chain.objs.size()=1 2024-03-09T15:07:03.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.M0AFDy4GT11WHSH4d1MQBzKoP9Djax9_0 2024-03-09T15:07:03.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9971022487794770197', time=2024-03-09T16:56:38.096770+0000, chain.objs.size()=1 2024-03-09T15:07:03.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.AhxKNz1GRe_ezNYFNdAGOrUyvXsMuUB_0 2024-03-09T15:07:03.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11923468958014106459', time=2024-03-09T16:56:38.100601+0000, chain.objs.size()=1 2024-03-09T15:07:03.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.y66G4a7bu6_ircUBv63ppHV7Fi_yBMi_0 2024-03-09T15:07:03.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17820931150438185362', time=2024-03-09T16:56:38.120106+0000, chain.objs.size()=1 2024-03-09T15:07:03.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Tzcp4XE1jAX1hfTpmb30nrphofq0pmA_0 2024-03-09T15:07:03.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1138822269161247888', time=2024-03-09T16:56:38.237816+0000, chain.objs.size()=1 2024-03-09T15:07:03.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6CgdvOcDeZQ12CzOd6cgRsi4YXQUAzB_0 2024-03-09T15:07:03.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16968551794687585334', time=2024-03-09T16:56:38.286711+0000, chain.objs.size()=1 2024-03-09T15:07:03.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.RoeJ48kpPGdVYmgpeMG4sbVHVEHzMKy_0 2024-03-09T15:07:03.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6136123755480165316', time=2024-03-09T16:56:38.345810+0000, chain.objs.size()=1 2024-03-09T15:07:03.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.OC2ags39Du5THDq9T-nsazWfETp_-qu_0 2024-03-09T15:07:03.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3623795492813432099', time=2024-03-09T16:56:38.360173+0000, chain.objs.size()=1 2024-03-09T15:07:03.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.3fFLhl5MivKz7sZHXJ0h2e1_fO96yaf_0 2024-03-09T15:07:03.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11883310005897889658', time=2024-03-09T16:56:38.496943+0000, chain.objs.size()=1 2024-03-09T15:07:03.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.nw4Oorz7xCFwiCv-2gg6YmxhpSfLcAB_0 2024-03-09T15:07:03.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11036245181188688406', time=2024-03-09T16:56:38.500822+0000, chain.objs.size()=1 2024-03-09T15:07:03.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Eww4sAy428fLbk7-G_qSNRoyYKYQexf_0 2024-03-09T15:07:03.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.738+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9573209741319622159', time=2024-03-09T16:56:38.582791+0000, chain.objs.size()=1 2024-03-09T15:07:03.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.738+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.d_H7DfKTouONiRQ-bqTAal6j5S2MZwn_0 2024-03-09T15:07:03.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.738+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18359078829539580668', time=2024-03-09T16:56:38.658761+0000, chain.objs.size()=1 2024-03-09T15:07:03.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.738+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Sz-BBqnDdwAjfQqtenGQS_rNfLV7xEt_0 2024-03-09T15:07:03.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.738+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5836241101328675908', time=2024-03-09T16:56:38.874702+0000, chain.objs.size()=1 2024-03-09T15:07:03.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.738+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6iZToMOA2YBeDGi_pcGA_oaM2cNmeR4_0 2024-03-09T15:07:03.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.738+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14086652821704909264', time=2024-03-09T16:56:38.875608+0000, chain.objs.size()=1 2024-03-09T15:07:03.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.738+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.p5-WPPNnUT8_YhvniVYkU3rELhYvH14_0 2024-03-09T15:07:03.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.738+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8923943385774206383', time=2024-03-09T16:56:38.887143+0000, chain.objs.size()=1 2024-03-09T15:07:03.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.738+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.7e57_dRPu9Ft-C22mUi0B7XoVBAWWTi_0 2024-03-09T15:07:03.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12777275574778344306', time=2024-03-09T16:56:39.107570+0000, chain.objs.size()=1 2024-03-09T15:07:03.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.MWOqxmQOS1I5NTrN9PPVIyFCbHiyFe-_0 2024-03-09T15:07:03.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6572709974826672292', time=2024-03-09T16:56:39.130082+0000, chain.objs.size()=1 2024-03-09T15:07:03.742 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.sUsGHcP9zzr324jRRGmOgjT_-H-2tz2_0 2024-03-09T15:07:03.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6536829139968179707', time=2024-03-09T16:56:39.185963+0000, chain.objs.size()=1 2024-03-09T15:07:03.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.IwzqQjdz4Ly31yzCFvPNybuhZ6tgf4R_0 2024-03-09T15:07:03.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14488383201716706420', time=2024-03-09T16:56:39.310069+0000, chain.objs.size()=1 2024-03-09T15:07:03.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.V6Fi_ZsZxUYGJIWk9HBrs0TKFe3m-Sl_0 2024-03-09T15:07:03.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8905279508728550994', time=2024-03-09T16:56:39.367683+0000, chain.objs.size()=1 2024-03-09T15:07:03.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Qy8RdCXyjyjjsj608lr2w4a6H3bbQfj_0 2024-03-09T15:07:03.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4891908692480617850', time=2024-03-09T16:56:39.414073+0000, chain.objs.size()=1 2024-03-09T15:07:03.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0nMXA0MLNfNfshyjsKdZgLyZIhLz24q_0 2024-03-09T15:07:03.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17487568023617177208', time=2024-03-09T16:56:39.440422+0000, chain.objs.size()=1 2024-03-09T15:07:03.745 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Cp7zQhqo4phte9dQALo2znaE8ZRG9fr_0 2024-03-09T15:07:03.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.746+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9634233154998326504', time=2024-03-09T16:56:39.444233+0000, chain.objs.size()=1 2024-03-09T15:07:03.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.746+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.eUmAAfFT8f6RPCDdG5CGtqKZP1w44w__0 2024-03-09T15:07:03.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9759665755192624843', time=2024-03-09T16:56:39.456647+0000, chain.objs.size()=1 2024-03-09T15:07:03.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.qGBf6BnyXf9G4L38AiwyI7Fi6lJAnQv_0 2024-03-09T15:07:03.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17521436813761125579', time=2024-03-09T16:56:39.634414+0000, chain.objs.size()=1 2024-03-09T15:07:03.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.1gq1omGTMtwOcjfEGxwo18CxsMsuZ6X_0 2024-03-09T15:07:03.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2535871752519494044', time=2024-03-09T16:56:39.662733+0000, chain.objs.size()=1 2024-03-09T15:07:03.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.YlydpS7sDNEIgjrEB4vtXaEu56hVWTH_0 2024-03-09T15:07:03.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4364824282873596265', time=2024-03-09T16:57:01.490043+0000, chain.objs.size()=1 2024-03-09T15:07:03.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Sqwo7cZboWQgvZp0ifwbw56F_aPTshS_0 2024-03-09T15:07:03.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1940185765209771169', time=2024-03-09T16:57:01.547039+0000, chain.objs.size()=1 2024-03-09T15:07:03.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.EBROx64avt3GUpXmk1_paZmtVnUi0bE_0 2024-03-09T15:07:03.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4888616765413507495', time=2024-03-09T16:57:01.554532+0000, chain.objs.size()=1 2024-03-09T15:07:03.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.A19eOl2Bv7ML4_FZo2t2k0gJjo3X7-J_0 2024-03-09T15:07:03.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3579769813658838157', time=2024-03-09T16:57:01.752595+0000, chain.objs.size()=1 2024-03-09T15:07:03.751 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ajQmdOeHoX6x2Uikzjec_uYRyL870-O_0 2024-03-09T15:07:03.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13943513251339375483', time=2024-03-09T16:57:01.778455+0000, chain.objs.size()=1 2024-03-09T15:07:03.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.hAoHru3af7f_yjhvPW2gWjtW_VZJ5aK_0 2024-03-09T15:07:03.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14375885761261778231', time=2024-03-09T16:57:01.786981+0000, chain.objs.size()=1 2024-03-09T15:07:03.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DwffoV_P2jjirCmMy0h1uJI14owYt8B_0 2024-03-09T15:07:03.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4881375718158106136', time=2024-03-09T16:57:01.792143+0000, chain.objs.size()=1 2024-03-09T15:07:03.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_._9rZ-a4YhbuhXf6aoIX3cPK--arlmhF_0 2024-03-09T15:07:03.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.754+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4742702867130064037', time=2024-03-09T16:57:01.795042+0000, chain.objs.size()=1 2024-03-09T15:07:03.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.754+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.n52bqSEY-HpHlWyAaJQWMA1Vn8Txoah_0 2024-03-09T15:07:03.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.754+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9159097575927718863', time=2024-03-09T16:57:01.819992+0000, chain.objs.size()=1 2024-03-09T15:07:03.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.754+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.nlzFA8bCidc1ILdJLcf4pc-_g2jjw22_0 2024-03-09T15:07:03.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.754+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6534784758191797413', time=2024-03-09T16:57:01.988742+0000, chain.objs.size()=1 2024-03-09T15:07:03.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.754+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_._m6zhDWOJpsx-U7RB67NuKAJG_Jqv9a_0 2024-03-09T15:07:03.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.754+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8309972812948870591', time=2024-03-09T16:57:02.008385+0000, chain.objs.size()=1 2024-03-09T15:07:03.756 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.754+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.eLqxIg31JqoBpAv1cclyXeiqMI-tVXG_0 2024-03-09T15:07:03.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14216777085466683288', time=2024-03-09T16:57:02.108648+0000, chain.objs.size()=1 2024-03-09T15:07:03.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xLcioBy8UWkOWPAJyAgBAMk9FjKySQ0_0 2024-03-09T15:07:03.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4391185024883321334', time=2024-03-09T16:57:02.226397+0000, chain.objs.size()=1 2024-03-09T15:07:03.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oAKEqjyln0mjVGBKMqxGov4eyqqJaC__0 2024-03-09T15:07:03.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16613718701371329050', time=2024-03-09T16:57:02.288515+0000, chain.objs.size()=1 2024-03-09T15:07:03.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_._oQfhA69Iew2zpoDeSXkbXV7lCb5tvw_0 2024-03-09T15:07:03.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12669393018307178887', time=2024-03-09T16:57:02.291076+0000, chain.objs.size()=1 2024-03-09T15:07:03.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Pblo2DgPJm1NZgHIzwgJIvR7ipfM0iU_0 2024-03-09T15:07:03.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7760367609039885781', time=2024-03-09T16:57:02.298257+0000, chain.objs.size()=1 2024-03-09T15:07:03.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Z8snOtzHjI2zZlUEW32wveYbdyJMuK4_0 2024-03-09T15:07:03.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7532192849046554776', time=2024-03-09T16:57:02.314985+0000, chain.objs.size()=1 2024-03-09T15:07:03.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.8fzNlZowEB3z2lgYUP4Bhaga4v60ra5_0 2024-03-09T15:07:03.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5411332078906113518', time=2024-03-09T16:57:02.323412+0000, chain.objs.size()=1 2024-03-09T15:07:03.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.whm8yWwifdb9vjO74gycuQF-Mh7o_yp_0 2024-03-09T15:07:03.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11464221680373514950', time=2024-03-09T16:57:02.333165+0000, chain.objs.size()=1 2024-03-09T15:07:03.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.JnIYPgihLaoScIJJ-SvTqm6o37yMtih_0 2024-03-09T15:07:03.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9201578850066447483', time=2024-03-09T16:57:02.343143+0000, chain.objs.size()=1 2024-03-09T15:07:03.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.i0TUg3Co_5ZQz5MiDkGYQkpLTvcddxl_0 2024-03-09T15:07:03.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4567274512898940234', time=2024-03-09T16:57:02.362799+0000, chain.objs.size()=1 2024-03-09T15:07:03.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.eoQPacHOs8BKju4uFTyWRpxMSYtny_b_0 2024-03-09T15:07:03.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9317731613320175394', time=2024-03-09T16:57:02.509362+0000, chain.objs.size()=1 2024-03-09T15:07:03.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.VgYr14DJWB9tZn0gmtuXHbISBVYMCaq_0 2024-03-09T15:07:03.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7600252880822503986', time=2024-03-09T16:57:02.545183+0000, chain.objs.size()=1 2024-03-09T15:07:03.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.iPc-0Blm5UeXfBKxMyqWyYsL5ZzxdmD_0 2024-03-09T15:07:03.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.770+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/58554 2024-03-09T15:07:03.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-03-09T15:07:03.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.90263498525974438', time=2024-03-09T16:57:02.562453+0000, chain.objs.size()=1 2024-03-09T15:07:03.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.TRO5lcUajwpqPA-FOKxFmywyMW48VPa_0 2024-03-09T15:07:03.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15869655370763365197', time=2024-03-09T16:57:02.563188+0000, chain.objs.size()=1 2024-03-09T15:07:03.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.I786eeQvm-ZhBTn6ZzuwbYBR0iSF0mY_0 2024-03-09T15:07:03.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7686733434892757819', time=2024-03-09T16:57:02.589497+0000, chain.objs.size()=1 2024-03-09T15:07:03.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.lSr_WsHWwoPRrYOGV3OfmHoZZeNM5dC_0 2024-03-09T15:07:03.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10766172232084676853', time=2024-03-09T16:57:02.624031+0000, chain.objs.size()=1 2024-03-09T15:07:03.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.k_wUhO5y-PtjspO0bi4sp0pO_sA-xsQ_0 2024-03-09T15:07:03.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8385934589822124299', time=2024-03-09T16:57:02.792027+0000, chain.objs.size()=1 2024-03-09T15:07:03.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.LwwIDLb1JyHXtETRxkNsFTa0Mmin1AP_0 2024-03-09T15:07:03.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14369353676920977992', time=2024-03-09T16:57:02.813591+0000, chain.objs.size()=1 2024-03-09T15:07:03.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.dcKFruLfQCdDKA9-8Fr4rbKNTC837ms_0 2024-03-09T15:07:03.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.586801307632524876', time=2024-03-09T16:57:02.850433+0000, chain.objs.size()=1 2024-03-09T15:07:03.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.2LURwSpsaQCawKPb5tUNvYihWOlThf9_0 2024-03-09T15:07:03.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18326087168775706941', time=2024-03-09T16:57:02.868006+0000, chain.objs.size()=1 2024-03-09T15:07:03.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Yx88LIQ57qqwTg2kdkZEGTuMdMv2bzU_0 2024-03-09T15:07:03.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.306582559210207044', time=2024-03-09T16:57:02.987734+0000, chain.objs.size()=1 2024-03-09T15:07:03.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.uafUmWgvQYGv46-cFf4E4zfV7jDt62u_0 2024-03-09T15:07:03.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9820038802654088626', time=2024-03-09T16:57:02.997706+0000, chain.objs.size()=1 2024-03-09T15:07:03.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.FNVs5HZrmecz5NOrqLZ-HgF7FDUSpgn_0 2024-03-09T15:07:03.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1256931736042829396', time=2024-03-09T16:57:03.018611+0000, chain.objs.size()=1 2024-03-09T15:07:03.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.SyiyJX6DZVPDvrFtfb-hj_yucsIQrlU_0 2024-03-09T15:07:03.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3402178945798929790', time=2024-03-09T16:57:03.057931+0000, chain.objs.size()=1 2024-03-09T15:07:03.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xbW3ckqh5rXqEGPfcso_Xk084MzI1sQ_0 2024-03-09T15:07:03.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11793441531490276370', time=2024-03-09T16:57:03.343366+0000, chain.objs.size()=1 2024-03-09T15:07:03.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Lm_N2R9iufbL2DUIKe--zqpNusHOocX_0 2024-03-09T15:07:03.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.819178642260111304', time=2024-03-09T16:59:13.385692+0000, chain.objs.size()=1 2024-03-09T15:07:03.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.454__shadow_.WUoGWBktsp2ShLMRQ_W5pDtMfIzXmg8_0 2024-03-09T15:07:03.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.493__shadow_.Ujmc3mZsgCmDrUvQR3zInXsAXOB7hXc_1_fdb0bcbc5c30c5f8d0e46de58288822f', time=2024-03-09T16:59:45.127405+0000, chain.objs.size()=1 2024-03-09T15:07:03.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.493__shadow_.Ujmc3mZsgCmDrUvQR3zInXsAXOB7hXc_0 2024-03-09T15:07:03.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.497__shadow:sTyMyf-pYbnbXvdieipjbZDtyAqnZAv_.YDOx1qoYlCKjXydeFP7D4JWYzcC9wbk_1_0e51e9cdc23d65840049716929b690da', time=2024-03-09T16:59:48.701855+0000, chain.objs.size()=1 2024-03-09T15:07:03.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.497__shadow:sTyMyf-pYbnbXvdieipjbZDtyAqnZAv_.YDOx1qoYlCKjXydeFP7D4JWYzcC9wbk_0 2024-03-09T15:07:03.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2518368116281167260', time=2024-03-09T17:01:34.665564+0000, chain.objs.size()=1 2024-03-09T15:07:03.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.550__shadow_.JLMvvo1OlWdfm7btaqLUSXqb0-3WFvc_0 2024-03-09T15:07:03.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10157452184049721366', time=2024-03-09T17:01:40.988256+0000, chain.objs.size()=1 2024-03-09T15:07:03.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.555__shadow_.odN4kStlajZA6wZ39QzlBEwdsKaqAmO_0 2024-03-09T15:07:03.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.258205646849982401', time=2024-03-09T17:01:48.602119+0000, chain.objs.size()=1 2024-03-09T15:07:03.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.559__shadow_.MhtL6grdQb4gAZMybfnHE_ISOpFEeiO_0 2024-03-09T15:07:03.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2572458698412002971', time=2024-03-09T17:01:56.070389+0000, chain.objs.size()=1 2024-03-09T15:07:03.778 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:oOI7rzlw1hrlo0hXJWXAAJgW1p1o6wF_.9-dNnBzvB8BnsrbAZPzHYZCGExf4Ozk_0 2024-03-09T15:07:03.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12878977328590343479', time=2024-03-09T17:01:58.804128+0000, chain.objs.size()=1 2024-03-09T15:07:03.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:nLlM3Q6mbqGguIj0Df5BVdUNAdf7DCH_.oa7xAWqgoNKAqMwrWm0OUR567R_44Dc_0 2024-03-09T15:07:03.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13641363618399531712', time=2024-03-09T17:02:12.789486+0000, chain.objs.size()=1 2024-03-09T15:07:03.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.569__shadow:w0n4PoxNPLQ5j0-exoSlF.SPhYBAHyl_.80CjW4dIX1f2OacFegpYLWg7zDMBuDd_0 2024-03-09T15:07:03.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7885550901611577638', time=2024-03-09T17:02:22.965698+0000, chain.objs.size()=1 2024-03-09T15:07:03.779 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.778+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:jvQYobHfondyKwERDtMuZHaEm6gn61Q_.FJ-vkFWM1zRpBWpu8Iko14Dxr9Gojby_0 2024-03-09T15:07:03.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.782+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17361012658645972373', time=2024-03-09T17:02:27.305709+0000, chain.objs.size()=1 2024-03-09T15:07:03.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:bHjfYZLMSqdUUaNZXnMZ2nWWFEyRQOR_.ceD-76J5F5R5Znyfcc0gOdxKqs94TFC_0 2024-03-09T15:07:03.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.782+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3913423576748670778', time=2024-03-09T17:02:46.573253+0000, chain.objs.size()=1 2024-03-09T15:07:03.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.580__shadow:tOCPLkx4A5JyWr-40K-xAVMiCiEEmgz_.u-Oyv8d5ISN9VhbznHE5Wu3-ZkrJdwk_0 2024-03-09T15:07:03.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.782+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~xu_P-2GPRt4ZNGc0C3krkTPOBIMnCDr', time=2024-03-09T17:03:33.498709+0000, chain.objs.size()=6 2024-03-09T15:07:03.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.616__multipart_multipart_enc.2~xu_P-2GPRt4ZNGc0C3krkTPOBIMnCDr.1 2024-03-09T15:07:03.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.616__multipart_multipart_enc.2~xu_P-2GPRt4ZNGc0C3krkTPOBIMnCDr.2 2024-03-09T15:07:03.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.616__multipart_multipart_enc.2~xu_P-2GPRt4ZNGc0C3krkTPOBIMnCDr.3 2024-03-09T15:07:03.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.616__multipart_multipart_enc.2~xu_P-2GPRt4ZNGc0C3krkTPOBIMnCDr.4 2024-03-09T15:07:03.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.616__multipart_multipart_enc.2~xu_P-2GPRt4ZNGc0C3krkTPOBIMnCDr.5 2024-03-09T15:07:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.616__multipart_multipart_enc.2~xu_P-2GPRt4ZNGc0C3krkTPOBIMnCDr.6 2024-03-09T15:07:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.782+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17225258228521218539', time=2024-03-09T17:03:34.346525+0000, chain.objs.size()=1 2024-03-09T15:07:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.617__shadow_.U-lJHIpXYb4SFoq4iB8x1kTzjeo9VEB_0 2024-03-09T15:07:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.782+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8450103239106961863', time=2024-03-09T17:04:45.550027+0000, chain.objs.size()=1 2024-03-09T15:07:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.695__shadow:t-PmSN57YocebCrcK4PjYBo5M0WDuZ0_.M-NgD3pD5FdksaQCHnwN5Pu3uLZKBNs_0 2024-03-09T15:07:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.782+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15774550802768415764', time=2024-03-09T17:06:00.273930+0000, chain.objs.size()=1 2024-03-09T15:07:03.784 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.736__shadow_.jE9wSraOvOBlg6VSD8jPZfDHAmHJiMO_0 2024-03-09T15:07:03.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.790+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:03.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-09T15:07:03.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:03.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:03.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45513' 2024-03-09T15:07:03.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7452219549916863596', time=2024-03-09T16:51:51.620578+0000, chain.objs.size()=2 2024-03-09T15:07:03.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.154__shadow_.6y2Zzs5QOUefr3j7mshvBzsdl0VKa2z_0 2024-03-09T15:07:03.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.154__shadow_.6y2Zzs5QOUefr3j7mshvBzsdl0VKa2z_1 2024-03-09T15:07:03.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8129357212175714582', time=2024-03-09T16:55:14.896688+0000, chain.objs.size()=1 2024-03-09T15:07:03.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.AIU7NTFlSneKf2ufJ7naYcLKHtNBoZq_0 2024-03-09T15:07:03.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13362102395331747485', time=2024-03-09T16:55:14.912236+0000, chain.objs.size()=1 2024-03-09T15:07:03.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.0XkTKD305DaBd_yaUpygwuWIWEeV-0U_0 2024-03-09T15:07:03.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11922419369315135938', time=2024-03-09T16:55:14.947979+0000, chain.objs.size()=1 2024-03-09T15:07:03.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.jHh6M6OSLLefQi6lt5QQdvUOtGDpu8-_0 2024-03-09T15:07:03.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12961010145079609697', time=2024-03-09T16:55:14.948943+0000, chain.objs.size()=1 2024-03-09T15:07:03.800 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.YX3FWAqmWzpXHd0YS1inMJ-PbHJmwLU_0 2024-03-09T15:07:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9519978857307684091', time=2024-03-09T16:55:14.994351+0000, chain.objs.size()=1 2024-03-09T15:07:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.8smjRCdyKDihdIKg1Q8cnNRpC8drCWi_0 2024-03-09T15:07:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3082813396583968529', time=2024-03-09T16:55:15.006259+0000, chain.objs.size()=1 2024-03-09T15:07:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.7u_qQzlSnQpDsR77Dc0y89xRiss6eQP_0 2024-03-09T15:07:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18278510314151782419', time=2024-03-09T16:55:15.213532+0000, chain.objs.size()=1 2024-03-09T15:07:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.AxpzzxsgWrrC0-EhEtw6vnWSOxXY04l_0 2024-03-09T15:07:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17815597564625267117', time=2024-03-09T16:55:15.214316+0000, chain.objs.size()=1 2024-03-09T15:07:03.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.CWNtGhvwOBBq8zOT49QfWul01KWrsFH_0 2024-03-09T15:07:03.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2774893945326669553', time=2024-03-09T16:55:15.217591+0000, chain.objs.size()=1 2024-03-09T15:07:03.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.P6O2D6pGHyaMVT9JenI4DhKnsGiDF4p_0 2024-03-09T15:07:03.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8176142444445101561', time=2024-03-09T16:55:15.274220+0000, chain.objs.size()=1 2024-03-09T15:07:03.802 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ZsiEMphm3Z3ueVtGbAoQBKS4zPaTZ5b_0 2024-03-09T15:07:03.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14347035836444309631', time=2024-03-09T16:55:15.522171+0000, chain.objs.size()=1 2024-03-09T15:07:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.K6NLSy_Foner-VOmJvUk5l7-g8S9spq_0 2024-03-09T15:07:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7525676928941664268', time=2024-03-09T16:55:15.558174+0000, chain.objs.size()=1 2024-03-09T15:07:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.mXh_2aSF0iM8dlW9zvX89cZZ6J8x7K9_0 2024-03-09T15:07:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12572359015645111244', time=2024-03-09T16:55:15.706422+0000, chain.objs.size()=1 2024-03-09T15:07:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.1lT-3U7hYsZ-YdmuRwOPdQ5w9WsH7rC_0 2024-03-09T15:07:03.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4831977244127323075', time=2024-03-09T16:55:15.767020+0000, chain.objs.size()=1 2024-03-09T15:07:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.PxszIjOUzF3QwHswCM8-UrpoeA_VCJm_0 2024-03-09T15:07:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15487129943421409916', time=2024-03-09T16:55:15.782605+0000, chain.objs.size()=1 2024-03-09T15:07:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.1xjpJ0gJstXnnUE9fMCkON0nzO1wQ15_0 2024-03-09T15:07:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13275820727720947341', time=2024-03-09T16:55:15.814062+0000, chain.objs.size()=1 2024-03-09T15:07:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Rc13M5nyv0rOdsLiTkHX7MfSzmE-Ifx_0 2024-03-09T15:07:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4602967701315350132', time=2024-03-09T16:55:16.013037+0000, chain.objs.size()=1 2024-03-09T15:07:03.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.0j27aoZ9JcviF0HTjsKc98FeHfZt5Xm_0 2024-03-09T15:07:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17581061094387108693', time=2024-03-09T16:55:16.019270+0000, chain.objs.size()=1 2024-03-09T15:07:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.VAlYLA_6VJyOYDxZxTZbyfdQpTqGzvW_0 2024-03-09T15:07:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3069573184405216117', time=2024-03-09T16:55:16.019970+0000, chain.objs.size()=1 2024-03-09T15:07:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.r9-_H0La0xOCzqvjupG_RDM0viesxKA_0 2024-03-09T15:07:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1178376596819873027', time=2024-03-09T16:55:16.043101+0000, chain.objs.size()=1 2024-03-09T15:07:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.P8zGv1VK-7gYafYRRB8xzTOGo2qTHhC_0 2024-03-09T15:07:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12687466699950803127', time=2024-03-09T16:55:16.045473+0000, chain.objs.size()=1 2024-03-09T15:07:03.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.EW9D-5P9OzRkLhH12aMIb7xU552_gPj_0 2024-03-09T15:07:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1329007956593717253', time=2024-03-09T16:55:16.064864+0000, chain.objs.size()=1 2024-03-09T15:07:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.c5rvdPzuqLxcCLdVnWjMydYz-U02iFy_0 2024-03-09T15:07:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3438744126774330756', time=2024-03-09T16:55:16.250561+0000, chain.objs.size()=1 2024-03-09T15:07:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.2R4hMVgHydrrLLTsB2PvkLjqdXWlV4R_0 2024-03-09T15:07:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26601096702942994', time=2024-03-09T16:55:16.262080+0000, chain.objs.size()=1 2024-03-09T15:07:03.813 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ac96t18_HMGSyJf0Y54tFJVJ8PMahTC_0 2024-03-09T15:07:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17605481722209962783', time=2024-03-09T16:55:16.276001+0000, chain.objs.size()=1 2024-03-09T15:07:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.N6WT2RVxcQixpsK0VRSbTO55tIW5rqs_0 2024-03-09T15:07:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1812585263308034882', time=2024-03-09T16:55:16.283790+0000, chain.objs.size()=1 2024-03-09T15:07:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.bjMcXYfdLxqssAp8ebjiv0mO8IIJo8H_0 2024-03-09T15:07:03.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1186888889181001755', time=2024-03-09T16:55:16.526450+0000, chain.objs.size()=1 2024-03-09T15:07:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.OIWe1LiraOFfoiotqK8PnHh3x8dOCqc_0 2024-03-09T15:07:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12480089466078340109', time=2024-03-09T16:55:16.530258+0000, chain.objs.size()=1 2024-03-09T15:07:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.WqDT2AhTqwXLoMSRmOmYnv46M7YW5Vz_0 2024-03-09T15:07:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12990559609579674847', time=2024-03-09T16:55:16.544920+0000, chain.objs.size()=1 2024-03-09T15:07:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.XjHp_XgrGkDUk0-PRhz1gYh3yr7dCR2_0 2024-03-09T15:07:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10032146763127250593', time=2024-03-09T16:55:16.599274+0000, chain.objs.size()=1 2024-03-09T15:07:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.LaiqFCGe14iOabCL7nUZXdKAOXFa7HM_0 2024-03-09T15:07:03.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17989505971723168008', time=2024-03-09T16:55:16.759633+0000, chain.objs.size()=1 2024-03-09T15:07:03.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.jYgL3EYkMML_thOMMeeYX-d1K97OU1G_0 2024-03-09T15:07:03.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13198994700027835630', time=2024-03-09T16:55:16.830852+0000, chain.objs.size()=1 2024-03-09T15:07:03.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.D7eE68cL1PAWlxSka341dW7uZeQdfvR_0 2024-03-09T15:07:03.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16534738410746156394', time=2024-03-09T16:55:16.847395+0000, chain.objs.size()=1 2024-03-09T15:07:03.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ss4lQrPA5JUzsheJMyJIhL-5fPokrb6_0 2024-03-09T15:07:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11834662173470499541', time=2024-03-09T16:55:16.851869+0000, chain.objs.size()=1 2024-03-09T15:07:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.dTS2v88S4W63wOFFQLcFgWsTY4531bC_0 2024-03-09T15:07:03.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.822+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6220528202749861492', time=2024-03-09T16:55:22.256821+0000, chain.objs.size()=1 2024-03-09T15:07:03.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.822+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.262__shadow_.mQSiRV4wiL-fd0K5r5xxbdbD6w2eH0c_0 2024-03-09T15:07:03.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.822+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15758685567640782112', time=2024-03-09T16:55:29.743856+0000, chain.objs.size()=1 2024-03-09T15:07:03.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.822+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.270__shadow_.EC5m8FIRxla5-Xa4Ow3cPffcBL7k4tu_0 2024-03-09T15:07:03.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.822+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4213445685284577100', time=2024-03-09T16:55:30.670892+0000, chain.objs.size()=1 2024-03-09T15:07:03.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.822+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.271__shadow_.NqPwkoWcw6nLjjJyk5fYB-4ktjwGrZv_0 2024-03-09T15:07:03.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.822+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14265231363678227709', time=2024-03-09T16:55:31.592600+0000, chain.objs.size()=1 2024-03-09T15:07:03.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.822+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.272__shadow_.a3Pyp3JECPCHt4Z2JCvE-359RyJbl_p_0 2024-03-09T15:07:03.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.822+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1579980903522559106', time=2024-03-09T16:55:36.261051+0000, chain.objs.size()=1 2024-03-09T15:07:03.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.822+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.277__shadow_.RVG9q-3YZAlVF27xBBSZVwQAFyzrauf_0 2024-03-09T15:07:03.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.822+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9599366921761407358', time=2024-03-09T16:55:46.236497+0000, chain.objs.size()=1 2024-03-09T15:07:03.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.822+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.MYz92LrexXcMiYSeuG0IYkfDT8aqYVD_0 2024-03-09T15:07:03.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.822+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16740792930369518186', time=2024-03-09T16:55:47.850810+0000, chain.objs.size()=1 2024-03-09T15:07:03.823 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.822+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.AgnqMOWsk-RPDUF1CIItJz3EFdA9tER_0 2024-03-09T15:07:03.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13198770324885505284', time=2024-03-09T16:55:49.682204+0000, chain.objs.size()=1 2024-03-09T15:07:03.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.289__shadow_.8vM6xSsAtMY9n4IJVIl4tLtKAoOqNN2_0 2024-03-09T15:07:03.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3606450745838621879', time=2024-03-09T16:55:50.642119+0000, chain.objs.size()=1 2024-03-09T15:07:03.824 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.290__shadow_.kthFHUU-zvO6FZPL7WKWrJzf33GOpZb_0 2024-03-09T15:07:03.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17694079831987017626', time=2024-03-09T16:55:52.655371+0000, chain.objs.size()=1 2024-03-09T15:07:03.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.292__shadow_.y3vvj2HFRDssRD_QmG8ptKF3TuyRoOe_0 2024-03-09T15:07:03.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6098604562460955047', time=2024-03-09T16:55:54.533505+0000, chain.objs.size()=1 2024-03-09T15:07:03.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.294__shadow_.KCpY4DUJfAvKvSefI-3AQ7ln9EtjutQ_0 2024-03-09T15:07:03.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7644535003743726535', time=2024-03-09T16:55:59.296305+0000, chain.objs.size()=1 2024-03-09T15:07:03.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.299__shadow_.NMMW_fvZWVEZmaJCXtYbB4Py9go5Pdg_0 2024-03-09T15:07:03.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7947532401142433821', time=2024-03-09T16:56:00.412158+0000, chain.objs.size()=1 2024-03-09T15:07:03.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.300__shadow_.IhGTEJTTEhNAOq0uiJNows9Lwk3XdKM_0 2024-03-09T15:07:03.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5588509308113734131', time=2024-03-09T16:56:37.729842+0000, chain.objs.size()=1 2024-03-09T15:07:03.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.srw69Azvnmo_EAS4gUVsoWGV6HcNC4A_0 2024-03-09T15:07:03.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9251753701346069047', time=2024-03-09T16:56:37.778407+0000, chain.objs.size()=1 2024-03-09T15:07:03.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.jF-zNSpdxPmNH2lMYaleOJhEH8vMSoz_0 2024-03-09T15:07:03.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13488337625967905445', time=2024-03-09T16:56:37.808009+0000, chain.objs.size()=1 2024-03-09T15:07:03.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.exujpJIOk7w4Gho5F_aRE2_4gUXNs7H_0 2024-03-09T15:07:03.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5069659632876809190', time=2024-03-09T16:56:38.018948+0000, chain.objs.size()=1 2024-03-09T15:07:03.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.hONBvvdXKIEDbDnVP7Ro2qNukFbIRRH_0 2024-03-09T15:07:03.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3411416088282994126', time=2024-03-09T16:56:38.267017+0000, chain.objs.size()=1 2024-03-09T15:07:03.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.UyNhzl_IwSAd1cnh4l9KipR4ig2Vbdk_0 2024-03-09T15:07:03.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13431727463160430794', time=2024-03-09T16:56:38.299778+0000, chain.objs.size()=1 2024-03-09T15:07:03.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.qd0JEnONCSmWCTWnEfB7-z1N0NQMp4K_0 2024-03-09T15:07:03.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17391156894871517209', time=2024-03-09T16:56:38.359022+0000, chain.objs.size()=1 2024-03-09T15:07:03.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_._Fu1xqW9MozVko_sBPLYVvdIxQE1Ut-_0 2024-03-09T15:07:03.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.830+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1412658276866785266', time=2024-03-09T16:56:38.373608+0000, chain.objs.size()=1 2024-03-09T15:07:03.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.830+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.tjgeUnCVyG8jU3aT3A_9vGcff7K-IgZ_0 2024-03-09T15:07:03.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15837524619308644605', time=2024-03-09T16:56:38.556154+0000, chain.objs.size()=1 2024-03-09T15:07:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.fMPFwPjPVFScQi5YeCW1Fe0kY3v79jq_0 2024-03-09T15:07:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1746076358224385690', time=2024-03-09T16:56:38.568475+0000, chain.objs.size()=1 2024-03-09T15:07:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.5t1zKM0_pKuqGk-pTIN8Bb_7xk1XWsZ_0 2024-03-09T15:07:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2151084182560221363', time=2024-03-09T16:56:38.608367+0000, chain.objs.size()=1 2024-03-09T15:07:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.l2e8YiqpKAhuMdNW-569BDm5m-yoXmS_0 2024-03-09T15:07:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7184461488188795576', time=2024-03-09T16:56:38.619298+0000, chain.objs.size()=1 2024-03-09T15:07:03.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lbR9wDCRV3FdUT2L4GxmtTsY4PkPHiU_0 2024-03-09T15:07:03.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4782329449588930814', time=2024-03-09T16:56:38.811815+0000, chain.objs.size()=1 2024-03-09T15:07:03.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Q02NBqE5ioCXHnK8uzinMCfNL1RRsBY_0 2024-03-09T15:07:03.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13656101658456807523', time=2024-03-09T16:56:38.814260+0000, chain.objs.size()=1 2024-03-09T15:07:03.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.8Ei1vlgzOt7dMNceikBIVKRK8ow5vLY_0 2024-03-09T15:07:03.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14560741827167165589', time=2024-03-09T16:56:38.828987+0000, chain.objs.size()=1 2024-03-09T15:07:03.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-iE3CZ29yZPfF7jCdkpx6hsSU09akDZ_0 2024-03-09T15:07:03.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14000359787374228197', time=2024-03-09T16:56:38.829876+0000, chain.objs.size()=1 2024-03-09T15:07:03.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.9B4TM_pGIKDXpMxHU8KpsfT97Tknj6Q_0 2024-03-09T15:07:03.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13415119197171009630', time=2024-03-09T16:56:38.832839+0000, chain.objs.size()=1 2024-03-09T15:07:03.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.o_rSlefGp7BrXoIEqZgVZxYbYgr3dQL_0 2024-03-09T15:07:03.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13204234549593480878', time=2024-03-09T16:56:38.870480+0000, chain.objs.size()=1 2024-03-09T15:07:03.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.TmpoLMfYvjIVA4SHf0RU0Fhy06bTmTZ_0 2024-03-09T15:07:03.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1005083985476903498', time=2024-03-09T16:56:38.876830+0000, chain.objs.size()=1 2024-03-09T15:07:03.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ysHkNIpcZboeBdJ5GMFNk1Vtp_nefKr_0 2024-03-09T15:07:03.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9195284884870893596', time=2024-03-09T16:56:38.892053+0000, chain.objs.size()=1 2024-03-09T15:07:03.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.1HcAUaCYFInIbylE78HHIkuHocrIx0F_0 2024-03-09T15:07:03.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8184476930211206442', time=2024-03-09T16:56:39.082672+0000, chain.objs.size()=1 2024-03-09T15:07:03.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.pyfl83bKqvCbWz0Ck2fWynvmPX9qq52_0 2024-03-09T15:07:03.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.321138325871533574', time=2024-03-09T16:56:39.095465+0000, chain.objs.size()=1 2024-03-09T15:07:03.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.rKXx9aDZD_Q55XwUmaU3qi-JV2x3see_0 2024-03-09T15:07:03.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15555527276651044089', time=2024-03-09T16:56:39.158610+0000, chain.objs.size()=1 2024-03-09T15:07:03.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0FSBHAE6gJf2nhMyuNkFrR4VzsoES9k_0 2024-03-09T15:07:03.839 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15397836548160139110', time=2024-03-09T16:56:39.307865+0000, chain.objs.size()=1 2024-03-09T15:07:03.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kNARdVgZ4KAwZwkXuuDPj68es6GHC7l_0 2024-03-09T15:07:03.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10900174641144753425', time=2024-03-09T16:56:39.311374+0000, chain.objs.size()=1 2024-03-09T15:07:03.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ZFRKukJt4rNtknQKrhSaJdSALrHYpIW_0 2024-03-09T15:07:03.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3092654452702957778', time=2024-03-09T16:56:39.313263+0000, chain.objs.size()=1 2024-03-09T15:07:03.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.uJbgAb0YB84iShcehtHj14t22n4g5D0_0 2024-03-09T15:07:03.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17725765294927790956', time=2024-03-09T16:56:39.372038+0000, chain.objs.size()=1 2024-03-09T15:07:03.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.zebXA-yK32Kojz-6S92sgmmilVKLpMZ_0 2024-03-09T15:07:03.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14472386868128901671', time=2024-03-09T16:56:39.401855+0000, chain.objs.size()=1 2024-03-09T15:07:03.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.5KeX8rPQ8eoKe5Ha_vsOYxF7isykTtV_0 2024-03-09T15:07:03.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4752788772660736146', time=2024-03-09T16:56:39.405546+0000, chain.objs.size()=1 2024-03-09T15:07:03.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Y_OxeFRadiILaMYnjYdDz9TwR4SPVmQ_0 2024-03-09T15:07:03.841 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15439999863381779744', time=2024-03-09T16:56:39.448698+0000, chain.objs.size()=1 2024-03-09T15:07:03.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.16lNNk8lMM7qPc1tYDXoUtrlDIY3hxD_0 2024-03-09T15:07:03.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11162258068217944558', time=2024-03-09T16:56:39.456942+0000, chain.objs.size()=1 2024-03-09T15:07:03.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.d8sFDnPO6bAMaDyDsrW4WLxffjZ4wUy_0 2024-03-09T15:07:03.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10303072680083740087', time=2024-03-09T16:56:39.464811+0000, chain.objs.size()=1 2024-03-09T15:07:03.842 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.cxOaVSVQJdxizgkiACBSmMzPcWiZX1b_0 2024-03-09T15:07:03.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17855689287092285494', time=2024-03-09T16:56:39.597112+0000, chain.objs.size()=1 2024-03-09T15:07:03.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.221tppoHkL0FFn6j2CfPPQALMxrJgb2_0 2024-03-09T15:07:03.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4338584518154390498', time=2024-03-09T16:56:39.610931+0000, chain.objs.size()=1 2024-03-09T15:07:03.843 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.vCwb9FJKMMdfHqfaj-RKkmVM0_RA2rD_0 2024-03-09T15:07:03.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13504597470746296012', time=2024-03-09T16:56:39.682984+0000, chain.objs.size()=1 2024-03-09T15:07:03.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0MTGj42OTRBbpu8FA4tR5enmGmpdMex_0 2024-03-09T15:07:03.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1746914894873819471', time=2024-03-09T16:56:39.690160+0000, chain.objs.size()=1 2024-03-09T15:07:03.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.5Paf5WdHBn2Ccj1mGy3zKePwMojfODI_0 2024-03-09T15:07:03.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8128192156672387157', time=2024-03-09T16:57:01.527550+0000, chain.objs.size()=1 2024-03-09T15:07:03.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.tkj0CXyR0T0JnLDXmi80CZ5K13NUhuK_0 2024-03-09T15:07:03.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4120273034467269545', time=2024-03-09T16:57:01.733318+0000, chain.objs.size()=1 2024-03-09T15:07:03.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.G1zC08QUUm1pn4_XRF2Gw1XIVHOowTm_0 2024-03-09T15:07:03.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8949455311049829160', time=2024-03-09T16:57:01.773442+0000, chain.objs.size()=1 2024-03-09T15:07:03.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.0Ka4MeDERGxMkg4YQ0zmUCfJAgQ_sVw_0 2024-03-09T15:07:03.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6434260779528325590', time=2024-03-09T16:57:01.875287+0000, chain.objs.size()=1 2024-03-09T15:07:03.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.hTATi2XGEWUu8PR0oO9LKAFkLjAuhlu_0 2024-03-09T15:07:03.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9690305536447326377', time=2024-03-09T16:57:01.986072+0000, chain.objs.size()=1 2024-03-09T15:07:03.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xuah8C4Mm-0XC4K5oar-MflCElodlfO_0 2024-03-09T15:07:03.848 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6873871353827983674', time=2024-03-09T16:57:02.026997+0000, chain.objs.size()=1 2024-03-09T15:07:03.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.y8IUWO1ry9x9n4ylaNuI8g22KXBHkaa_0 2024-03-09T15:07:03.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17879737903411649588', time=2024-03-09T16:57:02.047556+0000, chain.objs.size()=1 2024-03-09T15:07:03.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.sBt0vU0un1AimEHEILtr6T1X1z1cWTm_0 2024-03-09T15:07:03.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9803170349804782888', time=2024-03-09T16:57:02.069547+0000, chain.objs.size()=1 2024-03-09T15:07:03.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.O4ct0H1R-hhttk9lTipvshzFgR1U4dx_0 2024-03-09T15:07:03.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14464212109151490024', time=2024-03-09T16:57:02.090372+0000, chain.objs.size()=1 2024-03-09T15:07:03.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.b8AsTWABEMWfld8BzDwpGcX_XAK1lbo_0 2024-03-09T15:07:03.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14631239654212501687', time=2024-03-09T16:57:02.274399+0000, chain.objs.size()=1 2024-03-09T15:07:03.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.1EKvGzVcArBu4s1L10fuoGALCE4Wgei_0 2024-03-09T15:07:03.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9214442495893232280', time=2024-03-09T16:57:02.309066+0000, chain.objs.size()=1 2024-03-09T15:07:03.850 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.fJ0tpYDfaH2hVxJ4swAIzN_HqDtE_sM_0 2024-03-09T15:07:03.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.854+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18320120905706796301', time=2024-03-09T16:57:02.485028+0000, chain.objs.size()=1 2024-03-09T15:07:03.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.854+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.-s13Yvb67lWT5J8JnEVJF9aFbTcVfuG_0 2024-03-09T15:07:03.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.854+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11333017599696410783', time=2024-03-09T16:57:02.539511+0000, chain.objs.size()=1 2024-03-09T15:07:03.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.854+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.p4dbd213_8kxsYty_RVKRLjfIBXirNh_0 2024-03-09T15:07:03.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.854+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6050442821056135998', time=2024-03-09T16:57:02.603866+0000, chain.objs.size()=1 2024-03-09T15:07:03.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.854+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.hqtKQp0hn3g2hJ-tyCrCHVc3iU7Dogg_0 2024-03-09T15:07:03.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.854+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10632878094444055535', time=2024-03-09T16:57:02.617660+0000, chain.objs.size()=1 2024-03-09T15:07:03.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.854+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.jR8nKmM3bWOh2QclZE29ueqteLgkWXo_0 2024-03-09T15:07:03.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.854+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7881890465614216130', time=2024-03-09T16:57:02.761197+0000, chain.objs.size()=1 2024-03-09T15:07:03.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.854+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.m6VI006bANPpm8_72xNK8xQ-Id0lrP2_0 2024-03-09T15:07:03.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/45513 2024-03-09T15:07:03.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-03-09T15:07:03.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4275105497837558889', time=2024-03-09T16:57:02.849614+0000, chain.objs.size()=1 2024-03-09T15:07:03.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ao_p6oWU2iQYUgnLhI4cYo2MVJGJw30_0 2024-03-09T15:07:03.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10499061158555636826', time=2024-03-09T16:57:03.324748+0000, chain.objs.size()=1 2024-03-09T15:07:03.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.yjZPZs6FS4ZHZlwUAwNzdrDYqwtHwH7_0 2024-03-09T15:07:03.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1901144778206965215', time=2024-03-09T16:57:03.330647+0000, chain.objs.size()=1 2024-03-09T15:07:03.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.yJuMLudj_rcgzG3YDXKA3JSQ5mrrCqU_0 2024-03-09T15:07:03.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16086570094385782290', time=2024-03-09T16:57:03.371285+0000, chain.objs.size()=1 2024-03-09T15:07:03.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.MgkCjUGVusJlVYjlsJZLGjaDo1uPucB_0 2024-03-09T15:07:03.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8678879707252252550', time=2024-03-09T16:57:07.717049+0000, chain.objs.size()=1 2024-03-09T15:07:03.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.323__shadow_.OjdmY5HJI0rGR7psB6ewJMg3r1qXqmR_0 2024-03-09T15:07:03.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3818641097314163644', time=2024-03-09T16:57:44.613398+0000, chain.objs.size()=1 2024-03-09T15:07:03.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.366__shadow_.Sxg4aB0VtVTcJtjDe7HO9qEzYtZSueZ_0 2024-03-09T15:07:03.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13682782906319174642', time=2024-03-09T16:58:46.932304+0000, chain.objs.size()=1 2024-03-09T15:07:03.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.429__shadow_.y6-FhJa4P_MY7jlFS6Em0qOyZbDd8Kz_0 2024-03-09T15:07:03.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6127401894992312871', time=2024-03-09T16:59:19.518964+0000, chain.objs.size()=1 2024-03-09T15:07:03.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.459__shadow_.S__ZeUyEihVCwFu0-7gPxnZmuyFmZE5_0 2024-03-09T15:07:03.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4772793765886874518', time=2024-03-09T17:01:28.191741+0000, chain.objs.size()=1 2024-03-09T15:07:03.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.545__shadow_.8Ri8hAC4DzJljpVL_QISCvatXOUvETp_0 2024-03-09T15:07:03.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1707674299851390814', time=2024-03-09T17:01:36.329202+0000, chain.objs.size()=1 2024-03-09T15:07:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.551__shadow_.o3-zBmusd7_Hd8lsSERfcdsigqi0umx_0 2024-03-09T15:07:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.199312197135713306', time=2024-03-09T17:01:39.618158+0000, chain.objs.size()=1 2024-03-09T15:07:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.554__multipart_mymultipart.2~YquEx_CEmqUS45sCJG5vM5OFhreQ02f.1 2024-03-09T15:07:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12951990346821392585', time=2024-03-09T17:02:08.522487+0000, chain.objs.size()=1 2024-03-09T15:07:03.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.567__shadow:DKTr9AfjhAbzHB8fDg9yP47JIHr8OLc_.p-8QdiK0uvV4UrQjq6blPNTmhaZjIcK_0 2024-03-09T15:07:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3097429791478084155', time=2024-03-09T17:02:19.275940+0000, chain.objs.size()=1 2024-03-09T15:07:03.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:vu7vuMDq2X0AIz7auX6pLYMkTMadpQa_.OoPyPAtYexQTaHa61v94EsdwGxZLNHI_0 2024-03-09T15:07:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7778814549884763210', time=2024-03-09T17:02:22.673938+0000, chain.objs.size()=1 2024-03-09T15:07:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:afRLhUWvtv-d1OrwSceqeiUf94f0fC2_.2dIFGi-VSCxek8jBR8rSAkXMqgwkG7j_0 2024-03-09T15:07:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18159553190186343239', time=2024-03-09T17:02:37.589901+0000, chain.objs.size()=1 2024-03-09T15:07:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.572__shadow:zVFE2vIhAgJ71RWHuducBofuk8Cb0QM_.k2ttlN1bVr88yIJrYjy1TN0Re2TNK46_0 2024-03-09T15:07:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.573__shadow:NXIu.VdKj05M0i-97WKic33r1NAgFAg_.R8k3JtSuw9OOrQ4ThdQBWUaWmxKaNJS_1_143bcb55fb48fe5331f0de2e5fb49b6c', time=2024-03-09T17:02:39.448732+0000, chain.objs.size()=1 2024-03-09T15:07:03.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.573__shadow:NXIu.VdKj05M0i-97WKic33r1NAgFAg_.R8k3JtSuw9OOrQ4ThdQBWUaWmxKaNJS_0 2024-03-09T15:07:03.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14618092252708343835', time=2024-03-09T17:04:12.176746+0000, chain.objs.size()=1 2024-03-09T15:07:03.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.655__shadow_._U0CI24b1B0p4XMg1wcdO1taUOmJOWJ_0 2024-03-09T15:07:03.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16653935614524772321', time=2024-03-09T17:04:38.153514+0000, chain.objs.size()=1 2024-03-09T15:07:03.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.687__shadow:wIQeS9ylBZvFurDgnw12.ri0YBjatiY_.JK7Dn5ikFqcxM6YEQnzm_bYz3elunB3_0 2024-03-09T15:07:03.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8139750455086234139', time=2024-03-09T17:05:01.550218+0000, chain.objs.size()=1 2024-03-09T15:07:03.873 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.702__shadow:2aEa3ZvMaPCZGPcZeLym6p5.1cV9RSZ_.6FcptSGCo5Dmcuhiz2LzL9dZeV0X79H_0 2024-03-09T15:07:03.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.878+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:03.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.882+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-09T15:07:03.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:03.885 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:03.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43961' 2024-03-09T15:07:03.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='_6Znv-4hmDvKiFYKceoWt9zVRTetAHvR', time=2024-03-09T16:51:55.250046+0000, chain.objs.size()=1 2024-03-09T15:07:03.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__shadow_.u5F003rLY3m_qSGHRMod21LG6YdyQog_0 2024-03-09T15:07:03.886 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.445568863699386735', time=2024-03-09T16:54:20.716050+0000, chain.objs.size()=1 2024-03-09T15:07:03.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.222__shadow_.XsS3uQts6paLVef4K1iqjxeWG3rtjb9_0 2024-03-09T15:07:03.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.98190427361091267', time=2024-03-09T16:54:30.410453+0000, chain.objs.size()=1 2024-03-09T15:07:03.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.232__shadow_.dIuSd2Z75cFBr-UfDqt9j0zhqqEQAYC_0 2024-03-09T15:07:03.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12997776671402499843', time=2024-03-09T16:55:14.930316+0000, chain.objs.size()=1 2024-03-09T15:07:03.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.zv43PvUNc3jsIL6b9mTJLVnN28FeSuE_0 2024-03-09T15:07:03.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18385519804313730270', time=2024-03-09T16:55:14.986933+0000, chain.objs.size()=1 2024-03-09T15:07:03.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.5tl-2ysH8G1V-5BXWELqDC2najBPVBn_0 2024-03-09T15:07:03.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5165533723299134343', time=2024-03-09T16:55:14.997545+0000, chain.objs.size()=1 2024-03-09T15:07:03.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.7KXP8oSHcGRt6muisvSkeK_Xq9YyeEn_0 2024-03-09T15:07:03.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9988616840894749866', time=2024-03-09T16:55:15.193070+0000, chain.objs.size()=1 2024-03-09T15:07:03.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.XGIjhi6uXtZ4tpTfjWKDozlClezbCyW_0 2024-03-09T15:07:03.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2627835313336685409', time=2024-03-09T16:55:15.205030+0000, chain.objs.size()=1 2024-03-09T15:07:03.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.zeTTZ9GANSESZ-ggcg4UW8yvpXlLgfO_0 2024-03-09T15:07:03.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6484904181046784505', time=2024-03-09T16:55:15.252046+0000, chain.objs.size()=1 2024-03-09T15:07:03.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.4_w-A8kC2UVyQot38R3So1-6pwkvXZ9_0 2024-03-09T15:07:03.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5383512698753598235', time=2024-03-09T16:55:15.276169+0000, chain.objs.size()=1 2024-03-09T15:07:03.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Keg2Mp9lMnWZxRbKSuGxC7rjJi3gdrj_0 2024-03-09T15:07:03.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6155038941618849383', time=2024-03-09T16:55:15.292765+0000, chain.objs.size()=1 2024-03-09T15:07:03.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.D_tILgFHw_rRiAp15zAScNhbjXSUNXZ_0 2024-03-09T15:07:03.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7681760027855850346', time=2024-03-09T16:55:15.403009+0000, chain.objs.size()=1 2024-03-09T15:07:03.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.886+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.nSEH9LGkZ2pzSBllOYB1IWP1yU6luNi_0 2024-03-09T15:07:03.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5289201486146051916', time=2024-03-09T16:55:15.403872+0000, chain.objs.size()=1 2024-03-09T15:07:03.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ZQA95fyrchNE3qadQC-TWrmu2pM4t6d_0 2024-03-09T15:07:03.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9088384068969386616', time=2024-03-09T16:55:15.462972+0000, chain.objs.size()=1 2024-03-09T15:07:03.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.BC-4Aoq-qok5SRTg--ySDdElMo6zxgJ_0 2024-03-09T15:07:03.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.567142405579408790', time=2024-03-09T16:55:15.516036+0000, chain.objs.size()=1 2024-03-09T15:07:03.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.5r1VYKd8tS5i1dQ3FEZ00P9BmhXOKrs_0 2024-03-09T15:07:03.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11447695478966421534', time=2024-03-09T16:55:15.672113+0000, chain.objs.size()=1 2024-03-09T15:07:03.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.izrEqIZefovwbZAG3QyZQr1UCClnZn3_0 2024-03-09T15:07:03.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7504621054221299475', time=2024-03-09T16:55:15.723358+0000, chain.objs.size()=1 2024-03-09T15:07:03.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ZzEOIOlEBOJsdqc5AySF_HH_a8ueU5C_0 2024-03-09T15:07:03.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2054281667561984402', time=2024-03-09T16:55:15.749060+0000, chain.objs.size()=1 2024-03-09T15:07:03.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.bAOR2IVQb_P_j03i1kvdV-kouAiTQXF_0 2024-03-09T15:07:03.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15810068347122757986', time=2024-03-09T16:55:15.799130+0000, chain.objs.size()=1 2024-03-09T15:07:03.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.TSPWGZXAjkAVxuPux3aS_4G7mmbsMvJ_0 2024-03-09T15:07:03.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17638311832957241873', time=2024-03-09T16:55:15.800509+0000, chain.objs.size()=1 2024-03-09T15:07:03.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.r6wB5XZcNqfTVqi2QjO7Hwr8aZKfFaC_0 2024-03-09T15:07:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5038158298772393339', time=2024-03-09T16:55:15.834076+0000, chain.objs.size()=1 2024-03-09T15:07:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.zCdndCxzxnBvEMlCZo-yvxglvX2hFTg_0 2024-03-09T15:07:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14290041649015810902', time=2024-03-09T16:55:16.024945+0000, chain.objs.size()=1 2024-03-09T15:07:03.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.2avMjdFfvj_ktxF_BJAqR4J2ZoPlhVd_0 2024-03-09T15:07:03.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1787872109415957685', time=2024-03-09T16:55:16.025906+0000, chain.objs.size()=1 2024-03-09T15:07:03.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Jyw3vpmkp0PhKuxAVVzMV4fmqnFnuyE_0 2024-03-09T15:07:03.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.894+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9289392239555454338', time=2024-03-09T16:55:16.230845+0000, chain.objs.size()=1 2024-03-09T15:07:03.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.894+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.jrhVUkOmJc4ecO-IdY2t6o5Ef-8wstB_0 2024-03-09T15:07:03.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.894+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16791191035796233629', time=2024-03-09T16:55:16.287992+0000, chain.objs.size()=1 2024-03-09T15:07:03.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.894+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.bzgMzUAjboG8RhzjcV-PhGPHwrXm5SK_0 2024-03-09T15:07:03.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.894+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.835069765505705871', time=2024-03-09T16:55:16.317155+0000, chain.objs.size()=1 2024-03-09T15:07:03.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.894+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.7coddqXn3zTDXPsE7J2kxCLJbw5Kbzk_0 2024-03-09T15:07:03.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.898+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6321150358691559922', time=2024-03-09T16:55:16.334213+0000, chain.objs.size()=1 2024-03-09T15:07:03.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.898+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.A1oUxOD2Bu18z31Sc3aZaZ7VZXNn6QV_0 2024-03-09T15:07:03.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.898+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6085722705830345616', time=2024-03-09T16:55:16.338867+0000, chain.objs.size()=1 2024-03-09T15:07:03.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.898+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.VziykqvoWVnNoBOCetnc50sRCfRo7vc_0 2024-03-09T15:07:03.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.898+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10561339504926627552', time=2024-03-09T16:55:16.341684+0000, chain.objs.size()=1 2024-03-09T15:07:03.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.898+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.b3OIkRSISJvimNPQCWMb2wJnisa7CCd_0 2024-03-09T15:07:03.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.898+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10083014930633139106', time=2024-03-09T16:55:16.539810+0000, chain.objs.size()=1 2024-03-09T15:07:03.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.898+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.dHQbM2m57XNkwJl5ow8uwGfQ3bH87u0_0 2024-03-09T15:07:03.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.898+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18139387488763787806', time=2024-03-09T16:55:16.577250+0000, chain.objs.size()=1 2024-03-09T15:07:03.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.898+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.wnz3utj-bsjzdMaQLTfOJUeOYvvuTzS_0 2024-03-09T15:07:03.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.898+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14260583159077436191', time=2024-03-09T16:55:16.591436+0000, chain.objs.size()=1 2024-03-09T15:07:03.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.898+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.hcW1RXAeT2KHdg15VNxfBeKevg7iEeA_0 2024-03-09T15:07:03.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.898+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2260896429251058899', time=2024-03-09T16:55:16.621780+0000, chain.objs.size()=1 2024-03-09T15:07:03.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.898+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.wZYPzaYFD4fI-OcI_sEBGKtZgN-fYpd_0 2024-03-09T15:07:03.898 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.898+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7249494615928555967', time=2024-03-09T16:55:16.629641+0000, chain.objs.size()=1 2024-03-09T15:07:03.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.898+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.szT62d8ctXcW1vs11DHr7eKZRSJTY9s_0 2024-03-09T15:07:03.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9605166871657718607', time=2024-03-09T16:55:16.722694+0000, chain.objs.size()=1 2024-03-09T15:07:03.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.w-G5x_Jmk4AzFNvguuh7w1wa5H1-S1j_0 2024-03-09T15:07:03.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4452642263718554827', time=2024-03-09T16:55:16.774779+0000, chain.objs.size()=1 2024-03-09T15:07:03.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.iwPgoUGZ_mcvkQT3DEfdsHVQWBUIDTK_0 2024-03-09T15:07:03.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.259778351626817357', time=2024-03-09T16:55:21.347042+0000, chain.objs.size()=1 2024-03-09T15:07:03.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.261__shadow_.-p9Llpj7kHKDFkU4UwRFiYxY47XPJgm_0 2024-03-09T15:07:03.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9581449760688300023', time=2024-03-09T16:55:28.723035+0000, chain.objs.size()=1 2024-03-09T15:07:03.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.269__shadow_.RBSe88Yd_XiBj0c1O9E60WSp0dKYFS3_0 2024-03-09T15:07:03.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6525516556408664532', time=2024-03-09T16:55:33.412825+0000, chain.objs.size()=1 2024-03-09T15:07:03.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.274__shadow_.MeZe7wEkSTubs6TQyxE4fprhFJ7NLJP_0 2024-03-09T15:07:03.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17285865761557162198', time=2024-03-09T16:55:38.301591+0000, chain.objs.size()=1 2024-03-09T15:07:03.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.279__shadow_.ZzZMMQ7RUncmJuDOx9Wq6W_nFxIVkm5_0 2024-03-09T15:07:03.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6600376450799416716', time=2024-03-09T16:55:41.221591+0000, chain.objs.size()=1 2024-03-09T15:07:03.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.282__shadow_.Auwgav5Q6WFDVfXhFcE4YIKHBSKUgt9_0 2024-03-09T15:07:03.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4595022170831309417', time=2024-03-09T16:55:42.123085+0000, chain.objs.size()=1 2024-03-09T15:07:03.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.283__shadow_.EQWEoBFX6Di9TbLU4HdGd6VToThuYmY_0 2024-03-09T15:07:03.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16336501731229899937', time=2024-03-09T16:55:43.102039+0000, chain.objs.size()=1 2024-03-09T15:07:03.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.284__shadow_.KJmjU8UhSThhiK96lDD_XN2wrshtThK_0 2024-03-09T15:07:03.904 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1248931828699818268', time=2024-03-09T16:55:47.856318+0000, chain.objs.size()=1 2024-03-09T15:07:03.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.JHEQYKrlZy12Ct-lFxpQEcWyO-GX0_x_0 2024-03-09T15:07:03.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1269761333249931878', time=2024-03-09T16:55:52.657015+0000, chain.objs.size()=1 2024-03-09T15:07:03.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.292__shadow_.JFQW3FPINtsXGsx1IXcf8MoXp0BJNi3_0 2024-03-09T15:07:03.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14155165988961477804', time=2024-03-09T16:55:56.387211+0000, chain.objs.size()=1 2024-03-09T15:07:03.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.296__shadow_.vHA2hiEr6AmqcC6qT5fscHo2IVDvsTj_0 2024-03-09T15:07:03.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6142395717386077765', time=2024-03-09T16:56:37.799581+0000, chain.objs.size()=1 2024-03-09T15:07:03.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6rFieHDC1xRfnG2vmVLK5q4JrdCxBZH_0 2024-03-09T15:07:03.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12739443368535606116', time=2024-03-09T16:56:37.832125+0000, chain.objs.size()=1 2024-03-09T15:07:03.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.LTpBBeSL-XfkQ87Pj6hxMHqU5VpRDrG_0 2024-03-09T15:07:03.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2066464212145062107', time=2024-03-09T16:56:37.852230+0000, chain.objs.size()=1 2024-03-09T15:07:03.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.nCRADOYpRHxQBlN3WHpLpsZFHlFJr_J_0 2024-03-09T15:07:03.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2805446494403395509', time=2024-03-09T16:56:37.854386+0000, chain.objs.size()=1 2024-03-09T15:07:03.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.x-tx9bvjJ7r0cwTKkJKQazrJX1b4f8a_0 2024-03-09T15:07:03.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5066553818936458080', time=2024-03-09T16:56:38.026181+0000, chain.objs.size()=1 2024-03-09T15:07:03.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ZfgKsDuxRCPVHxDIH3mO5xKFOjANOgE_0 2024-03-09T15:07:03.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9372403343433650571', time=2024-03-09T16:56:38.093328+0000, chain.objs.size()=1 2024-03-09T15:07:03.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.aydxCJjPEkeC8pzhsr6qisT2ncAbCda_0 2024-03-09T15:07:03.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1634894525939559750', time=2024-03-09T16:56:38.512650+0000, chain.objs.size()=1 2024-03-09T15:07:03.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.wTnTp9aeftKYN0JWzSOTWQnGiullGZP_0 2024-03-09T15:07:03.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9432142618413874123', time=2024-03-09T16:56:38.515000+0000, chain.objs.size()=1 2024-03-09T15:07:03.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.dHtb8vBsETc4L9JT6w88uLxVcaL1_cR_0 2024-03-09T15:07:03.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4481086497782912226', time=2024-03-09T16:56:38.575833+0000, chain.objs.size()=1 2024-03-09T15:07:03.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.FdAJqr-QH1R425W7jiw5448Dcj45Rc3_0 2024-03-09T15:07:03.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5108132324687203689', time=2024-03-09T16:56:38.579890+0000, chain.objs.size()=1 2024-03-09T15:07:03.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lmmwAb44SMygfXc8JF3s9IsDtA9TC4m_0 2024-03-09T15:07:03.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2382149312805923547', time=2024-03-09T16:56:38.616060+0000, chain.objs.size()=1 2024-03-09T15:07:03.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.V5LsvEsl_LPKSMKJWDdmpr9u0vqdBaH_0 2024-03-09T15:07:03.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11844406886276682657', time=2024-03-09T16:56:38.624139+0000, chain.objs.size()=1 2024-03-09T15:07:03.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.T5irOGU3MQUW_dwpg78NGfJbVEflkxN_0 2024-03-09T15:07:03.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8155836908530549033', time=2024-03-09T16:56:38.781713+0000, chain.objs.size()=1 2024-03-09T15:07:03.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Hk-CjZvwiFtmF-o7EoCE4H3UWJy_qpm_0 2024-03-09T15:07:03.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12933762524037753364', time=2024-03-09T16:56:38.808427+0000, chain.objs.size()=1 2024-03-09T15:07:03.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.BA3NNrtopTyY_Z9GKpRCa-As-Z4R5gX_0 2024-03-09T15:07:03.915 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.671978932375350972', time=2024-03-09T16:56:38.856384+0000, chain.objs.size()=1 2024-03-09T15:07:03.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.QNP2mcs6xqBwnDIOzClj96nNt3_gJU4_0 2024-03-09T15:07:03.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11778498894769808731', time=2024-03-09T16:56:38.884177+0000, chain.objs.size()=1 2024-03-09T15:07:03.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lCPdXyTzSrVLJ50-IGetQRu9AwFDLPy_0 2024-03-09T15:07:03.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1364880946633071835', time=2024-03-09T16:56:38.918468+0000, chain.objs.size()=1 2024-03-09T15:07:03.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.eLyCIfhmFnDuYoqK5YnRhAB-zbq9deq_0 2024-03-09T15:07:03.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.918+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3663671249749894078', time=2024-03-09T16:56:38.920070+0000, chain.objs.size()=1 2024-03-09T15:07:03.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.918+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.cCpy2jO20D-1wMzt_4ScgZ6YSoLMQ9p_0 2024-03-09T15:07:03.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.918+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12340038682122048795', time=2024-03-09T16:56:38.920776+0000, chain.objs.size()=1 2024-03-09T15:07:03.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.918+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.RhUYg1p14PoYXVVYqzOwVPMFuCGLnK7_0 2024-03-09T15:07:03.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.918+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12438646957236298890', time=2024-03-09T16:56:38.927171+0000, chain.objs.size()=1 2024-03-09T15:07:03.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.918+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.38yzQO96Hl8ERvikvI6vtVLGew2KDc__0 2024-03-09T15:07:03.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.918+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17139220276441845265', time=2024-03-09T16:56:39.151684+0000, chain.objs.size()=1 2024-03-09T15:07:03.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.918+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.cc90iUSrq2I8KDZozN6NytQntVWMY-P_0 2024-03-09T15:07:03.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.918+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13254062229507318684', time=2024-03-09T16:56:39.164832+0000, chain.objs.size()=1 2024-03-09T15:07:03.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.918+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.e0CgE8MPCxF2ISpLbA7mLkr8w18RdOt_0 2024-03-09T15:07:03.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.918+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14021861826788741882', time=2024-03-09T16:56:39.176269+0000, chain.objs.size()=1 2024-03-09T15:07:03.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.918+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0-yBOQ0kq_iXnyPp13kD-sbM4qhWW4H_0 2024-03-09T15:07:03.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.918+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15569869946842402623', time=2024-03-09T16:56:39.387380+0000, chain.objs.size()=1 2024-03-09T15:07:03.920 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.918+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.NI_3P8g7B1g8Wp9_uvnTsaL8z7qH55N_0 2024-03-09T15:07:03.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14555065057896855226', time=2024-03-09T16:56:39.390167+0000, chain.objs.size()=1 2024-03-09T15:07:03.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_._dAehIfJawqDUnRPFJmW65ITGUE0-Pc_0 2024-03-09T15:07:03.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5486148595935198749', time=2024-03-09T16:56:39.391026+0000, chain.objs.size()=1 2024-03-09T15:07:03.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.KQXloRn9dR1MFFSGeFWto47eywUB9vR_0 2024-03-09T15:07:03.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4123261728027881329', time=2024-03-09T16:56:39.558474+0000, chain.objs.size()=1 2024-03-09T15:07:03.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.rIe2eIXzi7pJl9BkdgAOxh5uUcLYtsA_0 2024-03-09T15:07:03.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.859303230074062393', time=2024-03-09T16:56:39.562239+0000, chain.objs.size()=1 2024-03-09T15:07:03.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.TqNAuayqmZPx_0GjCSNr0j9G9tHanvG_0 2024-03-09T15:07:03.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13660173843306058145', time=2024-03-09T16:56:39.603140+0000, chain.objs.size()=1 2024-03-09T15:07:03.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.7Z9u1koQBQ5ZvY17mg2umugI4_BURKw_0 2024-03-09T15:07:03.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15738858239274637689', time=2024-03-09T16:57:01.413570+0000, chain.objs.size()=1 2024-03-09T15:07:03.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.uZHZwOyJqdwzXfA_3E4KSgnqYjRH0w8_0 2024-03-09T15:07:03.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18444840849285731166', time=2024-03-09T16:57:01.420152+0000, chain.objs.size()=1 2024-03-09T15:07:03.925 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.E_CY3nohHicIel4yhYj2g-HwZrBzqRJ_0 2024-03-09T15:07:03.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11830330525469000200', time=2024-03-09T16:57:01.490049+0000, chain.objs.size()=1 2024-03-09T15:07:03.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.s0WpNWOmLmwDgZW3kn1c1yg70C2MkWO_0 2024-03-09T15:07:03.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9831602841336646477', time=2024-03-09T16:57:01.497995+0000, chain.objs.size()=1 2024-03-09T15:07:03.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.AfMds8N6Gsj5yBqOZRURQ94YVboA-qP_0 2024-03-09T15:07:03.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2847796889126999238', time=2024-03-09T16:57:01.515777+0000, chain.objs.size()=1 2024-03-09T15:07:03.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.lk7UBIZ-joEvMjn2NXbR1PFFAxMhOEK_0 2024-03-09T15:07:03.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5510397659946862669', time=2024-03-09T16:57:01.572293+0000, chain.objs.size()=1 2024-03-09T15:07:03.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.bpqn50g1L5U28oEnp-8FiGxoZfsXRsf_0 2024-03-09T15:07:03.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13515766794550574751', time=2024-03-09T16:57:01.579361+0000, chain.objs.size()=1 2024-03-09T15:07:03.927 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.2qsODq5_3U3y_lbZBK24XH-Gnvl9uyg_0 2024-03-09T15:07:03.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11530592752435589243', time=2024-03-09T16:57:01.748510+0000, chain.objs.size()=1 2024-03-09T15:07:03.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.QJ69404-DZ9vrp3A6x8EHXa9lvviR_6_0 2024-03-09T15:07:03.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.930+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15613284348583018315', time=2024-03-09T16:57:01.757799+0000, chain.objs.size()=1 2024-03-09T15:07:03.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.930+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.e6xRfvjUbJTevAaLZsB_7SD0jQnVWPk_0 2024-03-09T15:07:03.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.930+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9199626836579566431', time=2024-03-09T16:57:01.851460+0000, chain.objs.size()=1 2024-03-09T15:07:03.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.930+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.FTH5pqRVAqurB1zPHoYlrCPfIgM3RwA_0 2024-03-09T15:07:03.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11767953437027180534', time=2024-03-09T16:57:01.860428+0000, chain.objs.size()=1 2024-03-09T15:07:03.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.r_RThIStYwg_Vkk1gJCMMgJQ3jg9N_I_0 2024-03-09T15:07:03.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17555140349450214694', time=2024-03-09T16:57:02.021307+0000, chain.objs.size()=1 2024-03-09T15:07:03.932 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.y6h1EPvCgzhCRXYzKrk4F583shGgcGV_0 2024-03-09T15:07:03.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4832855891790234796', time=2024-03-09T16:57:02.033678+0000, chain.objs.size()=1 2024-03-09T15:07:03.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.lgUruwCNbRRcFb95YFFgR5O74ZCBVm1_0 2024-03-09T15:07:03.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17061282298784108366', time=2024-03-09T16:57:02.055468+0000, chain.objs.size()=1 2024-03-09T15:07:03.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.uc4RBCGKl8T2-pIPLSnm88aXbaydzng_0 2024-03-09T15:07:03.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10743614202272342254', time=2024-03-09T16:57:02.072508+0000, chain.objs.size()=1 2024-03-09T15:07:03.933 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Pcr6UMGvd1hRzY2t8fbrL-AiH-rMIlg_0 2024-03-09T15:07:03.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16811048530101241343', time=2024-03-09T16:57:02.094473+0000, chain.objs.size()=1 2024-03-09T15:07:03.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.EQC261aHlhOCuqVKrFzrtdLY2i9ObTC_0 2024-03-09T15:07:03.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8085643509001946568', time=2024-03-09T16:57:02.112684+0000, chain.objs.size()=1 2024-03-09T15:07:03.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.m5lX9teRACZckQwTZJYME8DqQ_B4zRU_0 2024-03-09T15:07:03.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9411620131266057270', time=2024-03-09T16:57:02.267522+0000, chain.objs.size()=1 2024-03-09T15:07:03.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.WXXg9IFsD0VPcALx4IU9GGOaLahdgbk_0 2024-03-09T15:07:03.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7192684995426490323', time=2024-03-09T16:57:02.320201+0000, chain.objs.size()=1 2024-03-09T15:07:03.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.FUM7k4sGs2UpoOtgqUyJLkyJNruWSuY_0 2024-03-09T15:07:03.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9520889728214893077', time=2024-03-09T16:57:02.482228+0000, chain.objs.size()=1 2024-03-09T15:07:03.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.W_8dvRlsSMZH8FoVAyxJPcDqO3EcTyJ_0 2024-03-09T15:07:03.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3457714162222084896', time=2024-03-09T16:57:02.546862+0000, chain.objs.size()=1 2024-03-09T15:07:03.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.76ZjoTgztCzn7oyPPNOms-5PHUrRkEF_0 2024-03-09T15:07:03.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.942+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7547030743579910987', time=2024-03-09T16:57:02.586798+0000, chain.objs.size()=1 2024-03-09T15:07:03.940 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.942+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.9IC44x_GldMbguyxwfv1JmTUd2Oh2QJ_0 2024-03-09T15:07:03.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.942+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12491968001907272516', time=2024-03-09T16:57:02.637573+0000, chain.objs.size()=1 2024-03-09T15:07:03.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.942+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Xh9iIJFc3Pzr8FE2x-kP0HTZZR753Mi_0 2024-03-09T15:07:03.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.942+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3244605679140302552', time=2024-03-09T16:57:02.727264+0000, chain.objs.size()=1 2024-03-09T15:07:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.942+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.O9aroUmS_yh5ZUi0Fj_W9TCDe3n8CTJ_0 2024-03-09T15:07:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.942+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.397223648445848372', time=2024-03-09T16:57:02.728397+0000, chain.objs.size()=1 2024-03-09T15:07:03.943 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.942+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.45SPfvu3B0RXsS2eR2MBhuX76Opw-Z1_0 2024-03-09T15:07:03.944 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/43961 2024-03-09T15:07:03.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-03-09T15:07:03.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3676583998174536720', time=2024-03-09T16:57:02.765813+0000, chain.objs.size()=1 2024-03-09T15:07:03.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Nz0KydVQqEkd0_Wd0Jg2EHSD5cXsoBv_0 2024-03-09T15:07:03.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12649133138252257139', time=2024-03-09T16:57:03.014194+0000, chain.objs.size()=1 2024-03-09T15:07:03.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DVSfFotWqBj5ijTaExavE8ZRgx1IQ_X_0 2024-03-09T15:07:03.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3276882920190940892', time=2024-03-09T16:57:03.049727+0000, chain.objs.size()=1 2024-03-09T15:07:03.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.bCkS0EdbR3U42DYEgUIMxtk-9BgMaBE_0 2024-03-09T15:07:03.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2126862986661952830', time=2024-03-09T16:57:03.071107+0000, chain.objs.size()=1 2024-03-09T15:07:03.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ZT5i-_geoG9DowbSo5ybBs_35Kil09p_0 2024-03-09T15:07:03.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10737200636334059438', time=2024-03-09T16:57:03.083221+0000, chain.objs.size()=1 2024-03-09T15:07:03.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Avtjp8pkUfnO2ZKnoOrOV69Bgsll4F9_0 2024-03-09T15:07:03.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9166615378009016497', time=2024-03-09T16:57:03.111912+0000, chain.objs.size()=1 2024-03-09T15:07:03.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.pJ2qoCF0xSC-f6dYHbDO2Tn1wZmK08L_0 2024-03-09T15:07:03.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16090772881622582560', time=2024-03-09T16:57:03.269902+0000, chain.objs.size()=1 2024-03-09T15:07:03.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.BsSYlhToW2LNrUq7aEzm0Dlgc9Ep0kV_0 2024-03-09T15:07:03.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9722513975878451503', time=2024-03-09T16:57:03.336026+0000, chain.objs.size()=1 2024-03-09T15:07:03.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oGGZtqXrlFQHggRh1vI_sC-fZDsa9fx_0 2024-03-09T15:07:03.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.537632049210110029', time=2024-03-09T16:57:03.341718+0000, chain.objs.size()=1 2024-03-09T15:07:03.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.1n37778QaGdGbv_zk7OJPJZOGamFZsL_0 2024-03-09T15:07:03.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12818655621422209567', time=2024-03-09T16:57:03.365470+0000, chain.objs.size()=1 2024-03-09T15:07:03.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.mzrbHdrVavLJmMOdbMB1qfS__1qKKRY_0 2024-03-09T15:07:03.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9111632943234983568', time=2024-03-09T16:57:03.384031+0000, chain.objs.size()=1 2024-03-09T15:07:03.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.6IzsBfqdn57IzWC_sXx3l3w7r14bXFx_0 2024-03-09T15:07:03.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10968703425024599375', time=2024-03-09T16:57:03.564370+0000, chain.objs.size()=1 2024-03-09T15:07:03.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_._XrdC6H_WDit8ahCq_ysOp_IUaHIjF5_0 2024-03-09T15:07:03.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13735175036784116370', time=2024-03-09T16:57:13.197342+0000, chain.objs.size()=1 2024-03-09T15:07:03.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.329__shadow_.IhQrifFZCRiWCajTPZZ4KP_jMB66VfA_0 2024-03-09T15:07:03.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18084061709469828784', time=2024-03-09T16:59:12.115560+0000, chain.objs.size()=1 2024-03-09T15:07:03.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.453__shadow_.GOoKbt9CqntyTH4H0PulZW5VKFGAio7_0 2024-03-09T15:07:03.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.2_a06b7b4a21a784749036f47a0b7c080b', time=2024-03-09T16:59:52.998224+0000, chain.objs.size()=6 2024-03-09T15:07:03.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.1 2024-03-09T15:07:03.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.2 2024-03-09T15:07:03.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.3 2024-03-09T15:07:03.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.4 2024-03-09T15:07:03.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.5 2024-03-09T15:07:03.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.954+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.6 2024-03-09T15:07:03.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.954+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.832859729839380063', time=2024-03-09T17:00:02.743122+0000, chain.objs.size()=1 2024-03-09T15:07:03.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.954+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.511__shadow_.LSnu24lwdwaclqx2lLu-xy5Sj4KV88V_0 2024-03-09T15:07:03.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.954+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12785985716356224730', time=2024-03-09T17:00:27.984918+0000, chain.objs.size()=6 2024-03-09T15:07:03.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.954+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.74gNb_rQSifVQVi39Pp-bR4KnjAWT7xS.1 2024-03-09T15:07:03.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.954+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.gY2f7cAMEaRig-bQs8wk0mvQJY0q2AZW.2 2024-03-09T15:07:03.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.eaLUdc8ZZk2ZA-zccv0JF0j4IRO0hc_8.3 2024-03-09T15:07:03.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.H9WKCcJSUW5uA_OAh8pfCS_KiPMDwhXk.4 2024-03-09T15:07:03.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.4nb2rjzBPrA9Y9-QwbwOaJ8fRf6ljICk.5 2024-03-09T15:07:03.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.xX3sp-tBWf03Eece1eQyfc4uSkUZocBb.6 2024-03-09T15:07:03.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16215934928972292888', time=2024-03-09T17:00:29.322827+0000, chain.objs.size()=2 2024-03-09T15:07:03.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.517__multipart_mymultipart.2~UrL7jogwOr173YE9JWl1ljN8Xetd26p.1 2024-03-09T15:07:03.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.517__multipart_mymultipart.2~UrL7jogwOr173YE9JWl1ljN8Xetd26p.2 2024-03-09T15:07:03.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.122635416429084189', time=2024-03-09T17:02:37.525960+0000, chain.objs.size()=1 2024-03-09T15:07:03.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.572__shadow:HC9GJ5MVnwZ9JvX5qxVuLfmx6oTCdmQ_.d3asIMebKLW_TFn6L7_W9fmywGV6ADL_0 2024-03-09T15:07:03.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.573__shadow:MfJmlB2qzbbM5BVYhjWeizee4Czmi8m_.9OZvTSdS9Hkz2yUS1Dt2DaHzpXpaSrB_1_4ab68abed8f8378546db63f6a0e5f628', time=2024-03-09T17:02:39.631413+0000, chain.objs.size()=1 2024-03-09T15:07:03.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.573__shadow:MfJmlB2qzbbM5BVYhjWeizee4Czmi8m_.9OZvTSdS9Hkz2yUS1Dt2DaHzpXpaSrB_0 2024-03-09T15:07:03.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.716734641424006770', time=2024-03-09T17:03:37.937532+0000, chain.objs.size()=1 2024-03-09T15:07:03.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.621__shadow_.cwryIszMx37u-4EJtdHn8aDEeSxkV7J_0 2024-03-09T15:07:03.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13442735230505613537', time=2024-03-09T17:04:07.334532+0000, chain.objs.size()=6 2024-03-09T15:07:03.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.650__multipart_baz.2~c93AQfChEHulcHNPF6Va3haSshxzOwe.1 2024-03-09T15:07:03.959 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.650__multipart_baz.2~c93AQfChEHulcHNPF6Va3haSshxzOwe.2 2024-03-09T15:07:03.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.962+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.650__multipart_baz.2~c93AQfChEHulcHNPF6Va3haSshxzOwe.3 2024-03-09T15:07:03.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.962+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.650__multipart_baz.2~c93AQfChEHulcHNPF6Va3haSshxzOwe.4 2024-03-09T15:07:03.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.962+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.650__multipart_baz.2~c93AQfChEHulcHNPF6Va3haSshxzOwe.5 2024-03-09T15:07:03.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.962+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.650__multipart_baz.2~c93AQfChEHulcHNPF6Va3haSshxzOwe.6 2024-03-09T15:07:03.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.962+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.508868123195799073', time=2024-03-09T17:04:22.097368+0000, chain.objs.size()=1 2024-03-09T15:07:03.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.962+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.668__shadow_.LcFWUq0HboRlWvLhFheIWj2lhuVccn5_0 2024-03-09T15:07:03.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.962+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15597184922088466848', time=2024-03-09T17:04:40.001170+0000, chain.objs.size()=1 2024-03-09T15:07:03.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.962+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.689__shadow:ZpFcK6GSW-m4fr.q0TcQYrPk51dSQ-I_.KCL58-nA-o6K1hqdpXcNPIPn8hheN5H_0 2024-03-09T15:07:03.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.962+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9947844927724216469', time=2024-03-09T17:04:42.821872+0000, chain.objs.size()=1 2024-03-09T15:07:03.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.962+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.692__shadow:fFMeC6hq5XHFRblYS6TpaW-NWXiXdec_._CRyLG1k9k4ZVVILHa1cUlsPhGn5f8v_0 2024-03-09T15:07:03.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.962+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4201663943743579568', time=2024-03-09T17:04:46.499141+0000, chain.objs.size()=1 2024-03-09T15:07:03.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.962+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.696__shadow:UyPa2D8WhYXkA9H8pTm.us0V9A.0pIi_.XjhrFdas0OyZJTVzXg1dJWo579NOo3C_0 2024-03-09T15:07:03.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.962+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4771482639550217680', time=2024-03-09T17:06:29.539250+0000, chain.objs.size()=1 2024-03-09T15:07:03.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.962+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.751__shadow_.IEz_qSBDyg7StzRwWzAiyF9s0Z1IuoT_0 2024-03-09T15:07:03.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.962+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13589061685101099631', time=2024-03-09T17:06:30.852470+0000, chain.objs.size()=1 2024-03-09T15:07:03.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.962+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.752__shadow_.coUHvadzPYS-Q1I5YHdi5hhpK2Razy2_0 2024-03-09T15:07:03.969 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.970+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:03.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.974+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-09T15:07:03.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.974+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:03.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:03.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/40260' 2024-03-09T15:07:03.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='_E7XTC6mwTH6krOazg8foT-yqMmEZtnr', time=2024-03-09T16:51:52.457409+0000, chain.objs.size()=2 2024-03-09T15:07:03.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.154__shadow_.j3rKa6ZQUhYvcxnJ9MD32AATmKM-ORQ_0 2024-03-09T15:07:03.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.154__shadow_.j3rKa6ZQUhYvcxnJ9MD32AATmKM-ORQ_1 2024-03-09T15:07:03.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12879949463390475649', time=2024-03-09T16:52:14.520328+0000, chain.objs.size()=1 2024-03-09T15:07:03.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.176__shadow_.5huKOnZ0-uVu9GWon6Qk69BQMnGaKBS_0 2024-03-09T15:07:03.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6558972989958112396', time=2024-03-09T16:52:20.705154+0000, chain.objs.size()=1 2024-03-09T15:07:03.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.183__shadow_.6jwsA0luSMcHALxPMz9aFqmiLz_mGtu_0 2024-03-09T15:07:03.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.388578509559196611', time=2024-03-09T16:54:24.675751+0000, chain.objs.size()=1 2024-03-09T15:07:03.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.227__shadow_.twEF9Jzu5xffVi0z1AiAwZJN3EOVsAA_0 2024-03-09T15:07:03.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4474510546450358556', time=2024-03-09T16:54:50.947965+0000, chain.objs.size()=1 2024-03-09T15:07:03.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.253__shadow_.WybmqZPi5Hbb47tpKFMMmYkwk3yKFrf_0 2024-03-09T15:07:03.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1176334630981517164', time=2024-03-09T16:55:14.854829+0000, chain.objs.size()=1 2024-03-09T15:07:03.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.nRzl0k4BPeJD-EdZOOsn7JVqNiTgkKR_0 2024-03-09T15:07:03.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14111715818453316944', time=2024-03-09T16:55:14.923619+0000, chain.objs.size()=1 2024-03-09T15:07:03.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.VcDwnEvj8DTswZu8uyZijZjmyp0gL8h_0 2024-03-09T15:07:03.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7122225350939208565', time=2024-03-09T16:55:15.020131+0000, chain.objs.size()=1 2024-03-09T15:07:03.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.kaBbb438kE1XWwMO5FC_zRvbu3rL3BT_0 2024-03-09T15:07:03.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.224743932596920610', time=2024-03-09T16:55:15.180220+0000, chain.objs.size()=1 2024-03-09T15:07:03.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.RON7WPYRyxIbOBaQi7A0DjALXprhYdl_0 2024-03-09T15:07:03.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7372236224107540553', time=2024-03-09T16:55:15.194155+0000, chain.objs.size()=1 2024-03-09T15:07:03.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.x50xyMY7ZS2w5H1nmcR34bNTwOCaeHh_0 2024-03-09T15:07:03.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8512120657730394924', time=2024-03-09T16:55:15.217328+0000, chain.objs.size()=1 2024-03-09T15:07:03.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.zNQJG87OxsfaXclvstYRUhHPBsUiyep_0 2024-03-09T15:07:03.982 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10995332892356026952', time=2024-03-09T16:55:15.256930+0000, chain.objs.size()=1 2024-03-09T15:07:03.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.zk6H7VL9uiWFTQPDGraCX0LEeGdF5L9_0 2024-03-09T15:07:03.983 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13542607107771495580', time=2024-03-09T16:55:15.294089+0000, chain.objs.size()=1 2024-03-09T15:07:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.xW1-ZyrtmsDlIqFNEOkzaNgeUMyPeQM_0 2024-03-09T15:07:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18092079937139204455', time=2024-03-09T16:55:15.297415+0000, chain.objs.size()=1 2024-03-09T15:07:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.cxKVfSd7C3UEuma4-wBBBd-s8QBfHa9_0 2024-03-09T15:07:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14435921221651996802', time=2024-03-09T16:55:15.427027+0000, chain.objs.size()=1 2024-03-09T15:07:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.iRZOqveZe8iEMGf-Nv6NA6Z_em8qk-y_0 2024-03-09T15:07:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.682778656319148434', time=2024-03-09T16:55:15.512032+0000, chain.objs.size()=1 2024-03-09T15:07:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.aWfTtjaNzegFdBckfDLHrtI4SVZitfS_0 2024-03-09T15:07:03.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12648878311553503253', time=2024-03-09T16:55:15.512820+0000, chain.objs.size()=1 2024-03-09T15:07:03.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.DMZvrl7SIPxwQFSeWJfvYE5JuGfTCDa_0 2024-03-09T15:07:03.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13740250600417589859', time=2024-03-09T16:55:15.526813+0000, chain.objs.size()=1 2024-03-09T15:07:03.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.jWdRYsUpvXonhmTJKvhSOkxOSGMEz6-_0 2024-03-09T15:07:03.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.414288698519141707', time=2024-03-09T16:55:15.552970+0000, chain.objs.size()=1 2024-03-09T15:07:03.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.eZvqDE6CxTN4u1D8VG7NgSN3OO3VVfa_0 2024-03-09T15:07:03.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11228136065585974627', time=2024-03-09T16:55:15.672071+0000, chain.objs.size()=1 2024-03-09T15:07:03.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.eIsHAuWKSygpZVsRN1wMl1LugkOJnOU_0 2024-03-09T15:07:03.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16331464442497000267', time=2024-03-09T16:55:15.713263+0000, chain.objs.size()=1 2024-03-09T15:07:03.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.E-nV137uW3_4QCpioJL8G4QBF37FKak_0 2024-03-09T15:07:03.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17612909020032152379', time=2024-03-09T16:55:15.759481+0000, chain.objs.size()=1 2024-03-09T15:07:03.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.982+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.R2y6Hu0BAnLZaNsba9TgTWFTMlBrsOZ_0 2024-03-09T15:07:03.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.182202695950543324', time=2024-03-09T16:55:15.828195+0000, chain.objs.size()=1 2024-03-09T15:07:03.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.y1XueNRdYvxzK3IaGuEZR50RKQx2Xrz_0 2024-03-09T15:07:03.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8204215261863577639', time=2024-03-09T16:55:16.026871+0000, chain.objs.size()=1 2024-03-09T15:07:03.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.R13UiHPVwBRpDY9w6nduFGTXjsvs9q4_0 2024-03-09T15:07:03.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6057576196933808037', time=2024-03-09T16:55:16.266363+0000, chain.objs.size()=1 2024-03-09T15:07:03.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.fApEY3_FCwh0Pn6lkue5iTB3UwBKP7__0 2024-03-09T15:07:03.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16834301048675123842', time=2024-03-09T16:55:16.332305+0000, chain.objs.size()=1 2024-03-09T15:07:03.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.rvPbutJmzwAqDWoxmZHzHyb2wmD6R5l_0 2024-03-09T15:07:03.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1879984217134500772', time=2024-03-09T16:55:16.348017+0000, chain.objs.size()=1 2024-03-09T15:07:03.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.9VvEEtdn4fk4VsdK97MPemlwvMx6NYo_0 2024-03-09T15:07:03.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7417586150826559163', time=2024-03-09T16:55:16.472118+0000, chain.objs.size()=1 2024-03-09T15:07:03.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Wnz_lfN01p8QgZ1ND909c7cUnm8v9M0_0 2024-03-09T15:07:03.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5902220512258115255', time=2024-03-09T16:55:16.563453+0000, chain.objs.size()=1 2024-03-09T15:07:03.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.0e_bxSrfrvwcHmkcYDPIMafbZwqtG5I_0 2024-03-09T15:07:03.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9882127821090125160', time=2024-03-09T16:55:16.570940+0000, chain.objs.size()=1 2024-03-09T15:07:03.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.zn3TlXE1DJf2sSHL7GbeoLNh5894MKZ_0 2024-03-09T15:07:03.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3265719493422906091', time=2024-03-09T16:55:16.621944+0000, chain.objs.size()=1 2024-03-09T15:07:03.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.JYSQwvRCiiANr7YrUztawcUva84SnWH_0 2024-03-09T15:07:03.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14397059044126926246', time=2024-03-09T16:55:16.751352+0000, chain.objs.size()=1 2024-03-09T15:07:03.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.EzlNbWI_RCEcOaGffrpkHVeMUB0C_lE_0 2024-03-09T15:07:03.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9989759832978439975', time=2024-03-09T16:55:16.771344+0000, chain.objs.size()=1 2024-03-09T15:07:03.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.PJCIBYbWnY0NlvYFZlzMN5lqSWeq_gj_0 2024-03-09T15:07:03.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4799279050037870869', time=2024-03-09T16:55:18.575842+0000, chain.objs.size()=1 2024-03-09T15:07:03.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.258__shadow_.SHoSN2qR-FoNIlgqEHWciTzjlNjjoV5_0 2024-03-09T15:07:03.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9750653780278558010', time=2024-03-09T16:55:23.191007+0000, chain.objs.size()=1 2024-03-09T15:07:03.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.263__shadow_.c3awg184phmfTCDf5-ElmBYkuqnTeth_0 2024-03-09T15:07:03.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.727300133198361004', time=2024-03-09T16:55:29.742167+0000, chain.objs.size()=1 2024-03-09T15:07:03.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.270__shadow_.NskjmdJ5qUpoIyRM5QLrfjh0f19tBXY_0 2024-03-09T15:07:03.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.994+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7617331058566066510', time=2024-03-09T16:55:35.314859+0000, chain.objs.size()=1 2024-03-09T15:07:03.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.994+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.276__shadow_.Y-6Aa8xN-4g0NU04_YXMABXjJYvpR8J_0 2024-03-09T15:07:03.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.994+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15247989603729312159', time=2024-03-09T16:55:41.220464+0000, chain.objs.size()=1 2024-03-09T15:07:03.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.994+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.282__shadow_.6jobXBSLQOT6oYFbsHrk7-rNQKh5_yl_0 2024-03-09T15:07:03.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.994+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10496380014977400531', time=2024-03-09T16:55:46.217640+0000, chain.objs.size()=1 2024-03-09T15:07:03.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.994+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.XqLuc3IacX_fvQ1T7gLDwHX9ScKmM6k_0 2024-03-09T15:07:03.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.994+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12121711583959117273', time=2024-03-09T16:55:54.531022+0000, chain.objs.size()=1 2024-03-09T15:07:03.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.994+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.294__shadow_.t6SHPAYJGcawK4_SD0orNX-bRUB-jK5_0 2024-03-09T15:07:03.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.994+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.56486879101468827', time=2024-03-09T16:56:37.708896+0000, chain.objs.size()=1 2024-03-09T15:07:03.994 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.994+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.WswAMAPQ3G6lHmkmW9Z5RS_BN0jZiHQ_0 2024-03-09T15:07:03.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.994+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6907089157127077372', time=2024-03-09T16:56:37.740961+0000, chain.objs.size()=1 2024-03-09T15:07:03.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.994+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.3kNXh8GvlPUobo0yLiZmQhljU0S9xCv_0 2024-03-09T15:07:03.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.994+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11616890771114838529', time=2024-03-09T16:56:38.070422+0000, chain.objs.size()=1 2024-03-09T15:07:03.995 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.994+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.AvOrBTLfIR3gmB_LI1G5yInNeLtYTxS_0 2024-03-09T15:07:03.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8631936025956941872', time=2024-03-09T16:56:38.098741+0000, chain.objs.size()=1 2024-03-09T15:07:03.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_._-IPcDD9xmVRI_ssiFWCw_pBTN1bCat_0 2024-03-09T15:07:03.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.603683721382292373', time=2024-03-09T16:56:38.117547+0000, chain.objs.size()=1 2024-03-09T15:07:03.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.MJqFAYhtRzAOMIv--yRbf-FUKPTAyy7_0 2024-03-09T15:07:03.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1037393735389399352', time=2024-03-09T16:56:38.121306+0000, chain.objs.size()=1 2024-03-09T15:07:03.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.TQfzvDKYgvTHe3zFatZoFh-DBckPcOe_0 2024-03-09T15:07:03.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6232321076933207376', time=2024-03-09T16:56:38.242420+0000, chain.objs.size()=1 2024-03-09T15:07:03.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lLEg4zGCSNqgPZh2nCLKL8tVoKBspOF_0 2024-03-09T15:07:03.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16326969309581014942', time=2024-03-09T16:56:38.290796+0000, chain.objs.size()=1 2024-03-09T15:07:03.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.chX8OIbZoXeFM4yzdpM9UDH6zmbIwOP_0 2024-03-09T15:07:03.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1323055020912617931', time=2024-03-09T16:56:38.294438+0000, chain.objs.size()=1 2024-03-09T15:07:03.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.jYZKI0aHG7qm0CQA0mIxOesQi_RUdVa_0 2024-03-09T15:07:03.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14726334320082879143', time=2024-03-09T16:56:38.308747+0000, chain.objs.size()=1 2024-03-09T15:07:03.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.NsQp-EoA16iVUbVc4gc7HjqWx7DcTwO_0 2024-03-09T15:07:03.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12812157446113579004', time=2024-03-09T16:56:38.372413+0000, chain.objs.size()=1 2024-03-09T15:07:03.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lmSNp9D6M6FyMSGogqZebVOvysHu36N_0 2024-03-09T15:07:03.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7737902342657118970', time=2024-03-09T16:56:38.548542+0000, chain.objs.size()=1 2024-03-09T15:07:04.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:03.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kTbw06-g7m7tJRAx9xm8TRmSD9kVkMV_0 2024-03-09T15:07:04.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.002+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3292611091102145013', time=2024-03-09T16:56:38.549320+0000, chain.objs.size()=1 2024-03-09T15:07:04.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.002+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.8KmgHg32dwv7mhd0XD2vGnF-zBFv1zU_0 2024-03-09T15:07:04.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.002+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.266835613645933717', time=2024-03-09T16:56:38.581092+0000, chain.objs.size()=1 2024-03-09T15:07:04.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.002+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6NamZ1nQjUtkSlLvpTIpxpJkRp0h92N_0 2024-03-09T15:07:04.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.002+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16574229990589045326', time=2024-03-09T16:56:38.662006+0000, chain.objs.size()=1 2024-03-09T15:07:04.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.002+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0BJisWUV-sx3ld_x2gcjgNM5qlh0FLw_0 2024-03-09T15:07:04.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7902597809601044029', time=2024-03-09T16:56:38.777313+0000, chain.objs.size()=1 2024-03-09T15:07:04.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.UkxmP5mxfo-7eDcO3qbAhpp5b97mH0w_0 2024-03-09T15:07:04.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15640363652834369414', time=2024-03-09T16:56:38.807629+0000, chain.objs.size()=1 2024-03-09T15:07:04.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.v88cyKFe9TbLsihLuLD0RrpPrsLDe_I_0 2024-03-09T15:07:04.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10966752315635409036', time=2024-03-09T16:56:38.820203+0000, chain.objs.size()=1 2024-03-09T15:07:04.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.uM90cIXf3uVRJPDKY5sW5LSlRczQJ8G_0 2024-03-09T15:07:04.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8439717274075494329', time=2024-03-09T16:56:38.860751+0000, chain.objs.size()=1 2024-03-09T15:07:04.005 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.C5zIy69L0_T6zz2QL5aSO5MwR2tz8ik_0 2024-03-09T15:07:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10249145728897437970', time=2024-03-09T16:56:38.870497+0000, chain.objs.size()=1 2024-03-09T15:07:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.aCYrpFtY70SGfzkFzViqG6bsVMYCAve_0 2024-03-09T15:07:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1737699124314246585', time=2024-03-09T16:56:38.911177+0000, chain.objs.size()=1 2024-03-09T15:07:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.D_kmh4olprK-gn8Uoond5GbCbf8adzP_0 2024-03-09T15:07:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2281680209221527233', time=2024-03-09T16:56:39.125216+0000, chain.objs.size()=1 2024-03-09T15:07:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Soifm0BwcHNJ47K7t1fljvfHVx3UTnH_0 2024-03-09T15:07:04.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9925218278829890355', time=2024-03-09T16:56:39.125857+0000, chain.objs.size()=1 2024-03-09T15:07:04.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.GPD6ZmS1d8rUJ3hKio5b0Qhnjg1Z0qq_0 2024-03-09T15:07:04.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13088906471611264899', time=2024-03-09T16:56:39.161013+0000, chain.objs.size()=1 2024-03-09T15:07:04.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.gglU5zviTbx6sxu6pSsaRhVE55mqrXB_0 2024-03-09T15:07:04.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1189960377474095307', time=2024-03-09T16:56:39.203497+0000, chain.objs.size()=1 2024-03-09T15:07:04.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.aCzFlB2_QpfMQTC-obhrLg1sTwO5-f4_0 2024-03-09T15:07:04.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.010+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11859974136388924870', time=2024-03-09T16:56:39.344130+0000, chain.objs.size()=1 2024-03-09T15:07:04.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.010+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.O6YFARkBH_kCoJpx2TZK4RX8WBeONn9_0 2024-03-09T15:07:04.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.010+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6866479824773339246', time=2024-03-09T16:56:39.349382+0000, chain.objs.size()=1 2024-03-09T15:07:04.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.010+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.oOrCRUFG27kVt0mZyROTedKkahyh5LJ_0 2024-03-09T15:07:04.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.010+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2067695462202352804', time=2024-03-09T16:56:39.392174+0000, chain.objs.size()=1 2024-03-09T15:07:04.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.010+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.t7mZ-1zA1aqxpR6tzrFUJE2rVG7iUAk_0 2024-03-09T15:07:04.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.010+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13419822364898395230', time=2024-03-09T16:56:39.395302+0000, chain.objs.size()=1 2024-03-09T15:07:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.010+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.87ZXxIZwHHQKBFoyloL5GxoICiq2T3F_0 2024-03-09T15:07:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.010+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15060126214696849630', time=2024-03-09T16:56:39.452465+0000, chain.objs.size()=1 2024-03-09T15:07:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.010+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.MZ8ke7sSu5-1mlZ9n1-cGnSIk2Vb7Ll_0 2024-03-09T15:07:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.010+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8659089268648889761', time=2024-03-09T16:56:39.677021+0000, chain.objs.size()=1 2024-03-09T15:07:04.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.010+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.jKExXTDvEt_0twBrNWINdxQm3MSMR0s_0 2024-03-09T15:07:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.010+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5393995954145622093', time=2024-03-09T16:57:01.412236+0000, chain.objs.size()=1 2024-03-09T15:07:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.010+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.rT00i8mbIHH3rjzoFiCEUVDX4sMiu8G_0 2024-03-09T15:07:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.010+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17867342129213592607', time=2024-03-09T16:57:01.459603+0000, chain.objs.size()=1 2024-03-09T15:07:04.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.010+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.sTtuSKC07dsrNZdJPhkzM44D4UnTq0H_0 2024-03-09T15:07:04.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.014+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16144664147793873982', time=2024-03-09T16:57:01.464871+0000, chain.objs.size()=1 2024-03-09T15:07:04.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.014+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.95ztWX1hoOIDcJzs0oyaDkKpm7mgGJk_0 2024-03-09T15:07:04.014 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.014+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10208460027132590258', time=2024-03-09T16:57:01.476433+0000, chain.objs.size()=1 2024-03-09T15:07:04.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.014+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.GzW6LZoRsMP1_nnz546MBLn-YCM1jCW_0 2024-03-09T15:07:04.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.014+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16225819519220482159', time=2024-03-09T16:57:01.485517+0000, chain.objs.size()=1 2024-03-09T15:07:04.015 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.014+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.hHPxnbp5YpDDo7SrEWYL_iFkIhEV8vN_0 2024-03-09T15:07:04.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15158277059329591201', time=2024-03-09T16:57:01.535336+0000, chain.objs.size()=1 2024-03-09T15:07:04.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.1jJiCi8XyQYN3cWw2ag9Yo-R864szen_0 2024-03-09T15:07:04.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5333679203408533705', time=2024-03-09T16:57:01.588361+0000, chain.objs.size()=1 2024-03-09T15:07:04.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.vTZoUyqo_Zx3FtlRZhPcqTMxwXaOknZ_0 2024-03-09T15:07:04.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13968618738531729415', time=2024-03-09T16:57:01.595409+0000, chain.objs.size()=1 2024-03-09T15:07:04.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.yVHBBqyx_O-tWWQ717zZa2eKBZUfiBs_0 2024-03-09T15:07:04.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8750065458150251727', time=2024-03-09T16:57:01.768331+0000, chain.objs.size()=1 2024-03-09T15:07:04.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.PZcRREuuJ1CYWNGzBDhXykx42_Xf8r1_0 2024-03-09T15:07:04.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16498543976396478607', time=2024-03-09T16:57:01.829538+0000, chain.objs.size()=1 2024-03-09T15:07:04.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xq-0_fITE9NbesJQNkEXYr7H0RRa434_0 2024-03-09T15:07:04.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10650933112161242752', time=2024-03-09T16:57:01.833904+0000, chain.objs.size()=1 2024-03-09T15:07:04.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.zlzWaaSFSttdDf6HQNBNXCiuhAgg_-f_0 2024-03-09T15:07:04.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11034937430722760490', time=2024-03-09T16:57:01.850476+0000, chain.objs.size()=1 2024-03-09T15:07:04.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.KsDWcvOIEqc9Yp0Ugsv569tB_SiJ742_0 2024-03-09T15:07:04.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15616817723421077172', time=2024-03-09T16:57:02.217973+0000, chain.objs.size()=1 2024-03-09T15:07:04.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_._RzG6gKdhpsRxE8ewYbTn6bd_lfWaD2_0 2024-03-09T15:07:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11278450186564957340', time=2024-03-09T16:57:02.221478+0000, chain.objs.size()=1 2024-03-09T15:07:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Uf0IUAFAe1doautSaX8YJlputwWONQA_0 2024-03-09T15:07:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11109350718034270464', time=2024-03-09T16:57:02.299161+0000, chain.objs.size()=1 2024-03-09T15:07:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ponkeqRfhg-Y_4uARW0_gIHaIxKpDxU_0 2024-03-09T15:07:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15179781654269643956', time=2024-03-09T16:57:02.498246+0000, chain.objs.size()=1 2024-03-09T15:07:04.020 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.tHFGWISrvVkMJ8pqXoxVVQSBsCa1-8q_0 2024-03-09T15:07:04.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16675878658189846339', time=2024-03-09T16:57:02.526124+0000, chain.objs.size()=1 2024-03-09T15:07:04.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.AwLMCC78tfds2QM6bk1XocQEjkV6mCX_0 2024-03-09T15:07:04.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7441291985271099044', time=2024-03-09T16:57:02.539444+0000, chain.objs.size()=1 2024-03-09T15:07:04.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.EeDryxqe5ff5fUTH_YQQhKwG0gD7fAb_0 2024-03-09T15:07:04.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4694341064583026702', time=2024-03-09T16:57:02.566539+0000, chain.objs.size()=1 2024-03-09T15:07:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oapo0Dy0_K4fk81pY-4P9SitJpZnPnm_0 2024-03-09T15:07:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12785287248276354227', time=2024-03-09T16:57:02.606670+0000, chain.objs.size()=1 2024-03-09T15:07:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Aed0iRYa9z9Wi6YcTCkc_wceFQ4mF2v_0 2024-03-09T15:07:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8591991175340905071', time=2024-03-09T16:57:02.614559+0000, chain.objs.size()=1 2024-03-09T15:07:04.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.pHTSeCUMwuNlTP5D4xtPxvP0gqhYHZ1_0 2024-03-09T15:07:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4590528062273023367', time=2024-03-09T16:57:02.724805+0000, chain.objs.size()=1 2024-03-09T15:07:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.P4dUlyoOVFGaODuOa-B4OxOCcJENf3D_0 2024-03-09T15:07:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2144800957014432929', time=2024-03-09T16:57:02.797180+0000, chain.objs.size()=1 2024-03-09T15:07:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.AxLS9SM0CvSbTZVmfedQtteU60AAmwR_0 2024-03-09T15:07:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8813492470301112582', time=2024-03-09T16:57:02.853407+0000, chain.objs.size()=1 2024-03-09T15:07:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.HbG4EYmuudvDjcSuKnC9V7ws7h7jJwe_0 2024-03-09T15:07:04.027 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4955710765585611961', time=2024-03-09T16:57:02.865681+0000, chain.objs.size()=1 2024-03-09T15:07:04.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.vhTqeu6Ub1OlBpunhS49ajWZHUulzzp_0 2024-03-09T15:07:04.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2344189261566200555', time=2024-03-09T16:57:02.875857+0000, chain.objs.size()=1 2024-03-09T15:07:04.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.026+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.wOCPu8NRX18RYGfiVSdAeNsf_YyhPhR_0 2024-03-09T15:07:04.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.030+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7335660975650015923', time=2024-03-09T16:57:03.268410+0000, chain.objs.size()=1 2024-03-09T15:07:04.028 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.030+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.v6HP6NA3WTN5YylW8iEEJl7gKtJ86_c_0 2024-03-09T15:07:04.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.034+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15123634425987355674', time=2024-03-09T16:57:03.366640+0000, chain.objs.size()=1 2024-03-09T15:07:04.032 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.034+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.dJhuwCmsR8d0s5kmSmuwYK3tjCfh1RU_0 2024-03-09T15:07:04.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.034+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8699516224526640056', time=2024-03-09T16:57:09.710474+0000, chain.objs.size()=1 2024-03-09T15:07:04.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.034+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.325__shadow_.EuSbGssbO2KYkjkMgn4tXLM5w9EokCv_0 2024-03-09T15:07:04.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/40260 2024-03-09T15:07:04.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-03-09T15:07:04.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13413067956278197260', time=2024-03-09T16:57:45.516907+0000, chain.objs.size()=1 2024-03-09T15:07:04.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.367__shadow_.ON6Hwya4qClFtzdabjxlz_7Ki4KaGBW_0 2024-03-09T15:07:04.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5257775162084958902', time=2024-03-09T16:57:48.304014+0000, chain.objs.size()=1 2024-03-09T15:07:04.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.369__shadow_.Q4VmdViZ5f04eJZyQdNDS0jnc7FpPdy_0 2024-03-09T15:07:04.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.669610129853034421', time=2024-03-09T16:58:46.008034+0000, chain.objs.size()=1 2024-03-09T15:07:04.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.428__shadow_.Ko_4i-dHGwUpJPDte8ISVYPfNDOUdOf_0 2024-03-09T15:07:04.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8460746232025181220', time=2024-03-09T16:59:20.646564+0000, chain.objs.size()=1 2024-03-09T15:07:04.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.460__shadow_.BEWhFN1HsLpAIuRmyjjz05G6NtS5vlv_0 2024-03-09T15:07:04.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1058349656848696519', time=2024-03-09T16:59:32.469266+0000, chain.objs.size()=1 2024-03-09T15:07:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.478__shadow_.qRJrDPNtIRobfowIsLNYYQbsdcv7e___0 2024-03-09T15:07:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3059157057729869392', time=2024-03-09T16:59:32.471197+0000, chain.objs.size()=1 2024-03-09T15:07:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.478__shadow_.QKNX9V3EaN0QEjMhGm1fyLEXS47og6e_0 2024-03-09T15:07:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.497__shadow:sTyMyf-pYbnbXvdieipjbZDtyAqnZAv_.YDOx1qoYlCKjXydeFP7D4JWYzcC9wbk_1_5b50be8fe9f06677b32acd8478895a4c', time=2024-03-09T16:59:48.691460+0000, chain.objs.size()=1 2024-03-09T15:07:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.497__shadow:sTyMyf-pYbnbXvdieipjbZDtyAqnZAv_.YDOx1qoYlCKjXydeFP7D4JWYzcC9wbk_0 2024-03-09T15:07:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.497__shadow:sTyMyf-pYbnbXvdieipjbZDtyAqnZAv_.YDOx1qoYlCKjXydeFP7D4JWYzcC9wbk_1_fb2f740504b9077d507de795bb04677a', time=2024-03-09T16:59:48.872365+0000, chain.objs.size()=1 2024-03-09T15:07:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.497__shadow:sTyMyf-pYbnbXvdieipjbZDtyAqnZAv_.YDOx1qoYlCKjXydeFP7D4JWYzcC9wbk_0 2024-03-09T15:07:04.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.2_e98b7bc37954606b43f1c1b8476ddef0', time=2024-03-09T16:59:52.997471+0000, chain.objs.size()=6 2024-03-09T15:07:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.1 2024-03-09T15:07:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.2 2024-03-09T15:07:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.3 2024-03-09T15:07:04.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.042+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.4 2024-03-09T15:07:04.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.5 2024-03-09T15:07:04.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.6 2024-03-09T15:07:04.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9486953242414147981', time=2024-03-09T17:01:53.375899+0000, chain.objs.size()=1 2024-03-09T15:07:04.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:2S0KzOf-RvidVPwa38Ht9dYcbnyv4Uv_.Ps-Y8Z3oHtcTD3nT61uplnKGPR7ECgo_0 2024-03-09T15:07:04.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15338361755040706132', time=2024-03-09T17:01:59.514986+0000, chain.objs.size()=1 2024-03-09T15:07:04.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:jMKh-dI2y9wUtYvXEsmVR1O99GxSEIL_.nrcewdSP--s6l0gh411SJ0yS3v6yP6o_0 2024-03-09T15:07:04.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17402924817247099686', time=2024-03-09T17:02:01.793171+0000, chain.objs.size()=1 2024-03-09T15:07:04.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.564__shadow_.9ehCOQOVGTGURCe5mo9Z5GTKYjoFMS9_0 2024-03-09T15:07:04.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10987822718196355180', time=2024-03-09T17:02:19.897783+0000, chain.objs.size()=1 2024-03-09T15:07:04.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:errOA9ikN.1hj7wBGk48-k8Lopx0ESK_.rBnqs9lOa55hQ8XCUE9D_UrkwxCvCEZ_0 2024-03-09T15:07:04.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13548793500374340985', time=2024-03-09T17:03:00.972441+0000, chain.objs.size()=1 2024-03-09T15:07:04.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.597__shadow_.xVEkfa5WPtZ_dTgkna-igNEp6c927GK_0 2024-03-09T15:07:04.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3509716141247210137', time=2024-03-09T17:03:23.060190+0000, chain.objs.size()=1 2024-03-09T15:07:04.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.610__shadow_.9aRKtzOtvr-svD6UbywmDeMz6dj-KXS_0 2024-03-09T15:07:04.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7512728398864473740', time=2024-03-09T17:03:57.123853+0000, chain.objs.size()=1 2024-03-09T15:07:04.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.641__shadow_.QDxeRg6yvEdQbLEAQbvvPs3x7blguGx_0 2024-03-09T15:07:04.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2667514406476645748', time=2024-03-09T17:04:13.581321+0000, chain.objs.size()=1 2024-03-09T15:07:04.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.657__shadow_.qZApiCwVMN4EDyhMw0I4kfeBYH_Swtr_0 2024-03-09T15:07:04.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17271805013077789857', time=2024-03-09T17:04:22.093847+0000, chain.objs.size()=1 2024-03-09T15:07:04.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.668__shadow_.gUVpFAis06DPuBp65CBwtJ4TEhr053f_0 2024-03-09T15:07:04.058 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.058+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:04.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.062+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-09T15:07:04.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:04.064 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:04.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51575' 2024-03-09T15:07:04.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6272396437594274346', time=2024-03-09T16:51:48.890303+0000, chain.objs.size()=2 2024-03-09T15:07:04.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.152__shadow_.TZ_3XQ80IoLJI3K_xGmC4dvbetnMeIx_0 2024-03-09T15:07:04.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.152__shadow_.TZ_3XQ80IoLJI3K_xGmC4dvbetnMeIx_1 2024-03-09T15:07:04.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14445295632365033704', time=2024-03-09T16:52:11.168099+0000, chain.objs.size()=1 2024-03-09T15:07:04.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.172__shadow_.PAzg-w6MkYHzhWGe3jfUaW74vJSPA7A_0 2024-03-09T15:07:04.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14506024127659010300', time=2024-03-09T16:54:28.978533+0000, chain.objs.size()=1 2024-03-09T15:07:04.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.231__shadow_.sotk4sVvG869RxA-VRwWPXMY_P_6R4l_0 2024-03-09T15:07:04.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1867330276874468684', time=2024-03-09T16:54:43.471241+0000, chain.objs.size()=1 2024-03-09T15:07:04.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.245__shadow_.B__OV4m4h5F5jjG3AyfGWjeja_DcN80_0 2024-03-09T15:07:04.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.855921406490489005', time=2024-03-09T16:54:46.269928+0000, chain.objs.size()=1 2024-03-09T15:07:04.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.248__shadow_.1gCZjfXyGiA9AD9aPq-CaJ4uUEC1_1X_0 2024-03-09T15:07:04.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8203070616204555526', time=2024-03-09T16:55:14.844895+0000, chain.objs.size()=1 2024-03-09T15:07:04.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.CASel2r0CHqqLLP0YViyfuWzRCtnTqD_0 2024-03-09T15:07:04.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6692540216641356718', time=2024-03-09T16:55:14.975412+0000, chain.objs.size()=1 2024-03-09T15:07:04.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.WYWq3P61DoYq8yzP5kR-o76Qh0soZLy_0 2024-03-09T15:07:04.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11681403720557337383', time=2024-03-09T16:55:15.017418+0000, chain.objs.size()=1 2024-03-09T15:07:04.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.rCnbU9qAMlh_jdQCnsjs3u_wEL-a_cS_0 2024-03-09T15:07:04.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15651790116195389920', time=2024-03-09T16:55:15.213708+0000, chain.objs.size()=1 2024-03-09T15:07:04.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.mAzNcyowrJ-YwiCZAAWaX7yQO6Z7qd__0 2024-03-09T15:07:04.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17352864803554235910', time=2024-03-09T16:55:15.224920+0000, chain.objs.size()=1 2024-03-09T15:07:04.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.RrvbYXSjpW1C9WTj4NaPMIyedxfRbzx_0 2024-03-09T15:07:04.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11338655162050967531', time=2024-03-09T16:55:15.265112+0000, chain.objs.size()=1 2024-03-09T15:07:04.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.mGI72vAIfm9fhjudd13vTVgRpHYkNnw_0 2024-03-09T15:07:04.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18082445133406222685', time=2024-03-09T16:55:15.473955+0000, chain.objs.size()=1 2024-03-09T15:07:04.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.V8H3Bh3A5XANESkAArEVyZ2FL2AZAlH_0 2024-03-09T15:07:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.477577304265806712', time=2024-03-09T16:55:15.691403+0000, chain.objs.size()=1 2024-03-09T15:07:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.IIeY9HBzj2tuzz5I2_68a_dqJKFwplb_0 2024-03-09T15:07:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3625647175079148991', time=2024-03-09T16:55:15.737949+0000, chain.objs.size()=1 2024-03-09T15:07:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.uflvdMrozEpZ3YE3iM7u19evvC9bHrb_0 2024-03-09T15:07:04.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9264019373524181929', time=2024-03-09T16:55:15.789321+0000, chain.objs.size()=1 2024-03-09T15:07:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.yqWoalB5iEJBFrMsDbpA4uRdaUXPS55_0 2024-03-09T15:07:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10327058073989767861', time=2024-03-09T16:55:15.816741+0000, chain.objs.size()=1 2024-03-09T15:07:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.-yn8YYLJJZjQq1h7ZecftJTUzORo5sz_0 2024-03-09T15:07:04.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6369873164654765175', time=2024-03-09T16:55:15.958080+0000, chain.objs.size()=1 2024-03-09T15:07:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.DaQv2vHRKye1chf1lz8R2jo2b_VBa8t_0 2024-03-09T15:07:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3691203335144272956', time=2024-03-09T16:55:15.995994+0000, chain.objs.size()=1 2024-03-09T15:07:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.7U6EcZ9o8ngCsYo9qql6wlguC7SRBTO_0 2024-03-09T15:07:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.074+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8860477624125171596', time=2024-03-09T16:55:16.002767+0000, chain.objs.size()=1 2024-03-09T15:07:04.074 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.074+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.uR370qKgXz0eDe3-1wjKHaa7XlmwU51_0 2024-03-09T15:07:04.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.074+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17546978207037964422', time=2024-03-09T16:55:16.010939+0000, chain.objs.size()=1 2024-03-09T15:07:04.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.074+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Y6zjXcTGK8FdydVZe80hxITfVVMEB-s_0 2024-03-09T15:07:04.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.074+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5191062107018228912', time=2024-03-09T16:55:16.079205+0000, chain.objs.size()=1 2024-03-09T15:07:04.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.074+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.NODU5g4T-bLF6f__C1imKNEnQS39CPP_0 2024-03-09T15:07:04.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.074+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1822685207049168252', time=2024-03-09T16:55:16.266850+0000, chain.objs.size()=1 2024-03-09T15:07:04.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.074+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.4kIw6YbCl6CR1O4hVuEkY-J0N35aojf_0 2024-03-09T15:07:04.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.074+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.774068260626639838', time=2024-03-09T16:55:16.281893+0000, chain.objs.size()=1 2024-03-09T15:07:04.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.074+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qhYd7bDM2-byfZdqRRyLihLNQGfHh4t_0 2024-03-09T15:07:04.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4462781517455480362', time=2024-03-09T16:55:16.297986+0000, chain.objs.size()=1 2024-03-09T15:07:04.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.an8I3Jzdkivtc-vD42t8EROEPxs-4dF_0 2024-03-09T15:07:04.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2835200598516627935', time=2024-03-09T16:55:16.305445+0000, chain.objs.size()=1 2024-03-09T15:07:04.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.8VG6QO7ZynJcZox1HYakdAzXOghsXbB_0 2024-03-09T15:07:04.078 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6995250624227008731', time=2024-03-09T16:55:16.327329+0000, chain.objs.size()=1 2024-03-09T15:07:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.FuIgvWFzoZFrToHUQlW59dhJZLesuk1_0 2024-03-09T15:07:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2064982496962403955', time=2024-03-09T16:55:16.352321+0000, chain.objs.size()=1 2024-03-09T15:07:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.UfqbDT2UxMcMmaIxWo0qABHfpTa4ZRP_0 2024-03-09T15:07:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2189088354196751240', time=2024-03-09T16:55:16.516418+0000, chain.objs.size()=1 2024-03-09T15:07:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.r1F9yagSMaLxaZzOnNHKuey8Ge8fSiX_0 2024-03-09T15:07:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12196167675249673249', time=2024-03-09T16:55:16.528440+0000, chain.objs.size()=1 2024-03-09T15:07:04.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.GQasQzV6Z6F1pOqxPU9xh9CfcsILAVK_0 2024-03-09T15:07:04.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10139488121566720511', time=2024-03-09T16:55:16.548810+0000, chain.objs.size()=1 2024-03-09T15:07:04.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ebVvwbwqyuIICuwZC2YcYRnuPOtmyrK_0 2024-03-09T15:07:04.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18093161285222374393', time=2024-03-09T16:55:16.558554+0000, chain.objs.size()=1 2024-03-09T15:07:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.PFX_Cqmc1u5ISk8npZiv23STUfoy0lG_0 2024-03-09T15:07:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16819926518167044600', time=2024-03-09T16:55:16.588051+0000, chain.objs.size()=1 2024-03-09T15:07:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.PFB8TR13LGTNood-BjNIVKYhRaA7HeB_0 2024-03-09T15:07:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12266017272840719520', time=2024-03-09T16:55:16.803786+0000, chain.objs.size()=1 2024-03-09T15:07:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.DjXOXGRmdGQ1zPSPFdVTjGSzi-hh7kJ_0 2024-03-09T15:07:04.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6960314822712914650', time=2024-03-09T16:55:16.813805+0000, chain.objs.size()=1 2024-03-09T15:07:04.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6hCI45N9DQvS4khOlbvabIY0D7ae25s_0 2024-03-09T15:07:04.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12235998701899182885', time=2024-03-09T16:55:16.833743+0000, chain.objs.size()=1 2024-03-09T15:07:04.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.pNkHxKo6WpPy6ljUn6ixVBdO6Qdlff7_0 2024-03-09T15:07:04.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15811665922102355941', time=2024-03-09T16:55:18.572969+0000, chain.objs.size()=1 2024-03-09T15:07:04.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.258__shadow_.TTkf1u0T1GF387Vh6Oz6T02vIwOCaqa_0 2024-03-09T15:07:04.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17665685402753183009', time=2024-03-09T16:55:29.738276+0000, chain.objs.size()=1 2024-03-09T15:07:04.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.270__shadow_.1BqfdlAUvE3HKbkfkBKeTWp9OEzJjr4_0 2024-03-09T15:07:04.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11742341360920431649', time=2024-03-09T16:55:36.259743+0000, chain.objs.size()=1 2024-03-09T15:07:04.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.277__shadow_.cNN3njC6mQr28LzGBVNGR_nWOLNWFXE_0 2024-03-09T15:07:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13792416279107263190', time=2024-03-09T16:55:46.204677+0000, chain.objs.size()=1 2024-03-09T15:07:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.syRkeQDxMqc4S9t1dBnxCfOMgOdhG4P_0 2024-03-09T15:07:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5214819773533702401', time=2024-03-09T16:55:47.840628+0000, chain.objs.size()=1 2024-03-09T15:07:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.VLJoZ5v0xzwh3SYGG2LtLg-MX-M2iWk_0 2024-03-09T15:07:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.086+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11187304703160384025', time=2024-03-09T16:55:48.753762+0000, chain.objs.size()=1 2024-03-09T15:07:04.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.086+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.288__shadow_.41ooiIL7JQEZ3KxbDaF-BrDvKOSTqw9_0 2024-03-09T15:07:04.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.086+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8451698881336152118', time=2024-03-09T16:55:50.639565+0000, chain.objs.size()=1 2024-03-09T15:07:04.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.086+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.290__shadow_.QF7nDbnoiNRti8tuiXsCjS-ebubzQmC_0 2024-03-09T15:07:04.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.086+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10451617521974830512', time=2024-03-09T16:55:53.604096+0000, chain.objs.size()=1 2024-03-09T15:07:04.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.086+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.293__shadow_.F_shi4cTYOYoH9Lo5dRXc5ZS6PeNx92_0 2024-03-09T15:07:04.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.086+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5926568069230555567', time=2024-03-09T16:56:37.780026+0000, chain.objs.size()=1 2024-03-09T15:07:04.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.086+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.G0Y1k-y6MiVD6qSKMudS_vH5Nf5n0Om_0 2024-03-09T15:07:04.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.086+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3255092638970591029', time=2024-03-09T16:56:37.866115+0000, chain.objs.size()=1 2024-03-09T15:07:04.088 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.086+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.D77FfkkOYnX_rhbFbNHUxfbUMKQN8hN_0 2024-03-09T15:07:04.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.090+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1111373246936890597', time=2024-03-09T16:56:37.981353+0000, chain.objs.size()=1 2024-03-09T15:07:04.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.090+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ic3Ie7ZFzPruSYJitQduy-NrqI_rZF7_0 2024-03-09T15:07:04.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.090+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9197316630754610438', time=2024-03-09T16:56:37.993542+0000, chain.objs.size()=1 2024-03-09T15:07:04.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.090+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0MTUSV3irgwWhd-D6bRt_h78QylZS2i_0 2024-03-09T15:07:04.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.090+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7640679731472732084', time=2024-03-09T16:56:37.999799+0000, chain.objs.size()=1 2024-03-09T15:07:04.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.090+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_._Ql0GjilEEal4jXGdBbA-QyoPDDC8_G_0 2024-03-09T15:07:04.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.090+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3297064781554388344', time=2024-03-09T16:56:38.004869+0000, chain.objs.size()=1 2024-03-09T15:07:04.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.090+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.wsK_jx7-DcLBJO1a1EQIEaUt5yyL26F_0 2024-03-09T15:07:04.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.090+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16492959584005654492', time=2024-03-09T16:56:38.015929+0000, chain.objs.size()=1 2024-03-09T15:07:04.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.090+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.nWYb9Ke1bf_v9rZ6uX60R4loAR8_D6U_0 2024-03-09T15:07:04.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.090+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7528578249298862100', time=2024-03-09T16:56:38.045747+0000, chain.objs.size()=1 2024-03-09T15:07:04.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.090+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Xq4IrrS_uVDgxC9EM_OIely1yd3T7CN_0 2024-03-09T15:07:04.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.090+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12005770929325165785', time=2024-03-09T16:56:38.061806+0000, chain.objs.size()=1 2024-03-09T15:07:04.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.090+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.tzwYa-8Zf3GsAuHLUcOhvfxqMTWGksw_0 2024-03-09T15:07:04.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9948244248990967266', time=2024-03-09T16:56:38.123283+0000, chain.objs.size()=1 2024-03-09T15:07:04.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.DXHUKGSNIQWyY7acLafNkOcxRuA1SVD_0 2024-03-09T15:07:04.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5004132945107902197', time=2024-03-09T16:56:38.124472+0000, chain.objs.size()=1 2024-03-09T15:07:04.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.1Ne9ElB_PDxYG7AJd-cCQ9DtiglVWvr_0 2024-03-09T15:07:04.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17968213867657955503', time=2024-03-09T16:56:38.289320+0000, chain.objs.size()=1 2024-03-09T15:07:04.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.TG1RmM2upu3sggrYkaQr9aTbrmiQ4oc_0 2024-03-09T15:07:04.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11326712748821060639', time=2024-03-09T16:56:38.315035+0000, chain.objs.size()=1 2024-03-09T15:07:04.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ub-UAFLI2FJZ7xq5tyOnXO0-asVOPrW_0 2024-03-09T15:07:04.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7943969858953222318', time=2024-03-09T16:56:38.337762+0000, chain.objs.size()=1 2024-03-09T15:07:04.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ZLwxiX1RlTLdCUbYYdNmIPI4qPeA5i6_0 2024-03-09T15:07:04.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10840980193471974138', time=2024-03-09T16:56:38.352229+0000, chain.objs.size()=1 2024-03-09T15:07:04.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Fd1JMVMSSG212ey0xCBL3ev0RnaQDYS_0 2024-03-09T15:07:04.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7177804550319158370', time=2024-03-09T16:56:38.498656+0000, chain.objs.size()=1 2024-03-09T15:07:04.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.2EEJiRok8BngB80_CpDwHUJgagYs6Ly_0 2024-03-09T15:07:04.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16308073779513977184', time=2024-03-09T16:56:38.573345+0000, chain.objs.size()=1 2024-03-09T15:07:04.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.OAMXziLIGsYa5JeyvPOxGMy7H-YlxJC_0 2024-03-09T15:07:04.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14199604059070596307', time=2024-03-09T16:56:38.586316+0000, chain.objs.size()=1 2024-03-09T15:07:04.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.A9Izh-X5WA4xgQBIiMs6vYSAR33-3z8_0 2024-03-09T15:07:04.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16004969043600127599', time=2024-03-09T16:56:38.605632+0000, chain.objs.size()=1 2024-03-09T15:07:04.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kdkEVfdMdc5iWILnBMTl8h7O1BEzUP3_0 2024-03-09T15:07:04.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1767293720683831983', time=2024-03-09T16:56:38.623366+0000, chain.objs.size()=1 2024-03-09T15:07:04.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.VHzCx5uSJZW601kv2tCET-uQt2QKU1a_0 2024-03-09T15:07:04.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6180908286132384021', time=2024-03-09T16:56:38.646475+0000, chain.objs.size()=1 2024-03-09T15:07:04.097 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.h-YfQZNKWephYUwOBvE2Exl94t5AMBT_0 2024-03-09T15:07:04.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.862707417727370129', time=2024-03-09T16:56:38.843697+0000, chain.objs.size()=1 2024-03-09T15:07:04.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.aWH1mTxJpBuTJRDxJ3TaWjTcrJYLcwq_0 2024-03-09T15:07:04.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11611674632101711660', time=2024-03-09T16:56:38.906015+0000, chain.objs.size()=1 2024-03-09T15:07:04.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.YkX2hFw7OAO0TfK2cS1gdFiLmt0CBI5_0 2024-03-09T15:07:04.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6472572494704746403', time=2024-03-09T16:56:39.116315+0000, chain.objs.size()=1 2024-03-09T15:07:04.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.RbK30gvVJv9r2Gz4jpca01pR7VY7S3H_0 2024-03-09T15:07:04.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11797056573623062364', time=2024-03-09T16:56:39.135659+0000, chain.objs.size()=1 2024-03-09T15:07:04.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.WPSDoNYePRytu8zexnAxqGiDBcTf1b0_0 2024-03-09T15:07:04.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12194159491740926723', time=2024-03-09T16:56:39.151237+0000, chain.objs.size()=1 2024-03-09T15:07:04.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.fm7vdZ4YhPAxSGV8mIn8eBHTv6ZsSsJ_0 2024-03-09T15:07:04.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.102+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13614376566472640587', time=2024-03-09T16:56:39.157819+0000, chain.objs.size()=1 2024-03-09T15:07:04.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.102+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.1od9fxU21azVJGYI8bGhheWRLG6KDte_0 2024-03-09T15:07:04.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.102+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5405261838160269524', time=2024-03-09T16:56:39.192923+0000, chain.objs.size()=1 2024-03-09T15:07:04.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.102+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.OQG3fTo4ihJ1biAE4CZohjdJbbO2_yv_0 2024-03-09T15:07:04.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.102+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1437884470764618228', time=2024-03-09T16:56:39.405585+0000, chain.objs.size()=1 2024-03-09T15:07:04.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.102+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0ccfZNikwBBKmvPxuZGmlpP-n5UCMhz_0 2024-03-09T15:07:04.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.102+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3437114809590537008', time=2024-03-09T16:56:39.581620+0000, chain.objs.size()=1 2024-03-09T15:07:04.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.102+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.pUAJx-49s0fajHo_pvqp3zDEpjmKR6l_0 2024-03-09T15:07:04.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.102+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16035718520615894108', time=2024-03-09T16:56:39.609247+0000, chain.objs.size()=1 2024-03-09T15:07:04.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.102+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.n0wlQwlJBbHvbjjefeqVQJxiQsVxmA0_0 2024-03-09T15:07:04.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.102+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13447721672870270720', time=2024-03-09T16:56:39.610450+0000, chain.objs.size()=1 2024-03-09T15:07:04.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.102+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.mtKc4YYr0_X9ysHv0mVFni5Ork1avzU_0 2024-03-09T15:07:04.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6812545121110384993', time=2024-03-09T16:56:39.659572+0000, chain.objs.size()=1 2024-03-09T15:07:04.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.2Qs1BFJ85hJP1mWOH_movdHmBOGub9m_0 2024-03-09T15:07:04.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2018482076940629713', time=2024-03-09T16:56:39.662900+0000, chain.objs.size()=1 2024-03-09T15:07:04.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6Z1_-9w8Er5suahnzI1If_1uomINn0S_0 2024-03-09T15:07:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9864506364386928178', time=2024-03-09T16:57:01.523008+0000, chain.objs.size()=1 2024-03-09T15:07:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.mp5W0H2FRsNzLY7buZ69UlMOMKaXThb_0 2024-03-09T15:07:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17934683884365476036', time=2024-03-09T16:57:01.555725+0000, chain.objs.size()=1 2024-03-09T15:07:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.FdwFGQyZmWurZC2DQlgYVK5LrP-j68t_0 2024-03-09T15:07:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1925820548411156588', time=2024-03-09T16:57:01.593235+0000, chain.objs.size()=1 2024-03-09T15:07:04.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.TBMxH1vD6Y7cdCJtqn6e5_mHu1jYGHY_0 2024-03-09T15:07:04.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13490946579170896886', time=2024-03-09T16:57:01.725900+0000, chain.objs.size()=1 2024-03-09T15:07:04.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oqoIhOP03dJ093Aqg0HpZyYi7WeKraS_0 2024-03-09T15:07:04.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11142293817370400502', time=2024-03-09T16:57:01.729792+0000, chain.objs.size()=1 2024-03-09T15:07:04.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DJnqOe_gpMB9p2PRnI6e65rKuL_26Xx_0 2024-03-09T15:07:04.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5992543941079231564', time=2024-03-09T16:57:01.778265+0000, chain.objs.size()=1 2024-03-09T15:07:04.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.gYJyMtXQIR9j5esQTlpU3tu5BEgc27Q_0 2024-03-09T15:07:04.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12480866070962209823', time=2024-03-09T16:57:01.801758+0000, chain.objs.size()=1 2024-03-09T15:07:04.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.48cs9Kl8KbY4OCwoz_3sd6PIA37UM8m_0 2024-03-09T15:07:04.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.110+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15516024338678259240', time=2024-03-09T16:57:01.876040+0000, chain.objs.size()=1 2024-03-09T15:07:04.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.IWenwLkmwn3h4RQd8-O4po4uUvTACsD_0 2024-03-09T15:07:04.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.110+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10493788089305484121', time=2024-03-09T16:57:01.971108+0000, chain.objs.size()=1 2024-03-09T15:07:04.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Rw1_IEu8XcO5UhDstcnAyD2ucedOHps_0 2024-03-09T15:07:04.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.110+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15987480918757556028', time=2024-03-09T16:57:01.998879+0000, chain.objs.size()=1 2024-03-09T15:07:04.110 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xKiN6dkvRII4va9UYzD8RXHExuhGT95_0 2024-03-09T15:07:04.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.110+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8245323048399994754', time=2024-03-09T16:57:02.050286+0000, chain.objs.size()=1 2024-03-09T15:07:04.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.NqLbcgxJRnt2j5DLk_Dvp-14doEtHOS_0 2024-03-09T15:07:04.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.110+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5005822074474312901', time=2024-03-09T16:57:02.058823+0000, chain.objs.size()=1 2024-03-09T15:07:04.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.q4gZ9gmE2jOAuFp6zU8J5qVP7wZuOco_0 2024-03-09T15:07:04.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.110+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7692644648935056257', time=2024-03-09T16:57:02.062714+0000, chain.objs.size()=1 2024-03-09T15:07:04.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.4Co_ZKIuWnIOdpFswohrXqJcUaNKQAP_0 2024-03-09T15:07:04.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3510806678484818462', time=2024-03-09T16:57:02.316608+0000, chain.objs.size()=1 2024-03-09T15:07:04.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.btdUQkzzUAGATPCHQgQjr9UKtwbQ4fH_0 2024-03-09T15:07:04.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16009899008850371335', time=2024-03-09T16:57:02.588166+0000, chain.objs.size()=1 2024-03-09T15:07:04.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.6UiVUHP9EGUY4F54cFda3u3vU4haYeX_0 2024-03-09T15:07:04.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12838506187890772709', time=2024-03-09T16:57:02.733538+0000, chain.objs.size()=1 2024-03-09T15:07:04.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.6d2YHttFZ2M5DfXIOYY-oh87MMr7cV2_0 2024-03-09T15:07:04.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3850148629104886853', time=2024-03-09T16:57:02.736945+0000, chain.objs.size()=1 2024-03-09T15:07:04.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.3jjhn_smzPFTiSJaFjiBdhCNhdPOKFK_0 2024-03-09T15:07:04.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13181594448756317172', time=2024-03-09T16:57:02.747900+0000, chain.objs.size()=1 2024-03-09T15:07:04.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oBQeGeCgweOzTdRrFBGom-ekEM1eW-d_0 2024-03-09T15:07:04.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5918165438980059284', time=2024-03-09T16:57:02.776924+0000, chain.objs.size()=1 2024-03-09T15:07:04.114 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.HMgiedRzyLty171v6jV0QJK0Vhmrc7X_0 2024-03-09T15:07:04.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10899172621728317307', time=2024-03-09T16:57:02.798065+0000, chain.objs.size()=1 2024-03-09T15:07:04.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.9atMhngKDogprc3r21aen4qEpzO6pgx_0 2024-03-09T15:07:04.118 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13970828394090475042', time=2024-03-09T16:57:02.827754+0000, chain.objs.size()=1 2024-03-09T15:07:04.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.JFuvdH0D2S1ITte8gpUDh1xNQNlRhvx_0 2024-03-09T15:07:04.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6668311603276523523', time=2024-03-09T16:57:02.844138+0000, chain.objs.size()=1 2024-03-09T15:07:04.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.114+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ME3rfvVCrCbF-F7sbWKuW6wbDmcGwEU_0 2024-03-09T15:07:04.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.118+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16053393800122944629', time=2024-03-09T16:57:02.995989+0000, chain.objs.size()=1 2024-03-09T15:07:04.119 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.okOsLcb18oS9Y75BjpM-rC8wLli0dK2_0 2024-03-09T15:07:04.123 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.122+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/51575 2024-03-09T15:07:04.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-03-09T15:07:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3603787063586568927', time=2024-03-09T16:57:03.006858+0000, chain.objs.size()=1 2024-03-09T15:07:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.TlzUw1zcBcnhLmC2pnpu5vhnJygbFiE_0 2024-03-09T15:07:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1604311505978906177', time=2024-03-09T16:57:03.031474+0000, chain.objs.size()=1 2024-03-09T15:07:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.dGwbq9qWeCbL0EGcIEsDR4v--lDgMa__0 2024-03-09T15:07:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13532065049522067676', time=2024-03-09T16:57:03.049624+0000, chain.objs.size()=1 2024-03-09T15:07:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.VN2Uyod9o6EnU-Bl619bUtWS7fDPoSz_0 2024-03-09T15:07:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4568948506682158194', time=2024-03-09T16:57:03.074026+0000, chain.objs.size()=1 2024-03-09T15:07:04.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.YLVAEHEGFh-1_KjBNF3CihxTKTBIxe-_0 2024-03-09T15:07:04.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15428238112922499189', time=2024-03-09T16:57:03.090950+0000, chain.objs.size()=1 2024-03-09T15:07:04.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.qGY_VqgqEIEs6cul4d2hqifiTZJmZus_0 2024-03-09T15:07:04.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17281255943526968055', time=2024-03-09T16:57:03.316184+0000, chain.objs.size()=1 2024-03-09T15:07:04.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.SjkgzndT2zvdQfJSuGLNJxOW4fG7gIe_0 2024-03-09T15:07:04.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7922138672144243711', time=2024-03-09T16:57:03.330509+0000, chain.objs.size()=1 2024-03-09T15:07:04.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.zKG5Ue433CWdybnmS3rXCuzPmBAnOAd_0 2024-03-09T15:07:04.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14484129967546747921', time=2024-03-09T16:57:03.346195+0000, chain.objs.size()=1 2024-03-09T15:07:04.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.zqUODLeYw5CcSoJYV710_1jHty2LVZU_0 2024-03-09T15:07:04.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1463881759060158506', time=2024-03-09T16:59:05.874414+0000, chain.objs.size()=1 2024-03-09T15:07:04.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.448__shadow_.SuVKunDwCYPMbxkT0V63pLNCEWYbILZ_0 2024-03-09T15:07:04.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2626416661652346861', time=2024-03-09T16:59:20.408911+0000, chain.objs.size()=1 2024-03-09T15:07:04.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.460__shadow_.YsNvxReUueoypfqoV25aR4pQ7OjEM5z_0 2024-03-09T15:07:04.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18001747113003606271', time=2024-03-09T16:59:33.178587+0000, chain.objs.size()=1 2024-03-09T15:07:04.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.479__shadow_.xSEJhUriuwzK0O5SvSDKXIhtWMjkIkT_0 2024-03-09T15:07:04.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10723086773725966242', time=2024-03-09T16:59:48.696958+0000, chain.objs.size()=1 2024-03-09T15:07:04.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.497__shadow:sTyMyf-pYbnbXvdieipjbZDtyAqnZAv_.YDOx1qoYlCKjXydeFP7D4JWYzcC9wbk_0 2024-03-09T15:07:04.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.134+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3308930097370532083', time=2024-03-09T17:00:09.892088+0000, chain.objs.size()=3 2024-03-09T15:07:04.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.134+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.515__multipart_mymultipart.2~eVj60ib48WpLOZjVERF949GUOdq_2cu.1 2024-03-09T15:07:04.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.134+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.515__multipart_mymultipart.2~eVj60ib48WpLOZjVERF949GUOdq_2cu.2 2024-03-09T15:07:04.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.134+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.515__multipart_mymultipart.2~eVj60ib48WpLOZjVERF949GUOdq_2cu.3 2024-03-09T15:07:04.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.134+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11104453635310963064', time=2024-03-09T17:01:46.793471+0000, chain.objs.size()=1 2024-03-09T15:07:04.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.134+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.557__shadow_.RxpUpc__FSV8JudMugjIG-JZ7rEmebP_0 2024-03-09T15:07:04.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.134+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17045660418407825480', time=2024-03-09T17:01:57.726297+0000, chain.objs.size()=1 2024-03-09T15:07:04.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.134+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:NlbObVw18yccbY0Hg4ScSVEslGKMGE9_.qg7x82vcglCYlYNsqwKxMQAhfrcnyv5_0 2024-03-09T15:07:04.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.134+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1514579406440060201', time=2024-03-09T17:02:17.593508+0000, chain.objs.size()=1 2024-03-09T15:07:04.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.134+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:sM9iAnwM-tyd-AO9piD38JhkuxOLhbp_.Cn4QIOdfnCD8gCfPCtVu-9lt-UeM1fm_0 2024-03-09T15:07:04.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.134+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8141251519247973821', time=2024-03-09T17:03:46.362178+0000, chain.objs.size()=1 2024-03-09T15:07:04.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.134+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.631__shadow_.Ek29b0wzKBYM0ufR2UNlLKA-ZopwNk9_0 2024-03-09T15:07:04.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.134+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16725262789065103813', time=2024-03-09T17:03:55.342971+0000, chain.objs.size()=2 2024-03-09T15:07:04.136 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.134+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.639__shadow_.g6tOiJ2s1BZBauQEogTpb_fhDgvJ-Ah_0 2024-03-09T15:07:04.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.138+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.639__shadow_.g6tOiJ2s1BZBauQEogTpb_fhDgvJ-Ah_1 2024-03-09T15:07:04.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:04.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.150+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-09T15:07:04.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:04.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:04.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43626' 2024-03-09T15:07:04.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12055364117222039162', time=2024-03-09T16:51:41.707569+0000, chain.objs.size()=1 2024-03-09T15:07:04.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.136__shadow_.ZPadjaHex9WeimskVpIxsXRPTSzGWv8_0 2024-03-09T15:07:04.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13978839120540785190', time=2024-03-09T16:54:21.806572+0000, chain.objs.size()=1 2024-03-09T15:07:04.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.224__shadow_.Zumlmw1GPOfRfhk2SDjeL-RNT7uT20v_0 2024-03-09T15:07:04.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.268339759470806648', time=2024-03-09T16:54:28.982358+0000, chain.objs.size()=1 2024-03-09T15:07:04.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.231__shadow_.J0aXVfYzpROCLzz-oP8iDtQ_mNxhJgQ_0 2024-03-09T15:07:04.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17141589643756797761', time=2024-03-09T16:54:35.452784+0000, chain.objs.size()=1 2024-03-09T15:07:04.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.237__shadow_.eaAV8Wkr7YBKC0Yvv4VG-XcSSIOw6Qs_0 2024-03-09T15:07:04.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13045244619835934570', time=2024-03-09T16:54:37.852442+0000, chain.objs.size()=1 2024-03-09T15:07:04.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.239__shadow_.KWLhAg2A3dk6_J3U0meiVrIuZYcqSDV_0 2024-03-09T15:07:04.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14937617769232065872', time=2024-03-09T16:55:14.911256+0000, chain.objs.size()=1 2024-03-09T15:07:04.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.DUi1KmwZxf44Ov1srb_AI1EmFOM5dYl_0 2024-03-09T15:07:04.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3576373567462205615', time=2024-03-09T16:55:14.913084+0000, chain.objs.size()=1 2024-03-09T15:07:04.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6ILvU7YDfmX4rHNbzNPc60rgLnDPQJD_0 2024-03-09T15:07:04.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15939818200623019207', time=2024-03-09T16:55:14.944309+0000, chain.objs.size()=1 2024-03-09T15:07:04.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.xMWJv-kSYEMdDBRCOKdBkhaCM3nQ36a_0 2024-03-09T15:07:04.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11868222666301897973', time=2024-03-09T16:55:14.972318+0000, chain.objs.size()=1 2024-03-09T15:07:04.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.N16SiiSWbgbJwCTI1A7ZdR9JSzcwqQ4_0 2024-03-09T15:07:04.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7800902919200492644', time=2024-03-09T16:55:14.987920+0000, chain.objs.size()=1 2024-03-09T15:07:04.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ztFMtQNVKn7XXbhyxI-xzdXrQ6EBo9u_0 2024-03-09T15:07:04.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12286116345914203369', time=2024-03-09T16:55:14.988629+0000, chain.objs.size()=1 2024-03-09T15:07:04.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.1geSVPEO5T4wG0iO21Y8GHoZIzy3RX4_0 2024-03-09T15:07:04.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18067103368694045019', time=2024-03-09T16:55:15.180575+0000, chain.objs.size()=1 2024-03-09T15:07:04.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.V44-Uy1er_NmFRmbSz-d2sSyu5QZxNq_0 2024-03-09T15:07:04.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.158+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5221483138872195436', time=2024-03-09T16:55:15.183433+0000, chain.objs.size()=1 2024-03-09T15:07:04.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.158+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.wgOVsHVBCY4tdqhzpGEwRv836tzWr9p_0 2024-03-09T15:07:04.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18179706109686185610', time=2024-03-09T16:55:15.238877+0000, chain.objs.size()=1 2024-03-09T15:07:04.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.SgIjKfJMOmtksfSp3YyJ7WtEozfxDsn_0 2024-03-09T15:07:04.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3049672783041157463', time=2024-03-09T16:55:15.260554+0000, chain.objs.size()=1 2024-03-09T15:07:04.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ewPNGk5pL_NP3Qb7I8xkeuFL_OSB6sv_0 2024-03-09T15:07:04.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13687219360932782195', time=2024-03-09T16:55:15.282673+0000, chain.objs.size()=1 2024-03-09T15:07:04.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.29xpYQjCaW0bLWvw8y66qClyv2f9R6Q_0 2024-03-09T15:07:04.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11547197146481693648', time=2024-03-09T16:55:15.417245+0000, chain.objs.size()=1 2024-03-09T15:07:04.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.jdlmsrq9mwa27RiBvQu9s70wkYDKpF3_0 2024-03-09T15:07:04.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4472948766008311205', time=2024-03-09T16:55:15.428732+0000, chain.objs.size()=1 2024-03-09T15:07:04.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ahQ21KKzNUQiR9bgPQ18cSVuYlt3S8N_0 2024-03-09T15:07:04.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12577187505056432565', time=2024-03-09T16:55:15.477289+0000, chain.objs.size()=1 2024-03-09T15:07:04.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.bp-DL-6s9WqhPnmjTEvxJDur5IHySDe_0 2024-03-09T15:07:04.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17895240994800374779', time=2024-03-09T16:55:15.505466+0000, chain.objs.size()=1 2024-03-09T15:07:04.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.eF7pX4hV6BtzkSwUucwaskNYkIWA05W_0 2024-03-09T15:07:04.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15973552099821013289', time=2024-03-09T16:55:15.675255+0000, chain.objs.size()=1 2024-03-09T15:07:04.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.nw0ZOoWGc0kGS-O7vprID7Xu3PO0weN_0 2024-03-09T15:07:04.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1548585628023015566', time=2024-03-09T16:55:15.769521+0000, chain.objs.size()=1 2024-03-09T15:07:04.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.uYQEYq8167GljAmo6b6LxohW837Ucql_0 2024-03-09T15:07:04.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11710722150516133822', time=2024-03-09T16:55:15.791476+0000, chain.objs.size()=1 2024-03-09T15:07:04.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.-m7VoxtPvbk3R9cT6_zVWA44bcMShji_0 2024-03-09T15:07:04.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5591643361685042191', time=2024-03-09T16:55:15.793880+0000, chain.objs.size()=1 2024-03-09T15:07:04.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qYB9nuvFhCLvWXNS3PZSiSh6EZ78hIf_0 2024-03-09T15:07:04.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2600722282590736751', time=2024-03-09T16:55:15.820255+0000, chain.objs.size()=1 2024-03-09T15:07:04.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.AHZ2ouJSZaA86RenJJs4xMIU210St7P_0 2024-03-09T15:07:04.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.644980395616054009', time=2024-03-09T16:55:15.966171+0000, chain.objs.size()=1 2024-03-09T15:07:04.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.2SB1uw77Wjz_VZWVN8WTwIVBBExE4YR_0 2024-03-09T15:07:04.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6091100154339999580', time=2024-03-09T16:55:15.996226+0000, chain.objs.size()=1 2024-03-09T15:07:04.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.HZrqOHZyyub1uLNX9BpmtsKmoCkCXey_0 2024-03-09T15:07:04.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16488703536610119369', time=2024-03-09T16:55:16.060250+0000, chain.objs.size()=1 2024-03-09T15:07:04.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.mVHSDf6LFhTMjp231MxWmHIbzPW2d8L_0 2024-03-09T15:07:04.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15688700333921107555', time=2024-03-09T16:55:16.255094+0000, chain.objs.size()=1 2024-03-09T15:07:04.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.z5Xb8XWc9Ti0bWBOFURmWeStbrEIy3w_0 2024-03-09T15:07:04.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16396510770922062055', time=2024-03-09T16:55:16.266564+0000, chain.objs.size()=1 2024-03-09T15:07:04.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.IqWGthhni7luLX42v-7NV3-NXNsk9iw_0 2024-03-09T15:07:04.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18098814485675213081', time=2024-03-09T16:55:16.491766+0000, chain.objs.size()=1 2024-03-09T15:07:04.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.XKNC17j4HSP45jS3Ks7IE9PHczMmwK-_0 2024-03-09T15:07:04.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17043059651476560875', time=2024-03-09T16:55:16.531016+0000, chain.objs.size()=1 2024-03-09T15:07:04.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.g9aDmRvE20ZlYDJpdVrnXB0fa_JJMQ9_0 2024-03-09T15:07:04.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12081782178166355254', time=2024-03-09T16:55:16.542458+0000, chain.objs.size()=1 2024-03-09T15:07:04.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.HA5LJ1DQ9CTGcFWplqT1rFCUYD20V4q_0 2024-03-09T15:07:04.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.916745463407123648', time=2024-03-09T16:55:16.606936+0000, chain.objs.size()=1 2024-03-09T15:07:04.172 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.DCL5i0BkPuPFe9533V3za9ZYcBl0G0V_0 2024-03-09T15:07:04.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.174+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12935172461165253638', time=2024-03-09T16:55:16.614386+0000, chain.objs.size()=1 2024-03-09T15:07:04.173 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.174+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.sJSRBzaM1WOnIjf695ZSSAbIgvVX-DO_0 2024-03-09T15:07:04.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18084759814622122730', time=2024-03-09T16:55:16.754536+0000, chain.objs.size()=1 2024-03-09T15:07:04.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6GdYRcbWdQ_E8mPRkLFL8ikVNvtS6Zi_0 2024-03-09T15:07:04.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2040973742546465253', time=2024-03-09T16:55:16.809438+0000, chain.objs.size()=1 2024-03-09T15:07:04.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.k_X3JlxVIgp1-L3ogEk5M8Fp4QnnbLB_0 2024-03-09T15:07:04.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3815955826240073489', time=2024-03-09T16:55:16.813102+0000, chain.objs.size()=1 2024-03-09T15:07:04.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.LP9iXagDxuOpTzCcHJibBM3pxEeaZEA_0 2024-03-09T15:07:04.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4440825887290251311', time=2024-03-09T16:55:35.319715+0000, chain.objs.size()=1 2024-03-09T15:07:04.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.276__shadow_.I_awfvKLFh-2VE1v5NQgdAQoIFqogqI_0 2024-03-09T15:07:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4966111183295144991', time=2024-03-09T16:55:44.576542+0000, chain.objs.size()=1 2024-03-09T15:07:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.285__shadow_.xiQfX5_XiGxInB1fhqtIsSTlHbJaumP_0 2024-03-09T15:07:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17403278755386794040', time=2024-03-09T16:55:48.751636+0000, chain.objs.size()=1 2024-03-09T15:07:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.288__shadow_.YxDfb2iJk57oFI7lsi7Iln0levgjT-K_0 2024-03-09T15:07:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5227624756090595791', time=2024-03-09T16:56:01.755355+0000, chain.objs.size()=1 2024-03-09T15:07:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.301__shadow:3BTtZPjrlLxLOf4GASMtTYE-n6ZiVnB_.jUaW-pIcgzblno0ZLrOl6pT3gFp1Yc7_0 2024-03-09T15:07:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16646006009904091054', time=2024-03-09T16:56:37.734778+0000, chain.objs.size()=1 2024-03-09T15:07:04.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.KN9kuQeKmlcoLY8k3Z4ltYHUkRwSPPA_0 2024-03-09T15:07:04.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3485872484518614428', time=2024-03-09T16:56:37.750449+0000, chain.objs.size()=1 2024-03-09T15:07:04.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.K0tT73rAmUN7gr2tecU3qqz4IlOKm2y_0 2024-03-09T15:07:04.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7914751650693050130', time=2024-03-09T16:56:37.753251+0000, chain.objs.size()=1 2024-03-09T15:07:04.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Kl8LPA9btv-at6tRibLMIrlCy_vxygZ_0 2024-03-09T15:07:04.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13842332354434780995', time=2024-03-09T16:56:37.766901+0000, chain.objs.size()=1 2024-03-09T15:07:04.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.zu-E_XIuDK8DReyomX15KH074EUC9xd_0 2024-03-09T15:07:04.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9440334596049917924', time=2024-03-09T16:56:37.790478+0000, chain.objs.size()=1 2024-03-09T15:07:04.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-D31CtnpZDGfaGu0a_ndaNFzaIraeAt_0 2024-03-09T15:07:04.183 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5682336010259059596', time=2024-03-09T16:56:37.803340+0000, chain.objs.size()=1 2024-03-09T15:07:04.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.j8CxZVEIzFjUZbPquRDipwXl4RECayO_0 2024-03-09T15:07:04.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13044196583779791568', time=2024-03-09T16:56:37.871096+0000, chain.objs.size()=1 2024-03-09T15:07:04.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.SaXmEPFQflYc2T0vYCZytBGyzwubs6W_0 2024-03-09T15:07:04.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.598290323386757172', time=2024-03-09T16:56:38.070644+0000, chain.objs.size()=1 2024-03-09T15:07:04.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.DlUiWuUyZYxv5TruGQjD0E-veaIppOl_0 2024-03-09T15:07:04.185 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.238398273058030448', time=2024-03-09T16:56:38.106160+0000, chain.objs.size()=1 2024-03-09T15:07:04.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.sJmnmJcMf3RTpur3tw6O1A3E9oD-yJ4_0 2024-03-09T15:07:04.186 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6687147218080905775', time=2024-03-09T16:56:38.244958+0000, chain.objs.size()=1 2024-03-09T15:07:04.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.U4M0FSjJgpZ20X-eS7ciKKQAp9CLVba_0 2024-03-09T15:07:04.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7960361867352008670', time=2024-03-09T16:56:38.277206+0000, chain.objs.size()=1 2024-03-09T15:07:04.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.vXL8EMOVCecxohHeOw9rts8vmbMo9Dm_0 2024-03-09T15:07:04.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15470209009956033764', time=2024-03-09T16:56:38.311587+0000, chain.objs.size()=1 2024-03-09T15:07:04.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.HLwHrtj1BdguTDtPe7yRqqIIPjvbdAu_0 2024-03-09T15:07:04.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17063289273250099853', time=2024-03-09T16:56:38.379744+0000, chain.objs.size()=1 2024-03-09T15:07:04.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.PjPLp3J-Rv_QLQcvmXKOv67GX607m8f_0 2024-03-09T15:07:04.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4273898997722972211', time=2024-03-09T16:56:38.525959+0000, chain.objs.size()=1 2024-03-09T15:07:04.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.qjI-x19R8nxBpYYZjPd1WbpYA1zlf0h_0 2024-03-09T15:07:04.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13762199410121380182', time=2024-03-09T16:56:38.780145+0000, chain.objs.size()=1 2024-03-09T15:07:04.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.d5KTFUauB-8vn2VuH7if8T3GsRd1BMi_0 2024-03-09T15:07:04.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.194+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8571459567758664327', time=2024-03-09T16:56:38.826689+0000, chain.objs.size()=1 2024-03-09T15:07:04.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.194+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.PlNfQ78TFegkK-4eZHV2o7jLFMUUtfx_0 2024-03-09T15:07:04.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.194+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8873928815338428540', time=2024-03-09T16:56:38.836743+0000, chain.objs.size()=1 2024-03-09T15:07:04.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.194+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Fgut5VcPVD6zISqmj8kyb6t6tbDRC0U_0 2024-03-09T15:07:04.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.194+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2654877895330290208', time=2024-03-09T16:56:38.853787+0000, chain.objs.size()=1 2024-03-09T15:07:04.193 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.194+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.GUJM3nCRjUePGE6ioaxxKnJjPwM2K1V_0 2024-03-09T15:07:04.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.194+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8189499070475910650', time=2024-03-09T16:56:38.889697+0000, chain.objs.size()=1 2024-03-09T15:07:04.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.194+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.OUCDR9KkaFYPS8SGaJtSvbnMBPJK5Ia_0 2024-03-09T15:07:04.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13022979152600330779', time=2024-03-09T16:56:38.926483+0000, chain.objs.size()=1 2024-03-09T15:07:04.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.TRLw1JuxH8tf1UGUdQ-sLs-UUF4u1eY_0 2024-03-09T15:07:04.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10333811466842251562', time=2024-03-09T16:56:39.095453+0000, chain.objs.size()=1 2024-03-09T15:07:04.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Z5UZBY2549pykMhVLI8-QKhagu594EZ_0 2024-03-09T15:07:04.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4099539117309819418', time=2024-03-09T16:56:39.099818+0000, chain.objs.size()=1 2024-03-09T15:07:04.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.cQoJ3lKgi6WpLm9I3kKfJf_gyQ7-pVp_0 2024-03-09T15:07:04.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14080455494029757183', time=2024-03-09T16:56:39.109219+0000, chain.objs.size()=1 2024-03-09T15:07:04.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.SzGze6dXSgJ_a2yO2Xe8-Wr3NloiZxz_0 2024-03-09T15:07:04.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.941976976663561885', time=2024-03-09T16:56:39.140749+0000, chain.objs.size()=1 2024-03-09T15:07:04.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.954iztDDjuCghyx7bybOrUUJLzhC_il_0 2024-03-09T15:07:04.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8755549811379973290', time=2024-03-09T16:56:39.171093+0000, chain.objs.size()=1 2024-03-09T15:07:04.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.XeCYoNeN-EvRhhuo38Z5K_ZNFV9UWmi_0 2024-03-09T15:07:04.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4792012473297101052', time=2024-03-09T16:56:39.181171+0000, chain.objs.size()=1 2024-03-09T15:07:04.198 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.zTwT0Bxe5WwhBsLoDLEJFXw1S5H8OwI_0 2024-03-09T15:07:04.199 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11184266833986882188', time=2024-03-09T16:56:39.195386+0000, chain.objs.size()=1 2024-03-09T15:07:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kBct5rLsGsceJuO2WxlPQfzVJgG1otj_0 2024-03-09T15:07:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5620219787287284458', time=2024-03-09T16:56:39.369558+0000, chain.objs.size()=1 2024-03-09T15:07:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Qzh3NGGyVN2Sll7QyhC_zYnD4q2AsaR_0 2024-03-09T15:07:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15971079222984226193', time=2024-03-09T16:56:39.373193+0000, chain.objs.size()=1 2024-03-09T15:07:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.2PaM5Hr7x4quQwxmnc8xAFeQ6Y2qIiW_0 2024-03-09T15:07:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14012415122620455188', time=2024-03-09T16:56:39.405517+0000, chain.objs.size()=1 2024-03-09T15:07:04.200 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.YtT0Pg9doV4FtZL4Dao9fG3Sj_iksBE_0 2024-03-09T15:07:04.201 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.202+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14779409849617029479', time=2024-03-09T16:56:39.436143+0000, chain.objs.size()=1 2024-03-09T15:07:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.202+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Q76bR_loS7IkWcWrVS_KcM3YTPoUn1S_0 2024-03-09T15:07:04.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.202+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6262392323913355648', time=2024-03-09T16:56:39.438117+0000, chain.objs.size()=1 2024-03-09T15:07:04.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.202+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.C6OW_zGJ6QQxw7jlrUCk_n6J5fMcbw4_0 2024-03-09T15:07:04.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.202+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10762226457702108429', time=2024-03-09T16:56:39.447563+0000, chain.objs.size()=1 2024-03-09T15:07:04.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.202+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.MAtgzN_PRVjMp0wD4aspfxnmfJ2Rgt1_0 2024-03-09T15:07:04.203 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.202+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6978090356131129829', time=2024-03-09T16:56:39.562018+0000, chain.objs.size()=1 2024-03-09T15:07:04.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.202+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-StWNqtTWZkM8YaDMGcKZU9untFcpSg_0 2024-03-09T15:07:04.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.202+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7962556481817581485', time=2024-03-09T16:56:39.607855+0000, chain.objs.size()=1 2024-03-09T15:07:04.204 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.202+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.c_iS6vBeIgPycHO4OE_sqDQpww5ORXP_0 2024-03-09T15:07:04.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.206+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12383077455968411639', time=2024-03-09T16:56:39.611655+0000, chain.objs.size()=1 2024-03-09T15:07:04.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.aLUvrJONvUH-HIyF80NiUZv8k5Qqg1N_0 2024-03-09T15:07:04.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.206+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18102640410205000028', time=2024-03-09T16:56:39.626471+0000, chain.objs.size()=1 2024-03-09T15:07:04.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.xyU5iCAd-3a1jld5kKrnRduriKUDSc6_0 2024-03-09T15:07:04.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.206+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1223844855108869649', time=2024-03-09T16:56:39.633230+0000, chain.objs.size()=1 2024-03-09T15:07:04.207 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.34ssa34kMUY2lpbusxbmTXPmn0BRHN3_0 2024-03-09T15:07:04.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.206+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15676894467360021021', time=2024-03-09T16:56:39.689129+0000, chain.objs.size()=1 2024-03-09T15:07:04.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.SVUbFnki1gHO4MVh9EKioHPOrsdQELV_0 2024-03-09T15:07:04.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.206+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7304732644059004503', time=2024-03-09T16:57:01.411665+0000, chain.objs.size()=1 2024-03-09T15:07:04.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.MD85Rbs-SoCLYJHFd68bWB2P5zHC4_T_0 2024-03-09T15:07:04.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.206+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15471306024055008337', time=2024-03-09T16:57:01.458540+0000, chain.objs.size()=1 2024-03-09T15:07:04.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.TkXEguAmkZB3g9yRWkjLlQ2DQmfl3Wz_0 2024-03-09T15:07:04.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.210+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3282129379762963668', time=2024-03-09T16:57:01.500102+0000, chain.objs.size()=1 2024-03-09T15:07:04.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.210+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.PIr6nhJpnzvsjPr0LfvdTRuVVmG-CQS_0 2024-03-09T15:07:04.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.210+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9826797317295169538', time=2024-03-09T16:57:01.577942+0000, chain.objs.size()=1 2024-03-09T15:07:04.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.210+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.zb4_luljecVsapV_cPBnTFnpb75Asx-_0 2024-03-09T15:07:04.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.210+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5981909980547917525', time=2024-03-09T16:57:01.797713+0000, chain.objs.size()=1 2024-03-09T15:07:04.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.210+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DarUyHRW3--jWUvHdQVltxeYfTLfrfl_0 2024-03-09T15:07:04.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.210+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10081970489492771232', time=2024-03-09T16:57:01.828193+0000, chain.objs.size()=1 2024-03-09T15:07:04.212 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.210+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.fWt1fdInBelaHJ3YG6d_c8F64sjMl-C_0 2024-03-09T15:07:04.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12205339157907387110', time=2024-03-09T16:57:01.969778+0000, chain.objs.size()=1 2024-03-09T15:07:04.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.voq6-g-T9AmW8_fqzjzBm84R4_Zu_W8_0 2024-03-09T15:07:04.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18199439298074971872', time=2024-03-09T16:57:01.990488+0000, chain.objs.size()=1 2024-03-09T15:07:04.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Iz0c-jveXonRock6FZl-ZmNpeuqk5MP_0 2024-03-09T15:07:04.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.298382148339884312', time=2024-03-09T16:57:02.002998+0000, chain.objs.size()=1 2024-03-09T15:07:04.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Db4uLJFSueK7eeNSN1uerEBlOapMJCB_0 2024-03-09T15:07:04.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15403404763430050776', time=2024-03-09T16:57:02.017821+0000, chain.objs.size()=1 2024-03-09T15:07:04.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.mFX8PHduPrlx06-oFGF_zWjuDqjftS7_0 2024-03-09T15:07:04.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15174985106780060557', time=2024-03-09T16:57:02.045242+0000, chain.objs.size()=1 2024-03-09T15:07:04.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.loSwGhxdCsdtGTexsvxxK05Tcezmze7_0 2024-03-09T15:07:04.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14856371850596340597', time=2024-03-09T16:57:02.056440+0000, chain.objs.size()=1 2024-03-09T15:07:04.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.7-DeqZY5beufMIn2SKOHn4FpfzDPHe5_0 2024-03-09T15:07:04.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15302922450570368059', time=2024-03-09T16:57:02.094673+0000, chain.objs.size()=1 2024-03-09T15:07:04.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xheaXl96qbEek09XLHA5JjBMZE7tOb6_0 2024-03-09T15:07:04.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2125084044531579954', time=2024-03-09T16:57:02.104981+0000, chain.objs.size()=1 2024-03-09T15:07:04.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.t1hxCLSReEAYmbMb7SvCuh5cOrzKIGR_0 2024-03-09T15:07:04.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2629253520488446992', time=2024-03-09T16:57:02.218869+0000, chain.objs.size()=1 2024-03-09T15:07:04.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.kg-6xx0__KTqB4l6qsApYp5N5RuyQbI_0 2024-03-09T15:07:04.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12416684489429627487', time=2024-03-09T16:57:02.221793+0000, chain.objs.size()=1 2024-03-09T15:07:04.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.v4VFDAr6toenNPCKp1tunIo4nyOBapv_0 2024-03-09T15:07:04.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1884014244402358551', time=2024-03-09T16:57:02.350998+0000, chain.objs.size()=1 2024-03-09T15:07:04.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.X6ovFMmBaB6_xHFmYbUjxDk_nZKxLgt_0 2024-03-09T15:07:04.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4318846343269552370', time=2024-03-09T16:57:02.507819+0000, chain.objs.size()=1 2024-03-09T15:07:04.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.wcICG8gxjsYLSwoxXrNAAx43QtQoqOp_0 2024-03-09T15:07:04.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5003948973039077787', time=2024-03-09T16:57:02.530186+0000, chain.objs.size()=1 2024-03-09T15:07:04.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.lSe8aB2vOy1S1vnX5lXiL0jIVpny34s_0 2024-03-09T15:07:04.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.226+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/43626 2024-03-09T15:07:04.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-03-09T15:07:04.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2585063237571614247', time=2024-03-09T16:57:02.569118+0000, chain.objs.size()=1 2024-03-09T15:07:04.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.8iGRveapRlJU-6jyOLxu0rKQtv8rldd_0 2024-03-09T15:07:04.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13644333474086169780', time=2024-03-09T16:57:02.611901+0000, chain.objs.size()=1 2024-03-09T15:07:04.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.99jGB9aVP6sG2FXcnXcwyd7HzkgHqNl_0 2024-03-09T15:07:04.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13370977692579466327', time=2024-03-09T16:57:02.736579+0000, chain.objs.size()=1 2024-03-09T15:07:04.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.qP1Njjp0V6oKUelInn5nQC5HOGQkNRw_0 2024-03-09T15:07:04.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18182112055376354055', time=2024-03-09T16:57:02.780872+0000, chain.objs.size()=1 2024-03-09T15:07:04.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.PYcakJFp2yB0U62PeHdXymmkMPPr3zL_0 2024-03-09T15:07:04.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1232262062592424090', time=2024-03-09T16:57:02.782155+0000, chain.objs.size()=1 2024-03-09T15:07:04.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.eVZNWnJWCBngufAFvQGCN-Q28ryrB6F_0 2024-03-09T15:07:04.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5525096770115926496', time=2024-03-09T16:57:02.792198+0000, chain.objs.size()=1 2024-03-09T15:07:04.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.IJs3YvosdKNK48apVRBgtV1AlSSE82e_0 2024-03-09T15:07:04.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8173231200488310416', time=2024-03-09T16:57:02.806809+0000, chain.objs.size()=1 2024-03-09T15:07:04.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.95qJSGQuvHUA0blevgO1zsqOoYKAdTF_0 2024-03-09T15:07:04.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13055609816390537947', time=2024-03-09T16:57:02.825524+0000, chain.objs.size()=1 2024-03-09T15:07:04.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.O8eqM-riu3_q8gK8TQSJQuzYs80BRZC_0 2024-03-09T15:07:04.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17340034557801996622', time=2024-03-09T16:57:02.827408+0000, chain.objs.size()=1 2024-03-09T15:07:04.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.A9nlxwk67mSU8wzYdTklM5SgnSMWrPu_0 2024-03-09T15:07:04.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.541199423275340782', time=2024-03-09T16:57:02.839790+0000, chain.objs.size()=1 2024-03-09T15:07:04.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.PlLXVTqcMnRLjUHgekHGjqNxeO8FDSC_0 2024-03-09T15:07:04.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17645821569026838039', time=2024-03-09T16:57:02.869603+0000, chain.objs.size()=1 2024-03-09T15:07:04.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oQcdHMSXEKAHvxKvcw45Rt4eePYTyh4_0 2024-03-09T15:07:04.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17291308006598001337', time=2024-03-09T16:57:02.993407+0000, chain.objs.size()=1 2024-03-09T15:07:04.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.JJw27CvADyqt9EDHn8kqWl_WljHGpoI_0 2024-03-09T15:07:04.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7957728767653906891', time=2024-03-09T16:57:03.050166+0000, chain.objs.size()=1 2024-03-09T15:07:04.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.i0qIkt1PZUJbwCsForkHlTf1W5uY7zp_0 2024-03-09T15:07:04.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.238+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18142075119940892614', time=2024-03-09T16:57:03.105810+0000, chain.objs.size()=1 2024-03-09T15:07:04.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.wooZb9H7DuAeBQHUfPMSUTLb9aPHESj_0 2024-03-09T15:07:04.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.238+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2569028036373110651', time=2024-03-09T16:57:03.296860+0000, chain.objs.size()=1 2024-03-09T15:07:04.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.1omkiVungy9dD-asASl_XvpdaaOOugs_0 2024-03-09T15:07:04.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.238+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17701196837468736446', time=2024-03-09T16:57:03.300591+0000, chain.objs.size()=1 2024-03-09T15:07:04.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.yiRsen4EycZxr_0RCv04DEZyJ_pvxoM_0 2024-03-09T15:07:04.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.238+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12225990162219830554', time=2024-03-09T16:57:03.332696+0000, chain.objs.size()=1 2024-03-09T15:07:04.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.085cLcSAgzv-xU3kJkdH_0YSDShUKwX_0 2024-03-09T15:07:04.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.238+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2082870978166944669', time=2024-03-09T16:57:52.148214+0000, chain.objs.size()=1 2024-03-09T15:07:04.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.373__shadow_.sevgPvUt_BNprOyLcyXO_bQJhFBykgQ_0 2024-03-09T15:07:04.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.238+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11037853016925450795', time=2024-03-09T16:59:31.475852+0000, chain.objs.size()=1 2024-03-09T15:07:04.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.477__shadow_.d_HFc86ca54FGN5fvwrzSYSAriGD7q2_0 2024-03-09T15:07:04.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.238+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17864789416899964783', time=2024-03-09T17:00:06.428710+0000, chain.objs.size()=6 2024-03-09T15:07:04.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.513__multipart_mymultipart.2~YCHY2OunZXv6GV8ZMcO7vEbLj2Z7SiM.1 2024-03-09T15:07:04.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.513__multipart_mymultipart.2~YCHY2OunZXv6GV8ZMcO7vEbLj2Z7SiM.2 2024-03-09T15:07:04.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.242+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.513__multipart_mymultipart.2~YCHY2OunZXv6GV8ZMcO7vEbLj2Z7SiM.3 2024-03-09T15:07:04.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.242+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.513__multipart_mymultipart.2~YCHY2OunZXv6GV8ZMcO7vEbLj2Z7SiM.4 2024-03-09T15:07:04.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.242+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.513__multipart_mymultipart.2~YCHY2OunZXv6GV8ZMcO7vEbLj2Z7SiM.5 2024-03-09T15:07:04.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.513__multipart_mymultipart.2~YCHY2OunZXv6GV8ZMcO7vEbLj2Z7SiM.6 2024-03-09T15:07:04.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.645625627159694642', time=2024-03-09T17:02:02.979360+0000, chain.objs.size()=1 2024-03-09T15:07:04.246 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.565__shadow:uu0.FFYp6mcQTqfrG2kSVFYNFgUhOAE_.Q2-Ma5maHqAlfs-tNZ95qyWK5tPSFz-_0 2024-03-09T15:07:04.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15555782468424891791', time=2024-03-09T17:02:08.338282+0000, chain.objs.size()=1 2024-03-09T15:07:04.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.567__shadow:axUlO3E3-OG.BZCwEOE1MI9eg0xLZ70_.U0-65QnVgCke6-vRp35_jq4jyJPgLF6_0 2024-03-09T15:07:04.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12946898118584420622', time=2024-03-09T17:02:22.338366+0000, chain.objs.size()=1 2024-03-09T15:07:04.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:Y6oqQ6u4nB2H9j9Zdi4FHBoQXZLvcGS_.cQIXVnsF3jDYZTaWoEOFylRKEM6c5to_0 2024-03-09T15:07:04.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7014857848829223825', time=2024-03-09T17:02:37.603534+0000, chain.objs.size()=1 2024-03-09T15:07:04.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.572__shadow:m51BDZ0FpxMOlfGaiBitKAumoA4wGYP_.9QsJ93QzCd4roT6tqxvCtp9lrF6Novg_0 2024-03-09T15:07:04.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14444901523081882338', time=2024-03-09T17:02:44.307732+0000, chain.objs.size()=1 2024-03-09T15:07:04.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.578__shadow:FN.L7wDoGNLUwvooI7-Kj7g3CXd2Ifv_.WXVA01lXzWrx6kidMlTJXq54b9v0jN1_0 2024-03-09T15:07:04.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4472452948956188500', time=2024-03-09T17:02:46.411040+0000, chain.objs.size()=1 2024-03-09T15:07:04.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.580__shadow:gKxJU8ALegl9DEVmmeADPJB0FKnq4LT_.MlJ17KqbZreMptCHpH5oOcjEdOIaYv7_0 2024-03-09T15:07:04.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8598036155038937232', time=2024-03-09T17:03:51.917425+0000, chain.objs.size()=1 2024-03-09T15:07:04.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.636__shadow_.Hr5M3Ux0Lu_YUDj5HFQzJBHPMG6Q-2J_0 2024-03-09T15:07:04.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13228630569208627235', time=2024-03-09T17:04:35.525082+0000, chain.objs.size()=1 2024-03-09T15:07:04.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.684__shadow_.F0223WQgT36x5qTfwpnZGzGJ2EMluPe_0 2024-03-09T15:07:04.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.250+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7927545691735152291', time=2024-03-09T17:04:36.322215+0000, chain.objs.size()=1 2024-03-09T15:07:04.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.250+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.685__shadow:N9T6np18wpUdXlqJclAys3VQy5D.odO_.U4XU3AlYsEaD95xrClIL7uHv2I3eYch_0 2024-03-09T15:07:04.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.250+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14852548105779513445', time=2024-03-09T17:05:53.957126+0000, chain.objs.size()=1 2024-03-09T15:07:04.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.250+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.731__shadow_.uhAodI2a_mGcbAGntGrmYggoCm8hGMd_0 2024-03-09T15:07:04.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.254+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:04.261 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.262+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-09T15:07:04.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.262+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:04.263 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.262+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:04.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.262+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42990' 2024-03-09T15:07:04.264 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.262+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10329468059128288399', time=2024-03-09T16:52:42.676630+0000, chain.objs.size()=1 2024-03-09T15:07:04.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.262+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.194__shadow_.qKKAvyYyBzYooZoMBIGdiYq-v1bKwA6_0 2024-03-09T15:07:04.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.262+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6470600165863579971', time=2024-03-09T16:54:26.581134+0000, chain.objs.size()=1 2024-03-09T15:07:04.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.262+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.229__shadow_.FvqT89kDhtj149Zv8epfWx9sylHF6Xp_0 2024-03-09T15:07:04.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.262+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15943787069225475999', time=2024-03-09T16:54:30.412832+0000, chain.objs.size()=1 2024-03-09T15:07:04.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.232__shadow_.PWIFL3_bOKx5CaBuKrXuEwjw5uLOB6h_0 2024-03-09T15:07:04.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8860367045031845720', time=2024-03-09T16:54:33.111733+0000, chain.objs.size()=1 2024-03-09T15:07:04.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.235__shadow_.ulyJDoML4QrfWXa4BdochatrhQomYdn_0 2024-03-09T15:07:04.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17764719467077283932', time=2024-03-09T16:54:34.034409+0000, chain.objs.size()=1 2024-03-09T15:07:04.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.236__shadow_.K7aTAu9KnA7fcqkfDEu8GEM4EzYsC0n_0 2024-03-09T15:07:04.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1917157134295632991', time=2024-03-09T16:54:41.507569+0000, chain.objs.size()=1 2024-03-09T15:07:04.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.243__shadow_.exOLcWDmJxYrGqv78hjzRYBNs6vklYS_0 2024-03-09T15:07:04.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9569980098208166969', time=2024-03-09T16:55:14.948518+0000, chain.objs.size()=1 2024-03-09T15:07:04.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.XNyHEUDuqhNbp_uT3sUpoDT-9xe5kXg_0 2024-03-09T15:07:04.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2146339647531609624', time=2024-03-09T16:55:14.960235+0000, chain.objs.size()=1 2024-03-09T15:07:04.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.a6uOP3_kHyn04sD9gQIBnvPVUKcu0rt_0 2024-03-09T15:07:04.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6002133138345092973', time=2024-03-09T16:55:14.961860+0000, chain.objs.size()=1 2024-03-09T15:07:04.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.q4K9QfC9zBl5pbRrZ_lfU9SWASakirl_0 2024-03-09T15:07:04.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9217418534233691341', time=2024-03-09T16:55:14.985732+0000, chain.objs.size()=1 2024-03-09T15:07:04.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.QEBSmgnhtbgcurCeKVLvx0i1LOJ49HV_0 2024-03-09T15:07:04.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10499771470100505624', time=2024-03-09T16:55:14.986488+0000, chain.objs.size()=1 2024-03-09T15:07:04.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.NZmKy81TnAPL4nNFMLkKPGiBWT4g2zL_0 2024-03-09T15:07:04.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5854185851340102934', time=2024-03-09T16:55:14.987159+0000, chain.objs.size()=1 2024-03-09T15:07:04.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.uTLwFa7XDcP7mCwbd8x-HXkvY6dRDdE_0 2024-03-09T15:07:04.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4927901830875316876', time=2024-03-09T16:55:15.142910+0000, chain.objs.size()=1 2024-03-09T15:07:04.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.es52Dqe1sF7WsUuejo7k7VaHwQbgEfl_0 2024-03-09T15:07:04.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12546820491428877609', time=2024-03-09T16:55:15.187782+0000, chain.objs.size()=1 2024-03-09T15:07:04.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.amdDz9AlbYldP0kPtfb2QA7nUu5O1wM_0 2024-03-09T15:07:04.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17816503889274017102', time=2024-03-09T16:55:15.189456+0000, chain.objs.size()=1 2024-03-09T15:07:04.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.xWOZqMJ0SRRUOHURzZUaaBnDAc8cAvI_0 2024-03-09T15:07:04.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1669063796494409140', time=2024-03-09T16:55:15.399939+0000, chain.objs.size()=1 2024-03-09T15:07:04.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ESaXZDit0NHqsr442HYrdH7hpQcCutb_0 2024-03-09T15:07:04.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12099607063292480826', time=2024-03-09T16:55:15.438466+0000, chain.objs.size()=1 2024-03-09T15:07:04.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.BZRuwXx-zAdVNatBIOVojoMdUymYy-u_0 2024-03-09T15:07:04.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7730443970503374464', time=2024-03-09T16:55:15.750447+0000, chain.objs.size()=1 2024-03-09T15:07:04.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.OQ4d8r1sE13cI5nVXrwj8_K0g2b0SO__0 2024-03-09T15:07:04.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3724049371754928300', time=2024-03-09T16:55:15.765544+0000, chain.objs.size()=1 2024-03-09T15:07:04.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.GJKZN9Ey4s37UWoDYs-qPPnQrHzA-mn_0 2024-03-09T15:07:04.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10473407094520014079', time=2024-03-09T16:55:15.983645+0000, chain.objs.size()=1 2024-03-09T15:07:04.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qIw_xAjJ8HmQo572NJEZkd6arUH-tQU_0 2024-03-09T15:07:04.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3735791300785010859', time=2024-03-09T16:55:15.991568+0000, chain.objs.size()=1 2024-03-09T15:07:04.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Y12hPnbmt3OxH9eiuv4-JwVNWqOitbQ_0 2024-03-09T15:07:04.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1238820863986360102', time=2024-03-09T16:55:16.044880+0000, chain.objs.size()=1 2024-03-09T15:07:04.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.bFJz9LXWAg0G7gQs4JBiYHuAdW4T57C_0 2024-03-09T15:07:04.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4267222180441641584', time=2024-03-09T16:55:16.049555+0000, chain.objs.size()=1 2024-03-09T15:07:04.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.-EIjEUA_DrTl6cVOY0-3vpy2vpZ0ygh_0 2024-03-09T15:07:04.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.274+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6370652692286751422', time=2024-03-09T16:55:16.057555+0000, chain.objs.size()=1 2024-03-09T15:07:04.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.274+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.nGx36Zw99IE8DC1KxZPbB3m9vf5pCdR_0 2024-03-09T15:07:04.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12271038534777738451', time=2024-03-09T16:55:16.088496+0000, chain.objs.size()=1 2024-03-09T15:07:04.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.99zu_LWBjKtr8ozjj79L51SX8w4WT0Q_0 2024-03-09T15:07:04.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9048738738831548343', time=2024-03-09T16:55:16.496830+0000, chain.objs.size()=1 2024-03-09T15:07:04.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.5JZ0S49qhr9Ns61CSkoEsQsh-ByL3En_0 2024-03-09T15:07:04.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13336702277519709700', time=2024-03-09T16:55:16.543172+0000, chain.objs.size()=1 2024-03-09T15:07:04.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.OFNxoAkzCQf9VfQz1CUQKPe75L_EKM-_0 2024-03-09T15:07:04.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14782164618100796426', time=2024-03-09T16:55:16.566601+0000, chain.objs.size()=1 2024-03-09T15:07:04.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.0IVyidYLugltYValKwLk5qmaNHqMO9q_0 2024-03-09T15:07:04.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10810639806702519123', time=2024-03-09T16:55:16.577238+0000, chain.objs.size()=1 2024-03-09T15:07:04.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.x-e5EaYwsO3e93txzuMiJkQ42R2nBci_0 2024-03-09T15:07:04.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2791902479630541287', time=2024-03-09T16:55:16.598931+0000, chain.objs.size()=1 2024-03-09T15:07:04.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.MNPJuS2w2JzR0ajpVFp9E6WvHwFDtR5_0 2024-03-09T15:07:04.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6211693080940617374', time=2024-03-09T16:55:16.606003+0000, chain.objs.size()=1 2024-03-09T15:07:04.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.KPAQqsxcjM5bSaMi6hwev5a8hrZ3xjH_0 2024-03-09T15:07:04.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6376137913106655997', time=2024-03-09T16:55:16.610799+0000, chain.objs.size()=1 2024-03-09T15:07:04.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6i5VpMmAfbBf4ZYaADX8G4tkGKxgeMV_0 2024-03-09T15:07:04.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8836999005966078186', time=2024-03-09T16:55:16.619470+0000, chain.objs.size()=1 2024-03-09T15:07:04.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.QYOL9nlA-QbAFJT5W-Nqw82-fJaQTcr_0 2024-03-09T15:07:04.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15951596433148276537', time=2024-03-09T16:55:16.795559+0000, chain.objs.size()=1 2024-03-09T15:07:04.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qs_3OVl2EXts1C9R6LcCIm1Vhkd6jwS_0 2024-03-09T15:07:04.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6524971237323599724', time=2024-03-09T16:55:16.822275+0000, chain.objs.size()=1 2024-03-09T15:07:04.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.7TOb1dPra5lD9UyAbKFxKT-uHo26k50_0 2024-03-09T15:07:04.284 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11387160357498252582', time=2024-03-09T16:55:32.493455+0000, chain.objs.size()=1 2024-03-09T15:07:04.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.273__shadow_.PnXsnjJdhCtI-oIJ6gOZ6F6CiGGCCaT_0 2024-03-09T15:07:04.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11189024221805705132', time=2024-03-09T16:55:33.406988+0000, chain.objs.size()=1 2024-03-09T15:07:04.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.274__shadow_.wS0f6is8IAnPzcQ5hiyHBUwBo8ozzya_0 2024-03-09T15:07:04.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17743004623252863859', time=2024-03-09T16:55:46.230081+0000, chain.objs.size()=1 2024-03-09T15:07:04.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.MQJh5luypRdxPfaKDGn2-kOqznfKEPQ_0 2024-03-09T15:07:04.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9979280511807246013', time=2024-03-09T16:55:47.874630+0000, chain.objs.size()=1 2024-03-09T15:07:04.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.fpxXwjzJUOaLgCK9DIBu7OWdJnBYXPy_0 2024-03-09T15:07:04.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7470655931502013624', time=2024-03-09T16:55:56.386794+0000, chain.objs.size()=1 2024-03-09T15:07:04.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.296__shadow_.QM5awmAHVwfkC7Uh_gZ6ze_kMXs343__0 2024-03-09T15:07:04.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14081797235132871989', time=2024-03-09T16:56:10.250700+0000, chain.objs.size()=1 2024-03-09T15:07:04.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.282+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.309__shadow_.10UJDZjljRZOQ34kbcUBQLYZIjl8atd_0 2024-03-09T15:07:04.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.290+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9778384419269837168', time=2024-03-09T16:56:13.690431+0000, chain.objs.size()=1 2024-03-09T15:07:04.291 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.290+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.313__shadow:c97clFWQ4a6j1EAPpOO7WODPqO2ivi5_.DTcECe0EKEdtQCRSZdB4YjuXz3o0GX5_0 2024-03-09T15:07:04.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.290+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4588876516312040616', time=2024-03-09T16:56:37.744820+0000, chain.objs.size()=1 2024-03-09T15:07:04.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.290+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.P6lHHiAb8nqglvx38yESDu_hWDyD1Zg_0 2024-03-09T15:07:04.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.290+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1494395674603718186', time=2024-03-09T16:56:37.770971+0000, chain.objs.size()=1 2024-03-09T15:07:04.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.290+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.YQxllzJ3u19-14W_vrYGzX9Y107GXqf_0 2024-03-09T15:07:04.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.290+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7135881278403169976', time=2024-03-09T16:56:37.798932+0000, chain.objs.size()=1 2024-03-09T15:07:04.292 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.290+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.U48Ls6PUKNrTbgCqAyjuij0NCdMYsc0_0 2024-03-09T15:07:04.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5777241567239529066', time=2024-03-09T16:56:37.833486+0000, chain.objs.size()=1 2024-03-09T15:07:04.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.pSXEoonjmbypAB37M65tNKvwH6hYe4l_0 2024-03-09T15:07:04.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14176633406373688223', time=2024-03-09T16:56:37.844136+0000, chain.objs.size()=1 2024-03-09T15:07:04.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.41o1KCmId4uTJvPVxZsT6qZjG7ZE5S3_0 2024-03-09T15:07:04.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10160434722874051658', time=2024-03-09T16:56:38.007339+0000, chain.objs.size()=1 2024-03-09T15:07:04.293 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.5kJ_PuTyPam47yoCi6VigBoydqrLYTb_0 2024-03-09T15:07:04.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13410959392155776155', time=2024-03-09T16:56:38.066629+0000, chain.objs.size()=1 2024-03-09T15:07:04.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.CEhKZikfVSMI6U1Z_EVGl08Rh_eFPle_0 2024-03-09T15:07:04.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12066831112506609590', time=2024-03-09T16:56:38.076881+0000, chain.objs.size()=1 2024-03-09T15:07:04.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.XFB_5JQHpQBsdQ3OcGbSH_D5UWkTs48_0 2024-03-09T15:07:04.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8977653802342332057', time=2024-03-09T16:56:38.115704+0000, chain.objs.size()=1 2024-03-09T15:07:04.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.8SI2Y0I90DXiH5puiNKtqhInqMjBahU_0 2024-03-09T15:07:04.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17762556594815906910', time=2024-03-09T16:56:38.128036+0000, chain.objs.size()=1 2024-03-09T15:07:04.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.AGprXgTBNQ1e8Up_Az_l7tl_-ZbMONQ_0 2024-03-09T15:07:04.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4847022737529487602', time=2024-03-09T16:56:38.267072+0000, chain.objs.size()=1 2024-03-09T15:07:04.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.L0bur5LmqRogvJgsd9QIE8FPu6NZCcw_0 2024-03-09T15:07:04.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11261025793093346256', time=2024-03-09T16:56:38.270495+0000, chain.objs.size()=1 2024-03-09T15:07:04.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.RXUcs0NtGc9hIF7FNWn3WuxxQYfrw36_0 2024-03-09T15:07:04.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4592520025710848384', time=2024-03-09T16:56:38.272066+0000, chain.objs.size()=1 2024-03-09T15:07:04.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0HpUDQElj9HzjUiInucqw1vWxFN1pja_0 2024-03-09T15:07:04.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10344314936656039509', time=2024-03-09T16:56:38.301465+0000, chain.objs.size()=1 2024-03-09T15:07:04.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.4EOp4KPgPZw7MsagLDBK1PPkKznRGLi_0 2024-03-09T15:07:04.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1457213190328051046', time=2024-03-09T16:56:38.310615+0000, chain.objs.size()=1 2024-03-09T15:07:04.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.bYUASsDH9hJX3n60akrdNRrvlaHhBRg_0 2024-03-09T15:07:04.299 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3889703087761039625', time=2024-03-09T16:56:38.342315+0000, chain.objs.size()=1 2024-03-09T15:07:04.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.UinQtX7VWsVqg0tS0OoOQLxCC2DrCIs_0 2024-03-09T15:07:04.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16777440467987308508', time=2024-03-09T16:56:38.353768+0000, chain.objs.size()=1 2024-03-09T15:07:04.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.PjDKk-6FllKoUIXfuzJY8nUTf0M_VbY_0 2024-03-09T15:07:04.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.302+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15626376000975416287', time=2024-03-09T16:56:38.512329+0000, chain.objs.size()=1 2024-03-09T15:07:04.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.B5F91Q1dirW1w-WjqH_76ZCLXprhz8h_0 2024-03-09T15:07:04.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.302+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11133420452873089360', time=2024-03-09T16:56:38.531339+0000, chain.objs.size()=1 2024-03-09T15:07:04.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ERiO6nS5fBMsZhseaCkRSzNGRs6T6Au_0 2024-03-09T15:07:04.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.302+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7638507880511977875', time=2024-03-09T16:56:38.580487+0000, chain.objs.size()=1 2024-03-09T15:07:04.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.R5oA2nDmr1tAcqqPgr72_qMeiyb5auq_0 2024-03-09T15:07:04.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.302+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15639508391451407669', time=2024-03-09T16:56:38.592295+0000, chain.objs.size()=1 2024-03-09T15:07:04.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.58aeCtHOEV9r9BfUTdEbe_Tjinz4iM1_0 2024-03-09T15:07:04.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.302+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6285111667517235054', time=2024-03-09T16:56:38.624931+0000, chain.objs.size()=1 2024-03-09T15:07:04.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.oARzd39dDweOz3hOtDqUTTAWCJMa5rB_0 2024-03-09T15:07:04.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.302+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4053999276388222947', time=2024-03-09T16:56:38.634955+0000, chain.objs.size()=1 2024-03-09T15:07:04.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.2hpIxZU_fTrats8JqXPIr_RKwEHvxAM_0 2024-03-09T15:07:04.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13230118492815095010', time=2024-03-09T16:56:38.834190+0000, chain.objs.size()=1 2024-03-09T15:07:04.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.EoMJ5rUouNa0a1YsVdJ8n_FXHka07t-_0 2024-03-09T15:07:04.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16214949520471877531', time=2024-03-09T16:56:38.848624+0000, chain.objs.size()=1 2024-03-09T15:07:04.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.oO54bIizp8fbphkxH-LWXzdIQgA4hb9_0 2024-03-09T15:07:04.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2775894929647887325', time=2024-03-09T16:56:38.914692+0000, chain.objs.size()=1 2024-03-09T15:07:04.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.dp9R7KCDyFEuDWKjdruT2FcNNMErRUD_0 2024-03-09T15:07:04.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10563051030575262593', time=2024-03-09T16:56:39.035773+0000, chain.objs.size()=1 2024-03-09T15:07:04.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.JRIshhbKO9Es1iP5KJ0EsHThgi-Qn9X_0 2024-03-09T15:07:04.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10354885086358876300', time=2024-03-09T16:56:39.042948+0000, chain.objs.size()=1 2024-03-09T15:07:04.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ag1ri_5s_xZkBwWoXJER87nEkwZprhO_0 2024-03-09T15:07:04.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14159041933071816027', time=2024-03-09T16:56:39.302863+0000, chain.objs.size()=1 2024-03-09T15:07:04.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.QcFzGXe_a7UYj4o4QlDL6piYkJ4IPDU_0 2024-03-09T15:07:04.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17102795209133517090', time=2024-03-09T16:56:39.323179+0000, chain.objs.size()=1 2024-03-09T15:07:04.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.GwS1cY_3Jnfv13FLFvIlJgitYpIptr0_0 2024-03-09T15:07:04.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3704469800516046487', time=2024-03-09T16:56:39.382292+0000, chain.objs.size()=1 2024-03-09T15:07:04.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.AaUmS1mKYMveFn-s9amKgMARLXF3udj_0 2024-03-09T15:07:04.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15379259462345291716', time=2024-03-09T16:56:39.442299+0000, chain.objs.size()=1 2024-03-09T15:07:04.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.uquWL6GD3xRrabrrTPvyZJb244O5TTE_0 2024-03-09T15:07:04.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.41969492568238313', time=2024-03-09T16:56:39.566688+0000, chain.objs.size()=1 2024-03-09T15:07:04.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.dtnmKRXtMUpddNvKlQeKGMMTezWzoFC_0 2024-03-09T15:07:04.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5922246164438611487', time=2024-03-09T16:56:39.640948+0000, chain.objs.size()=1 2024-03-09T15:07:04.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lluTY1rYaALzi8LMUC4l8lb41excbPJ_0 2024-03-09T15:07:04.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.314+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13488801251988237680', time=2024-03-09T16:56:39.659898+0000, chain.objs.size()=1 2024-03-09T15:07:04.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.314+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.PnNVo-lwNHuC3t6tjcWavL5tBCtEP2g_0 2024-03-09T15:07:04.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5193025534470017659', time=2024-03-09T16:57:01.477618+0000, chain.objs.size()=1 2024-03-09T15:07:04.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.9Oh7hj5wDXtvwPILIBR9JNE8tJh8KKN_0 2024-03-09T15:07:04.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6445917195090369689', time=2024-03-09T16:57:01.540338+0000, chain.objs.size()=1 2024-03-09T15:07:04.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DPSksEvkRj0326I86j58iBL5wG_sp9w_0 2024-03-09T15:07:04.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2596266081710447057', time=2024-03-09T16:57:01.550459+0000, chain.objs.size()=1 2024-03-09T15:07:04.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Kkaz60J9R5sUSacNqwUa3fxvRByii2A_0 2024-03-09T15:07:04.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17505346492668511638', time=2024-03-09T16:57:01.576549+0000, chain.objs.size()=1 2024-03-09T15:07:04.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.vVcSncm-Z0YzcH2we3sQMnA8ScmAOoj_0 2024-03-09T15:07:04.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10993178229988881749', time=2024-03-09T16:57:01.763330+0000, chain.objs.size()=1 2024-03-09T15:07:04.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.sA04-khKFB9eaF16uh6JSuXgGQB8V--_0 2024-03-09T15:07:04.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15142799295561208692', time=2024-03-09T16:57:01.817771+0000, chain.objs.size()=1 2024-03-09T15:07:04.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ZmkSAKKSqS4534gDKaND3pbz_bbKFJU_0 2024-03-09T15:07:04.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5647692728371687263', time=2024-03-09T16:57:01.834856+0000, chain.objs.size()=1 2024-03-09T15:07:04.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xwQ1XOPL_yM7mfx5_aXhHwE98lb2RGx_0 2024-03-09T15:07:04.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8062800102149396899', time=2024-03-09T16:57:01.842664+0000, chain.objs.size()=1 2024-03-09T15:07:04.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Egne1spI_A0QWl4zNBndi2PfMRUJBUI_0 2024-03-09T15:07:04.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10982604410207770781', time=2024-03-09T16:57:02.015180+0000, chain.objs.size()=1 2024-03-09T15:07:04.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xpNlQTBSAxaDrAKxK3lOS2Z7zGfcWIM_0 2024-03-09T15:07:04.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8003110947682229108', time=2024-03-09T16:57:02.016401+0000, chain.objs.size()=1 2024-03-09T15:07:04.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Mu5n6Y7VKh9BMOo1mf1EufmQN7ZWqR-_0 2024-03-09T15:07:04.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.322+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1866660093523047838', time=2024-03-09T16:57:02.079821+0000, chain.objs.size()=1 2024-03-09T15:07:04.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.322+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_._N81TmdZKzHA7c5rm7JPLi6J5MVbc-8_0 2024-03-09T15:07:04.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.322+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3929658854121879025', time=2024-03-09T16:57:02.301716+0000, chain.objs.size()=1 2024-03-09T15:07:04.322 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.322+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.vxd9aD3Sc-21BBqpPOoaFUqhlPm01kt_0 2024-03-09T15:07:04.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17546212788483971191', time=2024-03-09T16:57:02.329040+0000, chain.objs.size()=1 2024-03-09T15:07:04.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.d5LK5sePTBoOPg9Rm2FEPEC86RMGyYw_0 2024-03-09T15:07:04.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7340456788694444396', time=2024-03-09T16:57:02.371472+0000, chain.objs.size()=1 2024-03-09T15:07:04.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.aN9EniUU_E1O8IwdNjfebPRuY8zaavo_0 2024-03-09T15:07:04.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12165196747987176574', time=2024-03-09T16:57:02.531651+0000, chain.objs.size()=1 2024-03-09T15:07:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.5S-hVdcSorw1x60ZKt1-RcfKJzpMxyX_0 2024-03-09T15:07:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15975401071941158495', time=2024-03-09T16:57:02.543325+0000, chain.objs.size()=1 2024-03-09T15:07:04.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xv4YgyOSdc8yp_YAHiMFiriqMfG0y9M_0 2024-03-09T15:07:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2952480516038188273', time=2024-03-09T16:57:02.729544+0000, chain.objs.size()=1 2024-03-09T15:07:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.-rWFsm7rz6zW7Y245IA0Dl6KGuv2q41_0 2024-03-09T15:07:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17373566256947321230', time=2024-03-09T16:57:02.773637+0000, chain.objs.size()=1 2024-03-09T15:07:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.rCPdzy1iJNvE7fC_mAyArudw1mh4ntO_0 2024-03-09T15:07:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8826183663251502861', time=2024-03-09T16:57:02.805750+0000, chain.objs.size()=1 2024-03-09T15:07:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.J0MLEh80e6W-IoqNLGOaNLCK0Nmy2cO_0 2024-03-09T15:07:04.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12226698807304364630', time=2024-03-09T16:57:02.833899+0000, chain.objs.size()=1 2024-03-09T15:07:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.RHwKAPEhSI_XtwE_pqNcxRZdTzlIZ3M_0 2024-03-09T15:07:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8496066803342973376', time=2024-03-09T16:57:02.848343+0000, chain.objs.size()=1 2024-03-09T15:07:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ctxmVtQQ1USdGqf8oWxOfZ0DcwQzoV6_0 2024-03-09T15:07:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2438663102235568917', time=2024-03-09T16:57:02.980000+0000, chain.objs.size()=1 2024-03-09T15:07:04.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.llqHTDUHj2_WSphf7JB_sMkkM-ICFQf_0 2024-03-09T15:07:04.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.987196146374998231', time=2024-03-09T16:57:03.018235+0000, chain.objs.size()=1 2024-03-09T15:07:04.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.1jQZcSuy-jQvRluhzYciu0-lCZeVx99_0 2024-03-09T15:07:04.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/42990 2024-03-09T15:07:04.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-03-09T15:07:04.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16095688415669782136', time=2024-03-09T16:57:03.038992+0000, chain.objs.size()=1 2024-03-09T15:07:04.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.-9R9z8oYpBrV88LNy762OESReH2zEiw_0 2024-03-09T15:07:04.344 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1622634278347591146', time=2024-03-09T16:57:03.346809+0000, chain.objs.size()=1 2024-03-09T15:07:04.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.LLcwHXo0FnjpcVlY-a_cEEj6b19bpvR_0 2024-03-09T15:07:04.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12356825248631581190', time=2024-03-09T16:57:03.362078+0000, chain.objs.size()=1 2024-03-09T15:07:04.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.fD-O-3l3vzyxn6txvlXK-HMeiv4qfnU_0 2024-03-09T15:07:04.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7854828453036512587', time=2024-03-09T16:57:03.368130+0000, chain.objs.size()=1 2024-03-09T15:07:04.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_._knNCw-FavrYa4lxmMmWTpr5qS2UKyz_0 2024-03-09T15:07:04.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13361784747802225184', time=2024-03-09T16:57:03.554730+0000, chain.objs.size()=1 2024-03-09T15:07:04.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.yfNTf_zvIvLpgQgUcHFD68SPEpSHx6n_0 2024-03-09T15:07:04.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4628733587847077849', time=2024-03-09T16:57:03.576039+0000, chain.objs.size()=1 2024-03-09T15:07:04.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.2DleDEJtoVQ1_1d6CrNXcAaC8PAN8yn_0 2024-03-09T15:07:04.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15755827663300259387', time=2024-03-09T16:57:20.114795+0000, chain.objs.size()=1 2024-03-09T15:07:04.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.337__shadow_.DYYnfgwiFQ_PNHc0CdHFhk_bTp79zFj_0 2024-03-09T15:07:04.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16240291393776612244', time=2024-03-09T16:57:49.179246+0000, chain.objs.size()=1 2024-03-09T15:07:04.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.370__shadow_.mJ3utkCiDqj8TwBhxdAkTSV1Yd03lQ3_0 2024-03-09T15:07:04.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.579136083940129698', time=2024-03-09T16:57:51.876471+0000, chain.objs.size()=1 2024-03-09T15:07:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.373__shadow_.3gt0gTg2P5Wi846UcbAn4bJzlbELsJy_0 2024-03-09T15:07:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2377307298436732426', time=2024-03-09T16:58:44.400388+0000, chain.objs.size()=1 2024-03-09T15:07:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.426__shadow_.3YGrR_Yk4nJ-uoCNRmh-5LENAr8wk02_0 2024-03-09T15:07:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7273905506984356155', time=2024-03-09T16:58:52.675148+0000, chain.objs.size()=1 2024-03-09T15:07:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.435__shadow_.lugjwQEgfQx98vmPZFz8dSasjVOFyaH_0 2024-03-09T15:07:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15269526926576268634', time=2024-03-09T16:59:12.113701+0000, chain.objs.size()=1 2024-03-09T15:07:04.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.453__shadow_.42pcqGRk4qrZDDNUV3zJfvzT4zLLlx4_0 2024-03-09T15:07:04.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11285591778779362557', time=2024-03-09T16:59:18.065771+0000, chain.objs.size()=1 2024-03-09T15:07:04.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.458__shadow_.Oe2UuIUiz6X9ydDrBCAalhiY3eiYqwN_0 2024-03-09T15:07:04.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3174879202045227677', time=2024-03-09T16:59:31.478069+0000, chain.objs.size()=1 2024-03-09T15:07:04.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.477__shadow_.4---RQikuyN9-S42lGkYzRXLj7uQQpg_0 2024-03-09T15:07:04.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.350+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2993411318472255040', time=2024-03-09T17:01:01.636322+0000, chain.objs.size()=4 2024-03-09T15:07:04.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.529__multipart_mymultipart.2~GGzebewhRJc4JOXMLhm-572pG0-NVep.1 2024-03-09T15:07:04.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.529__multipart_mymultipart.2~GGzebewhRJc4JOXMLhm-572pG0-NVep.2 2024-03-09T15:07:04.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.529__multipart_mymultipart.aaNilJixvf2Qk8HjE9rzf1sFjTsEdHsg.3 2024-03-09T15:07:04.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.529__multipart_mymultipart.2~GGzebewhRJc4JOXMLhm-572pG0-NVep.4 2024-03-09T15:07:04.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.350+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2926889131098287237', time=2024-03-09T17:01:32.603495+0000, chain.objs.size()=1 2024-03-09T15:07:04.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.548__shadow_.G2vYGOxTygYRAvySYGEpGp94Hhh_mfm_0 2024-03-09T15:07:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.350+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17463338263487102111', time=2024-03-09T17:03:21.208852+0000, chain.objs.size()=6 2024-03-09T15:07:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.608__multipart_multipart_enc.2~ZuBnGHpBqd9CjhSU5B7AQceu8NQxoMx.1 2024-03-09T15:07:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.608__multipart_multipart_enc.2~ZuBnGHpBqd9CjhSU5B7AQceu8NQxoMx.2 2024-03-09T15:07:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.608__multipart_multipart_enc.2~ZuBnGHpBqd9CjhSU5B7AQceu8NQxoMx.3 2024-03-09T15:07:04.351 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.350+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.608__multipart_multipart_enc.2~ZuBnGHpBqd9CjhSU5B7AQceu8NQxoMx.4 2024-03-09T15:07:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.354+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.608__multipart_multipart_enc.2~ZuBnGHpBqd9CjhSU5B7AQceu8NQxoMx.5 2024-03-09T15:07:04.352 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.354+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.608__multipart_multipart_enc.2~ZuBnGHpBqd9CjhSU5B7AQceu8NQxoMx.6 2024-03-09T15:07:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.354+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9159108148072448982', time=2024-03-09T17:03:42.602549+0000, chain.objs.size()=1 2024-03-09T15:07:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.354+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.626__shadow_.v3RTOibnUuGC1Yyl6LBHVQC3KuHozKG_0 2024-03-09T15:07:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.354+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9199312841948314683', time=2024-03-09T17:05:33.464603+0000, chain.objs.size()=1 2024-03-09T15:07:04.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.354+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.725__shadow_.3Lh6fGAY_E7GCba5pPtG4434P-FzNoE_0 2024-03-09T15:07:04.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.354+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5828815530096850524', time=2024-03-09T17:06:32.441744+0000, chain.objs.size()=1 2024-03-09T15:07:04.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.354+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.753__shadow_.kbSJec6x3-4dzICTssk3EMiXzKUpobO_0 2024-03-09T15:07:04.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.358+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:04.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-09T15:07:04.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:04.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:04.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42861' 2024-03-09T15:07:04.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6156552798440787586', time=2024-03-09T16:51:43.919118+0000, chain.objs.size()=1 2024-03-09T15:07:04.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.145__shadow_.nYBjSrmAt5-w4PJTvxX-I0tncJrFfLz_0 2024-03-09T15:07:04.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='_4pP3UIFZOoOL16G2VfFVqtICaAnaEPA', time=2024-03-09T16:51:52.471800+0000, chain.objs.size()=2 2024-03-09T15:07:04.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.154__shadow_.doSXN06b_oRixA5BlDM1i4-tPOo8OlB_0 2024-03-09T15:07:04.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.154__shadow_.doSXN06b_oRixA5BlDM1i4-tPOo8OlB_1 2024-03-09T15:07:04.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='_Nvm102U-FUMiwoKYeCVnd4GMmU2BfGL', time=2024-03-09T16:51:55.222455+0000, chain.objs.size()=2 2024-03-09T15:07:04.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__shadow_.NxP1Rlf8hcKlkN22oFOMaPxBSdxkU9Q_0 2024-03-09T15:07:04.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__shadow_.NxP1Rlf8hcKlkN22oFOMaPxBSdxkU9Q_1 2024-03-09T15:07:04.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8683366361836449431', time=2024-03-09T16:52:41.543172+0000, chain.objs.size()=1 2024-03-09T15:07:04.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.193__shadow_.lHFv8foshLHVA8yLx2A3nWfdr8pNiMT_0 2024-03-09T15:07:04.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14044281712191935897', time=2024-03-09T16:54:40.601095+0000, chain.objs.size()=1 2024-03-09T15:07:04.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.242__shadow_.DuJDiWy-cim_jBxuQQwnBgrfvqEdeaO_0 2024-03-09T15:07:04.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11796043041456697713', time=2024-03-09T16:55:14.922290+0000, chain.objs.size()=1 2024-03-09T15:07:04.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.THVjt6ovbClJSyf-SkLkyQHYh_cruev_0 2024-03-09T15:07:04.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16946374828093150126', time=2024-03-09T16:55:14.941526+0000, chain.objs.size()=1 2024-03-09T15:07:04.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Ye-SPd0qTRjLekQ7KJovUsNqNCq9gON_0 2024-03-09T15:07:04.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1022546900811657302', time=2024-03-09T16:55:14.965847+0000, chain.objs.size()=1 2024-03-09T15:07:04.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.wF6VaBGESLzzAg-Jzu7LUtJ3uX48XGh_0 2024-03-09T15:07:04.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17936618625506213609', time=2024-03-09T16:55:14.966661+0000, chain.objs.size()=1 2024-03-09T15:07:04.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.SkzLRtfpKd_v-Q705LPCkOVTvhBFEeE_0 2024-03-09T15:07:04.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15188038630301898708', time=2024-03-09T16:55:15.010775+0000, chain.objs.size()=1 2024-03-09T15:07:04.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.OaM9SiSPrem81KK5EagL1XX_cGwrMLb_0 2024-03-09T15:07:04.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8112279558422262590', time=2024-03-09T16:55:15.023642+0000, chain.objs.size()=1 2024-03-09T15:07:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.G5xKxy2EoxvmPrkiW1bKamc3tlFNowW_0 2024-03-09T15:07:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2310459526371584840', time=2024-03-09T16:55:15.137505+0000, chain.objs.size()=1 2024-03-09T15:07:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.laH8esqSHmvKJAsb-L2Kc_eTdM9EilO_0 2024-03-09T15:07:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13351926189554527179', time=2024-03-09T16:55:15.214404+0000, chain.objs.size()=1 2024-03-09T15:07:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.kRtajNasKmECCy--r6LcMjeaMKnyMBX_0 2024-03-09T15:07:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14942531091353798858', time=2024-03-09T16:55:15.253271+0000, chain.objs.size()=1 2024-03-09T15:07:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.aym3iEjB7Jgt-yGHw7i9Hb6RpNIcnYo_0 2024-03-09T15:07:04.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18074042921918314737', time=2024-03-09T16:55:15.428687+0000, chain.objs.size()=1 2024-03-09T15:07:04.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.nO0PpcA20GLv8nyR53Gm4EOweISV3Fy_0 2024-03-09T15:07:04.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11934318566245909852', time=2024-03-09T16:55:15.480472+0000, chain.objs.size()=1 2024-03-09T15:07:04.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.cJtQj8i6EIkVnBr-6JVgWM0qFujWB4B_0 2024-03-09T15:07:04.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1820951538523362328', time=2024-03-09T16:55:15.510248+0000, chain.objs.size()=1 2024-03-09T15:07:04.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.R1xzA35jVAvZjpsmc1_d-T_5J7B01XC_0 2024-03-09T15:07:04.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15670435273479596508', time=2024-03-09T16:55:15.536549+0000, chain.objs.size()=1 2024-03-09T15:07:04.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qIfH9WCHeHEXvVV1GF8sZWhLHiJGsbm_0 2024-03-09T15:07:04.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7792032166063732350', time=2024-03-09T16:55:15.550981+0000, chain.objs.size()=1 2024-03-09T15:07:04.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.58lWmo_KXQaSg_JDdNPbkugjoWfFTjm_0 2024-03-09T15:07:04.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.498161757539211686', time=2024-03-09T16:55:15.553121+0000, chain.objs.size()=1 2024-03-09T15:07:04.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_._wQ1_ffeTfR6npVNT7l-6cRwPQ5QwCx_0 2024-03-09T15:07:04.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4327749010410561503', time=2024-03-09T16:55:15.676566+0000, chain.objs.size()=1 2024-03-09T15:07:04.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.2grxytRtn-j6-1NsHxiETQ9n3n5KGtB_0 2024-03-09T15:07:04.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.932106658703400058', time=2024-03-09T16:55:15.755933+0000, chain.objs.size()=1 2024-03-09T15:07:04.373 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.-06aRp314CzEG8VU2b-E76cIrAOUz3x_0 2024-03-09T15:07:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2700451628104035925', time=2024-03-09T16:55:15.786064+0000, chain.objs.size()=1 2024-03-09T15:07:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.RPZwVBGXhSb-2rUOJk4Bnn_iREYn3BJ_0 2024-03-09T15:07:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14659384249686135643', time=2024-03-09T16:55:15.808584+0000, chain.objs.size()=1 2024-03-09T15:07:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.uQEzrOkayS0qdf3cjwfItuzNWxCr71l_0 2024-03-09T15:07:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3263167852712004314', time=2024-03-09T16:55:15.965509+0000, chain.objs.size()=1 2024-03-09T15:07:04.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.5Net3Fg7J6Oq10f6olbvcumifGt5xtt_0 2024-03-09T15:07:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11392696620108924061', time=2024-03-09T16:55:16.015083+0000, chain.objs.size()=1 2024-03-09T15:07:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.2XbP9zWsFLj1TvZxa3F-7LICgnnCJAW_0 2024-03-09T15:07:04.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8927396980970436290', time=2024-03-09T16:55:16.021630+0000, chain.objs.size()=1 2024-03-09T15:07:04.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.SuFxWTrU9IF6QMxucv-aVpfOTR-GFMn_0 2024-03-09T15:07:04.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8763543572576687932', time=2024-03-09T16:55:16.243460+0000, chain.objs.size()=1 2024-03-09T15:07:04.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.guszFu__WLTxAK_pZ-GcF70RjNumwwd_0 2024-03-09T15:07:04.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14673641112201893656', time=2024-03-09T16:55:16.281400+0000, chain.objs.size()=1 2024-03-09T15:07:04.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.jBeQx51A6DSr-qZHg_p6pnVqiP5JQ9R_0 2024-03-09T15:07:04.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.340257887480846004', time=2024-03-09T16:55:16.359015+0000, chain.objs.size()=1 2024-03-09T15:07:04.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.45YLtoOuXjVDI2AT_EJj89Z0EeUpkm2_0 2024-03-09T15:07:04.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9404591351545449049', time=2024-03-09T16:55:16.360101+0000, chain.objs.size()=1 2024-03-09T15:07:04.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.3cyZX7KD0OZFZUAeiJfc4nCLNw8PDcx_0 2024-03-09T15:07:04.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14849153798775789962', time=2024-03-09T16:55:16.475884+0000, chain.objs.size()=1 2024-03-09T15:07:04.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.uRwhvwIRwI3o3Ssk4acIFaXcmRteRm4_0 2024-03-09T15:07:04.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17499344155886991504', time=2024-03-09T16:55:16.504257+0000, chain.objs.size()=1 2024-03-09T15:07:04.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.5freSFuJi_1sQ84fEL1sfeyJjfW2W6__0 2024-03-09T15:07:04.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9757948886562862738', time=2024-03-09T16:55:16.521430+0000, chain.objs.size()=1 2024-03-09T15:07:04.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.378+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.sAoYiEXPmEkGBM4ljHxJt4o_QN1PXAt_0 2024-03-09T15:07:04.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7391653111449588545', time=2024-03-09T16:55:16.785052+0000, chain.objs.size()=1 2024-03-09T15:07:04.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.KI1BaJvOrDSLRYSOv4Wl1uBLZMhiUET_0 2024-03-09T15:07:04.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12614107017164110784', time=2024-03-09T16:55:16.832816+0000, chain.objs.size()=1 2024-03-09T15:07:04.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.c274YFQPGn9Urrf69Qw9b9djpV9nwtS_0 2024-03-09T15:07:04.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14982012266556993005', time=2024-03-09T16:55:17.667856+0000, chain.objs.size()=1 2024-03-09T15:07:04.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.257__shadow_.KmB3dZLO4a3-6KdI3yg2ZUV081sRZwV_0 2024-03-09T15:07:04.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11516696324248379103', time=2024-03-09T16:55:28.723419+0000, chain.objs.size()=1 2024-03-09T15:07:04.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.269__shadow_.yrGRbXTA8nbRg_DMtoHb-e2vg5F2P2__0 2024-03-09T15:07:04.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2915476345167651888', time=2024-03-09T16:55:37.291705+0000, chain.objs.size()=1 2024-03-09T15:07:04.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.278__shadow_.2V_J3CtbGbzF7b0I3nQkm3iR888QqlE_0 2024-03-09T15:07:04.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4251158464732139860', time=2024-03-09T16:55:37.293754+0000, chain.objs.size()=1 2024-03-09T15:07:04.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.278__shadow_.tlnteI23gtPQ_RJbJvviYx8rCkqElpP_0 2024-03-09T15:07:04.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15519213787023735629', time=2024-03-09T16:55:46.216716+0000, chain.objs.size()=1 2024-03-09T15:07:04.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.vnFvEzReTCAa7t8Lp72Rdntetuwdc_H_0 2024-03-09T15:07:04.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6769730533426329437', time=2024-03-09T16:55:47.841074+0000, chain.objs.size()=1 2024-03-09T15:07:04.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.-gMTI_yjlaMRcLfFNGqZBfd9t91MOCG_0 2024-03-09T15:07:04.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5777462867161227522', time=2024-03-09T16:55:47.857750+0000, chain.objs.size()=1 2024-03-09T15:07:04.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.Q53ww09DBnbHEyMqitvnizBIAUCNVfX_0 2024-03-09T15:07:04.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7736717678327138396', time=2024-03-09T16:55:55.452545+0000, chain.objs.size()=1 2024-03-09T15:07:04.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.295__shadow_.N97W3FKoKwWSVuOAhjqvpedN_0HFnKU_0 2024-03-09T15:07:04.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2060428767349058072', time=2024-03-09T16:56:37.759594+0000, chain.objs.size()=1 2024-03-09T15:07:04.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.RdfAPmRV_n4dwKtjhrV5atvhASEmZiM_0 2024-03-09T15:07:04.385 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4037210253138172320', time=2024-03-09T16:56:37.790404+0000, chain.objs.size()=1 2024-03-09T15:07:04.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.bhQJzwXWdux72XGFOKcFIgEREMJSclb_0 2024-03-09T15:07:04.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9816055135626010211', time=2024-03-09T16:56:37.845810+0000, chain.objs.size()=1 2024-03-09T15:07:04.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.SiZGuIZNqSZR6MTmfOtwSYA1DbWX3cV_0 2024-03-09T15:07:04.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2132074169244034175', time=2024-03-09T16:56:37.992925+0000, chain.objs.size()=1 2024-03-09T15:07:04.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kwQ6BxtG2Hevn9JDc3gYl-g136MzDpr_0 2024-03-09T15:07:04.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.662199707089404499', time=2024-03-09T16:56:38.126913+0000, chain.objs.size()=1 2024-03-09T15:07:04.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.dU2Or0zuH37kFdT7quPgpzTbwaHSyby_0 2024-03-09T15:07:04.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.390+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9123435805442936355', time=2024-03-09T16:56:38.326167+0000, chain.objs.size()=1 2024-03-09T15:07:04.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.390+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.MkQLfJpc6aTjXxetTP3wFdmlPWS-_6S_0 2024-03-09T15:07:04.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.390+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5242360025872304038', time=2024-03-09T16:56:38.340131+0000, chain.objs.size()=1 2024-03-09T15:07:04.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.390+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.UYoCOVh1Zftl8dpOQdSTAexdZ7ryvv3_0 2024-03-09T15:07:04.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.390+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.756865811326846304', time=2024-03-09T16:56:38.372680+0000, chain.objs.size()=1 2024-03-09T15:07:04.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.390+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.TqTKTjoykxGnHHAIlZ4Z7y6YFevxC9__0 2024-03-09T15:07:04.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.390+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4414484651027140841', time=2024-03-09T16:56:38.505883+0000, chain.objs.size()=1 2024-03-09T15:07:04.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.390+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kQq2UAkEDda5dCTz8fbXToFPB13GuCE_0 2024-03-09T15:07:04.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.390+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.776880436092516381', time=2024-03-09T16:56:38.553343+0000, chain.objs.size()=1 2024-03-09T15:07:04.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.390+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.V_9NHlpSl_DTvWiEuvsa3CCTL2Lkh2Z_0 2024-03-09T15:07:04.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.390+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1260953055196350260', time=2024-03-09T16:56:38.595781+0000, chain.objs.size()=1 2024-03-09T15:07:04.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.390+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.2vT51GsKdGDVwtGKKT2MbNGbMh-Okch_0 2024-03-09T15:07:04.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.390+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10841882676242396900', time=2024-03-09T16:56:38.609067+0000, chain.objs.size()=1 2024-03-09T15:07:04.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.390+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.WF5uP5lk43H_vB3LD74pn7aEbHcJ-yq_0 2024-03-09T15:07:04.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.390+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17225947932651740349', time=2024-03-09T16:56:38.772162+0000, chain.objs.size()=1 2024-03-09T15:07:04.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.390+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.mc6Ew2wmAAmERQhZdSppaGLVIKCQeY1_0 2024-03-09T15:07:04.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7610142676611791329', time=2024-03-09T16:56:38.840224+0000, chain.objs.size()=1 2024-03-09T15:07:04.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.PA5ML16te6jNOKo9WBUqfwsehBgxPt__0 2024-03-09T15:07:04.392 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17458291031827105051', time=2024-03-09T16:56:38.931348+0000, chain.objs.size()=1 2024-03-09T15:07:04.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.jv57MMJvx-McwMt3tE6TNl1Q2m-dziE_0 2024-03-09T15:07:04.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.854431062651010699', time=2024-03-09T16:56:39.054798+0000, chain.objs.size()=1 2024-03-09T15:07:04.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.LAyKxJOgK5lQb4Js0zcEhiehzVWpxZY_0 2024-03-09T15:07:04.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15246804134086678516', time=2024-03-09T16:56:39.085236+0000, chain.objs.size()=1 2024-03-09T15:07:04.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_._ixbPavg3u_yF6QRpfsfx7k_S1S3nF-_0 2024-03-09T15:07:04.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.514977349664866829', time=2024-03-09T16:56:39.115218+0000, chain.objs.size()=1 2024-03-09T15:07:04.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.VcWBs3JJKfVYSW7nlYMtlps4B3hhmxc_0 2024-03-09T15:07:04.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14418534186098266106', time=2024-03-09T16:56:39.305173+0000, chain.objs.size()=1 2024-03-09T15:07:04.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.VWGg4jD5v0bDdSOE9GSU4URw9lr08A-_0 2024-03-09T15:07:04.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17638298623681955470', time=2024-03-09T16:56:39.332759+0000, chain.objs.size()=1 2024-03-09T15:07:04.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6R7a1NozSWt_9Plek2paUOzW955DYPJ_0 2024-03-09T15:07:04.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17430326207911409437', time=2024-03-09T16:56:39.365098+0000, chain.objs.size()=1 2024-03-09T15:07:04.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.duzcgvoiXmapJxvVnVPPyku91jxG2AV_0 2024-03-09T15:07:04.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15647986929400416143', time=2024-03-09T16:56:39.399841+0000, chain.objs.size()=1 2024-03-09T15:07:04.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.K6d_ICUSLeNTKd4I4Fhx52OYkCc-8C5_0 2024-03-09T15:07:04.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2846351202559457873', time=2024-03-09T16:56:39.410970+0000, chain.objs.size()=1 2024-03-09T15:07:04.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.xKdI71cjNdrCjO7DRMCsD-1SfZZQ4OW_0 2024-03-09T15:07:04.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.398+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7591775135301162669', time=2024-03-09T16:56:39.429486+0000, chain.objs.size()=1 2024-03-09T15:07:04.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.398+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.yaGiI6dUfzK4cmiy5FqRayyHkt_8jXI_0 2024-03-09T15:07:04.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.398+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16664592845370995068', time=2024-03-09T16:56:39.459746+0000, chain.objs.size()=1 2024-03-09T15:07:04.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.398+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.u-7WQsFj6io2BKta_f3aMf3J1TnBbSr_0 2024-03-09T15:07:04.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.398+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17461894597717470213', time=2024-03-09T16:56:39.619411+0000, chain.objs.size()=1 2024-03-09T15:07:04.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.398+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.WcbK8Q8L2zPY0vZDs-oVrrJWLGkbECm_0 2024-03-09T15:07:04.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.398+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.807818959720677739', time=2024-03-09T16:56:39.620263+0000, chain.objs.size()=1 2024-03-09T15:07:04.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.398+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.3hehVMPJDeAF4A7RZzvyVJSdkoZ62Ga_0 2024-03-09T15:07:04.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.398+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2187380724113937941', time=2024-03-09T16:57:01.463449+0000, chain.objs.size()=1 2024-03-09T15:07:04.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.398+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.rT2Ivbue9aFOU6dKaGcvq2-vDmODH56_0 2024-03-09T15:07:04.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.398+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12826606164172307584', time=2024-03-09T16:57:01.492155+0000, chain.objs.size()=1 2024-03-09T15:07:04.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.398+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.BJL0XipqEw46ayNboXJbIhwVQWz0oN6_0 2024-03-09T15:07:04.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.398+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5967044147033667784', time=2024-03-09T16:57:01.518719+0000, chain.objs.size()=1 2024-03-09T15:07:04.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.398+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.uklcfvVulhEyVVkAPSVAEr5sccZTMih_0 2024-03-09T15:07:04.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2024415702297638853', time=2024-03-09T16:57:01.535281+0000, chain.objs.size()=1 2024-03-09T15:07:04.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.TpGIVZ68CDh1SdwaDEE4ApS17R61kui_0 2024-03-09T15:07:04.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16663041100198564586', time=2024-03-09T16:57:01.539360+0000, chain.objs.size()=1 2024-03-09T15:07:04.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.HmO8c2zYvvAxIIBy6mCwdzz1L2U1jCW_0 2024-03-09T15:07:04.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3049001384204480219', time=2024-03-09T16:57:01.746437+0000, chain.objs.size()=1 2024-03-09T15:07:04.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.VXyyp1MJYHVq2JMRoYCM0ADEuVYakE5_0 2024-03-09T15:07:04.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8175818519771755141', time=2024-03-09T16:57:01.825167+0000, chain.objs.size()=1 2024-03-09T15:07:04.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DTtoVKbJKkgvj9XxcVdtIgulRH_GtGq_0 2024-03-09T15:07:04.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5932184620440663357', time=2024-03-09T16:57:01.872212+0000, chain.objs.size()=1 2024-03-09T15:07:04.403 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.zitw9y0gQUHmKoAwCrFbaMENYJemOYx_0 2024-03-09T15:07:04.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14278957078464410261', time=2024-03-09T16:57:01.966634+0000, chain.objs.size()=1 2024-03-09T15:07:04.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.uUXTxst0dhv_U07RcAc7WFwTUL5EKki_0 2024-03-09T15:07:04.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15039321676987002598', time=2024-03-09T16:57:01.985184+0000, chain.objs.size()=1 2024-03-09T15:07:04.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.EMW8qQyF4lGRzXCiexCB5pC1TIhx1iU_0 2024-03-09T15:07:04.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7968199513855775218', time=2024-03-09T16:57:01.997492+0000, chain.objs.size()=1 2024-03-09T15:07:04.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.OSX_Ht5EWVxnZPlAcnBfJ-QFrVmBpfD_0 2024-03-09T15:07:04.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15332411965447787261', time=2024-03-09T16:57:02.039502+0000, chain.objs.size()=1 2024-03-09T15:07:04.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.VFTIF-tYkkFCxSAStDeQgKeyrV3kVQz_0 2024-03-09T15:07:04.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15019147020487574961', time=2024-03-09T16:57:02.051263+0000, chain.objs.size()=1 2024-03-09T15:07:04.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.410+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.I8T0Ezven3dqcCVPRxpDSX8Kp9RvPhx_0 2024-03-09T15:07:04.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.410+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3588947773177918266', time=2024-03-09T16:57:02.114244+0000, chain.objs.size()=1 2024-03-09T15:07:04.408 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.410+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.dDtJc6XXSRu5Tb_J1BWATaIozB_Xf_b_0 2024-03-09T15:07:04.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.410+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6638121539391294861', time=2024-03-09T16:57:02.222390+0000, chain.objs.size()=1 2024-03-09T15:07:04.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.410+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.CZb1u6-KmoXpyVg8p8dMrfoMtclThuH_0 2024-03-09T15:07:04.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.410+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9392084089861357767', time=2024-03-09T16:57:02.277931+0000, chain.objs.size()=1 2024-03-09T15:07:04.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.410+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.rnMKciVr0r7fMxR2hELKQMkjYaEutre_0 2024-03-09T15:07:04.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.410+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3978068649009040004', time=2024-03-09T16:57:02.283073+0000, chain.objs.size()=1 2024-03-09T15:07:04.409 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.410+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.C2AuS2KWcWsTaCRpSDimhYOSl436xBq_0 2024-03-09T15:07:04.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.410+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15331422545416508894', time=2024-03-09T16:57:02.305845+0000, chain.objs.size()=1 2024-03-09T15:07:04.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.410+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.fIiLPyasDj9WRKB47QBRKvJEoLp3ckP_0 2024-03-09T15:07:04.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.410+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16275142540822849065', time=2024-03-09T16:57:02.309976+0000, chain.objs.size()=1 2024-03-09T15:07:04.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.410+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.s9VoNdIgMj3NR3QThoy3fLWDWcNCVLZ_0 2024-03-09T15:07:04.410 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.410+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.574865100678943960', time=2024-03-09T16:57:02.483408+0000, chain.objs.size()=1 2024-03-09T15:07:04.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.410+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.84kKJEq99SaZVR0c9D2vRNuMSpC2yYX_0 2024-03-09T15:07:04.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.410+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1339727643195614599', time=2024-03-09T16:57:02.585738+0000, chain.objs.size()=1 2024-03-09T15:07:04.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.410+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.VNCasqDJHN-6kWnydBh3ta2RBAIcplN_0 2024-03-09T15:07:04.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18402118881148713047', time=2024-03-09T16:57:02.596045+0000, chain.objs.size()=1 2024-03-09T15:07:04.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.b_yZyKAmEcJfmd2vd8Y91S8bOF0ghDX_0 2024-03-09T15:07:04.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6959954437776877196', time=2024-03-09T16:57:02.722589+0000, chain.objs.size()=1 2024-03-09T15:07:04.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.MkWvp1BOlZaNj1Km5XjNfjwHXdbIt0P_0 2024-03-09T15:07:04.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.43674715303060605', time=2024-03-09T16:57:02.729154+0000, chain.objs.size()=1 2024-03-09T15:07:04.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.TqrUeHw7VD2Uv3u3801gZ3GRvWn2YkW_0 2024-03-09T15:07:04.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15389098186278805813', time=2024-03-09T16:57:02.751745+0000, chain.objs.size()=1 2024-03-09T15:07:04.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.UT_ouFyP47WpGfzlURHpZhg1RkkVhmM_0 2024-03-09T15:07:04.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15137253489458524081', time=2024-03-09T16:57:02.761292+0000, chain.objs.size()=1 2024-03-09T15:07:04.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.QFYmsWAEPWr9YTKLNFzLsVly2AWmhac_0 2024-03-09T15:07:04.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.418+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16586119180167725066', time=2024-03-09T16:57:02.777583+0000, chain.objs.size()=1 2024-03-09T15:07:04.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.418+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.thOApFyXlzUdrHOmnGU7_Iz4TyJUzUW_0 2024-03-09T15:07:04.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.418+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3681643592994624895', time=2024-03-09T16:57:02.779448+0000, chain.objs.size()=1 2024-03-09T15:07:04.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.418+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.h5wC2fayle9JaCUn1v25Cf1bb5n7bMt_0 2024-03-09T15:07:04.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.418+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3116990153325397077', time=2024-03-09T16:57:02.787089+0000, chain.objs.size()=1 2024-03-09T15:07:04.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.418+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.jFF1CNjl5LUEclzECZqhdTxF-zRRQgC_0 2024-03-09T15:07:04.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/42861 2024-03-09T15:07:04.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-03-09T15:07:04.423 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9579051105762186319', time=2024-03-09T16:57:03.015535+0000, chain.objs.size()=1 2024-03-09T15:07:04.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.RC2w2okuBMhi8aJbwdzyd-K1HBZG0NW_0 2024-03-09T15:07:04.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7893966908642395658', time=2024-03-09T16:57:03.047351+0000, chain.objs.size()=1 2024-03-09T15:07:04.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.VbmeL8Ar0oYMjoi17YQ64zZ3yzuO0IN_0 2024-03-09T15:07:04.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6763877222438762044', time=2024-03-09T16:57:03.064570+0000, chain.objs.size()=1 2024-03-09T15:07:04.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.GCALTfTtP7iCovyJ8yAGCRxwTtH4QS7_0 2024-03-09T15:07:04.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6471499058020203', time=2024-03-09T16:57:03.089742+0000, chain.objs.size()=1 2024-03-09T15:07:04.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.H2BvTiC3KExRUBUxz4-LoX1ny3ToCa9_0 2024-03-09T15:07:04.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15743957803373157100', time=2024-03-09T16:57:03.098417+0000, chain.objs.size()=1 2024-03-09T15:07:04.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.bLP9E7zY_AWBhNEOhIe57YSSLgktNg8_0 2024-03-09T15:07:04.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.584524059497021074', time=2024-03-09T16:57:03.373591+0000, chain.objs.size()=1 2024-03-09T15:07:04.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.OHq99a2pu3kzVQtYt_UbV6EI9B06sxI_0 2024-03-09T15:07:04.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10803445010164390831', time=2024-03-09T16:57:03.386677+0000, chain.objs.size()=1 2024-03-09T15:07:04.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.k0rltNrZhhzGOJUAVVaEJuTHEmmNWKX_0 2024-03-09T15:07:04.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10026793688747738179', time=2024-03-09T16:57:42.828375+0000, chain.objs.size()=1 2024-03-09T15:07:04.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.364__shadow_.p_Xwu1SFB1PtzIGZlzJcFyv2516Pq0j_0 2024-03-09T15:07:04.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14459675516591759081', time=2024-03-09T16:57:47.420183+0000, chain.objs.size()=1 2024-03-09T15:07:04.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.368__shadow_.MFTRSmHef380ntc8xo61S7QdcSbOgwk_0 2024-03-09T15:07:04.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14806730575869323644', time=2024-03-09T16:58:49.050239+0000, chain.objs.size()=1 2024-03-09T15:07:04.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.431__shadow_.yjTTKVMLXi_KXXDbxWVfbyOZMcUtBmT_0 2024-03-09T15:07:04.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12759725558972734081', time=2024-03-09T16:59:31.469280+0000, chain.objs.size()=1 2024-03-09T15:07:04.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.477__shadow_.7peAb1inTrVoGVjVHZt_HVMkEOF2ijQ_0 2024-03-09T15:07:04.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10626963382123535966', time=2024-03-09T16:59:31.471671+0000, chain.objs.size()=1 2024-03-09T15:07:04.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.422+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.477__shadow_.hoPl8zK5lIy0YHv2aTlZ0FvcxudunJe_0 2024-03-09T15:07:04.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.426+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.485__shadow_.dPdBCjunLwHJKlhy4oSRYDA6i8Vvc50_1_c192b3ccaffabf3e91c323345c55367a', time=2024-03-09T16:59:39.587341+0000, chain.objs.size()=1 2024-03-09T15:07:04.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.426+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.485__shadow_.dPdBCjunLwHJKlhy4oSRYDA6i8Vvc50_0 2024-03-09T15:07:04.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.426+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.490__shadow_.EllMb8OLqtX3xH92S8FvFm8Xj0bxrUO_1_efc6b8388e017c8be01a7ee526166f86', time=2024-03-09T16:59:42.690357+0000, chain.objs.size()=1 2024-03-09T15:07:04.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.426+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.490__shadow_.EllMb8OLqtX3xH92S8FvFm8Xj0bxrUO_0 2024-03-09T15:07:04.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7307495510766979713', time=2024-03-09T17:00:02.747860+0000, chain.objs.size()=1 2024-03-09T15:07:04.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.511__shadow_.DG6uAQmHtVqyJZfgUDFTYuCL5r2_7RS_0 2024-03-09T15:07:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1348551905095067896', time=2024-03-09T17:02:05.801320+0000, chain.objs.size()=1 2024-03-09T15:07:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.567__shadow_.TVOB9HbWRvBrURUkstH_PzWxoqT_NOp_0 2024-03-09T15:07:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11860911219686663174', time=2024-03-09T17:02:05.843562+0000, chain.objs.size()=1 2024-03-09T15:07:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.567__shadow_.6X4VA1uCnbpGRF51qHzr_cer4_Ho6dF_0 2024-03-09T15:07:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8948275862998465729', time=2024-03-09T17:02:37.606609+0000, chain.objs.size()=1 2024-03-09T15:07:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.572__shadow:ETgzAjKXmGNSWZbnW4C2DFUuPDozmAO_.3pwIpGKkntSAXuNNMmCadKlGNFqeCwX_0 2024-03-09T15:07:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6726672951770999219', time=2024-03-09T17:03:41.638136+0000, chain.objs.size()=1 2024-03-09T15:07:04.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.625__shadow_.nT78bMtt5u1mpbYdmU4lmzbSvE1OPYF_0 2024-03-09T15:07:04.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11685163721118201330', time=2024-03-09T17:03:53.083428+0000, chain.objs.size()=1 2024-03-09T15:07:04.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.637__shadow_.q8Mi2lKCqjsGoFKSepEapjgz7uLYAQ-_0 2024-03-09T15:07:04.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1167032829406296645', time=2024-03-09T17:03:54.165362+0000, chain.objs.size()=1 2024-03-09T15:07:04.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.638__shadow_.KZ2phiSmrI6miq9bB1c3XtV1fgxh58Y_0 2024-03-09T15:07:04.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.430+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2158532281071798717', time=2024-03-09T17:04:50.779220+0000, chain.objs.size()=1 2024-03-09T15:07:04.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.430+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.701__shadow:yb1-CJ9HZYbrfE2XwYi3uhFm0nqTBX0_.CmOCeosWFAjwfIza6oFrCTyAilxD8Lj_0 2024-03-09T15:07:04.434 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.434+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:04.436 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-09T15:07:04.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:04.437 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43227' 2024-03-09T15:07:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4071777584377023402', time=2024-03-09T16:51:42.222275+0000, chain.objs.size()=1 2024-03-09T15:07:04.439 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.138__shadow_.kfDQTw3nXyGkiS0nSTBtvyTckOw74Wc_0 2024-03-09T15:07:04.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='_8XkGerVSRRJ-plemv1JIItMpfLEb9oy', time=2024-03-09T16:51:51.259761+0000, chain.objs.size()=1 2024-03-09T15:07:04.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.154__shadow_.kFEpFrL4CRXp-96j5A_ZEN4XN3Lsogn_0 2024-03-09T15:07:04.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='_Uv28YadxlAbuWVqZWGwacfuM6f6VkTA', time=2024-03-09T16:51:51.778588+0000, chain.objs.size()=2 2024-03-09T15:07:04.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.154__shadow_.EMd8WVXYwQTqtdzryJLSfaf2t30qPcf_0 2024-03-09T15:07:04.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.154__shadow_.EMd8WVXYwQTqtdzryJLSfaf2t30qPcf_1 2024-03-09T15:07:04.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16221352799882990477', time=2024-03-09T16:54:36.858930+0000, chain.objs.size()=1 2024-03-09T15:07:04.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.238__shadow_.CrHr7iMG_4ig65jzonHbpJdOE2PC5ur_0 2024-03-09T15:07:04.440 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12093366270208143219', time=2024-03-09T16:54:39.679001+0000, chain.objs.size()=1 2024-03-09T15:07:04.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.241__shadow_.3R6QzhuSTHLY1sjfAv90FRJHoD9R3FM_0 2024-03-09T15:07:04.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7698479688988769526', time=2024-03-09T16:55:14.847252+0000, chain.objs.size()=1 2024-03-09T15:07:04.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.snyvLYt0EALhLe4opRidWvUeyzHf07g_0 2024-03-09T15:07:04.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1723394840693485426', time=2024-03-09T16:55:14.890397+0000, chain.objs.size()=1 2024-03-09T15:07:04.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.UIaLP6he21mz7OiN9ST2muEEsOu_bol_0 2024-03-09T15:07:04.441 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.494623065490031201', time=2024-03-09T16:55:14.895790+0000, chain.objs.size()=1 2024-03-09T15:07:04.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Aat2L5ITN_DIUdcwRF9Rlxb5XjV-eoV_0 2024-03-09T15:07:04.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12310640949266507166', time=2024-03-09T16:55:14.898239+0000, chain.objs.size()=1 2024-03-09T15:07:04.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.p_NhcnvfHsrO_PlaRIPzWGiHT2S_kc8_0 2024-03-09T15:07:04.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13863186450012581908', time=2024-03-09T16:55:15.011848+0000, chain.objs.size()=1 2024-03-09T15:07:04.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.sCX6R-78R-iK96H1-dKkDN-UT2bSNio_0 2024-03-09T15:07:04.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2331600381979892555', time=2024-03-09T16:55:15.167193+0000, chain.objs.size()=1 2024-03-09T15:07:04.442 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.438+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.WVeE6uJi1X3JZbrxBFsW1MdhkWwCX1g_0 2024-03-09T15:07:04.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.442+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12838986628839635128', time=2024-03-09T16:55:15.208501+0000, chain.objs.size()=1 2024-03-09T15:07:04.443 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.442+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.7BJSTxeVb-SeBCovX5YwN0LYvlG-qPq_0 2024-03-09T15:07:04.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.442+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15231631057682584453', time=2024-03-09T16:55:15.233269+0000, chain.objs.size()=1 2024-03-09T15:07:04.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.442+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6peNONSwrhASko-Tv3h03lNrBNobgWW_0 2024-03-09T15:07:04.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14355595721710494551', time=2024-03-09T16:55:15.269239+0000, chain.objs.size()=1 2024-03-09T15:07:04.444 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.9VbaSlr2eJjy8E3BcjiHpArkmN8e0np_0 2024-03-09T15:07:04.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7233527584984449209', time=2024-03-09T16:55:15.279898+0000, chain.objs.size()=1 2024-03-09T15:07:04.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.87pT62LEtVFPvBPfZjvXhUQsqyAXTEt_0 2024-03-09T15:07:04.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7150268283741380695', time=2024-03-09T16:55:15.284387+0000, chain.objs.size()=1 2024-03-09T15:07:04.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.8sgEZQVt_nCu7W_dcbdBL_S4yKmneUb_0 2024-03-09T15:07:04.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7133083497632829892', time=2024-03-09T16:55:15.401793+0000, chain.objs.size()=1 2024-03-09T15:07:04.445 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.J8mqE6DLZ-IHXKwR7EIbzbJZsx45ZAX_0 2024-03-09T15:07:04.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8008149838450466716', time=2024-03-09T16:55:15.403403+0000, chain.objs.size()=1 2024-03-09T15:07:04.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.jr-KMHrPTbJtdcorOp0MuaR3xqSa2jc_0 2024-03-09T15:07:04.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.850266631919801462', time=2024-03-09T16:55:15.413674+0000, chain.objs.size()=1 2024-03-09T15:07:04.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.5hGQJXjQ76g2Y1hIK7LJRxVGFOa9RW-_0 2024-03-09T15:07:04.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4639081907195604293', time=2024-03-09T16:55:15.428819+0000, chain.objs.size()=1 2024-03-09T15:07:04.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ZlXHfQ8nNXKlS_6A43b4i05cwHzkWSl_0 2024-03-09T15:07:04.446 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11549502851145700153', time=2024-03-09T16:55:15.431737+0000, chain.objs.size()=1 2024-03-09T15:07:04.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_._mGwZYbo2LOFBYsWcf-l7bvpF_7FQf0_0 2024-03-09T15:07:04.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4770202911817684155', time=2024-03-09T16:55:15.442091+0000, chain.objs.size()=1 2024-03-09T15:07:04.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Zs8S_XO9BG8zroXqkD85ZCVXektE5eB_0 2024-03-09T15:07:04.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10612087268524617714', time=2024-03-09T16:55:15.471659+0000, chain.objs.size()=1 2024-03-09T15:07:04.447 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.446+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.9kFtfBDYss4xfjbwVQdmixEy6Zs3v6J_0 2024-03-09T15:07:04.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16213480026714314208', time=2024-03-09T16:55:15.486074+0000, chain.objs.size()=1 2024-03-09T15:07:04.448 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.wb-7Qc5CvQUtExA8lTBl-GdKWDtP8H2_0 2024-03-09T15:07:04.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12817256275766943489', time=2024-03-09T16:55:15.505414+0000, chain.objs.size()=1 2024-03-09T15:07:04.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.sJtlwwNXYRtcpvcbXWTJx63FhxNgMpH_0 2024-03-09T15:07:04.449 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2000328615655176523', time=2024-03-09T16:55:15.558749+0000, chain.objs.size()=1 2024-03-09T15:07:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Dk_BP0ngwHOfb5mzzqj20P1hGT6xbvA_0 2024-03-09T15:07:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11850749144462423608', time=2024-03-09T16:55:15.684090+0000, chain.objs.size()=1 2024-03-09T15:07:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.y-udrEVAqk1G3rFCEm5O1rPFIVejUFI_0 2024-03-09T15:07:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3640046341712425049', time=2024-03-09T16:55:15.697789+0000, chain.objs.size()=1 2024-03-09T15:07:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.9eNq2HGspviEZMUshgehKJfHkoqz2lG_0 2024-03-09T15:07:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3156316268258365553', time=2024-03-09T16:55:15.798471+0000, chain.objs.size()=1 2024-03-09T15:07:04.450 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.gsTAcml0HHPzkNYj3KUOy8QTdBS7irz_0 2024-03-09T15:07:04.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17680472405820804026', time=2024-03-09T16:55:15.983945+0000, chain.objs.size()=1 2024-03-09T15:07:04.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.XnnpT7TxsTu1LMOSf80xyBHpCVUiM2U_0 2024-03-09T15:07:04.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3375063741782505890', time=2024-03-09T16:55:16.024805+0000, chain.objs.size()=1 2024-03-09T15:07:04.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_._NltVCerwazPumiR6T6zmZ2JfdEmHY6_0 2024-03-09T15:07:04.451 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17413587440466959916', time=2024-03-09T16:55:16.028338+0000, chain.objs.size()=1 2024-03-09T15:07:04.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.dEP9bx4NMT6XdTbpx_J6RTqnMhGd_iY_0 2024-03-09T15:07:04.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13691110803553889719', time=2024-03-09T16:55:16.032381+0000, chain.objs.size()=1 2024-03-09T15:07:04.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.-uQBvJm7U4yekiN-UG-23-PzmizNUte_0 2024-03-09T15:07:04.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8565866662676027714', time=2024-03-09T16:55:16.047467+0000, chain.objs.size()=1 2024-03-09T15:07:04.452 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.450+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.EcI66Mme26rprSem7hNbrvVPamoIbAw_0 2024-03-09T15:07:04.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.454+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4846316046670382562', time=2024-03-09T16:55:16.084611+0000, chain.objs.size()=1 2024-03-09T15:07:04.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.454+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.B8EfXof-YJkx8bare655fAJ9Ej5yrKJ_0 2024-03-09T15:07:04.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.454+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10299974891352598644', time=2024-03-09T16:55:16.319865+0000, chain.objs.size()=1 2024-03-09T15:07:04.453 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.454+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.FqSC-SrklrLCV-7t1vC-9voPV6QzPoj_0 2024-03-09T15:07:04.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.454+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8410253217815945442', time=2024-03-09T16:55:16.524386+0000, chain.objs.size()=1 2024-03-09T15:07:04.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.454+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.fIdvgVdqGxnmc1AQiQchwkrzn4-RjAX_0 2024-03-09T15:07:04.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.454+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13434382888273225155', time=2024-03-09T16:55:16.538360+0000, chain.objs.size()=1 2024-03-09T15:07:04.454 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.454+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.yqqBIHFM-C6Ty3oZuZaue0vlMjNcUsc_0 2024-03-09T15:07:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.454+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12975951952864902478', time=2024-03-09T16:55:16.807819+0000, chain.objs.size()=1 2024-03-09T15:07:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.454+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.gKoOVjacxGUJfi3dhPLhmXDG-XZ9yN7_0 2024-03-09T15:07:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.454+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11405764347198775160', time=2024-03-09T16:55:16.814056+0000, chain.objs.size()=1 2024-03-09T15:07:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.454+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.MHqxWI6iFhfa34JuD7tr2VpRa-T9789_0 2024-03-09T15:07:04.455 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.454+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9566975809499248693', time=2024-03-09T16:55:20.462605+0000, chain.objs.size()=1 2024-03-09T15:07:04.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.454+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.260__shadow_.4UprvezeXd0hE-by-3aeyqwDf4P17I4_0 2024-03-09T15:07:04.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.454+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6804783893410238450', time=2024-03-09T16:55:23.187640+0000, chain.objs.size()=1 2024-03-09T15:07:04.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.454+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.263__shadow_.IQfhGQng5MM5RBhhh-Uv-L_mJ09hNB4_0 2024-03-09T15:07:04.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5905920556753831895', time=2024-03-09T16:55:24.100533+0000, chain.objs.size()=1 2024-03-09T15:07:04.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.264__shadow_.O44L8y4f56HjT8EtkpvrteuF-Ye4jG4_0 2024-03-09T15:07:04.456 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13581151611997038399', time=2024-03-09T16:55:30.666549+0000, chain.objs.size()=1 2024-03-09T15:07:04.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.271__shadow_.QuAH4Gfgop4eu-og7LMTcQNOG0tUAOv_0 2024-03-09T15:07:04.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17061477081370213178', time=2024-03-09T16:55:41.218533+0000, chain.objs.size()=1 2024-03-09T15:07:04.457 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.282__shadow_.7lOXzaa6pvKuD79V22VkibHX3YrdFWJ_0 2024-03-09T15:07:04.458 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12827803314069921900', time=2024-03-09T16:55:43.099295+0000, chain.objs.size()=1 2024-03-09T15:07:04.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.284__shadow_.qJjOLppSm4eJkuMJcFuGVTyV3XKfWqE_0 2024-03-09T15:07:04.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3724398679883629180', time=2024-03-09T16:55:51.562704+0000, chain.objs.size()=1 2024-03-09T15:07:04.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.291__shadow_.efUukH2sVqp7o7VhH3wOH9t_2POyyaA_0 2024-03-09T15:07:04.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.390043190768244761', time=2024-03-09T16:56:14.708706+0000, chain.objs.size()=1 2024-03-09T15:07:04.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.315__shadow_.T9zQLF_n-1K473BAdSXjHwpKqF89x8s_0 2024-03-09T15:07:04.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14592494296417073425', time=2024-03-09T16:56:38.037151+0000, chain.objs.size()=1 2024-03-09T15:07:04.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.sPhHBkXeOvTDL_3xX2dnk_9E2Lhiwu3_0 2024-03-09T15:07:04.459 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9168547387529177854', time=2024-03-09T16:56:38.050747+0000, chain.objs.size()=1 2024-03-09T15:07:04.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.2PV_AYAvtrTFGnvSGCc_g_cPCO3OanL_0 2024-03-09T15:07:04.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13416554025976260627', time=2024-03-09T16:56:38.236165+0000, chain.objs.size()=1 2024-03-09T15:07:04.460 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.458+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.9u3Lzb8CmZz1gK9ck20JZXU1vRQhRCG_0 2024-03-09T15:07:04.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8013369774244394489', time=2024-03-09T16:56:38.261742+0000, chain.objs.size()=1 2024-03-09T15:07:04.461 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ytJdkQ1Cdtv3Mz6R2jbXjdnw-QeTKcF_0 2024-03-09T15:07:04.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12822616142690405548', time=2024-03-09T16:56:38.282103+0000, chain.objs.size()=1 2024-03-09T15:07:04.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.AY-rk7ccEqNnH35FIXqhMPz-kxdG_ZT_0 2024-03-09T15:07:04.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4417950828428508069', time=2024-03-09T16:56:38.283508+0000, chain.objs.size()=1 2024-03-09T15:07:04.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.x0LkbA_h70QpXZDC5Ibidudxvzb5WL2_0 2024-03-09T15:07:04.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13618187331796729807', time=2024-03-09T16:56:38.324957+0000, chain.objs.size()=1 2024-03-09T15:07:04.462 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.v9DF3-2cNtdtclyfsFuFWU6meIVGmrp_0 2024-03-09T15:07:04.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4874044024908600453', time=2024-03-09T16:56:38.380515+0000, chain.objs.size()=1 2024-03-09T15:07:04.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.dPua6smI_z7bBcUhtKxu6b471J2sQLS_0 2024-03-09T15:07:04.463 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7999835564958608665', time=2024-03-09T16:56:38.541780+0000, chain.objs.size()=1 2024-03-09T15:07:04.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.41M_VxiEixHKhTLdgLe_MOzhVM18C8V_0 2024-03-09T15:07:04.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15316645803106052311', time=2024-03-09T16:56:38.551678+0000, chain.objs.size()=1 2024-03-09T15:07:04.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.zoVD2bxBpMFFOq9Wsw0VcGNUX48i90l_0 2024-03-09T15:07:04.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17022895506991833867', time=2024-03-09T16:56:38.575507+0000, chain.objs.size()=1 2024-03-09T15:07:04.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Zyu_TnzJtwGARQzfy0paBiWhO4oNVLZ_0 2024-03-09T15:07:04.464 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13619877513438362481', time=2024-03-09T16:56:38.587318+0000, chain.objs.size()=1 2024-03-09T15:07:04.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kF1PWviPvlqR_cNQsDZyulCf_Yfg-iy_0 2024-03-09T15:07:04.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18097184661681329231', time=2024-03-09T16:56:38.594872+0000, chain.objs.size()=1 2024-03-09T15:07:04.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.462+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.jilM3yC_LWdN_-9-A5JfGoqae7kJA___0 2024-03-09T15:07:04.465 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.466+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7288737137258890965', time=2024-03-09T16:56:38.621272+0000, chain.objs.size()=1 2024-03-09T15:07:04.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.466+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ck3FVuVDnymGSq4D1dYgP10rNZ6K_Yd_0 2024-03-09T15:07:04.466 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.466+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14874200070790669678', time=2024-03-09T16:56:38.630811+0000, chain.objs.size()=1 2024-03-09T15:07:04.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.466+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.DN3pUvYif4uAIvBHoKK9xnQLFj3sVwY_0 2024-03-09T15:07:04.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.466+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6869410531526735930', time=2024-03-09T16:56:38.650311+0000, chain.objs.size()=1 2024-03-09T15:07:04.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.466+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.BCNDHz2r5uvX6P_aA4vQ8pr-vTWLbYU_0 2024-03-09T15:07:04.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.466+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17998312274076332866', time=2024-03-09T16:56:38.767981+0000, chain.objs.size()=1 2024-03-09T15:07:04.467 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.466+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.aAX1nJhQ6SJmz8XKR2cYfK3UGuoRqOV_0 2024-03-09T15:07:04.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.466+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12819028865590976391', time=2024-03-09T16:56:38.914837+0000, chain.objs.size()=1 2024-03-09T15:07:04.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.466+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.MvcIRqS5CDmegrqICZageVV_uI0zTbc_0 2024-03-09T15:07:04.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10591411666741968802', time=2024-03-09T16:56:38.918749+0000, chain.objs.size()=1 2024-03-09T15:07:04.468 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.OPzzD7eSVdluE56JuZN_uzNqC59PkZF_0 2024-03-09T15:07:04.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5759951121961173404', time=2024-03-09T16:56:39.165788+0000, chain.objs.size()=1 2024-03-09T15:07:04.469 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.gm3jw2oRo5T1mIJ5YvEhUCLtKWA4eI-_0 2024-03-09T15:07:04.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4496867810740326285', time=2024-03-09T16:56:39.169729+0000, chain.objs.size()=1 2024-03-09T15:07:04.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.mF5XSekTwFp9LypUhii11hN_kQAPcTs_0 2024-03-09T15:07:04.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2704859439356601364', time=2024-03-09T16:56:39.194862+0000, chain.objs.size()=1 2024-03-09T15:07:04.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.tXKmCb4KorPVNIhVIIAra25mATzkGZD_0 2024-03-09T15:07:04.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6261812533151019284', time=2024-03-09T16:56:39.389132+0000, chain.objs.size()=1 2024-03-09T15:07:04.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.yBsPZ9UVHEjImQJBjRJLLP9_aZSGX6b_0 2024-03-09T15:07:04.470 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6865808148909120371', time=2024-03-09T16:56:39.434284+0000, chain.objs.size()=1 2024-03-09T15:07:04.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.E6hcVU-QHTVfpYqOjArLSX80F-5rzIb_0 2024-03-09T15:07:04.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4317667481485812608', time=2024-03-09T16:56:39.584788+0000, chain.objs.size()=1 2024-03-09T15:07:04.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.pynbV14Qi_d53XeN-aApNF_4zciDZbC_0 2024-03-09T15:07:04.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5177920677712830853', time=2024-03-09T16:56:39.641767+0000, chain.objs.size()=1 2024-03-09T15:07:04.471 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.w5MTarPfqkQW_UguLUDLot6a6cbGn6D_0 2024-03-09T15:07:04.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16869543620628945779', time=2024-03-09T16:56:39.657410+0000, chain.objs.size()=1 2024-03-09T15:07:04.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.cuLTv4Henecym-jUpd5e3KKySG-CBT1_0 2024-03-09T15:07:04.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6380362768058111295', time=2024-03-09T16:56:39.674882+0000, chain.objs.size()=1 2024-03-09T15:07:04.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.470+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.N3Bb67DBtMKQ8RFtCweBXJ6cOl5gIci_0 2024-03-09T15:07:04.472 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1958924443991222260', time=2024-03-09T16:56:39.680762+0000, chain.objs.size()=1 2024-03-09T15:07:04.473 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.tc9fsC5vet_5Nd854V4Rnk358BzJrpY_0 2024-03-09T15:07:04.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14786301958113791068', time=2024-03-09T16:57:01.454364+0000, chain.objs.size()=1 2024-03-09T15:07:04.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.4wlQ30I0HAck2F9-WFnr-7MWqnyTAXq_0 2024-03-09T15:07:04.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13497255898994689723', time=2024-03-09T16:57:01.562860+0000, chain.objs.size()=1 2024-03-09T15:07:04.474 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.6_pG5TkoSozZPl5FlffdZOCtyvX6EVq_0 2024-03-09T15:07:04.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5738185854826116891', time=2024-03-09T16:57:01.564663+0000, chain.objs.size()=1 2024-03-09T15:07:04.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.diEmFYVISO9BJ6gSBL7uzD-hhr6901U_0 2024-03-09T15:07:04.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2175096611349451954', time=2024-03-09T16:57:01.580677+0000, chain.objs.size()=1 2024-03-09T15:07:04.475 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.p4TT8JUvuYlXAVwouyLz72qdVt23vYl_0 2024-03-09T15:07:04.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5337040630032804499', time=2024-03-09T16:57:01.583097+0000, chain.objs.size()=1 2024-03-09T15:07:04.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.D7OM-gzkNUNgr8xt_qNdRyKRwb-8Z-5_0 2024-03-09T15:07:04.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.828576660445628035', time=2024-03-09T16:57:01.786863+0000, chain.objs.size()=1 2024-03-09T15:07:04.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.GpZSdzhS6yHUEM8W-gK_fTYMKL6YTqp_0 2024-03-09T15:07:04.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9637228716265403788', time=2024-03-09T16:57:01.802426+0000, chain.objs.size()=1 2024-03-09T15:07:04.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.UjmQsvBjouCqo1XckaY45Tmi8OTj8K1_0 2024-03-09T15:07:04.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16318735898071230959', time=2024-03-09T16:57:01.818748+0000, chain.objs.size()=1 2024-03-09T15:07:04.476 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.474+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.zyNsd-IwvyK0NhtfNT-mIbplDlP_6Pt_0 2024-03-09T15:07:04.477 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14404041704127789033', time=2024-03-09T16:57:01.867721+0000, chain.objs.size()=1 2024-03-09T15:07:04.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.n44zitT_LjQYREJJRb3Q5tlfgV6psh8_0 2024-03-09T15:07:04.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16458590071918548764', time=2024-03-09T16:57:01.870491+0000, chain.objs.size()=1 2024-03-09T15:07:04.478 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.p6XBrH4T1qzsf5EADD-io-job9802Uf_0 2024-03-09T15:07:04.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10613306013686770592', time=2024-03-09T16:57:02.030238+0000, chain.objs.size()=1 2024-03-09T15:07:04.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.FiEqQdcjK4fRcU3QsPegqeE4haEoaXw_0 2024-03-09T15:07:04.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8369242992225124923', time=2024-03-09T16:57:02.092733+0000, chain.objs.size()=1 2024-03-09T15:07:04.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.WnHr-5ahU4f90zpOpt8KvMsInNiQ-of_0 2024-03-09T15:07:04.479 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4418179434146747631', time=2024-03-09T16:57:02.108745+0000, chain.objs.size()=1 2024-03-09T15:07:04.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.6dD8YOfHMio5T8ZKXapYFMNPILGVZwf_0 2024-03-09T15:07:04.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13478491684285368815', time=2024-03-09T16:57:02.215477+0000, chain.objs.size()=1 2024-03-09T15:07:04.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.qX6hbU_Y_1U6Icz5bBLX0pWvcVYZPzq_0 2024-03-09T15:07:04.480 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6430685732443976268', time=2024-03-09T16:57:02.240169+0000, chain.objs.size()=1 2024-03-09T15:07:04.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.k-lN29wZ8e6XTnIawivtrZvXx2OUsMe_0 2024-03-09T15:07:04.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12859780008137128372', time=2024-03-09T16:57:02.287421+0000, chain.objs.size()=1 2024-03-09T15:07:04.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.5nOIGn81fVmv0mH7T-gr4J_7hC2qcU5_0 2024-03-09T15:07:04.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1490235188830841110', time=2024-03-09T16:57:02.317676+0000, chain.objs.size()=1 2024-03-09T15:07:04.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.GAy0M_yZAp2Fk33sWws4-uJiSzCCdT-_0 2024-03-09T15:07:04.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12859441658703239151', time=2024-03-09T16:57:02.334695+0000, chain.objs.size()=1 2024-03-09T15:07:04.481 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Z6PzZ0go7BWMc6tAkbsxM3szlmOPpnx_0 2024-03-09T15:07:04.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15844970424289738155', time=2024-03-09T16:57:02.364073+0000, chain.objs.size()=1 2024-03-09T15:07:04.482 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.478+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xRNt3vi-wUUW5D-aiQ0gzJyi2goxNw8_0 2024-03-09T15:07:04.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.486+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12930645757845091954', time=2024-03-09T16:57:02.364954+0000, chain.objs.size()=1 2024-03-09T15:07:04.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.486+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.HDCt3f9bTt9nxaPEgD8PXGUze1L9Xk6_0 2024-03-09T15:07:04.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.486+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4366299274232319268', time=2024-03-09T16:57:02.554892+0000, chain.objs.size()=1 2024-03-09T15:07:04.486 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.486+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.LW_p7DTxNjcSV7cYkl_3jpzFejnpLwH_0 2024-03-09T15:07:04.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.486+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6822008036759608190', time=2024-03-09T16:57:02.565599+0000, chain.objs.size()=1 2024-03-09T15:07:04.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.486+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.3K8ktzxflgYB7jZNsSPQDH67X0aPoJI_0 2024-03-09T15:07:04.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.486+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10674242432122107101', time=2024-03-09T16:57:02.576599+0000, chain.objs.size()=1 2024-03-09T15:07:04.487 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.486+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.E3vjvz57ilxOYbLRGe06BU0WLw442XA_0 2024-03-09T15:07:04.490 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.490+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/43227 2024-03-09T15:07:04.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-03-09T15:07:04.492 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15028717137211911465', time=2024-03-09T16:57:02.611390+0000, chain.objs.size()=1 2024-03-09T15:07:04.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.l3dP26VcFeF_TTXf9DlcV-PeKZPr7jQ_0 2024-03-09T15:07:04.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12796791631543828191', time=2024-03-09T16:57:02.634505+0000, chain.objs.size()=1 2024-03-09T15:07:04.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.J4bRz8BgrKgqdEhNzROyHthXnlohx2c_0 2024-03-09T15:07:04.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11314633101722205235', time=2024-03-09T16:57:02.731029+0000, chain.objs.size()=1 2024-03-09T15:07:04.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.RbORWKGIOewTZyc-4v1UH4W_nE_Apux_0 2024-03-09T15:07:04.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3978481845276234440', time=2024-03-09T16:57:02.825645+0000, chain.objs.size()=1 2024-03-09T15:07:04.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ktUJgQOZw3BcgM-Pt2oN9Z0qCBoWvl9_0 2024-03-09T15:07:04.493 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15252762232358850044', time=2024-03-09T16:57:02.965023+0000, chain.objs.size()=1 2024-03-09T15:07:04.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.82XIsmh03EIguy2bjwQVxRiTapPpuzg_0 2024-03-09T15:07:04.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5327374427695699416', time=2024-03-09T16:57:02.994667+0000, chain.objs.size()=1 2024-03-09T15:07:04.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.QWCyXwVF8ICSUBWzPCYeKMqEzzSinvp_0 2024-03-09T15:07:04.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10897600973521688421', time=2024-03-09T16:57:03.008073+0000, chain.objs.size()=1 2024-03-09T15:07:04.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DOALWj9EUmazYuTYtdm21Zhe_yVP9v9_0 2024-03-09T15:07:04.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12213811317780050174', time=2024-03-09T16:57:03.039136+0000, chain.objs.size()=1 2024-03-09T15:07:04.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.jyI_bWArbaVL5Vfcluj81es0VCwF6lA_0 2024-03-09T15:07:04.494 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7298029644452150900', time=2024-03-09T16:57:03.293153+0000, chain.objs.size()=1 2024-03-09T15:07:04.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.MALI2gnJ5eLQXZErru4saJfIX-dm3j8_0 2024-03-09T15:07:04.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13648166038687357403', time=2024-03-09T16:57:03.330112+0000, chain.objs.size()=1 2024-03-09T15:07:04.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.HOZWtSiPRXJH7pal2jnnuPRLVZFFWAv_0 2024-03-09T15:07:04.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15956402921417473679', time=2024-03-09T16:57:03.346413+0000, chain.objs.size()=1 2024-03-09T15:07:04.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.GMHPiEdjF5fVgkcO9JPAixGUDYNwJS-_0 2024-03-09T15:07:04.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4402505440376971794', time=2024-03-09T16:57:03.360706+0000, chain.objs.size()=1 2024-03-09T15:07:04.495 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.494+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.0BaB9zk_6nZJV3Kmec-3lqInA4ilP7G_0 2024-03-09T15:07:04.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14870730740858620640', time=2024-03-09T16:57:03.376273+0000, chain.objs.size()=1 2024-03-09T15:07:04.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ztpYAxwZz7YBpLvG31oIgOFLCkFGSNL_0 2024-03-09T15:07:04.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2305895314808511058', time=2024-03-09T16:57:03.393977+0000, chain.objs.size()=1 2024-03-09T15:07:04.497 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.YyYBkD7Pl0UmYDnaG8g7weML2sCEYWp_0 2024-03-09T15:07:04.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4911895197875356345', time=2024-03-09T16:57:12.376062+0000, chain.objs.size()=1 2024-03-09T15:07:04.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.328__shadow_.LOOAGYJQ-xernYvv_tyR7B25SAlDqyE_0 2024-03-09T15:07:04.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14178158900500581233', time=2024-03-09T16:58:02.934213+0000, chain.objs.size()=1 2024-03-09T15:07:04.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.384__shadow_.6dW0cwlBVi9xaQ9nwDWWi6R7geh6HMo_0 2024-03-09T15:07:04.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13294615048239135662', time=2024-03-09T16:58:50.787628+0000, chain.objs.size()=1 2024-03-09T15:07:04.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.433__shadow_.h8Az6aFEAIeRGQ_pchaPNsTjLlXnczg_0 2024-03-09T15:07:04.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.800641708261233651', time=2024-03-09T16:59:20.329668+0000, chain.objs.size()=1 2024-03-09T15:07:04.498 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.460__shadow_.ZTI09iUXVDYcgFdJynRp7AyClNsWya9_0 2024-03-09T15:07:04.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12444974086281348456', time=2024-03-09T16:59:38.421277+0000, chain.objs.size()=1 2024-03-09T15:07:04.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.484__shadow_.PZF98Qx0Z7DgA53qW0Vd_x3KG6UW0cx_0 2024-03-09T15:07:04.499 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15250826831935473400', time=2024-03-09T16:59:40.393278+0000, chain.objs.size()=1 2024-03-09T15:07:04.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.487__shadow_.Pi_0Tx3jkhZem041Mr4nobU1O67sYIG_0 2024-03-09T15:07:04.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5639361820341337080', time=2024-03-09T17:00:30.646581+0000, chain.objs.size()=3 2024-03-09T15:07:04.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.517__multipart_mymultipart.2~5LTLr27wLJUJBQeyI5_no2JlLdHS_hX.1 2024-03-09T15:07:04.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.517__multipart_mymultipart.2~5LTLr27wLJUJBQeyI5_no2JlLdHS_hX.2 2024-03-09T15:07:04.500 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.498+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.517__multipart_mymultipart.2~5LTLr27wLJUJBQeyI5_no2JlLdHS_hX.3 2024-03-09T15:07:04.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.502+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16995398679259892343', time=2024-03-09T17:01:40.081816+0000, chain.objs.size()=1 2024-03-09T15:07:04.501 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.502+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.554__multipart_mymultipart.DveR0AFVepqugfKN8jcHu4Ws-5gZCnjX.1 2024-03-09T15:07:04.502 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.502+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4414829945477495064', time=2024-03-09T17:02:27.116714+0000, chain.objs.size()=1 2024-03-09T15:07:04.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.502+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:ri6UYGTxcDv7O3QHp84I0Taueopu6mW_.fjYYqS80mS9nBU-8Pj_Z04YT7Bqt9bM_0 2024-03-09T15:07:04.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.502+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.573__shadow:L3zT9mlDs1Azn.Si9K6gXUUJ2V4J8Cp_.Rq6OYpoFcPbS3fRQl_gx5DKyzgLj9sV_1_89a7cd713e933b3f3679755c77e4ef8b', time=2024-03-09T17:02:39.457981+0000, chain.objs.size()=1 2024-03-09T15:07:04.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.502+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.573__shadow:L3zT9mlDs1Azn.Si9K6gXUUJ2V4J8Cp_.Rq6OYpoFcPbS3fRQl_gx5DKyzgLj9sV_0 2024-03-09T15:07:04.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.502+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3299456285304010364', time=2024-03-09T17:02:40.493055+0000, chain.objs.size()=1 2024-03-09T15:07:04.503 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.502+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.575__shadow:WFj4CYV9YJ1om-yTBWIV7cy.X7FtvT2_.Gdap_8ANFEcw-yuQxH2LnFQepDUhHFx_0 2024-03-09T15:07:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.502+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10627055628005494581', time=2024-03-09T17:04:31.918620+0000, chain.objs.size()=1 2024-03-09T15:07:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.502+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.680__shadow_.y6xRa0iQt3PPk1ANA4tCN_D4Fnsmsvs_0 2024-03-09T15:07:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.502+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16942527913893935557', time=2024-03-09T17:04:39.029336+0000, chain.objs.size()=1 2024-03-09T15:07:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.502+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.688__shadow:UrWUll87Enl0izBx.Il0o-MaTYQ8ki._.VaCPzSY7ilswcFci7A1LGTm6wnFHCOr_0 2024-03-09T15:07:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.502+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.705__shadow_.hFPOrblmHCCFX0y8B0_jaJKD15vFCFd_1_3c32ec5f8918817465c42aae3c7bc85b', time=2024-03-09T17:05:13.996695+0000, chain.objs.size()=1 2024-03-09T15:07:04.504 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.502+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.705__shadow_.hFPOrblmHCCFX0y8B0_jaJKD15vFCFd_0 2024-03-09T15:07:04.512 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.514+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:04.514 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.514+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-09T15:07:04.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.514+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:04.515 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.514+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:04.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43919' 2024-03-09T15:07:04.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='_PT7251jgGQExhv1pBSyPWDCvVfLDJpS', time=2024-03-09T16:51:52.482967+0000, chain.objs.size()=1 2024-03-09T15:07:04.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.154__shadow_.cAi3DvbjrM3gTcq1-VkIaqk09TlQsvH_0 2024-03-09T15:07:04.517 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='_znV0CS0csZtlXFAw5xbIziLRhU0kYXO', time=2024-03-09T16:51:55.232185+0000, chain.objs.size()=2 2024-03-09T15:07:04.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__shadow_.y5NDAYISC4URezioSeWFeeCAO8Rx2-r_0 2024-03-09T15:07:04.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__shadow_.y5NDAYISC4URezioSeWFeeCAO8Rx2-r_1 2024-03-09T15:07:04.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5411042209294950772', time=2024-03-09T16:54:44.396903+0000, chain.objs.size()=1 2024-03-09T15:07:04.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.246__shadow_.kQeuQjuBlnV-1EzU7fuoyBwct-in8J2_0 2024-03-09T15:07:04.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4511418709018125864', time=2024-03-09T16:54:48.176385+0000, chain.objs.size()=1 2024-03-09T15:07:04.518 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.250__shadow_.2MGaCVH08TTYMjRSO7iPUUAMYkDowRM_0 2024-03-09T15:07:04.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3853918482397845970', time=2024-03-09T16:55:14.840108+0000, chain.objs.size()=1 2024-03-09T15:07:04.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.4z3c_bYe9Gen0tf2VbDu87H2T4eJF-f_0 2024-03-09T15:07:04.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7791525590034340115', time=2024-03-09T16:55:14.930317+0000, chain.objs.size()=1 2024-03-09T15:07:04.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.kfxdOTjXCSyI7VuVysmY-SIs6r3MwgO_0 2024-03-09T15:07:04.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7533957235418857218', time=2024-03-09T16:55:14.932814+0000, chain.objs.size()=1 2024-03-09T15:07:04.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.vWmhHArgu69R1b9T3I7Ot-jYA2Pyrc5_0 2024-03-09T15:07:04.519 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7413531006393419902', time=2024-03-09T16:55:15.138769+0000, chain.objs.size()=1 2024-03-09T15:07:04.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.vN36cbQc-hIYVa0NxIwq1XDKXotn7yY_0 2024-03-09T15:07:04.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2248516013976241774', time=2024-03-09T16:55:15.208644+0000, chain.objs.size()=1 2024-03-09T15:07:04.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.kMVx56z43iq9A38yD5USx0qK3g-jRMo_0 2024-03-09T15:07:04.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9838304354873203410', time=2024-03-09T16:55:15.211029+0000, chain.objs.size()=1 2024-03-09T15:07:04.520 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.GAVBlj0c_sD8TO4P1c48qzRBzidGlDv_0 2024-03-09T15:07:04.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11396550638239653960', time=2024-03-09T16:55:15.224069+0000, chain.objs.size()=1 2024-03-09T15:07:04.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.518+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.q3IyxR7xYWICF4GXHIHH5D1XTp6lTBX_0 2024-03-09T15:07:04.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8972990668318391283', time=2024-03-09T16:55:15.256421+0000, chain.objs.size()=1 2024-03-09T15:07:04.521 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.wKjhjHvhOAARaMV4ohKQQc15YhiCLts_0 2024-03-09T15:07:04.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2415890049645359981', time=2024-03-09T16:55:15.452247+0000, chain.objs.size()=1 2024-03-09T15:07:04.526 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.4c7f6fSJvlqe9h0_JKP3OT0PWATLky8_0 2024-03-09T15:07:04.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11795756625026263391', time=2024-03-09T16:55:15.475411+0000, chain.objs.size()=1 2024-03-09T15:07:04.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.r0-bmFQhbPBNkTdKi7rCdOD2Tdhi5UP_0 2024-03-09T15:07:04.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2794909910132622302', time=2024-03-09T16:55:15.531607+0000, chain.objs.size()=1 2024-03-09T15:07:04.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Q4G75UuGD1b_vYzhguWBYsU0LPCqOP-_0 2024-03-09T15:07:04.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3798356394301505669', time=2024-03-09T16:55:15.536880+0000, chain.objs.size()=1 2024-03-09T15:07:04.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.v2cZQ1zX-rGigEIV7u5TR2PsePzyxbt_0 2024-03-09T15:07:04.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16978106533161177905', time=2024-03-09T16:55:15.700837+0000, chain.objs.size()=1 2024-03-09T15:07:04.527 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.V9lVgLKiUIZnxFN-hE0dvAVh7b43OLP_0 2024-03-09T15:07:04.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18405230701647814392', time=2024-03-09T16:55:15.709345+0000, chain.objs.size()=1 2024-03-09T15:07:04.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.jmqpwx_4g-3rivpWAvuLhTG04iiSUXj_0 2024-03-09T15:07:04.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8279730916992691515', time=2024-03-09T16:55:15.765941+0000, chain.objs.size()=1 2024-03-09T15:07:04.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.SKHVoj_BjH9sCS1X3YlUm8DccO2n8hQ_0 2024-03-09T15:07:04.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5153848872683575265', time=2024-03-09T16:55:15.788858+0000, chain.objs.size()=1 2024-03-09T15:07:04.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.8XezHKBriQgiZ5az1t0nsss0ECpbarZ_0 2024-03-09T15:07:04.528 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3918205656527702316', time=2024-03-09T16:55:15.798533+0000, chain.objs.size()=1 2024-03-09T15:07:04.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.CYlLYVIcdfklBXlULxOEh3NoZo86GTm_0 2024-03-09T15:07:04.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4508915498737440143', time=2024-03-09T16:55:15.829778+0000, chain.objs.size()=1 2024-03-09T15:07:04.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.522+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.VpEo6nHi0aKaU7ZH9PPIIQKg2r88QT9_0 2024-03-09T15:07:04.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.526+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14909603606493462583', time=2024-03-09T16:55:15.834555+0000, chain.objs.size()=1 2024-03-09T15:07:04.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.526+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.2i9J0GAkJyG1IziM_EbuMnmqBsC3z8f_0 2024-03-09T15:07:04.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.526+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5936328218269978041', time=2024-03-09T16:55:15.971720+0000, chain.objs.size()=1 2024-03-09T15:07:04.529 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.526+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.p6SBoMzX4vbHfsmoEwljN49TAJ-wgie_0 2024-03-09T15:07:04.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13931387012070691791', time=2024-03-09T16:55:16.011418+0000, chain.objs.size()=1 2024-03-09T15:07:04.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.NsitIarXfh5Px2Rsb7B8O4zGP86UlAU_0 2024-03-09T15:07:04.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7698170687296071003', time=2024-03-09T16:55:16.070436+0000, chain.objs.size()=1 2024-03-09T15:07:04.530 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.R-YwYunOzKI7i7Kygw50LXEKo0UJs7M_0 2024-03-09T15:07:04.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14262400251553356612', time=2024-03-09T16:55:16.087684+0000, chain.objs.size()=1 2024-03-09T15:07:04.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.fedaaDAlkRMZ4edqrZS94K7Nubk8ecf_0 2024-03-09T15:07:04.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15201666681062479726', time=2024-03-09T16:55:16.557737+0000, chain.objs.size()=1 2024-03-09T15:07:04.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.0ZbWOMEwOHPZgV6h900aNZSfJSUSWP4_0 2024-03-09T15:07:04.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15538394494413446328', time=2024-03-09T16:55:16.726633+0000, chain.objs.size()=1 2024-03-09T15:07:04.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.bHl3Um8FCQpvpbxzX2Vazsl0riNX3Qj_0 2024-03-09T15:07:04.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2545864894620598365', time=2024-03-09T16:55:16.760240+0000, chain.objs.size()=1 2024-03-09T15:07:04.531 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.vv8IW5AT-rXDEZp39dNiZAm8aDibPlS_0 2024-03-09T15:07:04.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18315358138399338592', time=2024-03-09T16:55:16.844722+0000, chain.objs.size()=1 2024-03-09T15:07:04.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.a-jmDTLkk0QE0OjmTjdzwtGDryzY__p_0 2024-03-09T15:07:04.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1150149734898885547', time=2024-03-09T16:55:36.262126+0000, chain.objs.size()=1 2024-03-09T15:07:04.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.277__shadow_.gOe27RW3cgaLwq_aYHQGAloFjqzGYnH_0 2024-03-09T15:07:04.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16849108828809627634', time=2024-03-09T16:55:39.346673+0000, chain.objs.size()=1 2024-03-09T15:07:04.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.280__shadow_.cyBCC8l3PYazsCJjsAbEFjHn2nHr8rn_0 2024-03-09T15:07:04.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9740380945570954516', time=2024-03-09T16:55:49.676447+0000, chain.objs.size()=1 2024-03-09T15:07:04.532 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.289__shadow_.hNFCaz_tCB9Qvvywvlk0P_5aaSVCaQd_0 2024-03-09T15:07:04.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4996692251177886787', time=2024-03-09T16:56:37.705609+0000, chain.objs.size()=1 2024-03-09T15:07:04.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.530+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.bFHmxZvCaP1nZHlubBUaLGdbq3e-DHG_0 2024-03-09T15:07:04.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18199875981554620769', time=2024-03-09T16:56:37.739305+0000, chain.objs.size()=1 2024-03-09T15:07:04.533 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6dti2e8k6Jf1K0vVNZIF0f9YJC-gWKL_0 2024-03-09T15:07:04.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17673077318357908977', time=2024-03-09T16:56:37.761699+0000, chain.objs.size()=1 2024-03-09T15:07:04.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.yl2BXO7sB-yctPwnwA0yD_Q_9ohWS6M_0 2024-03-09T15:07:04.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13008449306269471959', time=2024-03-09T16:56:37.812090+0000, chain.objs.size()=1 2024-03-09T15:07:04.534 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ou_1yK72FlfEvcIf1z4ws4r-xDksGNV_0 2024-03-09T15:07:04.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6568994126875122025', time=2024-03-09T16:56:37.840819+0000, chain.objs.size()=1 2024-03-09T15:07:04.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lWV7Z4sgLm-oF0swJwiDJRYoHDp5WaX_0 2024-03-09T15:07:04.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13072333169076735834', time=2024-03-09T16:56:37.974196+0000, chain.objs.size()=1 2024-03-09T15:07:04.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.FLykqNsdvCos_PXwRcRsrSpMcmOnqgQ_0 2024-03-09T15:07:04.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4594703992869175225', time=2024-03-09T16:56:38.118478+0000, chain.objs.size()=1 2024-03-09T15:07:04.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.jDvtF7J-qfR-VpJmNO6-oKx3n8KNSJI_0 2024-03-09T15:07:04.535 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18044849751365940882', time=2024-03-09T16:56:38.257624+0000, chain.objs.size()=1 2024-03-09T15:07:04.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.2ULrXS3_3ALkMfczZcmB5ryrKLwp78m_0 2024-03-09T15:07:04.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14927868512314924208', time=2024-03-09T16:56:38.265397+0000, chain.objs.size()=1 2024-03-09T15:07:04.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.IInpf0qPL08fcFQtYv-nAqhZGWKQ8___0 2024-03-09T15:07:04.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2951604030908232723', time=2024-03-09T16:56:38.270598+0000, chain.objs.size()=1 2024-03-09T15:07:04.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.l9kJa_JFt5R7nGBMdgAzUNGsT9M40Oc_0 2024-03-09T15:07:04.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3419915757636460120', time=2024-03-09T16:56:38.286067+0000, chain.objs.size()=1 2024-03-09T15:07:04.536 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.R31ds1_iWA0JaO5UPIkabjp7qZuPiWg_0 2024-03-09T15:07:04.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5447216820067946916', time=2024-03-09T16:56:38.287052+0000, chain.objs.size()=1 2024-03-09T15:07:04.537 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.534+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.OP4KpVX6MLPytIFeLcrogcL9zlLbJva_0 2024-03-09T15:07:04.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.538+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7991864775574239764', time=2024-03-09T16:56:38.334745+0000, chain.objs.size()=1 2024-03-09T15:07:04.538 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.538+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.DW1SZjMnQvWAL0cIBj227UyKKD-g5HV_0 2024-03-09T15:07:04.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.538+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.553475049118053319', time=2024-03-09T16:56:38.364088+0000, chain.objs.size()=1 2024-03-09T15:07:04.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.538+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.v4ymBl2PE-Qx_Y3lSWLncWxK9MgZXlG_0 2024-03-09T15:07:04.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.538+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3391603382247434180', time=2024-03-09T16:56:38.370708+0000, chain.objs.size()=1 2024-03-09T15:07:04.540 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.538+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.oEj3s0O651Ljv0TxX5VmCoVylcgsxfa_0 2024-03-09T15:07:04.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8394240999167306658', time=2024-03-09T16:56:38.371772+0000, chain.objs.size()=1 2024-03-09T15:07:04.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.B1pV0suvPt0sfmJPJpwZcNqURiSKWAe_0 2024-03-09T15:07:04.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.107768154827033203', time=2024-03-09T16:56:38.547588+0000, chain.objs.size()=1 2024-03-09T15:07:04.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.pUBPuVDqVJDaB6D3fZ_jMQ9PlnSLgPI_0 2024-03-09T15:07:04.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2601838141006186399', time=2024-03-09T16:56:38.557810+0000, chain.objs.size()=1 2024-03-09T15:07:04.541 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.vzSHMr5PjEGzBlOx5P0TtPqUYw-iJGD_0 2024-03-09T15:07:04.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15177675662852782351', time=2024-03-09T16:56:38.914993+0000, chain.objs.size()=1 2024-03-09T15:07:04.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0T58APgFMAc5dtT91LYM1c0l2e5wUOs_0 2024-03-09T15:07:04.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8108600926653562813', time=2024-03-09T16:56:39.046982+0000, chain.objs.size()=1 2024-03-09T15:07:04.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.fEPuVxa0VQzLy74W8hiWY3msBaxoeAG_0 2024-03-09T15:07:04.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2538803973260710093', time=2024-03-09T16:56:39.098422+0000, chain.objs.size()=1 2024-03-09T15:07:04.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.xBzV8AourdWJvBQ42MrE751kVQy_rPX_0 2024-03-09T15:07:04.542 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14930945111659095900', time=2024-03-09T16:56:39.351443+0000, chain.objs.size()=1 2024-03-09T15:07:04.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.IGWSkAVTnvVCY9FVtrqghBFdhUZmnQx_0 2024-03-09T15:07:04.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4380197697447450245', time=2024-03-09T16:56:39.440609+0000, chain.objs.size()=1 2024-03-09T15:07:04.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.V1ERV42wKly7wXj39oY-ktQuSUCFozf_0 2024-03-09T15:07:04.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11568932211170379169', time=2024-03-09T16:56:39.450488+0000, chain.objs.size()=1 2024-03-09T15:07:04.543 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.542+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.gV5BkwATi9AdE0DQeUurxbf7vXoOmoK_0 2024-03-09T15:07:04.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3152242391178774773', time=2024-03-09T16:56:39.612325+0000, chain.objs.size()=1 2024-03-09T15:07:04.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.QmUlvdAJoTJR7Ygf4v2FOhsRVNla9Xc_0 2024-03-09T15:07:04.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13602644344144588782', time=2024-03-09T16:56:39.654913+0000, chain.objs.size()=1 2024-03-09T15:07:04.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ZoV9QJ5fs5ZZ_OHXqQ2gPeIOyzPPuQN_0 2024-03-09T15:07:04.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8515342331467685837', time=2024-03-09T16:56:39.667900+0000, chain.objs.size()=1 2024-03-09T15:07:04.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.7nHZFnZ6Pydcx6X7UixNJX0x8c-pEkJ_0 2024-03-09T15:07:04.547 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.544749192131857841', time=2024-03-09T16:56:39.681830+0000, chain.objs.size()=1 2024-03-09T15:07:04.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.G-2lgq41ZFIbJf9LSdXnZdKorK7I4WC_0 2024-03-09T15:07:04.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15128409891464991972', time=2024-03-09T16:57:01.461499+0000, chain.objs.size()=1 2024-03-09T15:07:04.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.S99RMbk-ngSbaoTCJ7NJqfTkXqlizYS_0 2024-03-09T15:07:04.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17140091053515579935', time=2024-03-09T16:57:01.508018+0000, chain.objs.size()=1 2024-03-09T15:07:04.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.fRNjyuTmQsqFY86CSWZf121SC2LkgHC_0 2024-03-09T15:07:04.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12805255708224769357', time=2024-03-09T16:57:01.555141+0000, chain.objs.size()=1 2024-03-09T15:07:04.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.-lldYO58dbTJVcX0wSWdI2aYL0ZAKP1_0 2024-03-09T15:07:04.548 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2934200077345933293', time=2024-03-09T16:57:01.562438+0000, chain.objs.size()=1 2024-03-09T15:07:04.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.tTCjhX3iifeFUBgR1owdwko2WtrzmCV_0 2024-03-09T15:07:04.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9120954774546929218', time=2024-03-09T16:57:01.729702+0000, chain.objs.size()=1 2024-03-09T15:07:04.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.00Xh46CjUX-CHree8IBYK2xaYWJ5Dgp_0 2024-03-09T15:07:04.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13072767623450897711', time=2024-03-09T16:57:01.766336+0000, chain.objs.size()=1 2024-03-09T15:07:04.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.c6DtIzVpsm4iQG6ipH0KakQIve2vIB3_0 2024-03-09T15:07:04.549 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8229848935382399151', time=2024-03-09T16:57:01.773760+0000, chain.objs.size()=1 2024-03-09T15:07:04.550 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.546+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.3-7xfhux5xPgjtByWImTqnZp5LMjyen_0 2024-03-09T15:07:04.551 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.550+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2332416689852137333', time=2024-03-09T16:57:01.784183+0000, chain.objs.size()=1 2024-03-09T15:07:04.552 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.550+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.rMIk_k7lSMHaQUyUiU5_7ZNNMDvglXa_0 2024-03-09T15:07:04.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14497039312183172558', time=2024-03-09T16:57:01.815417+0000, chain.objs.size()=1 2024-03-09T15:07:04.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.v7rbSA89ot886_Sov5TGEubmkYsrfDp_0 2024-03-09T15:07:04.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1706177958043164085', time=2024-03-09T16:57:01.834767+0000, chain.objs.size()=1 2024-03-09T15:07:04.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.-abfsHHkCRW8dekR_DFIpUNWKVcF22M_0 2024-03-09T15:07:04.553 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2216701963003343710', time=2024-03-09T16:57:01.851468+0000, chain.objs.size()=1 2024-03-09T15:07:04.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.B1Al0CgBB0NEJffzo_udRW6UxJO-USS_0 2024-03-09T15:07:04.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8196588394676773494', time=2024-03-09T16:57:01.852674+0000, chain.objs.size()=1 2024-03-09T15:07:04.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.0tSjIN8NN-ujWDTq_j6VloaoedtpzTF_0 2024-03-09T15:07:04.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14888207425966279080', time=2024-03-09T16:57:01.870514+0000, chain.objs.size()=1 2024-03-09T15:07:04.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.qDHvAdmTWW4cquZ5UAxnuZKFjavL9aP_0 2024-03-09T15:07:04.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4097983725681619742', time=2024-03-09T16:57:01.966767+0000, chain.objs.size()=1 2024-03-09T15:07:04.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.NerpLi_xt8tzW2rDcYa1e8ym1G75V3T_0 2024-03-09T15:07:04.554 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8769333074883295336', time=2024-03-09T16:57:02.000945+0000, chain.objs.size()=1 2024-03-09T15:07:04.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.EG_fHriQrkEHYOEjsHZ8wU4kl416IAl_0 2024-03-09T15:07:04.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10181091817497779810', time=2024-03-09T16:57:02.016205+0000, chain.objs.size()=1 2024-03-09T15:07:04.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.KAtUDRgUiR7nmOot726FTEhUmJaK-XO_0 2024-03-09T15:07:04.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5058593925969387701', time=2024-03-09T16:57:02.095222+0000, chain.objs.size()=1 2024-03-09T15:07:04.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.7fm5Xzp6zV2ndWDm61Ifo8NITik5iYh_0 2024-03-09T15:07:04.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13107346828219753430', time=2024-03-09T16:57:02.220412+0000, chain.objs.size()=1 2024-03-09T15:07:04.555 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.AV8BExWe5ggnNYWoDMZQQVA8X8rggtT_0 2024-03-09T15:07:04.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.772396800893939612', time=2024-03-09T16:57:02.227966+0000, chain.objs.size()=1 2024-03-09T15:07:04.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.mm1j2p2T4PnzqCR4cwi5tZUEfmLljcX_0 2024-03-09T15:07:04.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17997189558691936789', time=2024-03-09T16:57:02.276655+0000, chain.objs.size()=1 2024-03-09T15:07:04.556 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.554+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.n96C2DDYMGhj1Xn1o9euN5FyLP7QcED_0 2024-03-09T15:07:04.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1805682550454036379', time=2024-03-09T16:57:02.329537+0000, chain.objs.size()=1 2024-03-09T15:07:04.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.J-mpcAu-ZtJKqKLH8PnjaMXv5I2FqPG_0 2024-03-09T15:07:04.559 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2992329944619079666', time=2024-03-09T16:57:02.352036+0000, chain.objs.size()=1 2024-03-09T15:07:04.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.NGOo_A-XcfKD39yAqMYfSB-q3bkLPZb_0 2024-03-09T15:07:04.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2306590301790164054', time=2024-03-09T16:57:02.487772+0000, chain.objs.size()=1 2024-03-09T15:07:04.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.nBVcTl3p4yTk7-Z4ckdQbGDR7sarHqA_0 2024-03-09T15:07:04.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9992345951809114667', time=2024-03-09T16:57:02.527909+0000, chain.objs.size()=1 2024-03-09T15:07:04.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.4X3YintuBeJwNlsAAJoAwjRWffOYJvJ_0 2024-03-09T15:07:04.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13756428752131247853', time=2024-03-09T16:57:02.536298+0000, chain.objs.size()=1 2024-03-09T15:07:04.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Ws4SIJlLJm2zkXAwbBesedo94-CHqep_0 2024-03-09T15:07:04.560 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8667135005799068362', time=2024-03-09T16:57:02.538043+0000, chain.objs.size()=1 2024-03-09T15:07:04.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.d-iH1RNy5II6jtiuDEzSZiVhO-_hctY_0 2024-03-09T15:07:04.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6247264664996358888', time=2024-03-09T16:57:02.788492+0000, chain.objs.size()=1 2024-03-09T15:07:04.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.lh7H0-9DWhEJmCOsmdnBYvzPzwEAJC5_0 2024-03-09T15:07:04.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5247298213901782311', time=2024-03-09T16:57:02.831501+0000, chain.objs.size()=1 2024-03-09T15:07:04.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.tkJpCGEcWiWxlmTrPWi2MK_AdSPkPO4_0 2024-03-09T15:07:04.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9273299414477295393', time=2024-03-09T16:57:03.022195+0000, chain.objs.size()=1 2024-03-09T15:07:04.561 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.UveA4TLGPdGKwOXW2k73wC5sO4hZC7J_0 2024-03-09T15:07:04.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6941460578342085817', time=2024-03-09T16:57:03.066330+0000, chain.objs.size()=1 2024-03-09T15:07:04.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.eQ7vjbd0iEHqV120ELjoB3sGGvSnnKo_0 2024-03-09T15:07:04.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17865335725982738424', time=2024-03-09T16:57:03.101194+0000, chain.objs.size()=1 2024-03-09T15:07:04.562 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.558+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.vl_flh6ZcGA3AvYGJ-RE8DrfW8wOvfF_0 2024-03-09T15:07:04.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.566+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10475685302588220372', time=2024-03-09T16:57:03.112440+0000, chain.objs.size()=1 2024-03-09T15:07:04.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.566+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.KwM35qH3IcKfWReyrWaKhBKUlJ5sQJ3_0 2024-03-09T15:07:04.565 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.566+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9342156860416503887', time=2024-03-09T16:57:03.116714+0000, chain.objs.size()=1 2024-03-09T15:07:04.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.566+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.rF3JESsPGQ1Ad_PYy0RBme_i8tnCDOI_0 2024-03-09T15:07:04.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.566+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13348697128415677946', time=2024-03-09T16:57:03.293455+0000, chain.objs.size()=1 2024-03-09T15:07:04.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.566+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.93RDwk5mnSA_AAeYxItogDffz0TwCC1_0 2024-03-09T15:07:04.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.566+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13381259085076391832', time=2024-03-09T16:57:03.330070+0000, chain.objs.size()=1 2024-03-09T15:07:04.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.566+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ERRzH53W1mm3QN0rUK6aPupRt6hngW0_0 2024-03-09T15:07:04.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.566+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.143843836696660996', time=2024-03-09T16:57:14.118439+0000, chain.objs.size()=1 2024-03-09T15:07:04.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.566+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.330__shadow_.vWeLDzmjnyGVyL-Gpf2bTX-tJLmAGap_0 2024-03-09T15:07:04.566 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.566+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6750734197540527406', time=2024-03-09T16:57:20.984094+0000, chain.objs.size()=1 2024-03-09T15:07:04.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.566+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.338__shadow_.HQ2Th7kt4TvCMsSa8CGcbocKUWOixB6_0 2024-03-09T15:07:04.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.566+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10456910204346603660', time=2024-03-09T16:59:13.381396+0000, chain.objs.size()=1 2024-03-09T15:07:04.567 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.566+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.454__shadow_.foMk3a-bHmF_0Apq8yEEuIAs43JXjir_0 2024-03-09T15:07:04.570 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.570+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/43919 2024-03-09T15:07:04.572 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-03-09T15:07:04.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3084340003116079387', time=2024-03-09T16:59:19.519253+0000, chain.objs.size()=1 2024-03-09T15:07:04.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.459__shadow_.mTtis453Gv5WQulWJdDh2jIOxjMvaOg_0 2024-03-09T15:07:04.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12459139177512747967', time=2024-03-09T17:00:10.612201+0000, chain.objs.size()=3 2024-03-09T15:07:04.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.515__multipart_mymultipart.2~l_-F04GjAVXu6KweQVF_iGRF-q3tgRt.1 2024-03-09T15:07:04.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.515__multipart_mymultipart.2~l_-F04GjAVXu6KweQVF_iGRF-q3tgRt.2 2024-03-09T15:07:04.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.515__multipart_mymultipart.2~l_-F04GjAVXu6KweQVF_iGRF-q3tgRt.3 2024-03-09T15:07:04.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12063854595273549510', time=2024-03-09T17:00:32.624960+0000, chain.objs.size()=1 2024-03-09T15:07:04.573 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.519__multipart_mymultipart.2~_AlpZGCJ9r_vrNN0u-6a6qpf8S-49EI.1 2024-03-09T15:07:04.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12459426255373321813', time=2024-03-09T17:01:45.946875+0000, chain.objs.size()=2 2024-03-09T15:07:04.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.556__shadow_.ntPdoU3zt_ZmLMzyuANVclWB6nQUZif_0 2024-03-09T15:07:04.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.556__shadow_.ntPdoU3zt_ZmLMzyuANVclWB6nQUZif_1 2024-03-09T15:07:04.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7236435796670583912', time=2024-03-09T17:01:55.240622+0000, chain.objs.size()=1 2024-03-09T15:07:04.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:oyVvByqr75nK5fgIZys1mV37Efwt4uO_.wEKQnuS4n4NMR9hLoHPUxtXiwqiYcXP_0 2024-03-09T15:07:04.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.994746906145748056', time=2024-03-09T17:01:55.740923+0000, chain.objs.size()=1 2024-03-09T15:07:04.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:pJVIlMjy-5FQk6ytzcSaxz.tv9G4S6f_.Kcvape6sxd7ieN50vm0JuPUDLdAnpRA_0 2024-03-09T15:07:04.574 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3654458414823440443', time=2024-03-09T17:02:08.105241+0000, chain.objs.size()=1 2024-03-09T15:07:04.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.567__shadow:hy4PtlUIzMTZRuxfquyltFx.4Odbd31_.IJ755Y_s7-cHwAMKVe8Fc_EvvdYFWIF_0 2024-03-09T15:07:04.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4026921393782171734', time=2024-03-09T17:02:17.102009+0000, chain.objs.size()=1 2024-03-09T15:07:04.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:hVIKtku4m7zRcwbHoiaLOgwZd396w-C_.uQuiHPR10KULbpbTnTwgZKo96QpI5Xp_0 2024-03-09T15:07:04.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2986432339287151889', time=2024-03-09T17:02:19.459878+0000, chain.objs.size()=1 2024-03-09T15:07:04.575 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.574+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:XmuyrZkMWztIBHlnQFv-egaze9Cg8XW_.cdaLw8KRrBYvr43tPd5OADFNdLHhEs7_0 2024-03-09T15:07:04.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.578+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9065349740736546629', time=2024-03-09T17:02:28.340316+0000, chain.objs.size()=1 2024-03-09T15:07:04.577 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.578+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:vQisRtU8rOYwHVZ7O9pZ6.bYR57hKTr_.hMOHZ8nzOcSPtXawk5kvoIL5oQvOiyr_0 2024-03-09T15:07:04.579 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.578+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14192540998800256847', time=2024-03-09T17:02:30.812836+0000, chain.objs.size()=1 2024-03-09T15:07:04.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.578+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:V7NoenLHkTCjKIs9eQj-fZ5S7lfx5yZ_.84vw67Cvsmav4I2gvN3rQSTYO9iG0WJ_0 2024-03-09T15:07:04.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.578+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7565944383518268894', time=2024-03-09T17:02:37.553820+0000, chain.objs.size()=1 2024-03-09T15:07:04.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.578+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.572__shadow:.8MgHWnLrFr2yjhaZ3CqBRiCnkcSglH_.LUOj2sJOs66e2DBiBiOMbonBrOCLNN9_0 2024-03-09T15:07:04.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.578+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6813042041977740540', time=2024-03-09T17:02:39.451018+0000, chain.objs.size()=1 2024-03-09T15:07:04.580 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.578+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.573__shadow:NXIu.VdKj05M0i-97WKic33r1NAgFAg_.R8k3JtSuw9OOrQ4ThdQBWUaWmxKaNJS_0 2024-03-09T15:07:04.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.578+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5808904857238125171', time=2024-03-09T17:04:12.179893+0000, chain.objs.size()=1 2024-03-09T15:07:04.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.578+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.655__shadow_.AFGd2TRkCvAyUQUZcKSeEZvRf1GePPR_0 2024-03-09T15:07:04.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.578+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11682990918814729636', time=2024-03-09T17:06:03.030324+0000, chain.objs.size()=1 2024-03-09T15:07:04.582 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.578+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.738__shadow_.ZpP0MGSmhZSRt489C6PrR7Io8-DjrQO_0 2024-03-09T15:07:04.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.582+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12427737281269324634', time=2024-03-09T17:06:33.726197+0000, chain.objs.size()=1 2024-03-09T15:07:04.583 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.582+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.754__shadow_.4ifSh659OTh24PL-whFvEcRWenirl98_0 2024-03-09T15:07:04.584 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.586+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:04.587 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.586+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-09T15:07:04.588 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:04.589 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:04.590 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45095' 2024-03-09T15:07:04.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8185407530205077139', time=2024-03-09T16:54:22.769339+0000, chain.objs.size()=1 2024-03-09T15:07:04.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.225__shadow_.pPTmH1Rk_5eOhnuhpvl0WBYvqtp37Xu_0 2024-03-09T15:07:04.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6999470048149835198', time=2024-03-09T16:54:24.673673+0000, chain.objs.size()=1 2024-03-09T15:07:04.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.227__shadow_.mURW8d9tbBpSuo_iFX2iPt3FSmT1IPI_0 2024-03-09T15:07:04.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8444885203850934995', time=2024-03-09T16:54:25.612007+0000, chain.objs.size()=1 2024-03-09T15:07:04.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.228__shadow_.I3xFEjz3IRV2KtnM2vh4v4mOEdAZKXj_0 2024-03-09T15:07:04.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16291195488965096253', time=2024-03-09T16:54:34.038178+0000, chain.objs.size()=1 2024-03-09T15:07:04.591 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.236__shadow_.k1_LoRqiiaizVcRYXQQclMjuFW9Z0_T_0 2024-03-09T15:07:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1039560945601691434', time=2024-03-09T16:55:14.840273+0000, chain.objs.size()=1 2024-03-09T15:07:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.fwLLUwiBpHVPHCblmcYvoaWMkTh3ZBT_0 2024-03-09T15:07:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6534058271673499813', time=2024-03-09T16:55:14.842564+0000, chain.objs.size()=1 2024-03-09T15:07:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.-rJO7UX_iSQTnEJUhmwiyigfDsBELmB_0 2024-03-09T15:07:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5289545446998624826', time=2024-03-09T16:55:14.855984+0000, chain.objs.size()=1 2024-03-09T15:07:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.OXx94S2FoLyBaZIdj80ScpJo3c81yZE_0 2024-03-09T15:07:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2483466234536711508', time=2024-03-09T16:55:15.001256+0000, chain.objs.size()=1 2024-03-09T15:07:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.DGJPWLuleqlycTtLKnNGJgDc-rjzgK1_0 2024-03-09T15:07:04.592 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11329714288729399075', time=2024-03-09T16:55:15.007493+0000, chain.objs.size()=1 2024-03-09T15:07:04.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.nuUIVVkKMRDVCVnFJr84DJBVfV3xwFM_0 2024-03-09T15:07:04.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11186039861900990696', time=2024-03-09T16:55:15.022304+0000, chain.objs.size()=1 2024-03-09T15:07:04.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qYfDVBDTxfg8ZrG_QApe1A0DD7lKEWM_0 2024-03-09T15:07:04.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15584994227741186814', time=2024-03-09T16:55:15.167091+0000, chain.objs.size()=1 2024-03-09T15:07:04.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.RsZ9ZqX-FVjNI3mcERDq3s6NxBFT1NB_0 2024-03-09T15:07:04.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10510679754487203142', time=2024-03-09T16:55:15.186593+0000, chain.objs.size()=1 2024-03-09T15:07:04.593 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.590+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.4nFohypoXFnpBmCHQVVy3wPXGXJZda-_0 2024-03-09T15:07:04.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7413885775615772761', time=2024-03-09T16:55:15.214464+0000, chain.objs.size()=1 2024-03-09T15:07:04.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.u_Zrvd96tElNd-sE38ww41VabnUEw9b_0 2024-03-09T15:07:04.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7603649775564273334', time=2024-03-09T16:55:15.255212+0000, chain.objs.size()=1 2024-03-09T15:07:04.594 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.tT0AnvEyAlu-sPRvURacy1Hw-cgvw6M_0 2024-03-09T15:07:04.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7942255228018932239', time=2024-03-09T16:55:15.273291+0000, chain.objs.size()=1 2024-03-09T15:07:04.595 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.yuKZ3SnrGik-6zCmcAgDRbRIUYN1Qv4_0 2024-03-09T15:07:04.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4736486173295809996', time=2024-03-09T16:55:15.467584+0000, chain.objs.size()=1 2024-03-09T15:07:04.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.4HIz94U_AVT7yF_WaSS8Oz3NIgsTDxH_0 2024-03-09T15:07:04.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13270190872745533216', time=2024-03-09T16:55:15.471044+0000, chain.objs.size()=1 2024-03-09T15:07:04.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.J8vfI7XTu_g80qJ3KoS9s87oK3icI9p_0 2024-03-09T15:07:04.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15347245653027756045', time=2024-03-09T16:55:15.489766+0000, chain.objs.size()=1 2024-03-09T15:07:04.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6kNofwVRnXCmPs6DcTfUdrLdmc9Lylb_0 2024-03-09T15:07:04.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13010543707626405529', time=2024-03-09T16:55:15.515827+0000, chain.objs.size()=1 2024-03-09T15:07:04.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.mkDv0aasFhQz2yn8JFxMxH4GKwJAA_v_0 2024-03-09T15:07:04.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6115601545359890094', time=2024-03-09T16:55:15.546746+0000, chain.objs.size()=1 2024-03-09T15:07:04.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.hy1CbUEtRWdqcFWRtAU3qlZS-T-w5Ri_0 2024-03-09T15:07:04.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2804530332055070331', time=2024-03-09T16:55:15.559345+0000, chain.objs.size()=1 2024-03-09T15:07:04.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.e7SAX2RKN6c8OmBh3Aa_q2fIvMqstRx_0 2024-03-09T15:07:04.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11206252372390920170', time=2024-03-09T16:55:15.685917+0000, chain.objs.size()=1 2024-03-09T15:07:04.597 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.OWzVWIpMerBIe-INW-rzvTHQQa3uEjt_0 2024-03-09T15:07:04.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1184194942205064674', time=2024-03-09T16:55:15.721360+0000, chain.objs.size()=1 2024-03-09T15:07:04.598 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.594+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.1Bht2HT8bTwTVD9kXzmGeWkZ6DZthfA_0 2024-03-09T15:07:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2999481496940585897', time=2024-03-09T16:55:15.733169+0000, chain.objs.size()=1 2024-03-09T15:07:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.mxUGUgTIEbeVPBEG6XiJK4OUsqnQMIW_0 2024-03-09T15:07:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17544804468424295220', time=2024-03-09T16:55:15.763920+0000, chain.objs.size()=1 2024-03-09T15:07:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.OFqdYX8bOk51RX48JN36qAQXstftVX2_0 2024-03-09T15:07:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2537428215750419767', time=2024-03-09T16:55:15.822627+0000, chain.objs.size()=1 2024-03-09T15:07:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.kERoJhwyGCPJ5hFpIqiteRrY-wAbDJy_0 2024-03-09T15:07:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.598+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8167673357645586740', time=2024-03-09T16:55:15.952563+0000, chain.objs.size()=1 2024-03-09T15:07:04.600 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.598+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.3XcTrYzh-I7-01c2f9A2PIwxjJd8Ucb_0 2024-03-09T15:07:04.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.602+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4488261457859356157', time=2024-03-09T16:55:16.033944+0000, chain.objs.size()=1 2024-03-09T15:07:04.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.602+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Q4U3KwsiFRRBmdgSLAr6I94KUiYH93J_0 2024-03-09T15:07:04.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.602+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3828069640071136123', time=2024-03-09T16:55:16.047737+0000, chain.objs.size()=1 2024-03-09T15:07:04.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.602+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.njtZJifgBsbt9p90siQtCR_sPrx9f0j_0 2024-03-09T15:07:04.601 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.602+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14000095213170901338', time=2024-03-09T16:55:16.205271+0000, chain.objs.size()=1 2024-03-09T15:07:04.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.602+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.WX7ymMuNl3PeT-BqJB7u2dOzektxbCJ_0 2024-03-09T15:07:04.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.602+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15355006736845372237', time=2024-03-09T16:55:16.259556+0000, chain.objs.size()=1 2024-03-09T15:07:04.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.602+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6-Q1HqKDPRSP4nJX4GTZcvMYUwh_88l_0 2024-03-09T15:07:04.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.602+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5787306702145819759', time=2024-03-09T16:55:16.265945+0000, chain.objs.size()=1 2024-03-09T15:07:04.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.602+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.RxJG0KJpN9bIOPeQgs92YCIY5m3PK3r_0 2024-03-09T15:07:04.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.602+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1587005059674675212', time=2024-03-09T16:55:16.273849+0000, chain.objs.size()=1 2024-03-09T15:07:04.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.602+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.-2vrrJ4w77ywAH8V-q0ASwcDTIMvjK3_0 2024-03-09T15:07:04.602 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.602+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12475425490234221759', time=2024-03-09T16:55:16.303025+0000, chain.objs.size()=1 2024-03-09T15:07:04.603 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.602+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.8AnuRC0N1gxyjtd46ySTSyekHecOhs4_0 2024-03-09T15:07:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10758430559523655328', time=2024-03-09T16:55:16.335197+0000, chain.objs.size()=1 2024-03-09T15:07:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.UtlSMVZAdqj6cx7_z-jZOVnd-sqM9TE_0 2024-03-09T15:07:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2200361436632933933', time=2024-03-09T16:55:16.358324+0000, chain.objs.size()=1 2024-03-09T15:07:04.605 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.dSAtHWWFlIwuUO-LpTAwQjVijrJAGWa_0 2024-03-09T15:07:04.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12440286666174784705', time=2024-03-09T16:55:16.477269+0000, chain.objs.size()=1 2024-03-09T15:07:04.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.9wWKNTXQI_m-TUmbqd4RfGCr9UdfuqA_0 2024-03-09T15:07:04.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2736529517604129402', time=2024-03-09T16:55:16.515155+0000, chain.objs.size()=1 2024-03-09T15:07:04.606 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.P2K7eu5hoJ7HEkdnWuSWORel-Ax4A5T_0 2024-03-09T15:07:04.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12261291777551124079', time=2024-03-09T16:55:16.555037+0000, chain.objs.size()=1 2024-03-09T15:07:04.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.CmdIRbSfXEYpUrtU30DPbn9Atvg5yrY_0 2024-03-09T15:07:04.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11800646451345540104', time=2024-03-09T16:55:16.581576+0000, chain.objs.size()=1 2024-03-09T15:07:04.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.YcWvEWVrKwEVS6YfZIrWULxvx8GT_g4_0 2024-03-09T15:07:04.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10278577153887586716', time=2024-03-09T16:55:16.770340+0000, chain.objs.size()=1 2024-03-09T15:07:04.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.UDpmn7skUWFxBn7Eb2pK1lYQzr72KDe_0 2024-03-09T15:07:04.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4714802904170550382', time=2024-03-09T16:55:16.837377+0000, chain.objs.size()=1 2024-03-09T15:07:04.607 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Zo8CxaOQ5ahpGFpCZ4o5PHkrQNNXHZo_0 2024-03-09T15:07:04.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11076116724729261599', time=2024-03-09T16:55:16.844801+0000, chain.objs.size()=1 2024-03-09T15:07:04.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.4xsWzlWT7GKiyDN81aQF-Y9_19B_iUh_0 2024-03-09T15:07:04.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5141564497924034012', time=2024-03-09T16:55:31.588537+0000, chain.objs.size()=1 2024-03-09T15:07:04.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.272__shadow_.5fSxKS5M3-ZDwEyd7SgtIOWj7Jc7vq7_0 2024-03-09T15:07:04.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9395542267823554376', time=2024-03-09T16:55:46.231669+0000, chain.objs.size()=1 2024-03-09T15:07:04.608 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.606+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.EDJAQAjrF3yT1oOtMDDYY9ztESlbop9_0 2024-03-09T15:07:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3606245167767739836', time=2024-03-09T16:55:47.843205+0000, chain.objs.size()=1 2024-03-09T15:07:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.7PfWlOlMOodJC5z-rOktOdp3jv7XYAi_0 2024-03-09T15:07:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8674605219270327516', time=2024-03-09T16:55:47.846925+0000, chain.objs.size()=1 2024-03-09T15:07:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.rShIyqMCL4PGkPWgzKpCwzEYotEw9pm_0 2024-03-09T15:07:04.610 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6356251109715448933', time=2024-03-09T16:55:53.601190+0000, chain.objs.size()=1 2024-03-09T15:07:04.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.293__shadow_.03YzPIt4fELR7dkre6-xWG5WiwdwaH1_0 2024-03-09T15:07:04.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17519601287141333412', time=2024-03-09T16:55:57.382389+0000, chain.objs.size()=1 2024-03-09T15:07:04.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.297__shadow_.NHnjNk7MbNMPeOrNhjxoFSRIUzxIrru_0 2024-03-09T15:07:04.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.610+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17278337922058747242', time=2024-03-09T16:56:13.710862+0000, chain.objs.size()=1 2024-03-09T15:07:04.611 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.610+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.313__shadow:YkVHI3UNbM2Q2eBfbCyFLHpgllAYFB5_.VBZifjUL3SgU2yTNpwg51TI4ma9yyAc_0 2024-03-09T15:07:04.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.614+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8069011901830118553', time=2024-03-09T16:56:37.753501+0000, chain.objs.size()=1 2024-03-09T15:07:04.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.614+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.fNg157HVg5zkslC6fm6QvHIHpiiyy6S_0 2024-03-09T15:07:04.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.614+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4622257413680571465', time=2024-03-09T16:56:37.767459+0000, chain.objs.size()=1 2024-03-09T15:07:04.612 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.614+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.LyqtXoLX9MhGfEzDVVsQ3m9ss89wl9Q_0 2024-03-09T15:07:04.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.614+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1518629368954623179', time=2024-03-09T16:56:37.801960+0000, chain.objs.size()=1 2024-03-09T15:07:04.613 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.614+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.OFsl2b8aw45LrvQqLptBtlXzgDbZjfi_0 2024-03-09T15:07:04.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.614+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.970540321840561735', time=2024-03-09T16:56:37.822167+0000, chain.objs.size()=1 2024-03-09T15:07:04.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.614+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.YdZ_XBWA6QPib3AauyFgnjX_elc3g2W_0 2024-03-09T15:07:04.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.614+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13714449196375886782', time=2024-03-09T16:56:37.829651+0000, chain.objs.size()=1 2024-03-09T15:07:04.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.614+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-e112cmjJBKpfJf7WBoeU7UcXSE_vx__0 2024-03-09T15:07:04.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.614+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17999416115079247526', time=2024-03-09T16:56:37.869285+0000, chain.objs.size()=1 2024-03-09T15:07:04.614 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.614+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_._dbTPxBCjRGsL5eY5Ss-HgFPFYeuxV8_0 2024-03-09T15:07:04.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.614+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9097098222078096438', time=2024-03-09T16:56:38.012368+0000, chain.objs.size()=1 2024-03-09T15:07:04.615 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.614+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.BaM0EIyuiM9eFv964ZSq6So-Wk4Wp5O_0 2024-03-09T15:07:04.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17173392113259752796', time=2024-03-09T16:56:38.118474+0000, chain.objs.size()=1 2024-03-09T15:07:04.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.PNRvGL17fv4jmvhLibkGfBKn0rrBbqA_0 2024-03-09T15:07:04.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6372733349640785792', time=2024-03-09T16:56:38.286153+0000, chain.objs.size()=1 2024-03-09T15:07:04.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Tn3fKUiNHGgQ-00-zQ4uQbL9MSIS6_l_0 2024-03-09T15:07:04.616 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17743107778437123714', time=2024-03-09T16:56:38.394135+0000, chain.objs.size()=1 2024-03-09T15:07:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.yrO5FRWPLmTQoxrpgRdFmTS1gAtuhVO_0 2024-03-09T15:07:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12531122443506510913', time=2024-03-09T16:56:38.565227+0000, chain.objs.size()=1 2024-03-09T15:07:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.c9ofNJmx9mIm04vYtxvTgX1nDa8f4nP_0 2024-03-09T15:07:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11194536009353713770', time=2024-03-09T16:56:38.595039+0000, chain.objs.size()=1 2024-03-09T15:07:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.J9eqI_6TCRo4wqQEEwOV7UnST8TZWWl_0 2024-03-09T15:07:04.617 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8788638805454378789', time=2024-03-09T16:56:38.630603+0000, chain.objs.size()=1 2024-03-09T15:07:04.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ejBReqJRKh8rHbVOg5gMI0tPJz9tb1p_0 2024-03-09T15:07:04.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3560180561487914220', time=2024-03-09T16:56:38.772249+0000, chain.objs.size()=1 2024-03-09T15:07:04.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Aq_cvewrkUT_X7f38tXUojUKSbf3kd5_0 2024-03-09T15:07:04.618 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.744291444548599678', time=2024-03-09T16:56:38.898403+0000, chain.objs.size()=1 2024-03-09T15:07:04.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.QgmGCLDTcqmeGcHnoeYls-65WB9Gne6_0 2024-03-09T15:07:04.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2859128276200464075', time=2024-03-09T16:56:38.904481+0000, chain.objs.size()=1 2024-03-09T15:07:04.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ZUQlwax9ekf5fEXDDwL70-c8mss-KyI_0 2024-03-09T15:07:04.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8186957518722120261', time=2024-03-09T16:56:38.917979+0000, chain.objs.size()=1 2024-03-09T15:07:04.619 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.618+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.1G-O6-UJDU0ddEHkmf5S50TYkSF_0AL_0 2024-03-09T15:07:04.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14768862596564022574', time=2024-03-09T16:56:38.934504+0000, chain.objs.size()=1 2024-03-09T15:07:04.621 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.KLlxBg4m1OJOLlqn-Yx4jikE2b-5Zde_0 2024-03-09T15:07:04.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.31006399674996135', time=2024-03-09T16:56:39.083198+0000, chain.objs.size()=1 2024-03-09T15:07:04.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.5Z7-qqoUd7l2nX0kwnIp9QfrwtPjpOX_0 2024-03-09T15:07:04.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12460025689322301768', time=2024-03-09T16:56:39.147668+0000, chain.objs.size()=1 2024-03-09T15:07:04.622 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.sMx-XmI4I8lqPJSm8rpl0mjAFGAe_pk_0 2024-03-09T15:07:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12695252948178744379', time=2024-03-09T16:56:39.172813+0000, chain.objs.size()=1 2024-03-09T15:07:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-ZDAuzjFD0B1tq9gSTM-CgELZ9flfsa_0 2024-03-09T15:07:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9388360457220665375', time=2024-03-09T16:56:39.182004+0000, chain.objs.size()=1 2024-03-09T15:07:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.sedqrKsxJE9K6Vl-Msno6lPmPsaOqCM_0 2024-03-09T15:07:04.623 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18251565555098829482', time=2024-03-09T16:56:39.462050+0000, chain.objs.size()=1 2024-03-09T15:07:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.NiXiVu_gPsmZc2ibYZrnbUYE37Z82vT_0 2024-03-09T15:07:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1825469875187574', time=2024-03-09T16:56:39.469963+0000, chain.objs.size()=1 2024-03-09T15:07:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.oFATuOjQL4hh9VI5Pleb5SbClUNUuF7_0 2024-03-09T15:07:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6518968481779491255', time=2024-03-09T16:56:39.588645+0000, chain.objs.size()=1 2024-03-09T15:07:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.tXiFyE7gE5iQrG8ztTlyyOO-HUypqiS_0 2024-03-09T15:07:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3934322361810898621', time=2024-03-09T16:56:39.629487+0000, chain.objs.size()=1 2024-03-09T15:07:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.E2UtHSVX8b9Q67rKb4ir17HRSxV1zdF_0 2024-03-09T15:07:04.624 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1445752817934860864', time=2024-03-09T16:56:39.634270+0000, chain.objs.size()=1 2024-03-09T15:07:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.2-y-ssBeqPXcr9lcoWByvszCLR1YFQ3_0 2024-03-09T15:07:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11918646754336594263', time=2024-03-09T16:56:39.648447+0000, chain.objs.size()=1 2024-03-09T15:07:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.622+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.E9Bs_eKTHrRZse4dwsTsTy1LsRUROEZ_0 2024-03-09T15:07:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.626+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17624199638957017464', time=2024-03-09T16:57:01.427025+0000, chain.objs.size()=1 2024-03-09T15:07:04.625 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.626+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.CcCpSWf7AZPiRg7A3g3Gk_jfpnKPKGS_0 2024-03-09T15:07:04.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.626+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1059105916313257705', time=2024-03-09T16:57:01.522179+0000, chain.objs.size()=1 2024-03-09T15:07:04.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.626+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.6JESkjqqTaztKm96oLRsm0Lx9nuw9wq_0 2024-03-09T15:07:04.626 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.626+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2775452342689493131', time=2024-03-09T16:57:01.736082+0000, chain.objs.size()=1 2024-03-09T15:07:04.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.626+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.O165r_zW2MRenvjr2EEjQ2MM5DwgqCJ_0 2024-03-09T15:07:04.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.626+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13781104584612952363', time=2024-03-09T16:57:01.846644+0000, chain.objs.size()=1 2024-03-09T15:07:04.627 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.626+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.omsPVjRBiC03-qssLNmz7xry3jWdPwY_0 2024-03-09T15:07:04.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.626+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15180100878075826', time=2024-03-09T16:57:02.059515+0000, chain.objs.size()=1 2024-03-09T15:07:04.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.626+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.cRK96_Qv0rUpuKVazoFaFeHM4pLG2qy_0 2024-03-09T15:07:04.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5110488753311910054', time=2024-03-09T16:57:02.065986+0000, chain.objs.size()=1 2024-03-09T15:07:04.628 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.WdJljnaYeHYmFzibuj72pKmSBjmI9P__0 2024-03-09T15:07:04.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16082135353477536231', time=2024-03-09T16:57:02.072747+0000, chain.objs.size()=1 2024-03-09T15:07:04.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.QSykOLXqIbFx4OTXi9ooQpBmhlkeR-n_0 2024-03-09T15:07:04.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6446045600584972724', time=2024-03-09T16:57:02.106480+0000, chain.objs.size()=1 2024-03-09T15:07:04.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.72ezB884GWA9V9HOjQYWaFcO6sLLRie_0 2024-03-09T15:07:04.629 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11716371631498204720', time=2024-03-09T16:57:02.260635+0000, chain.objs.size()=1 2024-03-09T15:07:04.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.hZCtlAvHi42DXHVLhxNWqlSpxuin8lb_0 2024-03-09T15:07:04.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14131067103951509886', time=2024-03-09T16:57:02.312512+0000, chain.objs.size()=1 2024-03-09T15:07:04.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ZcXaiUPA8-XNQSuh1E-Cx8M0RD5z5GT_0 2024-03-09T15:07:04.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8647042733859519164', time=2024-03-09T16:57:02.336785+0000, chain.objs.size()=1 2024-03-09T15:07:04.630 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.2wXn7_p7EJ66LGDVvXrpEImKrFOSubz_0 2024-03-09T15:07:04.631 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7555009319800922466', time=2024-03-09T16:57:02.354522+0000, chain.objs.size()=1 2024-03-09T15:07:04.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.I6rWClVjON7BxPdZnkRdc5SSh4XxDBH_0 2024-03-09T15:07:04.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13555479592710144925', time=2024-03-09T16:57:02.521668+0000, chain.objs.size()=1 2024-03-09T15:07:04.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.7JDcbJ1z4GqYMAXgEoBkzoKPDUc4gnn_0 2024-03-09T15:07:04.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16138579544565000324', time=2024-03-09T16:57:02.538027+0000, chain.objs.size()=1 2024-03-09T15:07:04.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.630+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.b2K_R7qkYNOn3-NU1RNGAunblSANBwY_0 2024-03-09T15:07:04.632 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.634+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8211764275716459175', time=2024-03-09T16:57:02.626709+0000, chain.objs.size()=1 2024-03-09T15:07:04.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.634+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ZAExt6iIjEIEW8FzuA7DsWZXUaEVr-U_0 2024-03-09T15:07:04.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.634+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2660563688397520883', time=2024-03-09T16:57:02.788537+0000, chain.objs.size()=1 2024-03-09T15:07:04.633 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.634+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.o5luADO7JNTQHCRXxdBXFYziiIGDCyR_0 2024-03-09T15:07:04.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.634+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4462335333433827393', time=2024-03-09T16:57:02.841127+0000, chain.objs.size()=1 2024-03-09T15:07:04.634 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.634+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.yAWu7Wddmdl7zwabu2ykzjhVxRbw5kA_0 2024-03-09T15:07:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.410516753560758174', time=2024-03-09T16:57:02.971896+0000, chain.objs.size()=1 2024-03-09T15:07:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.bLakf8AvJLSVoWJJ-oubbuDtfI9YDVr_0 2024-03-09T15:07:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15263505719708267989', time=2024-03-09T16:57:03.000214+0000, chain.objs.size()=1 2024-03-09T15:07:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oq3BiZduDkQQjFzMx3i8OSsILMCva2f_0 2024-03-09T15:07:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3515283744479509504', time=2024-03-09T16:57:03.032375+0000, chain.objs.size()=1 2024-03-09T15:07:04.638 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oNv_oCV8O_xyT1sHEt_8AJn0BY2gIYN_0 2024-03-09T15:07:04.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10494829966330327919', time=2024-03-09T16:57:03.039041+0000, chain.objs.size()=1 2024-03-09T15:07:04.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.h-vO1LY_jz4Y6dgEn3j0pbQFdR8Xz7I_0 2024-03-09T15:07:04.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.638+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1245557978785426869', time=2024-03-09T16:57:03.063060+0000, chain.objs.size()=1 2024-03-09T15:07:04.639 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.638+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.PtN_UNCZeab8tSnGlHQ1qtDY5h6LNDA_0 2024-03-09T15:07:04.642 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.642+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/45095 2024-03-09T15:07:04.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-03-09T15:07:04.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16135115033623967818', time=2024-03-09T16:57:03.076898+0000, chain.objs.size()=1 2024-03-09T15:07:04.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.u5JyQvsvDA3oY3EHowbi7V0uQTcF5Ls_0 2024-03-09T15:07:04.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14912905263885125481', time=2024-03-09T16:57:03.115304+0000, chain.objs.size()=1 2024-03-09T15:07:04.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.czj6ovRXzqGKHMQQhLmLV4WHgDOZzUl_0 2024-03-09T15:07:04.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11223278168303433118', time=2024-03-09T16:57:03.117719+0000, chain.objs.size()=1 2024-03-09T15:07:04.645 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.XZPw6iXqSFFiVEn41ZhlEP7x2MuAsmH_0 2024-03-09T15:07:04.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17564040274233145346', time=2024-03-09T16:57:03.258974+0000, chain.objs.size()=1 2024-03-09T15:07:04.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.EY6M1QbOgJR3FQbERxSYXzagrlJls39_0 2024-03-09T15:07:04.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4836177273973558499', time=2024-03-09T16:57:03.292829+0000, chain.objs.size()=1 2024-03-09T15:07:04.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.o-zc0l1rJWCsztAhyGEd3kA0FqU9QKG_0 2024-03-09T15:07:04.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.30927833370906324', time=2024-03-09T16:57:11.288380+0000, chain.objs.size()=1 2024-03-09T15:07:04.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.327__shadow_._uMIZSlJcMcghqJ_NULttlHrVNc5AG5_0 2024-03-09T15:07:04.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6374813240337141635', time=2024-03-09T16:57:22.704463+0000, chain.objs.size()=1 2024-03-09T15:07:04.646 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.340__shadow_.wRc7rjmN3z3lPk7lCERs7cFLg7c4t_-_0 2024-03-09T15:07:04.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10673722286037352359', time=2024-03-09T16:59:43.867208+0000, chain.objs.size()=1 2024-03-09T15:07:04.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.491__shadow_.cDwgQT6M8EfmzLmplSi0DJ5YlPgbC3M_0 2024-03-09T15:07:04.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.2_db9e28a3b58933b7522d649d10a846b1', time=2024-03-09T16:59:53.373452+0000, chain.objs.size()=6 2024-03-09T15:07:04.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.1 2024-03-09T15:07:04.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.2 2024-03-09T15:07:04.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.3 2024-03-09T15:07:04.647 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.646+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.4 2024-03-09T15:07:04.648 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.5 2024-03-09T15:07:04.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.6 2024-03-09T15:07:04.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4104430378159398735', time=2024-03-09T17:01:51.694456+0000, chain.objs.size()=1 2024-03-09T15:07:04.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:TrFBRzJxPLnJrPPRNF6q5SYkFZM8ccb_.bWZa6h87AqhusuvgoZeLIneP3cKCvj5_0 2024-03-09T15:07:04.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4836846916154848383', time=2024-03-09T17:01:53.041794+0000, chain.objs.size()=1 2024-03-09T15:07:04.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:0rBBaBuSsOFphRrs8rvOmpPhE39a86j_.ARllSKspoSz4y-Ek3rdkkNFytwe0FKK_0 2024-03-09T15:07:04.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17396275034848971876', time=2024-03-09T17:02:21.510258+0000, chain.objs.size()=1 2024-03-09T15:07:04.649 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:0JKRG-EDeLXuysfrp4SjG-WQv.rLefG_.GXYtARkQjAThQCNnIjmYE8qpPephvhM_0 2024-03-09T15:07:04.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8625176894983230949', time=2024-03-09T17:02:27.741461+0000, chain.objs.size()=1 2024-03-09T15:07:04.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:Boi8tOcQcPzLuyaYxR2eOo8W1ldc-GZ_.f3e9kA5kyMza7HLSr0Ppnhu2A_4HDJz_0 2024-03-09T15:07:04.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2842405797546950559', time=2024-03-09T17:02:30.180399+0000, chain.objs.size()=1 2024-03-09T15:07:04.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:nNHEhJf12.T.loCt4dpU01zdp-h9co1_.cXbqP3kHIQIcJpgblQjYadTsYL0irMN_0 2024-03-09T15:07:04.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7456135471895634867', time=2024-03-09T17:02:41.734532+0000, chain.objs.size()=1 2024-03-09T15:07:04.650 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.576__shadow:dmciz.rt3rRtQen8qkALmzmAjVstY1k_.4WmMtK-QT4oWHzhBX2mZLRJSHgggaK4_0 2024-03-09T15:07:04.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.742930348023901983', time=2024-03-09T17:02:44.335341+0000, chain.objs.size()=1 2024-03-09T15:07:04.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.578__shadow:g641jW9112ozHh8TBVFidGBWhBqzHvH_.h4Gup3Hqprf6C2uA2WeJ6C2dje-UKly_0 2024-03-09T15:07:04.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2968439723638144752', time=2024-03-09T17:03:43.794675+0000, chain.objs.size()=1 2024-03-09T15:07:04.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.627__shadow_.enDvLCBgctQtErIHQ746e4HWHOh3x8N_0 2024-03-09T15:07:04.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1458390542418989155', time=2024-03-09T17:04:10.928762+0000, chain.objs.size()=1 2024-03-09T15:07:04.651 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.654__shadow_.dD7u27smS9xyj_BpzPwVTUXW532J3nO_0 2024-03-09T15:07:04.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.339157899093744026', time=2024-03-09T17:06:22.865335+0000, chain.objs.size()=1 2024-03-09T15:07:04.652 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.650+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.746__shadow_.yWPcJskIyFYh8pz7KiJI9PqYPDXld1F_0 2024-03-09T15:07:04.655 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.654+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:04.657 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-09T15:07:04.658 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:04.659 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:04.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48426' 2024-03-09T15:07:04.660 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15919734357622748034', time=2024-03-09T16:54:28.978092+0000, chain.objs.size()=1 2024-03-09T15:07:04.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.231__shadow_.SayA1hPeXV4Cso7PtSn2i3UrGbNM5kI_0 2024-03-09T15:07:04.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12436069827842520456', time=2024-03-09T16:54:47.264479+0000, chain.objs.size()=1 2024-03-09T15:07:04.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.249__shadow_.0QTHHmeNimYAwZ2Kiq0-VlMk_rfCuiS_0 2024-03-09T15:07:04.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8006132304724747828', time=2024-03-09T16:54:52.876799+0000, chain.objs.size()=1 2024-03-09T15:07:04.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.255__shadow_.fGBo08sQWGhnQUzDhTTrzuGI89xvibi_0 2024-03-09T15:07:04.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11597424656619906418', time=2024-03-09T16:55:14.966163+0000, chain.objs.size()=1 2024-03-09T15:07:04.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.DAZNj8D3PcpBhw-E7TSh9Z3H7ObHixf_0 2024-03-09T15:07:04.661 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13118877922097861808', time=2024-03-09T16:55:14.970936+0000, chain.objs.size()=1 2024-03-09T15:07:04.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.RpaWs-iqlY-oQHBaXFGGzM8pI78oyAQ_0 2024-03-09T15:07:04.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9700087813331433369', time=2024-03-09T16:55:15.001672+0000, chain.objs.size()=1 2024-03-09T15:07:04.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.lMrA8unAhMX1F-jk1ZozKfjypy-1NGT_0 2024-03-09T15:07:04.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16276574726055042419', time=2024-03-09T16:55:15.005809+0000, chain.objs.size()=1 2024-03-09T15:07:04.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.hfFAz9HZWvDKlLRdwS1oJx97lViLHa0_0 2024-03-09T15:07:04.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10476437782452001084', time=2024-03-09T16:55:15.241960+0000, chain.objs.size()=1 2024-03-09T15:07:04.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.7_zVZg0X7h4gUzcoa9Cjy-iB6HWsRLC_0 2024-03-09T15:07:04.662 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.754044167531472484', time=2024-03-09T16:55:15.455364+0000, chain.objs.size()=1 2024-03-09T15:07:04.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.1TS1Ged2uujOIkIVb_bBSNrbEGCHbqj_0 2024-03-09T15:07:04.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6058804560750489902', time=2024-03-09T16:55:15.503784+0000, chain.objs.size()=1 2024-03-09T15:07:04.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.658+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.PZ1zSm78kOiWbYiqH46MC3P3SYQZQxt_0 2024-03-09T15:07:04.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.662+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11215880437267480426', time=2024-03-09T16:55:15.718427+0000, chain.objs.size()=1 2024-03-09T15:07:04.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.662+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.9LSMJ6vVmuMQh9rIayZFpWxSGliNijx_0 2024-03-09T15:07:04.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.662+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3025645454893783958', time=2024-03-09T16:55:15.724064+0000, chain.objs.size()=1 2024-03-09T15:07:04.663 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.662+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.XvdD44i_gZL_-n7miyAgPC--2h-ZYKr_0 2024-03-09T15:07:04.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5964430789307230434', time=2024-03-09T16:55:15.724950+0000, chain.objs.size()=1 2024-03-09T15:07:04.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.TO2nItDkab0COw_JVDqCkdwqIpXNIbJ_0 2024-03-09T15:07:04.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7019321931036159223', time=2024-03-09T16:55:15.734436+0000, chain.objs.size()=1 2024-03-09T15:07:04.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.849A97qJI_WJT1pjboBBK_yO3EXl0nf_0 2024-03-09T15:07:04.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10573173883851228567', time=2024-03-09T16:55:15.744978+0000, chain.objs.size()=1 2024-03-09T15:07:04.665 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Lw8_zqCN4LtaESB9gipGq3VKmlRVzZW_0 2024-03-09T15:07:04.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5247009147455788987', time=2024-03-09T16:55:15.807036+0000, chain.objs.size()=1 2024-03-09T15:07:04.667 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.KNPOYTgScoRk08aPTyuwGSkZ1Ea4EeU_0 2024-03-09T15:07:04.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11886786703903992939', time=2024-03-09T16:55:16.018272+0000, chain.objs.size()=1 2024-03-09T15:07:04.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.g-nW7LVM6dAtRpyTY5NdR3N-SG7vkSX_0 2024-03-09T15:07:04.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12673319061455601953', time=2024-03-09T16:55:16.051568+0000, chain.objs.size()=1 2024-03-09T15:07:04.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.SsxAGNs-R1mbK8MNR-r3S1y18gv9h0Y_0 2024-03-09T15:07:04.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3072401159031942187', time=2024-03-09T16:55:16.201364+0000, chain.objs.size()=1 2024-03-09T15:07:04.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.RvR5T-K1R0J9MerOgnwctKzNCuUSoJs_0 2024-03-09T15:07:04.668 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3782170133626137147', time=2024-03-09T16:55:16.293598+0000, chain.objs.size()=1 2024-03-09T15:07:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Cf9ipPNWURc8dafHplqhVqMMgKfyX4x_0 2024-03-09T15:07:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8462750296628042086', time=2024-03-09T16:55:16.329602+0000, chain.objs.size()=1 2024-03-09T15:07:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.KaIryVW6zBo4N_6sczqHOuuAJmft9Fj_0 2024-03-09T15:07:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.127050456168191232', time=2024-03-09T16:55:16.360939+0000, chain.objs.size()=1 2024-03-09T15:07:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.x9QWNTAWSR1i-G7v1Qm-6GdROQB-7pd_0 2024-03-09T15:07:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4119779717105674132', time=2024-03-09T16:55:16.362038+0000, chain.objs.size()=1 2024-03-09T15:07:04.669 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.666+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.WMBkkmvOyvIsbaAeJt19zzGNU_94gLn_0 2024-03-09T15:07:04.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.670+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3334144379083352254', time=2024-03-09T16:55:16.480082+0000, chain.objs.size()=1 2024-03-09T15:07:04.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.670+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.nEUglmDvp4XXnSZovLkyj1nol21blhL_0 2024-03-09T15:07:04.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.670+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2837990107115223063', time=2024-03-09T16:55:16.571253+0000, chain.objs.size()=1 2024-03-09T15:07:04.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.670+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.BxU8SW89BFntwYqm4Lh4NVeq-nxDzmD_0 2024-03-09T15:07:04.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.670+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.624185762178296213', time=2024-03-09T16:55:16.573912+0000, chain.objs.size()=1 2024-03-09T15:07:04.670 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.670+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.WjDChbXIox76kUD2IGctS95znTRQvgg_0 2024-03-09T15:07:04.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.670+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9235430350684265558', time=2024-03-09T16:55:16.613289+0000, chain.objs.size()=1 2024-03-09T15:07:04.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.670+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.gzlKY99ASQ_YVaGGWNM2xIdDcDw_2TI_0 2024-03-09T15:07:04.671 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.670+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11594690203490424851', time=2024-03-09T16:55:16.627464+0000, chain.objs.size()=1 2024-03-09T15:07:04.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.670+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.-mXqiwIswf7TY997zTR3k4q692pZZmi_0 2024-03-09T15:07:04.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.670+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2191241807521141404', time=2024-03-09T16:55:16.631122+0000, chain.objs.size()=1 2024-03-09T15:07:04.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.670+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.3uuKMkpzcjtQUlglYLdAs1ZsaJ3EO55_0 2024-03-09T15:07:04.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.670+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5469636389788557534', time=2024-03-09T16:55:16.758649+0000, chain.objs.size()=1 2024-03-09T15:07:04.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.670+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.AQdC90gQMsSsRVa1Jv6NgMO6ejXs7L__0 2024-03-09T15:07:04.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.670+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14165941789750212040', time=2024-03-09T16:55:16.807512+0000, chain.objs.size()=1 2024-03-09T15:07:04.672 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.670+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Mg7G3rBm-W2mvPGuVpSwtF15K2a427N_0 2024-03-09T15:07:04.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.674+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16702128211216100074', time=2024-03-09T16:55:32.492696+0000, chain.objs.size()=1 2024-03-09T15:07:04.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.674+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.273__shadow_.CNCAxZbvVEaNe1s49t3bx3BNqrUemPM_0 2024-03-09T15:07:04.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.674+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5864664502491138754', time=2024-03-09T16:55:35.314934+0000, chain.objs.size()=1 2024-03-09T15:07:04.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.674+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.276__shadow_.JlfjPPzx8wxPKzF4-WPyaoV-8kNOg86_0 2024-03-09T15:07:04.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.674+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8440806810577874750', time=2024-03-09T16:55:39.352212+0000, chain.objs.size()=1 2024-03-09T15:07:04.673 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.674+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.280__shadow_.NAppy73mQcbYufwrwopUtXY1koJBfoN_0 2024-03-09T15:07:04.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.674+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15231056577688868358', time=2024-03-09T16:55:46.206037+0000, chain.objs.size()=1 2024-03-09T15:07:04.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.674+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.Xyl7t0UH-_WKgFxg61R7WM_FaYbdmhH_0 2024-03-09T15:07:04.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.674+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1888002644521418572', time=2024-03-09T16:55:55.453714+0000, chain.objs.size()=1 2024-03-09T15:07:04.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.674+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.295__shadow_.X0ChwZ5CY8VzsYsvH7-KnrLY_5PpvaH_0 2024-03-09T15:07:04.674 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.674+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2029379696840060827', time=2024-03-09T16:56:37.789457+0000, chain.objs.size()=1 2024-03-09T15:07:04.675 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.674+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.AeaLT1tBGwuDEteSjg1I_XQxnHjpVGI_0 2024-03-09T15:07:04.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.465494633486313484', time=2024-03-09T16:56:37.792763+0000, chain.objs.size()=1 2024-03-09T15:07:04.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.EvJ76ptavlm2cF_umuTP8LjXs-Rq1KM_0 2024-03-09T15:07:04.677 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7391831916632323037', time=2024-03-09T16:56:37.805657+0000, chain.objs.size()=1 2024-03-09T15:07:04.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.izDXs-UU-qeX3XH-A1AVgQij4ZvfP3L_0 2024-03-09T15:07:04.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5976689814971441281', time=2024-03-09T16:56:37.827803+0000, chain.objs.size()=1 2024-03-09T15:07:04.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.H5jLXm9mtSptNsEt1Nji3D_WY0UpfZQ_0 2024-03-09T15:07:04.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9692005873618601288', time=2024-03-09T16:56:37.844500+0000, chain.objs.size()=1 2024-03-09T15:07:04.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.VvKe9lmpMhHHAIbCA2TtD31F_majtDE_0 2024-03-09T15:07:04.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18216839832816566932', time=2024-03-09T16:56:37.860583+0000, chain.objs.size()=1 2024-03-09T15:07:04.678 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.C6s4uafaJuazprQa7rjVYPVVbbJZuwq_0 2024-03-09T15:07:04.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1276989179820031840', time=2024-03-09T16:56:37.866234+0000, chain.objs.size()=1 2024-03-09T15:07:04.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Q0p-S6xRTt20R_ToqsvU0cM8cDozqzU_0 2024-03-09T15:07:04.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11165128516108613256', time=2024-03-09T16:56:37.967925+0000, chain.objs.size()=1 2024-03-09T15:07:04.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.rjVziSXmskODnH5W10Uxhvbal1MuY-I_0 2024-03-09T15:07:04.679 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16984435637906644231', time=2024-03-09T16:56:37.975827+0000, chain.objs.size()=1 2024-03-09T15:07:04.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lYRfX_DikLE_XwsrxrdFgDqoTan59c9_0 2024-03-09T15:07:04.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16695404765257433458', time=2024-03-09T16:56:38.030355+0000, chain.objs.size()=1 2024-03-09T15:07:04.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.egSbF6XIjP-OY5_o-Ns5Dpdi2x7e-hl_0 2024-03-09T15:07:04.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5017463317945656555', time=2024-03-09T16:56:38.042282+0000, chain.objs.size()=1 2024-03-09T15:07:04.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.9YU6H27wSOho-5GoxldcgX4vzY7GYct_0 2024-03-09T15:07:04.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14582612510804475772', time=2024-03-09T16:56:38.057283+0000, chain.objs.size()=1 2024-03-09T15:07:04.680 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.678+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.7y3J4bFUJEItm8jpiw1IFNqd_kMrBiI_0 2024-03-09T15:07:04.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.682+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8431493461892735256', time=2024-03-09T16:56:38.079010+0000, chain.objs.size()=1 2024-03-09T15:07:04.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.682+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.2vw4VJIRe2IxvH1Rqdl3IgtkPtTKICa_0 2024-03-09T15:07:04.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.682+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287719823622587049', time=2024-03-09T16:56:38.089845+0000, chain.objs.size()=1 2024-03-09T15:07:04.681 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.682+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.CDPIZJIRHXSDg7CvyC3o3ecCWkHxffi_0 2024-03-09T15:07:04.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6543641909060688405', time=2024-03-09T16:56:38.093404+0000, chain.objs.size()=1 2024-03-09T15:07:04.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.QkqnVzyYF1bIosRFrqbYoTo7MA_ZPHs_0 2024-03-09T15:07:04.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17743841950859542601', time=2024-03-09T16:56:38.106531+0000, chain.objs.size()=1 2024-03-09T15:07:04.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.XWBs5zujI_9gWcrnM7XQLgagW5huTnX_0 2024-03-09T15:07:04.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10461463787929935545', time=2024-03-09T16:56:38.120213+0000, chain.objs.size()=1 2024-03-09T15:07:04.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0jjNLo81agaHgose_2QbT648_P3d8pD_0 2024-03-09T15:07:04.686 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9059887685004028565', time=2024-03-09T16:56:38.128996+0000, chain.objs.size()=1 2024-03-09T15:07:04.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Jd7iJ_MVaJozMsgdZOphTffvvPLQtna_0 2024-03-09T15:07:04.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1758760762925844036', time=2024-03-09T16:56:38.238865+0000, chain.objs.size()=1 2024-03-09T15:07:04.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.pVcKBicGZLUDgCUav7op_YAr2HMJjbd_0 2024-03-09T15:07:04.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9628466504244039473', time=2024-03-09T16:56:38.241783+0000, chain.objs.size()=1 2024-03-09T15:07:04.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.BgLv_vihX3X4dmKMpm6kur0KF27C5HO_0 2024-03-09T15:07:04.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6564469742855449581', time=2024-03-09T16:56:38.272806+0000, chain.objs.size()=1 2024-03-09T15:07:04.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Zb6U83TKSLWDz1nS7W8GGrhgdJ4q-DR_0 2024-03-09T15:07:04.687 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16489312295006066250', time=2024-03-09T16:56:38.325644+0000, chain.objs.size()=1 2024-03-09T15:07:04.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.sC8uHbDLLs-slVbn_nYlSAPRyMg_bp9_0 2024-03-09T15:07:04.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11862471335815859450', time=2024-03-09T16:56:38.511962+0000, chain.objs.size()=1 2024-03-09T15:07:04.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.zrLSuKyIeDq7-y8FT6n_ku40uKlfeAy_0 2024-03-09T15:07:04.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7683924577315081161', time=2024-03-09T16:56:38.550541+0000, chain.objs.size()=1 2024-03-09T15:07:04.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.bzUqhGPw_V1mx1A-yZEAXLF5ANZiKAb_0 2024-03-09T15:07:04.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17291416347995855187', time=2024-03-09T16:56:38.624826+0000, chain.objs.size()=1 2024-03-09T15:07:04.688 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.686+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.YOtmtrdIhFXdKK5mF0i7IE8F9c_6IqQ_0 2024-03-09T15:07:04.690 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18115442598863820871', time=2024-03-09T16:56:38.630703+0000, chain.objs.size()=1 2024-03-09T15:07:04.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.MG9XpDqbSnVYBxmfekVE5T_auWVp4Qt_0 2024-03-09T15:07:04.691 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1328803755070625583', time=2024-03-09T16:56:38.641944+0000, chain.objs.size()=1 2024-03-09T15:07:04.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6yii2N56XT5wmq-DXXuSsziNn8hB4YH_0 2024-03-09T15:07:04.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12153648630872977265', time=2024-03-09T16:56:38.663546+0000, chain.objs.size()=1 2024-03-09T15:07:04.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.GdYz8XvjwSllxX70bqp-AcCdr0IeF6o_0 2024-03-09T15:07:04.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.342492215672296148', time=2024-03-09T16:56:38.875569+0000, chain.objs.size()=1 2024-03-09T15:07:04.692 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.l4rGvAu4z3-TdKY_J5sqcUFn7iy6uQW_0 2024-03-09T15:07:04.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7361337627095386518', time=2024-03-09T16:56:39.037574+0000, chain.objs.size()=1 2024-03-09T15:07:04.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.KO4lBycllgU2CeE-7wcFoETkt6GNCLR_0 2024-03-09T15:07:04.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6972264756489391142', time=2024-03-09T16:56:39.044609+0000, chain.objs.size()=1 2024-03-09T15:07:04.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.XPbN9MGGYp3F5OJj7UXIcm7WpxOsSCW_0 2024-03-09T15:07:04.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12512752756842929706', time=2024-03-09T16:56:39.113794+0000, chain.objs.size()=1 2024-03-09T15:07:04.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.grwcUTpmX2RtxfrXLKK-8FoeTM0qb1V_0 2024-03-09T15:07:04.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15362046170315727791', time=2024-03-09T16:56:39.122604+0000, chain.objs.size()=1 2024-03-09T15:07:04.693 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ZYyHGLjvhWvPg1iUm3VZ-iU7_cRV7NH_0 2024-03-09T15:07:04.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11194294973902852244', time=2024-03-09T16:56:39.145122+0000, chain.objs.size()=1 2024-03-09T15:07:04.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Rztdyuzq4LaePOelTPCLfb0t4mygCfL_0 2024-03-09T15:07:04.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2918622742571546986', time=2024-03-09T16:56:39.188771+0000, chain.objs.size()=1 2024-03-09T15:07:04.694 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.qIQKOB3HChcQR1yN9rOiF7U5g_e2P_o_0 2024-03-09T15:07:04.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10998028821474882152', time=2024-03-09T16:56:39.364879+0000, chain.objs.size()=1 2024-03-09T15:07:04.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.690+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.VEhyBC5EqA_vrtxFWCfY-XylVFTX-0S_0 2024-03-09T15:07:04.695 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.694+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14464448394331349514', time=2024-03-09T16:56:39.372795+0000, chain.objs.size()=1 2024-03-09T15:07:04.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.694+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.QJhfqXvkimhZKf81pvSWl248f-in-Rf_0 2024-03-09T15:07:04.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.694+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3030511188405478464', time=2024-03-09T16:56:39.426333+0000, chain.objs.size()=1 2024-03-09T15:07:04.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.694+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.9tZzf_7RyAcm9ar_8owaua1h9UMJ2b5_0 2024-03-09T15:07:04.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.694+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10055466556447824223', time=2024-03-09T16:56:39.606963+0000, chain.objs.size()=1 2024-03-09T15:07:04.696 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.694+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.FbvBorPXp4o7vJAT5Jr8JbaJl6raeUL_0 2024-03-09T15:07:04.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f9333fff640 0 -- 172.21.15.99:0/3110485063 >> [v2:172.21.15.99:6816/2757713078,v1:172.21.15.99:6817/2757713078] conn(0x7f9334001720 msgr2=0x7f933403b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T15:07:04.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9283628444976769797', time=2024-03-09T16:56:39.646747+0000, chain.objs.size()=1 2024-03-09T15:07:04.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.KkWDj1-ft-UMXOGop3tNp8e4wGPqoHA_0 2024-03-09T15:07:04.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5970737914385560305', time=2024-03-09T16:57:01.509763+0000, chain.objs.size()=1 2024-03-09T15:07:04.697 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.P3XHrQ9BDXBaveeKrDZDtDEUkwtPvta_0 2024-03-09T15:07:04.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5905363787196351691', time=2024-03-09T16:57:01.512269+0000, chain.objs.size()=1 2024-03-09T15:07:04.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.SUj6zb8s90n-JDj5BXcOOaL8MdzDfEV_0 2024-03-09T15:07:04.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10979714952643075321', time=2024-03-09T16:57:01.721941+0000, chain.objs.size()=1 2024-03-09T15:07:04.698 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.tI_mMt1YtqtL5JTUH9dMK7mKm32hyFA_0 2024-03-09T15:07:04.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13680688953789835749', time=2024-03-09T16:57:01.725754+0000, chain.objs.size()=1 2024-03-09T15:07:04.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.2i4GDEgzZ3GtlOZLWi-6zk8SyATLZGT_0 2024-03-09T15:07:04.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1080680208380529381', time=2024-03-09T16:57:01.812463+0000, chain.objs.size()=1 2024-03-09T15:07:04.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.SFglX9b0eaw3adT4VEfHSKclaH8ZspM_0 2024-03-09T15:07:04.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17675545195813641489', time=2024-03-09T16:57:01.842890+0000, chain.objs.size()=1 2024-03-09T15:07:04.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.9gd3N5u7hHaQQFs_xAD8GFQK2cEnY3F_0 2024-03-09T15:07:04.699 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13465005104412146884', time=2024-03-09T16:57:01.859956+0000, chain.objs.size()=1 2024-03-09T15:07:04.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.4HY_OAlwB_ApzJZn2-bshpwGNw-nI8i_0 2024-03-09T15:07:04.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7844407818757715015', time=2024-03-09T16:57:01.969786+0000, chain.objs.size()=1 2024-03-09T15:07:04.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.SCsz64uBqeMuVmJJd6OrcsrjoFPu9_E_0 2024-03-09T15:07:04.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17557632938193659877', time=2024-03-09T16:57:01.978561+0000, chain.objs.size()=1 2024-03-09T15:07:04.700 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.1bRvxJgVLQmCd4tPLNTC22bl_MjK5E9_0 2024-03-09T15:07:04.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17313891046200611574', time=2024-03-09T16:57:01.998324+0000, chain.objs.size()=1 2024-03-09T15:07:04.701 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.698+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.c55EueAEC0N7D4wWmwRyIpcwWcHUMTr_0 2024-03-09T15:07:04.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.702+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7805986673400693875', time=2024-03-09T16:57:02.055919+0000, chain.objs.size()=1 2024-03-09T15:07:04.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.702+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.QFj4FstmUm4quA0zvx5ovpOOFjxFjzO_0 2024-03-09T15:07:04.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.702+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4615929193705291775', time=2024-03-09T16:57:02.087635+0000, chain.objs.size()=1 2024-03-09T15:07:04.702 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.702+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.W9k7cUPa5XPGFJYJUDc6ez-A-uKWZWy_0 2024-03-09T15:07:04.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.702+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10778009235254831434', time=2024-03-09T16:57:02.243782+0000, chain.objs.size()=1 2024-03-09T15:07:04.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.702+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.dvydxCVf15amSZWU0LNIr58XbE9HXub_0 2024-03-09T15:07:04.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.702+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1768448798900071576', time=2024-03-09T16:57:02.285281+0000, chain.objs.size()=1 2024-03-09T15:07:04.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.702+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.FegRo91tEqaF6QJ7jYjsKiiA7sYiyFB_0 2024-03-09T15:07:04.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.702+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15940126042665473110', time=2024-03-09T16:57:02.345032+0000, chain.objs.size()=1 2024-03-09T15:07:04.703 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.702+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.NkTUBGAT9ypO2zUOazGEUuH214tMav3_0 2024-03-09T15:07:04.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.702+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1683636363051779489', time=2024-03-09T16:57:02.486159+0000, chain.objs.size()=1 2024-03-09T15:07:04.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.702+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DG8Qg-Qrsig2AdiIz8VXXPiMWuPcybA_0 2024-03-09T15:07:04.704 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10159788950160280063', time=2024-03-09T16:57:02.619272+0000, chain.objs.size()=1 2024-03-09T15:07:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.rwRbKyyq-jTgfKTI0cJQ_h9jIyym4Fc_0 2024-03-09T15:07:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15911039725293139176', time=2024-03-09T16:57:02.629344+0000, chain.objs.size()=1 2024-03-09T15:07:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Xr9GxSFtTy2d-G4nHO3NRxLeK5WhlpE_0 2024-03-09T15:07:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8062826589419984201', time=2024-03-09T16:57:02.823869+0000, chain.objs.size()=1 2024-03-09T15:07:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.LsUorFS062NXfHV2PvAj-6hFzM0j-Y__0 2024-03-09T15:07:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13601347266755912276', time=2024-03-09T16:57:03.003851+0000, chain.objs.size()=1 2024-03-09T15:07:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.s7c7C4Gvp-sSRFmuaZgrqWvVd1lfNJS_0 2024-03-09T15:07:04.705 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10188275200071000407', time=2024-03-09T16:57:03.016159+0000, chain.objs.size()=1 2024-03-09T15:07:04.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.4GtLcID4BTxLlndAUp5lEGO_nNxci5z_0 2024-03-09T15:07:04.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11344334437454306545', time=2024-03-09T16:57:03.046442+0000, chain.objs.size()=1 2024-03-09T15:07:04.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_._KBbb0Lgv5QAHZr_F5wh64itwTCyQMx_0 2024-03-09T15:07:04.706 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.706+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4599052803694278136', time=2024-03-09T16:57:03.066339+0000, chain.objs.size()=1 2024-03-09T15:07:04.707 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.706+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.OT8XQXHYVImTO7smVRMeVx-_9qTNYpD_0 2024-03-09T15:07:04.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.710+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11940550494448377475', time=2024-03-09T16:57:03.101696+0000, chain.objs.size()=1 2024-03-09T15:07:04.709 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.710+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.P4Un1yrhasGC_aN6gYcPEJCqOdpSb0U_0 2024-03-09T15:07:04.710 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.710+0000 7f9333fff640 0 -- 172.21.15.99:0/3110485063 >> [v2:172.21.15.179:6807/4275579646,v1:172.21.15.179:6811/4275579646] conn(0x56139dff9ec0 msgr2=0x56139dffc310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T15:07:04.713 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/48426 2024-03-09T15:07:04.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-03-09T15:07:04.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6496313125099126243', time=2024-03-09T16:57:03.273106+0000, chain.objs.size()=1 2024-03-09T15:07:04.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.q5hj61gkAVRGyzE0PiO09Trk1A5pH6q_0 2024-03-09T15:07:04.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9847204419243646701', time=2024-03-09T16:57:03.408137+0000, chain.objs.size()=1 2024-03-09T15:07:04.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.X8PvyfPrAJcKtBwXUJMUOZZfkrkn79__0 2024-03-09T15:07:04.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.668069854480523412', time=2024-03-09T16:57:39.098637+0000, chain.objs.size()=1 2024-03-09T15:07:04.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.361__shadow_.EAM-Fw8tn5AIrjQKYv0F-mwRyZrO-hU_0 2024-03-09T15:07:04.716 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10992679674873698275', time=2024-03-09T16:58:48.054368+0000, chain.objs.size()=1 2024-03-09T15:07:04.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.430__shadow_.lfdr8ahiLG2cVCteSvNqty-LTpro7fw_0 2024-03-09T15:07:04.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16255585864086313491', time=2024-03-09T17:00:30.215466+0000, chain.objs.size()=3 2024-03-09T15:07:04.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.517__multipart_mymultipart.2~8BF5725SOqBu7KQfrE9bMpuZ7kMtsmq.1 2024-03-09T15:07:04.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.517__multipart_mymultipart.2~8BF5725SOqBu7KQfrE9bMpuZ7kMtsmq.2 2024-03-09T15:07:04.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.517__multipart_mymultipart.2~8BF5725SOqBu7KQfrE9bMpuZ7kMtsmq.3 2024-03-09T15:07:04.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8612746754335424609', time=2024-03-09T17:01:57.096021+0000, chain.objs.size()=1 2024-03-09T15:07:04.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:VGU2v4spHPFvDyuFan4im2I1U0O6HTn_.nhhhdpTKD9-U6y3rrN_oMuVTAEiypV9_0 2024-03-09T15:07:04.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6152741945069179793', time=2024-03-09T17:02:14.658653+0000, chain.objs.size()=1 2024-03-09T15:07:04.717 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.569__shadow:scDsRxo4nb-30ok68LWQacLtpTgSsb5_.shIWnl_e-HCoGRp1an9kiVWyowWWfYV_0 2024-03-09T15:07:04.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3372098550466834932', time=2024-03-09T17:02:31.043334+0000, chain.objs.size()=1 2024-03-09T15:07:04.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:L2GwcuPvskH8g6fU2oK.VRTJ3vd2IhZ_.XBLRBXoUnDaF9m4XVogtccq72vYdo5X_0 2024-03-09T15:07:04.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17925345422810022354', time=2024-03-09T17:02:37.575900+0000, chain.objs.size()=1 2024-03-09T15:07:04.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.572__shadow:EcPkS667BVhE9atnxfdN0bzUo15ocGX_.7lByfvciovVg9gMEfi6YFdedEulZc2n_0 2024-03-09T15:07:04.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7726113580937140581', time=2024-03-09T17:03:02.773102+0000, chain.objs.size()=1 2024-03-09T15:07:04.718 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.714+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.599__shadow_.QardVZz6K4g_oGI3MK_EibuN6vUSceK_0 2024-03-09T15:07:04.719 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.718+0000 7f9333fff640 0 -- 172.21.15.99:0/3110485063 >> [v2:172.21.15.179:6807/4275579646,v1:172.21.15.179:6811/4275579646] conn(0x7f9334001720 msgr2=0x7f92040839a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T15:07:04.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.722+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5746506613769326196', time=2024-03-09T17:03:36.975069+0000, chain.objs.size()=1 2024-03-09T15:07:04.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.722+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.620__shadow_.sPDuAe-rA63AXmxXDxAQe9pLSZTfOCT_0 2024-03-09T15:07:04.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.722+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12302493094174770703', time=2024-03-09T17:04:08.598150+0000, chain.objs.size()=1 2024-03-09T15:07:04.721 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.722+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.652__shadow_.Wa4OzObn2MTu-vs9fMLgb3y6soLn26X_0 2024-03-09T15:07:04.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.722+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17101138900016529585', time=2024-03-09T17:06:27.011697+0000, chain.objs.size()=1 2024-03-09T15:07:04.722 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.722+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.749__shadow_.Dfv1vkvDx_6w-cWnaaSw881VuPM9A6X_0 2024-03-09T15:07:04.724 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.726+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:04.726 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.726+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-09T15:07:04.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:04.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:04.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42719' 2024-03-09T15:07:04.732 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12709674287754197662', time=2024-03-09T16:51:44.206412+0000, chain.objs.size()=1 2024-03-09T15:07:04.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.146__shadow_.MrsrXfBZX7fgUgM9hJwAPYoVSZuJKMk_0 2024-03-09T15:07:04.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4008013899990110313', time=2024-03-09T16:51:51.182715+0000, chain.objs.size()=1 2024-03-09T15:07:04.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.154__shadow_.sy6sTDSD0pyHliTGoYOLCX_5AKKq_6g_0 2024-03-09T15:07:04.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2691520888837121982', time=2024-03-09T16:51:59.344330+0000, chain.objs.size()=1 2024-03-09T15:07:04.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.164__shadow_.TA9ySVADsHJNgmRgbNs0danKrmtO1k8_0 2024-03-09T15:07:04.733 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5399547382404492658', time=2024-03-09T16:54:27.476062+0000, chain.objs.size()=1 2024-03-09T15:07:04.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.230__shadow_.ctDxxILHmCYj1pDsqAdBWN-Smd31U-u_0 2024-03-09T15:07:04.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7208135458021597037', time=2024-03-09T16:54:34.032860+0000, chain.objs.size()=1 2024-03-09T15:07:04.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.236__shadow_.en1W6ik4lgCQ-W1BbTfzt5MqtrG3tuG_0 2024-03-09T15:07:04.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14743403115396962510', time=2024-03-09T16:54:51.968887+0000, chain.objs.size()=1 2024-03-09T15:07:04.734 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.254__shadow_.p13LzaV9JXn4YVoPembeLwYuK4k-Kdm_0 2024-03-09T15:07:04.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12251664423497213766', time=2024-03-09T16:55:14.839766+0000, chain.objs.size()=1 2024-03-09T15:07:04.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.gpzJ8PXpwTg_7cTEYXIOfNa4807CKl4_0 2024-03-09T15:07:04.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13176500770956522628', time=2024-03-09T16:55:15.017467+0000, chain.objs.size()=1 2024-03-09T15:07:04.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.a9dZaLhzI03z-JD61c-z7-NP78a8TFZ_0 2024-03-09T15:07:04.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5002349340754045858', time=2024-03-09T16:55:15.020758+0000, chain.objs.size()=1 2024-03-09T15:07:04.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.vfXBfQDO6fxFYa48Rd2ST5OB_V4Ehbp_0 2024-03-09T15:07:04.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5388447495879861221', time=2024-03-09T16:55:15.182775+0000, chain.objs.size()=1 2024-03-09T15:07:04.735 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.d1PWkciBOqggJ5bo6WW2Gwj9e1kX8z2_0 2024-03-09T15:07:04.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11283211066219516862', time=2024-03-09T16:55:15.286528+0000, chain.objs.size()=1 2024-03-09T15:07:04.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.G9tnJuUBWfJVwD4LueksxGIiavb-C8t_0 2024-03-09T15:07:04.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3262397917964541618', time=2024-03-09T16:55:15.415782+0000, chain.objs.size()=1 2024-03-09T15:07:04.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.730+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.sUgNJLxtizGgXCzs1CtnDP8L6wVz8Il_0 2024-03-09T15:07:04.736 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.734+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7693921657932016284', time=2024-03-09T16:55:15.503014+0000, chain.objs.size()=1 2024-03-09T15:07:04.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.JruHl2jJVf3VFP96LrrmBFgWqpDd9F1_0 2024-03-09T15:07:04.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.734+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5070268298930236592', time=2024-03-09T16:55:15.553201+0000, chain.objs.size()=1 2024-03-09T15:07:04.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.xucYTqP3WNTcRWJ84ufulSbq1GjDzCV_0 2024-03-09T15:07:04.737 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.734+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16720459223544023204', time=2024-03-09T16:55:15.688305+0000, chain.objs.size()=1 2024-03-09T15:07:04.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.734+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Uijr3ULJpVBM3CC-KqXPNXaNbbNsPEe_0 2024-03-09T15:07:04.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.738+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17744044662017319889', time=2024-03-09T16:55:15.751035+0000, chain.objs.size()=1 2024-03-09T15:07:04.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.738+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.lulWyWl3Rjj3SlHLY1Fb6a8ckyBzk-O_0 2024-03-09T15:07:04.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.738+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4401331584416787975', time=2024-03-09T16:55:15.756682+0000, chain.objs.size()=1 2024-03-09T15:07:04.738 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.738+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.naAMqF9Czvy9-X2pxf7sdLgnRgtjYYv_0 2024-03-09T15:07:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.738+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3649164778961466163', time=2024-03-09T16:55:15.788815+0000, chain.objs.size()=1 2024-03-09T15:07:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.738+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.KzYH1f5pnvcLQ8o_-GvZ_P364XorplY_0 2024-03-09T15:07:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.738+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13992276743846163274', time=2024-03-09T16:55:15.806212+0000, chain.objs.size()=1 2024-03-09T15:07:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.738+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.jTkIC7thAxzwN5Z3JF4j2NvVHI5cHTv_0 2024-03-09T15:07:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.738+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8144842350460652693', time=2024-03-09T16:55:15.830135+0000, chain.objs.size()=1 2024-03-09T15:07:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.738+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.eYlW-BTZyeXeDR9OvwqPxLE5tFsdmBQ_0 2024-03-09T15:07:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.738+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17948677239985632331', time=2024-03-09T16:55:15.986829+0000, chain.objs.size()=1 2024-03-09T15:07:04.739 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.738+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.hxJoqUhK1zRnt-Rnsf4tYg_L0lzwMG1_0 2024-03-09T15:07:04.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.738+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1182000228954471021', time=2024-03-09T16:55:16.069113+0000, chain.objs.size()=1 2024-03-09T15:07:04.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.738+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qOQAUDPM1Vya492stzVX2ZLzyQpn0GU_0 2024-03-09T15:07:04.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.738+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14306148340504378062', time=2024-03-09T16:55:16.089780+0000, chain.objs.size()=1 2024-03-09T15:07:04.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.738+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.jkiO-QMCv52k88XdWL4vyKcU-An_ul3_0 2024-03-09T15:07:04.740 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16251396996947449567', time=2024-03-09T16:55:16.090498+0000, chain.objs.size()=1 2024-03-09T15:07:04.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.zkkRp0MkG59eeA8TWcXbCNwfGih_qv__0 2024-03-09T15:07:04.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8626714133790101416', time=2024-03-09T16:55:16.095769+0000, chain.objs.size()=1 2024-03-09T15:07:04.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.cp7qy_IiJk6cTwwN5nCJVblRpoEUm5g_0 2024-03-09T15:07:04.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2796274820618124525', time=2024-03-09T16:55:16.096648+0000, chain.objs.size()=1 2024-03-09T15:07:04.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.NlUAGxicJCtCg1uIN_twigC7NOquYM1_0 2024-03-09T15:07:04.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14287709409836190323', time=2024-03-09T16:55:16.285644+0000, chain.objs.size()=1 2024-03-09T15:07:04.741 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.IOlt7HZrgJ06YQRNTjfaZHsgGZ75r6o_0 2024-03-09T15:07:04.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1998659262620420690', time=2024-03-09T16:55:16.313488+0000, chain.objs.size()=1 2024-03-09T15:07:04.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.wgx5o-vI-Rv57n-dvcj6AI9t4o9Mgfk_0 2024-03-09T15:07:04.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.26564685832762379', time=2024-03-09T16:55:16.322374+0000, chain.objs.size()=1 2024-03-09T15:07:04.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.H24D-xcT-NWcqnBtRluXrzDXtjC3LaD_0 2024-03-09T15:07:04.743 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10863314331329563510', time=2024-03-09T16:55:16.557471+0000, chain.objs.size()=1 2024-03-09T15:07:04.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.iyE3KiY4GB-YO8E44emDgDycX2NG8IX_0 2024-03-09T15:07:04.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8304605558623850212', time=2024-03-09T16:55:16.581563+0000, chain.objs.size()=1 2024-03-09T15:07:04.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.VsColfveN8HUSDbmePSHus3dIgJzdIZ_0 2024-03-09T15:07:04.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10203078341604525719', time=2024-03-09T16:55:16.603525+0000, chain.objs.size()=1 2024-03-09T15:07:04.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.AVZTtszZl5vFv5XcGP-gdaqtCjJVGt-_0 2024-03-09T15:07:04.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16861049951391762273', time=2024-03-09T16:55:16.749209+0000, chain.objs.size()=1 2024-03-09T15:07:04.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.sjvE5Jfai2tbTE3sx6P_yN84QpiY6NL_0 2024-03-09T15:07:04.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10410170013751734709', time=2024-03-09T16:55:16.752386+0000, chain.objs.size()=1 2024-03-09T15:07:04.744 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.742+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.7RDbDJfHi0AU3Gu4oYzbjgSKyXNqfOR_0 2024-03-09T15:07:04.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.746+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.594065487762805951', time=2024-03-09T16:55:16.757168+0000, chain.objs.size()=1 2024-03-09T15:07:04.746 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.746+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.i5t0lWutiUyeNe3X5wsrbxMWjawU9-z_0 2024-03-09T15:07:04.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.746+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8586796315909783785', time=2024-03-09T16:55:16.767250+0000, chain.objs.size()=1 2024-03-09T15:07:04.747 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.746+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.VsRW0uAs29O4gcLLQ5cD7fz9qDPKieq_0 2024-03-09T15:07:04.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.746+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11748422163073503497', time=2024-03-09T16:55:16.837335+0000, chain.objs.size()=1 2024-03-09T15:07:04.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.746+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.hVVHevQNsmZmX-qSLzLEIJC6KmCWNjv_0 2024-03-09T15:07:04.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.746+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15468398954839097824', time=2024-03-09T16:55:21.345415+0000, chain.objs.size()=1 2024-03-09T15:07:04.748 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.746+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.261__shadow_.oN2HalUEG7E3nmV4rLp7si1fOrd5WaD_0 2024-03-09T15:07:04.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16849764121392890572', time=2024-03-09T16:55:25.044964+0000, chain.objs.size()=1 2024-03-09T15:07:04.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.265__shadow_.WgaOvpg1Q_fqZKFwhFNn8XQLPctzkie_0 2024-03-09T15:07:04.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12997010009445727519', time=2024-03-09T16:55:40.265706+0000, chain.objs.size()=1 2024-03-09T15:07:04.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.281__shadow_.-DlSgR6kmFnfs2QLsls1q4T_yiQdkYb_0 2024-03-09T15:07:04.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14739372652186512772', time=2024-03-09T16:55:51.565732+0000, chain.objs.size()=1 2024-03-09T15:07:04.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.291__shadow_.MULcO2zxFgwhVEIPdeSKcBTDNL9SkM1_0 2024-03-09T15:07:04.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3673403354580900825', time=2024-03-09T16:56:14.710314+0000, chain.objs.size()=1 2024-03-09T15:07:04.749 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.315__shadow_.dvG0rnFlw8TRos6hYxAHs0I3zVDUQdD_0 2024-03-09T15:07:04.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1039292538110055970', time=2024-03-09T16:56:37.708486+0000, chain.objs.size()=1 2024-03-09T15:07:04.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lKTIGifETaPs0VUuxrQqrlU579vsE4H_0 2024-03-09T15:07:04.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.750+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3640239689768227257', time=2024-03-09T16:56:37.732552+0000, chain.objs.size()=1 2024-03-09T15:07:04.750 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.750+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.GhD0Rg7p2PMilth9WStHZ-Wh_F1L7NR_0 2024-03-09T15:07:04.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.754+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13051719821184735745', time=2024-03-09T16:56:37.822440+0000, chain.objs.size()=1 2024-03-09T15:07:04.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.754+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.RuCMk3VpqFEvozyssBHqIwEuPowxHVr_0 2024-03-09T15:07:04.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.754+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10748464207490718988', time=2024-03-09T16:56:37.991961+0000, chain.objs.size()=1 2024-03-09T15:07:04.752 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.754+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-OQi5Wl0WFY-jycPb6iPCyeEe2S2LRx_0 2024-03-09T15:07:04.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.754+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15531077468592034635', time=2024-03-09T16:56:37.997442+0000, chain.objs.size()=1 2024-03-09T15:07:04.753 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.754+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.nAv7ZP_SfJ-JLXoJWMrejsy6RREwQ42_0 2024-03-09T15:07:04.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.754+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2723428895102339249', time=2024-03-09T16:56:38.026555+0000, chain.objs.size()=1 2024-03-09T15:07:04.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.754+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.cjZLbbLkps7IBBxrDylZwq6SEDso1TM_0 2024-03-09T15:07:04.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.754+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8784913426895818108', time=2024-03-09T16:56:38.232432+0000, chain.objs.size()=1 2024-03-09T15:07:04.754 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.754+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.CgkGkhEX5oRchagPgxharf2FA6IBl-t_0 2024-03-09T15:07:04.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.754+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11720211246343379542', time=2024-03-09T16:56:38.267774+0000, chain.objs.size()=1 2024-03-09T15:07:04.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.754+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.3DtInbn72tSCwb4fVCc4ZquY4825fs-_0 2024-03-09T15:07:04.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.754+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1327285351990245185', time=2024-03-09T16:56:38.320844+0000, chain.objs.size()=1 2024-03-09T15:07:04.755 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.754+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.hhr26v1rQtC6QJbSKVwFHs9sCHU5Z9Y_0 2024-03-09T15:07:04.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10835598559483920471', time=2024-03-09T16:56:38.514076+0000, chain.objs.size()=1 2024-03-09T15:07:04.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.id2SU976qn6NsyG88TWXPjjTJPcxuV__0 2024-03-09T15:07:04.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14768367166061981409', time=2024-03-09T16:56:38.639024+0000, chain.objs.size()=1 2024-03-09T15:07:04.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.GeZUp-HipZ5RScPs-rtpBVCPCyL1pww_0 2024-03-09T15:07:04.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13771798737146878392', time=2024-03-09T16:56:38.847612+0000, chain.objs.size()=1 2024-03-09T15:07:04.757 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.8UIHdlM9-Aaomtz-iRi2SPD-vhK68Q9_0 2024-03-09T15:07:04.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.90552232109414353', time=2024-03-09T16:56:38.854270+0000, chain.objs.size()=1 2024-03-09T15:07:04.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.U3mvDMCASv7j8_The4WVs9KfYUUA4FJ_0 2024-03-09T15:07:04.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9906118122034688039', time=2024-03-09T16:56:38.886856+0000, chain.objs.size()=1 2024-03-09T15:07:04.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.R5Z14t-tb03_IedH6YRW7C1W6pBa-Gz_0 2024-03-09T15:07:04.758 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4063704071455968893', time=2024-03-09T16:56:38.929197+0000, chain.objs.size()=1 2024-03-09T15:07:04.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ib-UPl_DlmzqK4kWTnr0irBZYBKhm3A_0 2024-03-09T15:07:04.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15430415940377030903', time=2024-03-09T16:56:39.043013+0000, chain.objs.size()=1 2024-03-09T15:07:04.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.X6gNPfn24VzM7TG9nVjWvTxZl6S3XE0_0 2024-03-09T15:07:04.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3023155977878495172', time=2024-03-09T16:56:39.090376+0000, chain.objs.size()=1 2024-03-09T15:07:04.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.h7gewlVTCruFDvHVZwjiV4jCwPmRB_2_0 2024-03-09T15:07:04.759 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8848394422913066477', time=2024-03-09T16:56:39.092867+0000, chain.objs.size()=1 2024-03-09T15:07:04.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.C6A3Yp_WgECyyFElUFZDvQ6v5sRQXvX_0 2024-03-09T15:07:04.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11817997138306603322', time=2024-03-09T16:56:39.127812+0000, chain.objs.size()=1 2024-03-09T15:07:04.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Cn6KHDEFjzA9jf1GMF8j7UYO1edxlA3_0 2024-03-09T15:07:04.760 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1613137271128676574', time=2024-03-09T16:56:39.167180+0000, chain.objs.size()=1 2024-03-09T15:07:04.761 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.758+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.iQDTrEAyhTqRWz7PUK-v6e2CzZWs6pc_0 2024-03-09T15:07:04.762 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.69502898675412592', time=2024-03-09T16:56:39.177461+0000, chain.objs.size()=1 2024-03-09T15:07:04.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.JuFaTd8bpinna9OwX7qXc4p0RBOgb0b_0 2024-03-09T15:07:04.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12881621786418341175', time=2024-03-09T16:56:39.184464+0000, chain.objs.size()=1 2024-03-09T15:07:04.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.p3O39JQUEGRvteAPDxvJWY39glOWZIe_0 2024-03-09T15:07:04.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13796514633397034070', time=2024-03-09T16:56:39.198305+0000, chain.objs.size()=1 2024-03-09T15:07:04.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ZMYBDaF-KQthiIBX96cLqkuf_FyGzev_0 2024-03-09T15:07:04.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8872287910242190404', time=2024-03-09T16:56:39.203980+0000, chain.objs.size()=1 2024-03-09T15:07:04.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.NEYDcCeF2buEj2kN0HXzO3osxOcG2OC_0 2024-03-09T15:07:04.763 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15221915235200012352', time=2024-03-09T16:56:39.406472+0000, chain.objs.size()=1 2024-03-09T15:07:04.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.JnWBzt9T3Wg6214BwvCYMBH6MP1x2cq_0 2024-03-09T15:07:04.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2766333566135397249', time=2024-03-09T16:56:39.566440+0000, chain.objs.size()=1 2024-03-09T15:07:04.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ZfhIRvTFNt9VHmAg41AjL_riML9pgWu_0 2024-03-09T15:07:04.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3600224353892322090', time=2024-03-09T16:56:39.644141+0000, chain.objs.size()=1 2024-03-09T15:07:04.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.cftPlhUqbM6BNg8V_Foyn4fLCQwRXUa_0 2024-03-09T15:07:04.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1524927511038558151', time=2024-03-09T16:57:01.435106+0000, chain.objs.size()=1 2024-03-09T15:07:04.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.EeS68APBVmlKT8nRvrgNgRVQHafeLgX_0 2024-03-09T15:07:04.764 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.891001646737568219', time=2024-03-09T16:57:01.529916+0000, chain.objs.size()=1 2024-03-09T15:07:04.765 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.762+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.q-vGiowmIiZ4V93jD6gO6XsBzKHui9v_0 2024-03-09T15:07:04.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.766+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9142722277229974110', time=2024-03-09T16:57:01.543044+0000, chain.objs.size()=1 2024-03-09T15:07:04.766 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.766+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.RUuZso4GSGGtjtxLeFJ6fTMBM8KBrcF_0 2024-03-09T15:07:04.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.766+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9098967720007571418', time=2024-03-09T16:57:01.582001+0000, chain.objs.size()=1 2024-03-09T15:07:04.767 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.766+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.9dh0s-Dv8uG-S1dNgS_BYk9kQMEj5Pd_0 2024-03-09T15:07:04.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2752482965607870935', time=2024-03-09T16:57:01.591594+0000, chain.objs.size()=1 2024-03-09T15:07:04.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.kj5uId8ERP7Zuc0m9lIamDAzurR5dt8_0 2024-03-09T15:07:04.768 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18150228436126281056', time=2024-03-09T16:57:01.592338+0000, chain.objs.size()=1 2024-03-09T15:07:04.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.jOJQNITG07CooaZD8EyuBsDTVG612Fw_0 2024-03-09T15:07:04.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8520630918556095114', time=2024-03-09T16:57:01.756722+0000, chain.objs.size()=1 2024-03-09T15:07:04.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Prt6HU-KI-jdq2R3d2aFPM5CLVjaDfI_0 2024-03-09T15:07:04.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.408663194379645360', time=2024-03-09T16:57:01.772677+0000, chain.objs.size()=1 2024-03-09T15:07:04.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.mB8LajcpMT4LfgJ4ekace7CqGgOYWt4_0 2024-03-09T15:07:04.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.999991888237459168', time=2024-03-09T16:57:01.788710+0000, chain.objs.size()=1 2024-03-09T15:07:04.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.HJ4bOB-gp6biNBpnR61TTOm20SeH-l8_0 2024-03-09T15:07:04.769 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10674165882320959463', time=2024-03-09T16:57:01.835012+0000, chain.objs.size()=1 2024-03-09T15:07:04.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.3t0HCaazzsmvxusezfe1dRevG6QLMi8_0 2024-03-09T15:07:04.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5457080274616660955', time=2024-03-09T16:57:01.860660+0000, chain.objs.size()=1 2024-03-09T15:07:04.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Aw6XuufC2hwl3J20RE9-2crwWbUPhVS_0 2024-03-09T15:07:04.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9040724288615469499', time=2024-03-09T16:57:02.085934+0000, chain.objs.size()=1 2024-03-09T15:07:04.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.kuJtwhuDJxURqbkwNYTG43Yp9mp_wKx_0 2024-03-09T15:07:04.770 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11187397073597368914', time=2024-03-09T16:57:02.272186+0000, chain.objs.size()=1 2024-03-09T15:07:04.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.dmJDMbyYZXvtkD50CtEzrZpEEz2nOia_0 2024-03-09T15:07:04.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15625387459271823197', time=2024-03-09T16:57:02.317564+0000, chain.objs.size()=1 2024-03-09T15:07:04.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.t1c_UkZqMgngeJDazjMPQB5R6nxtr_1_0 2024-03-09T15:07:04.771 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3228643621807244942', time=2024-03-09T16:57:02.480899+0000, chain.objs.size()=1 2024-03-09T15:07:04.772 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.770+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.HzOh4w6xV_cgKfspDUbNO97EsIhzmag_0 2024-03-09T15:07:04.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15669068915578788963', time=2024-03-09T16:57:02.495350+0000, chain.objs.size()=1 2024-03-09T15:07:04.773 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.8-hYF06jSP2lUc0VhAWT1FMRoy6qr_l_0 2024-03-09T15:07:04.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6053128646185359833', time=2024-03-09T16:57:02.595309+0000, chain.objs.size()=1 2024-03-09T15:07:04.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.m2-ocilGUAmy9sR29IPBX2BzGlBXu0q_0 2024-03-09T15:07:04.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15236416214829781946', time=2024-03-09T16:57:02.613781+0000, chain.objs.size()=1 2024-03-09T15:07:04.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xx4b7PXhIeI2BhK-FBMuAGaoHZI_euP_0 2024-03-09T15:07:04.774 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5588348647162343842', time=2024-03-09T16:57:02.614661+0000, chain.objs.size()=1 2024-03-09T15:07:04.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.V4IHwiUQxjfAe43ANe8CgJMk1R9IojR_0 2024-03-09T15:07:04.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.116438350748987374', time=2024-03-09T16:57:02.626001+0000, chain.objs.size()=1 2024-03-09T15:07:04.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.5xNptLEZ2skiePb4oR8tH6MVuUiIIfe_0 2024-03-09T15:07:04.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2821268987829496296', time=2024-03-09T16:57:02.785640+0000, chain.objs.size()=1 2024-03-09T15:07:04.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xD7OQSJTPYFJ9Eq03k2YcL58r0TnDgf_0 2024-03-09T15:07:04.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15859835121776265065', time=2024-03-09T16:57:02.812530+0000, chain.objs.size()=1 2024-03-09T15:07:04.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.9aGFrWOlT5bqPws2kFym5u736eK8qId_0 2024-03-09T15:07:04.775 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7456243688738462443', time=2024-03-09T16:57:02.861050+0000, chain.objs.size()=1 2024-03-09T15:07:04.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.tF0wt8xk4UQm0GgVxIgH3QB5R1V0Z0P_0 2024-03-09T15:07:04.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13481723562944812384', time=2024-03-09T16:57:03.063042+0000, chain.objs.size()=1 2024-03-09T15:07:04.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.p5e2BgYXEOY_N4TZ7jCQwixX6vMcQ-1_0 2024-03-09T15:07:04.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1586599660981642425', time=2024-03-09T16:57:03.097915+0000, chain.objs.size()=1 2024-03-09T15:07:04.776 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.774+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.T1mIYgssZ7y47nRdIzdxMPBTEKr4INM_0 2024-03-09T15:07:04.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.778+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5090162371610460255', time=2024-03-09T16:57:03.305249+0000, chain.objs.size()=1 2024-03-09T15:07:04.777 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.778+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.7ULPmHjckzL6sb6Xb_ySeORbeYtAGi5_0 2024-03-09T15:07:04.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.778+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4805190257637667948', time=2024-03-09T16:57:03.322971+0000, chain.objs.size()=1 2024-03-09T15:07:04.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.778+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.18LDl6p8taTAHb5P5RbrFZh8iLjJZXi_0 2024-03-09T15:07:04.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.778+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15222802032627126402', time=2024-03-09T16:58:41.600759+0000, chain.objs.size()=1 2024-03-09T15:07:04.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.778+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.423__shadow_.Ljw4IW4HH_8nhKElELZ2tK4RtuJZMN7_0 2024-03-09T15:07:04.780 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.778+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14013223394546004840', time=2024-03-09T16:59:14.625766+0000, chain.objs.size()=1 2024-03-09T15:07:04.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.778+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.455__shadow_.bJ8drpyuAzeXz2mxQ_AlMRknGa-N99l_0 2024-03-09T15:07:04.781 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.782+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1084883027829836446', time=2024-03-09T16:59:44.045704+0000, chain.objs.size()=1 2024-03-09T15:07:04.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.492__shadow_.0wVkGEQu2HFGkqn67CS6zbNprZkw9Zs_0 2024-03-09T15:07:04.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.782+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4880889599218045985', time=2024-03-09T16:59:53.001697+0000, chain.objs.size()=6 2024-03-09T15:07:04.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.1 2024-03-09T15:07:04.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.2 2024-03-09T15:07:04.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.3 2024-03-09T15:07:04.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.4 2024-03-09T15:07:04.782 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.5 2024-03-09T15:07:04.783 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.782+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.6 2024-03-09T15:07:04.786 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/42719 2024-03-09T15:07:04.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-03-09T15:07:04.788 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13843199416332731975', time=2024-03-09T17:00:15.903266+0000, chain.objs.size()=6 2024-03-09T15:07:04.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.xm-5rAuGsDLggyxaprVG0romqZKniOgu.1 2024-03-09T15:07:04.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~64kNynbrnjpvi-TzlJ5QhR05dWLpIfu.2 2024-03-09T15:07:04.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~64kNynbrnjpvi-TzlJ5QhR05dWLpIfu.3 2024-03-09T15:07:04.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~64kNynbrnjpvi-TzlJ5QhR05dWLpIfu.4 2024-03-09T15:07:04.789 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~64kNynbrnjpvi-TzlJ5QhR05dWLpIfu.5 2024-03-09T15:07:04.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~64kNynbrnjpvi-TzlJ5QhR05dWLpIfu.6 2024-03-09T15:07:04.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~GGzebewhRJc4JOXMLhm-572pG0-NVep', time=2024-03-09T17:00:47.670391+0000, chain.objs.size()=1 2024-03-09T15:07:04.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.529__multipart_mymultipart.2~GGzebewhRJc4JOXMLhm-572pG0-NVep.3 2024-03-09T15:07:04.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15957048634001215784', time=2024-03-09T17:01:25.435472+0000, chain.objs.size()=1 2024-03-09T15:07:04.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.543__shadow_.I6wGT4jkf-QJCsg7dWhNzzyr5cJdYNk_0 2024-03-09T15:07:04.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6874566922782242627', time=2024-03-09T17:01:29.249163+0000, chain.objs.size()=1 2024-03-09T15:07:04.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.546__shadow_.mZS-yhFaIpO7zVnVm9oo6pd2DmxXfyd_0 2024-03-09T15:07:04.790 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14586839377963855531', time=2024-03-09T17:01:29.581695+0000, chain.objs.size()=1 2024-03-09T15:07:04.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.546__shadow_.ml0wNH9QBQFHwR8SJI7fudZ5vZbB7iM_0 2024-03-09T15:07:04.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6817781264090231557', time=2024-03-09T17:01:34.595047+0000, chain.objs.size()=1 2024-03-09T15:07:04.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.550__shadow_.0UHlgbeXRwwDEImwiGcmWXCGHiUQpWh_0 2024-03-09T15:07:04.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8515933074482332501', time=2024-03-09T17:01:54.085398+0000, chain.objs.size()=1 2024-03-09T15:07:04.791 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.786+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:9waScq-0YojwQk7nJrp8UgS7IU5Wu9v_.eWnqvSPT7UlI-2-MugoOCvzgWFcZHxI_0 2024-03-09T15:07:04.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.790+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1630955617115922761', time=2024-03-09T17:02:15.983118+0000, chain.objs.size()=1 2024-03-09T15:07:04.792 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.790+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:6vynmnWYgMUcIHQ01oXE9pv0pgiuGFs_.1gAD4sKBVKPXv-BwzFsXyHNLnXlDaCp_0 2024-03-09T15:07:04.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5083497653346681830', time=2024-03-09T17:02:16.576576+0000, chain.objs.size()=1 2024-03-09T15:07:04.793 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:asCDVjp67kH3TxhUWrj2EB5wCKTe1b6_.0Y26n7fT4Fy8bQ5k5cinXps38n9mgz2_0 2024-03-09T15:07:04.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17498392965658777443', time=2024-03-09T17:02:18.025435+0000, chain.objs.size()=1 2024-03-09T15:07:04.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:s.DAAZ7kork8hD5F3RSLK.tpZekK4Hl_.LVUMQHA4phk-OrBkLtZ3OfwMZyj_vEu_0 2024-03-09T15:07:04.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1785998995095719853', time=2024-03-09T17:02:37.531580+0000, chain.objs.size()=1 2024-03-09T15:07:04.794 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.572__shadow:QGD-RNnyF1LbYkn6SQOLVlzl2fGaQYn_.b8cJUlix5Q1L3x4PDzuKxRos_xO6O1Q_0 2024-03-09T15:07:04.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2641445892033580819', time=2024-03-09T17:02:45.560520+0000, chain.objs.size()=1 2024-03-09T15:07:04.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.579__shadow:5KKDPhgfOMQ.NmmcJxRh3k6Gf0WLdSj_.oFeE7imKy3Hw0K_TvpmMFOAi5kOE2B5_0 2024-03-09T15:07:04.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2601816996716726161', time=2024-03-09T17:02:46.551832+0000, chain.objs.size()=1 2024-03-09T15:07:04.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.580__shadow:D266QRPF.PBmAO5JDnYVLBJRhwxo8qK_.yfgQHhNIfqMRqWM9YJ9VxolxGQFrmZH_0 2024-03-09T15:07:04.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.840588448677669092', time=2024-03-09T17:02:54.192993+0000, chain.objs.size()=1 2024-03-09T15:07:04.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.589__shadow_.i3dcwpMXI9IvXXJDU7I3Psy4bv1a_IL_0 2024-03-09T15:07:04.795 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14330123087103159862', time=2024-03-09T17:03:49.730820+0000, chain.objs.size()=1 2024-03-09T15:07:04.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.634__shadow_.tMfqPOAv3o_uvEJPUoBN0tNjQPGw3o-_0 2024-03-09T15:07:04.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13340062050568648490', time=2024-03-09T17:04:09.776413+0000, chain.objs.size()=1 2024-03-09T15:07:04.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.653__shadow_.6Z3DEqFxVZJKcAkogk22LRdigUcp14J_0 2024-03-09T15:07:04.796 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2587427581882990370', time=2024-03-09T17:04:22.095979+0000, chain.objs.size()=1 2024-03-09T15:07:04.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.668__shadow_.R265hzW-ymrHZHkjNDbIBPxOUSZJhM1_0 2024-03-09T15:07:04.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14591004742857778629', time=2024-03-09T17:04:33.606073+0000, chain.objs.size()=1 2024-03-09T15:07:04.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.682__shadow:sQA6JJ82yF2nftkEWHeXL1MGaBqbcmz_.1Xqmd2ow1qyivn4eVZZK_7ays2-ggZ0_0 2024-03-09T15:07:04.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.398720013876596890', time=2024-03-09T17:04:47.370767+0000, chain.objs.size()=1 2024-03-09T15:07:04.797 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.794+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.697__shadow_.phltWwWojies-SEjpJccuYhnzlzymTB_0 2024-03-09T15:07:04.798 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9495328805568934652', time=2024-03-09T17:05:02.432305+0000, chain.objs.size()=1 2024-03-09T15:07:04.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.703__shadow:.j.FE.x2PDKslOg3DHSn7gS7bl3ePui_.qBAASAJxOoTkGit6GHQVGvyBYKP0v4-_0 2024-03-09T15:07:04.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.798+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14716585050280734761', time=2024-03-09T17:06:25.658317+0000, chain.objs.size()=1 2024-03-09T15:07:04.799 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.798+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.748__shadow_.zXv2_v6zv92OaeHGt18kDFDEFhVXP1h_0 2024-03-09T15:07:04.801 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.802+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:04.804 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-09T15:07:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:04.805 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:04.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42178' 2024-03-09T15:07:04.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='_yqJTk1Kc0w87MghrEyTgjwMQF9qL3m1', time=2024-03-09T16:51:52.280835+0000, chain.objs.size()=2 2024-03-09T15:07:04.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.154__shadow_.SspPIWopaSGoB2xCdP0yBJBtaA3p5rz_0 2024-03-09T15:07:04.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.154__shadow_.SspPIWopaSGoB2xCdP0yBJBtaA3p5rz_1 2024-03-09T15:07:04.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7724659242090274079', time=2024-03-09T16:54:21.807235+0000, chain.objs.size()=1 2024-03-09T15:07:04.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.224__shadow_.Dg8omlu5S4bys2C6NB2eQ4tUrgSfeqd_0 2024-03-09T15:07:04.807 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14389032172768210444', time=2024-03-09T16:54:27.484858+0000, chain.objs.size()=1 2024-03-09T15:07:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.230__shadow_.fY8G_1ZXLvx9uMAmXMARw1NwSIV5pqU_0 2024-03-09T15:07:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9122018133018804375', time=2024-03-09T16:54:36.863019+0000, chain.objs.size()=1 2024-03-09T15:07:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.238__shadow_.tiBwOpL2qg7WpjDfacOyeLSKNZnudAK_0 2024-03-09T15:07:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18111020992068345360', time=2024-03-09T16:54:38.761206+0000, chain.objs.size()=1 2024-03-09T15:07:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.240__shadow_.y5Fn0wKVcqBfHaU9ODRBSLMk0vjJBsO_0 2024-03-09T15:07:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.409012603440867531', time=2024-03-09T16:54:40.604223+0000, chain.objs.size()=1 2024-03-09T15:07:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.242__shadow_.APEbAxR-6xHQc4nHKuyNedt1iO3xRqm_0 2024-03-09T15:07:04.808 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7193372124703968986', time=2024-03-09T16:54:40.606087+0000, chain.objs.size()=1 2024-03-09T15:07:04.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.242__shadow_.xDxVaOfhDjh_zDAkU6XkEVNJHX6l_XZ_0 2024-03-09T15:07:04.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5398011951793003617', time=2024-03-09T16:54:42.526381+0000, chain.objs.size()=1 2024-03-09T15:07:04.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.244__shadow_.TANBlxqEcAi8g89faPMHV1m6wU2FbFX_0 2024-03-09T15:07:04.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10412708730804910332', time=2024-03-09T16:54:43.471627+0000, chain.objs.size()=1 2024-03-09T15:07:04.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.245__shadow_.afQFRSuhScBtSESwy3jAWyaI3lHKBza_0 2024-03-09T15:07:04.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12612394754922820364', time=2024-03-09T16:54:44.394792+0000, chain.objs.size()=1 2024-03-09T15:07:04.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.246__shadow_.h63Glt47VjhMYhrxPPWMFaW0EU0po-9_0 2024-03-09T15:07:04.809 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8769614854860251631', time=2024-03-09T16:55:14.922093+0000, chain.objs.size()=1 2024-03-09T15:07:04.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.806+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.BrvI2JhdLQS3RioJWTErAYzl2MCFRJG_0 2024-03-09T15:07:04.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.810+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8985914375437845584', time=2024-03-09T16:55:14.937379+0000, chain.objs.size()=1 2024-03-09T15:07:04.810 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.810+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.FCL2rH8sNcr_arzK5v8OYZqvCnJaaJA_0 2024-03-09T15:07:04.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.810+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11662260708243078193', time=2024-03-09T16:55:14.945824+0000, chain.objs.size()=1 2024-03-09T15:07:04.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.810+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.y3YKMNupg8-JjVUFpdVeMk32eaT1ig3_0 2024-03-09T15:07:04.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.810+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13219547093266977767', time=2024-03-09T16:55:15.131255+0000, chain.objs.size()=1 2024-03-09T15:07:04.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.810+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.sFF7pAa7ZBY9AHOEK8ch9VXmcO4FVXX_0 2024-03-09T15:07:04.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.810+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3679266215502982709', time=2024-03-09T16:55:15.154894+0000, chain.objs.size()=1 2024-03-09T15:07:04.811 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.810+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.pqoDqqFvbUDwhj2PimG1mI9B9Hk1bnF_0 2024-03-09T15:07:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13180940028058238152', time=2024-03-09T16:55:15.175799+0000, chain.objs.size()=1 2024-03-09T15:07:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qTEm9e19E4Dh1bo9usrvPGEmAx-Fimk_0 2024-03-09T15:07:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5450353598817313027', time=2024-03-09T16:55:15.204383+0000, chain.objs.size()=1 2024-03-09T15:07:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.0JEltrLd9Pqctk5T0PM253POZlPn-Ei_0 2024-03-09T15:07:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.314313734789014305', time=2024-03-09T16:55:15.230579+0000, chain.objs.size()=1 2024-03-09T15:07:04.814 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Gml65sV9Acg-3DEV4sC83p8Umq4WQ0h_0 2024-03-09T15:07:04.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16065782262081959145', time=2024-03-09T16:55:15.241696+0000, chain.objs.size()=1 2024-03-09T15:07:04.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.tcmXL0R4lHkztQ6jcC2bqtKXv5cuUd5_0 2024-03-09T15:07:04.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17526034844161333205', time=2024-03-09T16:55:15.461649+0000, chain.objs.size()=1 2024-03-09T15:07:04.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.x20W8Vtu4aJoeEQUjlZtSKOvHV0YGYF_0 2024-03-09T15:07:04.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6104294755756613919', time=2024-03-09T16:55:15.490404+0000, chain.objs.size()=1 2024-03-09T15:07:04.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.WUXCqVNMoV1eYP6aTbEzQ0jgMFIdCYV_0 2024-03-09T15:07:04.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15757788640454031261', time=2024-03-09T16:55:15.511034+0000, chain.objs.size()=1 2024-03-09T15:07:04.815 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Tg_uzpCNwbYhjn4BtbnAJoN-NIMUSxQ_0 2024-03-09T15:07:04.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8414390888544009846', time=2024-03-09T16:55:15.539199+0000, chain.objs.size()=1 2024-03-09T15:07:04.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.jzHhc6wf2CNQd0hIjh5TJ1Lh60HT-Cb_0 2024-03-09T15:07:04.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3074260424121741816', time=2024-03-09T16:55:15.543733+0000, chain.objs.size()=1 2024-03-09T15:07:04.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.GoJEHE7UoSELgBAZ0a_RjAE5BDx9iBm_0 2024-03-09T15:07:04.816 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17120920804453092152', time=2024-03-09T16:55:15.679262+0000, chain.objs.size()=1 2024-03-09T15:07:04.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Dgjh6aTrLr_N_fmjL2iEdDfYeMzS5Vz_0 2024-03-09T15:07:04.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15495568018166882964', time=2024-03-09T16:55:15.709895+0000, chain.objs.size()=1 2024-03-09T15:07:04.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.814+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.yuRZXX4c7I2OVFr296T3sroTI8kvzEZ_0 2024-03-09T15:07:04.817 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15459286281481289368', time=2024-03-09T16:55:15.817889+0000, chain.objs.size()=1 2024-03-09T15:07:04.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.UMVJ1nZxgMKMsxwkzQ4Cmc0LHi0UF7c_0 2024-03-09T15:07:04.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15992016171277004299', time=2024-03-09T16:55:15.821140+0000, chain.objs.size()=1 2024-03-09T15:07:04.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.2ysWzEM1Ao4j35nZiQ7W38LtvsWdxwl_0 2024-03-09T15:07:04.818 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11328489498353454196', time=2024-03-09T16:55:15.838635+0000, chain.objs.size()=1 2024-03-09T15:07:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.nc3uzW6D_ah3PINY1u1D0IAd9C4L0Uf_0 2024-03-09T15:07:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5295841868934696945', time=2024-03-09T16:55:15.956844+0000, chain.objs.size()=1 2024-03-09T15:07:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.2xxhI3AyjgBi6vlw8fCFCkMxrMRzfGn_0 2024-03-09T15:07:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10245905921666321925', time=2024-03-09T16:55:15.971292+0000, chain.objs.size()=1 2024-03-09T15:07:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.PsPFKnEIEv3VwZmd8SZp8H2YIt6y5YF_0 2024-03-09T15:07:04.819 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10342825997281857465', time=2024-03-09T16:55:15.976719+0000, chain.objs.size()=1 2024-03-09T15:07:04.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.BzuC0Vp8vMVcl_KBT-y7UWIaekLxU0m_0 2024-03-09T15:07:04.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.518407674546188028', time=2024-03-09T16:55:15.993768+0000, chain.objs.size()=1 2024-03-09T15:07:04.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.mU0LtLGXeJpRkX9TDLPUysqH_WN3V81_0 2024-03-09T15:07:04.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.634903758697337048', time=2024-03-09T16:55:16.003815+0000, chain.objs.size()=1 2024-03-09T15:07:04.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.pEllq9yxL8PSZqI77beh8fig3IWEUhx_0 2024-03-09T15:07:04.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13183746630760439160', time=2024-03-09T16:55:16.005182+0000, chain.objs.size()=1 2024-03-09T15:07:04.820 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.818+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.DVEJkvTHG3USnG5zgjCF1xXg5tPrj6W_0 2024-03-09T15:07:04.821 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.822+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5050084792581425336', time=2024-03-09T16:55:16.040806+0000, chain.objs.size()=1 2024-03-09T15:07:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.822+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.rGwtmw6kKndZR22QQ0fsHhjBzE4SwXT_0 2024-03-09T15:07:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.822+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4656069022329957805', time=2024-03-09T16:55:16.066113+0000, chain.objs.size()=1 2024-03-09T15:07:04.822 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.822+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.B3rPaIa2_xwxVxbW7IKLO2h5IEYAtPk_0 2024-03-09T15:07:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1820594774273088632', time=2024-03-09T16:55:16.081136+0000, chain.objs.size()=1 2024-03-09T15:07:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.VmtjQ-QH9PA12PFXyetLu2c-gqTr5aJ_0 2024-03-09T15:07:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15245738436986810042', time=2024-03-09T16:55:16.240238+0000, chain.objs.size()=1 2024-03-09T15:07:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.a0sE6MMe3WaS-1HjmdqSy-xi7ow4tJI_0 2024-03-09T15:07:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.327032473727715215', time=2024-03-09T16:55:16.273432+0000, chain.objs.size()=1 2024-03-09T15:07:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.WeTb1sDsI3eoLNPQIGWhYbyjk7LmZQK_0 2024-03-09T15:07:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11160591704503836107', time=2024-03-09T16:55:16.474982+0000, chain.objs.size()=1 2024-03-09T15:07:04.825 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.tMqkNdsyGpM8-yRGqqRli6j-sY0kkru_0 2024-03-09T15:07:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2078654028164656864', time=2024-03-09T16:55:16.504834+0000, chain.objs.size()=1 2024-03-09T15:07:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Gg6hu3OwpVrTrfUOkPWRHlk6gUncGCb_0 2024-03-09T15:07:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2325791043211600790', time=2024-03-09T16:55:16.521959+0000, chain.objs.size()=1 2024-03-09T15:07:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.GfdZfG7iVXYwNrr_dvv8yLGhGF5NpK7_0 2024-03-09T15:07:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10323391599221115711', time=2024-03-09T16:55:16.575563+0000, chain.objs.size()=1 2024-03-09T15:07:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.jq3szzDBcZcAFg8fespzbMKqeL2ULqM_0 2024-03-09T15:07:04.826 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6714108712604905747', time=2024-03-09T16:55:16.594179+0000, chain.objs.size()=1 2024-03-09T15:07:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.4MN8QwP8r-W-SOU4ZI_gVSU2L5M3yzp_0 2024-03-09T15:07:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11016908631838603950', time=2024-03-09T16:55:16.617104+0000, chain.objs.size()=1 2024-03-09T15:07:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.VEfnfXUw6Lfl-bdHd49j6KG9SYs-K2U_0 2024-03-09T15:07:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3538266161183882316', time=2024-03-09T16:55:16.724396+0000, chain.objs.size()=1 2024-03-09T15:07:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.1I3oUgTFznCVVlK6D9LkIKylGTNhbQ0_0 2024-03-09T15:07:04.827 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10711930216811880588', time=2024-03-09T16:55:16.801473+0000, chain.objs.size()=1 2024-03-09T15:07:04.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.826+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.8FflyS2BTWUkD7jJUF3HW5RS9SmUb3W_0 2024-03-09T15:07:04.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.830+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17693098911762549039', time=2024-03-09T16:55:16.811753+0000, chain.objs.size()=1 2024-03-09T15:07:04.828 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.830+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.vad60VvE9f9Y3R-x7xflT8PZ3yNtDds_0 2024-03-09T15:07:04.829 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.830+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11505446585142137326', time=2024-03-09T16:55:16.844971+0000, chain.objs.size()=1 2024-03-09T15:07:04.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.830+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.QiHJzC6uZECdHCW7bSgrYTiZxZVSIOx_0 2024-03-09T15:07:04.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.830+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5248349116871030068', time=2024-03-09T16:55:19.465426+0000, chain.objs.size()=1 2024-03-09T15:07:04.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.830+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.259__shadow_.zaVzlQrio3la1-XMlyltNTarcTsDNAY_0 2024-03-09T15:07:04.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.830+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13041834762781447720', time=2024-03-09T16:55:46.208477+0000, chain.objs.size()=1 2024-03-09T15:07:04.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.830+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.bZXi0kox2hcI5MUxpRml89J6RM0Rzoz_0 2024-03-09T15:07:04.830 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.830+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12689195250983029552', time=2024-03-09T16:55:46.239497+0000, chain.objs.size()=1 2024-03-09T15:07:04.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.830+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.msgo6qXTJZNsaIDlhOYz_0oiye6_2qs_0 2024-03-09T15:07:04.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.830+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8462194237893211825', time=2024-03-09T16:55:47.845606+0000, chain.objs.size()=1 2024-03-09T15:07:04.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.830+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.DT8g5khpubPYN3UjlpBOCg6QQHRKjTF_0 2024-03-09T15:07:04.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.830+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14503789580422513950', time=2024-03-09T16:55:47.854385+0000, chain.objs.size()=1 2024-03-09T15:07:04.831 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.830+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.ARKfH0RiWqhR9L1Cu7QlUgHh5DX9PjI_0 2024-03-09T15:07:04.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14539670264955974825', time=2024-03-09T16:55:47.876802+0000, chain.objs.size()=1 2024-03-09T15:07:04.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.pK_G4r7vwWxxX9ReEMBtXnPzDrXWbox_0 2024-03-09T15:07:04.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13613109315717755798', time=2024-03-09T16:55:47.880215+0000, chain.objs.size()=1 2024-03-09T15:07:04.832 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.sorA2HsA9zcsv8517oLxTuoRKgdz6___0 2024-03-09T15:07:04.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11100253541039730856', time=2024-03-09T16:55:58.320797+0000, chain.objs.size()=1 2024-03-09T15:07:04.833 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.298__shadow_.QsZPqBos_US-8RtfQV8Tsjf2cOKWT9Z_0 2024-03-09T15:07:04.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13645512123267381501', time=2024-03-09T16:56:37.803450+0000, chain.objs.size()=1 2024-03-09T15:07:04.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.aN0RwGnHm56-jkGUFZo5mNtUDEvHq1g_0 2024-03-09T15:07:04.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15537466978230242945', time=2024-03-09T16:56:37.804114+0000, chain.objs.size()=1 2024-03-09T15:07:04.834 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.06lkR1_fpbWRsNMd6xHEYiMuv135Ljx_0 2024-03-09T15:07:04.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7269137349450744610', time=2024-03-09T16:56:37.829672+0000, chain.objs.size()=1 2024-03-09T15:07:04.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Jf7jxuKIfKc1zTBx8RF3PNNvTmR4whq_0 2024-03-09T15:07:04.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12530436798151845273', time=2024-03-09T16:56:37.836703+0000, chain.objs.size()=1 2024-03-09T15:07:04.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.cIyI7fU8qAzRllnV7mwi4Ax3Lyeaqa6_0 2024-03-09T15:07:04.835 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6209943905314023531', time=2024-03-09T16:56:37.855224+0000, chain.objs.size()=1 2024-03-09T15:07:04.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.GdAwI8FtVeijzj0IYl9JFptiEj9GVj4_0 2024-03-09T15:07:04.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4207291893886108688', time=2024-03-09T16:56:37.972494+0000, chain.objs.size()=1 2024-03-09T15:07:04.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.2IddSaLMpl2ioLM_ZOrJFxvzHT8nrFm_0 2024-03-09T15:07:04.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11074643249505841608', time=2024-03-09T16:56:37.983432+0000, chain.objs.size()=1 2024-03-09T15:07:04.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.zY1iNZUs5Y6o46f-PFsVdGD_1Ad0CNy_0 2024-03-09T15:07:04.836 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17215637639093735176', time=2024-03-09T16:56:38.045174+0000, chain.objs.size()=1 2024-03-09T15:07:04.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.oSHQI-FV_gNRjtJVCU1F103E-w8r8oZ_0 2024-03-09T15:07:04.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2977012551889543097', time=2024-03-09T16:56:38.237544+0000, chain.objs.size()=1 2024-03-09T15:07:04.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.834+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.pTt_5nYLP6m8EmFBoEKDXmnC2y41lWN_0 2024-03-09T15:07:04.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4370452129936086835', time=2024-03-09T16:56:38.239192+0000, chain.objs.size()=1 2024-03-09T15:07:04.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.UvFohCRYwgxO_ajVbK37GdrXRzZ454T_0 2024-03-09T15:07:04.837 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3344240422963646170', time=2024-03-09T16:56:38.240326+0000, chain.objs.size()=1 2024-03-09T15:07:04.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.8TwMsk5_FMAyjdT-i9uMfGVMtGpxTxS_0 2024-03-09T15:07:04.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.838+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17238330557704540417', time=2024-03-09T16:56:38.245622+0000, chain.objs.size()=1 2024-03-09T15:07:04.838 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.838+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.4F0IgHBXK1Hm9N-6_rr6NJQREP3V2Yo_0 2024-03-09T15:07:04.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18264638376059755097', time=2024-03-09T16:56:38.320028+0000, chain.objs.size()=1 2024-03-09T15:07:04.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-qoXy_1Knm1qzE9xTt-ninz8C0LGGAa_0 2024-03-09T15:07:04.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.842+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14110890340754137856', time=2024-03-09T16:56:38.364219+0000, chain.objs.size()=1 2024-03-09T15:07:04.840 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.842+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Kw91VOl7fRpFTirEeUayb-wqfRu7mhn_0 2024-03-09T15:07:04.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14332347422975002197', time=2024-03-09T16:56:38.379848+0000, chain.objs.size()=1 2024-03-09T15:07:04.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.D7M2VYxMRp8cYUCP0bwqb8NNk9ndiZ5_0 2024-03-09T15:07:04.844 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5968276286156162829', time=2024-03-09T16:56:38.394439+0000, chain.objs.size()=1 2024-03-09T15:07:04.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.yYhxPllug4qQqMaqre90JN-zJJipKLI_0 2024-03-09T15:07:04.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11359416397561663465', time=2024-03-09T16:56:38.553152+0000, chain.objs.size()=1 2024-03-09T15:07:04.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.KrYUwq-Cea4bRf77AhtFFRyK-9nZn8F_0 2024-03-09T15:07:04.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7664541345600132585', time=2024-03-09T16:56:38.562154+0000, chain.objs.size()=1 2024-03-09T15:07:04.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.GlViA1lQ0aiZCJuFjkmzQhmocG3KQln_0 2024-03-09T15:07:04.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.955574277365156396', time=2024-03-09T16:56:38.648981+0000, chain.objs.size()=1 2024-03-09T15:07:04.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.p25qjHuHtE0PJsbWSlzbAxfzg-DgLnn_0 2024-03-09T15:07:04.845 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5898011505859986291', time=2024-03-09T16:56:38.660242+0000, chain.objs.size()=1 2024-03-09T15:07:04.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.DcwSkaF9ZCLw-zfzdHtEnnjach66ZqK_0 2024-03-09T15:07:04.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.323652084674444431', time=2024-03-09T16:56:38.868946+0000, chain.objs.size()=1 2024-03-09T15:07:04.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.93QbtghNSfxnWFLd2xcsMcI5i7wrcun_0 2024-03-09T15:07:04.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6538206076456218730', time=2024-03-09T16:56:38.898044+0000, chain.objs.size()=1 2024-03-09T15:07:04.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.K2MG6627ZHp-YkX8-RbAN_VtLcwrD4T_0 2024-03-09T15:07:04.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.680763862804024380', time=2024-03-09T16:56:39.042044+0000, chain.objs.size()=1 2024-03-09T15:07:04.846 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.RVnEAeRpMBS2_5bGd8OIhDE2VXv5qmW_0 2024-03-09T15:07:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14523777002799929070', time=2024-03-09T16:56:39.053072+0000, chain.objs.size()=1 2024-03-09T15:07:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.JqbHR_DmVmGYxV882R4YCYCgyFrgqsc_0 2024-03-09T15:07:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10383212489956072334', time=2024-03-09T16:56:39.126296+0000, chain.objs.size()=1 2024-03-09T15:07:04.847 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.846+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.v0WTNSj7OoKhrtLoquPUoX9Qv3Rig1-_0 2024-03-09T15:07:04.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18116150788678258911', time=2024-03-09T16:56:39.131031+0000, chain.objs.size()=1 2024-03-09T15:07:04.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ahds1i0d0t7QWyjmJTRZmKfG-QwzVYV_0 2024-03-09T15:07:04.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8129300997056356401', time=2024-03-09T16:56:39.145609+0000, chain.objs.size()=1 2024-03-09T15:07:04.849 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.nEnktZ0ihGaJ8oi35KaWVty2-tqYRGJ_0 2024-03-09T15:07:04.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1181759236453618555', time=2024-03-09T16:56:39.346363+0000, chain.objs.size()=1 2024-03-09T15:07:04.851 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.mdyybykwzvfejp-vZTBFPys2dMqF5XZ_0 2024-03-09T15:07:04.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8413360468434082803', time=2024-03-09T16:56:39.374412+0000, chain.objs.size()=1 2024-03-09T15:07:04.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.scAZ1vCVWICeTbVdchkAfLD5M1L1EJS_0 2024-03-09T15:07:04.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17044326489911358688', time=2024-03-09T16:56:39.375921+0000, chain.objs.size()=1 2024-03-09T15:07:04.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.gSguoXVBVAcFYuwmf3FJ1CyRbvREOoZ_0 2024-03-09T15:07:04.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13194894344267642554', time=2024-03-09T16:56:39.394801+0000, chain.objs.size()=1 2024-03-09T15:07:04.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.NXYkhBuK-KcQE48MM0F3Z0Z6gqhIBoC_0 2024-03-09T15:07:04.852 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7719575943160168884', time=2024-03-09T16:56:39.432775+0000, chain.objs.size()=1 2024-03-09T15:07:04.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.zRYZHgGnrGsa5iLxP6fZ5LemdohoDq2_0 2024-03-09T15:07:04.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15084943812273475288', time=2024-03-09T16:56:39.591363+0000, chain.objs.size()=1 2024-03-09T15:07:04.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.3n-WgTCd7K_PpOhKV_mFxXTlJa6ZDcC_0 2024-03-09T15:07:04.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9653186321830022329', time=2024-03-09T16:56:39.680587+0000, chain.objs.size()=1 2024-03-09T15:07:04.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.F06fNs_huPRHrBXoAnzsCoQL2z6_-PC_0 2024-03-09T15:07:04.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9633634451199500569', time=2024-03-09T16:57:01.418789+0000, chain.objs.size()=1 2024-03-09T15:07:04.853 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ZBtWLAJyXY461PHouVhdck1OVZrh8CH_0 2024-03-09T15:07:04.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8266739561461467261', time=2024-03-09T16:57:01.421453+0000, chain.objs.size()=1 2024-03-09T15:07:04.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.kfphkdoRvJsJFL-QbH9EI4wJ-cZ5YPv_0 2024-03-09T15:07:04.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4124857396027077020', time=2024-03-09T16:57:01.471822+0000, chain.objs.size()=1 2024-03-09T15:07:04.854 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.850+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.__3KV7-PfHfBxgUSa4mrSGzlEH32FgM_0 2024-03-09T15:07:04.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.854+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13485672541398056684', time=2024-03-09T16:57:01.492925+0000, chain.objs.size()=1 2024-03-09T15:07:04.855 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.854+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.X4McqbO1wpC3OU7nyT9m6GIB_Mw5Quj_0 2024-03-09T15:07:04.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.858+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1524351373174492340', time=2024-03-09T16:57:01.756277+0000, chain.objs.size()=1 2024-03-09T15:07:04.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.858+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.QC4POK5Hq-Xw4J86w62fDVGvgAgqx7f_0 2024-03-09T15:07:04.857 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.858+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11963609802406486758', time=2024-03-09T16:57:01.833604+0000, chain.objs.size()=1 2024-03-09T15:07:04.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.858+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.l9HpjtEsGTn6qmnmYSilT3XeBTrutJu_0 2024-03-09T15:07:04.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.858+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1579473541508001073', time=2024-03-09T16:57:01.836445+0000, chain.objs.size()=1 2024-03-09T15:07:04.858 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.858+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.mzJ_vDWsVc-ZKZul0oF31gd5dXeE7u-_0 2024-03-09T15:07:04.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.858+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12172553393044462470', time=2024-03-09T16:57:01.869708+0000, chain.objs.size()=1 2024-03-09T15:07:04.859 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.858+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.cPXz9u6FDWkVtiNj_-tVKMi3wo7bM3n_0 2024-03-09T15:07:04.861 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/42178 2024-03-09T15:07:04.863 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=40, truncated=0, next_marker='' 2024-03-09T15:07:04.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13316444877827811167', time=2024-03-09T16:57:01.875577+0000, chain.objs.size()=1 2024-03-09T15:07:04.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.NCao89iREXGPubOV3-qea60mV2TjCDU_0 2024-03-09T15:07:04.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1339662500916873297', time=2024-03-09T16:57:01.994595+0000, chain.objs.size()=1 2024-03-09T15:07:04.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.7rt3UBHwndKfbGsVyau2-12hGcuW5IF_0 2024-03-09T15:07:04.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16435675322953433176', time=2024-03-09T16:57:02.035009+0000, chain.objs.size()=1 2024-03-09T15:07:04.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.kgVR3WefEYafZjYH1y9UnWVRPnIHwVM_0 2024-03-09T15:07:04.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5892529265770710480', time=2024-03-09T16:57:02.042524+0000, chain.objs.size()=1 2024-03-09T15:07:04.864 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.vaNW-ksh02qKg9u7QL3uPOHlnrz58M5_0 2024-03-09T15:07:04.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4354823716863425923', time=2024-03-09T16:57:02.056692+0000, chain.objs.size()=1 2024-03-09T15:07:04.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.LmA-lade3xRv6QSb4SjgD3uHcj6wT8N_0 2024-03-09T15:07:04.865 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9607116155671523896', time=2024-03-09T16:57:02.095420+0000, chain.objs.size()=1 2024-03-09T15:07:04.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.hZ6dMYREbMvMgNqPmBhajJWF-BYI-EZ_0 2024-03-09T15:07:04.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13484442369385993393', time=2024-03-09T16:57:02.103128+0000, chain.objs.size()=1 2024-03-09T15:07:04.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.CoGzzS02lY1j_d6AuyiO11b0gGEc8eK_0 2024-03-09T15:07:04.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.402823747655002535', time=2024-03-09T16:57:02.235265+0000, chain.objs.size()=1 2024-03-09T15:07:04.866 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.5gmSyL8qK3b5_P3D74bL-J9NtK3Lmi-_0 2024-03-09T15:07:04.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3604369111371881394', time=2024-03-09T16:57:02.248685+0000, chain.objs.size()=1 2024-03-09T15:07:04.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.vWpjrgDa_Sb2euoweJ5-1KcL6tAV4gT_0 2024-03-09T15:07:04.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17700847117019948590', time=2024-03-09T16:57:02.269984+0000, chain.objs.size()=1 2024-03-09T15:07:04.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.KO5wpq7W4Ar17Esve9XfBjk6VXQsfta_0 2024-03-09T15:07:04.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16686211367357579926', time=2024-03-09T16:57:02.275708+0000, chain.objs.size()=1 2024-03-09T15:07:04.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.SivU-U4B81IxzXQM2uHXXfNW1GELFrK_0 2024-03-09T15:07:04.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18142699331750099283', time=2024-03-09T16:57:02.280824+0000, chain.objs.size()=1 2024-03-09T15:07:04.867 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.862+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.YEkH0T3BS5u_cnmWIGmiB5D7IndrX2L_0 2024-03-09T15:07:04.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.866+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6198916245672144649', time=2024-03-09T16:57:02.356949+0000, chain.objs.size()=1 2024-03-09T15:07:04.868 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.866+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.3ssTu2bLPQgqDH5S6f-JUxMJy3j4-dA_0 2024-03-09T15:07:04.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16673701816438022552', time=2024-03-09T16:57:02.544748+0000, chain.objs.size()=1 2024-03-09T15:07:04.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.g3Ucqqe2tiIelSXYdhRbDIEMGsAoX1F_0 2024-03-09T15:07:04.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11291926132015936015', time=2024-03-09T16:57:02.596680+0000, chain.objs.size()=1 2024-03-09T15:07:04.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Jggd0-OOPmX4JyCBm-aGzttFoGytBtb_0 2024-03-09T15:07:04.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3454747587916122206', time=2024-03-09T16:57:02.633606+0000, chain.objs.size()=1 2024-03-09T15:07:04.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.M48R0_E_TDpZAxSsr9r2B5CtWIbYTpM_0 2024-03-09T15:07:04.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17125387586068096971', time=2024-03-09T16:57:02.774307+0000, chain.objs.size()=1 2024-03-09T15:07:04.869 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.M2hcb4OjfLedGETitiwb9-y7UMvXz0A_0 2024-03-09T15:07:04.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.444226070321049959', time=2024-03-09T16:57:02.775127+0000, chain.objs.size()=1 2024-03-09T15:07:04.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.3HBix1Tggl3ehrid8oCi9afnKJGYv6a_0 2024-03-09T15:07:04.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1112092734751195064', time=2024-03-09T16:57:02.798337+0000, chain.objs.size()=1 2024-03-09T15:07:04.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.H46Ry63m3MtdFvfWauzl1dgFCOIC99y_0 2024-03-09T15:07:04.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13745102993656470329', time=2024-03-09T16:57:02.827417+0000, chain.objs.size()=1 2024-03-09T15:07:04.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.8Y_3mPlFt9VUz_DmfaM374XwbUtS0ae_0 2024-03-09T15:07:04.870 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16892116564831943269', time=2024-03-09T16:57:02.986594+0000, chain.objs.size()=1 2024-03-09T15:07:04.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.__GbsuB29s1OuZhoff781KLI36dJ-AH_0 2024-03-09T15:07:04.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7157276984332753366', time=2024-03-09T16:57:03.008588+0000, chain.objs.size()=1 2024-03-09T15:07:04.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.F8po4tEC4jZ_SYTGUfEQbrGNAYxtmUt_0 2024-03-09T15:07:04.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3052053882151084698', time=2024-03-09T16:57:03.023484+0000, chain.objs.size()=1 2024-03-09T15:07:04.871 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.870+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_._zgLIGHAmkUzhjrLpjxZo_ay8eT95Mj_0 2024-03-09T15:07:04.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.888824835050750774', time=2024-03-09T16:57:03.348170+0000, chain.objs.size()=1 2024-03-09T15:07:04.872 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.TnFpXgARm4UewKPnqk1QwUwzDMuO0gw_0 2024-03-09T15:07:04.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10527734904583408147', time=2024-03-09T16:57:03.368686+0000, chain.objs.size()=1 2024-03-09T15:07:04.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.KJIDpXKKaJDnPlpRF01-hKg6SpymVv5_0 2024-03-09T15:07:04.874 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3389483367652597679', time=2024-03-09T16:57:03.379218+0000, chain.objs.size()=1 2024-03-09T15:07:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.06nSg1-KRO61KP43SRTtZJu-IQ5euoR_0 2024-03-09T15:07:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7927516754166548116', time=2024-03-09T16:57:03.390879+0000, chain.objs.size()=1 2024-03-09T15:07:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.1iOCgTNXGBjaJ7jzhLR4M1rWXDq_2rJ_0 2024-03-09T15:07:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1265138574382007957', time=2024-03-09T16:59:08.333528+0000, chain.objs.size()=1 2024-03-09T15:07:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.450__shadow_.MW-owDeBwow7c5pL7NJgBzgD9UeGlMq_0 2024-03-09T15:07:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10451331273049431524', time=2024-03-09T16:59:18.297220+0000, chain.objs.size()=1 2024-03-09T15:07:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.458__shadow_.Xk_TOaJk9XuVDda2Of6rQqmw70z7dDc_0 2024-03-09T15:07:04.875 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.874+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9057097190702725510', time=2024-03-09T17:00:02.748054+0000, chain.objs.size()=1 2024-03-09T15:07:04.876 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.874+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.511__shadow_.v3s4zVLLBToVXD2-pn6fgFpH7jHVxGS_0 2024-03-09T15:07:04.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.878+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11456850754438216604', time=2024-03-09T17:01:30.733715+0000, chain.objs.size()=1 2024-03-09T15:07:04.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.878+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.547__shadow_.sRT-gwQMKqFusDSE5a_SV2c3s7XtiZ4_0 2024-03-09T15:07:04.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.878+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5232022817691104610', time=2024-03-09T17:02:13.222603+0000, chain.objs.size()=1 2024-03-09T15:07:04.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.878+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.569__shadow:uPisdPdHRFIBKSQTq6R0no.e23bHbhC_.S4KrHAOfMklRIaep-s7oyDo8SYpENAL_0 2024-03-09T15:07:04.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.878+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6734855510470056162', time=2024-03-09T17:02:23.391160+0000, chain.objs.size()=1 2024-03-09T15:07:04.877 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.878+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:ucEH01X.13iCRbuRW6NByD61KwX3cvj_.cMhsvjrTvKgKuvxc_ihBNSlSJtB1Rge_0 2024-03-09T15:07:04.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.878+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5331101794839679575', time=2024-03-09T17:02:23.822580+0000, chain.objs.size()=1 2024-03-09T15:07:04.878 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.878+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:mh.wbIv4LIDKBR3JR2fdjhqn8D7wB3E_.4xubbZhJN-1zvchlLraPAv_6JEaKSRd_0 2024-03-09T15:07:04.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.878+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3684182771760397913', time=2024-03-09T17:02:29.354614+0000, chain.objs.size()=1 2024-03-09T15:07:04.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.878+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:7ZM-SCe2bKG1-WzMwMMboiI.j5e0w7v_.KBaprL8iORCgkR2yxo16spFz4Gwjfxw_0 2024-03-09T15:07:04.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.878+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.655__shadow_.BRSsm5tsC922netGuxuLT2DIyRdoF-A_1_c843a3f316e00621618af9108014797c', time=2024-03-09T17:04:12.350979+0000, chain.objs.size()=1 2024-03-09T15:07:04.879 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.878+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.655__shadow_.BRSsm5tsC922netGuxuLT2DIyRdoF-A_0 2024-03-09T15:07:04.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.878+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12508853142982598517', time=2024-03-09T17:04:34.533689+0000, chain.objs.size()=1 2024-03-09T15:07:04.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.878+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.683__shadow:uPZKGHGehNGo13XhBLNW5eMt3EQiOPR_.Brx4CxH5fN5Y1wtlR2GMsd5GFzlRG9c_0 2024-03-09T15:07:04.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.882+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1160895528663790014', time=2024-03-09T17:04:49.841510+0000, chain.objs.size()=1 2024-03-09T15:07:04.880 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.882+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.700__shadow:ddcbvxkQ2KhGqcywLL0M9c4akUcEwq._.UDRAPaTUXeFVMDklCMqeGg9Q-it4UPj_0 2024-03-09T15:07:04.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.882+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8080931059777603102', time=2024-03-09T17:05:49.776459+0000, chain.objs.size()=1 2024-03-09T15:07:04.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.882+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.728__shadow_.A6wCTirQpCXXdBx6-s84MIbj3IMa8UN_0 2024-03-09T15:07:04.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.882+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14475980192589606476', time=2024-03-09T17:06:28.160743+0000, chain.objs.size()=1 2024-03-09T15:07:04.881 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.882+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.750__shadow_.JgcY2NobUsJV48s97xOWCCnN6-pUuCz_0 2024-03-09T15:07:04.884 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.886+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:04.887 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.886+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-09T15:07:04.888 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:04.889 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48408' 2024-03-09T15:07:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7191105972703305835', time=2024-03-09T16:51:44.498526+0000, chain.objs.size()=1 2024-03-09T15:07:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.147__shadow_._NOsz-jBnfm9NQmhM4_A0trfz81dBJi_0 2024-03-09T15:07:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14541185841925775881', time=2024-03-09T16:54:26.580157+0000, chain.objs.size()=1 2024-03-09T15:07:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.229__shadow_.VH8OZJQJ2emfXA_fU632NN9IEn8Sk9m_0 2024-03-09T15:07:04.890 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9014880252394773466', time=2024-03-09T16:54:28.977118+0000, chain.objs.size()=1 2024-03-09T15:07:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.231__shadow_.81_BTE6mcfI8yQbe4hggenOcYRmjb9M_0 2024-03-09T15:07:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9422786403472175490', time=2024-03-09T16:55:14.913518+0000, chain.objs.size()=1 2024-03-09T15:07:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.3YrIBOjSyQIOul8-Q-ATGlWq8gvWJVS_0 2024-03-09T15:07:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3681614157205915624', time=2024-03-09T16:55:14.945267+0000, chain.objs.size()=1 2024-03-09T15:07:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.hPaKYy_K-Lo3pULWGfk8iTLcEf53DSU_0 2024-03-09T15:07:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15650249235227767971', time=2024-03-09T16:55:15.011742+0000, chain.objs.size()=1 2024-03-09T15:07:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Z1tO9mGwQLLebenlJte3B4dnF5-B33d_0 2024-03-09T15:07:04.891 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4151101842297270327', time=2024-03-09T16:55:15.174614+0000, chain.objs.size()=1 2024-03-09T15:07:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.7ndAj1OeNvGF229Fu7koRCwnV0U2Lnv_0 2024-03-09T15:07:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16261110923187121669', time=2024-03-09T16:55:15.205635+0000, chain.objs.size()=1 2024-03-09T15:07:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.0WSOQ3sKc30rYtgvkPvptQIkpuzA0qm_0 2024-03-09T15:07:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7117232189045633945', time=2024-03-09T16:55:15.226902+0000, chain.objs.size()=1 2024-03-09T15:07:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.lDTVCSm3llZkcttu1VgC8WSMYAALWCm_0 2024-03-09T15:07:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7251813398870321242', time=2024-03-09T16:55:15.268967+0000, chain.objs.size()=1 2024-03-09T15:07:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.vDjuc4CNm1AaPbibWcc0H7cR1_jaN8F_0 2024-03-09T15:07:04.892 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6366493074104057358', time=2024-03-09T16:55:15.532969+0000, chain.objs.size()=1 2024-03-09T15:07:04.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.V-EFxkEmVYDYLcsEAnYYvjyXqw-DihH_0 2024-03-09T15:07:04.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15330523335436776504', time=2024-03-09T16:55:15.723644+0000, chain.objs.size()=1 2024-03-09T15:07:04.893 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.890+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.mRyBsIaPx7jWgBnZMEUlpEZ9wj5G1IX_0 2024-03-09T15:07:04.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15394747830470911139', time=2024-03-09T16:55:15.737067+0000, chain.objs.size()=1 2024-03-09T15:07:04.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.g3hmdY7ELObaIPv4KaSBWwJq7Y2ck3M_0 2024-03-09T15:07:04.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9848278399252762396', time=2024-03-09T16:55:15.763318+0000, chain.objs.size()=1 2024-03-09T15:07:04.894 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Wk-b5kvNNTNxEJHBz4EfVBoC1zkkfFm_0 2024-03-09T15:07:04.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.394071665393275021', time=2024-03-09T16:55:15.776995+0000, chain.objs.size()=1 2024-03-09T15:07:04.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.xGLzG4ZDa8R5tzx4nbvuapDkRmXx2aB_0 2024-03-09T15:07:04.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12598783465403275011', time=2024-03-09T16:55:15.793540+0000, chain.objs.size()=1 2024-03-09T15:07:04.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.k4YhH4H_qOXjpIf0vNgR9Bs9PChvLhJ_0 2024-03-09T15:07:04.895 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17147136678229741488', time=2024-03-09T16:55:15.807275+0000, chain.objs.size()=1 2024-03-09T15:07:04.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.xzPmUs8oIzgfofBxxBgMuTlH_k4x8RA_0 2024-03-09T15:07:04.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.492102082495596452', time=2024-03-09T16:55:15.822488+0000, chain.objs.size()=1 2024-03-09T15:07:04.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.DG7Txi9FB8wHGoFKRHDVOtDsqBD-Lj9_0 2024-03-09T15:07:04.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13901772499781905271', time=2024-03-09T16:55:15.951418+0000, chain.objs.size()=1 2024-03-09T15:07:04.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Jn-aF8h5y5WuLtyqggRAl8pm8JJn09h_0 2024-03-09T15:07:04.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7495327668700354263', time=2024-03-09T16:55:15.975476+0000, chain.objs.size()=1 2024-03-09T15:07:04.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.XzGCizLCygwJz8onISQ-WRg1KfaFl0M_0 2024-03-09T15:07:04.896 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7729215121351573415', time=2024-03-09T16:55:16.020707+0000, chain.objs.size()=1 2024-03-09T15:07:04.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.t999beuoHqzYVzNrfa8vEwO5dbKDTJI_0 2024-03-09T15:07:04.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11306825339834742635', time=2024-03-09T16:55:16.065533+0000, chain.objs.size()=1 2024-03-09T15:07:04.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.iGtYtBdKpuP4DouhP3m6EASPWckZj-q_0 2024-03-09T15:07:04.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11153519893169150672', time=2024-03-09T16:55:16.088194+0000, chain.objs.size()=1 2024-03-09T15:07:04.897 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.894+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.w5rQkcBqa0lmK3Wh_gMt-gzKPXLjLWp_0 2024-03-09T15:07:04.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.898+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5853833148013169055', time=2024-03-09T16:55:16.093466+0000, chain.objs.size()=1 2024-03-09T15:07:04.899 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.898+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.OB7p4HLMb8F-XW2f5VmbN39reKDedqZ_0 2024-03-09T15:07:04.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f9333fff640 0 -- 172.21.15.99:0/3110485063 >> [v2:172.21.15.179:6824/1220611928,v1:172.21.15.179:6825/1220611928] conn(0x7f9334001720 msgr2=0x7f92040839a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-03-09T15:07:04.900 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9152435000869392532', time=2024-03-09T16:55:16.236850+0000, chain.objs.size()=1 2024-03-09T15:07:04.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.cOpcYcyzS9-Z2Mp_N-2fuSPQRgzLAFj_0 2024-03-09T15:07:04.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7214745881031422263', time=2024-03-09T16:55:16.267694+0000, chain.objs.size()=1 2024-03-09T15:07:04.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.pAoT3j72HYtH_bDgLUpbkwA_hxVVZ2u_0 2024-03-09T15:07:04.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17039582167485291796', time=2024-03-09T16:55:16.268599+0000, chain.objs.size()=1 2024-03-09T15:07:04.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.vgCCiD-UoaKoWfBta5krdqZa4zUc8B1_0 2024-03-09T15:07:04.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1288028743056938507', time=2024-03-09T16:55:16.304113+0000, chain.objs.size()=1 2024-03-09T15:07:04.901 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.kCZ61q1pMp17upU-5E7QSn-pb6ubwja_0 2024-03-09T15:07:04.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15109778815341255705', time=2024-03-09T16:55:16.309321+0000, chain.objs.size()=1 2024-03-09T15:07:04.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.zh7PfjjxoWLTQKabRwRZHoVVRpSyA5x_0 2024-03-09T15:07:04.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6776156825452313537', time=2024-03-09T16:55:16.320166+0000, chain.objs.size()=1 2024-03-09T15:07:04.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.QPAosKXZe8Nnsi8hYuF4cHh53tNICO7_0 2024-03-09T15:07:04.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12817015414263618656', time=2024-03-09T16:55:16.345074+0000, chain.objs.size()=1 2024-03-09T15:07:04.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.xTb5u4ra4JRyzwTl0wHVgm8IQTdpfHH_0 2024-03-09T15:07:04.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.676204513181976190', time=2024-03-09T16:55:16.534992+0000, chain.objs.size()=1 2024-03-09T15:07:04.902 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.pmMvnq5rRZA_pffKS_8zWDBPAy8K0zo_0 2024-03-09T15:07:04.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8749662846912790128', time=2024-03-09T16:55:16.543695+0000, chain.objs.size()=1 2024-03-09T15:07:04.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.wc2R6JxYgx0AzHVpSWCsDroO740vQ8q_0 2024-03-09T15:07:04.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9955236873393948779', time=2024-03-09T16:55:16.547486+0000, chain.objs.size()=1 2024-03-09T15:07:04.903 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.902+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.0O7q3Q7DcbyC2k8jhUcrOKikMJK8knm_0 2024-03-09T15:07:04.905 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11559049802782650146', time=2024-03-09T16:55:16.568802+0000, chain.objs.size()=1 2024-03-09T15:07:04.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.NnW6Sy72dgd5N2Ftvj-HWjiCcXHOrHn_0 2024-03-09T15:07:04.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9316572330298065633', time=2024-03-09T16:55:16.595714+0000, chain.objs.size()=1 2024-03-09T15:07:04.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qR7_-Qj-YnlVHPDrDwKxSB6efe47E2v_0 2024-03-09T15:07:04.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7315675206847932807', time=2024-03-09T16:55:16.602137+0000, chain.objs.size()=1 2024-03-09T15:07:04.906 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.A2iIRidBDDbhUFCORJINM3JgJrNTs7o_0 2024-03-09T15:07:04.907 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4348444923252478083', time=2024-03-09T16:55:16.728860+0000, chain.objs.size()=1 2024-03-09T15:07:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.7VlyhORCuYsnPM5EqkzgbubbJBoPUfQ_0 2024-03-09T15:07:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12873378442718962067', time=2024-03-09T16:55:16.734428+0000, chain.objs.size()=1 2024-03-09T15:07:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.PJnJKsM9xmyFkm9Ff6RFhQB98E6t1Vp_0 2024-03-09T15:07:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9261582426517473976', time=2024-03-09T16:55:16.797429+0000, chain.objs.size()=1 2024-03-09T15:07:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.0w99Uo7P6esSfoseDQwHH8RUGSigSl4_0 2024-03-09T15:07:04.908 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10294061194799793344', time=2024-03-09T16:55:16.847623+0000, chain.objs.size()=1 2024-03-09T15:07:04.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Z5RZR1lcJ-WSLrRMzP5-uPlyaA7WHgy_0 2024-03-09T15:07:04.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5893538784258728474', time=2024-03-09T16:55:22.256303+0000, chain.objs.size()=1 2024-03-09T15:07:04.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.262__shadow_.bG6TeUvNkSVXcLqN5JJ6vS3CGaykBV-_0 2024-03-09T15:07:04.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2889037840019006430', time=2024-03-09T16:55:26.878902+0000, chain.objs.size()=1 2024-03-09T15:07:04.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.267__shadow_.wHdXYacIu0bCHxcghCH2dkdxDSXapI__0 2024-03-09T15:07:04.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3095139022679728265', time=2024-03-09T16:55:27.779936+0000, chain.objs.size()=1 2024-03-09T15:07:04.909 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.268__shadow_.0w1EjJowdzjhBSRQzPG2Iw3K30CuleL_0 2024-03-09T15:07:04.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3055850568462187244', time=2024-03-09T16:55:37.294512+0000, chain.objs.size()=1 2024-03-09T15:07:04.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.906+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.278__shadow_.93WPubI4AFiyUC1bGl-bFAyHmW6Y2LN_0 2024-03-09T15:07:04.910 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16173535468158339015', time=2024-03-09T16:55:46.243797+0000, chain.objs.size()=1 2024-03-09T15:07:04.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.RzxDdwt7GMR7cEJNsSIP7aGoiboUagY_0 2024-03-09T15:07:04.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6163915750706903943', time=2024-03-09T16:55:47.840969+0000, chain.objs.size()=1 2024-03-09T15:07:04.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.etWlXiePld0ij44qgxX74D5lE3JTeq4_0 2024-03-09T15:07:04.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.910+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16432493311402025526', time=2024-03-09T16:55:47.888675+0000, chain.objs.size()=1 2024-03-09T15:07:04.911 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.910+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.r90Liwld7SESuKDXC_Zodbd-lSevsvC_0 2024-03-09T15:07:04.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13139725049036692736', time=2024-03-09T16:56:37.755817+0000, chain.objs.size()=1 2024-03-09T15:07:04.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.RIww_038QShwRU4EYIRVJjX6cYK-0lD_0 2024-03-09T15:07:04.912 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15735722010285370740', time=2024-03-09T16:56:37.833131+0000, chain.objs.size()=1 2024-03-09T15:07:04.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.WBqCoEa04tnQU7h6lblZ9R95icNm3ps_0 2024-03-09T15:07:04.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1349458006403770769', time=2024-03-09T16:56:37.854504+0000, chain.objs.size()=1 2024-03-09T15:07:04.913 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.M6cHY-q9ltXq3OryN6MBLs7pLBX9eei_0 2024-03-09T15:07:04.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17133360071977823742', time=2024-03-09T16:56:38.054092+0000, chain.objs.size()=1 2024-03-09T15:07:04.914 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.3pxDD5oUk6Ne54oYWE97P1WVzrwIDm2_0 2024-03-09T15:07:04.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12811176609641611278', time=2024-03-09T16:56:38.086889+0000, chain.objs.size()=1 2024-03-09T15:07:04.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.KjyvZcM0jOosUMSB3bPEE5umDRp9zWz_0 2024-03-09T15:07:04.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1389847834146189147', time=2024-03-09T16:56:38.112860+0000, chain.objs.size()=1 2024-03-09T15:07:04.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.jYUlveuPwVZdZiztdBCTpsVkRNspmyQ_0 2024-03-09T15:07:04.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5703456612790595068', time=2024-03-09T16:56:38.317312+0000, chain.objs.size()=1 2024-03-09T15:07:04.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0It6alQbS-p4fzRluJVnbzBH0nFKe-8_0 2024-03-09T15:07:04.916 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1664960672606132147', time=2024-03-09T16:56:38.335754+0000, chain.objs.size()=1 2024-03-09T15:07:04.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.U-37hP1JwQ3C9mNLYNqTklU88BraeoK_0 2024-03-09T15:07:04.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.215147828969602353', time=2024-03-09T16:56:38.340114+0000, chain.objs.size()=1 2024-03-09T15:07:04.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.8rDcPTk_YcmUANj_eSBTbo8Owt9ucRF_0 2024-03-09T15:07:04.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4933360003927015916', time=2024-03-09T16:56:38.530289+0000, chain.objs.size()=1 2024-03-09T15:07:04.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.vdjaORyXWlAlJW_vc2Nzid8FNNT8CqK_0 2024-03-09T15:07:04.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16169226791969185415', time=2024-03-09T16:56:38.594681+0000, chain.objs.size()=1 2024-03-09T15:07:04.917 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.914+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.gdlnnMF2dQBkaU_-xSya3ow3ckTVKfR_0 2024-03-09T15:07:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.918+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5940252612138036397', time=2024-03-09T16:56:38.603055+0000, chain.objs.size()=1 2024-03-09T15:07:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.918+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.eX2CGLdZ8Dc6AQ-ksgN_HnuqWU-S-sJ_0 2024-03-09T15:07:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.918+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14616050024874932706', time=2024-03-09T16:56:38.666982+0000, chain.objs.size()=1 2024-03-09T15:07:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.918+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.aaC3iFsmD44uK7hQiwSdMH3lo2uKBiy_0 2024-03-09T15:07:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.918+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.356550664178683326', time=2024-03-09T16:56:38.812081+0000, chain.objs.size()=1 2024-03-09T15:07:04.918 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.918+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.jdeI56EgIphEuBlrQAG3fRjwa7Tas4a_0 2024-03-09T15:07:04.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.918+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11832614752980993058', time=2024-03-09T16:56:38.854860+0000, chain.objs.size()=1 2024-03-09T15:07:04.919 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.918+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.xT5lID2iGxhi-n5XcOWU7LbjjQz4HC9_0 2024-03-09T15:07:04.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7486319838462161720', time=2024-03-09T16:56:38.894110+0000, chain.objs.size()=1 2024-03-09T15:07:04.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.aLGzETkcWOb76Wscjg4pUxXJX19rm1F_0 2024-03-09T15:07:04.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11281026761903618900', time=2024-03-09T16:56:39.047028+0000, chain.objs.size()=1 2024-03-09T15:07:04.921 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.rt11LXJBD8X-H0pOuIks-Pt7i8fhvfu_0 2024-03-09T15:07:04.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17560144820081174812', time=2024-03-09T16:56:39.059411+0000, chain.objs.size()=1 2024-03-09T15:07:04.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.LiemmSyaWnT9eaXSgD0DhClWQU1tLwP_0 2024-03-09T15:07:04.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7287719353041629374', time=2024-03-09T16:56:39.105759+0000, chain.objs.size()=1 2024-03-09T15:07:04.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.1M0O-lCJ8HlTRyRML1ku43uOphsU_u9_0 2024-03-09T15:07:04.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15462039480142225172', time=2024-03-09T16:56:39.123216+0000, chain.objs.size()=1 2024-03-09T15:07:04.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.IjnLoTJfOlGzYSBlExRaynST8PZqn5f_0 2024-03-09T15:07:04.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7431510674762195902', time=2024-03-09T16:56:39.175542+0000, chain.objs.size()=1 2024-03-09T15:07:04.922 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.rr8XlWgilOj2pjup-FQO19RgMHbvJKK_0 2024-03-09T15:07:04.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4471354158874339296', time=2024-03-09T16:56:39.363862+0000, chain.objs.size()=1 2024-03-09T15:07:04.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.QEcunBSP3kjgJkPCEo_3FL6kHryq3ti_0 2024-03-09T15:07:04.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1713861607289446003', time=2024-03-09T16:56:39.408663+0000, chain.objs.size()=1 2024-03-09T15:07:04.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.BygE52Xi-ZeDqz5mHTX7vyTvt70ka7F_0 2024-03-09T15:07:04.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3296516022173597830', time=2024-03-09T16:56:39.584796+0000, chain.objs.size()=1 2024-03-09T15:07:04.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.a97-1E3yquHeoSHCjCOsL7KhxIGQfO3_0 2024-03-09T15:07:04.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13577710755773512494', time=2024-03-09T16:56:39.624884+0000, chain.objs.size()=1 2024-03-09T15:07:04.923 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lR-1MRy_71VqAIxrVp8KXr7rcRMAs9e_0 2024-03-09T15:07:04.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2223546993995174633', time=2024-03-09T16:56:39.641158+0000, chain.objs.size()=1 2024-03-09T15:07:04.924 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.922+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.LI3CzUMvxAXKHHlL1r3iHrbJu5Jgzxa_0 2024-03-09T15:07:04.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17756359518398291024', time=2024-03-09T16:56:39.665608+0000, chain.objs.size()=1 2024-03-09T15:07:04.926 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.4Hx43NfuHyUT0t97u-zZ1qqZu835jF6_0 2024-03-09T15:07:04.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7645063935252817694', time=2024-03-09T16:57:01.534184+0000, chain.objs.size()=1 2024-03-09T15:07:04.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.AftAizZn5vWXJ-gFB8kMGoyb3Qfag-W_0 2024-03-09T15:07:04.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.459258914945546316', time=2024-03-09T16:57:01.566206+0000, chain.objs.size()=1 2024-03-09T15:07:04.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.MnWAp_hHJnK7-wq9bJjoB1kAq-2etVg_0 2024-03-09T15:07:04.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17443240682926416291', time=2024-03-09T16:57:01.592975+0000, chain.objs.size()=1 2024-03-09T15:07:04.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.vUu78hbRBf9W-WqgMfBdvVJuVpst9qN_0 2024-03-09T15:07:04.928 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13025190622796959191', time=2024-03-09T16:57:01.870451+0000, chain.objs.size()=1 2024-03-09T15:07:04.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.RH0BqgPjD4vRqBLSArP9ckBJpsi1_5z_0 2024-03-09T15:07:04.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10058309275812643785', time=2024-03-09T16:57:01.976316+0000, chain.objs.size()=1 2024-03-09T15:07:04.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.IK-baUSH__yA14KirmgLhJCC-wlkplR_0 2024-03-09T15:07:04.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6299971754320272567', time=2024-03-09T16:57:02.038337+0000, chain.objs.size()=1 2024-03-09T15:07:04.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Iimy55pasffg2Z1SdBgLXyQ1jCBuvBh_0 2024-03-09T15:07:04.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14875122873210378726', time=2024-03-09T16:57:02.076569+0000, chain.objs.size()=1 2024-03-09T15:07:04.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.YR8AAso1n1yKL_hMwpxXJZQFr1rRg_r_0 2024-03-09T15:07:04.929 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8721651301977239046', time=2024-03-09T16:57:02.101740+0000, chain.objs.size()=1 2024-03-09T15:07:04.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.qUyNV49c1m-KzwI5CCZfN6k3W4zgNan_0 2024-03-09T15:07:04.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14486985492456768722', time=2024-03-09T16:57:02.111217+0000, chain.objs.size()=1 2024-03-09T15:07:04.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.L8rrgABBT5fyojrGJwGWIRlnpQ9MixC_0 2024-03-09T15:07:04.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6498654437468143941', time=2024-03-09T16:57:02.252461+0000, chain.objs.size()=1 2024-03-09T15:07:04.930 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.926+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.OfTKbhqhiwk7U_n25zbgRY8J8fNgwZx_0 2024-03-09T15:07:04.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.930+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.528462645332817866', time=2024-03-09T16:57:02.338720+0000, chain.objs.size()=1 2024-03-09T15:07:04.931 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.930+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xI3KCEPiKym4ua5FVPk1u9jaVnPH0Yr_0 2024-03-09T15:07:04.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6864850507589545498', time=2024-03-09T16:57:02.353186+0000, chain.objs.size()=1 2024-03-09T15:07:04.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ZHxly1gfDTYJC7s2GHVNA4eh5Dh1pEp_0 2024-03-09T15:07:04.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11143908142853531857', time=2024-03-09T16:57:02.354074+0000, chain.objs.size()=1 2024-03-09T15:07:04.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.7CexPqTX86DDQFwCwFi5n1fem0un88a_0 2024-03-09T15:07:04.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16750763313260821613', time=2024-03-09T16:57:02.369504+0000, chain.objs.size()=1 2024-03-09T15:07:04.934 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.iW3mSrYgLt5-q-zerHIaksnQ571kVCu_0 2024-03-09T15:07:04.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5232776132932561539', time=2024-03-09T16:57:02.495962+0000, chain.objs.size()=1 2024-03-09T15:07:04.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xUtBW2-hemYTP0xQg_repyOt0Xffvb__0 2024-03-09T15:07:04.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2791041907478959273', time=2024-03-09T16:57:02.524325+0000, chain.objs.size()=1 2024-03-09T15:07:04.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.OO2s1LavAvPu1-zVZTvO1SJyDS5Ujgx_0 2024-03-09T15:07:04.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1412873087042114756', time=2024-03-09T16:57:02.562027+0000, chain.objs.size()=1 2024-03-09T15:07:04.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Ux-E9yO9yUT1Zw1olBc1SAbSVY8lIIQ_0 2024-03-09T15:07:04.935 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13845113367521584055', time=2024-03-09T16:57:02.570193+0000, chain.objs.size()=1 2024-03-09T15:07:04.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ug2PsAj_IrV5BMjoxlaQMp7W9KV7KmJ_0 2024-03-09T15:07:04.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14794503597354372916', time=2024-03-09T16:57:02.579251+0000, chain.objs.size()=1 2024-03-09T15:07:04.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ejJ6hzrbO550FfXmOnosYgGrtr6GJEr_0 2024-03-09T15:07:04.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13472247307022775151', time=2024-03-09T16:57:02.794084+0000, chain.objs.size()=1 2024-03-09T15:07:04.936 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.M8SRFjVSujua1br-sQMK1DZQ5Vkol72_0 2024-03-09T15:07:04.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6324210314907220864', time=2024-03-09T16:57:02.823179+0000, chain.objs.size()=1 2024-03-09T15:07:04.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.uIX8taryqro7pp6aRZqL2Oqj60Hvp9E_0 2024-03-09T15:07:04.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1506761446072946304', time=2024-03-09T16:57:02.859043+0000, chain.objs.size()=1 2024-03-09T15:07:04.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.GCtDTjXGh_ChwUQsVlQQPasG3_qYlmi_0 2024-03-09T15:07:04.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1665526687153062516', time=2024-03-09T16:57:02.867407+0000, chain.objs.size()=1 2024-03-09T15:07:04.937 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.934+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.La-d5lc9qpKD1r7xWRZeYsiEeCgjzAt_0 2024-03-09T15:07:04.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.938+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.564008923243238034', time=2024-03-09T16:57:02.969301+0000, chain.objs.size()=1 2024-03-09T15:07:04.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.938+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.v-MrU504poh28WLvElb0E2vjWwNX95K_0 2024-03-09T15:07:04.938 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.938+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15290800918622677343', time=2024-03-09T16:57:03.035028+0000, chain.objs.size()=1 2024-03-09T15:07:04.939 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.938+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.P5XiQ36VvsET1Yb36LxyjmTBUnJgZ7x_0 2024-03-09T15:07:04.942 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.942+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/48408 2024-03-09T15:07:04.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-03-09T15:07:04.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14397757437044280894', time=2024-03-09T16:57:03.263531+0000, chain.objs.size()=1 2024-03-09T15:07:04.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.rt2goMCZcZGX6wqhOwBUUycy85mFFzG_0 2024-03-09T15:07:04.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.291648699324090816', time=2024-03-09T16:57:03.302689+0000, chain.objs.size()=1 2024-03-09T15:07:04.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.c4QmmIi6dhZE06d9TaDEigCLTu05nYE_0 2024-03-09T15:07:04.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5494737199724941638', time=2024-03-09T16:57:03.330895+0000, chain.objs.size()=1 2024-03-09T15:07:04.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.u0w-EQr9dlkSlbmNl80AI2BKpYtpWsn_0 2024-03-09T15:07:04.945 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.306016121605687434', time=2024-03-09T16:57:03.339079+0000, chain.objs.size()=1 2024-03-09T15:07:04.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.zFwFnGrx32VeWcVKTXRU4iUhs1hyrHO_0 2024-03-09T15:07:04.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2255558346572208878', time=2024-03-09T16:57:03.340750+0000, chain.objs.size()=1 2024-03-09T15:07:04.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oaMmqC3vAAMwv2C7U6uINnCdtGjXuP0_0 2024-03-09T15:07:04.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.715023933973027516', time=2024-03-09T16:57:03.362460+0000, chain.objs.size()=1 2024-03-09T15:07:04.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.171eDfaau_HGSLy_5rjH_UcDKULjlP4_0 2024-03-09T15:07:04.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11151432673053731934', time=2024-03-09T16:57:03.374757+0000, chain.objs.size()=1 2024-03-09T15:07:04.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Ps3S1Gqlgunak9a3NiEH9kAWVtbrJyl_0 2024-03-09T15:07:04.946 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7908501125136676333', time=2024-03-09T16:57:43.669285+0000, chain.objs.size()=1 2024-03-09T15:07:04.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.365__shadow_.dL67_UTxY9t_vQkfITLJqhwf-LWkU56_0 2024-03-09T15:07:04.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3610266854143838163', time=2024-03-09T16:57:50.135068+0000, chain.objs.size()=1 2024-03-09T15:07:04.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.371__shadow_.X0uDxfYIrBu_4eQM6NQ6SV2HHpevvuI_0 2024-03-09T15:07:04.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10375568129230594857', time=2024-03-09T16:59:08.334357+0000, chain.objs.size()=1 2024-03-09T15:07:04.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.450__shadow_.LpItiyRmAotsxMYG1cGh6CClO4Ex3S7_0 2024-03-09T15:07:04.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.875742601595339660', time=2024-03-09T16:59:15.896685+0000, chain.objs.size()=1 2024-03-09T15:07:04.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.456__shadow_.7QRRxW-Ovv_zrgwPIj3sRC6uR9FNonc_0 2024-03-09T15:07:04.947 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15113519477660557193', time=2024-03-09T16:59:59.307486+0000, chain.objs.size()=1 2024-03-09T15:07:04.948 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.946+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.509__shadow_._L_80SlvNAUCN_k0JT8e-dkwqhph1Hc_0 2024-03-09T15:07:04.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.397564654337797954', time=2024-03-09T17:00:30.814224+0000, chain.objs.size()=2 2024-03-09T15:07:04.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.517__multipart_mymultipart.2~dU59HFUSHAFxvs3caxq6RPbQUm69Ig9.1 2024-03-09T15:07:04.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.517__multipart_mymultipart.2~dU59HFUSHAFxvs3caxq6RPbQUm69Ig9.2 2024-03-09T15:07:04.949 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12522814700563547241', time=2024-03-09T17:00:34.694832+0000, chain.objs.size()=3 2024-03-09T15:07:04.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.519__multipart_mymultipart.2~bL3OBx3ZiyMvNnxqyIZFIjwu220E7HE.1 2024-03-09T15:07:04.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.519__multipart_mymultipart.2~bL3OBx3ZiyMvNnxqyIZFIjwu220E7HE.2 2024-03-09T15:07:04.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.519__multipart_mymultipart.2~bL3OBx3ZiyMvNnxqyIZFIjwu220E7HE.3 2024-03-09T15:07:04.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10583943364546129624', time=2024-03-09T17:01:55.422893+0000, chain.objs.size()=1 2024-03-09T15:07:04.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:qAyS2Adhy.e-GRQZiEuw5H-8nCpw1SD_.R3_gKgggGMs29MfkmBSWh1QKNY-yrSx_0 2024-03-09T15:07:04.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12730773277841174142', time=2024-03-09T17:01:57.965365+0000, chain.objs.size()=1 2024-03-09T15:07:04.950 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:wVZDvNVZrd43xOIa.tWi5yml1udRRoK_.PvvBZxPOZ4Ciz2yUuC-WxJSQyoOIeMg_0 2024-03-09T15:07:04.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15158366861356034302', time=2024-03-09T17:01:59.330373+0000, chain.objs.size()=1 2024-03-09T15:07:04.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:jXMXsfTbR2hKWxCcXxgmYYuSmkg4H3o_.grqom3ZRvmdnBx6-OUraP1Wse9koRfR_0 2024-03-09T15:07:04.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10847711918044887069', time=2024-03-09T17:02:23.203357+0000, chain.objs.size()=1 2024-03-09T15:07:04.951 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:1-rpCUCTrcNOcF8VyRv0jxHIUTcvqhl_.TgozijGp6Qk3MReaI727SToBJVkwAB7_0 2024-03-09T15:07:04.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4180549687075882711', time=2024-03-09T17:02:34.842046+0000, chain.objs.size()=4 2024-03-09T15:07:04.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.571__multipart_testobj.2~JeXwtJPsj-B56nuzV9robW74Uu57ioI.1 2024-03-09T15:07:04.952 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.950+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.571__multipart_testobj.2~JeXwtJPsj-B56nuzV9robW74Uu57ioI.2 2024-03-09T15:07:04.953 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.954+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.571__multipart_testobj.2~JeXwtJPsj-B56nuzV9robW74Uu57ioI.3 2024-03-09T15:07:04.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.954+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.571__multipart_testobj.2~JeXwtJPsj-B56nuzV9robW74Uu57ioI.4 2024-03-09T15:07:04.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.954+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7757732333923825113', time=2024-03-09T17:02:46.469346+0000, chain.objs.size()=1 2024-03-09T15:07:04.954 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.954+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.580__shadow:ZENwNaW0d4ZmYgjLJ3oNj.73a8PxFt8_.jarWetUy0btVWRvuL6-8JkcrOFmYOuN_0 2024-03-09T15:07:04.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.954+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15944517659617122476', time=2024-03-09T17:03:43.966559+0000, chain.objs.size()=1 2024-03-09T15:07:04.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.954+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.628__shadow_.WcT2m9btzrCf8iPGSnsL4yiLc4H0UAT_0 2024-03-09T15:07:04.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.954+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1789259480608697835', time=2024-03-09T17:04:01.585378+0000, chain.objs.size()=2 2024-03-09T15:07:04.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.954+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.645__shadow_.aWhUKH9vFG3mJWDTz9aIhisw6Ht5Skg_0 2024-03-09T15:07:04.955 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.954+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.645__shadow_.aWhUKH9vFG3mJWDTz9aIhisw6Ht5Skg_1 2024-03-09T15:07:04.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11900337837640848856', time=2024-03-09T17:04:07.522222+0000, chain.objs.size()=6 2024-03-09T15:07:04.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.651__multipart_foo.2~T_qph6gnWF42m_ocAzR0Dqbqmsnv4Wk.1 2024-03-09T15:07:04.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.651__multipart_foo.2~T_qph6gnWF42m_ocAzR0Dqbqmsnv4Wk.2 2024-03-09T15:07:04.956 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.651__multipart_foo.2~T_qph6gnWF42m_ocAzR0Dqbqmsnv4Wk.3 2024-03-09T15:07:04.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.651__multipart_foo.2~T_qph6gnWF42m_ocAzR0Dqbqmsnv4Wk.4 2024-03-09T15:07:04.957 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.651__multipart_foo.2~T_qph6gnWF42m_ocAzR0Dqbqmsnv4Wk.5 2024-03-09T15:07:04.958 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.651__multipart_foo.2~T_qph6gnWF42m_ocAzR0Dqbqmsnv4Wk.6 2024-03-09T15:07:04.960 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2540093719082856863', time=2024-03-09T17:06:04.124627+0000, chain.objs.size()=1 2024-03-09T15:07:04.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.739__shadow_.BZES1nd92ndrJ9tTnJ8Nnm1jpd0MwnT_0 2024-03-09T15:07:04.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7756727889979377558', time=2024-03-09T17:06:19.278766+0000, chain.objs.size()=1 2024-03-09T15:07:04.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.743__shadow_.tmI4OhBnRUBheoy01WCRKPorNst0nh1_0 2024-03-09T15:07:04.961 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7466769645029493753', time=2024-03-09T17:06:21.779725+0000, chain.objs.size()=1 2024-03-09T15:07:04.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.745__shadow_.ukAnhJ2TewH4i775yzuS8touE9182p5_0 2024-03-09T15:07:04.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.958+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15484692816024663911', time=2024-03-09T17:06:53.396930+0000, chain.objs.size()=5 2024-03-09T15:07:04.962 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.958+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.760__shadow_.lwyyKQAfCYabWOCc6sPhGwJ2UldT_5G_0 2024-03-09T15:07:04.963 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.962+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.760__shadow_.lwyyKQAfCYabWOCc6sPhGwJ2UldT_5G_1 2024-03-09T15:07:04.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.962+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.760__shadow_.lwyyKQAfCYabWOCc6sPhGwJ2UldT_5G_2 2024-03-09T15:07:04.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.962+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.760__shadow_.lwyyKQAfCYabWOCc6sPhGwJ2UldT_5G_3 2024-03-09T15:07:04.964 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.962+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.760__shadow_.lwyyKQAfCYabWOCc6sPhGwJ2UldT_5G_4 2024-03-09T15:07:04.967 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.966+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:04.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-03-09T15:07:04.971 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.970+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-09T15:07:04.972 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:04.973 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:04.974 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46996' 2024-03-09T15:07:04.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5488864722295814414', time=2024-03-09T16:51:41.961958+0000, chain.objs.size()=1 2024-03-09T15:07:04.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.137__shadow_.39uXjfOIeMyVLj6GNjBtgHp1GoLWGby_0 2024-03-09T15:07:04.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8962373999460724800', time=2024-03-09T16:51:48.905721+0000, chain.objs.size()=1 2024-03-09T15:07:04.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.152__shadow_.141Sy0LcvRUpJayh4CepexNuLAyFnF4_0 2024-03-09T15:07:04.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10192663973732050001', time=2024-03-09T16:51:53.190972+0000, chain.objs.size()=3 2024-03-09T15:07:04.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__multipart_foo-STANDARD.2~uRbzirMXhf9AVxRp0ZtH52g_J1iq0wW.1 2024-03-09T15:07:04.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__multipart_foo-STANDARD.2~uRbzirMXhf9AVxRp0ZtH52g_J1iq0wW.2 2024-03-09T15:07:04.975 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__multipart_foo-STANDARD.2~uRbzirMXhf9AVxRp0ZtH52g_J1iq0wW.3 2024-03-09T15:07:04.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~X9I-SJv1T6FIkKaXHEZw35nYMMh0wa6', time=2024-03-09T16:52:44.622176+0000, chain.objs.size()=1 2024-03-09T15:07:04.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.196__multipart_mymultipart.2~X9I-SJv1T6FIkKaXHEZw35nYMMh0wa6.1 2024-03-09T15:07:04.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11337686050931473185', time=2024-03-09T16:54:22.771519+0000, chain.objs.size()=1 2024-03-09T15:07:04.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.225__shadow_.o2WDWQRSplxPuldvG0XEJKVIEg40IEF_0 2024-03-09T15:07:04.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7271515175769981473', time=2024-03-09T16:54:38.753888+0000, chain.objs.size()=1 2024-03-09T15:07:04.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.240__shadow_.YQ7NwOm98uED8Rtih_YOxbfWBKUeWDI_0 2024-03-09T15:07:04.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17965045037464311561', time=2024-03-09T16:54:40.604793+0000, chain.objs.size()=1 2024-03-09T15:07:04.976 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.242__shadow_.dBkZr4l2CbBlOSOF_Ns9RyyjU7WYypG_0 2024-03-09T15:07:04.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15780601625815163732', time=2024-03-09T16:55:14.975485+0000, chain.objs.size()=1 2024-03-09T15:07:04.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.w80pXmyItO2rrPw875jN10ev7KmW-4P_0 2024-03-09T15:07:04.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14824851141742837780', time=2024-03-09T16:55:14.982064+0000, chain.objs.size()=1 2024-03-09T15:07:04.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.R-lIsG_WI-LzZ6xIiSkzkIaQOH8NNZ4_0 2024-03-09T15:07:04.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15866324576085555995', time=2024-03-09T16:55:14.993942+0000, chain.objs.size()=1 2024-03-09T15:07:04.977 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.974+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.m2zFmB2lX4xPdAWHkS24yc2atQuL3E2_0 2024-03-09T15:07:04.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9842671193964609256', time=2024-03-09T16:55:15.003404+0000, chain.objs.size()=1 2024-03-09T15:07:04.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.8BEcoQ8TqufOfDsLomHLqmJU1-DdI6g_0 2024-03-09T15:07:04.978 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16018863996454509722', time=2024-03-09T16:55:15.007733+0000, chain.objs.size()=1 2024-03-09T15:07:04.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ufa1E4tVwT76Ol86riXC7zgmTT2eq3s_0 2024-03-09T15:07:04.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.91736872816873138', time=2024-03-09T16:55:15.018595+0000, chain.objs.size()=1 2024-03-09T15:07:04.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.57i_8gRWc2V9UwGc-z6UX-il9jgylfI_0 2024-03-09T15:07:04.979 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.216186897063836821', time=2024-03-09T16:55:15.271838+0000, chain.objs.size()=1 2024-03-09T15:07:04.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.dTeMlJHaOU6J2Z-D1YEEEKdZjlJNWMj_0 2024-03-09T15:07:04.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16109852491133467378', time=2024-03-09T16:55:15.281953+0000, chain.objs.size()=1 2024-03-09T15:07:04.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.2EsJqStMmS2yp-Otg-Jp-RpWw2BDy0p_0 2024-03-09T15:07:04.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.978+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11473272615240800109', time=2024-03-09T16:55:15.284277+0000, chain.objs.size()=1 2024-03-09T15:07:04.980 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.978+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.NcVfgtjYVkVhWnS9eE5MvX87J4baNUD_0 2024-03-09T15:07:04.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12326399004794015235', time=2024-03-09T16:55:15.452282+0000, chain.objs.size()=1 2024-03-09T15:07:04.984 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.IJJuCXOBibS3TN1RXYtVNvB7IOYRHhO_0 2024-03-09T15:07:04.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.407240735177003643', time=2024-03-09T16:55:15.504485+0000, chain.objs.size()=1 2024-03-09T15:07:04.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.M6usbYUzxnv0CS29IcaH0jAYwebpY70_0 2024-03-09T15:07:04.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4182975954562837895', time=2024-03-09T16:55:15.517836+0000, chain.objs.size()=1 2024-03-09T15:07:04.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.QpRTDVSWG3qgqRPzM09miOcjInio5mX_0 2024-03-09T15:07:04.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2541326384342946087', time=2024-03-09T16:55:15.531384+0000, chain.objs.size()=1 2024-03-09T15:07:04.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.UmZXMkKCCr7oMHQcnv6Zs5BhpDD_TL3_0 2024-03-09T15:07:04.985 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9404169322608891424', time=2024-03-09T16:55:15.554264+0000, chain.objs.size()=1 2024-03-09T15:07:04.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.FeikX9rJ5-SVqhz1FLYBLuPJVlw5iza_0 2024-03-09T15:07:04.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.497249065551635362', time=2024-03-09T16:55:15.715387+0000, chain.objs.size()=1 2024-03-09T15:07:04.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.fLtnDvfAFaRjScvRWKiBjaoydZdgVkU_0 2024-03-09T15:07:04.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.741068100055956331', time=2024-03-09T16:55:15.782209+0000, chain.objs.size()=1 2024-03-09T15:07:04.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.3yq_ok_idZWkg4kMvbjWXlSspegq0gy_0 2024-03-09T15:07:04.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14940771429482493016', time=2024-03-09T16:55:15.830648+0000, chain.objs.size()=1 2024-03-09T15:07:04.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.m7uB_MdyCl0k2RWviRdTnBBIob1SEzG_0 2024-03-09T15:07:04.986 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3383033204011594837', time=2024-03-09T16:55:15.942376+0000, chain.objs.size()=1 2024-03-09T15:07:04.987 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.986+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.FOvT39hjs1gfFEd4G-u_VMMdQT6jYTz_0 2024-03-09T15:07:04.988 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17419776461610376599', time=2024-03-09T16:55:16.010363+0000, chain.objs.size()=1 2024-03-09T15:07:04.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.IOmGrRvxqA99W0MYJQA5kBiFkfm5CFv_0 2024-03-09T15:07:04.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2724699455155422111', time=2024-03-09T16:55:16.048367+0000, chain.objs.size()=1 2024-03-09T15:07:04.989 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.lTX1IvIRQPJO_7NAxeSwtlxjm76ssPS_0 2024-03-09T15:07:04.990 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7941041340502787241', time=2024-03-09T16:55:16.220356+0000, chain.objs.size()=1 2024-03-09T15:07:04.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.yH2i-NV82IJaYG5NXv1_VruUSS5Wary_0 2024-03-09T15:07:04.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13654606332416295063', time=2024-03-09T16:55:16.316018+0000, chain.objs.size()=1 2024-03-09T15:07:04.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ZB4Z3iSfyQR7Kr1gfzmFj4W4wSQABZg_0 2024-03-09T15:07:04.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7531645105433478531', time=2024-03-09T16:55:16.349349+0000, chain.objs.size()=1 2024-03-09T15:07:04.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.FLGtOI0F8AyME3dk-ekcbIAlO8RhODJ_0 2024-03-09T15:07:04.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18145356232195721661', time=2024-03-09T16:55:16.501281+0000, chain.objs.size()=1 2024-03-09T15:07:04.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.TwR0uB47OzEXxJZRhNURyHHUYmp9XZA_0 2024-03-09T15:07:04.991 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2839681547192138001', time=2024-03-09T16:55:16.534067+0000, chain.objs.size()=1 2024-03-09T15:07:04.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.iK8HC0dJkJiZgA6wrhmxWLSYQdwlM_F_0 2024-03-09T15:07:04.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8277060618291759676', time=2024-03-09T16:55:16.775670+0000, chain.objs.size()=1 2024-03-09T15:07:04.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ZpmnQ4SiVWqADU3Ne7g05k2O4gFqPjt_0 2024-03-09T15:07:04.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15017032428331382285', time=2024-03-09T16:55:16.782753+0000, chain.objs.size()=1 2024-03-09T15:07:04.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.gjNmmkczFQCthfBtF_vZtUTTnhTdhWv_0 2024-03-09T15:07:04.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11188404105279862334', time=2024-03-09T16:55:16.815452+0000, chain.objs.size()=1 2024-03-09T15:07:04.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.DXVahgm-A5OgWlgPTKWZrBPlx-I-hcl_0 2024-03-09T15:07:04.992 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8748614168754011679', time=2024-03-09T16:55:16.830200+0000, chain.objs.size()=1 2024-03-09T15:07:04.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.990+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.cduXuXjTaiHyCUnmkob2YzWThNw-Nl-_0 2024-03-09T15:07:04.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.994+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5551600411100811897', time=2024-03-09T16:55:30.667537+0000, chain.objs.size()=1 2024-03-09T15:07:04.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.994+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.271__shadow_.gGNKeCat8zim_qKtiKbodkaCj41AM_r_0 2024-03-09T15:07:04.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.994+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9023866633398424639', time=2024-03-09T16:55:40.264094+0000, chain.objs.size()=1 2024-03-09T15:07:04.993 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.994+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.281__shadow_.jvc56U5OOPhBlZL7bWdCxzMzcoOXz5G_0 2024-03-09T15:07:04.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.994+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12753944131267813151', time=2024-03-09T16:55:43.100145+0000, chain.objs.size()=1 2024-03-09T15:07:04.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.994+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.284__shadow_.49Fw-ZeRlq9rQ-_S-EzzkUVbtyktYS1_0 2024-03-09T15:07:04.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.994+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5403189678465527675', time=2024-03-09T16:55:46.240990+0000, chain.objs.size()=1 2024-03-09T15:07:04.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.-DXCHkiofyTFEjTOKuBIMK8Ss6XcQzB_0 2024-03-09T15:07:04.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10632408569239995715', time=2024-03-09T16:55:47.843121+0000, chain.objs.size()=1 2024-03-09T15:07:04.996 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.YAkhPhGbqE6P3RUwNLojE6I5t7EFULB_0 2024-03-09T15:07:04.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15179833643108110633', time=2024-03-09T16:55:51.563111+0000, chain.objs.size()=1 2024-03-09T15:07:04.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.291__shadow_.QIc5YxBYMWCrRWY6ma_bW75CxblIEim_0 2024-03-09T15:07:04.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18259522767985334517', time=2024-03-09T16:56:37.697557+0000, chain.objs.size()=1 2024-03-09T15:07:04.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.U-lunik680CjHBTJ7WQtXpE-rf8rJ6E_0 2024-03-09T15:07:04.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17966981734977961817', time=2024-03-09T16:56:37.712316+0000, chain.objs.size()=1 2024-03-09T15:07:04.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.pTXeVhlSgKkJZ5FmXsLWNBvYBWJOwBe_0 2024-03-09T15:07:04.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1715437348631921501', time=2024-03-09T16:56:37.735501+0000, chain.objs.size()=1 2024-03-09T15:07:04.997 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kIkUyMS0Sa4TDO44-IU3QrgNZpp8u0__0 2024-03-09T15:07:04.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2997078267838490497', time=2024-03-09T16:56:37.812964+0000, chain.objs.size()=1 2024-03-09T15:07:04.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.HIBEE9Jakf-5gYypMglIPICyGVfQRpX_0 2024-03-09T15:07:04.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10160147464623439760', time=2024-03-09T16:56:37.850136+0000, chain.objs.size()=1 2024-03-09T15:07:04.998 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.H4UIBbIg9axnfcrpZEGKmCDbl-XoAN5_0 2024-03-09T15:07:04.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17879020344052735109', time=2024-03-09T16:56:37.869019+0000, chain.objs.size()=1 2024-03-09T15:07:04.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.B_VzJN9cLtieZY0cCrFpVv-wc9Xc5iE_0 2024-03-09T15:07:04.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10293338786384855991', time=2024-03-09T16:56:37.870236+0000, chain.objs.size()=1 2024-03-09T15:07:04.999 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.DenlWCIF1MyuJzJIrY2laJchNNYc-YV_0 2024-03-09T15:07:05.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1299322952602561008', time=2024-03-09T16:56:37.872067+0000, chain.objs.size()=1 2024-03-09T15:07:05.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.QLDunQM-eJvDE-rlyJZrdqUqnSEK127_0 2024-03-09T15:07:05.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.654538941607949749', time=2024-03-09T16:56:37.969536+0000, chain.objs.size()=1 2024-03-09T15:07:05.000 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:04.998+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.vdeRo3HytmPtPXa3XmRr9xwgx9F-FE9_0 2024-03-09T15:07:05.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5862213536601473617', time=2024-03-09T16:56:37.971186+0000, chain.objs.size()=1 2024-03-09T15:07:05.001 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.d3_eZbQ71h6-rijoW8Sz51BXdZMwI38_0 2024-03-09T15:07:05.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17664968092504321078', time=2024-03-09T16:56:37.996396+0000, chain.objs.size()=1 2024-03-09T15:07:05.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.8krufqOHCSuMyJKR3YDiBspNbon4Ftc_0 2024-03-09T15:07:05.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13284309326709578120', time=2024-03-09T16:56:38.004688+0000, chain.objs.size()=1 2024-03-09T15:07:05.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-eeeUeuQvLp2s-UHv9QKf5PLa3BqU1U_0 2024-03-09T15:07:05.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8441993139220706399', time=2024-03-09T16:56:38.090869+0000, chain.objs.size()=1 2024-03-09T15:07:05.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.vcqUxB0x4LAxwqGF0tfKZ7kIhyjvgBG_0 2024-03-09T15:07:05.002 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11066919255168549179', time=2024-03-09T16:56:38.096019+0000, chain.objs.size()=1 2024-03-09T15:07:05.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kYKBKtsbktbBNL7zhWW0XhjRw3QtqHJ_0 2024-03-09T15:07:05.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2872729161080314643', time=2024-03-09T16:56:38.120268+0000, chain.objs.size()=1 2024-03-09T15:07:05.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.MetvF6nWBjumxR6mU7u58dX0e2jqKXw_0 2024-03-09T15:07:05.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8673583440702223345', time=2024-03-09T16:56:38.123582+0000, chain.objs.size()=1 2024-03-09T15:07:05.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lBfBFgwrFdN5akHE277170DqBukWRcW_0 2024-03-09T15:07:05.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17088521039911608350', time=2024-03-09T16:56:38.229941+0000, chain.objs.size()=1 2024-03-09T15:07:05.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.pcZY5qMmAq2VpgukNmLIrlEl52_PmGR_0 2024-03-09T15:07:05.003 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6888602122448742433', time=2024-03-09T16:56:38.300220+0000, chain.objs.size()=1 2024-03-09T15:07:05.004 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.002+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Pd3-wFB9718Vb5slVi4DFRY6wRQDq5d_0 2024-03-09T15:07:05.006 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9074385945898224661', time=2024-03-09T16:56:38.342234+0000, chain.objs.size()=1 2024-03-09T15:07:05.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.1fiIoCZM3iYt6apOhjhRmEI0zq-m1AU_0 2024-03-09T15:07:05.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13087287277744606593', time=2024-03-09T16:56:38.362698+0000, chain.objs.size()=1 2024-03-09T15:07:05.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.lAPAB8c1t9tHVfQSarGb3qcYfQ9Ilwv_0 2024-03-09T15:07:05.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.476029742424258674', time=2024-03-09T16:56:38.394354+0000, chain.objs.size()=1 2024-03-09T15:07:05.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.PjIwYd3fr11KDU77WX7_tyt2JcC8lhM_0 2024-03-09T15:07:05.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9680497021402684631', time=2024-03-09T16:56:38.497008+0000, chain.objs.size()=1 2024-03-09T15:07:05.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0wL2B9JJYT4ImMmNc-p-rCtG4yppURQ_0 2024-03-09T15:07:05.007 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12359556529902893676', time=2024-03-09T16:56:38.538748+0000, chain.objs.size()=1 2024-03-09T15:07:05.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.x-cfuRHlVPkySkC-Eivvct7kliRiy5m_0 2024-03-09T15:07:05.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16544415307635534223', time=2024-03-09T16:56:38.557687+0000, chain.objs.size()=1 2024-03-09T15:07:05.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.WiuKhdpJYouUR8AWU45l30Y1CMdNpz5_0 2024-03-09T15:07:05.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9170783087973417465', time=2024-03-09T16:56:38.640091+0000, chain.objs.size()=1 2024-03-09T15:07:05.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.cDellYL12Ec-DFu78imBe6HNqrO8ymX_0 2024-03-09T15:07:05.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7661978172811798198', time=2024-03-09T16:56:38.652073+0000, chain.objs.size()=1 2024-03-09T15:07:05.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.bjL8H9o-rqtUOuEjygjPk7PBu2Xg4JP_0 2024-03-09T15:07:05.008 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16435182529581948295', time=2024-03-09T16:56:38.812684+0000, chain.objs.size()=1 2024-03-09T15:07:05.009 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.006+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.F_4etNoPVWVnDda89Tvz4jFq3dmGf7o_0 2024-03-09T15:07:05.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9511088368641760727', time=2024-03-09T16:56:38.827359+0000, chain.objs.size()=1 2024-03-09T15:07:05.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Y_Id-gDnFMIk1Q4wuK5Zc6IndFPQeJa_0 2024-03-09T15:07:05.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12983461946634536198', time=2024-03-09T16:56:38.831911+0000, chain.objs.size()=1 2024-03-09T15:07:05.010 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Hdc1HCfIEEqMaQDyojoAiONHySqJu3i_0 2024-03-09T15:07:05.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6230508498503239161', time=2024-03-09T16:56:38.868463+0000, chain.objs.size()=1 2024-03-09T15:07:05.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.U6POGOWgx3rFr0tj-YwBGRdH3qtoGgV_0 2024-03-09T15:07:05.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15568784975925968474', time=2024-03-09T16:56:39.065539+0000, chain.objs.size()=1 2024-03-09T15:07:05.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.NLBBEN_6g9qrPc1khQswFHe_VmAa3rh_0 2024-03-09T15:07:05.011 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18264670897806615329', time=2024-03-09T16:56:39.102687+0000, chain.objs.size()=1 2024-03-09T15:07:05.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.xbMsZ4NcFkOfE5uMZ4Vmf0grX25aecR_0 2024-03-09T15:07:05.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14458333988091189122', time=2024-03-09T16:56:39.107705+0000, chain.objs.size()=1 2024-03-09T15:07:05.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.F7QFxnYYSMswPQh9wU13MDIIeY5xL_x_0 2024-03-09T15:07:05.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17907183410177765318', time=2024-03-09T16:56:39.127833+0000, chain.objs.size()=1 2024-03-09T15:07:05.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.uePyRhqUrz2BXkKlATNCT-vE29VOSEm_0 2024-03-09T15:07:05.012 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16841672449208022301', time=2024-03-09T16:56:39.342086+0000, chain.objs.size()=1 2024-03-09T15:07:05.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.yDCDPtGYAvT0T3JSSAULImSnuV99CYv_0 2024-03-09T15:07:05.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5979842057871586251', time=2024-03-09T16:56:39.413824+0000, chain.objs.size()=1 2024-03-09T15:07:05.013 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.010+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.U2DXUZLlsJOw8JVXHz6qbXLWAkZ2r77_0 2024-03-09T15:07:05.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10351917369582672614', time=2024-03-09T16:56:39.559406+0000, chain.objs.size()=1 2024-03-09T15:07:05.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_._TwO2SsmVOCrf9-QjsKJppD3BFcmrHu_0 2024-03-09T15:07:05.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2724972200597972635', time=2024-03-09T16:56:39.580457+0000, chain.objs.size()=1 2024-03-09T15:07:05.016 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.oer9N_Vgb91UiYefqAuV2g2urG8WUC7_0 2024-03-09T15:07:05.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1574303992517202039', time=2024-03-09T16:57:01.426354+0000, chain.objs.size()=1 2024-03-09T15:07:05.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.P2nbB5g5kHDM2-hIei26z1hbxwh5epl_0 2024-03-09T15:07:05.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8464885816176149247', time=2024-03-09T16:57:01.465735+0000, chain.objs.size()=1 2024-03-09T15:07:05.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.54gq6DfiydQyh3l7C24NWYBxBtHnW0M_0 2024-03-09T15:07:05.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10160121054662851960', time=2024-03-09T16:57:01.481537+0000, chain.objs.size()=1 2024-03-09T15:07:05.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.2ucFw44ftdwwH8cypdNOgTcZP43y2sG_0 2024-03-09T15:07:05.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16627721164540906518', time=2024-03-09T16:57:01.525673+0000, chain.objs.size()=1 2024-03-09T15:07:05.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.hRVv2RlkG7mo-KSyGJN8maQDVzze6JC_0 2024-03-09T15:07:05.017 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2881703840354014225', time=2024-03-09T16:57:01.594958+0000, chain.objs.size()=1 2024-03-09T15:07:05.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.HKVmBQJ9CiY4Bb-CzdeLBlq8pxuwBr-_0 2024-03-09T15:07:05.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16589506419747440920', time=2024-03-09T16:57:01.759250+0000, chain.objs.size()=1 2024-03-09T15:07:05.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.QV13iMJBy9NvQDdYGjl-uoJH-4mNsSk_0 2024-03-09T15:07:05.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10500428873676730667', time=2024-03-09T16:57:01.811111+0000, chain.objs.size()=1 2024-03-09T15:07:05.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.qiY_AaIkAGYrHKaDS6zlThOMQ9jK8Nu_0 2024-03-09T15:07:05.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8313463289317863514', time=2024-03-09T16:57:01.852722+0000, chain.objs.size()=1 2024-03-09T15:07:05.018 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ENkL6BplybJtAyfHsvQT4FlFMBLR5Nq_0 2024-03-09T15:07:05.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9800230748104509878', time=2024-03-09T16:57:02.012384+0000, chain.objs.size()=1 2024-03-09T15:07:05.019 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.018+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.5NwOlFXYOBik7Ep-o7CRvYAGdBsg5pa_0 2024-03-09T15:07:05.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1495893182504690894', time=2024-03-09T16:57:02.013205+0000, chain.objs.size()=1 2024-03-09T15:07:05.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.N6XstDUcB55YmmIG9S7Gw9SG4-RD4ak_0 2024-03-09T15:07:05.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12693744090737860760', time=2024-03-09T16:57:02.019684+0000, chain.objs.size()=1 2024-03-09T15:07:05.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Jmam7bb3KiEcgE306RnvscjBiYDVNtm_0 2024-03-09T15:07:05.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6432951579499575093', time=2024-03-09T16:57:02.028734+0000, chain.objs.size()=1 2024-03-09T15:07:05.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.jbuxvdUh4CVXY685UWN_994r9uWB7Oa_0 2024-03-09T15:07:05.024 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13223553863104929556', time=2024-03-09T16:57:02.074829+0000, chain.objs.size()=1 2024-03-09T15:07:05.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.45Nj9mmz8aGCH4od_OAG0ve0QiPLdMV_0 2024-03-09T15:07:05.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15118627346143328355', time=2024-03-09T16:57:02.076165+0000, chain.objs.size()=1 2024-03-09T15:07:05.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.u7tqKKPhTmVwEBvP1QvZoSRslcUF16j_0 2024-03-09T15:07:05.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16334706382196066141', time=2024-03-09T16:57:02.108659+0000, chain.objs.size()=1 2024-03-09T15:07:05.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.JWJLzskBZFJsP4vJibxwpab_jIOyWrJ_0 2024-03-09T15:07:05.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17284573011381881681', time=2024-03-09T16:57:02.220154+0000, chain.objs.size()=1 2024-03-09T15:07:05.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.yiD51HrvUo4GEasFT31FnG64Wq6ldRA_0 2024-03-09T15:07:05.025 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17434192758854766238', time=2024-03-09T16:57:02.241981+0000, chain.objs.size()=1 2024-03-09T15:07:05.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.SQjeskmHQGDuAPjQnQ5DSHtfZClsWo2_0 2024-03-09T15:07:05.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17610206813769473060', time=2024-03-09T16:57:02.253732+0000, chain.objs.size()=1 2024-03-09T15:07:05.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oixcPmEWMD70bWWAjoe7z1aDJREjpeC_0 2024-03-09T15:07:05.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4876188353503549014', time=2024-03-09T16:57:02.265187+0000, chain.objs.size()=1 2024-03-09T15:07:05.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.fd8_yoRYHK4pQl53TNfiD11b0Kjt6de_0 2024-03-09T15:07:05.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2653467223757635008', time=2024-03-09T16:57:02.327505+0000, chain.objs.size()=1 2024-03-09T15:07:05.026 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.022+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.bYrsur_YNJx48eq5-1CDSiNSfhrUE8-_0 2024-03-09T15:07:05.030 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.030+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/46996 2024-03-09T15:07:05.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-03-09T15:07:05.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13092431810502628630', time=2024-03-09T16:57:02.332872+0000, chain.objs.size()=1 2024-03-09T15:07:05.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.XskbZ4HQyz1Wz8lkaMn3Q_CRsOHstMO_0 2024-03-09T15:07:05.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7486029245143346313', time=2024-03-09T16:57:02.593317+0000, chain.objs.size()=1 2024-03-09T15:07:05.033 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.9B6gth8D8Dpa4YzfM5Su-zqqvpHj7hZ_0 2024-03-09T15:07:05.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9181179472677099761', time=2024-03-09T16:57:02.597009+0000, chain.objs.size()=1 2024-03-09T15:07:05.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Il8gz2bGxnhaOYrW-2Uc3BkeT6E-r8u_0 2024-03-09T15:07:05.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15701148041122619435', time=2024-03-09T16:57:02.632799+0000, chain.objs.size()=1 2024-03-09T15:07:05.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.PCyKUH7160-zj5wc6EcxDQhrCFsy-UN_0 2024-03-09T15:07:05.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4273501334326571130', time=2024-03-09T16:57:02.769749+0000, chain.objs.size()=1 2024-03-09T15:07:05.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Ei_1_cayi19LRxByCGSqOZSvp_oYFba_0 2024-03-09T15:07:05.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6298065963633141887', time=2024-03-09T16:57:02.847787+0000, chain.objs.size()=1 2024-03-09T15:07:05.034 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Vpla9mlqpp2RYuwGJFKefp9NOVoU60F_0 2024-03-09T15:07:05.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12164611833288759352', time=2024-03-09T16:57:02.972762+0000, chain.objs.size()=1 2024-03-09T15:07:05.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.mXtHWcVozTCbxp-_YK8HGJ5wPQFxdgF_0 2024-03-09T15:07:05.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15114655327157723818', time=2024-03-09T16:57:03.025180+0000, chain.objs.size()=1 2024-03-09T15:07:05.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.qN1_y1I6DkVYWr01IyA2THLkjYnn4Py_0 2024-03-09T15:07:05.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4550933788958471975', time=2024-03-09T16:57:03.043583+0000, chain.objs.size()=1 2024-03-09T15:07:05.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.CJ2Yrk0DvGiRKEPcthzZbAHdRBRaRrN_0 2024-03-09T15:07:05.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1146636059082482059', time=2024-03-09T16:57:03.079915+0000, chain.objs.size()=1 2024-03-09T15:07:05.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.NADyyPVHW1aYE6F2dMinfGUp2f13yi5_0 2024-03-09T15:07:05.035 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.435723813229538100', time=2024-03-09T16:57:03.263537+0000, chain.objs.size()=1 2024-03-09T15:07:05.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.TWUVfZYK-FfsXnS-9Mj-bWSXBa-yM7-_0 2024-03-09T15:07:05.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17813332179282265687', time=2024-03-09T16:57:03.266734+0000, chain.objs.size()=1 2024-03-09T15:07:05.036 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.034+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.kcXxtaex_L10L_YCwiGnHwlwOIAr62i_0 2024-03-09T15:07:05.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18365649319778482359', time=2024-03-09T16:57:03.288075+0000, chain.objs.size()=1 2024-03-09T15:07:05.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.yLqeYkPJjPob2DIR9TaE11cc8cSHtFi_0 2024-03-09T15:07:05.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3650690612393413941', time=2024-03-09T16:57:03.331074+0000, chain.objs.size()=1 2024-03-09T15:07:05.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.N3BLdcKVnYGf6njkCnkvnVzBWDTP_lN_0 2024-03-09T15:07:05.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7501156274842710344', time=2024-03-09T16:57:03.351817+0000, chain.objs.size()=1 2024-03-09T15:07:05.038 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.LD_-_CnQ9EuXaR5VqWBLNp_Sv2iWb6K_0 2024-03-09T15:07:05.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6233235714556194118', time=2024-03-09T16:57:03.359656+0000, chain.objs.size()=1 2024-03-09T15:07:05.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.zusQN_YJ-lcovUQXLCFGeZppeX8WWyj_0 2024-03-09T15:07:05.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13546734249304838925', time=2024-03-09T16:57:03.385261+0000, chain.objs.size()=1 2024-03-09T15:07:05.039 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.fsvC4c7J8Abp6xPuAbfQPzd-a_Ia9lS_0 2024-03-09T15:07:05.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3630271355592372798', time=2024-03-09T16:57:07.783495+0000, chain.objs.size()=1 2024-03-09T15:07:05.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.323__shadow_.JuxGVHDMFD-_xSWCqv0JnsU2YRmB3FS_0 2024-03-09T15:07:05.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6478910870209668330', time=2024-03-09T16:57:10.453658+0000, chain.objs.size()=1 2024-03-09T15:07:05.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.326__shadow_.umPtlvYUclRQ6yl9M07MBkIWFZVRA1S_0 2024-03-09T15:07:05.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3079005517500488141', time=2024-03-09T16:57:54.060470+0000, chain.objs.size()=1 2024-03-09T15:07:05.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.375__shadow_.jLYpNt6G7uPoel6ymrdPbMWtl-7bK81_0 2024-03-09T15:07:05.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14624187778124521451', time=2024-03-09T16:59:19.285188+0000, chain.objs.size()=1 2024-03-09T15:07:05.040 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.459__shadow_.jaegxzIA6oDPu69ShdbO2vs6nF8DLBf_0 2024-03-09T15:07:05.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11599413598524577258', time=2024-03-09T16:59:29.514715+0000, chain.objs.size()=1 2024-03-09T15:07:05.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.475__shadow_.vblXO8Li72Pp_c0dGKtEzBlwxVKi38A_0 2024-03-09T15:07:05.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.492__shadow_.0wVkGEQu2HFGkqn67CS6zbNprZkw9Zs_1_ed7855026f58125de0be6798df1e44b8', time=2024-03-09T16:59:44.044835+0000, chain.objs.size()=1 2024-03-09T15:07:05.041 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.038+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.492__shadow_.0wVkGEQu2HFGkqn67CS6zbNprZkw9Zs_0 2024-03-09T15:07:05.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.042+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6086579107536047904', time=2024-03-09T17:00:01.691250+0000, chain.objs.size()=1 2024-03-09T15:07:05.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.042+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.512__multipart_mymultipart.2~6pdIsePZirePewZADKiO8yZVVhc3-Rm.1 2024-03-09T15:07:05.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.042+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12672246153049212305', time=2024-03-09T17:00:22.273810+0000, chain.objs.size()=6 2024-03-09T15:07:05.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.042+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~Z803wEmCouIUDOhRKG7xQzFqV81iUDB.1 2024-03-09T15:07:05.043 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.042+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~Z803wEmCouIUDOhRKG7xQzFqV81iUDB.2 2024-03-09T15:07:05.044 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.042+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.27BJSOhxVU4kDCYk-vTGAxyq4QNTOZ34.3 2024-03-09T15:07:05.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~Z803wEmCouIUDOhRKG7xQzFqV81iUDB.4 2024-03-09T15:07:05.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~Z803wEmCouIUDOhRKG7xQzFqV81iUDB.5 2024-03-09T15:07:05.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.516__multipart_mymultipart.2~Z803wEmCouIUDOhRKG7xQzFqV81iUDB.6 2024-03-09T15:07:05.045 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.046+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17542730655154221367', time=2024-03-09T17:00:29.052633+0000, chain.objs.size()=1 2024-03-09T15:07:05.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.517__multipart_mymultipart.2~YU8ZKQeKK71Y9un38fhcb2BaTLCmxVJ.1 2024-03-09T15:07:05.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.046+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5042662202080228716', time=2024-03-09T17:00:33.970009+0000, chain.objs.size()=2 2024-03-09T15:07:05.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.519__multipart_mymultipart.2~woSMCbS-dhvf6Mpqw97cm0XUj-Slxkl.1 2024-03-09T15:07:05.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.519__multipart_mymultipart.2~woSMCbS-dhvf6Mpqw97cm0XUj-Slxkl.2 2024-03-09T15:07:05.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.046+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10502189596413243485', time=2024-03-09T17:01:36.586723+0000, chain.objs.size()=1 2024-03-09T15:07:05.046 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.046+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.551__shadow_.GNF8udv_iqv-Mi8sGkU1R0jsEok3Wwg_0 2024-03-09T15:07:05.048 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~rHdyrBmHNemeunuVIBvHtr7LBLc3nQ2', time=2024-03-09T17:01:39.742220+0000, chain.objs.size()=1 2024-03-09T15:07:05.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.554__multipart_mymultipart.2~rHdyrBmHNemeunuVIBvHtr7LBLc3nQ2.1 2024-03-09T15:07:05.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17831076268998848040', time=2024-03-09T17:02:07.816409+0000, chain.objs.size()=1 2024-03-09T15:07:05.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.567__shadow:eljCn1Dgr-DM1wr1piRSJZbZ8XMuR1q_.fPy577I8Bg9qOTBbifTrsz0cZDXUtcv_0 2024-03-09T15:07:05.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16988921779238249651', time=2024-03-09T17:02:35.515258+0000, chain.objs.size()=4 2024-03-09T15:07:05.049 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.571__multipart_testobj.2~vflWtH7-FH1lNSpjgqjxuiK42UI9snD.1 2024-03-09T15:07:05.050 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.571__multipart_testobj.2~vflWtH7-FH1lNSpjgqjxuiK42UI9snD.2 2024-03-09T15:07:05.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.571__multipart_testobj.2~vflWtH7-FH1lNSpjgqjxuiK42UI9snD.3 2024-03-09T15:07:05.051 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.571__multipart_testobj.2~vflWtH7-FH1lNSpjgqjxuiK42UI9snD.4 2024-03-09T15:07:05.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.573__shadow:MfJmlB2qzbbM5BVYhjWeizee4Czmi8m_.9OZvTSdS9Hkz2yUS1Dt2DaHzpXpaSrB_1_3de330b766726038e07e70c944fc1553', time=2024-03-09T17:02:39.451988+0000, chain.objs.size()=1 2024-03-09T15:07:05.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.573__shadow:MfJmlB2qzbbM5BVYhjWeizee4Czmi8m_.9OZvTSdS9Hkz2yUS1Dt2DaHzpXpaSrB_0 2024-03-09T15:07:05.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12244647349801574848', time=2024-03-09T17:03:38.877901+0000, chain.objs.size()=1 2024-03-09T15:07:05.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.622__shadow_.E9nsRNbgmIjYzJQgyf2hH8JRPFYT7NT_0 2024-03-09T15:07:05.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7203623419982045696', time=2024-03-09T17:03:47.406262+0000, chain.objs.size()=2 2024-03-09T15:07:05.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.632__shadow_.TTpHw5UDQdGhsZQQFvZWC1Egr5mgmnG_0 2024-03-09T15:07:05.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.632__shadow_.TTpHw5UDQdGhsZQQFvZWC1Egr5mgmnG_1 2024-03-09T15:07:05.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7150290132410989517', time=2024-03-09T17:03:59.314959+0000, chain.objs.size()=2 2024-03-09T15:07:05.052 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.050+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.643__shadow_.gJuMRtu3xMo5wXUmTLw8XNBW4AHuQUQ_0 2024-03-09T15:07:05.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.054+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.643__shadow_.gJuMRtu3xMo5wXUmTLw8XNBW4AHuQUQ_1 2024-03-09T15:07:05.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.054+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1348117886663497978', time=2024-03-09T17:04:41.885684+0000, chain.objs.size()=1 2024-03-09T15:07:05.053 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.054+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.691__shadow:ScJ1QWHfhJ2Y5XlGdxF99KzWcJz-.-4_.lT7SGQ5u-j9nQZwDKpzjb49QOwejdda_0 2024-03-09T15:07:05.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.054+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8458738626194073357', time=2024-03-09T17:05:13.043448+0000, chain.objs.size()=1 2024-03-09T15:07:05.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.054+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.704__shadow:cGWcO6ngJa8d0YNbJsb.0aRYxJgpd7y_.T2HYxuV11LVLB9U0XFPMqjwx6WcaDAo_0 2024-03-09T15:07:05.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.054+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.706__shadow_.kb5DMHN2ksQTT223T1OmUdKSf1tYn2p_1_24ee2fec1d9c84aa1b62bfa6512a5b1d', time=2024-03-09T17:05:14.926174+0000, chain.objs.size()=1 2024-03-09T15:07:05.055 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.054+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.706__shadow_.kb5DMHN2ksQTT223T1OmUdKSf1tYn2p_0 2024-03-09T15:07:05.060 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.058+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:05.062 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.062+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-09T15:07:05.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.062+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:05.063 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.062+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:05.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44109' 2024-03-09T15:07:05.065 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17970811295226015693', time=2024-03-09T16:51:50.781850+0000, chain.objs.size()=3 2024-03-09T15:07:05.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.153__multipart_mymultipart-LUKEWARM.2~yRHY0OxhUkx5MHdL7izoKkt3GauJWiO.1 2024-03-09T15:07:05.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.153__multipart_mymultipart-LUKEWARM.2~yRHY0OxhUkx5MHdL7izoKkt3GauJWiO.2 2024-03-09T15:07:05.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.153__multipart_mymultipart-LUKEWARM.2~yRHY0OxhUkx5MHdL7izoKkt3GauJWiO.3 2024-03-09T15:07:05.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='_bQE4iwFY2kycFDYO6UW-mlqmxvbNOcy', time=2024-03-09T16:51:57.414910+0000, chain.objs.size()=1 2024-03-09T15:07:05.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.159__shadow_.7GATEHGiWfV5gOaQg7A90f88sA0sAw5_0 2024-03-09T15:07:05.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='_0txjFQh_VCb_bE94nEtm4phNhxVygIK', time=2024-03-09T16:51:57.429261+0000, chain.objs.size()=1 2024-03-09T15:07:05.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.159__shadow_.jfKUlj18g3R_-GEs232T-iasI6PWHfh_0 2024-03-09T15:07:05.066 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8272901609999194264', time=2024-03-09T16:54:35.451451+0000, chain.objs.size()=1 2024-03-09T15:07:05.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.237__shadow_.LyG1f87C2LmhlHeldqgokNe76ai8ff-_0 2024-03-09T15:07:05.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12093428120368690072', time=2024-03-09T16:54:36.861295+0000, chain.objs.size()=1 2024-03-09T15:07:05.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.238__shadow_.WFhLm3XUKFG7F3qY7q7gMKI41jLAhWk_0 2024-03-09T15:07:05.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9940280758960638112', time=2024-03-09T16:54:52.876936+0000, chain.objs.size()=1 2024-03-09T15:07:05.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.255__shadow_.EOL37jrzCRhvmEXDchA6vr06kX224XY_0 2024-03-09T15:07:05.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9847958127477686529', time=2024-03-09T16:55:14.847711+0000, chain.objs.size()=1 2024-03-09T15:07:05.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.i3XcNflWY9T83AqWiylk7QOly4Qmz-b_0 2024-03-09T15:07:05.067 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7779430221084668298', time=2024-03-09T16:55:14.955371+0000, chain.objs.size()=1 2024-03-09T15:07:05.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.P2Gh3AHPB8BLcm3IzCi6cqk5-jXN1P__0 2024-03-09T15:07:05.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6747666643468263750', time=2024-03-09T16:55:15.254333+0000, chain.objs.size()=1 2024-03-09T15:07:05.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.aAZpBRkc228GMPMqzteqjH58vBKhFyi_0 2024-03-09T15:07:05.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.764325218575809156', time=2024-03-09T16:55:15.271893+0000, chain.objs.size()=1 2024-03-09T15:07:05.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.066+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.OLg5BJXaFryAAJ7XRmEZTz3bIycipVW_0 2024-03-09T15:07:05.068 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4359766796898936130', time=2024-03-09T16:55:15.397548+0000, chain.objs.size()=1 2024-03-09T15:07:05.069 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.kP68OkBUsvDNOzxs9qBRiu_A-xe8-mG_0 2024-03-09T15:07:05.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1572149005877488433', time=2024-03-09T16:55:15.412114+0000, chain.objs.size()=1 2024-03-09T15:07:05.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.zwBWLC_y1Ra32gVX1DZb-B2F4TCroMa_0 2024-03-09T15:07:05.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8322440262122046900', time=2024-03-09T16:55:15.436098+0000, chain.objs.size()=1 2024-03-09T15:07:05.070 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.tTqrqPXFqL2dtFVplKJuEIPM86ZO-IE_0 2024-03-09T15:07:05.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11878393247775448678', time=2024-03-09T16:55:15.445767+0000, chain.objs.size()=1 2024-03-09T15:07:05.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.GTXsCQ8HhpNhE1zV5Q6OUaVAuRS0RIU_0 2024-03-09T15:07:05.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2455529590121976966', time=2024-03-09T16:55:15.519185+0000, chain.objs.size()=1 2024-03-09T15:07:05.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Hw2idfbbqNZRXPRvq2afmle8Lzt-9r1_0 2024-03-09T15:07:05.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9020958715919851997', time=2024-03-09T16:55:15.682177+0000, chain.objs.size()=1 2024-03-09T15:07:05.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.netjd8wIDo6p2ySIS8i5hrzW7kflhVC_0 2024-03-09T15:07:05.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10258980020390017075', time=2024-03-09T16:55:15.753209+0000, chain.objs.size()=1 2024-03-09T15:07:05.071 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.43OjYdxVBHff4cE1rPWPuypqnvmIxgb_0 2024-03-09T15:07:05.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15504420712972333981', time=2024-03-09T16:55:15.779788+0000, chain.objs.size()=1 2024-03-09T15:07:05.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.JLboqjF6wi6BAVWfKPwO2oNSikadvmy_0 2024-03-09T15:07:05.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10731645583094407403', time=2024-03-09T16:55:15.796246+0000, chain.objs.size()=1 2024-03-09T15:07:05.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.jX1xskBpPKL3MJ5uVro84zrdL-HMA_N_0 2024-03-09T15:07:05.072 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14913270064082094303', time=2024-03-09T16:55:15.805455+0000, chain.objs.size()=1 2024-03-09T15:07:05.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.5o6OUhcilOj5faWdkG4u_8f_Xbw10JS_0 2024-03-09T15:07:05.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5687138141249837601', time=2024-03-09T16:55:15.835735+0000, chain.objs.size()=1 2024-03-09T15:07:05.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.070+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.N-_gLoJ4Lo2hCftkikI1Hbx84Yz-mw6_0 2024-03-09T15:07:05.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.074+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8477332977912562871', time=2024-03-09T16:55:15.982653+0000, chain.objs.size()=1 2024-03-09T15:07:05.073 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.074+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.nEC2MsvCK-Fw3EqJo9hMAakoYq_dafa_0 2024-03-09T15:07:05.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.074+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15671933084178149895', time=2024-03-09T16:55:15.997383+0000, chain.objs.size()=1 2024-03-09T15:07:05.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.074+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.pYckxH9UfQuefcio7A9CxTb2H61eQhp_0 2024-03-09T15:07:05.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.074+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15092739773645948653', time=2024-03-09T16:55:16.214922+0000, chain.objs.size()=1 2024-03-09T15:07:05.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.074+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6hz-iuhWgP3tp37z00BpBBFz5wR3tSl_0 2024-03-09T15:07:05.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.074+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1603370288742812654', time=2024-03-09T16:55:16.216929+0000, chain.objs.size()=1 2024-03-09T15:07:05.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.074+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.dFNaY8WAZU2-2SEy42VprRcD69QTnb-_0 2024-03-09T15:07:05.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.074+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15149139356854003030', time=2024-03-09T16:55:16.233313+0000, chain.objs.size()=1 2024-03-09T15:07:05.075 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.074+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.GHp915zjtYxbjKiPNT66YInWFkRLGC-_0 2024-03-09T15:07:05.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14075707138597839557', time=2024-03-09T16:55:16.287902+0000, chain.objs.size()=1 2024-03-09T15:07:05.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.C4AMzjD15E3IGJWI647rb5a6c3yvbe4_0 2024-03-09T15:07:05.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5081451094004857000', time=2024-03-09T16:55:16.362049+0000, chain.objs.size()=1 2024-03-09T15:07:05.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.kmtEXo2I0L3wvnhmgaHm9MIipnIbdp3_0 2024-03-09T15:07:05.076 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4646120348520750561', time=2024-03-09T16:55:16.507470+0000, chain.objs.size()=1 2024-03-09T15:07:05.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.fsy7MD6rtSmNYpPP_JJtrqGz8nMnj7L_0 2024-03-09T15:07:05.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12008649954332643765', time=2024-03-09T16:55:16.586856+0000, chain.objs.size()=1 2024-03-09T15:07:05.077 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.oDmOTvwTRuLNIVP4kE7SRZTUsWwMhVo_0 2024-03-09T15:07:05.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15141843123131960477', time=2024-03-09T16:55:16.588915+0000, chain.objs.size()=1 2024-03-09T15:07:05.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.e8tKB_COJHn8iUx-4DWPsbQEylgT_x8_0 2024-03-09T15:07:05.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17996579142425640192', time=2024-03-09T16:55:16.795522+0000, chain.objs.size()=1 2024-03-09T15:07:05.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.CADuxZvjD_gIS854XbAH_vq1NfivuUo_0 2024-03-09T15:07:05.079 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6221509247529356353', time=2024-03-09T16:55:24.102445+0000, chain.objs.size()=1 2024-03-09T15:07:05.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.264__shadow_.PGAMAScNvWS21NBtauhuWr9Li4hC4Nq_0 2024-03-09T15:07:05.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8471404173694053910', time=2024-03-09T16:55:27.777294+0000, chain.objs.size()=1 2024-03-09T15:07:05.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.268__shadow_.CfxwfBVzq0ylO--N9w-RspcQ5AQZBuW_0 2024-03-09T15:07:05.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2638594052234337366', time=2024-03-09T16:55:34.386191+0000, chain.objs.size()=1 2024-03-09T15:07:05.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.275__shadow_.xrReYDj_W2-nEFRgXpNkL0NGXzv55aP_0 2024-03-09T15:07:05.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17663506503695925248', time=2024-03-09T16:55:40.261815+0000, chain.objs.size()=1 2024-03-09T15:07:05.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.281__shadow_.alnkLDg_2vLBcL-j4mT56a5oMgDzGMG_0 2024-03-09T15:07:05.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15037101161518466150', time=2024-03-09T16:55:42.122972+0000, chain.objs.size()=1 2024-03-09T15:07:05.080 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.078+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.283__shadow_.uo30HsrpW8fKNKcWnKffQoHAZy9EVqr_0 2024-03-09T15:07:05.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17020476972654026742', time=2024-03-09T16:55:46.193592+0000, chain.objs.size()=1 2024-03-09T15:07:05.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.tIG-sF6Y8WXYRpT7_L3dvpPUjzJgnTY_0 2024-03-09T15:07:05.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10717594590709593041', time=2024-03-09T16:55:46.238322+0000, chain.objs.size()=1 2024-03-09T15:07:05.081 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.qb7yJpWXpv8FCwt1tGWLiBl2yT-PfFN_0 2024-03-09T15:07:05.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3995121119024679665', time=2024-03-09T16:55:47.845045+0000, chain.objs.size()=1 2024-03-09T15:07:05.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.x06N3JTGPFdA57ZH7RtqwoY8Cfk82Td_0 2024-03-09T15:07:05.082 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14499409396763276356', time=2024-03-09T16:55:48.751412+0000, chain.objs.size()=1 2024-03-09T15:07:05.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.288__shadow_.QHn6HUVdfuGLWBu4pUopMb0in1N0uUn_0 2024-03-09T15:07:05.083 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.082+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8029518807999410256', time=2024-03-09T16:56:01.752394+0000, chain.objs.size()=1 2024-03-09T15:07:05.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.082+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.301__shadow:S4uRbjRPJRLBxl4b6Cje29ypXVYsF1d_.GEO7j3hHAbN5PWsUOvPXoSGEg8aOngc_0 2024-03-09T15:07:05.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.086+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3582821746812806691', time=2024-03-09T16:56:37.761867+0000, chain.objs.size()=1 2024-03-09T15:07:05.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.086+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.dyQUeptCG6LLLKa7LnS9mVG7aER2TgD_0 2024-03-09T15:07:05.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.086+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1343566409778110486', time=2024-03-09T16:56:37.804812+0000, chain.objs.size()=1 2024-03-09T15:07:05.084 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.086+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.SAXaXdn95sBjKxOHhkob8pp-PygrwsI_0 2024-03-09T15:07:05.085 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.086+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10715699795224781721', time=2024-03-09T16:56:37.833947+0000, chain.objs.size()=1 2024-03-09T15:07:05.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.086+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.SEjUF3aeNVg6PRwXXb29V7vExxofpqQ_0 2024-03-09T15:07:05.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.086+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17584271032034407155', time=2024-03-09T16:56:37.850662+0000, chain.objs.size()=1 2024-03-09T15:07:05.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.086+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.tEdUbRZ81223JQVwFeB6pegPqCR7pHM_0 2024-03-09T15:07:05.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.086+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1732247700856488130', time=2024-03-09T16:56:38.028689+0000, chain.objs.size()=1 2024-03-09T15:07:05.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.086+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.8VwMOXZPduvPHSN8ZyiibeIw1XEb_al_0 2024-03-09T15:07:05.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.086+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5789930108026876696', time=2024-03-09T16:56:38.076879+0000, chain.objs.size()=1 2024-03-09T15:07:05.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.086+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.C_DO_RS1cA0_gDFBNaB7yws19ybIJ0__0 2024-03-09T15:07:05.086 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.086+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14996082333040830913', time=2024-03-09T16:56:38.087900+0000, chain.objs.size()=1 2024-03-09T15:07:05.087 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.086+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Cc8XQcr2RMz5uLFqWc7_QHesC-1zlXt_0 2024-03-09T15:07:05.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.090+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17333508301777425825', time=2024-03-09T16:56:38.092397+0000, chain.objs.size()=1 2024-03-09T15:07:05.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.090+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Aq1aS216X58nAyYWFJmh4VCeThmnEEj_0 2024-03-09T15:07:05.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.090+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16843942221894449210', time=2024-03-09T16:56:38.295695+0000, chain.objs.size()=1 2024-03-09T15:07:05.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.090+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_._VupuHqK-1mTKRX2BVgMsjbhODwfqak_0 2024-03-09T15:07:05.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.090+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13012461373991041299', time=2024-03-09T16:56:38.362609+0000, chain.objs.size()=1 2024-03-09T15:07:05.089 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.090+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6cnq6fE_w6buyg3xkj5N2OXUt4H-FVc_0 2024-03-09T15:07:05.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.090+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.647859349756033846', time=2024-03-09T16:56:38.383279+0000, chain.objs.size()=1 2024-03-09T15:07:05.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.090+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ertVQOmrFKgHiUzHy5jci8W0kMXSWdN_0 2024-03-09T15:07:05.090 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.090+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14879773521666685758', time=2024-03-09T16:56:38.506255+0000, chain.objs.size()=1 2024-03-09T15:07:05.091 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.090+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.1kczbbDSukMHZ4PspyGPglEaWbveSQh_0 2024-03-09T15:07:05.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1220165140999924754', time=2024-03-09T16:56:38.530222+0000, chain.objs.size()=1 2024-03-09T15:07:05.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.GBBRnsIlY-ZNp3WL02JF0izKKvd6vjh_0 2024-03-09T15:07:05.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12938482803048748468', time=2024-03-09T16:56:38.577221+0000, chain.objs.size()=1 2024-03-09T15:07:05.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.XJSrfXw6bCojTKoo64vK5FbaDRmjJIL_0 2024-03-09T15:07:05.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5072880735378962799', time=2024-03-09T16:56:38.903747+0000, chain.objs.size()=1 2024-03-09T15:07:05.092 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.wnAsE_6RYYLB1kaItw9trq5sYqL1nTG_0 2024-03-09T15:07:05.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1324993563129157314', time=2024-03-09T16:56:38.905228+0000, chain.objs.size()=1 2024-03-09T15:07:05.093 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.I4t2K9FeFez1nm6CMx-3mGe6aRke_v2_0 2024-03-09T15:07:05.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14344302935957655583', time=2024-03-09T16:56:39.066793+0000, chain.objs.size()=1 2024-03-09T15:07:05.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.1NLwwfSurtQme2fUxUy5EfITNm9uuOi_0 2024-03-09T15:07:05.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18351674814917302498', time=2024-03-09T16:56:39.341542+0000, chain.objs.size()=1 2024-03-09T15:07:05.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-wHdsru9fjp6M9xEJSnUbkF6GNubavf_0 2024-03-09T15:07:05.094 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17130632138659717483', time=2024-03-09T16:56:39.406494+0000, chain.objs.size()=1 2024-03-09T15:07:05.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.hvKYT2VxsKfD3LVV9eN9TMzMT2cu4_7_0 2024-03-09T15:07:05.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8126867172515307110', time=2024-03-09T16:56:39.409305+0000, chain.objs.size()=1 2024-03-09T15:07:05.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.xdFw51MF4hfYq-R5AIm_HykZfwK4RRv_0 2024-03-09T15:07:05.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13986766283453434590', time=2024-03-09T16:56:39.596081+0000, chain.objs.size()=1 2024-03-09T15:07:05.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.MlLP2IlpB-aGqqgv8XVy9bZylqwXvvl_0 2024-03-09T15:07:05.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5493768704938077303', time=2024-03-09T16:56:39.641057+0000, chain.objs.size()=1 2024-03-09T15:07:05.095 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-7enpR8vqd5WQLTSr12CLXLm9bOJSv6_0 2024-03-09T15:07:05.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.712641217795275978', time=2024-03-09T16:57:01.504673+0000, chain.objs.size()=1 2024-03-09T15:07:05.096 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.094+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.1ayryuQzmgiraimLAQ8qlmV5Jlh1KWb_0 2024-03-09T15:07:05.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4002294000320701898', time=2024-03-09T16:57:01.508532+0000, chain.objs.size()=1 2024-03-09T15:07:05.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.MMXGAK8M05I_oAxSvonUDewaIhLT4Xe_0 2024-03-09T15:07:05.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15901028447550726076', time=2024-03-09T16:57:01.558358+0000, chain.objs.size()=1 2024-03-09T15:07:05.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.fLPf9Uao_ZULjzWZNDFly-4mIYRoctp_0 2024-03-09T15:07:05.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17621574618155619871', time=2024-03-09T16:57:01.785989+0000, chain.objs.size()=1 2024-03-09T15:07:05.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.RlvtQY35I8AFlWwiOCpKJsfSkwADK1X_0 2024-03-09T15:07:05.098 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8698605403011958295', time=2024-03-09T16:57:01.805458+0000, chain.objs.size()=1 2024-03-09T15:07:05.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ka6cDHqM2qbj-IKvo1_NMJpUrTxKFHf_0 2024-03-09T15:07:05.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5311888660193128576', time=2024-03-09T16:57:02.003658+0000, chain.objs.size()=1 2024-03-09T15:07:05.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.XViPnI-qJoasRV-PRfJKGd-lDlLNRCj_0 2024-03-09T15:07:05.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2951600365124959452', time=2024-03-09T16:57:02.024937+0000, chain.objs.size()=1 2024-03-09T15:07:05.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.p0Ho5sftMu6asFJs7TgSU2thNvC9_-E_0 2024-03-09T15:07:05.099 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10546086487818170564', time=2024-03-09T16:57:02.039713+0000, chain.objs.size()=1 2024-03-09T15:07:05.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.w3-9ib7pc4iFv7pUkFV_28RCSmlb_Jb_0 2024-03-09T15:07:05.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.098+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6320837538743039159', time=2024-03-09T16:57:02.071336+0000, chain.objs.size()=1 2024-03-09T15:07:05.100 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.098+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ENSqtIlA2OGLY5ZY0ARyON1KBCtMug__0 2024-03-09T15:07:05.101 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.102+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16379441378602835948', time=2024-03-09T16:57:02.087975+0000, chain.objs.size()=1 2024-03-09T15:07:05.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.102+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.c7CuCDTtHTVC4yWZNph9-40M9fRBXUU_0 2024-03-09T15:07:05.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.102+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14326779967920250893', time=2024-03-09T16:57:02.245343+0000, chain.objs.size()=1 2024-03-09T15:07:05.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.102+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.zLccRxspxaJdNSdEFBgVTLmIABqbgen_0 2024-03-09T15:07:05.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.102+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9906536212455398056', time=2024-03-09T16:57:02.250736+0000, chain.objs.size()=1 2024-03-09T15:07:05.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.102+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.m8rnr4anAuhQtMyDlRDgo0iDaQCTkhV_0 2024-03-09T15:07:05.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.102+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6309322016390715484', time=2024-03-09T16:57:02.278839+0000, chain.objs.size()=1 2024-03-09T15:07:05.102 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.102+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.TrkO8Ws7YDGwNv1ylXDKsxJ9Mani2E0_0 2024-03-09T15:07:05.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.102+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.513855338660619336', time=2024-03-09T16:57:02.515669+0000, chain.objs.size()=1 2024-03-09T15:07:05.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.102+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.cUPV3QvtLAPb2sDCRMugGcYbXkV11Oa_0 2024-03-09T15:07:05.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.102+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8200209288748310719', time=2024-03-09T16:57:02.555997+0000, chain.objs.size()=1 2024-03-09T15:07:05.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.102+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.l1bqpqzh0JEnfRr57f-FVvLu9XtVuxd_0 2024-03-09T15:07:05.103 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.102+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10294506620753769598', time=2024-03-09T16:57:02.569758+0000, chain.objs.size()=1 2024-03-09T15:07:05.104 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.102+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.jUhm1PzFhUi1F6fhFGq8GnaagTqdepG_0 2024-03-09T15:07:05.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4078146503780888348', time=2024-03-09T16:57:02.754114+0000, chain.objs.size()=1 2024-03-09T15:07:05.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.n5YUPFzv5IV5_j8fP3ag7K5gI2oNlJF_0 2024-03-09T15:07:05.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3624515139542786894', time=2024-03-09T16:57:02.761124+0000, chain.objs.size()=1 2024-03-09T15:07:05.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DTYxI8aA9X_sj76_kuw1IeRno4FcvNX_0 2024-03-09T15:07:05.105 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.126650993166393731', time=2024-03-09T16:57:02.805843+0000, chain.objs.size()=1 2024-03-09T15:07:05.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Cf02wJD2DJyff309oc4GFm4j89f3EVH_0 2024-03-09T15:07:05.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4549065394844229837', time=2024-03-09T16:57:02.812851+0000, chain.objs.size()=1 2024-03-09T15:07:05.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.yGv0MhdFBvujap1alvU2LmFk7keCO1v_0 2024-03-09T15:07:05.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.642874567409210026', time=2024-03-09T16:57:02.823926+0000, chain.objs.size()=1 2024-03-09T15:07:05.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ykJHHjjZkULkIWP5VMQZL-llNnpjIiv_0 2024-03-09T15:07:05.106 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12801187167683804282', time=2024-03-09T16:57:02.831002+0000, chain.objs.size()=1 2024-03-09T15:07:05.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.tcvAYlNVlqVNn-rxIwAYorjn1u6-JHl_0 2024-03-09T15:07:05.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18024345500791954099', time=2024-03-09T16:57:02.839739+0000, chain.objs.size()=1 2024-03-09T15:07:05.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.IxAPdDw0mEqcnxdhT8etL3ABjKrnJhx_0 2024-03-09T15:07:05.107 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15553052752681409542', time=2024-03-09T16:57:02.842161+0000, chain.objs.size()=1 2024-03-09T15:07:05.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.POPYfn-WMGpMmh-nr55rwtUhD9koRO4_0 2024-03-09T15:07:05.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12405004485722607636', time=2024-03-09T16:57:03.101189+0000, chain.objs.size()=1 2024-03-09T15:07:05.108 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.106+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.elyMsdfae2J9OPicRYWm4v9nH7NW3xn_0 2024-03-09T15:07:05.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1238883878092169287', time=2024-03-09T16:57:03.110575+0000, chain.objs.size()=1 2024-03-09T15:07:05.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ew3_qlEYIyjdGV4SwD9vt9HkQgKzEqd_0 2024-03-09T15:07:05.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14078048045089271638', time=2024-03-09T16:57:03.297735+0000, chain.objs.size()=1 2024-03-09T15:07:05.109 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.yWhCNHevcR1AHn2kn5sElEsBxE1Bx-N_0 2024-03-09T15:07:05.111 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14172100017884633156', time=2024-03-09T16:57:03.341055+0000, chain.objs.size()=1 2024-03-09T15:07:05.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.WSDqAHaeXSrCyu6UJHvtXNN2a9exkIK_0 2024-03-09T15:07:05.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15512729718645580823', time=2024-03-09T16:57:03.344066+0000, chain.objs.size()=1 2024-03-09T15:07:05.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.dGH2LMIGJwNvu0ca1fsOBWMAleQSlx1_0 2024-03-09T15:07:05.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11378681583324194278', time=2024-03-09T16:57:03.577240+0000, chain.objs.size()=1 2024-03-09T15:07:05.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.HxmlYKS1wW3GNSaEagp-8azn9QMOXG-_0 2024-03-09T15:07:05.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11090959668036182813', time=2024-03-09T16:59:31.471531+0000, chain.objs.size()=1 2024-03-09T15:07:05.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.477__shadow_.WuleRkTPuOle4B1jz5hzfkiSwzVzwRe_0 2024-03-09T15:07:05.112 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.481__shadow_.v4MQk-n7ohcZQbow9zo6-N9c9D_iPRR_1_d667ab7d5019a322c8d9792932359488', time=2024-03-09T16:59:35.566322+0000, chain.objs.size()=1 2024-03-09T15:07:05.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.481__shadow_.v4MQk-n7ohcZQbow9zo6-N9c9D_iPRR_0 2024-03-09T15:07:05.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.482__shadow_.R5Ib_LKvYLgaW9sTiW1RmCZG6OKCZMB_1_3942caee0af5096834bfadf2ca8bc05d', time=2024-03-09T16:59:36.590680+0000, chain.objs.size()=1 2024-03-09T15:07:05.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.482__shadow_.R5Ib_LKvYLgaW9sTiW1RmCZG6OKCZMB_0 2024-03-09T15:07:05.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.491__shadow_.cDwgQT6M8EfmzLmplSi0DJ5YlPgbC3M_1_4f750336d02754e6f048ea22ad566346', time=2024-03-09T16:59:43.869174+0000, chain.objs.size()=1 2024-03-09T15:07:05.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.491__shadow_.cDwgQT6M8EfmzLmplSi0DJ5YlPgbC3M_0 2024-03-09T15:07:05.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.494__shadow_.eVwja6mROT24415AnnyW99OBXvbDjxn_1_bcaa1018a6df11cc51eb27ef54156bc9', time=2024-03-09T16:59:45.295844+0000, chain.objs.size()=1 2024-03-09T15:07:05.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.494__shadow_.eVwja6mROT24415AnnyW99OBXvbDjxn_0 2024-03-09T15:07:05.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.502603374743908251', time=2024-03-09T16:59:55.428707+0000, chain.objs.size()=1 2024-03-09T15:07:05.113 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.110+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.505__multipart_mymultipart.2~1Z8EJJv5Mfq-L5t1faUXg17F1HW0z7E.1 2024-03-09T15:07:05.117 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/44109 2024-03-09T15:07:05.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-03-09T15:07:05.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13827064117990596789', time=2024-03-09T17:01:52.541825+0000, chain.objs.size()=1 2024-03-09T15:07:05.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:khidnD8OfEw7FZT0LSjUfaNsxpNY4pN_.tgYwL6wy_fMqkBLg5K3JtlKV3TPyci8_0 2024-03-09T15:07:05.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.815591820430778183', time=2024-03-09T17:02:07.477297+0000, chain.objs.size()=1 2024-03-09T15:07:05.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.567__shadow:VkauoBDCD0O5kXwmk14W6KaQUkAyueS_.aSdKXxfrPLCp3jcz25aFkG9aN5ii5oA_0 2024-03-09T15:07:05.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16992083456107867844', time=2024-03-09T17:02:35.244007+0000, chain.objs.size()=4 2024-03-09T15:07:05.120 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.571__multipart_testobj.2~KbEYye_OU8YMXU-ROdxFlOhsnAp8j54.1 2024-03-09T15:07:05.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.571__multipart_testobj.2~KbEYye_OU8YMXU-ROdxFlOhsnAp8j54.2 2024-03-09T15:07:05.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.571__multipart_testobj.2~KbEYye_OU8YMXU-ROdxFlOhsnAp8j54.3 2024-03-09T15:07:05.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.571__multipart_testobj.2~KbEYye_OU8YMXU-ROdxFlOhsnAp8j54.4 2024-03-09T15:07:05.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7529883671874315770', time=2024-03-09T17:02:37.595759+0000, chain.objs.size()=1 2024-03-09T15:07:05.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.572__shadow:KNQG2ytkxFDwA6K0gYusxbtl195RJ-m_.s93HPAXIfGI3yHHHogVHyX8uD7wUKdA_0 2024-03-09T15:07:05.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6113663177090887404', time=2024-03-09T17:02:46.451885+0000, chain.objs.size()=1 2024-03-09T15:07:05.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.580__shadow:wwGVqIngG-5xY15SABt6NkG8R..7vX8_.ElwcyrrnupXVm09t4CWZ8TSMwxYXeXu_0 2024-03-09T15:07:05.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7811337067699640945', time=2024-03-09T17:04:48.980739+0000, chain.objs.size()=1 2024-03-09T15:07:05.121 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.699__shadow:u43mh7KmN3bFRh3RDdNo9UBCBEn3sPr_.udgBXdFCujNw_UR7w4CUF63bkNGYJ2L_0 2024-03-09T15:07:05.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17427190861544845477', time=2024-03-09T17:05:26.759157+0000, chain.objs.size()=1 2024-03-09T15:07:05.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.719__shadow_.ssljlYf4s5jsSKjcqVcTVUU6owQWM8B_0 2024-03-09T15:07:05.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6536634533477112041', time=2024-03-09T17:06:08.293909+0000, chain.objs.size()=1 2024-03-09T15:07:05.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.741__shadow_.MmxbRVVUiEZW2W2wmKHvZOO8dFhwwTu_0 2024-03-09T15:07:05.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16781145337916543039', time=2024-03-09T17:06:20.626435+0000, chain.objs.size()=1 2024-03-09T15:07:05.122 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.118+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.744__shadow_.0v24iiGrUBXkKVrE_wIVkE3WcufomGQ_0 2024-03-09T15:07:05.126 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.126+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:05.129 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-09T15:07:05.130 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:05.131 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:05.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49216' 2024-03-09T15:07:05.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.772777200534215832', time=2024-03-09T16:52:39.728434+0000, chain.objs.size()=1 2024-03-09T15:07:05.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.191__shadow_.zCP5zEkIZUYOd56izmwosrbjgXQDtgH_0 2024-03-09T15:07:05.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~VvO_5LPQDnsEObUCUBx3PZqXS3I7DFA', time=2024-03-09T16:52:43.559700+0000, chain.objs.size()=1 2024-03-09T15:07:05.132 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.195__multipart_mymultipart.2~VvO_5LPQDnsEObUCUBx3PZqXS3I7DFA.1 2024-03-09T15:07:05.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6559996035551483837', time=2024-03-09T16:52:46.598502+0000, chain.objs.size()=1 2024-03-09T15:07:05.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.198__shadow_.xGINE4HsRv0-TyWgxhpgdHy4puVEcjS_0 2024-03-09T15:07:05.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1523797732525172157', time=2024-03-09T16:54:27.479975+0000, chain.objs.size()=1 2024-03-09T15:07:05.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.230__shadow_.NRym5eD9yxqjjEKG3yUiXbkW_dz_wXq_0 2024-03-09T15:07:05.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15500817583024560778', time=2024-03-09T16:54:31.268290+0000, chain.objs.size()=1 2024-03-09T15:07:05.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.233__shadow_.FygFXOtSld8Atvm92fuAf65K26LcioI_0 2024-03-09T15:07:05.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12738935190470875943', time=2024-03-09T16:54:39.681165+0000, chain.objs.size()=1 2024-03-09T15:07:05.133 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.241__shadow_._NVYdi4f04Gt36qX53UTRGXKlblug7Y_0 2024-03-09T15:07:05.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9827464118333360103', time=2024-03-09T16:54:52.878897+0000, chain.objs.size()=1 2024-03-09T15:07:05.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.255__shadow_.sHkluaUI5FqJrmwyKd8HeO9BbYImrPB_0 2024-03-09T15:07:05.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17386452419316355732', time=2024-03-09T16:55:14.849220+0000, chain.objs.size()=1 2024-03-09T15:07:05.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.2F4LIdzgQ0NdYOrIk-0HefifC3Z6tg0_0 2024-03-09T15:07:05.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12078528693504854052', time=2024-03-09T16:55:15.138929+0000, chain.objs.size()=1 2024-03-09T15:07:05.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.LDCwfN3Be6NB6iYfSgM0w8AZd16FKSI_0 2024-03-09T15:07:05.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16033434866486522201', time=2024-03-09T16:55:15.164284+0000, chain.objs.size()=1 2024-03-09T15:07:05.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Mlww7_Gpm21JF6znl1vGBKsPnoijmvF_0 2024-03-09T15:07:05.134 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4553059447184498960', time=2024-03-09T16:55:15.173622+0000, chain.objs.size()=1 2024-03-09T15:07:05.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ykd4KCU8Yvx9eQFVjQC7RHUq0AA9rbN_0 2024-03-09T15:07:05.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1762834874083000999', time=2024-03-09T16:55:15.233100+0000, chain.objs.size()=1 2024-03-09T15:07:05.135 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.130+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.MvcYwb0hOqYuAZZ6gk0PzeXqUh04Tw9_0 2024-03-09T15:07:05.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.134+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.927683527182586111', time=2024-03-09T16:55:15.265962+0000, chain.objs.size()=1 2024-03-09T15:07:05.137 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.134+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.3dPQN2yeyXuiAL8oaPdF2RXkwFSNoAS_0 2024-03-09T15:07:05.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.134+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7007406670801996869', time=2024-03-09T16:55:15.486896+0000, chain.objs.size()=1 2024-03-09T15:07:05.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.134+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.S3EWKo8xs3_dNaPU64VUAr0oxR27jaV_0 2024-03-09T15:07:05.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.134+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5442594834300186075', time=2024-03-09T16:55:15.752370+0000, chain.objs.size()=1 2024-03-09T15:07:05.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.134+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.FApOHTweAZ9gEq_OFxi2uJjUeFzZ4Re_0 2024-03-09T15:07:05.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.134+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.553485185320191479', time=2024-03-09T16:55:15.773555+0000, chain.objs.size()=1 2024-03-09T15:07:05.138 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.134+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ZDcoc9N8hVsYFhh_Hddlf70eDCAWNx0_0 2024-03-09T15:07:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.134+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3506328931732500625', time=2024-03-09T16:55:15.784162+0000, chain.objs.size()=1 2024-03-09T15:07:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.134+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.zLXcXT8FGUOs9adh_ANYr9ofi-Hno6U_0 2024-03-09T15:07:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.134+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16896252564804655239', time=2024-03-09T16:55:15.835541+0000, chain.objs.size()=1 2024-03-09T15:07:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.134+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.egJq6OlBmzhaHxnGZkbKthVLo66WkAg_0 2024-03-09T15:07:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.134+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16984794693539918084', time=2024-03-09T16:55:16.085965+0000, chain.objs.size()=1 2024-03-09T15:07:05.139 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.134+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.9L2U_4mqlFmx_MN97vdsmeRL6Y9oshK_0 2024-03-09T15:07:05.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.138+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11707941186821841181', time=2024-03-09T16:55:16.093439+0000, chain.objs.size()=1 2024-03-09T15:07:05.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.138+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.f_MKgH6zGdPb95FPYSkdrgxf9Uxkg_5_0 2024-03-09T15:07:05.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.138+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.523528503194193045', time=2024-03-09T16:55:16.207137+0000, chain.objs.size()=1 2024-03-09T15:07:05.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.138+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.cs1-FatDvj8jXkbh5J954RokKQNVXGE_0 2024-03-09T15:07:05.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.138+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14520480636849382364', time=2024-03-09T16:55:16.246329+0000, chain.objs.size()=1 2024-03-09T15:07:05.140 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.138+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.G_nyc1KD72Gn8bS_KKfQugQWObc5U10_0 2024-03-09T15:07:05.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.138+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16202507143366489997', time=2024-03-09T16:55:16.259605+0000, chain.objs.size()=1 2024-03-09T15:07:05.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.138+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.AhB_Oq-ygnRC09VvngNb1wB1BZfL-v5_0 2024-03-09T15:07:05.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.138+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2978911635932759058', time=2024-03-09T16:55:16.278606+0000, chain.objs.size()=1 2024-03-09T15:07:05.141 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.138+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.PzkZcKf5n41QZ1xPxQa2w1_YwlKsJ9N_0 2024-03-09T15:07:05.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10319418783512843111', time=2024-03-09T16:55:16.287186+0000, chain.objs.size()=1 2024-03-09T15:07:05.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.bNK6lAExFa9Ememr7GPwNVHFBTso2yd_0 2024-03-09T15:07:05.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6901903950710475515', time=2024-03-09T16:55:16.313864+0000, chain.objs.size()=1 2024-03-09T15:07:05.142 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.c3HxcVPXVg-Ax-jVt7YFKB71J1z7Q9G_0 2024-03-09T15:07:05.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16292337772373620066', time=2024-03-09T16:55:16.618396+0000, chain.objs.size()=1 2024-03-09T15:07:05.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.HW_HjU__eGyJ4S23tRs98lQQmNDok1a_0 2024-03-09T15:07:05.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13383106212493631105', time=2024-03-09T16:55:16.731101+0000, chain.objs.size()=1 2024-03-09T15:07:05.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.XKDTe5H0niDo4FTu1_JLmVkN5uNaEFK_0 2024-03-09T15:07:05.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16464434642579272447', time=2024-03-09T16:55:16.757014+0000, chain.objs.size()=1 2024-03-09T15:07:05.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.3AQIY2NDzSEaXa2mWDXobHH3KCsL_yh_0 2024-03-09T15:07:05.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.142+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17954726984987152893', time=2024-03-09T16:55:16.800219+0000, chain.objs.size()=1 2024-03-09T15:07:05.143 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.142+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.PlXtMFSHNF3Hy5MuxRRJnGEwlKpXK7L_0 2024-03-09T15:07:05.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17608332464636474753', time=2024-03-09T16:55:16.802175+0000, chain.objs.size()=1 2024-03-09T15:07:05.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.3t1LP1yN6LIY3YRfr4nkyUmW5PELfHW_0 2024-03-09T15:07:05.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17334765201580143960', time=2024-03-09T16:55:16.821370+0000, chain.objs.size()=1 2024-03-09T15:07:05.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6GaV3nY3jEgjLT4nRTD7rANC7UtBNVK_0 2024-03-09T15:07:05.145 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17624125651123910255', time=2024-03-09T16:55:16.826745+0000, chain.objs.size()=1 2024-03-09T15:07:05.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.UK04fuzYQdvXCZCzFkxkZynPHwqcWW5_0 2024-03-09T15:07:05.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16584660054542332021', time=2024-03-09T16:55:17.666938+0000, chain.objs.size()=1 2024-03-09T15:07:05.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.257__shadow_.uwytiLzCfOAQf7aZPAJw2Gs8yYziTXS_0 2024-03-09T15:07:05.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13549502420338933045', time=2024-03-09T16:55:28.719211+0000, chain.objs.size()=1 2024-03-09T15:07:05.146 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.269__shadow_.cycr9xvjU2S3Y8p7ISkQT45Amj3ZD7R_0 2024-03-09T15:07:05.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5519472189401624939', time=2024-03-09T16:55:29.741303+0000, chain.objs.size()=1 2024-03-09T15:07:05.147 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.270__shadow_.Ohanzx6hYdP8brPneX1c1Ho2ZMG67Qj_0 2024-03-09T15:07:05.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4001257466276985164', time=2024-03-09T16:55:33.408538+0000, chain.objs.size()=1 2024-03-09T15:07:05.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.274__shadow_.-cJ5VZwcHsWkQ2FG_BNWLv5ExrzGgFp_0 2024-03-09T15:07:05.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14781198427581934966', time=2024-03-09T16:55:59.295604+0000, chain.objs.size()=1 2024-03-09T15:07:05.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.299__shadow_.Mz1qpXmVl0tpoD8slRrcaLmvRODIiEz_0 2024-03-09T15:07:05.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14477944019476479481', time=2024-03-09T16:56:37.693952+0000, chain.objs.size()=1 2024-03-09T15:07:05.148 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.d6Yy7pXpu_YeW8UABUVplJFeNrhOlvW_0 2024-03-09T15:07:05.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2293924024140029481', time=2024-03-09T16:56:37.760592+0000, chain.objs.size()=1 2024-03-09T15:07:05.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ZGu6TT_yglVTLuNn4TYa6jI8QlxhEAV_0 2024-03-09T15:07:05.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4065217211012755794', time=2024-03-09T16:56:37.781570+0000, chain.objs.size()=1 2024-03-09T15:07:05.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.146+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0-jIhtChEkMLCQGNJ2riTmTRLQYpOqr_0 2024-03-09T15:07:05.149 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.150+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15226407045932796886', time=2024-03-09T16:56:37.875458+0000, chain.objs.size()=1 2024-03-09T15:07:05.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.150+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.XzOaePedf2GWrhTb5lM4ejPOizqe1Cw_0 2024-03-09T15:07:05.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.150+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15947082232575769025', time=2024-03-09T16:56:38.054002+0000, chain.objs.size()=1 2024-03-09T15:07:05.150 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.150+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.gTPxexB3RuL2jjsn5Xg6yag6SFyFVFO_0 2024-03-09T15:07:05.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.150+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3927998007336434331', time=2024-03-09T16:56:38.079200+0000, chain.objs.size()=1 2024-03-09T15:07:05.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.150+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.KNdhpezPFCheKeWxDPcJJHT9jnQ8JIy_0 2024-03-09T15:07:05.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.150+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15397292146057767733', time=2024-03-09T16:56:38.111730+0000, chain.objs.size()=1 2024-03-09T15:07:05.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.150+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.W51TfnVgt2ueTryd1Qs-TFcSSudncPK_0 2024-03-09T15:07:05.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.150+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5057006716974476377', time=2024-03-09T16:56:38.325033+0000, chain.objs.size()=1 2024-03-09T15:07:05.151 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.150+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.sbTd37Gk9WpJ4rYcDI54aRLy4DROTfc_0 2024-03-09T15:07:05.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.150+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1095711663572232647', time=2024-03-09T16:56:38.327238+0000, chain.objs.size()=1 2024-03-09T15:07:05.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.150+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.aLUvVqdasqXmn9Vt5Tu2HbmnQqRlwX5_0 2024-03-09T15:07:05.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17632026526483514482', time=2024-03-09T16:56:38.564649+0000, chain.objs.size()=1 2024-03-09T15:07:05.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.cPGdAdCBEsUvW0P9sjiq_ieoNp-LT5j_0 2024-03-09T15:07:05.152 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5212746778461284335', time=2024-03-09T16:56:38.624850+0000, chain.objs.size()=1 2024-03-09T15:07:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.WKGL3R235W4t7KWAet4ruFFlEP97eQl_0 2024-03-09T15:07:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4440567796390792059', time=2024-03-09T16:56:38.655194+0000, chain.objs.size()=1 2024-03-09T15:07:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.v2g4MDEhbWwc2JvZjv8FckkNV_mnJWA_0 2024-03-09T15:07:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14909952154407003101', time=2024-03-09T16:56:38.817983+0000, chain.objs.size()=1 2024-03-09T15:07:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.kCEcbAXMZYiE6nLfvJwnRk26IXuf6sm_0 2024-03-09T15:07:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17595037188398623774', time=2024-03-09T16:56:38.869449+0000, chain.objs.size()=1 2024-03-09T15:07:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.8TXIgXFJojm1Wp_OLeFH5L_2zPjL4VJ_0 2024-03-09T15:07:05.153 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.168821496072050556', time=2024-03-09T16:56:38.922401+0000, chain.objs.size()=1 2024-03-09T15:07:05.154 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.GGVj2V5RSfbGIjuDgxcr8Gd33t8bW8E_0 2024-03-09T15:07:05.155 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7405767618307800835', time=2024-03-09T16:56:39.050675+0000, chain.objs.size()=1 2024-03-09T15:07:05.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.qgwxqgswITJpVrWhjZOMi37WleBVp5w_0 2024-03-09T15:07:05.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3416704849318940096', time=2024-03-09T16:56:39.072687+0000, chain.objs.size()=1 2024-03-09T15:07:05.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ZfzcQwyMhrRXvMx3WOLH4OZuDGHC7fL_0 2024-03-09T15:07:05.156 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11273001720215305860', time=2024-03-09T16:56:39.183582+0000, chain.objs.size()=1 2024-03-09T15:07:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.k2qg7xj73kQW9dteFe82tje10tHgRC2_0 2024-03-09T15:07:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5569489085580393381', time=2024-03-09T16:56:39.186460+0000, chain.objs.size()=1 2024-03-09T15:07:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.154+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.7MushJsDxufEFZdVcC21Z9sMuu4Rpxc_0 2024-03-09T15:07:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.158+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14961088411574460034', time=2024-03-09T16:56:39.339648+0000, chain.objs.size()=1 2024-03-09T15:07:05.157 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.158+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.2Gn_q6Qos95iNsjJOIH-1UHGYyTnllc_0 2024-03-09T15:07:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.158+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13245950334310684512', time=2024-03-09T16:56:39.419508+0000, chain.objs.size()=1 2024-03-09T15:07:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.158+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.TRy0nTohs1vtz5YOINpFULuIWxFUOLd_0 2024-03-09T15:07:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.158+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16803027491353772695', time=2024-03-09T16:56:39.452458+0000, chain.objs.size()=1 2024-03-09T15:07:05.158 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.158+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Idzj592dYLc3o1dCYDUmM7tRsl_pU6n_0 2024-03-09T15:07:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.158+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13661342519495149328', time=2024-03-09T16:56:39.564928+0000, chain.objs.size()=1 2024-03-09T15:07:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.158+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.fHBCJzFqs-y_ClGUMKmMS66G0E0oje-_0 2024-03-09T15:07:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.158+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4633085497515334439', time=2024-03-09T16:56:39.593941+0000, chain.objs.size()=1 2024-03-09T15:07:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.158+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.O1AFkqdHsjowzsjItqTJjA2_lrVLwLi_0 2024-03-09T15:07:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.158+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12484108403653858596', time=2024-03-09T16:56:39.597509+0000, chain.objs.size()=1 2024-03-09T15:07:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.158+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0VwZB9Hekh_3FVuaHtAkkJrGEB3vYp9_0 2024-03-09T15:07:05.159 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.158+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5359681572690145781', time=2024-03-09T16:56:39.617587+0000, chain.objs.size()=1 2024-03-09T15:07:05.160 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.158+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.TO1hYKhvYFvW8yRWjGoMgvVbYg_dXMB_0 2024-03-09T15:07:05.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6510656656438166430', time=2024-03-09T16:56:39.678440+0000, chain.objs.size()=1 2024-03-09T15:07:05.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Jt2nbdYrcPUxFjVBh0XeoU8DLtiHB8t_0 2024-03-09T15:07:05.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10718646167993983040', time=2024-03-09T16:57:01.472811+0000, chain.objs.size()=1 2024-03-09T15:07:05.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.al5xFd5cxUcFVPyU3fz2JmLVB6dA6QT_0 2024-03-09T15:07:05.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6765940467859123490', time=2024-03-09T16:57:01.523411+0000, chain.objs.size()=1 2024-03-09T15:07:05.161 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.BBbQcvAZtIpkqDT4wjrvWLXAAcREeAx_0 2024-03-09T15:07:05.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3343618111692340406', time=2024-03-09T16:57:01.524548+0000, chain.objs.size()=1 2024-03-09T15:07:05.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.YibOVJdga9JUAvpQ_AAnBfXuP-19iGB_0 2024-03-09T15:07:05.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11900173725656213790', time=2024-03-09T16:57:01.542203+0000, chain.objs.size()=1 2024-03-09T15:07:05.162 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.UnhUkBAKzZ_lHc71VLD6eV9E5kn44xv_0 2024-03-09T15:07:05.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4168236726937794769', time=2024-03-09T16:57:01.745921+0000, chain.objs.size()=1 2024-03-09T15:07:05.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.HwHW1bW8VFu3FFjMUhh1CpaY1bKwJ19_0 2024-03-09T15:07:05.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12979281551384959359', time=2024-03-09T16:57:01.804467+0000, chain.objs.size()=1 2024-03-09T15:07:05.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.kQr5hQUmQ0Xe3s2Tb5Oea7AsVxDruq1_0 2024-03-09T15:07:05.163 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15501916641543966607', time=2024-03-09T16:57:01.807191+0000, chain.objs.size()=1 2024-03-09T15:07:05.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.q9Vse3HrM9zg1at7JcO_3uBhmW5yY51_0 2024-03-09T15:07:05.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1440467834352211721', time=2024-03-09T16:57:01.974314+0000, chain.objs.size()=1 2024-03-09T15:07:05.164 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.162+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_._2GeJKgAV9UIvHIPkEbz3lMMzALWVqY_0 2024-03-09T15:07:05.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.166+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8662638801280356990', time=2024-03-09T16:57:02.041675+0000, chain.objs.size()=1 2024-03-09T15:07:05.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.166+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.sJC4wKQ19k64jIKGgBKjkH-iRRlwjVy_0 2024-03-09T15:07:05.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.166+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4156830267543493958', time=2024-03-09T16:57:02.066191+0000, chain.objs.size()=1 2024-03-09T15:07:05.165 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.166+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.A828B7vfAtGULe9Uf6f-x_2wHDZRjDe_0 2024-03-09T15:07:05.168 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6495381962460153666', time=2024-03-09T16:57:02.091442+0000, chain.objs.size()=1 2024-03-09T15:07:05.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.FQPLiMxIRtUXIHC7VArqDj2ZOJaLXCi_0 2024-03-09T15:07:05.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1515660917733264567', time=2024-03-09T16:57:02.095580+0000, chain.objs.size()=1 2024-03-09T15:07:05.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.lqnav50wYnG0R7UNDOgFq1aVc46i2qW_0 2024-03-09T15:07:05.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13394670530351264652', time=2024-03-09T16:57:02.098040+0000, chain.objs.size()=1 2024-03-09T15:07:05.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xPtgnenmO6jELoCEFbTjHLUQBAk45JO_0 2024-03-09T15:07:05.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9281689103890061898', time=2024-03-09T16:57:02.316420+0000, chain.objs.size()=1 2024-03-09T15:07:05.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.j6eYvXx9r6Xd3Z3HCN8sB-uF_yYvGV8_0 2024-03-09T15:07:05.169 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4567752441272272643', time=2024-03-09T16:57:02.551474+0000, chain.objs.size()=1 2024-03-09T15:07:05.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.kdTAMsCUNMAuimgbhcCzKpxlS2-nu2n_0 2024-03-09T15:07:05.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12961495495214524480', time=2024-03-09T16:57:02.559655+0000, chain.objs.size()=1 2024-03-09T15:07:05.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ycYqEMluKlaxVlUVtbpA-84FuXFawci_0 2024-03-09T15:07:05.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2742795827288832749', time=2024-03-09T16:57:02.560752+0000, chain.objs.size()=1 2024-03-09T15:07:05.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ddzb9Mayo6QExN90_4ZQIMRNVwc13J7_0 2024-03-09T15:07:05.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2622979209217038961', time=2024-03-09T16:57:02.563122+0000, chain.objs.size()=1 2024-03-09T15:07:05.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_._sGEdSNsCG9MbI5PwvfKg-qKABMJAx__0 2024-03-09T15:07:05.170 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8966049961886378304', time=2024-03-09T16:57:02.581574+0000, chain.objs.size()=1 2024-03-09T15:07:05.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.XtybZczmzFeV5R0WS9_-C3rYkOiVshF_0 2024-03-09T15:07:05.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17865261055244470355', time=2024-03-09T16:57:02.635598+0000, chain.objs.size()=1 2024-03-09T15:07:05.171 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.170+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.WphjJdKsXhm3gTIrFGcZISeYjeZNLcZ_0 2024-03-09T15:07:05.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.174+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1720435189929000014', time=2024-03-09T16:57:02.636315+0000, chain.objs.size()=1 2024-03-09T15:07:05.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.174+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.P_OzaNHojrrNCdt9JB8MFtELfK6AyRm_0 2024-03-09T15:07:05.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.174+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2963120382195731256', time=2024-03-09T16:57:02.729419+0000, chain.objs.size()=1 2024-03-09T15:07:05.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.174+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.N56kXtqZsdB4myChUI1_g1o5E5HnudI_0 2024-03-09T15:07:05.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.174+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4488475260856956384', time=2024-03-09T16:57:02.731306+0000, chain.objs.size()=1 2024-03-09T15:07:05.175 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.174+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Bl3LK_EhBev8V4P3uq4VPnp1Wq6Eh4I_0 2024-03-09T15:07:05.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4314083077741989565', time=2024-03-09T16:57:02.763127+0000, chain.objs.size()=1 2024-03-09T15:07:05.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.TRxNsunmuihYBWIktANCok4oXJvpkAk_0 2024-03-09T15:07:05.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16063473346904775405', time=2024-03-09T16:57:02.781269+0000, chain.objs.size()=1 2024-03-09T15:07:05.176 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Kf5Vu1MgLPaQ7wnNlgNidH5nSQyzTGm_0 2024-03-09T15:07:05.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4052941316732486632', time=2024-03-09T16:57:02.805133+0000, chain.objs.size()=1 2024-03-09T15:07:05.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ktfJDOhVuUIzWgPcKfA3H3Fr9iFzGIy_0 2024-03-09T15:07:05.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11159029088684112539', time=2024-03-09T16:57:02.875714+0000, chain.objs.size()=1 2024-03-09T15:07:05.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.vLV_UG1jWnkQidnjcXPetEbfHR4gSJE_0 2024-03-09T15:07:05.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17716048138847437542', time=2024-03-09T16:57:02.978417+0000, chain.objs.size()=1 2024-03-09T15:07:05.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.swREv9IruNJAe05w1m2Kq0XNG-S-qLZ_0 2024-03-09T15:07:05.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10692452295359457883', time=2024-03-09T16:57:03.078724+0000, chain.objs.size()=1 2024-03-09T15:07:05.177 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.q__YXtXu3jsk9ptedrPsDR6HEtXHZTd_0 2024-03-09T15:07:05.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10774949903961802315', time=2024-03-09T16:57:03.102182+0000, chain.objs.size()=1 2024-03-09T15:07:05.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.QP2f2HUdORuOp4uMmQPPMfAiNMcaX0s_0 2024-03-09T15:07:05.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9909406756983603945', time=2024-03-09T16:57:03.306670+0000, chain.objs.size()=1 2024-03-09T15:07:05.178 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.sBFFJICzfSo6Q5592dX9rGXC8bs4Rrg_0 2024-03-09T15:07:05.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13425960569738592574', time=2024-03-09T16:57:03.310685+0000, chain.objs.size()=1 2024-03-09T15:07:05.179 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.178+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.MqExSXEY9MpjQYyijZHHR8t_Mtntl56_0 2024-03-09T15:07:05.180 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17217132516306652959', time=2024-03-09T16:57:03.388864+0000, chain.objs.size()=1 2024-03-09T15:07:05.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.KO-T-60sc0P3N_ZAXIddNQTInnqwFn8_0 2024-03-09T15:07:05.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11312547739194678342', time=2024-03-09T16:57:08.808024+0000, chain.objs.size()=1 2024-03-09T15:07:05.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.324__shadow_.0oWRIXP2dWBy42hOzGEv9EXSL2eGs1S_0 2024-03-09T15:07:05.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.182+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6276121609992791539', time=2024-03-09T16:57:49.929754+0000, chain.objs.size()=1 2024-03-09T15:07:05.181 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.182+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.371__shadow_.MHPxNf-0XFweLCr40oBxLSIMm9Da_1h_0 2024-03-09T15:07:05.184 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/49216 2024-03-09T15:07:05.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-03-09T15:07:05.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17165043990865754559', time=2024-03-09T16:57:57.015732+0000, chain.objs.size()=1 2024-03-09T15:07:05.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.378__shadow_.iIcViXT04RUtMzVL1pindQvjgYr4DSl_0 2024-03-09T15:07:05.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1265021642982342107', time=2024-03-09T16:58:20.848145+0000, chain.objs.size()=1 2024-03-09T15:07:05.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.403__shadow_.LYBsBscu2de35Jy6vaYEKCXgUpijoDz_0 2024-03-09T15:07:05.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8624967062713968319', time=2024-03-09T16:58:43.457618+0000, chain.objs.size()=1 2024-03-09T15:07:05.187 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.425__shadow_.RgG0G1TCB61OQpyPLeZmaFIA7b8ukXu_0 2024-03-09T15:07:05.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2408752791086868918', time=2024-03-09T16:59:20.643487+0000, chain.objs.size()=1 2024-03-09T15:07:05.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.460__shadow_.DE1BCaLz0QB6tzS2U4S46C0jlTW4-Aw_0 2024-03-09T15:07:05.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.497__shadow:sTyMyf-pYbnbXvdieipjbZDtyAqnZAv_.YDOx1qoYlCKjXydeFP7D4JWYzcC9wbk_1_1f88b99f9113b4d3e1aedcb1da88c98c', time=2024-03-09T16:59:48.697212+0000, chain.objs.size()=1 2024-03-09T15:07:05.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.497__shadow:sTyMyf-pYbnbXvdieipjbZDtyAqnZAv_.YDOx1qoYlCKjXydeFP7D4JWYzcC9wbk_0 2024-03-09T15:07:05.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.2_fc3097192abba71ad0eac1bdfacea5b4', time=2024-03-09T16:59:53.531537+0000, chain.objs.size()=6 2024-03-09T15:07:05.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.1 2024-03-09T15:07:05.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.2 2024-03-09T15:07:05.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.3 2024-03-09T15:07:05.188 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.4 2024-03-09T15:07:05.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.5 2024-03-09T15:07:05.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.501__multipart_srcmultipart.2~rOzqP6MfNPkGrpFrPEQa1RxZfSp5MF_.6 2024-03-09T15:07:05.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9558459507754774214', time=2024-03-09T16:59:57.054252+0000, chain.objs.size()=1 2024-03-09T15:07:05.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.186+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.507__multipart_mymultipart.2~VH5--Nbw_5vkuZNr9jDxdqai1IniyQr.1 2024-03-09T15:07:05.189 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18015052587721108547', time=2024-03-09T17:00:38.541000+0000, chain.objs.size()=4 2024-03-09T15:07:05.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.521__multipart_mymultipart.2~agseu9sBkvxH0zs8Rd_ifRwW0LquNDP.1 2024-03-09T15:07:05.190 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.521__multipart_mymultipart.2~agseu9sBkvxH0zs8Rd_ifRwW0LquNDP.2 2024-03-09T15:07:05.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.521__multipart_mymultipart.2~agseu9sBkvxH0zs8Rd_ifRwW0LquNDP.3 2024-03-09T15:07:05.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.521__multipart_mymultipart.2~agseu9sBkvxH0zs8Rd_ifRwW0LquNDP.4 2024-03-09T15:07:05.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='2~NLNRbsIxDT6iXmW6BZiNMpjJddVF7mu', time=2024-03-09T17:00:40.957006+0000, chain.objs.size()=2 2024-03-09T15:07:05.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.523__multipart_mymultipart.2~NLNRbsIxDT6iXmW6BZiNMpjJddVF7mu.1 2024-03-09T15:07:05.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.523__multipart_mymultipart.2~NLNRbsIxDT6iXmW6BZiNMpjJddVF7mu.2 2024-03-09T15:07:05.191 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9719886929984126731', time=2024-03-09T17:01:52.726724+0000, chain.objs.size()=1 2024-03-09T15:07:05.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:9y6TWTaOzDBQNuGtlAA0sU43tZk-tN8_.eiGAlN55yek9p1jS8OtBZB0U3p5RAFE_0 2024-03-09T15:07:05.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2606312952125384985', time=2024-03-09T17:02:00.806858+0000, chain.objs.size()=1 2024-03-09T15:07:05.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.563__shadow:p5Xotsr96MPPvMzEWVMS0X1MNWgTBN2_.ubwNT7yMhnvTw-M2gXKAT0Vx3bVPhne_0 2024-03-09T15:07:05.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9603758749168101118', time=2024-03-09T17:02:18.410772+0000, chain.objs.size()=1 2024-03-09T15:07:05.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:H2Th9C-GwHOIPRu4Ct8S.Zi9.fX937S_.zUym6AnQfLyXQmY5Lj-WC4zo6PDlGvq_0 2024-03-09T15:07:05.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14454092103461141534', time=2024-03-09T17:02:24.422153+0000, chain.objs.size()=1 2024-03-09T15:07:05.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:02QAdLBkIj8dxOwCmlYgtzUjWNmCKj5_.tkcGEdRS_DJWl48e__QD_M5EDjS9jcN_0 2024-03-09T15:07:05.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13628288871130699756', time=2024-03-09T17:02:26.882489+0000, chain.objs.size()=1 2024-03-09T15:07:05.192 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.190+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.570__shadow:m4ugBMpzL6U1GVzRWoXpHs5QlW-sq6-_.FpklV3UcRXDmz_6-GNAKG8xGQZhFg6f_0 2024-03-09T15:07:05.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.194+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11202433416500103208', time=2024-03-09T17:02:37.571127+0000, chain.objs.size()=1 2024-03-09T15:07:05.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.194+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.572__shadow:GFW67aGTIW9JxvxmZcHxFv3C0lgQt.x_.VN48fbppEG9sSSMGfHaRaIRf6f2eN1r_0 2024-03-09T15:07:05.194 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.194+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.573__shadow:MfJmlB2qzbbM5BVYhjWeizee4Czmi8m_.9OZvTSdS9Hkz2yUS1Dt2DaHzpXpaSrB_1_1736e1b7bd0d9d3682b15a5dcc34c145', time=2024-03-09T17:02:39.633932+0000, chain.objs.size()=1 2024-03-09T15:07:05.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.194+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.573__shadow:MfJmlB2qzbbM5BVYhjWeizee4Czmi8m_.9OZvTSdS9Hkz2yUS1Dt2DaHzpXpaSrB_0 2024-03-09T15:07:05.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.194+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16833744977055290863', time=2024-03-09T17:03:35.201037+0000, chain.objs.size()=1 2024-03-09T15:07:05.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.194+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.618__shadow_.h4I2Ts_dpNGgieC7OrCIPvCs5-VNnjZ_0 2024-03-09T15:07:05.195 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.194+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15447879575124419656', time=2024-03-09T17:03:40.675949+0000, chain.objs.size()=1 2024-03-09T15:07:05.196 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.194+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.624__shadow_.ORL1bE9QcB1PLr41kQi6Zxyma_zdQVK_0 2024-03-09T15:07:05.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1610722183529096514', time=2024-03-09T17:04:00.456248+0000, chain.objs.size()=1 2024-03-09T15:07:05.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.644__shadow_.VmpLzdOplLyeZzLiV590lcmMx3YC7dG_0 2024-03-09T15:07:05.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.655__shadow_.AFGd2TRkCvAyUQUZcKSeEZvRf1GePPR_1_847038ace70cc1b0a16f216f76f0cd80', time=2024-03-09T17:04:12.347911+0000, chain.objs.size()=1 2024-03-09T15:07:05.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.655__shadow_.AFGd2TRkCvAyUQUZcKSeEZvRf1GePPR_0 2024-03-09T15:07:05.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.198+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6742412104999536788', time=2024-03-09T17:05:51.008762+0000, chain.objs.size()=1 2024-03-09T15:07:05.197 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.198+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.729__shadow_.lpMeMavTK0lbL05OyprRO9UcOg4vUE5_0 2024-03-09T15:07:05.202 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.202+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:05.205 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-09T15:07:05.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:05.206 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:05.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47607' 2024-03-09T15:07:05.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='_iC6c9gLx5Oq8znthdQrGNrL-k5tcO20', time=2024-03-09T16:51:54.118130+0000, chain.objs.size()=2 2024-03-09T15:07:05.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__shadow_.cU-ZC7yTuoeRjcvdwhybqwZvywE8BKm_0 2024-03-09T15:07:05.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__shadow_.cU-ZC7yTuoeRjcvdwhybqwZvywE8BKm_1 2024-03-09T15:07:05.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3572346063507396917', time=2024-03-09T16:51:56.079764+0000, chain.objs.size()=1 2024-03-09T15:07:05.208 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.156__shadow_.C3zL6tx5J0DzXdSnP1Qna1tsVRyzszC_0 2024-03-09T15:07:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8778756302576629834', time=2024-03-09T16:54:35.457091+0000, chain.objs.size()=1 2024-03-09T15:07:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.237__shadow_.VqMXmLupYIaUqXb1U0XCE6GrIPY4OhR_0 2024-03-09T15:07:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5925872476653774825', time=2024-03-09T16:54:38.754142+0000, chain.objs.size()=1 2024-03-09T15:07:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.240__shadow_.zde0uI4O0AQFIspK3ClTySw5qBBDqp1_0 2024-03-09T15:07:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8485586008986485462', time=2024-03-09T16:54:41.507855+0000, chain.objs.size()=1 2024-03-09T15:07:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.243__shadow_.7ueUct74SDszQEIKnTok5wxHlYYCGC-_0 2024-03-09T15:07:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10589920150367259964', time=2024-03-09T16:54:42.521102+0000, chain.objs.size()=1 2024-03-09T15:07:05.209 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.244__shadow_.KUgo2hV60Fwi9gL-rXtesUvnKLHIa75_0 2024-03-09T15:07:05.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12994542342445039401', time=2024-03-09T16:54:46.266081+0000, chain.objs.size()=1 2024-03-09T15:07:05.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.248__shadow_.X56WzLdlVC6xFWLnjSr4GNfSq761EXw_0 2024-03-09T15:07:05.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1415861155680111523', time=2024-03-09T16:54:49.087885+0000, chain.objs.size()=1 2024-03-09T15:07:05.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.251__shadow_.DF943Zo3Wuk9UupPuclka00aRZOVzOe_0 2024-03-09T15:07:05.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11195186906003566223', time=2024-03-09T16:54:51.966930+0000, chain.objs.size()=1 2024-03-09T15:07:05.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.254__shadow_.Fw80l_68JuoKzeEZWrxSHw7Wwvq7VNv_0 2024-03-09T15:07:05.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11388176372175140901', time=2024-03-09T16:55:14.870082+0000, chain.objs.size()=1 2024-03-09T15:07:05.210 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.KAvHwD7MEX4Vyuuh0RJNW-O8xDATu61_0 2024-03-09T15:07:05.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.53471176427642856', time=2024-03-09T16:55:14.895637+0000, chain.objs.size()=1 2024-03-09T15:07:05.211 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.206+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.j5ldRHiAB93SWLRak1zeiyU2x-uQ3af_0 2024-03-09T15:07:05.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17044810411958472226', time=2024-03-09T16:55:14.916249+0000, chain.objs.size()=1 2024-03-09T15:07:05.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6Cl8LZqWGTtgZNdsgTB5ad_GESiIoRP_0 2024-03-09T15:07:05.213 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9425407565215259042', time=2024-03-09T16:55:14.932957+0000, chain.objs.size()=1 2024-03-09T15:07:05.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.4_JjuhsFgAxHNULjMJ-Ywg42tK5h7h2_0 2024-03-09T15:07:05.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3624944109200791809', time=2024-03-09T16:55:14.943334+0000, chain.objs.size()=1 2024-03-09T15:07:05.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.uC3gWSVJNKqVb44lngLG_itzwUVaxt8_0 2024-03-09T15:07:05.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5479894935028163572', time=2024-03-09T16:55:14.993877+0000, chain.objs.size()=1 2024-03-09T15:07:05.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.CHKEEFWsDHWjEtBZQ3EbO7k4Ok83eul_0 2024-03-09T15:07:05.214 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13210199294379554441', time=2024-03-09T16:55:15.193433+0000, chain.objs.size()=1 2024-03-09T15:07:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.WWZNsUr7u8zOmuyVc1R0f9F6oH3dl1T_0 2024-03-09T15:07:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17776766667591794959', time=2024-03-09T16:55:15.246863+0000, chain.objs.size()=1 2024-03-09T15:07:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.wVUScTYbcuFFTvj50osOCyORqBBaNPc_0 2024-03-09T15:07:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8356545530720895531', time=2024-03-09T16:55:15.266226+0000, chain.objs.size()=1 2024-03-09T15:07:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.zROyYsDaUlN6Fqd-5Di-TK0w1xFL7cM_0 2024-03-09T15:07:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17047895951347029757', time=2024-03-09T16:55:15.289966+0000, chain.objs.size()=1 2024-03-09T15:07:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.-hjRJ8XhS83-KNYkG9vZKLsO5MEKkTb_0 2024-03-09T15:07:05.215 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12774615904057154364', time=2024-03-09T16:55:15.471108+0000, chain.objs.size()=1 2024-03-09T15:07:05.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.eiqTVw_Np-0e8_KhLuLiDVrckZss7No_0 2024-03-09T15:07:05.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5921028063526577703', time=2024-03-09T16:55:15.481640+0000, chain.objs.size()=1 2024-03-09T15:07:05.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.g-8-2A1YF8oHN25VukVcA-z1QO656_D_0 2024-03-09T15:07:05.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17500867813900980393', time=2024-03-09T16:55:15.495746+0000, chain.objs.size()=1 2024-03-09T15:07:05.216 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.214+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Uu18XXyJlE7WMkg6vvnRIXeBVC-P6SZ_0 2024-03-09T15:07:05.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.756915543142336878', time=2024-03-09T16:55:15.515927+0000, chain.objs.size()=1 2024-03-09T15:07:05.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.vLzCvRPD_4O1YjhgPrG9eYWGr1tpQjT_0 2024-03-09T15:07:05.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10560608336857342412', time=2024-03-09T16:55:15.546523+0000, chain.objs.size()=1 2024-03-09T15:07:05.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.C-w2dLge-67of_dKgqHI0V-2s4pY0dy_0 2024-03-09T15:07:05.217 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5875834406120539803', time=2024-03-09T16:55:15.710581+0000, chain.objs.size()=1 2024-03-09T15:07:05.218 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.eAy3n2GjVFmpnDFyA1vEvstglz4mtfl_0 2024-03-09T15:07:05.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12828188833351261266', time=2024-03-09T16:55:15.744147+0000, chain.objs.size()=1 2024-03-09T15:07:05.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.GOWV8msU5pAFLK2C67hRKLuE4cHStVG_0 2024-03-09T15:07:05.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2402092623376550400', time=2024-03-09T16:55:15.765574+0000, chain.objs.size()=1 2024-03-09T15:07:05.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.BA0HC-EVQlJ_CnSh9U2xMu1rmpCjpPM_0 2024-03-09T15:07:05.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7637731039403058331', time=2024-03-09T16:55:15.823343+0000, chain.objs.size()=1 2024-03-09T15:07:05.219 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.J69f24slb8wSAXCX2D5wfGCPybZ-bs1_0 2024-03-09T15:07:05.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6988278263638318532', time=2024-03-09T16:55:15.941724+0000, chain.objs.size()=1 2024-03-09T15:07:05.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.I0wCKF-QKutqD43cV8HwIb0EIiNEvwE_0 2024-03-09T15:07:05.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12223358164189477970', time=2024-03-09T16:55:16.079309+0000, chain.objs.size()=1 2024-03-09T15:07:05.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.lWBdIEP7ADwuyObhNbOfgUiiCi-vVgy_0 2024-03-09T15:07:05.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4760290855038701014', time=2024-03-09T16:55:16.213617+0000, chain.objs.size()=1 2024-03-09T15:07:05.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.5r1DPJtoM6nk5E5TVNc6YENqo8gAJnR_0 2024-03-09T15:07:05.220 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11977918443305667054', time=2024-03-09T16:55:16.242873+0000, chain.objs.size()=1 2024-03-09T15:07:05.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.-4jkmYpbp-QWBHHiA02AzEht6A2p6Mw_0 2024-03-09T15:07:05.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13137227430847186627', time=2024-03-09T16:55:16.281786+0000, chain.objs.size()=1 2024-03-09T15:07:05.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.218+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.bkQXRfewNw4pE3rXAu3VjW9k9yF5L4Q_0 2024-03-09T15:07:05.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.222+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5266250689238332270', time=2024-03-09T16:55:16.294906+0000, chain.objs.size()=1 2024-03-09T15:07:05.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.222+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.EETf1Sq2Bn4t7aNg3iw5TDNO0k2QLsI_0 2024-03-09T15:07:05.221 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.222+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2724148127364089809', time=2024-03-09T16:55:16.312098+0000, chain.objs.size()=1 2024-03-09T15:07:05.222 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.222+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.S2jd6lJ75Wb9tjqx4rzqcl9aqUNjGhC_0 2024-03-09T15:07:05.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.222+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9795860307654827545', time=2024-03-09T16:55:16.321619+0000, chain.objs.size()=1 2024-03-09T15:07:05.223 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.222+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.5J58ftqJ406DzQd47x-X29XseHceBzA_0 2024-03-09T15:07:05.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.222+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15462033888051045560', time=2024-03-09T16:55:16.331564+0000, chain.objs.size()=1 2024-03-09T15:07:05.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.222+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Q0Eek19qBn5-CY4ldnwtInzD6adLJKA_0 2024-03-09T15:07:05.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.222+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11047995786120617891', time=2024-03-09T16:55:16.504528+0000, chain.objs.size()=1 2024-03-09T15:07:05.224 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.222+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.rRJ5IMCX0xujeLiLZKsnQEkWi0WJMnB_0 2024-03-09T15:07:05.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.222+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4595850558393602320', time=2024-03-09T16:55:16.537702+0000, chain.objs.size()=1 2024-03-09T15:07:05.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.222+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.VvjzZd7Qy6uylCSAK87UlJBM2XaJ1O5_0 2024-03-09T15:07:05.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.226+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15063110014103945833', time=2024-03-09T16:55:16.561385+0000, chain.objs.size()=1 2024-03-09T15:07:05.225 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.226+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.iI3FwUGxvWVjJlVjGMXE2gag1nTM9cn_0 2024-03-09T15:07:05.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.226+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3702104988049571610', time=2024-03-09T16:55:16.571462+0000, chain.objs.size()=1 2024-03-09T15:07:05.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.226+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.EWKEN_SXdMHwhoI4XoRPbHdjJbNRqgC_0 2024-03-09T15:07:05.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.226+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3189751039970744006', time=2024-03-09T16:55:16.576828+0000, chain.objs.size()=1 2024-03-09T15:07:05.226 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.226+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.OMKcZizRBhXQcpCORHmD496k6jZOK3b_0 2024-03-09T15:07:05.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.226+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9427975432439583687', time=2024-03-09T16:55:16.604335+0000, chain.objs.size()=1 2024-03-09T15:07:05.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.226+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.eiVm_upnwTuceA_SoIXVW6h9EXpdIxx_0 2024-03-09T15:07:05.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.226+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17444443805022790400', time=2024-03-09T16:55:16.607893+0000, chain.objs.size()=1 2024-03-09T15:07:05.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.226+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.vDD2JEbwKyWQE3sUPkTfCU15BkFTcbw_0 2024-03-09T15:07:05.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.226+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10872920234001448806', time=2024-03-09T16:55:16.623608+0000, chain.objs.size()=1 2024-03-09T15:07:05.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.226+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.vPmAnFQu_zQnoM7EYP9wE-kqO_WugVI_0 2024-03-09T15:07:05.227 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.226+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9747082081147414915', time=2024-03-09T16:55:16.722194+0000, chain.objs.size()=1 2024-03-09T15:07:05.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.226+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.ZV6jG2scJ6-fTUF3txtrfGFqgVVbfpK_0 2024-03-09T15:07:05.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.226+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17899428597061471886', time=2024-03-09T16:55:16.757070+0000, chain.objs.size()=1 2024-03-09T15:07:05.228 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.226+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.7Mdrcxb1BtBjcOdexxjMb1L3yDv-Q2w_0 2024-03-09T15:07:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.230+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.231415913707231081', time=2024-03-09T16:55:16.776457+0000, chain.objs.size()=1 2024-03-09T15:07:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.230+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_._TLxey1AAYnKiIhGbyRBZNXwG7XdetU_0 2024-03-09T15:07:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.230+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2485261495523026731', time=2024-03-09T16:55:16.780765+0000, chain.objs.size()=1 2024-03-09T15:07:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.230+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.qVrVpA-5OiQclmPr8puCt84pJJH3-66_0 2024-03-09T15:07:05.229 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.230+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6705081645057655230', time=2024-03-09T16:55:16.782745+0000, chain.objs.size()=1 2024-03-09T15:07:05.230 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.230+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.m4_iwTFCP8sUWd2XLpF6j4KEMJTTdfF_0 2024-03-09T15:07:05.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.230+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8426403941653817720', time=2024-03-09T16:55:16.795726+0000, chain.objs.size()=1 2024-03-09T15:07:05.231 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.230+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.dYQ9ETul1xhL13Gm2hTaXGMkD6tcRfx_0 2024-03-09T15:07:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.230+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6380573938220172950', time=2024-03-09T16:55:16.803365+0000, chain.objs.size()=1 2024-03-09T15:07:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.230+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.g-fw9uvYQKPfOoX1jvWuskaRvy5MELX_0 2024-03-09T15:07:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.230+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8784335240316303329', time=2024-03-09T16:55:16.812341+0000, chain.objs.size()=1 2024-03-09T15:07:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.230+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.zbFbaFBplH7CmE4yLVGkVI0ZLHiCUDB_0 2024-03-09T15:07:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.230+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14473573458766788586', time=2024-03-09T16:55:16.844411+0000, chain.objs.size()=1 2024-03-09T15:07:05.232 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.230+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Xj3xS4rSk3i0hoBcO1T9clkN9Vy7_n9_0 2024-03-09T15:07:05.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14613167342674166461', time=2024-03-09T16:55:22.253125+0000, chain.objs.size()=1 2024-03-09T15:07:05.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.262__shadow_.yKeQvccGYpARGgpRKQDkZZlFU8DqXLv_0 2024-03-09T15:07:05.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13653302325043639920', time=2024-03-09T16:55:25.041382+0000, chain.objs.size()=1 2024-03-09T15:07:05.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.265__shadow_.mM2timJDtnO8VZXOfYB-xRnGwnWhM-U_0 2024-03-09T15:07:05.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9154143092664803226', time=2024-03-09T16:55:28.723610+0000, chain.objs.size()=1 2024-03-09T15:07:05.233 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.269__shadow_.qicjxrK1JerokaENOajFbZoM26w05ZA_0 2024-03-09T15:07:05.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11320298779152692659', time=2024-03-09T16:55:50.636854+0000, chain.objs.size()=1 2024-03-09T15:07:05.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.290__shadow_.IqMXYtR1L1ud_mTEkRjUkW243THBb28_0 2024-03-09T15:07:05.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14786818215075225427', time=2024-03-09T16:55:52.656724+0000, chain.objs.size()=1 2024-03-09T15:07:05.234 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.292__shadow_.cU5kMpj7-AEFIUArsj6bAg-I8HU8Hht_0 2024-03-09T15:07:05.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16655766964256183403', time=2024-03-09T16:55:59.295763+0000, chain.objs.size()=1 2024-03-09T15:07:05.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.299__shadow_.87hFPrWf4JIouH2ThhZPyiii0YVYpd0_0 2024-03-09T15:07:05.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2298287996318330572', time=2024-03-09T16:56:37.715421+0000, chain.objs.size()=1 2024-03-09T15:07:05.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Y8g5giENVCBYIPQdSL9r6hxRkONSq5k_0 2024-03-09T15:07:05.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.234+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15008446584079738307', time=2024-03-09T16:56:38.006839+0000, chain.objs.size()=1 2024-03-09T15:07:05.235 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.234+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.uSfX7UWSwUOPWM0EJmAh4gsuMW4DvY4_0 2024-03-09T15:07:05.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7653273142284995914', time=2024-03-09T16:56:38.064596+0000, chain.objs.size()=1 2024-03-09T15:07:05.236 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.UtwI55R1yzNfvIcDbtaGNQFGdxDVUyb_0 2024-03-09T15:07:05.237 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16973174523490502913', time=2024-03-09T16:56:38.103506+0000, chain.objs.size()=1 2024-03-09T15:07:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.O-ZMxRw8Nv5wGFiWCrRSCbUslx221f8_0 2024-03-09T15:07:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12889794782297880909', time=2024-03-09T16:56:38.291679+0000, chain.objs.size()=1 2024-03-09T15:07:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.7gZaW7fzaKXSeUTYwr74e6SrNV3ht55_0 2024-03-09T15:07:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10677190748379218385', time=2024-03-09T16:56:38.298029+0000, chain.objs.size()=1 2024-03-09T15:07:05.238 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.3R9zkSAxrAeyst1ovFwP9BsN0yCxcEm_0 2024-03-09T15:07:05.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2391530400097868826', time=2024-03-09T16:56:38.316218+0000, chain.objs.size()=1 2024-03-09T15:07:05.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.akits6irQsCbHc1RTNFSwWc0P2BLrVN_0 2024-03-09T15:07:05.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9985186071480851702', time=2024-03-09T16:56:38.364574+0000, chain.objs.size()=1 2024-03-09T15:07:05.239 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.bRP99AFy-x9LMNt3momi8fZtMR4WFps_0 2024-03-09T15:07:05.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7871138927285583082', time=2024-03-09T16:56:38.507609+0000, chain.objs.size()=1 2024-03-09T15:07:05.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.g-mPOpcnv3A2gMua7JltOhRhW838nMq_0 2024-03-09T15:07:05.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1769565050308104123', time=2024-03-09T16:56:38.538673+0000, chain.objs.size()=1 2024-03-09T15:07:05.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.CyNNfDfQLYsP27n8XQMcLwJaMkKX-JG_0 2024-03-09T15:07:05.240 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7297738159920647498', time=2024-03-09T16:56:38.885994+0000, chain.objs.size()=1 2024-03-09T15:07:05.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.nGbcd5aQHRAVtkNgcxkNzCD4W5sx2pA_0 2024-03-09T15:07:05.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3006139433397933748', time=2024-03-09T16:56:39.040332+0000, chain.objs.size()=1 2024-03-09T15:07:05.241 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.238+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.UQ_bb74hdvFzuz2BTbNBoJvLxUlos9I_0 2024-03-09T15:07:05.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.242+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13520044248230625378', time=2024-03-09T16:56:39.143942+0000, chain.objs.size()=1 2024-03-09T15:07:05.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.242+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.G-0P2ggWz6PmSlmcsBKemzhjNU03XMF_0 2024-03-09T15:07:05.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.242+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8466029800405031836', time=2024-03-09T16:56:39.312057+0000, chain.objs.size()=1 2024-03-09T15:07:05.242 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.242+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.d_Zpxy5TGqYFw2RxkY3kirMD9EW-K06_0 2024-03-09T15:07:05.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.242+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2918363118356764292', time=2024-03-09T16:56:39.317491+0000, chain.objs.size()=1 2024-03-09T15:07:05.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.242+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.rpr9sNgrEsB6VlyNmPdWPLttAuGiS7J_0 2024-03-09T15:07:05.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.242+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14912293546233537560', time=2024-03-09T16:56:39.344639+0000, chain.objs.size()=1 2024-03-09T15:07:05.243 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.242+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.hgn5YEcAoU29f7MMPKtsvEkYj82e5NA_0 2024-03-09T15:07:05.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.242+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6496853251528095697', time=2024-03-09T16:56:39.359905+0000, chain.objs.size()=1 2024-03-09T15:07:05.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.242+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ky9k7u9Bbdqho1alr7LcXE8pUXrTQmT_0 2024-03-09T15:07:05.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.242+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6807501422088649924', time=2024-03-09T16:56:39.379732+0000, chain.objs.size()=1 2024-03-09T15:07:05.244 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.242+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Dj9HY1SGpWN_fGcHF4mHvr8f_4DxLR6_0 2024-03-09T15:07:05.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16957867198243090008', time=2024-03-09T16:56:39.397089+0000, chain.objs.size()=1 2024-03-09T15:07:05.245 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.yXSHh1FJp7e76OIhDqY-BUZSjQpGN1g_0 2024-03-09T15:07:05.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17226561832163788518', time=2024-03-09T16:56:39.418659+0000, chain.objs.size()=1 2024-03-09T15:07:05.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.XgL9Gggh3tKMSMb8jfTklYXf4nlRHad_0 2024-03-09T15:07:05.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14040816752423308714', time=2024-03-09T16:56:39.422188+0000, chain.objs.size()=1 2024-03-09T15:07:05.247 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.o2oK3JgXVqSmCtBuQHvI6l6CF7EjYkQ_0 2024-03-09T15:07:05.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2549977985058477731', time=2024-03-09T16:56:39.559039+0000, chain.objs.size()=1 2024-03-09T15:07:05.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.svtGZnqzpQxCaHA7V71XZDqhBPPl3P__0 2024-03-09T15:07:05.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2661620458338006236', time=2024-03-09T16:56:39.561284+0000, chain.objs.size()=1 2024-03-09T15:07:05.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Q7KHKm8sSSdVD5h70ShIXqj1Eah7YT__0 2024-03-09T15:07:05.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2680580252356100019', time=2024-03-09T16:56:39.628282+0000, chain.objs.size()=1 2024-03-09T15:07:05.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.peIp_vDz3tqHC6zV8eId4rchAOY6Xuc_0 2024-03-09T15:07:05.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10695867772422647040', time=2024-03-09T16:57:01.459889+0000, chain.objs.size()=1 2024-03-09T15:07:05.248 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.fLqnofD5PYnAv_9TY-ltXMPCtJcMdPc_0 2024-03-09T15:07:05.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2608368898191706684', time=2024-03-09T16:57:01.516171+0000, chain.objs.size()=1 2024-03-09T15:07:05.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.aFsjwmOWK30TBremB9ga6DzAuVLmqAX_0 2024-03-09T15:07:05.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15390446054200713028', time=2024-03-09T16:57:01.520610+0000, chain.objs.size()=1 2024-03-09T15:07:05.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.246+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.LxbjDae8jvnJjayHmWW-BrL61VJ2AOh_0 2024-03-09T15:07:05.249 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.250+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9787838938192289135', time=2024-03-09T16:57:01.538638+0000, chain.objs.size()=1 2024-03-09T15:07:05.250 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.250+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Rafbu-b-9TknSW6xOdxsYpKAwrBeYOq_0 2024-03-09T15:07:05.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.254+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15148239040911520539', time=2024-03-09T16:57:01.546009+0000, chain.objs.size()=1 2024-03-09T15:07:05.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.254+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ATkE1G8gWRVnjYLvDFPVDT5oPFo_nWI_0 2024-03-09T15:07:05.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.254+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5850105276206582441', time=2024-03-09T16:57:01.771047+0000, chain.objs.size()=1 2024-03-09T15:07:05.254 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.254+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.-yBMyyXKWU18evYJIGvKDnI2Fb4s5Zz_0 2024-03-09T15:07:05.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.254+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11541264139604798166', time=2024-03-09T16:57:01.772888+0000, chain.objs.size()=1 2024-03-09T15:07:05.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.254+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.fFSkWKNN-sc-bt2WTEyilLdQEnePSYt_0 2024-03-09T15:07:05.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.254+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17155578897651088826', time=2024-03-09T16:57:01.781904+0000, chain.objs.size()=1 2024-03-09T15:07:05.255 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.254+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.uUsBnsTbAnEVnIjlBfT142j6OyEZufz_0 2024-03-09T15:07:05.257 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.258+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16601556607435082070', time=2024-03-09T16:57:01.814839+0000, chain.objs.size()=1 2024-03-09T15:07:05.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.258+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.wiX7BkDXqqRLaecm20GXkb8RcvuvA_V_0 2024-03-09T15:07:05.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.258+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3059191134267074402', time=2024-03-09T16:57:01.817925+0000, chain.objs.size()=1 2024-03-09T15:07:05.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.258+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.hTZo70ch0mqoyHkvlvvRU_OH9F6IYh1_0 2024-03-09T15:07:05.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.258+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2851420285036547402', time=2024-03-09T16:57:01.849639+0000, chain.objs.size()=1 2024-03-09T15:07:05.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.258+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.tJxHv3cUJ822pOwRzJNP56wVuXyEB33_0 2024-03-09T15:07:05.258 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.258+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15284769015054920305', time=2024-03-09T16:57:01.853500+0000, chain.objs.size()=1 2024-03-09T15:07:05.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.258+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.c9MwDAqdHw3NQ78zx4aTwGeLLlcI6-q_0 2024-03-09T15:07:05.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.258+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17135619560284581234', time=2024-03-09T16:57:01.854294+0000, chain.objs.size()=1 2024-03-09T15:07:05.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.258+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.z4nwO_Y7DcWYWkkVEfYtxKnSIaMLmad_0 2024-03-09T15:07:05.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.258+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5057633383376717631', time=2024-03-09T16:57:02.049644+0000, chain.objs.size()=1 2024-03-09T15:07:05.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.258+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Nb7wByRuYbEanZtrrPkJBoMepCoyH9q_0 2024-03-09T15:07:05.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.258+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12933509045969267156', time=2024-03-09T16:57:02.212659+0000, chain.objs.size()=1 2024-03-09T15:07:05.259 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.258+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.HoE0ajjjM2jSirUpn1koh-MFGbih2dJ_0 2024-03-09T15:07:05.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.258+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9886057572971830557', time=2024-03-09T16:57:02.214475+0000, chain.objs.size()=1 2024-03-09T15:07:05.260 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.258+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.hxyONRYa9H4eyo4nh6lT6HndvLp_MYj_0 2024-03-09T15:07:05.262 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.262+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/47607 2024-03-09T15:07:05.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-03-09T15:07:05.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16004134035293938097', time=2024-03-09T16:57:02.245288+0000, chain.objs.size()=1 2024-03-09T15:07:05.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.3PEboLU1ZwrbNg3d1HMxD1-qEWPkIWz_0 2024-03-09T15:07:05.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18038846903479312934', time=2024-03-09T16:57:02.256840+0000, chain.objs.size()=1 2024-03-09T15:07:05.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.yXz0R0ARCh9-9Ta_N9pUoPo_Vde6p96_0 2024-03-09T15:07:05.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2842283162386081541', time=2024-03-09T16:57:02.270454+0000, chain.objs.size()=1 2024-03-09T15:07:05.265 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.PHyET15zbUwWyCDJ5hF7qu-Ne16NfHf_0 2024-03-09T15:07:05.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1402985148840719258', time=2024-03-09T16:57:02.281089+0000, chain.objs.size()=1 2024-03-09T15:07:05.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.9zdsVczZokgElW-woNiQfrc7I8rSymo_0 2024-03-09T15:07:05.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12312456173417016671', time=2024-03-09T16:57:02.299777+0000, chain.objs.size()=1 2024-03-09T15:07:05.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oMlUuM-gXBXGHrhc5jKSKRWOT8b0uoB_0 2024-03-09T15:07:05.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15448076881023556743', time=2024-03-09T16:57:02.312185+0000, chain.objs.size()=1 2024-03-09T15:07:05.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.5ZUbb_22PXPn4piUt6hDGodX5ShNhMA_0 2024-03-09T15:07:05.266 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14239436805867968796', time=2024-03-09T16:57:02.334871+0000, chain.objs.size()=1 2024-03-09T15:07:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.4wmUmxUMInXVfqL8GQw_JU3NGEgX0lG_0 2024-03-09T15:07:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14412743947199003323', time=2024-03-09T16:57:02.371195+0000, chain.objs.size()=1 2024-03-09T15:07:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xoCrcJ_-Z4O7nVAI8N1osgRIJEtjqI7_0 2024-03-09T15:07:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11968645416089016282', time=2024-03-09T16:57:02.611440+0000, chain.objs.size()=1 2024-03-09T15:07:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.qru99zZeYC9zOrvSfcixeocTk76CE07_0 2024-03-09T15:07:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4737841035626692632', time=2024-03-09T16:57:02.732506+0000, chain.objs.size()=1 2024-03-09T15:07:05.267 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.zB9VjtmGKgpvrPg3HXoXQGdRPbF8pzQ_0 2024-03-09T15:07:05.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14958678593940974830', time=2024-03-09T16:57:02.870657+0000, chain.objs.size()=1 2024-03-09T15:07:05.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.WnLpIt2_l9zjqNH52VOjdeGQQAZdrMl_0 2024-03-09T15:07:05.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8106100720726010839', time=2024-03-09T16:57:02.960951+0000, chain.objs.size()=1 2024-03-09T15:07:05.268 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.266+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.46ED3Qgj7p4RL4zmyl_z18oPx7paMvr_0 2024-03-09T15:07:05.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3454362055749780122', time=2024-03-09T16:57:02.980317+0000, chain.objs.size()=1 2024-03-09T15:07:05.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.QyoeAHWPKPlmtmko_vaFG1kgxmVX2u6_0 2024-03-09T15:07:05.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.736246785443648483', time=2024-03-09T16:57:02.991734+0000, chain.objs.size()=1 2024-03-09T15:07:05.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.J36oZ0X3tY9Cc5CZmXxxPywVrWe9TCJ_0 2024-03-09T15:07:05.269 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14340057752766912187', time=2024-03-09T16:57:03.027895+0000, chain.objs.size()=1 2024-03-09T15:07:05.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.OJAAAs7JEfXCTOpcKaqipXgcM9mcpzS_0 2024-03-09T15:07:05.270 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7924910964231707138', time=2024-03-09T16:57:03.084568+0000, chain.objs.size()=1 2024-03-09T15:07:05.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oXcK0pAB-57ZbTiOnv3gH2_VaZxZVyV_0 2024-03-09T15:07:05.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14007530682232314599', time=2024-03-09T16:57:03.109713+0000, chain.objs.size()=1 2024-03-09T15:07:05.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.hcPacSZIdeGAZkCm4dlPKPhLHe7ujeo_0 2024-03-09T15:07:05.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12578065675974226914', time=2024-03-09T16:57:03.114571+0000, chain.objs.size()=1 2024-03-09T15:07:05.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.E0yc_TyQsp40StxqLill-TozGoL0myY_0 2024-03-09T15:07:05.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5123841365664372486', time=2024-03-09T16:57:03.261380+0000, chain.objs.size()=1 2024-03-09T15:07:05.271 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.gx8oq751Ygva66NPqTplB25A5BB95_I_0 2024-03-09T15:07:05.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.270+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14667723921665834519', time=2024-03-09T16:57:03.266279+0000, chain.objs.size()=1 2024-03-09T15:07:05.272 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.270+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.u2d3hOoFDf_uECpNr4dAaFL_WAoKmUm_0 2024-03-09T15:07:05.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.274+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8840665530127240755', time=2024-03-09T16:57:03.268577+0000, chain.objs.size()=1 2024-03-09T15:07:05.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.274+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.o4mppMvjxZOiyiBPuJLcD8_XngSEyTJ_0 2024-03-09T15:07:05.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.274+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13505155754291595581', time=2024-03-09T16:57:03.355690+0000, chain.objs.size()=1 2024-03-09T15:07:05.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.274+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ctX6cPVUSmrhuOG5MG2byHchCltgyva_0 2024-03-09T15:07:05.273 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.274+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2227281428563162421', time=2024-03-09T16:57:03.358305+0000, chain.objs.size()=1 2024-03-09T15:07:05.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.274+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Awr3swPd0JMKU0YoMoI5RA-aLuCCRrh_0 2024-03-09T15:07:05.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.274+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6657999273888072100', time=2024-03-09T16:57:03.563216+0000, chain.objs.size()=1 2024-03-09T15:07:05.274 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.274+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.hWrerP1Yq1dhNXwMCtnsPiIo8c6z2kf_0 2024-03-09T15:07:05.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.274+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2048336278197493728', time=2024-03-09T16:59:07.066265+0000, chain.objs.size()=1 2024-03-09T15:07:05.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.274+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.449__shadow_.eHLkR9IIyLwSn_L7ilzfJUZYaWH4ixn_0 2024-03-09T15:07:05.275 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.274+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3436815583319900541', time=2024-03-09T16:59:35.565400+0000, chain.objs.size()=1 2024-03-09T15:07:05.276 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.274+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.481__shadow_.v4MQk-n7ohcZQbow9zo6-N9c9D_iPRR_0 2024-03-09T15:07:05.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.489__shadow_.cbbTqzeMINTkN6QQn-XGtXaW5sucAiy_1_f317f37b6823dde4ea7a1b8b4b1db0e8', time=2024-03-09T16:59:41.697800+0000, chain.objs.size()=1 2024-03-09T15:07:05.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.489__shadow_.cbbTqzeMINTkN6QQn-XGtXaW5sucAiy_0 2024-03-09T15:07:05.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.490__shadow_.EllMb8OLqtX3xH92S8FvFm8Xj0bxrUO_1_7de8d1ee4361f8dafb0cdfed780a7c1a', time=2024-03-09T16:59:42.691970+0000, chain.objs.size()=1 2024-03-09T15:07:05.277 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.490__shadow_.EllMb8OLqtX3xH92S8FvFm8Xj0bxrUO_0 2024-03-09T15:07:05.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9544568796213769960', time=2024-03-09T17:00:02.360756+0000, chain.objs.size()=1 2024-03-09T15:07:05.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.512__multipart_mymultipart.2~aPTweWn8CrE8OA3K66rtB85BHZifCoT.1 2024-03-09T15:07:05.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15778661550283300907', time=2024-03-09T17:01:55.008483+0000, chain.objs.size()=1 2024-03-09T15:07:05.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:gsxCXmZYj7Jw9QMY6X9SR.zPGWFpjCL_.8n0c2TIblZikFcGr1tCUrNsdeIIXs5h_0 2024-03-09T15:07:05.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2513648724187842439', time=2024-03-09T17:02:44.352881+0000, chain.objs.size()=1 2024-03-09T15:07:05.278 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.578__shadow:xRCkKAYk1FqNGQuDviYTEOphA1mfbXH_.sjEN5t7NdS-InurkBcGPFaZ0dn8Cu0o_0 2024-03-09T15:07:05.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9961771919137873705', time=2024-03-09T17:04:44.626344+0000, chain.objs.size()=1 2024-03-09T15:07:05.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.694__shadow_.mYUWySfJr44si26q0hP2OX8zFWkPTeI_0 2024-03-09T15:07:05.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15427034380935996428', time=2024-03-09T17:05:14.927546+0000, chain.objs.size()=1 2024-03-09T15:07:05.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.706__shadow_.kb5DMHN2ksQTT223T1OmUdKSf1tYn2p_0 2024-03-09T15:07:05.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.278+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2893232546211618867', time=2024-03-09T17:06:41.019372+0000, chain.objs.size()=1 2024-03-09T15:07:05.279 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.278+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.758__shadow_.0RzYV38v6xxmXpU6iKhdrQEnv38QDbj_0 2024-03-09T15:07:05.283 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.282+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:05.285 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-09T15:07:05.286 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:05.287 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:05.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43823' 2024-03-09T15:07:05.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13100781406081920819', time=2024-03-09T16:51:48.878351+0000, chain.objs.size()=2 2024-03-09T15:07:05.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.152__shadow_.ePMHJhtIaz5bSZqxOuRVXKuyl8kAslk_0 2024-03-09T15:07:05.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.152__shadow_.ePMHJhtIaz5bSZqxOuRVXKuyl8kAslk_1 2024-03-09T15:07:05.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1924527375178286830', time=2024-03-09T16:51:50.770532+0000, chain.objs.size()=3 2024-03-09T15:07:05.288 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.153__multipart_mymultipart-FROZEN.2~23VnG0D9RDXz4GkI8AUtm_0HQdptUeD.1 2024-03-09T15:07:05.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.153__multipart_mymultipart-FROZEN.2~23VnG0D9RDXz4GkI8AUtm_0HQdptUeD.2 2024-03-09T15:07:05.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.153__multipart_mymultipart-FROZEN.2~23VnG0D9RDXz4GkI8AUtm_0HQdptUeD.3 2024-03-09T15:07:05.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16894849924890820', time=2024-03-09T16:51:53.968747+0000, chain.objs.size()=3 2024-03-09T15:07:05.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__multipart_foo-LUKEWARM.2~xnRUB1EM1ayUBdyjacPrcqfKkgMAq7y.1 2024-03-09T15:07:05.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__multipart_foo-LUKEWARM.2~xnRUB1EM1ayUBdyjacPrcqfKkgMAq7y.2 2024-03-09T15:07:05.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.155__multipart_foo-LUKEWARM.2~xnRUB1EM1ayUBdyjacPrcqfKkgMAq7y.3 2024-03-09T15:07:05.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6886307496739556149', time=2024-03-09T16:54:27.479490+0000, chain.objs.size()=1 2024-03-09T15:07:05.289 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.230__shadow_.Nkb1Zmq3BGElpzi6SejGCU7WnQ7qbvm_0 2024-03-09T15:07:05.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15332858819489564760', time=2024-03-09T16:54:48.177302+0000, chain.objs.size()=1 2024-03-09T15:07:05.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.250__shadow_.j7TMG8CWvWkUcP9EifIfmcmW71EoMqi_0 2024-03-09T15:07:05.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17501897821690820460', time=2024-03-09T16:55:14.912282+0000, chain.objs.size()=1 2024-03-09T15:07:05.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.mXPI5o2bGdC3EF_kBwrgbupnGpVoUeg_0 2024-03-09T15:07:05.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12798348595142342657', time=2024-03-09T16:55:14.941526+0000, chain.objs.size()=1 2024-03-09T15:07:05.290 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.286+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.LkO8wvbmHVU1M53o4fcoIxebcUDYDpd_0 2024-03-09T15:07:05.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15575355996597482056', time=2024-03-09T16:55:14.960175+0000, chain.objs.size()=1 2024-03-09T15:07:05.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.UqeDj-wlJ7b2oOkkhspPVZLpUZsmk3T_0 2024-03-09T15:07:05.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.486907693367057567', time=2024-03-09T16:55:15.013449+0000, chain.objs.size()=1 2024-03-09T15:07:05.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.65CNKOqjAKqr16og14J1YLg7ktCsmTj_0 2024-03-09T15:07:05.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16511624021548928114', time=2024-03-09T16:55:15.435183+0000, chain.objs.size()=1 2024-03-09T15:07:05.294 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.UqVK8HlgB0xPbJDctz-rUvQrKyLXGuL_0 2024-03-09T15:07:05.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17820113234088101287', time=2024-03-09T16:55:15.438693+0000, chain.objs.size()=1 2024-03-09T15:07:05.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.7_P6Ys-c7GdbjvQJHPUbyHZ3VpLzPwC_0 2024-03-09T15:07:05.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2602683553952070686', time=2024-03-09T16:55:15.452860+0000, chain.objs.size()=1 2024-03-09T15:07:05.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.BW__AtyZ-pXSmHzRJuKoiPe-ZIfYSPW_0 2024-03-09T15:07:05.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7382549794751253810', time=2024-03-09T16:55:15.471249+0000, chain.objs.size()=1 2024-03-09T15:07:05.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.G4Nlc_HDyNMdLLG46uwgJzntkc2Xusr_0 2024-03-09T15:07:05.295 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3781698551116643353', time=2024-03-09T16:55:15.490011+0000, chain.objs.size()=1 2024-03-09T15:07:05.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.KG1410Xx1VMshOKTMizpHLShoUyf-1c_0 2024-03-09T15:07:05.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13571981924649703246', time=2024-03-09T16:55:15.490782+0000, chain.objs.size()=1 2024-03-09T15:07:05.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.E6APVXZmsXo2LuhU7hX6qk25k13IKDa_0 2024-03-09T15:07:05.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13509720116179701073', time=2024-03-09T16:55:15.542359+0000, chain.objs.size()=1 2024-03-09T15:07:05.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.JIdhCsX66foxrLZX_8d8G4Ao98dQmn1_0 2024-03-09T15:07:05.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18394901190108255322', time=2024-03-09T16:55:15.677291+0000, chain.objs.size()=1 2024-03-09T15:07:05.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.2zeS_QxAdm9rJLnR_aVJtpPOR2f8rkI_0 2024-03-09T15:07:05.296 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17367649038493773010', time=2024-03-09T16:55:15.748688+0000, chain.objs.size()=1 2024-03-09T15:07:05.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.294+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.eGG4Y3lcNwJV6S9njTyzTI94zAe6GMz_0 2024-03-09T15:07:05.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6233892377244762876', time=2024-03-09T16:55:15.788282+0000, chain.objs.size()=1 2024-03-09T15:07:05.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.2qbPk6xUOsQinajGQYuwTbF7tUBN_cZ_0 2024-03-09T15:07:05.297 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13950322651003690230', time=2024-03-09T16:55:15.825202+0000, chain.objs.size()=1 2024-03-09T15:07:05.298 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.prxYHgIz9lRhJOfo-Qjgnjl5AESNFgD_0 2024-03-09T15:07:05.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15702473566449813638', time=2024-03-09T16:55:15.828915+0000, chain.objs.size()=1 2024-03-09T15:07:05.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.WBMsbe-DTmoOkLWOvF8kUkhVtgVkzxc_0 2024-03-09T15:07:05.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5344558004761495180', time=2024-03-09T16:55:15.937302+0000, chain.objs.size()=1 2024-03-09T15:07:05.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.76qsv5FojHb-ga0nxluC4nvZjvhvATP_0 2024-03-09T15:07:05.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3698678159298987895', time=2024-03-09T16:55:15.947444+0000, chain.objs.size()=1 2024-03-09T15:07:05.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.nTuGMSZbLUAFMTquQQ5RKHJjQh2bncw_0 2024-03-09T15:07:05.300 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5668406186292321659', time=2024-03-09T16:55:16.016507+0000, chain.objs.size()=1 2024-03-09T15:07:05.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.rsCTjfWAGujsFoTflwakuPrnZXQGb8k_0 2024-03-09T15:07:05.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17731118113754749463', time=2024-03-09T16:55:16.058646+0000, chain.objs.size()=1 2024-03-09T15:07:05.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.irmYOC6aAzs4QjaIuwAk71iayfLI6gd_0 2024-03-09T15:07:05.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13445532251060793259', time=2024-03-09T16:55:16.203513+0000, chain.objs.size()=1 2024-03-09T15:07:05.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.vALb6_8hJj_z47RsWfzQ6LmRqc7-q89_0 2024-03-09T15:07:05.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9403358288997759214', time=2024-03-09T16:55:16.245040+0000, chain.objs.size()=1 2024-03-09T15:07:05.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.4c_pB58kTf9Yf8611E_ETmB9J65KaV7_0 2024-03-09T15:07:05.301 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7306186360130739635', time=2024-03-09T16:55:16.263682+0000, chain.objs.size()=1 2024-03-09T15:07:05.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.hPpyLmxEbqzwsPO67csEnk9z_LA2Dwa_0 2024-03-09T15:07:05.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17984204188244475046', time=2024-03-09T16:55:16.286296+0000, chain.objs.size()=1 2024-03-09T15:07:05.302 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.298+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.eG3iYj-PEIdT_GC27ciTcZLL7foN3BD_0 2024-03-09T15:07:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.302+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16706594810293583194', time=2024-03-09T16:55:16.296290+0000, chain.objs.size()=1 2024-03-09T15:07:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.VzilwISxTCZ3sSdNfVUwZmrTPXOMSJm_0 2024-03-09T15:07:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.302+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.845413650265813676', time=2024-03-09T16:55:16.589867+0000, chain.objs.size()=1 2024-03-09T15:07:05.303 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.302+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.fkIj9JrxGTTdi3Lx3ctjV8XZp8W_jaC_0 2024-03-09T15:07:05.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13630762845340218335', time=2024-03-09T16:55:16.724294+0000, chain.objs.size()=1 2024-03-09T15:07:05.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.g1MvPVCBQ6gcr4wexTyJRg83Y_pNBPT_0 2024-03-09T15:07:05.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2678880308177408007', time=2024-03-09T16:55:16.767528+0000, chain.objs.size()=1 2024-03-09T15:07:05.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.x2cM7Lo-H7s2-5FZro__4LnT5riIh8L_0 2024-03-09T15:07:05.306 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7331335362124789512', time=2024-03-09T16:55:25.043996+0000, chain.objs.size()=1 2024-03-09T15:07:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.265__shadow_.YsrKiFDBY5YvSnKr8xlKVBS4Dqiugzp_0 2024-03-09T15:07:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3390697442001282088', time=2024-03-09T16:55:32.492491+0000, chain.objs.size()=1 2024-03-09T15:07:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.273__shadow_.QgzyPK66ZMEGnvOfAV7FCz2K9dT3CqC_0 2024-03-09T15:07:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6862366908282996573', time=2024-03-09T16:55:38.304394+0000, chain.objs.size()=1 2024-03-09T15:07:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.279__shadow_.2ureII_AeQxfcKRuEQ3mReKj9Gl4scA_0 2024-03-09T15:07:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2007167266423144777', time=2024-03-09T16:55:42.123751+0000, chain.objs.size()=1 2024-03-09T15:07:05.307 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.283__shadow_.-9yOYeIa-uM5Pu3fllwMxxRQhf-GxNI_0 2024-03-09T15:07:05.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9572451647889674111', time=2024-03-09T16:55:46.203987+0000, chain.objs.size()=1 2024-03-09T15:07:05.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.GeibsH1dCVJvCxwmCBOoQcVP83Ix1qv_0 2024-03-09T15:07:05.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.310105922401154015', time=2024-03-09T16:55:46.242725+0000, chain.objs.size()=1 2024-03-09T15:07:05.308 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.lrtHJ3ZhRuX3VTXRotUAKdsionAqR2y_0 2024-03-09T15:07:05.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15739781428244428277', time=2024-03-09T16:55:47.846664+0000, chain.objs.size()=1 2024-03-09T15:07:05.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.287__shadow_.Y8FG5YigydLW4f_9m09Mtkt7XcDGrj__0 2024-03-09T15:07:05.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16460368852986370859', time=2024-03-09T16:55:50.645363+0000, chain.objs.size()=1 2024-03-09T15:07:05.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.290__shadow_.L0DsmOeDcffRfo6N8eHI2AmFrJ1DkPW_0 2024-03-09T15:07:05.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.444203933886380435', time=2024-03-09T16:55:57.384560+0000, chain.objs.size()=1 2024-03-09T15:07:05.309 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.306+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.297__shadow_.sm-Bwf_DAzAXaJ1ihZjdC4zmccMwo_O_0 2024-03-09T15:07:05.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5350017416920955601', time=2024-03-09T16:56:38.029213+0000, chain.objs.size()=1 2024-03-09T15:07:05.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.XM5l0c6TelkHB-_1ZSQINXtXZxq8gQp_0 2024-03-09T15:07:05.310 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8307121791347282925', time=2024-03-09T16:56:38.079127+0000, chain.objs.size()=1 2024-03-09T15:07:05.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.oSbfVQhXoxn3rMynNiQ_nDPq_VrWnHe_0 2024-03-09T15:07:05.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8019004134675759008', time=2024-03-09T16:56:38.084507+0000, chain.objs.size()=1 2024-03-09T15:07:05.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.JIHONVhvkRWg7KjV2t6aPmayDaJHTqN_0 2024-03-09T15:07:05.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11422382012797679105', time=2024-03-09T16:56:38.094857+0000, chain.objs.size()=1 2024-03-09T15:07:05.311 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.MtWAPs_gXz6OL3sDqt87Ao_ylyY5IPr_0 2024-03-09T15:07:05.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.310+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5773221281033742901', time=2024-03-09T16:56:38.602282+0000, chain.objs.size()=1 2024-03-09T15:07:05.312 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.310+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.VzKxvw2A7W0v5ECjZAtVkERuc23ZjVX_0 2024-03-09T15:07:05.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.314+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1257167641115108705', time=2024-03-09T16:56:38.603891+0000, chain.objs.size()=1 2024-03-09T15:07:05.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.314+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Ng0DNOWCbKnhdJc7plv2bOORoV8GIDq_0 2024-03-09T15:07:05.313 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.314+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7878349267432006994', time=2024-03-09T16:56:38.635543+0000, chain.objs.size()=1 2024-03-09T15:07:05.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.314+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.07v33yXl-3pgIKFAL-1MtH5cjIktgRU_0 2024-03-09T15:07:05.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.314+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15991373931201494695', time=2024-03-09T16:56:38.644507+0000, chain.objs.size()=1 2024-03-09T15:07:05.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.314+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.OAVcaNGYrc69hPvD_uTSaWvkCEqa7pf_0 2024-03-09T15:07:05.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.314+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9683551252382154681', time=2024-03-09T16:56:38.813338+0000, chain.objs.size()=1 2024-03-09T15:07:05.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.314+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.HOubBaaioaSPGbgEpghboDRvFIIjyDy_0 2024-03-09T15:07:05.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.314+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1462756153140135885', time=2024-03-09T16:56:38.858640+0000, chain.objs.size()=1 2024-03-09T15:07:05.314 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.314+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.UuJaTBb0JB_ek2SKNWdi-RAPt5BIgSS_0 2024-03-09T15:07:05.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.314+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12230625956415504185', time=2024-03-09T16:56:38.865556+0000, chain.objs.size()=1 2024-03-09T15:07:05.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.314+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.vU1-K8Q4AtL3BAQhCn0jm7vDygZzXaS_0 2024-03-09T15:07:05.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.314+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1897008715956740108', time=2024-03-09T16:56:38.913174+0000, chain.objs.size()=1 2024-03-09T15:07:05.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.314+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.LoepsuMaB_GGmdvUGUin2fz5l2xCyeC_0 2024-03-09T15:07:05.315 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.314+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13336979985835807107', time=2024-03-09T16:56:38.925382+0000, chain.objs.size()=1 2024-03-09T15:07:05.316 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.314+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.qyTxbnku64o-jq0Lil8EsVl-oj5dSzn_0 2024-03-09T15:07:05.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7760710191197167865', time=2024-03-09T16:56:38.931627+0000, chain.objs.size()=1 2024-03-09T15:07:05.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Si6AbowaSUrtNG9XHU9lUbmxNA-wxqd_0 2024-03-09T15:07:05.317 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4713355926955236764', time=2024-03-09T16:56:39.086411+0000, chain.objs.size()=1 2024-03-09T15:07:05.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.SkMBXwsI9ZgAYcG9A8INuG8UzqADDS8_0 2024-03-09T15:07:05.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8005339466884953887', time=2024-03-09T16:56:39.104376+0000, chain.objs.size()=1 2024-03-09T15:07:05.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.BTYxevPMaEgu3s-L6ZNyvo1V9dxkgIV_0 2024-03-09T15:07:05.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17099029706676475751', time=2024-03-09T16:56:39.135864+0000, chain.objs.size()=1 2024-03-09T15:07:05.318 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.xwl63eBXysaRdV4MJqyrAB3lg3QbueR_0 2024-03-09T15:07:05.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9342710986400926448', time=2024-03-09T16:56:39.142960+0000, chain.objs.size()=1 2024-03-09T15:07:05.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.NAzQI46YPkpa1f-VyMbodyTzrHPos1z_0 2024-03-09T15:07:05.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14999595317362088535', time=2024-03-09T16:56:39.144544+0000, chain.objs.size()=1 2024-03-09T15:07:05.319 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.KR2ok4W9rbtsLerloWPK3OAGyGO6PSi_0 2024-03-09T15:07:05.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13293276038756597072', time=2024-03-09T16:56:39.153284+0000, chain.objs.size()=1 2024-03-09T15:07:05.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6lUzkNXcg_jwIP0VuMGgv3MNBhRjHWb_0 2024-03-09T15:07:05.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10341187055001033371', time=2024-03-09T16:56:39.188885+0000, chain.objs.size()=1 2024-03-09T15:07:05.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.LNm_5Teqv3jSvle4A3GeoUSuaVJo0BC_0 2024-03-09T15:07:05.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13368486357976285696', time=2024-03-09T16:56:39.190242+0000, chain.objs.size()=1 2024-03-09T15:07:05.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.KF_w3tMeK9vAkg1Mbc6aLh6Y1l-9XTt_0 2024-03-09T15:07:05.320 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13474980639157020252', time=2024-03-09T16:56:39.303800+0000, chain.objs.size()=1 2024-03-09T15:07:05.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ZWHmVy5_r7A1XUBCVrdJmL-J6hYX7O5_0 2024-03-09T15:07:05.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14528243969099989653', time=2024-03-09T16:56:39.336082+0000, chain.objs.size()=1 2024-03-09T15:07:05.321 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.318+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.2jtkikyQZ3dwa1-OgcTY3ioiJ5IMivP_0 2024-03-09T15:07:05.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2317453574567349886', time=2024-03-09T16:56:39.388069+0000, chain.objs.size()=1 2024-03-09T15:07:05.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Ch61iWCr3Q9Qnu_GBcOceVXVrI9AVyl_0 2024-03-09T15:07:05.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7083499086570307926', time=2024-03-09T16:56:39.467184+0000, chain.objs.size()=1 2024-03-09T15:07:05.324 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.iWeW9W0RYcCvIG0JGEMTkFnq2Q1NAgt_0 2024-03-09T15:07:05.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3892358222961289637', time=2024-03-09T16:56:39.564253+0000, chain.objs.size()=1 2024-03-09T15:07:05.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.3xscPDXz6eVsaw5NOIweeuE8wPBzXTj_0 2024-03-09T15:07:05.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16518853938309464768', time=2024-03-09T16:56:39.589220+0000, chain.objs.size()=1 2024-03-09T15:07:05.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.10w2sPywDj4YZ6LfObMI3Hl39wmO06f_0 2024-03-09T15:07:05.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12267060764785903974', time=2024-03-09T16:56:39.625581+0000, chain.objs.size()=1 2024-03-09T15:07:05.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.fxskl-HwtbkCQdMl804rB31JE5vuaVY_0 2024-03-09T15:07:05.325 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1947000327465174928', time=2024-03-09T16:56:39.642757+0000, chain.objs.size()=1 2024-03-09T15:07:05.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.QyxlykwAbHPMHqWzAGL0YMQpLQKviQA_0 2024-03-09T15:07:05.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10280283849807702960', time=2024-03-09T16:56:39.664858+0000, chain.objs.size()=1 2024-03-09T15:07:05.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.vNURVd6DPy16vJ9G6ExaFcMvn_8BGoB_0 2024-03-09T15:07:05.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2690413689143498830', time=2024-03-09T16:57:01.728570+0000, chain.objs.size()=1 2024-03-09T15:07:05.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.TwB8bEnVO_yvBsKOwH27ScwtICBVzjZ_0 2024-03-09T15:07:05.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15355875800213745413', time=2024-03-09T16:57:01.754321+0000, chain.objs.size()=1 2024-03-09T15:07:05.326 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.fab3y2tte_m7cGvAcTZi43hcLithLUp_0 2024-03-09T15:07:05.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14015810741746938648', time=2024-03-09T16:57:01.840283+0000, chain.objs.size()=1 2024-03-09T15:07:05.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.N5dNrZf9ZOKFCTSmq7mXCEYnrAMmXVx_0 2024-03-09T15:07:05.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13421426921401965888', time=2024-03-09T16:57:01.869691+0000, chain.objs.size()=1 2024-03-09T15:07:05.327 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.326+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.oarQ3tYRhyfJZ1be9N8KKQIHDc6_iyf_0 2024-03-09T15:07:05.328 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16764338329350198537', time=2024-03-09T16:57:02.023830+0000, chain.objs.size()=1 2024-03-09T15:07:05.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.r79eNb1caeU0P4gQjJl6ojZCl1u3hf7_0 2024-03-09T15:07:05.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14589212997329704967', time=2024-03-09T16:57:02.057986+0000, chain.objs.size()=1 2024-03-09T15:07:05.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.b0CMjFhV6WiI14EsjiMkr1K6P3MG0gk_0 2024-03-09T15:07:05.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1720278426690915114', time=2024-03-09T16:57:02.088366+0000, chain.objs.size()=1 2024-03-09T15:07:05.329 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.y0gHTe-y3gMFrC-rEnW4lRq-Sn6FgD0_0 2024-03-09T15:07:05.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15560863538249509966', time=2024-03-09T16:57:02.259568+0000, chain.objs.size()=1 2024-03-09T15:07:05.330 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.PyC9iqbqQ_p5VOAW1ObDjqlnOe2oODJ_0 2024-03-09T15:07:05.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14839539031222034682', time=2024-03-09T16:57:02.289319+0000, chain.objs.size()=1 2024-03-09T15:07:05.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.Xl4RbOZ4I9C0BPm6hul7w--dfDoZBiU_0 2024-03-09T15:07:05.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1226027544504426955', time=2024-03-09T16:57:02.293228+0000, chain.objs.size()=1 2024-03-09T15:07:05.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.DS3goqAJCaJA7hI--L6ivm9U9_CS5dX_0 2024-03-09T15:07:05.331 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4964431000415621485', time=2024-03-09T16:57:02.349743+0000, chain.objs.size()=1 2024-03-09T15:07:05.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.ZTd4ww5aQ_xd0Lsieb2fouMINUyFH5v_0 2024-03-09T15:07:05.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18424602968225449950', time=2024-03-09T16:57:02.355213+0000, chain.objs.size()=1 2024-03-09T15:07:05.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.rx4NaGwYHhgPgSHZJXS6IFX-Olwv2CJ_0 2024-03-09T15:07:05.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11180293234440927437', time=2024-03-09T16:57:02.370424+0000, chain.objs.size()=1 2024-03-09T15:07:05.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.vFGPEoiwmzs3hdK_IonLqNbadfeaSgq_0 2024-03-09T15:07:05.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11110198965680752711', time=2024-03-09T16:57:02.576813+0000, chain.objs.size()=1 2024-03-09T15:07:05.332 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.QMT1KN6lIoCc5y4fEmBLxkIqlS6kvoM_0 2024-03-09T15:07:05.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13560146304469840397', time=2024-03-09T16:57:02.813280+0000, chain.objs.size()=1 2024-03-09T15:07:05.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.gLh9gArYwoV7bfapktnCi6oXaMQw2gY_0 2024-03-09T15:07:05.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12294811620346447674', time=2024-03-09T16:57:02.870466+0000, chain.objs.size()=1 2024-03-09T15:07:05.333 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.330+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.qSpiAsOjywRupo8t33At5gadpOR9ljU_0 2024-03-09T15:07:05.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.334+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3938391374801980162', time=2024-03-09T16:57:02.964748+0000, chain.objs.size()=1 2024-03-09T15:07:05.334 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.334+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.FaIzYOFcvgGvXrJLG__A4yJAG8TGyve_0 2024-03-09T15:07:05.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.334+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4900334689683526420', time=2024-03-09T16:57:02.996995+0000, chain.objs.size()=1 2024-03-09T15:07:05.335 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.334+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.XyH0TuHUg_UJHJsYpHZHnlNkIxpyM2H_0 2024-03-09T15:07:05.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15597893504895487787', time=2024-03-09T16:57:03.063672+0000, chain.objs.size()=1 2024-03-09T15:07:05.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.PdizK90aK8SsRcePwrPvAOpnaakGw7I_0 2024-03-09T15:07:05.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8361595891289052612', time=2024-03-09T16:57:03.083045+0000, chain.objs.size()=1 2024-03-09T15:07:05.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xvpXXNTj8XsN7NCWT5mWWpAs3yxH_l8_0 2024-03-09T15:07:05.337 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5329084334128992895', time=2024-03-09T16:57:03.108607+0000, chain.objs.size()=1 2024-03-09T15:07:05.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.HQQueYzRQDtSJxguKq5hKNKZpvX_y7V_0 2024-03-09T15:07:05.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7319858788988181898', time=2024-03-09T16:57:03.350713+0000, chain.objs.size()=1 2024-03-09T15:07:05.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.e2G465poGMRo6vHzvfIeR2nQtj4UJSL_0 2024-03-09T15:07:05.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3305644471069750830', time=2024-03-09T16:57:03.398433+0000, chain.objs.size()=1 2024-03-09T15:07:05.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.IZYYiNw7nsQydmRcklRk4I4c44YzNQF_0 2024-03-09T15:07:05.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11637358189908539103', time=2024-03-09T16:57:03.406194+0000, chain.objs.size()=1 2024-03-09T15:07:05.338 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.UGX_yIbSrfiy1i5RTaYq4v249jW14_P_0 2024-03-09T15:07:05.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4927067864106847079', time=2024-03-09T16:57:06.115771+0000, chain.objs.size()=1 2024-03-09T15:07:05.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.321__shadow_.oZIGpf84dyzW5HBiBcGFvMpOgB1XAMQ_0 2024-03-09T15:07:05.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.338+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8624902034252734220', time=2024-03-09T16:57:11.462667+0000, chain.objs.size()=1 2024-03-09T15:07:05.339 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.338+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.327__shadow_.CCN6vT3CqwEHePTsf1ElIBJwBrJKaAD_0 2024-03-09T15:07:05.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.342+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6663577956075191688', time=2024-03-09T16:58:59.439745+0000, chain.objs.size()=1 2024-03-09T15:07:05.340 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.441__shadow_.dAaJ2VgntS8LHFAI8RVFOZkMIRUHIHv_0 2024-03-09T15:07:05.345 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.342+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/43823 2024-03-09T15:07:05.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-03-09T15:07:05.346 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14108142759954387100', time=2024-03-09T16:59:18.294485+0000, chain.objs.size()=1 2024-03-09T15:07:05.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.458__shadow_.G6vJ4g3i4PWlWA4F0HKvGWeyuY13suK_0 2024-03-09T15:07:05.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5352476841814905105', time=2024-03-09T16:59:41.696925+0000, chain.objs.size()=1 2024-03-09T15:07:05.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.489__shadow_.cbbTqzeMINTkN6QQn-XGtXaW5sucAiy_0 2024-03-09T15:07:05.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7264156112627185499', time=2024-03-09T16:59:45.295432+0000, chain.objs.size()=1 2024-03-09T15:07:05.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.494__shadow_.eVwja6mROT24415AnnyW99OBXvbDjxn_0 2024-03-09T15:07:05.347 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10247729845341183339', time=2024-03-09T17:00:35.938365+0000, chain.objs.size()=2 2024-03-09T15:07:05.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.519__multipart_mymultipart.2~xMoqi8OcO8Iz3ZjysMqyagD12gR_z9k.1 2024-03-09T15:07:05.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.519__multipart_mymultipart.2~xMoqi8OcO8Iz3ZjysMqyagD12gR_z9k.2 2024-03-09T15:07:05.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15120425873477832591', time=2024-03-09T17:01:56.350421+0000, chain.objs.size()=1 2024-03-09T15:07:05.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:wL0cGSGvXlB4ZLevjcNTbazCgUSIjRz_.l04JIyGw20X6c3diHE9HFNoxnlZt13C_0 2024-03-09T15:07:05.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7438046225168727283', time=2024-03-09T17:02:00.773009+0000, chain.objs.size()=1 2024-03-09T15:07:05.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.563__shadow:SOih1c1RBg.drrWvsurPNfb1rws2wtX_.DzE8WjlwLX-PBYHX0koGsvresdkSS5B_0 2024-03-09T15:07:05.348 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4188139400357349503', time=2024-03-09T17:03:22.092935+0000, chain.objs.size()=1 2024-03-09T15:07:05.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.609__shadow_.JoFMClGUhRGIJqf0av0PmtpXn8dAdXT_0 2024-03-09T15:07:05.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.17813064574955799645', time=2024-03-09T17:03:56.208084+0000, chain.objs.size()=1 2024-03-09T15:07:05.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.640__shadow_.sXOIpEEq49jj6yLRW1VQinfKF_3PTL5_0 2024-03-09T15:07:05.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12314786879281313808', time=2024-03-09T17:04:09.779159+0000, chain.objs.size()=1 2024-03-09T15:07:05.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.653__shadow_.zdMokH-CCdEOu_QDnwy84sjJVDywVU4_0 2024-03-09T15:07:05.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6778284901763850600', time=2024-03-09T17:04:42.774488+0000, chain.objs.size()=1 2024-03-09T15:07:05.349 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.692__shadow:YOVt5FQY2dv9bLBYu1ZN-fVmsanndkU_.M_70RYPUewqdw9xRXksoClsGzj2ztmk_0 2024-03-09T15:07:05.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8728824758803365877', time=2024-03-09T17:04:43.803235+0000, chain.objs.size()=1 2024-03-09T15:07:05.350 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.346+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.693__shadow:Vv.lAFQEOsorfWSSCzCI1NNoGuAmmzr_.1CzKXeKqupuu2xpsV4qrKGXDQXw_Jhq_0 2024-03-09T15:07:05.353 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.354+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:05.355 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.354+0000 7f933ec68980 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-09T15:07:05.356 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-09T15:07:05.357 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-09T15:07:05.358 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45204' 2024-03-09T15:07:05.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1041560822578668950', time=2024-03-09T16:51:42.974352+0000, chain.objs.size()=1 2024-03-09T15:07:05.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.141__shadow_.3J9T0DHLxHVvF9JwPPqPRneAakjUVug_0 2024-03-09T15:07:05.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='_KIIwGk4dydA0YMT_J_uaMsALyN5aiUd', time=2024-03-09T16:51:56.231121+0000, chain.objs.size()=1 2024-03-09T15:07:05.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.157__shadow_.odfJLnlD4Fv8Wlide7AaFBBpjLsFiQ2_0 2024-03-09T15:07:05.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4554842254815670430', time=2024-03-09T16:51:57.283353+0000, chain.objs.size()=2 2024-03-09T15:07:05.359 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.158__multipart_foo.2~fj9bP5MyhISSJIhDLHtAMWt1tmGxl2T.1 2024-03-09T15:07:05.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.158__multipart_foo.2~fj9bP5MyhISSJIhDLHtAMWt1tmGxl2T.2 2024-03-09T15:07:05.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4764695580333115492', time=2024-03-09T16:52:15.348126+0000, chain.objs.size()=1 2024-03-09T15:07:05.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.177__shadow_.mf4RjREMP99DsSfex8xSLcyUwbo4zq3_0 2024-03-09T15:07:05.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15642353823109299370', time=2024-03-09T16:52:19.908527+0000, chain.objs.size()=1 2024-03-09T15:07:05.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.182__shadow_.ZUN6caXceAX2-p_XRy5Ym-O02URIDmp_0 2024-03-09T15:07:05.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4101625259380010750', time=2024-03-09T16:54:26.580436+0000, chain.objs.size()=1 2024-03-09T15:07:05.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.229__shadow_.Ob5PlKbxvIAxi8ugyNXKS9dZVnR5WxP_0 2024-03-09T15:07:05.360 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5550413182655307247', time=2024-03-09T16:54:36.863637+0000, chain.objs.size()=1 2024-03-09T15:07:05.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.238__shadow_.0K18YfywepArW4zo4hwfMzCWkAPJiE3_0 2024-03-09T15:07:05.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14068347626627448906', time=2024-03-09T16:54:42.522905+0000, chain.objs.size()=1 2024-03-09T15:07:05.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.244__shadow_.Dot5HUH_Re1Kbb4wMHQVVVjaDi-Ketj_0 2024-03-09T15:07:05.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11723378968426789736', time=2024-03-09T16:54:45.314796+0000, chain.objs.size()=1 2024-03-09T15:07:05.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.247__shadow_.bGze-W0l3SelKZq-mHgXQUWOgfzs6C0_0 2024-03-09T15:07:05.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14979317303813341655', time=2024-03-09T16:54:52.874250+0000, chain.objs.size()=1 2024-03-09T15:07:05.361 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.255__shadow_.ZKNK8-jDdXAy_vIvJhmVbOY-aBDUDWO_0 2024-03-09T15:07:05.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1654402306238280967', time=2024-03-09T16:55:14.836725+0000, chain.objs.size()=1 2024-03-09T15:07:05.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.358+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.atJvddGv7-PDDD1AcapZk3ZtoINggaC_0 2024-03-09T15:07:05.362 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11773903967507772496', time=2024-03-09T16:55:15.207009+0000, chain.objs.size()=1 2024-03-09T15:07:05.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.YyIPCmOnEGrycJUZmt1jCsZaFHtW9rN_0 2024-03-09T15:07:05.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.362+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.386321273980397510', time=2024-03-09T16:55:15.217524+0000, chain.objs.size()=1 2024-03-09T15:07:05.363 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.362+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.fekyYxqVEYfolzdAXjqqOELLHEcPmaI_0 2024-03-09T15:07:05.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12269415071680179581', time=2024-03-09T16:55:15.251428+0000, chain.objs.size()=1 2024-03-09T15:07:05.364 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.0SBhFTeGfLOLBwZLh2NUU_M2TF9fitF_0 2024-03-09T15:07:05.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2767477114421687879', time=2024-03-09T16:55:15.261711+0000, chain.objs.size()=1 2024-03-09T15:07:05.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.sz4BKH81kFfgs9gS-IRbUT8P-SjMIB6_0 2024-03-09T15:07:05.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7240658628676629290', time=2024-03-09T16:55:15.408978+0000, chain.objs.size()=1 2024-03-09T15:07:05.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.MGMWxT3YACvz_ws3tsmrKQRRnPo6WRn_0 2024-03-09T15:07:05.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12634399642305939876', time=2024-03-09T16:55:15.436553+0000, chain.objs.size()=1 2024-03-09T15:07:05.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.kGpRR-k_8w8aEi_9jvef4-IzGPB_H2y_0 2024-03-09T15:07:05.365 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16733653751945622141', time=2024-03-09T16:55:15.440914+0000, chain.objs.size()=1 2024-03-09T15:07:05.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.sA3gemPi68049i4Vxk3mQS3lp54O7K7_0 2024-03-09T15:07:05.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7457026177773573377', time=2024-03-09T16:55:15.491998+0000, chain.objs.size()=1 2024-03-09T15:07:05.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.gTs0BnotOczzlluOLC7Fg-PaPblSL_S_0 2024-03-09T15:07:05.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4624659021419824850', time=2024-03-09T16:55:15.493411+0000, chain.objs.size()=1 2024-03-09T15:07:05.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.7qWbpvVhoShHFOk8hN6vJS490QRhgXs_0 2024-03-09T15:07:05.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9542109901752432347', time=2024-03-09T16:55:15.775887+0000, chain.objs.size()=1 2024-03-09T15:07:05.366 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.tG9FAj9afY9Akq0XqNsp5hwUt3ViBKs_0 2024-03-09T15:07:05.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3469369437461388452', time=2024-03-09T16:55:16.066192+0000, chain.objs.size()=1 2024-03-09T15:07:05.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.aNIQuuHNk4luDwxJvp34d1Q0iANd7Mj_0 2024-03-09T15:07:05.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12402668574317212427', time=2024-03-09T16:55:16.203135+0000, chain.objs.size()=1 2024-03-09T15:07:05.367 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.366+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Ks32KgVmIFgkdItGSRe-S6yR5ehloOv_0 2024-03-09T15:07:05.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6713939919069283141', time=2024-03-09T16:55:16.208291+0000, chain.objs.size()=1 2024-03-09T15:07:05.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.P4_Z20B1-cywffNjis8YzX1BD-dDbz1_0 2024-03-09T15:07:05.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16349724733340005201', time=2024-03-09T16:55:16.306832+0000, chain.objs.size()=1 2024-03-09T15:07:05.368 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.LcRPqqQonVc4OFZXDEmt_BCjJsDHI1P_0 2024-03-09T15:07:05.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8606508510334124713', time=2024-03-09T16:55:16.321400+0000, chain.objs.size()=1 2024-03-09T15:07:05.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.6V2LdPWFqcnQ7u8lWTcfg_HwPGPt33h_0 2024-03-09T15:07:05.369 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5310165645417069985', time=2024-03-09T16:55:16.325281+0000, chain.objs.size()=1 2024-03-09T15:07:05.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.I_kEX8-ELpxpYdN0fSWeaXcXuBcX7Pl_0 2024-03-09T15:07:05.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10716326526052019759', time=2024-03-09T16:55:16.339602+0000, chain.objs.size()=1 2024-03-09T15:07:05.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.N48VK37vqvmrLqI_dDdEzeXitpN9m86_0 2024-03-09T15:07:05.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1399038747388001752', time=2024-03-09T16:55:16.473533+0000, chain.objs.size()=1 2024-03-09T15:07:05.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.Tmq2rZsORWs-W9F4A_oYdf87KsSahE5_0 2024-03-09T15:07:05.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.746929006752642791', time=2024-03-09T16:55:16.844439+0000, chain.objs.size()=1 2024-03-09T15:07:05.370 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.256__shadow_.9YXD3NrU2bRwbok1HkURk4dtaNOHLIW_0 2024-03-09T15:07:05.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2803275362855276249', time=2024-03-09T16:55:24.104099+0000, chain.objs.size()=1 2024-03-09T15:07:05.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.264__shadow_.yctTHB8Xti0JVSIGRIQuW6TGctj6ZR6_0 2024-03-09T15:07:05.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.283621538052830665', time=2024-03-09T16:55:25.964419+0000, chain.objs.size()=1 2024-03-09T15:07:05.371 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.266__shadow_.dal0GZ7wZD_GS_F6EcPKIvxZEcjdUwb_0 2024-03-09T15:07:05.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1400333054501110694', time=2024-03-09T16:55:46.193943+0000, chain.objs.size()=1 2024-03-09T15:07:05.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.drSwTRvViY_4tkb1XIRkZOKoqFxAQOL_0 2024-03-09T15:07:05.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6354005154956546247', time=2024-03-09T16:55:46.231275+0000, chain.objs.size()=1 2024-03-09T15:07:05.372 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.370+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.286__shadow_.SqNNCHo-5Uvp5DgSmjiiBv9kxL1sdg4_0 2024-03-09T15:07:05.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12647685886156885537', time=2024-03-09T16:55:56.389224+0000, chain.objs.size()=1 2024-03-09T15:07:05.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.296__shadow_.-CDPKwLawoXxZgDjGikqNnaBoUartfY_0 2024-03-09T15:07:05.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.706097021551920819', time=2024-03-09T16:55:59.294807+0000, chain.objs.size()=1 2024-03-09T15:07:05.374 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.299__shadow_.UlGvTE0EjdixHWgxomOJt4ZbT3nEWML_0 2024-03-09T15:07:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13638249843675001331', time=2024-03-09T16:56:37.702711+0000, chain.objs.size()=1 2024-03-09T15:07:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Bo_D-laOP32g2XqyjPiCyJiGP6RMuNt_0 2024-03-09T15:07:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13487961843453619981', time=2024-03-09T16:56:37.760401+0000, chain.objs.size()=1 2024-03-09T15:07:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.NOPvHY5ai5UJMws2xI7PgQX8hEyfzoa_0 2024-03-09T15:07:05.375 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7144667864554675841', time=2024-03-09T16:56:37.787752+0000, chain.objs.size()=1 2024-03-09T15:07:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.MmEOsX_W_mDmU5YiDMGBiuVNukZ1ToE_0 2024-03-09T15:07:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18060347671573558443', time=2024-03-09T16:56:37.851032+0000, chain.objs.size()=1 2024-03-09T15:07:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.4XdSnBpekIsqMzqlcjPT9D6C0A05tG-_0 2024-03-09T15:07:05.376 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1994294916777040777', time=2024-03-09T16:56:38.013319+0000, chain.objs.size()=1 2024-03-09T15:07:05.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.zpnoHB923h3GqQJGoVT8UAMVp_yhO9n_0 2024-03-09T15:07:05.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13545088600380100112', time=2024-03-09T16:56:38.041446+0000, chain.objs.size()=1 2024-03-09T15:07:05.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.ExyUosCMUf3w5aIKn35mV7dgusKirte_0 2024-03-09T15:07:05.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1338138701167837704', time=2024-03-09T16:56:38.262227+0000, chain.objs.size()=1 2024-03-09T15:07:05.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.GpT2BA8rCYD6x9NYElT4OuCzcL8eJsK_0 2024-03-09T15:07:05.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9832613830862474776', time=2024-03-09T16:56:38.275678+0000, chain.objs.size()=1 2024-03-09T15:07:05.377 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.k-846bFVWEkVq5b6ltomQ2XqyAbR754_0 2024-03-09T15:07:05.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7149459219388163886', time=2024-03-09T16:56:38.307314+0000, chain.objs.size()=1 2024-03-09T15:07:05.378 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.374+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.O_XX3VWzs-a3dLPApr_QsdD5HOS5e_Z_0 2024-03-09T15:07:05.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.378+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10946217007909870967', time=2024-03-09T16:56:38.372100+0000, chain.objs.size()=1 2024-03-09T15:07:05.379 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.378+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.95lM6nV_9xu0X4Qiwt2UPVmLsEhG7kv_0 2024-03-09T15:07:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1458471118783486168', time=2024-03-09T16:56:38.565350+0000, chain.objs.size()=1 2024-03-09T15:07:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.0TUzmFDNRDsgpzfhNcjCh3WUJJCTkcZ_0 2024-03-09T15:07:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3228966723987917863', time=2024-03-09T16:56:38.648503+0000, chain.objs.size()=1 2024-03-09T15:07:05.380 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.8_j3JQMo4p5aF1ZGA6Qo6nhpX35lohW_0 2024-03-09T15:07:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.723303186027498043', time=2024-03-09T16:56:38.805298+0000, chain.objs.size()=1 2024-03-09T15:07:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.53C_zwN7Ev0mxNhnC9eanYnV8tQ_1bt_0 2024-03-09T15:07:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18137593995170362208', time=2024-03-09T16:56:38.849912+0000, chain.objs.size()=1 2024-03-09T15:07:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.2-vBWzGAuMn3SkA06MZ_NbHMvPRImvW_0 2024-03-09T15:07:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.18133660646225398036', time=2024-03-09T16:56:38.852258+0000, chain.objs.size()=1 2024-03-09T15:07:05.381 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.KIJ96zUhPa7bDA4n4Igc0ekiRrpUgvU_0 2024-03-09T15:07:05.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11171643456953297196', time=2024-03-09T16:56:38.854350+0000, chain.objs.size()=1 2024-03-09T15:07:05.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.t0sqYR7y2LADZOrLLX6vB9je9lvcDCv_0 2024-03-09T15:07:05.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7785222006184257241', time=2024-03-09T16:56:38.883701+0000, chain.objs.size()=1 2024-03-09T15:07:05.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.b1PHUTT_IytZKtKUH83CZQrlsPkyOJh_0 2024-03-09T15:07:05.382 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12533490127181108257', time=2024-03-09T16:56:38.902492+0000, chain.objs.size()=1 2024-03-09T15:07:05.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.axwgE-TNbeJPT87FAOIqtOotDuS1NSd_0 2024-03-09T15:07:05.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11621533362149429099', time=2024-03-09T16:56:38.903307+0000, chain.objs.size()=1 2024-03-09T15:07:05.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.KYm4qHxwIx93hN5MZkKJ0ha4lFfTxTI_0 2024-03-09T15:07:05.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3366967252754104734', time=2024-03-09T16:56:39.063691+0000, chain.objs.size()=1 2024-03-09T15:07:05.383 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.5SOheGZQ9LKRKlnU2GhUxX9BCZ7erXM_0 2024-03-09T15:07:05.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15824053031136085067', time=2024-03-09T16:56:39.083410+0000, chain.objs.size()=1 2024-03-09T15:07:05.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.382+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.C18yn2_VjCnEnXeiAgOaSF6_9ZcQVuS_0 2024-03-09T15:07:05.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5385908920561715496', time=2024-03-09T16:56:39.094186+0000, chain.objs.size()=1 2024-03-09T15:07:05.384 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.-JyS6wMX--8T0UqMQA-BxhHbbqr-zqn_0 2024-03-09T15:07:05.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10394669346891020955', time=2024-03-09T16:56:39.105282+0000, chain.objs.size()=1 2024-03-09T15:07:05.386 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.tFyLG9wkoULHZ5CX4OsZnvnYni-3LC3_0 2024-03-09T15:07:05.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4806983469908534203', time=2024-03-09T16:56:39.111051+0000, chain.objs.size()=1 2024-03-09T15:07:05.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.6w4eXQDdGRlI43e9eW3NSWH_MSj36Uc_0 2024-03-09T15:07:05.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8008770597078944961', time=2024-03-09T16:56:39.379755+0000, chain.objs.size()=1 2024-03-09T15:07:05.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.i0zNm1hY_UZB_PbMslUxllEAh5aJhaf_0 2024-03-09T15:07:05.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10598708194671573416', time=2024-03-09T16:56:39.616132+0000, chain.objs.size()=1 2024-03-09T15:07:05.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.xjjzZH6DT1Zi3loocygW8gtbK9b5b2A_0 2024-03-09T15:07:05.387 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15468944336201675769', time=2024-03-09T16:56:39.649604+0000, chain.objs.size()=1 2024-03-09T15:07:05.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.Jx1hSwpx2RGHo_f0wJGk7dOf6cluOUl_0 2024-03-09T15:07:05.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.386+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9957321228743746409', time=2024-03-09T16:56:39.672931+0000, chain.objs.size()=1 2024-03-09T15:07:05.388 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.386+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.317__shadow_.NDR2fkjOgP1rUPkg7Jb6asE0dMUhCWc_0 2024-03-09T15:07:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.390+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6669656123245224511', time=2024-03-09T16:57:01.435047+0000, chain.objs.size()=1 2024-03-09T15:07:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.390+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.YIOTVSRx6TOgxWOWJmW5myobWmH8Ydp_0 2024-03-09T15:07:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.390+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.705399092494647213', time=2024-03-09T16:57:01.550737+0000, chain.objs.size()=1 2024-03-09T15:07:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.390+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.LhlSpsdIiDGAi-84KYF6r3qbuqF9PtJ_0 2024-03-09T15:07:05.389 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.390+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10142162743186081045', time=2024-03-09T16:57:01.589656+0000, chain.objs.size()=1 2024-03-09T15:07:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.390+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.mpVa401zP7-VLMuV4z3VPSezx5neZT6_0 2024-03-09T15:07:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.390+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8239993886438026495', time=2024-03-09T16:57:01.779874+0000, chain.objs.size()=1 2024-03-09T15:07:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.390+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.pAHhaBhlxG9YvPFouDcmMDuMGIKmNaa_0 2024-03-09T15:07:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.390+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.2870179678607368131', time=2024-03-09T16:57:01.821277+0000, chain.objs.size()=1 2024-03-09T15:07:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.390+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.JSOsTZrqyt27_xIZM50taeu1tD26ONn_0 2024-03-09T15:07:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.390+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.873389583201352659', time=2024-03-09T16:57:02.073676+0000, chain.objs.size()=1 2024-03-09T15:07:05.390 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.390+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.JAARmnNTEepb8jO4U75DZU7fFY2cHcI_0 2024-03-09T15:07:05.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.390+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5723861599451142832', time=2024-03-09T16:57:02.084467+0000, chain.objs.size()=1 2024-03-09T15:07:05.391 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.390+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.9dkzjB-tnucw9cmav1FQ1Q7opGzkbjK_0 2024-03-09T15:07:05.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.1922642073792978223', time=2024-03-09T16:57:02.102613+0000, chain.objs.size()=1 2024-03-09T15:07:05.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.X7tLfOcT-6rl7TfpNXTBkY-ABG_Ptef_0 2024-03-09T15:07:05.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12906866126695001987', time=2024-03-09T16:57:02.113749+0000, chain.objs.size()=1 2024-03-09T15:07:05.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.WFihh-w71syobsyv-kr2tWZ6Z4LE6Vp_0 2024-03-09T15:07:05.393 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8840155550322756', time=2024-03-09T16:57:02.218390+0000, chain.objs.size()=1 2024-03-09T15:07:05.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.qg-hp2MtFcOLKDVG_jAQ0YiCfKzRalp_0 2024-03-09T15:07:05.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16720923504551993604', time=2024-03-09T16:57:02.286841+0000, chain.objs.size()=1 2024-03-09T15:07:05.394 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.tKpzWGZcn5oKhbyw3Lq3JqdBNF6__Cq_0 2024-03-09T15:07:05.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.130358734303750729', time=2024-03-09T16:57:02.301614+0000, chain.objs.size()=1 2024-03-09T15:07:05.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.e5Eh-1zrjnvlJ9t6KardkacHcRRO8fF_0 2024-03-09T15:07:05.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11035315463817520698', time=2024-03-09T16:57:02.317355+0000, chain.objs.size()=1 2024-03-09T15:07:05.395 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_._73TvF32yl7fzTtgyUhSJTGUOkV6ZAy_0 2024-03-09T15:07:05.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.284996417235435714', time=2024-03-09T16:57:02.359523+0000, chain.objs.size()=1 2024-03-09T15:07:05.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.M6c-gO-X6xn2riyhKxlE-CDiVj72mk9_0 2024-03-09T15:07:05.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6522932911498511696', time=2024-03-09T16:57:02.485761+0000, chain.objs.size()=1 2024-03-09T15:07:05.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.g-JDEGC-VUTYrf843YioRM94cwsHPU4_0 2024-03-09T15:07:05.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4493544439971583104', time=2024-03-09T16:57:02.522918+0000, chain.objs.size()=1 2024-03-09T15:07:05.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.5Yq3czinBntMhHdrz4OluT3cyIzZ_Zm_0 2024-03-09T15:07:05.396 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13153259022097428730', time=2024-03-09T16:57:02.530429+0000, chain.objs.size()=1 2024-03-09T15:07:05.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.pOcEKviF0oY-9bPuuUfuDRiEb12_xC5_0 2024-03-09T15:07:05.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10050572478077650570', time=2024-03-09T16:57:02.542158+0000, chain.objs.size()=1 2024-03-09T15:07:05.397 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.394+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.CBdKv4b0jkKOj_Ke16REyZEvAl3PNnR_0 2024-03-09T15:07:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.398+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3341748401160320579', time=2024-03-09T16:57:02.598350+0000, chain.objs.size()=1 2024-03-09T15:07:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.398+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.s_yX_U6azkhyMG0FrO-5rmckFxxWcYt_0 2024-03-09T15:07:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.398+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14132461194673167473', time=2024-03-09T16:57:02.616614+0000, chain.objs.size()=1 2024-03-09T15:07:05.398 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.398+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.SITFElZppeE9P_LPAxC5bvlJ6p9bn8R_0 2024-03-09T15:07:05.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.398+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3795275388286404421', time=2024-03-09T16:57:02.759774+0000, chain.objs.size()=1 2024-03-09T15:07:05.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.398+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.YtCit-v_82jM8ao8HyOWw45-cll8rSK_0 2024-03-09T15:07:05.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.398+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10621982748747604148', time=2024-03-09T16:57:02.797735+0000, chain.objs.size()=1 2024-03-09T15:07:05.399 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.398+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.YYHUBPFwnhRZUtCAblQTrd0kkcnyFDq_0 2024-03-09T15:07:05.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4048757760362242977', time=2024-03-09T16:57:02.858242+0000, chain.objs.size()=1 2024-03-09T15:07:05.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.cFU6MyT81OJ9NdcgJZPNCqNu2r7dTEI_0 2024-03-09T15:07:05.400 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.9276555804706909504', time=2024-03-09T16:57:02.876493+0000, chain.objs.size()=1 2024-03-09T15:07:05.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.boergVuBiHm6P2_TTDTFsqNKUJtywAt_0 2024-03-09T15:07:05.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3370482537048347519', time=2024-03-09T16:57:02.971085+0000, chain.objs.size()=1 2024-03-09T15:07:05.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.mimuwo1o1XEEAJq9xQnO9PyeXlAr9B7_0 2024-03-09T15:07:05.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6537571255994757435', time=2024-03-09T16:57:03.010123+0000, chain.objs.size()=1 2024-03-09T15:07:05.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.2wGBeGiA1Bjg5qTpRPL8eg2KMLC6bi9_0 2024-03-09T15:07:05.401 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3083379136250840914', time=2024-03-09T16:57:03.034100+0000, chain.objs.size()=1 2024-03-09T15:07:05.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.JYjFW7zGYokshC0z8v9HTYwyMplC7_P_0 2024-03-09T15:07:05.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16169893915132460736', time=2024-03-09T16:57:03.042117+0000, chain.objs.size()=1 2024-03-09T15:07:05.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.dP64LpkMQzTsotLJyQnZCPoSwIHR7kI_0 2024-03-09T15:07:05.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.5780326361445446212', time=2024-03-09T16:57:03.081366+0000, chain.objs.size()=1 2024-03-09T15:07:05.402 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.xyR9BkHzBcR5iLMJ_ORwSKL1LCvgaKc_0 2024-03-09T15:07:05.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.402+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12444982221013064420', time=2024-03-09T16:57:03.102837+0000, chain.objs.size()=1 2024-03-09T15:07:05.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.402+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.EIYOk4egX15Ms8_pTCOVwOaEcFWAA-t_0 2024-03-09T15:07:05.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15414821350436504741', time=2024-03-09T16:57:03.323921+0000, chain.objs.size()=1 2024-03-09T15:07:05.404 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.h4P85uAPYkBh-W5ZFn7WgbzWK6wniYk_0 2024-03-09T15:07:05.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4805650930844860502', time=2024-03-09T16:57:03.346224+0000, chain.objs.size()=1 2024-03-09T15:07:05.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.318__shadow_.J-MQsOOlW5E9ZlSmyKUy1VwfvLcHVQA_0 2024-03-09T15:07:05.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.13812405464582567029', time=2024-03-09T16:57:16.574355+0000, chain.objs.size()=1 2024-03-09T15:07:05.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.333__shadow_.uuw2hMowsyXLYEjCkeLMvgIN4Nhifbn_0 2024-03-09T15:07:05.405 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3608525493271409593', time=2024-03-09T16:57:19.316596+0000, chain.objs.size()=1 2024-03-09T15:07:05.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.336__shadow_.gGUYNlIer0-ItOGMaNSnd-VSr5W2E4j_0 2024-03-09T15:07:05.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.14128138465241066247', time=2024-03-09T16:57:28.278830+0000, chain.objs.size()=1 2024-03-09T15:07:05.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.347__shadow_.M9lEuJPORv4zfWdQNk7UcGWCaMTPUat_0 2024-03-09T15:07:05.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.406+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10058736310572757353', time=2024-03-09T16:57:41.921070+0000, chain.objs.size()=1 2024-03-09T15:07:05.406 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.406+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.363__shadow_.RELk7u6Fspm43itq9fXNRIPhkxNUQaP_0 2024-03-09T15:07:05.411 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.410+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 0/45204 2024-03-09T15:07:05.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-03-09T15:07:05.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.12962171689419696467', time=2024-03-09T16:58:19.942854+0000, chain.objs.size()=1 2024-03-09T15:07:05.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.402__shadow_.RYwe8gL7XVq4248u_iNMWMkzcyThdpS_0 2024-03-09T15:07:05.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.7005560909195028898', time=2024-03-09T16:58:21.819753+0000, chain.objs.size()=1 2024-03-09T15:07:05.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.404__shadow_._PC6ueLpLgIqqLYETyqAEp-YLeYdGHB_0 2024-03-09T15:07:05.414 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4947040410748641074', time=2024-03-09T16:59:10.865792+0000, chain.objs.size()=1 2024-03-09T15:07:05.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.452__shadow_.c-3bH2vNRCGR9rRqrgu7TMpqsCOiR-2_0 2024-03-09T15:07:05.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.10515890675074229221', time=2024-03-09T16:59:20.646350+0000, chain.objs.size()=1 2024-03-09T15:07:05.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.460__shadow_.10bBhlTMLxHEcyX7vyxnKPVuwDPIDRz_0 2024-03-09T15:07:05.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.4742333896487215489', time=2024-03-09T16:59:31.476446+0000, chain.objs.size()=1 2024-03-09T15:07:05.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.477__shadow_.m7Z16MNxlIx8YlZMPL17_ZOOAahibxB_0 2024-03-09T15:07:05.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.11083126980110945436', time=2024-03-09T16:59:31.479719+0000, chain.objs.size()=1 2024-03-09T15:07:05.415 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.477__shadow_.Gx6_fdANGlSV0o5uaaZbAlmuiL_mHXN_0 2024-03-09T15:07:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.480__shadow_.b8dc2ZNHh-6yAEqw_MHHwCBOvwTz0B6_1_54f182914e365ae4c6b62316bcb2fd75', time=2024-03-09T16:59:34.589881+0000, chain.objs.size()=1 2024-03-09T15:07:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.480__shadow_.b8dc2ZNHh-6yAEqw_MHHwCBOvwTz0B6_0 2024-03-09T15:07:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3395659641233325354', time=2024-03-09T17:00:33.212651+0000, chain.objs.size()=2 2024-03-09T15:07:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.519__multipart_mymultipart.2~cAK_uzlZWyAkR0GgPd2v52R7QVwoN1z.1 2024-03-09T15:07:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.519__multipart_mymultipart.2~cAK_uzlZWyAkR0GgPd2v52R7QVwoN1z.2 2024-03-09T15:07:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.16918869148364341336', time=2024-03-09T17:01:52.028727+0000, chain.objs.size()=1 2024-03-09T15:07:05.416 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:JECbAvbdP86dTCzYPEFzhHxZRW7xwqo_.VtjYrvzAEo5I0CpS4zMSIG_xgY4EMsh_0 2024-03-09T15:07:05.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.3813419074149795555', time=2024-03-09T17:01:56.784027+0000, chain.objs.size()=1 2024-03-09T15:07:05.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:gtAWEQ3xZSY8HXpsRH4K0f3isxiHa8k_.Lz3tlnx-z1Gt5UWs1qzfkyo0ZsY379s_0 2024-03-09T15:07:05.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.8221490751948778609', time=2024-03-09T17:01:57.436690+0000, chain.objs.size()=1 2024-03-09T15:07:05.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.414+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.562__shadow:cQq5XhjB3iXRN1lya4VhQ5D1DfHxd8c_.MsklmiiR9S5eIHdSs7jqB8b-Cl6XS78_0 2024-03-09T15:07:05.417 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.418+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.15384762417223937165', time=2024-03-09T17:02:39.466439+0000, chain.objs.size()=1 2024-03-09T15:07:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.418+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.573__shadow:L3zT9mlDs1Azn.Si9K6gXUUJ2V4J8Cp_.Rq6OYpoFcPbS3fRQl_gx5DKyzgLj9sV_0 2024-03-09T15:07:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.418+0000 7f933ec68980 20 garbage collection: RGWGC::process iterating over entry tag='160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.6922436821022999429', time=2024-03-09T17:04:12.176239+0000, chain.objs.size()=1 2024-03-09T15:07:05.418 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.418+0000 7f933ec68980 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:160105e3-abe0-4c80-8c65-b187bbe6d91d.4635.655__shadow_.BRSsm5tsC922netGuxuLT2DIyRdoF-A_0 2024-03-09T15:07:05.421 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.422+0000 7f933ec68980 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-09T15:07:05.424 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.422+0000 7f91f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-09T15:07:05.425 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.426+0000 7f933ec68980 20 remove_watcher() i=0 2024-03-09T15:07:05.426 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.426+0000 7f933ec68980 2 removed watcher, disabling cache 2024-03-09T15:07:05.427 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.426+0000 7f933ec68980 20 remove_watcher() i=1 2024-03-09T15:07:05.428 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.430+0000 7f933ec68980 20 remove_watcher() i=2 2024-03-09T15:07:05.429 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.430+0000 7f933ec68980 20 remove_watcher() i=3 2024-03-09T15:07:05.430 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.430+0000 7f933ec68980 20 remove_watcher() i=4 2024-03-09T15:07:05.431 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.430+0000 7f933ec68980 20 remove_watcher() i=5 2024-03-09T15:07:05.432 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.434+0000 7f933ec68980 20 remove_watcher() i=6 2024-03-09T15:07:05.433 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:05.434+0000 7f933ec68980 20 remove_watcher() i=7 2024-03-09T15:07:05.444 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-03-09T15:07:05.455 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-03-09T15:07:05.493 DEBUG:teuthology.orchestra.run.smithi099:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-03-09T15:07:05.539 DEBUG:teuthology.orchestra.run.smithi099:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-03-09T15:07:05.588 DEBUG:teuthology.orchestra.run.smithi099:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-03-09T15:07:05.635 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm /usr/local/share/ca-certificates/root.crt 2024-03-09T15:07:05.690 DEBUG:teuthology.orchestra.run.smithi099:> sudo update-ca-certificates 2024-03-09T15:07:05.744 INFO:teuthology.orchestra.run.smithi099.stdout:Updating certificates in /etc/ssl/certs... 2024-03-09T15:07:06.112 INFO:teuthology.orchestra.run.smithi099.stdout:0 added, 0 removed; done. 2024-03-09T15:07:06.112 INFO:teuthology.orchestra.run.smithi099.stdout:Running hooks in /etc/ca-certificates/update.d... 2024-03-09T15:07:06.114 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:07:06.348 INFO:teuthology.orchestra.run.smithi099.stdout:done. 2024-03-09T15:07:06.348 INFO:teuthology.orchestra.run.smithi099.stdout:done. 2024-03-09T15:07:06.352 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-09T15:07:06.362 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-09T15:07:06.363 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:07:06.746 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:07:06.760 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-09T15:07:06.769 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":1412,"stamp":"2024-03-09T15:07:04.844237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":556778040,"num_objects":3190,"num_object_clones":0,"num_object_copies":11832,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3190,"num_whiteouts":0,"num_read":266428,"num_read_kb":2559738,"num_write":159197,"num_write_kb":2520655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":176,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13386,"ondisk_log_size":13386,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2516468,"kb_used_data":868544,"kb_used_omap":12,"kb_used_meta":1647219,"kb_avail":752458252,"statfs":{"total":773094113280,"available":770517250048,"internally_reserved":0,"allocated":889389056,"data_stored":873465104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1686752816},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,1,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-266690349,"num_objects":-1656,"num_object_clones":0,"num_object_copies":-6596,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1656,"num_whiteouts":0,"num_read":2080,"num_read_kb":61456,"num_write":1834,"num_write_kb":29890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007731"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:24.861905+0000","last_change":"2024-03-09T14:49:53.659913+0000","last_active":"2024-03-09T15:02:24.861905+0000","last_peered":"2024-03-09T15:02:24.861905+0000","last_clean":"2024-03-09T15:02:24.861905+0000","last_became_active":"2024-03-09T14:49:53.656173+0000","last_became_peered":"2024-03-09T14:49:53.656173+0000","last_unstale":"2024-03-09T15:02:24.861905+0000","last_undegraded":"2024-03-09T15:02:24.861905+0000","last_fullsized":"2024-03-09T15:02:24.861905+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:35.929830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.860903+0000","last_change":"2024-03-09T14:42:19.006802+0000","last_active":"2024-03-09T15:02:19.860903+0000","last_peered":"2024-03-09T15:02:19.860903+0000","last_clean":"2024-03-09T15:02:19.860903+0000","last_became_active":"2024-03-09T14:42:19.006064+0000","last_became_peered":"2024-03-09T14:42:19.006064+0000","last_unstale":"2024-03-09T15:02:19.860903+0000","last_undegraded":"2024-03-09T15:02:19.860903+0000","last_fullsized":"2024-03-09T15:02:19.860903+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:00:50.245633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.912628+0000","last_change":"2024-03-09T14:42:15.929304+0000","last_active":"2024-03-09T15:02:19.912628+0000","last_peered":"2024-03-09T15:02:19.912628+0000","last_clean":"2024-03-09T15:02:19.912628+0000","last_became_active":"2024-03-09T14:42:15.928518+0000","last_became_peered":"2024-03-09T14:42:15.928518+0000","last_unstale":"2024-03-09T15:02:19.912628+0000","last_undegraded":"2024-03-09T15:02:19.912628+0000","last_fullsized":"2024-03-09T15:02:19.912628+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:41:16.939221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'49","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.722055+0000","last_change":"2024-03-09T14:39:57.903467+0000","last_active":"2024-03-09T15:04:59.722055+0000","last_peered":"2024-03-09T15:04:59.722055+0000","last_clean":"2024-03-09T15:04:59.722055+0000","last_became_active":"2024-03-09T14:39:57.901879+0000","last_became_peered":"2024-03-09T14:39:57.901879+0000","last_unstale":"2024-03-09T15:04:59.722055+0000","last_undegraded":"2024-03-09T15:04:59.722055+0000","last_fullsized":"2024-03-09T15:04:59.722055+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:06:48.629872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":129,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:24.672562+0000","last_change":"2024-03-09T14:49:53.685563+0000","last_active":"2024-03-09T15:02:24.672562+0000","last_peered":"2024-03-09T15:02:24.672562+0000","last_clean":"2024-03-09T15:02:24.672562+0000","last_became_active":"2024-03-09T14:49:53.684941+0000","last_became_peered":"2024-03-09T14:49:53.684941+0000","last_unstale":"2024-03-09T15:02:24.672562+0000","last_undegraded":"2024-03-09T15:02:24.672562+0000","last_fullsized":"2024-03-09T15:02:24.672562+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:56:08.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.677113+0000","last_change":"2024-03-09T14:42:19.016523+0000","last_active":"2024-03-09T15:02:19.677113+0000","last_peered":"2024-03-09T15:02:19.677113+0000","last_clean":"2024-03-09T15:02:19.677113+0000","last_became_active":"2024-03-09T14:42:19.011453+0000","last_became_peered":"2024-03-09T14:42:19.011453+0000","last_unstale":"2024-03-09T15:02:19.677113+0000","last_undegraded":"2024-03-09T15:02:19.677113+0000","last_fullsized":"2024-03-09T15:02:19.677113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:58.069721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:20.035223+0000","last_change":"2024-03-09T14:42:15.971426+0000","last_active":"2024-03-09T15:02:20.035223+0000","last_peered":"2024-03-09T15:02:20.035223+0000","last_clean":"2024-03-09T15:02:20.035223+0000","last_became_active":"2024-03-09T14:42:15.970720+0000","last_became_peered":"2024-03-09T14:42:15.970720+0000","last_unstale":"2024-03-09T15:02:20.035223+0000","last_undegraded":"2024-03-09T15:02:20.035223+0000","last_fullsized":"2024-03-09T15:02:20.035223+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:19:28.165527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.696208+0000","last_change":"2024-03-09T14:39:57.894737+0000","last_active":"2024-03-09T15:04:09.696208+0000","last_peered":"2024-03-09T15:04:09.696208+0000","last_clean":"2024-03-09T15:04:09.696208+0000","last_became_active":"2024-03-09T14:39:57.894022+0000","last_became_peered":"2024-03-09T14:39:57.894022+0000","last_unstale":"2024-03-09T15:04:09.696208+0000","last_undegraded":"2024-03-09T15:04:09.696208+0000","last_fullsized":"2024-03-09T15:04:09.696208+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:04:28.968947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.703233+0000","last_change":"2024-03-09T14:49:53.677659+0000","last_active":"2024-03-09T15:04:24.703233+0000","last_peered":"2024-03-09T15:04:24.703233+0000","last_clean":"2024-03-09T15:04:24.703233+0000","last_became_active":"2024-03-09T14:49:53.676530+0000","last_became_peered":"2024-03-09T14:49:53.676530+0000","last_unstale":"2024-03-09T15:04:24.703233+0000","last_undegraded":"2024-03-09T15:04:24.703233+0000","last_fullsized":"2024-03-09T15:04:24.703233+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:46:58.203837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.695100+0000","last_change":"2024-03-09T14:42:19.295942+0000","last_active":"2024-03-09T15:03:09.695100+0000","last_peered":"2024-03-09T15:03:09.695100+0000","last_clean":"2024-03-09T15:03:09.695100+0000","last_became_active":"2024-03-09T14:42:19.295218+0000","last_became_peered":"2024-03-09T14:42:19.295218+0000","last_unstale":"2024-03-09T15:03:09.695100+0000","last_undegraded":"2024-03-09T15:03:09.695100+0000","last_fullsized":"2024-03-09T15:03:09.695100+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:07:18.137379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":63,"num_write":3,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"261'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.701153+0000","last_change":"2024-03-09T14:42:15.958751+0000","last_active":"2024-03-09T15:04:29.701153+0000","last_peered":"2024-03-09T15:04:29.701153+0000","last_clean":"2024-03-09T15:04:29.701153+0000","last_became_active":"2024-03-09T14:42:15.958052+0000","last_became_peered":"2024-03-09T14:42:15.958052+0000","last_unstale":"2024-03-09T15:04:29.701153+0000","last_undegraded":"2024-03-09T15:04:29.701153+0000","last_fullsized":"2024-03-09T15:04:29.701153+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:29:31.200748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'67","reported_seq":205,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:05.886666+0000","last_change":"2024-03-09T14:39:57.891306+0000","last_active":"2024-03-09T15:04:05.886666+0000","last_peered":"2024-03-09T15:04:05.886666+0000","last_clean":"2024-03-09T15:04:05.886666+0000","last_became_active":"2024-03-09T14:39:57.890452+0000","last_became_peered":"2024-03-09T14:39:57.890452+0000","last_unstale":"2024-03-09T15:04:05.886666+0000","last_undegraded":"2024-03-09T15:04:05.886666+0000","last_fullsized":"2024-03-09T15:04:05.886666+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:26.583506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":205,"num_write":124,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.944291+0000","last_change":"2024-03-09T14:49:53.669862+0000","last_active":"2024-03-09T15:04:24.944291+0000","last_peered":"2024-03-09T15:04:24.944291+0000","last_clean":"2024-03-09T15:04:24.944291+0000","last_became_active":"2024-03-09T14:49:53.669178+0000","last_became_peered":"2024-03-09T14:49:53.669178+0000","last_unstale":"2024-03-09T15:04:24.944291+0000","last_undegraded":"2024-03-09T15:04:24.944291+0000","last_fullsized":"2024-03-09T15:04:24.944291+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:33.018328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'6","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.944631+0000","last_change":"2024-03-09T14:42:19.295020+0000","last_active":"2024-03-09T15:04:24.944631+0000","last_peered":"2024-03-09T15:04:24.944631+0000","last_clean":"2024-03-09T15:04:24.944631+0000","last_became_active":"2024-03-09T14:42:19.294235+0000","last_became_peered":"2024-03-09T14:42:19.294235+0000","last_unstale":"2024-03-09T15:04:24.944631+0000","last_undegraded":"2024-03-09T15:04:24.944631+0000","last_fullsized":"2024-03-09T15:04:24.944631+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:26.179213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.688252+0000","last_change":"2024-03-09T14:42:15.958787+0000","last_active":"2024-03-09T15:03:09.688252+0000","last_peered":"2024-03-09T15:03:09.688252+0000","last_clean":"2024-03-09T15:03:09.688252+0000","last_became_active":"2024-03-09T14:42:15.957974+0000","last_became_peered":"2024-03-09T14:42:15.957974+0000","last_unstale":"2024-03-09T15:03:09.688252+0000","last_undegraded":"2024-03-09T15:03:09.688252+0000","last_fullsized":"2024-03-09T15:03:09.688252+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:28:08.525108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'35","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:15.106458+0000","last_change":"2024-03-09T14:39:57.910289+0000","last_active":"2024-03-09T15:03:15.106458+0000","last_peered":"2024-03-09T15:03:15.106458+0000","last_clean":"2024-03-09T15:03:15.106458+0000","last_became_active":"2024-03-09T14:39:57.909761+0000","last_became_peered":"2024-03-09T14:39:57.909761+0000","last_unstale":"2024-03-09T15:03:15.106458+0000","last_undegraded":"2024-03-09T15:03:15.106458+0000","last_fullsized":"2024-03-09T15:03:15.106458+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:05:46.103142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":109,"num_write":58,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:54.936666+0000","last_change":"2024-03-09T14:49:53.678276+0000","last_active":"2024-03-09T15:03:54.936666+0000","last_peered":"2024-03-09T15:03:54.936666+0000","last_clean":"2024-03-09T15:03:54.936666+0000","last_became_active":"2024-03-09T14:49:53.676902+0000","last_became_peered":"2024-03-09T14:49:53.676902+0000","last_unstale":"2024-03-09T15:03:54.936666+0000","last_undegraded":"2024-03-09T15:03:54.936666+0000","last_fullsized":"2024-03-09T15:03:54.936666+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:07:34.791991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.886265+0000","last_change":"2024-03-09T14:42:19.008196+0000","last_active":"2024-03-09T15:04:09.886265+0000","last_peered":"2024-03-09T15:04:09.886265+0000","last_clean":"2024-03-09T15:04:09.886265+0000","last_became_active":"2024-03-09T14:42:19.006923+0000","last_became_peered":"2024-03-09T14:42:19.006923+0000","last_unstale":"2024-03-09T15:04:09.886265+0000","last_undegraded":"2024-03-09T15:04:09.886265+0000","last_fullsized":"2024-03-09T15:04:09.886265+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:47:53.638625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.743319+0000","last_change":"2024-03-09T14:42:15.974088+0000","last_active":"2024-03-09T15:06:29.743319+0000","last_peered":"2024-03-09T15:06:29.743319+0000","last_clean":"2024-03-09T15:06:29.743319+0000","last_became_active":"2024-03-09T14:42:15.971499+0000","last_became_peered":"2024-03-09T14:42:15.971499+0000","last_unstale":"2024-03-09T15:06:29.743319+0000","last_undegraded":"2024-03-09T15:06:29.743319+0000","last_fullsized":"2024-03-09T15:06:29.743319+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:31.642579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'33","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:29.915211+0000","last_change":"2024-03-09T14:39:57.900156+0000","last_active":"2024-03-09T15:02:29.915211+0000","last_peered":"2024-03-09T15:02:29.915211+0000","last_clean":"2024-03-09T15:02:29.915211+0000","last_became_active":"2024-03-09T14:39:57.898849+0000","last_became_peered":"2024-03-09T14:39:57.898849+0000","last_unstale":"2024-03-09T15:02:29.915211+0000","last_undegraded":"2024-03-09T15:02:29.915211+0000","last_fullsized":"2024-03-09T15:02:29.915211+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:28.068027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":100,"num_write":52,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:30.064856+0000","last_change":"2024-03-09T14:49:53.660759+0000","last_active":"2024-03-09T15:04:30.064856+0000","last_peered":"2024-03-09T15:04:30.064856+0000","last_clean":"2024-03-09T15:04:30.064856+0000","last_became_active":"2024-03-09T14:49:53.648332+0000","last_became_peered":"2024-03-09T14:49:53.648332+0000","last_unstale":"2024-03-09T15:04:30.064856+0000","last_undegraded":"2024-03-09T15:04:30.064856+0000","last_fullsized":"2024-03-09T15:04:30.064856+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:53:22.627039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'5","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.699112+0000","last_change":"2024-03-09T14:42:19.004615+0000","last_active":"2024-03-09T15:04:04.699112+0000","last_peered":"2024-03-09T15:04:04.699112+0000","last_clean":"2024-03-09T15:04:04.699112+0000","last_became_active":"2024-03-09T14:42:19.003868+0000","last_became_peered":"2024-03-09T14:42:19.003868+0000","last_unstale":"2024-03-09T15:04:04.699112+0000","last_undegraded":"2024-03-09T15:04:04.699112+0000","last_fullsized":"2024-03-09T15:04:04.699112+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:37:03.868001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'1","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:14.702723+0000","last_change":"2024-03-09T14:42:15.948619+0000","last_active":"2024-03-09T15:04:14.702723+0000","last_peered":"2024-03-09T15:04:14.702723+0000","last_clean":"2024-03-09T15:04:14.702723+0000","last_became_active":"2024-03-09T14:42:15.947888+0000","last_became_peered":"2024-03-09T14:42:15.947888+0000","last_unstale":"2024-03-09T15:04:14.702723+0000","last_undegraded":"2024-03-09T15:04:14.702723+0000","last_fullsized":"2024-03-09T15:04:14.702723+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:44.462054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'23","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:29.678061+0000","last_change":"2024-03-09T14:39:57.908221+0000","last_active":"2024-03-09T15:02:29.678061+0000","last_peered":"2024-03-09T15:02:29.678061+0000","last_clean":"2024-03-09T15:02:29.678061+0000","last_became_active":"2024-03-09T14:39:57.907530+0000","last_became_peered":"2024-03-09T14:39:57.907530+0000","last_unstale":"2024-03-09T15:02:29.678061+0000","last_undegraded":"2024-03-09T15:02:29.678061+0000","last_fullsized":"2024-03-09T15:02:29.678061+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:04:57.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":69,"num_write":39,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:24.893913+0000","last_change":"2024-03-09T14:49:53.677579+0000","last_active":"2024-03-09T15:02:24.893913+0000","last_peered":"2024-03-09T15:02:24.893913+0000","last_clean":"2024-03-09T15:02:24.893913+0000","last_became_active":"2024-03-09T14:49:53.676976+0000","last_became_peered":"2024-03-09T14:49:53.676976+0000","last_unstale":"2024-03-09T15:02:24.893913+0000","last_undegraded":"2024-03-09T15:02:24.893913+0000","last_fullsized":"2024-03-09T15:02:24.893913+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:07:35.978642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.675982+0000","last_change":"2024-03-09T14:42:19.017355+0000","last_active":"2024-03-09T15:02:19.675982+0000","last_peered":"2024-03-09T15:02:19.675982+0000","last_clean":"2024-03-09T15:02:19.675982+0000","last_became_active":"2024-03-09T14:42:19.008779+0000","last_became_peered":"2024-03-09T14:42:19.008779+0000","last_unstale":"2024-03-09T15:02:19.675982+0000","last_undegraded":"2024-03-09T15:02:19.675982+0000","last_fullsized":"2024-03-09T15:02:19.675982+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:37:37.205376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"261'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.676961+0000","last_change":"2024-03-09T14:42:15.943933+0000","last_active":"2024-03-09T15:02:19.676961+0000","last_peered":"2024-03-09T15:02:19.676961+0000","last_clean":"2024-03-09T15:02:19.676961+0000","last_became_active":"2024-03-09T14:42:15.943177+0000","last_became_peered":"2024-03-09T14:42:15.943177+0000","last_unstale":"2024-03-09T15:02:19.676961+0000","last_undegraded":"2024-03-09T15:02:19.676961+0000","last_fullsized":"2024-03-09T15:02:19.676961+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:55.865049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'28","reported_seq":111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:14.710731+0000","last_change":"2024-03-09T14:39:57.895113+0000","last_active":"2024-03-09T15:04:14.710731+0000","last_peered":"2024-03-09T15:04:14.710731+0000","last_clean":"2024-03-09T15:04:14.710731+0000","last_became_active":"2024-03-09T14:39:57.894343+0000","last_became_peered":"2024-03-09T14:39:57.894343+0000","last_unstale":"2024-03-09T15:04:14.710731+0000","last_undegraded":"2024-03-09T15:04:14.710731+0000","last_fullsized":"2024-03-09T15:04:14.710731+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:50:51.100845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":82,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:24.894013+0000","last_change":"2024-03-09T14:49:53.666909+0000","last_active":"2024-03-09T15:02:24.894013+0000","last_peered":"2024-03-09T15:02:24.894013+0000","last_clean":"2024-03-09T15:02:24.894013+0000","last_became_active":"2024-03-09T14:49:53.666178+0000","last_became_peered":"2024-03-09T14:49:53.666178+0000","last_unstale":"2024-03-09T15:02:24.894013+0000","last_undegraded":"2024-03-09T15:02:24.894013+0000","last_fullsized":"2024-03-09T15:02:24.894013+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:52.776783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.912444+0000","last_change":"2024-03-09T14:42:19.007765+0000","last_active":"2024-03-09T15:02:19.912444+0000","last_peered":"2024-03-09T15:02:19.912444+0000","last_clean":"2024-03-09T15:02:19.912444+0000","last_became_active":"2024-03-09T14:42:19.004684+0000","last_became_peered":"2024-03-09T14:42:19.004684+0000","last_unstale":"2024-03-09T15:02:19.912444+0000","last_undegraded":"2024-03-09T15:02:19.912444+0000","last_fullsized":"2024-03-09T15:02:19.912444+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:43:10.037376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"261'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.683201+0000","last_change":"2024-03-09T14:42:15.973483+0000","last_active":"2024-03-09T15:02:19.683201+0000","last_peered":"2024-03-09T15:02:19.683201+0000","last_clean":"2024-03-09T15:02:19.683201+0000","last_became_active":"2024-03-09T14:42:15.972713+0000","last_became_peered":"2024-03-09T14:42:15.972713+0000","last_unstale":"2024-03-09T15:02:19.683201+0000","last_undegraded":"2024-03-09T15:02:19.683201+0000","last_fullsized":"2024-03-09T15:02:19.683201+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:13:58.988787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'37","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:10.059878+0000","last_change":"2024-03-09T14:39:57.870198+0000","last_active":"2024-03-09T15:04:10.059878+0000","last_peered":"2024-03-09T15:04:10.059878+0000","last_clean":"2024-03-09T15:04:10.059878+0000","last_became_active":"2024-03-09T14:39:57.869392+0000","last_became_peered":"2024-03-09T14:39:57.869392+0000","last_unstale":"2024-03-09T15:04:10.059878+0000","last_undegraded":"2024-03-09T15:04:10.059878+0000","last_fullsized":"2024-03-09T15:04:10.059878+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:30:48.323996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":118,"num_write":73,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:55.056586+0000","last_change":"2024-03-09T14:49:53.652690+0000","last_active":"2024-03-09T15:03:55.056586+0000","last_peered":"2024-03-09T15:03:55.056586+0000","last_clean":"2024-03-09T15:03:55.056586+0000","last_became_active":"2024-03-09T14:49:53.651987+0000","last_became_peered":"2024-03-09T14:49:53.651987+0000","last_unstale":"2024-03-09T15:03:55.056586+0000","last_undegraded":"2024-03-09T15:03:55.056586+0000","last_fullsized":"2024-03-09T15:03:55.056586+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:48:58.583996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.939291+0000","last_change":"2024-03-09T14:42:19.294955+0000","last_active":"2024-03-09T15:04:04.939291+0000","last_peered":"2024-03-09T15:04:04.939291+0000","last_clean":"2024-03-09T15:04:04.939291+0000","last_became_active":"2024-03-09T14:42:19.294108+0000","last_became_peered":"2024-03-09T14:42:19.294108+0000","last_unstale":"2024-03-09T15:04:04.939291+0000","last_undegraded":"2024-03-09T15:04:04.939291+0000","last_fullsized":"2024-03-09T15:04:04.939291+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:48:58.874062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.875733+0000","last_change":"2024-03-09T14:42:15.950610+0000","last_active":"2024-03-09T15:03:24.875733+0000","last_peered":"2024-03-09T15:03:24.875733+0000","last_clean":"2024-03-09T15:03:24.875733+0000","last_became_active":"2024-03-09T14:42:15.947591+0000","last_became_peered":"2024-03-09T14:42:15.947591+0000","last_unstale":"2024-03-09T15:03:24.875733+0000","last_undegraded":"2024-03-09T15:03:24.875733+0000","last_fullsized":"2024-03-09T15:03:24.875733+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:54:57.588230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'56","reported_seq":185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.709771+0000","last_change":"2024-03-09T14:39:57.895126+0000","last_active":"2024-03-09T15:04:09.709771+0000","last_peered":"2024-03-09T15:04:09.709771+0000","last_clean":"2024-03-09T15:04:09.709771+0000","last_became_active":"2024-03-09T14:39:57.894370+0000","last_became_peered":"2024-03-09T14:39:57.894370+0000","last_unstale":"2024-03-09T15:04:09.709771+0000","last_undegraded":"2024-03-09T15:04:09.709771+0000","last_fullsized":"2024-03-09T15:04:09.709771+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:33:51.603400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":182,"num_write":87,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:54.692738+0000","last_change":"2024-03-09T14:49:53.661026+0000","last_active":"2024-03-09T15:03:54.692738+0000","last_peered":"2024-03-09T15:03:54.692738+0000","last_clean":"2024-03-09T15:03:54.692738+0000","last_became_active":"2024-03-09T14:49:53.660291+0000","last_became_peered":"2024-03-09T14:49:53.660291+0000","last_unstale":"2024-03-09T15:03:54.692738+0000","last_undegraded":"2024-03-09T15:03:54.692738+0000","last_fullsized":"2024-03-09T15:03:54.692738+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:48:25.436136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.929184+0000","last_change":"2024-03-09T14:42:19.299865+0000","last_active":"2024-03-09T15:03:24.929184+0000","last_peered":"2024-03-09T15:03:24.929184+0000","last_clean":"2024-03-09T15:03:24.929184+0000","last_became_active":"2024-03-09T14:42:19.294391+0000","last_became_peered":"2024-03-09T14:42:19.294391+0000","last_unstale":"2024-03-09T15:03:24.929184+0000","last_undegraded":"2024-03-09T15:03:24.929184+0000","last_fullsized":"2024-03-09T15:03:24.929184+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:29.593526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.704425+0000","last_change":"2024-03-09T14:42:15.962523+0000","last_active":"2024-03-09T15:04:04.704425+0000","last_peered":"2024-03-09T15:04:04.704425+0000","last_clean":"2024-03-09T15:04:04.704425+0000","last_became_active":"2024-03-09T14:42:15.961751+0000","last_became_peered":"2024-03-09T14:42:15.961751+0000","last_unstale":"2024-03-09T15:04:04.704425+0000","last_undegraded":"2024-03-09T15:04:04.704425+0000","last_fullsized":"2024-03-09T15:04:04.704425+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:20:28.923195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'41","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.940491+0000","last_change":"2024-03-09T14:39:57.900193+0000","last_active":"2024-03-09T15:04:09.940491+0000","last_peered":"2024-03-09T15:04:09.940491+0000","last_clean":"2024-03-09T15:04:09.940491+0000","last_became_active":"2024-03-09T14:39:57.898651+0000","last_became_peered":"2024-03-09T14:39:57.898651+0000","last_unstale":"2024-03-09T15:04:09.940491+0000","last_undegraded":"2024-03-09T15:04:09.940491+0000","last_fullsized":"2024-03-09T15:04:09.940491+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:57:09.093834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":141,"num_write":58,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:54.701644+0000","last_change":"2024-03-09T14:49:53.677983+0000","last_active":"2024-03-09T15:03:54.701644+0000","last_peered":"2024-03-09T15:03:54.701644+0000","last_clean":"2024-03-09T15:03:54.701644+0000","last_became_active":"2024-03-09T14:49:53.677160+0000","last_became_peered":"2024-03-09T14:49:53.677160+0000","last_unstale":"2024-03-09T15:03:54.701644+0000","last_undegraded":"2024-03-09T15:03:54.701644+0000","last_fullsized":"2024-03-09T15:03:54.701644+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:52:56.789373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.939388+0000","last_change":"2024-03-09T14:42:19.298779+0000","last_active":"2024-03-09T15:04:04.939388+0000","last_peered":"2024-03-09T15:04:04.939388+0000","last_clean":"2024-03-09T15:04:04.939388+0000","last_became_active":"2024-03-09T14:42:19.297984+0000","last_became_peered":"2024-03-09T14:42:19.297984+0000","last_unstale":"2024-03-09T15:04:04.939388+0000","last_undegraded":"2024-03-09T15:04:04.939388+0000","last_fullsized":"2024-03-09T15:04:04.939388+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:39.001468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.695173+0000","last_change":"2024-03-09T14:42:15.959256+0000","last_active":"2024-03-09T15:04:04.695173+0000","last_peered":"2024-03-09T15:04:04.695173+0000","last_clean":"2024-03-09T15:04:04.695173+0000","last_became_active":"2024-03-09T14:42:15.958476+0000","last_became_peered":"2024-03-09T14:42:15.958476+0000","last_unstale":"2024-03-09T15:04:04.695173+0000","last_undegraded":"2024-03-09T15:04:04.695173+0000","last_fullsized":"2024-03-09T15:04:04.695173+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:53:52.388607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'111","reported_seq":374,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.696130+0000","last_change":"2024-03-09T14:39:57.873649+0000","last_active":"2024-03-09T15:04:09.696130+0000","last_peered":"2024-03-09T15:04:09.696130+0000","last_clean":"2024-03-09T15:04:09.696130+0000","last_became_active":"2024-03-09T14:39:57.872922+0000","last_became_peered":"2024-03-09T14:39:57.872922+0000","last_unstale":"2024-03-09T15:04:09.696130+0000","last_undegraded":"2024-03-09T15:04:09.696130+0000","last_fullsized":"2024-03-09T15:04:09.696130+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:27:37.326144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":634,"num_read_kb":458,"num_write":138,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:54.882960+0000","last_change":"2024-03-09T14:49:53.652070+0000","last_active":"2024-03-09T15:03:54.882960+0000","last_peered":"2024-03-09T15:03:54.882960+0000","last_clean":"2024-03-09T15:03:54.882960+0000","last_became_active":"2024-03-09T14:49:53.651353+0000","last_became_peered":"2024-03-09T14:49:53.651353+0000","last_unstale":"2024-03-09T15:03:54.882960+0000","last_undegraded":"2024-03-09T15:03:54.882960+0000","last_fullsized":"2024-03-09T15:03:54.882960+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:38.891462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.700677+0000","last_change":"2024-03-09T14:42:19.015145+0000","last_active":"2024-03-09T15:04:04.700677+0000","last_peered":"2024-03-09T15:04:04.700677+0000","last_clean":"2024-03-09T15:04:04.700677+0000","last_became_active":"2024-03-09T14:42:19.011213+0000","last_became_peered":"2024-03-09T14:42:19.011213+0000","last_unstale":"2024-03-09T15:04:04.700677+0000","last_undegraded":"2024-03-09T15:04:04.700677+0000","last_fullsized":"2024-03-09T15:04:04.700677+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:06:20.548710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.743627+0000","last_change":"2024-03-09T14:42:15.975026+0000","last_active":"2024-03-09T15:06:29.743627+0000","last_peered":"2024-03-09T15:06:29.743627+0000","last_clean":"2024-03-09T15:06:29.743627+0000","last_became_active":"2024-03-09T14:42:15.974300+0000","last_became_peered":"2024-03-09T14:42:15.974300+0000","last_unstale":"2024-03-09T15:06:29.743627+0000","last_undegraded":"2024-03-09T15:06:29.743627+0000","last_fullsized":"2024-03-09T15:06:29.743627+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:06.615185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'10","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:29.695997+0000","last_change":"2024-03-09T14:39:57.906220+0000","last_active":"2024-03-09T15:03:29.695997+0000","last_peered":"2024-03-09T15:03:29.695997+0000","last_clean":"2024-03-09T15:03:29.695997+0000","last_became_active":"2024-03-09T14:39:57.905161+0000","last_became_peered":"2024-03-09T14:39:57.905161+0000","last_unstale":"2024-03-09T15:03:29.695997+0000","last_undegraded":"2024-03-09T15:03:29.695997+0000","last_fullsized":"2024-03-09T15:03:29.695997+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:43.275061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.944574+0000","last_change":"2024-03-09T14:49:53.677779+0000","last_active":"2024-03-09T15:04:24.944574+0000","last_peered":"2024-03-09T15:04:24.944574+0000","last_clean":"2024-03-09T15:04:24.944574+0000","last_became_active":"2024-03-09T14:49:53.676180+0000","last_became_peered":"2024-03-09T14:49:53.676180+0000","last_unstale":"2024-03-09T15:04:24.944574+0000","last_undegraded":"2024-03-09T15:04:24.944574+0000","last_fullsized":"2024-03-09T15:04:24.944574+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:48.285352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'14","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:20.048967+0000","last_change":"2024-03-09T14:42:19.015638+0000","last_active":"2024-03-09T15:03:20.048967+0000","last_peered":"2024-03-09T15:03:20.048967+0000","last_clean":"2024-03-09T15:03:20.048967+0000","last_became_active":"2024-03-09T14:42:19.015001+0000","last_became_peered":"2024-03-09T14:42:19.015001+0000","last_unstale":"2024-03-09T15:03:20.048967+0000","last_undegraded":"2024-03-09T15:03:20.048967+0000","last_fullsized":"2024-03-09T15:03:20.048967+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:05.722560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1053539,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":18444,"num_write":28,"num_write_kb":15365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'8","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:39.721379+0000","last_change":"2024-03-09T14:42:15.937658+0000","last_active":"2024-03-09T15:05:39.721379+0000","last_peered":"2024-03-09T15:05:39.721379+0000","last_clean":"2024-03-09T15:05:39.721379+0000","last_became_active":"2024-03-09T14:42:15.936690+0000","last_became_peered":"2024-03-09T14:42:15.936690+0000","last_unstale":"2024-03-09T15:05:39.721379+0000","last_undegraded":"2024-03-09T15:05:39.721379+0000","last_fullsized":"2024-03-09T15:05:39.721379+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:16:38.693218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'45","reported_seq":154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.693525+0000","last_change":"2024-03-09T14:39:57.900885+0000","last_active":"2024-03-09T15:03:19.693525+0000","last_peered":"2024-03-09T15:03:19.693525+0000","last_clean":"2024-03-09T15:03:19.693525+0000","last_became_active":"2024-03-09T14:39:57.900112+0000","last_became_peered":"2024-03-09T14:39:57.900112+0000","last_unstale":"2024-03-09T15:03:19.693525+0000","last_undegraded":"2024-03-09T15:03:19.693525+0000","last_fullsized":"2024-03-09T15:03:19.693525+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:04:24.272860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":133,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.713253+0000","last_change":"2024-03-09T14:49:53.687062+0000","last_active":"2024-03-09T15:04:24.713253+0000","last_peered":"2024-03-09T15:04:24.713253+0000","last_clean":"2024-03-09T15:04:24.713253+0000","last_became_active":"2024-03-09T14:49:53.683189+0000","last_became_peered":"2024-03-09T14:49:53.683189+0000","last_unstale":"2024-03-09T15:04:24.713253+0000","last_undegraded":"2024-03-09T15:04:24.713253+0000","last_fullsized":"2024-03-09T15:04:24.713253+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:53.571138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'1","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:20.048879+0000","last_change":"2024-03-09T14:42:19.009789+0000","last_active":"2024-03-09T15:03:20.048879+0000","last_peered":"2024-03-09T15:03:20.048879+0000","last_clean":"2024-03-09T15:03:20.048879+0000","last_became_active":"2024-03-09T14:42:19.009159+0000","last_became_peered":"2024-03-09T14:42:19.009159+0000","last_unstale":"2024-03-09T15:03:20.048879+0000","last_undegraded":"2024-03-09T15:03:20.048879+0000","last_fullsized":"2024-03-09T15:03:20.048879+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:07:33.321079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'8","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.927850+0000","last_change":"2024-03-09T14:42:15.954296+0000","last_active":"2024-03-09T15:03:19.927850+0000","last_peered":"2024-03-09T15:03:19.927850+0000","last_clean":"2024-03-09T15:03:19.927850+0000","last_became_active":"2024-03-09T14:42:15.953580+0000","last_became_peered":"2024-03-09T14:42:15.953580+0000","last_unstale":"2024-03-09T15:03:19.927850+0000","last_undegraded":"2024-03-09T15:03:19.927850+0000","last_fullsized":"2024-03-09T15:03:19.927850+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:02:21.500373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":25600,"num_write":23,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'39","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.697112+0000","last_change":"2024-03-09T14:39:57.897154+0000","last_active":"2024-03-09T15:03:19.697112+0000","last_peered":"2024-03-09T15:03:19.697112+0000","last_clean":"2024-03-09T15:03:19.697112+0000","last_became_active":"2024-03-09T14:39:57.896549+0000","last_became_peered":"2024-03-09T14:39:57.896549+0000","last_unstale":"2024-03-09T15:03:19.697112+0000","last_undegraded":"2024-03-09T15:03:19.697112+0000","last_fullsized":"2024-03-09T15:03:19.697112+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:01:16.877495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":110,"num_write":67,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.706787+0000","last_change":"2024-03-09T14:49:53.674470+0000","last_active":"2024-03-09T15:03:59.706787+0000","last_peered":"2024-03-09T15:03:59.706787+0000","last_clean":"2024-03-09T15:03:59.706787+0000","last_became_active":"2024-03-09T14:49:53.673345+0000","last_became_peered":"2024-03-09T14:49:53.673345+0000","last_unstale":"2024-03-09T15:03:59.706787+0000","last_undegraded":"2024-03-09T15:03:59.706787+0000","last_fullsized":"2024-03-09T15:03:59.706787+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:18.602619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.927955+0000","last_change":"2024-03-09T14:42:19.021679+0000","last_active":"2024-03-09T15:03:19.927955+0000","last_peered":"2024-03-09T15:03:19.927955+0000","last_clean":"2024-03-09T15:03:19.927955+0000","last_became_active":"2024-03-09T14:42:19.020650+0000","last_became_peered":"2024-03-09T14:42:19.020650+0000","last_unstale":"2024-03-09T15:03:19.927955+0000","last_undegraded":"2024-03-09T15:03:19.927955+0000","last_fullsized":"2024-03-09T15:03:19.927955+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:04:12.719156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.688968+0000","last_change":"2024-03-09T14:42:15.959020+0000","last_active":"2024-03-09T15:03:19.688968+0000","last_peered":"2024-03-09T15:03:19.688968+0000","last_clean":"2024-03-09T15:03:19.688968+0000","last_became_active":"2024-03-09T14:42:15.958276+0000","last_became_peered":"2024-03-09T14:42:15.958276+0000","last_unstale":"2024-03-09T15:03:19.688968+0000","last_undegraded":"2024-03-09T15:03:19.688968+0000","last_fullsized":"2024-03-09T15:03:19.688968+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:56:29.405946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'35","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.690399+0000","last_change":"2024-03-09T14:39:57.892474+0000","last_active":"2024-03-09T15:03:19.690399+0000","last_peered":"2024-03-09T15:03:19.690399+0000","last_clean":"2024-03-09T15:03:19.690399+0000","last_became_active":"2024-03-09T14:39:57.891706+0000","last_became_peered":"2024-03-09T14:39:57.891706+0000","last_unstale":"2024-03-09T15:03:19.690399+0000","last_undegraded":"2024-03-09T15:03:19.690399+0000","last_fullsized":"2024-03-09T15:03:19.690399+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:29.216981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":98,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.944492+0000","last_change":"2024-03-09T14:49:53.678730+0000","last_active":"2024-03-09T15:04:24.944492+0000","last_peered":"2024-03-09T15:04:24.944492+0000","last_clean":"2024-03-09T15:04:24.944492+0000","last_became_active":"2024-03-09T14:49:53.670121+0000","last_became_peered":"2024-03-09T14:49:53.670121+0000","last_unstale":"2024-03-09T15:04:24.944492+0000","last_undegraded":"2024-03-09T15:04:24.944492+0000","last_fullsized":"2024-03-09T15:04:24.944492+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:10:05.346364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.688916+0000","last_change":"2024-03-09T14:42:18.993764+0000","last_active":"2024-03-09T15:03:19.688916+0000","last_peered":"2024-03-09T15:03:19.688916+0000","last_clean":"2024-03-09T15:03:19.688916+0000","last_became_active":"2024-03-09T14:42:18.992996+0000","last_became_peered":"2024-03-09T14:42:18.992996+0000","last_unstale":"2024-03-09T15:03:19.688916+0000","last_undegraded":"2024-03-09T15:03:19.688916+0000","last_fullsized":"2024-03-09T15:03:19.688916+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:13:18.645764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"261'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.874329+0000","last_change":"2024-03-09T14:42:15.950801+0000","last_active":"2024-03-09T15:03:19.874329+0000","last_peered":"2024-03-09T15:03:19.874329+0000","last_clean":"2024-03-09T15:03:19.874329+0000","last_became_active":"2024-03-09T14:42:15.950001+0000","last_became_peered":"2024-03-09T14:42:15.950001+0000","last_unstale":"2024-03-09T15:03:19.874329+0000","last_undegraded":"2024-03-09T15:03:19.874329+0000","last_fullsized":"2024-03-09T15:03:19.874329+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:46:50.557868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'55","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.927771+0000","last_change":"2024-03-09T14:39:57.910603+0000","last_active":"2024-03-09T15:03:19.927771+0000","last_peered":"2024-03-09T15:03:19.927771+0000","last_clean":"2024-03-09T15:03:19.927771+0000","last_became_active":"2024-03-09T14:39:57.909827+0000","last_became_peered":"2024-03-09T14:39:57.909827+0000","last_unstale":"2024-03-09T15:03:19.927771+0000","last_undegraded":"2024-03-09T15:03:19.927771+0000","last_fullsized":"2024-03-09T15:03:19.927771+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:39:16.796198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":147,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:59.680775+0000","last_change":"2024-03-09T14:49:53.642413+0000","last_active":"2024-03-09T15:02:59.680775+0000","last_peered":"2024-03-09T15:02:59.680775+0000","last_clean":"2024-03-09T15:02:59.680775+0000","last_became_active":"2024-03-09T14:49:53.641152+0000","last_became_peered":"2024-03-09T14:49:53.641152+0000","last_unstale":"2024-03-09T15:02:59.680775+0000","last_undegraded":"2024-03-09T15:02:59.680775+0000","last_fullsized":"2024-03-09T15:02:59.680775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:14:59.780475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:34.916573+0000","last_change":"2024-03-09T14:42:19.015582+0000","last_active":"2024-03-09T15:02:34.916573+0000","last_peered":"2024-03-09T15:02:34.916573+0000","last_clean":"2024-03-09T15:02:34.916573+0000","last_became_active":"2024-03-09T14:42:19.013356+0000","last_became_peered":"2024-03-09T14:42:19.013356+0000","last_unstale":"2024-03-09T15:02:34.916573+0000","last_undegraded":"2024-03-09T15:02:34.916573+0000","last_fullsized":"2024-03-09T15:02:34.916573+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:23.724974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":15360,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.715863+0000","last_change":"2024-03-09T14:42:15.965456+0000","last_active":"2024-03-09T15:04:49.715863+0000","last_peered":"2024-03-09T15:04:49.715863+0000","last_clean":"2024-03-09T15:04:49.715863+0000","last_became_active":"2024-03-09T14:42:15.964591+0000","last_became_peered":"2024-03-09T14:42:15.964591+0000","last_unstale":"2024-03-09T15:04:49.715863+0000","last_undegraded":"2024-03-09T15:04:49.715863+0000","last_fullsized":"2024-03-09T15:04:49.715863+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:37.614168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'15","reported_seq":83,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:28.704099+0000","last_change":"2024-03-09T14:39:57.901484+0000","last_active":"2024-03-09T15:05:28.704099+0000","last_peered":"2024-03-09T15:05:28.704099+0000","last_clean":"2024-03-09T15:05:28.704099+0000","last_became_active":"2024-03-09T14:39:57.898952+0000","last_became_peered":"2024-03-09T14:39:57.898952+0000","last_unstale":"2024-03-09T15:05:28.704099+0000","last_undegraded":"2024-03-09T15:05:28.704099+0000","last_fullsized":"2024-03-09T15:05:28.704099+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:26:28.443115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":52,"num_write":21,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.694828+0000","last_change":"2024-03-09T14:49:53.654700+0000","last_active":"2024-03-09T15:03:24.694828+0000","last_peered":"2024-03-09T15:03:24.694828+0000","last_clean":"2024-03-09T15:03:24.694828+0000","last_became_active":"2024-03-09T14:49:53.653943+0000","last_became_peered":"2024-03-09T14:49:53.653943+0000","last_unstale":"2024-03-09T15:03:24.694828+0000","last_undegraded":"2024-03-09T15:03:24.694828+0000","last_fullsized":"2024-03-09T15:03:24.694828+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:42:20.322883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:34.916502+0000","last_change":"2024-03-09T14:42:19.016131+0000","last_active":"2024-03-09T15:02:34.916502+0000","last_peered":"2024-03-09T15:02:34.916502+0000","last_clean":"2024-03-09T15:02:34.916502+0000","last_became_active":"2024-03-09T14:42:19.008729+0000","last_became_peered":"2024-03-09T14:42:19.008729+0000","last_unstale":"2024-03-09T15:02:34.916502+0000","last_undegraded":"2024-03-09T15:02:34.916502+0000","last_fullsized":"2024-03-09T15:02:34.916502+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:26.299678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.705243+0000","last_change":"2024-03-09T14:42:15.979152+0000","last_active":"2024-03-09T15:04:49.705243+0000","last_peered":"2024-03-09T15:04:49.705243+0000","last_clean":"2024-03-09T15:04:49.705243+0000","last_became_active":"2024-03-09T14:42:15.978166+0000","last_became_peered":"2024-03-09T14:42:15.978166+0000","last_unstale":"2024-03-09T15:04:49.705243+0000","last_undegraded":"2024-03-09T15:04:49.705243+0000","last_fullsized":"2024-03-09T15:04:49.705243+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:16.321080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'46","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:44.894221+0000","last_change":"2024-03-09T14:39:57.904419+0000","last_active":"2024-03-09T15:04:44.894221+0000","last_peered":"2024-03-09T15:04:44.894221+0000","last_clean":"2024-03-09T15:04:44.894221+0000","last_became_active":"2024-03-09T14:39:57.904012+0000","last_became_peered":"2024-03-09T14:39:57.904012+0000","last_unstale":"2024-03-09T15:04:44.894221+0000","last_undegraded":"2024-03-09T15:04:44.894221+0000","last_fullsized":"2024-03-09T15:04:44.894221+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:15:51.742502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":131,"num_write":86,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.683364+0000","last_change":"2024-03-09T14:49:53.680169+0000","last_active":"2024-03-09T15:02:54.683364+0000","last_peered":"2024-03-09T15:02:54.683364+0000","last_clean":"2024-03-09T15:02:54.683364+0000","last_became_active":"2024-03-09T14:49:53.678157+0000","last_became_peered":"2024-03-09T14:49:53.678157+0000","last_unstale":"2024-03-09T15:02:54.683364+0000","last_undegraded":"2024-03-09T15:02:54.683364+0000","last_fullsized":"2024-03-09T15:02:54.683364+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:04:53.932617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:35.038563+0000","last_change":"2024-03-09T14:42:19.296270+0000","last_active":"2024-03-09T15:02:35.038563+0000","last_peered":"2024-03-09T15:02:35.038563+0000","last_clean":"2024-03-09T15:02:35.038563+0000","last_became_active":"2024-03-09T14:42:19.295533+0000","last_became_peered":"2024-03-09T14:42:19.295533+0000","last_unstale":"2024-03-09T15:02:35.038563+0000","last_undegraded":"2024-03-09T15:02:35.038563+0000","last_fullsized":"2024-03-09T15:02:35.038563+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:35:31.738225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"261'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.719520+0000","last_change":"2024-03-09T14:42:15.968987+0000","last_active":"2024-03-09T15:04:49.719520+0000","last_peered":"2024-03-09T15:04:49.719520+0000","last_clean":"2024-03-09T15:04:49.719520+0000","last_became_active":"2024-03-09T14:42:15.968323+0000","last_became_peered":"2024-03-09T14:42:15.968323+0000","last_unstale":"2024-03-09T15:04:49.719520+0000","last_undegraded":"2024-03-09T15:04:49.719520+0000","last_fullsized":"2024-03-09T15:04:49.719520+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:52:18.206406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'40","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:44.707473+0000","last_change":"2024-03-09T14:39:57.898866+0000","last_active":"2024-03-09T15:04:44.707473+0000","last_peered":"2024-03-09T15:04:44.707473+0000","last_clean":"2024-03-09T15:04:44.707473+0000","last_became_active":"2024-03-09T14:39:57.898234+0000","last_became_peered":"2024-03-09T14:39:57.898234+0000","last_unstale":"2024-03-09T15:04:44.707473+0000","last_undegraded":"2024-03-09T15:04:44.707473+0000","last_fullsized":"2024-03-09T15:04:44.707473+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:55:57.096082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":111,"num_write":71,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.901778+0000","last_change":"2024-03-09T14:49:53.663589+0000","last_active":"2024-03-09T15:02:54.901778+0000","last_peered":"2024-03-09T15:02:54.901778+0000","last_clean":"2024-03-09T15:02:54.901778+0000","last_became_active":"2024-03-09T14:49:53.662812+0000","last_became_peered":"2024-03-09T14:49:53.662812+0000","last_unstale":"2024-03-09T15:02:54.901778+0000","last_undegraded":"2024-03-09T15:02:54.901778+0000","last_fullsized":"2024-03-09T15:02:54.901778+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:16:14.334955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:34.916612+0000","last_change":"2024-03-09T14:42:19.018301+0000","last_active":"2024-03-09T15:02:34.916612+0000","last_peered":"2024-03-09T15:02:34.916612+0000","last_clean":"2024-03-09T15:02:34.916612+0000","last_became_active":"2024-03-09T14:42:19.017434+0000","last_became_peered":"2024-03-09T14:42:19.017434+0000","last_unstale":"2024-03-09T15:02:34.916612+0000","last_undegraded":"2024-03-09T15:02:34.916612+0000","last_fullsized":"2024-03-09T15:02:34.916612+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:08:07.632656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4234449,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6,"num_read_kb":8272,"num_write":9,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'4","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:35.038505+0000","last_change":"2024-03-09T14:42:15.946399+0000","last_active":"2024-03-09T15:02:35.038505+0000","last_peered":"2024-03-09T15:02:35.038505+0000","last_clean":"2024-03-09T15:02:35.038505+0000","last_became_active":"2024-03-09T14:42:15.945565+0000","last_became_peered":"2024-03-09T14:42:15.945565+0000","last_unstale":"2024-03-09T15:02:35.038505+0000","last_undegraded":"2024-03-09T15:02:35.038505+0000","last_fullsized":"2024-03-09T15:02:35.038505+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:05:17.625355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4963,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1029,"num_write":9,"num_write_kb":1029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'55","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:44.703996+0000","last_change":"2024-03-09T14:39:57.901411+0000","last_active":"2024-03-09T15:04:44.703996+0000","last_peered":"2024-03-09T15:04:44.703996+0000","last_clean":"2024-03-09T15:04:44.703996+0000","last_became_active":"2024-03-09T14:39:57.900659+0000","last_became_peered":"2024-03-09T14:39:57.900659+0000","last_unstale":"2024-03-09T15:04:44.703996+0000","last_undegraded":"2024-03-09T15:04:44.703996+0000","last_fullsized":"2024-03-09T15:04:44.703996+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:14.811571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":161,"num_write":89,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.929301+0000","last_change":"2024-03-09T14:49:53.683045+0000","last_active":"2024-03-09T15:03:24.929301+0000","last_peered":"2024-03-09T15:03:24.929301+0000","last_clean":"2024-03-09T15:03:24.929301+0000","last_became_active":"2024-03-09T14:49:53.678822+0000","last_became_peered":"2024-03-09T14:49:53.678822+0000","last_unstale":"2024-03-09T15:03:24.929301+0000","last_undegraded":"2024-03-09T15:03:24.929301+0000","last_fullsized":"2024-03-09T15:03:24.929301+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:54.757256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.699298+0000","last_change":"2024-03-09T14:42:19.021170+0000","last_active":"2024-03-09T15:03:59.699298+0000","last_peered":"2024-03-09T15:03:59.699298+0000","last_clean":"2024-03-09T15:03:59.699298+0000","last_became_active":"2024-03-09T14:42:19.016262+0000","last_became_peered":"2024-03-09T14:42:19.016262+0000","last_unstale":"2024-03-09T15:03:59.699298+0000","last_undegraded":"2024-03-09T15:03:59.699298+0000","last_fullsized":"2024-03-09T15:03:59.699298+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:11:24.272229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'1","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.706547+0000","last_change":"2024-03-09T14:42:15.964302+0000","last_active":"2024-03-09T15:03:59.706547+0000","last_peered":"2024-03-09T15:03:59.706547+0000","last_clean":"2024-03-09T15:03:59.706547+0000","last_became_active":"2024-03-09T14:42:15.963496+0000","last_became_peered":"2024-03-09T14:42:15.963496+0000","last_unstale":"2024-03-09T15:03:59.706547+0000","last_undegraded":"2024-03-09T15:03:59.706547+0000","last_fullsized":"2024-03-09T15:03:59.706547+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:49:10.732358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3217,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'33","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:44.717850+0000","last_change":"2024-03-09T14:39:57.879692+0000","last_active":"2024-03-09T15:04:44.717850+0000","last_peered":"2024-03-09T15:04:44.717850+0000","last_clean":"2024-03-09T15:04:44.717850+0000","last_became_active":"2024-03-09T14:39:57.879068+0000","last_became_peered":"2024-03-09T14:39:57.879068+0000","last_unstale":"2024-03-09T15:04:44.717850+0000","last_undegraded":"2024-03-09T15:04:44.717850+0000","last_fullsized":"2024-03-09T15:04:44.717850+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:28:08.950204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":89,"num_write":57,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:29.696105+0000","last_change":"2024-03-09T14:49:53.666848+0000","last_active":"2024-03-09T15:03:29.696105+0000","last_peered":"2024-03-09T15:03:29.696105+0000","last_clean":"2024-03-09T15:03:29.696105+0000","last_became_active":"2024-03-09T14:49:53.666088+0000","last_became_peered":"2024-03-09T14:49:53.666088+0000","last_unstale":"2024-03-09T15:03:29.696105+0000","last_undegraded":"2024-03-09T15:03:29.696105+0000","last_fullsized":"2024-03-09T15:03:29.696105+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:24:04.438357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.702889+0000","last_change":"2024-03-09T14:42:19.288789+0000","last_active":"2024-03-09T15:03:59.702889+0000","last_peered":"2024-03-09T15:03:59.702889+0000","last_clean":"2024-03-09T15:03:59.702889+0000","last_became_active":"2024-03-09T14:42:19.288155+0000","last_became_peered":"2024-03-09T14:42:19.288155+0000","last_unstale":"2024-03-09T15:03:59.702889+0000","last_undegraded":"2024-03-09T15:03:59.702889+0000","last_fullsized":"2024-03-09T15:03:59.702889+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:36:14.730415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:00.057676+0000","last_change":"2024-03-09T14:42:15.962724+0000","last_active":"2024-03-09T15:04:00.057676+0000","last_peered":"2024-03-09T15:04:00.057676+0000","last_clean":"2024-03-09T15:04:00.057676+0000","last_became_active":"2024-03-09T14:42:15.962004+0000","last_became_peered":"2024-03-09T14:42:15.962004+0000","last_unstale":"2024-03-09T15:04:00.057676+0000","last_undegraded":"2024-03-09T15:04:00.057676+0000","last_fullsized":"2024-03-09T15:04:00.057676+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:30.363544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.875140+0000","last_change":"2024-03-09T14:39:57.906667+0000","last_active":"2024-03-09T15:04:04.875140+0000","last_peered":"2024-03-09T15:04:04.875140+0000","last_clean":"2024-03-09T15:04:04.875140+0000","last_became_active":"2024-03-09T14:39:57.906043+0000","last_became_peered":"2024-03-09T14:39:57.906043+0000","last_unstale":"2024-03-09T15:04:04.875140+0000","last_undegraded":"2024-03-09T15:04:04.875140+0000","last_fullsized":"2024-03-09T15:04:04.875140+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:36.853805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":86,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.694884+0000","last_change":"2024-03-09T14:49:53.666880+0000","last_active":"2024-03-09T15:03:24.694884+0000","last_peered":"2024-03-09T15:03:24.694884+0000","last_clean":"2024-03-09T15:03:24.694884+0000","last_became_active":"2024-03-09T14:49:53.666251+0000","last_became_peered":"2024-03-09T14:49:53.666251+0000","last_unstale":"2024-03-09T15:03:24.694884+0000","last_undegraded":"2024-03-09T15:03:24.694884+0000","last_fullsized":"2024-03-09T15:03:24.694884+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:12:56.088402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:35.038377+0000","last_change":"2024-03-09T14:42:18.999259+0000","last_active":"2024-03-09T15:02:35.038377+0000","last_peered":"2024-03-09T15:02:35.038377+0000","last_clean":"2024-03-09T15:02:35.038377+0000","last_became_active":"2024-03-09T14:42:18.998145+0000","last_became_peered":"2024-03-09T14:42:18.998145+0000","last_unstale":"2024-03-09T15:02:35.038377+0000","last_undegraded":"2024-03-09T15:02:35.038377+0000","last_fullsized":"2024-03-09T15:02:35.038377+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:56:21.105602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:14.739716+0000","last_change":"2024-03-09T14:42:15.974356+0000","last_active":"2024-03-09T15:06:14.739716+0000","last_peered":"2024-03-09T15:06:14.739716+0000","last_clean":"2024-03-09T15:06:14.739716+0000","last_became_active":"2024-03-09T14:42:15.973793+0000","last_became_peered":"2024-03-09T14:42:15.973793+0000","last_unstale":"2024-03-09T15:06:14.739716+0000","last_undegraded":"2024-03-09T15:06:14.739716+0000","last_fullsized":"2024-03-09T15:06:14.739716+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:01:29.081317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'18","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.934890+0000","last_change":"2024-03-09T14:39:57.900299+0000","last_active":"2024-03-09T15:03:49.934890+0000","last_peered":"2024-03-09T15:03:49.934890+0000","last_clean":"2024-03-09T15:03:49.934890+0000","last_became_active":"2024-03-09T14:39:57.895347+0000","last_became_peered":"2024-03-09T14:39:57.895347+0000","last_unstale":"2024-03-09T15:03:49.934890+0000","last_undegraded":"2024-03-09T15:03:49.934890+0000","last_fullsized":"2024-03-09T15:03:49.934890+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:35.906733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":49,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.698327+0000","last_change":"2024-03-09T14:49:53.680516+0000","last_active":"2024-03-09T15:03:24.698327+0000","last_peered":"2024-03-09T15:03:24.698327+0000","last_clean":"2024-03-09T15:03:24.698327+0000","last_became_active":"2024-03-09T14:49:53.676907+0000","last_became_peered":"2024-03-09T14:49:53.676907+0000","last_unstale":"2024-03-09T15:03:24.698327+0000","last_undegraded":"2024-03-09T15:03:24.698327+0000","last_fullsized":"2024-03-09T15:03:24.698327+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:27.679077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.705594+0000","last_change":"2024-03-09T14:42:29.985480+0000","last_active":"2024-03-09T15:04:09.705594+0000","last_peered":"2024-03-09T15:04:09.705594+0000","last_clean":"2024-03-09T15:04:09.705594+0000","last_became_active":"2024-03-09T14:42:29.984595+0000","last_became_peered":"2024-03-09T14:42:29.984595+0000","last_unstale":"2024-03-09T15:04:09.705594+0000","last_undegraded":"2024-03-09T15:04:09.705594+0000","last_fullsized":"2024-03-09T15:04:09.705594+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:49:17.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.710416+0000","last_change":"2024-03-09T14:42:15.942495+0000","last_active":"2024-03-09T15:04:49.710416+0000","last_peered":"2024-03-09T15:04:49.710416+0000","last_clean":"2024-03-09T15:04:49.710416+0000","last_became_active":"2024-03-09T14:42:15.941583+0000","last_became_peered":"2024-03-09T14:42:15.941583+0000","last_unstale":"2024-03-09T15:04:49.710416+0000","last_undegraded":"2024-03-09T15:04:49.710416+0000","last_fullsized":"2024-03-09T15:04:49.710416+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:58:21.145613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'16","reported_seq":88,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.695726+0000","last_change":"2024-03-09T14:39:57.886088+0000","last_active":"2024-03-09T15:03:49.695726+0000","last_peered":"2024-03-09T15:03:49.695726+0000","last_clean":"2024-03-09T15:03:49.695726+0000","last_became_active":"2024-03-09T14:39:57.884479+0000","last_became_peered":"2024-03-09T14:39:57.884479+0000","last_unstale":"2024-03-09T15:03:49.695726+0000","last_undegraded":"2024-03-09T15:03:49.695726+0000","last_fullsized":"2024-03-09T15:03:49.695726+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:06:06.518769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":55,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.710399+0000","last_change":"2024-03-09T14:49:53.664600+0000","last_active":"2024-03-09T15:04:29.710399+0000","last_peered":"2024-03-09T15:04:29.710399+0000","last_clean":"2024-03-09T15:04:29.710399+0000","last_became_active":"2024-03-09T14:49:53.663825+0000","last_became_peered":"2024-03-09T14:49:53.663825+0000","last_unstale":"2024-03-09T15:04:29.710399+0000","last_undegraded":"2024-03-09T15:04:29.710399+0000","last_fullsized":"2024-03-09T15:04:29.710399+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:38:11.359908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:14.696135+0000","last_change":"2024-03-09T14:42:18.996069+0000","last_active":"2024-03-09T15:03:14.696135+0000","last_peered":"2024-03-09T15:03:14.696135+0000","last_clean":"2024-03-09T15:03:14.696135+0000","last_became_active":"2024-03-09T14:42:18.995340+0000","last_became_peered":"2024-03-09T14:42:18.995340+0000","last_unstale":"2024-03-09T15:03:14.696135+0000","last_undegraded":"2024-03-09T15:03:14.696135+0000","last_fullsized":"2024-03-09T15:03:14.696135+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:53.974508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.905451+0000","last_change":"2024-03-09T14:42:15.963780+0000","last_active":"2024-03-09T15:03:09.905451+0000","last_peered":"2024-03-09T15:03:09.905451+0000","last_clean":"2024-03-09T15:03:09.905451+0000","last_became_active":"2024-03-09T14:42:15.963155+0000","last_became_peered":"2024-03-09T14:42:15.963155+0000","last_unstale":"2024-03-09T15:03:09.905451+0000","last_undegraded":"2024-03-09T15:03:09.905451+0000","last_fullsized":"2024-03-09T15:03:09.905451+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:17:06.912120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'33","reported_seq":127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.704256+0000","last_change":"2024-03-09T14:39:57.889247+0000","last_active":"2024-03-09T15:03:49.704256+0000","last_peered":"2024-03-09T15:03:49.704256+0000","last_clean":"2024-03-09T15:03:49.704256+0000","last_became_active":"2024-03-09T14:39:57.888467+0000","last_became_peered":"2024-03-09T14:39:57.888467+0000","last_unstale":"2024-03-09T15:03:49.704256+0000","last_undegraded":"2024-03-09T15:03:49.704256+0000","last_fullsized":"2024-03-09T15:03:49.704256+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:30:37.652546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":106,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.890833+0000","last_change":"2024-03-09T14:49:53.659073+0000","last_active":"2024-03-09T15:04:29.890833+0000","last_peered":"2024-03-09T15:04:29.890833+0000","last_clean":"2024-03-09T15:04:29.890833+0000","last_became_active":"2024-03-09T14:49:53.658183+0000","last_became_peered":"2024-03-09T14:49:53.658183+0000","last_unstale":"2024-03-09T15:04:29.890833+0000","last_undegraded":"2024-03-09T15:04:29.890833+0000","last_fullsized":"2024-03-09T15:04:29.890833+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:41:48.538335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:14.726025+0000","last_change":"2024-03-09T14:42:19.295167+0000","last_active":"2024-03-09T15:05:14.726025+0000","last_peered":"2024-03-09T15:05:14.726025+0000","last_clean":"2024-03-09T15:05:14.726025+0000","last_became_active":"2024-03-09T14:42:19.294401+0000","last_became_peered":"2024-03-09T14:42:19.294401+0000","last_unstale":"2024-03-09T15:05:14.726025+0000","last_undegraded":"2024-03-09T15:05:14.726025+0000","last_fullsized":"2024-03-09T15:05:14.726025+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:56:05.250854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'7","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.370131+0000","last_change":"2024-03-09T14:42:15.975168+0000","last_active":"2024-03-09T15:07:04.370131+0000","last_peered":"2024-03-09T15:07:04.370131+0000","last_clean":"2024-03-09T15:07:04.370131+0000","last_became_active":"2024-03-09T14:42:15.974493+0000","last_became_peered":"2024-03-09T14:42:15.974493+0000","last_unstale":"2024-03-09T15:07:04.370131+0000","last_undegraded":"2024-03-09T15:07:04.370131+0000","last_fullsized":"2024-03-09T15:07:04.370131+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:49:53.666199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5160,"num_write":12,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'28","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.695916+0000","last_change":"2024-03-09T14:39:57.907522+0000","last_active":"2024-03-09T15:03:49.695916+0000","last_peered":"2024-03-09T15:03:49.695916+0000","last_clean":"2024-03-09T15:03:49.695916+0000","last_became_active":"2024-03-09T14:39:57.907009+0000","last_became_peered":"2024-03-09T14:39:57.907009+0000","last_unstale":"2024-03-09T15:03:49.695916+0000","last_undegraded":"2024-03-09T15:03:49.695916+0000","last_fullsized":"2024-03-09T15:03:49.695916+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:27:52.279130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":74,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:55.056453+0000","last_change":"2024-03-09T14:49:53.681028+0000","last_active":"2024-03-09T15:03:55.056453+0000","last_peered":"2024-03-09T15:03:55.056453+0000","last_clean":"2024-03-09T15:03:55.056453+0000","last_became_active":"2024-03-09T14:49:53.680477+0000","last_became_peered":"2024-03-09T14:49:53.680477+0000","last_unstale":"2024-03-09T15:03:55.056453+0000","last_undegraded":"2024-03-09T15:03:55.056453+0000","last_fullsized":"2024-03-09T15:03:55.056453+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:50.745753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.703193+0000","last_change":"2024-03-09T14:42:19.290124+0000","last_active":"2024-03-09T15:03:59.703193+0000","last_peered":"2024-03-09T15:03:59.703193+0000","last_clean":"2024-03-09T15:03:59.703193+0000","last_became_active":"2024-03-09T14:42:19.289487+0000","last_became_peered":"2024-03-09T14:42:19.289487+0000","last_unstale":"2024-03-09T15:03:59.703193+0000","last_undegraded":"2024-03-09T15:03:59.703193+0000","last_fullsized":"2024-03-09T15:03:59.703193+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:53:33.609180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.884266+0000","last_change":"2024-03-09T14:42:15.957344+0000","last_active":"2024-03-09T15:03:59.884266+0000","last_peered":"2024-03-09T15:03:59.884266+0000","last_clean":"2024-03-09T15:03:59.884266+0000","last_became_active":"2024-03-09T14:42:15.956648+0000","last_became_peered":"2024-03-09T14:42:15.956648+0000","last_unstale":"2024-03-09T15:03:59.884266+0000","last_undegraded":"2024-03-09T15:03:59.884266+0000","last_fullsized":"2024-03-09T15:03:59.884266+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:56:53.168125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'62","reported_seq":198,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:59.903168+0000","last_change":"2024-03-09T14:39:57.906130+0000","last_active":"2024-03-09T15:02:59.903168+0000","last_peered":"2024-03-09T15:02:59.903168+0000","last_clean":"2024-03-09T15:02:59.903168+0000","last_became_active":"2024-03-09T14:39:57.905410+0000","last_became_peered":"2024-03-09T14:39:57.905410+0000","last_unstale":"2024-03-09T15:02:59.903168+0000","last_undegraded":"2024-03-09T15:02:59.903168+0000","last_fullsized":"2024-03-09T15:02:59.903168+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:50:45.243291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":193,"num_write":94,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.706106+0000","last_change":"2024-03-09T14:49:53.658895+0000","last_active":"2024-03-09T15:04:29.706106+0000","last_peered":"2024-03-09T15:04:29.706106+0000","last_clean":"2024-03-09T15:04:29.706106+0000","last_became_active":"2024-03-09T14:49:53.658190+0000","last_became_peered":"2024-03-09T14:49:53.658190+0000","last_unstale":"2024-03-09T15:04:29.706106+0000","last_undegraded":"2024-03-09T15:04:29.706106+0000","last_fullsized":"2024-03-09T15:04:29.706106+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:31:23.260028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'5","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:09.727994+0000","last_change":"2024-03-09T14:42:19.020830+0000","last_active":"2024-03-09T15:06:09.727994+0000","last_peered":"2024-03-09T15:06:09.727994+0000","last_clean":"2024-03-09T15:06:09.727994+0000","last_became_active":"2024-03-09T14:42:19.013977+0000","last_became_peered":"2024-03-09T14:42:19.013977+0000","last_unstale":"2024-03-09T15:06:09.727994+0000","last_undegraded":"2024-03-09T15:06:09.727994+0000","last_fullsized":"2024-03-09T15:06:09.727994+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:02:04.141033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":5,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.703218+0000","last_change":"2024-03-09T14:42:15.961048+0000","last_active":"2024-03-09T15:03:59.703218+0000","last_peered":"2024-03-09T15:03:59.703218+0000","last_clean":"2024-03-09T15:03:59.703218+0000","last_became_active":"2024-03-09T14:42:15.960225+0000","last_became_peered":"2024-03-09T14:42:15.960225+0000","last_unstale":"2024-03-09T15:03:59.703218+0000","last_undegraded":"2024-03-09T15:03:59.703218+0000","last_fullsized":"2024-03-09T15:03:59.703218+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:20:39.859217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'130","reported_seq":430,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:55.043052+0000","last_change":"2024-03-09T14:39:57.893265+0000","last_active":"2024-03-09T15:02:55.043052+0000","last_peered":"2024-03-09T15:02:55.043052+0000","last_clean":"2024-03-09T15:02:55.043052+0000","last_became_active":"2024-03-09T14:39:57.892592+0000","last_became_peered":"2024-03-09T14:39:57.892592+0000","last_unstale":"2024-03-09T15:02:55.043052+0000","last_undegraded":"2024-03-09T15:02:55.043052+0000","last_fullsized":"2024-03-09T15:02:55.043052+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:48:11.422790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":739,"num_read_kb":529,"num_write":173,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.679735+0000","last_change":"2024-03-09T14:49:53.672983+0000","last_active":"2024-03-09T15:02:54.679735+0000","last_peered":"2024-03-09T15:02:54.679735+0000","last_clean":"2024-03-09T15:02:54.679735+0000","last_became_active":"2024-03-09T14:49:53.672292+0000","last_became_peered":"2024-03-09T14:49:53.672292+0000","last_unstale":"2024-03-09T15:02:54.679735+0000","last_undegraded":"2024-03-09T15:02:54.679735+0000","last_fullsized":"2024-03-09T15:02:54.679735+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:45:38.980243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:10.046246+0000","last_change":"2024-03-09T14:42:19.004206+0000","last_active":"2024-03-09T15:03:10.046246+0000","last_peered":"2024-03-09T15:03:10.046246+0000","last_clean":"2024-03-09T15:03:10.046246+0000","last_became_active":"2024-03-09T14:42:19.002083+0000","last_became_peered":"2024-03-09T14:42:19.002083+0000","last_unstale":"2024-03-09T15:03:10.046246+0000","last_undegraded":"2024-03-09T15:03:10.046246+0000","last_fullsized":"2024-03-09T15:03:10.046246+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:33.779863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'5","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.710240+0000","last_change":"2024-03-09T14:42:15.976503+0000","last_active":"2024-03-09T15:04:29.710240+0000","last_peered":"2024-03-09T15:04:29.710240+0000","last_clean":"2024-03-09T15:04:29.710240+0000","last_became_active":"2024-03-09T14:42:15.975956+0000","last_became_peered":"2024-03-09T14:42:15.975956+0000","last_unstale":"2024-03-09T15:04:29.710240+0000","last_undegraded":"2024-03-09T15:04:29.710240+0000","last_fullsized":"2024-03-09T15:04:29.710240+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:51:51.535147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'35","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.868777+0000","last_change":"2024-03-09T14:39:57.887500+0000","last_active":"2024-03-09T15:02:54.868777+0000","last_peered":"2024-03-09T15:02:54.868777+0000","last_clean":"2024-03-09T15:02:54.868777+0000","last_became_active":"2024-03-09T14:39:57.886792+0000","last_became_peered":"2024-03-09T14:39:57.886792+0000","last_unstale":"2024-03-09T15:02:54.868777+0000","last_undegraded":"2024-03-09T15:02:54.868777+0000","last_fullsized":"2024-03-09T15:02:54.868777+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:48:32.831728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":107,"num_write":66,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.691638+0000","last_change":"2024-03-09T14:49:53.687783+0000","last_active":"2024-03-09T15:02:54.691638+0000","last_peered":"2024-03-09T15:02:54.691638+0000","last_clean":"2024-03-09T15:02:54.691638+0000","last_became_active":"2024-03-09T14:49:53.683703+0000","last_became_peered":"2024-03-09T14:49:53.683703+0000","last_unstale":"2024-03-09T15:02:54.691638+0000","last_undegraded":"2024-03-09T15:02:54.691638+0000","last_fullsized":"2024-03-09T15:02:54.691638+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:03:26.499909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.889433+0000","last_change":"2024-03-09T14:42:19.014096+0000","last_active":"2024-03-09T15:04:24.889433+0000","last_peered":"2024-03-09T15:04:24.889433+0000","last_clean":"2024-03-09T15:04:24.889433+0000","last_became_active":"2024-03-09T14:42:19.013372+0000","last_became_peered":"2024-03-09T14:42:19.013372+0000","last_unstale":"2024-03-09T15:04:24.889433+0000","last_undegraded":"2024-03-09T15:04:24.889433+0000","last_fullsized":"2024-03-09T15:04:24.889433+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:33:04.031449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":25602,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"261'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.905329+0000","last_change":"2024-03-09T14:42:15.955016+0000","last_active":"2024-03-09T15:03:09.905329+0000","last_peered":"2024-03-09T15:03:09.905329+0000","last_clean":"2024-03-09T15:03:09.905329+0000","last_became_active":"2024-03-09T14:42:15.954274+0000","last_became_peered":"2024-03-09T14:42:15.954274+0000","last_unstale":"2024-03-09T15:03:09.905329+0000","last_undegraded":"2024-03-09T15:03:09.905329+0000","last_fullsized":"2024-03-09T15:03:09.905329+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:32.985487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'59","reported_seq":199,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.712470+0000","last_change":"2024-03-09T14:39:57.902294+0000","last_active":"2024-03-09T15:04:59.712470+0000","last_peered":"2024-03-09T15:04:59.712470+0000","last_clean":"2024-03-09T15:04:59.712470+0000","last_became_active":"2024-03-09T14:39:57.901599+0000","last_became_peered":"2024-03-09T14:39:57.901599+0000","last_unstale":"2024-03-09T15:04:59.712470+0000","last_undegraded":"2024-03-09T15:04:59.712470+0000","last_fullsized":"2024-03-09T15:04:59.712470+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:02:52.013131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":206,"num_write":96,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.714264+0000","last_change":"2024-03-09T14:49:53.681958+0000","last_active":"2024-03-09T15:04:29.714264+0000","last_peered":"2024-03-09T15:04:29.714264+0000","last_clean":"2024-03-09T15:04:29.714264+0000","last_became_active":"2024-03-09T14:49:53.681327+0000","last_became_peered":"2024-03-09T14:49:53.681327+0000","last_unstale":"2024-03-09T15:04:29.714264+0000","last_undegraded":"2024-03-09T15:04:29.714264+0000","last_fullsized":"2024-03-09T15:04:29.714264+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:41:14.532324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.686795+0000","last_change":"2024-03-09T14:42:19.020053+0000","last_active":"2024-03-09T15:03:09.686795+0000","last_peered":"2024-03-09T15:03:09.686795+0000","last_clean":"2024-03-09T15:03:09.686795+0000","last_became_active":"2024-03-09T14:42:19.019151+0000","last_became_peered":"2024-03-09T14:42:19.019151+0000","last_unstale":"2024-03-09T15:03:09.686795+0000","last_undegraded":"2024-03-09T15:03:09.686795+0000","last_fullsized":"2024-03-09T15:03:09.686795+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:33:06.100480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:10.046324+0000","last_change":"2024-03-09T14:42:15.960915+0000","last_active":"2024-03-09T15:03:10.046324+0000","last_peered":"2024-03-09T15:03:10.046324+0000","last_clean":"2024-03-09T15:03:10.046324+0000","last_became_active":"2024-03-09T14:42:15.959503+0000","last_became_peered":"2024-03-09T14:42:15.959503+0000","last_unstale":"2024-03-09T15:03:10.046324+0000","last_undegraded":"2024-03-09T15:03:10.046324+0000","last_fullsized":"2024-03-09T15:03:10.046324+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:18.018358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'13","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.710516+0000","last_change":"2024-03-09T14:39:57.896340+0000","last_active":"2024-03-09T15:04:59.710516+0000","last_peered":"2024-03-09T15:04:59.710516+0000","last_clean":"2024-03-09T15:04:59.710516+0000","last_became_active":"2024-03-09T14:39:57.895579+0000","last_became_peered":"2024-03-09T14:39:57.895579+0000","last_unstale":"2024-03-09T15:04:59.710516+0000","last_undegraded":"2024-03-09T15:04:59.710516+0000","last_fullsized":"2024-03-09T15:04:59.710516+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:50.092894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:34.711774+0000","last_change":"2024-03-09T14:49:53.681449+0000","last_active":"2024-03-09T15:04:34.711774+0000","last_peered":"2024-03-09T15:04:34.711774+0000","last_clean":"2024-03-09T15:04:34.711774+0000","last_became_active":"2024-03-09T14:49:53.680782+0000","last_became_peered":"2024-03-09T14:49:53.680782+0000","last_unstale":"2024-03-09T15:04:34.711774+0000","last_undegraded":"2024-03-09T15:04:34.711774+0000","last_fullsized":"2024-03-09T15:04:34.711774+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:47:13.858756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'1","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.688046+0000","last_change":"2024-03-09T14:42:19.021910+0000","last_active":"2024-03-09T15:03:09.688046+0000","last_peered":"2024-03-09T15:03:09.688046+0000","last_clean":"2024-03-09T15:03:09.688046+0000","last_became_active":"2024-03-09T14:42:19.020789+0000","last_became_peered":"2024-03-09T14:42:19.020789+0000","last_unstale":"2024-03-09T15:03:09.688046+0000","last_undegraded":"2024-03-09T15:03:09.688046+0000","last_fullsized":"2024-03-09T15:03:09.688046+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:45:01.147814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3217,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'7","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:14.714197+0000","last_change":"2024-03-09T14:42:15.961112+0000","last_active":"2024-03-09T15:05:14.714197+0000","last_peered":"2024-03-09T15:05:14.714197+0000","last_clean":"2024-03-09T15:05:14.714197+0000","last_became_active":"2024-03-09T14:42:15.960341+0000","last_became_peered":"2024-03-09T14:42:15.960341+0000","last_unstale":"2024-03-09T15:05:14.714197+0000","last_undegraded":"2024-03-09T15:05:14.714197+0000","last_fullsized":"2024-03-09T15:05:14.714197+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:19:05.030621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":20522,"num_write":11,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'42","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.705495+0000","last_change":"2024-03-09T14:39:57.898959+0000","last_active":"2024-03-09T15:04:09.705495+0000","last_peered":"2024-03-09T15:04:09.705495+0000","last_clean":"2024-03-09T15:04:09.705495+0000","last_became_active":"2024-03-09T14:39:57.898267+0000","last_became_peered":"2024-03-09T14:39:57.898267+0000","last_unstale":"2024-03-09T15:04:09.705495+0000","last_undegraded":"2024-03-09T15:04:09.705495+0000","last_fullsized":"2024-03-09T15:04:09.705495+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:00:24.847765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":119,"num_write":82,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'286","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.666522+0000","last_change":"2024-03-09T14:28:53.624341+0000","last_active":"2024-03-09T15:07:04.666522+0000","last_peered":"2024-03-09T15:07:04.666522+0000","last_clean":"2024-03-09T15:07:04.666522+0000","last_became_active":"2024-03-09T14:28:53.623701+0000","last_became_peered":"2024-03-09T14:28:53.623701+0000","last_unstale":"2024-03-09T15:07:04.666522+0000","last_undegraded":"2024-03-09T15:07:04.666522+0000","last_fullsized":"2024-03-09T15:07:04.666522+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:38.200914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5567709,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":742,"num_read_kb":36473,"num_write":1125,"num_write_kb":31503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'692","reported_seq":2207,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.442129+0000","last_change":"2024-03-09T14:28:55.575692+0000","last_active":"2024-03-09T15:06:42.442129+0000","last_peered":"2024-03-09T15:06:42.442129+0000","last_clean":"2024-03-09T15:06:42.442129+0000","last_became_active":"2024-03-09T14:28:55.574984+0000","last_became_peered":"2024-03-09T14:28:55.574984+0000","last_unstale":"2024-03-09T15:06:42.442129+0000","last_undegraded":"2024-03-09T15:06:42.442129+0000","last_fullsized":"2024-03-09T15:06:42.442129+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:07.026587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3313,"num_read_kb":2995,"num_write":917,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'247","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:44.410019+0000","last_change":"2024-03-09T14:28:53.626962+0000","last_active":"2024-03-09T15:04:44.410019+0000","last_peered":"2024-03-09T15:04:44.410019+0000","last_clean":"2024-03-09T15:04:44.410019+0000","last_became_active":"2024-03-09T14:28:53.626490+0000","last_became_peered":"2024-03-09T14:28:53.626490+0000","last_unstale":"2024-03-09T15:04:44.410019+0000","last_undegraded":"2024-03-09T15:04:44.410019+0000","last_fullsized":"2024-03-09T15:04:44.410019+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:16:05.659643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16802302,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":408,"num_read_kb":36382,"num_write":1045,"num_write_kb":36054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'348","reported_seq":1729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.522825+0000","last_change":"2024-03-09T14:28:55.592370+0000","last_active":"2024-03-09T15:06:32.522825+0000","last_peered":"2024-03-09T15:06:32.522825+0000","last_clean":"2024-03-09T15:06:32.522825+0000","last_became_active":"2024-03-09T14:28:55.591640+0000","last_became_peered":"2024-03-09T14:28:55.591640+0000","last_unstale":"2024-03-09T15:06:32.522825+0000","last_undegraded":"2024-03-09T15:06:32.522825+0000","last_fullsized":"2024-03-09T15:06:32.522825+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:10.597479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1906,"num_read_kb":1805,"num_write":411,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'261","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:53.612151+0000","last_change":"2024-03-09T14:29:28.828234+0000","last_active":"2024-03-09T15:05:53.612151+0000","last_peered":"2024-03-09T15:05:53.612151+0000","last_clean":"2024-03-09T15:05:53.612151+0000","last_became_active":"2024-03-09T14:29:28.827096+0000","last_became_peered":"2024-03-09T14:29:28.827096+0000","last_unstale":"2024-03-09T15:05:53.612151+0000","last_undegraded":"2024-03-09T15:05:53.612151+0000","last_fullsized":"2024-03-09T15:05:53.612151+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:43.226590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22868954,"num_objects":75,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":520,"num_read_kb":23096,"num_write":1164,"num_write_kb":39906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,7],"acting":[3,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"264'398","reported_seq":1882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.439715+0000","last_change":"2024-03-09T14:28:55.571747+0000","last_active":"2024-03-09T15:06:42.439715+0000","last_peered":"2024-03-09T15:06:42.439715+0000","last_clean":"2024-03-09T15:06:42.439715+0000","last_became_active":"2024-03-09T14:28:55.570930+0000","last_became_peered":"2024-03-09T14:28:55.570930+0000","last_unstale":"2024-03-09T15:06:42.439715+0000","last_undegraded":"2024-03-09T15:06:42.439715+0000","last_fullsized":"2024-03-09T15:06:42.439715+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:13.704377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2164,"num_read_kb":2043,"num_write":472,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'247","reported_seq":879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:28.081061+0000","last_change":"2024-03-09T14:28:53.605127+0000","last_active":"2024-03-09T15:05:28.081061+0000","last_peered":"2024-03-09T15:05:28.081061+0000","last_clean":"2024-03-09T15:05:28.081061+0000","last_became_active":"2024-03-09T14:28:53.603454+0000","last_became_peered":"2024-03-09T14:28:53.603454+0000","last_unstale":"2024-03-09T15:05:28.081061+0000","last_undegraded":"2024-03-09T15:05:28.081061+0000","last_fullsized":"2024-03-09T15:05:28.081061+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:11:31.442216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":833645,"num_objects":53,"num_object_clones":0,"num_object_copies":212,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":427,"num_read_kb":6538,"num_write":1135,"num_write_kb":12238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'433","reported_seq":1935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:03.127553+0000","last_change":"2024-03-09T14:28:55.611079+0000","last_active":"2024-03-09T15:06:03.127553+0000","last_peered":"2024-03-09T15:06:03.127553+0000","last_clean":"2024-03-09T15:06:03.127553+0000","last_became_active":"2024-03-09T14:28:55.610360+0000","last_became_peered":"2024-03-09T14:28:55.610360+0000","last_unstale":"2024-03-09T15:06:03.127553+0000","last_undegraded":"2024-03-09T15:06:03.127553+0000","last_fullsized":"2024-03-09T15:06:03.127553+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:29:26.385739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2375,"num_read_kb":2224,"num_write":558,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'317","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.651479+0000","last_change":"2024-03-09T14:28:53.624123+0000","last_active":"2024-03-09T15:07:04.651479+0000","last_peered":"2024-03-09T15:07:04.651479+0000","last_clean":"2024-03-09T15:07:04.651479+0000","last_became_active":"2024-03-09T14:28:53.622689+0000","last_became_peered":"2024-03-09T14:28:53.622689+0000","last_unstale":"2024-03-09T15:07:04.651479+0000","last_undegraded":"2024-03-09T15:07:04.651479+0000","last_fullsized":"2024-03-09T15:07:04.651479+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:35:07.478864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9892647,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":507,"num_read_kb":7526,"num_write":1233,"num_write_kb":32260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'361","reported_seq":1916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.497289+0000","last_change":"2024-03-09T14:28:55.594992+0000","last_active":"2024-03-09T15:06:53.497289+0000","last_peered":"2024-03-09T15:06:53.497289+0000","last_clean":"2024-03-09T15:06:53.497289+0000","last_became_active":"2024-03-09T14:28:55.588204+0000","last_became_peered":"2024-03-09T14:28:55.588204+0000","last_unstale":"2024-03-09T15:06:53.497289+0000","last_undegraded":"2024-03-09T15:06:53.497289+0000","last_fullsized":"2024-03-09T15:06:53.497289+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:08:51.680835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2088,"num_read_kb":2012,"num_write":400,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'303","reported_seq":1006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:48.991291+0000","last_change":"2024-03-09T14:28:53.605882+0000","last_active":"2024-03-09T15:04:48.991291+0000","last_peered":"2024-03-09T15:04:48.991291+0000","last_clean":"2024-03-09T15:04:48.991291+0000","last_became_active":"2024-03-09T14:28:53.604391+0000","last_became_peered":"2024-03-09T14:28:53.604391+0000","last_unstale":"2024-03-09T15:04:48.991291+0000","last_undegraded":"2024-03-09T15:04:48.991291+0000","last_fullsized":"2024-03-09T15:04:48.991291+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:59:20.682629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6644913,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":685,"num_read_kb":3295,"num_write":1168,"num_write_kb":34124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'790","reported_seq":2517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.519848+0000","last_change":"2024-03-09T14:28:55.572158+0000","last_active":"2024-03-09T15:06:32.519848+0000","last_peered":"2024-03-09T15:06:32.519848+0000","last_clean":"2024-03-09T15:06:32.519848+0000","last_became_active":"2024-03-09T14:28:55.571291+0000","last_became_peered":"2024-03-09T14:28:55.571291+0000","last_unstale":"2024-03-09T15:06:32.519848+0000","last_undegraded":"2024-03-09T15:06:32.519848+0000","last_fullsized":"2024-03-09T15:06:32.519848+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:13.639955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3843,"num_read_kb":3494,"num_write":1039,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'377","reported_seq":1038,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.675047+0000","last_change":"2024-03-09T14:28:53.619197+0000","last_active":"2024-03-09T15:07:04.675047+0000","last_peered":"2024-03-09T15:07:04.675047+0000","last_clean":"2024-03-09T15:07:04.675047+0000","last_became_active":"2024-03-09T14:28:53.618259+0000","last_became_peered":"2024-03-09T14:28:53.618259+0000","last_unstale":"2024-03-09T15:07:04.675047+0000","last_undegraded":"2024-03-09T15:07:04.675047+0000","last_fullsized":"2024-03-09T15:07:04.675047+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:17:48.901903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243871,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":558,"num_read_kb":8007,"num_write":1492,"num_write_kb":37535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'416","reported_seq":2018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:30.937626+0000","last_change":"2024-03-09T14:28:55.588359+0000","last_active":"2024-03-09T15:06:30.937626+0000","last_peered":"2024-03-09T15:06:30.937626+0000","last_clean":"2024-03-09T15:06:30.937626+0000","last_became_active":"2024-03-09T14:28:55.587626+0000","last_became_peered":"2024-03-09T14:28:55.587626+0000","last_unstale":"2024-03-09T15:06:30.937626+0000","last_undegraded":"2024-03-09T15:06:30.937626+0000","last_fullsized":"2024-03-09T15:06:30.937626+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:11:15.692803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2314,"num_read_kb":2202,"num_write":483,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'263","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:22.862902+0000","last_change":"2024-03-09T14:28:53.589649+0000","last_active":"2024-03-09T15:06:22.862902+0000","last_peered":"2024-03-09T15:06:22.862902+0000","last_clean":"2024-03-09T15:06:22.862902+0000","last_became_active":"2024-03-09T14:28:53.589232+0000","last_became_peered":"2024-03-09T14:28:53.589232+0000","last_unstale":"2024-03-09T15:06:22.862902+0000","last_undegraded":"2024-03-09T15:06:22.862902+0000","last_fullsized":"2024-03-09T15:06:22.862902+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:39:52.724655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11025831,"num_objects":71,"num_object_clones":0,"num_object_copies":284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":415,"num_read_kb":42616,"num_write":1167,"num_write_kb":40647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'928","reported_seq":2692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.479559+0000","last_change":"2024-03-09T14:28:55.603210+0000","last_active":"2024-03-09T15:06:53.479559+0000","last_peered":"2024-03-09T15:06:53.479559+0000","last_clean":"2024-03-09T15:06:53.479559+0000","last_became_active":"2024-03-09T14:28:55.602477+0000","last_became_peered":"2024-03-09T14:28:55.602477+0000","last_unstale":"2024-03-09T15:06:53.479559+0000","last_undegraded":"2024-03-09T15:06:53.479559+0000","last_fullsized":"2024-03-09T15:06:53.479559+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:09:50.068938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4605,"num_read_kb":4102,"num_write":1299,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'353","reported_seq":1797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.436373+0000","last_change":"2024-03-09T14:28:55.571793+0000","last_active":"2024-03-09T15:06:42.436373+0000","last_peered":"2024-03-09T15:06:42.436373+0000","last_clean":"2024-03-09T15:06:42.436373+0000","last_became_active":"2024-03-09T14:28:55.570861+0000","last_became_peered":"2024-03-09T14:28:55.570861+0000","last_unstale":"2024-03-09T15:06:42.436373+0000","last_undegraded":"2024-03-09T15:06:42.436373+0000","last_fullsized":"2024-03-09T15:06:42.436373+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:59:27.495054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1960,"num_read_kb":1866,"num_write":405,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'329","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.588942+0000","last_change":"2024-03-09T14:28:53.608951+0000","last_active":"2024-03-09T15:07:04.588942+0000","last_peered":"2024-03-09T15:07:04.588942+0000","last_clean":"2024-03-09T15:07:04.588942+0000","last_became_active":"2024-03-09T14:28:53.607915+0000","last_became_peered":"2024-03-09T14:28:53.607915+0000","last_unstale":"2024-03-09T15:07:04.588942+0000","last_undegraded":"2024-03-09T15:07:04.588942+0000","last_fullsized":"2024-03-09T15:07:04.588942+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:57.850290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5561340,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":529,"num_read_kb":78571,"num_write":1317,"num_write_kb":47168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'819","reported_seq":2221,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.471725+0000","last_change":"2024-03-09T14:28:55.592675+0000","last_active":"2024-03-09T15:06:53.471725+0000","last_peered":"2024-03-09T15:06:53.471725+0000","last_clean":"2024-03-09T15:06:53.471725+0000","last_became_active":"2024-03-09T14:28:55.591884+0000","last_became_peered":"2024-03-09T14:28:55.591884+0000","last_unstale":"2024-03-09T15:06:53.471725+0000","last_undegraded":"2024-03-09T15:06:53.471725+0000","last_fullsized":"2024-03-09T15:06:53.471725+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:10:17.105445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3579,"num_read_kb":3134,"num_write":1128,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'234","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.698433+0000","last_change":"2024-03-09T14:28:53.638241+0000","last_active":"2024-03-09T15:07:04.698433+0000","last_peered":"2024-03-09T15:07:04.698433+0000","last_clean":"2024-03-09T15:07:04.698433+0000","last_became_active":"2024-03-09T14:28:53.635735+0000","last_became_peered":"2024-03-09T14:28:53.635735+0000","last_unstale":"2024-03-09T15:07:04.698433+0000","last_undegraded":"2024-03-09T15:07:04.698433+0000","last_fullsized":"2024-03-09T15:07:04.698433+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:44:09.619974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":439,"num_read_kb":101132,"num_write":968,"num_write_kb":27272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'365","reported_seq":1868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.435386+0000","last_change":"2024-03-09T14:28:55.590086+0000","last_active":"2024-03-09T15:06:42.435386+0000","last_peered":"2024-03-09T15:06:42.435386+0000","last_clean":"2024-03-09T15:06:42.435386+0000","last_became_active":"2024-03-09T14:28:55.589360+0000","last_became_peered":"2024-03-09T14:28:55.589360+0000","last_unstale":"2024-03-09T15:06:42.435386+0000","last_undegraded":"2024-03-09T15:06:42.435386+0000","last_fullsized":"2024-03-09T15:06:42.435386+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:02.064740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2092,"num_write":426,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'295","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.615763+0000","last_change":"2024-03-09T14:28:53.638187+0000","last_active":"2024-03-09T15:07:04.615763+0000","last_peered":"2024-03-09T15:07:04.615763+0000","last_clean":"2024-03-09T15:07:04.615763+0000","last_became_active":"2024-03-09T14:28:53.635713+0000","last_became_peered":"2024-03-09T14:28:53.635713+0000","last_unstale":"2024-03-09T15:07:04.615763+0000","last_undegraded":"2024-03-09T15:07:04.615763+0000","last_fullsized":"2024-03-09T15:07:04.615763+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:54:41.702227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7073816,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":509,"num_read_kb":101700,"num_write":1094,"num_write_kb":55747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'1330","reported_seq":2999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.480828+0000","last_change":"2024-03-09T14:28:55.602534+0000","last_active":"2024-03-09T15:06:53.480828+0000","last_peered":"2024-03-09T15:06:53.480828+0000","last_clean":"2024-03-09T15:06:53.480828+0000","last_became_active":"2024-03-09T14:28:55.602235+0000","last_became_peered":"2024-03-09T14:28:55.602235+0000","last_unstale":"2024-03-09T15:06:53.480828+0000","last_undegraded":"2024-03-09T15:06:53.480828+0000","last_fullsized":"2024-03-09T15:06:53.480828+0000","mapping_epoch":25,"log_start":"264'1300","ondisk_log_start":"264'1300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:37.897038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5607,"num_read_kb":4937,"num_write":1889,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'420","reported_seq":1087,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.643322+0000","last_change":"2024-03-09T14:29:28.825001+0000","last_active":"2024-03-09T15:07:04.643322+0000","last_peered":"2024-03-09T15:07:04.643322+0000","last_clean":"2024-03-09T15:07:04.643322+0000","last_became_active":"2024-03-09T14:29:28.823751+0000","last_became_peered":"2024-03-09T14:29:28.823751+0000","last_unstale":"2024-03-09T15:07:04.643322+0000","last_undegraded":"2024-03-09T15:07:04.643322+0000","last_fullsized":"2024-03-09T15:07:04.643322+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:51:51.410458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289653,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":790,"num_read_kb":6645,"num_write":1405,"num_write_kb":15242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,0],"acting":[2,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"264'438","reported_seq":2021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.377980+0000","last_change":"2024-03-09T14:28:55.575476+0000","last_active":"2024-03-09T15:06:38.377980+0000","last_peered":"2024-03-09T15:06:38.377980+0000","last_clean":"2024-03-09T15:06:38.377980+0000","last_became_active":"2024-03-09T14:28:55.574645+0000","last_became_peered":"2024-03-09T14:28:55.574645+0000","last_unstale":"2024-03-09T15:06:38.377980+0000","last_undegraded":"2024-03-09T15:06:38.377980+0000","last_fullsized":"2024-03-09T15:06:38.377980+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:13:49.646435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2503,"num_read_kb":2358,"num_write":585,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'303","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:27.730812+0000","last_change":"2024-03-09T14:28:53.619764+0000","last_active":"2024-03-09T15:05:27.730812+0000","last_peered":"2024-03-09T15:05:27.730812+0000","last_clean":"2024-03-09T15:05:27.730812+0000","last_became_active":"2024-03-09T14:28:53.619291+0000","last_became_peered":"2024-03-09T14:28:53.619291+0000","last_unstale":"2024-03-09T15:05:27.730812+0000","last_undegraded":"2024-03-09T15:05:27.730812+0000","last_fullsized":"2024-03-09T15:05:27.730812+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:18.730889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7274808,"num_objects":82,"num_object_clones":0,"num_object_copies":328,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":512,"num_read_kb":88953,"num_write":1289,"num_write_kb":34328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'358","reported_seq":1902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.473697+0000","last_change":"2024-03-09T14:28:55.563774+0000","last_active":"2024-03-09T15:06:53.473697+0000","last_peered":"2024-03-09T15:06:53.473697+0000","last_clean":"2024-03-09T15:06:53.473697+0000","last_became_active":"2024-03-09T14:28:55.563041+0000","last_became_peered":"2024-03-09T14:28:55.563041+0000","last_unstale":"2024-03-09T15:06:53.473697+0000","last_undegraded":"2024-03-09T15:06:53.473697+0000","last_fullsized":"2024-03-09T15:06:53.473697+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:57.726313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2055,"num_read_kb":1986,"num_write":393,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'385","reported_seq":1066,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.650593+0000","last_change":"2024-03-09T14:28:53.586359+0000","last_active":"2024-03-09T15:07:04.650593+0000","last_peered":"2024-03-09T15:07:04.650593+0000","last_clean":"2024-03-09T15:07:04.650593+0000","last_became_active":"2024-03-09T14:28:53.585880+0000","last_became_peered":"2024-03-09T14:28:53.585880+0000","last_unstale":"2024-03-09T15:07:04.650593+0000","last_undegraded":"2024-03-09T15:07:04.650593+0000","last_fullsized":"2024-03-09T15:07:04.650593+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:35:20.383666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45730,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":625,"num_read_kb":65521,"num_write":1358,"num_write_kb":24882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'120","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:26.294126+0000","last_change":"2024-03-09T14:29:03.661025+0000","last_active":"2024-03-09T15:06:26.294126+0000","last_peered":"2024-03-09T15:06:26.294126+0000","last_clean":"2024-03-09T15:06:26.294126+0000","last_became_active":"2024-03-09T14:29:03.660224+0000","last_became_peered":"2024-03-09T14:29:03.660224+0000","last_unstale":"2024-03-09T15:06:26.294126+0000","last_undegraded":"2024-03-09T15:06:26.294126+0000","last_fullsized":"2024-03-09T15:06:26.294126+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:52.780401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":112,"num_write":285,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'399","reported_seq":1864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.290586+0000","last_change":"2024-03-09T14:28:55.598495+0000","last_active":"2024-03-09T15:06:41.290586+0000","last_peered":"2024-03-09T15:06:41.290586+0000","last_clean":"2024-03-09T15:06:41.290586+0000","last_became_active":"2024-03-09T14:28:55.596404+0000","last_became_peered":"2024-03-09T14:28:55.596404+0000","last_unstale":"2024-03-09T15:06:41.290586+0000","last_undegraded":"2024-03-09T15:06:41.290586+0000","last_fullsized":"2024-03-09T15:06:41.290586+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:01:23.717950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2183,"num_read_kb":2049,"num_write":485,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'292","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.603739+0000","last_change":"2024-03-09T14:28:53.610969+0000","last_active":"2024-03-09T15:07:04.603739+0000","last_peered":"2024-03-09T15:07:04.603739+0000","last_clean":"2024-03-09T15:07:04.603739+0000","last_became_active":"2024-03-09T14:28:53.610073+0000","last_became_peered":"2024-03-09T14:28:53.610073+0000","last_unstale":"2024-03-09T15:07:04.603739+0000","last_undegraded":"2024-03-09T15:07:04.603739+0000","last_fullsized":"2024-03-09T15:07:04.603739+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:36.026110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8695860,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":555,"num_read_kb":1412,"num_write":1128,"num_write_kb":31021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.867610+0000","last_change":"2024-03-09T14:28:57.606795+0000","last_active":"2024-03-09T15:02:49.867610+0000","last_peered":"2024-03-09T15:02:49.867610+0000","last_clean":"2024-03-09T15:02:49.867610+0000","last_became_active":"2024-03-09T14:28:57.606062+0000","last_became_peered":"2024-03-09T14:28:57.606062+0000","last_unstale":"2024-03-09T15:02:49.867610+0000","last_undegraded":"2024-03-09T15:02:49.867610+0000","last_fullsized":"2024-03-09T15:02:49.867610+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:20:55.983665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'315","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.460277+0000","last_change":"2024-03-09T14:28:59.622695+0000","last_active":"2024-03-09T15:06:55.460277+0000","last_peered":"2024-03-09T15:06:55.460277+0000","last_clean":"2024-03-09T15:06:55.460277+0000","last_became_active":"2024-03-09T14:28:59.622357+0000","last_became_peered":"2024-03-09T14:28:59.622357+0000","last_unstale":"2024-03-09T15:06:55.460277+0000","last_undegraded":"2024-03-09T15:06:55.460277+0000","last_fullsized":"2024-03-09T15:06:55.460277+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:40:38.071877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59515,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":498,"num_read_kb":977,"num_write":398,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.902045+0000","last_change":"2024-03-09T14:29:01.637387+0000","last_active":"2024-03-09T15:02:54.902045+0000","last_peered":"2024-03-09T15:02:54.902045+0000","last_clean":"2024-03-09T15:02:54.902045+0000","last_became_active":"2024-03-09T14:29:01.636497+0000","last_became_peered":"2024-03-09T14:29:01.636497+0000","last_unstale":"2024-03-09T15:02:54.902045+0000","last_undegraded":"2024-03-09T15:02:54.902045+0000","last_fullsized":"2024-03-09T15:02:54.902045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:20:55.356981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2460","reported_seq":4883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.842069+0000","last_change":"2024-03-09T14:29:03.667138+0000","last_active":"2024-03-09T15:06:53.842069+0000","last_peered":"2024-03-09T15:06:53.842069+0000","last_clean":"2024-03-09T15:06:53.842069+0000","last_became_active":"2024-03-09T14:29:03.664933+0000","last_became_peered":"2024-03-09T14:29:03.664933+0000","last_unstale":"2024-03-09T15:06:53.842069+0000","last_undegraded":"2024-03-09T15:06:53.842069+0000","last_fullsized":"2024-03-09T15:06:53.842069+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":2400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:18:59.045000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6733,"num_read_kb":6729,"num_write":4969,"num_write_kb":1822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'420","reported_seq":1996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.091742+0000","last_change":"2024-03-09T14:28:55.595855+0000","last_active":"2024-03-09T15:06:27.091742+0000","last_peered":"2024-03-09T15:06:27.091742+0000","last_clean":"2024-03-09T15:06:27.091742+0000","last_became_active":"2024-03-09T14:28:55.594120+0000","last_became_peered":"2024-03-09T14:28:55.594120+0000","last_unstale":"2024-03-09T15:06:27.091742+0000","last_undegraded":"2024-03-09T15:06:27.091742+0000","last_fullsized":"2024-03-09T15:06:27.091742+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:33:22.109526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2334,"num_read_kb":2217,"num_write":521,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'322","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.612800+0000","last_change":"2024-03-09T14:28:53.592039+0000","last_active":"2024-03-09T15:07:04.612800+0000","last_peered":"2024-03-09T15:07:04.612800+0000","last_clean":"2024-03-09T15:07:04.612800+0000","last_became_active":"2024-03-09T14:28:53.589914+0000","last_became_peered":"2024-03-09T14:28:53.589914+0000","last_unstale":"2024-03-09T15:07:04.612800+0000","last_undegraded":"2024-03-09T15:07:04.612800+0000","last_fullsized":"2024-03-09T15:07:04.612800+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:53:01.915523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097434,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":441,"num_read_kb":36278,"num_write":1194,"num_write_kb":26714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.939219+0000","last_change":"2024-03-09T14:28:57.609556+0000","last_active":"2024-03-09T15:04:04.939219+0000","last_peered":"2024-03-09T15:04:04.939219+0000","last_clean":"2024-03-09T15:04:04.939219+0000","last_became_active":"2024-03-09T14:28:57.608444+0000","last_became_peered":"2024-03-09T14:28:57.608444+0000","last_unstale":"2024-03-09T15:04:04.939219+0000","last_undegraded":"2024-03-09T15:04:04.939219+0000","last_fullsized":"2024-03-09T15:04:04.939219+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:54.351478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'65","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.201008+0000","last_change":"2024-03-09T14:28:59.615503+0000","last_active":"2024-03-09T15:04:49.201008+0000","last_peered":"2024-03-09T15:04:49.201008+0000","last_clean":"2024-03-09T15:04:49.201008+0000","last_became_active":"2024-03-09T14:28:59.614144+0000","last_became_peered":"2024-03-09T14:28:59.614144+0000","last_unstale":"2024-03-09T15:04:49.201008+0000","last_undegraded":"2024-03-09T15:04:49.201008+0000","last_fullsized":"2024-03-09T15:04:49.201008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:26:26.621561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":74,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.684839+0000","last_change":"2024-03-09T14:29:01.650515+0000","last_active":"2024-03-09T15:02:54.684839+0000","last_peered":"2024-03-09T15:02:54.684839+0000","last_clean":"2024-03-09T15:02:54.684839+0000","last_became_active":"2024-03-09T14:29:01.649716+0000","last_became_peered":"2024-03-09T14:29:01.649716+0000","last_unstale":"2024-03-09T15:02:54.684839+0000","last_undegraded":"2024-03-09T15:02:54.684839+0000","last_fullsized":"2024-03-09T15:02:54.684839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:50:00.172206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'128","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.347500+0000","last_change":"2024-03-09T14:29:03.677339+0000","last_active":"2024-03-09T15:06:24.347500+0000","last_peered":"2024-03-09T15:06:24.347500+0000","last_clean":"2024-03-09T15:06:24.347500+0000","last_became_active":"2024-03-09T14:29:03.676427+0000","last_became_peered":"2024-03-09T14:29:03.676427+0000","last_unstale":"2024-03-09T15:06:24.347500+0000","last_undegraded":"2024-03-09T15:06:24.347500+0000","last_fullsized":"2024-03-09T15:06:24.347500+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:46:24.909885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":126,"num_write":288,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'348","reported_seq":1729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:28.240636+0000","last_change":"2024-03-09T14:29:28.734389+0000","last_active":"2024-03-09T15:06:28.240636+0000","last_peered":"2024-03-09T15:06:28.240636+0000","last_clean":"2024-03-09T15:06:28.240636+0000","last_became_active":"2024-03-09T14:29:28.733522+0000","last_became_peered":"2024-03-09T14:29:28.733522+0000","last_unstale":"2024-03-09T15:06:28.240636+0000","last_undegraded":"2024-03-09T15:06:28.240636+0000","last_fullsized":"2024-03-09T15:06:28.240636+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:16:32.699098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1907,"num_read_kb":1804,"num_write":410,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'320","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.710687+0000","last_change":"2024-03-09T14:28:53.633910+0000","last_active":"2024-03-09T15:07:04.710687+0000","last_peered":"2024-03-09T15:07:04.710687+0000","last_clean":"2024-03-09T15:07:04.710687+0000","last_became_active":"2024-03-09T14:28:53.633368+0000","last_became_peered":"2024-03-09T14:28:53.633368+0000","last_unstale":"2024-03-09T15:07:04.710687+0000","last_undegraded":"2024-03-09T15:07:04.710687+0000","last_fullsized":"2024-03-09T15:07:04.710687+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:26.540977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918128,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":428,"num_read_kb":7245,"num_write":1132,"num_write_kb":29598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.920522+0000","last_change":"2024-03-09T14:28:57.614611+0000","last_active":"2024-03-09T15:02:49.920522+0000","last_peered":"2024-03-09T15:02:49.920522+0000","last_clean":"2024-03-09T15:02:49.920522+0000","last_became_active":"2024-03-09T14:28:57.613841+0000","last_became_peered":"2024-03-09T14:28:57.613841+0000","last_unstale":"2024-03-09T15:02:49.920522+0000","last_undegraded":"2024-03-09T15:02:49.920522+0000","last_fullsized":"2024-03-09T15:02:49.920522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:44.586932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'103","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.727031+0000","last_change":"2024-03-09T14:28:59.619913+0000","last_active":"2024-03-09T15:06:29.727031+0000","last_peered":"2024-03-09T15:06:29.727031+0000","last_clean":"2024-03-09T15:06:29.727031+0000","last_became_active":"2024-03-09T14:28:59.619147+0000","last_became_peered":"2024-03-09T14:28:59.619147+0000","last_unstale":"2024-03-09T15:06:29.727031+0000","last_undegraded":"2024-03-09T15:06:29.727031+0000","last_fullsized":"2024-03-09T15:06:29.727031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:54:42.905183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":102,"num_write":78,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'532","reported_seq":3845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.474622+0000","last_change":"2024-03-09T14:29:01.637642+0000","last_active":"2024-03-09T15:07:02.474622+0000","last_peered":"2024-03-09T15:07:02.474622+0000","last_clean":"2024-03-09T15:07:02.474622+0000","last_became_active":"2024-03-09T14:29:01.636743+0000","last_became_peered":"2024-03-09T14:29:01.636743+0000","last_unstale":"2024-03-09T15:07:02.474622+0000","last_undegraded":"2024-03-09T15:07:02.474622+0000","last_fullsized":"2024-03-09T15:07:02.474622+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:58:02.166987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'197","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:20.713069+0000","last_change":"2024-03-09T14:29:03.649992+0000","last_active":"2024-03-09T15:06:20.713069+0000","last_peered":"2024-03-09T15:06:20.713069+0000","last_clean":"2024-03-09T15:06:20.713069+0000","last_became_active":"2024-03-09T14:29:03.649194+0000","last_became_peered":"2024-03-09T14:29:03.649194+0000","last_unstale":"2024-03-09T15:06:20.713069+0000","last_undegraded":"2024-03-09T15:06:20.713069+0000","last_fullsized":"2024-03-09T15:06:20.713069+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:46.290792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":551,"num_read_kb":549,"num_write":426,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'370","reported_seq":1843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:56.287432+0000","last_change":"2024-03-09T14:28:55.597244+0000","last_active":"2024-03-09T15:05:56.287432+0000","last_peered":"2024-03-09T15:05:56.287432+0000","last_clean":"2024-03-09T15:05:56.287432+0000","last_became_active":"2024-03-09T14:28:55.592359+0000","last_became_peered":"2024-03-09T14:28:55.592359+0000","last_unstale":"2024-03-09T15:05:56.287432+0000","last_undegraded":"2024-03-09T15:05:56.287432+0000","last_fullsized":"2024-03-09T15:05:56.287432+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:59.078312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2105,"num_read_kb":2015,"num_write":416,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'265","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.674212+0000","last_change":"2024-03-09T14:28:53.632702+0000","last_active":"2024-03-09T15:07:04.674212+0000","last_peered":"2024-03-09T15:07:04.674212+0000","last_clean":"2024-03-09T15:07:04.674212+0000","last_became_active":"2024-03-09T14:28:53.631559+0000","last_became_peered":"2024-03-09T14:28:53.631559+0000","last_unstale":"2024-03-09T15:07:04.674212+0000","last_undegraded":"2024-03-09T15:07:04.674212+0000","last_fullsized":"2024-03-09T15:07:04.674212+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:01:04.705294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9603321,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":376,"num_read_kb":6712,"num_write":1032,"num_write_kb":20730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.867656+0000","last_change":"2024-03-09T14:28:57.606488+0000","last_active":"2024-03-09T15:02:49.867656+0000","last_peered":"2024-03-09T15:02:49.867656+0000","last_clean":"2024-03-09T15:02:49.867656+0000","last_became_active":"2024-03-09T14:28:57.605787+0000","last_became_peered":"2024-03-09T14:28:57.605787+0000","last_unstale":"2024-03-09T15:02:49.867656+0000","last_undegraded":"2024-03-09T15:02:49.867656+0000","last_fullsized":"2024-03-09T15:02:49.867656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:26.152998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'240","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.732734+0000","last_change":"2024-03-09T14:28:59.627011+0000","last_active":"2024-03-09T15:07:04.732734+0000","last_peered":"2024-03-09T15:07:04.732734+0000","last_clean":"2024-03-09T15:07:04.732734+0000","last_became_active":"2024-03-09T14:28:59.626279+0000","last_became_peered":"2024-03-09T14:28:59.626279+0000","last_unstale":"2024-03-09T15:07:04.732734+0000","last_undegraded":"2024-03-09T15:07:04.732734+0000","last_fullsized":"2024-03-09T15:07:04.732734+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:16:34.909728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51626,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":406,"num_read_kb":896,"num_write":329,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'581","reported_seq":1924,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.537264+0000","last_change":"2024-03-09T14:29:01.629131+0000","last_active":"2024-03-09T15:06:55.537264+0000","last_peered":"2024-03-09T15:06:55.537264+0000","last_clean":"2024-03-09T15:06:55.537264+0000","last_became_active":"2024-03-09T14:29:01.628420+0000","last_became_peered":"2024-03-09T14:29:01.628420+0000","last_unstale":"2024-03-09T15:06:55.537264+0000","last_undegraded":"2024-03-09T15:06:55.537264+0000","last_fullsized":"2024-03-09T15:06:55.537264+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:38.918481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'514","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:33.802719+0000","last_change":"2024-03-09T14:28:55.583472+0000","last_active":"2024-03-09T15:06:33.802719+0000","last_peered":"2024-03-09T15:06:33.802719+0000","last_clean":"2024-03-09T15:06:33.802719+0000","last_became_active":"2024-03-09T14:28:55.582638+0000","last_became_peered":"2024-03-09T14:28:55.582638+0000","last_unstale":"2024-03-09T15:06:33.802719+0000","last_undegraded":"2024-03-09T15:06:33.802719+0000","last_fullsized":"2024-03-09T15:06:33.802719+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:37:10.517715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2835,"num_read_kb":2627,"num_write":675,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'325","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.640986+0000","last_change":"2024-03-09T14:28:53.615478+0000","last_active":"2024-03-09T15:07:04.640986+0000","last_peered":"2024-03-09T15:07:04.640986+0000","last_clean":"2024-03-09T15:07:04.640986+0000","last_became_active":"2024-03-09T14:28:53.614586+0000","last_became_peered":"2024-03-09T14:28:53.614586+0000","last_unstale":"2024-03-09T15:07:04.640986+0000","last_undegraded":"2024-03-09T15:07:04.640986+0000","last_fullsized":"2024-03-09T15:07:04.640986+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:26:26.454638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2569943,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":448,"num_read_kb":10439,"num_write":1242,"num_write_kb":25392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:39.698275+0000","last_change":"2024-03-09T14:28:57.604178+0000","last_active":"2024-03-09T15:03:39.698275+0000","last_peered":"2024-03-09T15:03:39.698275+0000","last_clean":"2024-03-09T15:03:39.698275+0000","last_became_active":"2024-03-09T14:28:57.603233+0000","last_became_peered":"2024-03-09T14:28:57.603233+0000","last_unstale":"2024-03-09T15:03:39.698275+0000","last_undegraded":"2024-03-09T15:03:39.698275+0000","last_fullsized":"2024-03-09T15:03:39.698275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:12.919139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'327","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.837184+0000","last_change":"2024-03-09T14:28:59.627283+0000","last_active":"2024-03-09T15:06:39.837184+0000","last_peered":"2024-03-09T15:06:39.837184+0000","last_clean":"2024-03-09T15:06:39.837184+0000","last_became_active":"2024-03-09T14:28:59.626371+0000","last_became_peered":"2024-03-09T14:28:59.626371+0000","last_unstale":"2024-03-09T15:06:39.837184+0000","last_undegraded":"2024-03-09T15:06:39.837184+0000","last_fullsized":"2024-03-09T15:06:39.837184+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:29:20.179850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62313,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":548,"num_read_kb":1067,"num_write":440,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:50.041923+0000","last_change":"2024-03-09T14:29:01.637753+0000","last_active":"2024-03-09T15:02:50.041923+0000","last_peered":"2024-03-09T15:02:50.041923+0000","last_clean":"2024-03-09T15:02:50.041923+0000","last_became_active":"2024-03-09T14:29:01.636735+0000","last_became_peered":"2024-03-09T14:29:01.636735+0000","last_unstale":"2024-03-09T15:02:50.041923+0000","last_undegraded":"2024-03-09T15:02:50.041923+0000","last_fullsized":"2024-03-09T15:02:50.041923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:26:05.528994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'542","reported_seq":1364,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.504334+0000","last_change":"2024-03-09T14:29:03.676776+0000","last_active":"2024-03-09T15:06:55.504334+0000","last_peered":"2024-03-09T15:06:55.504334+0000","last_clean":"2024-03-09T15:06:55.504334+0000","last_became_active":"2024-03-09T14:29:03.676068+0000","last_became_peered":"2024-03-09T14:29:03.676068+0000","last_unstale":"2024-03-09T15:06:55.504334+0000","last_undegraded":"2024-03-09T15:06:55.504334+0000","last_fullsized":"2024-03-09T15:06:55.504334+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:53:03.331837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1331,"num_read_kb":1310,"num_write":1143,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'505","reported_seq":2110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.476263+0000","last_change":"2024-03-09T14:28:55.563572+0000","last_active":"2024-03-09T15:06:53.476263+0000","last_peered":"2024-03-09T15:06:53.476263+0000","last_clean":"2024-03-09T15:06:53.476263+0000","last_became_active":"2024-03-09T14:28:55.562782+0000","last_became_peered":"2024-03-09T14:28:55.562782+0000","last_unstale":"2024-03-09T15:06:53.476263+0000","last_undegraded":"2024-03-09T15:06:53.476263+0000","last_fullsized":"2024-03-09T15:06:53.476263+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:08.148515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2703,"num_read_kb":2505,"num_write":654,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'299","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.613984+0000","last_change":"2024-03-09T14:28:53.614539+0000","last_active":"2024-03-09T15:07:04.613984+0000","last_peered":"2024-03-09T15:07:04.613984+0000","last_clean":"2024-03-09T15:07:04.613984+0000","last_became_active":"2024-03-09T14:28:53.613015+0000","last_became_peered":"2024-03-09T14:28:53.613015+0000","last_unstale":"2024-03-09T15:07:04.613984+0000","last_undegraded":"2024-03-09T15:07:04.613984+0000","last_fullsized":"2024-03-09T15:07:04.613984+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:43:30.232179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3031329,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":472,"num_read_kb":9909,"num_write":1154,"num_write_kb":22337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:39.689387+0000","last_change":"2024-03-09T14:28:57.605938+0000","last_active":"2024-03-09T15:03:39.689387+0000","last_peered":"2024-03-09T15:03:39.689387+0000","last_clean":"2024-03-09T15:03:39.689387+0000","last_became_active":"2024-03-09T14:28:57.605493+0000","last_became_peered":"2024-03-09T14:28:57.605493+0000","last_unstale":"2024-03-09T15:03:39.689387+0000","last_undegraded":"2024-03-09T15:03:39.689387+0000","last_fullsized":"2024-03-09T15:03:39.689387+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:08:58.747971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'258","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.461872+0000","last_change":"2024-03-09T14:28:59.615074+0000","last_active":"2024-03-09T15:06:42.461872+0000","last_peered":"2024-03-09T15:06:42.461872+0000","last_clean":"2024-03-09T15:06:42.461872+0000","last_became_active":"2024-03-09T14:28:59.614640+0000","last_became_peered":"2024-03-09T14:28:59.614640+0000","last_unstale":"2024-03-09T15:06:42.461872+0000","last_undegraded":"2024-03-09T15:06:42.461872+0000","last_fullsized":"2024-03-09T15:06:42.461872+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:55:14.804093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58009,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":422,"num_read_kb":904,"num_write":350,"num_write_kb":297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.934983+0000","last_change":"2024-03-09T14:29:01.628631+0000","last_active":"2024-03-09T15:03:49.934983+0000","last_peered":"2024-03-09T15:03:49.934983+0000","last_clean":"2024-03-09T15:03:49.934983+0000","last_became_active":"2024-03-09T14:29:01.627897+0000","last_became_peered":"2024-03-09T14:29:01.627897+0000","last_unstale":"2024-03-09T15:03:49.934983+0000","last_undegraded":"2024-03-09T15:03:49.934983+0000","last_fullsized":"2024-03-09T15:03:49.934983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:56:12.214362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'106","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:21.867785+0000","last_change":"2024-03-09T14:29:03.673997+0000","last_active":"2024-03-09T15:06:21.867785+0000","last_peered":"2024-03-09T15:06:21.867785+0000","last_clean":"2024-03-09T15:06:21.867785+0000","last_became_active":"2024-03-09T14:29:03.673265+0000","last_became_peered":"2024-03-09T14:29:03.673265+0000","last_unstale":"2024-03-09T15:06:21.867785+0000","last_undegraded":"2024-03-09T15:06:21.867785+0000","last_fullsized":"2024-03-09T15:06:21.867785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:26:29.254697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":93,"num_write":248,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'556","reported_seq":2185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.336610+0000","last_change":"2024-03-09T14:28:55.595155+0000","last_active":"2024-03-09T15:06:24.336610+0000","last_peered":"2024-03-09T15:06:24.336610+0000","last_clean":"2024-03-09T15:06:24.336610+0000","last_became_active":"2024-03-09T14:28:55.588092+0000","last_became_peered":"2024-03-09T14:28:55.588092+0000","last_unstale":"2024-03-09T15:06:24.336610+0000","last_undegraded":"2024-03-09T15:06:24.336610+0000","last_fullsized":"2024-03-09T15:06:24.336610+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:04:55.020928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2916,"num_read_kb":2661,"num_write":728,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'285","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.654742+0000","last_change":"2024-03-09T14:29:28.824146+0000","last_active":"2024-03-09T15:07:04.654742+0000","last_peered":"2024-03-09T15:07:04.654742+0000","last_clean":"2024-03-09T15:07:04.654742+0000","last_became_active":"2024-03-09T14:29:28.822971+0000","last_became_peered":"2024-03-09T14:29:28.822971+0000","last_unstale":"2024-03-09T15:07:04.654742+0000","last_undegraded":"2024-03-09T15:07:04.654742+0000","last_fullsized":"2024-03-09T15:07:04.654742+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:05:04.090335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289525,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":349,"num_read_kb":22878,"num_write":977,"num_write_kb":75728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:44.677095+0000","last_change":"2024-03-09T14:28:57.610888+0000","last_active":"2024-03-09T15:02:44.677095+0000","last_peered":"2024-03-09T15:02:44.677095+0000","last_clean":"2024-03-09T15:02:44.677095+0000","last_became_active":"2024-03-09T14:28:57.610472+0000","last_became_peered":"2024-03-09T14:28:57.610472+0000","last_unstale":"2024-03-09T15:02:44.677095+0000","last_undegraded":"2024-03-09T15:02:44.677095+0000","last_fullsized":"2024-03-09T15:02:44.677095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:44:44.084587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'303","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.936163+0000","last_change":"2024-03-09T14:28:59.613949+0000","last_active":"2024-03-09T15:07:02.936163+0000","last_peered":"2024-03-09T15:07:02.936163+0000","last_clean":"2024-03-09T15:07:02.936163+0000","last_became_active":"2024-03-09T14:28:59.610930+0000","last_became_peered":"2024-03-09T14:28:59.610930+0000","last_unstale":"2024-03-09T15:07:02.936163+0000","last_undegraded":"2024-03-09T15:07:02.936163+0000","last_fullsized":"2024-03-09T15:07:02.936163+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:18:06.308383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48936,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":498,"num_read_kb":1136,"num_write":410,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'559","reported_seq":2051,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.490282+0000","last_change":"2024-03-09T14:29:01.648142+0000","last_active":"2024-03-09T15:07:02.490282+0000","last_peered":"2024-03-09T15:07:02.490282+0000","last_clean":"2024-03-09T15:07:02.490282+0000","last_became_active":"2024-03-09T14:29:01.647361+0000","last_became_peered":"2024-03-09T14:29:01.647361+0000","last_unstale":"2024-03-09T15:07:02.490282+0000","last_undegraded":"2024-03-09T15:07:02.490282+0000","last_fullsized":"2024-03-09T15:07:02.490282+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:44:05.118214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'137","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:30.943762+0000","last_change":"2024-03-09T14:29:03.666545+0000","last_active":"2024-03-09T15:06:30.943762+0000","last_peered":"2024-03-09T15:06:30.943762+0000","last_clean":"2024-03-09T15:06:30.943762+0000","last_became_active":"2024-03-09T14:29:03.665744+0000","last_became_peered":"2024-03-09T14:29:03.665744+0000","last_unstale":"2024-03-09T15:06:30.943762+0000","last_undegraded":"2024-03-09T15:06:30.943762+0000","last_fullsized":"2024-03-09T15:06:30.943762+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:32:02.001608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'380","reported_seq":1992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.473681+0000","last_change":"2024-03-09T14:28:55.587716+0000","last_active":"2024-03-09T15:06:53.473681+0000","last_peered":"2024-03-09T15:06:53.473681+0000","last_clean":"2024-03-09T15:06:53.473681+0000","last_became_active":"2024-03-09T14:28:55.587413+0000","last_became_peered":"2024-03-09T14:28:55.587413+0000","last_unstale":"2024-03-09T15:06:53.473681+0000","last_undegraded":"2024-03-09T15:06:53.473681+0000","last_fullsized":"2024-03-09T15:06:53.473681+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:48:05.277419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2251,"num_read_kb":2175,"num_write":432,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'234","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:37.936658+0000","last_change":"2024-03-09T14:28:53.640425+0000","last_active":"2024-03-09T15:06:37.936658+0000","last_peered":"2024-03-09T15:06:37.936658+0000","last_clean":"2024-03-09T15:06:37.936658+0000","last_became_active":"2024-03-09T14:28:53.639073+0000","last_became_peered":"2024-03-09T14:28:53.639073+0000","last_unstale":"2024-03-09T15:06:37.936658+0000","last_undegraded":"2024-03-09T15:06:37.936658+0000","last_fullsized":"2024-03-09T15:06:37.936658+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:18.874857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2741333,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":370,"num_read_kb":3405,"num_write":1092,"num_write_kb":27946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.691482+0000","last_change":"2024-03-09T14:28:57.620565+0000","last_active":"2024-03-09T15:03:49.691482+0000","last_peered":"2024-03-09T15:03:49.691482+0000","last_clean":"2024-03-09T15:03:49.691482+0000","last_became_active":"2024-03-09T14:28:57.620037+0000","last_became_peered":"2024-03-09T14:28:57.620037+0000","last_unstale":"2024-03-09T15:03:49.691482+0000","last_undegraded":"2024-03-09T15:03:49.691482+0000","last_fullsized":"2024-03-09T15:03:49.691482+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:17:42.157517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'470","reported_seq":1090,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.261609+0000","last_change":"2024-03-09T14:28:59.626702+0000","last_active":"2024-03-09T15:07:04.261609+0000","last_peered":"2024-03-09T15:07:04.261609+0000","last_clean":"2024-03-09T15:07:04.261609+0000","last_became_active":"2024-03-09T14:28:59.625949+0000","last_became_peered":"2024-03-09T14:28:59.625949+0000","last_unstale":"2024-03-09T15:07:04.261609+0000","last_undegraded":"2024-03-09T15:07:04.261609+0000","last_fullsized":"2024-03-09T15:07:04.261609+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:42:22.844016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84476,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":828,"num_read_kb":2021,"num_write":686,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:44.690461+0000","last_change":"2024-03-09T14:29:01.620598+0000","last_active":"2024-03-09T15:03:44.690461+0000","last_peered":"2024-03-09T15:03:44.690461+0000","last_clean":"2024-03-09T15:03:44.690461+0000","last_became_active":"2024-03-09T14:29:01.620136+0000","last_became_peered":"2024-03-09T14:29:01.620136+0000","last_unstale":"2024-03-09T15:03:44.690461+0000","last_undegraded":"2024-03-09T15:03:44.690461+0000","last_fullsized":"2024-03-09T15:03:44.690461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:33.969272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'157","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.043416+0000","last_change":"2024-03-09T14:29:03.674681+0000","last_active":"2024-03-09T15:06:39.043416+0000","last_peered":"2024-03-09T15:06:39.043416+0000","last_clean":"2024-03-09T15:06:39.043416+0000","last_became_active":"2024-03-09T14:29:03.673216+0000","last_became_peered":"2024-03-09T14:29:03.673216+0000","last_unstale":"2024-03-09T15:06:39.043416+0000","last_undegraded":"2024-03-09T15:06:39.043416+0000","last_fullsized":"2024-03-09T15:06:39.043416+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:09:16.468619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":716,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":343,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'284","reported_seq":1635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.437313+0000","last_change":"2024-03-09T14:28:55.575944+0000","last_active":"2024-03-09T15:06:42.437313+0000","last_peered":"2024-03-09T15:06:42.437313+0000","last_clean":"2024-03-09T15:06:42.437313+0000","last_became_active":"2024-03-09T14:28:55.575211+0000","last_became_peered":"2024-03-09T14:28:55.575211+0000","last_unstale":"2024-03-09T15:06:42.437313+0000","last_undegraded":"2024-03-09T15:06:42.437313+0000","last_fullsized":"2024-03-09T15:06:42.437313+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:01:47.496592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1639,"num_read_kb":1592,"num_write":307,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'250","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.530862+0000","last_change":"2024-03-09T14:28:53.562474+0000","last_active":"2024-03-09T15:06:29.530862+0000","last_peered":"2024-03-09T15:06:29.530862+0000","last_clean":"2024-03-09T15:06:29.530862+0000","last_became_active":"2024-03-09T14:28:53.561769+0000","last_became_peered":"2024-03-09T14:28:53.561769+0000","last_unstale":"2024-03-09T15:06:29.530862+0000","last_undegraded":"2024-03-09T15:06:29.530862+0000","last_fullsized":"2024-03-09T15:06:29.530862+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:13.573028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13215948,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":491,"num_read_kb":46371,"num_write":1167,"num_write_kb":14767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:44.677212+0000","last_change":"2024-03-09T14:28:57.606747+0000","last_active":"2024-03-09T15:02:44.677212+0000","last_peered":"2024-03-09T15:02:44.677212+0000","last_clean":"2024-03-09T15:02:44.677212+0000","last_became_active":"2024-03-09T14:28:57.606029+0000","last_became_peered":"2024-03-09T14:28:57.606029+0000","last_unstale":"2024-03-09T15:02:44.677212+0000","last_undegraded":"2024-03-09T15:02:44.677212+0000","last_fullsized":"2024-03-09T15:02:44.677212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:37:28.933755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'272","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.364674+0000","last_change":"2024-03-09T14:28:59.630783+0000","last_active":"2024-03-09T15:07:04.364674+0000","last_peered":"2024-03-09T15:07:04.364674+0000","last_clean":"2024-03-09T15:07:04.364674+0000","last_became_active":"2024-03-09T14:28:59.630097+0000","last_became_peered":"2024-03-09T14:28:59.630097+0000","last_unstale":"2024-03-09T15:07:04.364674+0000","last_undegraded":"2024-03-09T15:07:04.364674+0000","last_fullsized":"2024-03-09T15:07:04.364674+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:59:00.777817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42990,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":1018,"num_write":414,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.691717+0000","last_change":"2024-03-09T14:29:01.648762+0000","last_active":"2024-03-09T15:02:54.691717+0000","last_peered":"2024-03-09T15:02:54.691717+0000","last_clean":"2024-03-09T15:02:54.691717+0000","last_became_active":"2024-03-09T14:29:01.647375+0000","last_became_peered":"2024-03-09T14:29:01.647375+0000","last_unstale":"2024-03-09T15:02:54.691717+0000","last_undegraded":"2024-03-09T15:02:54.691717+0000","last_fullsized":"2024-03-09T15:02:54.691717+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:25:06.920706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'128","reported_seq":607,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:51.352059+0000","last_change":"2024-03-09T14:29:03.678484+0000","last_active":"2024-03-09T15:06:51.352059+0000","last_peered":"2024-03-09T15:06:51.352059+0000","last_clean":"2024-03-09T15:06:51.352059+0000","last_became_active":"2024-03-09T14:29:03.677704+0000","last_became_peered":"2024-03-09T14:29:03.677704+0000","last_unstale":"2024-03-09T15:06:51.352059+0000","last_undegraded":"2024-03-09T15:06:51.352059+0000","last_fullsized":"2024-03-09T15:06:51.352059+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:25.512736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":309,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'396","reported_seq":2038,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:08.369675+0000","last_change":"2024-03-09T14:28:55.578548+0000","last_active":"2024-03-09T15:06:08.369675+0000","last_peered":"2024-03-09T15:06:08.369675+0000","last_clean":"2024-03-09T15:06:08.369675+0000","last_became_active":"2024-03-09T14:28:55.577690+0000","last_became_peered":"2024-03-09T14:28:55.577690+0000","last_unstale":"2024-03-09T15:06:08.369675+0000","last_undegraded":"2024-03-09T15:06:08.369675+0000","last_fullsized":"2024-03-09T15:06:08.369675+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:48:46.933238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2493,"num_read_kb":2366,"num_write":474,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'277","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.608644+0000","last_change":"2024-03-09T14:28:53.631261+0000","last_active":"2024-03-09T15:07:04.608644+0000","last_peered":"2024-03-09T15:07:04.608644+0000","last_clean":"2024-03-09T15:07:04.608644+0000","last_became_active":"2024-03-09T14:28:53.627013+0000","last_became_peered":"2024-03-09T14:28:53.627013+0000","last_unstale":"2024-03-09T15:07:04.608644+0000","last_undegraded":"2024-03-09T15:07:04.608644+0000","last_fullsized":"2024-03-09T15:07:04.608644+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:05:48.407861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5645276,"num_objects":19,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":450,"num_read_kb":6489,"num_write":1106,"num_write_kb":11469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:45.040808+0000","last_change":"2024-03-09T14:28:57.614495+0000","last_active":"2024-03-09T15:02:45.040808+0000","last_peered":"2024-03-09T15:02:45.040808+0000","last_clean":"2024-03-09T15:02:45.040808+0000","last_became_active":"2024-03-09T14:28:57.614028+0000","last_became_peered":"2024-03-09T14:28:57.614028+0000","last_unstale":"2024-03-09T15:02:45.040808+0000","last_undegraded":"2024-03-09T15:02:45.040808+0000","last_fullsized":"2024-03-09T15:02:45.040808+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:12:00.953633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'260","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.705827+0000","last_change":"2024-03-09T14:28:59.613701+0000","last_active":"2024-03-09T15:07:03.705827+0000","last_peered":"2024-03-09T15:07:03.705827+0000","last_clean":"2024-03-09T15:07:03.705827+0000","last_became_active":"2024-03-09T14:28:59.613169+0000","last_became_peered":"2024-03-09T14:28:59.613169+0000","last_unstale":"2024-03-09T15:07:03.705827+0000","last_undegraded":"2024-03-09T15:07:03.705827+0000","last_fullsized":"2024-03-09T15:07:03.705827+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:29:04.658643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":434,"num_read_kb":985,"num_write":344,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'524","reported_seq":4073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.476180+0000","last_change":"2024-03-09T14:29:01.634092+0000","last_active":"2024-03-09T15:07:02.476180+0000","last_peered":"2024-03-09T15:07:02.476180+0000","last_clean":"2024-03-09T15:07:02.476180+0000","last_became_active":"2024-03-09T14:29:01.633363+0000","last_became_peered":"2024-03-09T14:29:01.633363+0000","last_unstale":"2024-03-09T15:07:02.476180+0000","last_undegraded":"2024-03-09T15:07:02.476180+0000","last_fullsized":"2024-03-09T15:07:02.476180+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:29.117930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'114","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:35.097974+0000","last_change":"2024-03-09T14:29:03.680649+0000","last_active":"2024-03-09T15:06:35.097974+0000","last_peered":"2024-03-09T15:06:35.097974+0000","last_clean":"2024-03-09T15:06:35.097974+0000","last_became_active":"2024-03-09T14:29:03.679941+0000","last_became_peered":"2024-03-09T14:29:03.679941+0000","last_unstale":"2024-03-09T15:06:35.097974+0000","last_undegraded":"2024-03-09T15:06:35.097974+0000","last_fullsized":"2024-03-09T15:06:35.097974+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:51:15.615789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1871,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":265,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'457","reported_seq":2150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.374575+0000","last_change":"2024-03-09T14:28:55.590773+0000","last_active":"2024-03-09T15:06:38.374575+0000","last_peered":"2024-03-09T15:06:38.374575+0000","last_clean":"2024-03-09T15:06:38.374575+0000","last_became_active":"2024-03-09T14:28:55.589982+0000","last_became_peered":"2024-03-09T14:28:55.589982+0000","last_unstale":"2024-03-09T15:06:38.374575+0000","last_undegraded":"2024-03-09T15:06:38.374575+0000","last_fullsized":"2024-03-09T15:06:38.374575+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:13:42.061416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2457,"num_read_kb":2347,"num_write":517,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'319","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.698296+0000","last_change":"2024-03-09T14:28:53.603618+0000","last_active":"2024-03-09T15:07:04.698296+0000","last_peered":"2024-03-09T15:07:04.698296+0000","last_clean":"2024-03-09T15:07:04.698296+0000","last_became_active":"2024-03-09T14:28:53.596847+0000","last_became_peered":"2024-03-09T14:28:53.596847+0000","last_unstale":"2024-03-09T15:07:04.698296+0000","last_undegraded":"2024-03-09T15:07:04.698296+0000","last_fullsized":"2024-03-09T15:07:04.698296+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:28:50.808652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243310,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":431,"num_read_kb":7047,"num_write":1150,"num_write_kb":21742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.375695+0000","last_change":"2024-03-09T14:28:57.619309+0000","last_active":"2024-03-09T15:06:55.375695+0000","last_peered":"2024-03-09T15:06:55.375695+0000","last_clean":"2024-03-09T15:06:55.375695+0000","last_became_active":"2024-03-09T14:28:57.618459+0000","last_became_peered":"2024-03-09T14:28:57.618459+0000","last_unstale":"2024-03-09T15:06:55.375695+0000","last_undegraded":"2024-03-09T15:06:55.375695+0000","last_fullsized":"2024-03-09T15:06:55.375695+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:07:02.519797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":636,"num_read_kb":636,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'56","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.953770+0000","last_change":"2024-03-09T14:28:59.635240+0000","last_active":"2024-03-09T15:04:59.953770+0000","last_peered":"2024-03-09T15:04:59.953770+0000","last_clean":"2024-03-09T15:04:59.953770+0000","last_became_active":"2024-03-09T14:28:59.634653+0000","last_became_peered":"2024-03-09T14:28:59.634653+0000","last_unstale":"2024-03-09T15:04:59.953770+0000","last_undegraded":"2024-03-09T15:04:59.953770+0000","last_fullsized":"2024-03-09T15:04:59.953770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:14:05.243868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'536","reported_seq":1985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.483082+0000","last_change":"2024-03-09T14:29:01.656750+0000","last_active":"2024-03-09T15:07:02.483082+0000","last_peered":"2024-03-09T15:07:02.483082+0000","last_clean":"2024-03-09T15:07:02.483082+0000","last_became_active":"2024-03-09T14:29:01.656177+0000","last_became_peered":"2024-03-09T14:29:01.656177+0000","last_unstale":"2024-03-09T15:07:02.483082+0000","last_undegraded":"2024-03-09T15:07:02.483082+0000","last_fullsized":"2024-03-09T15:07:02.483082+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":500,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:14:48.749660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'149","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.627725+0000","last_change":"2024-03-09T14:29:03.673147+0000","last_active":"2024-03-09T15:06:29.627725+0000","last_peered":"2024-03-09T15:06:29.627725+0000","last_clean":"2024-03-09T15:06:29.627725+0000","last_became_active":"2024-03-09T14:29:03.672416+0000","last_became_peered":"2024-03-09T14:29:03.672416+0000","last_unstale":"2024-03-09T15:06:29.627725+0000","last_undegraded":"2024-03-09T15:06:29.627725+0000","last_fullsized":"2024-03-09T15:06:29.627725+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:33.857671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":118,"num_read_kb":112,"num_write":348,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'860","reported_seq":2473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.908049+0000","last_change":"2024-03-09T14:28:55.584166+0000","last_active":"2024-03-09T15:06:39.908049+0000","last_peered":"2024-03-09T15:06:39.908049+0000","last_clean":"2024-03-09T15:06:39.908049+0000","last_became_active":"2024-03-09T14:28:55.583618+0000","last_became_peered":"2024-03-09T14:28:55.583618+0000","last_unstale":"2024-03-09T15:06:39.908049+0000","last_undegraded":"2024-03-09T15:06:39.908049+0000","last_fullsized":"2024-03-09T15:06:39.908049+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:38:20.845683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4083,"num_read_kb":3643,"num_write":1199,"num_write_kb":506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'255","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:02.443089+0000","last_change":"2024-03-09T14:28:53.568437+0000","last_active":"2024-03-09T15:05:02.443089+0000","last_peered":"2024-03-09T15:05:02.443089+0000","last_clean":"2024-03-09T15:05:02.443089+0000","last_became_active":"2024-03-09T14:28:53.568002+0000","last_became_peered":"2024-03-09T14:28:53.568002+0000","last_unstale":"2024-03-09T15:05:02.443089+0000","last_undegraded":"2024-03-09T15:05:02.443089+0000","last_fullsized":"2024-03-09T15:05:02.443089+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:23:32.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11074352,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":581,"num_read_kb":26432,"num_write":1059,"num_write_kb":51619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:44.682741+0000","last_change":"2024-03-09T14:28:57.616235+0000","last_active":"2024-03-09T15:02:44.682741+0000","last_peered":"2024-03-09T15:02:44.682741+0000","last_clean":"2024-03-09T15:02:44.682741+0000","last_became_active":"2024-03-09T14:28:57.615518+0000","last_became_peered":"2024-03-09T14:28:57.615518+0000","last_unstale":"2024-03-09T15:02:44.682741+0000","last_undegraded":"2024-03-09T15:02:44.682741+0000","last_fullsized":"2024-03-09T15:02:44.682741+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:42:54.401600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'354","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.463731+0000","last_change":"2024-03-09T14:28:59.607936+0000","last_active":"2024-03-09T15:06:55.463731+0000","last_peered":"2024-03-09T15:06:55.463731+0000","last_clean":"2024-03-09T15:06:55.463731+0000","last_became_active":"2024-03-09T14:28:59.607095+0000","last_became_peered":"2024-03-09T14:28:59.607095+0000","last_unstale":"2024-03-09T15:06:55.463731+0000","last_undegraded":"2024-03-09T15:06:55.463731+0000","last_fullsized":"2024-03-09T15:06:55.463731+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:16:14.902005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59189,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1181,"num_read_kb":1706,"num_write":1722,"num_write_kb":1608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.682241+0000","last_change":"2024-03-09T14:29:01.650586+0000","last_active":"2024-03-09T15:02:49.682241+0000","last_peered":"2024-03-09T15:02:49.682241+0000","last_clean":"2024-03-09T15:02:49.682241+0000","last_became_active":"2024-03-09T14:29:01.649769+0000","last_became_peered":"2024-03-09T14:29:01.649769+0000","last_unstale":"2024-03-09T15:02:49.682241+0000","last_undegraded":"2024-03-09T15:02:49.682241+0000","last_fullsized":"2024-03-09T15:02:49.682241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:07:16.076604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'142","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:25.753617+0000","last_change":"2024-03-09T14:29:03.678921+0000","last_active":"2024-03-09T15:06:25.753617+0000","last_peered":"2024-03-09T15:06:25.753617+0000","last_clean":"2024-03-09T15:06:25.753617+0000","last_became_active":"2024-03-09T14:29:03.678140+0000","last_became_peered":"2024-03-09T14:29:03.678140+0000","last_unstale":"2024-03-09T15:06:25.753617+0000","last_undegraded":"2024-03-09T15:06:25.753617+0000","last_fullsized":"2024-03-09T15:06:25.753617+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:56:42.351083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":150,"num_write":332,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'1639","reported_seq":3308,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.109281+0000","last_change":"2024-03-09T14:28:55.597191+0000","last_active":"2024-03-09T15:06:27.109281+0000","last_peered":"2024-03-09T15:06:27.109281+0000","last_clean":"2024-03-09T15:06:27.109281+0000","last_became_active":"2024-03-09T14:28:55.596219+0000","last_became_peered":"2024-03-09T14:28:55.596219+0000","last_unstale":"2024-03-09T15:06:27.109281+0000","last_undegraded":"2024-03-09T15:06:27.109281+0000","last_fullsized":"2024-03-09T15:06:27.109281+0000","mapping_epoch":25,"log_start":"264'1600","ondisk_log_start":"264'1600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:18:39.978742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6749,"num_read_kb":5786,"num_write":2314,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.715671+0000","last_change":"2024-03-09T14:28:36.802806+0000","last_active":"2024-03-09T15:04:49.715671+0000","last_peered":"2024-03-09T15:04:49.715671+0000","last_clean":"2024-03-09T15:04:49.715671+0000","last_became_active":"2024-03-09T14:28:36.802270+0000","last_became_peered":"2024-03-09T14:28:36.802270+0000","last_unstale":"2024-03-09T15:04:49.715671+0000","last_undegraded":"2024-03-09T15:04:49.715671+0000","last_fullsized":"2024-03-09T15:04:49.715671+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:35.777784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:35.777784+0000","last_clean_scrub_stamp":"2024-03-09T14:28:35.777784+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:02:15.668382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.886372+0000","last_change":"2024-03-09T14:28:41.842055+0000","last_active":"2024-03-09T15:04:09.886372+0000","last_peered":"2024-03-09T15:04:09.886372+0000","last_clean":"2024-03-09T15:04:09.886372+0000","last_became_active":"2024-03-09T14:28:41.841153+0000","last_became_peered":"2024-03-09T14:28:41.841153+0000","last_unstale":"2024-03-09T15:04:09.886372+0000","last_undegraded":"2024-03-09T15:04:09.886372+0000","last_fullsized":"2024-03-09T15:04:09.886372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:49.085946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'278","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.002768+0000","last_change":"2024-03-09T14:28:53.623164+0000","last_active":"2024-03-09T15:06:27.002768+0000","last_peered":"2024-03-09T15:06:27.002768+0000","last_clean":"2024-03-09T15:06:27.002768+0000","last_became_active":"2024-03-09T14:28:53.622700+0000","last_became_peered":"2024-03-09T14:28:53.622700+0000","last_unstale":"2024-03-09T15:06:27.002768+0000","last_undegraded":"2024-03-09T15:06:27.002768+0000","last_fullsized":"2024-03-09T15:06:27.002768+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:03:47.434250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15759292,"num_objects":68,"num_object_clones":0,"num_object_copies":272,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":487,"num_read_kb":30199,"num_write":1195,"num_write_kb":35948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.709259+0000","last_change":"2024-03-09T14:28:57.607452+0000","last_active":"2024-03-09T15:04:24.709259+0000","last_peered":"2024-03-09T15:04:24.709259+0000","last_clean":"2024-03-09T15:04:24.709259+0000","last_became_active":"2024-03-09T14:28:57.606611+0000","last_became_peered":"2024-03-09T14:28:57.606611+0000","last_unstale":"2024-03-09T15:04:24.709259+0000","last_undegraded":"2024-03-09T15:04:24.709259+0000","last_fullsized":"2024-03-09T15:04:24.709259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:02:18.757444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'678","reported_seq":1359,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.469091+0000","last_change":"2024-03-09T14:28:59.604427+0000","last_active":"2024-03-09T15:06:55.469091+0000","last_peered":"2024-03-09T15:06:55.469091+0000","last_clean":"2024-03-09T15:06:55.469091+0000","last_became_active":"2024-03-09T14:28:59.603722+0000","last_became_peered":"2024-03-09T14:28:59.603722+0000","last_unstale":"2024-03-09T15:06:55.469091+0000","last_undegraded":"2024-03-09T15:06:55.469091+0000","last_fullsized":"2024-03-09T15:06:55.469091+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:32:43.960476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":171209,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1323,"num_read_kb":2726,"num_write":1260,"num_write_kb":1130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:44.703042+0000","last_change":"2024-03-09T14:29:01.648470+0000","last_active":"2024-03-09T15:03:44.703042+0000","last_peered":"2024-03-09T15:03:44.703042+0000","last_clean":"2024-03-09T15:03:44.703042+0000","last_became_active":"2024-03-09T14:29:01.647958+0000","last_became_peered":"2024-03-09T14:29:01.647958+0000","last_unstale":"2024-03-09T15:03:44.703042+0000","last_undegraded":"2024-03-09T15:03:44.703042+0000","last_fullsized":"2024-03-09T15:03:44.703042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:52:09.215340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'226","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:22.522461+0000","last_change":"2024-03-09T14:29:03.681803+0000","last_active":"2024-03-09T15:06:22.522461+0000","last_peered":"2024-03-09T15:06:22.522461+0000","last_clean":"2024-03-09T15:06:22.522461+0000","last_became_active":"2024-03-09T14:29:03.680962+0000","last_became_peered":"2024-03-09T14:29:03.680962+0000","last_unstale":"2024-03-09T15:06:22.522461+0000","last_undegraded":"2024-03-09T15:06:22.522461+0000","last_fullsized":"2024-03-09T15:06:22.522461+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:28:12.130155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":425,"num_read_kb":422,"num_write":485,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'387","reported_seq":1944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.433238+0000","last_change":"2024-03-09T14:28:55.575679+0000","last_active":"2024-03-09T15:06:42.433238+0000","last_peered":"2024-03-09T15:06:42.433238+0000","last_clean":"2024-03-09T15:06:42.433238+0000","last_became_active":"2024-03-09T14:28:55.575229+0000","last_became_peered":"2024-03-09T14:28:55.575229+0000","last_unstale":"2024-03-09T15:06:42.433238+0000","last_undegraded":"2024-03-09T15:06:42.433238+0000","last_fullsized":"2024-03-09T15:06:42.433238+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:26:56.492010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2264,"num_read_kb":2158,"num_write":447,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:54.716837+0000","last_change":"2024-03-09T14:28:41.839813+0000","last_active":"2024-03-09T15:04:54.716837+0000","last_peered":"2024-03-09T15:04:54.716837+0000","last_clean":"2024-03-09T15:04:54.716837+0000","last_became_active":"2024-03-09T14:28:41.838669+0000","last_became_peered":"2024-03-09T14:28:41.838669+0000","last_unstale":"2024-03-09T15:04:54.716837+0000","last_undegraded":"2024-03-09T15:04:54.716837+0000","last_fullsized":"2024-03-09T15:04:54.716837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:52:50.503614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'287","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.625017+0000","last_change":"2024-03-09T14:28:53.587759+0000","last_active":"2024-03-09T15:07:04.625017+0000","last_peered":"2024-03-09T15:07:04.625017+0000","last_clean":"2024-03-09T15:07:04.625017+0000","last_became_active":"2024-03-09T14:28:53.587201+0000","last_became_peered":"2024-03-09T14:28:53.587201+0000","last_unstale":"2024-03-09T15:07:04.625017+0000","last_undegraded":"2024-03-09T15:07:04.625017+0000","last_fullsized":"2024-03-09T15:07:04.625017+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:37:04.349336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11539118,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":421,"num_read_kb":38281,"num_write":1103,"num_write_kb":47895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:39.879966+0000","last_change":"2024-03-09T14:28:57.613708+0000","last_active":"2024-03-09T15:03:39.879966+0000","last_peered":"2024-03-09T15:03:39.879966+0000","last_clean":"2024-03-09T15:03:39.879966+0000","last_became_active":"2024-03-09T14:28:57.612854+0000","last_became_peered":"2024-03-09T14:28:57.612854+0000","last_unstale":"2024-03-09T15:03:39.879966+0000","last_undegraded":"2024-03-09T15:03:39.879966+0000","last_fullsized":"2024-03-09T15:03:39.879966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:41:11.322298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1058","reported_seq":2355,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.682989+0000","last_change":"2024-03-09T14:28:59.601211+0000","last_active":"2024-03-09T15:06:55.682989+0000","last_peered":"2024-03-09T15:06:55.682989+0000","last_clean":"2024-03-09T15:06:55.682989+0000","last_became_active":"2024-03-09T14:28:59.599819+0000","last_became_peered":"2024-03-09T14:28:59.599819+0000","last_unstale":"2024-03-09T15:06:55.682989+0000","last_undegraded":"2024-03-09T15:06:55.682989+0000","last_fullsized":"2024-03-09T15:06:55.682989+0000","mapping_epoch":29,"log_start":"264'1000","ondisk_log_start":"264'1000","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":1000,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:21:21.381897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158009,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1660,"num_read_kb":2983,"num_write":1032,"num_write_kb":889,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:39.712987+0000","last_change":"2024-03-09T14:29:01.628141+0000","last_active":"2024-03-09T15:04:39.712987+0000","last_peered":"2024-03-09T15:04:39.712987+0000","last_clean":"2024-03-09T15:04:39.712987+0000","last_became_active":"2024-03-09T14:29:01.626582+0000","last_became_peered":"2024-03-09T14:29:01.626582+0000","last_unstale":"2024-03-09T15:04:39.712987+0000","last_undegraded":"2024-03-09T15:04:39.712987+0000","last_fullsized":"2024-03-09T15:04:39.712987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:05:36.345657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'109","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:31.614081+0000","last_change":"2024-03-09T14:29:03.660377+0000","last_active":"2024-03-09T15:06:31.614081+0000","last_peered":"2024-03-09T15:06:31.614081+0000","last_clean":"2024-03-09T15:06:31.614081+0000","last_became_active":"2024-03-09T14:29:03.659633+0000","last_became_peered":"2024-03-09T14:29:03.659633+0000","last_unstale":"2024-03-09T15:06:31.614081+0000","last_undegraded":"2024-03-09T15:06:31.614081+0000","last_fullsized":"2024-03-09T15:06:31.614081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:02:02.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":112,"num_read_kb":106,"num_write":262,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'372","reported_seq":1937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.084567+0000","last_change":"2024-03-09T14:28:55.585014+0000","last_active":"2024-03-09T15:06:27.084567+0000","last_peered":"2024-03-09T15:06:27.084567+0000","last_clean":"2024-03-09T15:06:27.084567+0000","last_became_active":"2024-03-09T14:28:55.584347+0000","last_became_peered":"2024-03-09T14:28:55.584347+0000","last_unstale":"2024-03-09T15:06:27.084567+0000","last_undegraded":"2024-03-09T15:06:27.084567+0000","last_fullsized":"2024-03-09T15:06:27.084567+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:07.167466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2124,"num_read_kb":2043,"num_write":421,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.695024+0000","last_change":"2024-03-09T14:28:41.837266+0000","last_active":"2024-03-09T15:04:04.695024+0000","last_peered":"2024-03-09T15:04:04.695024+0000","last_clean":"2024-03-09T15:04:04.695024+0000","last_became_active":"2024-03-09T14:28:41.836544+0000","last_became_peered":"2024-03-09T14:28:41.836544+0000","last_unstale":"2024-03-09T15:04:04.695024+0000","last_undegraded":"2024-03-09T15:04:04.695024+0000","last_fullsized":"2024-03-09T15:04:04.695024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:40.144949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'274","reported_seq":924,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.294904+0000","last_change":"2024-03-09T14:28:53.626870+0000","last_active":"2024-03-09T15:06:38.294904+0000","last_peered":"2024-03-09T15:06:38.294904+0000","last_clean":"2024-03-09T15:06:38.294904+0000","last_became_active":"2024-03-09T14:28:53.626472+0000","last_became_peered":"2024-03-09T14:28:53.626472+0000","last_unstale":"2024-03-09T15:06:38.294904+0000","last_undegraded":"2024-03-09T15:06:38.294904+0000","last_fullsized":"2024-03-09T15:06:38.294904+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:28.665281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10933458,"num_objects":65,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":495,"num_read_kb":1460,"num_write":1252,"num_write_kb":27243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:39.689548+0000","last_change":"2024-03-09T14:28:57.610715+0000","last_active":"2024-03-09T15:03:39.689548+0000","last_peered":"2024-03-09T15:03:39.689548+0000","last_clean":"2024-03-09T15:03:39.689548+0000","last_became_active":"2024-03-09T14:28:57.609908+0000","last_became_peered":"2024-03-09T14:28:57.609908+0000","last_unstale":"2024-03-09T15:03:39.689548+0000","last_undegraded":"2024-03-09T15:03:39.689548+0000","last_fullsized":"2024-03-09T15:03:39.689548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:42:15.361989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'225","reported_seq":1219,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.681224+0000","last_change":"2024-03-09T14:28:59.628581+0000","last_active":"2024-03-09T15:06:55.681224+0000","last_peered":"2024-03-09T15:06:55.681224+0000","last_clean":"2024-03-09T15:06:55.681224+0000","last_became_active":"2024-03-09T14:28:59.627810+0000","last_became_peered":"2024-03-09T14:28:59.627810+0000","last_unstale":"2024-03-09T15:06:55.681224+0000","last_undegraded":"2024-03-09T15:06:55.681224+0000","last_fullsized":"2024-03-09T15:06:55.681224+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:38:33.367082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":165,"num_read_kb":157,"num_write":151,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.714308+0000","last_change":"2024-03-09T14:29:01.647816+0000","last_active":"2024-03-09T15:04:29.714308+0000","last_peered":"2024-03-09T15:04:29.714308+0000","last_clean":"2024-03-09T15:04:29.714308+0000","last_became_active":"2024-03-09T14:29:01.647228+0000","last_became_peered":"2024-03-09T14:29:01.647228+0000","last_unstale":"2024-03-09T15:04:29.714308+0000","last_undegraded":"2024-03-09T15:04:29.714308+0000","last_fullsized":"2024-03-09T15:04:29.714308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:05:51.167608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'248","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:33.164698+0000","last_change":"2024-03-09T14:29:03.659156+0000","last_active":"2024-03-09T15:06:33.164698+0000","last_peered":"2024-03-09T15:06:33.164698+0000","last_clean":"2024-03-09T15:06:33.164698+0000","last_became_active":"2024-03-09T14:29:03.654872+0000","last_became_peered":"2024-03-09T14:29:03.654872+0000","last_unstale":"2024-03-09T15:06:33.164698+0000","last_undegraded":"2024-03-09T15:06:33.164698+0000","last_fullsized":"2024-03-09T15:06:33.164698+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:31:12.618967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":497,"num_write":533,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'463","reported_seq":2014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.372347+0000","last_change":"2024-03-09T14:28:55.578525+0000","last_active":"2024-03-09T15:06:38.372347+0000","last_peered":"2024-03-09T15:06:38.372347+0000","last_clean":"2024-03-09T15:06:38.372347+0000","last_became_active":"2024-03-09T14:28:55.577946+0000","last_became_peered":"2024-03-09T14:28:55.577946+0000","last_unstale":"2024-03-09T15:06:38.372347+0000","last_undegraded":"2024-03-09T15:06:38.372347+0000","last_fullsized":"2024-03-09T15:06:38.372347+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:44:39.146598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2440,"num_read_kb":2271,"num_write":585,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.886323+0000","last_change":"2024-03-09T14:28:41.843028+0000","last_active":"2024-03-09T15:04:09.886323+0000","last_peered":"2024-03-09T15:04:09.886323+0000","last_clean":"2024-03-09T15:04:09.886323+0000","last_became_active":"2024-03-09T14:28:41.842251+0000","last_became_peered":"2024-03-09T14:28:41.842251+0000","last_unstale":"2024-03-09T15:04:09.886323+0000","last_undegraded":"2024-03-09T15:04:09.886323+0000","last_fullsized":"2024-03-09T15:04:09.886323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:09:29.190170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'313","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.651914+0000","last_change":"2024-03-09T14:28:53.622441+0000","last_active":"2024-03-09T15:07:04.651914+0000","last_peered":"2024-03-09T15:07:04.651914+0000","last_clean":"2024-03-09T15:07:04.651914+0000","last_became_active":"2024-03-09T14:28:53.621914+0000","last_became_peered":"2024-03-09T14:28:53.621914+0000","last_unstale":"2024-03-09T15:07:04.651914+0000","last_undegraded":"2024-03-09T15:07:04.651914+0000","last_fullsized":"2024-03-09T15:07:04.651914+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:35.698441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7585770,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":520,"num_read_kb":22951,"num_write":1121,"num_write_kb":34708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.714348+0000","last_change":"2024-03-09T14:28:57.613906+0000","last_active":"2024-03-09T15:04:29.714348+0000","last_peered":"2024-03-09T15:04:29.714348+0000","last_clean":"2024-03-09T15:04:29.714348+0000","last_became_active":"2024-03-09T14:28:57.613407+0000","last_became_peered":"2024-03-09T14:28:57.613407+0000","last_unstale":"2024-03-09T15:04:29.714348+0000","last_undegraded":"2024-03-09T15:04:29.714348+0000","last_fullsized":"2024-03-09T15:04:29.714348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:51:41.922830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'110","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:01.825035+0000","last_change":"2024-03-09T14:28:59.619709+0000","last_active":"2024-03-09T15:06:01.825035+0000","last_peered":"2024-03-09T15:06:01.825035+0000","last_clean":"2024-03-09T15:06:01.825035+0000","last_became_active":"2024-03-09T14:28:59.619291+0000","last_became_peered":"2024-03-09T14:28:59.619291+0000","last_unstale":"2024-03-09T15:06:01.825035+0000","last_undegraded":"2024-03-09T15:06:01.825035+0000","last_fullsized":"2024-03-09T15:06:01.825035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:25.604984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":110,"num_write":80,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:44.694699+0000","last_change":"2024-03-09T14:29:01.657586+0000","last_active":"2024-03-09T15:03:44.694699+0000","last_peered":"2024-03-09T15:03:44.694699+0000","last_clean":"2024-03-09T15:03:44.694699+0000","last_became_active":"2024-03-09T14:29:01.656672+0000","last_became_peered":"2024-03-09T14:29:01.656672+0000","last_unstale":"2024-03-09T15:03:44.694699+0000","last_undegraded":"2024-03-09T15:03:44.694699+0000","last_fullsized":"2024-03-09T15:03:44.694699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:15:26.411549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'104","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:31.620441+0000","last_change":"2024-03-09T14:29:03.673314+0000","last_active":"2024-03-09T15:06:31.620441+0000","last_peered":"2024-03-09T15:06:31.620441+0000","last_clean":"2024-03-09T15:06:31.620441+0000","last_became_active":"2024-03-09T14:29:03.672534+0000","last_became_peered":"2024-03-09T14:29:03.672534+0000","last_unstale":"2024-03-09T15:06:31.620441+0000","last_undegraded":"2024-03-09T15:06:31.620441+0000","last_fullsized":"2024-03-09T15:06:31.620441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:59:22.964887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":109,"num_write":236,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'463","reported_seq":2131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.144388+0000","last_change":"2024-03-09T14:28:55.584898+0000","last_active":"2024-03-09T15:06:36.144388+0000","last_peered":"2024-03-09T15:06:36.144388+0000","last_clean":"2024-03-09T15:06:36.144388+0000","last_became_active":"2024-03-09T14:28:55.583536+0000","last_became_peered":"2024-03-09T14:28:55.583536+0000","last_unstale":"2024-03-09T15:06:36.144388+0000","last_undegraded":"2024-03-09T15:06:36.144388+0000","last_fullsized":"2024-03-09T15:06:36.144388+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:58:23.929457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2714,"num_read_kb":2554,"num_write":561,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'290","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:33.487334+0000","last_change":"2024-03-09T14:28:53.629100+0000","last_active":"2024-03-09T15:04:33.487334+0000","last_peered":"2024-03-09T15:04:33.487334+0000","last_clean":"2024-03-09T15:04:33.487334+0000","last_became_active":"2024-03-09T14:28:53.626879+0000","last_became_peered":"2024-03-09T14:28:53.626879+0000","last_unstale":"2024-03-09T15:04:33.487334+0000","last_undegraded":"2024-03-09T15:04:33.487334+0000","last_fullsized":"2024-03-09T15:04:33.487334+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:04:10.643317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14857202,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":453,"num_read_kb":4755,"num_write":1292,"num_write_kb":47511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:10.059991+0000","last_change":"2024-03-09T14:28:42.127635+0000","last_active":"2024-03-09T15:04:10.059991+0000","last_peered":"2024-03-09T15:04:10.059991+0000","last_clean":"2024-03-09T15:04:10.059991+0000","last_became_active":"2024-03-09T14:28:42.126799+0000","last_became_peered":"2024-03-09T14:28:42.126799+0000","last_unstale":"2024-03-09T15:04:10.059991+0000","last_undegraded":"2024-03-09T15:04:10.059991+0000","last_fullsized":"2024-03-09T15:04:10.059991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:32.493854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.713156+0000","last_change":"2024-03-09T14:28:57.609247+0000","last_active":"2024-03-09T15:04:24.713156+0000","last_peered":"2024-03-09T15:04:24.713156+0000","last_clean":"2024-03-09T15:04:24.713156+0000","last_became_active":"2024-03-09T14:28:57.608723+0000","last_became_peered":"2024-03-09T14:28:57.608723+0000","last_unstale":"2024-03-09T15:04:24.713156+0000","last_undegraded":"2024-03-09T15:04:24.713156+0000","last_fullsized":"2024-03-09T15:04:24.713156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:02:45.228011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'526","reported_seq":1170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.631986+0000","last_change":"2024-03-09T14:28:59.625137+0000","last_active":"2024-03-09T15:07:03.631986+0000","last_peered":"2024-03-09T15:07:03.631986+0000","last_clean":"2024-03-09T15:07:03.631986+0000","last_became_active":"2024-03-09T14:28:59.624680+0000","last_became_peered":"2024-03-09T14:28:59.624680+0000","last_unstale":"2024-03-09T15:07:03.631986+0000","last_undegraded":"2024-03-09T15:07:03.631986+0000","last_fullsized":"2024-03-09T15:07:03.631986+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:11.075920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101647,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":939,"num_read_kb":2081,"num_write":778,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.706169+0000","last_change":"2024-03-09T14:29:01.641583+0000","last_active":"2024-03-09T15:04:29.706169+0000","last_peered":"2024-03-09T15:04:29.706169+0000","last_clean":"2024-03-09T15:04:29.706169+0000","last_became_active":"2024-03-09T14:29:01.640485+0000","last_became_peered":"2024-03-09T14:29:01.640485+0000","last_unstale":"2024-03-09T15:04:29.706169+0000","last_undegraded":"2024-03-09T15:04:29.706169+0000","last_fullsized":"2024-03-09T15:04:29.706169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:42:25.734918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'141","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.924663+0000","last_change":"2024-03-09T14:29:03.676884+0000","last_active":"2024-03-09T15:06:41.924663+0000","last_peered":"2024-03-09T15:06:41.924663+0000","last_clean":"2024-03-09T15:06:41.924663+0000","last_became_active":"2024-03-09T14:29:03.676032+0000","last_became_peered":"2024-03-09T14:29:03.676032+0000","last_unstale":"2024-03-09T15:06:41.924663+0000","last_undegraded":"2024-03-09T15:06:41.924663+0000","last_fullsized":"2024-03-09T15:06:41.924663+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:51:57.095744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":195,"num_read_kb":176,"num_write":349,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'352","reported_seq":1744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.457643+0000","last_change":"2024-03-09T14:28:55.583629+0000","last_active":"2024-03-09T15:06:42.457643+0000","last_peered":"2024-03-09T15:06:42.457643+0000","last_clean":"2024-03-09T15:06:42.457643+0000","last_became_active":"2024-03-09T14:28:55.582743+0000","last_became_peered":"2024-03-09T14:28:55.582743+0000","last_unstale":"2024-03-09T15:06:42.457643+0000","last_undegraded":"2024-03-09T15:06:42.457643+0000","last_fullsized":"2024-03-09T15:06:42.457643+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:13.051466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1869,"num_read_kb":1781,"num_write":409,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'258","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:58.324197+0000","last_change":"2024-03-09T14:28:53.590149+0000","last_active":"2024-03-09T15:05:58.324197+0000","last_peered":"2024-03-09T15:05:58.324197+0000","last_clean":"2024-03-09T15:05:58.324197+0000","last_became_active":"2024-03-09T14:28:53.589640+0000","last_became_peered":"2024-03-09T14:28:53.589640+0000","last_unstale":"2024-03-09T15:05:58.324197+0000","last_undegraded":"2024-03-09T15:05:58.324197+0000","last_fullsized":"2024-03-09T15:05:58.324197+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:38:10.355714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6471547,"num_objects":72,"num_object_clones":0,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":397,"num_read_kb":38844,"num_write":1060,"num_write_kb":48736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:19.707999+0000","last_change":"2024-03-09T14:28:42.127115+0000","last_active":"2024-03-09T15:04:19.707999+0000","last_peered":"2024-03-09T15:04:19.707999+0000","last_clean":"2024-03-09T15:04:19.707999+0000","last_became_active":"2024-03-09T14:28:42.126201+0000","last_became_peered":"2024-03-09T14:28:42.126201+0000","last_unstale":"2024-03-09T15:04:19.707999+0000","last_undegraded":"2024-03-09T15:04:19.707999+0000","last_fullsized":"2024-03-09T15:04:19.707999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:57.954868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.703353+0000","last_change":"2024-03-09T14:28:57.607498+0000","last_active":"2024-03-09T15:04:24.703353+0000","last_peered":"2024-03-09T15:04:24.703353+0000","last_clean":"2024-03-09T15:04:24.703353+0000","last_became_active":"2024-03-09T14:28:57.606429+0000","last_became_peered":"2024-03-09T14:28:57.606429+0000","last_unstale":"2024-03-09T15:04:24.703353+0000","last_undegraded":"2024-03-09T15:04:24.703353+0000","last_fullsized":"2024-03-09T15:04:24.703353+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:11:59.349598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'174","reported_seq":727,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.722805+0000","last_change":"2024-03-09T14:28:59.627298+0000","last_active":"2024-03-09T15:06:38.722805+0000","last_peered":"2024-03-09T15:06:38.722805+0000","last_clean":"2024-03-09T15:06:38.722805+0000","last_became_active":"2024-03-09T14:28:59.626697+0000","last_became_peered":"2024-03-09T14:28:59.626697+0000","last_unstale":"2024-03-09T15:06:38.722805+0000","last_undegraded":"2024-03-09T15:06:38.722805+0000","last_fullsized":"2024-03-09T15:06:38.722805+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:54:49.703899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":207,"num_read_kb":198,"num_write":186,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'559","reported_seq":2134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.528162+0000","last_change":"2024-03-09T14:29:01.637730+0000","last_active":"2024-03-09T15:06:55.528162+0000","last_peered":"2024-03-09T15:06:55.528162+0000","last_clean":"2024-03-09T15:06:55.528162+0000","last_became_active":"2024-03-09T14:29:01.636912+0000","last_became_peered":"2024-03-09T14:29:01.636912+0000","last_unstale":"2024-03-09T15:06:55.528162+0000","last_undegraded":"2024-03-09T15:06:55.528162+0000","last_fullsized":"2024-03-09T15:06:55.528162+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:03:38.907925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'95","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:28.252100+0000","last_change":"2024-03-09T14:29:03.665396+0000","last_active":"2024-03-09T15:06:28.252100+0000","last_peered":"2024-03-09T15:06:28.252100+0000","last_clean":"2024-03-09T15:06:28.252100+0000","last_became_active":"2024-03-09T14:29:03.664665+0000","last_became_peered":"2024-03-09T14:29:03.664665+0000","last_unstale":"2024-03-09T15:06:28.252100+0000","last_undegraded":"2024-03-09T15:06:28.252100+0000","last_fullsized":"2024-03-09T15:06:28.252100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:09:45.489579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":223,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'343","reported_seq":1825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.542652+0000","last_change":"2024-03-09T14:28:55.603920+0000","last_active":"2024-03-09T15:06:32.542652+0000","last_peered":"2024-03-09T15:06:32.542652+0000","last_clean":"2024-03-09T15:06:32.542652+0000","last_became_active":"2024-03-09T14:28:55.601355+0000","last_became_peered":"2024-03-09T14:28:55.601355+0000","last_unstale":"2024-03-09T15:06:32.542652+0000","last_undegraded":"2024-03-09T15:06:32.542652+0000","last_fullsized":"2024-03-09T15:06:32.542652+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:34.833891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1977,"num_read_kb":1906,"num_write":384,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'267","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:03.019507+0000","last_change":"2024-03-09T14:28:53.585247+0000","last_active":"2024-03-09T15:06:03.019507+0000","last_peered":"2024-03-09T15:06:03.019507+0000","last_clean":"2024-03-09T15:06:03.019507+0000","last_became_active":"2024-03-09T14:28:53.584728+0000","last_became_peered":"2024-03-09T14:28:53.584728+0000","last_unstale":"2024-03-09T15:06:03.019507+0000","last_undegraded":"2024-03-09T15:06:03.019507+0000","last_fullsized":"2024-03-09T15:06:03.019507+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:55.413559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8584738,"num_objects":69,"num_object_clones":0,"num_object_copies":276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":451,"num_read_kb":33595,"num_write":1113,"num_write_kb":22083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:20.049118+0000","last_change":"2024-03-09T14:28:41.840785+0000","last_active":"2024-03-09T15:03:20.049118+0000","last_peered":"2024-03-09T15:03:20.049118+0000","last_clean":"2024-03-09T15:03:20.049118+0000","last_became_active":"2024-03-09T14:28:41.840168+0000","last_became_peered":"2024-03-09T14:28:41.840168+0000","last_unstale":"2024-03-09T15:03:20.049118+0000","last_undegraded":"2024-03-09T15:03:20.049118+0000","last_fullsized":"2024-03-09T15:03:20.049118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:34:15.498376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"35'5","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.007346+0000","last_change":"2024-03-09T14:28:57.613265+0000","last_active":"2024-03-09T15:07:02.007346+0000","last_peered":"2024-03-09T15:07:02.007346+0000","last_clean":"2024-03-09T15:07:02.007346+0000","last_became_active":"2024-03-09T14:28:57.610373+0000","last_became_peered":"2024-03-09T14:28:57.610373+0000","last_unstale":"2024-03-09T15:07:02.007346+0000","last_undegraded":"2024-03-09T15:07:02.007346+0000","last_fullsized":"2024-03-09T15:07:02.007346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:29.212547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":492,"num_read_kb":799,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'102","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:04.229619+0000","last_change":"2024-03-09T14:28:59.616174+0000","last_active":"2024-03-09T15:06:04.229619+0000","last_peered":"2024-03-09T15:06:04.229619+0000","last_clean":"2024-03-09T15:06:04.229619+0000","last_became_active":"2024-03-09T14:28:59.615084+0000","last_became_peered":"2024-03-09T14:28:59.615084+0000","last_unstale":"2024-03-09T15:06:04.229619+0000","last_undegraded":"2024-03-09T15:06:04.229619+0000","last_fullsized":"2024-03-09T15:06:04.229619+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:06:53.932808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":100,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'579","reported_seq":2170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.535723+0000","last_change":"2024-03-09T14:29:01.631333+0000","last_active":"2024-03-09T15:06:55.535723+0000","last_peered":"2024-03-09T15:06:55.535723+0000","last_clean":"2024-03-09T15:06:55.535723+0000","last_became_active":"2024-03-09T14:29:01.630598+0000","last_became_peered":"2024-03-09T14:29:01.630598+0000","last_unstale":"2024-03-09T15:06:55.535723+0000","last_undegraded":"2024-03-09T15:06:55.535723+0000","last_fullsized":"2024-03-09T15:06:55.535723+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":500,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:04:45.034915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'228","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:28.905578+0000","last_change":"2024-03-09T14:29:03.684917+0000","last_active":"2024-03-09T15:06:28.905578+0000","last_peered":"2024-03-09T15:06:28.905578+0000","last_clean":"2024-03-09T15:06:28.905578+0000","last_became_active":"2024-03-09T14:29:03.684294+0000","last_became_peered":"2024-03-09T14:29:03.684294+0000","last_unstale":"2024-03-09T15:06:28.905578+0000","last_undegraded":"2024-03-09T15:06:28.905578+0000","last_fullsized":"2024-03-09T15:06:28.905578+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:49:59.049525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":199,"num_write":480,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'364","reported_seq":2033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.910397+0000","last_change":"2024-03-09T14:28:55.569425+0000","last_active":"2024-03-09T15:06:39.910397+0000","last_peered":"2024-03-09T15:06:39.910397+0000","last_clean":"2024-03-09T15:06:39.910397+0000","last_became_active":"2024-03-09T14:28:55.568430+0000","last_became_peered":"2024-03-09T14:28:55.568430+0000","last_unstale":"2024-03-09T15:06:39.910397+0000","last_undegraded":"2024-03-09T15:06:39.910397+0000","last_fullsized":"2024-03-09T15:06:39.910397+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:22:01.506801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2357,"num_read_kb":2282,"num_write":412,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'353","reported_seq":980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.699547+0000","last_change":"2024-03-09T14:28:53.589944+0000","last_active":"2024-03-09T15:07:04.699547+0000","last_peered":"2024-03-09T15:07:04.699547+0000","last_clean":"2024-03-09T15:07:04.699547+0000","last_became_active":"2024-03-09T14:28:53.589491+0000","last_became_peered":"2024-03-09T14:28:53.589491+0000","last_unstale":"2024-03-09T15:07:04.699547+0000","last_undegraded":"2024-03-09T15:07:04.699547+0000","last_fullsized":"2024-03-09T15:07:04.699547+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:10.418545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17646996,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":459,"num_read_kb":37358,"num_write":1224,"num_write_kb":47489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.690049+0000","last_change":"2024-03-09T14:28:41.841410+0000","last_active":"2024-03-09T15:03:24.690049+0000","last_peered":"2024-03-09T15:03:24.690049+0000","last_clean":"2024-03-09T15:03:24.690049+0000","last_became_active":"2024-03-09T14:28:41.840575+0000","last_became_peered":"2024-03-09T14:28:41.840575+0000","last_unstale":"2024-03-09T15:03:24.690049+0000","last_undegraded":"2024-03-09T15:03:24.690049+0000","last_fullsized":"2024-03-09T15:03:24.690049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:57.501425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"35'3","reported_seq":813,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.362020+0000","last_change":"2024-03-09T14:28:57.605420+0000","last_active":"2024-03-09T15:06:55.362020+0000","last_peered":"2024-03-09T15:06:55.362020+0000","last_clean":"2024-03-09T15:06:55.362020+0000","last_became_active":"2024-03-09T14:28:57.604511+0000","last_became_peered":"2024-03-09T14:28:57.604511+0000","last_unstale":"2024-03-09T15:06:55.362020+0000","last_undegraded":"2024-03-09T15:06:55.362020+0000","last_fullsized":"2024-03-09T15:06:55.362020+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:27:24.834782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":487,"num_read_kb":485,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'678","reported_seq":1381,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.660675+0000","last_change":"2024-03-09T14:28:59.630805+0000","last_active":"2024-03-09T15:07:04.660675+0000","last_peered":"2024-03-09T15:07:04.660675+0000","last_clean":"2024-03-09T15:07:04.660675+0000","last_became_active":"2024-03-09T14:28:59.630044+0000","last_became_peered":"2024-03-09T14:28:59.630044+0000","last_unstale":"2024-03-09T15:07:04.660675+0000","last_undegraded":"2024-03-09T15:07:04.660675+0000","last_fullsized":"2024-03-09T15:07:04.660675+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:29:17.068940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144882,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1208,"num_read_kb":2774,"num_write":982,"num_write_kb":820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.946142+0000","last_change":"2024-03-09T14:29:01.639091+0000","last_active":"2024-03-09T15:04:29.946142+0000","last_peered":"2024-03-09T15:04:29.946142+0000","last_clean":"2024-03-09T15:04:29.946142+0000","last_became_active":"2024-03-09T14:29:01.638590+0000","last_became_peered":"2024-03-09T14:29:01.638590+0000","last_unstale":"2024-03-09T15:04:29.946142+0000","last_undegraded":"2024-03-09T15:04:29.946142+0000","last_fullsized":"2024-03-09T15:04:29.946142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:05:05.637460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'122","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:16.433331+0000","last_change":"2024-03-09T14:29:03.671961+0000","last_active":"2024-03-09T15:05:16.433331+0000","last_peered":"2024-03-09T15:05:16.433331+0000","last_clean":"2024-03-09T15:05:16.433331+0000","last_became_active":"2024-03-09T14:29:03.671138+0000","last_became_peered":"2024-03-09T14:29:03.671138+0000","last_unstale":"2024-03-09T15:05:16.433331+0000","last_undegraded":"2024-03-09T15:05:16.433331+0000","last_fullsized":"2024-03-09T15:05:16.433331+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:11.482213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":309,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'132","reported_seq":679,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:06.018193+0000","last_change":"2024-03-09T14:29:03.682511+0000","last_active":"2024-03-09T15:06:06.018193+0000","last_peered":"2024-03-09T15:06:06.018193+0000","last_clean":"2024-03-09T15:06:06.018193+0000","last_became_active":"2024-03-09T14:29:03.681920+0000","last_became_peered":"2024-03-09T14:29:03.681920+0000","last_unstale":"2024-03-09T15:06:06.018193+0000","last_undegraded":"2024-03-09T15:06:06.018193+0000","last_fullsized":"2024-03-09T15:06:06.018193+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:28:46.108899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":222,"num_write":331,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'713","reported_seq":2210,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.478578+0000","last_change":"2024-03-09T14:28:55.590020+0000","last_active":"2024-03-09T15:06:53.478578+0000","last_peered":"2024-03-09T15:06:53.478578+0000","last_clean":"2024-03-09T15:06:53.478578+0000","last_became_active":"2024-03-09T14:28:55.589278+0000","last_became_peered":"2024-03-09T14:28:55.589278+0000","last_unstale":"2024-03-09T15:06:53.478578+0000","last_undegraded":"2024-03-09T15:06:53.478578+0000","last_fullsized":"2024-03-09T15:06:53.478578+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":700,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:16:27.469317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3302,"num_read_kb":2973,"num_write":944,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'301","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.709386+0000","last_change":"2024-03-09T14:28:53.624761+0000","last_active":"2024-03-09T15:07:04.709386+0000","last_peered":"2024-03-09T15:07:04.709386+0000","last_clean":"2024-03-09T15:07:04.709386+0000","last_became_active":"2024-03-09T14:28:53.624231+0000","last_became_peered":"2024-03-09T14:28:53.624231+0000","last_unstale":"2024-03-09T15:07:04.709386+0000","last_undegraded":"2024-03-09T15:07:04.709386+0000","last_fullsized":"2024-03-09T15:07:04.709386+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:01:48.466150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10692168,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":521,"num_read_kb":58598,"num_write":1147,"num_write_kb":63743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:00.057746+0000","last_change":"2024-03-09T14:28:57.616817+0000","last_active":"2024-03-09T15:04:00.057746+0000","last_peered":"2024-03-09T15:04:00.057746+0000","last_clean":"2024-03-09T15:04:00.057746+0000","last_became_active":"2024-03-09T14:28:57.616045+0000","last_became_peered":"2024-03-09T14:28:57.616045+0000","last_unstale":"2024-03-09T15:04:00.057746+0000","last_undegraded":"2024-03-09T15:04:00.057746+0000","last_fullsized":"2024-03-09T15:04:00.057746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:40:21.513986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'246","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:21.881983+0000","last_change":"2024-03-09T14:28:59.615640+0000","last_active":"2024-03-09T15:06:21.881983+0000","last_peered":"2024-03-09T15:06:21.881983+0000","last_clean":"2024-03-09T15:06:21.881983+0000","last_became_active":"2024-03-09T14:28:59.615265+0000","last_became_peered":"2024-03-09T14:28:59.615265+0000","last_unstale":"2024-03-09T15:06:21.881983+0000","last_undegraded":"2024-03-09T15:06:21.881983+0000","last_fullsized":"2024-03-09T15:06:21.881983+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:29:10.543045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48592,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":385,"num_read_kb":780,"num_write":312,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.938921+0000","last_change":"2024-03-09T14:29:01.630945+0000","last_active":"2024-03-09T15:04:04.938921+0000","last_peered":"2024-03-09T15:04:04.938921+0000","last_clean":"2024-03-09T15:04:04.938921+0000","last_became_active":"2024-03-09T14:29:01.630021+0000","last_became_peered":"2024-03-09T14:29:01.630021+0000","last_unstale":"2024-03-09T15:04:04.938921+0000","last_undegraded":"2024-03-09T15:04:04.938921+0000","last_fullsized":"2024-03-09T15:04:04.938921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:51.210479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'124","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.163225+0000","last_change":"2024-03-09T14:29:03.661082+0000","last_active":"2024-03-09T15:06:36.163225+0000","last_peered":"2024-03-09T15:06:36.163225+0000","last_clean":"2024-03-09T15:06:36.163225+0000","last_became_active":"2024-03-09T14:29:03.660356+0000","last_became_peered":"2024-03-09T14:29:03.660356+0000","last_unstale":"2024-03-09T15:06:36.163225+0000","last_undegraded":"2024-03-09T15:06:36.163225+0000","last_fullsized":"2024-03-09T15:06:36.163225+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:48:43.599086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'835","reported_seq":2443,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.381007+0000","last_change":"2024-03-09T14:28:55.592219+0000","last_active":"2024-03-09T15:06:38.381007+0000","last_peered":"2024-03-09T15:06:38.381007+0000","last_clean":"2024-03-09T15:06:38.381007+0000","last_became_active":"2024-03-09T14:28:55.591498+0000","last_became_peered":"2024-03-09T14:28:55.591498+0000","last_unstale":"2024-03-09T15:06:38.381007+0000","last_undegraded":"2024-03-09T15:06:38.381007+0000","last_fullsized":"2024-03-09T15:06:38.381007+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:10:05.911916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3847,"num_read_kb":3445,"num_write":1140,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'300","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.666868+0000","last_change":"2024-03-09T14:29:28.731900+0000","last_active":"2024-03-09T15:07:04.666868+0000","last_peered":"2024-03-09T15:07:04.666868+0000","last_clean":"2024-03-09T15:07:04.666868+0000","last_became_active":"2024-03-09T14:29:28.729906+0000","last_became_peered":"2024-03-09T14:29:28.729906+0000","last_unstale":"2024-03-09T15:07:04.666868+0000","last_undegraded":"2024-03-09T15:07:04.666868+0000","last_fullsized":"2024-03-09T15:07:04.666868+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:32:05.771889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":649620,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":465,"num_read_kb":3449,"num_write":1246,"num_write_kb":20441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,4],"acting":[2,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.937932+0000","last_change":"2024-03-09T14:28:57.609587+0000","last_active":"2024-03-09T15:03:59.937932+0000","last_peered":"2024-03-09T15:03:59.937932+0000","last_clean":"2024-03-09T15:03:59.937932+0000","last_became_active":"2024-03-09T14:28:57.608697+0000","last_became_peered":"2024-03-09T14:28:57.608697+0000","last_unstale":"2024-03-09T15:03:59.937932+0000","last_undegraded":"2024-03-09T15:03:59.937932+0000","last_fullsized":"2024-03-09T15:03:59.937932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:57.108279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'48","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:19.740738+0000","last_change":"2024-03-09T14:28:59.621455+0000","last_active":"2024-03-09T15:06:19.740738+0000","last_peered":"2024-03-09T15:06:19.740738+0000","last_clean":"2024-03-09T15:06:19.740738+0000","last_became_active":"2024-03-09T14:28:59.620907+0000","last_became_peered":"2024-03-09T14:28:59.620907+0000","last_unstale":"2024-03-09T15:06:19.740738+0000","last_undegraded":"2024-03-09T15:06:19.740738+0000","last_fullsized":"2024-03-09T15:06:19.740738+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:04:27.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.704294+0000","last_change":"2024-03-09T14:29:01.651271+0000","last_active":"2024-03-09T15:04:04.704294+0000","last_peered":"2024-03-09T15:04:04.704294+0000","last_clean":"2024-03-09T15:04:04.704294+0000","last_became_active":"2024-03-09T14:29:01.650734+0000","last_became_peered":"2024-03-09T14:29:01.650734+0000","last_unstale":"2024-03-09T15:04:04.704294+0000","last_undegraded":"2024-03-09T15:04:04.704294+0000","last_fullsized":"2024-03-09T15:04:04.704294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:42:30.232634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'222","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:06.013623+0000","last_change":"2024-03-09T14:29:03.687235+0000","last_active":"2024-03-09T15:06:06.013623+0000","last_peered":"2024-03-09T15:06:06.013623+0000","last_clean":"2024-03-09T15:06:06.013623+0000","last_became_active":"2024-03-09T14:29:03.686455+0000","last_became_peered":"2024-03-09T14:29:03.686455+0000","last_unstale":"2024-03-09T15:06:06.013623+0000","last_undegraded":"2024-03-09T15:06:06.013623+0000","last_fullsized":"2024-03-09T15:06:06.013623+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:01:35.182146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":435,"num_write":508,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'405","reported_seq":1934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:21.863481+0000","last_change":"2024-03-09T14:28:55.591974+0000","last_active":"2024-03-09T15:06:21.863481+0000","last_peered":"2024-03-09T15:06:21.863481+0000","last_clean":"2024-03-09T15:06:21.863481+0000","last_became_active":"2024-03-09T14:28:55.591649+0000","last_became_peered":"2024-03-09T14:28:55.591649+0000","last_unstale":"2024-03-09T15:06:21.863481+0000","last_undegraded":"2024-03-09T15:06:21.863481+0000","last_fullsized":"2024-03-09T15:06:21.863481+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:01:16.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2197,"num_read_kb":2083,"num_write":469,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'226","reported_seq":834,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.388891+0000","last_change":"2024-03-09T14:28:53.600254+0000","last_active":"2024-03-09T15:06:53.388891+0000","last_peered":"2024-03-09T15:06:53.388891+0000","last_clean":"2024-03-09T15:06:53.388891+0000","last_became_active":"2024-03-09T14:28:53.598990+0000","last_became_peered":"2024-03-09T14:28:53.598990+0000","last_unstale":"2024-03-09T15:06:53.388891+0000","last_undegraded":"2024-03-09T15:06:53.388891+0000","last_fullsized":"2024-03-09T15:06:53.388891+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:19:25.865137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24132843,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":305,"num_read_kb":35560,"num_write":958,"num_write_kb":44906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.702952+0000","last_change":"2024-03-09T14:28:57.615933+0000","last_active":"2024-03-09T15:03:59.702952+0000","last_peered":"2024-03-09T15:03:59.702952+0000","last_clean":"2024-03-09T15:03:59.702952+0000","last_became_active":"2024-03-09T14:28:57.615229+0000","last_became_peered":"2024-03-09T14:28:57.615229+0000","last_unstale":"2024-03-09T15:03:59.702952+0000","last_undegraded":"2024-03-09T15:03:59.702952+0000","last_fullsized":"2024-03-09T15:03:59.702952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:53:06.887398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'265","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.015028+0000","last_change":"2024-03-09T14:28:59.617614+0000","last_active":"2024-03-09T15:06:27.015028+0000","last_peered":"2024-03-09T15:06:27.015028+0000","last_clean":"2024-03-09T15:06:27.015028+0000","last_became_active":"2024-03-09T14:28:59.615881+0000","last_became_peered":"2024-03-09T14:28:59.615881+0000","last_unstale":"2024-03-09T15:06:27.015028+0000","last_undegraded":"2024-03-09T15:06:27.015028+0000","last_fullsized":"2024-03-09T15:06:27.015028+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:14.844823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53562,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":879,"num_write":350,"num_write_kb":265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.699216+0000","last_change":"2024-03-09T14:29:01.657350+0000","last_active":"2024-03-09T15:04:04.699216+0000","last_peered":"2024-03-09T15:04:04.699216+0000","last_clean":"2024-03-09T15:04:04.699216+0000","last_became_active":"2024-03-09T14:29:01.656740+0000","last_became_peered":"2024-03-09T14:29:01.656740+0000","last_unstale":"2024-03-09T15:04:04.699216+0000","last_undegraded":"2024-03-09T15:04:04.699216+0000","last_fullsized":"2024-03-09T15:04:04.699216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:51.984064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'189","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:40.560043+0000","last_change":"2024-03-09T14:29:03.674368+0000","last_active":"2024-03-09T15:06:40.560043+0000","last_peered":"2024-03-09T15:06:40.560043+0000","last_clean":"2024-03-09T15:06:40.560043+0000","last_became_active":"2024-03-09T14:29:03.671571+0000","last_became_peered":"2024-03-09T14:29:03.671571+0000","last_unstale":"2024-03-09T15:06:40.560043+0000","last_undegraded":"2024-03-09T15:06:40.560043+0000","last_fullsized":"2024-03-09T15:06:40.560043+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:55:55.769903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":257,"num_read_kb":221,"num_write":372,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'1158","reported_seq":2774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.374429+0000","last_change":"2024-03-09T14:28:55.596769+0000","last_active":"2024-03-09T15:06:38.374429+0000","last_peered":"2024-03-09T15:06:38.374429+0000","last_clean":"2024-03-09T15:06:38.374429+0000","last_became_active":"2024-03-09T14:28:55.592387+0000","last_became_peered":"2024-03-09T14:28:55.592387+0000","last_unstale":"2024-03-09T15:06:38.374429+0000","last_undegraded":"2024-03-09T15:06:38.374429+0000","last_fullsized":"2024-03-09T15:06:38.374429+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":1100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:32:02.543520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4979,"num_read_kb":4357,"num_write":1600,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'303","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.740153+0000","last_change":"2024-03-09T14:28:53.627197+0000","last_active":"2024-03-09T15:07:04.740153+0000","last_peered":"2024-03-09T15:07:04.740153+0000","last_clean":"2024-03-09T15:07:04.740153+0000","last_became_active":"2024-03-09T14:28:53.626736+0000","last_became_peered":"2024-03-09T14:28:53.626736+0000","last_unstale":"2024-03-09T15:07:04.740153+0000","last_undegraded":"2024-03-09T15:07:04.740153+0000","last_fullsized":"2024-03-09T15:07:04.740153+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:05:23.421912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1696239,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":471,"num_read_kb":7830,"num_write":1201,"num_write_kb":47405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.698154+0000","last_change":"2024-03-09T14:28:57.614929+0000","last_active":"2024-03-09T15:03:59.698154+0000","last_peered":"2024-03-09T15:03:59.698154+0000","last_clean":"2024-03-09T15:03:59.698154+0000","last_became_active":"2024-03-09T14:28:57.613999+0000","last_became_peered":"2024-03-09T14:28:57.613999+0000","last_unstale":"2024-03-09T15:03:59.698154+0000","last_undegraded":"2024-03-09T15:03:59.698154+0000","last_fullsized":"2024-03-09T15:03:59.698154+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:36:44.418823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'255","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.517558+0000","last_change":"2024-03-09T14:28:59.615487+0000","last_active":"2024-03-09T15:07:04.517558+0000","last_peered":"2024-03-09T15:07:04.517558+0000","last_clean":"2024-03-09T15:07:04.517558+0000","last_became_active":"2024-03-09T14:28:59.614754+0000","last_became_peered":"2024-03-09T14:28:59.614754+0000","last_unstale":"2024-03-09T15:07:04.517558+0000","last_undegraded":"2024-03-09T15:07:04.517558+0000","last_fullsized":"2024-03-09T15:07:04.517558+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:55:46.151434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43227,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":1017,"num_write":350,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.708050+0000","last_change":"2024-03-09T14:29:01.648210+0000","last_active":"2024-03-09T15:04:04.708050+0000","last_peered":"2024-03-09T15:04:04.708050+0000","last_clean":"2024-03-09T15:04:04.708050+0000","last_became_active":"2024-03-09T14:29:01.647570+0000","last_became_peered":"2024-03-09T14:29:01.647570+0000","last_unstale":"2024-03-09T15:04:04.708050+0000","last_undegraded":"2024-03-09T15:04:04.708050+0000","last_fullsized":"2024-03-09T15:04:04.708050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:32:26.862326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'814","reported_seq":2349,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:30.930229+0000","last_change":"2024-03-09T14:28:55.600454+0000","last_active":"2024-03-09T15:06:30.930229+0000","last_peered":"2024-03-09T15:06:30.930229+0000","last_clean":"2024-03-09T15:06:30.930229+0000","last_became_active":"2024-03-09T14:28:55.599825+0000","last_became_peered":"2024-03-09T14:28:55.599825+0000","last_unstale":"2024-03-09T15:06:30.930229+0000","last_undegraded":"2024-03-09T15:06:30.930229+0000","last_fullsized":"2024-03-09T15:06:30.930229+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:16:30.042238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3687,"num_read_kb":3276,"num_write":1113,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'226","reported_seq":836,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:11.919381+0000","last_change":"2024-03-09T14:28:53.565880+0000","last_active":"2024-03-09T15:04:11.919381+0000","last_peered":"2024-03-09T15:04:11.919381+0000","last_clean":"2024-03-09T15:04:11.919381+0000","last_became_active":"2024-03-09T14:28:53.565431+0000","last_became_peered":"2024-03-09T14:28:53.565431+0000","last_unstale":"2024-03-09T15:04:11.919381+0000","last_undegraded":"2024-03-09T15:04:11.919381+0000","last_fullsized":"2024-03-09T15:04:11.919381+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:17:59.099392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1683299,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":317,"num_read_kb":7266,"num_write":908,"num_write_kb":31379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:04.723350+0000","last_change":"2024-03-09T14:28:57.611182+0000","last_active":"2024-03-09T15:05:04.723350+0000","last_peered":"2024-03-09T15:05:04.723350+0000","last_clean":"2024-03-09T15:05:04.723350+0000","last_became_active":"2024-03-09T14:28:57.610126+0000","last_became_peered":"2024-03-09T14:28:57.610126+0000","last_unstale":"2024-03-09T15:05:04.723350+0000","last_undegraded":"2024-03-09T15:05:04.723350+0000","last_fullsized":"2024-03-09T15:05:04.723350+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:16:33.837545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'464","reported_seq":1080,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.435899+0000","last_change":"2024-03-09T14:28:59.614860+0000","last_active":"2024-03-09T15:06:55.435899+0000","last_peered":"2024-03-09T15:06:55.435899+0000","last_clean":"2024-03-09T15:06:55.435899+0000","last_became_active":"2024-03-09T14:28:59.614069+0000","last_became_peered":"2024-03-09T14:28:59.614069+0000","last_unstale":"2024-03-09T15:06:55.435899+0000","last_undegraded":"2024-03-09T15:06:55.435899+0000","last_fullsized":"2024-03-09T15:06:55.435899+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:31:13.778160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111243,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":843,"num_read_kb":1832,"num_write":738,"num_write_kb":668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.885313+0000","last_change":"2024-03-09T14:29:01.640843+0000","last_active":"2024-03-09T15:04:04.885313+0000","last_peered":"2024-03-09T15:04:04.885313+0000","last_clean":"2024-03-09T15:04:04.885313+0000","last_became_active":"2024-03-09T14:29:01.639825+0000","last_became_peered":"2024-03-09T14:29:01.639825+0000","last_unstale":"2024-03-09T15:04:04.885313+0000","last_undegraded":"2024-03-09T15:04:04.885313+0000","last_fullsized":"2024-03-09T15:04:04.885313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:39:04.267480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'149","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.868628+0000","last_change":"2024-03-09T14:29:03.667287+0000","last_active":"2024-03-09T15:06:36.868628+0000","last_peered":"2024-03-09T15:06:36.868628+0000","last_clean":"2024-03-09T15:06:36.868628+0000","last_became_active":"2024-03-09T14:29:03.666515+0000","last_became_peered":"2024-03-09T14:29:03.666515+0000","last_unstale":"2024-03-09T15:06:36.868628+0000","last_undegraded":"2024-03-09T15:06:36.868628+0000","last_fullsized":"2024-03-09T15:06:36.868628+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:42.886520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":181,"num_write":332,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'874","reported_seq":2620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.307400+0000","last_change":"2024-03-09T14:28:55.586646+0000","last_active":"2024-03-09T15:06:41.307400+0000","last_peered":"2024-03-09T15:06:41.307400+0000","last_clean":"2024-03-09T15:06:41.307400+0000","last_became_active":"2024-03-09T14:28:55.586247+0000","last_became_peered":"2024-03-09T14:28:55.586247+0000","last_unstale":"2024-03-09T15:06:41.307400+0000","last_undegraded":"2024-03-09T15:06:41.307400+0000","last_fullsized":"2024-03-09T15:06:41.307400+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:51.468365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4288,"num_read_kb":3851,"num_write":1208,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'241","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:52.489453+0000","last_change":"2024-03-09T14:28:53.618203+0000","last_active":"2024-03-09T15:06:52.489453+0000","last_peered":"2024-03-09T15:06:52.489453+0000","last_clean":"2024-03-09T15:06:52.489453+0000","last_became_active":"2024-03-09T14:28:53.617832+0000","last_became_peered":"2024-03-09T14:28:53.617832+0000","last_unstale":"2024-03-09T15:06:52.489453+0000","last_undegraded":"2024-03-09T15:06:52.489453+0000","last_fullsized":"2024-03-09T15:06:52.489453+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:04:16.779631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12779212,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":370,"num_read_kb":36519,"num_write":1035,"num_write_kb":22031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.703460+0000","last_change":"2024-03-09T14:28:57.616765+0000","last_active":"2024-03-09T15:04:24.703460+0000","last_peered":"2024-03-09T15:04:24.703460+0000","last_clean":"2024-03-09T15:04:24.703460+0000","last_became_active":"2024-03-09T14:28:57.616057+0000","last_became_peered":"2024-03-09T14:28:57.616057+0000","last_unstale":"2024-03-09T15:04:24.703460+0000","last_undegraded":"2024-03-09T15:04:24.703460+0000","last_fullsized":"2024-03-09T15:04:24.703460+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:41:28.651737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'267","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.590358+0000","last_change":"2024-03-09T14:28:59.616152+0000","last_active":"2024-03-09T15:07:04.590358+0000","last_peered":"2024-03-09T15:07:04.590358+0000","last_clean":"2024-03-09T15:07:04.590358+0000","last_became_active":"2024-03-09T14:28:59.615193+0000","last_became_peered":"2024-03-09T14:28:59.615193+0000","last_unstale":"2024-03-09T15:07:04.590358+0000","last_undegraded":"2024-03-09T15:07:04.590358+0000","last_fullsized":"2024-03-09T15:07:04.590358+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:59:33.826109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43919,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":455,"num_read_kb":986,"num_write":382,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:05.058877+0000","last_change":"2024-03-09T14:29:01.661393+0000","last_active":"2024-03-09T15:04:05.058877+0000","last_peered":"2024-03-09T15:04:05.058877+0000","last_clean":"2024-03-09T15:04:05.058877+0000","last_became_active":"2024-03-09T14:29:01.660997+0000","last_became_peered":"2024-03-09T14:29:01.660997+0000","last_unstale":"2024-03-09T15:04:05.058877+0000","last_undegraded":"2024-03-09T15:04:05.058877+0000","last_fullsized":"2024-03-09T15:04:05.058877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:23.078367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'181","reported_seq":1376,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.944898+0000","last_change":"2024-03-09T14:29:03.669572+0000","last_active":"2024-03-09T15:06:53.944898+0000","last_peered":"2024-03-09T15:06:53.944898+0000","last_clean":"2024-03-09T15:06:53.944898+0000","last_became_active":"2024-03-09T14:29:03.668833+0000","last_became_peered":"2024-03-09T14:29:03.668833+0000","last_unstale":"2024-03-09T15:06:53.944898+0000","last_undegraded":"2024-03-09T15:06:53.944898+0000","last_fullsized":"2024-03-09T15:06:53.944898+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:52.062869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2487,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":947,"num_read_kb":932,"num_write":509,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'486","reported_seq":2228,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.516678+0000","last_change":"2024-03-09T14:28:55.597840+0000","last_active":"2024-03-09T15:06:32.516678+0000","last_peered":"2024-03-09T15:06:32.516678+0000","last_clean":"2024-03-09T15:06:32.516678+0000","last_became_active":"2024-03-09T14:28:55.596538+0000","last_became_peered":"2024-03-09T14:28:55.596538+0000","last_unstale":"2024-03-09T15:06:32.516678+0000","last_undegraded":"2024-03-09T15:06:32.516678+0000","last_fullsized":"2024-03-09T15:06:32.516678+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:07:17.844183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2772,"num_read_kb":2616,"num_write":579,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'269","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.687653+0000","last_change":"2024-03-09T14:28:53.597236+0000","last_active":"2024-03-09T15:07:04.687653+0000","last_peered":"2024-03-09T15:07:04.687653+0000","last_clean":"2024-03-09T15:07:04.687653+0000","last_became_active":"2024-03-09T14:28:53.589932+0000","last_became_peered":"2024-03-09T14:28:53.589932+0000","last_unstale":"2024-03-09T15:07:04.687653+0000","last_undegraded":"2024-03-09T15:07:04.687653+0000","last_fullsized":"2024-03-09T15:07:04.687653+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:18:23.444910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16919366,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":405,"num_read_kb":14456,"num_write":968,"num_write_kb":42013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.699471+0000","last_change":"2024-03-09T14:28:57.610733+0000","last_active":"2024-03-09T15:03:59.699471+0000","last_peered":"2024-03-09T15:03:59.699471+0000","last_clean":"2024-03-09T15:03:59.699471+0000","last_became_active":"2024-03-09T14:28:57.609903+0000","last_became_peered":"2024-03-09T14:28:57.609903+0000","last_unstale":"2024-03-09T15:03:59.699471+0000","last_undegraded":"2024-03-09T15:03:59.699471+0000","last_fullsized":"2024-03-09T15:03:59.699471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:06:42.154492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'254","reported_seq":813,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.975245+0000","last_change":"2024-03-09T14:28:59.631074+0000","last_active":"2024-03-09T15:06:29.975245+0000","last_peered":"2024-03-09T15:06:29.975245+0000","last_clean":"2024-03-09T15:06:29.975245+0000","last_became_active":"2024-03-09T14:28:59.630460+0000","last_became_peered":"2024-03-09T14:28:59.630460+0000","last_unstale":"2024-03-09T15:06:29.975245+0000","last_undegraded":"2024-03-09T15:06:29.975245+0000","last_fullsized":"2024-03-09T15:06:29.975245+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:09.212045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53832,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":901,"num_write":354,"num_write_kb":290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:05.045241+0000","last_change":"2024-03-09T14:29:01.636817+0000","last_active":"2024-03-09T15:03:05.045241+0000","last_peered":"2024-03-09T15:03:05.045241+0000","last_clean":"2024-03-09T15:03:05.045241+0000","last_became_active":"2024-03-09T14:29:01.636083+0000","last_became_peered":"2024-03-09T14:29:01.636083+0000","last_unstale":"2024-03-09T15:03:05.045241+0000","last_undegraded":"2024-03-09T15:03:05.045241+0000","last_fullsized":"2024-03-09T15:03:05.045241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:03.128255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'121","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.502593+0000","last_change":"2024-03-09T14:29:03.678242+0000","last_active":"2024-03-09T15:06:55.502593+0000","last_peered":"2024-03-09T15:06:55.502593+0000","last_clean":"2024-03-09T15:06:55.502593+0000","last_became_active":"2024-03-09T14:29:03.677376+0000","last_became_peered":"2024-03-09T14:29:03.677376+0000","last_unstale":"2024-03-09T15:06:55.502593+0000","last_undegraded":"2024-03-09T15:06:55.502593+0000","last_fullsized":"2024-03-09T15:06:55.502593+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:47.054570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":93,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'1138","reported_seq":2990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:01.820596+0000","last_change":"2024-03-09T14:28:55.588136+0000","last_active":"2024-03-09T15:06:01.820596+0000","last_peered":"2024-03-09T15:06:01.820596+0000","last_clean":"2024-03-09T15:06:01.820596+0000","last_became_active":"2024-03-09T14:28:55.587547+0000","last_became_peered":"2024-03-09T14:28:55.587547+0000","last_unstale":"2024-03-09T15:06:01.820596+0000","last_undegraded":"2024-03-09T15:06:01.820596+0000","last_fullsized":"2024-03-09T15:06:01.820596+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:58:51.176419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5366,"num_read_kb":4772,"num_write":1564,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'273","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.705301+0000","last_change":"2024-03-09T14:28:53.589911+0000","last_active":"2024-03-09T15:07:04.705301+0000","last_peered":"2024-03-09T15:07:04.705301+0000","last_clean":"2024-03-09T15:07:04.705301+0000","last_became_active":"2024-03-09T14:28:53.589407+0000","last_became_peered":"2024-03-09T14:28:53.589407+0000","last_unstale":"2024-03-09T15:07:04.705301+0000","last_undegraded":"2024-03-09T15:07:04.705301+0000","last_fullsized":"2024-03-09T15:07:04.705301+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:02.804743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097363,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":436,"num_read_kb":59464,"num_write":1026,"num_write_kb":28198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:00.057828+0000","last_change":"2024-03-09T14:28:57.620777+0000","last_active":"2024-03-09T15:04:00.057828+0000","last_peered":"2024-03-09T15:04:00.057828+0000","last_clean":"2024-03-09T15:04:00.057828+0000","last_became_active":"2024-03-09T14:28:57.620140+0000","last_became_peered":"2024-03-09T14:28:57.620140+0000","last_unstale":"2024-03-09T15:04:00.057828+0000","last_undegraded":"2024-03-09T15:04:00.057828+0000","last_fullsized":"2024-03-09T15:04:00.057828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:26:24.646259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'72","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:21.156819+0000","last_change":"2024-03-09T14:28:59.630490+0000","last_active":"2024-03-09T15:05:21.156819+0000","last_peered":"2024-03-09T15:05:21.156819+0000","last_clean":"2024-03-09T15:05:21.156819+0000","last_became_active":"2024-03-09T14:28:59.629734+0000","last_became_peered":"2024-03-09T14:28:59.629734+0000","last_unstale":"2024-03-09T15:05:21.156819+0000","last_undegraded":"2024-03-09T15:05:21.156819+0000","last_fullsized":"2024-03-09T15:05:21.156819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:44:21.794038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":70,"num_read_kb":63,"num_write":56,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'539","reported_seq":2053,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.470889+0000","last_change":"2024-03-09T14:29:01.651371+0000","last_active":"2024-03-09T15:07:02.470889+0000","last_peered":"2024-03-09T15:07:02.470889+0000","last_clean":"2024-03-09T15:07:02.470889+0000","last_became_active":"2024-03-09T14:29:01.650590+0000","last_became_peered":"2024-03-09T14:29:01.650590+0000","last_unstale":"2024-03-09T15:07:02.470889+0000","last_undegraded":"2024-03-09T15:07:02.470889+0000","last_fullsized":"2024-03-09T15:07:02.470889+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:16:18.239400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'124","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.980854+0000","last_change":"2024-03-09T14:29:03.677895+0000","last_active":"2024-03-09T15:06:24.980854+0000","last_peered":"2024-03-09T15:06:24.980854+0000","last_clean":"2024-03-09T15:06:24.980854+0000","last_became_active":"2024-03-09T14:29:03.677064+0000","last_became_peered":"2024-03-09T14:29:03.677064+0000","last_unstale":"2024-03-09T15:06:24.980854+0000","last_undegraded":"2024-03-09T15:06:24.980854+0000","last_fullsized":"2024-03-09T15:06:24.980854+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:21:06.747179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":150,"num_write":318,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'509","reported_seq":1975,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.288260+0000","last_change":"2024-03-09T14:28:55.610871+0000","last_active":"2024-03-09T15:06:41.288260+0000","last_peered":"2024-03-09T15:06:41.288260+0000","last_clean":"2024-03-09T15:06:41.288260+0000","last_became_active":"2024-03-09T14:28:55.610134+0000","last_became_peered":"2024-03-09T14:28:55.610134+0000","last_unstale":"2024-03-09T15:06:41.288260+0000","last_undegraded":"2024-03-09T15:06:41.288260+0000","last_fullsized":"2024-03-09T15:06:41.288260+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:52:17.579543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2571,"num_read_kb":2332,"num_write":699,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'363","reported_seq":1081,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:00.049155+0000","last_change":"2024-03-09T14:28:53.637554+0000","last_active":"2024-03-09T15:06:00.049155+0000","last_peered":"2024-03-09T15:06:00.049155+0000","last_clean":"2024-03-09T15:06:00.049155+0000","last_became_active":"2024-03-09T14:28:53.636761+0000","last_became_peered":"2024-03-09T14:28:53.636761+0000","last_unstale":"2024-03-09T15:06:00.049155+0000","last_undegraded":"2024-03-09T15:06:00.049155+0000","last_fullsized":"2024-03-09T15:06:00.049155+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:52:47.651977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":766847,"num_objects":73,"num_object_clones":0,"num_object_copies":292,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":721,"num_read_kb":7041,"num_write":1448,"num_write_kb":16792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.703042+0000","last_change":"2024-03-09T14:28:57.613685+0000","last_active":"2024-03-09T15:03:59.703042+0000","last_peered":"2024-03-09T15:03:59.703042+0000","last_clean":"2024-03-09T15:03:59.703042+0000","last_became_active":"2024-03-09T14:28:57.612982+0000","last_became_peered":"2024-03-09T14:28:57.612982+0000","last_unstale":"2024-03-09T15:03:59.703042+0000","last_undegraded":"2024-03-09T15:03:59.703042+0000","last_fullsized":"2024-03-09T15:03:59.703042+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:06:42.400023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'283","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:08.395501+0000","last_change":"2024-03-09T14:28:59.601758+0000","last_active":"2024-03-09T15:06:08.395501+0000","last_peered":"2024-03-09T15:06:08.395501+0000","last_clean":"2024-03-09T15:06:08.395501+0000","last_became_active":"2024-03-09T14:28:59.601007+0000","last_became_peered":"2024-03-09T14:28:59.601007+0000","last_unstale":"2024-03-09T15:06:08.395501+0000","last_undegraded":"2024-03-09T15:06:08.395501+0000","last_fullsized":"2024-03-09T15:06:08.395501+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:57.069347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70198,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":970,"num_write":380,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.691415+0000","last_change":"2024-03-09T14:29:01.657738+0000","last_active":"2024-03-09T15:02:54.691415+0000","last_peered":"2024-03-09T15:02:54.691415+0000","last_clean":"2024-03-09T15:02:54.691415+0000","last_became_active":"2024-03-09T14:29:01.657169+0000","last_became_peered":"2024-03-09T14:29:01.657169+0000","last_unstale":"2024-03-09T15:02:54.691415+0000","last_undegraded":"2024-03-09T15:02:54.691415+0000","last_fullsized":"2024-03-09T15:02:54.691415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:34:38.555150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'122","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:51.348829+0000","last_change":"2024-03-09T14:29:03.670802+0000","last_active":"2024-03-09T15:06:51.348829+0000","last_peered":"2024-03-09T15:06:51.348829+0000","last_clean":"2024-03-09T15:06:51.348829+0000","last_became_active":"2024-03-09T14:29:03.669978+0000","last_became_peered":"2024-03-09T14:29:03.669978+0000","last_unstale":"2024-03-09T15:06:51.348829+0000","last_undegraded":"2024-03-09T15:06:51.348829+0000","last_fullsized":"2024-03-09T15:06:51.348829+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:24:30.237273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":289,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'771","reported_seq":2297,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.376951+0000","last_change":"2024-03-09T14:28:55.570920+0000","last_active":"2024-03-09T15:06:38.376951+0000","last_peered":"2024-03-09T15:06:38.376951+0000","last_clean":"2024-03-09T15:06:38.376951+0000","last_became_active":"2024-03-09T14:28:55.570161+0000","last_became_peered":"2024-03-09T14:28:55.570161+0000","last_unstale":"2024-03-09T15:06:38.376951+0000","last_undegraded":"2024-03-09T15:06:38.376951+0000","last_fullsized":"2024-03-09T15:06:38.376951+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:42:17.825813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3636,"num_read_kb":3267,"num_write":1033,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'336","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.676325+0000","last_change":"2024-03-09T14:29:28.825741+0000","last_active":"2024-03-09T15:07:04.676325+0000","last_peered":"2024-03-09T15:07:04.676325+0000","last_clean":"2024-03-09T15:07:04.676325+0000","last_became_active":"2024-03-09T14:29:28.824399+0000","last_became_peered":"2024-03-09T14:29:28.824399+0000","last_unstale":"2024-03-09T15:07:04.676325+0000","last_undegraded":"2024-03-09T15:07:04.676325+0000","last_fullsized":"2024-03-09T15:07:04.676325+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:08:57.826548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5527889,"num_objects":19,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":585,"num_read_kb":66383,"num_write":1388,"num_write_kb":58469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.884189+0000","last_change":"2024-03-09T14:28:57.609386+0000","last_active":"2024-03-09T15:03:59.884189+0000","last_peered":"2024-03-09T15:03:59.884189+0000","last_clean":"2024-03-09T15:03:59.884189+0000","last_became_active":"2024-03-09T14:28:57.608639+0000","last_became_peered":"2024-03-09T14:28:57.608639+0000","last_unstale":"2024-03-09T15:03:59.884189+0000","last_undegraded":"2024-03-09T15:03:59.884189+0000","last_fullsized":"2024-03-09T15:03:59.884189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:26:53.678171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'267","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.883594+0000","last_change":"2024-03-09T14:28:59.624561+0000","last_active":"2024-03-09T15:07:03.883594+0000","last_peered":"2024-03-09T15:07:03.883594+0000","last_clean":"2024-03-09T15:07:03.883594+0000","last_became_active":"2024-03-09T14:28:59.623529+0000","last_became_peered":"2024-03-09T14:28:59.623529+0000","last_unstale":"2024-03-09T15:07:03.883594+0000","last_undegraded":"2024-03-09T15:07:03.883594+0000","last_fullsized":"2024-03-09T15:07:03.883594+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:17.455070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":971,"num_write":346,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:04.685658+0000","last_change":"2024-03-09T14:29:01.651867+0000","last_active":"2024-03-09T15:03:04.685658+0000","last_peered":"2024-03-09T15:03:04.685658+0000","last_clean":"2024-03-09T15:03:04.685658+0000","last_became_active":"2024-03-09T14:29:01.651183+0000","last_became_peered":"2024-03-09T14:29:01.651183+0000","last_unstale":"2024-03-09T15:03:04.685658+0000","last_undegraded":"2024-03-09T15:03:04.685658+0000","last_fullsized":"2024-03-09T15:03:04.685658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:00:28.916197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'121","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:50.981576+0000","last_change":"2024-03-09T14:29:03.662620+0000","last_active":"2024-03-09T15:04:50.981576+0000","last_peered":"2024-03-09T15:04:50.981576+0000","last_clean":"2024-03-09T15:04:50.981576+0000","last_became_active":"2024-03-09T14:29:03.661848+0000","last_became_peered":"2024-03-09T14:29:03.661848+0000","last_unstale":"2024-03-09T15:04:50.981576+0000","last_undegraded":"2024-03-09T15:04:50.981576+0000","last_fullsized":"2024-03-09T15:04:50.981576+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:22:12.693452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":975,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":172,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'742","reported_seq":2302,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:22.942126+0000","last_change":"2024-03-09T14:28:55.582020+0000","last_active":"2024-03-09T15:06:22.942126+0000","last_peered":"2024-03-09T15:06:22.942126+0000","last_clean":"2024-03-09T15:06:22.942126+0000","last_became_active":"2024-03-09T14:28:55.580902+0000","last_became_peered":"2024-03-09T14:28:55.580902+0000","last_unstale":"2024-03-09T15:06:22.942126+0000","last_undegraded":"2024-03-09T15:06:22.942126+0000","last_fullsized":"2024-03-09T15:06:22.942126+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:36:35.032329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3409,"num_read_kb":3074,"num_write":976,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'238","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.953815+0000","last_change":"2024-03-09T14:28:53.619086+0000","last_active":"2024-03-09T15:04:59.953815+0000","last_peered":"2024-03-09T15:04:59.953815+0000","last_clean":"2024-03-09T15:04:59.953815+0000","last_became_active":"2024-03-09T14:28:53.618470+0000","last_became_peered":"2024-03-09T14:28:53.618470+0000","last_unstale":"2024-03-09T15:04:59.953815+0000","last_undegraded":"2024-03-09T15:04:59.953815+0000","last_fullsized":"2024-03-09T15:04:59.953815+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:00:32.753851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16077236,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":374,"num_read_kb":49463,"num_write":1091,"num_write_kb":38192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.683621+0000","last_change":"2024-03-09T14:28:57.612579+0000","last_active":"2024-03-09T15:02:49.683621+0000","last_peered":"2024-03-09T15:02:49.683621+0000","last_clean":"2024-03-09T15:02:49.683621+0000","last_became_active":"2024-03-09T14:28:57.611745+0000","last_became_peered":"2024-03-09T14:28:57.611745+0000","last_unstale":"2024-03-09T15:02:49.683621+0000","last_undegraded":"2024-03-09T15:02:49.683621+0000","last_fullsized":"2024-03-09T15:02:49.683621+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:31:50.123606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'208","reported_seq":752,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.975098+0000","last_change":"2024-03-09T14:28:59.617486+0000","last_active":"2024-03-09T15:06:29.975098+0000","last_peered":"2024-03-09T15:06:29.975098+0000","last_clean":"2024-03-09T15:06:29.975098+0000","last_became_active":"2024-03-09T14:28:59.615400+0000","last_became_peered":"2024-03-09T14:28:59.615400+0000","last_unstale":"2024-03-09T15:06:29.975098+0000","last_undegraded":"2024-03-09T15:06:29.975098+0000","last_fullsized":"2024-03-09T15:06:29.975098+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:18:51.266792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44334,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":343,"num_read_kb":742,"num_write":280,"num_write_kb":240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.700482+0000","last_change":"2024-03-09T14:29:01.657829+0000","last_active":"2024-03-09T15:04:04.700482+0000","last_peered":"2024-03-09T15:04:04.700482+0000","last_clean":"2024-03-09T15:04:04.700482+0000","last_became_active":"2024-03-09T14:29:01.657117+0000","last_became_peered":"2024-03-09T14:29:01.657117+0000","last_unstale":"2024-03-09T15:04:04.700482+0000","last_undegraded":"2024-03-09T15:04:04.700482+0000","last_fullsized":"2024-03-09T15:04:04.700482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:43:59.466343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'133","reported_seq":1791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.893900+0000","last_change":"2024-03-09T14:29:03.660649+0000","last_active":"2024-03-09T15:06:53.893900+0000","last_peered":"2024-03-09T15:06:53.893900+0000","last_clean":"2024-03-09T15:06:53.893900+0000","last_became_active":"2024-03-09T14:29:03.659930+0000","last_became_peered":"2024-03-09T14:29:03.659930+0000","last_unstale":"2024-03-09T15:06:53.893900+0000","last_undegraded":"2024-03-09T15:06:53.893900+0000","last_fullsized":"2024-03-09T15:06:53.893900+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:47.922788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1320,"num_read_kb":1317,"num_write":320,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'484","reported_seq":2147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.154286+0000","last_change":"2024-03-09T14:28:55.599386+0000","last_active":"2024-03-09T15:06:36.154286+0000","last_peered":"2024-03-09T15:06:36.154286+0000","last_clean":"2024-03-09T15:06:36.154286+0000","last_became_active":"2024-03-09T14:28:55.598822+0000","last_became_peered":"2024-03-09T14:28:55.598822+0000","last_unstale":"2024-03-09T15:06:36.154286+0000","last_undegraded":"2024-03-09T15:06:36.154286+0000","last_fullsized":"2024-03-09T15:06:36.154286+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:22.447249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2615,"num_read_kb":2447,"num_write":578,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'271","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.644776+0000","last_change":"2024-03-09T14:28:53.595926+0000","last_active":"2024-03-09T15:07:04.644776+0000","last_peered":"2024-03-09T15:07:04.644776+0000","last_clean":"2024-03-09T15:07:04.644776+0000","last_became_active":"2024-03-09T14:28:53.595479+0000","last_became_peered":"2024-03-09T14:28:53.595479+0000","last_unstale":"2024-03-09T15:07:04.644776+0000","last_undegraded":"2024-03-09T15:07:04.644776+0000","last_fullsized":"2024-03-09T15:07:04.644776+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:37:40.541650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":882545,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":379,"num_read_kb":37241,"num_write":1043,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:50.041858+0000","last_change":"2024-03-09T14:28:57.608989+0000","last_active":"2024-03-09T15:02:50.041858+0000","last_peered":"2024-03-09T15:02:50.041858+0000","last_clean":"2024-03-09T15:02:50.041858+0000","last_became_active":"2024-03-09T14:28:57.608170+0000","last_became_peered":"2024-03-09T14:28:57.608170+0000","last_unstale":"2024-03-09T15:02:50.041858+0000","last_undegraded":"2024-03-09T15:02:50.041858+0000","last_fullsized":"2024-03-09T15:02:50.041858+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:20:42.765359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'254","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.336978+0000","last_change":"2024-03-09T14:28:59.615602+0000","last_active":"2024-03-09T15:07:03.336978+0000","last_peered":"2024-03-09T15:07:03.336978+0000","last_clean":"2024-03-09T15:07:03.336978+0000","last_became_active":"2024-03-09T14:28:59.614271+0000","last_became_peered":"2024-03-09T14:28:59.614271+0000","last_unstale":"2024-03-09T15:07:03.336978+0000","last_undegraded":"2024-03-09T15:07:03.336978+0000","last_fullsized":"2024-03-09T15:07:03.336978+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:53:14.078880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45957,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":426,"num_read_kb":925,"num_write":332,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.708033+0000","last_change":"2024-03-09T14:29:01.652400+0000","last_active":"2024-03-09T15:04:04.708033+0000","last_peered":"2024-03-09T15:04:04.708033+0000","last_clean":"2024-03-09T15:04:04.708033+0000","last_became_active":"2024-03-09T14:29:01.648467+0000","last_became_peered":"2024-03-09T14:29:01.648467+0000","last_unstale":"2024-03-09T15:04:04.708033+0000","last_undegraded":"2024-03-09T15:04:04.708033+0000","last_fullsized":"2024-03-09T15:04:04.708033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:46:40.874214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'89","reported_seq":573,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.103203+0000","last_change":"2024-03-09T14:29:03.666859+0000","last_active":"2024-03-09T15:06:27.103203+0000","last_peered":"2024-03-09T15:06:27.103203+0000","last_clean":"2024-03-09T15:06:27.103203+0000","last_became_active":"2024-03-09T14:29:03.666157+0000","last_became_peered":"2024-03-09T14:29:03.666157+0000","last_unstale":"2024-03-09T15:06:27.103203+0000","last_undegraded":"2024-03-09T15:06:27.103203+0000","last_fullsized":"2024-03-09T15:06:27.103203+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:26:26.981367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":67,"num_write":211,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'502","reported_seq":2001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.397894+0000","last_change":"2024-03-09T14:28:55.591379+0000","last_active":"2024-03-09T15:06:38.397894+0000","last_peered":"2024-03-09T15:06:38.397894+0000","last_clean":"2024-03-09T15:06:38.397894+0000","last_became_active":"2024-03-09T14:28:55.591054+0000","last_became_peered":"2024-03-09T14:28:55.591054+0000","last_unstale":"2024-03-09T15:06:38.397894+0000","last_undegraded":"2024-03-09T15:06:38.397894+0000","last_fullsized":"2024-03-09T15:06:38.397894+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:25.032606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2590,"num_read_kb":2449,"num_write":673,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'287","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.625676+0000","last_change":"2024-03-09T14:28:53.640090+0000","last_active":"2024-03-09T15:07:04.625676+0000","last_peered":"2024-03-09T15:07:04.625676+0000","last_clean":"2024-03-09T15:07:04.625676+0000","last_became_active":"2024-03-09T14:28:53.638941+0000","last_became_peered":"2024-03-09T14:28:53.638941+0000","last_unstale":"2024-03-09T15:07:04.625676+0000","last_undegraded":"2024-03-09T15:07:04.625676+0000","last_fullsized":"2024-03-09T15:07:04.625676+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:03:53.299755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5997998,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":445,"num_read_kb":10894,"num_write":1145,"num_write_kb":33356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'698","reported_seq":2158,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.621155+0000","last_change":"2024-03-09T14:28:55.582893+0000","last_active":"2024-03-09T15:06:29.621155+0000","last_peered":"2024-03-09T15:06:29.621155+0000","last_clean":"2024-03-09T15:06:29.621155+0000","last_became_active":"2024-03-09T14:28:55.578705+0000","last_became_peered":"2024-03-09T14:28:55.578705+0000","last_unstale":"2024-03-09T15:06:29.621155+0000","last_undegraded":"2024-03-09T15:06:29.621155+0000","last_fullsized":"2024-03-09T15:06:29.621155+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:54:28.358839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3212,"num_read_kb":2884,"num_write":923,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'298","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.619784+0000","last_change":"2024-03-09T14:28:53.618037+0000","last_active":"2024-03-09T15:07:04.619784+0000","last_peered":"2024-03-09T15:07:04.619784+0000","last_clean":"2024-03-09T15:07:04.619784+0000","last_became_active":"2024-03-09T14:28:53.617469+0000","last_became_peered":"2024-03-09T14:28:53.617469+0000","last_unstale":"2024-03-09T15:07:04.619784+0000","last_undegraded":"2024-03-09T15:07:04.619784+0000","last_fullsized":"2024-03-09T15:07:04.619784+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:13:32.235158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655947,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":476,"num_read_kb":96508,"num_write":1196,"num_write_kb":39289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'474","reported_seq":2150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.920469+0000","last_change":"2024-03-09T14:28:55.595276+0000","last_active":"2024-03-09T15:06:39.920469+0000","last_peered":"2024-03-09T15:06:39.920469+0000","last_clean":"2024-03-09T15:06:39.920469+0000","last_became_active":"2024-03-09T14:28:55.594171+0000","last_became_peered":"2024-03-09T14:28:55.594171+0000","last_unstale":"2024-03-09T15:06:39.920469+0000","last_undegraded":"2024-03-09T15:06:39.920469+0000","last_fullsized":"2024-03-09T15:06:39.920469+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:59.297943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2696,"num_read_kb":2529,"num_write":600,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'250","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:40.710614+0000","last_change":"2024-03-09T14:28:53.627660+0000","last_active":"2024-03-09T15:06:40.710614+0000","last_peered":"2024-03-09T15:06:40.710614+0000","last_clean":"2024-03-09T15:06:40.710614+0000","last_became_active":"2024-03-09T14:28:53.627011+0000","last_became_peered":"2024-03-09T14:28:53.627011+0000","last_unstale":"2024-03-09T15:06:40.710614+0000","last_undegraded":"2024-03-09T15:06:40.710614+0000","last_fullsized":"2024-03-09T15:06:40.710614+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:28:43.144281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1819233,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":518,"num_read_kb":86707,"num_write":1117,"num_write_kb":21935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'404","reported_seq":2036,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:28.237644+0000","last_change":"2024-03-09T14:28:55.578260+0000","last_active":"2024-03-09T15:06:28.237644+0000","last_peered":"2024-03-09T15:06:28.237644+0000","last_clean":"2024-03-09T15:06:28.237644+0000","last_became_active":"2024-03-09T14:28:55.577524+0000","last_became_peered":"2024-03-09T14:28:55.577524+0000","last_unstale":"2024-03-09T15:06:28.237644+0000","last_undegraded":"2024-03-09T15:06:28.237644+0000","last_fullsized":"2024-03-09T15:06:28.237644+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:07:13.808728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2346,"num_read_kb":2237,"num_write":463,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'352","reported_seq":1111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.723517+0000","last_change":"2024-03-09T14:28:53.579012+0000","last_active":"2024-03-09T15:07:04.723517+0000","last_peered":"2024-03-09T15:07:04.723517+0000","last_clean":"2024-03-09T15:07:04.723517+0000","last_became_active":"2024-03-09T14:28:53.578574+0000","last_became_peered":"2024-03-09T14:28:53.578574+0000","last_unstale":"2024-03-09T15:07:04.723517+0000","last_undegraded":"2024-03-09T15:07:04.723517+0000","last_fullsized":"2024-03-09T15:07:04.723517+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:29:04.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270109,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":879,"num_read_kb":59109,"num_write":1320,"num_write_kb":49113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'697","reported_seq":2179,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:20.724401+0000","last_change":"2024-03-09T14:28:55.597239+0000","last_active":"2024-03-09T15:06:20.724401+0000","last_peered":"2024-03-09T15:06:20.724401+0000","last_clean":"2024-03-09T15:06:20.724401+0000","last_became_active":"2024-03-09T14:28:55.596637+0000","last_became_peered":"2024-03-09T14:28:55.596637+0000","last_unstale":"2024-03-09T15:06:20.724401+0000","last_undegraded":"2024-03-09T15:06:20.724401+0000","last_fullsized":"2024-03-09T15:06:20.724401+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:18:02.596150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3232,"num_read_kb":2910,"num_write":917,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'208","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:49.506165+0000","last_change":"2024-03-09T14:28:53.578550+0000","last_active":"2024-03-09T15:05:49.506165+0000","last_peered":"2024-03-09T15:05:49.506165+0000","last_clean":"2024-03-09T15:05:49.506165+0000","last_became_active":"2024-03-09T14:28:53.577994+0000","last_became_peered":"2024-03-09T14:28:53.577994+0000","last_unstale":"2024-03-09T15:05:49.506165+0000","last_undegraded":"2024-03-09T15:05:49.506165+0000","last_fullsized":"2024-03-09T15:05:49.506165+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:14.265275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11606910,"num_objects":57,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":329,"num_read_kb":10769,"num_write":944,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'1034","reported_seq":2409,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.913055+0000","last_change":"2024-03-09T14:28:55.598885+0000","last_active":"2024-03-09T15:06:39.913055+0000","last_peered":"2024-03-09T15:06:39.913055+0000","last_clean":"2024-03-09T15:06:39.913055+0000","last_became_active":"2024-03-09T14:28:55.598235+0000","last_became_peered":"2024-03-09T14:28:55.598235+0000","last_unstale":"2024-03-09T15:06:39.913055+0000","last_undegraded":"2024-03-09T15:06:39.913055+0000","last_fullsized":"2024-03-09T15:06:39.913055+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1000,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:31.960386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4348,"num_read_kb":3780,"num_write":1436,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'310","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.347395+0000","last_change":"2024-03-09T14:28:53.591761+0000","last_active":"2024-03-09T15:06:42.347395+0000","last_peered":"2024-03-09T15:06:42.347395+0000","last_clean":"2024-03-09T15:06:42.347395+0000","last_became_active":"2024-03-09T14:28:53.591365+0000","last_became_peered":"2024-03-09T14:28:53.591365+0000","last_unstale":"2024-03-09T15:06:42.347395+0000","last_undegraded":"2024-03-09T15:06:42.347395+0000","last_fullsized":"2024-03-09T15:06:42.347395+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:40:51.486043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":265024,"num_objects":76,"num_object_clones":0,"num_object_copies":304,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":606,"num_read_kb":645,"num_write":1563,"num_write_kb":21789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'476","reported_seq":1840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.471455+0000","last_change":"2024-03-09T14:29:28.739085+0000","last_active":"2024-03-09T15:06:53.471455+0000","last_peered":"2024-03-09T15:06:53.471455+0000","last_clean":"2024-03-09T15:06:53.471455+0000","last_became_active":"2024-03-09T14:29:28.738427+0000","last_became_peered":"2024-03-09T14:29:28.738427+0000","last_unstale":"2024-03-09T15:06:53.471455+0000","last_undegraded":"2024-03-09T15:06:53.471455+0000","last_fullsized":"2024-03-09T15:06:53.471455+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:33:07.046397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2425,"num_read_kb":2201,"num_write":660,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'320","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.631598+0000","last_change":"2024-03-09T14:28:53.638759+0000","last_active":"2024-03-09T15:07:04.631598+0000","last_peered":"2024-03-09T15:07:04.631598+0000","last_clean":"2024-03-09T15:07:04.631598+0000","last_became_active":"2024-03-09T14:28:53.635866+0000","last_became_peered":"2024-03-09T14:28:53.635866+0000","last_unstale":"2024-03-09T15:07:04.631598+0000","last_undegraded":"2024-03-09T15:07:04.631598+0000","last_fullsized":"2024-03-09T15:07:04.631598+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:08:50.346352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049848,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":533,"num_read_kb":68120,"num_write":1298,"num_write_kb":51277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'625","reported_seq":2293,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.477485+0000","last_change":"2024-03-09T14:28:55.597656+0000","last_active":"2024-03-09T15:06:53.477485+0000","last_peered":"2024-03-09T15:06:53.477485+0000","last_clean":"2024-03-09T15:06:53.477485+0000","last_became_active":"2024-03-09T14:28:55.596430+0000","last_became_peered":"2024-03-09T14:28:55.596430+0000","last_unstale":"2024-03-09T15:06:53.477485+0000","last_undegraded":"2024-03-09T15:06:53.477485+0000","last_fullsized":"2024-03-09T15:06:53.477485+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":600,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:16:10.976172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3224,"num_read_kb":2919,"num_write":927,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'250","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:28.444541+0000","last_change":"2024-03-09T14:28:53.585196+0000","last_active":"2024-03-09T15:05:28.444541+0000","last_peered":"2024-03-09T15:05:28.444541+0000","last_clean":"2024-03-09T15:05:28.444541+0000","last_became_active":"2024-03-09T14:28:53.584780+0000","last_became_peered":"2024-03-09T14:28:53.584780+0000","last_unstale":"2024-03-09T15:05:28.444541+0000","last_undegraded":"2024-03-09T15:05:28.444541+0000","last_fullsized":"2024-03-09T15:05:28.444541+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:17:52.899385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6076549,"num_objects":62,"num_object_clones":0,"num_object_copies":248,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":350,"num_read_kb":4504,"num_write":1168,"num_write_kb":43139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1138","reported_seq":2640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.279203+0000","last_change":"2024-03-09T14:28:55.585579+0000","last_active":"2024-03-09T15:06:41.279203+0000","last_peered":"2024-03-09T15:06:41.279203+0000","last_clean":"2024-03-09T15:06:41.279203+0000","last_became_active":"2024-03-09T14:28:55.582655+0000","last_became_peered":"2024-03-09T14:28:55.582655+0000","last_unstale":"2024-03-09T15:06:41.279203+0000","last_undegraded":"2024-03-09T15:06:41.279203+0000","last_fullsized":"2024-03-09T15:06:41.279203+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:00:59.988789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4834,"num_read_kb":4203,"num_write":1586,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'364","reported_seq":1065,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.824869+0000","last_change":"2024-03-09T14:28:53.627517+0000","last_active":"2024-03-09T15:06:39.824869+0000","last_peered":"2024-03-09T15:06:39.824869+0000","last_clean":"2024-03-09T15:06:39.824869+0000","last_became_active":"2024-03-09T14:28:53.626746+0000","last_became_peered":"2024-03-09T14:28:53.626746+0000","last_unstale":"2024-03-09T15:06:39.824869+0000","last_undegraded":"2024-03-09T15:06:39.824869+0000","last_fullsized":"2024-03-09T15:06:39.824869+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:13:12.536809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10787790,"num_objects":67,"num_object_clones":0,"num_object_copies":268,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":761,"num_read_kb":5936,"num_write":1437,"num_write_kb":27133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'403","reported_seq":2031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.290762+0000","last_change":"2024-03-09T14:28:55.575483+0000","last_active":"2024-03-09T15:06:41.290762+0000","last_peered":"2024-03-09T15:06:41.290762+0000","last_clean":"2024-03-09T15:06:41.290762+0000","last_became_active":"2024-03-09T14:28:55.574723+0000","last_became_peered":"2024-03-09T14:28:55.574723+0000","last_unstale":"2024-03-09T15:06:41.290762+0000","last_undegraded":"2024-03-09T15:06:41.290762+0000","last_fullsized":"2024-03-09T15:06:41.290762+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:21:08.880858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2270,"num_read_kb":2181,"num_write":450,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'296","reported_seq":1172,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:14.657922+0000","last_change":"2024-03-09T14:28:53.565397+0000","last_active":"2024-03-09T15:05:14.657922+0000","last_peered":"2024-03-09T15:05:14.657922+0000","last_clean":"2024-03-09T15:05:14.657922+0000","last_became_active":"2024-03-09T14:28:53.564605+0000","last_became_peered":"2024-03-09T14:28:53.564605+0000","last_unstale":"2024-03-09T15:05:14.657922+0000","last_undegraded":"2024-03-09T15:05:14.657922+0000","last_fullsized":"2024-03-09T15:05:14.657922+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:27:21.297821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3358,"num_objects":78,"num_object_clones":0,"num_object_copies":312,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":951,"num_read_kb":12220,"num_write":1302,"num_write_kb":35283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'474","reported_seq":2092,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.442041+0000","last_change":"2024-03-09T14:28:55.596361+0000","last_active":"2024-03-09T15:06:42.442041+0000","last_peered":"2024-03-09T15:06:42.442041+0000","last_clean":"2024-03-09T15:06:42.442041+0000","last_became_active":"2024-03-09T14:28:55.596007+0000","last_became_peered":"2024-03-09T14:28:55.596007+0000","last_unstale":"2024-03-09T15:06:42.442041+0000","last_undegraded":"2024-03-09T15:06:42.442041+0000","last_fullsized":"2024-03-09T15:06:42.442041+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:09.008168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2627,"num_read_kb":2464,"num_write":596,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'211","reported_seq":800,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:41.883923+0000","last_change":"2024-03-09T14:28:53.638536+0000","last_active":"2024-03-09T15:04:41.883923+0000","last_peered":"2024-03-09T15:04:41.883923+0000","last_clean":"2024-03-09T15:04:41.883923+0000","last_became_active":"2024-03-09T14:28:53.637905+0000","last_became_peered":"2024-03-09T14:28:53.637905+0000","last_unstale":"2024-03-09T15:04:41.883923+0000","last_undegraded":"2024-03-09T15:04:41.883923+0000","last_fullsized":"2024-03-09T15:04:41.883923+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:24:14.058362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5532803,"num_objects":54,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":317,"num_read_kb":388,"num_write":980,"num_write_kb":15956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'865","reported_seq":2402,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:30.933407+0000","last_change":"2024-03-09T14:28:55.590315+0000","last_active":"2024-03-09T15:06:30.933407+0000","last_peered":"2024-03-09T15:06:30.933407+0000","last_clean":"2024-03-09T15:06:30.933407+0000","last_became_active":"2024-03-09T14:28:55.589596+0000","last_became_peered":"2024-03-09T14:28:55.589596+0000","last_unstale":"2024-03-09T15:06:30.933407+0000","last_undegraded":"2024-03-09T15:06:30.933407+0000","last_fullsized":"2024-03-09T15:06:30.933407+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:18:51.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4032,"num_read_kb":3559,"num_write":1203,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'295","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.723042+0000","last_change":"2024-03-09T14:28:53.627710+0000","last_active":"2024-03-09T15:07:04.723042+0000","last_peered":"2024-03-09T15:07:04.723042+0000","last_clean":"2024-03-09T15:07:04.723042+0000","last_became_active":"2024-03-09T14:28:53.626673+0000","last_became_peered":"2024-03-09T14:28:53.626673+0000","last_unstale":"2024-03-09T15:07:04.723042+0000","last_undegraded":"2024-03-09T15:07:04.723042+0000","last_fullsized":"2024-03-09T15:07:04.723042+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:43.839078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2007922,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":552,"num_read_kb":94144,"num_write":1072,"num_write_kb":28965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'470","reported_seq":1980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.378173+0000","last_change":"2024-03-09T14:28:55.610858+0000","last_active":"2024-03-09T15:06:38.378173+0000","last_peered":"2024-03-09T15:06:38.378173+0000","last_clean":"2024-03-09T15:06:38.378173+0000","last_became_active":"2024-03-09T14:28:55.610314+0000","last_became_peered":"2024-03-09T14:28:55.610314+0000","last_unstale":"2024-03-09T15:06:38.378173+0000","last_undegraded":"2024-03-09T15:06:38.378173+0000","last_fullsized":"2024-03-09T15:06:38.378173+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:48.765613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2645,"num_read_kb":2435,"num_write":625,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'341","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.679819+0000","last_change":"2024-03-09T14:28:53.632280+0000","last_active":"2024-03-09T15:07:04.679819+0000","last_peered":"2024-03-09T15:07:04.679819+0000","last_clean":"2024-03-09T15:07:04.679819+0000","last_became_active":"2024-03-09T14:28:53.631327+0000","last_became_peered":"2024-03-09T14:28:53.631327+0000","last_unstale":"2024-03-09T15:07:04.679819+0000","last_undegraded":"2024-03-09T15:07:04.679819+0000","last_fullsized":"2024-03-09T15:07:04.679819+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:34:05.226694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4801783,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":567,"num_read_kb":48859,"num_write":1211,"num_write_kb":49653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'386","reported_seq":1869,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.431122+0000","last_change":"2024-03-09T14:28:55.587624+0000","last_active":"2024-03-09T15:06:42.431122+0000","last_peered":"2024-03-09T15:06:42.431122+0000","last_clean":"2024-03-09T15:06:42.431122+0000","last_became_active":"2024-03-09T14:28:55.587355+0000","last_became_peered":"2024-03-09T14:28:55.587355+0000","last_unstale":"2024-03-09T15:06:42.431122+0000","last_undegraded":"2024-03-09T15:06:42.431122+0000","last_fullsized":"2024-03-09T15:06:42.431122+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:31:51.705629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2078,"num_read_kb":1975,"num_write":455,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'374","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.641796+0000","last_change":"2024-03-09T14:28:53.624013+0000","last_active":"2024-03-09T15:07:04.641796+0000","last_peered":"2024-03-09T15:07:04.641796+0000","last_clean":"2024-03-09T15:07:04.641796+0000","last_became_active":"2024-03-09T14:28:53.622624+0000","last_became_peered":"2024-03-09T14:28:53.622624+0000","last_unstale":"2024-03-09T15:07:04.641796+0000","last_undegraded":"2024-03-09T15:07:04.641796+0000","last_fullsized":"2024-03-09T15:07:04.641796+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:47:00.573989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6554788,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":632,"num_read_kb":22045,"num_write":1223,"num_write_kb":48993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'1099","reported_seq":2573,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.149754+0000","last_change":"2024-03-09T14:28:55.591286+0000","last_active":"2024-03-09T15:06:36.149754+0000","last_peered":"2024-03-09T15:06:36.149754+0000","last_clean":"2024-03-09T15:06:36.149754+0000","last_became_active":"2024-03-09T14:28:55.582143+0000","last_became_peered":"2024-03-09T14:28:55.582143+0000","last_unstale":"2024-03-09T15:06:36.149754+0000","last_undegraded":"2024-03-09T15:06:36.149754+0000","last_fullsized":"2024-03-09T15:06:36.149754+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":1000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:02:27.150531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4588,"num_read_kb":3996,"num_write":1519,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'348","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.712681+0000","last_change":"2024-03-09T14:28:53.633628+0000","last_active":"2024-03-09T15:07:04.712681+0000","last_peered":"2024-03-09T15:07:04.712681+0000","last_clean":"2024-03-09T15:07:04.712681+0000","last_became_active":"2024-03-09T14:28:53.633121+0000","last_became_peered":"2024-03-09T14:28:53.633121+0000","last_unstale":"2024-03-09T15:07:04.712681+0000","last_undegraded":"2024-03-09T15:07:04.712681+0000","last_fullsized":"2024-03-09T15:07:04.712681+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:08:16.219438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3362505,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":692,"num_read_kb":9275,"num_write":1356,"num_write_kb":66964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'676","reported_seq":2114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.284688+0000","last_change":"2024-03-09T14:28:55.602146+0000","last_active":"2024-03-09T15:06:41.284688+0000","last_peered":"2024-03-09T15:06:41.284688+0000","last_clean":"2024-03-09T15:06:41.284688+0000","last_became_active":"2024-03-09T14:28:55.601622+0000","last_became_peered":"2024-03-09T14:28:55.601622+0000","last_unstale":"2024-03-09T15:06:41.284688+0000","last_undegraded":"2024-03-09T15:06:41.284688+0000","last_fullsized":"2024-03-09T15:06:41.284688+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":600,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:03:29.881841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3103,"num_read_kb":2796,"num_write":889,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'386","reported_seq":1112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.706273+0000","last_change":"2024-03-09T14:29:28.829008+0000","last_active":"2024-03-09T15:07:04.706273+0000","last_peered":"2024-03-09T15:07:04.706273+0000","last_clean":"2024-03-09T15:07:04.706273+0000","last_became_active":"2024-03-09T14:29:28.827826+0000","last_became_peered":"2024-03-09T14:29:28.827826+0000","last_unstale":"2024-03-09T15:07:04.706273+0000","last_undegraded":"2024-03-09T15:07:04.706273+0000","last_fullsized":"2024-03-09T15:07:04.706273+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:23.249436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2067841,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":862,"num_read_kb":41003,"num_write":1545,"num_write_kb":37571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"264'232","reported_seq":846,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:55.970649+0000","last_change":"2024-03-09T14:28:53.603932+0000","last_active":"2024-03-09T15:05:55.970649+0000","last_peered":"2024-03-09T15:05:55.970649+0000","last_clean":"2024-03-09T15:05:55.970649+0000","last_became_active":"2024-03-09T14:28:53.602502+0000","last_became_peered":"2024-03-09T14:28:53.602502+0000","last_unstale":"2024-03-09T15:05:55.970649+0000","last_undegraded":"2024-03-09T15:05:55.970649+0000","last_fullsized":"2024-03-09T15:05:55.970649+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:03:28.530349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6657680,"num_objects":66,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":331,"num_read_kb":11977,"num_write":1001,"num_write_kb":41245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'855","reported_seq":2303,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.333436+0000","last_change":"2024-03-09T14:28:55.602029+0000","last_active":"2024-03-09T15:06:24.333436+0000","last_peered":"2024-03-09T15:06:24.333436+0000","last_clean":"2024-03-09T15:06:24.333436+0000","last_became_active":"2024-03-09T14:28:55.601537+0000","last_became_peered":"2024-03-09T14:28:55.601537+0000","last_unstale":"2024-03-09T15:06:24.333436+0000","last_undegraded":"2024-03-09T15:06:24.333436+0000","last_fullsized":"2024-03-09T15:06:24.333436+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:50:14.569583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3890,"num_read_kb":3404,"num_write":1199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'280","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.059379+0000","last_change":"2024-03-09T14:28:53.589127+0000","last_active":"2024-03-09T15:06:36.059379+0000","last_peered":"2024-03-09T15:06:36.059379+0000","last_clean":"2024-03-09T15:06:36.059379+0000","last_became_active":"2024-03-09T14:28:53.588717+0000","last_became_peered":"2024-03-09T14:28:53.588717+0000","last_unstale":"2024-03-09T15:06:36.059379+0000","last_undegraded":"2024-03-09T15:06:36.059379+0000","last_fullsized":"2024-03-09T15:06:36.059379+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:19:41.863054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10775327,"num_objects":74,"num_object_clones":0,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":501,"num_read_kb":5739,"num_write":1111,"num_write_kb":28449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'1155","reported_seq":2682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.479714+0000","last_change":"2024-03-09T14:28:55.583336+0000","last_active":"2024-03-09T15:06:53.479714+0000","last_peered":"2024-03-09T15:06:53.479714+0000","last_clean":"2024-03-09T15:06:53.479714+0000","last_became_active":"2024-03-09T14:28:55.582541+0000","last_became_peered":"2024-03-09T14:28:55.582541+0000","last_unstale":"2024-03-09T15:06:53.479714+0000","last_undegraded":"2024-03-09T15:06:53.479714+0000","last_fullsized":"2024-03-09T15:06:53.479714+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:40.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4871,"num_read_kb":4234,"num_write":1610,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5930,"num_read_kb":4217,"num_write":2190,"num_write_kb":844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1123,"ondisk_log_size":1123,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":13413,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":15557,"num_read_kb":15326,"num_write":16235,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":26826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1560,"ondisk_log_size":1560,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":409,"ondisk_log_size":409,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1662349,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":15984,"num_read_kb":32162,"num_write":13708,"num_write_kb":11098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2174976,"data_stored":1729593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2057,"ondisk_log_size":2057,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1615,"num_read_kb":1920,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":194579,"num_read_kb":177681,"num_write":51390,"num_write_kb":17534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":132,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4061,"ondisk_log_size":4061,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":433827301,"num_objects":2726,"num_object_clones":0,"num_object_copies":10904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2726,"num_whiteouts":0,"num_read":32392,"num_read_kb":1970627,"num_write":75201,"num_write_kb":2252311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":600047616,"data_stored":600047616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3979,"ondisk_log_size":3979,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":67197334,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":120,"num_read_kb":180405,"num_write":134,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":110288896,"data_stored":110277420,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":53485556,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":123,"num_read_kb":177288,"num_write":140,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":97574912,"data_stored":97569110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575316,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":391396,"kb_used_data":75564,"kb_used_omap":1,"kb_used_meta":315774,"kb_avail":93980444,"statfs":{"total":96636764160,"available":96235974656,"internally_reserved":0,"allocated":77377536,"data_stored":75372085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":323353034},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575313,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379716,"kb_used_data":73540,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":93992124,"statfs":{"total":96636764160,"available":96247934976,"internally_reserved":0,"allocated":75304960,"data_stored":73333756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575316,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289184,"kb_used_data":149784,"kb_used_omap":1,"kb_used_meta":139390,"kb_avail":94082656,"statfs":{"total":96636764160,"available":96340639744,"internally_reserved":0,"allocated":153378816,"data_stored":151322568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":142735813},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575314,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":232052,"kb_used_data":124484,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94139788,"statfs":{"total":96636764160,"available":96399142912,"internally_reserved":0,"allocated":127471616,"data_stored":125551919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575315,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":435184,"kb_used_data":183272,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":93936656,"statfs":{"total":96636764160,"available":96191135744,"internally_reserved":0,"allocated":187670528,"data_stored":185626298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575312,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":171004,"kb_used_data":67496,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94200836,"statfs":{"total":96636764160,"available":96461656064,"internally_reserved":0,"allocated":69115904,"data_stored":67191426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575315,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298620,"kb_used_data":137012,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94073220,"statfs":{"total":96636764160,"available":96330977280,"internally_reserved":0,"allocated":140300288,"data_stored":138297479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575313,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319312,"kb_used_data":57392,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94052528,"statfs":{"total":96636764160,"available":96309788672,"internally_reserved":0,"allocated":58769408,"data_stored":56769573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":47398912,"data_stored":47398912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":119902208,"data_stored":119902208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37072896,"data_stored":37072896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":108396544,"data_stored":108396544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":59637760,"data_stored":59637760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":115896320,"data_stored":115896320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":50921472,"data_stored":50921472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":60821504,"data_stored":60821504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":91608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":466944,"data_stored":390468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":472058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":679936,"data_stored":565515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":82594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":192512,"data_stored":126800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1052672,"data_stored":1051793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11542528,"data_stored":11539299,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32505856,"data_stored":32505856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11579392,"data_stored":11577698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5283840,"data_stored":5283025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4202496,"data_stored":4199267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15769600,"data_stored":15768785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":41984000,"data_stored":41983185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10489856,"data_stored":10488977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21020672,"data_stored":21016628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10489856,"data_stored":10488977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:07:06.789 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:07:07.173 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:07:07.192 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-09T15:07:07.204 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":1413,"stamp":"2024-03-09T15:07:06.845356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":322237174,"num_objects":1752,"num_object_clones":0,"num_object_copies":6104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1752,"num_whiteouts":0,"num_read":268055,"num_read_kb":2561305,"num_write":160716,"num_write_kb":2520679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":176,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13423,"ondisk_log_size":13423,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2330508,"kb_used_data":641440,"kb_used_omap":12,"kb_used_meta":1687475,"kb_avail":752644212,"statfs":{"total":773094113280,"available":770707673088,"internally_reserved":0,"allocated":656834560,"data_stored":641007067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1727974960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[22,1,4],"upper_bound":8},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-525494720,"num_objects":-3098,"num_object_clones":0,"num_object_copies":-12340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3098,"num_whiteouts":0,"num_read":3575,"num_read_kb":15517,"num_write":3322,"num_write_kb":6218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008013"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:24.861905+0000","last_change":"2024-03-09T14:49:53.659913+0000","last_active":"2024-03-09T15:02:24.861905+0000","last_peered":"2024-03-09T15:02:24.861905+0000","last_clean":"2024-03-09T15:02:24.861905+0000","last_became_active":"2024-03-09T14:49:53.656173+0000","last_became_peered":"2024-03-09T14:49:53.656173+0000","last_unstale":"2024-03-09T15:02:24.861905+0000","last_undegraded":"2024-03-09T15:02:24.861905+0000","last_fullsized":"2024-03-09T15:02:24.861905+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:35.929830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.860903+0000","last_change":"2024-03-09T14:42:19.006802+0000","last_active":"2024-03-09T15:02:19.860903+0000","last_peered":"2024-03-09T15:02:19.860903+0000","last_clean":"2024-03-09T15:02:19.860903+0000","last_became_active":"2024-03-09T14:42:19.006064+0000","last_became_peered":"2024-03-09T14:42:19.006064+0000","last_unstale":"2024-03-09T15:02:19.860903+0000","last_undegraded":"2024-03-09T15:02:19.860903+0000","last_fullsized":"2024-03-09T15:02:19.860903+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:00:50.245633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.912628+0000","last_change":"2024-03-09T14:42:15.929304+0000","last_active":"2024-03-09T15:02:19.912628+0000","last_peered":"2024-03-09T15:02:19.912628+0000","last_clean":"2024-03-09T15:02:19.912628+0000","last_became_active":"2024-03-09T14:42:15.928518+0000","last_became_peered":"2024-03-09T14:42:15.928518+0000","last_unstale":"2024-03-09T15:02:19.912628+0000","last_undegraded":"2024-03-09T15:02:19.912628+0000","last_fullsized":"2024-03-09T15:02:19.912628+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:41:16.939221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'49","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.722055+0000","last_change":"2024-03-09T14:39:57.903467+0000","last_active":"2024-03-09T15:04:59.722055+0000","last_peered":"2024-03-09T15:04:59.722055+0000","last_clean":"2024-03-09T15:04:59.722055+0000","last_became_active":"2024-03-09T14:39:57.901879+0000","last_became_peered":"2024-03-09T14:39:57.901879+0000","last_unstale":"2024-03-09T15:04:59.722055+0000","last_undegraded":"2024-03-09T15:04:59.722055+0000","last_fullsized":"2024-03-09T15:04:59.722055+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:06:48.629872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":129,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:24.672562+0000","last_change":"2024-03-09T14:49:53.685563+0000","last_active":"2024-03-09T15:02:24.672562+0000","last_peered":"2024-03-09T15:02:24.672562+0000","last_clean":"2024-03-09T15:02:24.672562+0000","last_became_active":"2024-03-09T14:49:53.684941+0000","last_became_peered":"2024-03-09T14:49:53.684941+0000","last_unstale":"2024-03-09T15:02:24.672562+0000","last_undegraded":"2024-03-09T15:02:24.672562+0000","last_fullsized":"2024-03-09T15:02:24.672562+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:56:08.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.677113+0000","last_change":"2024-03-09T14:42:19.016523+0000","last_active":"2024-03-09T15:02:19.677113+0000","last_peered":"2024-03-09T15:02:19.677113+0000","last_clean":"2024-03-09T15:02:19.677113+0000","last_became_active":"2024-03-09T14:42:19.011453+0000","last_became_peered":"2024-03-09T14:42:19.011453+0000","last_unstale":"2024-03-09T15:02:19.677113+0000","last_undegraded":"2024-03-09T15:02:19.677113+0000","last_fullsized":"2024-03-09T15:02:19.677113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:58.069721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:20.035223+0000","last_change":"2024-03-09T14:42:15.971426+0000","last_active":"2024-03-09T15:02:20.035223+0000","last_peered":"2024-03-09T15:02:20.035223+0000","last_clean":"2024-03-09T15:02:20.035223+0000","last_became_active":"2024-03-09T14:42:15.970720+0000","last_became_peered":"2024-03-09T14:42:15.970720+0000","last_unstale":"2024-03-09T15:02:20.035223+0000","last_undegraded":"2024-03-09T15:02:20.035223+0000","last_fullsized":"2024-03-09T15:02:20.035223+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:19:28.165527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.696208+0000","last_change":"2024-03-09T14:39:57.894737+0000","last_active":"2024-03-09T15:04:09.696208+0000","last_peered":"2024-03-09T15:04:09.696208+0000","last_clean":"2024-03-09T15:04:09.696208+0000","last_became_active":"2024-03-09T14:39:57.894022+0000","last_became_peered":"2024-03-09T14:39:57.894022+0000","last_unstale":"2024-03-09T15:04:09.696208+0000","last_undegraded":"2024-03-09T15:04:09.696208+0000","last_fullsized":"2024-03-09T15:04:09.696208+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:04:28.968947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.703233+0000","last_change":"2024-03-09T14:49:53.677659+0000","last_active":"2024-03-09T15:04:24.703233+0000","last_peered":"2024-03-09T15:04:24.703233+0000","last_clean":"2024-03-09T15:04:24.703233+0000","last_became_active":"2024-03-09T14:49:53.676530+0000","last_became_peered":"2024-03-09T14:49:53.676530+0000","last_unstale":"2024-03-09T15:04:24.703233+0000","last_undegraded":"2024-03-09T15:04:24.703233+0000","last_fullsized":"2024-03-09T15:04:24.703233+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:46:58.203837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.695100+0000","last_change":"2024-03-09T14:42:19.295942+0000","last_active":"2024-03-09T15:03:09.695100+0000","last_peered":"2024-03-09T15:03:09.695100+0000","last_clean":"2024-03-09T15:03:09.695100+0000","last_became_active":"2024-03-09T14:42:19.295218+0000","last_became_peered":"2024-03-09T14:42:19.295218+0000","last_unstale":"2024-03-09T15:03:09.695100+0000","last_undegraded":"2024-03-09T15:03:09.695100+0000","last_fullsized":"2024-03-09T15:03:09.695100+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:07:18.137379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":63,"num_write":3,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"261'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.701153+0000","last_change":"2024-03-09T14:42:15.958751+0000","last_active":"2024-03-09T15:04:29.701153+0000","last_peered":"2024-03-09T15:04:29.701153+0000","last_clean":"2024-03-09T15:04:29.701153+0000","last_became_active":"2024-03-09T14:42:15.958052+0000","last_became_peered":"2024-03-09T14:42:15.958052+0000","last_unstale":"2024-03-09T15:04:29.701153+0000","last_undegraded":"2024-03-09T15:04:29.701153+0000","last_fullsized":"2024-03-09T15:04:29.701153+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:29:31.200748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'67","reported_seq":205,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:05.886666+0000","last_change":"2024-03-09T14:39:57.891306+0000","last_active":"2024-03-09T15:04:05.886666+0000","last_peered":"2024-03-09T15:04:05.886666+0000","last_clean":"2024-03-09T15:04:05.886666+0000","last_became_active":"2024-03-09T14:39:57.890452+0000","last_became_peered":"2024-03-09T14:39:57.890452+0000","last_unstale":"2024-03-09T15:04:05.886666+0000","last_undegraded":"2024-03-09T15:04:05.886666+0000","last_fullsized":"2024-03-09T15:04:05.886666+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:26.583506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":205,"num_write":124,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.944291+0000","last_change":"2024-03-09T14:49:53.669862+0000","last_active":"2024-03-09T15:04:24.944291+0000","last_peered":"2024-03-09T15:04:24.944291+0000","last_clean":"2024-03-09T15:04:24.944291+0000","last_became_active":"2024-03-09T14:49:53.669178+0000","last_became_peered":"2024-03-09T14:49:53.669178+0000","last_unstale":"2024-03-09T15:04:24.944291+0000","last_undegraded":"2024-03-09T15:04:24.944291+0000","last_fullsized":"2024-03-09T15:04:24.944291+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:33.018328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'6","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.944631+0000","last_change":"2024-03-09T14:42:19.295020+0000","last_active":"2024-03-09T15:04:24.944631+0000","last_peered":"2024-03-09T15:04:24.944631+0000","last_clean":"2024-03-09T15:04:24.944631+0000","last_became_active":"2024-03-09T14:42:19.294235+0000","last_became_peered":"2024-03-09T14:42:19.294235+0000","last_unstale":"2024-03-09T15:04:24.944631+0000","last_undegraded":"2024-03-09T15:04:24.944631+0000","last_fullsized":"2024-03-09T15:04:24.944631+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:26.179213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.688252+0000","last_change":"2024-03-09T14:42:15.958787+0000","last_active":"2024-03-09T15:03:09.688252+0000","last_peered":"2024-03-09T15:03:09.688252+0000","last_clean":"2024-03-09T15:03:09.688252+0000","last_became_active":"2024-03-09T14:42:15.957974+0000","last_became_peered":"2024-03-09T14:42:15.957974+0000","last_unstale":"2024-03-09T15:03:09.688252+0000","last_undegraded":"2024-03-09T15:03:09.688252+0000","last_fullsized":"2024-03-09T15:03:09.688252+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:28:08.525108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'35","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:15.106458+0000","last_change":"2024-03-09T14:39:57.910289+0000","last_active":"2024-03-09T15:03:15.106458+0000","last_peered":"2024-03-09T15:03:15.106458+0000","last_clean":"2024-03-09T15:03:15.106458+0000","last_became_active":"2024-03-09T14:39:57.909761+0000","last_became_peered":"2024-03-09T14:39:57.909761+0000","last_unstale":"2024-03-09T15:03:15.106458+0000","last_undegraded":"2024-03-09T15:03:15.106458+0000","last_fullsized":"2024-03-09T15:03:15.106458+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:05:46.103142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":109,"num_write":58,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:54.936666+0000","last_change":"2024-03-09T14:49:53.678276+0000","last_active":"2024-03-09T15:03:54.936666+0000","last_peered":"2024-03-09T15:03:54.936666+0000","last_clean":"2024-03-09T15:03:54.936666+0000","last_became_active":"2024-03-09T14:49:53.676902+0000","last_became_peered":"2024-03-09T14:49:53.676902+0000","last_unstale":"2024-03-09T15:03:54.936666+0000","last_undegraded":"2024-03-09T15:03:54.936666+0000","last_fullsized":"2024-03-09T15:03:54.936666+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:07:34.791991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.886265+0000","last_change":"2024-03-09T14:42:19.008196+0000","last_active":"2024-03-09T15:04:09.886265+0000","last_peered":"2024-03-09T15:04:09.886265+0000","last_clean":"2024-03-09T15:04:09.886265+0000","last_became_active":"2024-03-09T14:42:19.006923+0000","last_became_peered":"2024-03-09T14:42:19.006923+0000","last_unstale":"2024-03-09T15:04:09.886265+0000","last_undegraded":"2024-03-09T15:04:09.886265+0000","last_fullsized":"2024-03-09T15:04:09.886265+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:47:53.638625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.743319+0000","last_change":"2024-03-09T14:42:15.974088+0000","last_active":"2024-03-09T15:06:29.743319+0000","last_peered":"2024-03-09T15:06:29.743319+0000","last_clean":"2024-03-09T15:06:29.743319+0000","last_became_active":"2024-03-09T14:42:15.971499+0000","last_became_peered":"2024-03-09T14:42:15.971499+0000","last_unstale":"2024-03-09T15:06:29.743319+0000","last_undegraded":"2024-03-09T15:06:29.743319+0000","last_fullsized":"2024-03-09T15:06:29.743319+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:31.642579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'33","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:29.915211+0000","last_change":"2024-03-09T14:39:57.900156+0000","last_active":"2024-03-09T15:02:29.915211+0000","last_peered":"2024-03-09T15:02:29.915211+0000","last_clean":"2024-03-09T15:02:29.915211+0000","last_became_active":"2024-03-09T14:39:57.898849+0000","last_became_peered":"2024-03-09T14:39:57.898849+0000","last_unstale":"2024-03-09T15:02:29.915211+0000","last_undegraded":"2024-03-09T15:02:29.915211+0000","last_fullsized":"2024-03-09T15:02:29.915211+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:28.068027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":100,"num_write":52,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:30.064856+0000","last_change":"2024-03-09T14:49:53.660759+0000","last_active":"2024-03-09T15:04:30.064856+0000","last_peered":"2024-03-09T15:04:30.064856+0000","last_clean":"2024-03-09T15:04:30.064856+0000","last_became_active":"2024-03-09T14:49:53.648332+0000","last_became_peered":"2024-03-09T14:49:53.648332+0000","last_unstale":"2024-03-09T15:04:30.064856+0000","last_undegraded":"2024-03-09T15:04:30.064856+0000","last_fullsized":"2024-03-09T15:04:30.064856+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:53:22.627039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'5","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.699112+0000","last_change":"2024-03-09T14:42:19.004615+0000","last_active":"2024-03-09T15:04:04.699112+0000","last_peered":"2024-03-09T15:04:04.699112+0000","last_clean":"2024-03-09T15:04:04.699112+0000","last_became_active":"2024-03-09T14:42:19.003868+0000","last_became_peered":"2024-03-09T14:42:19.003868+0000","last_unstale":"2024-03-09T15:04:04.699112+0000","last_undegraded":"2024-03-09T15:04:04.699112+0000","last_fullsized":"2024-03-09T15:04:04.699112+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:37:03.868001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'1","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:14.702723+0000","last_change":"2024-03-09T14:42:15.948619+0000","last_active":"2024-03-09T15:04:14.702723+0000","last_peered":"2024-03-09T15:04:14.702723+0000","last_clean":"2024-03-09T15:04:14.702723+0000","last_became_active":"2024-03-09T14:42:15.947888+0000","last_became_peered":"2024-03-09T14:42:15.947888+0000","last_unstale":"2024-03-09T15:04:14.702723+0000","last_undegraded":"2024-03-09T15:04:14.702723+0000","last_fullsized":"2024-03-09T15:04:14.702723+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:44.462054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'23","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:29.678061+0000","last_change":"2024-03-09T14:39:57.908221+0000","last_active":"2024-03-09T15:02:29.678061+0000","last_peered":"2024-03-09T15:02:29.678061+0000","last_clean":"2024-03-09T15:02:29.678061+0000","last_became_active":"2024-03-09T14:39:57.907530+0000","last_became_peered":"2024-03-09T14:39:57.907530+0000","last_unstale":"2024-03-09T15:02:29.678061+0000","last_undegraded":"2024-03-09T15:02:29.678061+0000","last_fullsized":"2024-03-09T15:02:29.678061+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:04:57.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":69,"num_write":39,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:24.893913+0000","last_change":"2024-03-09T14:49:53.677579+0000","last_active":"2024-03-09T15:02:24.893913+0000","last_peered":"2024-03-09T15:02:24.893913+0000","last_clean":"2024-03-09T15:02:24.893913+0000","last_became_active":"2024-03-09T14:49:53.676976+0000","last_became_peered":"2024-03-09T14:49:53.676976+0000","last_unstale":"2024-03-09T15:02:24.893913+0000","last_undegraded":"2024-03-09T15:02:24.893913+0000","last_fullsized":"2024-03-09T15:02:24.893913+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:07:35.978642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.675982+0000","last_change":"2024-03-09T14:42:19.017355+0000","last_active":"2024-03-09T15:02:19.675982+0000","last_peered":"2024-03-09T15:02:19.675982+0000","last_clean":"2024-03-09T15:02:19.675982+0000","last_became_active":"2024-03-09T14:42:19.008779+0000","last_became_peered":"2024-03-09T14:42:19.008779+0000","last_unstale":"2024-03-09T15:02:19.675982+0000","last_undegraded":"2024-03-09T15:02:19.675982+0000","last_fullsized":"2024-03-09T15:02:19.675982+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:37:37.205376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"261'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.676961+0000","last_change":"2024-03-09T14:42:15.943933+0000","last_active":"2024-03-09T15:02:19.676961+0000","last_peered":"2024-03-09T15:02:19.676961+0000","last_clean":"2024-03-09T15:02:19.676961+0000","last_became_active":"2024-03-09T14:42:15.943177+0000","last_became_peered":"2024-03-09T14:42:15.943177+0000","last_unstale":"2024-03-09T15:02:19.676961+0000","last_undegraded":"2024-03-09T15:02:19.676961+0000","last_fullsized":"2024-03-09T15:02:19.676961+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:55.865049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'28","reported_seq":111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:14.710731+0000","last_change":"2024-03-09T14:39:57.895113+0000","last_active":"2024-03-09T15:04:14.710731+0000","last_peered":"2024-03-09T15:04:14.710731+0000","last_clean":"2024-03-09T15:04:14.710731+0000","last_became_active":"2024-03-09T14:39:57.894343+0000","last_became_peered":"2024-03-09T14:39:57.894343+0000","last_unstale":"2024-03-09T15:04:14.710731+0000","last_undegraded":"2024-03-09T15:04:14.710731+0000","last_fullsized":"2024-03-09T15:04:14.710731+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:50:51.100845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":82,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:24.894013+0000","last_change":"2024-03-09T14:49:53.666909+0000","last_active":"2024-03-09T15:02:24.894013+0000","last_peered":"2024-03-09T15:02:24.894013+0000","last_clean":"2024-03-09T15:02:24.894013+0000","last_became_active":"2024-03-09T14:49:53.666178+0000","last_became_peered":"2024-03-09T14:49:53.666178+0000","last_unstale":"2024-03-09T15:02:24.894013+0000","last_undegraded":"2024-03-09T15:02:24.894013+0000","last_fullsized":"2024-03-09T15:02:24.894013+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:52.776783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.912444+0000","last_change":"2024-03-09T14:42:19.007765+0000","last_active":"2024-03-09T15:02:19.912444+0000","last_peered":"2024-03-09T15:02:19.912444+0000","last_clean":"2024-03-09T15:02:19.912444+0000","last_became_active":"2024-03-09T14:42:19.004684+0000","last_became_peered":"2024-03-09T14:42:19.004684+0000","last_unstale":"2024-03-09T15:02:19.912444+0000","last_undegraded":"2024-03-09T15:02:19.912444+0000","last_fullsized":"2024-03-09T15:02:19.912444+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:43:10.037376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"261'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.683201+0000","last_change":"2024-03-09T14:42:15.973483+0000","last_active":"2024-03-09T15:02:19.683201+0000","last_peered":"2024-03-09T15:02:19.683201+0000","last_clean":"2024-03-09T15:02:19.683201+0000","last_became_active":"2024-03-09T14:42:15.972713+0000","last_became_peered":"2024-03-09T14:42:15.972713+0000","last_unstale":"2024-03-09T15:02:19.683201+0000","last_undegraded":"2024-03-09T15:02:19.683201+0000","last_fullsized":"2024-03-09T15:02:19.683201+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:13:58.988787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'37","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:10.059878+0000","last_change":"2024-03-09T14:39:57.870198+0000","last_active":"2024-03-09T15:04:10.059878+0000","last_peered":"2024-03-09T15:04:10.059878+0000","last_clean":"2024-03-09T15:04:10.059878+0000","last_became_active":"2024-03-09T14:39:57.869392+0000","last_became_peered":"2024-03-09T14:39:57.869392+0000","last_unstale":"2024-03-09T15:04:10.059878+0000","last_undegraded":"2024-03-09T15:04:10.059878+0000","last_fullsized":"2024-03-09T15:04:10.059878+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:30:48.323996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":118,"num_write":73,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:55.056586+0000","last_change":"2024-03-09T14:49:53.652690+0000","last_active":"2024-03-09T15:03:55.056586+0000","last_peered":"2024-03-09T15:03:55.056586+0000","last_clean":"2024-03-09T15:03:55.056586+0000","last_became_active":"2024-03-09T14:49:53.651987+0000","last_became_peered":"2024-03-09T14:49:53.651987+0000","last_unstale":"2024-03-09T15:03:55.056586+0000","last_undegraded":"2024-03-09T15:03:55.056586+0000","last_fullsized":"2024-03-09T15:03:55.056586+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:48:58.583996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.939291+0000","last_change":"2024-03-09T14:42:19.294955+0000","last_active":"2024-03-09T15:04:04.939291+0000","last_peered":"2024-03-09T15:04:04.939291+0000","last_clean":"2024-03-09T15:04:04.939291+0000","last_became_active":"2024-03-09T14:42:19.294108+0000","last_became_peered":"2024-03-09T14:42:19.294108+0000","last_unstale":"2024-03-09T15:04:04.939291+0000","last_undegraded":"2024-03-09T15:04:04.939291+0000","last_fullsized":"2024-03-09T15:04:04.939291+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:48:58.874062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.875733+0000","last_change":"2024-03-09T14:42:15.950610+0000","last_active":"2024-03-09T15:03:24.875733+0000","last_peered":"2024-03-09T15:03:24.875733+0000","last_clean":"2024-03-09T15:03:24.875733+0000","last_became_active":"2024-03-09T14:42:15.947591+0000","last_became_peered":"2024-03-09T14:42:15.947591+0000","last_unstale":"2024-03-09T15:03:24.875733+0000","last_undegraded":"2024-03-09T15:03:24.875733+0000","last_fullsized":"2024-03-09T15:03:24.875733+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:54:57.588230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'56","reported_seq":185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.709771+0000","last_change":"2024-03-09T14:39:57.895126+0000","last_active":"2024-03-09T15:04:09.709771+0000","last_peered":"2024-03-09T15:04:09.709771+0000","last_clean":"2024-03-09T15:04:09.709771+0000","last_became_active":"2024-03-09T14:39:57.894370+0000","last_became_peered":"2024-03-09T14:39:57.894370+0000","last_unstale":"2024-03-09T15:04:09.709771+0000","last_undegraded":"2024-03-09T15:04:09.709771+0000","last_fullsized":"2024-03-09T15:04:09.709771+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:33:51.603400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":182,"num_write":87,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:54.692738+0000","last_change":"2024-03-09T14:49:53.661026+0000","last_active":"2024-03-09T15:03:54.692738+0000","last_peered":"2024-03-09T15:03:54.692738+0000","last_clean":"2024-03-09T15:03:54.692738+0000","last_became_active":"2024-03-09T14:49:53.660291+0000","last_became_peered":"2024-03-09T14:49:53.660291+0000","last_unstale":"2024-03-09T15:03:54.692738+0000","last_undegraded":"2024-03-09T15:03:54.692738+0000","last_fullsized":"2024-03-09T15:03:54.692738+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:48:25.436136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.929184+0000","last_change":"2024-03-09T14:42:19.299865+0000","last_active":"2024-03-09T15:03:24.929184+0000","last_peered":"2024-03-09T15:03:24.929184+0000","last_clean":"2024-03-09T15:03:24.929184+0000","last_became_active":"2024-03-09T14:42:19.294391+0000","last_became_peered":"2024-03-09T14:42:19.294391+0000","last_unstale":"2024-03-09T15:03:24.929184+0000","last_undegraded":"2024-03-09T15:03:24.929184+0000","last_fullsized":"2024-03-09T15:03:24.929184+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:29.593526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.704425+0000","last_change":"2024-03-09T14:42:15.962523+0000","last_active":"2024-03-09T15:04:04.704425+0000","last_peered":"2024-03-09T15:04:04.704425+0000","last_clean":"2024-03-09T15:04:04.704425+0000","last_became_active":"2024-03-09T14:42:15.961751+0000","last_became_peered":"2024-03-09T14:42:15.961751+0000","last_unstale":"2024-03-09T15:04:04.704425+0000","last_undegraded":"2024-03-09T15:04:04.704425+0000","last_fullsized":"2024-03-09T15:04:04.704425+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:20:28.923195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'41","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.940491+0000","last_change":"2024-03-09T14:39:57.900193+0000","last_active":"2024-03-09T15:04:09.940491+0000","last_peered":"2024-03-09T15:04:09.940491+0000","last_clean":"2024-03-09T15:04:09.940491+0000","last_became_active":"2024-03-09T14:39:57.898651+0000","last_became_peered":"2024-03-09T14:39:57.898651+0000","last_unstale":"2024-03-09T15:04:09.940491+0000","last_undegraded":"2024-03-09T15:04:09.940491+0000","last_fullsized":"2024-03-09T15:04:09.940491+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:57:09.093834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":141,"num_write":58,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:54.701644+0000","last_change":"2024-03-09T14:49:53.677983+0000","last_active":"2024-03-09T15:03:54.701644+0000","last_peered":"2024-03-09T15:03:54.701644+0000","last_clean":"2024-03-09T15:03:54.701644+0000","last_became_active":"2024-03-09T14:49:53.677160+0000","last_became_peered":"2024-03-09T14:49:53.677160+0000","last_unstale":"2024-03-09T15:03:54.701644+0000","last_undegraded":"2024-03-09T15:03:54.701644+0000","last_fullsized":"2024-03-09T15:03:54.701644+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:52:56.789373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.939388+0000","last_change":"2024-03-09T14:42:19.298779+0000","last_active":"2024-03-09T15:04:04.939388+0000","last_peered":"2024-03-09T15:04:04.939388+0000","last_clean":"2024-03-09T15:04:04.939388+0000","last_became_active":"2024-03-09T14:42:19.297984+0000","last_became_peered":"2024-03-09T14:42:19.297984+0000","last_unstale":"2024-03-09T15:04:04.939388+0000","last_undegraded":"2024-03-09T15:04:04.939388+0000","last_fullsized":"2024-03-09T15:04:04.939388+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:39.001468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.695173+0000","last_change":"2024-03-09T14:42:15.959256+0000","last_active":"2024-03-09T15:04:04.695173+0000","last_peered":"2024-03-09T15:04:04.695173+0000","last_clean":"2024-03-09T15:04:04.695173+0000","last_became_active":"2024-03-09T14:42:15.958476+0000","last_became_peered":"2024-03-09T14:42:15.958476+0000","last_unstale":"2024-03-09T15:04:04.695173+0000","last_undegraded":"2024-03-09T15:04:04.695173+0000","last_fullsized":"2024-03-09T15:04:04.695173+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:53:52.388607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'111","reported_seq":374,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.696130+0000","last_change":"2024-03-09T14:39:57.873649+0000","last_active":"2024-03-09T15:04:09.696130+0000","last_peered":"2024-03-09T15:04:09.696130+0000","last_clean":"2024-03-09T15:04:09.696130+0000","last_became_active":"2024-03-09T14:39:57.872922+0000","last_became_peered":"2024-03-09T14:39:57.872922+0000","last_unstale":"2024-03-09T15:04:09.696130+0000","last_undegraded":"2024-03-09T15:04:09.696130+0000","last_fullsized":"2024-03-09T15:04:09.696130+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:27:37.326144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":634,"num_read_kb":458,"num_write":138,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:54.882960+0000","last_change":"2024-03-09T14:49:53.652070+0000","last_active":"2024-03-09T15:03:54.882960+0000","last_peered":"2024-03-09T15:03:54.882960+0000","last_clean":"2024-03-09T15:03:54.882960+0000","last_became_active":"2024-03-09T14:49:53.651353+0000","last_became_peered":"2024-03-09T14:49:53.651353+0000","last_unstale":"2024-03-09T15:03:54.882960+0000","last_undegraded":"2024-03-09T15:03:54.882960+0000","last_fullsized":"2024-03-09T15:03:54.882960+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:38.891462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.700677+0000","last_change":"2024-03-09T14:42:19.015145+0000","last_active":"2024-03-09T15:04:04.700677+0000","last_peered":"2024-03-09T15:04:04.700677+0000","last_clean":"2024-03-09T15:04:04.700677+0000","last_became_active":"2024-03-09T14:42:19.011213+0000","last_became_peered":"2024-03-09T14:42:19.011213+0000","last_unstale":"2024-03-09T15:04:04.700677+0000","last_undegraded":"2024-03-09T15:04:04.700677+0000","last_fullsized":"2024-03-09T15:04:04.700677+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:06:20.548710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.743627+0000","last_change":"2024-03-09T14:42:15.975026+0000","last_active":"2024-03-09T15:06:29.743627+0000","last_peered":"2024-03-09T15:06:29.743627+0000","last_clean":"2024-03-09T15:06:29.743627+0000","last_became_active":"2024-03-09T14:42:15.974300+0000","last_became_peered":"2024-03-09T14:42:15.974300+0000","last_unstale":"2024-03-09T15:06:29.743627+0000","last_undegraded":"2024-03-09T15:06:29.743627+0000","last_fullsized":"2024-03-09T15:06:29.743627+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:06.615185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'10","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:29.695997+0000","last_change":"2024-03-09T14:39:57.906220+0000","last_active":"2024-03-09T15:03:29.695997+0000","last_peered":"2024-03-09T15:03:29.695997+0000","last_clean":"2024-03-09T15:03:29.695997+0000","last_became_active":"2024-03-09T14:39:57.905161+0000","last_became_peered":"2024-03-09T14:39:57.905161+0000","last_unstale":"2024-03-09T15:03:29.695997+0000","last_undegraded":"2024-03-09T15:03:29.695997+0000","last_fullsized":"2024-03-09T15:03:29.695997+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:43.275061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.944574+0000","last_change":"2024-03-09T14:49:53.677779+0000","last_active":"2024-03-09T15:04:24.944574+0000","last_peered":"2024-03-09T15:04:24.944574+0000","last_clean":"2024-03-09T15:04:24.944574+0000","last_became_active":"2024-03-09T14:49:53.676180+0000","last_became_peered":"2024-03-09T14:49:53.676180+0000","last_unstale":"2024-03-09T15:04:24.944574+0000","last_undegraded":"2024-03-09T15:04:24.944574+0000","last_fullsized":"2024-03-09T15:04:24.944574+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:48.285352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'15","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:40.084255+0000","last_change":"2024-03-09T14:42:19.015638+0000","last_active":"2024-03-09T15:05:40.084255+0000","last_peered":"2024-03-09T15:05:40.084255+0000","last_clean":"2024-03-09T15:05:40.084255+0000","last_became_active":"2024-03-09T14:42:19.015001+0000","last_became_peered":"2024-03-09T14:42:19.015001+0000","last_unstale":"2024-03-09T15:05:40.084255+0000","last_undegraded":"2024-03-09T15:05:40.084255+0000","last_fullsized":"2024-03-09T15:05:40.084255+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:05.722560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":18444,"num_write":29,"num_write_kb":15365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'8","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:39.721379+0000","last_change":"2024-03-09T14:42:15.937658+0000","last_active":"2024-03-09T15:05:39.721379+0000","last_peered":"2024-03-09T15:05:39.721379+0000","last_clean":"2024-03-09T15:05:39.721379+0000","last_became_active":"2024-03-09T14:42:15.936690+0000","last_became_peered":"2024-03-09T14:42:15.936690+0000","last_unstale":"2024-03-09T15:05:39.721379+0000","last_undegraded":"2024-03-09T15:05:39.721379+0000","last_fullsized":"2024-03-09T15:05:39.721379+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:16:38.693218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'45","reported_seq":154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.693525+0000","last_change":"2024-03-09T14:39:57.900885+0000","last_active":"2024-03-09T15:03:19.693525+0000","last_peered":"2024-03-09T15:03:19.693525+0000","last_clean":"2024-03-09T15:03:19.693525+0000","last_became_active":"2024-03-09T14:39:57.900112+0000","last_became_peered":"2024-03-09T14:39:57.900112+0000","last_unstale":"2024-03-09T15:03:19.693525+0000","last_undegraded":"2024-03-09T15:03:19.693525+0000","last_fullsized":"2024-03-09T15:03:19.693525+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:04:24.272860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":133,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.713253+0000","last_change":"2024-03-09T14:49:53.687062+0000","last_active":"2024-03-09T15:04:24.713253+0000","last_peered":"2024-03-09T15:04:24.713253+0000","last_clean":"2024-03-09T15:04:24.713253+0000","last_became_active":"2024-03-09T14:49:53.683189+0000","last_became_peered":"2024-03-09T14:49:53.683189+0000","last_unstale":"2024-03-09T15:04:24.713253+0000","last_undegraded":"2024-03-09T15:04:24.713253+0000","last_fullsized":"2024-03-09T15:04:24.713253+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:53.571138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:40.084152+0000","last_change":"2024-03-09T14:42:19.009789+0000","last_active":"2024-03-09T15:05:40.084152+0000","last_peered":"2024-03-09T15:05:40.084152+0000","last_clean":"2024-03-09T15:05:40.084152+0000","last_became_active":"2024-03-09T14:42:19.009159+0000","last_became_peered":"2024-03-09T14:42:19.009159+0000","last_unstale":"2024-03-09T15:05:40.084152+0000","last_undegraded":"2024-03-09T15:05:40.084152+0000","last_fullsized":"2024-03-09T15:05:40.084152+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:07:33.321079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'11","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.948498+0000","last_change":"2024-03-09T14:42:15.954296+0000","last_active":"2024-03-09T15:07:02.948498+0000","last_peered":"2024-03-09T15:07:02.948498+0000","last_clean":"2024-03-09T15:07:02.948498+0000","last_became_active":"2024-03-09T14:42:15.953580+0000","last_became_peered":"2024-03-09T14:42:15.953580+0000","last_unstale":"2024-03-09T15:07:02.948498+0000","last_undegraded":"2024-03-09T15:07:02.948498+0000","last_fullsized":"2024-03-09T15:07:02.948498+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:02:21.500373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":25600,"num_write":26,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'39","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.697112+0000","last_change":"2024-03-09T14:39:57.897154+0000","last_active":"2024-03-09T15:03:19.697112+0000","last_peered":"2024-03-09T15:03:19.697112+0000","last_clean":"2024-03-09T15:03:19.697112+0000","last_became_active":"2024-03-09T14:39:57.896549+0000","last_became_peered":"2024-03-09T14:39:57.896549+0000","last_unstale":"2024-03-09T15:03:19.697112+0000","last_undegraded":"2024-03-09T15:03:19.697112+0000","last_fullsized":"2024-03-09T15:03:19.697112+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:01:16.877495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":110,"num_write":67,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.706787+0000","last_change":"2024-03-09T14:49:53.674470+0000","last_active":"2024-03-09T15:03:59.706787+0000","last_peered":"2024-03-09T15:03:59.706787+0000","last_clean":"2024-03-09T15:03:59.706787+0000","last_became_active":"2024-03-09T14:49:53.673345+0000","last_became_peered":"2024-03-09T14:49:53.673345+0000","last_unstale":"2024-03-09T15:03:59.706787+0000","last_undegraded":"2024-03-09T15:03:59.706787+0000","last_fullsized":"2024-03-09T15:03:59.706787+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:18.602619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:39.963872+0000","last_change":"2024-03-09T14:42:19.021679+0000","last_active":"2024-03-09T15:05:39.963872+0000","last_peered":"2024-03-09T15:05:39.963872+0000","last_clean":"2024-03-09T15:05:39.963872+0000","last_became_active":"2024-03-09T14:42:19.020650+0000","last_became_peered":"2024-03-09T14:42:19.020650+0000","last_unstale":"2024-03-09T15:05:39.963872+0000","last_undegraded":"2024-03-09T15:05:39.963872+0000","last_fullsized":"2024-03-09T15:05:39.963872+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:04:12.719156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.688968+0000","last_change":"2024-03-09T14:42:15.959020+0000","last_active":"2024-03-09T15:03:19.688968+0000","last_peered":"2024-03-09T15:03:19.688968+0000","last_clean":"2024-03-09T15:03:19.688968+0000","last_became_active":"2024-03-09T14:42:15.958276+0000","last_became_peered":"2024-03-09T14:42:15.958276+0000","last_unstale":"2024-03-09T15:03:19.688968+0000","last_undegraded":"2024-03-09T15:03:19.688968+0000","last_fullsized":"2024-03-09T15:03:19.688968+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:56:29.405946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'35","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.690399+0000","last_change":"2024-03-09T14:39:57.892474+0000","last_active":"2024-03-09T15:03:19.690399+0000","last_peered":"2024-03-09T15:03:19.690399+0000","last_clean":"2024-03-09T15:03:19.690399+0000","last_became_active":"2024-03-09T14:39:57.891706+0000","last_became_peered":"2024-03-09T14:39:57.891706+0000","last_unstale":"2024-03-09T15:03:19.690399+0000","last_undegraded":"2024-03-09T15:03:19.690399+0000","last_fullsized":"2024-03-09T15:03:19.690399+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:29.216981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":98,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.944492+0000","last_change":"2024-03-09T14:49:53.678730+0000","last_active":"2024-03-09T15:04:24.944492+0000","last_peered":"2024-03-09T15:04:24.944492+0000","last_clean":"2024-03-09T15:04:24.944492+0000","last_became_active":"2024-03-09T14:49:53.670121+0000","last_became_peered":"2024-03-09T14:49:53.670121+0000","last_unstale":"2024-03-09T15:04:24.944492+0000","last_undegraded":"2024-03-09T15:04:24.944492+0000","last_fullsized":"2024-03-09T15:04:24.944492+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:10:05.346364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.688916+0000","last_change":"2024-03-09T14:42:18.993764+0000","last_active":"2024-03-09T15:03:19.688916+0000","last_peered":"2024-03-09T15:03:19.688916+0000","last_clean":"2024-03-09T15:03:19.688916+0000","last_became_active":"2024-03-09T14:42:18.992996+0000","last_became_peered":"2024-03-09T14:42:18.992996+0000","last_unstale":"2024-03-09T15:03:19.688916+0000","last_undegraded":"2024-03-09T15:03:19.688916+0000","last_fullsized":"2024-03-09T15:03:19.688916+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:13:18.645764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"261'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.874329+0000","last_change":"2024-03-09T14:42:15.950801+0000","last_active":"2024-03-09T15:03:19.874329+0000","last_peered":"2024-03-09T15:03:19.874329+0000","last_clean":"2024-03-09T15:03:19.874329+0000","last_became_active":"2024-03-09T14:42:15.950001+0000","last_became_peered":"2024-03-09T14:42:15.950001+0000","last_unstale":"2024-03-09T15:03:19.874329+0000","last_undegraded":"2024-03-09T15:03:19.874329+0000","last_fullsized":"2024-03-09T15:03:19.874329+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:46:50.557868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'55","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.927771+0000","last_change":"2024-03-09T14:39:57.910603+0000","last_active":"2024-03-09T15:03:19.927771+0000","last_peered":"2024-03-09T15:03:19.927771+0000","last_clean":"2024-03-09T15:03:19.927771+0000","last_became_active":"2024-03-09T14:39:57.909827+0000","last_became_peered":"2024-03-09T14:39:57.909827+0000","last_unstale":"2024-03-09T15:03:19.927771+0000","last_undegraded":"2024-03-09T15:03:19.927771+0000","last_fullsized":"2024-03-09T15:03:19.927771+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:39:16.796198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":147,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:59.680775+0000","last_change":"2024-03-09T14:49:53.642413+0000","last_active":"2024-03-09T15:02:59.680775+0000","last_peered":"2024-03-09T15:02:59.680775+0000","last_clean":"2024-03-09T15:02:59.680775+0000","last_became_active":"2024-03-09T14:49:53.641152+0000","last_became_peered":"2024-03-09T14:49:53.641152+0000","last_unstale":"2024-03-09T15:02:59.680775+0000","last_undegraded":"2024-03-09T15:02:59.680775+0000","last_fullsized":"2024-03-09T15:02:59.680775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:14:59.780475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.071597+0000","last_change":"2024-03-09T14:42:19.015582+0000","last_active":"2024-03-09T15:07:04.071597+0000","last_peered":"2024-03-09T15:07:04.071597+0000","last_clean":"2024-03-09T15:07:04.071597+0000","last_became_active":"2024-03-09T14:42:19.013356+0000","last_became_peered":"2024-03-09T14:42:19.013356+0000","last_unstale":"2024-03-09T15:07:04.071597+0000","last_undegraded":"2024-03-09T15:07:04.071597+0000","last_fullsized":"2024-03-09T15:07:04.071597+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:23.724974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.715863+0000","last_change":"2024-03-09T14:42:15.965456+0000","last_active":"2024-03-09T15:04:49.715863+0000","last_peered":"2024-03-09T15:04:49.715863+0000","last_clean":"2024-03-09T15:04:49.715863+0000","last_became_active":"2024-03-09T14:42:15.964591+0000","last_became_peered":"2024-03-09T14:42:15.964591+0000","last_unstale":"2024-03-09T15:04:49.715863+0000","last_undegraded":"2024-03-09T15:04:49.715863+0000","last_fullsized":"2024-03-09T15:04:49.715863+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:37.614168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'15","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:28.710665+0000","last_change":"2024-03-09T14:39:57.901484+0000","last_active":"2024-03-09T15:05:28.710665+0000","last_peered":"2024-03-09T15:05:28.710665+0000","last_clean":"2024-03-09T15:05:28.710665+0000","last_became_active":"2024-03-09T14:39:57.898952+0000","last_became_peered":"2024-03-09T14:39:57.898952+0000","last_unstale":"2024-03-09T15:05:28.710665+0000","last_undegraded":"2024-03-09T15:05:28.710665+0000","last_fullsized":"2024-03-09T15:05:28.710665+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:26:28.443115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":52,"num_write":21,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.694828+0000","last_change":"2024-03-09T14:49:53.654700+0000","last_active":"2024-03-09T15:03:24.694828+0000","last_peered":"2024-03-09T15:03:24.694828+0000","last_clean":"2024-03-09T15:03:24.694828+0000","last_became_active":"2024-03-09T14:49:53.653943+0000","last_became_peered":"2024-03-09T14:49:53.653943+0000","last_unstale":"2024-03-09T15:03:24.694828+0000","last_undegraded":"2024-03-09T15:03:24.694828+0000","last_fullsized":"2024-03-09T15:03:24.694828+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:42:20.322883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.951150+0000","last_change":"2024-03-09T14:42:19.016131+0000","last_active":"2024-03-09T15:04:49.951150+0000","last_peered":"2024-03-09T15:04:49.951150+0000","last_clean":"2024-03-09T15:04:49.951150+0000","last_became_active":"2024-03-09T14:42:19.008729+0000","last_became_peered":"2024-03-09T14:42:19.008729+0000","last_unstale":"2024-03-09T15:04:49.951150+0000","last_undegraded":"2024-03-09T15:04:49.951150+0000","last_fullsized":"2024-03-09T15:04:49.951150+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:26.299678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.705243+0000","last_change":"2024-03-09T14:42:15.979152+0000","last_active":"2024-03-09T15:04:49.705243+0000","last_peered":"2024-03-09T15:04:49.705243+0000","last_clean":"2024-03-09T15:04:49.705243+0000","last_became_active":"2024-03-09T14:42:15.978166+0000","last_became_peered":"2024-03-09T14:42:15.978166+0000","last_unstale":"2024-03-09T15:04:49.705243+0000","last_undegraded":"2024-03-09T15:04:49.705243+0000","last_fullsized":"2024-03-09T15:04:49.705243+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:16.321080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'46","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:44.894221+0000","last_change":"2024-03-09T14:39:57.904419+0000","last_active":"2024-03-09T15:04:44.894221+0000","last_peered":"2024-03-09T15:04:44.894221+0000","last_clean":"2024-03-09T15:04:44.894221+0000","last_became_active":"2024-03-09T14:39:57.904012+0000","last_became_peered":"2024-03-09T14:39:57.904012+0000","last_unstale":"2024-03-09T15:04:44.894221+0000","last_undegraded":"2024-03-09T15:04:44.894221+0000","last_fullsized":"2024-03-09T15:04:44.894221+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:15:51.742502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":131,"num_write":86,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.683364+0000","last_change":"2024-03-09T14:49:53.680169+0000","last_active":"2024-03-09T15:02:54.683364+0000","last_peered":"2024-03-09T15:02:54.683364+0000","last_clean":"2024-03-09T15:02:54.683364+0000","last_became_active":"2024-03-09T14:49:53.678157+0000","last_became_peered":"2024-03-09T14:49:53.678157+0000","last_unstale":"2024-03-09T15:02:54.683364+0000","last_undegraded":"2024-03-09T15:02:54.683364+0000","last_fullsized":"2024-03-09T15:02:54.683364+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:04:53.932617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:50.069668+0000","last_change":"2024-03-09T14:42:19.296270+0000","last_active":"2024-03-09T15:04:50.069668+0000","last_peered":"2024-03-09T15:04:50.069668+0000","last_clean":"2024-03-09T15:04:50.069668+0000","last_became_active":"2024-03-09T14:42:19.295533+0000","last_became_peered":"2024-03-09T14:42:19.295533+0000","last_unstale":"2024-03-09T15:04:50.069668+0000","last_undegraded":"2024-03-09T15:04:50.069668+0000","last_fullsized":"2024-03-09T15:04:50.069668+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:35:31.738225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"261'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.719520+0000","last_change":"2024-03-09T14:42:15.968987+0000","last_active":"2024-03-09T15:04:49.719520+0000","last_peered":"2024-03-09T15:04:49.719520+0000","last_clean":"2024-03-09T15:04:49.719520+0000","last_became_active":"2024-03-09T14:42:15.968323+0000","last_became_peered":"2024-03-09T14:42:15.968323+0000","last_unstale":"2024-03-09T15:04:49.719520+0000","last_undegraded":"2024-03-09T15:04:49.719520+0000","last_fullsized":"2024-03-09T15:04:49.719520+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:52:18.206406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'40","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:44.707473+0000","last_change":"2024-03-09T14:39:57.898866+0000","last_active":"2024-03-09T15:04:44.707473+0000","last_peered":"2024-03-09T15:04:44.707473+0000","last_clean":"2024-03-09T15:04:44.707473+0000","last_became_active":"2024-03-09T14:39:57.898234+0000","last_became_peered":"2024-03-09T14:39:57.898234+0000","last_unstale":"2024-03-09T15:04:44.707473+0000","last_undegraded":"2024-03-09T15:04:44.707473+0000","last_fullsized":"2024-03-09T15:04:44.707473+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:55:57.096082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":111,"num_write":71,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.901778+0000","last_change":"2024-03-09T14:49:53.663589+0000","last_active":"2024-03-09T15:02:54.901778+0000","last_peered":"2024-03-09T15:02:54.901778+0000","last_clean":"2024-03-09T15:02:54.901778+0000","last_became_active":"2024-03-09T14:49:53.662812+0000","last_became_peered":"2024-03-09T14:49:53.662812+0000","last_unstale":"2024-03-09T15:02:54.901778+0000","last_undegraded":"2024-03-09T15:02:54.901778+0000","last_fullsized":"2024-03-09T15:02:54.901778+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:16:14.334955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'6","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.446373+0000","last_change":"2024-03-09T14:42:19.018301+0000","last_active":"2024-03-09T15:07:04.446373+0000","last_peered":"2024-03-09T15:07:04.446373+0000","last_clean":"2024-03-09T15:07:04.446373+0000","last_became_active":"2024-03-09T14:42:19.017434+0000","last_became_peered":"2024-03-09T14:42:19.017434+0000","last_unstale":"2024-03-09T15:07:04.446373+0000","last_undegraded":"2024-03-09T15:07:04.446373+0000","last_fullsized":"2024-03-09T15:07:04.446373+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:08:07.632656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8272,"num_write":11,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.892374+0000","last_change":"2024-03-09T14:42:15.946399+0000","last_active":"2024-03-09T15:07:03.892374+0000","last_peered":"2024-03-09T15:07:03.892374+0000","last_clean":"2024-03-09T15:07:03.892374+0000","last_became_active":"2024-03-09T14:42:15.945565+0000","last_became_peered":"2024-03-09T14:42:15.945565+0000","last_unstale":"2024-03-09T15:07:03.892374+0000","last_undegraded":"2024-03-09T15:07:03.892374+0000","last_fullsized":"2024-03-09T15:07:03.892374+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:05:17.625355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1029,"num_write":10,"num_write_kb":1029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'55","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:44.703996+0000","last_change":"2024-03-09T14:39:57.901411+0000","last_active":"2024-03-09T15:04:44.703996+0000","last_peered":"2024-03-09T15:04:44.703996+0000","last_clean":"2024-03-09T15:04:44.703996+0000","last_became_active":"2024-03-09T14:39:57.900659+0000","last_became_peered":"2024-03-09T14:39:57.900659+0000","last_unstale":"2024-03-09T15:04:44.703996+0000","last_undegraded":"2024-03-09T15:04:44.703996+0000","last_fullsized":"2024-03-09T15:04:44.703996+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:14.811571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":161,"num_write":89,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.929301+0000","last_change":"2024-03-09T14:49:53.683045+0000","last_active":"2024-03-09T15:03:24.929301+0000","last_peered":"2024-03-09T15:03:24.929301+0000","last_clean":"2024-03-09T15:03:24.929301+0000","last_became_active":"2024-03-09T14:49:53.678822+0000","last_became_peered":"2024-03-09T14:49:53.678822+0000","last_unstale":"2024-03-09T15:03:24.929301+0000","last_undegraded":"2024-03-09T15:03:24.929301+0000","last_fullsized":"2024-03-09T15:03:24.929301+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:54.757256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.699298+0000","last_change":"2024-03-09T14:42:19.021170+0000","last_active":"2024-03-09T15:03:59.699298+0000","last_peered":"2024-03-09T15:03:59.699298+0000","last_clean":"2024-03-09T15:03:59.699298+0000","last_became_active":"2024-03-09T14:42:19.016262+0000","last_became_peered":"2024-03-09T14:42:19.016262+0000","last_unstale":"2024-03-09T15:03:59.699298+0000","last_undegraded":"2024-03-09T15:03:59.699298+0000","last_fullsized":"2024-03-09T15:03:59.699298+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:11:24.272229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'1","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.706547+0000","last_change":"2024-03-09T14:42:15.964302+0000","last_active":"2024-03-09T15:03:59.706547+0000","last_peered":"2024-03-09T15:03:59.706547+0000","last_clean":"2024-03-09T15:03:59.706547+0000","last_became_active":"2024-03-09T14:42:15.963496+0000","last_became_peered":"2024-03-09T14:42:15.963496+0000","last_unstale":"2024-03-09T15:03:59.706547+0000","last_undegraded":"2024-03-09T15:03:59.706547+0000","last_fullsized":"2024-03-09T15:03:59.706547+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:49:10.732358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3217,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'33","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:44.717850+0000","last_change":"2024-03-09T14:39:57.879692+0000","last_active":"2024-03-09T15:04:44.717850+0000","last_peered":"2024-03-09T15:04:44.717850+0000","last_clean":"2024-03-09T15:04:44.717850+0000","last_became_active":"2024-03-09T14:39:57.879068+0000","last_became_peered":"2024-03-09T14:39:57.879068+0000","last_unstale":"2024-03-09T15:04:44.717850+0000","last_undegraded":"2024-03-09T15:04:44.717850+0000","last_fullsized":"2024-03-09T15:04:44.717850+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:28:08.950204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":89,"num_write":57,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:29.696105+0000","last_change":"2024-03-09T14:49:53.666848+0000","last_active":"2024-03-09T15:03:29.696105+0000","last_peered":"2024-03-09T15:03:29.696105+0000","last_clean":"2024-03-09T15:03:29.696105+0000","last_became_active":"2024-03-09T14:49:53.666088+0000","last_became_peered":"2024-03-09T14:49:53.666088+0000","last_unstale":"2024-03-09T15:03:29.696105+0000","last_undegraded":"2024-03-09T15:03:29.696105+0000","last_fullsized":"2024-03-09T15:03:29.696105+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:24:04.438357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.702889+0000","last_change":"2024-03-09T14:42:19.288789+0000","last_active":"2024-03-09T15:03:59.702889+0000","last_peered":"2024-03-09T15:03:59.702889+0000","last_clean":"2024-03-09T15:03:59.702889+0000","last_became_active":"2024-03-09T14:42:19.288155+0000","last_became_peered":"2024-03-09T14:42:19.288155+0000","last_unstale":"2024-03-09T15:03:59.702889+0000","last_undegraded":"2024-03-09T15:03:59.702889+0000","last_fullsized":"2024-03-09T15:03:59.702889+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:36:14.730415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:00.057676+0000","last_change":"2024-03-09T14:42:15.962724+0000","last_active":"2024-03-09T15:04:00.057676+0000","last_peered":"2024-03-09T15:04:00.057676+0000","last_clean":"2024-03-09T15:04:00.057676+0000","last_became_active":"2024-03-09T14:42:15.962004+0000","last_became_peered":"2024-03-09T14:42:15.962004+0000","last_unstale":"2024-03-09T15:04:00.057676+0000","last_undegraded":"2024-03-09T15:04:00.057676+0000","last_fullsized":"2024-03-09T15:04:00.057676+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:30.363544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.875140+0000","last_change":"2024-03-09T14:39:57.906667+0000","last_active":"2024-03-09T15:04:04.875140+0000","last_peered":"2024-03-09T15:04:04.875140+0000","last_clean":"2024-03-09T15:04:04.875140+0000","last_became_active":"2024-03-09T14:39:57.906043+0000","last_became_peered":"2024-03-09T14:39:57.906043+0000","last_unstale":"2024-03-09T15:04:04.875140+0000","last_undegraded":"2024-03-09T15:04:04.875140+0000","last_fullsized":"2024-03-09T15:04:04.875140+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:36.853805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":86,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.694884+0000","last_change":"2024-03-09T14:49:53.666880+0000","last_active":"2024-03-09T15:03:24.694884+0000","last_peered":"2024-03-09T15:03:24.694884+0000","last_clean":"2024-03-09T15:03:24.694884+0000","last_became_active":"2024-03-09T14:49:53.666251+0000","last_became_peered":"2024-03-09T14:49:53.666251+0000","last_unstale":"2024-03-09T15:03:24.694884+0000","last_undegraded":"2024-03-09T15:03:24.694884+0000","last_fullsized":"2024-03-09T15:03:24.694884+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:12:56.088402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:50.069510+0000","last_change":"2024-03-09T14:42:18.999259+0000","last_active":"2024-03-09T15:04:50.069510+0000","last_peered":"2024-03-09T15:04:50.069510+0000","last_clean":"2024-03-09T15:04:50.069510+0000","last_became_active":"2024-03-09T14:42:18.998145+0000","last_became_peered":"2024-03-09T14:42:18.998145+0000","last_unstale":"2024-03-09T15:04:50.069510+0000","last_undegraded":"2024-03-09T15:04:50.069510+0000","last_fullsized":"2024-03-09T15:04:50.069510+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:56:21.105602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:14.739716+0000","last_change":"2024-03-09T14:42:15.974356+0000","last_active":"2024-03-09T15:06:14.739716+0000","last_peered":"2024-03-09T15:06:14.739716+0000","last_clean":"2024-03-09T15:06:14.739716+0000","last_became_active":"2024-03-09T14:42:15.973793+0000","last_became_peered":"2024-03-09T14:42:15.973793+0000","last_unstale":"2024-03-09T15:06:14.739716+0000","last_undegraded":"2024-03-09T15:06:14.739716+0000","last_fullsized":"2024-03-09T15:06:14.739716+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:01:29.081317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'18","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.934890+0000","last_change":"2024-03-09T14:39:57.900299+0000","last_active":"2024-03-09T15:03:49.934890+0000","last_peered":"2024-03-09T15:03:49.934890+0000","last_clean":"2024-03-09T15:03:49.934890+0000","last_became_active":"2024-03-09T14:39:57.895347+0000","last_became_peered":"2024-03-09T14:39:57.895347+0000","last_unstale":"2024-03-09T15:03:49.934890+0000","last_undegraded":"2024-03-09T15:03:49.934890+0000","last_fullsized":"2024-03-09T15:03:49.934890+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:35.906733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":49,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.698327+0000","last_change":"2024-03-09T14:49:53.680516+0000","last_active":"2024-03-09T15:03:24.698327+0000","last_peered":"2024-03-09T15:03:24.698327+0000","last_clean":"2024-03-09T15:03:24.698327+0000","last_became_active":"2024-03-09T14:49:53.676907+0000","last_became_peered":"2024-03-09T14:49:53.676907+0000","last_unstale":"2024-03-09T15:03:24.698327+0000","last_undegraded":"2024-03-09T15:03:24.698327+0000","last_fullsized":"2024-03-09T15:03:24.698327+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:27.679077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.705594+0000","last_change":"2024-03-09T14:42:29.985480+0000","last_active":"2024-03-09T15:04:09.705594+0000","last_peered":"2024-03-09T15:04:09.705594+0000","last_clean":"2024-03-09T15:04:09.705594+0000","last_became_active":"2024-03-09T14:42:29.984595+0000","last_became_peered":"2024-03-09T14:42:29.984595+0000","last_unstale":"2024-03-09T15:04:09.705594+0000","last_undegraded":"2024-03-09T15:04:09.705594+0000","last_fullsized":"2024-03-09T15:04:09.705594+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:49:17.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.710416+0000","last_change":"2024-03-09T14:42:15.942495+0000","last_active":"2024-03-09T15:04:49.710416+0000","last_peered":"2024-03-09T15:04:49.710416+0000","last_clean":"2024-03-09T15:04:49.710416+0000","last_became_active":"2024-03-09T14:42:15.941583+0000","last_became_peered":"2024-03-09T14:42:15.941583+0000","last_unstale":"2024-03-09T15:04:49.710416+0000","last_undegraded":"2024-03-09T15:04:49.710416+0000","last_fullsized":"2024-03-09T15:04:49.710416+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:58:21.145613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'16","reported_seq":88,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.695726+0000","last_change":"2024-03-09T14:39:57.886088+0000","last_active":"2024-03-09T15:03:49.695726+0000","last_peered":"2024-03-09T15:03:49.695726+0000","last_clean":"2024-03-09T15:03:49.695726+0000","last_became_active":"2024-03-09T14:39:57.884479+0000","last_became_peered":"2024-03-09T14:39:57.884479+0000","last_unstale":"2024-03-09T15:03:49.695726+0000","last_undegraded":"2024-03-09T15:03:49.695726+0000","last_fullsized":"2024-03-09T15:03:49.695726+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:06:06.518769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":55,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.710399+0000","last_change":"2024-03-09T14:49:53.664600+0000","last_active":"2024-03-09T15:04:29.710399+0000","last_peered":"2024-03-09T15:04:29.710399+0000","last_clean":"2024-03-09T15:04:29.710399+0000","last_became_active":"2024-03-09T14:49:53.663825+0000","last_became_peered":"2024-03-09T14:49:53.663825+0000","last_unstale":"2024-03-09T15:04:29.710399+0000","last_undegraded":"2024-03-09T15:04:29.710399+0000","last_fullsized":"2024-03-09T15:04:29.710399+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:38:11.359908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:14.696135+0000","last_change":"2024-03-09T14:42:18.996069+0000","last_active":"2024-03-09T15:03:14.696135+0000","last_peered":"2024-03-09T15:03:14.696135+0000","last_clean":"2024-03-09T15:03:14.696135+0000","last_became_active":"2024-03-09T14:42:18.995340+0000","last_became_peered":"2024-03-09T14:42:18.995340+0000","last_unstale":"2024-03-09T15:03:14.696135+0000","last_undegraded":"2024-03-09T15:03:14.696135+0000","last_fullsized":"2024-03-09T15:03:14.696135+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:53.974508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.905451+0000","last_change":"2024-03-09T14:42:15.963780+0000","last_active":"2024-03-09T15:03:09.905451+0000","last_peered":"2024-03-09T15:03:09.905451+0000","last_clean":"2024-03-09T15:03:09.905451+0000","last_became_active":"2024-03-09T14:42:15.963155+0000","last_became_peered":"2024-03-09T14:42:15.963155+0000","last_unstale":"2024-03-09T15:03:09.905451+0000","last_undegraded":"2024-03-09T15:03:09.905451+0000","last_fullsized":"2024-03-09T15:03:09.905451+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:17:06.912120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'33","reported_seq":127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.704256+0000","last_change":"2024-03-09T14:39:57.889247+0000","last_active":"2024-03-09T15:03:49.704256+0000","last_peered":"2024-03-09T15:03:49.704256+0000","last_clean":"2024-03-09T15:03:49.704256+0000","last_became_active":"2024-03-09T14:39:57.888467+0000","last_became_peered":"2024-03-09T14:39:57.888467+0000","last_unstale":"2024-03-09T15:03:49.704256+0000","last_undegraded":"2024-03-09T15:03:49.704256+0000","last_fullsized":"2024-03-09T15:03:49.704256+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:30:37.652546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":106,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.890833+0000","last_change":"2024-03-09T14:49:53.659073+0000","last_active":"2024-03-09T15:04:29.890833+0000","last_peered":"2024-03-09T15:04:29.890833+0000","last_clean":"2024-03-09T15:04:29.890833+0000","last_became_active":"2024-03-09T14:49:53.658183+0000","last_became_peered":"2024-03-09T14:49:53.658183+0000","last_unstale":"2024-03-09T15:04:29.890833+0000","last_undegraded":"2024-03-09T15:04:29.890833+0000","last_fullsized":"2024-03-09T15:04:29.890833+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:41:48.538335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:14.726025+0000","last_change":"2024-03-09T14:42:19.295167+0000","last_active":"2024-03-09T15:05:14.726025+0000","last_peered":"2024-03-09T15:05:14.726025+0000","last_clean":"2024-03-09T15:05:14.726025+0000","last_became_active":"2024-03-09T14:42:19.294401+0000","last_became_peered":"2024-03-09T14:42:19.294401+0000","last_unstale":"2024-03-09T15:05:14.726025+0000","last_undegraded":"2024-03-09T15:05:14.726025+0000","last_fullsized":"2024-03-09T15:05:14.726025+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:56:05.250854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'7","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.370131+0000","last_change":"2024-03-09T14:42:15.975168+0000","last_active":"2024-03-09T15:07:04.370131+0000","last_peered":"2024-03-09T15:07:04.370131+0000","last_clean":"2024-03-09T15:07:04.370131+0000","last_became_active":"2024-03-09T14:42:15.974493+0000","last_became_peered":"2024-03-09T14:42:15.974493+0000","last_unstale":"2024-03-09T15:07:04.370131+0000","last_undegraded":"2024-03-09T15:07:04.370131+0000","last_fullsized":"2024-03-09T15:07:04.370131+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:49:53.666199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5160,"num_write":12,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'28","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.695916+0000","last_change":"2024-03-09T14:39:57.907522+0000","last_active":"2024-03-09T15:03:49.695916+0000","last_peered":"2024-03-09T15:03:49.695916+0000","last_clean":"2024-03-09T15:03:49.695916+0000","last_became_active":"2024-03-09T14:39:57.907009+0000","last_became_peered":"2024-03-09T14:39:57.907009+0000","last_unstale":"2024-03-09T15:03:49.695916+0000","last_undegraded":"2024-03-09T15:03:49.695916+0000","last_fullsized":"2024-03-09T15:03:49.695916+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:27:52.279130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":74,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:55.056453+0000","last_change":"2024-03-09T14:49:53.681028+0000","last_active":"2024-03-09T15:03:55.056453+0000","last_peered":"2024-03-09T15:03:55.056453+0000","last_clean":"2024-03-09T15:03:55.056453+0000","last_became_active":"2024-03-09T14:49:53.680477+0000","last_became_peered":"2024-03-09T14:49:53.680477+0000","last_unstale":"2024-03-09T15:03:55.056453+0000","last_undegraded":"2024-03-09T15:03:55.056453+0000","last_fullsized":"2024-03-09T15:03:55.056453+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:50.745753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.703193+0000","last_change":"2024-03-09T14:42:19.290124+0000","last_active":"2024-03-09T15:03:59.703193+0000","last_peered":"2024-03-09T15:03:59.703193+0000","last_clean":"2024-03-09T15:03:59.703193+0000","last_became_active":"2024-03-09T14:42:19.289487+0000","last_became_peered":"2024-03-09T14:42:19.289487+0000","last_unstale":"2024-03-09T15:03:59.703193+0000","last_undegraded":"2024-03-09T15:03:59.703193+0000","last_fullsized":"2024-03-09T15:03:59.703193+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:53:33.609180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.884266+0000","last_change":"2024-03-09T14:42:15.957344+0000","last_active":"2024-03-09T15:03:59.884266+0000","last_peered":"2024-03-09T15:03:59.884266+0000","last_clean":"2024-03-09T15:03:59.884266+0000","last_became_active":"2024-03-09T14:42:15.956648+0000","last_became_peered":"2024-03-09T14:42:15.956648+0000","last_unstale":"2024-03-09T15:03:59.884266+0000","last_undegraded":"2024-03-09T15:03:59.884266+0000","last_fullsized":"2024-03-09T15:03:59.884266+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:56:53.168125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'62","reported_seq":198,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:59.903168+0000","last_change":"2024-03-09T14:39:57.906130+0000","last_active":"2024-03-09T15:02:59.903168+0000","last_peered":"2024-03-09T15:02:59.903168+0000","last_clean":"2024-03-09T15:02:59.903168+0000","last_became_active":"2024-03-09T14:39:57.905410+0000","last_became_peered":"2024-03-09T14:39:57.905410+0000","last_unstale":"2024-03-09T15:02:59.903168+0000","last_undegraded":"2024-03-09T15:02:59.903168+0000","last_fullsized":"2024-03-09T15:02:59.903168+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:50:45.243291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":193,"num_write":94,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.706106+0000","last_change":"2024-03-09T14:49:53.658895+0000","last_active":"2024-03-09T15:04:29.706106+0000","last_peered":"2024-03-09T15:04:29.706106+0000","last_clean":"2024-03-09T15:04:29.706106+0000","last_became_active":"2024-03-09T14:49:53.658190+0000","last_became_peered":"2024-03-09T14:49:53.658190+0000","last_unstale":"2024-03-09T15:04:29.706106+0000","last_undegraded":"2024-03-09T15:04:29.706106+0000","last_fullsized":"2024-03-09T15:04:29.706106+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:31:23.260028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'5","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:09.727994+0000","last_change":"2024-03-09T14:42:19.020830+0000","last_active":"2024-03-09T15:06:09.727994+0000","last_peered":"2024-03-09T15:06:09.727994+0000","last_clean":"2024-03-09T15:06:09.727994+0000","last_became_active":"2024-03-09T14:42:19.013977+0000","last_became_peered":"2024-03-09T14:42:19.013977+0000","last_unstale":"2024-03-09T15:06:09.727994+0000","last_undegraded":"2024-03-09T15:06:09.727994+0000","last_fullsized":"2024-03-09T15:06:09.727994+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:02:04.141033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":5,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.703218+0000","last_change":"2024-03-09T14:42:15.961048+0000","last_active":"2024-03-09T15:03:59.703218+0000","last_peered":"2024-03-09T15:03:59.703218+0000","last_clean":"2024-03-09T15:03:59.703218+0000","last_became_active":"2024-03-09T14:42:15.960225+0000","last_became_peered":"2024-03-09T14:42:15.960225+0000","last_unstale":"2024-03-09T15:03:59.703218+0000","last_undegraded":"2024-03-09T15:03:59.703218+0000","last_fullsized":"2024-03-09T15:03:59.703218+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:20:39.859217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'130","reported_seq":431,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:00.071914+0000","last_change":"2024-03-09T14:39:57.893265+0000","last_active":"2024-03-09T15:05:00.071914+0000","last_peered":"2024-03-09T15:05:00.071914+0000","last_clean":"2024-03-09T15:05:00.071914+0000","last_became_active":"2024-03-09T14:39:57.892592+0000","last_became_peered":"2024-03-09T14:39:57.892592+0000","last_unstale":"2024-03-09T15:05:00.071914+0000","last_undegraded":"2024-03-09T15:05:00.071914+0000","last_fullsized":"2024-03-09T15:05:00.071914+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:48:11.422790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":739,"num_read_kb":529,"num_write":173,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.679735+0000","last_change":"2024-03-09T14:49:53.672983+0000","last_active":"2024-03-09T15:02:54.679735+0000","last_peered":"2024-03-09T15:02:54.679735+0000","last_clean":"2024-03-09T15:02:54.679735+0000","last_became_active":"2024-03-09T14:49:53.672292+0000","last_became_peered":"2024-03-09T14:49:53.672292+0000","last_unstale":"2024-03-09T15:02:54.679735+0000","last_undegraded":"2024-03-09T15:02:54.679735+0000","last_fullsized":"2024-03-09T15:02:54.679735+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:45:38.980243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:10.046246+0000","last_change":"2024-03-09T14:42:19.004206+0000","last_active":"2024-03-09T15:03:10.046246+0000","last_peered":"2024-03-09T15:03:10.046246+0000","last_clean":"2024-03-09T15:03:10.046246+0000","last_became_active":"2024-03-09T14:42:19.002083+0000","last_became_peered":"2024-03-09T14:42:19.002083+0000","last_unstale":"2024-03-09T15:03:10.046246+0000","last_undegraded":"2024-03-09T15:03:10.046246+0000","last_fullsized":"2024-03-09T15:03:10.046246+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:33.779863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'5","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.710240+0000","last_change":"2024-03-09T14:42:15.976503+0000","last_active":"2024-03-09T15:04:29.710240+0000","last_peered":"2024-03-09T15:04:29.710240+0000","last_clean":"2024-03-09T15:04:29.710240+0000","last_became_active":"2024-03-09T14:42:15.975956+0000","last_became_peered":"2024-03-09T14:42:15.975956+0000","last_unstale":"2024-03-09T15:04:29.710240+0000","last_undegraded":"2024-03-09T15:04:29.710240+0000","last_fullsized":"2024-03-09T15:04:29.710240+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:51:51.535147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'35","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.897602+0000","last_change":"2024-03-09T14:39:57.887500+0000","last_active":"2024-03-09T15:04:59.897602+0000","last_peered":"2024-03-09T15:04:59.897602+0000","last_clean":"2024-03-09T15:04:59.897602+0000","last_became_active":"2024-03-09T14:39:57.886792+0000","last_became_peered":"2024-03-09T14:39:57.886792+0000","last_unstale":"2024-03-09T15:04:59.897602+0000","last_undegraded":"2024-03-09T15:04:59.897602+0000","last_fullsized":"2024-03-09T15:04:59.897602+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:48:32.831728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":107,"num_write":66,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.691638+0000","last_change":"2024-03-09T14:49:53.687783+0000","last_active":"2024-03-09T15:02:54.691638+0000","last_peered":"2024-03-09T15:02:54.691638+0000","last_clean":"2024-03-09T15:02:54.691638+0000","last_became_active":"2024-03-09T14:49:53.683703+0000","last_became_peered":"2024-03-09T14:49:53.683703+0000","last_unstale":"2024-03-09T15:02:54.691638+0000","last_undegraded":"2024-03-09T15:02:54.691638+0000","last_fullsized":"2024-03-09T15:02:54.691638+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:03:26.499909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.916629+0000","last_change":"2024-03-09T14:42:19.014096+0000","last_active":"2024-03-09T15:06:24.916629+0000","last_peered":"2024-03-09T15:06:24.916629+0000","last_clean":"2024-03-09T15:06:24.916629+0000","last_became_active":"2024-03-09T14:42:19.013372+0000","last_became_peered":"2024-03-09T14:42:19.013372+0000","last_unstale":"2024-03-09T15:06:24.916629+0000","last_undegraded":"2024-03-09T15:06:24.916629+0000","last_fullsized":"2024-03-09T15:06:24.916629+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:33:04.031449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"261'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.905329+0000","last_change":"2024-03-09T14:42:15.955016+0000","last_active":"2024-03-09T15:03:09.905329+0000","last_peered":"2024-03-09T15:03:09.905329+0000","last_clean":"2024-03-09T15:03:09.905329+0000","last_became_active":"2024-03-09T14:42:15.954274+0000","last_became_peered":"2024-03-09T14:42:15.954274+0000","last_unstale":"2024-03-09T15:03:09.905329+0000","last_undegraded":"2024-03-09T15:03:09.905329+0000","last_fullsized":"2024-03-09T15:03:09.905329+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:32.985487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'59","reported_seq":199,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.712470+0000","last_change":"2024-03-09T14:39:57.902294+0000","last_active":"2024-03-09T15:04:59.712470+0000","last_peered":"2024-03-09T15:04:59.712470+0000","last_clean":"2024-03-09T15:04:59.712470+0000","last_became_active":"2024-03-09T14:39:57.901599+0000","last_became_peered":"2024-03-09T14:39:57.901599+0000","last_unstale":"2024-03-09T15:04:59.712470+0000","last_undegraded":"2024-03-09T15:04:59.712470+0000","last_fullsized":"2024-03-09T15:04:59.712470+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:02:52.013131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":206,"num_write":96,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.714264+0000","last_change":"2024-03-09T14:49:53.681958+0000","last_active":"2024-03-09T15:04:29.714264+0000","last_peered":"2024-03-09T15:04:29.714264+0000","last_clean":"2024-03-09T15:04:29.714264+0000","last_became_active":"2024-03-09T14:49:53.681327+0000","last_became_peered":"2024-03-09T14:49:53.681327+0000","last_unstale":"2024-03-09T15:04:29.714264+0000","last_undegraded":"2024-03-09T15:04:29.714264+0000","last_fullsized":"2024-03-09T15:04:29.714264+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:41:14.532324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.686795+0000","last_change":"2024-03-09T14:42:19.020053+0000","last_active":"2024-03-09T15:03:09.686795+0000","last_peered":"2024-03-09T15:03:09.686795+0000","last_clean":"2024-03-09T15:03:09.686795+0000","last_became_active":"2024-03-09T14:42:19.019151+0000","last_became_peered":"2024-03-09T14:42:19.019151+0000","last_unstale":"2024-03-09T15:03:09.686795+0000","last_undegraded":"2024-03-09T15:03:09.686795+0000","last_fullsized":"2024-03-09T15:03:09.686795+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:33:06.100480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:10.046324+0000","last_change":"2024-03-09T14:42:15.960915+0000","last_active":"2024-03-09T15:03:10.046324+0000","last_peered":"2024-03-09T15:03:10.046324+0000","last_clean":"2024-03-09T15:03:10.046324+0000","last_became_active":"2024-03-09T14:42:15.959503+0000","last_became_peered":"2024-03-09T14:42:15.959503+0000","last_unstale":"2024-03-09T15:03:10.046324+0000","last_undegraded":"2024-03-09T15:03:10.046324+0000","last_fullsized":"2024-03-09T15:03:10.046324+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:18.018358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'13","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.710516+0000","last_change":"2024-03-09T14:39:57.896340+0000","last_active":"2024-03-09T15:04:59.710516+0000","last_peered":"2024-03-09T15:04:59.710516+0000","last_clean":"2024-03-09T15:04:59.710516+0000","last_became_active":"2024-03-09T14:39:57.895579+0000","last_became_peered":"2024-03-09T14:39:57.895579+0000","last_unstale":"2024-03-09T15:04:59.710516+0000","last_undegraded":"2024-03-09T15:04:59.710516+0000","last_fullsized":"2024-03-09T15:04:59.710516+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:50.092894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:34.711774+0000","last_change":"2024-03-09T14:49:53.681449+0000","last_active":"2024-03-09T15:04:34.711774+0000","last_peered":"2024-03-09T15:04:34.711774+0000","last_clean":"2024-03-09T15:04:34.711774+0000","last_became_active":"2024-03-09T14:49:53.680782+0000","last_became_peered":"2024-03-09T14:49:53.680782+0000","last_unstale":"2024-03-09T15:04:34.711774+0000","last_undegraded":"2024-03-09T15:04:34.711774+0000","last_fullsized":"2024-03-09T15:04:34.711774+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:47:13.858756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'1","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.688046+0000","last_change":"2024-03-09T14:42:19.021910+0000","last_active":"2024-03-09T15:03:09.688046+0000","last_peered":"2024-03-09T15:03:09.688046+0000","last_clean":"2024-03-09T15:03:09.688046+0000","last_became_active":"2024-03-09T14:42:19.020789+0000","last_became_peered":"2024-03-09T14:42:19.020789+0000","last_unstale":"2024-03-09T15:03:09.688046+0000","last_undegraded":"2024-03-09T15:03:09.688046+0000","last_fullsized":"2024-03-09T15:03:09.688046+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:45:01.147814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3217,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'7","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:14.714197+0000","last_change":"2024-03-09T14:42:15.961112+0000","last_active":"2024-03-09T15:05:14.714197+0000","last_peered":"2024-03-09T15:05:14.714197+0000","last_clean":"2024-03-09T15:05:14.714197+0000","last_became_active":"2024-03-09T14:42:15.960341+0000","last_became_peered":"2024-03-09T14:42:15.960341+0000","last_unstale":"2024-03-09T15:05:14.714197+0000","last_undegraded":"2024-03-09T15:05:14.714197+0000","last_fullsized":"2024-03-09T15:05:14.714197+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:19:05.030621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":20522,"num_write":11,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'42","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.705495+0000","last_change":"2024-03-09T14:39:57.898959+0000","last_active":"2024-03-09T15:04:09.705495+0000","last_peered":"2024-03-09T15:04:09.705495+0000","last_clean":"2024-03-09T15:04:09.705495+0000","last_became_active":"2024-03-09T14:39:57.898267+0000","last_became_peered":"2024-03-09T14:39:57.898267+0000","last_unstale":"2024-03-09T15:04:09.705495+0000","last_undegraded":"2024-03-09T15:04:09.705495+0000","last_fullsized":"2024-03-09T15:04:09.705495+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:00:24.847765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":119,"num_write":82,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'286","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.666522+0000","last_change":"2024-03-09T14:28:53.624341+0000","last_active":"2024-03-09T15:07:04.666522+0000","last_peered":"2024-03-09T15:07:04.666522+0000","last_clean":"2024-03-09T15:07:04.666522+0000","last_became_active":"2024-03-09T14:28:53.623701+0000","last_became_peered":"2024-03-09T14:28:53.623701+0000","last_unstale":"2024-03-09T15:07:04.666522+0000","last_undegraded":"2024-03-09T15:07:04.666522+0000","last_fullsized":"2024-03-09T15:07:04.666522+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:38.200914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5567709,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":742,"num_read_kb":36473,"num_write":1125,"num_write_kb":31503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'692","reported_seq":2207,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.442129+0000","last_change":"2024-03-09T14:28:55.575692+0000","last_active":"2024-03-09T15:06:42.442129+0000","last_peered":"2024-03-09T15:06:42.442129+0000","last_clean":"2024-03-09T15:06:42.442129+0000","last_became_active":"2024-03-09T14:28:55.574984+0000","last_became_peered":"2024-03-09T14:28:55.574984+0000","last_unstale":"2024-03-09T15:06:42.442129+0000","last_undegraded":"2024-03-09T15:06:42.442129+0000","last_fullsized":"2024-03-09T15:06:42.442129+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:07.026587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3313,"num_read_kb":2995,"num_write":917,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'294","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.023242+0000","last_change":"2024-03-09T14:28:53.626962+0000","last_active":"2024-03-09T15:07:05.023242+0000","last_peered":"2024-03-09T15:07:05.023242+0000","last_clean":"2024-03-09T15:07:05.023242+0000","last_became_active":"2024-03-09T14:28:53.626490+0000","last_became_peered":"2024-03-09T14:28:53.626490+0000","last_unstale":"2024-03-09T15:07:05.023242+0000","last_undegraded":"2024-03-09T15:07:05.023242+0000","last_fullsized":"2024-03-09T15:07:05.023242+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:16:05.659643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5265861,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":455,"num_read_kb":36382,"num_write":1092,"num_write_kb":36054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'348","reported_seq":1729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.522825+0000","last_change":"2024-03-09T14:28:55.592370+0000","last_active":"2024-03-09T15:06:32.522825+0000","last_peered":"2024-03-09T15:06:32.522825+0000","last_clean":"2024-03-09T15:06:32.522825+0000","last_became_active":"2024-03-09T14:28:55.591640+0000","last_became_peered":"2024-03-09T14:28:55.591640+0000","last_unstale":"2024-03-09T15:06:32.522825+0000","last_undegraded":"2024-03-09T15:06:32.522825+0000","last_fullsized":"2024-03-09T15:06:32.522825+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:10.597479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1906,"num_read_kb":1805,"num_write":411,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'317","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.871014+0000","last_change":"2024-03-09T14:29:28.828234+0000","last_active":"2024-03-09T15:07:04.871014+0000","last_peered":"2024-03-09T15:07:04.871014+0000","last_clean":"2024-03-09T15:07:04.871014+0000","last_became_active":"2024-03-09T14:29:28.827096+0000","last_became_peered":"2024-03-09T14:29:28.827096+0000","last_unstale":"2024-03-09T15:07:04.871014+0000","last_undegraded":"2024-03-09T15:07:04.871014+0000","last_fullsized":"2024-03-09T15:07:04.871014+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:43.226590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269082,"num_objects":19,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":576,"num_read_kb":23096,"num_write":1220,"num_write_kb":39906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,7],"acting":[3,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"264'398","reported_seq":1882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.439715+0000","last_change":"2024-03-09T14:28:55.571747+0000","last_active":"2024-03-09T15:06:42.439715+0000","last_peered":"2024-03-09T15:06:42.439715+0000","last_clean":"2024-03-09T15:06:42.439715+0000","last_became_active":"2024-03-09T14:28:55.570930+0000","last_became_peered":"2024-03-09T14:28:55.570930+0000","last_unstale":"2024-03-09T15:06:42.439715+0000","last_undegraded":"2024-03-09T15:06:42.439715+0000","last_fullsized":"2024-03-09T15:06:42.439715+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:13.704377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2164,"num_read_kb":2043,"num_write":472,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'286","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.822098+0000","last_change":"2024-03-09T14:28:53.605127+0000","last_active":"2024-03-09T15:07:04.822098+0000","last_peered":"2024-03-09T15:07:04.822098+0000","last_clean":"2024-03-09T15:07:04.822098+0000","last_became_active":"2024-03-09T14:28:53.603454+0000","last_became_peered":"2024-03-09T14:28:53.603454+0000","last_unstale":"2024-03-09T15:07:04.822098+0000","last_undegraded":"2024-03-09T15:07:04.822098+0000","last_fullsized":"2024-03-09T15:07:04.822098+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:11:31.442216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":508519,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":466,"num_read_kb":6538,"num_write":1174,"num_write_kb":12238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'433","reported_seq":1935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:03.127553+0000","last_change":"2024-03-09T14:28:55.611079+0000","last_active":"2024-03-09T15:06:03.127553+0000","last_peered":"2024-03-09T15:06:03.127553+0000","last_clean":"2024-03-09T15:06:03.127553+0000","last_became_active":"2024-03-09T14:28:55.610360+0000","last_became_peered":"2024-03-09T14:28:55.610360+0000","last_unstale":"2024-03-09T15:06:03.127553+0000","last_undegraded":"2024-03-09T15:06:03.127553+0000","last_fullsized":"2024-03-09T15:06:03.127553+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:29:26.385739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2375,"num_read_kb":2224,"num_write":558,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'317","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.651479+0000","last_change":"2024-03-09T14:28:53.624123+0000","last_active":"2024-03-09T15:07:04.651479+0000","last_peered":"2024-03-09T15:07:04.651479+0000","last_clean":"2024-03-09T15:07:04.651479+0000","last_became_active":"2024-03-09T14:28:53.622689+0000","last_became_peered":"2024-03-09T14:28:53.622689+0000","last_unstale":"2024-03-09T15:07:04.651479+0000","last_undegraded":"2024-03-09T15:07:04.651479+0000","last_fullsized":"2024-03-09T15:07:04.651479+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:35:07.478864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9892647,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":507,"num_read_kb":7526,"num_write":1233,"num_write_kb":32260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'361","reported_seq":1916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.497289+0000","last_change":"2024-03-09T14:28:55.594992+0000","last_active":"2024-03-09T15:06:53.497289+0000","last_peered":"2024-03-09T15:06:53.497289+0000","last_clean":"2024-03-09T15:06:53.497289+0000","last_became_active":"2024-03-09T14:28:55.588204+0000","last_became_peered":"2024-03-09T14:28:55.588204+0000","last_unstale":"2024-03-09T15:06:53.497289+0000","last_undegraded":"2024-03-09T15:06:53.497289+0000","last_fullsized":"2024-03-09T15:06:53.497289+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:08:51.680835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2088,"num_read_kb":2012,"num_write":400,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'355","reported_seq":1058,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.870513+0000","last_change":"2024-03-09T14:28:53.605882+0000","last_active":"2024-03-09T15:07:04.870513+0000","last_peered":"2024-03-09T15:07:04.870513+0000","last_clean":"2024-03-09T15:07:04.870513+0000","last_became_active":"2024-03-09T14:28:53.604391+0000","last_became_peered":"2024-03-09T14:28:53.604391+0000","last_unstale":"2024-03-09T15:07:04.870513+0000","last_undegraded":"2024-03-09T15:07:04.870513+0000","last_fullsized":"2024-03-09T15:07:04.870513+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:59:20.682629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6292408,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":737,"num_read_kb":3295,"num_write":1220,"num_write_kb":34124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'790","reported_seq":2517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.519848+0000","last_change":"2024-03-09T14:28:55.572158+0000","last_active":"2024-03-09T15:06:32.519848+0000","last_peered":"2024-03-09T15:06:32.519848+0000","last_clean":"2024-03-09T15:06:32.519848+0000","last_became_active":"2024-03-09T14:28:55.571291+0000","last_became_peered":"2024-03-09T14:28:55.571291+0000","last_unstale":"2024-03-09T15:06:32.519848+0000","last_undegraded":"2024-03-09T15:06:32.519848+0000","last_fullsized":"2024-03-09T15:06:32.519848+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:13.639955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3843,"num_read_kb":3494,"num_write":1039,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'377","reported_seq":1038,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.675047+0000","last_change":"2024-03-09T14:28:53.619197+0000","last_active":"2024-03-09T15:07:04.675047+0000","last_peered":"2024-03-09T15:07:04.675047+0000","last_clean":"2024-03-09T15:07:04.675047+0000","last_became_active":"2024-03-09T14:28:53.618259+0000","last_became_peered":"2024-03-09T14:28:53.618259+0000","last_unstale":"2024-03-09T15:07:04.675047+0000","last_undegraded":"2024-03-09T15:07:04.675047+0000","last_fullsized":"2024-03-09T15:07:04.675047+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:17:48.901903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243871,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":558,"num_read_kb":8007,"num_write":1492,"num_write_kb":37535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'416","reported_seq":2018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:30.937626+0000","last_change":"2024-03-09T14:28:55.588359+0000","last_active":"2024-03-09T15:06:30.937626+0000","last_peered":"2024-03-09T15:06:30.937626+0000","last_clean":"2024-03-09T15:06:30.937626+0000","last_became_active":"2024-03-09T14:28:55.587626+0000","last_became_peered":"2024-03-09T14:28:55.587626+0000","last_unstale":"2024-03-09T15:06:30.937626+0000","last_undegraded":"2024-03-09T15:06:30.937626+0000","last_fullsized":"2024-03-09T15:06:30.937626+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:11:15.692803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2314,"num_read_kb":2202,"num_write":483,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'319","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.799608+0000","last_change":"2024-03-09T14:28:53.589649+0000","last_active":"2024-03-09T15:07:04.799608+0000","last_peered":"2024-03-09T15:07:04.799608+0000","last_clean":"2024-03-09T15:07:04.799608+0000","last_became_active":"2024-03-09T14:28:53.589232+0000","last_became_peered":"2024-03-09T14:28:53.589232+0000","last_unstale":"2024-03-09T15:07:04.799608+0000","last_undegraded":"2024-03-09T15:07:04.799608+0000","last_fullsized":"2024-03-09T15:07:04.799608+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:39:52.724655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539421,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":471,"num_read_kb":42616,"num_write":1223,"num_write_kb":40647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'928","reported_seq":2692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.479559+0000","last_change":"2024-03-09T14:28:55.603210+0000","last_active":"2024-03-09T15:06:53.479559+0000","last_peered":"2024-03-09T15:06:53.479559+0000","last_clean":"2024-03-09T15:06:53.479559+0000","last_became_active":"2024-03-09T14:28:55.602477+0000","last_became_peered":"2024-03-09T14:28:55.602477+0000","last_unstale":"2024-03-09T15:06:53.479559+0000","last_undegraded":"2024-03-09T15:06:53.479559+0000","last_fullsized":"2024-03-09T15:06:53.479559+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:09:50.068938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4605,"num_read_kb":4102,"num_write":1299,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'353","reported_seq":1797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.436373+0000","last_change":"2024-03-09T14:28:55.571793+0000","last_active":"2024-03-09T15:06:42.436373+0000","last_peered":"2024-03-09T15:06:42.436373+0000","last_clean":"2024-03-09T15:06:42.436373+0000","last_became_active":"2024-03-09T14:28:55.570861+0000","last_became_peered":"2024-03-09T14:28:55.570861+0000","last_unstale":"2024-03-09T15:06:42.436373+0000","last_undegraded":"2024-03-09T15:06:42.436373+0000","last_fullsized":"2024-03-09T15:06:42.436373+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:59:27.495054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1960,"num_read_kb":1866,"num_write":405,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'329","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.588942+0000","last_change":"2024-03-09T14:28:53.608951+0000","last_active":"2024-03-09T15:07:04.588942+0000","last_peered":"2024-03-09T15:07:04.588942+0000","last_clean":"2024-03-09T15:07:04.588942+0000","last_became_active":"2024-03-09T14:28:53.607915+0000","last_became_peered":"2024-03-09T14:28:53.607915+0000","last_unstale":"2024-03-09T15:07:04.588942+0000","last_undegraded":"2024-03-09T15:07:04.588942+0000","last_fullsized":"2024-03-09T15:07:04.588942+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:57.850290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5561340,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":529,"num_read_kb":78571,"num_write":1317,"num_write_kb":47168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'819","reported_seq":2221,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.471725+0000","last_change":"2024-03-09T14:28:55.592675+0000","last_active":"2024-03-09T15:06:53.471725+0000","last_peered":"2024-03-09T15:06:53.471725+0000","last_clean":"2024-03-09T15:06:53.471725+0000","last_became_active":"2024-03-09T14:28:55.591884+0000","last_became_peered":"2024-03-09T14:28:55.591884+0000","last_unstale":"2024-03-09T15:06:53.471725+0000","last_undegraded":"2024-03-09T15:06:53.471725+0000","last_fullsized":"2024-03-09T15:06:53.471725+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:10:17.105445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3579,"num_read_kb":3134,"num_write":1128,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'234","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.698433+0000","last_change":"2024-03-09T14:28:53.638241+0000","last_active":"2024-03-09T15:07:04.698433+0000","last_peered":"2024-03-09T15:07:04.698433+0000","last_clean":"2024-03-09T15:07:04.698433+0000","last_became_active":"2024-03-09T14:28:53.635735+0000","last_became_peered":"2024-03-09T14:28:53.635735+0000","last_unstale":"2024-03-09T15:07:04.698433+0000","last_undegraded":"2024-03-09T15:07:04.698433+0000","last_fullsized":"2024-03-09T15:07:04.698433+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:44:09.619974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":439,"num_read_kb":101132,"num_write":968,"num_write_kb":27272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'365","reported_seq":1868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.435386+0000","last_change":"2024-03-09T14:28:55.590086+0000","last_active":"2024-03-09T15:06:42.435386+0000","last_peered":"2024-03-09T15:06:42.435386+0000","last_clean":"2024-03-09T15:06:42.435386+0000","last_became_active":"2024-03-09T14:28:55.589360+0000","last_became_peered":"2024-03-09T14:28:55.589360+0000","last_unstale":"2024-03-09T15:06:42.435386+0000","last_undegraded":"2024-03-09T15:06:42.435386+0000","last_fullsized":"2024-03-09T15:06:42.435386+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:02.064740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2092,"num_write":426,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'295","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.615763+0000","last_change":"2024-03-09T14:28:53.638187+0000","last_active":"2024-03-09T15:07:04.615763+0000","last_peered":"2024-03-09T15:07:04.615763+0000","last_clean":"2024-03-09T15:07:04.615763+0000","last_became_active":"2024-03-09T14:28:53.635713+0000","last_became_peered":"2024-03-09T14:28:53.635713+0000","last_unstale":"2024-03-09T15:07:04.615763+0000","last_undegraded":"2024-03-09T15:07:04.615763+0000","last_fullsized":"2024-03-09T15:07:04.615763+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:54:41.702227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7073816,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":509,"num_read_kb":101700,"num_write":1094,"num_write_kb":55747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'1330","reported_seq":2999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.480828+0000","last_change":"2024-03-09T14:28:55.602534+0000","last_active":"2024-03-09T15:06:53.480828+0000","last_peered":"2024-03-09T15:06:53.480828+0000","last_clean":"2024-03-09T15:06:53.480828+0000","last_became_active":"2024-03-09T14:28:55.602235+0000","last_became_peered":"2024-03-09T14:28:55.602235+0000","last_unstale":"2024-03-09T15:06:53.480828+0000","last_undegraded":"2024-03-09T15:06:53.480828+0000","last_fullsized":"2024-03-09T15:06:53.480828+0000","mapping_epoch":25,"log_start":"264'1300","ondisk_log_start":"264'1300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:37.897038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5607,"num_read_kb":4937,"num_write":1889,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'420","reported_seq":1087,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.643322+0000","last_change":"2024-03-09T14:29:28.825001+0000","last_active":"2024-03-09T15:07:04.643322+0000","last_peered":"2024-03-09T15:07:04.643322+0000","last_clean":"2024-03-09T15:07:04.643322+0000","last_became_active":"2024-03-09T14:29:28.823751+0000","last_became_peered":"2024-03-09T14:29:28.823751+0000","last_unstale":"2024-03-09T15:07:04.643322+0000","last_undegraded":"2024-03-09T15:07:04.643322+0000","last_fullsized":"2024-03-09T15:07:04.643322+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:51:51.410458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289653,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":790,"num_read_kb":6645,"num_write":1405,"num_write_kb":15242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,0],"acting":[2,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"264'438","reported_seq":2021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.377980+0000","last_change":"2024-03-09T14:28:55.575476+0000","last_active":"2024-03-09T15:06:38.377980+0000","last_peered":"2024-03-09T15:06:38.377980+0000","last_clean":"2024-03-09T15:06:38.377980+0000","last_became_active":"2024-03-09T14:28:55.574645+0000","last_became_peered":"2024-03-09T14:28:55.574645+0000","last_unstale":"2024-03-09T15:06:38.377980+0000","last_undegraded":"2024-03-09T15:06:38.377980+0000","last_fullsized":"2024-03-09T15:06:38.377980+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:13:49.646435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2503,"num_read_kb":2358,"num_write":585,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'369","reported_seq":1037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.769949+0000","last_change":"2024-03-09T14:28:53.619764+0000","last_active":"2024-03-09T15:07:04.769949+0000","last_peered":"2024-03-09T15:07:04.769949+0000","last_clean":"2024-03-09T15:07:04.769949+0000","last_became_active":"2024-03-09T14:28:53.619291+0000","last_became_peered":"2024-03-09T14:28:53.619291+0000","last_unstale":"2024-03-09T15:07:04.769949+0000","last_undegraded":"2024-03-09T15:07:04.769949+0000","last_fullsized":"2024-03-09T15:07:04.769949+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:18.730889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505363,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":578,"num_read_kb":88953,"num_write":1355,"num_write_kb":34328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'358","reported_seq":1902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.473697+0000","last_change":"2024-03-09T14:28:55.563774+0000","last_active":"2024-03-09T15:06:53.473697+0000","last_peered":"2024-03-09T15:06:53.473697+0000","last_clean":"2024-03-09T15:06:53.473697+0000","last_became_active":"2024-03-09T14:28:55.563041+0000","last_became_peered":"2024-03-09T14:28:55.563041+0000","last_unstale":"2024-03-09T15:06:53.473697+0000","last_undegraded":"2024-03-09T15:06:53.473697+0000","last_fullsized":"2024-03-09T15:06:53.473697+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:57.726313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2055,"num_read_kb":1986,"num_write":393,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'385","reported_seq":1066,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.650593+0000","last_change":"2024-03-09T14:28:53.586359+0000","last_active":"2024-03-09T15:07:04.650593+0000","last_peered":"2024-03-09T15:07:04.650593+0000","last_clean":"2024-03-09T15:07:04.650593+0000","last_became_active":"2024-03-09T14:28:53.585880+0000","last_became_peered":"2024-03-09T14:28:53.585880+0000","last_unstale":"2024-03-09T15:07:04.650593+0000","last_undegraded":"2024-03-09T15:07:04.650593+0000","last_fullsized":"2024-03-09T15:07:04.650593+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:35:20.383666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45730,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":625,"num_read_kb":65521,"num_write":1358,"num_write_kb":24882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'120","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:26.294126+0000","last_change":"2024-03-09T14:29:03.661025+0000","last_active":"2024-03-09T15:06:26.294126+0000","last_peered":"2024-03-09T15:06:26.294126+0000","last_clean":"2024-03-09T15:06:26.294126+0000","last_became_active":"2024-03-09T14:29:03.660224+0000","last_became_peered":"2024-03-09T14:29:03.660224+0000","last_unstale":"2024-03-09T15:06:26.294126+0000","last_undegraded":"2024-03-09T15:06:26.294126+0000","last_fullsized":"2024-03-09T15:06:26.294126+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:52.780401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":112,"num_write":285,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'399","reported_seq":1864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.290586+0000","last_change":"2024-03-09T14:28:55.598495+0000","last_active":"2024-03-09T15:06:41.290586+0000","last_peered":"2024-03-09T15:06:41.290586+0000","last_clean":"2024-03-09T15:06:41.290586+0000","last_became_active":"2024-03-09T14:28:55.596404+0000","last_became_peered":"2024-03-09T14:28:55.596404+0000","last_unstale":"2024-03-09T15:06:41.290586+0000","last_undegraded":"2024-03-09T15:06:41.290586+0000","last_fullsized":"2024-03-09T15:06:41.290586+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:01:23.717950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2183,"num_read_kb":2049,"num_write":485,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'292","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.603739+0000","last_change":"2024-03-09T14:28:53.610969+0000","last_active":"2024-03-09T15:07:04.603739+0000","last_peered":"2024-03-09T15:07:04.603739+0000","last_clean":"2024-03-09T15:07:04.603739+0000","last_became_active":"2024-03-09T14:28:53.610073+0000","last_became_peered":"2024-03-09T14:28:53.610073+0000","last_unstale":"2024-03-09T15:07:04.603739+0000","last_undegraded":"2024-03-09T15:07:04.603739+0000","last_fullsized":"2024-03-09T15:07:04.603739+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:36.026110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8695860,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":555,"num_read_kb":1412,"num_write":1128,"num_write_kb":31021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.867610+0000","last_change":"2024-03-09T14:28:57.606795+0000","last_active":"2024-03-09T15:02:49.867610+0000","last_peered":"2024-03-09T15:02:49.867610+0000","last_clean":"2024-03-09T15:02:49.867610+0000","last_became_active":"2024-03-09T14:28:57.606062+0000","last_became_peered":"2024-03-09T14:28:57.606062+0000","last_unstale":"2024-03-09T15:02:49.867610+0000","last_undegraded":"2024-03-09T15:02:49.867610+0000","last_fullsized":"2024-03-09T15:02:49.867610+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:20:55.983665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'315","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.460277+0000","last_change":"2024-03-09T14:28:59.622695+0000","last_active":"2024-03-09T15:06:55.460277+0000","last_peered":"2024-03-09T15:06:55.460277+0000","last_clean":"2024-03-09T15:06:55.460277+0000","last_became_active":"2024-03-09T14:28:59.622357+0000","last_became_peered":"2024-03-09T14:28:59.622357+0000","last_unstale":"2024-03-09T15:06:55.460277+0000","last_undegraded":"2024-03-09T15:06:55.460277+0000","last_fullsized":"2024-03-09T15:06:55.460277+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:40:38.071877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59515,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":498,"num_read_kb":977,"num_write":398,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.902045+0000","last_change":"2024-03-09T14:29:01.637387+0000","last_active":"2024-03-09T15:02:54.902045+0000","last_peered":"2024-03-09T15:02:54.902045+0000","last_clean":"2024-03-09T15:02:54.902045+0000","last_became_active":"2024-03-09T14:29:01.636497+0000","last_became_peered":"2024-03-09T14:29:01.636497+0000","last_unstale":"2024-03-09T15:02:54.902045+0000","last_undegraded":"2024-03-09T15:02:54.902045+0000","last_fullsized":"2024-03-09T15:02:54.902045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:20:55.356981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2460","reported_seq":4883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.842069+0000","last_change":"2024-03-09T14:29:03.667138+0000","last_active":"2024-03-09T15:06:53.842069+0000","last_peered":"2024-03-09T15:06:53.842069+0000","last_clean":"2024-03-09T15:06:53.842069+0000","last_became_active":"2024-03-09T14:29:03.664933+0000","last_became_peered":"2024-03-09T14:29:03.664933+0000","last_unstale":"2024-03-09T15:06:53.842069+0000","last_undegraded":"2024-03-09T15:06:53.842069+0000","last_fullsized":"2024-03-09T15:06:53.842069+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":2400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:18:59.045000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6733,"num_read_kb":6729,"num_write":4969,"num_write_kb":1822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'420","reported_seq":1996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.091742+0000","last_change":"2024-03-09T14:28:55.595855+0000","last_active":"2024-03-09T15:06:27.091742+0000","last_peered":"2024-03-09T15:06:27.091742+0000","last_clean":"2024-03-09T15:06:27.091742+0000","last_became_active":"2024-03-09T14:28:55.594120+0000","last_became_peered":"2024-03-09T14:28:55.594120+0000","last_unstale":"2024-03-09T15:06:27.091742+0000","last_undegraded":"2024-03-09T15:06:27.091742+0000","last_fullsized":"2024-03-09T15:06:27.091742+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:33:22.109526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2334,"num_read_kb":2217,"num_write":521,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'322","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.612800+0000","last_change":"2024-03-09T14:28:53.592039+0000","last_active":"2024-03-09T15:07:04.612800+0000","last_peered":"2024-03-09T15:07:04.612800+0000","last_clean":"2024-03-09T15:07:04.612800+0000","last_became_active":"2024-03-09T14:28:53.589914+0000","last_became_peered":"2024-03-09T14:28:53.589914+0000","last_unstale":"2024-03-09T15:07:04.612800+0000","last_undegraded":"2024-03-09T15:07:04.612800+0000","last_fullsized":"2024-03-09T15:07:04.612800+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:53:01.915523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097434,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":441,"num_read_kb":36278,"num_write":1194,"num_write_kb":26714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.939219+0000","last_change":"2024-03-09T14:28:57.609556+0000","last_active":"2024-03-09T15:04:04.939219+0000","last_peered":"2024-03-09T15:04:04.939219+0000","last_clean":"2024-03-09T15:04:04.939219+0000","last_became_active":"2024-03-09T14:28:57.608444+0000","last_became_peered":"2024-03-09T14:28:57.608444+0000","last_unstale":"2024-03-09T15:04:04.939219+0000","last_undegraded":"2024-03-09T15:04:04.939219+0000","last_fullsized":"2024-03-09T15:04:04.939219+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:54.351478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'65","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.201008+0000","last_change":"2024-03-09T14:28:59.615503+0000","last_active":"2024-03-09T15:04:49.201008+0000","last_peered":"2024-03-09T15:04:49.201008+0000","last_clean":"2024-03-09T15:04:49.201008+0000","last_became_active":"2024-03-09T14:28:59.614144+0000","last_became_peered":"2024-03-09T14:28:59.614144+0000","last_unstale":"2024-03-09T15:04:49.201008+0000","last_undegraded":"2024-03-09T15:04:49.201008+0000","last_fullsized":"2024-03-09T15:04:49.201008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:26:26.621561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":74,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.684839+0000","last_change":"2024-03-09T14:29:01.650515+0000","last_active":"2024-03-09T15:02:54.684839+0000","last_peered":"2024-03-09T15:02:54.684839+0000","last_clean":"2024-03-09T15:02:54.684839+0000","last_became_active":"2024-03-09T14:29:01.649716+0000","last_became_peered":"2024-03-09T14:29:01.649716+0000","last_unstale":"2024-03-09T15:02:54.684839+0000","last_undegraded":"2024-03-09T15:02:54.684839+0000","last_fullsized":"2024-03-09T15:02:54.684839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:50:00.172206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'128","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.347500+0000","last_change":"2024-03-09T14:29:03.677339+0000","last_active":"2024-03-09T15:06:24.347500+0000","last_peered":"2024-03-09T15:06:24.347500+0000","last_clean":"2024-03-09T15:06:24.347500+0000","last_became_active":"2024-03-09T14:29:03.676427+0000","last_became_peered":"2024-03-09T14:29:03.676427+0000","last_unstale":"2024-03-09T15:06:24.347500+0000","last_undegraded":"2024-03-09T15:06:24.347500+0000","last_fullsized":"2024-03-09T15:06:24.347500+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:46:24.909885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":126,"num_write":288,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'348","reported_seq":1729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:28.240636+0000","last_change":"2024-03-09T14:29:28.734389+0000","last_active":"2024-03-09T15:06:28.240636+0000","last_peered":"2024-03-09T15:06:28.240636+0000","last_clean":"2024-03-09T15:06:28.240636+0000","last_became_active":"2024-03-09T14:29:28.733522+0000","last_became_peered":"2024-03-09T14:29:28.733522+0000","last_unstale":"2024-03-09T15:06:28.240636+0000","last_undegraded":"2024-03-09T15:06:28.240636+0000","last_fullsized":"2024-03-09T15:06:28.240636+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:16:32.699098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1907,"num_read_kb":1804,"num_write":410,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'320","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.710687+0000","last_change":"2024-03-09T14:28:53.633910+0000","last_active":"2024-03-09T15:07:04.710687+0000","last_peered":"2024-03-09T15:07:04.710687+0000","last_clean":"2024-03-09T15:07:04.710687+0000","last_became_active":"2024-03-09T14:28:53.633368+0000","last_became_peered":"2024-03-09T14:28:53.633368+0000","last_unstale":"2024-03-09T15:07:04.710687+0000","last_undegraded":"2024-03-09T15:07:04.710687+0000","last_fullsized":"2024-03-09T15:07:04.710687+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:26.540977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918128,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":428,"num_read_kb":7245,"num_write":1132,"num_write_kb":29598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.920522+0000","last_change":"2024-03-09T14:28:57.614611+0000","last_active":"2024-03-09T15:02:49.920522+0000","last_peered":"2024-03-09T15:02:49.920522+0000","last_clean":"2024-03-09T15:02:49.920522+0000","last_became_active":"2024-03-09T14:28:57.613841+0000","last_became_peered":"2024-03-09T14:28:57.613841+0000","last_unstale":"2024-03-09T15:02:49.920522+0000","last_undegraded":"2024-03-09T15:02:49.920522+0000","last_fullsized":"2024-03-09T15:02:49.920522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:44.586932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'103","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.727031+0000","last_change":"2024-03-09T14:28:59.619913+0000","last_active":"2024-03-09T15:06:29.727031+0000","last_peered":"2024-03-09T15:06:29.727031+0000","last_clean":"2024-03-09T15:06:29.727031+0000","last_became_active":"2024-03-09T14:28:59.619147+0000","last_became_peered":"2024-03-09T14:28:59.619147+0000","last_unstale":"2024-03-09T15:06:29.727031+0000","last_undegraded":"2024-03-09T15:06:29.727031+0000","last_fullsized":"2024-03-09T15:06:29.727031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:54:42.905183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":102,"num_write":78,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'532","reported_seq":3845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.474622+0000","last_change":"2024-03-09T14:29:01.637642+0000","last_active":"2024-03-09T15:07:02.474622+0000","last_peered":"2024-03-09T15:07:02.474622+0000","last_clean":"2024-03-09T15:07:02.474622+0000","last_became_active":"2024-03-09T14:29:01.636743+0000","last_became_peered":"2024-03-09T14:29:01.636743+0000","last_unstale":"2024-03-09T15:07:02.474622+0000","last_undegraded":"2024-03-09T15:07:02.474622+0000","last_fullsized":"2024-03-09T15:07:02.474622+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:58:02.166987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'197","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:20.713069+0000","last_change":"2024-03-09T14:29:03.649992+0000","last_active":"2024-03-09T15:06:20.713069+0000","last_peered":"2024-03-09T15:06:20.713069+0000","last_clean":"2024-03-09T15:06:20.713069+0000","last_became_active":"2024-03-09T14:29:03.649194+0000","last_became_peered":"2024-03-09T14:29:03.649194+0000","last_unstale":"2024-03-09T15:06:20.713069+0000","last_undegraded":"2024-03-09T15:06:20.713069+0000","last_fullsized":"2024-03-09T15:06:20.713069+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:46.290792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":551,"num_read_kb":549,"num_write":426,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'370","reported_seq":1843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:56.287432+0000","last_change":"2024-03-09T14:28:55.597244+0000","last_active":"2024-03-09T15:05:56.287432+0000","last_peered":"2024-03-09T15:05:56.287432+0000","last_clean":"2024-03-09T15:05:56.287432+0000","last_became_active":"2024-03-09T14:28:55.592359+0000","last_became_peered":"2024-03-09T14:28:55.592359+0000","last_unstale":"2024-03-09T15:05:56.287432+0000","last_undegraded":"2024-03-09T15:05:56.287432+0000","last_fullsized":"2024-03-09T15:05:56.287432+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:59.078312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2105,"num_read_kb":2015,"num_write":416,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'265","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.674212+0000","last_change":"2024-03-09T14:28:53.632702+0000","last_active":"2024-03-09T15:07:04.674212+0000","last_peered":"2024-03-09T15:07:04.674212+0000","last_clean":"2024-03-09T15:07:04.674212+0000","last_became_active":"2024-03-09T14:28:53.631559+0000","last_became_peered":"2024-03-09T14:28:53.631559+0000","last_unstale":"2024-03-09T15:07:04.674212+0000","last_undegraded":"2024-03-09T15:07:04.674212+0000","last_fullsized":"2024-03-09T15:07:04.674212+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:01:04.705294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9603321,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":376,"num_read_kb":6712,"num_write":1032,"num_write_kb":20730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.867656+0000","last_change":"2024-03-09T14:28:57.606488+0000","last_active":"2024-03-09T15:02:49.867656+0000","last_peered":"2024-03-09T15:02:49.867656+0000","last_clean":"2024-03-09T15:02:49.867656+0000","last_became_active":"2024-03-09T14:28:57.605787+0000","last_became_peered":"2024-03-09T14:28:57.605787+0000","last_unstale":"2024-03-09T15:02:49.867656+0000","last_undegraded":"2024-03-09T15:02:49.867656+0000","last_fullsized":"2024-03-09T15:02:49.867656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:26.152998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'240","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.732734+0000","last_change":"2024-03-09T14:28:59.627011+0000","last_active":"2024-03-09T15:07:04.732734+0000","last_peered":"2024-03-09T15:07:04.732734+0000","last_clean":"2024-03-09T15:07:04.732734+0000","last_became_active":"2024-03-09T14:28:59.626279+0000","last_became_peered":"2024-03-09T14:28:59.626279+0000","last_unstale":"2024-03-09T15:07:04.732734+0000","last_undegraded":"2024-03-09T15:07:04.732734+0000","last_fullsized":"2024-03-09T15:07:04.732734+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:16:34.909728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51626,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":406,"num_read_kb":896,"num_write":329,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'584","reported_seq":1927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.487401+0000","last_change":"2024-03-09T14:29:01.629131+0000","last_active":"2024-03-09T15:07:02.487401+0000","last_peered":"2024-03-09T15:07:02.487401+0000","last_clean":"2024-03-09T15:07:02.487401+0000","last_became_active":"2024-03-09T14:29:01.628420+0000","last_became_peered":"2024-03-09T14:29:01.628420+0000","last_unstale":"2024-03-09T15:07:02.487401+0000","last_undegraded":"2024-03-09T15:07:02.487401+0000","last_fullsized":"2024-03-09T15:07:02.487401+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:38.918481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'514","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:33.802719+0000","last_change":"2024-03-09T14:28:55.583472+0000","last_active":"2024-03-09T15:06:33.802719+0000","last_peered":"2024-03-09T15:06:33.802719+0000","last_clean":"2024-03-09T15:06:33.802719+0000","last_became_active":"2024-03-09T14:28:55.582638+0000","last_became_peered":"2024-03-09T14:28:55.582638+0000","last_unstale":"2024-03-09T15:06:33.802719+0000","last_undegraded":"2024-03-09T15:06:33.802719+0000","last_fullsized":"2024-03-09T15:06:33.802719+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:37:10.517715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2835,"num_read_kb":2627,"num_write":675,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'325","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.640986+0000","last_change":"2024-03-09T14:28:53.615478+0000","last_active":"2024-03-09T15:07:04.640986+0000","last_peered":"2024-03-09T15:07:04.640986+0000","last_clean":"2024-03-09T15:07:04.640986+0000","last_became_active":"2024-03-09T14:28:53.614586+0000","last_became_peered":"2024-03-09T14:28:53.614586+0000","last_unstale":"2024-03-09T15:07:04.640986+0000","last_undegraded":"2024-03-09T15:07:04.640986+0000","last_fullsized":"2024-03-09T15:07:04.640986+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:26:26.454638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2569943,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":448,"num_read_kb":10439,"num_write":1242,"num_write_kb":25392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:39.698275+0000","last_change":"2024-03-09T14:28:57.604178+0000","last_active":"2024-03-09T15:03:39.698275+0000","last_peered":"2024-03-09T15:03:39.698275+0000","last_clean":"2024-03-09T15:03:39.698275+0000","last_became_active":"2024-03-09T14:28:57.603233+0000","last_became_peered":"2024-03-09T14:28:57.603233+0000","last_unstale":"2024-03-09T15:03:39.698275+0000","last_undegraded":"2024-03-09T15:03:39.698275+0000","last_fullsized":"2024-03-09T15:03:39.698275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:12.919139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'332","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.751254+0000","last_change":"2024-03-09T14:28:59.627283+0000","last_active":"2024-03-09T15:07:02.751254+0000","last_peered":"2024-03-09T15:07:02.751254+0000","last_clean":"2024-03-09T15:07:02.751254+0000","last_became_active":"2024-03-09T14:28:59.626371+0000","last_became_peered":"2024-03-09T14:28:59.626371+0000","last_unstale":"2024-03-09T15:07:02.751254+0000","last_undegraded":"2024-03-09T15:07:02.751254+0000","last_fullsized":"2024-03-09T15:07:02.751254+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:29:20.179850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46990,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":561,"num_read_kb":1214,"num_write":446,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:50.041923+0000","last_change":"2024-03-09T14:29:01.637753+0000","last_active":"2024-03-09T15:02:50.041923+0000","last_peered":"2024-03-09T15:02:50.041923+0000","last_clean":"2024-03-09T15:02:50.041923+0000","last_became_active":"2024-03-09T14:29:01.636735+0000","last_became_peered":"2024-03-09T14:29:01.636735+0000","last_unstale":"2024-03-09T15:02:50.041923+0000","last_undegraded":"2024-03-09T15:02:50.041923+0000","last_fullsized":"2024-03-09T15:02:50.041923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:26:05.528994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'542","reported_seq":1364,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.504334+0000","last_change":"2024-03-09T14:29:03.676776+0000","last_active":"2024-03-09T15:06:55.504334+0000","last_peered":"2024-03-09T15:06:55.504334+0000","last_clean":"2024-03-09T15:06:55.504334+0000","last_became_active":"2024-03-09T14:29:03.676068+0000","last_became_peered":"2024-03-09T14:29:03.676068+0000","last_unstale":"2024-03-09T15:06:55.504334+0000","last_undegraded":"2024-03-09T15:06:55.504334+0000","last_fullsized":"2024-03-09T15:06:55.504334+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:53:03.331837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1331,"num_read_kb":1310,"num_write":1143,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'505","reported_seq":2110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.476263+0000","last_change":"2024-03-09T14:28:55.563572+0000","last_active":"2024-03-09T15:06:53.476263+0000","last_peered":"2024-03-09T15:06:53.476263+0000","last_clean":"2024-03-09T15:06:53.476263+0000","last_became_active":"2024-03-09T14:28:55.562782+0000","last_became_peered":"2024-03-09T14:28:55.562782+0000","last_unstale":"2024-03-09T15:06:53.476263+0000","last_undegraded":"2024-03-09T15:06:53.476263+0000","last_fullsized":"2024-03-09T15:06:53.476263+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:08.148515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2703,"num_read_kb":2505,"num_write":654,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'299","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.613984+0000","last_change":"2024-03-09T14:28:53.614539+0000","last_active":"2024-03-09T15:07:04.613984+0000","last_peered":"2024-03-09T15:07:04.613984+0000","last_clean":"2024-03-09T15:07:04.613984+0000","last_became_active":"2024-03-09T14:28:53.613015+0000","last_became_peered":"2024-03-09T14:28:53.613015+0000","last_unstale":"2024-03-09T15:07:04.613984+0000","last_undegraded":"2024-03-09T15:07:04.613984+0000","last_fullsized":"2024-03-09T15:07:04.613984+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:43:30.232179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3031329,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":472,"num_read_kb":9909,"num_write":1154,"num_write_kb":22337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:39.689387+0000","last_change":"2024-03-09T14:28:57.605938+0000","last_active":"2024-03-09T15:03:39.689387+0000","last_peered":"2024-03-09T15:03:39.689387+0000","last_clean":"2024-03-09T15:03:39.689387+0000","last_became_active":"2024-03-09T14:28:57.605493+0000","last_became_peered":"2024-03-09T14:28:57.605493+0000","last_unstale":"2024-03-09T15:03:39.689387+0000","last_undegraded":"2024-03-09T15:03:39.689387+0000","last_fullsized":"2024-03-09T15:03:39.689387+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:08:58.747971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'263","reported_seq":821,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.976449+0000","last_change":"2024-03-09T14:28:59.615074+0000","last_active":"2024-03-09T15:07:03.976449+0000","last_peered":"2024-03-09T15:07:03.976449+0000","last_clean":"2024-03-09T15:07:03.976449+0000","last_became_active":"2024-03-09T14:28:59.614640+0000","last_became_peered":"2024-03-09T14:28:59.614640+0000","last_unstale":"2024-03-09T15:07:03.976449+0000","last_undegraded":"2024-03-09T15:07:03.976449+0000","last_fullsized":"2024-03-09T15:07:03.976449+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:55:14.804093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43961,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1047,"num_write":356,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.934983+0000","last_change":"2024-03-09T14:29:01.628631+0000","last_active":"2024-03-09T15:03:49.934983+0000","last_peered":"2024-03-09T15:03:49.934983+0000","last_clean":"2024-03-09T15:03:49.934983+0000","last_became_active":"2024-03-09T14:29:01.627897+0000","last_became_peered":"2024-03-09T14:29:01.627897+0000","last_unstale":"2024-03-09T15:03:49.934983+0000","last_undegraded":"2024-03-09T15:03:49.934983+0000","last_fullsized":"2024-03-09T15:03:49.934983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:56:12.214362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'106","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:21.867785+0000","last_change":"2024-03-09T14:29:03.673997+0000","last_active":"2024-03-09T15:06:21.867785+0000","last_peered":"2024-03-09T15:06:21.867785+0000","last_clean":"2024-03-09T15:06:21.867785+0000","last_became_active":"2024-03-09T14:29:03.673265+0000","last_became_peered":"2024-03-09T14:29:03.673265+0000","last_unstale":"2024-03-09T15:06:21.867785+0000","last_undegraded":"2024-03-09T15:06:21.867785+0000","last_fullsized":"2024-03-09T15:06:21.867785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:26:29.254697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":93,"num_write":248,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'556","reported_seq":2185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.336610+0000","last_change":"2024-03-09T14:28:55.595155+0000","last_active":"2024-03-09T15:06:24.336610+0000","last_peered":"2024-03-09T15:06:24.336610+0000","last_clean":"2024-03-09T15:06:24.336610+0000","last_became_active":"2024-03-09T14:28:55.588092+0000","last_became_peered":"2024-03-09T14:28:55.588092+0000","last_unstale":"2024-03-09T15:06:24.336610+0000","last_undegraded":"2024-03-09T15:06:24.336610+0000","last_fullsized":"2024-03-09T15:06:24.336610+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:04:55.020928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2916,"num_read_kb":2661,"num_write":728,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'285","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.654742+0000","last_change":"2024-03-09T14:29:28.824146+0000","last_active":"2024-03-09T15:07:04.654742+0000","last_peered":"2024-03-09T15:07:04.654742+0000","last_clean":"2024-03-09T15:07:04.654742+0000","last_became_active":"2024-03-09T14:29:28.822971+0000","last_became_peered":"2024-03-09T14:29:28.822971+0000","last_unstale":"2024-03-09T15:07:04.654742+0000","last_undegraded":"2024-03-09T15:07:04.654742+0000","last_fullsized":"2024-03-09T15:07:04.654742+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:05:04.090335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289525,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":349,"num_read_kb":22878,"num_write":977,"num_write_kb":75728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:44.677095+0000","last_change":"2024-03-09T14:28:57.610888+0000","last_active":"2024-03-09T15:02:44.677095+0000","last_peered":"2024-03-09T15:02:44.677095+0000","last_clean":"2024-03-09T15:02:44.677095+0000","last_became_active":"2024-03-09T14:28:57.610472+0000","last_became_peered":"2024-03-09T14:28:57.610472+0000","last_unstale":"2024-03-09T15:02:44.677095+0000","last_undegraded":"2024-03-09T15:02:44.677095+0000","last_fullsized":"2024-03-09T15:02:44.677095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:44:44.084587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'303","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.936163+0000","last_change":"2024-03-09T14:28:59.613949+0000","last_active":"2024-03-09T15:07:02.936163+0000","last_peered":"2024-03-09T15:07:02.936163+0000","last_clean":"2024-03-09T15:07:02.936163+0000","last_became_active":"2024-03-09T14:28:59.610930+0000","last_became_peered":"2024-03-09T14:28:59.610930+0000","last_unstale":"2024-03-09T15:07:02.936163+0000","last_undegraded":"2024-03-09T15:07:02.936163+0000","last_fullsized":"2024-03-09T15:07:02.936163+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:18:06.308383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48936,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":498,"num_read_kb":1136,"num_write":410,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'559","reported_seq":2051,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.490282+0000","last_change":"2024-03-09T14:29:01.648142+0000","last_active":"2024-03-09T15:07:02.490282+0000","last_peered":"2024-03-09T15:07:02.490282+0000","last_clean":"2024-03-09T15:07:02.490282+0000","last_became_active":"2024-03-09T14:29:01.647361+0000","last_became_peered":"2024-03-09T14:29:01.647361+0000","last_unstale":"2024-03-09T15:07:02.490282+0000","last_undegraded":"2024-03-09T15:07:02.490282+0000","last_fullsized":"2024-03-09T15:07:02.490282+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:44:05.118214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'137","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:30.943762+0000","last_change":"2024-03-09T14:29:03.666545+0000","last_active":"2024-03-09T15:06:30.943762+0000","last_peered":"2024-03-09T15:06:30.943762+0000","last_clean":"2024-03-09T15:06:30.943762+0000","last_became_active":"2024-03-09T14:29:03.665744+0000","last_became_peered":"2024-03-09T14:29:03.665744+0000","last_unstale":"2024-03-09T15:06:30.943762+0000","last_undegraded":"2024-03-09T15:06:30.943762+0000","last_fullsized":"2024-03-09T15:06:30.943762+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:32:02.001608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'380","reported_seq":1992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.473681+0000","last_change":"2024-03-09T14:28:55.587716+0000","last_active":"2024-03-09T15:06:53.473681+0000","last_peered":"2024-03-09T15:06:53.473681+0000","last_clean":"2024-03-09T15:06:53.473681+0000","last_became_active":"2024-03-09T14:28:55.587413+0000","last_became_peered":"2024-03-09T14:28:55.587413+0000","last_unstale":"2024-03-09T15:06:53.473681+0000","last_undegraded":"2024-03-09T15:06:53.473681+0000","last_fullsized":"2024-03-09T15:06:53.473681+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:48:05.277419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2251,"num_read_kb":2175,"num_write":432,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'279","reported_seq":891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.909541+0000","last_change":"2024-03-09T14:28:53.640425+0000","last_active":"2024-03-09T15:07:04.909541+0000","last_peered":"2024-03-09T15:07:04.909541+0000","last_clean":"2024-03-09T15:07:04.909541+0000","last_became_active":"2024-03-09T14:28:53.639073+0000","last_became_peered":"2024-03-09T14:28:53.639073+0000","last_unstale":"2024-03-09T15:07:04.909541+0000","last_undegraded":"2024-03-09T15:07:04.909541+0000","last_fullsized":"2024-03-09T15:07:04.909541+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:18.874857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656785,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":415,"num_read_kb":3405,"num_write":1137,"num_write_kb":27946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.691482+0000","last_change":"2024-03-09T14:28:57.620565+0000","last_active":"2024-03-09T15:03:49.691482+0000","last_peered":"2024-03-09T15:03:49.691482+0000","last_clean":"2024-03-09T15:03:49.691482+0000","last_became_active":"2024-03-09T14:28:57.620037+0000","last_became_peered":"2024-03-09T14:28:57.620037+0000","last_unstale":"2024-03-09T15:03:49.691482+0000","last_undegraded":"2024-03-09T15:03:49.691482+0000","last_fullsized":"2024-03-09T15:03:49.691482+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:17:42.157517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'470","reported_seq":1090,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.261609+0000","last_change":"2024-03-09T14:28:59.626702+0000","last_active":"2024-03-09T15:07:04.261609+0000","last_peered":"2024-03-09T15:07:04.261609+0000","last_clean":"2024-03-09T15:07:04.261609+0000","last_became_active":"2024-03-09T14:28:59.625949+0000","last_became_peered":"2024-03-09T14:28:59.625949+0000","last_unstale":"2024-03-09T15:07:04.261609+0000","last_undegraded":"2024-03-09T15:07:04.261609+0000","last_fullsized":"2024-03-09T15:07:04.261609+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:42:22.844016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84476,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":828,"num_read_kb":2021,"num_write":686,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:44.690461+0000","last_change":"2024-03-09T14:29:01.620598+0000","last_active":"2024-03-09T15:03:44.690461+0000","last_peered":"2024-03-09T15:03:44.690461+0000","last_clean":"2024-03-09T15:03:44.690461+0000","last_became_active":"2024-03-09T14:29:01.620136+0000","last_became_peered":"2024-03-09T14:29:01.620136+0000","last_unstale":"2024-03-09T15:03:44.690461+0000","last_undegraded":"2024-03-09T15:03:44.690461+0000","last_fullsized":"2024-03-09T15:03:44.690461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:33.969272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'157","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.043416+0000","last_change":"2024-03-09T14:29:03.674681+0000","last_active":"2024-03-09T15:06:39.043416+0000","last_peered":"2024-03-09T15:06:39.043416+0000","last_clean":"2024-03-09T15:06:39.043416+0000","last_became_active":"2024-03-09T14:29:03.673216+0000","last_became_peered":"2024-03-09T14:29:03.673216+0000","last_unstale":"2024-03-09T15:06:39.043416+0000","last_undegraded":"2024-03-09T15:06:39.043416+0000","last_fullsized":"2024-03-09T15:06:39.043416+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:09:16.468619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":716,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":343,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'284","reported_seq":1635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.437313+0000","last_change":"2024-03-09T14:28:55.575944+0000","last_active":"2024-03-09T15:06:42.437313+0000","last_peered":"2024-03-09T15:06:42.437313+0000","last_clean":"2024-03-09T15:06:42.437313+0000","last_became_active":"2024-03-09T14:28:55.575211+0000","last_became_peered":"2024-03-09T14:28:55.575211+0000","last_unstale":"2024-03-09T15:06:42.437313+0000","last_undegraded":"2024-03-09T15:06:42.437313+0000","last_fullsized":"2024-03-09T15:06:42.437313+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:01:47.496592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1639,"num_read_kb":1592,"num_write":307,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'302","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.838100+0000","last_change":"2024-03-09T14:28:53.562474+0000","last_active":"2024-03-09T15:07:04.838100+0000","last_peered":"2024-03-09T15:07:04.838100+0000","last_clean":"2024-03-09T15:07:04.838100+0000","last_became_active":"2024-03-09T14:28:53.561769+0000","last_became_peered":"2024-03-09T14:28:53.561769+0000","last_unstale":"2024-03-09T15:07:04.838100+0000","last_undegraded":"2024-03-09T15:07:04.838100+0000","last_fullsized":"2024-03-09T15:07:04.838100+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:13.573028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947742,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":543,"num_read_kb":46371,"num_write":1219,"num_write_kb":14767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:44.677212+0000","last_change":"2024-03-09T14:28:57.606747+0000","last_active":"2024-03-09T15:02:44.677212+0000","last_peered":"2024-03-09T15:02:44.677212+0000","last_clean":"2024-03-09T15:02:44.677212+0000","last_became_active":"2024-03-09T14:28:57.606029+0000","last_became_peered":"2024-03-09T14:28:57.606029+0000","last_unstale":"2024-03-09T15:02:44.677212+0000","last_undegraded":"2024-03-09T15:02:44.677212+0000","last_fullsized":"2024-03-09T15:02:44.677212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:37:28.933755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'272","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.364674+0000","last_change":"2024-03-09T14:28:59.630783+0000","last_active":"2024-03-09T15:07:04.364674+0000","last_peered":"2024-03-09T15:07:04.364674+0000","last_clean":"2024-03-09T15:07:04.364674+0000","last_became_active":"2024-03-09T14:28:59.630097+0000","last_became_peered":"2024-03-09T14:28:59.630097+0000","last_unstale":"2024-03-09T15:07:04.364674+0000","last_undegraded":"2024-03-09T15:07:04.364674+0000","last_fullsized":"2024-03-09T15:07:04.364674+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:59:00.777817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42990,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":1018,"num_write":414,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.691717+0000","last_change":"2024-03-09T14:29:01.648762+0000","last_active":"2024-03-09T15:02:54.691717+0000","last_peered":"2024-03-09T15:02:54.691717+0000","last_clean":"2024-03-09T15:02:54.691717+0000","last_became_active":"2024-03-09T14:29:01.647375+0000","last_became_peered":"2024-03-09T14:29:01.647375+0000","last_unstale":"2024-03-09T15:02:54.691717+0000","last_undegraded":"2024-03-09T15:02:54.691717+0000","last_fullsized":"2024-03-09T15:02:54.691717+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:25:06.920706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'128","reported_seq":607,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:51.352059+0000","last_change":"2024-03-09T14:29:03.678484+0000","last_active":"2024-03-09T15:06:51.352059+0000","last_peered":"2024-03-09T15:06:51.352059+0000","last_clean":"2024-03-09T15:06:51.352059+0000","last_became_active":"2024-03-09T14:29:03.677704+0000","last_became_peered":"2024-03-09T14:29:03.677704+0000","last_unstale":"2024-03-09T15:06:51.352059+0000","last_undegraded":"2024-03-09T15:06:51.352059+0000","last_fullsized":"2024-03-09T15:06:51.352059+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:25.512736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":309,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'396","reported_seq":2038,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:08.369675+0000","last_change":"2024-03-09T14:28:55.578548+0000","last_active":"2024-03-09T15:06:08.369675+0000","last_peered":"2024-03-09T15:06:08.369675+0000","last_clean":"2024-03-09T15:06:08.369675+0000","last_became_active":"2024-03-09T14:28:55.577690+0000","last_became_peered":"2024-03-09T14:28:55.577690+0000","last_unstale":"2024-03-09T15:06:08.369675+0000","last_undegraded":"2024-03-09T15:06:08.369675+0000","last_fullsized":"2024-03-09T15:06:08.369675+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:48:46.933238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2493,"num_read_kb":2366,"num_write":474,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'277","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.608644+0000","last_change":"2024-03-09T14:28:53.631261+0000","last_active":"2024-03-09T15:07:04.608644+0000","last_peered":"2024-03-09T15:07:04.608644+0000","last_clean":"2024-03-09T15:07:04.608644+0000","last_became_active":"2024-03-09T14:28:53.627013+0000","last_became_peered":"2024-03-09T14:28:53.627013+0000","last_unstale":"2024-03-09T15:07:04.608644+0000","last_undegraded":"2024-03-09T15:07:04.608644+0000","last_fullsized":"2024-03-09T15:07:04.608644+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:05:48.407861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5645276,"num_objects":19,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":450,"num_read_kb":6489,"num_write":1106,"num_write_kb":11469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:45.040808+0000","last_change":"2024-03-09T14:28:57.614495+0000","last_active":"2024-03-09T15:02:45.040808+0000","last_peered":"2024-03-09T15:02:45.040808+0000","last_clean":"2024-03-09T15:02:45.040808+0000","last_became_active":"2024-03-09T14:28:57.614028+0000","last_became_peered":"2024-03-09T14:28:57.614028+0000","last_unstale":"2024-03-09T15:02:45.040808+0000","last_undegraded":"2024-03-09T15:02:45.040808+0000","last_fullsized":"2024-03-09T15:02:45.040808+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:12:00.953633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'260","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.705827+0000","last_change":"2024-03-09T14:28:59.613701+0000","last_active":"2024-03-09T15:07:03.705827+0000","last_peered":"2024-03-09T15:07:03.705827+0000","last_clean":"2024-03-09T15:07:03.705827+0000","last_became_active":"2024-03-09T14:28:59.613169+0000","last_became_peered":"2024-03-09T14:28:59.613169+0000","last_unstale":"2024-03-09T15:07:03.705827+0000","last_undegraded":"2024-03-09T15:07:03.705827+0000","last_fullsized":"2024-03-09T15:07:03.705827+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:29:04.658643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":434,"num_read_kb":985,"num_write":344,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'524","reported_seq":4073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.476180+0000","last_change":"2024-03-09T14:29:01.634092+0000","last_active":"2024-03-09T15:07:02.476180+0000","last_peered":"2024-03-09T15:07:02.476180+0000","last_clean":"2024-03-09T15:07:02.476180+0000","last_became_active":"2024-03-09T14:29:01.633363+0000","last_became_peered":"2024-03-09T14:29:01.633363+0000","last_unstale":"2024-03-09T15:07:02.476180+0000","last_undegraded":"2024-03-09T15:07:02.476180+0000","last_fullsized":"2024-03-09T15:07:02.476180+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:29.117930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'114","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:35.097974+0000","last_change":"2024-03-09T14:29:03.680649+0000","last_active":"2024-03-09T15:06:35.097974+0000","last_peered":"2024-03-09T15:06:35.097974+0000","last_clean":"2024-03-09T15:06:35.097974+0000","last_became_active":"2024-03-09T14:29:03.679941+0000","last_became_peered":"2024-03-09T14:29:03.679941+0000","last_unstale":"2024-03-09T15:06:35.097974+0000","last_undegraded":"2024-03-09T15:06:35.097974+0000","last_fullsized":"2024-03-09T15:06:35.097974+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:51:15.615789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1871,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":265,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'457","reported_seq":2150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.374575+0000","last_change":"2024-03-09T14:28:55.590773+0000","last_active":"2024-03-09T15:06:38.374575+0000","last_peered":"2024-03-09T15:06:38.374575+0000","last_clean":"2024-03-09T15:06:38.374575+0000","last_became_active":"2024-03-09T14:28:55.589982+0000","last_became_peered":"2024-03-09T14:28:55.589982+0000","last_unstale":"2024-03-09T15:06:38.374575+0000","last_undegraded":"2024-03-09T15:06:38.374575+0000","last_fullsized":"2024-03-09T15:06:38.374575+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:13:42.061416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2457,"num_read_kb":2347,"num_write":517,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'319","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.698296+0000","last_change":"2024-03-09T14:28:53.603618+0000","last_active":"2024-03-09T15:07:04.698296+0000","last_peered":"2024-03-09T15:07:04.698296+0000","last_clean":"2024-03-09T15:07:04.698296+0000","last_became_active":"2024-03-09T14:28:53.596847+0000","last_became_peered":"2024-03-09T14:28:53.596847+0000","last_unstale":"2024-03-09T15:07:04.698296+0000","last_undegraded":"2024-03-09T15:07:04.698296+0000","last_fullsized":"2024-03-09T15:07:04.698296+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:28:50.808652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243310,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":431,"num_read_kb":7047,"num_write":1150,"num_write_kb":21742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.022324+0000","last_change":"2024-03-09T14:28:57.619309+0000","last_active":"2024-03-09T15:07:02.022324+0000","last_peered":"2024-03-09T15:07:02.022324+0000","last_clean":"2024-03-09T15:07:02.022324+0000","last_became_active":"2024-03-09T14:28:57.618459+0000","last_became_peered":"2024-03-09T14:28:57.618459+0000","last_unstale":"2024-03-09T15:07:02.022324+0000","last_undegraded":"2024-03-09T15:07:02.022324+0000","last_fullsized":"2024-03-09T15:07:02.022324+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:07:02.519797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":640,"num_read_kb":640,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'56","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.953770+0000","last_change":"2024-03-09T14:28:59.635240+0000","last_active":"2024-03-09T15:04:59.953770+0000","last_peered":"2024-03-09T15:04:59.953770+0000","last_clean":"2024-03-09T15:04:59.953770+0000","last_became_active":"2024-03-09T14:28:59.634653+0000","last_became_peered":"2024-03-09T14:28:59.634653+0000","last_unstale":"2024-03-09T15:04:59.953770+0000","last_undegraded":"2024-03-09T15:04:59.953770+0000","last_fullsized":"2024-03-09T15:04:59.953770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:14:05.243868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'536","reported_seq":1985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.483082+0000","last_change":"2024-03-09T14:29:01.656750+0000","last_active":"2024-03-09T15:07:02.483082+0000","last_peered":"2024-03-09T15:07:02.483082+0000","last_clean":"2024-03-09T15:07:02.483082+0000","last_became_active":"2024-03-09T14:29:01.656177+0000","last_became_peered":"2024-03-09T14:29:01.656177+0000","last_unstale":"2024-03-09T15:07:02.483082+0000","last_undegraded":"2024-03-09T15:07:02.483082+0000","last_fullsized":"2024-03-09T15:07:02.483082+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":500,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:14:48.749660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'149","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.627725+0000","last_change":"2024-03-09T14:29:03.673147+0000","last_active":"2024-03-09T15:06:29.627725+0000","last_peered":"2024-03-09T15:06:29.627725+0000","last_clean":"2024-03-09T15:06:29.627725+0000","last_became_active":"2024-03-09T14:29:03.672416+0000","last_became_peered":"2024-03-09T14:29:03.672416+0000","last_unstale":"2024-03-09T15:06:29.627725+0000","last_undegraded":"2024-03-09T15:06:29.627725+0000","last_fullsized":"2024-03-09T15:06:29.627725+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:33.857671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":118,"num_read_kb":112,"num_write":348,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'860","reported_seq":2473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.908049+0000","last_change":"2024-03-09T14:28:55.584166+0000","last_active":"2024-03-09T15:06:39.908049+0000","last_peered":"2024-03-09T15:06:39.908049+0000","last_clean":"2024-03-09T15:06:39.908049+0000","last_became_active":"2024-03-09T14:28:55.583618+0000","last_became_peered":"2024-03-09T14:28:55.583618+0000","last_unstale":"2024-03-09T15:06:39.908049+0000","last_undegraded":"2024-03-09T15:06:39.908049+0000","last_fullsized":"2024-03-09T15:06:39.908049+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:38:20.845683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4083,"num_read_kb":3643,"num_write":1199,"num_write_kb":506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'306","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.962582+0000","last_change":"2024-03-09T14:28:53.568437+0000","last_active":"2024-03-09T15:07:04.962582+0000","last_peered":"2024-03-09T15:07:04.962582+0000","last_clean":"2024-03-09T15:07:04.962582+0000","last_became_active":"2024-03-09T14:28:53.568002+0000","last_became_peered":"2024-03-09T14:28:53.568002+0000","last_unstale":"2024-03-09T15:07:04.962582+0000","last_undegraded":"2024-03-09T15:07:04.962582+0000","last_fullsized":"2024-03-09T15:07:04.962582+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:23:32.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262279,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":632,"num_read_kb":26433,"num_write":1110,"num_write_kb":51619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:44.682741+0000","last_change":"2024-03-09T14:28:57.616235+0000","last_active":"2024-03-09T15:02:44.682741+0000","last_peered":"2024-03-09T15:02:44.682741+0000","last_clean":"2024-03-09T15:02:44.682741+0000","last_became_active":"2024-03-09T14:28:57.615518+0000","last_became_peered":"2024-03-09T14:28:57.615518+0000","last_unstale":"2024-03-09T15:02:44.682741+0000","last_undegraded":"2024-03-09T15:02:44.682741+0000","last_fullsized":"2024-03-09T15:02:44.682741+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:42:54.401600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'355","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.687122+0000","last_change":"2024-03-09T14:28:59.607936+0000","last_active":"2024-03-09T15:06:55.687122+0000","last_peered":"2024-03-09T15:06:55.687122+0000","last_clean":"2024-03-09T15:06:55.687122+0000","last_became_active":"2024-03-09T14:28:59.607095+0000","last_became_peered":"2024-03-09T14:28:59.607095+0000","last_unstale":"2024-03-09T15:06:55.687122+0000","last_undegraded":"2024-03-09T15:06:55.687122+0000","last_fullsized":"2024-03-09T15:06:55.687122+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:16:14.902005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59189,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1181,"num_read_kb":1706,"num_write":1722,"num_write_kb":1608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.682241+0000","last_change":"2024-03-09T14:29:01.650586+0000","last_active":"2024-03-09T15:02:49.682241+0000","last_peered":"2024-03-09T15:02:49.682241+0000","last_clean":"2024-03-09T15:02:49.682241+0000","last_became_active":"2024-03-09T14:29:01.649769+0000","last_became_peered":"2024-03-09T14:29:01.649769+0000","last_unstale":"2024-03-09T15:02:49.682241+0000","last_undegraded":"2024-03-09T15:02:49.682241+0000","last_fullsized":"2024-03-09T15:02:49.682241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:07:16.076604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'142","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:25.753617+0000","last_change":"2024-03-09T14:29:03.678921+0000","last_active":"2024-03-09T15:06:25.753617+0000","last_peered":"2024-03-09T15:06:25.753617+0000","last_clean":"2024-03-09T15:06:25.753617+0000","last_became_active":"2024-03-09T14:29:03.678140+0000","last_became_peered":"2024-03-09T14:29:03.678140+0000","last_unstale":"2024-03-09T15:06:25.753617+0000","last_undegraded":"2024-03-09T15:06:25.753617+0000","last_fullsized":"2024-03-09T15:06:25.753617+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:56:42.351083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":150,"num_write":332,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'1639","reported_seq":3308,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.109281+0000","last_change":"2024-03-09T14:28:55.597191+0000","last_active":"2024-03-09T15:06:27.109281+0000","last_peered":"2024-03-09T15:06:27.109281+0000","last_clean":"2024-03-09T15:06:27.109281+0000","last_became_active":"2024-03-09T14:28:55.596219+0000","last_became_peered":"2024-03-09T14:28:55.596219+0000","last_unstale":"2024-03-09T15:06:27.109281+0000","last_undegraded":"2024-03-09T15:06:27.109281+0000","last_fullsized":"2024-03-09T15:06:27.109281+0000","mapping_epoch":25,"log_start":"264'1600","ondisk_log_start":"264'1600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:18:39.978742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6749,"num_read_kb":5786,"num_write":2314,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.715671+0000","last_change":"2024-03-09T14:28:36.802806+0000","last_active":"2024-03-09T15:04:49.715671+0000","last_peered":"2024-03-09T15:04:49.715671+0000","last_clean":"2024-03-09T15:04:49.715671+0000","last_became_active":"2024-03-09T14:28:36.802270+0000","last_became_peered":"2024-03-09T14:28:36.802270+0000","last_unstale":"2024-03-09T15:04:49.715671+0000","last_undegraded":"2024-03-09T15:04:49.715671+0000","last_fullsized":"2024-03-09T15:04:49.715671+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:35.777784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:35.777784+0000","last_clean_scrub_stamp":"2024-03-09T14:28:35.777784+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:02:15.668382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.886372+0000","last_change":"2024-03-09T14:28:41.842055+0000","last_active":"2024-03-09T15:04:09.886372+0000","last_peered":"2024-03-09T15:04:09.886372+0000","last_clean":"2024-03-09T15:04:09.886372+0000","last_became_active":"2024-03-09T14:28:41.841153+0000","last_became_peered":"2024-03-09T14:28:41.841153+0000","last_unstale":"2024-03-09T15:04:09.886372+0000","last_undegraded":"2024-03-09T15:04:09.886372+0000","last_fullsized":"2024-03-09T15:04:09.886372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:49.085946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'331","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.912192+0000","last_change":"2024-03-09T14:28:53.623164+0000","last_active":"2024-03-09T15:07:04.912192+0000","last_peered":"2024-03-09T15:07:04.912192+0000","last_clean":"2024-03-09T15:07:04.912192+0000","last_became_active":"2024-03-09T14:28:53.622700+0000","last_became_peered":"2024-03-09T14:28:53.622700+0000","last_unstale":"2024-03-09T15:07:04.912192+0000","last_undegraded":"2024-03-09T15:07:04.912192+0000","last_fullsized":"2024-03-09T15:07:04.912192+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:03:47.434250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":540,"num_read_kb":30200,"num_write":1248,"num_write_kb":35948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.709259+0000","last_change":"2024-03-09T14:28:57.607452+0000","last_active":"2024-03-09T15:04:24.709259+0000","last_peered":"2024-03-09T15:04:24.709259+0000","last_clean":"2024-03-09T15:04:24.709259+0000","last_became_active":"2024-03-09T14:28:57.606611+0000","last_became_peered":"2024-03-09T14:28:57.606611+0000","last_unstale":"2024-03-09T15:04:24.709259+0000","last_undegraded":"2024-03-09T15:04:24.709259+0000","last_fullsized":"2024-03-09T15:04:24.709259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:02:18.757444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'685","reported_seq":1371,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.522717+0000","last_change":"2024-03-09T14:28:59.604427+0000","last_active":"2024-03-09T15:07:03.522717+0000","last_peered":"2024-03-09T15:07:03.522717+0000","last_clean":"2024-03-09T15:07:03.522717+0000","last_became_active":"2024-03-09T14:28:59.603722+0000","last_became_peered":"2024-03-09T14:28:59.603722+0000","last_unstale":"2024-03-09T15:07:03.522717+0000","last_undegraded":"2024-03-09T15:07:03.522717+0000","last_fullsized":"2024-03-09T15:07:03.522717+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:32:43.960476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161709,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1336,"num_read_kb":2851,"num_write":1266,"num_write_kb":1132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:44.703042+0000","last_change":"2024-03-09T14:29:01.648470+0000","last_active":"2024-03-09T15:03:44.703042+0000","last_peered":"2024-03-09T15:03:44.703042+0000","last_clean":"2024-03-09T15:03:44.703042+0000","last_became_active":"2024-03-09T14:29:01.647958+0000","last_became_peered":"2024-03-09T14:29:01.647958+0000","last_unstale":"2024-03-09T15:03:44.703042+0000","last_undegraded":"2024-03-09T15:03:44.703042+0000","last_fullsized":"2024-03-09T15:03:44.703042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:52:09.215340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'226","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:22.522461+0000","last_change":"2024-03-09T14:29:03.681803+0000","last_active":"2024-03-09T15:06:22.522461+0000","last_peered":"2024-03-09T15:06:22.522461+0000","last_clean":"2024-03-09T15:06:22.522461+0000","last_became_active":"2024-03-09T14:29:03.680962+0000","last_became_peered":"2024-03-09T14:29:03.680962+0000","last_unstale":"2024-03-09T15:06:22.522461+0000","last_undegraded":"2024-03-09T15:06:22.522461+0000","last_fullsized":"2024-03-09T15:06:22.522461+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:28:12.130155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":425,"num_read_kb":422,"num_write":485,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'387","reported_seq":1944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.433238+0000","last_change":"2024-03-09T14:28:55.575679+0000","last_active":"2024-03-09T15:06:42.433238+0000","last_peered":"2024-03-09T15:06:42.433238+0000","last_clean":"2024-03-09T15:06:42.433238+0000","last_became_active":"2024-03-09T14:28:55.575229+0000","last_became_peered":"2024-03-09T14:28:55.575229+0000","last_unstale":"2024-03-09T15:06:42.433238+0000","last_undegraded":"2024-03-09T15:06:42.433238+0000","last_fullsized":"2024-03-09T15:06:42.433238+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:26:56.492010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2264,"num_read_kb":2158,"num_write":447,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:54.716837+0000","last_change":"2024-03-09T14:28:41.839813+0000","last_active":"2024-03-09T15:04:54.716837+0000","last_peered":"2024-03-09T15:04:54.716837+0000","last_clean":"2024-03-09T15:04:54.716837+0000","last_became_active":"2024-03-09T14:28:41.838669+0000","last_became_peered":"2024-03-09T14:28:41.838669+0000","last_unstale":"2024-03-09T15:04:54.716837+0000","last_undegraded":"2024-03-09T15:04:54.716837+0000","last_fullsized":"2024-03-09T15:04:54.716837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:52:50.503614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'287","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.625017+0000","last_change":"2024-03-09T14:28:53.587759+0000","last_active":"2024-03-09T15:07:04.625017+0000","last_peered":"2024-03-09T15:07:04.625017+0000","last_clean":"2024-03-09T15:07:04.625017+0000","last_became_active":"2024-03-09T14:28:53.587201+0000","last_became_peered":"2024-03-09T14:28:53.587201+0000","last_unstale":"2024-03-09T15:07:04.625017+0000","last_undegraded":"2024-03-09T15:07:04.625017+0000","last_fullsized":"2024-03-09T15:07:04.625017+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:37:04.349336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11539118,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":421,"num_read_kb":38281,"num_write":1103,"num_write_kb":47895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:39.879966+0000","last_change":"2024-03-09T14:28:57.613708+0000","last_active":"2024-03-09T15:03:39.879966+0000","last_peered":"2024-03-09T15:03:39.879966+0000","last_clean":"2024-03-09T15:03:39.879966+0000","last_became_active":"2024-03-09T14:28:57.612854+0000","last_became_peered":"2024-03-09T14:28:57.612854+0000","last_unstale":"2024-03-09T15:03:39.879966+0000","last_undegraded":"2024-03-09T15:03:39.879966+0000","last_fullsized":"2024-03-09T15:03:39.879966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:41:11.322298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1071","reported_seq":2379,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.973085+0000","last_change":"2024-03-09T14:28:59.601211+0000","last_active":"2024-03-09T15:07:04.973085+0000","last_peered":"2024-03-09T15:07:04.973085+0000","last_clean":"2024-03-09T15:07:04.973085+0000","last_became_active":"2024-03-09T14:28:59.599819+0000","last_became_peered":"2024-03-09T14:28:59.599819+0000","last_unstale":"2024-03-09T15:07:04.973085+0000","last_undegraded":"2024-03-09T15:07:04.973085+0000","last_fullsized":"2024-03-09T15:07:04.973085+0000","mapping_epoch":29,"log_start":"264'1000","ondisk_log_start":"264'1000","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":1000,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:21:21.381897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136728,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1689,"num_read_kb":3246,"num_write":1044,"num_write_kb":893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:39.712987+0000","last_change":"2024-03-09T14:29:01.628141+0000","last_active":"2024-03-09T15:04:39.712987+0000","last_peered":"2024-03-09T15:04:39.712987+0000","last_clean":"2024-03-09T15:04:39.712987+0000","last_became_active":"2024-03-09T14:29:01.626582+0000","last_became_peered":"2024-03-09T14:29:01.626582+0000","last_unstale":"2024-03-09T15:04:39.712987+0000","last_undegraded":"2024-03-09T15:04:39.712987+0000","last_fullsized":"2024-03-09T15:04:39.712987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:05:36.345657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'109","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:31.614081+0000","last_change":"2024-03-09T14:29:03.660377+0000","last_active":"2024-03-09T15:06:31.614081+0000","last_peered":"2024-03-09T15:06:31.614081+0000","last_clean":"2024-03-09T15:06:31.614081+0000","last_became_active":"2024-03-09T14:29:03.659633+0000","last_became_peered":"2024-03-09T14:29:03.659633+0000","last_unstale":"2024-03-09T15:06:31.614081+0000","last_undegraded":"2024-03-09T15:06:31.614081+0000","last_fullsized":"2024-03-09T15:06:31.614081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:02:02.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":112,"num_read_kb":106,"num_write":262,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'372","reported_seq":1937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.084567+0000","last_change":"2024-03-09T14:28:55.585014+0000","last_active":"2024-03-09T15:06:27.084567+0000","last_peered":"2024-03-09T15:06:27.084567+0000","last_clean":"2024-03-09T15:06:27.084567+0000","last_became_active":"2024-03-09T14:28:55.584347+0000","last_became_peered":"2024-03-09T14:28:55.584347+0000","last_unstale":"2024-03-09T15:06:27.084567+0000","last_undegraded":"2024-03-09T15:06:27.084567+0000","last_fullsized":"2024-03-09T15:06:27.084567+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:07.167466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2124,"num_read_kb":2043,"num_write":421,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.695024+0000","last_change":"2024-03-09T14:28:41.837266+0000","last_active":"2024-03-09T15:04:04.695024+0000","last_peered":"2024-03-09T15:04:04.695024+0000","last_clean":"2024-03-09T15:04:04.695024+0000","last_became_active":"2024-03-09T14:28:41.836544+0000","last_became_peered":"2024-03-09T14:28:41.836544+0000","last_unstale":"2024-03-09T15:04:04.695024+0000","last_undegraded":"2024-03-09T15:04:04.695024+0000","last_fullsized":"2024-03-09T15:04:04.695024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:40.144949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'323","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.086797+0000","last_change":"2024-03-09T14:28:53.626870+0000","last_active":"2024-03-09T15:07:05.086797+0000","last_peered":"2024-03-09T15:07:05.086797+0000","last_clean":"2024-03-09T15:07:05.086797+0000","last_became_active":"2024-03-09T14:28:53.626472+0000","last_became_peered":"2024-03-09T14:28:53.626472+0000","last_unstale":"2024-03-09T15:07:05.086797+0000","last_undegraded":"2024-03-09T15:07:05.086797+0000","last_fullsized":"2024-03-09T15:07:05.086797+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:28.665281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262302,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":544,"num_read_kb":1460,"num_write":1301,"num_write_kb":27243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:39.689548+0000","last_change":"2024-03-09T14:28:57.610715+0000","last_active":"2024-03-09T15:03:39.689548+0000","last_peered":"2024-03-09T15:03:39.689548+0000","last_clean":"2024-03-09T15:03:39.689548+0000","last_became_active":"2024-03-09T14:28:57.609908+0000","last_became_peered":"2024-03-09T14:28:57.609908+0000","last_unstale":"2024-03-09T15:03:39.689548+0000","last_undegraded":"2024-03-09T15:03:39.689548+0000","last_fullsized":"2024-03-09T15:03:39.689548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:42:15.361989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'225","reported_seq":1219,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.681224+0000","last_change":"2024-03-09T14:28:59.628581+0000","last_active":"2024-03-09T15:06:55.681224+0000","last_peered":"2024-03-09T15:06:55.681224+0000","last_clean":"2024-03-09T15:06:55.681224+0000","last_became_active":"2024-03-09T14:28:59.627810+0000","last_became_peered":"2024-03-09T14:28:59.627810+0000","last_unstale":"2024-03-09T15:06:55.681224+0000","last_undegraded":"2024-03-09T15:06:55.681224+0000","last_fullsized":"2024-03-09T15:06:55.681224+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:38:33.367082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":165,"num_read_kb":157,"num_write":151,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.714308+0000","last_change":"2024-03-09T14:29:01.647816+0000","last_active":"2024-03-09T15:04:29.714308+0000","last_peered":"2024-03-09T15:04:29.714308+0000","last_clean":"2024-03-09T15:04:29.714308+0000","last_became_active":"2024-03-09T14:29:01.647228+0000","last_became_peered":"2024-03-09T14:29:01.647228+0000","last_unstale":"2024-03-09T15:04:29.714308+0000","last_undegraded":"2024-03-09T15:04:29.714308+0000","last_fullsized":"2024-03-09T15:04:29.714308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:05:51.167608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'248","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:33.164698+0000","last_change":"2024-03-09T14:29:03.659156+0000","last_active":"2024-03-09T15:06:33.164698+0000","last_peered":"2024-03-09T15:06:33.164698+0000","last_clean":"2024-03-09T15:06:33.164698+0000","last_became_active":"2024-03-09T14:29:03.654872+0000","last_became_peered":"2024-03-09T14:29:03.654872+0000","last_unstale":"2024-03-09T15:06:33.164698+0000","last_undegraded":"2024-03-09T15:06:33.164698+0000","last_fullsized":"2024-03-09T15:06:33.164698+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:31:12.618967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":497,"num_write":533,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'463","reported_seq":2014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.372347+0000","last_change":"2024-03-09T14:28:55.578525+0000","last_active":"2024-03-09T15:06:38.372347+0000","last_peered":"2024-03-09T15:06:38.372347+0000","last_clean":"2024-03-09T15:06:38.372347+0000","last_became_active":"2024-03-09T14:28:55.577946+0000","last_became_peered":"2024-03-09T14:28:55.577946+0000","last_unstale":"2024-03-09T15:06:38.372347+0000","last_undegraded":"2024-03-09T15:06:38.372347+0000","last_fullsized":"2024-03-09T15:06:38.372347+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:44:39.146598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2440,"num_read_kb":2271,"num_write":585,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.886323+0000","last_change":"2024-03-09T14:28:41.843028+0000","last_active":"2024-03-09T15:04:09.886323+0000","last_peered":"2024-03-09T15:04:09.886323+0000","last_clean":"2024-03-09T15:04:09.886323+0000","last_became_active":"2024-03-09T14:28:41.842251+0000","last_became_peered":"2024-03-09T14:28:41.842251+0000","last_unstale":"2024-03-09T15:04:09.886323+0000","last_undegraded":"2024-03-09T15:04:09.886323+0000","last_fullsized":"2024-03-09T15:04:09.886323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:09:29.190170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'313","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.651914+0000","last_change":"2024-03-09T14:28:53.622441+0000","last_active":"2024-03-09T15:07:04.651914+0000","last_peered":"2024-03-09T15:07:04.651914+0000","last_clean":"2024-03-09T15:07:04.651914+0000","last_became_active":"2024-03-09T14:28:53.621914+0000","last_became_peered":"2024-03-09T14:28:53.621914+0000","last_unstale":"2024-03-09T15:07:04.651914+0000","last_undegraded":"2024-03-09T15:07:04.651914+0000","last_fullsized":"2024-03-09T15:07:04.651914+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:35.698441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7585770,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":520,"num_read_kb":22951,"num_write":1121,"num_write_kb":34708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.714348+0000","last_change":"2024-03-09T14:28:57.613906+0000","last_active":"2024-03-09T15:04:29.714348+0000","last_peered":"2024-03-09T15:04:29.714348+0000","last_clean":"2024-03-09T15:04:29.714348+0000","last_became_active":"2024-03-09T14:28:57.613407+0000","last_became_peered":"2024-03-09T14:28:57.613407+0000","last_unstale":"2024-03-09T15:04:29.714348+0000","last_undegraded":"2024-03-09T15:04:29.714348+0000","last_fullsized":"2024-03-09T15:04:29.714348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:51:41.922830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'110","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:01.825035+0000","last_change":"2024-03-09T14:28:59.619709+0000","last_active":"2024-03-09T15:06:01.825035+0000","last_peered":"2024-03-09T15:06:01.825035+0000","last_clean":"2024-03-09T15:06:01.825035+0000","last_became_active":"2024-03-09T14:28:59.619291+0000","last_became_peered":"2024-03-09T14:28:59.619291+0000","last_unstale":"2024-03-09T15:06:01.825035+0000","last_undegraded":"2024-03-09T15:06:01.825035+0000","last_fullsized":"2024-03-09T15:06:01.825035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:25.604984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":110,"num_write":80,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:44.694699+0000","last_change":"2024-03-09T14:29:01.657586+0000","last_active":"2024-03-09T15:03:44.694699+0000","last_peered":"2024-03-09T15:03:44.694699+0000","last_clean":"2024-03-09T15:03:44.694699+0000","last_became_active":"2024-03-09T14:29:01.656672+0000","last_became_peered":"2024-03-09T14:29:01.656672+0000","last_unstale":"2024-03-09T15:03:44.694699+0000","last_undegraded":"2024-03-09T15:03:44.694699+0000","last_fullsized":"2024-03-09T15:03:44.694699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:15:26.411549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'104","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:31.620441+0000","last_change":"2024-03-09T14:29:03.673314+0000","last_active":"2024-03-09T15:06:31.620441+0000","last_peered":"2024-03-09T15:06:31.620441+0000","last_clean":"2024-03-09T15:06:31.620441+0000","last_became_active":"2024-03-09T14:29:03.672534+0000","last_became_peered":"2024-03-09T14:29:03.672534+0000","last_unstale":"2024-03-09T15:06:31.620441+0000","last_undegraded":"2024-03-09T15:06:31.620441+0000","last_fullsized":"2024-03-09T15:06:31.620441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:59:22.964887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":109,"num_write":236,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'463","reported_seq":2131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.144388+0000","last_change":"2024-03-09T14:28:55.584898+0000","last_active":"2024-03-09T15:06:36.144388+0000","last_peered":"2024-03-09T15:06:36.144388+0000","last_clean":"2024-03-09T15:06:36.144388+0000","last_became_active":"2024-03-09T14:28:55.583536+0000","last_became_peered":"2024-03-09T14:28:55.583536+0000","last_unstale":"2024-03-09T15:06:36.144388+0000","last_undegraded":"2024-03-09T15:06:36.144388+0000","last_fullsized":"2024-03-09T15:06:36.144388+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:58:23.929457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2714,"num_read_kb":2554,"num_write":561,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'347","reported_seq":975,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.915639+0000","last_change":"2024-03-09T14:28:53.629100+0000","last_active":"2024-03-09T15:07:04.915639+0000","last_peered":"2024-03-09T15:07:04.915639+0000","last_clean":"2024-03-09T15:07:04.915639+0000","last_became_active":"2024-03-09T14:28:53.626879+0000","last_became_peered":"2024-03-09T14:28:53.626879+0000","last_unstale":"2024-03-09T15:07:04.915639+0000","last_undegraded":"2024-03-09T15:07:04.915639+0000","last_fullsized":"2024-03-09T15:07:04.915639+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:04:10.643317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8554852,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":510,"num_read_kb":4755,"num_write":1349,"num_write_kb":47511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:10.059991+0000","last_change":"2024-03-09T14:28:42.127635+0000","last_active":"2024-03-09T15:04:10.059991+0000","last_peered":"2024-03-09T15:04:10.059991+0000","last_clean":"2024-03-09T15:04:10.059991+0000","last_became_active":"2024-03-09T14:28:42.126799+0000","last_became_peered":"2024-03-09T14:28:42.126799+0000","last_unstale":"2024-03-09T15:04:10.059991+0000","last_undegraded":"2024-03-09T15:04:10.059991+0000","last_fullsized":"2024-03-09T15:04:10.059991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:32.493854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.713156+0000","last_change":"2024-03-09T14:28:57.609247+0000","last_active":"2024-03-09T15:04:24.713156+0000","last_peered":"2024-03-09T15:04:24.713156+0000","last_clean":"2024-03-09T15:04:24.713156+0000","last_became_active":"2024-03-09T14:28:57.608723+0000","last_became_peered":"2024-03-09T14:28:57.608723+0000","last_unstale":"2024-03-09T15:04:24.713156+0000","last_undegraded":"2024-03-09T15:04:24.713156+0000","last_fullsized":"2024-03-09T15:04:24.713156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:02:45.228011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'526","reported_seq":1170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.631986+0000","last_change":"2024-03-09T14:28:59.625137+0000","last_active":"2024-03-09T15:07:03.631986+0000","last_peered":"2024-03-09T15:07:03.631986+0000","last_clean":"2024-03-09T15:07:03.631986+0000","last_became_active":"2024-03-09T14:28:59.624680+0000","last_became_peered":"2024-03-09T14:28:59.624680+0000","last_unstale":"2024-03-09T15:07:03.631986+0000","last_undegraded":"2024-03-09T15:07:03.631986+0000","last_fullsized":"2024-03-09T15:07:03.631986+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:11.075920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101647,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":939,"num_read_kb":2081,"num_write":778,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.706169+0000","last_change":"2024-03-09T14:29:01.641583+0000","last_active":"2024-03-09T15:04:29.706169+0000","last_peered":"2024-03-09T15:04:29.706169+0000","last_clean":"2024-03-09T15:04:29.706169+0000","last_became_active":"2024-03-09T14:29:01.640485+0000","last_became_peered":"2024-03-09T14:29:01.640485+0000","last_unstale":"2024-03-09T15:04:29.706169+0000","last_undegraded":"2024-03-09T15:04:29.706169+0000","last_fullsized":"2024-03-09T15:04:29.706169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:42:25.734918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'141","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.924663+0000","last_change":"2024-03-09T14:29:03.676884+0000","last_active":"2024-03-09T15:06:41.924663+0000","last_peered":"2024-03-09T15:06:41.924663+0000","last_clean":"2024-03-09T15:06:41.924663+0000","last_became_active":"2024-03-09T14:29:03.676032+0000","last_became_peered":"2024-03-09T14:29:03.676032+0000","last_unstale":"2024-03-09T15:06:41.924663+0000","last_undegraded":"2024-03-09T15:06:41.924663+0000","last_fullsized":"2024-03-09T15:06:41.924663+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:51:57.095744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":195,"num_read_kb":176,"num_write":349,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'352","reported_seq":1744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.457643+0000","last_change":"2024-03-09T14:28:55.583629+0000","last_active":"2024-03-09T15:06:42.457643+0000","last_peered":"2024-03-09T15:06:42.457643+0000","last_clean":"2024-03-09T15:06:42.457643+0000","last_became_active":"2024-03-09T14:28:55.582743+0000","last_became_peered":"2024-03-09T14:28:55.582743+0000","last_unstale":"2024-03-09T15:06:42.457643+0000","last_undegraded":"2024-03-09T15:06:42.457643+0000","last_fullsized":"2024-03-09T15:06:42.457643+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:13.051466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1869,"num_read_kb":1781,"num_write":409,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'317","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.902455+0000","last_change":"2024-03-09T14:28:53.590149+0000","last_active":"2024-03-09T15:07:04.902455+0000","last_peered":"2024-03-09T15:07:04.902455+0000","last_clean":"2024-03-09T15:07:04.902455+0000","last_became_active":"2024-03-09T14:28:53.589640+0000","last_became_peered":"2024-03-09T14:28:53.589640+0000","last_unstale":"2024-03-09T15:07:04.902455+0000","last_undegraded":"2024-03-09T15:07:04.902455+0000","last_fullsized":"2024-03-09T15:07:04.902455+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:38:10.355714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049044,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":456,"num_read_kb":38844,"num_write":1119,"num_write_kb":48736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:19.707999+0000","last_change":"2024-03-09T14:28:42.127115+0000","last_active":"2024-03-09T15:04:19.707999+0000","last_peered":"2024-03-09T15:04:19.707999+0000","last_clean":"2024-03-09T15:04:19.707999+0000","last_became_active":"2024-03-09T14:28:42.126201+0000","last_became_peered":"2024-03-09T14:28:42.126201+0000","last_unstale":"2024-03-09T15:04:19.707999+0000","last_undegraded":"2024-03-09T15:04:19.707999+0000","last_fullsized":"2024-03-09T15:04:19.707999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:57.954868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.703353+0000","last_change":"2024-03-09T14:28:57.607498+0000","last_active":"2024-03-09T15:04:24.703353+0000","last_peered":"2024-03-09T15:04:24.703353+0000","last_clean":"2024-03-09T15:04:24.703353+0000","last_became_active":"2024-03-09T14:28:57.606429+0000","last_became_peered":"2024-03-09T14:28:57.606429+0000","last_unstale":"2024-03-09T15:04:24.703353+0000","last_undegraded":"2024-03-09T15:04:24.703353+0000","last_fullsized":"2024-03-09T15:04:24.703353+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:11:59.349598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'174","reported_seq":727,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.722805+0000","last_change":"2024-03-09T14:28:59.627298+0000","last_active":"2024-03-09T15:06:38.722805+0000","last_peered":"2024-03-09T15:06:38.722805+0000","last_clean":"2024-03-09T15:06:38.722805+0000","last_became_active":"2024-03-09T14:28:59.626697+0000","last_became_peered":"2024-03-09T14:28:59.626697+0000","last_unstale":"2024-03-09T15:06:38.722805+0000","last_undegraded":"2024-03-09T15:06:38.722805+0000","last_fullsized":"2024-03-09T15:06:38.722805+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:54:49.703899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":207,"num_read_kb":198,"num_write":186,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'563","reported_seq":2138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.717818+0000","last_change":"2024-03-09T14:29:01.637730+0000","last_active":"2024-03-09T15:07:04.717818+0000","last_peered":"2024-03-09T15:07:04.717818+0000","last_clean":"2024-03-09T15:07:04.717818+0000","last_became_active":"2024-03-09T14:29:01.636912+0000","last_became_peered":"2024-03-09T14:29:01.636912+0000","last_unstale":"2024-03-09T15:07:04.717818+0000","last_undegraded":"2024-03-09T15:07:04.717818+0000","last_fullsized":"2024-03-09T15:07:04.717818+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:03:38.907925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'95","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:28.252100+0000","last_change":"2024-03-09T14:29:03.665396+0000","last_active":"2024-03-09T15:06:28.252100+0000","last_peered":"2024-03-09T15:06:28.252100+0000","last_clean":"2024-03-09T15:06:28.252100+0000","last_became_active":"2024-03-09T14:29:03.664665+0000","last_became_peered":"2024-03-09T14:29:03.664665+0000","last_unstale":"2024-03-09T15:06:28.252100+0000","last_undegraded":"2024-03-09T15:06:28.252100+0000","last_fullsized":"2024-03-09T15:06:28.252100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:09:45.489579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":223,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'343","reported_seq":1825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.542652+0000","last_change":"2024-03-09T14:28:55.603920+0000","last_active":"2024-03-09T15:06:32.542652+0000","last_peered":"2024-03-09T15:06:32.542652+0000","last_clean":"2024-03-09T15:06:32.542652+0000","last_became_active":"2024-03-09T14:28:55.601355+0000","last_became_peered":"2024-03-09T14:28:55.601355+0000","last_unstale":"2024-03-09T15:06:32.542652+0000","last_undegraded":"2024-03-09T15:06:32.542652+0000","last_fullsized":"2024-03-09T15:06:32.542652+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:34.833891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1977,"num_read_kb":1906,"num_write":384,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'318","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.902300+0000","last_change":"2024-03-09T14:28:53.585247+0000","last_active":"2024-03-09T15:07:04.902300+0000","last_peered":"2024-03-09T15:07:04.902300+0000","last_clean":"2024-03-09T15:07:04.902300+0000","last_became_active":"2024-03-09T14:28:53.584728+0000","last_became_peered":"2024-03-09T14:28:53.584728+0000","last_unstale":"2024-03-09T15:07:04.902300+0000","last_undegraded":"2024-03-09T15:07:04.902300+0000","last_fullsized":"2024-03-09T15:07:04.902300+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:55.413559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918185,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":502,"num_read_kb":33595,"num_write":1164,"num_write_kb":22083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:20.049118+0000","last_change":"2024-03-09T14:28:41.840785+0000","last_active":"2024-03-09T15:03:20.049118+0000","last_peered":"2024-03-09T15:03:20.049118+0000","last_clean":"2024-03-09T15:03:20.049118+0000","last_became_active":"2024-03-09T14:28:41.840168+0000","last_became_peered":"2024-03-09T14:28:41.840168+0000","last_unstale":"2024-03-09T15:03:20.049118+0000","last_undegraded":"2024-03-09T15:03:20.049118+0000","last_fullsized":"2024-03-09T15:03:20.049118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:34:15.498376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"35'5","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.007346+0000","last_change":"2024-03-09T14:28:57.613265+0000","last_active":"2024-03-09T15:07:02.007346+0000","last_peered":"2024-03-09T15:07:02.007346+0000","last_clean":"2024-03-09T15:07:02.007346+0000","last_became_active":"2024-03-09T14:28:57.610373+0000","last_became_peered":"2024-03-09T14:28:57.610373+0000","last_unstale":"2024-03-09T15:07:02.007346+0000","last_undegraded":"2024-03-09T15:07:02.007346+0000","last_fullsized":"2024-03-09T15:07:02.007346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:29.212547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":492,"num_read_kb":799,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'102","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:04.229619+0000","last_change":"2024-03-09T14:28:59.616174+0000","last_active":"2024-03-09T15:06:04.229619+0000","last_peered":"2024-03-09T15:06:04.229619+0000","last_clean":"2024-03-09T15:06:04.229619+0000","last_became_active":"2024-03-09T14:28:59.615084+0000","last_became_peered":"2024-03-09T14:28:59.615084+0000","last_unstale":"2024-03-09T15:06:04.229619+0000","last_undegraded":"2024-03-09T15:06:04.229619+0000","last_fullsized":"2024-03-09T15:06:04.229619+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:06:53.932808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":100,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'582","reported_seq":2173,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.484960+0000","last_change":"2024-03-09T14:29:01.631333+0000","last_active":"2024-03-09T15:07:02.484960+0000","last_peered":"2024-03-09T15:07:02.484960+0000","last_clean":"2024-03-09T15:07:02.484960+0000","last_became_active":"2024-03-09T14:29:01.630598+0000","last_became_peered":"2024-03-09T14:29:01.630598+0000","last_unstale":"2024-03-09T15:07:02.484960+0000","last_undegraded":"2024-03-09T15:07:02.484960+0000","last_fullsized":"2024-03-09T15:07:02.484960+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:04:45.034915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'228","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:28.905578+0000","last_change":"2024-03-09T14:29:03.684917+0000","last_active":"2024-03-09T15:06:28.905578+0000","last_peered":"2024-03-09T15:06:28.905578+0000","last_clean":"2024-03-09T15:06:28.905578+0000","last_became_active":"2024-03-09T14:29:03.684294+0000","last_became_peered":"2024-03-09T14:29:03.684294+0000","last_unstale":"2024-03-09T15:06:28.905578+0000","last_undegraded":"2024-03-09T15:06:28.905578+0000","last_fullsized":"2024-03-09T15:06:28.905578+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:49:59.049525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":199,"num_write":480,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'364","reported_seq":2033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.910397+0000","last_change":"2024-03-09T14:28:55.569425+0000","last_active":"2024-03-09T15:06:39.910397+0000","last_peered":"2024-03-09T15:06:39.910397+0000","last_clean":"2024-03-09T15:06:39.910397+0000","last_became_active":"2024-03-09T14:28:55.568430+0000","last_became_peered":"2024-03-09T14:28:55.568430+0000","last_unstale":"2024-03-09T15:06:39.910397+0000","last_undegraded":"2024-03-09T15:06:39.910397+0000","last_fullsized":"2024-03-09T15:06:39.910397+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:22:01.506801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2357,"num_read_kb":2282,"num_write":412,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'353","reported_seq":980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.699547+0000","last_change":"2024-03-09T14:28:53.589944+0000","last_active":"2024-03-09T15:07:04.699547+0000","last_peered":"2024-03-09T15:07:04.699547+0000","last_clean":"2024-03-09T15:07:04.699547+0000","last_became_active":"2024-03-09T14:28:53.589491+0000","last_became_peered":"2024-03-09T14:28:53.589491+0000","last_unstale":"2024-03-09T15:07:04.699547+0000","last_undegraded":"2024-03-09T15:07:04.699547+0000","last_fullsized":"2024-03-09T15:07:04.699547+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:10.418545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17646996,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":459,"num_read_kb":37358,"num_write":1224,"num_write_kb":47489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.690049+0000","last_change":"2024-03-09T14:28:41.841410+0000","last_active":"2024-03-09T15:03:24.690049+0000","last_peered":"2024-03-09T15:03:24.690049+0000","last_clean":"2024-03-09T15:03:24.690049+0000","last_became_active":"2024-03-09T14:28:41.840575+0000","last_became_peered":"2024-03-09T14:28:41.840575+0000","last_unstale":"2024-03-09T15:03:24.690049+0000","last_undegraded":"2024-03-09T15:03:24.690049+0000","last_fullsized":"2024-03-09T15:03:24.690049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:57.501425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"35'3","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.461344+0000","last_change":"2024-03-09T14:28:57.605420+0000","last_active":"2024-03-09T15:07:02.461344+0000","last_peered":"2024-03-09T15:07:02.461344+0000","last_clean":"2024-03-09T15:07:02.461344+0000","last_became_active":"2024-03-09T14:28:57.604511+0000","last_became_peered":"2024-03-09T14:28:57.604511+0000","last_unstale":"2024-03-09T15:07:02.461344+0000","last_undegraded":"2024-03-09T15:07:02.461344+0000","last_fullsized":"2024-03-09T15:07:02.461344+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:27:24.834782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":488,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'678","reported_seq":1381,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.660675+0000","last_change":"2024-03-09T14:28:59.630805+0000","last_active":"2024-03-09T15:07:04.660675+0000","last_peered":"2024-03-09T15:07:04.660675+0000","last_clean":"2024-03-09T15:07:04.660675+0000","last_became_active":"2024-03-09T14:28:59.630044+0000","last_became_peered":"2024-03-09T14:28:59.630044+0000","last_unstale":"2024-03-09T15:07:04.660675+0000","last_undegraded":"2024-03-09T15:07:04.660675+0000","last_fullsized":"2024-03-09T15:07:04.660675+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:29:17.068940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144882,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1208,"num_read_kb":2774,"num_write":982,"num_write_kb":820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.946142+0000","last_change":"2024-03-09T14:29:01.639091+0000","last_active":"2024-03-09T15:04:29.946142+0000","last_peered":"2024-03-09T15:04:29.946142+0000","last_clean":"2024-03-09T15:04:29.946142+0000","last_became_active":"2024-03-09T14:29:01.638590+0000","last_became_peered":"2024-03-09T14:29:01.638590+0000","last_unstale":"2024-03-09T15:04:29.946142+0000","last_undegraded":"2024-03-09T15:04:29.946142+0000","last_fullsized":"2024-03-09T15:04:29.946142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:05:05.637460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'122","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:16.433331+0000","last_change":"2024-03-09T14:29:03.671961+0000","last_active":"2024-03-09T15:05:16.433331+0000","last_peered":"2024-03-09T15:05:16.433331+0000","last_clean":"2024-03-09T15:05:16.433331+0000","last_became_active":"2024-03-09T14:29:03.671138+0000","last_became_peered":"2024-03-09T14:29:03.671138+0000","last_unstale":"2024-03-09T15:05:16.433331+0000","last_undegraded":"2024-03-09T15:05:16.433331+0000","last_fullsized":"2024-03-09T15:05:16.433331+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:11.482213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":309,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'132","reported_seq":679,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:06.018193+0000","last_change":"2024-03-09T14:29:03.682511+0000","last_active":"2024-03-09T15:06:06.018193+0000","last_peered":"2024-03-09T15:06:06.018193+0000","last_clean":"2024-03-09T15:06:06.018193+0000","last_became_active":"2024-03-09T14:29:03.681920+0000","last_became_peered":"2024-03-09T14:29:03.681920+0000","last_unstale":"2024-03-09T15:06:06.018193+0000","last_undegraded":"2024-03-09T15:06:06.018193+0000","last_fullsized":"2024-03-09T15:06:06.018193+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:28:46.108899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":222,"num_write":331,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'713","reported_seq":2210,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.478578+0000","last_change":"2024-03-09T14:28:55.590020+0000","last_active":"2024-03-09T15:06:53.478578+0000","last_peered":"2024-03-09T15:06:53.478578+0000","last_clean":"2024-03-09T15:06:53.478578+0000","last_became_active":"2024-03-09T14:28:55.589278+0000","last_became_peered":"2024-03-09T14:28:55.589278+0000","last_unstale":"2024-03-09T15:06:53.478578+0000","last_undegraded":"2024-03-09T15:06:53.478578+0000","last_fullsized":"2024-03-09T15:06:53.478578+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":700,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:16:27.469317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3302,"num_read_kb":2973,"num_write":944,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'301","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.709386+0000","last_change":"2024-03-09T14:28:53.624761+0000","last_active":"2024-03-09T15:07:04.709386+0000","last_peered":"2024-03-09T15:07:04.709386+0000","last_clean":"2024-03-09T15:07:04.709386+0000","last_became_active":"2024-03-09T14:28:53.624231+0000","last_became_peered":"2024-03-09T14:28:53.624231+0000","last_unstale":"2024-03-09T15:07:04.709386+0000","last_undegraded":"2024-03-09T15:07:04.709386+0000","last_fullsized":"2024-03-09T15:07:04.709386+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:01:48.466150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10692168,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":521,"num_read_kb":58598,"num_write":1147,"num_write_kb":63743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:00.057746+0000","last_change":"2024-03-09T14:28:57.616817+0000","last_active":"2024-03-09T15:04:00.057746+0000","last_peered":"2024-03-09T15:04:00.057746+0000","last_clean":"2024-03-09T15:04:00.057746+0000","last_became_active":"2024-03-09T14:28:57.616045+0000","last_became_peered":"2024-03-09T14:28:57.616045+0000","last_unstale":"2024-03-09T15:04:00.057746+0000","last_undegraded":"2024-03-09T15:04:00.057746+0000","last_fullsized":"2024-03-09T15:04:00.057746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:40:21.513986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'251","reported_seq":813,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.836638+0000","last_change":"2024-03-09T14:28:59.615640+0000","last_active":"2024-03-09T15:07:02.836638+0000","last_peered":"2024-03-09T15:07:02.836638+0000","last_clean":"2024-03-09T15:07:02.836638+0000","last_became_active":"2024-03-09T14:28:59.615265+0000","last_became_peered":"2024-03-09T14:28:59.615265+0000","last_unstale":"2024-03-09T15:07:02.836638+0000","last_undegraded":"2024-03-09T15:07:02.836638+0000","last_fullsized":"2024-03-09T15:07:02.836638+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:29:10.543045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41654,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":398,"num_read_kb":895,"num_write":318,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.938921+0000","last_change":"2024-03-09T14:29:01.630945+0000","last_active":"2024-03-09T15:04:04.938921+0000","last_peered":"2024-03-09T15:04:04.938921+0000","last_clean":"2024-03-09T15:04:04.938921+0000","last_became_active":"2024-03-09T14:29:01.630021+0000","last_became_peered":"2024-03-09T14:29:01.630021+0000","last_unstale":"2024-03-09T15:04:04.938921+0000","last_undegraded":"2024-03-09T15:04:04.938921+0000","last_fullsized":"2024-03-09T15:04:04.938921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:51.210479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'124","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.163225+0000","last_change":"2024-03-09T14:29:03.661082+0000","last_active":"2024-03-09T15:06:36.163225+0000","last_peered":"2024-03-09T15:06:36.163225+0000","last_clean":"2024-03-09T15:06:36.163225+0000","last_became_active":"2024-03-09T14:29:03.660356+0000","last_became_peered":"2024-03-09T14:29:03.660356+0000","last_unstale":"2024-03-09T15:06:36.163225+0000","last_undegraded":"2024-03-09T15:06:36.163225+0000","last_fullsized":"2024-03-09T15:06:36.163225+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:48:43.599086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'835","reported_seq":2443,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.381007+0000","last_change":"2024-03-09T14:28:55.592219+0000","last_active":"2024-03-09T15:06:38.381007+0000","last_peered":"2024-03-09T15:06:38.381007+0000","last_clean":"2024-03-09T15:06:38.381007+0000","last_became_active":"2024-03-09T14:28:55.591498+0000","last_became_peered":"2024-03-09T14:28:55.591498+0000","last_unstale":"2024-03-09T15:06:38.381007+0000","last_undegraded":"2024-03-09T15:06:38.381007+0000","last_fullsized":"2024-03-09T15:06:38.381007+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:10:05.911916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3847,"num_read_kb":3445,"num_write":1140,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'300","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.666868+0000","last_change":"2024-03-09T14:29:28.731900+0000","last_active":"2024-03-09T15:07:04.666868+0000","last_peered":"2024-03-09T15:07:04.666868+0000","last_clean":"2024-03-09T15:07:04.666868+0000","last_became_active":"2024-03-09T14:29:28.729906+0000","last_became_peered":"2024-03-09T14:29:28.729906+0000","last_unstale":"2024-03-09T15:07:04.666868+0000","last_undegraded":"2024-03-09T15:07:04.666868+0000","last_fullsized":"2024-03-09T15:07:04.666868+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:32:05.771889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":649620,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":465,"num_read_kb":3449,"num_write":1246,"num_write_kb":20441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,4],"acting":[2,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.937932+0000","last_change":"2024-03-09T14:28:57.609587+0000","last_active":"2024-03-09T15:03:59.937932+0000","last_peered":"2024-03-09T15:03:59.937932+0000","last_clean":"2024-03-09T15:03:59.937932+0000","last_became_active":"2024-03-09T14:28:57.608697+0000","last_became_peered":"2024-03-09T14:28:57.608697+0000","last_unstale":"2024-03-09T15:03:59.937932+0000","last_undegraded":"2024-03-09T15:03:59.937932+0000","last_fullsized":"2024-03-09T15:03:59.937932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:57.108279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'48","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:19.740738+0000","last_change":"2024-03-09T14:28:59.621455+0000","last_active":"2024-03-09T15:06:19.740738+0000","last_peered":"2024-03-09T15:06:19.740738+0000","last_clean":"2024-03-09T15:06:19.740738+0000","last_became_active":"2024-03-09T14:28:59.620907+0000","last_became_peered":"2024-03-09T14:28:59.620907+0000","last_unstale":"2024-03-09T15:06:19.740738+0000","last_undegraded":"2024-03-09T15:06:19.740738+0000","last_fullsized":"2024-03-09T15:06:19.740738+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:04:27.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.704294+0000","last_change":"2024-03-09T14:29:01.651271+0000","last_active":"2024-03-09T15:04:04.704294+0000","last_peered":"2024-03-09T15:04:04.704294+0000","last_clean":"2024-03-09T15:04:04.704294+0000","last_became_active":"2024-03-09T14:29:01.650734+0000","last_became_peered":"2024-03-09T14:29:01.650734+0000","last_unstale":"2024-03-09T15:04:04.704294+0000","last_undegraded":"2024-03-09T15:04:04.704294+0000","last_fullsized":"2024-03-09T15:04:04.704294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:42:30.232634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'222","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:06.013623+0000","last_change":"2024-03-09T14:29:03.687235+0000","last_active":"2024-03-09T15:06:06.013623+0000","last_peered":"2024-03-09T15:06:06.013623+0000","last_clean":"2024-03-09T15:06:06.013623+0000","last_became_active":"2024-03-09T14:29:03.686455+0000","last_became_peered":"2024-03-09T14:29:03.686455+0000","last_unstale":"2024-03-09T15:06:06.013623+0000","last_undegraded":"2024-03-09T15:06:06.013623+0000","last_fullsized":"2024-03-09T15:06:06.013623+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:01:35.182146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":435,"num_write":508,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'405","reported_seq":1934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:21.863481+0000","last_change":"2024-03-09T14:28:55.591974+0000","last_active":"2024-03-09T15:06:21.863481+0000","last_peered":"2024-03-09T15:06:21.863481+0000","last_clean":"2024-03-09T15:06:21.863481+0000","last_became_active":"2024-03-09T14:28:55.591649+0000","last_became_peered":"2024-03-09T14:28:55.591649+0000","last_unstale":"2024-03-09T15:06:21.863481+0000","last_undegraded":"2024-03-09T15:06:21.863481+0000","last_fullsized":"2024-03-09T15:06:21.863481+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:01:16.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2197,"num_read_kb":2083,"num_write":469,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'278","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.902100+0000","last_change":"2024-03-09T14:28:53.600254+0000","last_active":"2024-03-09T15:07:04.902100+0000","last_peered":"2024-03-09T15:07:04.902100+0000","last_clean":"2024-03-09T15:07:04.902100+0000","last_became_active":"2024-03-09T14:28:53.598990+0000","last_became_peered":"2024-03-09T14:28:53.598990+0000","last_unstale":"2024-03-09T15:07:04.902100+0000","last_undegraded":"2024-03-09T15:07:04.902100+0000","last_fullsized":"2024-03-09T15:07:04.902100+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:19:25.865137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245675,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":357,"num_read_kb":35561,"num_write":1010,"num_write_kb":44906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.702952+0000","last_change":"2024-03-09T14:28:57.615933+0000","last_active":"2024-03-09T15:03:59.702952+0000","last_peered":"2024-03-09T15:03:59.702952+0000","last_clean":"2024-03-09T15:03:59.702952+0000","last_became_active":"2024-03-09T14:28:57.615229+0000","last_became_peered":"2024-03-09T14:28:57.615229+0000","last_unstale":"2024-03-09T15:03:59.702952+0000","last_undegraded":"2024-03-09T15:03:59.702952+0000","last_fullsized":"2024-03-09T15:03:59.702952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:53:06.887398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'270","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.728834+0000","last_change":"2024-03-09T14:28:59.617614+0000","last_active":"2024-03-09T15:07:04.728834+0000","last_peered":"2024-03-09T15:07:04.728834+0000","last_clean":"2024-03-09T15:07:04.728834+0000","last_became_active":"2024-03-09T14:28:59.615881+0000","last_became_peered":"2024-03-09T14:28:59.615881+0000","last_unstale":"2024-03-09T15:07:04.728834+0000","last_undegraded":"2024-03-09T15:07:04.728834+0000","last_fullsized":"2024-03-09T15:07:04.728834+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:14.844823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48426,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":988,"num_write":356,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.699216+0000","last_change":"2024-03-09T14:29:01.657350+0000","last_active":"2024-03-09T15:04:04.699216+0000","last_peered":"2024-03-09T15:04:04.699216+0000","last_clean":"2024-03-09T15:04:04.699216+0000","last_became_active":"2024-03-09T14:29:01.656740+0000","last_became_peered":"2024-03-09T14:29:01.656740+0000","last_unstale":"2024-03-09T15:04:04.699216+0000","last_undegraded":"2024-03-09T15:04:04.699216+0000","last_fullsized":"2024-03-09T15:04:04.699216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:51.984064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'189","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:40.560043+0000","last_change":"2024-03-09T14:29:03.674368+0000","last_active":"2024-03-09T15:06:40.560043+0000","last_peered":"2024-03-09T15:06:40.560043+0000","last_clean":"2024-03-09T15:06:40.560043+0000","last_became_active":"2024-03-09T14:29:03.671571+0000","last_became_peered":"2024-03-09T14:29:03.671571+0000","last_unstale":"2024-03-09T15:06:40.560043+0000","last_undegraded":"2024-03-09T15:06:40.560043+0000","last_fullsized":"2024-03-09T15:06:40.560043+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:55:55.769903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":257,"num_read_kb":221,"num_write":372,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'1158","reported_seq":2774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.374429+0000","last_change":"2024-03-09T14:28:55.596769+0000","last_active":"2024-03-09T15:06:38.374429+0000","last_peered":"2024-03-09T15:06:38.374429+0000","last_clean":"2024-03-09T15:06:38.374429+0000","last_became_active":"2024-03-09T14:28:55.592387+0000","last_became_peered":"2024-03-09T14:28:55.592387+0000","last_unstale":"2024-03-09T15:06:38.374429+0000","last_undegraded":"2024-03-09T15:06:38.374429+0000","last_fullsized":"2024-03-09T15:06:38.374429+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":1100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:32:02.543520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4979,"num_read_kb":4357,"num_write":1600,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'303","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.740153+0000","last_change":"2024-03-09T14:28:53.627197+0000","last_active":"2024-03-09T15:07:04.740153+0000","last_peered":"2024-03-09T15:07:04.740153+0000","last_clean":"2024-03-09T15:07:04.740153+0000","last_became_active":"2024-03-09T14:28:53.626736+0000","last_became_peered":"2024-03-09T14:28:53.626736+0000","last_unstale":"2024-03-09T15:07:04.740153+0000","last_undegraded":"2024-03-09T15:07:04.740153+0000","last_fullsized":"2024-03-09T15:07:04.740153+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:05:23.421912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1696239,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":471,"num_read_kb":7830,"num_write":1201,"num_write_kb":47405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.698154+0000","last_change":"2024-03-09T14:28:57.614929+0000","last_active":"2024-03-09T15:03:59.698154+0000","last_peered":"2024-03-09T15:03:59.698154+0000","last_clean":"2024-03-09T15:03:59.698154+0000","last_became_active":"2024-03-09T14:28:57.613999+0000","last_became_peered":"2024-03-09T14:28:57.613999+0000","last_unstale":"2024-03-09T15:03:59.698154+0000","last_undegraded":"2024-03-09T15:03:59.698154+0000","last_fullsized":"2024-03-09T15:03:59.698154+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:36:44.418823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'255","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.517558+0000","last_change":"2024-03-09T14:28:59.615487+0000","last_active":"2024-03-09T15:07:04.517558+0000","last_peered":"2024-03-09T15:07:04.517558+0000","last_clean":"2024-03-09T15:07:04.517558+0000","last_became_active":"2024-03-09T14:28:59.614754+0000","last_became_peered":"2024-03-09T14:28:59.614754+0000","last_unstale":"2024-03-09T15:07:04.517558+0000","last_undegraded":"2024-03-09T15:07:04.517558+0000","last_fullsized":"2024-03-09T15:07:04.517558+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:55:46.151434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43227,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":1017,"num_write":350,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.708050+0000","last_change":"2024-03-09T14:29:01.648210+0000","last_active":"2024-03-09T15:04:04.708050+0000","last_peered":"2024-03-09T15:04:04.708050+0000","last_clean":"2024-03-09T15:04:04.708050+0000","last_became_active":"2024-03-09T14:29:01.647570+0000","last_became_peered":"2024-03-09T14:29:01.647570+0000","last_unstale":"2024-03-09T15:04:04.708050+0000","last_undegraded":"2024-03-09T15:04:04.708050+0000","last_fullsized":"2024-03-09T15:04:04.708050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:32:26.862326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'814","reported_seq":2349,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:30.930229+0000","last_change":"2024-03-09T14:28:55.600454+0000","last_active":"2024-03-09T15:06:30.930229+0000","last_peered":"2024-03-09T15:06:30.930229+0000","last_clean":"2024-03-09T15:06:30.930229+0000","last_became_active":"2024-03-09T14:28:55.599825+0000","last_became_peered":"2024-03-09T14:28:55.599825+0000","last_unstale":"2024-03-09T15:06:30.930229+0000","last_undegraded":"2024-03-09T15:06:30.930229+0000","last_fullsized":"2024-03-09T15:06:30.930229+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:16:30.042238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3687,"num_read_kb":3276,"num_write":1113,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'276","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.886314+0000","last_change":"2024-03-09T14:28:53.565880+0000","last_active":"2024-03-09T15:07:04.886314+0000","last_peered":"2024-03-09T15:07:04.886314+0000","last_clean":"2024-03-09T15:07:04.886314+0000","last_became_active":"2024-03-09T14:28:53.565431+0000","last_became_peered":"2024-03-09T14:28:53.565431+0000","last_unstale":"2024-03-09T15:07:04.886314+0000","last_undegraded":"2024-03-09T15:07:04.886314+0000","last_fullsized":"2024-03-09T15:07:04.886314+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:17:59.099392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656008,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":367,"num_read_kb":7267,"num_write":958,"num_write_kb":31379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:04.723350+0000","last_change":"2024-03-09T14:28:57.611182+0000","last_active":"2024-03-09T15:05:04.723350+0000","last_peered":"2024-03-09T15:05:04.723350+0000","last_clean":"2024-03-09T15:05:04.723350+0000","last_became_active":"2024-03-09T14:28:57.610126+0000","last_became_peered":"2024-03-09T14:28:57.610126+0000","last_unstale":"2024-03-09T15:05:04.723350+0000","last_undegraded":"2024-03-09T15:05:04.723350+0000","last_fullsized":"2024-03-09T15:05:04.723350+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:16:33.837545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'474","reported_seq":1100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.438153+0000","last_change":"2024-03-09T14:28:59.614860+0000","last_active":"2024-03-09T15:07:04.438153+0000","last_peered":"2024-03-09T15:07:04.438153+0000","last_clean":"2024-03-09T15:07:04.438153+0000","last_became_active":"2024-03-09T14:28:59.614069+0000","last_became_peered":"2024-03-09T14:28:59.614069+0000","last_unstale":"2024-03-09T15:07:04.438153+0000","last_undegraded":"2024-03-09T15:07:04.438153+0000","last_fullsized":"2024-03-09T15:07:04.438153+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:31:13.778160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88057,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":2100,"num_write":750,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.885313+0000","last_change":"2024-03-09T14:29:01.640843+0000","last_active":"2024-03-09T15:04:04.885313+0000","last_peered":"2024-03-09T15:04:04.885313+0000","last_clean":"2024-03-09T15:04:04.885313+0000","last_became_active":"2024-03-09T14:29:01.639825+0000","last_became_peered":"2024-03-09T14:29:01.639825+0000","last_unstale":"2024-03-09T15:04:04.885313+0000","last_undegraded":"2024-03-09T15:04:04.885313+0000","last_fullsized":"2024-03-09T15:04:04.885313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:39:04.267480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'149","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.868628+0000","last_change":"2024-03-09T14:29:03.667287+0000","last_active":"2024-03-09T15:06:36.868628+0000","last_peered":"2024-03-09T15:06:36.868628+0000","last_clean":"2024-03-09T15:06:36.868628+0000","last_became_active":"2024-03-09T14:29:03.666515+0000","last_became_peered":"2024-03-09T14:29:03.666515+0000","last_unstale":"2024-03-09T15:06:36.868628+0000","last_undegraded":"2024-03-09T15:06:36.868628+0000","last_fullsized":"2024-03-09T15:06:36.868628+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:42.886520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":181,"num_write":332,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'874","reported_seq":2620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.307400+0000","last_change":"2024-03-09T14:28:55.586646+0000","last_active":"2024-03-09T15:06:41.307400+0000","last_peered":"2024-03-09T15:06:41.307400+0000","last_clean":"2024-03-09T15:06:41.307400+0000","last_became_active":"2024-03-09T14:28:55.586247+0000","last_became_peered":"2024-03-09T14:28:55.586247+0000","last_unstale":"2024-03-09T15:06:41.307400+0000","last_undegraded":"2024-03-09T15:06:41.307400+0000","last_fullsized":"2024-03-09T15:06:41.307400+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:51.468365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4288,"num_read_kb":3851,"num_write":1208,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'307","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.086705+0000","last_change":"2024-03-09T14:28:53.618203+0000","last_active":"2024-03-09T15:07:05.086705+0000","last_peered":"2024-03-09T15:07:05.086705+0000","last_clean":"2024-03-09T15:07:05.086705+0000","last_became_active":"2024-03-09T14:28:53.617832+0000","last_became_peered":"2024-03-09T14:28:53.617832+0000","last_unstale":"2024-03-09T15:07:05.086705+0000","last_undegraded":"2024-03-09T15:07:05.086705+0000","last_fullsized":"2024-03-09T15:07:05.086705+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:04:16.779631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22926,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":436,"num_read_kb":36524,"num_write":1097,"num_write_kb":22031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.703460+0000","last_change":"2024-03-09T14:28:57.616765+0000","last_active":"2024-03-09T15:04:24.703460+0000","last_peered":"2024-03-09T15:04:24.703460+0000","last_clean":"2024-03-09T15:04:24.703460+0000","last_became_active":"2024-03-09T14:28:57.616057+0000","last_became_peered":"2024-03-09T14:28:57.616057+0000","last_unstale":"2024-03-09T15:04:24.703460+0000","last_undegraded":"2024-03-09T15:04:24.703460+0000","last_fullsized":"2024-03-09T15:04:24.703460+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:41:28.651737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'267","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.590358+0000","last_change":"2024-03-09T14:28:59.616152+0000","last_active":"2024-03-09T15:07:04.590358+0000","last_peered":"2024-03-09T15:07:04.590358+0000","last_clean":"2024-03-09T15:07:04.590358+0000","last_became_active":"2024-03-09T14:28:59.615193+0000","last_became_peered":"2024-03-09T14:28:59.615193+0000","last_unstale":"2024-03-09T15:07:04.590358+0000","last_undegraded":"2024-03-09T15:07:04.590358+0000","last_fullsized":"2024-03-09T15:07:04.590358+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:59:33.826109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43919,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":455,"num_read_kb":986,"num_write":382,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:05.058877+0000","last_change":"2024-03-09T14:29:01.661393+0000","last_active":"2024-03-09T15:04:05.058877+0000","last_peered":"2024-03-09T15:04:05.058877+0000","last_clean":"2024-03-09T15:04:05.058877+0000","last_became_active":"2024-03-09T14:29:01.660997+0000","last_became_peered":"2024-03-09T14:29:01.660997+0000","last_unstale":"2024-03-09T15:04:05.058877+0000","last_undegraded":"2024-03-09T15:04:05.058877+0000","last_fullsized":"2024-03-09T15:04:05.058877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:23.078367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'181","reported_seq":1376,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.944898+0000","last_change":"2024-03-09T14:29:03.669572+0000","last_active":"2024-03-09T15:06:53.944898+0000","last_peered":"2024-03-09T15:06:53.944898+0000","last_clean":"2024-03-09T15:06:53.944898+0000","last_became_active":"2024-03-09T14:29:03.668833+0000","last_became_peered":"2024-03-09T14:29:03.668833+0000","last_unstale":"2024-03-09T15:06:53.944898+0000","last_undegraded":"2024-03-09T15:06:53.944898+0000","last_fullsized":"2024-03-09T15:06:53.944898+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:52.062869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2487,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":947,"num_read_kb":932,"num_write":509,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'486","reported_seq":2228,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.516678+0000","last_change":"2024-03-09T14:28:55.597840+0000","last_active":"2024-03-09T15:06:32.516678+0000","last_peered":"2024-03-09T15:06:32.516678+0000","last_clean":"2024-03-09T15:06:32.516678+0000","last_became_active":"2024-03-09T14:28:55.596538+0000","last_became_peered":"2024-03-09T14:28:55.596538+0000","last_unstale":"2024-03-09T15:06:32.516678+0000","last_undegraded":"2024-03-09T15:06:32.516678+0000","last_fullsized":"2024-03-09T15:06:32.516678+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:07:17.844183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2772,"num_read_kb":2616,"num_write":579,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'269","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.687653+0000","last_change":"2024-03-09T14:28:53.597236+0000","last_active":"2024-03-09T15:07:04.687653+0000","last_peered":"2024-03-09T15:07:04.687653+0000","last_clean":"2024-03-09T15:07:04.687653+0000","last_became_active":"2024-03-09T14:28:53.589932+0000","last_became_peered":"2024-03-09T14:28:53.589932+0000","last_unstale":"2024-03-09T15:07:04.687653+0000","last_undegraded":"2024-03-09T15:07:04.687653+0000","last_fullsized":"2024-03-09T15:07:04.687653+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:18:23.444910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16919366,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":405,"num_read_kb":14456,"num_write":968,"num_write_kb":42013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.699471+0000","last_change":"2024-03-09T14:28:57.610733+0000","last_active":"2024-03-09T15:03:59.699471+0000","last_peered":"2024-03-09T15:03:59.699471+0000","last_clean":"2024-03-09T15:03:59.699471+0000","last_became_active":"2024-03-09T14:28:57.609903+0000","last_became_peered":"2024-03-09T14:28:57.609903+0000","last_unstale":"2024-03-09T15:03:59.699471+0000","last_undegraded":"2024-03-09T15:03:59.699471+0000","last_fullsized":"2024-03-09T15:03:59.699471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:06:42.154492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'259","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.245145+0000","last_change":"2024-03-09T14:28:59.631074+0000","last_active":"2024-03-09T15:07:03.245145+0000","last_peered":"2024-03-09T15:07:03.245145+0000","last_clean":"2024-03-09T15:07:03.245145+0000","last_became_active":"2024-03-09T14:28:59.630460+0000","last_became_peered":"2024-03-09T14:28:59.630460+0000","last_unstale":"2024-03-09T15:07:03.245145+0000","last_undegraded":"2024-03-09T15:07:03.245145+0000","last_fullsized":"2024-03-09T15:07:03.245145+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:09.212045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":1036,"num_write":360,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:05.073121+0000","last_change":"2024-03-09T14:29:01.636817+0000","last_active":"2024-03-09T15:05:05.073121+0000","last_peered":"2024-03-09T15:05:05.073121+0000","last_clean":"2024-03-09T15:05:05.073121+0000","last_became_active":"2024-03-09T14:29:01.636083+0000","last_became_peered":"2024-03-09T14:29:01.636083+0000","last_unstale":"2024-03-09T15:05:05.073121+0000","last_undegraded":"2024-03-09T15:05:05.073121+0000","last_fullsized":"2024-03-09T15:05:05.073121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:03.128255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'121","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.502593+0000","last_change":"2024-03-09T14:29:03.678242+0000","last_active":"2024-03-09T15:06:55.502593+0000","last_peered":"2024-03-09T15:06:55.502593+0000","last_clean":"2024-03-09T15:06:55.502593+0000","last_became_active":"2024-03-09T14:29:03.677376+0000","last_became_peered":"2024-03-09T14:29:03.677376+0000","last_unstale":"2024-03-09T15:06:55.502593+0000","last_undegraded":"2024-03-09T15:06:55.502593+0000","last_fullsized":"2024-03-09T15:06:55.502593+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:47.054570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":93,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'1138","reported_seq":2990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:01.820596+0000","last_change":"2024-03-09T14:28:55.588136+0000","last_active":"2024-03-09T15:06:01.820596+0000","last_peered":"2024-03-09T15:06:01.820596+0000","last_clean":"2024-03-09T15:06:01.820596+0000","last_became_active":"2024-03-09T14:28:55.587547+0000","last_became_peered":"2024-03-09T14:28:55.587547+0000","last_unstale":"2024-03-09T15:06:01.820596+0000","last_undegraded":"2024-03-09T15:06:01.820596+0000","last_fullsized":"2024-03-09T15:06:01.820596+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:58:51.176419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5366,"num_read_kb":4772,"num_write":1564,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'273","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.705301+0000","last_change":"2024-03-09T14:28:53.589911+0000","last_active":"2024-03-09T15:07:04.705301+0000","last_peered":"2024-03-09T15:07:04.705301+0000","last_clean":"2024-03-09T15:07:04.705301+0000","last_became_active":"2024-03-09T14:28:53.589407+0000","last_became_peered":"2024-03-09T14:28:53.589407+0000","last_unstale":"2024-03-09T15:07:04.705301+0000","last_undegraded":"2024-03-09T15:07:04.705301+0000","last_fullsized":"2024-03-09T15:07:04.705301+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:02.804743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097363,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":436,"num_read_kb":59464,"num_write":1026,"num_write_kb":28198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:00.057828+0000","last_change":"2024-03-09T14:28:57.620777+0000","last_active":"2024-03-09T15:04:00.057828+0000","last_peered":"2024-03-09T15:04:00.057828+0000","last_clean":"2024-03-09T15:04:00.057828+0000","last_became_active":"2024-03-09T14:28:57.620140+0000","last_became_peered":"2024-03-09T14:28:57.620140+0000","last_unstale":"2024-03-09T15:04:00.057828+0000","last_undegraded":"2024-03-09T15:04:00.057828+0000","last_fullsized":"2024-03-09T15:04:00.057828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:26:24.646259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'72","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:21.156819+0000","last_change":"2024-03-09T14:28:59.630490+0000","last_active":"2024-03-09T15:05:21.156819+0000","last_peered":"2024-03-09T15:05:21.156819+0000","last_clean":"2024-03-09T15:05:21.156819+0000","last_became_active":"2024-03-09T14:28:59.629734+0000","last_became_peered":"2024-03-09T14:28:59.629734+0000","last_unstale":"2024-03-09T15:05:21.156819+0000","last_undegraded":"2024-03-09T15:05:21.156819+0000","last_fullsized":"2024-03-09T15:05:21.156819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:44:21.794038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":70,"num_read_kb":63,"num_write":56,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'539","reported_seq":2053,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.470889+0000","last_change":"2024-03-09T14:29:01.651371+0000","last_active":"2024-03-09T15:07:02.470889+0000","last_peered":"2024-03-09T15:07:02.470889+0000","last_clean":"2024-03-09T15:07:02.470889+0000","last_became_active":"2024-03-09T14:29:01.650590+0000","last_became_peered":"2024-03-09T14:29:01.650590+0000","last_unstale":"2024-03-09T15:07:02.470889+0000","last_undegraded":"2024-03-09T15:07:02.470889+0000","last_fullsized":"2024-03-09T15:07:02.470889+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:16:18.239400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'124","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.980854+0000","last_change":"2024-03-09T14:29:03.677895+0000","last_active":"2024-03-09T15:06:24.980854+0000","last_peered":"2024-03-09T15:06:24.980854+0000","last_clean":"2024-03-09T15:06:24.980854+0000","last_became_active":"2024-03-09T14:29:03.677064+0000","last_became_peered":"2024-03-09T14:29:03.677064+0000","last_unstale":"2024-03-09T15:06:24.980854+0000","last_undegraded":"2024-03-09T15:06:24.980854+0000","last_fullsized":"2024-03-09T15:06:24.980854+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:21:06.747179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":150,"num_write":318,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'509","reported_seq":1975,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.288260+0000","last_change":"2024-03-09T14:28:55.610871+0000","last_active":"2024-03-09T15:06:41.288260+0000","last_peered":"2024-03-09T15:06:41.288260+0000","last_clean":"2024-03-09T15:06:41.288260+0000","last_became_active":"2024-03-09T14:28:55.610134+0000","last_became_peered":"2024-03-09T14:28:55.610134+0000","last_unstale":"2024-03-09T15:06:41.288260+0000","last_undegraded":"2024-03-09T15:06:41.288260+0000","last_fullsized":"2024-03-09T15:06:41.288260+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:52:17.579543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2571,"num_read_kb":2332,"num_write":699,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'419","reported_seq":1137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.871550+0000","last_change":"2024-03-09T14:28:53.637554+0000","last_active":"2024-03-09T15:07:04.871550+0000","last_peered":"2024-03-09T15:07:04.871550+0000","last_clean":"2024-03-09T15:07:04.871550+0000","last_became_active":"2024-03-09T14:28:53.636761+0000","last_became_peered":"2024-03-09T14:28:53.636761+0000","last_unstale":"2024-03-09T15:07:04.871550+0000","last_undegraded":"2024-03-09T15:07:04.871550+0000","last_fullsized":"2024-03-09T15:07:04.871550+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:52:47.651977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262355,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":777,"num_read_kb":7041,"num_write":1504,"num_write_kb":16792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.703042+0000","last_change":"2024-03-09T14:28:57.613685+0000","last_active":"2024-03-09T15:03:59.703042+0000","last_peered":"2024-03-09T15:03:59.703042+0000","last_clean":"2024-03-09T15:03:59.703042+0000","last_became_active":"2024-03-09T14:28:57.612982+0000","last_became_peered":"2024-03-09T14:28:57.612982+0000","last_unstale":"2024-03-09T15:03:59.703042+0000","last_undegraded":"2024-03-09T15:03:59.703042+0000","last_fullsized":"2024-03-09T15:03:59.703042+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:06:42.400023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'288","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.799108+0000","last_change":"2024-03-09T14:28:59.601758+0000","last_active":"2024-03-09T15:07:03.799108+0000","last_peered":"2024-03-09T15:07:03.799108+0000","last_clean":"2024-03-09T15:07:03.799108+0000","last_became_active":"2024-03-09T14:28:59.601007+0000","last_became_peered":"2024-03-09T14:28:59.601007+0000","last_unstale":"2024-03-09T15:07:03.799108+0000","last_undegraded":"2024-03-09T15:07:03.799108+0000","last_fullsized":"2024-03-09T15:07:03.799108+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:57.069347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58554,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":1103,"num_write":386,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.691415+0000","last_change":"2024-03-09T14:29:01.657738+0000","last_active":"2024-03-09T15:02:54.691415+0000","last_peered":"2024-03-09T15:02:54.691415+0000","last_clean":"2024-03-09T15:02:54.691415+0000","last_became_active":"2024-03-09T14:29:01.657169+0000","last_became_peered":"2024-03-09T14:29:01.657169+0000","last_unstale":"2024-03-09T15:02:54.691415+0000","last_undegraded":"2024-03-09T15:02:54.691415+0000","last_fullsized":"2024-03-09T15:02:54.691415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:34:38.555150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'122","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:51.348829+0000","last_change":"2024-03-09T14:29:03.670802+0000","last_active":"2024-03-09T15:06:51.348829+0000","last_peered":"2024-03-09T15:06:51.348829+0000","last_clean":"2024-03-09T15:06:51.348829+0000","last_became_active":"2024-03-09T14:29:03.669978+0000","last_became_peered":"2024-03-09T14:29:03.669978+0000","last_unstale":"2024-03-09T15:06:51.348829+0000","last_undegraded":"2024-03-09T15:06:51.348829+0000","last_fullsized":"2024-03-09T15:06:51.348829+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:24:30.237273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":289,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'771","reported_seq":2297,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.376951+0000","last_change":"2024-03-09T14:28:55.570920+0000","last_active":"2024-03-09T15:06:38.376951+0000","last_peered":"2024-03-09T15:06:38.376951+0000","last_clean":"2024-03-09T15:06:38.376951+0000","last_became_active":"2024-03-09T14:28:55.570161+0000","last_became_peered":"2024-03-09T14:28:55.570161+0000","last_unstale":"2024-03-09T15:06:38.376951+0000","last_undegraded":"2024-03-09T15:06:38.376951+0000","last_fullsized":"2024-03-09T15:06:38.376951+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:42:17.825813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3636,"num_read_kb":3267,"num_write":1033,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'336","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.676325+0000","last_change":"2024-03-09T14:29:28.825741+0000","last_active":"2024-03-09T15:07:04.676325+0000","last_peered":"2024-03-09T15:07:04.676325+0000","last_clean":"2024-03-09T15:07:04.676325+0000","last_became_active":"2024-03-09T14:29:28.824399+0000","last_became_peered":"2024-03-09T14:29:28.824399+0000","last_unstale":"2024-03-09T15:07:04.676325+0000","last_undegraded":"2024-03-09T15:07:04.676325+0000","last_fullsized":"2024-03-09T15:07:04.676325+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:08:57.826548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5527889,"num_objects":19,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":585,"num_read_kb":66383,"num_write":1388,"num_write_kb":58469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.884189+0000","last_change":"2024-03-09T14:28:57.609386+0000","last_active":"2024-03-09T15:03:59.884189+0000","last_peered":"2024-03-09T15:03:59.884189+0000","last_clean":"2024-03-09T15:03:59.884189+0000","last_became_active":"2024-03-09T14:28:57.608639+0000","last_became_peered":"2024-03-09T14:28:57.608639+0000","last_unstale":"2024-03-09T15:03:59.884189+0000","last_undegraded":"2024-03-09T15:03:59.884189+0000","last_fullsized":"2024-03-09T15:03:59.884189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:26:53.678171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'267","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.883594+0000","last_change":"2024-03-09T14:28:59.624561+0000","last_active":"2024-03-09T15:07:03.883594+0000","last_peered":"2024-03-09T15:07:03.883594+0000","last_clean":"2024-03-09T15:07:03.883594+0000","last_became_active":"2024-03-09T14:28:59.623529+0000","last_became_peered":"2024-03-09T14:28:59.623529+0000","last_unstale":"2024-03-09T15:07:03.883594+0000","last_undegraded":"2024-03-09T15:07:03.883594+0000","last_fullsized":"2024-03-09T15:07:03.883594+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:17.455070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":971,"num_write":346,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:04.685658+0000","last_change":"2024-03-09T14:29:01.651867+0000","last_active":"2024-03-09T15:03:04.685658+0000","last_peered":"2024-03-09T15:03:04.685658+0000","last_clean":"2024-03-09T15:03:04.685658+0000","last_became_active":"2024-03-09T14:29:01.651183+0000","last_became_peered":"2024-03-09T14:29:01.651183+0000","last_unstale":"2024-03-09T15:03:04.685658+0000","last_undegraded":"2024-03-09T15:03:04.685658+0000","last_fullsized":"2024-03-09T15:03:04.685658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:00:28.916197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'121","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:50.981576+0000","last_change":"2024-03-09T14:29:03.662620+0000","last_active":"2024-03-09T15:04:50.981576+0000","last_peered":"2024-03-09T15:04:50.981576+0000","last_clean":"2024-03-09T15:04:50.981576+0000","last_became_active":"2024-03-09T14:29:03.661848+0000","last_became_peered":"2024-03-09T14:29:03.661848+0000","last_unstale":"2024-03-09T15:04:50.981576+0000","last_undegraded":"2024-03-09T15:04:50.981576+0000","last_fullsized":"2024-03-09T15:04:50.981576+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:22:12.693452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":975,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":172,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'742","reported_seq":2302,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:22.942126+0000","last_change":"2024-03-09T14:28:55.582020+0000","last_active":"2024-03-09T15:06:22.942126+0000","last_peered":"2024-03-09T15:06:22.942126+0000","last_clean":"2024-03-09T15:06:22.942126+0000","last_became_active":"2024-03-09T14:28:55.580902+0000","last_became_peered":"2024-03-09T14:28:55.580902+0000","last_unstale":"2024-03-09T15:06:22.942126+0000","last_undegraded":"2024-03-09T15:06:22.942126+0000","last_fullsized":"2024-03-09T15:06:22.942126+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:36:35.032329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3409,"num_read_kb":3074,"num_write":976,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'280","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.783881+0000","last_change":"2024-03-09T14:28:53.619086+0000","last_active":"2024-03-09T15:07:04.783881+0000","last_peered":"2024-03-09T15:07:04.783881+0000","last_clean":"2024-03-09T15:07:04.783881+0000","last_became_active":"2024-03-09T14:28:53.618470+0000","last_became_peered":"2024-03-09T14:28:53.618470+0000","last_unstale":"2024-03-09T15:07:04.783881+0000","last_undegraded":"2024-03-09T15:07:04.783881+0000","last_fullsized":"2024-03-09T15:07:04.783881+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:00:32.753851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10509264,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":416,"num_read_kb":49463,"num_write":1133,"num_write_kb":38192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.683621+0000","last_change":"2024-03-09T14:28:57.612579+0000","last_active":"2024-03-09T15:02:49.683621+0000","last_peered":"2024-03-09T15:02:49.683621+0000","last_clean":"2024-03-09T15:02:49.683621+0000","last_became_active":"2024-03-09T14:28:57.611745+0000","last_became_peered":"2024-03-09T14:28:57.611745+0000","last_unstale":"2024-03-09T15:02:49.683621+0000","last_undegraded":"2024-03-09T15:02:49.683621+0000","last_fullsized":"2024-03-09T15:02:49.683621+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:31:50.123606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'213","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.032335+0000","last_change":"2024-03-09T14:28:59.617486+0000","last_active":"2024-03-09T15:07:03.032335+0000","last_peered":"2024-03-09T15:07:03.032335+0000","last_clean":"2024-03-09T15:07:03.032335+0000","last_became_active":"2024-03-09T14:28:59.615400+0000","last_became_peered":"2024-03-09T14:28:59.615400+0000","last_unstale":"2024-03-09T15:07:03.032335+0000","last_undegraded":"2024-03-09T15:07:03.032335+0000","last_fullsized":"2024-03-09T15:07:03.032335+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:18:51.266792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41975,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":356,"num_read_kb":841,"num_write":286,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.700482+0000","last_change":"2024-03-09T14:29:01.657829+0000","last_active":"2024-03-09T15:04:04.700482+0000","last_peered":"2024-03-09T15:04:04.700482+0000","last_clean":"2024-03-09T15:04:04.700482+0000","last_became_active":"2024-03-09T14:29:01.657117+0000","last_became_peered":"2024-03-09T14:29:01.657117+0000","last_unstale":"2024-03-09T15:04:04.700482+0000","last_undegraded":"2024-03-09T15:04:04.700482+0000","last_fullsized":"2024-03-09T15:04:04.700482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:43:59.466343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'133","reported_seq":1791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.893900+0000","last_change":"2024-03-09T14:29:03.660649+0000","last_active":"2024-03-09T15:06:53.893900+0000","last_peered":"2024-03-09T15:06:53.893900+0000","last_clean":"2024-03-09T15:06:53.893900+0000","last_became_active":"2024-03-09T14:29:03.659930+0000","last_became_peered":"2024-03-09T14:29:03.659930+0000","last_unstale":"2024-03-09T15:06:53.893900+0000","last_undegraded":"2024-03-09T15:06:53.893900+0000","last_fullsized":"2024-03-09T15:06:53.893900+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:47.922788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1320,"num_read_kb":1317,"num_write":320,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'484","reported_seq":2147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.154286+0000","last_change":"2024-03-09T14:28:55.599386+0000","last_active":"2024-03-09T15:06:36.154286+0000","last_peered":"2024-03-09T15:06:36.154286+0000","last_clean":"2024-03-09T15:06:36.154286+0000","last_became_active":"2024-03-09T14:28:55.598822+0000","last_became_peered":"2024-03-09T14:28:55.598822+0000","last_unstale":"2024-03-09T15:06:36.154286+0000","last_undegraded":"2024-03-09T15:06:36.154286+0000","last_fullsized":"2024-03-09T15:06:36.154286+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:22.447249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2615,"num_read_kb":2447,"num_write":578,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'271","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.644776+0000","last_change":"2024-03-09T14:28:53.595926+0000","last_active":"2024-03-09T15:07:04.644776+0000","last_peered":"2024-03-09T15:07:04.644776+0000","last_clean":"2024-03-09T15:07:04.644776+0000","last_became_active":"2024-03-09T14:28:53.595479+0000","last_became_peered":"2024-03-09T14:28:53.595479+0000","last_unstale":"2024-03-09T15:07:04.644776+0000","last_undegraded":"2024-03-09T15:07:04.644776+0000","last_fullsized":"2024-03-09T15:07:04.644776+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:37:40.541650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":882545,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":379,"num_read_kb":37241,"num_write":1043,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:50.041858+0000","last_change":"2024-03-09T14:28:57.608989+0000","last_active":"2024-03-09T15:02:50.041858+0000","last_peered":"2024-03-09T15:02:50.041858+0000","last_clean":"2024-03-09T15:02:50.041858+0000","last_became_active":"2024-03-09T14:28:57.608170+0000","last_became_peered":"2024-03-09T14:28:57.608170+0000","last_unstale":"2024-03-09T15:02:50.041858+0000","last_undegraded":"2024-03-09T15:02:50.041858+0000","last_fullsized":"2024-03-09T15:02:50.041858+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:20:42.765359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'254","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.336978+0000","last_change":"2024-03-09T14:28:59.615602+0000","last_active":"2024-03-09T15:07:03.336978+0000","last_peered":"2024-03-09T15:07:03.336978+0000","last_clean":"2024-03-09T15:07:03.336978+0000","last_became_active":"2024-03-09T14:28:59.614271+0000","last_became_peered":"2024-03-09T14:28:59.614271+0000","last_unstale":"2024-03-09T15:07:03.336978+0000","last_undegraded":"2024-03-09T15:07:03.336978+0000","last_fullsized":"2024-03-09T15:07:03.336978+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:53:14.078880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45957,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":426,"num_read_kb":925,"num_write":332,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.708033+0000","last_change":"2024-03-09T14:29:01.652400+0000","last_active":"2024-03-09T15:04:04.708033+0000","last_peered":"2024-03-09T15:04:04.708033+0000","last_clean":"2024-03-09T15:04:04.708033+0000","last_became_active":"2024-03-09T14:29:01.648467+0000","last_became_peered":"2024-03-09T14:29:01.648467+0000","last_unstale":"2024-03-09T15:04:04.708033+0000","last_undegraded":"2024-03-09T15:04:04.708033+0000","last_fullsized":"2024-03-09T15:04:04.708033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:46:40.874214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'89","reported_seq":573,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.103203+0000","last_change":"2024-03-09T14:29:03.666859+0000","last_active":"2024-03-09T15:06:27.103203+0000","last_peered":"2024-03-09T15:06:27.103203+0000","last_clean":"2024-03-09T15:06:27.103203+0000","last_became_active":"2024-03-09T14:29:03.666157+0000","last_became_peered":"2024-03-09T14:29:03.666157+0000","last_unstale":"2024-03-09T15:06:27.103203+0000","last_undegraded":"2024-03-09T15:06:27.103203+0000","last_fullsized":"2024-03-09T15:06:27.103203+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:26:26.981367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":67,"num_write":211,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'502","reported_seq":2001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.397894+0000","last_change":"2024-03-09T14:28:55.591379+0000","last_active":"2024-03-09T15:06:38.397894+0000","last_peered":"2024-03-09T15:06:38.397894+0000","last_clean":"2024-03-09T15:06:38.397894+0000","last_became_active":"2024-03-09T14:28:55.591054+0000","last_became_peered":"2024-03-09T14:28:55.591054+0000","last_unstale":"2024-03-09T15:06:38.397894+0000","last_undegraded":"2024-03-09T15:06:38.397894+0000","last_fullsized":"2024-03-09T15:06:38.397894+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:25.032606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2590,"num_read_kb":2449,"num_write":673,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'287","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.625676+0000","last_change":"2024-03-09T14:28:53.640090+0000","last_active":"2024-03-09T15:07:04.625676+0000","last_peered":"2024-03-09T15:07:04.625676+0000","last_clean":"2024-03-09T15:07:04.625676+0000","last_became_active":"2024-03-09T14:28:53.638941+0000","last_became_peered":"2024-03-09T14:28:53.638941+0000","last_unstale":"2024-03-09T15:07:04.625676+0000","last_undegraded":"2024-03-09T15:07:04.625676+0000","last_fullsized":"2024-03-09T15:07:04.625676+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:03:53.299755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5997998,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":445,"num_read_kb":10894,"num_write":1145,"num_write_kb":33356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'698","reported_seq":2158,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.621155+0000","last_change":"2024-03-09T14:28:55.582893+0000","last_active":"2024-03-09T15:06:29.621155+0000","last_peered":"2024-03-09T15:06:29.621155+0000","last_clean":"2024-03-09T15:06:29.621155+0000","last_became_active":"2024-03-09T14:28:55.578705+0000","last_became_peered":"2024-03-09T14:28:55.578705+0000","last_unstale":"2024-03-09T15:06:29.621155+0000","last_undegraded":"2024-03-09T15:06:29.621155+0000","last_fullsized":"2024-03-09T15:06:29.621155+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:54:28.358839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3212,"num_read_kb":2884,"num_write":923,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'298","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.619784+0000","last_change":"2024-03-09T14:28:53.618037+0000","last_active":"2024-03-09T15:07:04.619784+0000","last_peered":"2024-03-09T15:07:04.619784+0000","last_clean":"2024-03-09T15:07:04.619784+0000","last_became_active":"2024-03-09T14:28:53.617469+0000","last_became_peered":"2024-03-09T14:28:53.617469+0000","last_unstale":"2024-03-09T15:07:04.619784+0000","last_undegraded":"2024-03-09T15:07:04.619784+0000","last_fullsized":"2024-03-09T15:07:04.619784+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:13:32.235158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655947,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":476,"num_read_kb":96508,"num_write":1196,"num_write_kb":39289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'474","reported_seq":2150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.920469+0000","last_change":"2024-03-09T14:28:55.595276+0000","last_active":"2024-03-09T15:06:39.920469+0000","last_peered":"2024-03-09T15:06:39.920469+0000","last_clean":"2024-03-09T15:06:39.920469+0000","last_became_active":"2024-03-09T14:28:55.594171+0000","last_became_peered":"2024-03-09T14:28:55.594171+0000","last_unstale":"2024-03-09T15:06:39.920469+0000","last_undegraded":"2024-03-09T15:06:39.920469+0000","last_fullsized":"2024-03-09T15:06:39.920469+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:59.297943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2696,"num_read_kb":2529,"num_write":600,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'300","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.838803+0000","last_change":"2024-03-09T14:28:53.627660+0000","last_active":"2024-03-09T15:07:04.838803+0000","last_peered":"2024-03-09T15:07:04.838803+0000","last_clean":"2024-03-09T15:07:04.838803+0000","last_became_active":"2024-03-09T14:28:53.627011+0000","last_became_peered":"2024-03-09T14:28:53.627011+0000","last_unstale":"2024-03-09T15:07:04.838803+0000","last_undegraded":"2024-03-09T15:07:04.838803+0000","last_fullsized":"2024-03-09T15:07:04.838803+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:28:43.144281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":987627,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":568,"num_read_kb":86707,"num_write":1167,"num_write_kb":21935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'404","reported_seq":2036,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:28.237644+0000","last_change":"2024-03-09T14:28:55.578260+0000","last_active":"2024-03-09T15:06:28.237644+0000","last_peered":"2024-03-09T15:06:28.237644+0000","last_clean":"2024-03-09T15:06:28.237644+0000","last_became_active":"2024-03-09T14:28:55.577524+0000","last_became_peered":"2024-03-09T14:28:55.577524+0000","last_unstale":"2024-03-09T15:06:28.237644+0000","last_undegraded":"2024-03-09T15:06:28.237644+0000","last_fullsized":"2024-03-09T15:06:28.237644+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:07:13.808728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2346,"num_read_kb":2237,"num_write":463,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'352","reported_seq":1111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.723517+0000","last_change":"2024-03-09T14:28:53.579012+0000","last_active":"2024-03-09T15:07:04.723517+0000","last_peered":"2024-03-09T15:07:04.723517+0000","last_clean":"2024-03-09T15:07:04.723517+0000","last_became_active":"2024-03-09T14:28:53.578574+0000","last_became_peered":"2024-03-09T14:28:53.578574+0000","last_unstale":"2024-03-09T15:07:04.723517+0000","last_undegraded":"2024-03-09T15:07:04.723517+0000","last_fullsized":"2024-03-09T15:07:04.723517+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:29:04.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270109,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":879,"num_read_kb":59109,"num_write":1320,"num_write_kb":49113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'697","reported_seq":2179,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:20.724401+0000","last_change":"2024-03-09T14:28:55.597239+0000","last_active":"2024-03-09T15:06:20.724401+0000","last_peered":"2024-03-09T15:06:20.724401+0000","last_clean":"2024-03-09T15:06:20.724401+0000","last_became_active":"2024-03-09T14:28:55.596637+0000","last_became_peered":"2024-03-09T14:28:55.596637+0000","last_unstale":"2024-03-09T15:06:20.724401+0000","last_undegraded":"2024-03-09T15:06:20.724401+0000","last_fullsized":"2024-03-09T15:06:20.724401+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:18:02.596150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3232,"num_read_kb":2910,"num_write":917,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'253","reported_seq":850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.886998+0000","last_change":"2024-03-09T14:28:53.578550+0000","last_active":"2024-03-09T15:07:04.886998+0000","last_peered":"2024-03-09T15:07:04.886998+0000","last_clean":"2024-03-09T15:07:04.886998+0000","last_became_active":"2024-03-09T14:28:53.577994+0000","last_became_peered":"2024-03-09T14:28:53.577994+0000","last_unstale":"2024-03-09T15:07:04.886998+0000","last_undegraded":"2024-03-09T15:07:04.886998+0000","last_fullsized":"2024-03-09T15:07:04.886998+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:14.265275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6341462,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":374,"num_read_kb":10774,"num_write":985,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'1034","reported_seq":2409,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.913055+0000","last_change":"2024-03-09T14:28:55.598885+0000","last_active":"2024-03-09T15:06:39.913055+0000","last_peered":"2024-03-09T15:06:39.913055+0000","last_clean":"2024-03-09T15:06:39.913055+0000","last_became_active":"2024-03-09T14:28:55.598235+0000","last_became_peered":"2024-03-09T14:28:55.598235+0000","last_unstale":"2024-03-09T15:06:39.913055+0000","last_undegraded":"2024-03-09T15:06:39.913055+0000","last_fullsized":"2024-03-09T15:06:39.913055+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1000,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:31.960386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4348,"num_read_kb":3780,"num_write":1436,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'369","reported_seq":1055,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.081147+0000","last_change":"2024-03-09T14:28:53.591761+0000","last_active":"2024-03-09T15:07:05.081147+0000","last_peered":"2024-03-09T15:07:05.081147+0000","last_clean":"2024-03-09T15:07:05.081147+0000","last_became_active":"2024-03-09T14:28:53.591365+0000","last_became_peered":"2024-03-09T14:28:53.591365+0000","last_unstale":"2024-03-09T15:07:05.081147+0000","last_undegraded":"2024-03-09T15:07:05.081147+0000","last_fullsized":"2024-03-09T15:07:05.081147+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:40:51.486043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264373,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":665,"num_read_kb":645,"num_write":1622,"num_write_kb":21789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'476","reported_seq":1840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.471455+0000","last_change":"2024-03-09T14:29:28.739085+0000","last_active":"2024-03-09T15:06:53.471455+0000","last_peered":"2024-03-09T15:06:53.471455+0000","last_clean":"2024-03-09T15:06:53.471455+0000","last_became_active":"2024-03-09T14:29:28.738427+0000","last_became_peered":"2024-03-09T14:29:28.738427+0000","last_unstale":"2024-03-09T15:06:53.471455+0000","last_undegraded":"2024-03-09T15:06:53.471455+0000","last_fullsized":"2024-03-09T15:06:53.471455+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:33:07.046397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2425,"num_read_kb":2201,"num_write":660,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'320","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.631598+0000","last_change":"2024-03-09T14:28:53.638759+0000","last_active":"2024-03-09T15:07:04.631598+0000","last_peered":"2024-03-09T15:07:04.631598+0000","last_clean":"2024-03-09T15:07:04.631598+0000","last_became_active":"2024-03-09T14:28:53.635866+0000","last_became_peered":"2024-03-09T14:28:53.635866+0000","last_unstale":"2024-03-09T15:07:04.631598+0000","last_undegraded":"2024-03-09T15:07:04.631598+0000","last_fullsized":"2024-03-09T15:07:04.631598+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:08:50.346352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049848,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":533,"num_read_kb":68120,"num_write":1298,"num_write_kb":51277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'625","reported_seq":2293,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.477485+0000","last_change":"2024-03-09T14:28:55.597656+0000","last_active":"2024-03-09T15:06:53.477485+0000","last_peered":"2024-03-09T15:06:53.477485+0000","last_clean":"2024-03-09T15:06:53.477485+0000","last_became_active":"2024-03-09T14:28:55.596430+0000","last_became_peered":"2024-03-09T14:28:55.596430+0000","last_unstale":"2024-03-09T15:06:53.477485+0000","last_undegraded":"2024-03-09T15:06:53.477485+0000","last_fullsized":"2024-03-09T15:06:53.477485+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":600,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:16:10.976172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3224,"num_read_kb":2919,"num_write":927,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'297","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.745553+0000","last_change":"2024-03-09T14:28:53.585196+0000","last_active":"2024-03-09T15:07:04.745553+0000","last_peered":"2024-03-09T15:07:04.745553+0000","last_clean":"2024-03-09T15:07:04.745553+0000","last_became_active":"2024-03-09T14:28:53.584780+0000","last_became_peered":"2024-03-09T14:28:53.584780+0000","last_unstale":"2024-03-09T15:07:04.745553+0000","last_undegraded":"2024-03-09T15:07:04.745553+0000","last_fullsized":"2024-03-09T15:07:04.745553+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:17:52.899385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262274,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":397,"num_read_kb":4504,"num_write":1215,"num_write_kb":43139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1138","reported_seq":2640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.279203+0000","last_change":"2024-03-09T14:28:55.585579+0000","last_active":"2024-03-09T15:06:41.279203+0000","last_peered":"2024-03-09T15:06:41.279203+0000","last_clean":"2024-03-09T15:06:41.279203+0000","last_became_active":"2024-03-09T14:28:55.582655+0000","last_became_peered":"2024-03-09T14:28:55.582655+0000","last_unstale":"2024-03-09T15:06:41.279203+0000","last_undegraded":"2024-03-09T15:06:41.279203+0000","last_fullsized":"2024-03-09T15:06:41.279203+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:00:59.988789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4834,"num_read_kb":4203,"num_write":1586,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'408","reported_seq":1109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.885317+0000","last_change":"2024-03-09T14:28:53.627517+0000","last_active":"2024-03-09T15:07:04.885317+0000","last_peered":"2024-03-09T15:07:04.885317+0000","last_clean":"2024-03-09T15:07:04.885317+0000","last_became_active":"2024-03-09T14:28:53.626746+0000","last_became_peered":"2024-03-09T14:28:53.626746+0000","last_unstale":"2024-03-09T15:07:04.885317+0000","last_undegraded":"2024-03-09T15:07:04.885317+0000","last_fullsized":"2024-03-09T15:07:04.885317+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:13:12.536809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262904,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":805,"num_read_kb":5936,"num_write":1481,"num_write_kb":27133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'403","reported_seq":2031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.290762+0000","last_change":"2024-03-09T14:28:55.575483+0000","last_active":"2024-03-09T15:06:41.290762+0000","last_peered":"2024-03-09T15:06:41.290762+0000","last_clean":"2024-03-09T15:06:41.290762+0000","last_became_active":"2024-03-09T14:28:55.574723+0000","last_became_peered":"2024-03-09T14:28:55.574723+0000","last_unstale":"2024-03-09T15:06:41.290762+0000","last_undegraded":"2024-03-09T15:06:41.290762+0000","last_fullsized":"2024-03-09T15:06:41.290762+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:21:08.880858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2270,"num_read_kb":2181,"num_write":450,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'353","reported_seq":1229,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.896178+0000","last_change":"2024-03-09T14:28:53.565397+0000","last_active":"2024-03-09T15:07:04.896178+0000","last_peered":"2024-03-09T15:07:04.896178+0000","last_clean":"2024-03-09T15:07:04.896178+0000","last_became_active":"2024-03-09T14:28:53.564605+0000","last_became_peered":"2024-03-09T14:28:53.564605+0000","last_unstale":"2024-03-09T15:07:04.896178+0000","last_undegraded":"2024-03-09T15:07:04.896178+0000","last_fullsized":"2024-03-09T15:07:04.896178+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:27:21.297821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1352,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1008,"num_read_kb":12224,"num_write":1357,"num_write_kb":35283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'474","reported_seq":2092,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.442041+0000","last_change":"2024-03-09T14:28:55.596361+0000","last_active":"2024-03-09T15:06:42.442041+0000","last_peered":"2024-03-09T15:06:42.442041+0000","last_clean":"2024-03-09T15:06:42.442041+0000","last_became_active":"2024-03-09T14:28:55.596007+0000","last_became_peered":"2024-03-09T14:28:55.596007+0000","last_unstale":"2024-03-09T15:06:42.442041+0000","last_undegraded":"2024-03-09T15:06:42.442041+0000","last_fullsized":"2024-03-09T15:06:42.442041+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:09.008168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2627,"num_read_kb":2464,"num_write":596,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'256","reported_seq":845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.897210+0000","last_change":"2024-03-09T14:28:53.638536+0000","last_active":"2024-03-09T15:07:04.897210+0000","last_peered":"2024-03-09T15:07:04.897210+0000","last_clean":"2024-03-09T15:07:04.897210+0000","last_became_active":"2024-03-09T14:28:53.637905+0000","last_became_peered":"2024-03-09T14:28:53.637905+0000","last_unstale":"2024-03-09T15:07:04.897210+0000","last_undegraded":"2024-03-09T15:07:04.897210+0000","last_fullsized":"2024-03-09T15:07:04.897210+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:24:14.058362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289422,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":362,"num_read_kb":388,"num_write":1025,"num_write_kb":15956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'865","reported_seq":2402,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:30.933407+0000","last_change":"2024-03-09T14:28:55.590315+0000","last_active":"2024-03-09T15:06:30.933407+0000","last_peered":"2024-03-09T15:06:30.933407+0000","last_clean":"2024-03-09T15:06:30.933407+0000","last_became_active":"2024-03-09T14:28:55.589596+0000","last_became_peered":"2024-03-09T14:28:55.589596+0000","last_unstale":"2024-03-09T15:06:30.933407+0000","last_undegraded":"2024-03-09T15:06:30.933407+0000","last_fullsized":"2024-03-09T15:06:30.933407+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:18:51.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4032,"num_read_kb":3559,"num_write":1203,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'295","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.723042+0000","last_change":"2024-03-09T14:28:53.627710+0000","last_active":"2024-03-09T15:07:04.723042+0000","last_peered":"2024-03-09T15:07:04.723042+0000","last_clean":"2024-03-09T15:07:04.723042+0000","last_became_active":"2024-03-09T14:28:53.626673+0000","last_became_peered":"2024-03-09T14:28:53.626673+0000","last_unstale":"2024-03-09T15:07:04.723042+0000","last_undegraded":"2024-03-09T15:07:04.723042+0000","last_fullsized":"2024-03-09T15:07:04.723042+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:43.839078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2007922,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":552,"num_read_kb":94144,"num_write":1072,"num_write_kb":28965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'470","reported_seq":1980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.378173+0000","last_change":"2024-03-09T14:28:55.610858+0000","last_active":"2024-03-09T15:06:38.378173+0000","last_peered":"2024-03-09T15:06:38.378173+0000","last_clean":"2024-03-09T15:06:38.378173+0000","last_became_active":"2024-03-09T14:28:55.610314+0000","last_became_peered":"2024-03-09T14:28:55.610314+0000","last_unstale":"2024-03-09T15:06:38.378173+0000","last_undegraded":"2024-03-09T15:06:38.378173+0000","last_fullsized":"2024-03-09T15:06:38.378173+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:48.765613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2645,"num_read_kb":2435,"num_write":625,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'341","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.679819+0000","last_change":"2024-03-09T14:28:53.632280+0000","last_active":"2024-03-09T15:07:04.679819+0000","last_peered":"2024-03-09T15:07:04.679819+0000","last_clean":"2024-03-09T15:07:04.679819+0000","last_became_active":"2024-03-09T14:28:53.631327+0000","last_became_peered":"2024-03-09T14:28:53.631327+0000","last_unstale":"2024-03-09T15:07:04.679819+0000","last_undegraded":"2024-03-09T15:07:04.679819+0000","last_fullsized":"2024-03-09T15:07:04.679819+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:34:05.226694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4801783,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":567,"num_read_kb":48859,"num_write":1211,"num_write_kb":49653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'386","reported_seq":1869,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.431122+0000","last_change":"2024-03-09T14:28:55.587624+0000","last_active":"2024-03-09T15:06:42.431122+0000","last_peered":"2024-03-09T15:06:42.431122+0000","last_clean":"2024-03-09T15:06:42.431122+0000","last_became_active":"2024-03-09T14:28:55.587355+0000","last_became_peered":"2024-03-09T14:28:55.587355+0000","last_unstale":"2024-03-09T15:06:42.431122+0000","last_undegraded":"2024-03-09T15:06:42.431122+0000","last_fullsized":"2024-03-09T15:06:42.431122+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:31:51.705629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2078,"num_read_kb":1975,"num_write":455,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'374","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.641796+0000","last_change":"2024-03-09T14:28:53.624013+0000","last_active":"2024-03-09T15:07:04.641796+0000","last_peered":"2024-03-09T15:07:04.641796+0000","last_clean":"2024-03-09T15:07:04.641796+0000","last_became_active":"2024-03-09T14:28:53.622624+0000","last_became_peered":"2024-03-09T14:28:53.622624+0000","last_unstale":"2024-03-09T15:07:04.641796+0000","last_undegraded":"2024-03-09T15:07:04.641796+0000","last_fullsized":"2024-03-09T15:07:04.641796+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:47:00.573989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6554788,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":632,"num_read_kb":22045,"num_write":1223,"num_write_kb":48993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'1099","reported_seq":2573,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.149754+0000","last_change":"2024-03-09T14:28:55.591286+0000","last_active":"2024-03-09T15:06:36.149754+0000","last_peered":"2024-03-09T15:06:36.149754+0000","last_clean":"2024-03-09T15:06:36.149754+0000","last_became_active":"2024-03-09T14:28:55.582143+0000","last_became_peered":"2024-03-09T14:28:55.582143+0000","last_unstale":"2024-03-09T15:06:36.149754+0000","last_undegraded":"2024-03-09T15:06:36.149754+0000","last_fullsized":"2024-03-09T15:06:36.149754+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":1000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:02:27.150531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4588,"num_read_kb":3996,"num_write":1519,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'348","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.712681+0000","last_change":"2024-03-09T14:28:53.633628+0000","last_active":"2024-03-09T15:07:04.712681+0000","last_peered":"2024-03-09T15:07:04.712681+0000","last_clean":"2024-03-09T15:07:04.712681+0000","last_became_active":"2024-03-09T14:28:53.633121+0000","last_became_peered":"2024-03-09T14:28:53.633121+0000","last_unstale":"2024-03-09T15:07:04.712681+0000","last_undegraded":"2024-03-09T15:07:04.712681+0000","last_fullsized":"2024-03-09T15:07:04.712681+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:08:16.219438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3362505,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":692,"num_read_kb":9275,"num_write":1356,"num_write_kb":66964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'676","reported_seq":2114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.284688+0000","last_change":"2024-03-09T14:28:55.602146+0000","last_active":"2024-03-09T15:06:41.284688+0000","last_peered":"2024-03-09T15:06:41.284688+0000","last_clean":"2024-03-09T15:06:41.284688+0000","last_became_active":"2024-03-09T14:28:55.601622+0000","last_became_peered":"2024-03-09T14:28:55.601622+0000","last_unstale":"2024-03-09T15:06:41.284688+0000","last_undegraded":"2024-03-09T15:06:41.284688+0000","last_fullsized":"2024-03-09T15:06:41.284688+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":600,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:03:29.881841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3103,"num_read_kb":2796,"num_write":889,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'386","reported_seq":1112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.706273+0000","last_change":"2024-03-09T14:29:28.829008+0000","last_active":"2024-03-09T15:07:04.706273+0000","last_peered":"2024-03-09T15:07:04.706273+0000","last_clean":"2024-03-09T15:07:04.706273+0000","last_became_active":"2024-03-09T14:29:28.827826+0000","last_became_peered":"2024-03-09T14:29:28.827826+0000","last_unstale":"2024-03-09T15:07:04.706273+0000","last_undegraded":"2024-03-09T15:07:04.706273+0000","last_fullsized":"2024-03-09T15:07:04.706273+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:23.249436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2067841,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":862,"num_read_kb":41003,"num_write":1545,"num_write_kb":37571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"264'283","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.903720+0000","last_change":"2024-03-09T14:28:53.603932+0000","last_active":"2024-03-09T15:07:04.903720+0000","last_peered":"2024-03-09T15:07:04.903720+0000","last_clean":"2024-03-09T15:07:04.903720+0000","last_became_active":"2024-03-09T14:28:53.602502+0000","last_became_peered":"2024-03-09T14:28:53.602502+0000","last_unstale":"2024-03-09T15:07:04.903720+0000","last_undegraded":"2024-03-09T15:07:04.903720+0000","last_fullsized":"2024-03-09T15:07:04.903720+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:03:28.530349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250254,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":382,"num_read_kb":11977,"num_write":1052,"num_write_kb":41245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'855","reported_seq":2303,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.333436+0000","last_change":"2024-03-09T14:28:55.602029+0000","last_active":"2024-03-09T15:06:24.333436+0000","last_peered":"2024-03-09T15:06:24.333436+0000","last_clean":"2024-03-09T15:06:24.333436+0000","last_became_active":"2024-03-09T14:28:55.601537+0000","last_became_peered":"2024-03-09T14:28:55.601537+0000","last_unstale":"2024-03-09T15:06:24.333436+0000","last_undegraded":"2024-03-09T15:06:24.333436+0000","last_fullsized":"2024-03-09T15:06:24.333436+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:50:14.569583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3890,"num_read_kb":3404,"num_write":1199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'332","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.044420+0000","last_change":"2024-03-09T14:28:53.589127+0000","last_active":"2024-03-09T15:07:05.044420+0000","last_peered":"2024-03-09T15:07:05.044420+0000","last_clean":"2024-03-09T15:07:05.044420+0000","last_became_active":"2024-03-09T14:28:53.588717+0000","last_became_peered":"2024-03-09T14:28:53.588717+0000","last_unstale":"2024-03-09T15:07:05.044420+0000","last_undegraded":"2024-03-09T15:07:05.044420+0000","last_fullsized":"2024-03-09T15:07:05.044420+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:19:41.863054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286957,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":553,"num_read_kb":5744,"num_write":1159,"num_write_kb":28449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'1155","reported_seq":2682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.479714+0000","last_change":"2024-03-09T14:28:55.583336+0000","last_active":"2024-03-09T15:06:53.479714+0000","last_peered":"2024-03-09T15:06:53.479714+0000","last_clean":"2024-03-09T15:06:53.479714+0000","last_became_active":"2024-03-09T14:28:55.582541+0000","last_became_peered":"2024-03-09T14:28:55.582541+0000","last_unstale":"2024-03-09T15:06:53.479714+0000","last_undegraded":"2024-03-09T15:06:53.479714+0000","last_fullsized":"2024-03-09T15:06:53.479714+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:40.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4871,"num_read_kb":4234,"num_write":1610,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5930,"num_read_kb":4217,"num_write":2190,"num_write_kb":844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1123,"ondisk_log_size":1123,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":13413,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":15557,"num_read_kb":15326,"num_write":16235,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":26826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1560,"ondisk_log_size":1560,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":419,"ondisk_log_size":419,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1540732,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":16143,"num_read_kb":33699,"num_write":13780,"num_write_kb":11122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1036288,"data_stored":696270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2023,"ondisk_log_size":2023,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1622,"num_read_kb":1927,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":194579,"num_read_kb":177681,"num_write":51390,"num_write_kb":17534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":132,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4061,"ondisk_log_size":4061,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":242449739,"num_objects":1300,"num_object_clones":0,"num_object_copies":5200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1300,"num_whiteouts":0,"num_read":33841,"num_read_kb":1970650,"num_write":76636,"num_write_kb":2252311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":349028352,"data_stored":349028352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4028,"ondisk_log_size":4028,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":39889250,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":128,"num_read_kb":180405,"num_write":142,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79781888,"data_stored":79778500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":37751953,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":127,"num_read_kb":177288,"num_write":144,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":75505664,"data_stored":75503906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575316,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":391396,"kb_used_data":75564,"kb_used_omap":1,"kb_used_meta":315774,"kb_avail":93980444,"statfs":{"total":96636764160,"available":96235974656,"internally_reserved":0,"allocated":77377536,"data_stored":75372085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":323353034},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575313,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379716,"kb_used_data":73540,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":93992124,"statfs":{"total":96636764160,"available":96247934976,"internally_reserved":0,"allocated":75304960,"data_stored":73333756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575317,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":218324,"kb_used_data":70328,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94153516,"statfs":{"total":96636764160,"available":96413200384,"internally_reserved":0,"allocated":72015872,"data_stored":69995251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575314,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":232052,"kb_used_data":124484,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94139788,"statfs":{"total":96636764160,"available":96399142912,"internally_reserved":0,"allocated":127471616,"data_stored":125551919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575316,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":387356,"kb_used_data":112916,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93984484,"statfs":{"total":96636764160,"available":96240111616,"internally_reserved":0,"allocated":115625984,"data_stored":113612427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280689095},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575312,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":171004,"kb_used_data":67496,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94200836,"statfs":{"total":96636764160,"available":96461656064,"internally_reserved":0,"allocated":69115904,"data_stored":67191426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575316,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":231348,"kb_used_data":59720,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94140492,"statfs":{"total":96636764160,"available":96399863808,"internally_reserved":0,"allocated":61153280,"data_stored":59180630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575313,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319312,"kb_used_data":57392,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94052528,"statfs":{"total":96636764160,"available":96309788672,"internally_reserved":0,"allocated":58769408,"data_stored":56769573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":47398912,"data_stored":47398912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27369472,"data_stored":27369472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37072896,"data_stored":37072896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29974528,"data_stored":29974528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":59637760,"data_stored":59637760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":35831808,"data_stored":35831808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":50921472,"data_stored":50921472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":60821504,"data_stored":60821504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":91608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":84957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":89493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":220268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":82594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":192512,"data_stored":126800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1052672,"data_stored":1051793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11538432,"data_stored":11537553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5283840,"data_stored":5283025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15769600,"data_stored":15768785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10489856,"data_stored":10488977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10489856,"data_stored":10488977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:07:07.220 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-09T15:07:07.220 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:07:07.595 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:07:07.607 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-09T15:07:07.614 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":1413,"stamp":"2024-03-09T15:07:06.845356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":322237174,"num_objects":1752,"num_object_clones":0,"num_object_copies":6104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1752,"num_whiteouts":0,"num_read":268055,"num_read_kb":2561305,"num_write":160716,"num_write_kb":2520679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":176,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13423,"ondisk_log_size":13423,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2330508,"kb_used_data":641440,"kb_used_omap":12,"kb_used_meta":1687475,"kb_avail":752644212,"statfs":{"total":773094113280,"available":770707673088,"internally_reserved":0,"allocated":656834560,"data_stored":641007067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1727974960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[22,1,4],"upper_bound":8},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-525494720,"num_objects":-3098,"num_object_clones":0,"num_object_copies":-12340,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-3098,"num_whiteouts":0,"num_read":3575,"num_read_kb":15517,"num_write":3322,"num_write_kb":6218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008013"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:24.861905+0000","last_change":"2024-03-09T14:49:53.659913+0000","last_active":"2024-03-09T15:02:24.861905+0000","last_peered":"2024-03-09T15:02:24.861905+0000","last_clean":"2024-03-09T15:02:24.861905+0000","last_became_active":"2024-03-09T14:49:53.656173+0000","last_became_peered":"2024-03-09T14:49:53.656173+0000","last_unstale":"2024-03-09T15:02:24.861905+0000","last_undegraded":"2024-03-09T15:02:24.861905+0000","last_fullsized":"2024-03-09T15:02:24.861905+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:35.929830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.860903+0000","last_change":"2024-03-09T14:42:19.006802+0000","last_active":"2024-03-09T15:02:19.860903+0000","last_peered":"2024-03-09T15:02:19.860903+0000","last_clean":"2024-03-09T15:02:19.860903+0000","last_became_active":"2024-03-09T14:42:19.006064+0000","last_became_peered":"2024-03-09T14:42:19.006064+0000","last_unstale":"2024-03-09T15:02:19.860903+0000","last_undegraded":"2024-03-09T15:02:19.860903+0000","last_fullsized":"2024-03-09T15:02:19.860903+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:00:50.245633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.912628+0000","last_change":"2024-03-09T14:42:15.929304+0000","last_active":"2024-03-09T15:02:19.912628+0000","last_peered":"2024-03-09T15:02:19.912628+0000","last_clean":"2024-03-09T15:02:19.912628+0000","last_became_active":"2024-03-09T14:42:15.928518+0000","last_became_peered":"2024-03-09T14:42:15.928518+0000","last_unstale":"2024-03-09T15:02:19.912628+0000","last_undegraded":"2024-03-09T15:02:19.912628+0000","last_fullsized":"2024-03-09T15:02:19.912628+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:41:16.939221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'49","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.722055+0000","last_change":"2024-03-09T14:39:57.903467+0000","last_active":"2024-03-09T15:04:59.722055+0000","last_peered":"2024-03-09T15:04:59.722055+0000","last_clean":"2024-03-09T15:04:59.722055+0000","last_became_active":"2024-03-09T14:39:57.901879+0000","last_became_peered":"2024-03-09T14:39:57.901879+0000","last_unstale":"2024-03-09T15:04:59.722055+0000","last_undegraded":"2024-03-09T15:04:59.722055+0000","last_fullsized":"2024-03-09T15:04:59.722055+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:06:48.629872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":129,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:24.672562+0000","last_change":"2024-03-09T14:49:53.685563+0000","last_active":"2024-03-09T15:02:24.672562+0000","last_peered":"2024-03-09T15:02:24.672562+0000","last_clean":"2024-03-09T15:02:24.672562+0000","last_became_active":"2024-03-09T14:49:53.684941+0000","last_became_peered":"2024-03-09T14:49:53.684941+0000","last_unstale":"2024-03-09T15:02:24.672562+0000","last_undegraded":"2024-03-09T15:02:24.672562+0000","last_fullsized":"2024-03-09T15:02:24.672562+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:56:08.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.677113+0000","last_change":"2024-03-09T14:42:19.016523+0000","last_active":"2024-03-09T15:02:19.677113+0000","last_peered":"2024-03-09T15:02:19.677113+0000","last_clean":"2024-03-09T15:02:19.677113+0000","last_became_active":"2024-03-09T14:42:19.011453+0000","last_became_peered":"2024-03-09T14:42:19.011453+0000","last_unstale":"2024-03-09T15:02:19.677113+0000","last_undegraded":"2024-03-09T15:02:19.677113+0000","last_fullsized":"2024-03-09T15:02:19.677113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:58.069721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:20.035223+0000","last_change":"2024-03-09T14:42:15.971426+0000","last_active":"2024-03-09T15:02:20.035223+0000","last_peered":"2024-03-09T15:02:20.035223+0000","last_clean":"2024-03-09T15:02:20.035223+0000","last_became_active":"2024-03-09T14:42:15.970720+0000","last_became_peered":"2024-03-09T14:42:15.970720+0000","last_unstale":"2024-03-09T15:02:20.035223+0000","last_undegraded":"2024-03-09T15:02:20.035223+0000","last_fullsized":"2024-03-09T15:02:20.035223+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:19:28.165527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.696208+0000","last_change":"2024-03-09T14:39:57.894737+0000","last_active":"2024-03-09T15:04:09.696208+0000","last_peered":"2024-03-09T15:04:09.696208+0000","last_clean":"2024-03-09T15:04:09.696208+0000","last_became_active":"2024-03-09T14:39:57.894022+0000","last_became_peered":"2024-03-09T14:39:57.894022+0000","last_unstale":"2024-03-09T15:04:09.696208+0000","last_undegraded":"2024-03-09T15:04:09.696208+0000","last_fullsized":"2024-03-09T15:04:09.696208+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:04:28.968947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.703233+0000","last_change":"2024-03-09T14:49:53.677659+0000","last_active":"2024-03-09T15:04:24.703233+0000","last_peered":"2024-03-09T15:04:24.703233+0000","last_clean":"2024-03-09T15:04:24.703233+0000","last_became_active":"2024-03-09T14:49:53.676530+0000","last_became_peered":"2024-03-09T14:49:53.676530+0000","last_unstale":"2024-03-09T15:04:24.703233+0000","last_undegraded":"2024-03-09T15:04:24.703233+0000","last_fullsized":"2024-03-09T15:04:24.703233+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:46:58.203837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.695100+0000","last_change":"2024-03-09T14:42:19.295942+0000","last_active":"2024-03-09T15:03:09.695100+0000","last_peered":"2024-03-09T15:03:09.695100+0000","last_clean":"2024-03-09T15:03:09.695100+0000","last_became_active":"2024-03-09T14:42:19.295218+0000","last_became_peered":"2024-03-09T14:42:19.295218+0000","last_unstale":"2024-03-09T15:03:09.695100+0000","last_undegraded":"2024-03-09T15:03:09.695100+0000","last_fullsized":"2024-03-09T15:03:09.695100+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:07:18.137379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":63,"num_write":3,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"261'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.701153+0000","last_change":"2024-03-09T14:42:15.958751+0000","last_active":"2024-03-09T15:04:29.701153+0000","last_peered":"2024-03-09T15:04:29.701153+0000","last_clean":"2024-03-09T15:04:29.701153+0000","last_became_active":"2024-03-09T14:42:15.958052+0000","last_became_peered":"2024-03-09T14:42:15.958052+0000","last_unstale":"2024-03-09T15:04:29.701153+0000","last_undegraded":"2024-03-09T15:04:29.701153+0000","last_fullsized":"2024-03-09T15:04:29.701153+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:29:31.200748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'67","reported_seq":205,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:05.886666+0000","last_change":"2024-03-09T14:39:57.891306+0000","last_active":"2024-03-09T15:04:05.886666+0000","last_peered":"2024-03-09T15:04:05.886666+0000","last_clean":"2024-03-09T15:04:05.886666+0000","last_became_active":"2024-03-09T14:39:57.890452+0000","last_became_peered":"2024-03-09T14:39:57.890452+0000","last_unstale":"2024-03-09T15:04:05.886666+0000","last_undegraded":"2024-03-09T15:04:05.886666+0000","last_fullsized":"2024-03-09T15:04:05.886666+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:26.583506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":205,"num_write":124,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.944291+0000","last_change":"2024-03-09T14:49:53.669862+0000","last_active":"2024-03-09T15:04:24.944291+0000","last_peered":"2024-03-09T15:04:24.944291+0000","last_clean":"2024-03-09T15:04:24.944291+0000","last_became_active":"2024-03-09T14:49:53.669178+0000","last_became_peered":"2024-03-09T14:49:53.669178+0000","last_unstale":"2024-03-09T15:04:24.944291+0000","last_undegraded":"2024-03-09T15:04:24.944291+0000","last_fullsized":"2024-03-09T15:04:24.944291+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:33.018328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'6","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.944631+0000","last_change":"2024-03-09T14:42:19.295020+0000","last_active":"2024-03-09T15:04:24.944631+0000","last_peered":"2024-03-09T15:04:24.944631+0000","last_clean":"2024-03-09T15:04:24.944631+0000","last_became_active":"2024-03-09T14:42:19.294235+0000","last_became_peered":"2024-03-09T14:42:19.294235+0000","last_unstale":"2024-03-09T15:04:24.944631+0000","last_undegraded":"2024-03-09T15:04:24.944631+0000","last_fullsized":"2024-03-09T15:04:24.944631+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:26.179213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.688252+0000","last_change":"2024-03-09T14:42:15.958787+0000","last_active":"2024-03-09T15:03:09.688252+0000","last_peered":"2024-03-09T15:03:09.688252+0000","last_clean":"2024-03-09T15:03:09.688252+0000","last_became_active":"2024-03-09T14:42:15.957974+0000","last_became_peered":"2024-03-09T14:42:15.957974+0000","last_unstale":"2024-03-09T15:03:09.688252+0000","last_undegraded":"2024-03-09T15:03:09.688252+0000","last_fullsized":"2024-03-09T15:03:09.688252+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:28:08.525108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'35","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:15.106458+0000","last_change":"2024-03-09T14:39:57.910289+0000","last_active":"2024-03-09T15:03:15.106458+0000","last_peered":"2024-03-09T15:03:15.106458+0000","last_clean":"2024-03-09T15:03:15.106458+0000","last_became_active":"2024-03-09T14:39:57.909761+0000","last_became_peered":"2024-03-09T14:39:57.909761+0000","last_unstale":"2024-03-09T15:03:15.106458+0000","last_undegraded":"2024-03-09T15:03:15.106458+0000","last_fullsized":"2024-03-09T15:03:15.106458+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:05:46.103142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":109,"num_write":58,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:54.936666+0000","last_change":"2024-03-09T14:49:53.678276+0000","last_active":"2024-03-09T15:03:54.936666+0000","last_peered":"2024-03-09T15:03:54.936666+0000","last_clean":"2024-03-09T15:03:54.936666+0000","last_became_active":"2024-03-09T14:49:53.676902+0000","last_became_peered":"2024-03-09T14:49:53.676902+0000","last_unstale":"2024-03-09T15:03:54.936666+0000","last_undegraded":"2024-03-09T15:03:54.936666+0000","last_fullsized":"2024-03-09T15:03:54.936666+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:07:34.791991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.886265+0000","last_change":"2024-03-09T14:42:19.008196+0000","last_active":"2024-03-09T15:04:09.886265+0000","last_peered":"2024-03-09T15:04:09.886265+0000","last_clean":"2024-03-09T15:04:09.886265+0000","last_became_active":"2024-03-09T14:42:19.006923+0000","last_became_peered":"2024-03-09T14:42:19.006923+0000","last_unstale":"2024-03-09T15:04:09.886265+0000","last_undegraded":"2024-03-09T15:04:09.886265+0000","last_fullsized":"2024-03-09T15:04:09.886265+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:47:53.638625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.743319+0000","last_change":"2024-03-09T14:42:15.974088+0000","last_active":"2024-03-09T15:06:29.743319+0000","last_peered":"2024-03-09T15:06:29.743319+0000","last_clean":"2024-03-09T15:06:29.743319+0000","last_became_active":"2024-03-09T14:42:15.971499+0000","last_became_peered":"2024-03-09T14:42:15.971499+0000","last_unstale":"2024-03-09T15:06:29.743319+0000","last_undegraded":"2024-03-09T15:06:29.743319+0000","last_fullsized":"2024-03-09T15:06:29.743319+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:31.642579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'33","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:29.915211+0000","last_change":"2024-03-09T14:39:57.900156+0000","last_active":"2024-03-09T15:02:29.915211+0000","last_peered":"2024-03-09T15:02:29.915211+0000","last_clean":"2024-03-09T15:02:29.915211+0000","last_became_active":"2024-03-09T14:39:57.898849+0000","last_became_peered":"2024-03-09T14:39:57.898849+0000","last_unstale":"2024-03-09T15:02:29.915211+0000","last_undegraded":"2024-03-09T15:02:29.915211+0000","last_fullsized":"2024-03-09T15:02:29.915211+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:28.068027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":100,"num_write":52,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:30.064856+0000","last_change":"2024-03-09T14:49:53.660759+0000","last_active":"2024-03-09T15:04:30.064856+0000","last_peered":"2024-03-09T15:04:30.064856+0000","last_clean":"2024-03-09T15:04:30.064856+0000","last_became_active":"2024-03-09T14:49:53.648332+0000","last_became_peered":"2024-03-09T14:49:53.648332+0000","last_unstale":"2024-03-09T15:04:30.064856+0000","last_undegraded":"2024-03-09T15:04:30.064856+0000","last_fullsized":"2024-03-09T15:04:30.064856+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:53:22.627039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'5","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.699112+0000","last_change":"2024-03-09T14:42:19.004615+0000","last_active":"2024-03-09T15:04:04.699112+0000","last_peered":"2024-03-09T15:04:04.699112+0000","last_clean":"2024-03-09T15:04:04.699112+0000","last_became_active":"2024-03-09T14:42:19.003868+0000","last_became_peered":"2024-03-09T14:42:19.003868+0000","last_unstale":"2024-03-09T15:04:04.699112+0000","last_undegraded":"2024-03-09T15:04:04.699112+0000","last_fullsized":"2024-03-09T15:04:04.699112+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:37:03.868001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'1","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:14.702723+0000","last_change":"2024-03-09T14:42:15.948619+0000","last_active":"2024-03-09T15:04:14.702723+0000","last_peered":"2024-03-09T15:04:14.702723+0000","last_clean":"2024-03-09T15:04:14.702723+0000","last_became_active":"2024-03-09T14:42:15.947888+0000","last_became_peered":"2024-03-09T14:42:15.947888+0000","last_unstale":"2024-03-09T15:04:14.702723+0000","last_undegraded":"2024-03-09T15:04:14.702723+0000","last_fullsized":"2024-03-09T15:04:14.702723+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:44.462054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'23","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:29.678061+0000","last_change":"2024-03-09T14:39:57.908221+0000","last_active":"2024-03-09T15:02:29.678061+0000","last_peered":"2024-03-09T15:02:29.678061+0000","last_clean":"2024-03-09T15:02:29.678061+0000","last_became_active":"2024-03-09T14:39:57.907530+0000","last_became_peered":"2024-03-09T14:39:57.907530+0000","last_unstale":"2024-03-09T15:02:29.678061+0000","last_undegraded":"2024-03-09T15:02:29.678061+0000","last_fullsized":"2024-03-09T15:02:29.678061+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:04:57.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":69,"num_write":39,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:24.893913+0000","last_change":"2024-03-09T14:49:53.677579+0000","last_active":"2024-03-09T15:02:24.893913+0000","last_peered":"2024-03-09T15:02:24.893913+0000","last_clean":"2024-03-09T15:02:24.893913+0000","last_became_active":"2024-03-09T14:49:53.676976+0000","last_became_peered":"2024-03-09T14:49:53.676976+0000","last_unstale":"2024-03-09T15:02:24.893913+0000","last_undegraded":"2024-03-09T15:02:24.893913+0000","last_fullsized":"2024-03-09T15:02:24.893913+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:07:35.978642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.675982+0000","last_change":"2024-03-09T14:42:19.017355+0000","last_active":"2024-03-09T15:02:19.675982+0000","last_peered":"2024-03-09T15:02:19.675982+0000","last_clean":"2024-03-09T15:02:19.675982+0000","last_became_active":"2024-03-09T14:42:19.008779+0000","last_became_peered":"2024-03-09T14:42:19.008779+0000","last_unstale":"2024-03-09T15:02:19.675982+0000","last_undegraded":"2024-03-09T15:02:19.675982+0000","last_fullsized":"2024-03-09T15:02:19.675982+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:37:37.205376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"261'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.676961+0000","last_change":"2024-03-09T14:42:15.943933+0000","last_active":"2024-03-09T15:02:19.676961+0000","last_peered":"2024-03-09T15:02:19.676961+0000","last_clean":"2024-03-09T15:02:19.676961+0000","last_became_active":"2024-03-09T14:42:15.943177+0000","last_became_peered":"2024-03-09T14:42:15.943177+0000","last_unstale":"2024-03-09T15:02:19.676961+0000","last_undegraded":"2024-03-09T15:02:19.676961+0000","last_fullsized":"2024-03-09T15:02:19.676961+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:55.865049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'28","reported_seq":111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:14.710731+0000","last_change":"2024-03-09T14:39:57.895113+0000","last_active":"2024-03-09T15:04:14.710731+0000","last_peered":"2024-03-09T15:04:14.710731+0000","last_clean":"2024-03-09T15:04:14.710731+0000","last_became_active":"2024-03-09T14:39:57.894343+0000","last_became_peered":"2024-03-09T14:39:57.894343+0000","last_unstale":"2024-03-09T15:04:14.710731+0000","last_undegraded":"2024-03-09T15:04:14.710731+0000","last_fullsized":"2024-03-09T15:04:14.710731+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:50:51.100845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":82,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:24.894013+0000","last_change":"2024-03-09T14:49:53.666909+0000","last_active":"2024-03-09T15:02:24.894013+0000","last_peered":"2024-03-09T15:02:24.894013+0000","last_clean":"2024-03-09T15:02:24.894013+0000","last_became_active":"2024-03-09T14:49:53.666178+0000","last_became_peered":"2024-03-09T14:49:53.666178+0000","last_unstale":"2024-03-09T15:02:24.894013+0000","last_undegraded":"2024-03-09T15:02:24.894013+0000","last_fullsized":"2024-03-09T15:02:24.894013+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:52.776783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.912444+0000","last_change":"2024-03-09T14:42:19.007765+0000","last_active":"2024-03-09T15:02:19.912444+0000","last_peered":"2024-03-09T15:02:19.912444+0000","last_clean":"2024-03-09T15:02:19.912444+0000","last_became_active":"2024-03-09T14:42:19.004684+0000","last_became_peered":"2024-03-09T14:42:19.004684+0000","last_unstale":"2024-03-09T15:02:19.912444+0000","last_undegraded":"2024-03-09T15:02:19.912444+0000","last_fullsized":"2024-03-09T15:02:19.912444+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:43:10.037376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"261'3","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.683201+0000","last_change":"2024-03-09T14:42:15.973483+0000","last_active":"2024-03-09T15:02:19.683201+0000","last_peered":"2024-03-09T15:02:19.683201+0000","last_clean":"2024-03-09T15:02:19.683201+0000","last_became_active":"2024-03-09T14:42:15.972713+0000","last_became_peered":"2024-03-09T14:42:15.972713+0000","last_unstale":"2024-03-09T15:02:19.683201+0000","last_undegraded":"2024-03-09T15:02:19.683201+0000","last_fullsized":"2024-03-09T15:02:19.683201+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:13:58.988787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'37","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:10.059878+0000","last_change":"2024-03-09T14:39:57.870198+0000","last_active":"2024-03-09T15:04:10.059878+0000","last_peered":"2024-03-09T15:04:10.059878+0000","last_clean":"2024-03-09T15:04:10.059878+0000","last_became_active":"2024-03-09T14:39:57.869392+0000","last_became_peered":"2024-03-09T14:39:57.869392+0000","last_unstale":"2024-03-09T15:04:10.059878+0000","last_undegraded":"2024-03-09T15:04:10.059878+0000","last_fullsized":"2024-03-09T15:04:10.059878+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:30:48.323996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":118,"num_write":73,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:55.056586+0000","last_change":"2024-03-09T14:49:53.652690+0000","last_active":"2024-03-09T15:03:55.056586+0000","last_peered":"2024-03-09T15:03:55.056586+0000","last_clean":"2024-03-09T15:03:55.056586+0000","last_became_active":"2024-03-09T14:49:53.651987+0000","last_became_peered":"2024-03-09T14:49:53.651987+0000","last_unstale":"2024-03-09T15:03:55.056586+0000","last_undegraded":"2024-03-09T15:03:55.056586+0000","last_fullsized":"2024-03-09T15:03:55.056586+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:48:58.583996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'2","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.939291+0000","last_change":"2024-03-09T14:42:19.294955+0000","last_active":"2024-03-09T15:04:04.939291+0000","last_peered":"2024-03-09T15:04:04.939291+0000","last_clean":"2024-03-09T15:04:04.939291+0000","last_became_active":"2024-03-09T14:42:19.294108+0000","last_became_peered":"2024-03-09T14:42:19.294108+0000","last_unstale":"2024-03-09T15:04:04.939291+0000","last_undegraded":"2024-03-09T15:04:04.939291+0000","last_fullsized":"2024-03-09T15:04:04.939291+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:48:58.874062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.875733+0000","last_change":"2024-03-09T14:42:15.950610+0000","last_active":"2024-03-09T15:03:24.875733+0000","last_peered":"2024-03-09T15:03:24.875733+0000","last_clean":"2024-03-09T15:03:24.875733+0000","last_became_active":"2024-03-09T14:42:15.947591+0000","last_became_peered":"2024-03-09T14:42:15.947591+0000","last_unstale":"2024-03-09T15:03:24.875733+0000","last_undegraded":"2024-03-09T15:03:24.875733+0000","last_fullsized":"2024-03-09T15:03:24.875733+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:54:57.588230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'56","reported_seq":185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.709771+0000","last_change":"2024-03-09T14:39:57.895126+0000","last_active":"2024-03-09T15:04:09.709771+0000","last_peered":"2024-03-09T15:04:09.709771+0000","last_clean":"2024-03-09T15:04:09.709771+0000","last_became_active":"2024-03-09T14:39:57.894370+0000","last_became_peered":"2024-03-09T14:39:57.894370+0000","last_unstale":"2024-03-09T15:04:09.709771+0000","last_undegraded":"2024-03-09T15:04:09.709771+0000","last_fullsized":"2024-03-09T15:04:09.709771+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:33:51.603400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":182,"num_write":87,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:54.692738+0000","last_change":"2024-03-09T14:49:53.661026+0000","last_active":"2024-03-09T15:03:54.692738+0000","last_peered":"2024-03-09T15:03:54.692738+0000","last_clean":"2024-03-09T15:03:54.692738+0000","last_became_active":"2024-03-09T14:49:53.660291+0000","last_became_peered":"2024-03-09T14:49:53.660291+0000","last_unstale":"2024-03-09T15:03:54.692738+0000","last_undegraded":"2024-03-09T15:03:54.692738+0000","last_fullsized":"2024-03-09T15:03:54.692738+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:48:25.436136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.929184+0000","last_change":"2024-03-09T14:42:19.299865+0000","last_active":"2024-03-09T15:03:24.929184+0000","last_peered":"2024-03-09T15:03:24.929184+0000","last_clean":"2024-03-09T15:03:24.929184+0000","last_became_active":"2024-03-09T14:42:19.294391+0000","last_became_peered":"2024-03-09T14:42:19.294391+0000","last_unstale":"2024-03-09T15:03:24.929184+0000","last_undegraded":"2024-03-09T15:03:24.929184+0000","last_fullsized":"2024-03-09T15:03:24.929184+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:29.593526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.704425+0000","last_change":"2024-03-09T14:42:15.962523+0000","last_active":"2024-03-09T15:04:04.704425+0000","last_peered":"2024-03-09T15:04:04.704425+0000","last_clean":"2024-03-09T15:04:04.704425+0000","last_became_active":"2024-03-09T14:42:15.961751+0000","last_became_peered":"2024-03-09T14:42:15.961751+0000","last_unstale":"2024-03-09T15:04:04.704425+0000","last_undegraded":"2024-03-09T15:04:04.704425+0000","last_fullsized":"2024-03-09T15:04:04.704425+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:20:28.923195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'41","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.940491+0000","last_change":"2024-03-09T14:39:57.900193+0000","last_active":"2024-03-09T15:04:09.940491+0000","last_peered":"2024-03-09T15:04:09.940491+0000","last_clean":"2024-03-09T15:04:09.940491+0000","last_became_active":"2024-03-09T14:39:57.898651+0000","last_became_peered":"2024-03-09T14:39:57.898651+0000","last_unstale":"2024-03-09T15:04:09.940491+0000","last_undegraded":"2024-03-09T15:04:09.940491+0000","last_fullsized":"2024-03-09T15:04:09.940491+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:57:09.093834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":141,"num_write":58,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:54.701644+0000","last_change":"2024-03-09T14:49:53.677983+0000","last_active":"2024-03-09T15:03:54.701644+0000","last_peered":"2024-03-09T15:03:54.701644+0000","last_clean":"2024-03-09T15:03:54.701644+0000","last_became_active":"2024-03-09T14:49:53.677160+0000","last_became_peered":"2024-03-09T14:49:53.677160+0000","last_unstale":"2024-03-09T15:03:54.701644+0000","last_undegraded":"2024-03-09T15:03:54.701644+0000","last_fullsized":"2024-03-09T15:03:54.701644+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:52:56.789373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.939388+0000","last_change":"2024-03-09T14:42:19.298779+0000","last_active":"2024-03-09T15:04:04.939388+0000","last_peered":"2024-03-09T15:04:04.939388+0000","last_clean":"2024-03-09T15:04:04.939388+0000","last_became_active":"2024-03-09T14:42:19.297984+0000","last_became_peered":"2024-03-09T14:42:19.297984+0000","last_unstale":"2024-03-09T15:04:04.939388+0000","last_undegraded":"2024-03-09T15:04:04.939388+0000","last_fullsized":"2024-03-09T15:04:04.939388+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:39.001468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.695173+0000","last_change":"2024-03-09T14:42:15.959256+0000","last_active":"2024-03-09T15:04:04.695173+0000","last_peered":"2024-03-09T15:04:04.695173+0000","last_clean":"2024-03-09T15:04:04.695173+0000","last_became_active":"2024-03-09T14:42:15.958476+0000","last_became_peered":"2024-03-09T14:42:15.958476+0000","last_unstale":"2024-03-09T15:04:04.695173+0000","last_undegraded":"2024-03-09T15:04:04.695173+0000","last_fullsized":"2024-03-09T15:04:04.695173+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:53:52.388607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'111","reported_seq":374,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.696130+0000","last_change":"2024-03-09T14:39:57.873649+0000","last_active":"2024-03-09T15:04:09.696130+0000","last_peered":"2024-03-09T15:04:09.696130+0000","last_clean":"2024-03-09T15:04:09.696130+0000","last_became_active":"2024-03-09T14:39:57.872922+0000","last_became_peered":"2024-03-09T14:39:57.872922+0000","last_unstale":"2024-03-09T15:04:09.696130+0000","last_undegraded":"2024-03-09T15:04:09.696130+0000","last_fullsized":"2024-03-09T15:04:09.696130+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:27:37.326144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":634,"num_read_kb":458,"num_write":138,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:54.882960+0000","last_change":"2024-03-09T14:49:53.652070+0000","last_active":"2024-03-09T15:03:54.882960+0000","last_peered":"2024-03-09T15:03:54.882960+0000","last_clean":"2024-03-09T15:03:54.882960+0000","last_became_active":"2024-03-09T14:49:53.651353+0000","last_became_peered":"2024-03-09T14:49:53.651353+0000","last_unstale":"2024-03-09T15:03:54.882960+0000","last_undegraded":"2024-03-09T15:03:54.882960+0000","last_fullsized":"2024-03-09T15:03:54.882960+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:38.891462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.700677+0000","last_change":"2024-03-09T14:42:19.015145+0000","last_active":"2024-03-09T15:04:04.700677+0000","last_peered":"2024-03-09T15:04:04.700677+0000","last_clean":"2024-03-09T15:04:04.700677+0000","last_became_active":"2024-03-09T14:42:19.011213+0000","last_became_peered":"2024-03-09T14:42:19.011213+0000","last_unstale":"2024-03-09T15:04:04.700677+0000","last_undegraded":"2024-03-09T15:04:04.700677+0000","last_fullsized":"2024-03-09T15:04:04.700677+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:06:20.548710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.743627+0000","last_change":"2024-03-09T14:42:15.975026+0000","last_active":"2024-03-09T15:06:29.743627+0000","last_peered":"2024-03-09T15:06:29.743627+0000","last_clean":"2024-03-09T15:06:29.743627+0000","last_became_active":"2024-03-09T14:42:15.974300+0000","last_became_peered":"2024-03-09T14:42:15.974300+0000","last_unstale":"2024-03-09T15:06:29.743627+0000","last_undegraded":"2024-03-09T15:06:29.743627+0000","last_fullsized":"2024-03-09T15:06:29.743627+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:06.615185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'10","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:29.695997+0000","last_change":"2024-03-09T14:39:57.906220+0000","last_active":"2024-03-09T15:03:29.695997+0000","last_peered":"2024-03-09T15:03:29.695997+0000","last_clean":"2024-03-09T15:03:29.695997+0000","last_became_active":"2024-03-09T14:39:57.905161+0000","last_became_peered":"2024-03-09T14:39:57.905161+0000","last_unstale":"2024-03-09T15:03:29.695997+0000","last_undegraded":"2024-03-09T15:03:29.695997+0000","last_fullsized":"2024-03-09T15:03:29.695997+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:43.275061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.944574+0000","last_change":"2024-03-09T14:49:53.677779+0000","last_active":"2024-03-09T15:04:24.944574+0000","last_peered":"2024-03-09T15:04:24.944574+0000","last_clean":"2024-03-09T15:04:24.944574+0000","last_became_active":"2024-03-09T14:49:53.676180+0000","last_became_peered":"2024-03-09T14:49:53.676180+0000","last_unstale":"2024-03-09T15:04:24.944574+0000","last_undegraded":"2024-03-09T15:04:24.944574+0000","last_fullsized":"2024-03-09T15:04:24.944574+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:48.285352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'15","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:40.084255+0000","last_change":"2024-03-09T14:42:19.015638+0000","last_active":"2024-03-09T15:05:40.084255+0000","last_peered":"2024-03-09T15:05:40.084255+0000","last_clean":"2024-03-09T15:05:40.084255+0000","last_became_active":"2024-03-09T14:42:19.015001+0000","last_became_peered":"2024-03-09T14:42:19.015001+0000","last_unstale":"2024-03-09T15:05:40.084255+0000","last_undegraded":"2024-03-09T15:05:40.084255+0000","last_fullsized":"2024-03-09T15:05:40.084255+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:05.722560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":18444,"num_write":29,"num_write_kb":15365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'8","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:39.721379+0000","last_change":"2024-03-09T14:42:15.937658+0000","last_active":"2024-03-09T15:05:39.721379+0000","last_peered":"2024-03-09T15:05:39.721379+0000","last_clean":"2024-03-09T15:05:39.721379+0000","last_became_active":"2024-03-09T14:42:15.936690+0000","last_became_peered":"2024-03-09T14:42:15.936690+0000","last_unstale":"2024-03-09T15:05:39.721379+0000","last_undegraded":"2024-03-09T15:05:39.721379+0000","last_fullsized":"2024-03-09T15:05:39.721379+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:16:38.693218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'45","reported_seq":154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.693525+0000","last_change":"2024-03-09T14:39:57.900885+0000","last_active":"2024-03-09T15:03:19.693525+0000","last_peered":"2024-03-09T15:03:19.693525+0000","last_clean":"2024-03-09T15:03:19.693525+0000","last_became_active":"2024-03-09T14:39:57.900112+0000","last_became_peered":"2024-03-09T14:39:57.900112+0000","last_unstale":"2024-03-09T15:03:19.693525+0000","last_undegraded":"2024-03-09T15:03:19.693525+0000","last_fullsized":"2024-03-09T15:03:19.693525+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:04:24.272860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":133,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.713253+0000","last_change":"2024-03-09T14:49:53.687062+0000","last_active":"2024-03-09T15:04:24.713253+0000","last_peered":"2024-03-09T15:04:24.713253+0000","last_clean":"2024-03-09T15:04:24.713253+0000","last_became_active":"2024-03-09T14:49:53.683189+0000","last_became_peered":"2024-03-09T14:49:53.683189+0000","last_unstale":"2024-03-09T15:04:24.713253+0000","last_undegraded":"2024-03-09T15:04:24.713253+0000","last_fullsized":"2024-03-09T15:04:24.713253+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:53.571138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:40.084152+0000","last_change":"2024-03-09T14:42:19.009789+0000","last_active":"2024-03-09T15:05:40.084152+0000","last_peered":"2024-03-09T15:05:40.084152+0000","last_clean":"2024-03-09T15:05:40.084152+0000","last_became_active":"2024-03-09T14:42:19.009159+0000","last_became_peered":"2024-03-09T14:42:19.009159+0000","last_unstale":"2024-03-09T15:05:40.084152+0000","last_undegraded":"2024-03-09T15:05:40.084152+0000","last_fullsized":"2024-03-09T15:05:40.084152+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:07:33.321079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'11","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.948498+0000","last_change":"2024-03-09T14:42:15.954296+0000","last_active":"2024-03-09T15:07:02.948498+0000","last_peered":"2024-03-09T15:07:02.948498+0000","last_clean":"2024-03-09T15:07:02.948498+0000","last_became_active":"2024-03-09T14:42:15.953580+0000","last_became_peered":"2024-03-09T14:42:15.953580+0000","last_unstale":"2024-03-09T15:07:02.948498+0000","last_undegraded":"2024-03-09T15:07:02.948498+0000","last_fullsized":"2024-03-09T15:07:02.948498+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:02:21.500373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":25600,"num_write":26,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'39","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.697112+0000","last_change":"2024-03-09T14:39:57.897154+0000","last_active":"2024-03-09T15:03:19.697112+0000","last_peered":"2024-03-09T15:03:19.697112+0000","last_clean":"2024-03-09T15:03:19.697112+0000","last_became_active":"2024-03-09T14:39:57.896549+0000","last_became_peered":"2024-03-09T14:39:57.896549+0000","last_unstale":"2024-03-09T15:03:19.697112+0000","last_undegraded":"2024-03-09T15:03:19.697112+0000","last_fullsized":"2024-03-09T15:03:19.697112+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:01:16.877495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":110,"num_write":67,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.706787+0000","last_change":"2024-03-09T14:49:53.674470+0000","last_active":"2024-03-09T15:03:59.706787+0000","last_peered":"2024-03-09T15:03:59.706787+0000","last_clean":"2024-03-09T15:03:59.706787+0000","last_became_active":"2024-03-09T14:49:53.673345+0000","last_became_peered":"2024-03-09T14:49:53.673345+0000","last_unstale":"2024-03-09T15:03:59.706787+0000","last_undegraded":"2024-03-09T15:03:59.706787+0000","last_fullsized":"2024-03-09T15:03:59.706787+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:18.602619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:39.963872+0000","last_change":"2024-03-09T14:42:19.021679+0000","last_active":"2024-03-09T15:05:39.963872+0000","last_peered":"2024-03-09T15:05:39.963872+0000","last_clean":"2024-03-09T15:05:39.963872+0000","last_became_active":"2024-03-09T14:42:19.020650+0000","last_became_peered":"2024-03-09T14:42:19.020650+0000","last_unstale":"2024-03-09T15:05:39.963872+0000","last_undegraded":"2024-03-09T15:05:39.963872+0000","last_fullsized":"2024-03-09T15:05:39.963872+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:04:12.719156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.688968+0000","last_change":"2024-03-09T14:42:15.959020+0000","last_active":"2024-03-09T15:03:19.688968+0000","last_peered":"2024-03-09T15:03:19.688968+0000","last_clean":"2024-03-09T15:03:19.688968+0000","last_became_active":"2024-03-09T14:42:15.958276+0000","last_became_peered":"2024-03-09T14:42:15.958276+0000","last_unstale":"2024-03-09T15:03:19.688968+0000","last_undegraded":"2024-03-09T15:03:19.688968+0000","last_fullsized":"2024-03-09T15:03:19.688968+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:56:29.405946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'35","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.690399+0000","last_change":"2024-03-09T14:39:57.892474+0000","last_active":"2024-03-09T15:03:19.690399+0000","last_peered":"2024-03-09T15:03:19.690399+0000","last_clean":"2024-03-09T15:03:19.690399+0000","last_became_active":"2024-03-09T14:39:57.891706+0000","last_became_peered":"2024-03-09T14:39:57.891706+0000","last_unstale":"2024-03-09T15:03:19.690399+0000","last_undegraded":"2024-03-09T15:03:19.690399+0000","last_fullsized":"2024-03-09T15:03:19.690399+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:29.216981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":98,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.944492+0000","last_change":"2024-03-09T14:49:53.678730+0000","last_active":"2024-03-09T15:04:24.944492+0000","last_peered":"2024-03-09T15:04:24.944492+0000","last_clean":"2024-03-09T15:04:24.944492+0000","last_became_active":"2024-03-09T14:49:53.670121+0000","last_became_peered":"2024-03-09T14:49:53.670121+0000","last_unstale":"2024-03-09T15:04:24.944492+0000","last_undegraded":"2024-03-09T15:04:24.944492+0000","last_fullsized":"2024-03-09T15:04:24.944492+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:10:05.346364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.688916+0000","last_change":"2024-03-09T14:42:18.993764+0000","last_active":"2024-03-09T15:03:19.688916+0000","last_peered":"2024-03-09T15:03:19.688916+0000","last_clean":"2024-03-09T15:03:19.688916+0000","last_became_active":"2024-03-09T14:42:18.992996+0000","last_became_peered":"2024-03-09T14:42:18.992996+0000","last_unstale":"2024-03-09T15:03:19.688916+0000","last_undegraded":"2024-03-09T15:03:19.688916+0000","last_fullsized":"2024-03-09T15:03:19.688916+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:13:18.645764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"261'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.874329+0000","last_change":"2024-03-09T14:42:15.950801+0000","last_active":"2024-03-09T15:03:19.874329+0000","last_peered":"2024-03-09T15:03:19.874329+0000","last_clean":"2024-03-09T15:03:19.874329+0000","last_became_active":"2024-03-09T14:42:15.950001+0000","last_became_peered":"2024-03-09T14:42:15.950001+0000","last_unstale":"2024-03-09T15:03:19.874329+0000","last_undegraded":"2024-03-09T15:03:19.874329+0000","last_fullsized":"2024-03-09T15:03:19.874329+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:46:50.557868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'55","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.927771+0000","last_change":"2024-03-09T14:39:57.910603+0000","last_active":"2024-03-09T15:03:19.927771+0000","last_peered":"2024-03-09T15:03:19.927771+0000","last_clean":"2024-03-09T15:03:19.927771+0000","last_became_active":"2024-03-09T14:39:57.909827+0000","last_became_peered":"2024-03-09T14:39:57.909827+0000","last_unstale":"2024-03-09T15:03:19.927771+0000","last_undegraded":"2024-03-09T15:03:19.927771+0000","last_fullsized":"2024-03-09T15:03:19.927771+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:39:16.796198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":147,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:59.680775+0000","last_change":"2024-03-09T14:49:53.642413+0000","last_active":"2024-03-09T15:02:59.680775+0000","last_peered":"2024-03-09T15:02:59.680775+0000","last_clean":"2024-03-09T15:02:59.680775+0000","last_became_active":"2024-03-09T14:49:53.641152+0000","last_became_peered":"2024-03-09T14:49:53.641152+0000","last_unstale":"2024-03-09T15:02:59.680775+0000","last_undegraded":"2024-03-09T15:02:59.680775+0000","last_fullsized":"2024-03-09T15:02:59.680775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:14:59.780475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.071597+0000","last_change":"2024-03-09T14:42:19.015582+0000","last_active":"2024-03-09T15:07:04.071597+0000","last_peered":"2024-03-09T15:07:04.071597+0000","last_clean":"2024-03-09T15:07:04.071597+0000","last_became_active":"2024-03-09T14:42:19.013356+0000","last_became_peered":"2024-03-09T14:42:19.013356+0000","last_unstale":"2024-03-09T15:07:04.071597+0000","last_undegraded":"2024-03-09T15:07:04.071597+0000","last_fullsized":"2024-03-09T15:07:04.071597+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:23.724974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.715863+0000","last_change":"2024-03-09T14:42:15.965456+0000","last_active":"2024-03-09T15:04:49.715863+0000","last_peered":"2024-03-09T15:04:49.715863+0000","last_clean":"2024-03-09T15:04:49.715863+0000","last_became_active":"2024-03-09T14:42:15.964591+0000","last_became_peered":"2024-03-09T14:42:15.964591+0000","last_unstale":"2024-03-09T15:04:49.715863+0000","last_undegraded":"2024-03-09T15:04:49.715863+0000","last_fullsized":"2024-03-09T15:04:49.715863+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:37.614168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'15","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:28.710665+0000","last_change":"2024-03-09T14:39:57.901484+0000","last_active":"2024-03-09T15:05:28.710665+0000","last_peered":"2024-03-09T15:05:28.710665+0000","last_clean":"2024-03-09T15:05:28.710665+0000","last_became_active":"2024-03-09T14:39:57.898952+0000","last_became_peered":"2024-03-09T14:39:57.898952+0000","last_unstale":"2024-03-09T15:05:28.710665+0000","last_undegraded":"2024-03-09T15:05:28.710665+0000","last_fullsized":"2024-03-09T15:05:28.710665+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:26:28.443115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":52,"num_write":21,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.694828+0000","last_change":"2024-03-09T14:49:53.654700+0000","last_active":"2024-03-09T15:03:24.694828+0000","last_peered":"2024-03-09T15:03:24.694828+0000","last_clean":"2024-03-09T15:03:24.694828+0000","last_became_active":"2024-03-09T14:49:53.653943+0000","last_became_peered":"2024-03-09T14:49:53.653943+0000","last_unstale":"2024-03-09T15:03:24.694828+0000","last_undegraded":"2024-03-09T15:03:24.694828+0000","last_fullsized":"2024-03-09T15:03:24.694828+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:42:20.322883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.951150+0000","last_change":"2024-03-09T14:42:19.016131+0000","last_active":"2024-03-09T15:04:49.951150+0000","last_peered":"2024-03-09T15:04:49.951150+0000","last_clean":"2024-03-09T15:04:49.951150+0000","last_became_active":"2024-03-09T14:42:19.008729+0000","last_became_peered":"2024-03-09T14:42:19.008729+0000","last_unstale":"2024-03-09T15:04:49.951150+0000","last_undegraded":"2024-03-09T15:04:49.951150+0000","last_fullsized":"2024-03-09T15:04:49.951150+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:26.299678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.705243+0000","last_change":"2024-03-09T14:42:15.979152+0000","last_active":"2024-03-09T15:04:49.705243+0000","last_peered":"2024-03-09T15:04:49.705243+0000","last_clean":"2024-03-09T15:04:49.705243+0000","last_became_active":"2024-03-09T14:42:15.978166+0000","last_became_peered":"2024-03-09T14:42:15.978166+0000","last_unstale":"2024-03-09T15:04:49.705243+0000","last_undegraded":"2024-03-09T15:04:49.705243+0000","last_fullsized":"2024-03-09T15:04:49.705243+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:16.321080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'46","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:44.894221+0000","last_change":"2024-03-09T14:39:57.904419+0000","last_active":"2024-03-09T15:04:44.894221+0000","last_peered":"2024-03-09T15:04:44.894221+0000","last_clean":"2024-03-09T15:04:44.894221+0000","last_became_active":"2024-03-09T14:39:57.904012+0000","last_became_peered":"2024-03-09T14:39:57.904012+0000","last_unstale":"2024-03-09T15:04:44.894221+0000","last_undegraded":"2024-03-09T15:04:44.894221+0000","last_fullsized":"2024-03-09T15:04:44.894221+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:15:51.742502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":131,"num_write":86,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.683364+0000","last_change":"2024-03-09T14:49:53.680169+0000","last_active":"2024-03-09T15:02:54.683364+0000","last_peered":"2024-03-09T15:02:54.683364+0000","last_clean":"2024-03-09T15:02:54.683364+0000","last_became_active":"2024-03-09T14:49:53.678157+0000","last_became_peered":"2024-03-09T14:49:53.678157+0000","last_unstale":"2024-03-09T15:02:54.683364+0000","last_undegraded":"2024-03-09T15:02:54.683364+0000","last_fullsized":"2024-03-09T15:02:54.683364+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:04:53.932617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:50.069668+0000","last_change":"2024-03-09T14:42:19.296270+0000","last_active":"2024-03-09T15:04:50.069668+0000","last_peered":"2024-03-09T15:04:50.069668+0000","last_clean":"2024-03-09T15:04:50.069668+0000","last_became_active":"2024-03-09T14:42:19.295533+0000","last_became_peered":"2024-03-09T14:42:19.295533+0000","last_unstale":"2024-03-09T15:04:50.069668+0000","last_undegraded":"2024-03-09T15:04:50.069668+0000","last_fullsized":"2024-03-09T15:04:50.069668+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:35:31.738225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"261'6","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.719520+0000","last_change":"2024-03-09T14:42:15.968987+0000","last_active":"2024-03-09T15:04:49.719520+0000","last_peered":"2024-03-09T15:04:49.719520+0000","last_clean":"2024-03-09T15:04:49.719520+0000","last_became_active":"2024-03-09T14:42:15.968323+0000","last_became_peered":"2024-03-09T14:42:15.968323+0000","last_unstale":"2024-03-09T15:04:49.719520+0000","last_undegraded":"2024-03-09T15:04:49.719520+0000","last_fullsized":"2024-03-09T15:04:49.719520+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:52:18.206406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'40","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:44.707473+0000","last_change":"2024-03-09T14:39:57.898866+0000","last_active":"2024-03-09T15:04:44.707473+0000","last_peered":"2024-03-09T15:04:44.707473+0000","last_clean":"2024-03-09T15:04:44.707473+0000","last_became_active":"2024-03-09T14:39:57.898234+0000","last_became_peered":"2024-03-09T14:39:57.898234+0000","last_unstale":"2024-03-09T15:04:44.707473+0000","last_undegraded":"2024-03-09T15:04:44.707473+0000","last_fullsized":"2024-03-09T15:04:44.707473+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:55:57.096082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":111,"num_write":71,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.901778+0000","last_change":"2024-03-09T14:49:53.663589+0000","last_active":"2024-03-09T15:02:54.901778+0000","last_peered":"2024-03-09T15:02:54.901778+0000","last_clean":"2024-03-09T15:02:54.901778+0000","last_became_active":"2024-03-09T14:49:53.662812+0000","last_became_peered":"2024-03-09T14:49:53.662812+0000","last_unstale":"2024-03-09T15:02:54.901778+0000","last_undegraded":"2024-03-09T15:02:54.901778+0000","last_fullsized":"2024-03-09T15:02:54.901778+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:16:14.334955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'6","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.446373+0000","last_change":"2024-03-09T14:42:19.018301+0000","last_active":"2024-03-09T15:07:04.446373+0000","last_peered":"2024-03-09T15:07:04.446373+0000","last_clean":"2024-03-09T15:07:04.446373+0000","last_became_active":"2024-03-09T14:42:19.017434+0000","last_became_peered":"2024-03-09T14:42:19.017434+0000","last_unstale":"2024-03-09T15:07:04.446373+0000","last_undegraded":"2024-03-09T15:07:04.446373+0000","last_fullsized":"2024-03-09T15:07:04.446373+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:08:07.632656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":8272,"num_write":11,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.892374+0000","last_change":"2024-03-09T14:42:15.946399+0000","last_active":"2024-03-09T15:07:03.892374+0000","last_peered":"2024-03-09T15:07:03.892374+0000","last_clean":"2024-03-09T15:07:03.892374+0000","last_became_active":"2024-03-09T14:42:15.945565+0000","last_became_peered":"2024-03-09T14:42:15.945565+0000","last_unstale":"2024-03-09T15:07:03.892374+0000","last_undegraded":"2024-03-09T15:07:03.892374+0000","last_fullsized":"2024-03-09T15:07:03.892374+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:05:17.625355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1029,"num_write":10,"num_write_kb":1029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'55","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:44.703996+0000","last_change":"2024-03-09T14:39:57.901411+0000","last_active":"2024-03-09T15:04:44.703996+0000","last_peered":"2024-03-09T15:04:44.703996+0000","last_clean":"2024-03-09T15:04:44.703996+0000","last_became_active":"2024-03-09T14:39:57.900659+0000","last_became_peered":"2024-03-09T14:39:57.900659+0000","last_unstale":"2024-03-09T15:04:44.703996+0000","last_undegraded":"2024-03-09T15:04:44.703996+0000","last_fullsized":"2024-03-09T15:04:44.703996+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:14.811571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":161,"num_write":89,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.929301+0000","last_change":"2024-03-09T14:49:53.683045+0000","last_active":"2024-03-09T15:03:24.929301+0000","last_peered":"2024-03-09T15:03:24.929301+0000","last_clean":"2024-03-09T15:03:24.929301+0000","last_became_active":"2024-03-09T14:49:53.678822+0000","last_became_peered":"2024-03-09T14:49:53.678822+0000","last_unstale":"2024-03-09T15:03:24.929301+0000","last_undegraded":"2024-03-09T15:03:24.929301+0000","last_fullsized":"2024-03-09T15:03:24.929301+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:54.757256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.699298+0000","last_change":"2024-03-09T14:42:19.021170+0000","last_active":"2024-03-09T15:03:59.699298+0000","last_peered":"2024-03-09T15:03:59.699298+0000","last_clean":"2024-03-09T15:03:59.699298+0000","last_became_active":"2024-03-09T14:42:19.016262+0000","last_became_peered":"2024-03-09T14:42:19.016262+0000","last_unstale":"2024-03-09T15:03:59.699298+0000","last_undegraded":"2024-03-09T15:03:59.699298+0000","last_fullsized":"2024-03-09T15:03:59.699298+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:11:24.272229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'1","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.706547+0000","last_change":"2024-03-09T14:42:15.964302+0000","last_active":"2024-03-09T15:03:59.706547+0000","last_peered":"2024-03-09T15:03:59.706547+0000","last_clean":"2024-03-09T15:03:59.706547+0000","last_became_active":"2024-03-09T14:42:15.963496+0000","last_became_peered":"2024-03-09T14:42:15.963496+0000","last_unstale":"2024-03-09T15:03:59.706547+0000","last_undegraded":"2024-03-09T15:03:59.706547+0000","last_fullsized":"2024-03-09T15:03:59.706547+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:49:10.732358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3217,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'33","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:44.717850+0000","last_change":"2024-03-09T14:39:57.879692+0000","last_active":"2024-03-09T15:04:44.717850+0000","last_peered":"2024-03-09T15:04:44.717850+0000","last_clean":"2024-03-09T15:04:44.717850+0000","last_became_active":"2024-03-09T14:39:57.879068+0000","last_became_peered":"2024-03-09T14:39:57.879068+0000","last_unstale":"2024-03-09T15:04:44.717850+0000","last_undegraded":"2024-03-09T15:04:44.717850+0000","last_fullsized":"2024-03-09T15:04:44.717850+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:28:08.950204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":89,"num_write":57,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:29.696105+0000","last_change":"2024-03-09T14:49:53.666848+0000","last_active":"2024-03-09T15:03:29.696105+0000","last_peered":"2024-03-09T15:03:29.696105+0000","last_clean":"2024-03-09T15:03:29.696105+0000","last_became_active":"2024-03-09T14:49:53.666088+0000","last_became_peered":"2024-03-09T14:49:53.666088+0000","last_unstale":"2024-03-09T15:03:29.696105+0000","last_undegraded":"2024-03-09T15:03:29.696105+0000","last_fullsized":"2024-03-09T15:03:29.696105+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:24:04.438357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'2","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.702889+0000","last_change":"2024-03-09T14:42:19.288789+0000","last_active":"2024-03-09T15:03:59.702889+0000","last_peered":"2024-03-09T15:03:59.702889+0000","last_clean":"2024-03-09T15:03:59.702889+0000","last_became_active":"2024-03-09T14:42:19.288155+0000","last_became_peered":"2024-03-09T14:42:19.288155+0000","last_unstale":"2024-03-09T15:03:59.702889+0000","last_undegraded":"2024-03-09T15:03:59.702889+0000","last_fullsized":"2024-03-09T15:03:59.702889+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:36:14.730415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:00.057676+0000","last_change":"2024-03-09T14:42:15.962724+0000","last_active":"2024-03-09T15:04:00.057676+0000","last_peered":"2024-03-09T15:04:00.057676+0000","last_clean":"2024-03-09T15:04:00.057676+0000","last_became_active":"2024-03-09T14:42:15.962004+0000","last_became_peered":"2024-03-09T14:42:15.962004+0000","last_unstale":"2024-03-09T15:04:00.057676+0000","last_undegraded":"2024-03-09T15:04:00.057676+0000","last_fullsized":"2024-03-09T15:04:00.057676+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:25:30.363544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.875140+0000","last_change":"2024-03-09T14:39:57.906667+0000","last_active":"2024-03-09T15:04:04.875140+0000","last_peered":"2024-03-09T15:04:04.875140+0000","last_clean":"2024-03-09T15:04:04.875140+0000","last_became_active":"2024-03-09T14:39:57.906043+0000","last_became_peered":"2024-03-09T14:39:57.906043+0000","last_unstale":"2024-03-09T15:04:04.875140+0000","last_undegraded":"2024-03-09T15:04:04.875140+0000","last_fullsized":"2024-03-09T15:04:04.875140+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:36.853805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":86,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.694884+0000","last_change":"2024-03-09T14:49:53.666880+0000","last_active":"2024-03-09T15:03:24.694884+0000","last_peered":"2024-03-09T15:03:24.694884+0000","last_clean":"2024-03-09T15:03:24.694884+0000","last_became_active":"2024-03-09T14:49:53.666251+0000","last_became_peered":"2024-03-09T14:49:53.666251+0000","last_unstale":"2024-03-09T15:03:24.694884+0000","last_undegraded":"2024-03-09T15:03:24.694884+0000","last_fullsized":"2024-03-09T15:03:24.694884+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:12:56.088402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:50.069510+0000","last_change":"2024-03-09T14:42:18.999259+0000","last_active":"2024-03-09T15:04:50.069510+0000","last_peered":"2024-03-09T15:04:50.069510+0000","last_clean":"2024-03-09T15:04:50.069510+0000","last_became_active":"2024-03-09T14:42:18.998145+0000","last_became_peered":"2024-03-09T14:42:18.998145+0000","last_unstale":"2024-03-09T15:04:50.069510+0000","last_undegraded":"2024-03-09T15:04:50.069510+0000","last_fullsized":"2024-03-09T15:04:50.069510+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:56:21.105602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:14.739716+0000","last_change":"2024-03-09T14:42:15.974356+0000","last_active":"2024-03-09T15:06:14.739716+0000","last_peered":"2024-03-09T15:06:14.739716+0000","last_clean":"2024-03-09T15:06:14.739716+0000","last_became_active":"2024-03-09T14:42:15.973793+0000","last_became_peered":"2024-03-09T14:42:15.973793+0000","last_unstale":"2024-03-09T15:06:14.739716+0000","last_undegraded":"2024-03-09T15:06:14.739716+0000","last_fullsized":"2024-03-09T15:06:14.739716+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:01:29.081317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'18","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.934890+0000","last_change":"2024-03-09T14:39:57.900299+0000","last_active":"2024-03-09T15:03:49.934890+0000","last_peered":"2024-03-09T15:03:49.934890+0000","last_clean":"2024-03-09T15:03:49.934890+0000","last_became_active":"2024-03-09T14:39:57.895347+0000","last_became_peered":"2024-03-09T14:39:57.895347+0000","last_unstale":"2024-03-09T15:03:49.934890+0000","last_undegraded":"2024-03-09T15:03:49.934890+0000","last_fullsized":"2024-03-09T15:03:49.934890+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:35.906733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":49,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.698327+0000","last_change":"2024-03-09T14:49:53.680516+0000","last_active":"2024-03-09T15:03:24.698327+0000","last_peered":"2024-03-09T15:03:24.698327+0000","last_clean":"2024-03-09T15:03:24.698327+0000","last_became_active":"2024-03-09T14:49:53.676907+0000","last_became_peered":"2024-03-09T14:49:53.676907+0000","last_unstale":"2024-03-09T15:03:24.698327+0000","last_undegraded":"2024-03-09T15:03:24.698327+0000","last_fullsized":"2024-03-09T15:03:24.698327+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:27.679077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.705594+0000","last_change":"2024-03-09T14:42:29.985480+0000","last_active":"2024-03-09T15:04:09.705594+0000","last_peered":"2024-03-09T15:04:09.705594+0000","last_clean":"2024-03-09T15:04:09.705594+0000","last_became_active":"2024-03-09T14:42:29.984595+0000","last_became_peered":"2024-03-09T14:42:29.984595+0000","last_unstale":"2024-03-09T15:04:09.705594+0000","last_undegraded":"2024-03-09T15:04:09.705594+0000","last_fullsized":"2024-03-09T15:04:09.705594+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:49:17.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'4","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.710416+0000","last_change":"2024-03-09T14:42:15.942495+0000","last_active":"2024-03-09T15:04:49.710416+0000","last_peered":"2024-03-09T15:04:49.710416+0000","last_clean":"2024-03-09T15:04:49.710416+0000","last_became_active":"2024-03-09T14:42:15.941583+0000","last_became_peered":"2024-03-09T14:42:15.941583+0000","last_unstale":"2024-03-09T15:04:49.710416+0000","last_undegraded":"2024-03-09T15:04:49.710416+0000","last_fullsized":"2024-03-09T15:04:49.710416+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:58:21.145613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'16","reported_seq":88,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.695726+0000","last_change":"2024-03-09T14:39:57.886088+0000","last_active":"2024-03-09T15:03:49.695726+0000","last_peered":"2024-03-09T15:03:49.695726+0000","last_clean":"2024-03-09T15:03:49.695726+0000","last_became_active":"2024-03-09T14:39:57.884479+0000","last_became_peered":"2024-03-09T14:39:57.884479+0000","last_unstale":"2024-03-09T15:03:49.695726+0000","last_undegraded":"2024-03-09T15:03:49.695726+0000","last_fullsized":"2024-03-09T15:03:49.695726+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:06:06.518769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":55,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.710399+0000","last_change":"2024-03-09T14:49:53.664600+0000","last_active":"2024-03-09T15:04:29.710399+0000","last_peered":"2024-03-09T15:04:29.710399+0000","last_clean":"2024-03-09T15:04:29.710399+0000","last_became_active":"2024-03-09T14:49:53.663825+0000","last_became_peered":"2024-03-09T14:49:53.663825+0000","last_unstale":"2024-03-09T15:04:29.710399+0000","last_undegraded":"2024-03-09T15:04:29.710399+0000","last_fullsized":"2024-03-09T15:04:29.710399+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:38:11.359908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:14.696135+0000","last_change":"2024-03-09T14:42:18.996069+0000","last_active":"2024-03-09T15:03:14.696135+0000","last_peered":"2024-03-09T15:03:14.696135+0000","last_clean":"2024-03-09T15:03:14.696135+0000","last_became_active":"2024-03-09T14:42:18.995340+0000","last_became_peered":"2024-03-09T14:42:18.995340+0000","last_unstale":"2024-03-09T15:03:14.696135+0000","last_undegraded":"2024-03-09T15:03:14.696135+0000","last_fullsized":"2024-03-09T15:03:14.696135+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:53.974508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.905451+0000","last_change":"2024-03-09T14:42:15.963780+0000","last_active":"2024-03-09T15:03:09.905451+0000","last_peered":"2024-03-09T15:03:09.905451+0000","last_clean":"2024-03-09T15:03:09.905451+0000","last_became_active":"2024-03-09T14:42:15.963155+0000","last_became_peered":"2024-03-09T14:42:15.963155+0000","last_unstale":"2024-03-09T15:03:09.905451+0000","last_undegraded":"2024-03-09T15:03:09.905451+0000","last_fullsized":"2024-03-09T15:03:09.905451+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:17:06.912120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'33","reported_seq":127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.704256+0000","last_change":"2024-03-09T14:39:57.889247+0000","last_active":"2024-03-09T15:03:49.704256+0000","last_peered":"2024-03-09T15:03:49.704256+0000","last_clean":"2024-03-09T15:03:49.704256+0000","last_became_active":"2024-03-09T14:39:57.888467+0000","last_became_peered":"2024-03-09T14:39:57.888467+0000","last_unstale":"2024-03-09T15:03:49.704256+0000","last_undegraded":"2024-03-09T15:03:49.704256+0000","last_fullsized":"2024-03-09T15:03:49.704256+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:30:37.652546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":106,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.890833+0000","last_change":"2024-03-09T14:49:53.659073+0000","last_active":"2024-03-09T15:04:29.890833+0000","last_peered":"2024-03-09T15:04:29.890833+0000","last_clean":"2024-03-09T15:04:29.890833+0000","last_became_active":"2024-03-09T14:49:53.658183+0000","last_became_peered":"2024-03-09T14:49:53.658183+0000","last_unstale":"2024-03-09T15:04:29.890833+0000","last_undegraded":"2024-03-09T15:04:29.890833+0000","last_fullsized":"2024-03-09T15:04:29.890833+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:41:48.538335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:14.726025+0000","last_change":"2024-03-09T14:42:19.295167+0000","last_active":"2024-03-09T15:05:14.726025+0000","last_peered":"2024-03-09T15:05:14.726025+0000","last_clean":"2024-03-09T15:05:14.726025+0000","last_became_active":"2024-03-09T14:42:19.294401+0000","last_became_peered":"2024-03-09T14:42:19.294401+0000","last_unstale":"2024-03-09T15:05:14.726025+0000","last_undegraded":"2024-03-09T15:05:14.726025+0000","last_fullsized":"2024-03-09T15:05:14.726025+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:56:05.250854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'7","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.370131+0000","last_change":"2024-03-09T14:42:15.975168+0000","last_active":"2024-03-09T15:07:04.370131+0000","last_peered":"2024-03-09T15:07:04.370131+0000","last_clean":"2024-03-09T15:07:04.370131+0000","last_became_active":"2024-03-09T14:42:15.974493+0000","last_became_peered":"2024-03-09T14:42:15.974493+0000","last_unstale":"2024-03-09T15:07:04.370131+0000","last_undegraded":"2024-03-09T15:07:04.370131+0000","last_fullsized":"2024-03-09T15:07:04.370131+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:49:53.666199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5160,"num_write":12,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'28","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.695916+0000","last_change":"2024-03-09T14:39:57.907522+0000","last_active":"2024-03-09T15:03:49.695916+0000","last_peered":"2024-03-09T15:03:49.695916+0000","last_clean":"2024-03-09T15:03:49.695916+0000","last_became_active":"2024-03-09T14:39:57.907009+0000","last_became_peered":"2024-03-09T14:39:57.907009+0000","last_unstale":"2024-03-09T15:03:49.695916+0000","last_undegraded":"2024-03-09T15:03:49.695916+0000","last_fullsized":"2024-03-09T15:03:49.695916+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:27:52.279130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":74,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:55.056453+0000","last_change":"2024-03-09T14:49:53.681028+0000","last_active":"2024-03-09T15:03:55.056453+0000","last_peered":"2024-03-09T15:03:55.056453+0000","last_clean":"2024-03-09T15:03:55.056453+0000","last_became_active":"2024-03-09T14:49:53.680477+0000","last_became_peered":"2024-03-09T14:49:53.680477+0000","last_unstale":"2024-03-09T15:03:55.056453+0000","last_undegraded":"2024-03-09T15:03:55.056453+0000","last_fullsized":"2024-03-09T15:03:55.056453+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:50.745753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.703193+0000","last_change":"2024-03-09T14:42:19.290124+0000","last_active":"2024-03-09T15:03:59.703193+0000","last_peered":"2024-03-09T15:03:59.703193+0000","last_clean":"2024-03-09T15:03:59.703193+0000","last_became_active":"2024-03-09T14:42:19.289487+0000","last_became_peered":"2024-03-09T14:42:19.289487+0000","last_unstale":"2024-03-09T15:03:59.703193+0000","last_undegraded":"2024-03-09T15:03:59.703193+0000","last_fullsized":"2024-03-09T15:03:59.703193+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:53:33.609180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.884266+0000","last_change":"2024-03-09T14:42:15.957344+0000","last_active":"2024-03-09T15:03:59.884266+0000","last_peered":"2024-03-09T15:03:59.884266+0000","last_clean":"2024-03-09T15:03:59.884266+0000","last_became_active":"2024-03-09T14:42:15.956648+0000","last_became_peered":"2024-03-09T14:42:15.956648+0000","last_unstale":"2024-03-09T15:03:59.884266+0000","last_undegraded":"2024-03-09T15:03:59.884266+0000","last_fullsized":"2024-03-09T15:03:59.884266+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:56:53.168125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'62","reported_seq":198,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:59.903168+0000","last_change":"2024-03-09T14:39:57.906130+0000","last_active":"2024-03-09T15:02:59.903168+0000","last_peered":"2024-03-09T15:02:59.903168+0000","last_clean":"2024-03-09T15:02:59.903168+0000","last_became_active":"2024-03-09T14:39:57.905410+0000","last_became_peered":"2024-03-09T14:39:57.905410+0000","last_unstale":"2024-03-09T15:02:59.903168+0000","last_undegraded":"2024-03-09T15:02:59.903168+0000","last_fullsized":"2024-03-09T15:02:59.903168+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:50:45.243291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":193,"num_write":94,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.706106+0000","last_change":"2024-03-09T14:49:53.658895+0000","last_active":"2024-03-09T15:04:29.706106+0000","last_peered":"2024-03-09T15:04:29.706106+0000","last_clean":"2024-03-09T15:04:29.706106+0000","last_became_active":"2024-03-09T14:49:53.658190+0000","last_became_peered":"2024-03-09T14:49:53.658190+0000","last_unstale":"2024-03-09T15:04:29.706106+0000","last_undegraded":"2024-03-09T15:04:29.706106+0000","last_fullsized":"2024-03-09T15:04:29.706106+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:31:23.260028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'5","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:09.727994+0000","last_change":"2024-03-09T14:42:19.020830+0000","last_active":"2024-03-09T15:06:09.727994+0000","last_peered":"2024-03-09T15:06:09.727994+0000","last_clean":"2024-03-09T15:06:09.727994+0000","last_became_active":"2024-03-09T14:42:19.013977+0000","last_became_peered":"2024-03-09T14:42:19.013977+0000","last_unstale":"2024-03-09T15:06:09.727994+0000","last_undegraded":"2024-03-09T15:06:09.727994+0000","last_fullsized":"2024-03-09T15:06:09.727994+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:02:04.141033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":5,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.703218+0000","last_change":"2024-03-09T14:42:15.961048+0000","last_active":"2024-03-09T15:03:59.703218+0000","last_peered":"2024-03-09T15:03:59.703218+0000","last_clean":"2024-03-09T15:03:59.703218+0000","last_became_active":"2024-03-09T14:42:15.960225+0000","last_became_peered":"2024-03-09T14:42:15.960225+0000","last_unstale":"2024-03-09T15:03:59.703218+0000","last_undegraded":"2024-03-09T15:03:59.703218+0000","last_fullsized":"2024-03-09T15:03:59.703218+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:20:39.859217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'130","reported_seq":431,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:00.071914+0000","last_change":"2024-03-09T14:39:57.893265+0000","last_active":"2024-03-09T15:05:00.071914+0000","last_peered":"2024-03-09T15:05:00.071914+0000","last_clean":"2024-03-09T15:05:00.071914+0000","last_became_active":"2024-03-09T14:39:57.892592+0000","last_became_peered":"2024-03-09T14:39:57.892592+0000","last_unstale":"2024-03-09T15:05:00.071914+0000","last_undegraded":"2024-03-09T15:05:00.071914+0000","last_fullsized":"2024-03-09T15:05:00.071914+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:48:11.422790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":739,"num_read_kb":529,"num_write":173,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.679735+0000","last_change":"2024-03-09T14:49:53.672983+0000","last_active":"2024-03-09T15:02:54.679735+0000","last_peered":"2024-03-09T15:02:54.679735+0000","last_clean":"2024-03-09T15:02:54.679735+0000","last_became_active":"2024-03-09T14:49:53.672292+0000","last_became_peered":"2024-03-09T14:49:53.672292+0000","last_unstale":"2024-03-09T15:02:54.679735+0000","last_undegraded":"2024-03-09T15:02:54.679735+0000","last_fullsized":"2024-03-09T15:02:54.679735+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:45:38.980243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:10.046246+0000","last_change":"2024-03-09T14:42:19.004206+0000","last_active":"2024-03-09T15:03:10.046246+0000","last_peered":"2024-03-09T15:03:10.046246+0000","last_clean":"2024-03-09T15:03:10.046246+0000","last_became_active":"2024-03-09T14:42:19.002083+0000","last_became_peered":"2024-03-09T14:42:19.002083+0000","last_unstale":"2024-03-09T15:03:10.046246+0000","last_undegraded":"2024-03-09T15:03:10.046246+0000","last_fullsized":"2024-03-09T15:03:10.046246+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:33.779863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'5","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.710240+0000","last_change":"2024-03-09T14:42:15.976503+0000","last_active":"2024-03-09T15:04:29.710240+0000","last_peered":"2024-03-09T15:04:29.710240+0000","last_clean":"2024-03-09T15:04:29.710240+0000","last_became_active":"2024-03-09T14:42:15.975956+0000","last_became_peered":"2024-03-09T14:42:15.975956+0000","last_unstale":"2024-03-09T15:04:29.710240+0000","last_undegraded":"2024-03-09T15:04:29.710240+0000","last_fullsized":"2024-03-09T15:04:29.710240+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:51:51.535147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'35","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.897602+0000","last_change":"2024-03-09T14:39:57.887500+0000","last_active":"2024-03-09T15:04:59.897602+0000","last_peered":"2024-03-09T15:04:59.897602+0000","last_clean":"2024-03-09T15:04:59.897602+0000","last_became_active":"2024-03-09T14:39:57.886792+0000","last_became_peered":"2024-03-09T14:39:57.886792+0000","last_unstale":"2024-03-09T15:04:59.897602+0000","last_undegraded":"2024-03-09T15:04:59.897602+0000","last_fullsized":"2024-03-09T15:04:59.897602+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:48:32.831728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":107,"num_write":66,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.691638+0000","last_change":"2024-03-09T14:49:53.687783+0000","last_active":"2024-03-09T15:02:54.691638+0000","last_peered":"2024-03-09T15:02:54.691638+0000","last_clean":"2024-03-09T15:02:54.691638+0000","last_became_active":"2024-03-09T14:49:53.683703+0000","last_became_peered":"2024-03-09T14:49:53.683703+0000","last_unstale":"2024-03-09T15:02:54.691638+0000","last_undegraded":"2024-03-09T15:02:54.691638+0000","last_fullsized":"2024-03-09T15:02:54.691638+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:03:26.499909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.916629+0000","last_change":"2024-03-09T14:42:19.014096+0000","last_active":"2024-03-09T15:06:24.916629+0000","last_peered":"2024-03-09T15:06:24.916629+0000","last_clean":"2024-03-09T15:06:24.916629+0000","last_became_active":"2024-03-09T14:42:19.013372+0000","last_became_peered":"2024-03-09T14:42:19.013372+0000","last_unstale":"2024-03-09T15:06:24.916629+0000","last_undegraded":"2024-03-09T15:06:24.916629+0000","last_fullsized":"2024-03-09T15:06:24.916629+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:33:04.031449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"261'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.905329+0000","last_change":"2024-03-09T14:42:15.955016+0000","last_active":"2024-03-09T15:03:09.905329+0000","last_peered":"2024-03-09T15:03:09.905329+0000","last_clean":"2024-03-09T15:03:09.905329+0000","last_became_active":"2024-03-09T14:42:15.954274+0000","last_became_peered":"2024-03-09T14:42:15.954274+0000","last_unstale":"2024-03-09T15:03:09.905329+0000","last_undegraded":"2024-03-09T15:03:09.905329+0000","last_fullsized":"2024-03-09T15:03:09.905329+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:32.985487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'59","reported_seq":199,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.712470+0000","last_change":"2024-03-09T14:39:57.902294+0000","last_active":"2024-03-09T15:04:59.712470+0000","last_peered":"2024-03-09T15:04:59.712470+0000","last_clean":"2024-03-09T15:04:59.712470+0000","last_became_active":"2024-03-09T14:39:57.901599+0000","last_became_peered":"2024-03-09T14:39:57.901599+0000","last_unstale":"2024-03-09T15:04:59.712470+0000","last_undegraded":"2024-03-09T15:04:59.712470+0000","last_fullsized":"2024-03-09T15:04:59.712470+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:02:52.013131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":206,"num_write":96,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.714264+0000","last_change":"2024-03-09T14:49:53.681958+0000","last_active":"2024-03-09T15:04:29.714264+0000","last_peered":"2024-03-09T15:04:29.714264+0000","last_clean":"2024-03-09T15:04:29.714264+0000","last_became_active":"2024-03-09T14:49:53.681327+0000","last_became_peered":"2024-03-09T14:49:53.681327+0000","last_unstale":"2024-03-09T15:04:29.714264+0000","last_undegraded":"2024-03-09T15:04:29.714264+0000","last_fullsized":"2024-03-09T15:04:29.714264+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:41:14.532324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.686795+0000","last_change":"2024-03-09T14:42:19.020053+0000","last_active":"2024-03-09T15:03:09.686795+0000","last_peered":"2024-03-09T15:03:09.686795+0000","last_clean":"2024-03-09T15:03:09.686795+0000","last_became_active":"2024-03-09T14:42:19.019151+0000","last_became_peered":"2024-03-09T14:42:19.019151+0000","last_unstale":"2024-03-09T15:03:09.686795+0000","last_undegraded":"2024-03-09T15:03:09.686795+0000","last_fullsized":"2024-03-09T15:03:09.686795+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:33:06.100480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:10.046324+0000","last_change":"2024-03-09T14:42:15.960915+0000","last_active":"2024-03-09T15:03:10.046324+0000","last_peered":"2024-03-09T15:03:10.046324+0000","last_clean":"2024-03-09T15:03:10.046324+0000","last_became_active":"2024-03-09T14:42:15.959503+0000","last_became_peered":"2024-03-09T14:42:15.959503+0000","last_unstale":"2024-03-09T15:03:10.046324+0000","last_undegraded":"2024-03-09T15:03:10.046324+0000","last_fullsized":"2024-03-09T15:03:10.046324+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:18.018358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'13","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.710516+0000","last_change":"2024-03-09T14:39:57.896340+0000","last_active":"2024-03-09T15:04:59.710516+0000","last_peered":"2024-03-09T15:04:59.710516+0000","last_clean":"2024-03-09T15:04:59.710516+0000","last_became_active":"2024-03-09T14:39:57.895579+0000","last_became_peered":"2024-03-09T14:39:57.895579+0000","last_unstale":"2024-03-09T15:04:59.710516+0000","last_undegraded":"2024-03-09T15:04:59.710516+0000","last_fullsized":"2024-03-09T15:04:59.710516+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:50.092894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:34.711774+0000","last_change":"2024-03-09T14:49:53.681449+0000","last_active":"2024-03-09T15:04:34.711774+0000","last_peered":"2024-03-09T15:04:34.711774+0000","last_clean":"2024-03-09T15:04:34.711774+0000","last_became_active":"2024-03-09T14:49:53.680782+0000","last_became_peered":"2024-03-09T14:49:53.680782+0000","last_unstale":"2024-03-09T15:04:34.711774+0000","last_undegraded":"2024-03-09T15:04:34.711774+0000","last_fullsized":"2024-03-09T15:04:34.711774+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:47:13.858756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'1","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.688046+0000","last_change":"2024-03-09T14:42:19.021910+0000","last_active":"2024-03-09T15:03:09.688046+0000","last_peered":"2024-03-09T15:03:09.688046+0000","last_clean":"2024-03-09T15:03:09.688046+0000","last_became_active":"2024-03-09T14:42:19.020789+0000","last_became_peered":"2024-03-09T14:42:19.020789+0000","last_unstale":"2024-03-09T15:03:09.688046+0000","last_undegraded":"2024-03-09T15:03:09.688046+0000","last_fullsized":"2024-03-09T15:03:09.688046+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:45:01.147814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3217,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'7","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:14.714197+0000","last_change":"2024-03-09T14:42:15.961112+0000","last_active":"2024-03-09T15:05:14.714197+0000","last_peered":"2024-03-09T15:05:14.714197+0000","last_clean":"2024-03-09T15:05:14.714197+0000","last_became_active":"2024-03-09T14:42:15.960341+0000","last_became_peered":"2024-03-09T14:42:15.960341+0000","last_unstale":"2024-03-09T15:05:14.714197+0000","last_undegraded":"2024-03-09T15:05:14.714197+0000","last_fullsized":"2024-03-09T15:05:14.714197+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:19:05.030621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":20522,"num_write":11,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'42","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.705495+0000","last_change":"2024-03-09T14:39:57.898959+0000","last_active":"2024-03-09T15:04:09.705495+0000","last_peered":"2024-03-09T15:04:09.705495+0000","last_clean":"2024-03-09T15:04:09.705495+0000","last_became_active":"2024-03-09T14:39:57.898267+0000","last_became_peered":"2024-03-09T14:39:57.898267+0000","last_unstale":"2024-03-09T15:04:09.705495+0000","last_undegraded":"2024-03-09T15:04:09.705495+0000","last_fullsized":"2024-03-09T15:04:09.705495+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:00:24.847765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":119,"num_write":82,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'286","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.666522+0000","last_change":"2024-03-09T14:28:53.624341+0000","last_active":"2024-03-09T15:07:04.666522+0000","last_peered":"2024-03-09T15:07:04.666522+0000","last_clean":"2024-03-09T15:07:04.666522+0000","last_became_active":"2024-03-09T14:28:53.623701+0000","last_became_peered":"2024-03-09T14:28:53.623701+0000","last_unstale":"2024-03-09T15:07:04.666522+0000","last_undegraded":"2024-03-09T15:07:04.666522+0000","last_fullsized":"2024-03-09T15:07:04.666522+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:38.200914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5567709,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":742,"num_read_kb":36473,"num_write":1125,"num_write_kb":31503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'692","reported_seq":2207,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.442129+0000","last_change":"2024-03-09T14:28:55.575692+0000","last_active":"2024-03-09T15:06:42.442129+0000","last_peered":"2024-03-09T15:06:42.442129+0000","last_clean":"2024-03-09T15:06:42.442129+0000","last_became_active":"2024-03-09T14:28:55.574984+0000","last_became_peered":"2024-03-09T14:28:55.574984+0000","last_unstale":"2024-03-09T15:06:42.442129+0000","last_undegraded":"2024-03-09T15:06:42.442129+0000","last_fullsized":"2024-03-09T15:06:42.442129+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:07.026587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3313,"num_read_kb":2995,"num_write":917,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'294","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.023242+0000","last_change":"2024-03-09T14:28:53.626962+0000","last_active":"2024-03-09T15:07:05.023242+0000","last_peered":"2024-03-09T15:07:05.023242+0000","last_clean":"2024-03-09T15:07:05.023242+0000","last_became_active":"2024-03-09T14:28:53.626490+0000","last_became_peered":"2024-03-09T14:28:53.626490+0000","last_unstale":"2024-03-09T15:07:05.023242+0000","last_undegraded":"2024-03-09T15:07:05.023242+0000","last_fullsized":"2024-03-09T15:07:05.023242+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:16:05.659643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5265861,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":455,"num_read_kb":36382,"num_write":1092,"num_write_kb":36054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'348","reported_seq":1729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.522825+0000","last_change":"2024-03-09T14:28:55.592370+0000","last_active":"2024-03-09T15:06:32.522825+0000","last_peered":"2024-03-09T15:06:32.522825+0000","last_clean":"2024-03-09T15:06:32.522825+0000","last_became_active":"2024-03-09T14:28:55.591640+0000","last_became_peered":"2024-03-09T14:28:55.591640+0000","last_unstale":"2024-03-09T15:06:32.522825+0000","last_undegraded":"2024-03-09T15:06:32.522825+0000","last_fullsized":"2024-03-09T15:06:32.522825+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:10.597479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1906,"num_read_kb":1805,"num_write":411,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'317","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.871014+0000","last_change":"2024-03-09T14:29:28.828234+0000","last_active":"2024-03-09T15:07:04.871014+0000","last_peered":"2024-03-09T15:07:04.871014+0000","last_clean":"2024-03-09T15:07:04.871014+0000","last_became_active":"2024-03-09T14:29:28.827096+0000","last_became_peered":"2024-03-09T14:29:28.827096+0000","last_unstale":"2024-03-09T15:07:04.871014+0000","last_undegraded":"2024-03-09T15:07:04.871014+0000","last_fullsized":"2024-03-09T15:07:04.871014+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:43.226590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269082,"num_objects":19,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":576,"num_read_kb":23096,"num_write":1220,"num_write_kb":39906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,7],"acting":[3,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"264'398","reported_seq":1882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.439715+0000","last_change":"2024-03-09T14:28:55.571747+0000","last_active":"2024-03-09T15:06:42.439715+0000","last_peered":"2024-03-09T15:06:42.439715+0000","last_clean":"2024-03-09T15:06:42.439715+0000","last_became_active":"2024-03-09T14:28:55.570930+0000","last_became_peered":"2024-03-09T14:28:55.570930+0000","last_unstale":"2024-03-09T15:06:42.439715+0000","last_undegraded":"2024-03-09T15:06:42.439715+0000","last_fullsized":"2024-03-09T15:06:42.439715+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:13.704377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2164,"num_read_kb":2043,"num_write":472,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'286","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.822098+0000","last_change":"2024-03-09T14:28:53.605127+0000","last_active":"2024-03-09T15:07:04.822098+0000","last_peered":"2024-03-09T15:07:04.822098+0000","last_clean":"2024-03-09T15:07:04.822098+0000","last_became_active":"2024-03-09T14:28:53.603454+0000","last_became_peered":"2024-03-09T14:28:53.603454+0000","last_unstale":"2024-03-09T15:07:04.822098+0000","last_undegraded":"2024-03-09T15:07:04.822098+0000","last_fullsized":"2024-03-09T15:07:04.822098+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:11:31.442216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":508519,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":466,"num_read_kb":6538,"num_write":1174,"num_write_kb":12238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'433","reported_seq":1935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:03.127553+0000","last_change":"2024-03-09T14:28:55.611079+0000","last_active":"2024-03-09T15:06:03.127553+0000","last_peered":"2024-03-09T15:06:03.127553+0000","last_clean":"2024-03-09T15:06:03.127553+0000","last_became_active":"2024-03-09T14:28:55.610360+0000","last_became_peered":"2024-03-09T14:28:55.610360+0000","last_unstale":"2024-03-09T15:06:03.127553+0000","last_undegraded":"2024-03-09T15:06:03.127553+0000","last_fullsized":"2024-03-09T15:06:03.127553+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:29:26.385739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2375,"num_read_kb":2224,"num_write":558,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'317","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.651479+0000","last_change":"2024-03-09T14:28:53.624123+0000","last_active":"2024-03-09T15:07:04.651479+0000","last_peered":"2024-03-09T15:07:04.651479+0000","last_clean":"2024-03-09T15:07:04.651479+0000","last_became_active":"2024-03-09T14:28:53.622689+0000","last_became_peered":"2024-03-09T14:28:53.622689+0000","last_unstale":"2024-03-09T15:07:04.651479+0000","last_undegraded":"2024-03-09T15:07:04.651479+0000","last_fullsized":"2024-03-09T15:07:04.651479+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:35:07.478864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9892647,"num_objects":30,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":507,"num_read_kb":7526,"num_write":1233,"num_write_kb":32260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'361","reported_seq":1916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.497289+0000","last_change":"2024-03-09T14:28:55.594992+0000","last_active":"2024-03-09T15:06:53.497289+0000","last_peered":"2024-03-09T15:06:53.497289+0000","last_clean":"2024-03-09T15:06:53.497289+0000","last_became_active":"2024-03-09T14:28:55.588204+0000","last_became_peered":"2024-03-09T14:28:55.588204+0000","last_unstale":"2024-03-09T15:06:53.497289+0000","last_undegraded":"2024-03-09T15:06:53.497289+0000","last_fullsized":"2024-03-09T15:06:53.497289+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:08:51.680835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2088,"num_read_kb":2012,"num_write":400,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'355","reported_seq":1058,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.870513+0000","last_change":"2024-03-09T14:28:53.605882+0000","last_active":"2024-03-09T15:07:04.870513+0000","last_peered":"2024-03-09T15:07:04.870513+0000","last_clean":"2024-03-09T15:07:04.870513+0000","last_became_active":"2024-03-09T14:28:53.604391+0000","last_became_peered":"2024-03-09T14:28:53.604391+0000","last_unstale":"2024-03-09T15:07:04.870513+0000","last_undegraded":"2024-03-09T15:07:04.870513+0000","last_fullsized":"2024-03-09T15:07:04.870513+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:59:20.682629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6292408,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":737,"num_read_kb":3295,"num_write":1220,"num_write_kb":34124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'790","reported_seq":2517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.519848+0000","last_change":"2024-03-09T14:28:55.572158+0000","last_active":"2024-03-09T15:06:32.519848+0000","last_peered":"2024-03-09T15:06:32.519848+0000","last_clean":"2024-03-09T15:06:32.519848+0000","last_became_active":"2024-03-09T14:28:55.571291+0000","last_became_peered":"2024-03-09T14:28:55.571291+0000","last_unstale":"2024-03-09T15:06:32.519848+0000","last_undegraded":"2024-03-09T15:06:32.519848+0000","last_fullsized":"2024-03-09T15:06:32.519848+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:13.639955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3843,"num_read_kb":3494,"num_write":1039,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'377","reported_seq":1038,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.675047+0000","last_change":"2024-03-09T14:28:53.619197+0000","last_active":"2024-03-09T15:07:04.675047+0000","last_peered":"2024-03-09T15:07:04.675047+0000","last_clean":"2024-03-09T15:07:04.675047+0000","last_became_active":"2024-03-09T14:28:53.618259+0000","last_became_peered":"2024-03-09T14:28:53.618259+0000","last_unstale":"2024-03-09T15:07:04.675047+0000","last_undegraded":"2024-03-09T15:07:04.675047+0000","last_fullsized":"2024-03-09T15:07:04.675047+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:17:48.901903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243871,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":558,"num_read_kb":8007,"num_write":1492,"num_write_kb":37535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'416","reported_seq":2018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:30.937626+0000","last_change":"2024-03-09T14:28:55.588359+0000","last_active":"2024-03-09T15:06:30.937626+0000","last_peered":"2024-03-09T15:06:30.937626+0000","last_clean":"2024-03-09T15:06:30.937626+0000","last_became_active":"2024-03-09T14:28:55.587626+0000","last_became_peered":"2024-03-09T14:28:55.587626+0000","last_unstale":"2024-03-09T15:06:30.937626+0000","last_undegraded":"2024-03-09T15:06:30.937626+0000","last_fullsized":"2024-03-09T15:06:30.937626+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:11:15.692803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2314,"num_read_kb":2202,"num_write":483,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'319","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.799608+0000","last_change":"2024-03-09T14:28:53.589649+0000","last_active":"2024-03-09T15:07:04.799608+0000","last_peered":"2024-03-09T15:07:04.799608+0000","last_clean":"2024-03-09T15:07:04.799608+0000","last_became_active":"2024-03-09T14:28:53.589232+0000","last_became_peered":"2024-03-09T14:28:53.589232+0000","last_unstale":"2024-03-09T15:07:04.799608+0000","last_undegraded":"2024-03-09T15:07:04.799608+0000","last_fullsized":"2024-03-09T15:07:04.799608+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:39:52.724655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539421,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":471,"num_read_kb":42616,"num_write":1223,"num_write_kb":40647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'928","reported_seq":2692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.479559+0000","last_change":"2024-03-09T14:28:55.603210+0000","last_active":"2024-03-09T15:06:53.479559+0000","last_peered":"2024-03-09T15:06:53.479559+0000","last_clean":"2024-03-09T15:06:53.479559+0000","last_became_active":"2024-03-09T14:28:55.602477+0000","last_became_peered":"2024-03-09T14:28:55.602477+0000","last_unstale":"2024-03-09T15:06:53.479559+0000","last_undegraded":"2024-03-09T15:06:53.479559+0000","last_fullsized":"2024-03-09T15:06:53.479559+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:09:50.068938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4605,"num_read_kb":4102,"num_write":1299,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'353","reported_seq":1797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.436373+0000","last_change":"2024-03-09T14:28:55.571793+0000","last_active":"2024-03-09T15:06:42.436373+0000","last_peered":"2024-03-09T15:06:42.436373+0000","last_clean":"2024-03-09T15:06:42.436373+0000","last_became_active":"2024-03-09T14:28:55.570861+0000","last_became_peered":"2024-03-09T14:28:55.570861+0000","last_unstale":"2024-03-09T15:06:42.436373+0000","last_undegraded":"2024-03-09T15:06:42.436373+0000","last_fullsized":"2024-03-09T15:06:42.436373+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:59:27.495054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1960,"num_read_kb":1866,"num_write":405,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'329","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.588942+0000","last_change":"2024-03-09T14:28:53.608951+0000","last_active":"2024-03-09T15:07:04.588942+0000","last_peered":"2024-03-09T15:07:04.588942+0000","last_clean":"2024-03-09T15:07:04.588942+0000","last_became_active":"2024-03-09T14:28:53.607915+0000","last_became_peered":"2024-03-09T14:28:53.607915+0000","last_unstale":"2024-03-09T15:07:04.588942+0000","last_undegraded":"2024-03-09T15:07:04.588942+0000","last_fullsized":"2024-03-09T15:07:04.588942+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:57.850290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5561340,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":529,"num_read_kb":78571,"num_write":1317,"num_write_kb":47168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'819","reported_seq":2221,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.471725+0000","last_change":"2024-03-09T14:28:55.592675+0000","last_active":"2024-03-09T15:06:53.471725+0000","last_peered":"2024-03-09T15:06:53.471725+0000","last_clean":"2024-03-09T15:06:53.471725+0000","last_became_active":"2024-03-09T14:28:55.591884+0000","last_became_peered":"2024-03-09T14:28:55.591884+0000","last_unstale":"2024-03-09T15:06:53.471725+0000","last_undegraded":"2024-03-09T15:06:53.471725+0000","last_fullsized":"2024-03-09T15:06:53.471725+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:10:17.105445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3579,"num_read_kb":3134,"num_write":1128,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'234","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.698433+0000","last_change":"2024-03-09T14:28:53.638241+0000","last_active":"2024-03-09T15:07:04.698433+0000","last_peered":"2024-03-09T15:07:04.698433+0000","last_clean":"2024-03-09T15:07:04.698433+0000","last_became_active":"2024-03-09T14:28:53.635735+0000","last_became_peered":"2024-03-09T14:28:53.635735+0000","last_unstale":"2024-03-09T15:07:04.698433+0000","last_undegraded":"2024-03-09T15:07:04.698433+0000","last_fullsized":"2024-03-09T15:07:04.698433+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:44:09.619974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":439,"num_read_kb":101132,"num_write":968,"num_write_kb":27272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'365","reported_seq":1868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.435386+0000","last_change":"2024-03-09T14:28:55.590086+0000","last_active":"2024-03-09T15:06:42.435386+0000","last_peered":"2024-03-09T15:06:42.435386+0000","last_clean":"2024-03-09T15:06:42.435386+0000","last_became_active":"2024-03-09T14:28:55.589360+0000","last_became_peered":"2024-03-09T14:28:55.589360+0000","last_unstale":"2024-03-09T15:06:42.435386+0000","last_undegraded":"2024-03-09T15:06:42.435386+0000","last_fullsized":"2024-03-09T15:06:42.435386+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:02.064740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2092,"num_write":426,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'295","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.615763+0000","last_change":"2024-03-09T14:28:53.638187+0000","last_active":"2024-03-09T15:07:04.615763+0000","last_peered":"2024-03-09T15:07:04.615763+0000","last_clean":"2024-03-09T15:07:04.615763+0000","last_became_active":"2024-03-09T14:28:53.635713+0000","last_became_peered":"2024-03-09T14:28:53.635713+0000","last_unstale":"2024-03-09T15:07:04.615763+0000","last_undegraded":"2024-03-09T15:07:04.615763+0000","last_fullsized":"2024-03-09T15:07:04.615763+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:54:41.702227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7073816,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":509,"num_read_kb":101700,"num_write":1094,"num_write_kb":55747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'1330","reported_seq":2999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.480828+0000","last_change":"2024-03-09T14:28:55.602534+0000","last_active":"2024-03-09T15:06:53.480828+0000","last_peered":"2024-03-09T15:06:53.480828+0000","last_clean":"2024-03-09T15:06:53.480828+0000","last_became_active":"2024-03-09T14:28:55.602235+0000","last_became_peered":"2024-03-09T14:28:55.602235+0000","last_unstale":"2024-03-09T15:06:53.480828+0000","last_undegraded":"2024-03-09T15:06:53.480828+0000","last_fullsized":"2024-03-09T15:06:53.480828+0000","mapping_epoch":25,"log_start":"264'1300","ondisk_log_start":"264'1300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:37.897038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5607,"num_read_kb":4937,"num_write":1889,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'420","reported_seq":1087,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.643322+0000","last_change":"2024-03-09T14:29:28.825001+0000","last_active":"2024-03-09T15:07:04.643322+0000","last_peered":"2024-03-09T15:07:04.643322+0000","last_clean":"2024-03-09T15:07:04.643322+0000","last_became_active":"2024-03-09T14:29:28.823751+0000","last_became_peered":"2024-03-09T14:29:28.823751+0000","last_unstale":"2024-03-09T15:07:04.643322+0000","last_undegraded":"2024-03-09T15:07:04.643322+0000","last_fullsized":"2024-03-09T15:07:04.643322+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:51:51.410458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289653,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":790,"num_read_kb":6645,"num_write":1405,"num_write_kb":15242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,0],"acting":[2,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"264'438","reported_seq":2021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.377980+0000","last_change":"2024-03-09T14:28:55.575476+0000","last_active":"2024-03-09T15:06:38.377980+0000","last_peered":"2024-03-09T15:06:38.377980+0000","last_clean":"2024-03-09T15:06:38.377980+0000","last_became_active":"2024-03-09T14:28:55.574645+0000","last_became_peered":"2024-03-09T14:28:55.574645+0000","last_unstale":"2024-03-09T15:06:38.377980+0000","last_undegraded":"2024-03-09T15:06:38.377980+0000","last_fullsized":"2024-03-09T15:06:38.377980+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:13:49.646435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2503,"num_read_kb":2358,"num_write":585,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'369","reported_seq":1037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.769949+0000","last_change":"2024-03-09T14:28:53.619764+0000","last_active":"2024-03-09T15:07:04.769949+0000","last_peered":"2024-03-09T15:07:04.769949+0000","last_clean":"2024-03-09T15:07:04.769949+0000","last_became_active":"2024-03-09T14:28:53.619291+0000","last_became_peered":"2024-03-09T14:28:53.619291+0000","last_unstale":"2024-03-09T15:07:04.769949+0000","last_undegraded":"2024-03-09T15:07:04.769949+0000","last_fullsized":"2024-03-09T15:07:04.769949+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:18.730889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505363,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":578,"num_read_kb":88953,"num_write":1355,"num_write_kb":34328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'358","reported_seq":1902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.473697+0000","last_change":"2024-03-09T14:28:55.563774+0000","last_active":"2024-03-09T15:06:53.473697+0000","last_peered":"2024-03-09T15:06:53.473697+0000","last_clean":"2024-03-09T15:06:53.473697+0000","last_became_active":"2024-03-09T14:28:55.563041+0000","last_became_peered":"2024-03-09T14:28:55.563041+0000","last_unstale":"2024-03-09T15:06:53.473697+0000","last_undegraded":"2024-03-09T15:06:53.473697+0000","last_fullsized":"2024-03-09T15:06:53.473697+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:57.726313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2055,"num_read_kb":1986,"num_write":393,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'385","reported_seq":1066,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.650593+0000","last_change":"2024-03-09T14:28:53.586359+0000","last_active":"2024-03-09T15:07:04.650593+0000","last_peered":"2024-03-09T15:07:04.650593+0000","last_clean":"2024-03-09T15:07:04.650593+0000","last_became_active":"2024-03-09T14:28:53.585880+0000","last_became_peered":"2024-03-09T14:28:53.585880+0000","last_unstale":"2024-03-09T15:07:04.650593+0000","last_undegraded":"2024-03-09T15:07:04.650593+0000","last_fullsized":"2024-03-09T15:07:04.650593+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:35:20.383666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45730,"num_objects":33,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":625,"num_read_kb":65521,"num_write":1358,"num_write_kb":24882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'120","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:26.294126+0000","last_change":"2024-03-09T14:29:03.661025+0000","last_active":"2024-03-09T15:06:26.294126+0000","last_peered":"2024-03-09T15:06:26.294126+0000","last_clean":"2024-03-09T15:06:26.294126+0000","last_became_active":"2024-03-09T14:29:03.660224+0000","last_became_peered":"2024-03-09T14:29:03.660224+0000","last_unstale":"2024-03-09T15:06:26.294126+0000","last_undegraded":"2024-03-09T15:06:26.294126+0000","last_fullsized":"2024-03-09T15:06:26.294126+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:52.780401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":112,"num_write":285,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'399","reported_seq":1864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.290586+0000","last_change":"2024-03-09T14:28:55.598495+0000","last_active":"2024-03-09T15:06:41.290586+0000","last_peered":"2024-03-09T15:06:41.290586+0000","last_clean":"2024-03-09T15:06:41.290586+0000","last_became_active":"2024-03-09T14:28:55.596404+0000","last_became_peered":"2024-03-09T14:28:55.596404+0000","last_unstale":"2024-03-09T15:06:41.290586+0000","last_undegraded":"2024-03-09T15:06:41.290586+0000","last_fullsized":"2024-03-09T15:06:41.290586+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:01:23.717950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2183,"num_read_kb":2049,"num_write":485,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'292","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.603739+0000","last_change":"2024-03-09T14:28:53.610969+0000","last_active":"2024-03-09T15:07:04.603739+0000","last_peered":"2024-03-09T15:07:04.603739+0000","last_clean":"2024-03-09T15:07:04.603739+0000","last_became_active":"2024-03-09T14:28:53.610073+0000","last_became_peered":"2024-03-09T14:28:53.610073+0000","last_unstale":"2024-03-09T15:07:04.603739+0000","last_undegraded":"2024-03-09T15:07:04.603739+0000","last_fullsized":"2024-03-09T15:07:04.603739+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:36.026110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8695860,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":555,"num_read_kb":1412,"num_write":1128,"num_write_kb":31021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.867610+0000","last_change":"2024-03-09T14:28:57.606795+0000","last_active":"2024-03-09T15:02:49.867610+0000","last_peered":"2024-03-09T15:02:49.867610+0000","last_clean":"2024-03-09T15:02:49.867610+0000","last_became_active":"2024-03-09T14:28:57.606062+0000","last_became_peered":"2024-03-09T14:28:57.606062+0000","last_unstale":"2024-03-09T15:02:49.867610+0000","last_undegraded":"2024-03-09T15:02:49.867610+0000","last_fullsized":"2024-03-09T15:02:49.867610+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:20:55.983665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'315","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.460277+0000","last_change":"2024-03-09T14:28:59.622695+0000","last_active":"2024-03-09T15:06:55.460277+0000","last_peered":"2024-03-09T15:06:55.460277+0000","last_clean":"2024-03-09T15:06:55.460277+0000","last_became_active":"2024-03-09T14:28:59.622357+0000","last_became_peered":"2024-03-09T14:28:59.622357+0000","last_unstale":"2024-03-09T15:06:55.460277+0000","last_undegraded":"2024-03-09T15:06:55.460277+0000","last_fullsized":"2024-03-09T15:06:55.460277+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:40:38.071877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59515,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":498,"num_read_kb":977,"num_write":398,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.902045+0000","last_change":"2024-03-09T14:29:01.637387+0000","last_active":"2024-03-09T15:02:54.902045+0000","last_peered":"2024-03-09T15:02:54.902045+0000","last_clean":"2024-03-09T15:02:54.902045+0000","last_became_active":"2024-03-09T14:29:01.636497+0000","last_became_peered":"2024-03-09T14:29:01.636497+0000","last_unstale":"2024-03-09T15:02:54.902045+0000","last_undegraded":"2024-03-09T15:02:54.902045+0000","last_fullsized":"2024-03-09T15:02:54.902045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:20:55.356981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2460","reported_seq":4883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.842069+0000","last_change":"2024-03-09T14:29:03.667138+0000","last_active":"2024-03-09T15:06:53.842069+0000","last_peered":"2024-03-09T15:06:53.842069+0000","last_clean":"2024-03-09T15:06:53.842069+0000","last_became_active":"2024-03-09T14:29:03.664933+0000","last_became_peered":"2024-03-09T14:29:03.664933+0000","last_unstale":"2024-03-09T15:06:53.842069+0000","last_undegraded":"2024-03-09T15:06:53.842069+0000","last_fullsized":"2024-03-09T15:06:53.842069+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":2400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:18:59.045000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6733,"num_read_kb":6729,"num_write":4969,"num_write_kb":1822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'420","reported_seq":1996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.091742+0000","last_change":"2024-03-09T14:28:55.595855+0000","last_active":"2024-03-09T15:06:27.091742+0000","last_peered":"2024-03-09T15:06:27.091742+0000","last_clean":"2024-03-09T15:06:27.091742+0000","last_became_active":"2024-03-09T14:28:55.594120+0000","last_became_peered":"2024-03-09T14:28:55.594120+0000","last_unstale":"2024-03-09T15:06:27.091742+0000","last_undegraded":"2024-03-09T15:06:27.091742+0000","last_fullsized":"2024-03-09T15:06:27.091742+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:33:22.109526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2334,"num_read_kb":2217,"num_write":521,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'322","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.612800+0000","last_change":"2024-03-09T14:28:53.592039+0000","last_active":"2024-03-09T15:07:04.612800+0000","last_peered":"2024-03-09T15:07:04.612800+0000","last_clean":"2024-03-09T15:07:04.612800+0000","last_became_active":"2024-03-09T14:28:53.589914+0000","last_became_peered":"2024-03-09T14:28:53.589914+0000","last_unstale":"2024-03-09T15:07:04.612800+0000","last_undegraded":"2024-03-09T15:07:04.612800+0000","last_fullsized":"2024-03-09T15:07:04.612800+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:53:01.915523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097434,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":441,"num_read_kb":36278,"num_write":1194,"num_write_kb":26714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.939219+0000","last_change":"2024-03-09T14:28:57.609556+0000","last_active":"2024-03-09T15:04:04.939219+0000","last_peered":"2024-03-09T15:04:04.939219+0000","last_clean":"2024-03-09T15:04:04.939219+0000","last_became_active":"2024-03-09T14:28:57.608444+0000","last_became_peered":"2024-03-09T14:28:57.608444+0000","last_unstale":"2024-03-09T15:04:04.939219+0000","last_undegraded":"2024-03-09T15:04:04.939219+0000","last_fullsized":"2024-03-09T15:04:04.939219+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:54.351478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'65","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.201008+0000","last_change":"2024-03-09T14:28:59.615503+0000","last_active":"2024-03-09T15:04:49.201008+0000","last_peered":"2024-03-09T15:04:49.201008+0000","last_clean":"2024-03-09T15:04:49.201008+0000","last_became_active":"2024-03-09T14:28:59.614144+0000","last_became_peered":"2024-03-09T14:28:59.614144+0000","last_unstale":"2024-03-09T15:04:49.201008+0000","last_undegraded":"2024-03-09T15:04:49.201008+0000","last_fullsized":"2024-03-09T15:04:49.201008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:26:26.621561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":74,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.684839+0000","last_change":"2024-03-09T14:29:01.650515+0000","last_active":"2024-03-09T15:02:54.684839+0000","last_peered":"2024-03-09T15:02:54.684839+0000","last_clean":"2024-03-09T15:02:54.684839+0000","last_became_active":"2024-03-09T14:29:01.649716+0000","last_became_peered":"2024-03-09T14:29:01.649716+0000","last_unstale":"2024-03-09T15:02:54.684839+0000","last_undegraded":"2024-03-09T15:02:54.684839+0000","last_fullsized":"2024-03-09T15:02:54.684839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:50:00.172206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'128","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.347500+0000","last_change":"2024-03-09T14:29:03.677339+0000","last_active":"2024-03-09T15:06:24.347500+0000","last_peered":"2024-03-09T15:06:24.347500+0000","last_clean":"2024-03-09T15:06:24.347500+0000","last_became_active":"2024-03-09T14:29:03.676427+0000","last_became_peered":"2024-03-09T14:29:03.676427+0000","last_unstale":"2024-03-09T15:06:24.347500+0000","last_undegraded":"2024-03-09T15:06:24.347500+0000","last_fullsized":"2024-03-09T15:06:24.347500+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:46:24.909885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":126,"num_write":288,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'348","reported_seq":1729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:28.240636+0000","last_change":"2024-03-09T14:29:28.734389+0000","last_active":"2024-03-09T15:06:28.240636+0000","last_peered":"2024-03-09T15:06:28.240636+0000","last_clean":"2024-03-09T15:06:28.240636+0000","last_became_active":"2024-03-09T14:29:28.733522+0000","last_became_peered":"2024-03-09T14:29:28.733522+0000","last_unstale":"2024-03-09T15:06:28.240636+0000","last_undegraded":"2024-03-09T15:06:28.240636+0000","last_fullsized":"2024-03-09T15:06:28.240636+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:16:32.699098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1907,"num_read_kb":1804,"num_write":410,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'320","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.710687+0000","last_change":"2024-03-09T14:28:53.633910+0000","last_active":"2024-03-09T15:07:04.710687+0000","last_peered":"2024-03-09T15:07:04.710687+0000","last_clean":"2024-03-09T15:07:04.710687+0000","last_became_active":"2024-03-09T14:28:53.633368+0000","last_became_peered":"2024-03-09T14:28:53.633368+0000","last_unstale":"2024-03-09T15:07:04.710687+0000","last_undegraded":"2024-03-09T15:07:04.710687+0000","last_fullsized":"2024-03-09T15:07:04.710687+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:26.540977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918128,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":428,"num_read_kb":7245,"num_write":1132,"num_write_kb":29598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.920522+0000","last_change":"2024-03-09T14:28:57.614611+0000","last_active":"2024-03-09T15:02:49.920522+0000","last_peered":"2024-03-09T15:02:49.920522+0000","last_clean":"2024-03-09T15:02:49.920522+0000","last_became_active":"2024-03-09T14:28:57.613841+0000","last_became_peered":"2024-03-09T14:28:57.613841+0000","last_unstale":"2024-03-09T15:02:49.920522+0000","last_undegraded":"2024-03-09T15:02:49.920522+0000","last_fullsized":"2024-03-09T15:02:49.920522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:44.586932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'103","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.727031+0000","last_change":"2024-03-09T14:28:59.619913+0000","last_active":"2024-03-09T15:06:29.727031+0000","last_peered":"2024-03-09T15:06:29.727031+0000","last_clean":"2024-03-09T15:06:29.727031+0000","last_became_active":"2024-03-09T14:28:59.619147+0000","last_became_peered":"2024-03-09T14:28:59.619147+0000","last_unstale":"2024-03-09T15:06:29.727031+0000","last_undegraded":"2024-03-09T15:06:29.727031+0000","last_fullsized":"2024-03-09T15:06:29.727031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:54:42.905183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":102,"num_write":78,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'532","reported_seq":3845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.474622+0000","last_change":"2024-03-09T14:29:01.637642+0000","last_active":"2024-03-09T15:07:02.474622+0000","last_peered":"2024-03-09T15:07:02.474622+0000","last_clean":"2024-03-09T15:07:02.474622+0000","last_became_active":"2024-03-09T14:29:01.636743+0000","last_became_peered":"2024-03-09T14:29:01.636743+0000","last_unstale":"2024-03-09T15:07:02.474622+0000","last_undegraded":"2024-03-09T15:07:02.474622+0000","last_fullsized":"2024-03-09T15:07:02.474622+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":500,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:58:02.166987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'197","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:20.713069+0000","last_change":"2024-03-09T14:29:03.649992+0000","last_active":"2024-03-09T15:06:20.713069+0000","last_peered":"2024-03-09T15:06:20.713069+0000","last_clean":"2024-03-09T15:06:20.713069+0000","last_became_active":"2024-03-09T14:29:03.649194+0000","last_became_peered":"2024-03-09T14:29:03.649194+0000","last_unstale":"2024-03-09T15:06:20.713069+0000","last_undegraded":"2024-03-09T15:06:20.713069+0000","last_fullsized":"2024-03-09T15:06:20.713069+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:46.290792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":551,"num_read_kb":549,"num_write":426,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'370","reported_seq":1843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:56.287432+0000","last_change":"2024-03-09T14:28:55.597244+0000","last_active":"2024-03-09T15:05:56.287432+0000","last_peered":"2024-03-09T15:05:56.287432+0000","last_clean":"2024-03-09T15:05:56.287432+0000","last_became_active":"2024-03-09T14:28:55.592359+0000","last_became_peered":"2024-03-09T14:28:55.592359+0000","last_unstale":"2024-03-09T15:05:56.287432+0000","last_undegraded":"2024-03-09T15:05:56.287432+0000","last_fullsized":"2024-03-09T15:05:56.287432+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:59.078312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2105,"num_read_kb":2015,"num_write":416,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'265","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.674212+0000","last_change":"2024-03-09T14:28:53.632702+0000","last_active":"2024-03-09T15:07:04.674212+0000","last_peered":"2024-03-09T15:07:04.674212+0000","last_clean":"2024-03-09T15:07:04.674212+0000","last_became_active":"2024-03-09T14:28:53.631559+0000","last_became_peered":"2024-03-09T14:28:53.631559+0000","last_unstale":"2024-03-09T15:07:04.674212+0000","last_undegraded":"2024-03-09T15:07:04.674212+0000","last_fullsized":"2024-03-09T15:07:04.674212+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:01:04.705294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9603321,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":376,"num_read_kb":6712,"num_write":1032,"num_write_kb":20730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.867656+0000","last_change":"2024-03-09T14:28:57.606488+0000","last_active":"2024-03-09T15:02:49.867656+0000","last_peered":"2024-03-09T15:02:49.867656+0000","last_clean":"2024-03-09T15:02:49.867656+0000","last_became_active":"2024-03-09T14:28:57.605787+0000","last_became_peered":"2024-03-09T14:28:57.605787+0000","last_unstale":"2024-03-09T15:02:49.867656+0000","last_undegraded":"2024-03-09T15:02:49.867656+0000","last_fullsized":"2024-03-09T15:02:49.867656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:26.152998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'240","reported_seq":799,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.732734+0000","last_change":"2024-03-09T14:28:59.627011+0000","last_active":"2024-03-09T15:07:04.732734+0000","last_peered":"2024-03-09T15:07:04.732734+0000","last_clean":"2024-03-09T15:07:04.732734+0000","last_became_active":"2024-03-09T14:28:59.626279+0000","last_became_peered":"2024-03-09T14:28:59.626279+0000","last_unstale":"2024-03-09T15:07:04.732734+0000","last_undegraded":"2024-03-09T15:07:04.732734+0000","last_fullsized":"2024-03-09T15:07:04.732734+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:16:34.909728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51626,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":406,"num_read_kb":896,"num_write":329,"num_write_kb":273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'584","reported_seq":1927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.487401+0000","last_change":"2024-03-09T14:29:01.629131+0000","last_active":"2024-03-09T15:07:02.487401+0000","last_peered":"2024-03-09T15:07:02.487401+0000","last_clean":"2024-03-09T15:07:02.487401+0000","last_became_active":"2024-03-09T14:29:01.628420+0000","last_became_peered":"2024-03-09T14:29:01.628420+0000","last_unstale":"2024-03-09T15:07:02.487401+0000","last_undegraded":"2024-03-09T15:07:02.487401+0000","last_fullsized":"2024-03-09T15:07:02.487401+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:38.918481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'514","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:33.802719+0000","last_change":"2024-03-09T14:28:55.583472+0000","last_active":"2024-03-09T15:06:33.802719+0000","last_peered":"2024-03-09T15:06:33.802719+0000","last_clean":"2024-03-09T15:06:33.802719+0000","last_became_active":"2024-03-09T14:28:55.582638+0000","last_became_peered":"2024-03-09T14:28:55.582638+0000","last_unstale":"2024-03-09T15:06:33.802719+0000","last_undegraded":"2024-03-09T15:06:33.802719+0000","last_fullsized":"2024-03-09T15:06:33.802719+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:37:10.517715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2835,"num_read_kb":2627,"num_write":675,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'325","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.640986+0000","last_change":"2024-03-09T14:28:53.615478+0000","last_active":"2024-03-09T15:07:04.640986+0000","last_peered":"2024-03-09T15:07:04.640986+0000","last_clean":"2024-03-09T15:07:04.640986+0000","last_became_active":"2024-03-09T14:28:53.614586+0000","last_became_peered":"2024-03-09T14:28:53.614586+0000","last_unstale":"2024-03-09T15:07:04.640986+0000","last_undegraded":"2024-03-09T15:07:04.640986+0000","last_fullsized":"2024-03-09T15:07:04.640986+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:26:26.454638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2569943,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":448,"num_read_kb":10439,"num_write":1242,"num_write_kb":25392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:39.698275+0000","last_change":"2024-03-09T14:28:57.604178+0000","last_active":"2024-03-09T15:03:39.698275+0000","last_peered":"2024-03-09T15:03:39.698275+0000","last_clean":"2024-03-09T15:03:39.698275+0000","last_became_active":"2024-03-09T14:28:57.603233+0000","last_became_peered":"2024-03-09T14:28:57.603233+0000","last_unstale":"2024-03-09T15:03:39.698275+0000","last_undegraded":"2024-03-09T15:03:39.698275+0000","last_fullsized":"2024-03-09T15:03:39.698275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:12.919139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'332","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.751254+0000","last_change":"2024-03-09T14:28:59.627283+0000","last_active":"2024-03-09T15:07:02.751254+0000","last_peered":"2024-03-09T15:07:02.751254+0000","last_clean":"2024-03-09T15:07:02.751254+0000","last_became_active":"2024-03-09T14:28:59.626371+0000","last_became_peered":"2024-03-09T14:28:59.626371+0000","last_unstale":"2024-03-09T15:07:02.751254+0000","last_undegraded":"2024-03-09T15:07:02.751254+0000","last_fullsized":"2024-03-09T15:07:02.751254+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:29:20.179850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46990,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":561,"num_read_kb":1214,"num_write":446,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:50.041923+0000","last_change":"2024-03-09T14:29:01.637753+0000","last_active":"2024-03-09T15:02:50.041923+0000","last_peered":"2024-03-09T15:02:50.041923+0000","last_clean":"2024-03-09T15:02:50.041923+0000","last_became_active":"2024-03-09T14:29:01.636735+0000","last_became_peered":"2024-03-09T14:29:01.636735+0000","last_unstale":"2024-03-09T15:02:50.041923+0000","last_undegraded":"2024-03-09T15:02:50.041923+0000","last_fullsized":"2024-03-09T15:02:50.041923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:26:05.528994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'542","reported_seq":1364,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.504334+0000","last_change":"2024-03-09T14:29:03.676776+0000","last_active":"2024-03-09T15:06:55.504334+0000","last_peered":"2024-03-09T15:06:55.504334+0000","last_clean":"2024-03-09T15:06:55.504334+0000","last_became_active":"2024-03-09T14:29:03.676068+0000","last_became_peered":"2024-03-09T14:29:03.676068+0000","last_unstale":"2024-03-09T15:06:55.504334+0000","last_undegraded":"2024-03-09T15:06:55.504334+0000","last_fullsized":"2024-03-09T15:06:55.504334+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:53:03.331837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1331,"num_read_kb":1310,"num_write":1143,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'505","reported_seq":2110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.476263+0000","last_change":"2024-03-09T14:28:55.563572+0000","last_active":"2024-03-09T15:06:53.476263+0000","last_peered":"2024-03-09T15:06:53.476263+0000","last_clean":"2024-03-09T15:06:53.476263+0000","last_became_active":"2024-03-09T14:28:55.562782+0000","last_became_peered":"2024-03-09T14:28:55.562782+0000","last_unstale":"2024-03-09T15:06:53.476263+0000","last_undegraded":"2024-03-09T15:06:53.476263+0000","last_fullsized":"2024-03-09T15:06:53.476263+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:08.148515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2703,"num_read_kb":2505,"num_write":654,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'299","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.613984+0000","last_change":"2024-03-09T14:28:53.614539+0000","last_active":"2024-03-09T15:07:04.613984+0000","last_peered":"2024-03-09T15:07:04.613984+0000","last_clean":"2024-03-09T15:07:04.613984+0000","last_became_active":"2024-03-09T14:28:53.613015+0000","last_became_peered":"2024-03-09T14:28:53.613015+0000","last_unstale":"2024-03-09T15:07:04.613984+0000","last_undegraded":"2024-03-09T15:07:04.613984+0000","last_fullsized":"2024-03-09T15:07:04.613984+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:43:30.232179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3031329,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":472,"num_read_kb":9909,"num_write":1154,"num_write_kb":22337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:39.689387+0000","last_change":"2024-03-09T14:28:57.605938+0000","last_active":"2024-03-09T15:03:39.689387+0000","last_peered":"2024-03-09T15:03:39.689387+0000","last_clean":"2024-03-09T15:03:39.689387+0000","last_became_active":"2024-03-09T14:28:57.605493+0000","last_became_peered":"2024-03-09T14:28:57.605493+0000","last_unstale":"2024-03-09T15:03:39.689387+0000","last_undegraded":"2024-03-09T15:03:39.689387+0000","last_fullsized":"2024-03-09T15:03:39.689387+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:08:58.747971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'263","reported_seq":821,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.976449+0000","last_change":"2024-03-09T14:28:59.615074+0000","last_active":"2024-03-09T15:07:03.976449+0000","last_peered":"2024-03-09T15:07:03.976449+0000","last_clean":"2024-03-09T15:07:03.976449+0000","last_became_active":"2024-03-09T14:28:59.614640+0000","last_became_peered":"2024-03-09T14:28:59.614640+0000","last_unstale":"2024-03-09T15:07:03.976449+0000","last_undegraded":"2024-03-09T15:07:03.976449+0000","last_fullsized":"2024-03-09T15:07:03.976449+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:55:14.804093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43961,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1047,"num_write":356,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.934983+0000","last_change":"2024-03-09T14:29:01.628631+0000","last_active":"2024-03-09T15:03:49.934983+0000","last_peered":"2024-03-09T15:03:49.934983+0000","last_clean":"2024-03-09T15:03:49.934983+0000","last_became_active":"2024-03-09T14:29:01.627897+0000","last_became_peered":"2024-03-09T14:29:01.627897+0000","last_unstale":"2024-03-09T15:03:49.934983+0000","last_undegraded":"2024-03-09T15:03:49.934983+0000","last_fullsized":"2024-03-09T15:03:49.934983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:56:12.214362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'106","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:21.867785+0000","last_change":"2024-03-09T14:29:03.673997+0000","last_active":"2024-03-09T15:06:21.867785+0000","last_peered":"2024-03-09T15:06:21.867785+0000","last_clean":"2024-03-09T15:06:21.867785+0000","last_became_active":"2024-03-09T14:29:03.673265+0000","last_became_peered":"2024-03-09T14:29:03.673265+0000","last_unstale":"2024-03-09T15:06:21.867785+0000","last_undegraded":"2024-03-09T15:06:21.867785+0000","last_fullsized":"2024-03-09T15:06:21.867785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:26:29.254697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":93,"num_write":248,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'556","reported_seq":2185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.336610+0000","last_change":"2024-03-09T14:28:55.595155+0000","last_active":"2024-03-09T15:06:24.336610+0000","last_peered":"2024-03-09T15:06:24.336610+0000","last_clean":"2024-03-09T15:06:24.336610+0000","last_became_active":"2024-03-09T14:28:55.588092+0000","last_became_peered":"2024-03-09T14:28:55.588092+0000","last_unstale":"2024-03-09T15:06:24.336610+0000","last_undegraded":"2024-03-09T15:06:24.336610+0000","last_fullsized":"2024-03-09T15:06:24.336610+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:04:55.020928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2916,"num_read_kb":2661,"num_write":728,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'285","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.654742+0000","last_change":"2024-03-09T14:29:28.824146+0000","last_active":"2024-03-09T15:07:04.654742+0000","last_peered":"2024-03-09T15:07:04.654742+0000","last_clean":"2024-03-09T15:07:04.654742+0000","last_became_active":"2024-03-09T14:29:28.822971+0000","last_became_peered":"2024-03-09T14:29:28.822971+0000","last_unstale":"2024-03-09T15:07:04.654742+0000","last_undegraded":"2024-03-09T15:07:04.654742+0000","last_fullsized":"2024-03-09T15:07:04.654742+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:05:04.090335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289525,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":349,"num_read_kb":22878,"num_write":977,"num_write_kb":75728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:44.677095+0000","last_change":"2024-03-09T14:28:57.610888+0000","last_active":"2024-03-09T15:02:44.677095+0000","last_peered":"2024-03-09T15:02:44.677095+0000","last_clean":"2024-03-09T15:02:44.677095+0000","last_became_active":"2024-03-09T14:28:57.610472+0000","last_became_peered":"2024-03-09T14:28:57.610472+0000","last_unstale":"2024-03-09T15:02:44.677095+0000","last_undegraded":"2024-03-09T15:02:44.677095+0000","last_fullsized":"2024-03-09T15:02:44.677095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:44:44.084587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'303","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.936163+0000","last_change":"2024-03-09T14:28:59.613949+0000","last_active":"2024-03-09T15:07:02.936163+0000","last_peered":"2024-03-09T15:07:02.936163+0000","last_clean":"2024-03-09T15:07:02.936163+0000","last_became_active":"2024-03-09T14:28:59.610930+0000","last_became_peered":"2024-03-09T14:28:59.610930+0000","last_unstale":"2024-03-09T15:07:02.936163+0000","last_undegraded":"2024-03-09T15:07:02.936163+0000","last_fullsized":"2024-03-09T15:07:02.936163+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:18:06.308383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48936,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":498,"num_read_kb":1136,"num_write":410,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'559","reported_seq":2051,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.490282+0000","last_change":"2024-03-09T14:29:01.648142+0000","last_active":"2024-03-09T15:07:02.490282+0000","last_peered":"2024-03-09T15:07:02.490282+0000","last_clean":"2024-03-09T15:07:02.490282+0000","last_became_active":"2024-03-09T14:29:01.647361+0000","last_became_peered":"2024-03-09T14:29:01.647361+0000","last_unstale":"2024-03-09T15:07:02.490282+0000","last_undegraded":"2024-03-09T15:07:02.490282+0000","last_fullsized":"2024-03-09T15:07:02.490282+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":500,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:44:05.118214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'137","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:30.943762+0000","last_change":"2024-03-09T14:29:03.666545+0000","last_active":"2024-03-09T15:06:30.943762+0000","last_peered":"2024-03-09T15:06:30.943762+0000","last_clean":"2024-03-09T15:06:30.943762+0000","last_became_active":"2024-03-09T14:29:03.665744+0000","last_became_peered":"2024-03-09T14:29:03.665744+0000","last_unstale":"2024-03-09T15:06:30.943762+0000","last_undegraded":"2024-03-09T15:06:30.943762+0000","last_fullsized":"2024-03-09T15:06:30.943762+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:32:02.001608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'380","reported_seq":1992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.473681+0000","last_change":"2024-03-09T14:28:55.587716+0000","last_active":"2024-03-09T15:06:53.473681+0000","last_peered":"2024-03-09T15:06:53.473681+0000","last_clean":"2024-03-09T15:06:53.473681+0000","last_became_active":"2024-03-09T14:28:55.587413+0000","last_became_peered":"2024-03-09T14:28:55.587413+0000","last_unstale":"2024-03-09T15:06:53.473681+0000","last_undegraded":"2024-03-09T15:06:53.473681+0000","last_fullsized":"2024-03-09T15:06:53.473681+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:48:05.277419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2251,"num_read_kb":2175,"num_write":432,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'279","reported_seq":891,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.909541+0000","last_change":"2024-03-09T14:28:53.640425+0000","last_active":"2024-03-09T15:07:04.909541+0000","last_peered":"2024-03-09T15:07:04.909541+0000","last_clean":"2024-03-09T15:07:04.909541+0000","last_became_active":"2024-03-09T14:28:53.639073+0000","last_became_peered":"2024-03-09T14:28:53.639073+0000","last_unstale":"2024-03-09T15:07:04.909541+0000","last_undegraded":"2024-03-09T15:07:04.909541+0000","last_fullsized":"2024-03-09T15:07:04.909541+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:18.874857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656785,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":415,"num_read_kb":3405,"num_write":1137,"num_write_kb":27946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.691482+0000","last_change":"2024-03-09T14:28:57.620565+0000","last_active":"2024-03-09T15:03:49.691482+0000","last_peered":"2024-03-09T15:03:49.691482+0000","last_clean":"2024-03-09T15:03:49.691482+0000","last_became_active":"2024-03-09T14:28:57.620037+0000","last_became_peered":"2024-03-09T14:28:57.620037+0000","last_unstale":"2024-03-09T15:03:49.691482+0000","last_undegraded":"2024-03-09T15:03:49.691482+0000","last_fullsized":"2024-03-09T15:03:49.691482+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:17:42.157517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'470","reported_seq":1090,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.261609+0000","last_change":"2024-03-09T14:28:59.626702+0000","last_active":"2024-03-09T15:07:04.261609+0000","last_peered":"2024-03-09T15:07:04.261609+0000","last_clean":"2024-03-09T15:07:04.261609+0000","last_became_active":"2024-03-09T14:28:59.625949+0000","last_became_peered":"2024-03-09T14:28:59.625949+0000","last_unstale":"2024-03-09T15:07:04.261609+0000","last_undegraded":"2024-03-09T15:07:04.261609+0000","last_fullsized":"2024-03-09T15:07:04.261609+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:42:22.844016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84476,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":828,"num_read_kb":2021,"num_write":686,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:44.690461+0000","last_change":"2024-03-09T14:29:01.620598+0000","last_active":"2024-03-09T15:03:44.690461+0000","last_peered":"2024-03-09T15:03:44.690461+0000","last_clean":"2024-03-09T15:03:44.690461+0000","last_became_active":"2024-03-09T14:29:01.620136+0000","last_became_peered":"2024-03-09T14:29:01.620136+0000","last_unstale":"2024-03-09T15:03:44.690461+0000","last_undegraded":"2024-03-09T15:03:44.690461+0000","last_fullsized":"2024-03-09T15:03:44.690461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:33.969272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'157","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.043416+0000","last_change":"2024-03-09T14:29:03.674681+0000","last_active":"2024-03-09T15:06:39.043416+0000","last_peered":"2024-03-09T15:06:39.043416+0000","last_clean":"2024-03-09T15:06:39.043416+0000","last_became_active":"2024-03-09T14:29:03.673216+0000","last_became_peered":"2024-03-09T14:29:03.673216+0000","last_unstale":"2024-03-09T15:06:39.043416+0000","last_undegraded":"2024-03-09T15:06:39.043416+0000","last_fullsized":"2024-03-09T15:06:39.043416+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:09:16.468619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":716,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":343,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'284","reported_seq":1635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.437313+0000","last_change":"2024-03-09T14:28:55.575944+0000","last_active":"2024-03-09T15:06:42.437313+0000","last_peered":"2024-03-09T15:06:42.437313+0000","last_clean":"2024-03-09T15:06:42.437313+0000","last_became_active":"2024-03-09T14:28:55.575211+0000","last_became_peered":"2024-03-09T14:28:55.575211+0000","last_unstale":"2024-03-09T15:06:42.437313+0000","last_undegraded":"2024-03-09T15:06:42.437313+0000","last_fullsized":"2024-03-09T15:06:42.437313+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:01:47.496592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1639,"num_read_kb":1592,"num_write":307,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'302","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.838100+0000","last_change":"2024-03-09T14:28:53.562474+0000","last_active":"2024-03-09T15:07:04.838100+0000","last_peered":"2024-03-09T15:07:04.838100+0000","last_clean":"2024-03-09T15:07:04.838100+0000","last_became_active":"2024-03-09T14:28:53.561769+0000","last_became_peered":"2024-03-09T14:28:53.561769+0000","last_unstale":"2024-03-09T15:07:04.838100+0000","last_undegraded":"2024-03-09T15:07:04.838100+0000","last_fullsized":"2024-03-09T15:07:04.838100+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:13.573028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947742,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":543,"num_read_kb":46371,"num_write":1219,"num_write_kb":14767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:44.677212+0000","last_change":"2024-03-09T14:28:57.606747+0000","last_active":"2024-03-09T15:02:44.677212+0000","last_peered":"2024-03-09T15:02:44.677212+0000","last_clean":"2024-03-09T15:02:44.677212+0000","last_became_active":"2024-03-09T14:28:57.606029+0000","last_became_peered":"2024-03-09T14:28:57.606029+0000","last_unstale":"2024-03-09T15:02:44.677212+0000","last_undegraded":"2024-03-09T15:02:44.677212+0000","last_fullsized":"2024-03-09T15:02:44.677212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:37:28.933755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'272","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.364674+0000","last_change":"2024-03-09T14:28:59.630783+0000","last_active":"2024-03-09T15:07:04.364674+0000","last_peered":"2024-03-09T15:07:04.364674+0000","last_clean":"2024-03-09T15:07:04.364674+0000","last_became_active":"2024-03-09T14:28:59.630097+0000","last_became_peered":"2024-03-09T14:28:59.630097+0000","last_unstale":"2024-03-09T15:07:04.364674+0000","last_undegraded":"2024-03-09T15:07:04.364674+0000","last_fullsized":"2024-03-09T15:07:04.364674+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:59:00.777817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42990,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":1018,"num_write":414,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.691717+0000","last_change":"2024-03-09T14:29:01.648762+0000","last_active":"2024-03-09T15:02:54.691717+0000","last_peered":"2024-03-09T15:02:54.691717+0000","last_clean":"2024-03-09T15:02:54.691717+0000","last_became_active":"2024-03-09T14:29:01.647375+0000","last_became_peered":"2024-03-09T14:29:01.647375+0000","last_unstale":"2024-03-09T15:02:54.691717+0000","last_undegraded":"2024-03-09T15:02:54.691717+0000","last_fullsized":"2024-03-09T15:02:54.691717+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:25:06.920706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'128","reported_seq":607,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:51.352059+0000","last_change":"2024-03-09T14:29:03.678484+0000","last_active":"2024-03-09T15:06:51.352059+0000","last_peered":"2024-03-09T15:06:51.352059+0000","last_clean":"2024-03-09T15:06:51.352059+0000","last_became_active":"2024-03-09T14:29:03.677704+0000","last_became_peered":"2024-03-09T14:29:03.677704+0000","last_unstale":"2024-03-09T15:06:51.352059+0000","last_undegraded":"2024-03-09T15:06:51.352059+0000","last_fullsized":"2024-03-09T15:06:51.352059+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:25.512736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":309,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'396","reported_seq":2038,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:08.369675+0000","last_change":"2024-03-09T14:28:55.578548+0000","last_active":"2024-03-09T15:06:08.369675+0000","last_peered":"2024-03-09T15:06:08.369675+0000","last_clean":"2024-03-09T15:06:08.369675+0000","last_became_active":"2024-03-09T14:28:55.577690+0000","last_became_peered":"2024-03-09T14:28:55.577690+0000","last_unstale":"2024-03-09T15:06:08.369675+0000","last_undegraded":"2024-03-09T15:06:08.369675+0000","last_fullsized":"2024-03-09T15:06:08.369675+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:48:46.933238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2493,"num_read_kb":2366,"num_write":474,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'277","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.608644+0000","last_change":"2024-03-09T14:28:53.631261+0000","last_active":"2024-03-09T15:07:04.608644+0000","last_peered":"2024-03-09T15:07:04.608644+0000","last_clean":"2024-03-09T15:07:04.608644+0000","last_became_active":"2024-03-09T14:28:53.627013+0000","last_became_peered":"2024-03-09T14:28:53.627013+0000","last_unstale":"2024-03-09T15:07:04.608644+0000","last_undegraded":"2024-03-09T15:07:04.608644+0000","last_fullsized":"2024-03-09T15:07:04.608644+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:05:48.407861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5645276,"num_objects":19,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":450,"num_read_kb":6489,"num_write":1106,"num_write_kb":11469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:45.040808+0000","last_change":"2024-03-09T14:28:57.614495+0000","last_active":"2024-03-09T15:02:45.040808+0000","last_peered":"2024-03-09T15:02:45.040808+0000","last_clean":"2024-03-09T15:02:45.040808+0000","last_became_active":"2024-03-09T14:28:57.614028+0000","last_became_peered":"2024-03-09T14:28:57.614028+0000","last_unstale":"2024-03-09T15:02:45.040808+0000","last_undegraded":"2024-03-09T15:02:45.040808+0000","last_fullsized":"2024-03-09T15:02:45.040808+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:12:00.953633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'260","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.705827+0000","last_change":"2024-03-09T14:28:59.613701+0000","last_active":"2024-03-09T15:07:03.705827+0000","last_peered":"2024-03-09T15:07:03.705827+0000","last_clean":"2024-03-09T15:07:03.705827+0000","last_became_active":"2024-03-09T14:28:59.613169+0000","last_became_peered":"2024-03-09T14:28:59.613169+0000","last_unstale":"2024-03-09T15:07:03.705827+0000","last_undegraded":"2024-03-09T15:07:03.705827+0000","last_fullsized":"2024-03-09T15:07:03.705827+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:29:04.658643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":434,"num_read_kb":985,"num_write":344,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'524","reported_seq":4073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.476180+0000","last_change":"2024-03-09T14:29:01.634092+0000","last_active":"2024-03-09T15:07:02.476180+0000","last_peered":"2024-03-09T15:07:02.476180+0000","last_clean":"2024-03-09T15:07:02.476180+0000","last_became_active":"2024-03-09T14:29:01.633363+0000","last_became_peered":"2024-03-09T14:29:01.633363+0000","last_unstale":"2024-03-09T15:07:02.476180+0000","last_undegraded":"2024-03-09T15:07:02.476180+0000","last_fullsized":"2024-03-09T15:07:02.476180+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":500,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:29.117930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'114","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:35.097974+0000","last_change":"2024-03-09T14:29:03.680649+0000","last_active":"2024-03-09T15:06:35.097974+0000","last_peered":"2024-03-09T15:06:35.097974+0000","last_clean":"2024-03-09T15:06:35.097974+0000","last_became_active":"2024-03-09T14:29:03.679941+0000","last_became_peered":"2024-03-09T14:29:03.679941+0000","last_unstale":"2024-03-09T15:06:35.097974+0000","last_undegraded":"2024-03-09T15:06:35.097974+0000","last_fullsized":"2024-03-09T15:06:35.097974+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:51:15.615789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1871,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":265,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'457","reported_seq":2150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.374575+0000","last_change":"2024-03-09T14:28:55.590773+0000","last_active":"2024-03-09T15:06:38.374575+0000","last_peered":"2024-03-09T15:06:38.374575+0000","last_clean":"2024-03-09T15:06:38.374575+0000","last_became_active":"2024-03-09T14:28:55.589982+0000","last_became_peered":"2024-03-09T14:28:55.589982+0000","last_unstale":"2024-03-09T15:06:38.374575+0000","last_undegraded":"2024-03-09T15:06:38.374575+0000","last_fullsized":"2024-03-09T15:06:38.374575+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:13:42.061416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2457,"num_read_kb":2347,"num_write":517,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'319","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.698296+0000","last_change":"2024-03-09T14:28:53.603618+0000","last_active":"2024-03-09T15:07:04.698296+0000","last_peered":"2024-03-09T15:07:04.698296+0000","last_clean":"2024-03-09T15:07:04.698296+0000","last_became_active":"2024-03-09T14:28:53.596847+0000","last_became_peered":"2024-03-09T14:28:53.596847+0000","last_unstale":"2024-03-09T15:07:04.698296+0000","last_undegraded":"2024-03-09T15:07:04.698296+0000","last_fullsized":"2024-03-09T15:07:04.698296+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:28:50.808652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243310,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":431,"num_read_kb":7047,"num_write":1150,"num_write_kb":21742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.022324+0000","last_change":"2024-03-09T14:28:57.619309+0000","last_active":"2024-03-09T15:07:02.022324+0000","last_peered":"2024-03-09T15:07:02.022324+0000","last_clean":"2024-03-09T15:07:02.022324+0000","last_became_active":"2024-03-09T14:28:57.618459+0000","last_became_peered":"2024-03-09T14:28:57.618459+0000","last_unstale":"2024-03-09T15:07:02.022324+0000","last_undegraded":"2024-03-09T15:07:02.022324+0000","last_fullsized":"2024-03-09T15:07:02.022324+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:07:02.519797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":640,"num_read_kb":640,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'56","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.953770+0000","last_change":"2024-03-09T14:28:59.635240+0000","last_active":"2024-03-09T15:04:59.953770+0000","last_peered":"2024-03-09T15:04:59.953770+0000","last_clean":"2024-03-09T15:04:59.953770+0000","last_became_active":"2024-03-09T14:28:59.634653+0000","last_became_peered":"2024-03-09T14:28:59.634653+0000","last_unstale":"2024-03-09T15:04:59.953770+0000","last_undegraded":"2024-03-09T15:04:59.953770+0000","last_fullsized":"2024-03-09T15:04:59.953770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:14:05.243868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'536","reported_seq":1985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.483082+0000","last_change":"2024-03-09T14:29:01.656750+0000","last_active":"2024-03-09T15:07:02.483082+0000","last_peered":"2024-03-09T15:07:02.483082+0000","last_clean":"2024-03-09T15:07:02.483082+0000","last_became_active":"2024-03-09T14:29:01.656177+0000","last_became_peered":"2024-03-09T14:29:01.656177+0000","last_unstale":"2024-03-09T15:07:02.483082+0000","last_undegraded":"2024-03-09T15:07:02.483082+0000","last_fullsized":"2024-03-09T15:07:02.483082+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":500,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:14:48.749660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'149","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.627725+0000","last_change":"2024-03-09T14:29:03.673147+0000","last_active":"2024-03-09T15:06:29.627725+0000","last_peered":"2024-03-09T15:06:29.627725+0000","last_clean":"2024-03-09T15:06:29.627725+0000","last_became_active":"2024-03-09T14:29:03.672416+0000","last_became_peered":"2024-03-09T14:29:03.672416+0000","last_unstale":"2024-03-09T15:06:29.627725+0000","last_undegraded":"2024-03-09T15:06:29.627725+0000","last_fullsized":"2024-03-09T15:06:29.627725+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:33.857671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":118,"num_read_kb":112,"num_write":348,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'860","reported_seq":2473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.908049+0000","last_change":"2024-03-09T14:28:55.584166+0000","last_active":"2024-03-09T15:06:39.908049+0000","last_peered":"2024-03-09T15:06:39.908049+0000","last_clean":"2024-03-09T15:06:39.908049+0000","last_became_active":"2024-03-09T14:28:55.583618+0000","last_became_peered":"2024-03-09T14:28:55.583618+0000","last_unstale":"2024-03-09T15:06:39.908049+0000","last_undegraded":"2024-03-09T15:06:39.908049+0000","last_fullsized":"2024-03-09T15:06:39.908049+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:38:20.845683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4083,"num_read_kb":3643,"num_write":1199,"num_write_kb":506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'306","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.962582+0000","last_change":"2024-03-09T14:28:53.568437+0000","last_active":"2024-03-09T15:07:04.962582+0000","last_peered":"2024-03-09T15:07:04.962582+0000","last_clean":"2024-03-09T15:07:04.962582+0000","last_became_active":"2024-03-09T14:28:53.568002+0000","last_became_peered":"2024-03-09T14:28:53.568002+0000","last_unstale":"2024-03-09T15:07:04.962582+0000","last_undegraded":"2024-03-09T15:07:04.962582+0000","last_fullsized":"2024-03-09T15:07:04.962582+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:23:32.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262279,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":632,"num_read_kb":26433,"num_write":1110,"num_write_kb":51619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:44.682741+0000","last_change":"2024-03-09T14:28:57.616235+0000","last_active":"2024-03-09T15:02:44.682741+0000","last_peered":"2024-03-09T15:02:44.682741+0000","last_clean":"2024-03-09T15:02:44.682741+0000","last_became_active":"2024-03-09T14:28:57.615518+0000","last_became_peered":"2024-03-09T14:28:57.615518+0000","last_unstale":"2024-03-09T15:02:44.682741+0000","last_undegraded":"2024-03-09T15:02:44.682741+0000","last_fullsized":"2024-03-09T15:02:44.682741+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:42:54.401600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'355","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.687122+0000","last_change":"2024-03-09T14:28:59.607936+0000","last_active":"2024-03-09T15:06:55.687122+0000","last_peered":"2024-03-09T15:06:55.687122+0000","last_clean":"2024-03-09T15:06:55.687122+0000","last_became_active":"2024-03-09T14:28:59.607095+0000","last_became_peered":"2024-03-09T14:28:59.607095+0000","last_unstale":"2024-03-09T15:06:55.687122+0000","last_undegraded":"2024-03-09T15:06:55.687122+0000","last_fullsized":"2024-03-09T15:06:55.687122+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:16:14.902005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59189,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1181,"num_read_kb":1706,"num_write":1722,"num_write_kb":1608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.682241+0000","last_change":"2024-03-09T14:29:01.650586+0000","last_active":"2024-03-09T15:02:49.682241+0000","last_peered":"2024-03-09T15:02:49.682241+0000","last_clean":"2024-03-09T15:02:49.682241+0000","last_became_active":"2024-03-09T14:29:01.649769+0000","last_became_peered":"2024-03-09T14:29:01.649769+0000","last_unstale":"2024-03-09T15:02:49.682241+0000","last_undegraded":"2024-03-09T15:02:49.682241+0000","last_fullsized":"2024-03-09T15:02:49.682241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:07:16.076604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'142","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:25.753617+0000","last_change":"2024-03-09T14:29:03.678921+0000","last_active":"2024-03-09T15:06:25.753617+0000","last_peered":"2024-03-09T15:06:25.753617+0000","last_clean":"2024-03-09T15:06:25.753617+0000","last_became_active":"2024-03-09T14:29:03.678140+0000","last_became_peered":"2024-03-09T14:29:03.678140+0000","last_unstale":"2024-03-09T15:06:25.753617+0000","last_undegraded":"2024-03-09T15:06:25.753617+0000","last_fullsized":"2024-03-09T15:06:25.753617+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:56:42.351083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":150,"num_write":332,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'1639","reported_seq":3308,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.109281+0000","last_change":"2024-03-09T14:28:55.597191+0000","last_active":"2024-03-09T15:06:27.109281+0000","last_peered":"2024-03-09T15:06:27.109281+0000","last_clean":"2024-03-09T15:06:27.109281+0000","last_became_active":"2024-03-09T14:28:55.596219+0000","last_became_peered":"2024-03-09T14:28:55.596219+0000","last_unstale":"2024-03-09T15:06:27.109281+0000","last_undegraded":"2024-03-09T15:06:27.109281+0000","last_fullsized":"2024-03-09T15:06:27.109281+0000","mapping_epoch":25,"log_start":"264'1600","ondisk_log_start":"264'1600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:18:39.978742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6749,"num_read_kb":5786,"num_write":2314,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.715671+0000","last_change":"2024-03-09T14:28:36.802806+0000","last_active":"2024-03-09T15:04:49.715671+0000","last_peered":"2024-03-09T15:04:49.715671+0000","last_clean":"2024-03-09T15:04:49.715671+0000","last_became_active":"2024-03-09T14:28:36.802270+0000","last_became_peered":"2024-03-09T14:28:36.802270+0000","last_unstale":"2024-03-09T15:04:49.715671+0000","last_undegraded":"2024-03-09T15:04:49.715671+0000","last_fullsized":"2024-03-09T15:04:49.715671+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:35.777784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:35.777784+0000","last_clean_scrub_stamp":"2024-03-09T14:28:35.777784+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:02:15.668382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.886372+0000","last_change":"2024-03-09T14:28:41.842055+0000","last_active":"2024-03-09T15:04:09.886372+0000","last_peered":"2024-03-09T15:04:09.886372+0000","last_clean":"2024-03-09T15:04:09.886372+0000","last_became_active":"2024-03-09T14:28:41.841153+0000","last_became_peered":"2024-03-09T14:28:41.841153+0000","last_unstale":"2024-03-09T15:04:09.886372+0000","last_undegraded":"2024-03-09T15:04:09.886372+0000","last_fullsized":"2024-03-09T15:04:09.886372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:49.085946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'331","reported_seq":974,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.912192+0000","last_change":"2024-03-09T14:28:53.623164+0000","last_active":"2024-03-09T15:07:04.912192+0000","last_peered":"2024-03-09T15:07:04.912192+0000","last_clean":"2024-03-09T15:07:04.912192+0000","last_became_active":"2024-03-09T14:28:53.622700+0000","last_became_peered":"2024-03-09T14:28:53.622700+0000","last_unstale":"2024-03-09T15:07:04.912192+0000","last_undegraded":"2024-03-09T15:07:04.912192+0000","last_fullsized":"2024-03-09T15:07:04.912192+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:03:47.434250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":176,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":540,"num_read_kb":30200,"num_write":1248,"num_write_kb":35948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.709259+0000","last_change":"2024-03-09T14:28:57.607452+0000","last_active":"2024-03-09T15:04:24.709259+0000","last_peered":"2024-03-09T15:04:24.709259+0000","last_clean":"2024-03-09T15:04:24.709259+0000","last_became_active":"2024-03-09T14:28:57.606611+0000","last_became_peered":"2024-03-09T14:28:57.606611+0000","last_unstale":"2024-03-09T15:04:24.709259+0000","last_undegraded":"2024-03-09T15:04:24.709259+0000","last_fullsized":"2024-03-09T15:04:24.709259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:02:18.757444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'685","reported_seq":1371,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.522717+0000","last_change":"2024-03-09T14:28:59.604427+0000","last_active":"2024-03-09T15:07:03.522717+0000","last_peered":"2024-03-09T15:07:03.522717+0000","last_clean":"2024-03-09T15:07:03.522717+0000","last_became_active":"2024-03-09T14:28:59.603722+0000","last_became_peered":"2024-03-09T14:28:59.603722+0000","last_unstale":"2024-03-09T15:07:03.522717+0000","last_undegraded":"2024-03-09T15:07:03.522717+0000","last_fullsized":"2024-03-09T15:07:03.522717+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":600,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:32:43.960476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161709,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1336,"num_read_kb":2851,"num_write":1266,"num_write_kb":1132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:44.703042+0000","last_change":"2024-03-09T14:29:01.648470+0000","last_active":"2024-03-09T15:03:44.703042+0000","last_peered":"2024-03-09T15:03:44.703042+0000","last_clean":"2024-03-09T15:03:44.703042+0000","last_became_active":"2024-03-09T14:29:01.647958+0000","last_became_peered":"2024-03-09T14:29:01.647958+0000","last_unstale":"2024-03-09T15:03:44.703042+0000","last_undegraded":"2024-03-09T15:03:44.703042+0000","last_fullsized":"2024-03-09T15:03:44.703042+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:52:09.215340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'226","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:22.522461+0000","last_change":"2024-03-09T14:29:03.681803+0000","last_active":"2024-03-09T15:06:22.522461+0000","last_peered":"2024-03-09T15:06:22.522461+0000","last_clean":"2024-03-09T15:06:22.522461+0000","last_became_active":"2024-03-09T14:29:03.680962+0000","last_became_peered":"2024-03-09T14:29:03.680962+0000","last_unstale":"2024-03-09T15:06:22.522461+0000","last_undegraded":"2024-03-09T15:06:22.522461+0000","last_fullsized":"2024-03-09T15:06:22.522461+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:28:12.130155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":425,"num_read_kb":422,"num_write":485,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'387","reported_seq":1944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.433238+0000","last_change":"2024-03-09T14:28:55.575679+0000","last_active":"2024-03-09T15:06:42.433238+0000","last_peered":"2024-03-09T15:06:42.433238+0000","last_clean":"2024-03-09T15:06:42.433238+0000","last_became_active":"2024-03-09T14:28:55.575229+0000","last_became_peered":"2024-03-09T14:28:55.575229+0000","last_unstale":"2024-03-09T15:06:42.433238+0000","last_undegraded":"2024-03-09T15:06:42.433238+0000","last_fullsized":"2024-03-09T15:06:42.433238+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:26:56.492010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2264,"num_read_kb":2158,"num_write":447,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:54.716837+0000","last_change":"2024-03-09T14:28:41.839813+0000","last_active":"2024-03-09T15:04:54.716837+0000","last_peered":"2024-03-09T15:04:54.716837+0000","last_clean":"2024-03-09T15:04:54.716837+0000","last_became_active":"2024-03-09T14:28:41.838669+0000","last_became_peered":"2024-03-09T14:28:41.838669+0000","last_unstale":"2024-03-09T15:04:54.716837+0000","last_undegraded":"2024-03-09T15:04:54.716837+0000","last_fullsized":"2024-03-09T15:04:54.716837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:52:50.503614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'287","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.625017+0000","last_change":"2024-03-09T14:28:53.587759+0000","last_active":"2024-03-09T15:07:04.625017+0000","last_peered":"2024-03-09T15:07:04.625017+0000","last_clean":"2024-03-09T15:07:04.625017+0000","last_became_active":"2024-03-09T14:28:53.587201+0000","last_became_peered":"2024-03-09T14:28:53.587201+0000","last_unstale":"2024-03-09T15:07:04.625017+0000","last_undegraded":"2024-03-09T15:07:04.625017+0000","last_fullsized":"2024-03-09T15:07:04.625017+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:37:04.349336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11539118,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":421,"num_read_kb":38281,"num_write":1103,"num_write_kb":47895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:39.879966+0000","last_change":"2024-03-09T14:28:57.613708+0000","last_active":"2024-03-09T15:03:39.879966+0000","last_peered":"2024-03-09T15:03:39.879966+0000","last_clean":"2024-03-09T15:03:39.879966+0000","last_became_active":"2024-03-09T14:28:57.612854+0000","last_became_peered":"2024-03-09T14:28:57.612854+0000","last_unstale":"2024-03-09T15:03:39.879966+0000","last_undegraded":"2024-03-09T15:03:39.879966+0000","last_fullsized":"2024-03-09T15:03:39.879966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:41:11.322298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1071","reported_seq":2379,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.973085+0000","last_change":"2024-03-09T14:28:59.601211+0000","last_active":"2024-03-09T15:07:04.973085+0000","last_peered":"2024-03-09T15:07:04.973085+0000","last_clean":"2024-03-09T15:07:04.973085+0000","last_became_active":"2024-03-09T14:28:59.599819+0000","last_became_peered":"2024-03-09T14:28:59.599819+0000","last_unstale":"2024-03-09T15:07:04.973085+0000","last_undegraded":"2024-03-09T15:07:04.973085+0000","last_fullsized":"2024-03-09T15:07:04.973085+0000","mapping_epoch":29,"log_start":"264'1000","ondisk_log_start":"264'1000","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":1000,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:21:21.381897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":136728,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1689,"num_read_kb":3246,"num_write":1044,"num_write_kb":893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:39.712987+0000","last_change":"2024-03-09T14:29:01.628141+0000","last_active":"2024-03-09T15:04:39.712987+0000","last_peered":"2024-03-09T15:04:39.712987+0000","last_clean":"2024-03-09T15:04:39.712987+0000","last_became_active":"2024-03-09T14:29:01.626582+0000","last_became_peered":"2024-03-09T14:29:01.626582+0000","last_unstale":"2024-03-09T15:04:39.712987+0000","last_undegraded":"2024-03-09T15:04:39.712987+0000","last_fullsized":"2024-03-09T15:04:39.712987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:05:36.345657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'109","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:31.614081+0000","last_change":"2024-03-09T14:29:03.660377+0000","last_active":"2024-03-09T15:06:31.614081+0000","last_peered":"2024-03-09T15:06:31.614081+0000","last_clean":"2024-03-09T15:06:31.614081+0000","last_became_active":"2024-03-09T14:29:03.659633+0000","last_became_peered":"2024-03-09T14:29:03.659633+0000","last_unstale":"2024-03-09T15:06:31.614081+0000","last_undegraded":"2024-03-09T15:06:31.614081+0000","last_fullsized":"2024-03-09T15:06:31.614081+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:02:02.969731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":112,"num_read_kb":106,"num_write":262,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'372","reported_seq":1937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.084567+0000","last_change":"2024-03-09T14:28:55.585014+0000","last_active":"2024-03-09T15:06:27.084567+0000","last_peered":"2024-03-09T15:06:27.084567+0000","last_clean":"2024-03-09T15:06:27.084567+0000","last_became_active":"2024-03-09T14:28:55.584347+0000","last_became_peered":"2024-03-09T14:28:55.584347+0000","last_unstale":"2024-03-09T15:06:27.084567+0000","last_undegraded":"2024-03-09T15:06:27.084567+0000","last_fullsized":"2024-03-09T15:06:27.084567+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:07.167466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2124,"num_read_kb":2043,"num_write":421,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.695024+0000","last_change":"2024-03-09T14:28:41.837266+0000","last_active":"2024-03-09T15:04:04.695024+0000","last_peered":"2024-03-09T15:04:04.695024+0000","last_clean":"2024-03-09T15:04:04.695024+0000","last_became_active":"2024-03-09T14:28:41.836544+0000","last_became_peered":"2024-03-09T14:28:41.836544+0000","last_unstale":"2024-03-09T15:04:04.695024+0000","last_undegraded":"2024-03-09T15:04:04.695024+0000","last_fullsized":"2024-03-09T15:04:04.695024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:40.144949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'323","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.086797+0000","last_change":"2024-03-09T14:28:53.626870+0000","last_active":"2024-03-09T15:07:05.086797+0000","last_peered":"2024-03-09T15:07:05.086797+0000","last_clean":"2024-03-09T15:07:05.086797+0000","last_became_active":"2024-03-09T14:28:53.626472+0000","last_became_peered":"2024-03-09T14:28:53.626472+0000","last_unstale":"2024-03-09T15:07:05.086797+0000","last_undegraded":"2024-03-09T15:07:05.086797+0000","last_fullsized":"2024-03-09T15:07:05.086797+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:28.665281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262302,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":544,"num_read_kb":1460,"num_write":1301,"num_write_kb":27243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:39.689548+0000","last_change":"2024-03-09T14:28:57.610715+0000","last_active":"2024-03-09T15:03:39.689548+0000","last_peered":"2024-03-09T15:03:39.689548+0000","last_clean":"2024-03-09T15:03:39.689548+0000","last_became_active":"2024-03-09T14:28:57.609908+0000","last_became_peered":"2024-03-09T14:28:57.609908+0000","last_unstale":"2024-03-09T15:03:39.689548+0000","last_undegraded":"2024-03-09T15:03:39.689548+0000","last_fullsized":"2024-03-09T15:03:39.689548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:42:15.361989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'225","reported_seq":1219,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.681224+0000","last_change":"2024-03-09T14:28:59.628581+0000","last_active":"2024-03-09T15:06:55.681224+0000","last_peered":"2024-03-09T15:06:55.681224+0000","last_clean":"2024-03-09T15:06:55.681224+0000","last_became_active":"2024-03-09T14:28:59.627810+0000","last_became_peered":"2024-03-09T14:28:59.627810+0000","last_unstale":"2024-03-09T15:06:55.681224+0000","last_undegraded":"2024-03-09T15:06:55.681224+0000","last_fullsized":"2024-03-09T15:06:55.681224+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:38:33.367082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":165,"num_read_kb":157,"num_write":151,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.714308+0000","last_change":"2024-03-09T14:29:01.647816+0000","last_active":"2024-03-09T15:04:29.714308+0000","last_peered":"2024-03-09T15:04:29.714308+0000","last_clean":"2024-03-09T15:04:29.714308+0000","last_became_active":"2024-03-09T14:29:01.647228+0000","last_became_peered":"2024-03-09T14:29:01.647228+0000","last_unstale":"2024-03-09T15:04:29.714308+0000","last_undegraded":"2024-03-09T15:04:29.714308+0000","last_fullsized":"2024-03-09T15:04:29.714308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:05:51.167608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'248","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:33.164698+0000","last_change":"2024-03-09T14:29:03.659156+0000","last_active":"2024-03-09T15:06:33.164698+0000","last_peered":"2024-03-09T15:06:33.164698+0000","last_clean":"2024-03-09T15:06:33.164698+0000","last_became_active":"2024-03-09T14:29:03.654872+0000","last_became_peered":"2024-03-09T14:29:03.654872+0000","last_unstale":"2024-03-09T15:06:33.164698+0000","last_undegraded":"2024-03-09T15:06:33.164698+0000","last_fullsized":"2024-03-09T15:06:33.164698+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:31:12.618967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":497,"num_write":533,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'463","reported_seq":2014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.372347+0000","last_change":"2024-03-09T14:28:55.578525+0000","last_active":"2024-03-09T15:06:38.372347+0000","last_peered":"2024-03-09T15:06:38.372347+0000","last_clean":"2024-03-09T15:06:38.372347+0000","last_became_active":"2024-03-09T14:28:55.577946+0000","last_became_peered":"2024-03-09T14:28:55.577946+0000","last_unstale":"2024-03-09T15:06:38.372347+0000","last_undegraded":"2024-03-09T15:06:38.372347+0000","last_fullsized":"2024-03-09T15:06:38.372347+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:44:39.146598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2440,"num_read_kb":2271,"num_write":585,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.886323+0000","last_change":"2024-03-09T14:28:41.843028+0000","last_active":"2024-03-09T15:04:09.886323+0000","last_peered":"2024-03-09T15:04:09.886323+0000","last_clean":"2024-03-09T15:04:09.886323+0000","last_became_active":"2024-03-09T14:28:41.842251+0000","last_became_peered":"2024-03-09T14:28:41.842251+0000","last_unstale":"2024-03-09T15:04:09.886323+0000","last_undegraded":"2024-03-09T15:04:09.886323+0000","last_fullsized":"2024-03-09T15:04:09.886323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:09:29.190170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'313","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.651914+0000","last_change":"2024-03-09T14:28:53.622441+0000","last_active":"2024-03-09T15:07:04.651914+0000","last_peered":"2024-03-09T15:07:04.651914+0000","last_clean":"2024-03-09T15:07:04.651914+0000","last_became_active":"2024-03-09T14:28:53.621914+0000","last_became_peered":"2024-03-09T14:28:53.621914+0000","last_unstale":"2024-03-09T15:07:04.651914+0000","last_undegraded":"2024-03-09T15:07:04.651914+0000","last_fullsized":"2024-03-09T15:07:04.651914+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:35.698441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7585770,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":520,"num_read_kb":22951,"num_write":1121,"num_write_kb":34708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.714348+0000","last_change":"2024-03-09T14:28:57.613906+0000","last_active":"2024-03-09T15:04:29.714348+0000","last_peered":"2024-03-09T15:04:29.714348+0000","last_clean":"2024-03-09T15:04:29.714348+0000","last_became_active":"2024-03-09T14:28:57.613407+0000","last_became_peered":"2024-03-09T14:28:57.613407+0000","last_unstale":"2024-03-09T15:04:29.714348+0000","last_undegraded":"2024-03-09T15:04:29.714348+0000","last_fullsized":"2024-03-09T15:04:29.714348+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:51:41.922830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'110","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:01.825035+0000","last_change":"2024-03-09T14:28:59.619709+0000","last_active":"2024-03-09T15:06:01.825035+0000","last_peered":"2024-03-09T15:06:01.825035+0000","last_clean":"2024-03-09T15:06:01.825035+0000","last_became_active":"2024-03-09T14:28:59.619291+0000","last_became_peered":"2024-03-09T14:28:59.619291+0000","last_unstale":"2024-03-09T15:06:01.825035+0000","last_undegraded":"2024-03-09T15:06:01.825035+0000","last_fullsized":"2024-03-09T15:06:01.825035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:25.604984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":110,"num_write":80,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:44.694699+0000","last_change":"2024-03-09T14:29:01.657586+0000","last_active":"2024-03-09T15:03:44.694699+0000","last_peered":"2024-03-09T15:03:44.694699+0000","last_clean":"2024-03-09T15:03:44.694699+0000","last_became_active":"2024-03-09T14:29:01.656672+0000","last_became_peered":"2024-03-09T14:29:01.656672+0000","last_unstale":"2024-03-09T15:03:44.694699+0000","last_undegraded":"2024-03-09T15:03:44.694699+0000","last_fullsized":"2024-03-09T15:03:44.694699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:15:26.411549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'104","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:31.620441+0000","last_change":"2024-03-09T14:29:03.673314+0000","last_active":"2024-03-09T15:06:31.620441+0000","last_peered":"2024-03-09T15:06:31.620441+0000","last_clean":"2024-03-09T15:06:31.620441+0000","last_became_active":"2024-03-09T14:29:03.672534+0000","last_became_peered":"2024-03-09T14:29:03.672534+0000","last_unstale":"2024-03-09T15:06:31.620441+0000","last_undegraded":"2024-03-09T15:06:31.620441+0000","last_fullsized":"2024-03-09T15:06:31.620441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:59:22.964887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":109,"num_write":236,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'463","reported_seq":2131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.144388+0000","last_change":"2024-03-09T14:28:55.584898+0000","last_active":"2024-03-09T15:06:36.144388+0000","last_peered":"2024-03-09T15:06:36.144388+0000","last_clean":"2024-03-09T15:06:36.144388+0000","last_became_active":"2024-03-09T14:28:55.583536+0000","last_became_peered":"2024-03-09T14:28:55.583536+0000","last_unstale":"2024-03-09T15:06:36.144388+0000","last_undegraded":"2024-03-09T15:06:36.144388+0000","last_fullsized":"2024-03-09T15:06:36.144388+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:58:23.929457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2714,"num_read_kb":2554,"num_write":561,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'347","reported_seq":975,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.915639+0000","last_change":"2024-03-09T14:28:53.629100+0000","last_active":"2024-03-09T15:07:04.915639+0000","last_peered":"2024-03-09T15:07:04.915639+0000","last_clean":"2024-03-09T15:07:04.915639+0000","last_became_active":"2024-03-09T14:28:53.626879+0000","last_became_peered":"2024-03-09T14:28:53.626879+0000","last_unstale":"2024-03-09T15:07:04.915639+0000","last_undegraded":"2024-03-09T15:07:04.915639+0000","last_fullsized":"2024-03-09T15:07:04.915639+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:04:10.643317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8554852,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":510,"num_read_kb":4755,"num_write":1349,"num_write_kb":47511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:10.059991+0000","last_change":"2024-03-09T14:28:42.127635+0000","last_active":"2024-03-09T15:04:10.059991+0000","last_peered":"2024-03-09T15:04:10.059991+0000","last_clean":"2024-03-09T15:04:10.059991+0000","last_became_active":"2024-03-09T14:28:42.126799+0000","last_became_peered":"2024-03-09T14:28:42.126799+0000","last_unstale":"2024-03-09T15:04:10.059991+0000","last_undegraded":"2024-03-09T15:04:10.059991+0000","last_fullsized":"2024-03-09T15:04:10.059991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:32.493854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.713156+0000","last_change":"2024-03-09T14:28:57.609247+0000","last_active":"2024-03-09T15:04:24.713156+0000","last_peered":"2024-03-09T15:04:24.713156+0000","last_clean":"2024-03-09T15:04:24.713156+0000","last_became_active":"2024-03-09T14:28:57.608723+0000","last_became_peered":"2024-03-09T14:28:57.608723+0000","last_unstale":"2024-03-09T15:04:24.713156+0000","last_undegraded":"2024-03-09T15:04:24.713156+0000","last_fullsized":"2024-03-09T15:04:24.713156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:02:45.228011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'526","reported_seq":1170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.631986+0000","last_change":"2024-03-09T14:28:59.625137+0000","last_active":"2024-03-09T15:07:03.631986+0000","last_peered":"2024-03-09T15:07:03.631986+0000","last_clean":"2024-03-09T15:07:03.631986+0000","last_became_active":"2024-03-09T14:28:59.624680+0000","last_became_peered":"2024-03-09T14:28:59.624680+0000","last_unstale":"2024-03-09T15:07:03.631986+0000","last_undegraded":"2024-03-09T15:07:03.631986+0000","last_fullsized":"2024-03-09T15:07:03.631986+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:47:11.075920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101647,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":939,"num_read_kb":2081,"num_write":778,"num_write_kb":632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.706169+0000","last_change":"2024-03-09T14:29:01.641583+0000","last_active":"2024-03-09T15:04:29.706169+0000","last_peered":"2024-03-09T15:04:29.706169+0000","last_clean":"2024-03-09T15:04:29.706169+0000","last_became_active":"2024-03-09T14:29:01.640485+0000","last_became_peered":"2024-03-09T14:29:01.640485+0000","last_unstale":"2024-03-09T15:04:29.706169+0000","last_undegraded":"2024-03-09T15:04:29.706169+0000","last_fullsized":"2024-03-09T15:04:29.706169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:42:25.734918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'141","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.924663+0000","last_change":"2024-03-09T14:29:03.676884+0000","last_active":"2024-03-09T15:06:41.924663+0000","last_peered":"2024-03-09T15:06:41.924663+0000","last_clean":"2024-03-09T15:06:41.924663+0000","last_became_active":"2024-03-09T14:29:03.676032+0000","last_became_peered":"2024-03-09T14:29:03.676032+0000","last_unstale":"2024-03-09T15:06:41.924663+0000","last_undegraded":"2024-03-09T15:06:41.924663+0000","last_fullsized":"2024-03-09T15:06:41.924663+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:51:57.095744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":195,"num_read_kb":176,"num_write":349,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'352","reported_seq":1744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.457643+0000","last_change":"2024-03-09T14:28:55.583629+0000","last_active":"2024-03-09T15:06:42.457643+0000","last_peered":"2024-03-09T15:06:42.457643+0000","last_clean":"2024-03-09T15:06:42.457643+0000","last_became_active":"2024-03-09T14:28:55.582743+0000","last_became_peered":"2024-03-09T14:28:55.582743+0000","last_unstale":"2024-03-09T15:06:42.457643+0000","last_undegraded":"2024-03-09T15:06:42.457643+0000","last_fullsized":"2024-03-09T15:06:42.457643+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:13.051466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1869,"num_read_kb":1781,"num_write":409,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'317","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.902455+0000","last_change":"2024-03-09T14:28:53.590149+0000","last_active":"2024-03-09T15:07:04.902455+0000","last_peered":"2024-03-09T15:07:04.902455+0000","last_clean":"2024-03-09T15:07:04.902455+0000","last_became_active":"2024-03-09T14:28:53.589640+0000","last_became_peered":"2024-03-09T14:28:53.589640+0000","last_unstale":"2024-03-09T15:07:04.902455+0000","last_undegraded":"2024-03-09T15:07:04.902455+0000","last_fullsized":"2024-03-09T15:07:04.902455+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:38:10.355714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049044,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":456,"num_read_kb":38844,"num_write":1119,"num_write_kb":48736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:19.707999+0000","last_change":"2024-03-09T14:28:42.127115+0000","last_active":"2024-03-09T15:04:19.707999+0000","last_peered":"2024-03-09T15:04:19.707999+0000","last_clean":"2024-03-09T15:04:19.707999+0000","last_became_active":"2024-03-09T14:28:42.126201+0000","last_became_peered":"2024-03-09T14:28:42.126201+0000","last_unstale":"2024-03-09T15:04:19.707999+0000","last_undegraded":"2024-03-09T15:04:19.707999+0000","last_fullsized":"2024-03-09T15:04:19.707999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:57.954868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.703353+0000","last_change":"2024-03-09T14:28:57.607498+0000","last_active":"2024-03-09T15:04:24.703353+0000","last_peered":"2024-03-09T15:04:24.703353+0000","last_clean":"2024-03-09T15:04:24.703353+0000","last_became_active":"2024-03-09T14:28:57.606429+0000","last_became_peered":"2024-03-09T14:28:57.606429+0000","last_unstale":"2024-03-09T15:04:24.703353+0000","last_undegraded":"2024-03-09T15:04:24.703353+0000","last_fullsized":"2024-03-09T15:04:24.703353+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:11:59.349598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'174","reported_seq":727,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.722805+0000","last_change":"2024-03-09T14:28:59.627298+0000","last_active":"2024-03-09T15:06:38.722805+0000","last_peered":"2024-03-09T15:06:38.722805+0000","last_clean":"2024-03-09T15:06:38.722805+0000","last_became_active":"2024-03-09T14:28:59.626697+0000","last_became_peered":"2024-03-09T14:28:59.626697+0000","last_unstale":"2024-03-09T15:06:38.722805+0000","last_undegraded":"2024-03-09T15:06:38.722805+0000","last_fullsized":"2024-03-09T15:06:38.722805+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:54:49.703899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":207,"num_read_kb":198,"num_write":186,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'563","reported_seq":2138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.717818+0000","last_change":"2024-03-09T14:29:01.637730+0000","last_active":"2024-03-09T15:07:04.717818+0000","last_peered":"2024-03-09T15:07:04.717818+0000","last_clean":"2024-03-09T15:07:04.717818+0000","last_became_active":"2024-03-09T14:29:01.636912+0000","last_became_peered":"2024-03-09T14:29:01.636912+0000","last_unstale":"2024-03-09T15:07:04.717818+0000","last_undegraded":"2024-03-09T15:07:04.717818+0000","last_fullsized":"2024-03-09T15:07:04.717818+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":500,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:03:38.907925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'95","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:28.252100+0000","last_change":"2024-03-09T14:29:03.665396+0000","last_active":"2024-03-09T15:06:28.252100+0000","last_peered":"2024-03-09T15:06:28.252100+0000","last_clean":"2024-03-09T15:06:28.252100+0000","last_became_active":"2024-03-09T14:29:03.664665+0000","last_became_peered":"2024-03-09T14:29:03.664665+0000","last_unstale":"2024-03-09T15:06:28.252100+0000","last_undegraded":"2024-03-09T15:06:28.252100+0000","last_fullsized":"2024-03-09T15:06:28.252100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:09:45.489579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":223,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'343","reported_seq":1825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.542652+0000","last_change":"2024-03-09T14:28:55.603920+0000","last_active":"2024-03-09T15:06:32.542652+0000","last_peered":"2024-03-09T15:06:32.542652+0000","last_clean":"2024-03-09T15:06:32.542652+0000","last_became_active":"2024-03-09T14:28:55.601355+0000","last_became_peered":"2024-03-09T14:28:55.601355+0000","last_unstale":"2024-03-09T15:06:32.542652+0000","last_undegraded":"2024-03-09T15:06:32.542652+0000","last_fullsized":"2024-03-09T15:06:32.542652+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:34.833891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1977,"num_read_kb":1906,"num_write":384,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'318","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.902300+0000","last_change":"2024-03-09T14:28:53.585247+0000","last_active":"2024-03-09T15:07:04.902300+0000","last_peered":"2024-03-09T15:07:04.902300+0000","last_clean":"2024-03-09T15:07:04.902300+0000","last_became_active":"2024-03-09T14:28:53.584728+0000","last_became_peered":"2024-03-09T14:28:53.584728+0000","last_unstale":"2024-03-09T15:07:04.902300+0000","last_undegraded":"2024-03-09T15:07:04.902300+0000","last_fullsized":"2024-03-09T15:07:04.902300+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:55.413559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918185,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":502,"num_read_kb":33595,"num_write":1164,"num_write_kb":22083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:20.049118+0000","last_change":"2024-03-09T14:28:41.840785+0000","last_active":"2024-03-09T15:03:20.049118+0000","last_peered":"2024-03-09T15:03:20.049118+0000","last_clean":"2024-03-09T15:03:20.049118+0000","last_became_active":"2024-03-09T14:28:41.840168+0000","last_became_peered":"2024-03-09T14:28:41.840168+0000","last_unstale":"2024-03-09T15:03:20.049118+0000","last_undegraded":"2024-03-09T15:03:20.049118+0000","last_fullsized":"2024-03-09T15:03:20.049118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:34:15.498376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"35'5","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.007346+0000","last_change":"2024-03-09T14:28:57.613265+0000","last_active":"2024-03-09T15:07:02.007346+0000","last_peered":"2024-03-09T15:07:02.007346+0000","last_clean":"2024-03-09T15:07:02.007346+0000","last_became_active":"2024-03-09T14:28:57.610373+0000","last_became_peered":"2024-03-09T14:28:57.610373+0000","last_unstale":"2024-03-09T15:07:02.007346+0000","last_undegraded":"2024-03-09T15:07:02.007346+0000","last_fullsized":"2024-03-09T15:07:02.007346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:29.212547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":492,"num_read_kb":799,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'102","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:04.229619+0000","last_change":"2024-03-09T14:28:59.616174+0000","last_active":"2024-03-09T15:06:04.229619+0000","last_peered":"2024-03-09T15:06:04.229619+0000","last_clean":"2024-03-09T15:06:04.229619+0000","last_became_active":"2024-03-09T14:28:59.615084+0000","last_became_peered":"2024-03-09T14:28:59.615084+0000","last_unstale":"2024-03-09T15:06:04.229619+0000","last_undegraded":"2024-03-09T15:06:04.229619+0000","last_fullsized":"2024-03-09T15:06:04.229619+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:06:53.932808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":100,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'582","reported_seq":2173,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.484960+0000","last_change":"2024-03-09T14:29:01.631333+0000","last_active":"2024-03-09T15:07:02.484960+0000","last_peered":"2024-03-09T15:07:02.484960+0000","last_clean":"2024-03-09T15:07:02.484960+0000","last_became_active":"2024-03-09T14:29:01.630598+0000","last_became_peered":"2024-03-09T14:29:01.630598+0000","last_unstale":"2024-03-09T15:07:02.484960+0000","last_undegraded":"2024-03-09T15:07:02.484960+0000","last_fullsized":"2024-03-09T15:07:02.484960+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":500,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:04:45.034915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'228","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:28.905578+0000","last_change":"2024-03-09T14:29:03.684917+0000","last_active":"2024-03-09T15:06:28.905578+0000","last_peered":"2024-03-09T15:06:28.905578+0000","last_clean":"2024-03-09T15:06:28.905578+0000","last_became_active":"2024-03-09T14:29:03.684294+0000","last_became_peered":"2024-03-09T14:29:03.684294+0000","last_unstale":"2024-03-09T15:06:28.905578+0000","last_undegraded":"2024-03-09T15:06:28.905578+0000","last_fullsized":"2024-03-09T15:06:28.905578+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:49:59.049525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":199,"num_write":480,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'364","reported_seq":2033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.910397+0000","last_change":"2024-03-09T14:28:55.569425+0000","last_active":"2024-03-09T15:06:39.910397+0000","last_peered":"2024-03-09T15:06:39.910397+0000","last_clean":"2024-03-09T15:06:39.910397+0000","last_became_active":"2024-03-09T14:28:55.568430+0000","last_became_peered":"2024-03-09T14:28:55.568430+0000","last_unstale":"2024-03-09T15:06:39.910397+0000","last_undegraded":"2024-03-09T15:06:39.910397+0000","last_fullsized":"2024-03-09T15:06:39.910397+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:22:01.506801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2357,"num_read_kb":2282,"num_write":412,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'353","reported_seq":980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.699547+0000","last_change":"2024-03-09T14:28:53.589944+0000","last_active":"2024-03-09T15:07:04.699547+0000","last_peered":"2024-03-09T15:07:04.699547+0000","last_clean":"2024-03-09T15:07:04.699547+0000","last_became_active":"2024-03-09T14:28:53.589491+0000","last_became_peered":"2024-03-09T14:28:53.589491+0000","last_unstale":"2024-03-09T15:07:04.699547+0000","last_undegraded":"2024-03-09T15:07:04.699547+0000","last_fullsized":"2024-03-09T15:07:04.699547+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:10.418545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17646996,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":459,"num_read_kb":37358,"num_write":1224,"num_write_kb":47489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.690049+0000","last_change":"2024-03-09T14:28:41.841410+0000","last_active":"2024-03-09T15:03:24.690049+0000","last_peered":"2024-03-09T15:03:24.690049+0000","last_clean":"2024-03-09T15:03:24.690049+0000","last_became_active":"2024-03-09T14:28:41.840575+0000","last_became_peered":"2024-03-09T14:28:41.840575+0000","last_unstale":"2024-03-09T15:03:24.690049+0000","last_undegraded":"2024-03-09T15:03:24.690049+0000","last_fullsized":"2024-03-09T15:03:24.690049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:57.501425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"35'3","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.461344+0000","last_change":"2024-03-09T14:28:57.605420+0000","last_active":"2024-03-09T15:07:02.461344+0000","last_peered":"2024-03-09T15:07:02.461344+0000","last_clean":"2024-03-09T15:07:02.461344+0000","last_became_active":"2024-03-09T14:28:57.604511+0000","last_became_peered":"2024-03-09T14:28:57.604511+0000","last_unstale":"2024-03-09T15:07:02.461344+0000","last_undegraded":"2024-03-09T15:07:02.461344+0000","last_fullsized":"2024-03-09T15:07:02.461344+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:27:24.834782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":488,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'678","reported_seq":1381,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.660675+0000","last_change":"2024-03-09T14:28:59.630805+0000","last_active":"2024-03-09T15:07:04.660675+0000","last_peered":"2024-03-09T15:07:04.660675+0000","last_clean":"2024-03-09T15:07:04.660675+0000","last_became_active":"2024-03-09T14:28:59.630044+0000","last_became_peered":"2024-03-09T14:28:59.630044+0000","last_unstale":"2024-03-09T15:07:04.660675+0000","last_undegraded":"2024-03-09T15:07:04.660675+0000","last_fullsized":"2024-03-09T15:07:04.660675+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:29:17.068940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":144882,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1208,"num_read_kb":2774,"num_write":982,"num_write_kb":820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.946142+0000","last_change":"2024-03-09T14:29:01.639091+0000","last_active":"2024-03-09T15:04:29.946142+0000","last_peered":"2024-03-09T15:04:29.946142+0000","last_clean":"2024-03-09T15:04:29.946142+0000","last_became_active":"2024-03-09T14:29:01.638590+0000","last_became_peered":"2024-03-09T14:29:01.638590+0000","last_unstale":"2024-03-09T15:04:29.946142+0000","last_undegraded":"2024-03-09T15:04:29.946142+0000","last_fullsized":"2024-03-09T15:04:29.946142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:05:05.637460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'122","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:16.433331+0000","last_change":"2024-03-09T14:29:03.671961+0000","last_active":"2024-03-09T15:05:16.433331+0000","last_peered":"2024-03-09T15:05:16.433331+0000","last_clean":"2024-03-09T15:05:16.433331+0000","last_became_active":"2024-03-09T14:29:03.671138+0000","last_became_peered":"2024-03-09T14:29:03.671138+0000","last_unstale":"2024-03-09T15:05:16.433331+0000","last_undegraded":"2024-03-09T15:05:16.433331+0000","last_fullsized":"2024-03-09T15:05:16.433331+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:11.482213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":309,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'132","reported_seq":679,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:06.018193+0000","last_change":"2024-03-09T14:29:03.682511+0000","last_active":"2024-03-09T15:06:06.018193+0000","last_peered":"2024-03-09T15:06:06.018193+0000","last_clean":"2024-03-09T15:06:06.018193+0000","last_became_active":"2024-03-09T14:29:03.681920+0000","last_became_peered":"2024-03-09T14:29:03.681920+0000","last_unstale":"2024-03-09T15:06:06.018193+0000","last_undegraded":"2024-03-09T15:06:06.018193+0000","last_fullsized":"2024-03-09T15:06:06.018193+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:28:46.108899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":222,"num_write":331,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'713","reported_seq":2210,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.478578+0000","last_change":"2024-03-09T14:28:55.590020+0000","last_active":"2024-03-09T15:06:53.478578+0000","last_peered":"2024-03-09T15:06:53.478578+0000","last_clean":"2024-03-09T15:06:53.478578+0000","last_became_active":"2024-03-09T14:28:55.589278+0000","last_became_peered":"2024-03-09T14:28:55.589278+0000","last_unstale":"2024-03-09T15:06:53.478578+0000","last_undegraded":"2024-03-09T15:06:53.478578+0000","last_fullsized":"2024-03-09T15:06:53.478578+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":700,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:16:27.469317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3302,"num_read_kb":2973,"num_write":944,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'301","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.709386+0000","last_change":"2024-03-09T14:28:53.624761+0000","last_active":"2024-03-09T15:07:04.709386+0000","last_peered":"2024-03-09T15:07:04.709386+0000","last_clean":"2024-03-09T15:07:04.709386+0000","last_became_active":"2024-03-09T14:28:53.624231+0000","last_became_peered":"2024-03-09T14:28:53.624231+0000","last_unstale":"2024-03-09T15:07:04.709386+0000","last_undegraded":"2024-03-09T15:07:04.709386+0000","last_fullsized":"2024-03-09T15:07:04.709386+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:01:48.466150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10692168,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":521,"num_read_kb":58598,"num_write":1147,"num_write_kb":63743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:00.057746+0000","last_change":"2024-03-09T14:28:57.616817+0000","last_active":"2024-03-09T15:04:00.057746+0000","last_peered":"2024-03-09T15:04:00.057746+0000","last_clean":"2024-03-09T15:04:00.057746+0000","last_became_active":"2024-03-09T14:28:57.616045+0000","last_became_peered":"2024-03-09T14:28:57.616045+0000","last_unstale":"2024-03-09T15:04:00.057746+0000","last_undegraded":"2024-03-09T15:04:00.057746+0000","last_fullsized":"2024-03-09T15:04:00.057746+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:40:21.513986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'251","reported_seq":813,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.836638+0000","last_change":"2024-03-09T14:28:59.615640+0000","last_active":"2024-03-09T15:07:02.836638+0000","last_peered":"2024-03-09T15:07:02.836638+0000","last_clean":"2024-03-09T15:07:02.836638+0000","last_became_active":"2024-03-09T14:28:59.615265+0000","last_became_peered":"2024-03-09T14:28:59.615265+0000","last_unstale":"2024-03-09T15:07:02.836638+0000","last_undegraded":"2024-03-09T15:07:02.836638+0000","last_fullsized":"2024-03-09T15:07:02.836638+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:29:10.543045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41654,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":398,"num_read_kb":895,"num_write":318,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.938921+0000","last_change":"2024-03-09T14:29:01.630945+0000","last_active":"2024-03-09T15:04:04.938921+0000","last_peered":"2024-03-09T15:04:04.938921+0000","last_clean":"2024-03-09T15:04:04.938921+0000","last_became_active":"2024-03-09T14:29:01.630021+0000","last_became_peered":"2024-03-09T14:29:01.630021+0000","last_unstale":"2024-03-09T15:04:04.938921+0000","last_undegraded":"2024-03-09T15:04:04.938921+0000","last_fullsized":"2024-03-09T15:04:04.938921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:51.210479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'124","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.163225+0000","last_change":"2024-03-09T14:29:03.661082+0000","last_active":"2024-03-09T15:06:36.163225+0000","last_peered":"2024-03-09T15:06:36.163225+0000","last_clean":"2024-03-09T15:06:36.163225+0000","last_became_active":"2024-03-09T14:29:03.660356+0000","last_became_peered":"2024-03-09T14:29:03.660356+0000","last_unstale":"2024-03-09T15:06:36.163225+0000","last_undegraded":"2024-03-09T15:06:36.163225+0000","last_fullsized":"2024-03-09T15:06:36.163225+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:48:43.599086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'835","reported_seq":2443,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.381007+0000","last_change":"2024-03-09T14:28:55.592219+0000","last_active":"2024-03-09T15:06:38.381007+0000","last_peered":"2024-03-09T15:06:38.381007+0000","last_clean":"2024-03-09T15:06:38.381007+0000","last_became_active":"2024-03-09T14:28:55.591498+0000","last_became_peered":"2024-03-09T14:28:55.591498+0000","last_unstale":"2024-03-09T15:06:38.381007+0000","last_undegraded":"2024-03-09T15:06:38.381007+0000","last_fullsized":"2024-03-09T15:06:38.381007+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:10:05.911916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3847,"num_read_kb":3445,"num_write":1140,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'300","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.666868+0000","last_change":"2024-03-09T14:29:28.731900+0000","last_active":"2024-03-09T15:07:04.666868+0000","last_peered":"2024-03-09T15:07:04.666868+0000","last_clean":"2024-03-09T15:07:04.666868+0000","last_became_active":"2024-03-09T14:29:28.729906+0000","last_became_peered":"2024-03-09T14:29:28.729906+0000","last_unstale":"2024-03-09T15:07:04.666868+0000","last_undegraded":"2024-03-09T15:07:04.666868+0000","last_fullsized":"2024-03-09T15:07:04.666868+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:32:05.771889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":649620,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":465,"num_read_kb":3449,"num_write":1246,"num_write_kb":20441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,4],"acting":[2,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.937932+0000","last_change":"2024-03-09T14:28:57.609587+0000","last_active":"2024-03-09T15:03:59.937932+0000","last_peered":"2024-03-09T15:03:59.937932+0000","last_clean":"2024-03-09T15:03:59.937932+0000","last_became_active":"2024-03-09T14:28:57.608697+0000","last_became_peered":"2024-03-09T14:28:57.608697+0000","last_unstale":"2024-03-09T15:03:59.937932+0000","last_undegraded":"2024-03-09T15:03:59.937932+0000","last_fullsized":"2024-03-09T15:03:59.937932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:57.108279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'48","reported_seq":541,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:19.740738+0000","last_change":"2024-03-09T14:28:59.621455+0000","last_active":"2024-03-09T15:06:19.740738+0000","last_peered":"2024-03-09T15:06:19.740738+0000","last_clean":"2024-03-09T15:06:19.740738+0000","last_became_active":"2024-03-09T14:28:59.620907+0000","last_became_peered":"2024-03-09T14:28:59.620907+0000","last_unstale":"2024-03-09T15:06:19.740738+0000","last_undegraded":"2024-03-09T15:06:19.740738+0000","last_fullsized":"2024-03-09T15:06:19.740738+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:04:27.968876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.704294+0000","last_change":"2024-03-09T14:29:01.651271+0000","last_active":"2024-03-09T15:04:04.704294+0000","last_peered":"2024-03-09T15:04:04.704294+0000","last_clean":"2024-03-09T15:04:04.704294+0000","last_became_active":"2024-03-09T14:29:01.650734+0000","last_became_peered":"2024-03-09T14:29:01.650734+0000","last_unstale":"2024-03-09T15:04:04.704294+0000","last_undegraded":"2024-03-09T15:04:04.704294+0000","last_fullsized":"2024-03-09T15:04:04.704294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:42:30.232634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'222","reported_seq":778,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:06.013623+0000","last_change":"2024-03-09T14:29:03.687235+0000","last_active":"2024-03-09T15:06:06.013623+0000","last_peered":"2024-03-09T15:06:06.013623+0000","last_clean":"2024-03-09T15:06:06.013623+0000","last_became_active":"2024-03-09T14:29:03.686455+0000","last_became_peered":"2024-03-09T14:29:03.686455+0000","last_unstale":"2024-03-09T15:06:06.013623+0000","last_undegraded":"2024-03-09T15:06:06.013623+0000","last_fullsized":"2024-03-09T15:06:06.013623+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:01:35.182146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":435,"num_write":508,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'405","reported_seq":1934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:21.863481+0000","last_change":"2024-03-09T14:28:55.591974+0000","last_active":"2024-03-09T15:06:21.863481+0000","last_peered":"2024-03-09T15:06:21.863481+0000","last_clean":"2024-03-09T15:06:21.863481+0000","last_became_active":"2024-03-09T14:28:55.591649+0000","last_became_peered":"2024-03-09T14:28:55.591649+0000","last_unstale":"2024-03-09T15:06:21.863481+0000","last_undegraded":"2024-03-09T15:06:21.863481+0000","last_fullsized":"2024-03-09T15:06:21.863481+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:01:16.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2197,"num_read_kb":2083,"num_write":469,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'278","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.902100+0000","last_change":"2024-03-09T14:28:53.600254+0000","last_active":"2024-03-09T15:07:04.902100+0000","last_peered":"2024-03-09T15:07:04.902100+0000","last_clean":"2024-03-09T15:07:04.902100+0000","last_became_active":"2024-03-09T14:28:53.598990+0000","last_became_peered":"2024-03-09T14:28:53.598990+0000","last_unstale":"2024-03-09T15:07:04.902100+0000","last_undegraded":"2024-03-09T15:07:04.902100+0000","last_fullsized":"2024-03-09T15:07:04.902100+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:19:25.865137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245675,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":357,"num_read_kb":35561,"num_write":1010,"num_write_kb":44906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.702952+0000","last_change":"2024-03-09T14:28:57.615933+0000","last_active":"2024-03-09T15:03:59.702952+0000","last_peered":"2024-03-09T15:03:59.702952+0000","last_clean":"2024-03-09T15:03:59.702952+0000","last_became_active":"2024-03-09T14:28:57.615229+0000","last_became_peered":"2024-03-09T14:28:57.615229+0000","last_unstale":"2024-03-09T15:03:59.702952+0000","last_undegraded":"2024-03-09T15:03:59.702952+0000","last_fullsized":"2024-03-09T15:03:59.702952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:53:06.887398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'270","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.728834+0000","last_change":"2024-03-09T14:28:59.617614+0000","last_active":"2024-03-09T15:07:04.728834+0000","last_peered":"2024-03-09T15:07:04.728834+0000","last_clean":"2024-03-09T15:07:04.728834+0000","last_became_active":"2024-03-09T14:28:59.615881+0000","last_became_peered":"2024-03-09T14:28:59.615881+0000","last_unstale":"2024-03-09T15:07:04.728834+0000","last_undegraded":"2024-03-09T15:07:04.728834+0000","last_fullsized":"2024-03-09T15:07:04.728834+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:14.844823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48426,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":988,"num_write":356,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.699216+0000","last_change":"2024-03-09T14:29:01.657350+0000","last_active":"2024-03-09T15:04:04.699216+0000","last_peered":"2024-03-09T15:04:04.699216+0000","last_clean":"2024-03-09T15:04:04.699216+0000","last_became_active":"2024-03-09T14:29:01.656740+0000","last_became_peered":"2024-03-09T14:29:01.656740+0000","last_unstale":"2024-03-09T15:04:04.699216+0000","last_undegraded":"2024-03-09T15:04:04.699216+0000","last_fullsized":"2024-03-09T15:04:04.699216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:51.984064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'189","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:40.560043+0000","last_change":"2024-03-09T14:29:03.674368+0000","last_active":"2024-03-09T15:06:40.560043+0000","last_peered":"2024-03-09T15:06:40.560043+0000","last_clean":"2024-03-09T15:06:40.560043+0000","last_became_active":"2024-03-09T14:29:03.671571+0000","last_became_peered":"2024-03-09T14:29:03.671571+0000","last_unstale":"2024-03-09T15:06:40.560043+0000","last_undegraded":"2024-03-09T15:06:40.560043+0000","last_fullsized":"2024-03-09T15:06:40.560043+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:55:55.769903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":257,"num_read_kb":221,"num_write":372,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'1158","reported_seq":2774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.374429+0000","last_change":"2024-03-09T14:28:55.596769+0000","last_active":"2024-03-09T15:06:38.374429+0000","last_peered":"2024-03-09T15:06:38.374429+0000","last_clean":"2024-03-09T15:06:38.374429+0000","last_became_active":"2024-03-09T14:28:55.592387+0000","last_became_peered":"2024-03-09T14:28:55.592387+0000","last_unstale":"2024-03-09T15:06:38.374429+0000","last_undegraded":"2024-03-09T15:06:38.374429+0000","last_fullsized":"2024-03-09T15:06:38.374429+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":1100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:32:02.543520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4979,"num_read_kb":4357,"num_write":1600,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'303","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.740153+0000","last_change":"2024-03-09T14:28:53.627197+0000","last_active":"2024-03-09T15:07:04.740153+0000","last_peered":"2024-03-09T15:07:04.740153+0000","last_clean":"2024-03-09T15:07:04.740153+0000","last_became_active":"2024-03-09T14:28:53.626736+0000","last_became_peered":"2024-03-09T14:28:53.626736+0000","last_unstale":"2024-03-09T15:07:04.740153+0000","last_undegraded":"2024-03-09T15:07:04.740153+0000","last_fullsized":"2024-03-09T15:07:04.740153+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:05:23.421912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1696239,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":471,"num_read_kb":7830,"num_write":1201,"num_write_kb":47405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.698154+0000","last_change":"2024-03-09T14:28:57.614929+0000","last_active":"2024-03-09T15:03:59.698154+0000","last_peered":"2024-03-09T15:03:59.698154+0000","last_clean":"2024-03-09T15:03:59.698154+0000","last_became_active":"2024-03-09T14:28:57.613999+0000","last_became_peered":"2024-03-09T14:28:57.613999+0000","last_unstale":"2024-03-09T15:03:59.698154+0000","last_undegraded":"2024-03-09T15:03:59.698154+0000","last_fullsized":"2024-03-09T15:03:59.698154+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:36:44.418823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'255","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.517558+0000","last_change":"2024-03-09T14:28:59.615487+0000","last_active":"2024-03-09T15:07:04.517558+0000","last_peered":"2024-03-09T15:07:04.517558+0000","last_clean":"2024-03-09T15:07:04.517558+0000","last_became_active":"2024-03-09T14:28:59.614754+0000","last_became_peered":"2024-03-09T14:28:59.614754+0000","last_unstale":"2024-03-09T15:07:04.517558+0000","last_undegraded":"2024-03-09T15:07:04.517558+0000","last_fullsized":"2024-03-09T15:07:04.517558+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:55:46.151434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43227,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":1017,"num_write":350,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.708050+0000","last_change":"2024-03-09T14:29:01.648210+0000","last_active":"2024-03-09T15:04:04.708050+0000","last_peered":"2024-03-09T15:04:04.708050+0000","last_clean":"2024-03-09T15:04:04.708050+0000","last_became_active":"2024-03-09T14:29:01.647570+0000","last_became_peered":"2024-03-09T14:29:01.647570+0000","last_unstale":"2024-03-09T15:04:04.708050+0000","last_undegraded":"2024-03-09T15:04:04.708050+0000","last_fullsized":"2024-03-09T15:04:04.708050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:32:26.862326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'814","reported_seq":2349,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:30.930229+0000","last_change":"2024-03-09T14:28:55.600454+0000","last_active":"2024-03-09T15:06:30.930229+0000","last_peered":"2024-03-09T15:06:30.930229+0000","last_clean":"2024-03-09T15:06:30.930229+0000","last_became_active":"2024-03-09T14:28:55.599825+0000","last_became_peered":"2024-03-09T14:28:55.599825+0000","last_unstale":"2024-03-09T15:06:30.930229+0000","last_undegraded":"2024-03-09T15:06:30.930229+0000","last_fullsized":"2024-03-09T15:06:30.930229+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:16:30.042238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3687,"num_read_kb":3276,"num_write":1113,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'276","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.886314+0000","last_change":"2024-03-09T14:28:53.565880+0000","last_active":"2024-03-09T15:07:04.886314+0000","last_peered":"2024-03-09T15:07:04.886314+0000","last_clean":"2024-03-09T15:07:04.886314+0000","last_became_active":"2024-03-09T14:28:53.565431+0000","last_became_peered":"2024-03-09T14:28:53.565431+0000","last_unstale":"2024-03-09T15:07:04.886314+0000","last_undegraded":"2024-03-09T15:07:04.886314+0000","last_fullsized":"2024-03-09T15:07:04.886314+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:17:59.099392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656008,"num_objects":18,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":367,"num_read_kb":7267,"num_write":958,"num_write_kb":31379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:04.723350+0000","last_change":"2024-03-09T14:28:57.611182+0000","last_active":"2024-03-09T15:05:04.723350+0000","last_peered":"2024-03-09T15:05:04.723350+0000","last_clean":"2024-03-09T15:05:04.723350+0000","last_became_active":"2024-03-09T14:28:57.610126+0000","last_became_peered":"2024-03-09T14:28:57.610126+0000","last_unstale":"2024-03-09T15:05:04.723350+0000","last_undegraded":"2024-03-09T15:05:04.723350+0000","last_fullsized":"2024-03-09T15:05:04.723350+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:16:33.837545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'474","reported_seq":1100,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.438153+0000","last_change":"2024-03-09T14:28:59.614860+0000","last_active":"2024-03-09T15:07:04.438153+0000","last_peered":"2024-03-09T15:07:04.438153+0000","last_clean":"2024-03-09T15:07:04.438153+0000","last_became_active":"2024-03-09T14:28:59.614069+0000","last_became_peered":"2024-03-09T14:28:59.614069+0000","last_unstale":"2024-03-09T15:07:04.438153+0000","last_undegraded":"2024-03-09T15:07:04.438153+0000","last_fullsized":"2024-03-09T15:07:04.438153+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:31:13.778160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88057,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":2100,"num_write":750,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.885313+0000","last_change":"2024-03-09T14:29:01.640843+0000","last_active":"2024-03-09T15:04:04.885313+0000","last_peered":"2024-03-09T15:04:04.885313+0000","last_clean":"2024-03-09T15:04:04.885313+0000","last_became_active":"2024-03-09T14:29:01.639825+0000","last_became_peered":"2024-03-09T14:29:01.639825+0000","last_unstale":"2024-03-09T15:04:04.885313+0000","last_undegraded":"2024-03-09T15:04:04.885313+0000","last_fullsized":"2024-03-09T15:04:04.885313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:39:04.267480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'149","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.868628+0000","last_change":"2024-03-09T14:29:03.667287+0000","last_active":"2024-03-09T15:06:36.868628+0000","last_peered":"2024-03-09T15:06:36.868628+0000","last_clean":"2024-03-09T15:06:36.868628+0000","last_became_active":"2024-03-09T14:29:03.666515+0000","last_became_peered":"2024-03-09T14:29:03.666515+0000","last_unstale":"2024-03-09T15:06:36.868628+0000","last_undegraded":"2024-03-09T15:06:36.868628+0000","last_fullsized":"2024-03-09T15:06:36.868628+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:42.886520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":181,"num_write":332,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'874","reported_seq":2620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.307400+0000","last_change":"2024-03-09T14:28:55.586646+0000","last_active":"2024-03-09T15:06:41.307400+0000","last_peered":"2024-03-09T15:06:41.307400+0000","last_clean":"2024-03-09T15:06:41.307400+0000","last_became_active":"2024-03-09T14:28:55.586247+0000","last_became_peered":"2024-03-09T14:28:55.586247+0000","last_unstale":"2024-03-09T15:06:41.307400+0000","last_undegraded":"2024-03-09T15:06:41.307400+0000","last_fullsized":"2024-03-09T15:06:41.307400+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:51.468365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4288,"num_read_kb":3851,"num_write":1208,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'307","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.086705+0000","last_change":"2024-03-09T14:28:53.618203+0000","last_active":"2024-03-09T15:07:05.086705+0000","last_peered":"2024-03-09T15:07:05.086705+0000","last_clean":"2024-03-09T15:07:05.086705+0000","last_became_active":"2024-03-09T14:28:53.617832+0000","last_became_peered":"2024-03-09T14:28:53.617832+0000","last_unstale":"2024-03-09T15:07:05.086705+0000","last_undegraded":"2024-03-09T15:07:05.086705+0000","last_fullsized":"2024-03-09T15:07:05.086705+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:04:16.779631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22926,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":436,"num_read_kb":36524,"num_write":1097,"num_write_kb":22031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.703460+0000","last_change":"2024-03-09T14:28:57.616765+0000","last_active":"2024-03-09T15:04:24.703460+0000","last_peered":"2024-03-09T15:04:24.703460+0000","last_clean":"2024-03-09T15:04:24.703460+0000","last_became_active":"2024-03-09T14:28:57.616057+0000","last_became_peered":"2024-03-09T14:28:57.616057+0000","last_unstale":"2024-03-09T15:04:24.703460+0000","last_undegraded":"2024-03-09T15:04:24.703460+0000","last_fullsized":"2024-03-09T15:04:24.703460+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:41:28.651737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'267","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.590358+0000","last_change":"2024-03-09T14:28:59.616152+0000","last_active":"2024-03-09T15:07:04.590358+0000","last_peered":"2024-03-09T15:07:04.590358+0000","last_clean":"2024-03-09T15:07:04.590358+0000","last_became_active":"2024-03-09T14:28:59.615193+0000","last_became_peered":"2024-03-09T14:28:59.615193+0000","last_unstale":"2024-03-09T15:07:04.590358+0000","last_undegraded":"2024-03-09T15:07:04.590358+0000","last_fullsized":"2024-03-09T15:07:04.590358+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:59:33.826109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43919,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":455,"num_read_kb":986,"num_write":382,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:05.058877+0000","last_change":"2024-03-09T14:29:01.661393+0000","last_active":"2024-03-09T15:04:05.058877+0000","last_peered":"2024-03-09T15:04:05.058877+0000","last_clean":"2024-03-09T15:04:05.058877+0000","last_became_active":"2024-03-09T14:29:01.660997+0000","last_became_peered":"2024-03-09T14:29:01.660997+0000","last_unstale":"2024-03-09T15:04:05.058877+0000","last_undegraded":"2024-03-09T15:04:05.058877+0000","last_fullsized":"2024-03-09T15:04:05.058877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:23.078367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'181","reported_seq":1376,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.944898+0000","last_change":"2024-03-09T14:29:03.669572+0000","last_active":"2024-03-09T15:06:53.944898+0000","last_peered":"2024-03-09T15:06:53.944898+0000","last_clean":"2024-03-09T15:06:53.944898+0000","last_became_active":"2024-03-09T14:29:03.668833+0000","last_became_peered":"2024-03-09T14:29:03.668833+0000","last_unstale":"2024-03-09T15:06:53.944898+0000","last_undegraded":"2024-03-09T15:06:53.944898+0000","last_fullsized":"2024-03-09T15:06:53.944898+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:52.062869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2487,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":947,"num_read_kb":932,"num_write":509,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'486","reported_seq":2228,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.516678+0000","last_change":"2024-03-09T14:28:55.597840+0000","last_active":"2024-03-09T15:06:32.516678+0000","last_peered":"2024-03-09T15:06:32.516678+0000","last_clean":"2024-03-09T15:06:32.516678+0000","last_became_active":"2024-03-09T14:28:55.596538+0000","last_became_peered":"2024-03-09T14:28:55.596538+0000","last_unstale":"2024-03-09T15:06:32.516678+0000","last_undegraded":"2024-03-09T15:06:32.516678+0000","last_fullsized":"2024-03-09T15:06:32.516678+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:07:17.844183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2772,"num_read_kb":2616,"num_write":579,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'269","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.687653+0000","last_change":"2024-03-09T14:28:53.597236+0000","last_active":"2024-03-09T15:07:04.687653+0000","last_peered":"2024-03-09T15:07:04.687653+0000","last_clean":"2024-03-09T15:07:04.687653+0000","last_became_active":"2024-03-09T14:28:53.589932+0000","last_became_peered":"2024-03-09T14:28:53.589932+0000","last_unstale":"2024-03-09T15:07:04.687653+0000","last_undegraded":"2024-03-09T15:07:04.687653+0000","last_fullsized":"2024-03-09T15:07:04.687653+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:18:23.444910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16919366,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":405,"num_read_kb":14456,"num_write":968,"num_write_kb":42013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.699471+0000","last_change":"2024-03-09T14:28:57.610733+0000","last_active":"2024-03-09T15:03:59.699471+0000","last_peered":"2024-03-09T15:03:59.699471+0000","last_clean":"2024-03-09T15:03:59.699471+0000","last_became_active":"2024-03-09T14:28:57.609903+0000","last_became_peered":"2024-03-09T14:28:57.609903+0000","last_unstale":"2024-03-09T15:03:59.699471+0000","last_undegraded":"2024-03-09T15:03:59.699471+0000","last_fullsized":"2024-03-09T15:03:59.699471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:06:42.154492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'259","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.245145+0000","last_change":"2024-03-09T14:28:59.631074+0000","last_active":"2024-03-09T15:07:03.245145+0000","last_peered":"2024-03-09T15:07:03.245145+0000","last_clean":"2024-03-09T15:07:03.245145+0000","last_became_active":"2024-03-09T14:28:59.630460+0000","last_became_peered":"2024-03-09T14:28:59.630460+0000","last_unstale":"2024-03-09T15:07:03.245145+0000","last_undegraded":"2024-03-09T15:07:03.245145+0000","last_fullsized":"2024-03-09T15:07:03.245145+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:09.212045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":1036,"num_write":360,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:05.073121+0000","last_change":"2024-03-09T14:29:01.636817+0000","last_active":"2024-03-09T15:05:05.073121+0000","last_peered":"2024-03-09T15:05:05.073121+0000","last_clean":"2024-03-09T15:05:05.073121+0000","last_became_active":"2024-03-09T14:29:01.636083+0000","last_became_peered":"2024-03-09T14:29:01.636083+0000","last_unstale":"2024-03-09T15:05:05.073121+0000","last_undegraded":"2024-03-09T15:05:05.073121+0000","last_fullsized":"2024-03-09T15:05:05.073121+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:03.128255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'121","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.502593+0000","last_change":"2024-03-09T14:29:03.678242+0000","last_active":"2024-03-09T15:06:55.502593+0000","last_peered":"2024-03-09T15:06:55.502593+0000","last_clean":"2024-03-09T15:06:55.502593+0000","last_became_active":"2024-03-09T14:29:03.677376+0000","last_became_peered":"2024-03-09T14:29:03.677376+0000","last_unstale":"2024-03-09T15:06:55.502593+0000","last_undegraded":"2024-03-09T15:06:55.502593+0000","last_fullsized":"2024-03-09T15:06:55.502593+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:47.054570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":93,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'1138","reported_seq":2990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:01.820596+0000","last_change":"2024-03-09T14:28:55.588136+0000","last_active":"2024-03-09T15:06:01.820596+0000","last_peered":"2024-03-09T15:06:01.820596+0000","last_clean":"2024-03-09T15:06:01.820596+0000","last_became_active":"2024-03-09T14:28:55.587547+0000","last_became_peered":"2024-03-09T14:28:55.587547+0000","last_unstale":"2024-03-09T15:06:01.820596+0000","last_undegraded":"2024-03-09T15:06:01.820596+0000","last_fullsized":"2024-03-09T15:06:01.820596+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:58:51.176419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5366,"num_read_kb":4772,"num_write":1564,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'273","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.705301+0000","last_change":"2024-03-09T14:28:53.589911+0000","last_active":"2024-03-09T15:07:04.705301+0000","last_peered":"2024-03-09T15:07:04.705301+0000","last_clean":"2024-03-09T15:07:04.705301+0000","last_became_active":"2024-03-09T14:28:53.589407+0000","last_became_peered":"2024-03-09T14:28:53.589407+0000","last_unstale":"2024-03-09T15:07:04.705301+0000","last_undegraded":"2024-03-09T15:07:04.705301+0000","last_fullsized":"2024-03-09T15:07:04.705301+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:34:02.804743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097363,"num_objects":14,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":436,"num_read_kb":59464,"num_write":1026,"num_write_kb":28198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:00.057828+0000","last_change":"2024-03-09T14:28:57.620777+0000","last_active":"2024-03-09T15:04:00.057828+0000","last_peered":"2024-03-09T15:04:00.057828+0000","last_clean":"2024-03-09T15:04:00.057828+0000","last_became_active":"2024-03-09T14:28:57.620140+0000","last_became_peered":"2024-03-09T14:28:57.620140+0000","last_unstale":"2024-03-09T15:04:00.057828+0000","last_undegraded":"2024-03-09T15:04:00.057828+0000","last_fullsized":"2024-03-09T15:04:00.057828+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:26:24.646259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'72","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:21.156819+0000","last_change":"2024-03-09T14:28:59.630490+0000","last_active":"2024-03-09T15:05:21.156819+0000","last_peered":"2024-03-09T15:05:21.156819+0000","last_clean":"2024-03-09T15:05:21.156819+0000","last_became_active":"2024-03-09T14:28:59.629734+0000","last_became_peered":"2024-03-09T14:28:59.629734+0000","last_unstale":"2024-03-09T15:05:21.156819+0000","last_undegraded":"2024-03-09T15:05:21.156819+0000","last_fullsized":"2024-03-09T15:05:21.156819+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:44:21.794038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":70,"num_read_kb":63,"num_write":56,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'539","reported_seq":2053,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.470889+0000","last_change":"2024-03-09T14:29:01.651371+0000","last_active":"2024-03-09T15:07:02.470889+0000","last_peered":"2024-03-09T15:07:02.470889+0000","last_clean":"2024-03-09T15:07:02.470889+0000","last_became_active":"2024-03-09T14:29:01.650590+0000","last_became_peered":"2024-03-09T14:29:01.650590+0000","last_unstale":"2024-03-09T15:07:02.470889+0000","last_undegraded":"2024-03-09T15:07:02.470889+0000","last_fullsized":"2024-03-09T15:07:02.470889+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":500,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:16:18.239400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'124","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.980854+0000","last_change":"2024-03-09T14:29:03.677895+0000","last_active":"2024-03-09T15:06:24.980854+0000","last_peered":"2024-03-09T15:06:24.980854+0000","last_clean":"2024-03-09T15:06:24.980854+0000","last_became_active":"2024-03-09T14:29:03.677064+0000","last_became_peered":"2024-03-09T14:29:03.677064+0000","last_unstale":"2024-03-09T15:06:24.980854+0000","last_undegraded":"2024-03-09T15:06:24.980854+0000","last_fullsized":"2024-03-09T15:06:24.980854+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:21:06.747179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":150,"num_write":318,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'509","reported_seq":1975,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.288260+0000","last_change":"2024-03-09T14:28:55.610871+0000","last_active":"2024-03-09T15:06:41.288260+0000","last_peered":"2024-03-09T15:06:41.288260+0000","last_clean":"2024-03-09T15:06:41.288260+0000","last_became_active":"2024-03-09T14:28:55.610134+0000","last_became_peered":"2024-03-09T14:28:55.610134+0000","last_unstale":"2024-03-09T15:06:41.288260+0000","last_undegraded":"2024-03-09T15:06:41.288260+0000","last_fullsized":"2024-03-09T15:06:41.288260+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:52:17.579543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2571,"num_read_kb":2332,"num_write":699,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'419","reported_seq":1137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.871550+0000","last_change":"2024-03-09T14:28:53.637554+0000","last_active":"2024-03-09T15:07:04.871550+0000","last_peered":"2024-03-09T15:07:04.871550+0000","last_clean":"2024-03-09T15:07:04.871550+0000","last_became_active":"2024-03-09T14:28:53.636761+0000","last_became_peered":"2024-03-09T14:28:53.636761+0000","last_unstale":"2024-03-09T15:07:04.871550+0000","last_undegraded":"2024-03-09T15:07:04.871550+0000","last_fullsized":"2024-03-09T15:07:04.871550+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:52:47.651977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262355,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":777,"num_read_kb":7041,"num_write":1504,"num_write_kb":16792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.703042+0000","last_change":"2024-03-09T14:28:57.613685+0000","last_active":"2024-03-09T15:03:59.703042+0000","last_peered":"2024-03-09T15:03:59.703042+0000","last_clean":"2024-03-09T15:03:59.703042+0000","last_became_active":"2024-03-09T14:28:57.612982+0000","last_became_peered":"2024-03-09T14:28:57.612982+0000","last_unstale":"2024-03-09T15:03:59.703042+0000","last_undegraded":"2024-03-09T15:03:59.703042+0000","last_fullsized":"2024-03-09T15:03:59.703042+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:06:42.400023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'288","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.799108+0000","last_change":"2024-03-09T14:28:59.601758+0000","last_active":"2024-03-09T15:07:03.799108+0000","last_peered":"2024-03-09T15:07:03.799108+0000","last_clean":"2024-03-09T15:07:03.799108+0000","last_became_active":"2024-03-09T14:28:59.601007+0000","last_became_peered":"2024-03-09T14:28:59.601007+0000","last_unstale":"2024-03-09T15:07:03.799108+0000","last_undegraded":"2024-03-09T15:07:03.799108+0000","last_fullsized":"2024-03-09T15:07:03.799108+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:57.069347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58554,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":1103,"num_write":386,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.691415+0000","last_change":"2024-03-09T14:29:01.657738+0000","last_active":"2024-03-09T15:02:54.691415+0000","last_peered":"2024-03-09T15:02:54.691415+0000","last_clean":"2024-03-09T15:02:54.691415+0000","last_became_active":"2024-03-09T14:29:01.657169+0000","last_became_peered":"2024-03-09T14:29:01.657169+0000","last_unstale":"2024-03-09T15:02:54.691415+0000","last_undegraded":"2024-03-09T15:02:54.691415+0000","last_fullsized":"2024-03-09T15:02:54.691415+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:34:38.555150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'122","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:51.348829+0000","last_change":"2024-03-09T14:29:03.670802+0000","last_active":"2024-03-09T15:06:51.348829+0000","last_peered":"2024-03-09T15:06:51.348829+0000","last_clean":"2024-03-09T15:06:51.348829+0000","last_became_active":"2024-03-09T14:29:03.669978+0000","last_became_peered":"2024-03-09T14:29:03.669978+0000","last_unstale":"2024-03-09T15:06:51.348829+0000","last_undegraded":"2024-03-09T15:06:51.348829+0000","last_fullsized":"2024-03-09T15:06:51.348829+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:24:30.237273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":289,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'771","reported_seq":2297,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.376951+0000","last_change":"2024-03-09T14:28:55.570920+0000","last_active":"2024-03-09T15:06:38.376951+0000","last_peered":"2024-03-09T15:06:38.376951+0000","last_clean":"2024-03-09T15:06:38.376951+0000","last_became_active":"2024-03-09T14:28:55.570161+0000","last_became_peered":"2024-03-09T14:28:55.570161+0000","last_unstale":"2024-03-09T15:06:38.376951+0000","last_undegraded":"2024-03-09T15:06:38.376951+0000","last_fullsized":"2024-03-09T15:06:38.376951+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:42:17.825813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3636,"num_read_kb":3267,"num_write":1033,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'336","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.676325+0000","last_change":"2024-03-09T14:29:28.825741+0000","last_active":"2024-03-09T15:07:04.676325+0000","last_peered":"2024-03-09T15:07:04.676325+0000","last_clean":"2024-03-09T15:07:04.676325+0000","last_became_active":"2024-03-09T14:29:28.824399+0000","last_became_peered":"2024-03-09T14:29:28.824399+0000","last_unstale":"2024-03-09T15:07:04.676325+0000","last_undegraded":"2024-03-09T15:07:04.676325+0000","last_fullsized":"2024-03-09T15:07:04.676325+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:08:57.826548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5527889,"num_objects":19,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":585,"num_read_kb":66383,"num_write":1388,"num_write_kb":58469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.884189+0000","last_change":"2024-03-09T14:28:57.609386+0000","last_active":"2024-03-09T15:03:59.884189+0000","last_peered":"2024-03-09T15:03:59.884189+0000","last_clean":"2024-03-09T15:03:59.884189+0000","last_became_active":"2024-03-09T14:28:57.608639+0000","last_became_peered":"2024-03-09T14:28:57.608639+0000","last_unstale":"2024-03-09T15:03:59.884189+0000","last_undegraded":"2024-03-09T15:03:59.884189+0000","last_fullsized":"2024-03-09T15:03:59.884189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:26:53.678171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'267","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.883594+0000","last_change":"2024-03-09T14:28:59.624561+0000","last_active":"2024-03-09T15:07:03.883594+0000","last_peered":"2024-03-09T15:07:03.883594+0000","last_clean":"2024-03-09T15:07:03.883594+0000","last_became_active":"2024-03-09T14:28:59.623529+0000","last_became_peered":"2024-03-09T14:28:59.623529+0000","last_unstale":"2024-03-09T15:07:03.883594+0000","last_undegraded":"2024-03-09T15:07:03.883594+0000","last_fullsized":"2024-03-09T15:07:03.883594+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:17.455070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":971,"num_write":346,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:04.685658+0000","last_change":"2024-03-09T14:29:01.651867+0000","last_active":"2024-03-09T15:03:04.685658+0000","last_peered":"2024-03-09T15:03:04.685658+0000","last_clean":"2024-03-09T15:03:04.685658+0000","last_became_active":"2024-03-09T14:29:01.651183+0000","last_became_peered":"2024-03-09T14:29:01.651183+0000","last_unstale":"2024-03-09T15:03:04.685658+0000","last_undegraded":"2024-03-09T15:03:04.685658+0000","last_fullsized":"2024-03-09T15:03:04.685658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:00:28.916197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'121","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:50.981576+0000","last_change":"2024-03-09T14:29:03.662620+0000","last_active":"2024-03-09T15:04:50.981576+0000","last_peered":"2024-03-09T15:04:50.981576+0000","last_clean":"2024-03-09T15:04:50.981576+0000","last_became_active":"2024-03-09T14:29:03.661848+0000","last_became_peered":"2024-03-09T14:29:03.661848+0000","last_unstale":"2024-03-09T15:04:50.981576+0000","last_undegraded":"2024-03-09T15:04:50.981576+0000","last_fullsized":"2024-03-09T15:04:50.981576+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:22:12.693452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":975,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":172,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'742","reported_seq":2302,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:22.942126+0000","last_change":"2024-03-09T14:28:55.582020+0000","last_active":"2024-03-09T15:06:22.942126+0000","last_peered":"2024-03-09T15:06:22.942126+0000","last_clean":"2024-03-09T15:06:22.942126+0000","last_became_active":"2024-03-09T14:28:55.580902+0000","last_became_peered":"2024-03-09T14:28:55.580902+0000","last_unstale":"2024-03-09T15:06:22.942126+0000","last_undegraded":"2024-03-09T15:06:22.942126+0000","last_fullsized":"2024-03-09T15:06:22.942126+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:36:35.032329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3409,"num_read_kb":3074,"num_write":976,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'280","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.783881+0000","last_change":"2024-03-09T14:28:53.619086+0000","last_active":"2024-03-09T15:07:04.783881+0000","last_peered":"2024-03-09T15:07:04.783881+0000","last_clean":"2024-03-09T15:07:04.783881+0000","last_became_active":"2024-03-09T14:28:53.618470+0000","last_became_peered":"2024-03-09T14:28:53.618470+0000","last_unstale":"2024-03-09T15:07:04.783881+0000","last_undegraded":"2024-03-09T15:07:04.783881+0000","last_fullsized":"2024-03-09T15:07:04.783881+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:00:32.753851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10509264,"num_objects":20,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":416,"num_read_kb":49463,"num_write":1133,"num_write_kb":38192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.683621+0000","last_change":"2024-03-09T14:28:57.612579+0000","last_active":"2024-03-09T15:02:49.683621+0000","last_peered":"2024-03-09T15:02:49.683621+0000","last_clean":"2024-03-09T15:02:49.683621+0000","last_became_active":"2024-03-09T14:28:57.611745+0000","last_became_peered":"2024-03-09T14:28:57.611745+0000","last_unstale":"2024-03-09T15:02:49.683621+0000","last_undegraded":"2024-03-09T15:02:49.683621+0000","last_fullsized":"2024-03-09T15:02:49.683621+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:31:50.123606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'213","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.032335+0000","last_change":"2024-03-09T14:28:59.617486+0000","last_active":"2024-03-09T15:07:03.032335+0000","last_peered":"2024-03-09T15:07:03.032335+0000","last_clean":"2024-03-09T15:07:03.032335+0000","last_became_active":"2024-03-09T14:28:59.615400+0000","last_became_peered":"2024-03-09T14:28:59.615400+0000","last_unstale":"2024-03-09T15:07:03.032335+0000","last_undegraded":"2024-03-09T15:07:03.032335+0000","last_fullsized":"2024-03-09T15:07:03.032335+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:18:51.266792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41975,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":356,"num_read_kb":841,"num_write":286,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.700482+0000","last_change":"2024-03-09T14:29:01.657829+0000","last_active":"2024-03-09T15:04:04.700482+0000","last_peered":"2024-03-09T15:04:04.700482+0000","last_clean":"2024-03-09T15:04:04.700482+0000","last_became_active":"2024-03-09T14:29:01.657117+0000","last_became_peered":"2024-03-09T14:29:01.657117+0000","last_unstale":"2024-03-09T15:04:04.700482+0000","last_undegraded":"2024-03-09T15:04:04.700482+0000","last_fullsized":"2024-03-09T15:04:04.700482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:43:59.466343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'133","reported_seq":1791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.893900+0000","last_change":"2024-03-09T14:29:03.660649+0000","last_active":"2024-03-09T15:06:53.893900+0000","last_peered":"2024-03-09T15:06:53.893900+0000","last_clean":"2024-03-09T15:06:53.893900+0000","last_became_active":"2024-03-09T14:29:03.659930+0000","last_became_peered":"2024-03-09T14:29:03.659930+0000","last_unstale":"2024-03-09T15:06:53.893900+0000","last_undegraded":"2024-03-09T15:06:53.893900+0000","last_fullsized":"2024-03-09T15:06:53.893900+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:47.922788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1320,"num_read_kb":1317,"num_write":320,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'484","reported_seq":2147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.154286+0000","last_change":"2024-03-09T14:28:55.599386+0000","last_active":"2024-03-09T15:06:36.154286+0000","last_peered":"2024-03-09T15:06:36.154286+0000","last_clean":"2024-03-09T15:06:36.154286+0000","last_became_active":"2024-03-09T14:28:55.598822+0000","last_became_peered":"2024-03-09T14:28:55.598822+0000","last_unstale":"2024-03-09T15:06:36.154286+0000","last_undegraded":"2024-03-09T15:06:36.154286+0000","last_fullsized":"2024-03-09T15:06:36.154286+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:22.447249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2615,"num_read_kb":2447,"num_write":578,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'271","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.644776+0000","last_change":"2024-03-09T14:28:53.595926+0000","last_active":"2024-03-09T15:07:04.644776+0000","last_peered":"2024-03-09T15:07:04.644776+0000","last_clean":"2024-03-09T15:07:04.644776+0000","last_became_active":"2024-03-09T14:28:53.595479+0000","last_became_peered":"2024-03-09T14:28:53.595479+0000","last_unstale":"2024-03-09T15:07:04.644776+0000","last_undegraded":"2024-03-09T15:07:04.644776+0000","last_fullsized":"2024-03-09T15:07:04.644776+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:37:40.541650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":882545,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":379,"num_read_kb":37241,"num_write":1043,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:50.041858+0000","last_change":"2024-03-09T14:28:57.608989+0000","last_active":"2024-03-09T15:02:50.041858+0000","last_peered":"2024-03-09T15:02:50.041858+0000","last_clean":"2024-03-09T15:02:50.041858+0000","last_became_active":"2024-03-09T14:28:57.608170+0000","last_became_peered":"2024-03-09T14:28:57.608170+0000","last_unstale":"2024-03-09T15:02:50.041858+0000","last_undegraded":"2024-03-09T15:02:50.041858+0000","last_fullsized":"2024-03-09T15:02:50.041858+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:20:42.765359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'254","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.336978+0000","last_change":"2024-03-09T14:28:59.615602+0000","last_active":"2024-03-09T15:07:03.336978+0000","last_peered":"2024-03-09T15:07:03.336978+0000","last_clean":"2024-03-09T15:07:03.336978+0000","last_became_active":"2024-03-09T14:28:59.614271+0000","last_became_peered":"2024-03-09T14:28:59.614271+0000","last_unstale":"2024-03-09T15:07:03.336978+0000","last_undegraded":"2024-03-09T15:07:03.336978+0000","last_fullsized":"2024-03-09T15:07:03.336978+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:53:14.078880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45957,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":426,"num_read_kb":925,"num_write":332,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.708033+0000","last_change":"2024-03-09T14:29:01.652400+0000","last_active":"2024-03-09T15:04:04.708033+0000","last_peered":"2024-03-09T15:04:04.708033+0000","last_clean":"2024-03-09T15:04:04.708033+0000","last_became_active":"2024-03-09T14:29:01.648467+0000","last_became_peered":"2024-03-09T14:29:01.648467+0000","last_unstale":"2024-03-09T15:04:04.708033+0000","last_undegraded":"2024-03-09T15:04:04.708033+0000","last_fullsized":"2024-03-09T15:04:04.708033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:46:40.874214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'89","reported_seq":573,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.103203+0000","last_change":"2024-03-09T14:29:03.666859+0000","last_active":"2024-03-09T15:06:27.103203+0000","last_peered":"2024-03-09T15:06:27.103203+0000","last_clean":"2024-03-09T15:06:27.103203+0000","last_became_active":"2024-03-09T14:29:03.666157+0000","last_became_peered":"2024-03-09T14:29:03.666157+0000","last_unstale":"2024-03-09T15:06:27.103203+0000","last_undegraded":"2024-03-09T15:06:27.103203+0000","last_fullsized":"2024-03-09T15:06:27.103203+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:26:26.981367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":67,"num_write":211,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'502","reported_seq":2001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.397894+0000","last_change":"2024-03-09T14:28:55.591379+0000","last_active":"2024-03-09T15:06:38.397894+0000","last_peered":"2024-03-09T15:06:38.397894+0000","last_clean":"2024-03-09T15:06:38.397894+0000","last_became_active":"2024-03-09T14:28:55.591054+0000","last_became_peered":"2024-03-09T14:28:55.591054+0000","last_unstale":"2024-03-09T15:06:38.397894+0000","last_undegraded":"2024-03-09T15:06:38.397894+0000","last_fullsized":"2024-03-09T15:06:38.397894+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:20:25.032606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2590,"num_read_kb":2449,"num_write":673,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'287","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.625676+0000","last_change":"2024-03-09T14:28:53.640090+0000","last_active":"2024-03-09T15:07:04.625676+0000","last_peered":"2024-03-09T15:07:04.625676+0000","last_clean":"2024-03-09T15:07:04.625676+0000","last_became_active":"2024-03-09T14:28:53.638941+0000","last_became_peered":"2024-03-09T14:28:53.638941+0000","last_unstale":"2024-03-09T15:07:04.625676+0000","last_undegraded":"2024-03-09T15:07:04.625676+0000","last_fullsized":"2024-03-09T15:07:04.625676+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:03:53.299755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5997998,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":445,"num_read_kb":10894,"num_write":1145,"num_write_kb":33356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'698","reported_seq":2158,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.621155+0000","last_change":"2024-03-09T14:28:55.582893+0000","last_active":"2024-03-09T15:06:29.621155+0000","last_peered":"2024-03-09T15:06:29.621155+0000","last_clean":"2024-03-09T15:06:29.621155+0000","last_became_active":"2024-03-09T14:28:55.578705+0000","last_became_peered":"2024-03-09T14:28:55.578705+0000","last_unstale":"2024-03-09T15:06:29.621155+0000","last_undegraded":"2024-03-09T15:06:29.621155+0000","last_fullsized":"2024-03-09T15:06:29.621155+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:54:28.358839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3212,"num_read_kb":2884,"num_write":923,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'298","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.619784+0000","last_change":"2024-03-09T14:28:53.618037+0000","last_active":"2024-03-09T15:07:04.619784+0000","last_peered":"2024-03-09T15:07:04.619784+0000","last_clean":"2024-03-09T15:07:04.619784+0000","last_became_active":"2024-03-09T14:28:53.617469+0000","last_became_peered":"2024-03-09T14:28:53.617469+0000","last_unstale":"2024-03-09T15:07:04.619784+0000","last_undegraded":"2024-03-09T15:07:04.619784+0000","last_fullsized":"2024-03-09T15:07:04.619784+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:13:32.235158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655947,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":476,"num_read_kb":96508,"num_write":1196,"num_write_kb":39289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'474","reported_seq":2150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.920469+0000","last_change":"2024-03-09T14:28:55.595276+0000","last_active":"2024-03-09T15:06:39.920469+0000","last_peered":"2024-03-09T15:06:39.920469+0000","last_clean":"2024-03-09T15:06:39.920469+0000","last_became_active":"2024-03-09T14:28:55.594171+0000","last_became_peered":"2024-03-09T14:28:55.594171+0000","last_unstale":"2024-03-09T15:06:39.920469+0000","last_undegraded":"2024-03-09T15:06:39.920469+0000","last_fullsized":"2024-03-09T15:06:39.920469+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:59.297943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2696,"num_read_kb":2529,"num_write":600,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'300","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.838803+0000","last_change":"2024-03-09T14:28:53.627660+0000","last_active":"2024-03-09T15:07:04.838803+0000","last_peered":"2024-03-09T15:07:04.838803+0000","last_clean":"2024-03-09T15:07:04.838803+0000","last_became_active":"2024-03-09T14:28:53.627011+0000","last_became_peered":"2024-03-09T14:28:53.627011+0000","last_unstale":"2024-03-09T15:07:04.838803+0000","last_undegraded":"2024-03-09T15:07:04.838803+0000","last_fullsized":"2024-03-09T15:07:04.838803+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:28:43.144281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":987627,"num_objects":16,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":568,"num_read_kb":86707,"num_write":1167,"num_write_kb":21935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'404","reported_seq":2036,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:28.237644+0000","last_change":"2024-03-09T14:28:55.578260+0000","last_active":"2024-03-09T15:06:28.237644+0000","last_peered":"2024-03-09T15:06:28.237644+0000","last_clean":"2024-03-09T15:06:28.237644+0000","last_became_active":"2024-03-09T14:28:55.577524+0000","last_became_peered":"2024-03-09T14:28:55.577524+0000","last_unstale":"2024-03-09T15:06:28.237644+0000","last_undegraded":"2024-03-09T15:06:28.237644+0000","last_fullsized":"2024-03-09T15:06:28.237644+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:07:13.808728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2346,"num_read_kb":2237,"num_write":463,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'352","reported_seq":1111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.723517+0000","last_change":"2024-03-09T14:28:53.579012+0000","last_active":"2024-03-09T15:07:04.723517+0000","last_peered":"2024-03-09T15:07:04.723517+0000","last_clean":"2024-03-09T15:07:04.723517+0000","last_became_active":"2024-03-09T14:28:53.578574+0000","last_became_peered":"2024-03-09T14:28:53.578574+0000","last_unstale":"2024-03-09T15:07:04.723517+0000","last_undegraded":"2024-03-09T15:07:04.723517+0000","last_fullsized":"2024-03-09T15:07:04.723517+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:29:04.559321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":270109,"num_objects":24,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":879,"num_read_kb":59109,"num_write":1320,"num_write_kb":49113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'697","reported_seq":2179,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:20.724401+0000","last_change":"2024-03-09T14:28:55.597239+0000","last_active":"2024-03-09T15:06:20.724401+0000","last_peered":"2024-03-09T15:06:20.724401+0000","last_clean":"2024-03-09T15:06:20.724401+0000","last_became_active":"2024-03-09T14:28:55.596637+0000","last_became_peered":"2024-03-09T14:28:55.596637+0000","last_unstale":"2024-03-09T15:06:20.724401+0000","last_undegraded":"2024-03-09T15:06:20.724401+0000","last_fullsized":"2024-03-09T15:06:20.724401+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:18:02.596150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3232,"num_read_kb":2910,"num_write":917,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'253","reported_seq":850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.886998+0000","last_change":"2024-03-09T14:28:53.578550+0000","last_active":"2024-03-09T15:07:04.886998+0000","last_peered":"2024-03-09T15:07:04.886998+0000","last_clean":"2024-03-09T15:07:04.886998+0000","last_became_active":"2024-03-09T14:28:53.577994+0000","last_became_peered":"2024-03-09T14:28:53.577994+0000","last_unstale":"2024-03-09T15:07:04.886998+0000","last_undegraded":"2024-03-09T15:07:04.886998+0000","last_fullsized":"2024-03-09T15:07:04.886998+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:14.265275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6341462,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":374,"num_read_kb":10774,"num_write":985,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'1034","reported_seq":2409,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.913055+0000","last_change":"2024-03-09T14:28:55.598885+0000","last_active":"2024-03-09T15:06:39.913055+0000","last_peered":"2024-03-09T15:06:39.913055+0000","last_clean":"2024-03-09T15:06:39.913055+0000","last_became_active":"2024-03-09T14:28:55.598235+0000","last_became_peered":"2024-03-09T14:28:55.598235+0000","last_unstale":"2024-03-09T15:06:39.913055+0000","last_undegraded":"2024-03-09T15:06:39.913055+0000","last_fullsized":"2024-03-09T15:06:39.913055+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1000,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:31.960386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4348,"num_read_kb":3780,"num_write":1436,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'369","reported_seq":1055,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.081147+0000","last_change":"2024-03-09T14:28:53.591761+0000","last_active":"2024-03-09T15:07:05.081147+0000","last_peered":"2024-03-09T15:07:05.081147+0000","last_clean":"2024-03-09T15:07:05.081147+0000","last_became_active":"2024-03-09T14:28:53.591365+0000","last_became_peered":"2024-03-09T14:28:53.591365+0000","last_unstale":"2024-03-09T15:07:05.081147+0000","last_undegraded":"2024-03-09T15:07:05.081147+0000","last_fullsized":"2024-03-09T15:07:05.081147+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:40:51.486043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":264373,"num_objects":17,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":665,"num_read_kb":645,"num_write":1622,"num_write_kb":21789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'476","reported_seq":1840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.471455+0000","last_change":"2024-03-09T14:29:28.739085+0000","last_active":"2024-03-09T15:06:53.471455+0000","last_peered":"2024-03-09T15:06:53.471455+0000","last_clean":"2024-03-09T15:06:53.471455+0000","last_became_active":"2024-03-09T14:29:28.738427+0000","last_became_peered":"2024-03-09T14:29:28.738427+0000","last_unstale":"2024-03-09T15:06:53.471455+0000","last_undegraded":"2024-03-09T15:06:53.471455+0000","last_fullsized":"2024-03-09T15:06:53.471455+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:33:07.046397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2425,"num_read_kb":2201,"num_write":660,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'320","reported_seq":976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.631598+0000","last_change":"2024-03-09T14:28:53.638759+0000","last_active":"2024-03-09T15:07:04.631598+0000","last_peered":"2024-03-09T15:07:04.631598+0000","last_clean":"2024-03-09T15:07:04.631598+0000","last_became_active":"2024-03-09T14:28:53.635866+0000","last_became_peered":"2024-03-09T14:28:53.635866+0000","last_unstale":"2024-03-09T15:07:04.631598+0000","last_undegraded":"2024-03-09T15:07:04.631598+0000","last_fullsized":"2024-03-09T15:07:04.631598+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:08:50.346352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049848,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":533,"num_read_kb":68120,"num_write":1298,"num_write_kb":51277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'625","reported_seq":2293,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.477485+0000","last_change":"2024-03-09T14:28:55.597656+0000","last_active":"2024-03-09T15:06:53.477485+0000","last_peered":"2024-03-09T15:06:53.477485+0000","last_clean":"2024-03-09T15:06:53.477485+0000","last_became_active":"2024-03-09T14:28:55.596430+0000","last_became_peered":"2024-03-09T14:28:55.596430+0000","last_unstale":"2024-03-09T15:06:53.477485+0000","last_undegraded":"2024-03-09T15:06:53.477485+0000","last_fullsized":"2024-03-09T15:06:53.477485+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":600,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:16:10.976172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3224,"num_read_kb":2919,"num_write":927,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'297","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.745553+0000","last_change":"2024-03-09T14:28:53.585196+0000","last_active":"2024-03-09T15:07:04.745553+0000","last_peered":"2024-03-09T15:07:04.745553+0000","last_clean":"2024-03-09T15:07:04.745553+0000","last_became_active":"2024-03-09T14:28:53.584780+0000","last_became_peered":"2024-03-09T14:28:53.584780+0000","last_unstale":"2024-03-09T15:07:04.745553+0000","last_undegraded":"2024-03-09T15:07:04.745553+0000","last_fullsized":"2024-03-09T15:07:04.745553+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:17:52.899385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262274,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":397,"num_read_kb":4504,"num_write":1215,"num_write_kb":43139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1138","reported_seq":2640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.279203+0000","last_change":"2024-03-09T14:28:55.585579+0000","last_active":"2024-03-09T15:06:41.279203+0000","last_peered":"2024-03-09T15:06:41.279203+0000","last_clean":"2024-03-09T15:06:41.279203+0000","last_became_active":"2024-03-09T14:28:55.582655+0000","last_became_peered":"2024-03-09T14:28:55.582655+0000","last_unstale":"2024-03-09T15:06:41.279203+0000","last_undegraded":"2024-03-09T15:06:41.279203+0000","last_fullsized":"2024-03-09T15:06:41.279203+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:00:59.988789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4834,"num_read_kb":4203,"num_write":1586,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'408","reported_seq":1109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.885317+0000","last_change":"2024-03-09T14:28:53.627517+0000","last_active":"2024-03-09T15:07:04.885317+0000","last_peered":"2024-03-09T15:07:04.885317+0000","last_clean":"2024-03-09T15:07:04.885317+0000","last_became_active":"2024-03-09T14:28:53.626746+0000","last_became_peered":"2024-03-09T14:28:53.626746+0000","last_unstale":"2024-03-09T15:07:04.885317+0000","last_undegraded":"2024-03-09T15:07:04.885317+0000","last_fullsized":"2024-03-09T15:07:04.885317+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:13:12.536809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262904,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":805,"num_read_kb":5936,"num_write":1481,"num_write_kb":27133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'403","reported_seq":2031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.290762+0000","last_change":"2024-03-09T14:28:55.575483+0000","last_active":"2024-03-09T15:06:41.290762+0000","last_peered":"2024-03-09T15:06:41.290762+0000","last_clean":"2024-03-09T15:06:41.290762+0000","last_became_active":"2024-03-09T14:28:55.574723+0000","last_became_peered":"2024-03-09T14:28:55.574723+0000","last_unstale":"2024-03-09T15:06:41.290762+0000","last_undegraded":"2024-03-09T15:06:41.290762+0000","last_fullsized":"2024-03-09T15:06:41.290762+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:21:08.880858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2270,"num_read_kb":2181,"num_write":450,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'353","reported_seq":1229,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.896178+0000","last_change":"2024-03-09T14:28:53.565397+0000","last_active":"2024-03-09T15:07:04.896178+0000","last_peered":"2024-03-09T15:07:04.896178+0000","last_clean":"2024-03-09T15:07:04.896178+0000","last_became_active":"2024-03-09T14:28:53.564605+0000","last_became_peered":"2024-03-09T14:28:53.564605+0000","last_unstale":"2024-03-09T15:07:04.896178+0000","last_undegraded":"2024-03-09T15:07:04.896178+0000","last_fullsized":"2024-03-09T15:07:04.896178+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:27:21.297821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1352,"num_objects":25,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":1008,"num_read_kb":12224,"num_write":1357,"num_write_kb":35283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'474","reported_seq":2092,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.442041+0000","last_change":"2024-03-09T14:28:55.596361+0000","last_active":"2024-03-09T15:06:42.442041+0000","last_peered":"2024-03-09T15:06:42.442041+0000","last_clean":"2024-03-09T15:06:42.442041+0000","last_became_active":"2024-03-09T14:28:55.596007+0000","last_became_peered":"2024-03-09T14:28:55.596007+0000","last_unstale":"2024-03-09T15:06:42.442041+0000","last_undegraded":"2024-03-09T15:06:42.442041+0000","last_fullsized":"2024-03-09T15:06:42.442041+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:09.008168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2627,"num_read_kb":2464,"num_write":596,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'256","reported_seq":845,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.897210+0000","last_change":"2024-03-09T14:28:53.638536+0000","last_active":"2024-03-09T15:07:04.897210+0000","last_peered":"2024-03-09T15:07:04.897210+0000","last_clean":"2024-03-09T15:07:04.897210+0000","last_became_active":"2024-03-09T14:28:53.637905+0000","last_became_peered":"2024-03-09T14:28:53.637905+0000","last_unstale":"2024-03-09T15:07:04.897210+0000","last_undegraded":"2024-03-09T15:07:04.897210+0000","last_fullsized":"2024-03-09T15:07:04.897210+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:24:14.058362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":289422,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":362,"num_read_kb":388,"num_write":1025,"num_write_kb":15956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'865","reported_seq":2402,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:30.933407+0000","last_change":"2024-03-09T14:28:55.590315+0000","last_active":"2024-03-09T15:06:30.933407+0000","last_peered":"2024-03-09T15:06:30.933407+0000","last_clean":"2024-03-09T15:06:30.933407+0000","last_became_active":"2024-03-09T14:28:55.589596+0000","last_became_peered":"2024-03-09T14:28:55.589596+0000","last_unstale":"2024-03-09T15:06:30.933407+0000","last_undegraded":"2024-03-09T15:06:30.933407+0000","last_fullsized":"2024-03-09T15:06:30.933407+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:18:51.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4032,"num_read_kb":3559,"num_write":1203,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'295","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.723042+0000","last_change":"2024-03-09T14:28:53.627710+0000","last_active":"2024-03-09T15:07:04.723042+0000","last_peered":"2024-03-09T15:07:04.723042+0000","last_clean":"2024-03-09T15:07:04.723042+0000","last_became_active":"2024-03-09T14:28:53.626673+0000","last_became_peered":"2024-03-09T14:28:53.626673+0000","last_unstale":"2024-03-09T15:07:04.723042+0000","last_undegraded":"2024-03-09T15:07:04.723042+0000","last_fullsized":"2024-03-09T15:07:04.723042+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:23:43.839078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2007922,"num_objects":23,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":552,"num_read_kb":94144,"num_write":1072,"num_write_kb":28965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'470","reported_seq":1980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.378173+0000","last_change":"2024-03-09T14:28:55.610858+0000","last_active":"2024-03-09T15:06:38.378173+0000","last_peered":"2024-03-09T15:06:38.378173+0000","last_clean":"2024-03-09T15:06:38.378173+0000","last_became_active":"2024-03-09T14:28:55.610314+0000","last_became_peered":"2024-03-09T14:28:55.610314+0000","last_unstale":"2024-03-09T15:06:38.378173+0000","last_undegraded":"2024-03-09T15:06:38.378173+0000","last_fullsized":"2024-03-09T15:06:38.378173+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:48.765613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2645,"num_read_kb":2435,"num_write":625,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'341","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.679819+0000","last_change":"2024-03-09T14:28:53.632280+0000","last_active":"2024-03-09T15:07:04.679819+0000","last_peered":"2024-03-09T15:07:04.679819+0000","last_clean":"2024-03-09T15:07:04.679819+0000","last_became_active":"2024-03-09T14:28:53.631327+0000","last_became_peered":"2024-03-09T14:28:53.631327+0000","last_unstale":"2024-03-09T15:07:04.679819+0000","last_undegraded":"2024-03-09T15:07:04.679819+0000","last_fullsized":"2024-03-09T15:07:04.679819+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:34:05.226694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4801783,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":567,"num_read_kb":48859,"num_write":1211,"num_write_kb":49653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'386","reported_seq":1869,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.431122+0000","last_change":"2024-03-09T14:28:55.587624+0000","last_active":"2024-03-09T15:06:42.431122+0000","last_peered":"2024-03-09T15:06:42.431122+0000","last_clean":"2024-03-09T15:06:42.431122+0000","last_became_active":"2024-03-09T14:28:55.587355+0000","last_became_peered":"2024-03-09T14:28:55.587355+0000","last_unstale":"2024-03-09T15:06:42.431122+0000","last_undegraded":"2024-03-09T15:06:42.431122+0000","last_fullsized":"2024-03-09T15:06:42.431122+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:31:51.705629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2078,"num_read_kb":1975,"num_write":455,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'374","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.641796+0000","last_change":"2024-03-09T14:28:53.624013+0000","last_active":"2024-03-09T15:07:04.641796+0000","last_peered":"2024-03-09T15:07:04.641796+0000","last_clean":"2024-03-09T15:07:04.641796+0000","last_became_active":"2024-03-09T14:28:53.622624+0000","last_became_peered":"2024-03-09T14:28:53.622624+0000","last_unstale":"2024-03-09T15:07:04.641796+0000","last_undegraded":"2024-03-09T15:07:04.641796+0000","last_fullsized":"2024-03-09T15:07:04.641796+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":300,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:47:00.573989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6554788,"num_objects":26,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":632,"num_read_kb":22045,"num_write":1223,"num_write_kb":48993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'1099","reported_seq":2573,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.149754+0000","last_change":"2024-03-09T14:28:55.591286+0000","last_active":"2024-03-09T15:06:36.149754+0000","last_peered":"2024-03-09T15:06:36.149754+0000","last_clean":"2024-03-09T15:06:36.149754+0000","last_became_active":"2024-03-09T14:28:55.582143+0000","last_became_peered":"2024-03-09T14:28:55.582143+0000","last_unstale":"2024-03-09T15:06:36.149754+0000","last_undegraded":"2024-03-09T15:06:36.149754+0000","last_fullsized":"2024-03-09T15:06:36.149754+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":1000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:02:27.150531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4588,"num_read_kb":3996,"num_write":1519,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'348","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.712681+0000","last_change":"2024-03-09T14:28:53.633628+0000","last_active":"2024-03-09T15:07:04.712681+0000","last_peered":"2024-03-09T15:07:04.712681+0000","last_clean":"2024-03-09T15:07:04.712681+0000","last_became_active":"2024-03-09T14:28:53.633121+0000","last_became_peered":"2024-03-09T14:28:53.633121+0000","last_unstale":"2024-03-09T15:07:04.712681+0000","last_undegraded":"2024-03-09T15:07:04.712681+0000","last_fullsized":"2024-03-09T15:07:04.712681+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:08:16.219438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3362505,"num_objects":22,"num_object_clones":0,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":692,"num_read_kb":9275,"num_write":1356,"num_write_kb":66964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'676","reported_seq":2114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.284688+0000","last_change":"2024-03-09T14:28:55.602146+0000","last_active":"2024-03-09T15:06:41.284688+0000","last_peered":"2024-03-09T15:06:41.284688+0000","last_clean":"2024-03-09T15:06:41.284688+0000","last_became_active":"2024-03-09T14:28:55.601622+0000","last_became_peered":"2024-03-09T14:28:55.601622+0000","last_unstale":"2024-03-09T15:06:41.284688+0000","last_undegraded":"2024-03-09T15:06:41.284688+0000","last_fullsized":"2024-03-09T15:06:41.284688+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":600,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:03:29.881841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3103,"num_read_kb":2796,"num_write":889,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'386","reported_seq":1112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.706273+0000","last_change":"2024-03-09T14:29:28.829008+0000","last_active":"2024-03-09T15:07:04.706273+0000","last_peered":"2024-03-09T15:07:04.706273+0000","last_clean":"2024-03-09T15:07:04.706273+0000","last_became_active":"2024-03-09T14:29:28.827826+0000","last_became_peered":"2024-03-09T14:29:28.827826+0000","last_unstale":"2024-03-09T15:07:04.706273+0000","last_undegraded":"2024-03-09T15:07:04.706273+0000","last_fullsized":"2024-03-09T15:07:04.706273+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:23.249436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2067841,"num_objects":29,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":862,"num_read_kb":41003,"num_write":1545,"num_write_kb":37571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"264'283","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.903720+0000","last_change":"2024-03-09T14:28:53.603932+0000","last_active":"2024-03-09T15:07:04.903720+0000","last_peered":"2024-03-09T15:07:04.903720+0000","last_clean":"2024-03-09T15:07:04.903720+0000","last_became_active":"2024-03-09T14:28:53.602502+0000","last_became_peered":"2024-03-09T14:28:53.602502+0000","last_unstale":"2024-03-09T15:07:04.903720+0000","last_undegraded":"2024-03-09T15:07:04.903720+0000","last_fullsized":"2024-03-09T15:07:04.903720+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:03:28.530349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":250254,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":382,"num_read_kb":11977,"num_write":1052,"num_write_kb":41245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'855","reported_seq":2303,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.333436+0000","last_change":"2024-03-09T14:28:55.602029+0000","last_active":"2024-03-09T15:06:24.333436+0000","last_peered":"2024-03-09T15:06:24.333436+0000","last_clean":"2024-03-09T15:06:24.333436+0000","last_became_active":"2024-03-09T14:28:55.601537+0000","last_became_peered":"2024-03-09T14:28:55.601537+0000","last_unstale":"2024-03-09T15:06:24.333436+0000","last_undegraded":"2024-03-09T15:06:24.333436+0000","last_fullsized":"2024-03-09T15:06:24.333436+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:50:14.569583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3890,"num_read_kb":3404,"num_write":1199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'332","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.044420+0000","last_change":"2024-03-09T14:28:53.589127+0000","last_active":"2024-03-09T15:07:05.044420+0000","last_peered":"2024-03-09T15:07:05.044420+0000","last_clean":"2024-03-09T15:07:05.044420+0000","last_became_active":"2024-03-09T14:28:53.588717+0000","last_became_peered":"2024-03-09T14:28:53.588717+0000","last_unstale":"2024-03-09T15:07:05.044420+0000","last_undegraded":"2024-03-09T15:07:05.044420+0000","last_fullsized":"2024-03-09T15:07:05.044420+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:19:41.863054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286957,"num_objects":27,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":553,"num_read_kb":5744,"num_write":1159,"num_write_kb":28449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'1155","reported_seq":2682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.479714+0000","last_change":"2024-03-09T14:28:55.583336+0000","last_active":"2024-03-09T15:06:53.479714+0000","last_peered":"2024-03-09T15:06:53.479714+0000","last_clean":"2024-03-09T15:06:53.479714+0000","last_became_active":"2024-03-09T14:28:55.582541+0000","last_became_peered":"2024-03-09T14:28:55.582541+0000","last_unstale":"2024-03-09T15:06:53.479714+0000","last_undegraded":"2024-03-09T15:06:53.479714+0000","last_fullsized":"2024-03-09T15:06:53.479714+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:40.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4871,"num_read_kb":4234,"num_write":1610,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5930,"num_read_kb":4217,"num_write":2190,"num_write_kb":844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1123,"ondisk_log_size":1123,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":13413,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":15557,"num_read_kb":15326,"num_write":16235,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":26826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1560,"ondisk_log_size":1560,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":419,"ondisk_log_size":419,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1540732,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":16143,"num_read_kb":33699,"num_write":13780,"num_write_kb":11122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1036288,"data_stored":696270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2023,"ondisk_log_size":2023,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1622,"num_read_kb":1927,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":194579,"num_read_kb":177681,"num_write":51390,"num_write_kb":17534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":132,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4061,"ondisk_log_size":4061,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":242449739,"num_objects":1300,"num_object_clones":0,"num_object_copies":5200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1300,"num_whiteouts":0,"num_read":33841,"num_read_kb":1970650,"num_write":76636,"num_write_kb":2252311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":349028352,"data_stored":349028352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4028,"ondisk_log_size":4028,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":39889250,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":128,"num_read_kb":180405,"num_write":142,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":79781888,"data_stored":79778500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":37751953,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":127,"num_read_kb":177288,"num_write":144,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":75505664,"data_stored":75503906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575316,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":391396,"kb_used_data":75564,"kb_used_omap":1,"kb_used_meta":315774,"kb_avail":93980444,"statfs":{"total":96636764160,"available":96235974656,"internally_reserved":0,"allocated":77377536,"data_stored":75372085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":323353034},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575313,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":379716,"kb_used_data":73540,"kb_used_omap":1,"kb_used_meta":306046,"kb_avail":93992124,"statfs":{"total":96636764160,"available":96247934976,"internally_reserved":0,"allocated":75304960,"data_stored":73333756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":313391558},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575317,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":218324,"kb_used_data":70328,"kb_used_omap":1,"kb_used_meta":147710,"kb_avail":94153516,"statfs":{"total":96636764160,"available":96413200384,"internally_reserved":0,"allocated":72015872,"data_stored":69995251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":151255493},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575314,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":232052,"kb_used_data":124484,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94139788,"statfs":{"total":96636764160,"available":96399142912,"internally_reserved":0,"allocated":127471616,"data_stored":125551919,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575316,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":387356,"kb_used_data":112916,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":93984484,"statfs":{"total":96636764160,"available":96240111616,"internally_reserved":0,"allocated":115625984,"data_stored":113612427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280689095},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575312,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":171004,"kb_used_data":67496,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94200836,"statfs":{"total":96636764160,"available":96461656064,"internally_reserved":0,"allocated":69115904,"data_stored":67191426,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575316,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":231348,"kb_used_data":59720,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94140492,"statfs":{"total":96636764160,"available":96399863808,"internally_reserved":0,"allocated":61153280,"data_stored":59180630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,0,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575313,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":319312,"kb_used_data":57392,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94052528,"statfs":{"total":96636764160,"available":96309788672,"internally_reserved":0,"allocated":58769408,"data_stored":56769573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,2],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":47398912,"data_stored":47398912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":27369472,"data_stored":27369472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":37072896,"data_stored":37072896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":29974528,"data_stored":29974528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":59637760,"data_stored":59637760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":35831808,"data_stored":35831808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":50921472,"data_stored":50921472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":60821504,"data_stored":60821504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":91608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":84957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":143360,"data_stored":89493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":220268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":82594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":192512,"data_stored":126800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1052672,"data_stored":1051793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11538432,"data_stored":11537553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":5283840,"data_stored":5283025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15769600,"data_stored":15768785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":23068672,"data_stored":23068672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10489856,"data_stored":10488977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10489856,"data_stored":10488977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:07:07.628 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-09T15:07:07.960 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:07:07.961 INFO:teuthology.orchestra.run.smithi099.stdout:{"epoch":264,"fsid":"c118b1d7-bb5d-4ffd-b0cf-8c047c4a122e","created":"2024-03-09T14:28:22.555967+0000","modified":"2024-03-09T14:49:54.625196+0000","last_up_change":"2024-03-09T14:28:33.692192+0000","last_in_change":"2024-03-09T14:28:24.846197+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-09T14:28:35.514636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-09T14:28:40.724074+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-03-09T14:28:51.559472+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-03-09T14:28:53.923280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-03-09T14:28:55.963028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-03-09T14:28:57.743050+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-03-09T14:28:59.660923+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-03-09T14:29:01.808574+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-03-09T14:39:56.317315+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"253","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-03-09T14:42:14.001221+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"256","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-03-09T14:42:17.175896+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"259","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-03-09T14:49:52.289329+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"264","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f7049dc8-86cc-47e3-b16a-e3e9a620ee63","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6816","nonce":2757713078},{"type":"v1","addr":"172.21.15.99:6817","nonce":2757713078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6818","nonce":2757713078},{"type":"v1","addr":"172.21.15.99:6819","nonce":2757713078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6822","nonce":2757713078},{"type":"v1","addr":"172.21.15.99:6823","nonce":2757713078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6820","nonce":2757713078},{"type":"v1","addr":"172.21.15.99:6821","nonce":2757713078}]},"public_addr":"172.21.15.99:6817/2757713078","cluster_addr":"172.21.15.99:6819/2757713078","heartbeat_back_addr":"172.21.15.99:6823/2757713078","heartbeat_front_addr":"172.21.15.99:6821/2757713078","state":["exists","up"]},{"osd":1,"uuid":"5877574c-62c9-4ee0-b9db-cd3995ca0a3c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6808","nonce":2872705330},{"type":"v1","addr":"172.21.15.99:6809","nonce":2872705330}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6810","nonce":2872705330},{"type":"v1","addr":"172.21.15.99:6811","nonce":2872705330}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6814","nonce":2872705330},{"type":"v1","addr":"172.21.15.99:6815","nonce":2872705330}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6812","nonce":2872705330},{"type":"v1","addr":"172.21.15.99:6813","nonce":2872705330}]},"public_addr":"172.21.15.99:6809/2872705330","cluster_addr":"172.21.15.99:6811/2872705330","heartbeat_back_addr":"172.21.15.99:6815/2872705330","heartbeat_front_addr":"172.21.15.99:6813/2872705330","state":["exists","up"]},{"osd":2,"uuid":"220962ad-f847-4fb0-9daf-76cf09ca5c7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6824","nonce":3618878900},{"type":"v1","addr":"172.21.15.99:6825","nonce":3618878900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6826","nonce":3618878900},{"type":"v1","addr":"172.21.15.99:6827","nonce":3618878900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6830","nonce":3618878900},{"type":"v1","addr":"172.21.15.99:6831","nonce":3618878900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6828","nonce":3618878900},{"type":"v1","addr":"172.21.15.99:6829","nonce":3618878900}]},"public_addr":"172.21.15.99:6825/3618878900","cluster_addr":"172.21.15.99:6827/3618878900","heartbeat_back_addr":"172.21.15.99:6831/3618878900","heartbeat_front_addr":"172.21.15.99:6829/3618878900","state":["exists","up"]},{"osd":3,"uuid":"2a1e0d81-f422-4fa0-af27-6dbefd01b429","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6800","nonce":643519472},{"type":"v1","addr":"172.21.15.99:6801","nonce":643519472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6802","nonce":643519472},{"type":"v1","addr":"172.21.15.99:6803","nonce":643519472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6806","nonce":643519472},{"type":"v1","addr":"172.21.15.99:6807","nonce":643519472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.99:6804","nonce":643519472},{"type":"v1","addr":"172.21.15.99:6805","nonce":643519472}]},"public_addr":"172.21.15.99:6801/643519472","cluster_addr":"172.21.15.99:6803/643519472","heartbeat_back_addr":"172.21.15.99:6807/643519472","heartbeat_front_addr":"172.21.15.99:6805/643519472","state":["exists","up"]},{"osd":4,"uuid":"42f23385-6032-4aaf-9d95-3eb6c59eb515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":2461929152},{"type":"v1","addr":"172.21.15.179:6801","nonce":2461929152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6802","nonce":2461929152},{"type":"v1","addr":"172.21.15.179:6803","nonce":2461929152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":2461929152},{"type":"v1","addr":"172.21.15.179:6815","nonce":2461929152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":2461929152},{"type":"v1","addr":"172.21.15.179:6809","nonce":2461929152}]},"public_addr":"172.21.15.179:6801/2461929152","cluster_addr":"172.21.15.179:6803/2461929152","heartbeat_back_addr":"172.21.15.179:6815/2461929152","heartbeat_front_addr":"172.21.15.179:6809/2461929152","state":["exists","up"]},{"osd":5,"uuid":"e2ff7aea-ca15-4bf6-91df-cef1f6ddac9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6807","nonce":4275579646},{"type":"v1","addr":"172.21.15.179:6811","nonce":4275579646}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":4275579646},{"type":"v1","addr":"172.21.15.179:6816","nonce":4275579646}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":4275579646},{"type":"v1","addr":"172.21.15.179:6823","nonce":4275579646}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":4275579646},{"type":"v1","addr":"172.21.15.179:6820","nonce":4275579646}]},"public_addr":"172.21.15.179:6811/4275579646","cluster_addr":"172.21.15.179:6816/4275579646","heartbeat_back_addr":"172.21.15.179:6823/4275579646","heartbeat_front_addr":"172.21.15.179:6820/4275579646","state":["exists","up"]},{"osd":6,"uuid":"a58c2272-d8ee-49eb-b12e-d968c541b36e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":2511961392},{"type":"v1","addr":"172.21.15.179:6806","nonce":2511961392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":2511961392},{"type":"v1","addr":"172.21.15.179:6810","nonce":2511961392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6819","nonce":2511961392},{"type":"v1","addr":"172.21.15.179:6821","nonce":2511961392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6814","nonce":2511961392},{"type":"v1","addr":"172.21.15.179:6817","nonce":2511961392}]},"public_addr":"172.21.15.179:6806/2511961392","cluster_addr":"172.21.15.179:6810/2511961392","heartbeat_back_addr":"172.21.15.179:6821/2511961392","heartbeat_front_addr":"172.21.15.179:6817/2511961392","state":["exists","up"]},{"osd":7,"uuid":"8f499990-ff5b-4066-bda3-3eda76980f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":1220611928},{"type":"v1","addr":"172.21.15.179:6825","nonce":1220611928}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":1220611928},{"type":"v1","addr":"172.21.15.179:6827","nonce":1220611928}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":1220611928},{"type":"v1","addr":"172.21.15.179:6831","nonce":1220611928}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":1220611928},{"type":"v1","addr":"172.21.15.179:6829","nonce":1220611928}]},"public_addr":"172.21.15.179:6825/1220611928","cluster_addr":"172.21.15.179:6827/1220611928","heartbeat_back_addr":"172.21.15.179:6831/1220611928","heartbeat_front_addr":"172.21.15.179:6829/1220611928","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.447229+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.475263+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.348371+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.438398+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.537961+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.533762+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.309350+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-09T14:28:30.419779+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":7,"to":2}]},{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.34","mappings":[{"from":4,"to":2}]},{"pgid":"3.3d","mappings":[{"from":0,"to":3}]},{"pgid":"4.16","mappings":[{"from":3,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":5}]},{"pgid":"67.a","mappings":[{"from":3,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-09T15:07:08.979 INFO:tasks.ceph:Scrubbing osd.0 2024-03-09T15:07:08.979 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:07:09.134 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T15:07:09.135 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:07:09.135 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T15:07:09.151 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-09T15:07:09.434 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 0 to deep-scrub 2024-03-09T15:07:09.452 INFO:tasks.ceph:Scrubbing osd.1 2024-03-09T15:07:09.452 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:07:09.585 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T15:07:09.586 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:07:09.586 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T15:07:09.601 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-09T15:07:09.890 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 1 to deep-scrub 2024-03-09T15:07:09.910 INFO:tasks.ceph:Scrubbing osd.2 2024-03-09T15:07:09.910 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:07:10.058 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T15:07:10.059 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:07:10.059 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T15:07:10.075 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-09T15:07:10.356 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 2 to deep-scrub 2024-03-09T15:07:10.375 INFO:tasks.ceph:Scrubbing osd.3 2024-03-09T15:07:10.375 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:07:10.515 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T15:07:10.516 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:07:10.516 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T15:07:10.530 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-09T15:07:10.806 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 3 to deep-scrub 2024-03-09T15:07:10.826 INFO:tasks.ceph:Scrubbing osd.4 2024-03-09T15:07:10.826 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:07:10.971 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T15:07:10.971 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:07:10.972 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T15:07:10.986 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-09T15:07:11.259 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 4 to deep-scrub 2024-03-09T15:07:11.278 INFO:tasks.ceph:Scrubbing osd.5 2024-03-09T15:07:11.279 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:07:11.596 INFO:teuthology.orchestra.run.smithi099.stderr:2024-03-09T15:07:11.598+0000 7fd74148e640 0 --2- 172.21.15.99:0/370334689 >> [v2:172.21.15.99:3300/0,v1:172.21.15.99:6789/0] conn(0x7fd73c0b14c0 0x7fd73c1374c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-03-09T15:07:11.622 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T15:07:11.623 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:07:11.623 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T15:07:11.649 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-09T15:07:11.948 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 5 to deep-scrub 2024-03-09T15:07:11.967 INFO:tasks.ceph:Scrubbing osd.6 2024-03-09T15:07:11.968 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:07:12.116 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T15:07:12.116 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:07:12.116 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T15:07:12.132 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-09T15:07:12.398 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 6 to deep-scrub 2024-03-09T15:07:12.416 INFO:tasks.ceph:Scrubbing osd.7 2024-03-09T15:07:12.416 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-09T15:07:12.554 INFO:teuthology.orchestra.run.smithi099.stdout:{ 2024-03-09T15:07:12.554 INFO:teuthology.orchestra.run.smithi099.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-09T15:07:12.555 INFO:teuthology.orchestra.run.smithi099.stdout:} 2024-03-09T15:07:12.569 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-09T15:07:12.835 INFO:teuthology.orchestra.run.smithi099.stderr:instructed osd(s) 7 to deep-scrub 2024-03-09T15:07:12.854 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:07:13.193 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:07:13.208 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-09T15:07:13.225 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":1416,"stamp":"2024-03-09T15:07:12.848872+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":178454650,"num_objects":799,"num_object_clones":0,"num_object_copies":2320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":799,"num_whiteouts":0,"num_read":269134,"num_read_kb":2562286,"num_write":161720,"num_write_kb":2520695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":176,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13250,"ondisk_log_size":13250,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2015796,"kb_used_data":288512,"kb_used_omap":12,"kb_used_meta":1726323,"kb_avail":752958924,"statfs":{"total":773094113280,"available":771029938176,"internally_reserved":0,"allocated":295436288,"data_stored":279714436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1767755312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-675569441,"num_objects":-4048,"num_object_clones":0,"num_object_copies":-16120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4048,"num_whiteouts":0,"num_read":4561,"num_read_kb":4117,"num_write":4266,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007586"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:24.861905+0000","last_change":"2024-03-09T14:49:53.659913+0000","last_active":"2024-03-09T15:02:24.861905+0000","last_peered":"2024-03-09T15:02:24.861905+0000","last_clean":"2024-03-09T15:02:24.861905+0000","last_became_active":"2024-03-09T14:49:53.656173+0000","last_became_peered":"2024-03-09T14:49:53.656173+0000","last_unstale":"2024-03-09T15:02:24.861905+0000","last_undegraded":"2024-03-09T15:02:24.861905+0000","last_fullsized":"2024-03-09T15:02:24.861905+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:35.929830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.860903+0000","last_change":"2024-03-09T14:42:19.006802+0000","last_active":"2024-03-09T15:02:19.860903+0000","last_peered":"2024-03-09T15:02:19.860903+0000","last_clean":"2024-03-09T15:02:19.860903+0000","last_became_active":"2024-03-09T14:42:19.006064+0000","last_became_peered":"2024-03-09T14:42:19.006064+0000","last_unstale":"2024-03-09T15:02:19.860903+0000","last_undegraded":"2024-03-09T15:02:19.860903+0000","last_fullsized":"2024-03-09T15:02:19.860903+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:00:50.245633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.912628+0000","last_change":"2024-03-09T14:42:15.929304+0000","last_active":"2024-03-09T15:02:19.912628+0000","last_peered":"2024-03-09T15:02:19.912628+0000","last_clean":"2024-03-09T15:02:19.912628+0000","last_became_active":"2024-03-09T14:42:15.928518+0000","last_became_peered":"2024-03-09T14:42:15.928518+0000","last_unstale":"2024-03-09T15:02:19.912628+0000","last_undegraded":"2024-03-09T15:02:19.912628+0000","last_fullsized":"2024-03-09T15:02:19.912628+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:41:16.939221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'49","reported_seq":165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.732265+0000","last_change":"2024-03-09T15:07:09.732293+0000","last_active":"2024-03-09T15:07:09.732265+0000","last_peered":"2024-03-09T15:07:09.732265+0000","last_clean":"2024-03-09T15:07:09.732265+0000","last_became_active":"2024-03-09T14:39:57.901879+0000","last_became_peered":"2024-03-09T14:39:57.901879+0000","last_unstale":"2024-03-09T15:07:09.732265+0000","last_undegraded":"2024-03-09T15:07:09.732265+0000","last_fullsized":"2024-03-09T15:07:09.732265+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-03-09T15:07:09.732154+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-03-09T15:07:09.732154+0000","last_clean_scrub_stamp":"2024-03-09T15:07:09.732154+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:47.058510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":129,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:24.672562+0000","last_change":"2024-03-09T14:49:53.685563+0000","last_active":"2024-03-09T15:02:24.672562+0000","last_peered":"2024-03-09T15:02:24.672562+0000","last_clean":"2024-03-09T15:02:24.672562+0000","last_became_active":"2024-03-09T14:49:53.684941+0000","last_became_peered":"2024-03-09T14:49:53.684941+0000","last_unstale":"2024-03-09T15:02:24.672562+0000","last_undegraded":"2024-03-09T15:02:24.672562+0000","last_fullsized":"2024-03-09T15:02:24.672562+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:56:08.696978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.677113+0000","last_change":"2024-03-09T14:42:19.016523+0000","last_active":"2024-03-09T15:02:19.677113+0000","last_peered":"2024-03-09T15:02:19.677113+0000","last_clean":"2024-03-09T15:02:19.677113+0000","last_became_active":"2024-03-09T14:42:19.011453+0000","last_became_peered":"2024-03-09T14:42:19.011453+0000","last_unstale":"2024-03-09T15:02:19.677113+0000","last_undegraded":"2024-03-09T15:02:19.677113+0000","last_fullsized":"2024-03-09T15:02:19.677113+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:58.069721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:50.069570+0000","last_change":"2024-03-09T14:42:15.971426+0000","last_active":"2024-03-09T15:04:50.069570+0000","last_peered":"2024-03-09T15:04:50.069570+0000","last_clean":"2024-03-09T15:04:50.069570+0000","last_became_active":"2024-03-09T14:42:15.970720+0000","last_became_peered":"2024-03-09T14:42:15.970720+0000","last_unstale":"2024-03-09T15:04:50.069570+0000","last_undegraded":"2024-03-09T15:04:50.069570+0000","last_fullsized":"2024-03-09T15:04:50.069570+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.696208+0000","last_change":"2024-03-09T14:39:57.894737+0000","last_active":"2024-03-09T15:04:09.696208+0000","last_peered":"2024-03-09T15:04:09.696208+0000","last_clean":"2024-03-09T15:04:09.696208+0000","last_became_active":"2024-03-09T14:39:57.894022+0000","last_became_peered":"2024-03-09T14:39:57.894022+0000","last_unstale":"2024-03-09T15:04:09.696208+0000","last_undegraded":"2024-03-09T15:04:09.696208+0000","last_fullsized":"2024-03-09T15:04:09.696208+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:04:28.968947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.703233+0000","last_change":"2024-03-09T14:49:53.677659+0000","last_active":"2024-03-09T15:04:24.703233+0000","last_peered":"2024-03-09T15:04:24.703233+0000","last_clean":"2024-03-09T15:04:24.703233+0000","last_became_active":"2024-03-09T14:49:53.676530+0000","last_became_peered":"2024-03-09T14:49:53.676530+0000","last_unstale":"2024-03-09T15:04:24.703233+0000","last_undegraded":"2024-03-09T15:04:24.703233+0000","last_fullsized":"2024-03-09T15:04:24.703233+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:46:58.203837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.365374+0000","last_change":"2024-03-09T14:42:19.295942+0000","last_active":"2024-03-09T15:07:05.365374+0000","last_peered":"2024-03-09T15:07:05.365374+0000","last_clean":"2024-03-09T15:07:05.365374+0000","last_became_active":"2024-03-09T14:42:19.295218+0000","last_became_peered":"2024-03-09T14:42:19.295218+0000","last_unstale":"2024-03-09T15:07:05.365374+0000","last_undegraded":"2024-03-09T15:07:05.365374+0000","last_fullsized":"2024-03-09T15:07:05.365374+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":63,"num_write":4,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"261'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.701153+0000","last_change":"2024-03-09T14:42:15.958751+0000","last_active":"2024-03-09T15:04:29.701153+0000","last_peered":"2024-03-09T15:04:29.701153+0000","last_clean":"2024-03-09T15:04:29.701153+0000","last_became_active":"2024-03-09T14:42:15.958052+0000","last_became_peered":"2024-03-09T14:42:15.958052+0000","last_unstale":"2024-03-09T15:04:29.701153+0000","last_undegraded":"2024-03-09T15:04:29.701153+0000","last_fullsized":"2024-03-09T15:04:29.701153+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:29:31.200748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'67","reported_seq":206,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.721938+0000","last_change":"2024-03-09T14:39:57.891306+0000","last_active":"2024-03-09T15:04:59.721938+0000","last_peered":"2024-03-09T15:04:59.721938+0000","last_clean":"2024-03-09T15:04:59.721938+0000","last_became_active":"2024-03-09T14:39:57.890452+0000","last_became_peered":"2024-03-09T14:39:57.890452+0000","last_unstale":"2024-03-09T15:04:59.721938+0000","last_undegraded":"2024-03-09T15:04:59.721938+0000","last_fullsized":"2024-03-09T15:04:59.721938+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":205,"num_write":124,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.944291+0000","last_change":"2024-03-09T14:49:53.669862+0000","last_active":"2024-03-09T15:04:24.944291+0000","last_peered":"2024-03-09T15:04:24.944291+0000","last_clean":"2024-03-09T15:04:24.944291+0000","last_became_active":"2024-03-09T14:49:53.669178+0000","last_became_peered":"2024-03-09T14:49:53.669178+0000","last_unstale":"2024-03-09T15:04:24.944291+0000","last_undegraded":"2024-03-09T15:04:24.944291+0000","last_fullsized":"2024-03-09T15:04:24.944291+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:33.018328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'6","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.944631+0000","last_change":"2024-03-09T14:42:19.295020+0000","last_active":"2024-03-09T15:04:24.944631+0000","last_peered":"2024-03-09T15:04:24.944631+0000","last_clean":"2024-03-09T15:04:24.944631+0000","last_became_active":"2024-03-09T14:42:19.294235+0000","last_became_peered":"2024-03-09T14:42:19.294235+0000","last_unstale":"2024-03-09T15:04:24.944631+0000","last_undegraded":"2024-03-09T15:04:24.944631+0000","last_fullsized":"2024-03-09T15:04:24.944631+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:26.179213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.688252+0000","last_change":"2024-03-09T14:42:15.958787+0000","last_active":"2024-03-09T15:03:09.688252+0000","last_peered":"2024-03-09T15:03:09.688252+0000","last_clean":"2024-03-09T15:03:09.688252+0000","last_became_active":"2024-03-09T14:42:15.957974+0000","last_became_peered":"2024-03-09T14:42:15.957974+0000","last_unstale":"2024-03-09T15:03:09.688252+0000","last_undegraded":"2024-03-09T15:03:09.688252+0000","last_fullsized":"2024-03-09T15:03:09.688252+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:28:08.525108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'35","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:15.106458+0000","last_change":"2024-03-09T14:39:57.910289+0000","last_active":"2024-03-09T15:03:15.106458+0000","last_peered":"2024-03-09T15:03:15.106458+0000","last_clean":"2024-03-09T15:03:15.106458+0000","last_became_active":"2024-03-09T14:39:57.909761+0000","last_became_peered":"2024-03-09T14:39:57.909761+0000","last_unstale":"2024-03-09T15:03:15.106458+0000","last_undegraded":"2024-03-09T15:03:15.106458+0000","last_fullsized":"2024-03-09T15:03:15.106458+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:05:46.103142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":109,"num_write":58,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:54.936666+0000","last_change":"2024-03-09T14:49:53.678276+0000","last_active":"2024-03-09T15:03:54.936666+0000","last_peered":"2024-03-09T15:03:54.936666+0000","last_clean":"2024-03-09T15:03:54.936666+0000","last_became_active":"2024-03-09T14:49:53.676902+0000","last_became_peered":"2024-03-09T14:49:53.676902+0000","last_unstale":"2024-03-09T15:03:54.936666+0000","last_undegraded":"2024-03-09T15:03:54.936666+0000","last_fullsized":"2024-03-09T15:03:54.936666+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:07:34.791991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.886265+0000","last_change":"2024-03-09T14:42:19.008196+0000","last_active":"2024-03-09T15:04:09.886265+0000","last_peered":"2024-03-09T15:04:09.886265+0000","last_clean":"2024-03-09T15:04:09.886265+0000","last_became_active":"2024-03-09T14:42:19.006923+0000","last_became_peered":"2024-03-09T14:42:19.006923+0000","last_unstale":"2024-03-09T15:04:09.886265+0000","last_undegraded":"2024-03-09T15:04:09.886265+0000","last_fullsized":"2024-03-09T15:04:09.886265+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:47:53.638625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.525636+0000","last_change":"2024-03-09T14:42:15.974088+0000","last_active":"2024-03-09T15:07:04.525636+0000","last_peered":"2024-03-09T15:07:04.525636+0000","last_clean":"2024-03-09T15:07:04.525636+0000","last_became_active":"2024-03-09T14:42:15.971499+0000","last_became_peered":"2024-03-09T14:42:15.971499+0000","last_unstale":"2024-03-09T15:07:04.525636+0000","last_undegraded":"2024-03-09T15:07:04.525636+0000","last_fullsized":"2024-03-09T15:07:04.525636+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'33","reported_seq":124,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:29.915211+0000","last_change":"2024-03-09T14:39:57.900156+0000","last_active":"2024-03-09T15:02:29.915211+0000","last_peered":"2024-03-09T15:02:29.915211+0000","last_clean":"2024-03-09T15:02:29.915211+0000","last_became_active":"2024-03-09T14:39:57.898849+0000","last_became_peered":"2024-03-09T14:39:57.898849+0000","last_unstale":"2024-03-09T15:02:29.915211+0000","last_undegraded":"2024-03-09T15:02:29.915211+0000","last_fullsized":"2024-03-09T15:02:29.915211+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:28.068027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":100,"num_write":52,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:35.098171+0000","last_change":"2024-03-09T14:49:53.660759+0000","last_active":"2024-03-09T15:06:35.098171+0000","last_peered":"2024-03-09T15:06:35.098171+0000","last_clean":"2024-03-09T15:06:35.098171+0000","last_became_active":"2024-03-09T14:49:53.648332+0000","last_became_peered":"2024-03-09T14:49:53.648332+0000","last_unstale":"2024-03-09T15:06:35.098171+0000","last_undegraded":"2024-03-09T15:06:35.098171+0000","last_fullsized":"2024-03-09T15:06:35.098171+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'6","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.730533+0000","last_change":"2024-03-09T14:42:19.004615+0000","last_active":"2024-03-09T15:06:29.730533+0000","last_peered":"2024-03-09T15:06:29.730533+0000","last_clean":"2024-03-09T15:06:29.730533+0000","last_became_active":"2024-03-09T14:42:19.003868+0000","last_became_peered":"2024-03-09T14:42:19.003868+0000","last_unstale":"2024-03-09T15:06:29.730533+0000","last_undegraded":"2024-03-09T15:06:29.730533+0000","last_fullsized":"2024-03-09T15:06:29.730533+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:37:03.868001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.735345+0000","last_change":"2024-03-09T14:42:15.948619+0000","last_active":"2024-03-09T15:06:39.735345+0000","last_peered":"2024-03-09T15:06:39.735345+0000","last_clean":"2024-03-09T15:06:39.735345+0000","last_became_active":"2024-03-09T14:42:15.947888+0000","last_became_peered":"2024-03-09T14:42:15.947888+0000","last_unstale":"2024-03-09T15:06:39.735345+0000","last_undegraded":"2024-03-09T15:06:39.735345+0000","last_fullsized":"2024-03-09T15:06:39.735345+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:44.462054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'23","reported_seq":99,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:29.678061+0000","last_change":"2024-03-09T14:39:57.908221+0000","last_active":"2024-03-09T15:02:29.678061+0000","last_peered":"2024-03-09T15:02:29.678061+0000","last_clean":"2024-03-09T15:02:29.678061+0000","last_became_active":"2024-03-09T14:39:57.907530+0000","last_became_peered":"2024-03-09T14:39:57.907530+0000","last_unstale":"2024-03-09T15:02:29.678061+0000","last_undegraded":"2024-03-09T15:02:29.678061+0000","last_fullsized":"2024-03-09T15:02:29.678061+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:04:57.676537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":69,"num_write":39,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:24.893913+0000","last_change":"2024-03-09T14:49:53.677579+0000","last_active":"2024-03-09T15:02:24.893913+0000","last_peered":"2024-03-09T15:02:24.893913+0000","last_clean":"2024-03-09T15:02:24.893913+0000","last_became_active":"2024-03-09T14:49:53.676976+0000","last_became_peered":"2024-03-09T14:49:53.676976+0000","last_unstale":"2024-03-09T15:02:24.893913+0000","last_undegraded":"2024-03-09T15:02:24.893913+0000","last_fullsized":"2024-03-09T15:02:24.893913+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:07:35.978642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.675982+0000","last_change":"2024-03-09T14:42:19.017355+0000","last_active":"2024-03-09T15:02:19.675982+0000","last_peered":"2024-03-09T15:02:19.675982+0000","last_clean":"2024-03-09T15:02:19.675982+0000","last_became_active":"2024-03-09T14:42:19.008779+0000","last_became_peered":"2024-03-09T14:42:19.008779+0000","last_unstale":"2024-03-09T15:02:19.675982+0000","last_undegraded":"2024-03-09T15:02:19.675982+0000","last_fullsized":"2024-03-09T15:02:19.675982+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:37:37.205376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"261'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.676961+0000","last_change":"2024-03-09T14:42:15.943933+0000","last_active":"2024-03-09T15:02:19.676961+0000","last_peered":"2024-03-09T15:02:19.676961+0000","last_clean":"2024-03-09T15:02:19.676961+0000","last_became_active":"2024-03-09T14:42:15.943177+0000","last_became_peered":"2024-03-09T14:42:15.943177+0000","last_unstale":"2024-03-09T15:02:19.676961+0000","last_undegraded":"2024-03-09T15:02:19.676961+0000","last_fullsized":"2024-03-09T15:02:19.676961+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:55:55.865049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'28","reported_seq":112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.746627+0000","last_change":"2024-03-09T14:39:57.895113+0000","last_active":"2024-03-09T15:06:39.746627+0000","last_peered":"2024-03-09T15:06:39.746627+0000","last_clean":"2024-03-09T15:06:39.746627+0000","last_became_active":"2024-03-09T14:39:57.894343+0000","last_became_peered":"2024-03-09T14:39:57.894343+0000","last_unstale":"2024-03-09T15:06:39.746627+0000","last_undegraded":"2024-03-09T15:06:39.746627+0000","last_fullsized":"2024-03-09T15:06:39.746627+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":82,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":18,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:24.894013+0000","last_change":"2024-03-09T14:49:53.666909+0000","last_active":"2024-03-09T15:02:24.894013+0000","last_peered":"2024-03-09T15:02:24.894013+0000","last_clean":"2024-03-09T15:02:24.894013+0000","last_became_active":"2024-03-09T14:49:53.666178+0000","last_became_peered":"2024-03-09T14:49:53.666178+0000","last_unstale":"2024-03-09T15:02:24.894013+0000","last_undegraded":"2024-03-09T15:02:24.894013+0000","last_fullsized":"2024-03-09T15:02:24.894013+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:52.776783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:19.912444+0000","last_change":"2024-03-09T14:42:19.007765+0000","last_active":"2024-03-09T15:02:19.912444+0000","last_peered":"2024-03-09T15:02:19.912444+0000","last_clean":"2024-03-09T15:02:19.912444+0000","last_became_active":"2024-03-09T14:42:19.004684+0000","last_became_peered":"2024-03-09T14:42:19.004684+0000","last_unstale":"2024-03-09T15:02:19.912444+0000","last_undegraded":"2024-03-09T15:02:19.912444+0000","last_fullsized":"2024-03-09T15:02:19.912444+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:43:10.037376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"261'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.719317+0000","last_change":"2024-03-09T14:42:15.973483+0000","last_active":"2024-03-09T15:04:49.719317+0000","last_peered":"2024-03-09T15:04:49.719317+0000","last_clean":"2024-03-09T15:04:49.719317+0000","last_became_active":"2024-03-09T14:42:15.972713+0000","last_became_peered":"2024-03-09T14:42:15.972713+0000","last_unstale":"2024-03-09T15:04:49.719317+0000","last_undegraded":"2024-03-09T15:04:49.719317+0000","last_fullsized":"2024-03-09T15:04:49.719317+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'37","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:35.097911+0000","last_change":"2024-03-09T14:39:57.870198+0000","last_active":"2024-03-09T15:06:35.097911+0000","last_peered":"2024-03-09T15:06:35.097911+0000","last_clean":"2024-03-09T15:06:35.097911+0000","last_became_active":"2024-03-09T14:39:57.869392+0000","last_became_peered":"2024-03-09T14:39:57.869392+0000","last_unstale":"2024-03-09T15:06:35.097911+0000","last_undegraded":"2024-03-09T15:06:35.097911+0000","last_fullsized":"2024-03-09T15:06:35.097911+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":118,"num_write":73,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:15.092778+0000","last_change":"2024-03-09T14:49:53.652690+0000","last_active":"2024-03-09T15:06:15.092778+0000","last_peered":"2024-03-09T15:06:15.092778+0000","last_clean":"2024-03-09T15:06:15.092778+0000","last_became_active":"2024-03-09T14:49:53.651987+0000","last_became_peered":"2024-03-09T14:49:53.651987+0000","last_unstale":"2024-03-09T15:06:15.092778+0000","last_undegraded":"2024-03-09T15:06:15.092778+0000","last_fullsized":"2024-03-09T15:06:15.092778+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.975174+0000","last_change":"2024-03-09T14:42:19.294955+0000","last_active":"2024-03-09T15:06:29.975174+0000","last_peered":"2024-03-09T15:06:29.975174+0000","last_clean":"2024-03-09T15:06:29.975174+0000","last_became_active":"2024-03-09T14:42:19.294108+0000","last_became_peered":"2024-03-09T14:42:19.294108+0000","last_unstale":"2024-03-09T15:06:29.975174+0000","last_undegraded":"2024-03-09T15:06:29.975174+0000","last_fullsized":"2024-03-09T15:06:29.975174+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:48:58.874062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.875733+0000","last_change":"2024-03-09T14:42:15.950610+0000","last_active":"2024-03-09T15:03:24.875733+0000","last_peered":"2024-03-09T15:03:24.875733+0000","last_clean":"2024-03-09T15:03:24.875733+0000","last_became_active":"2024-03-09T14:42:15.947591+0000","last_became_peered":"2024-03-09T14:42:15.947591+0000","last_unstale":"2024-03-09T15:03:24.875733+0000","last_undegraded":"2024-03-09T15:03:24.875733+0000","last_fullsized":"2024-03-09T15:03:24.875733+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:54:57.588230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'56","reported_seq":186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.745325+0000","last_change":"2024-03-09T14:39:57.895126+0000","last_active":"2024-03-09T15:06:34.745325+0000","last_peered":"2024-03-09T15:06:34.745325+0000","last_clean":"2024-03-09T15:06:34.745325+0000","last_became_active":"2024-03-09T14:39:57.894370+0000","last_became_peered":"2024-03-09T14:39:57.894370+0000","last_unstale":"2024-03-09T15:06:34.745325+0000","last_undegraded":"2024-03-09T15:06:34.745325+0000","last_fullsized":"2024-03-09T15:06:34.745325+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":182,"num_write":87,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:54.692738+0000","last_change":"2024-03-09T14:49:53.661026+0000","last_active":"2024-03-09T15:03:54.692738+0000","last_peered":"2024-03-09T15:03:54.692738+0000","last_clean":"2024-03-09T15:03:54.692738+0000","last_became_active":"2024-03-09T14:49:53.660291+0000","last_became_peered":"2024-03-09T14:49:53.660291+0000","last_unstale":"2024-03-09T15:03:54.692738+0000","last_undegraded":"2024-03-09T15:03:54.692738+0000","last_fullsized":"2024-03-09T15:03:54.692738+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:48:25.436136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.929184+0000","last_change":"2024-03-09T14:42:19.299865+0000","last_active":"2024-03-09T15:03:24.929184+0000","last_peered":"2024-03-09T15:03:24.929184+0000","last_clean":"2024-03-09T15:03:24.929184+0000","last_became_active":"2024-03-09T14:42:19.294391+0000","last_became_peered":"2024-03-09T14:42:19.294391+0000","last_unstale":"2024-03-09T15:03:24.929184+0000","last_undegraded":"2024-03-09T15:03:24.929184+0000","last_fullsized":"2024-03-09T15:03:24.929184+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:29.593526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.704425+0000","last_change":"2024-03-09T14:42:15.962523+0000","last_active":"2024-03-09T15:04:04.704425+0000","last_peered":"2024-03-09T15:04:04.704425+0000","last_clean":"2024-03-09T15:04:04.704425+0000","last_became_active":"2024-03-09T14:42:15.961751+0000","last_became_peered":"2024-03-09T14:42:15.961751+0000","last_unstale":"2024-03-09T15:04:04.704425+0000","last_undegraded":"2024-03-09T15:04:04.704425+0000","last_fullsized":"2024-03-09T15:04:04.704425+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:20:28.923195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'41","reported_seq":150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.940491+0000","last_change":"2024-03-09T14:39:57.900193+0000","last_active":"2024-03-09T15:04:09.940491+0000","last_peered":"2024-03-09T15:04:09.940491+0000","last_clean":"2024-03-09T15:04:09.940491+0000","last_became_active":"2024-03-09T14:39:57.898651+0000","last_became_peered":"2024-03-09T14:39:57.898651+0000","last_unstale":"2024-03-09T15:04:09.940491+0000","last_undegraded":"2024-03-09T15:04:09.940491+0000","last_fullsized":"2024-03-09T15:04:09.940491+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:57:09.093834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":141,"num_write":58,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:54.701644+0000","last_change":"2024-03-09T14:49:53.677983+0000","last_active":"2024-03-09T15:03:54.701644+0000","last_peered":"2024-03-09T15:03:54.701644+0000","last_clean":"2024-03-09T15:03:54.701644+0000","last_became_active":"2024-03-09T14:49:53.677160+0000","last_became_peered":"2024-03-09T14:49:53.677160+0000","last_unstale":"2024-03-09T15:03:54.701644+0000","last_undegraded":"2024-03-09T15:03:54.701644+0000","last_fullsized":"2024-03-09T15:03:54.701644+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:52:56.789373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.939388+0000","last_change":"2024-03-09T14:42:19.298779+0000","last_active":"2024-03-09T15:04:04.939388+0000","last_peered":"2024-03-09T15:04:04.939388+0000","last_clean":"2024-03-09T15:04:04.939388+0000","last_became_active":"2024-03-09T14:42:19.297984+0000","last_became_peered":"2024-03-09T14:42:19.297984+0000","last_unstale":"2024-03-09T15:04:04.939388+0000","last_undegraded":"2024-03-09T15:04:04.939388+0000","last_fullsized":"2024-03-09T15:04:04.939388+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:39.001468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.695173+0000","last_change":"2024-03-09T14:42:15.959256+0000","last_active":"2024-03-09T15:04:04.695173+0000","last_peered":"2024-03-09T15:04:04.695173+0000","last_clean":"2024-03-09T15:04:04.695173+0000","last_became_active":"2024-03-09T14:42:15.958476+0000","last_became_peered":"2024-03-09T14:42:15.958476+0000","last_unstale":"2024-03-09T15:04:04.695173+0000","last_undegraded":"2024-03-09T15:04:04.695173+0000","last_fullsized":"2024-03-09T15:04:04.695173+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:53:52.388607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'111","reported_seq":374,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.696130+0000","last_change":"2024-03-09T14:39:57.873649+0000","last_active":"2024-03-09T15:04:09.696130+0000","last_peered":"2024-03-09T15:04:09.696130+0000","last_clean":"2024-03-09T15:04:09.696130+0000","last_became_active":"2024-03-09T14:39:57.872922+0000","last_became_peered":"2024-03-09T14:39:57.872922+0000","last_unstale":"2024-03-09T15:04:09.696130+0000","last_undegraded":"2024-03-09T15:04:09.696130+0000","last_fullsized":"2024-03-09T15:04:09.696130+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:27:37.326144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":634,"num_read_kb":458,"num_write":138,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:54.882960+0000","last_change":"2024-03-09T14:49:53.652070+0000","last_active":"2024-03-09T15:03:54.882960+0000","last_peered":"2024-03-09T15:03:54.882960+0000","last_clean":"2024-03-09T15:03:54.882960+0000","last_became_active":"2024-03-09T14:49:53.651353+0000","last_became_peered":"2024-03-09T14:49:53.651353+0000","last_unstale":"2024-03-09T15:03:54.882960+0000","last_undegraded":"2024-03-09T15:03:54.882960+0000","last_fullsized":"2024-03-09T15:03:54.882960+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:38.891462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"261'5","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.700677+0000","last_change":"2024-03-09T14:42:19.015145+0000","last_active":"2024-03-09T15:04:04.700677+0000","last_peered":"2024-03-09T15:04:04.700677+0000","last_clean":"2024-03-09T15:04:04.700677+0000","last_became_active":"2024-03-09T14:42:19.011213+0000","last_became_peered":"2024-03-09T14:42:19.011213+0000","last_unstale":"2024-03-09T15:04:04.700677+0000","last_undegraded":"2024-03-09T15:04:04.700677+0000","last_fullsized":"2024-03-09T15:04:04.700677+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:06:20.548710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'3","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.047855+0000","last_change":"2024-03-09T14:42:15.975026+0000","last_active":"2024-03-09T15:07:03.047855+0000","last_peered":"2024-03-09T15:07:03.047855+0000","last_clean":"2024-03-09T15:07:03.047855+0000","last_became_active":"2024-03-09T14:42:15.974300+0000","last_became_peered":"2024-03-09T14:42:15.974300+0000","last_unstale":"2024-03-09T15:07:03.047855+0000","last_undegraded":"2024-03-09T15:07:03.047855+0000","last_fullsized":"2024-03-09T15:07:03.047855+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'10","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:29.695997+0000","last_change":"2024-03-09T14:39:57.906220+0000","last_active":"2024-03-09T15:03:29.695997+0000","last_peered":"2024-03-09T15:03:29.695997+0000","last_clean":"2024-03-09T15:03:29.695997+0000","last_became_active":"2024-03-09T14:39:57.905161+0000","last_became_peered":"2024-03-09T14:39:57.905161+0000","last_unstale":"2024-03-09T15:03:29.695997+0000","last_undegraded":"2024-03-09T15:03:29.695997+0000","last_fullsized":"2024-03-09T15:03:29.695997+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:43.275061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.944574+0000","last_change":"2024-03-09T14:49:53.677779+0000","last_active":"2024-03-09T15:04:24.944574+0000","last_peered":"2024-03-09T15:04:24.944574+0000","last_clean":"2024-03-09T15:04:24.944574+0000","last_became_active":"2024-03-09T14:49:53.676180+0000","last_became_peered":"2024-03-09T14:49:53.676180+0000","last_unstale":"2024-03-09T15:04:24.944574+0000","last_undegraded":"2024-03-09T15:04:24.944574+0000","last_fullsized":"2024-03-09T15:04:24.944574+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:48.285352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'15","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.711976+0000","last_change":"2024-03-09T14:42:19.015638+0000","last_active":"2024-03-09T15:07:03.711976+0000","last_peered":"2024-03-09T15:07:03.711976+0000","last_clean":"2024-03-09T15:07:03.711976+0000","last_became_active":"2024-03-09T14:42:19.015001+0000","last_became_peered":"2024-03-09T14:42:19.015001+0000","last_unstale":"2024-03-09T15:07:03.711976+0000","last_undegraded":"2024-03-09T15:07:03.711976+0000","last_fullsized":"2024-03-09T15:07:03.711976+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":18444,"num_write":29,"num_write_kb":15365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'8","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:39.721379+0000","last_change":"2024-03-09T14:42:15.937658+0000","last_active":"2024-03-09T15:05:39.721379+0000","last_peered":"2024-03-09T15:05:39.721379+0000","last_clean":"2024-03-09T15:05:39.721379+0000","last_became_active":"2024-03-09T14:42:15.936690+0000","last_became_peered":"2024-03-09T14:42:15.936690+0000","last_unstale":"2024-03-09T15:05:39.721379+0000","last_undegraded":"2024-03-09T15:05:39.721379+0000","last_fullsized":"2024-03-09T15:05:39.721379+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:16:38.693218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'45","reported_seq":154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.693525+0000","last_change":"2024-03-09T14:39:57.900885+0000","last_active":"2024-03-09T15:03:19.693525+0000","last_peered":"2024-03-09T15:03:19.693525+0000","last_clean":"2024-03-09T15:03:19.693525+0000","last_became_active":"2024-03-09T14:39:57.900112+0000","last_became_peered":"2024-03-09T14:39:57.900112+0000","last_unstale":"2024-03-09T15:03:19.693525+0000","last_undegraded":"2024-03-09T15:03:19.693525+0000","last_fullsized":"2024-03-09T15:03:19.693525+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:04:24.272860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":133,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:49.748959+0000","last_change":"2024-03-09T14:49:53.687062+0000","last_active":"2024-03-09T15:06:49.748959+0000","last_peered":"2024-03-09T15:06:49.748959+0000","last_clean":"2024-03-09T15:06:49.748959+0000","last_became_active":"2024-03-09T14:49:53.683189+0000","last_became_peered":"2024-03-09T14:49:53.683189+0000","last_unstale":"2024-03-09T15:06:49.748959+0000","last_undegraded":"2024-03-09T15:06:49.748959+0000","last_fullsized":"2024-03-09T15:06:49.748959+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.982645+0000","last_change":"2024-03-09T14:42:19.009789+0000","last_active":"2024-03-09T15:07:03.982645+0000","last_peered":"2024-03-09T15:07:03.982645+0000","last_clean":"2024-03-09T15:07:03.982645+0000","last_became_active":"2024-03-09T14:42:19.009159+0000","last_became_peered":"2024-03-09T14:42:19.009159+0000","last_unstale":"2024-03-09T15:07:03.982645+0000","last_undegraded":"2024-03-09T15:07:03.982645+0000","last_fullsized":"2024-03-09T15:07:03.982645+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'12","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.523037+0000","last_change":"2024-03-09T14:42:15.954296+0000","last_active":"2024-03-09T15:07:04.523037+0000","last_peered":"2024-03-09T15:07:04.523037+0000","last_clean":"2024-03-09T15:07:04.523037+0000","last_became_active":"2024-03-09T14:42:15.953580+0000","last_became_peered":"2024-03-09T14:42:15.953580+0000","last_unstale":"2024-03-09T15:07:04.523037+0000","last_undegraded":"2024-03-09T15:07:04.523037+0000","last_fullsized":"2024-03-09T15:07:04.523037+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:02:21.500373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":25600,"num_write":27,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'39","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:39.731556+0000","last_change":"2024-03-09T14:39:57.897154+0000","last_active":"2024-03-09T15:05:39.731556+0000","last_peered":"2024-03-09T15:05:39.731556+0000","last_clean":"2024-03-09T15:05:39.731556+0000","last_became_active":"2024-03-09T14:39:57.896549+0000","last_became_peered":"2024-03-09T14:39:57.896549+0000","last_unstale":"2024-03-09T15:05:39.731556+0000","last_undegraded":"2024-03-09T15:05:39.731556+0000","last_fullsized":"2024-03-09T15:05:39.731556+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":110,"num_write":67,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:19.740889+0000","last_change":"2024-03-09T14:49:53.674470+0000","last_active":"2024-03-09T15:06:19.740889+0000","last_peered":"2024-03-09T15:06:19.740889+0000","last_clean":"2024-03-09T15:06:19.740889+0000","last_became_active":"2024-03-09T14:49:53.673345+0000","last_became_peered":"2024-03-09T14:49:53.673345+0000","last_unstale":"2024-03-09T15:06:19.740889+0000","last_undegraded":"2024-03-09T15:06:19.740889+0000","last_fullsized":"2024-03-09T15:06:19.740889+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:39.963872+0000","last_change":"2024-03-09T14:42:19.021679+0000","last_active":"2024-03-09T15:05:39.963872+0000","last_peered":"2024-03-09T15:05:39.963872+0000","last_clean":"2024-03-09T15:05:39.963872+0000","last_became_active":"2024-03-09T14:42:19.020650+0000","last_became_peered":"2024-03-09T14:42:19.020650+0000","last_unstale":"2024-03-09T15:05:39.963872+0000","last_undegraded":"2024-03-09T15:05:39.963872+0000","last_fullsized":"2024-03-09T15:05:39.963872+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:04:12.719156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.688968+0000","last_change":"2024-03-09T14:42:15.959020+0000","last_active":"2024-03-09T15:03:19.688968+0000","last_peered":"2024-03-09T15:03:19.688968+0000","last_clean":"2024-03-09T15:03:19.688968+0000","last_became_active":"2024-03-09T14:42:15.958276+0000","last_became_peered":"2024-03-09T14:42:15.958276+0000","last_unstale":"2024-03-09T15:03:19.688968+0000","last_undegraded":"2024-03-09T15:03:19.688968+0000","last_fullsized":"2024-03-09T15:03:19.688968+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:56:29.405946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'35","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.690399+0000","last_change":"2024-03-09T14:39:57.892474+0000","last_active":"2024-03-09T15:03:19.690399+0000","last_peered":"2024-03-09T15:03:19.690399+0000","last_clean":"2024-03-09T15:03:19.690399+0000","last_became_active":"2024-03-09T14:39:57.891706+0000","last_became_peered":"2024-03-09T14:39:57.891706+0000","last_unstale":"2024-03-09T15:03:19.690399+0000","last_undegraded":"2024-03-09T15:03:19.690399+0000","last_fullsized":"2024-03-09T15:03:19.690399+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:29.216981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":98,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.944492+0000","last_change":"2024-03-09T14:49:53.678730+0000","last_active":"2024-03-09T15:04:24.944492+0000","last_peered":"2024-03-09T15:04:24.944492+0000","last_clean":"2024-03-09T15:04:24.944492+0000","last_became_active":"2024-03-09T14:49:53.670121+0000","last_became_peered":"2024-03-09T14:49:53.670121+0000","last_unstale":"2024-03-09T15:04:24.944492+0000","last_undegraded":"2024-03-09T15:04:24.944492+0000","last_fullsized":"2024-03-09T15:04:24.944492+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:10:05.346364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":32,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.688916+0000","last_change":"2024-03-09T14:42:18.993764+0000","last_active":"2024-03-09T15:03:19.688916+0000","last_peered":"2024-03-09T15:03:19.688916+0000","last_clean":"2024-03-09T15:03:19.688916+0000","last_became_active":"2024-03-09T14:42:18.992996+0000","last_became_peered":"2024-03-09T14:42:18.992996+0000","last_unstale":"2024-03-09T15:03:19.688916+0000","last_undegraded":"2024-03-09T15:03:19.688916+0000","last_fullsized":"2024-03-09T15:03:19.688916+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:13:18.645764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"261'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.874329+0000","last_change":"2024-03-09T14:42:15.950801+0000","last_active":"2024-03-09T15:03:19.874329+0000","last_peered":"2024-03-09T15:03:19.874329+0000","last_clean":"2024-03-09T15:03:19.874329+0000","last_became_active":"2024-03-09T14:42:15.950001+0000","last_became_peered":"2024-03-09T14:42:15.950001+0000","last_unstale":"2024-03-09T15:03:19.874329+0000","last_undegraded":"2024-03-09T15:03:19.874329+0000","last_fullsized":"2024-03-09T15:03:19.874329+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:46:50.557868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'55","reported_seq":168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:19.927771+0000","last_change":"2024-03-09T14:39:57.910603+0000","last_active":"2024-03-09T15:03:19.927771+0000","last_peered":"2024-03-09T15:03:19.927771+0000","last_clean":"2024-03-09T15:03:19.927771+0000","last_became_active":"2024-03-09T14:39:57.909827+0000","last_became_peered":"2024-03-09T14:39:57.909827+0000","last_unstale":"2024-03-09T15:03:19.927771+0000","last_undegraded":"2024-03-09T15:03:19.927771+0000","last_fullsized":"2024-03-09T15:03:19.927771+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:39:16.796198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":147,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:59.680775+0000","last_change":"2024-03-09T14:49:53.642413+0000","last_active":"2024-03-09T15:02:59.680775+0000","last_peered":"2024-03-09T15:02:59.680775+0000","last_clean":"2024-03-09T15:02:59.680775+0000","last_became_active":"2024-03-09T14:49:53.641152+0000","last_became_peered":"2024-03-09T14:49:53.641152+0000","last_unstale":"2024-03-09T15:02:59.680775+0000","last_undegraded":"2024-03-09T15:02:59.680775+0000","last_fullsized":"2024-03-09T15:02:59.680775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:14:59.780475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.071597+0000","last_change":"2024-03-09T14:42:19.015582+0000","last_active":"2024-03-09T15:07:04.071597+0000","last_peered":"2024-03-09T15:07:04.071597+0000","last_clean":"2024-03-09T15:07:04.071597+0000","last_became_active":"2024-03-09T14:42:19.013356+0000","last_became_peered":"2024-03-09T14:42:19.013356+0000","last_unstale":"2024-03-09T15:07:04.071597+0000","last_undegraded":"2024-03-09T15:07:04.071597+0000","last_fullsized":"2024-03-09T15:07:04.071597+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:23.724974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.715863+0000","last_change":"2024-03-09T14:42:15.965456+0000","last_active":"2024-03-09T15:04:49.715863+0000","last_peered":"2024-03-09T15:04:49.715863+0000","last_clean":"2024-03-09T15:04:49.715863+0000","last_became_active":"2024-03-09T14:42:15.964591+0000","last_became_peered":"2024-03-09T14:42:15.964591+0000","last_unstale":"2024-03-09T15:04:49.715863+0000","last_undegraded":"2024-03-09T15:04:49.715863+0000","last_fullsized":"2024-03-09T15:04:49.715863+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:37.614168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'15","reported_seq":84,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:28.710665+0000","last_change":"2024-03-09T14:39:57.901484+0000","last_active":"2024-03-09T15:05:28.710665+0000","last_peered":"2024-03-09T15:05:28.710665+0000","last_clean":"2024-03-09T15:05:28.710665+0000","last_became_active":"2024-03-09T14:39:57.898952+0000","last_became_peered":"2024-03-09T14:39:57.898952+0000","last_unstale":"2024-03-09T15:05:28.710665+0000","last_undegraded":"2024-03-09T15:05:28.710665+0000","last_fullsized":"2024-03-09T15:05:28.710665+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:26:28.443115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":52,"num_write":21,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.694828+0000","last_change":"2024-03-09T14:49:53.654700+0000","last_active":"2024-03-09T15:03:24.694828+0000","last_peered":"2024-03-09T15:03:24.694828+0000","last_clean":"2024-03-09T15:03:24.694828+0000","last_became_active":"2024-03-09T14:49:53.653943+0000","last_became_peered":"2024-03-09T14:49:53.653943+0000","last_unstale":"2024-03-09T15:03:24.694828+0000","last_undegraded":"2024-03-09T15:03:24.694828+0000","last_fullsized":"2024-03-09T15:03:24.694828+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:42:20.322883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.982808+0000","last_change":"2024-03-09T14:42:19.016131+0000","last_active":"2024-03-09T15:07:04.982808+0000","last_peered":"2024-03-09T15:07:04.982808+0000","last_clean":"2024-03-09T15:07:04.982808+0000","last_became_active":"2024-03-09T14:42:19.008729+0000","last_became_peered":"2024-03-09T14:42:19.008729+0000","last_unstale":"2024-03-09T15:07:04.982808+0000","last_undegraded":"2024-03-09T15:07:04.982808+0000","last_fullsized":"2024-03-09T15:07:04.982808+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:26.299678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.705243+0000","last_change":"2024-03-09T14:42:15.979152+0000","last_active":"2024-03-09T15:04:49.705243+0000","last_peered":"2024-03-09T15:04:49.705243+0000","last_clean":"2024-03-09T15:04:49.705243+0000","last_became_active":"2024-03-09T14:42:15.978166+0000","last_became_peered":"2024-03-09T14:42:15.978166+0000","last_unstale":"2024-03-09T15:04:49.705243+0000","last_undegraded":"2024-03-09T15:04:49.705243+0000","last_fullsized":"2024-03-09T15:04:49.705243+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:16.321080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'46","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:44.894221+0000","last_change":"2024-03-09T14:39:57.904419+0000","last_active":"2024-03-09T15:04:44.894221+0000","last_peered":"2024-03-09T15:04:44.894221+0000","last_clean":"2024-03-09T15:04:44.894221+0000","last_became_active":"2024-03-09T14:39:57.904012+0000","last_became_peered":"2024-03-09T14:39:57.904012+0000","last_unstale":"2024-03-09T15:04:44.894221+0000","last_undegraded":"2024-03-09T15:04:44.894221+0000","last_fullsized":"2024-03-09T15:04:44.894221+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:15:51.742502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":131,"num_write":86,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.683364+0000","last_change":"2024-03-09T14:49:53.680169+0000","last_active":"2024-03-09T15:02:54.683364+0000","last_peered":"2024-03-09T15:02:54.683364+0000","last_clean":"2024-03-09T15:02:54.683364+0000","last_became_active":"2024-03-09T14:49:53.678157+0000","last_became_peered":"2024-03-09T14:49:53.678157+0000","last_unstale":"2024-03-09T15:02:54.683364+0000","last_undegraded":"2024-03-09T15:02:54.683364+0000","last_fullsized":"2024-03-09T15:02:54.683364+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:04:53.932617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.104208+0000","last_change":"2024-03-09T14:42:19.296270+0000","last_active":"2024-03-09T15:07:05.104208+0000","last_peered":"2024-03-09T15:07:05.104208+0000","last_clean":"2024-03-09T15:07:05.104208+0000","last_became_active":"2024-03-09T14:42:19.295533+0000","last_became_peered":"2024-03-09T14:42:19.295533+0000","last_unstale":"2024-03-09T15:07:05.104208+0000","last_undegraded":"2024-03-09T15:07:05.104208+0000","last_fullsized":"2024-03-09T15:07:05.104208+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"261'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.752356+0000","last_change":"2024-03-09T14:42:15.968987+0000","last_active":"2024-03-09T15:07:04.752356+0000","last_peered":"2024-03-09T15:07:04.752356+0000","last_clean":"2024-03-09T15:07:04.752356+0000","last_became_active":"2024-03-09T14:42:15.968323+0000","last_became_peered":"2024-03-09T14:42:15.968323+0000","last_unstale":"2024-03-09T15:07:04.752356+0000","last_undegraded":"2024-03-09T15:07:04.752356+0000","last_fullsized":"2024-03-09T15:07:04.752356+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'40","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:44.707473+0000","last_change":"2024-03-09T14:39:57.898866+0000","last_active":"2024-03-09T15:04:44.707473+0000","last_peered":"2024-03-09T15:04:44.707473+0000","last_clean":"2024-03-09T15:04:44.707473+0000","last_became_active":"2024-03-09T14:39:57.898234+0000","last_became_peered":"2024-03-09T14:39:57.898234+0000","last_unstale":"2024-03-09T15:04:44.707473+0000","last_undegraded":"2024-03-09T15:04:44.707473+0000","last_fullsized":"2024-03-09T15:04:44.707473+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:55:57.096082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":111,"num_write":71,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.901778+0000","last_change":"2024-03-09T14:49:53.663589+0000","last_active":"2024-03-09T15:02:54.901778+0000","last_peered":"2024-03-09T15:02:54.901778+0000","last_clean":"2024-03-09T15:02:54.901778+0000","last_became_active":"2024-03-09T14:49:53.662812+0000","last_became_peered":"2024-03-09T14:49:53.662812+0000","last_unstale":"2024-03-09T15:02:54.901778+0000","last_undegraded":"2024-03-09T15:02:54.901778+0000","last_fullsized":"2024-03-09T15:02:54.901778+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:16:14.334955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'7","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.982871+0000","last_change":"2024-03-09T14:42:19.018301+0000","last_active":"2024-03-09T15:07:04.982871+0000","last_peered":"2024-03-09T15:07:04.982871+0000","last_clean":"2024-03-09T15:07:04.982871+0000","last_became_active":"2024-03-09T14:42:19.017434+0000","last_became_peered":"2024-03-09T14:42:19.017434+0000","last_unstale":"2024-03-09T15:07:04.982871+0000","last_undegraded":"2024-03-09T15:07:04.982871+0000","last_fullsized":"2024-03-09T15:07:04.982871+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:08:07.632656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8272,"num_write":12,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.104188+0000","last_change":"2024-03-09T14:42:15.946399+0000","last_active":"2024-03-09T15:07:05.104188+0000","last_peered":"2024-03-09T15:07:05.104188+0000","last_clean":"2024-03-09T15:07:05.104188+0000","last_became_active":"2024-03-09T14:42:15.945565+0000","last_became_peered":"2024-03-09T14:42:15.945565+0000","last_unstale":"2024-03-09T15:07:05.104188+0000","last_undegraded":"2024-03-09T15:07:05.104188+0000","last_fullsized":"2024-03-09T15:07:05.104188+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1029,"num_write":10,"num_write_kb":1029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'55","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:44.703996+0000","last_change":"2024-03-09T14:39:57.901411+0000","last_active":"2024-03-09T15:04:44.703996+0000","last_peered":"2024-03-09T15:04:44.703996+0000","last_clean":"2024-03-09T15:04:44.703996+0000","last_became_active":"2024-03-09T14:39:57.900659+0000","last_became_peered":"2024-03-09T14:39:57.900659+0000","last_unstale":"2024-03-09T15:04:44.703996+0000","last_undegraded":"2024-03-09T15:04:44.703996+0000","last_fullsized":"2024-03-09T15:04:44.703996+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:14.811571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":161,"num_write":89,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.929301+0000","last_change":"2024-03-09T14:49:53.683045+0000","last_active":"2024-03-09T15:03:24.929301+0000","last_peered":"2024-03-09T15:03:24.929301+0000","last_clean":"2024-03-09T15:03:24.929301+0000","last_became_active":"2024-03-09T14:49:53.678822+0000","last_became_peered":"2024-03-09T14:49:53.678822+0000","last_unstale":"2024-03-09T15:03:24.929301+0000","last_undegraded":"2024-03-09T15:03:24.929301+0000","last_fullsized":"2024-03-09T15:03:24.929301+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:34:54.757256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:09.727816+0000","last_change":"2024-03-09T14:42:19.021170+0000","last_active":"2024-03-09T15:06:09.727816+0000","last_peered":"2024-03-09T15:06:09.727816+0000","last_clean":"2024-03-09T15:06:09.727816+0000","last_became_active":"2024-03-09T14:42:19.016262+0000","last_became_peered":"2024-03-09T14:42:19.016262+0000","last_unstale":"2024-03-09T15:06:09.727816+0000","last_undegraded":"2024-03-09T15:06:09.727816+0000","last_fullsized":"2024-03-09T15:06:09.727816+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:11:24.272229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.070080+0000","last_change":"2024-03-09T14:42:15.964302+0000","last_active":"2024-03-09T15:07:05.070080+0000","last_peered":"2024-03-09T15:07:05.070080+0000","last_clean":"2024-03-09T15:07:05.070080+0000","last_became_active":"2024-03-09T14:42:15.963496+0000","last_became_peered":"2024-03-09T14:42:15.963496+0000","last_unstale":"2024-03-09T15:07:05.070080+0000","last_undegraded":"2024-03-09T15:07:05.070080+0000","last_fullsized":"2024-03-09T15:07:05.070080+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'33","reported_seq":121,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:59.751429+0000","last_change":"2024-03-09T14:39:57.879692+0000","last_active":"2024-03-09T15:06:59.751429+0000","last_peered":"2024-03-09T15:06:59.751429+0000","last_clean":"2024-03-09T15:06:59.751429+0000","last_became_active":"2024-03-09T14:39:57.879068+0000","last_became_peered":"2024-03-09T14:39:57.879068+0000","last_unstale":"2024-03-09T15:06:59.751429+0000","last_undegraded":"2024-03-09T15:06:59.751429+0000","last_fullsized":"2024-03-09T15:06:59.751429+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":89,"num_write":57,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:29.696105+0000","last_change":"2024-03-09T14:49:53.666848+0000","last_active":"2024-03-09T15:03:29.696105+0000","last_peered":"2024-03-09T15:03:29.696105+0000","last_clean":"2024-03-09T15:03:29.696105+0000","last_became_active":"2024-03-09T14:49:53.666088+0000","last_became_peered":"2024-03-09T14:49:53.666088+0000","last_unstale":"2024-03-09T15:03:29.696105+0000","last_undegraded":"2024-03-09T15:03:29.696105+0000","last_fullsized":"2024-03-09T15:03:29.696105+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:24:04.438357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:09.735495+0000","last_change":"2024-03-09T14:42:19.288789+0000","last_active":"2024-03-09T15:06:09.735495+0000","last_peered":"2024-03-09T15:06:09.735495+0000","last_clean":"2024-03-09T15:06:09.735495+0000","last_became_active":"2024-03-09T14:42:19.288155+0000","last_became_peered":"2024-03-09T14:42:19.288155+0000","last_unstale":"2024-03-09T15:06:09.735495+0000","last_undegraded":"2024-03-09T15:06:09.735495+0000","last_fullsized":"2024-03-09T15:06:09.735495+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:36:14.730415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:10.091482+0000","last_change":"2024-03-09T14:42:15.962724+0000","last_active":"2024-03-09T15:06:10.091482+0000","last_peered":"2024-03-09T15:06:10.091482+0000","last_clean":"2024-03-09T15:06:10.091482+0000","last_became_active":"2024-03-09T14:42:15.962004+0000","last_became_peered":"2024-03-09T14:42:15.962004+0000","last_unstale":"2024-03-09T15:06:10.091482+0000","last_undegraded":"2024-03-09T15:06:10.091482+0000","last_fullsized":"2024-03-09T15:06:10.091482+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.875140+0000","last_change":"2024-03-09T14:39:57.906667+0000","last_active":"2024-03-09T15:04:04.875140+0000","last_peered":"2024-03-09T15:04:04.875140+0000","last_clean":"2024-03-09T15:04:04.875140+0000","last_became_active":"2024-03-09T14:39:57.906043+0000","last_became_peered":"2024-03-09T14:39:57.906043+0000","last_unstale":"2024-03-09T15:04:04.875140+0000","last_undegraded":"2024-03-09T15:04:04.875140+0000","last_fullsized":"2024-03-09T15:04:04.875140+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:36.853805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":86,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.694884+0000","last_change":"2024-03-09T14:49:53.666880+0000","last_active":"2024-03-09T15:03:24.694884+0000","last_peered":"2024-03-09T15:03:24.694884+0000","last_clean":"2024-03-09T15:03:24.694884+0000","last_became_active":"2024-03-09T14:49:53.666251+0000","last_became_peered":"2024-03-09T14:49:53.666251+0000","last_unstale":"2024-03-09T15:03:24.694884+0000","last_undegraded":"2024-03-09T15:03:24.694884+0000","last_fullsized":"2024-03-09T15:03:24.694884+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:12:56.088402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.104104+0000","last_change":"2024-03-09T14:42:18.999259+0000","last_active":"2024-03-09T15:07:05.104104+0000","last_peered":"2024-03-09T15:07:05.104104+0000","last_clean":"2024-03-09T15:07:05.104104+0000","last_became_active":"2024-03-09T14:42:18.998145+0000","last_became_peered":"2024-03-09T14:42:18.998145+0000","last_unstale":"2024-03-09T15:07:05.104104+0000","last_undegraded":"2024-03-09T15:07:05.104104+0000","last_fullsized":"2024-03-09T15:07:05.104104+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.045398+0000","last_change":"2024-03-09T14:42:15.974356+0000","last_active":"2024-03-09T15:07:03.045398+0000","last_peered":"2024-03-09T15:07:03.045398+0000","last_clean":"2024-03-09T15:07:03.045398+0000","last_became_active":"2024-03-09T14:42:15.973793+0000","last_became_peered":"2024-03-09T14:42:15.973793+0000","last_unstale":"2024-03-09T15:07:03.045398+0000","last_undegraded":"2024-03-09T15:07:03.045398+0000","last_fullsized":"2024-03-09T15:07:03.045398+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'18","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.934890+0000","last_change":"2024-03-09T14:39:57.900299+0000","last_active":"2024-03-09T15:03:49.934890+0000","last_peered":"2024-03-09T15:03:49.934890+0000","last_clean":"2024-03-09T15:03:49.934890+0000","last_became_active":"2024-03-09T14:39:57.895347+0000","last_became_peered":"2024-03-09T14:39:57.895347+0000","last_unstale":"2024-03-09T15:03:49.934890+0000","last_undegraded":"2024-03-09T15:03:49.934890+0000","last_fullsized":"2024-03-09T15:03:49.934890+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:35.906733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":49,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:39.731670+0000","last_change":"2024-03-09T14:49:53.680516+0000","last_active":"2024-03-09T15:05:39.731670+0000","last_peered":"2024-03-09T15:05:39.731670+0000","last_clean":"2024-03-09T15:05:39.731670+0000","last_became_active":"2024-03-09T14:49:53.676907+0000","last_became_peered":"2024-03-09T14:49:53.676907+0000","last_unstale":"2024-03-09T15:05:39.731670+0000","last_undegraded":"2024-03-09T15:05:39.731670+0000","last_fullsized":"2024-03-09T15:05:39.731670+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.705594+0000","last_change":"2024-03-09T14:42:29.985480+0000","last_active":"2024-03-09T15:04:09.705594+0000","last_peered":"2024-03-09T15:04:09.705594+0000","last_clean":"2024-03-09T15:04:09.705594+0000","last_became_active":"2024-03-09T14:42:29.984595+0000","last_became_peered":"2024-03-09T14:42:29.984595+0000","last_unstale":"2024-03-09T15:04:09.705594+0000","last_undegraded":"2024-03-09T15:04:09.705594+0000","last_fullsized":"2024-03-09T15:04:09.705594+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:49:17.181815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'6","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.296106+0000","last_change":"2024-03-09T14:42:15.942495+0000","last_active":"2024-03-09T15:07:05.296106+0000","last_peered":"2024-03-09T15:07:05.296106+0000","last_clean":"2024-03-09T15:07:05.296106+0000","last_became_active":"2024-03-09T14:42:15.941583+0000","last_became_peered":"2024-03-09T14:42:15.941583+0000","last_unstale":"2024-03-09T15:07:05.296106+0000","last_undegraded":"2024-03-09T15:07:05.296106+0000","last_fullsized":"2024-03-09T15:07:05.296106+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:58:21.145613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'16","reported_seq":88,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.695726+0000","last_change":"2024-03-09T14:39:57.886088+0000","last_active":"2024-03-09T15:03:49.695726+0000","last_peered":"2024-03-09T15:03:49.695726+0000","last_clean":"2024-03-09T15:03:49.695726+0000","last_became_active":"2024-03-09T14:39:57.884479+0000","last_became_peered":"2024-03-09T14:39:57.884479+0000","last_unstale":"2024-03-09T15:03:49.695726+0000","last_undegraded":"2024-03-09T15:03:49.695726+0000","last_fullsized":"2024-03-09T15:03:49.695726+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:06:06.518769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":55,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.710399+0000","last_change":"2024-03-09T14:49:53.664600+0000","last_active":"2024-03-09T15:04:29.710399+0000","last_peered":"2024-03-09T15:04:29.710399+0000","last_clean":"2024-03-09T15:04:29.710399+0000","last_became_active":"2024-03-09T14:49:53.663825+0000","last_became_peered":"2024-03-09T14:49:53.663825+0000","last_unstale":"2024-03-09T15:04:29.710399+0000","last_undegraded":"2024-03-09T15:04:29.710399+0000","last_fullsized":"2024-03-09T15:04:29.710399+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:38:11.359908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:19.727291+0000","last_change":"2024-03-09T14:42:18.996069+0000","last_active":"2024-03-09T15:05:19.727291+0000","last_peered":"2024-03-09T15:05:19.727291+0000","last_clean":"2024-03-09T15:05:19.727291+0000","last_became_active":"2024-03-09T14:42:18.995340+0000","last_became_peered":"2024-03-09T14:42:18.995340+0000","last_unstale":"2024-03-09T15:05:19.727291+0000","last_undegraded":"2024-03-09T15:05:19.727291+0000","last_fullsized":"2024-03-09T15:05:19.727291+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.905451+0000","last_change":"2024-03-09T14:42:15.963780+0000","last_active":"2024-03-09T15:03:09.905451+0000","last_peered":"2024-03-09T15:03:09.905451+0000","last_clean":"2024-03-09T15:03:09.905451+0000","last_became_active":"2024-03-09T14:42:15.963155+0000","last_became_peered":"2024-03-09T14:42:15.963155+0000","last_unstale":"2024-03-09T15:03:09.905451+0000","last_undegraded":"2024-03-09T15:03:09.905451+0000","last_fullsized":"2024-03-09T15:03:09.905451+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:17:06.912120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'33","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:59.736576+0000","last_change":"2024-03-09T14:39:57.889247+0000","last_active":"2024-03-09T15:05:59.736576+0000","last_peered":"2024-03-09T15:05:59.736576+0000","last_clean":"2024-03-09T15:05:59.736576+0000","last_became_active":"2024-03-09T14:39:57.888467+0000","last_became_peered":"2024-03-09T14:39:57.888467+0000","last_unstale":"2024-03-09T15:05:59.736576+0000","last_undegraded":"2024-03-09T15:05:59.736576+0000","last_fullsized":"2024-03-09T15:05:59.736576+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":106,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.890833+0000","last_change":"2024-03-09T14:49:53.659073+0000","last_active":"2024-03-09T15:04:29.890833+0000","last_peered":"2024-03-09T15:04:29.890833+0000","last_clean":"2024-03-09T15:04:29.890833+0000","last_became_active":"2024-03-09T14:49:53.658183+0000","last_became_peered":"2024-03-09T14:49:53.658183+0000","last_unstale":"2024-03-09T15:04:29.890833+0000","last_undegraded":"2024-03-09T15:04:29.890833+0000","last_fullsized":"2024-03-09T15:04:29.890833+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:41:48.538335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.985245+0000","last_change":"2024-03-09T14:42:19.295167+0000","last_active":"2024-03-09T15:07:03.985245+0000","last_peered":"2024-03-09T15:07:03.985245+0000","last_clean":"2024-03-09T15:07:03.985245+0000","last_became_active":"2024-03-09T14:42:19.294401+0000","last_became_peered":"2024-03-09T14:42:19.294401+0000","last_unstale":"2024-03-09T15:07:03.985245+0000","last_undegraded":"2024-03-09T15:07:03.985245+0000","last_fullsized":"2024-03-09T15:07:03.985245+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'7","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.370131+0000","last_change":"2024-03-09T14:42:15.975168+0000","last_active":"2024-03-09T15:07:04.370131+0000","last_peered":"2024-03-09T15:07:04.370131+0000","last_clean":"2024-03-09T15:07:04.370131+0000","last_became_active":"2024-03-09T14:42:15.974493+0000","last_became_peered":"2024-03-09T14:42:15.974493+0000","last_unstale":"2024-03-09T15:07:04.370131+0000","last_undegraded":"2024-03-09T15:07:04.370131+0000","last_fullsized":"2024-03-09T15:07:04.370131+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:49:53.666199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5160,"num_write":12,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'28","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.695916+0000","last_change":"2024-03-09T14:39:57.907522+0000","last_active":"2024-03-09T15:03:49.695916+0000","last_peered":"2024-03-09T15:03:49.695916+0000","last_clean":"2024-03-09T15:03:49.695916+0000","last_became_active":"2024-03-09T14:39:57.907009+0000","last_became_peered":"2024-03-09T14:39:57.907009+0000","last_unstale":"2024-03-09T15:03:49.695916+0000","last_undegraded":"2024-03-09T15:03:49.695916+0000","last_fullsized":"2024-03-09T15:03:49.695916+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:27:52.279130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":74,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:55.087821+0000","last_change":"2024-03-09T14:49:53.681028+0000","last_active":"2024-03-09T15:05:55.087821+0000","last_peered":"2024-03-09T15:05:55.087821+0000","last_clean":"2024-03-09T15:05:55.087821+0000","last_became_active":"2024-03-09T14:49:53.680477+0000","last_became_peered":"2024-03-09T14:49:53.680477+0000","last_unstale":"2024-03-09T15:05:55.087821+0000","last_undegraded":"2024-03-09T15:05:55.087821+0000","last_fullsized":"2024-03-09T15:05:55.087821+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.703193+0000","last_change":"2024-03-09T14:42:19.290124+0000","last_active":"2024-03-09T15:03:59.703193+0000","last_peered":"2024-03-09T15:03:59.703193+0000","last_clean":"2024-03-09T15:03:59.703193+0000","last_became_active":"2024-03-09T14:42:19.289487+0000","last_became_peered":"2024-03-09T14:42:19.289487+0000","last_unstale":"2024-03-09T15:03:59.703193+0000","last_undegraded":"2024-03-09T15:03:59.703193+0000","last_fullsized":"2024-03-09T15:03:59.703193+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:53:33.609180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:09.913494+0000","last_change":"2024-03-09T14:42:15.957344+0000","last_active":"2024-03-09T15:06:09.913494+0000","last_peered":"2024-03-09T15:06:09.913494+0000","last_clean":"2024-03-09T15:06:09.913494+0000","last_became_active":"2024-03-09T14:42:15.956648+0000","last_became_peered":"2024-03-09T14:42:15.956648+0000","last_unstale":"2024-03-09T15:06:09.913494+0000","last_undegraded":"2024-03-09T15:06:09.913494+0000","last_fullsized":"2024-03-09T15:06:09.913494+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:56:53.168125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'62","reported_seq":198,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:59.903168+0000","last_change":"2024-03-09T14:39:57.906130+0000","last_active":"2024-03-09T15:02:59.903168+0000","last_peered":"2024-03-09T15:02:59.903168+0000","last_clean":"2024-03-09T15:02:59.903168+0000","last_became_active":"2024-03-09T14:39:57.905410+0000","last_became_peered":"2024-03-09T14:39:57.905410+0000","last_unstale":"2024-03-09T15:02:59.903168+0000","last_undegraded":"2024-03-09T15:02:59.903168+0000","last_fullsized":"2024-03-09T15:02:59.903168+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:50:45.243291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":193,"num_write":94,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.706106+0000","last_change":"2024-03-09T14:49:53.658895+0000","last_active":"2024-03-09T15:04:29.706106+0000","last_peered":"2024-03-09T15:04:29.706106+0000","last_clean":"2024-03-09T15:04:29.706106+0000","last_became_active":"2024-03-09T14:49:53.658190+0000","last_became_peered":"2024-03-09T14:49:53.658190+0000","last_unstale":"2024-03-09T15:04:29.706106+0000","last_undegraded":"2024-03-09T15:04:29.706106+0000","last_fullsized":"2024-03-09T15:04:29.706106+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:31:23.260028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'5","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:09.727994+0000","last_change":"2024-03-09T14:42:19.020830+0000","last_active":"2024-03-09T15:06:09.727994+0000","last_peered":"2024-03-09T15:06:09.727994+0000","last_clean":"2024-03-09T15:06:09.727994+0000","last_became_active":"2024-03-09T14:42:19.013977+0000","last_became_peered":"2024-03-09T14:42:19.013977+0000","last_unstale":"2024-03-09T15:06:09.727994+0000","last_undegraded":"2024-03-09T15:06:09.727994+0000","last_fullsized":"2024-03-09T15:06:09.727994+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:02:04.141033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":5,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.703218+0000","last_change":"2024-03-09T14:42:15.961048+0000","last_active":"2024-03-09T15:03:59.703218+0000","last_peered":"2024-03-09T15:03:59.703218+0000","last_clean":"2024-03-09T15:03:59.703218+0000","last_became_active":"2024-03-09T14:42:15.960225+0000","last_became_peered":"2024-03-09T14:42:15.960225+0000","last_unstale":"2024-03-09T15:03:59.703218+0000","last_undegraded":"2024-03-09T15:03:59.703218+0000","last_fullsized":"2024-03-09T15:03:59.703218+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:20:39.859217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'130","reported_seq":432,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.104127+0000","last_change":"2024-03-09T14:39:57.893265+0000","last_active":"2024-03-09T15:07:05.104127+0000","last_peered":"2024-03-09T15:07:05.104127+0000","last_clean":"2024-03-09T15:07:05.104127+0000","last_became_active":"2024-03-09T14:39:57.892592+0000","last_became_peered":"2024-03-09T14:39:57.892592+0000","last_unstale":"2024-03-09T15:07:05.104127+0000","last_undegraded":"2024-03-09T15:07:05.104127+0000","last_fullsized":"2024-03-09T15:07:05.104127+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":739,"num_read_kb":529,"num_write":173,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.679735+0000","last_change":"2024-03-09T14:49:53.672983+0000","last_active":"2024-03-09T15:02:54.679735+0000","last_peered":"2024-03-09T15:02:54.679735+0000","last_clean":"2024-03-09T15:02:54.679735+0000","last_became_active":"2024-03-09T14:49:53.672292+0000","last_became_peered":"2024-03-09T14:49:53.672292+0000","last_unstale":"2024-03-09T15:02:54.679735+0000","last_undegraded":"2024-03-09T15:02:54.679735+0000","last_fullsized":"2024-03-09T15:02:54.679735+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:45:38.980243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:15.075245+0000","last_change":"2024-03-09T14:42:19.004206+0000","last_active":"2024-03-09T15:05:15.075245+0000","last_peered":"2024-03-09T15:05:15.075245+0000","last_clean":"2024-03-09T15:05:15.075245+0000","last_became_active":"2024-03-09T14:42:19.002083+0000","last_became_peered":"2024-03-09T14:42:19.002083+0000","last_unstale":"2024-03-09T15:05:15.075245+0000","last_undegraded":"2024-03-09T15:05:15.075245+0000","last_fullsized":"2024-03-09T15:05:15.075245+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'5","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.710240+0000","last_change":"2024-03-09T14:42:15.976503+0000","last_active":"2024-03-09T15:04:29.710240+0000","last_peered":"2024-03-09T15:04:29.710240+0000","last_clean":"2024-03-09T15:04:29.710240+0000","last_became_active":"2024-03-09T14:42:15.975956+0000","last_became_peered":"2024-03-09T14:42:15.975956+0000","last_unstale":"2024-03-09T15:04:29.710240+0000","last_undegraded":"2024-03-09T15:04:29.710240+0000","last_fullsized":"2024-03-09T15:04:29.710240+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:51:51.535147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'35","reported_seq":132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.897602+0000","last_change":"2024-03-09T14:39:57.887500+0000","last_active":"2024-03-09T15:04:59.897602+0000","last_peered":"2024-03-09T15:04:59.897602+0000","last_clean":"2024-03-09T15:04:59.897602+0000","last_became_active":"2024-03-09T14:39:57.886792+0000","last_became_peered":"2024-03-09T14:39:57.886792+0000","last_unstale":"2024-03-09T15:04:59.897602+0000","last_undegraded":"2024-03-09T15:04:59.897602+0000","last_fullsized":"2024-03-09T15:04:59.897602+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:48:32.831728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":107,"num_write":66,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:04.723449+0000","last_change":"2024-03-09T14:49:53.687783+0000","last_active":"2024-03-09T15:05:04.723449+0000","last_peered":"2024-03-09T15:05:04.723449+0000","last_clean":"2024-03-09T15:05:04.723449+0000","last_became_active":"2024-03-09T14:49:53.683703+0000","last_became_peered":"2024-03-09T14:49:53.683703+0000","last_unstale":"2024-03-09T15:05:04.723449+0000","last_undegraded":"2024-03-09T15:05:04.723449+0000","last_fullsized":"2024-03-09T15:05:04.723449+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.916629+0000","last_change":"2024-03-09T14:42:19.014096+0000","last_active":"2024-03-09T15:06:24.916629+0000","last_peered":"2024-03-09T15:06:24.916629+0000","last_clean":"2024-03-09T15:06:24.916629+0000","last_became_active":"2024-03-09T14:42:19.013372+0000","last_became_peered":"2024-03-09T14:42:19.013372+0000","last_unstale":"2024-03-09T15:06:24.916629+0000","last_undegraded":"2024-03-09T15:06:24.916629+0000","last_fullsized":"2024-03-09T15:06:24.916629+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:33:04.031449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"261'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.905329+0000","last_change":"2024-03-09T14:42:15.955016+0000","last_active":"2024-03-09T15:03:09.905329+0000","last_peered":"2024-03-09T15:03:09.905329+0000","last_clean":"2024-03-09T15:03:09.905329+0000","last_became_active":"2024-03-09T14:42:15.954274+0000","last_became_peered":"2024-03-09T14:42:15.954274+0000","last_unstale":"2024-03-09T15:03:09.905329+0000","last_undegraded":"2024-03-09T15:03:09.905329+0000","last_fullsized":"2024-03-09T15:03:09.905329+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:33:32.985487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'59","reported_seq":199,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.712470+0000","last_change":"2024-03-09T14:39:57.902294+0000","last_active":"2024-03-09T15:04:59.712470+0000","last_peered":"2024-03-09T15:04:59.712470+0000","last_clean":"2024-03-09T15:04:59.712470+0000","last_became_active":"2024-03-09T14:39:57.901599+0000","last_became_peered":"2024-03-09T14:39:57.901599+0000","last_unstale":"2024-03-09T15:04:59.712470+0000","last_undegraded":"2024-03-09T15:04:59.712470+0000","last_fullsized":"2024-03-09T15:04:59.712470+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:02:52.013131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":206,"num_write":96,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.745057+0000","last_change":"2024-03-09T14:49:53.681958+0000","last_active":"2024-03-09T15:06:34.745057+0000","last_peered":"2024-03-09T15:06:34.745057+0000","last_clean":"2024-03-09T15:06:34.745057+0000","last_became_active":"2024-03-09T14:49:53.681327+0000","last_became_peered":"2024-03-09T14:49:53.681327+0000","last_unstale":"2024-03-09T15:06:34.745057+0000","last_undegraded":"2024-03-09T15:06:34.745057+0000","last_fullsized":"2024-03-09T15:06:34.745057+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:09.686795+0000","last_change":"2024-03-09T14:42:19.020053+0000","last_active":"2024-03-09T15:03:09.686795+0000","last_peered":"2024-03-09T15:03:09.686795+0000","last_clean":"2024-03-09T15:03:09.686795+0000","last_became_active":"2024-03-09T14:42:19.019151+0000","last_became_peered":"2024-03-09T14:42:19.019151+0000","last_unstale":"2024-03-09T15:03:09.686795+0000","last_undegraded":"2024-03-09T15:03:09.686795+0000","last_fullsized":"2024-03-09T15:03:09.686795+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:33:06.100480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.917635+0000","last_change":"2024-03-09T15:07:09.917661+0000","last_active":"2024-03-09T15:07:09.917635+0000","last_peered":"2024-03-09T15:07:09.917635+0000","last_clean":"2024-03-09T15:07:09.917635+0000","last_became_active":"2024-03-09T14:42:15.959503+0000","last_became_peered":"2024-03-09T14:42:15.959503+0000","last_unstale":"2024-03-09T15:07:09.917635+0000","last_undegraded":"2024-03-09T15:07:09.917635+0000","last_fullsized":"2024-03-09T15:07:09.917635+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:09.917534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:09.917534+0000","last_clean_scrub_stamp":"2024-03-09T15:07:09.917534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:08.292151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'13","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.710516+0000","last_change":"2024-03-09T14:39:57.896340+0000","last_active":"2024-03-09T15:04:59.710516+0000","last_peered":"2024-03-09T15:04:59.710516+0000","last_clean":"2024-03-09T15:04:59.710516+0000","last_became_active":"2024-03-09T14:39:57.895579+0000","last_became_peered":"2024-03-09T14:39:57.895579+0000","last_unstale":"2024-03-09T15:04:59.710516+0000","last_undegraded":"2024-03-09T15:04:59.710516+0000","last_fullsized":"2024-03-09T15:04:59.710516+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:50.092894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:34.711774+0000","last_change":"2024-03-09T14:49:53.681449+0000","last_active":"2024-03-09T15:04:34.711774+0000","last_peered":"2024-03-09T15:04:34.711774+0000","last_clean":"2024-03-09T15:04:34.711774+0000","last_became_active":"2024-03-09T14:49:53.680782+0000","last_became_peered":"2024-03-09T14:49:53.680782+0000","last_unstale":"2024-03-09T15:04:34.711774+0000","last_undegraded":"2024-03-09T15:04:34.711774+0000","last_fullsized":"2024-03-09T15:04:34.711774+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:47:13.858756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:14.716083+0000","last_change":"2024-03-09T14:42:19.021910+0000","last_active":"2024-03-09T15:05:14.716083+0000","last_peered":"2024-03-09T15:05:14.716083+0000","last_clean":"2024-03-09T15:05:14.716083+0000","last_became_active":"2024-03-09T14:42:19.020789+0000","last_became_peered":"2024-03-09T14:42:19.020789+0000","last_unstale":"2024-03-09T15:05:14.716083+0000","last_undegraded":"2024-03-09T15:05:14.716083+0000","last_fullsized":"2024-03-09T15:05:14.716083+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:45:01.147814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'7","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:14.714197+0000","last_change":"2024-03-09T14:42:15.961112+0000","last_active":"2024-03-09T15:05:14.714197+0000","last_peered":"2024-03-09T15:05:14.714197+0000","last_clean":"2024-03-09T15:05:14.714197+0000","last_became_active":"2024-03-09T14:42:15.960341+0000","last_became_peered":"2024-03-09T14:42:15.960341+0000","last_unstale":"2024-03-09T15:05:14.714197+0000","last_undegraded":"2024-03-09T15:05:14.714197+0000","last_fullsized":"2024-03-09T15:05:14.714197+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:19:05.030621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":20522,"num_write":11,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'42","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.705495+0000","last_change":"2024-03-09T14:39:57.898959+0000","last_active":"2024-03-09T15:04:09.705495+0000","last_peered":"2024-03-09T15:04:09.705495+0000","last_clean":"2024-03-09T15:04:09.705495+0000","last_became_active":"2024-03-09T14:39:57.898267+0000","last_became_peered":"2024-03-09T14:39:57.898267+0000","last_unstale":"2024-03-09T15:04:09.705495+0000","last_undegraded":"2024-03-09T15:04:09.705495+0000","last_fullsized":"2024-03-09T15:04:09.705495+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:00:24.847765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":119,"num_write":82,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'300","reported_seq":1040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.276570+0000","last_change":"2024-03-09T14:28:53.624341+0000","last_active":"2024-03-09T15:07:05.276570+0000","last_peered":"2024-03-09T15:07:05.276570+0000","last_clean":"2024-03-09T15:07:05.276570+0000","last_became_active":"2024-03-09T14:28:53.623701+0000","last_became_peered":"2024-03-09T14:28:53.623701+0000","last_unstale":"2024-03-09T15:07:05.276570+0000","last_undegraded":"2024-03-09T15:07:05.276570+0000","last_fullsized":"2024-03-09T15:07:05.276570+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:38.200914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":756,"num_read_kb":36473,"num_write":1139,"num_write_kb":31503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'692","reported_seq":2207,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.442129+0000","last_change":"2024-03-09T14:28:55.575692+0000","last_active":"2024-03-09T15:06:42.442129+0000","last_peered":"2024-03-09T15:06:42.442129+0000","last_clean":"2024-03-09T15:06:42.442129+0000","last_became_active":"2024-03-09T14:28:55.574984+0000","last_became_peered":"2024-03-09T14:28:55.574984+0000","last_unstale":"2024-03-09T15:06:42.442129+0000","last_undegraded":"2024-03-09T15:06:42.442129+0000","last_fullsized":"2024-03-09T15:06:42.442129+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:07.026587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3313,"num_read_kb":2995,"num_write":917,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'302","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.383582+0000","last_change":"2024-03-09T14:28:53.626962+0000","last_active":"2024-03-09T15:07:05.383582+0000","last_peered":"2024-03-09T15:07:05.383582+0000","last_clean":"2024-03-09T15:07:05.383582+0000","last_became_active":"2024-03-09T14:28:53.626490+0000","last_became_peered":"2024-03-09T14:28:53.626490+0000","last_unstale":"2024-03-09T15:07:05.383582+0000","last_undegraded":"2024-03-09T15:07:05.383582+0000","last_fullsized":"2024-03-09T15:07:05.383582+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5265769,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":463,"num_read_kb":36382,"num_write":1100,"num_write_kb":36054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'348","reported_seq":1729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.522825+0000","last_change":"2024-03-09T14:28:55.592370+0000","last_active":"2024-03-09T15:06:32.522825+0000","last_peered":"2024-03-09T15:06:32.522825+0000","last_clean":"2024-03-09T15:06:32.522825+0000","last_became_active":"2024-03-09T14:28:55.591640+0000","last_became_peered":"2024-03-09T14:28:55.591640+0000","last_unstale":"2024-03-09T15:06:32.522825+0000","last_undegraded":"2024-03-09T15:06:32.522825+0000","last_fullsized":"2024-03-09T15:06:32.522825+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:10.597479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1906,"num_read_kb":1805,"num_write":411,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'330","reported_seq":1045,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.414538+0000","last_change":"2024-03-09T14:29:28.828234+0000","last_active":"2024-03-09T15:07:05.414538+0000","last_peered":"2024-03-09T15:07:05.414538+0000","last_clean":"2024-03-09T15:07:05.414538+0000","last_became_active":"2024-03-09T14:29:28.827096+0000","last_became_peered":"2024-03-09T14:29:28.827096+0000","last_unstale":"2024-03-09T15:07:05.414538+0000","last_undegraded":"2024-03-09T15:07:05.414538+0000","last_fullsized":"2024-03-09T15:07:05.414538+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:43.226590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262173,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":589,"num_read_kb":23096,"num_write":1233,"num_write_kb":39906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,7],"acting":[3,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"264'398","reported_seq":1882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.439715+0000","last_change":"2024-03-09T14:28:55.571747+0000","last_active":"2024-03-09T15:06:42.439715+0000","last_peered":"2024-03-09T15:06:42.439715+0000","last_clean":"2024-03-09T15:06:42.439715+0000","last_became_active":"2024-03-09T14:28:55.570930+0000","last_became_peered":"2024-03-09T14:28:55.570930+0000","last_unstale":"2024-03-09T15:06:42.439715+0000","last_undegraded":"2024-03-09T15:06:42.439715+0000","last_fullsized":"2024-03-09T15:06:42.439715+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:55:13.704377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2164,"num_read_kb":2043,"num_write":472,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'297","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.205791+0000","last_change":"2024-03-09T14:28:53.605127+0000","last_active":"2024-03-09T15:07:05.205791+0000","last_peered":"2024-03-09T15:07:05.205791+0000","last_clean":"2024-03-09T15:07:05.205791+0000","last_became_active":"2024-03-09T14:28:53.603454+0000","last_became_peered":"2024-03-09T14:28:53.603454+0000","last_unstale":"2024-03-09T15:07:05.205791+0000","last_undegraded":"2024-03-09T15:07:05.205791+0000","last_fullsized":"2024-03-09T15:07:05.205791+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:11:31.442216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":6538,"num_write":1185,"num_write_kb":12238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'433","reported_seq":1936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.742151+0000","last_change":"2024-03-09T14:28:55.611079+0000","last_active":"2024-03-09T15:06:24.742151+0000","last_peered":"2024-03-09T15:06:24.742151+0000","last_clean":"2024-03-09T15:06:24.742151+0000","last_became_active":"2024-03-09T14:28:55.610360+0000","last_became_peered":"2024-03-09T14:28:55.610360+0000","last_unstale":"2024-03-09T15:06:24.742151+0000","last_undegraded":"2024-03-09T15:06:24.742151+0000","last_fullsized":"2024-03-09T15:06:24.742151+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2375,"num_read_kb":2224,"num_write":558,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'339","reported_seq":981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.248910+0000","last_change":"2024-03-09T14:28:53.624123+0000","last_active":"2024-03-09T15:07:05.248910+0000","last_peered":"2024-03-09T15:07:05.248910+0000","last_clean":"2024-03-09T15:07:05.248910+0000","last_became_active":"2024-03-09T14:28:53.622689+0000","last_became_peered":"2024-03-09T14:28:53.622689+0000","last_unstale":"2024-03-09T15:07:05.248910+0000","last_undegraded":"2024-03-09T15:07:05.248910+0000","last_fullsized":"2024-03-09T15:07:05.248910+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:35:07.478864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9722121,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":529,"num_read_kb":7528,"num_write":1253,"num_write_kb":32260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'361","reported_seq":1916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.497289+0000","last_change":"2024-03-09T14:28:55.594992+0000","last_active":"2024-03-09T15:06:53.497289+0000","last_peered":"2024-03-09T15:06:53.497289+0000","last_clean":"2024-03-09T15:06:53.497289+0000","last_became_active":"2024-03-09T14:28:55.588204+0000","last_became_peered":"2024-03-09T14:28:55.588204+0000","last_unstale":"2024-03-09T15:06:53.497289+0000","last_undegraded":"2024-03-09T15:06:53.497289+0000","last_fullsized":"2024-03-09T15:06:53.497289+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:08:51.680835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2088,"num_read_kb":2012,"num_write":400,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'366","reported_seq":1069,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.300581+0000","last_change":"2024-03-09T14:28:53.605882+0000","last_active":"2024-03-09T15:07:05.300581+0000","last_peered":"2024-03-09T15:07:05.300581+0000","last_clean":"2024-03-09T15:07:05.300581+0000","last_became_active":"2024-03-09T14:28:53.604391+0000","last_became_peered":"2024-03-09T14:28:53.604391+0000","last_unstale":"2024-03-09T15:07:05.300581+0000","last_undegraded":"2024-03-09T15:07:05.300581+0000","last_fullsized":"2024-03-09T15:07:05.300581+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:59:20.682629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":836,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":748,"num_read_kb":3295,"num_write":1231,"num_write_kb":34124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'790","reported_seq":2517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.519848+0000","last_change":"2024-03-09T14:28:55.572158+0000","last_active":"2024-03-09T15:06:32.519848+0000","last_peered":"2024-03-09T15:06:32.519848+0000","last_clean":"2024-03-09T15:06:32.519848+0000","last_became_active":"2024-03-09T14:28:55.571291+0000","last_became_peered":"2024-03-09T14:28:55.571291+0000","last_unstale":"2024-03-09T15:06:32.519848+0000","last_undegraded":"2024-03-09T15:06:32.519848+0000","last_fullsized":"2024-03-09T15:06:32.519848+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:13.639955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3843,"num_read_kb":3494,"num_write":1039,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'393","reported_seq":1054,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.408790+0000","last_change":"2024-03-09T14:28:53.619197+0000","last_active":"2024-03-09T15:07:05.408790+0000","last_peered":"2024-03-09T15:07:05.408790+0000","last_clean":"2024-03-09T15:07:05.408790+0000","last_became_active":"2024-03-09T14:28:53.618259+0000","last_became_peered":"2024-03-09T14:28:53.618259+0000","last_unstale":"2024-03-09T15:07:05.408790+0000","last_undegraded":"2024-03-09T15:07:05.408790+0000","last_fullsized":"2024-03-09T15:07:05.408790+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:17:48.901903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243711,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":574,"num_read_kb":8008,"num_write":1507,"num_write_kb":37535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'416","reported_seq":2018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:30.937626+0000","last_change":"2024-03-09T14:28:55.588359+0000","last_active":"2024-03-09T15:06:30.937626+0000","last_peered":"2024-03-09T15:06:30.937626+0000","last_clean":"2024-03-09T15:06:30.937626+0000","last_became_active":"2024-03-09T14:28:55.587626+0000","last_became_peered":"2024-03-09T14:28:55.587626+0000","last_unstale":"2024-03-09T15:06:30.937626+0000","last_undegraded":"2024-03-09T15:06:30.937626+0000","last_fullsized":"2024-03-09T15:06:30.937626+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:11:15.692803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2314,"num_read_kb":2202,"num_write":483,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'331","reported_seq":960,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.319480+0000","last_change":"2024-03-09T14:28:53.589649+0000","last_active":"2024-03-09T15:07:05.319480+0000","last_peered":"2024-03-09T15:07:05.319480+0000","last_clean":"2024-03-09T15:07:05.319480+0000","last_became_active":"2024-03-09T14:28:53.589232+0000","last_became_peered":"2024-03-09T14:28:53.589232+0000","last_unstale":"2024-03-09T15:07:05.319480+0000","last_undegraded":"2024-03-09T15:07:05.319480+0000","last_fullsized":"2024-03-09T15:07:05.319480+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:39:52.724655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":42616,"num_write":1235,"num_write_kb":40647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'928","reported_seq":2692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.479559+0000","last_change":"2024-03-09T14:28:55.603210+0000","last_active":"2024-03-09T15:06:53.479559+0000","last_peered":"2024-03-09T15:06:53.479559+0000","last_clean":"2024-03-09T15:06:53.479559+0000","last_became_active":"2024-03-09T14:28:55.602477+0000","last_became_peered":"2024-03-09T14:28:55.602477+0000","last_unstale":"2024-03-09T15:06:53.479559+0000","last_undegraded":"2024-03-09T15:06:53.479559+0000","last_fullsized":"2024-03-09T15:06:53.479559+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:09:50.068938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4605,"num_read_kb":4102,"num_write":1299,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'353","reported_seq":1797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.436373+0000","last_change":"2024-03-09T14:28:55.571793+0000","last_active":"2024-03-09T15:06:42.436373+0000","last_peered":"2024-03-09T15:06:42.436373+0000","last_clean":"2024-03-09T15:06:42.436373+0000","last_became_active":"2024-03-09T14:28:55.570861+0000","last_became_peered":"2024-03-09T14:28:55.570861+0000","last_unstale":"2024-03-09T15:06:42.436373+0000","last_undegraded":"2024-03-09T15:06:42.436373+0000","last_fullsized":"2024-03-09T15:06:42.436373+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:59:27.495054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1960,"num_read_kb":1866,"num_write":405,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'351","reported_seq":1038,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.339619+0000","last_change":"2024-03-09T14:28:53.608951+0000","last_active":"2024-03-09T15:07:05.339619+0000","last_peered":"2024-03-09T15:07:05.339619+0000","last_clean":"2024-03-09T15:07:05.339619+0000","last_became_active":"2024-03-09T14:28:53.607915+0000","last_became_peered":"2024-03-09T14:28:53.607915+0000","last_unstale":"2024-03-09T15:07:05.339619+0000","last_undegraded":"2024-03-09T15:07:05.339619+0000","last_fullsized":"2024-03-09T15:07:05.339619+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:57.850290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5273368,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":78573,"num_write":1337,"num_write_kb":47168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'819","reported_seq":2221,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.471725+0000","last_change":"2024-03-09T14:28:55.592675+0000","last_active":"2024-03-09T15:06:53.471725+0000","last_peered":"2024-03-09T15:06:53.471725+0000","last_clean":"2024-03-09T15:06:53.471725+0000","last_became_active":"2024-03-09T14:28:55.591884+0000","last_became_peered":"2024-03-09T14:28:55.591884+0000","last_unstale":"2024-03-09T15:06:53.471725+0000","last_undegraded":"2024-03-09T15:06:53.471725+0000","last_fullsized":"2024-03-09T15:06:53.471725+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:10:17.105445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3579,"num_read_kb":3134,"num_write":1128,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'247","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.339120+0000","last_change":"2024-03-09T14:28:53.638241+0000","last_active":"2024-03-09T15:07:05.339120+0000","last_peered":"2024-03-09T15:07:05.339120+0000","last_clean":"2024-03-09T15:07:05.339120+0000","last_became_active":"2024-03-09T14:28:53.635735+0000","last_became_peered":"2024-03-09T14:28:53.635735+0000","last_unstale":"2024-03-09T15:07:05.339120+0000","last_undegraded":"2024-03-09T15:07:05.339120+0000","last_fullsized":"2024-03-09T15:07:05.339120+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:44:09.619974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":452,"num_read_kb":101132,"num_write":981,"num_write_kb":27272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'365","reported_seq":1868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.435386+0000","last_change":"2024-03-09T14:28:55.590086+0000","last_active":"2024-03-09T15:06:42.435386+0000","last_peered":"2024-03-09T15:06:42.435386+0000","last_clean":"2024-03-09T15:06:42.435386+0000","last_became_active":"2024-03-09T14:28:55.589360+0000","last_became_peered":"2024-03-09T14:28:55.589360+0000","last_unstale":"2024-03-09T15:06:42.435386+0000","last_undegraded":"2024-03-09T15:06:42.435386+0000","last_fullsized":"2024-03-09T15:06:42.435386+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:02.064740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2092,"num_write":426,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'318","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.399236+0000","last_change":"2024-03-09T14:28:53.638187+0000","last_active":"2024-03-09T15:07:05.399236+0000","last_peered":"2024-03-09T15:07:05.399236+0000","last_clean":"2024-03-09T15:07:05.399236+0000","last_became_active":"2024-03-09T14:28:53.635713+0000","last_became_peered":"2024-03-09T14:28:53.635713+0000","last_unstale":"2024-03-09T15:07:05.399236+0000","last_undegraded":"2024-03-09T15:07:05.399236+0000","last_fullsized":"2024-03-09T15:07:05.399236+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:54:41.702227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1830670,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":532,"num_read_kb":101700,"num_write":1117,"num_write_kb":55747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'1330","reported_seq":2999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.480828+0000","last_change":"2024-03-09T14:28:55.602534+0000","last_active":"2024-03-09T15:06:53.480828+0000","last_peered":"2024-03-09T15:06:53.480828+0000","last_clean":"2024-03-09T15:06:53.480828+0000","last_became_active":"2024-03-09T14:28:55.602235+0000","last_became_peered":"2024-03-09T14:28:55.602235+0000","last_unstale":"2024-03-09T15:06:53.480828+0000","last_undegraded":"2024-03-09T15:06:53.480828+0000","last_fullsized":"2024-03-09T15:06:53.480828+0000","mapping_epoch":25,"log_start":"264'1300","ondisk_log_start":"264'1300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:37.897038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5607,"num_read_kb":4937,"num_write":1889,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'441","reported_seq":1108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.343763+0000","last_change":"2024-03-09T14:29:28.825001+0000","last_active":"2024-03-09T15:07:05.343763+0000","last_peered":"2024-03-09T15:07:05.343763+0000","last_clean":"2024-03-09T15:07:05.343763+0000","last_became_active":"2024-03-09T14:29:28.823751+0000","last_became_peered":"2024-03-09T14:29:28.823751+0000","last_unstale":"2024-03-09T15:07:05.343763+0000","last_undegraded":"2024-03-09T15:07:05.343763+0000","last_fullsized":"2024-03-09T15:07:05.343763+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:51:51.410458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262230,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":811,"num_read_kb":6645,"num_write":1426,"num_write_kb":15242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,0],"acting":[2,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"264'438","reported_seq":2021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.377980+0000","last_change":"2024-03-09T14:28:55.575476+0000","last_active":"2024-03-09T15:06:38.377980+0000","last_peered":"2024-03-09T15:06:38.377980+0000","last_clean":"2024-03-09T15:06:38.377980+0000","last_became_active":"2024-03-09T14:28:55.574645+0000","last_became_peered":"2024-03-09T14:28:55.574645+0000","last_unstale":"2024-03-09T15:06:38.377980+0000","last_undegraded":"2024-03-09T15:06:38.377980+0000","last_fullsized":"2024-03-09T15:06:38.377980+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:13:49.646435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2503,"num_read_kb":2358,"num_write":585,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'378","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.371545+0000","last_change":"2024-03-09T14:28:53.619764+0000","last_active":"2024-03-09T15:07:05.371545+0000","last_peered":"2024-03-09T15:07:05.371545+0000","last_clean":"2024-03-09T15:07:05.371545+0000","last_became_active":"2024-03-09T14:28:53.619291+0000","last_became_peered":"2024-03-09T14:28:53.619291+0000","last_unstale":"2024-03-09T15:07:05.371545+0000","last_undegraded":"2024-03-09T15:07:05.371545+0000","last_fullsized":"2024-03-09T15:07:05.371545+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:23:18.730889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505224,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":587,"num_read_kb":88953,"num_write":1364,"num_write_kb":34328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'358","reported_seq":1902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.473697+0000","last_change":"2024-03-09T14:28:55.563774+0000","last_active":"2024-03-09T15:06:53.473697+0000","last_peered":"2024-03-09T15:06:53.473697+0000","last_clean":"2024-03-09T15:06:53.473697+0000","last_became_active":"2024-03-09T14:28:55.563041+0000","last_became_peered":"2024-03-09T14:28:55.563041+0000","last_unstale":"2024-03-09T15:06:53.473697+0000","last_undegraded":"2024-03-09T15:06:53.473697+0000","last_fullsized":"2024-03-09T15:06:53.473697+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:57.726313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2055,"num_read_kb":1986,"num_write":393,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'413","reported_seq":1095,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.391552+0000","last_change":"2024-03-09T14:28:53.586359+0000","last_active":"2024-03-09T15:07:05.391552+0000","last_peered":"2024-03-09T15:07:05.391552+0000","last_clean":"2024-03-09T15:07:05.391552+0000","last_became_active":"2024-03-09T14:28:53.585880+0000","last_became_peered":"2024-03-09T14:28:53.585880+0000","last_unstale":"2024-03-09T15:07:05.391552+0000","last_undegraded":"2024-03-09T15:07:05.391552+0000","last_fullsized":"2024-03-09T15:07:05.391552+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22734,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":653,"num_read_kb":65524,"num_write":1383,"num_write_kb":24882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'120","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:26.294126+0000","last_change":"2024-03-09T14:29:03.661025+0000","last_active":"2024-03-09T15:06:26.294126+0000","last_peered":"2024-03-09T15:06:26.294126+0000","last_clean":"2024-03-09T15:06:26.294126+0000","last_became_active":"2024-03-09T14:29:03.660224+0000","last_became_peered":"2024-03-09T14:29:03.660224+0000","last_unstale":"2024-03-09T15:06:26.294126+0000","last_undegraded":"2024-03-09T15:06:26.294126+0000","last_fullsized":"2024-03-09T15:06:26.294126+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:52.780401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":112,"num_write":285,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'399","reported_seq":1864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.290586+0000","last_change":"2024-03-09T14:28:55.598495+0000","last_active":"2024-03-09T15:06:41.290586+0000","last_peered":"2024-03-09T15:06:41.290586+0000","last_clean":"2024-03-09T15:06:41.290586+0000","last_became_active":"2024-03-09T14:28:55.596404+0000","last_became_peered":"2024-03-09T14:28:55.596404+0000","last_unstale":"2024-03-09T15:06:41.290586+0000","last_undegraded":"2024-03-09T15:06:41.290586+0000","last_fullsized":"2024-03-09T15:06:41.290586+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:01:23.717950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2183,"num_read_kb":2049,"num_write":485,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'309","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.344564+0000","last_change":"2024-03-09T14:28:53.610969+0000","last_active":"2024-03-09T15:07:05.344564+0000","last_peered":"2024-03-09T15:07:05.344564+0000","last_clean":"2024-03-09T15:07:05.344564+0000","last_became_active":"2024-03-09T14:28:53.610073+0000","last_became_peered":"2024-03-09T14:28:53.610073+0000","last_unstale":"2024-03-09T15:07:05.344564+0000","last_undegraded":"2024-03-09T15:07:05.344564+0000","last_fullsized":"2024-03-09T15:07:05.344564+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:36.026110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145852,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":1412,"num_write":1145,"num_write_kb":31021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.867610+0000","last_change":"2024-03-09T14:28:57.606795+0000","last_active":"2024-03-09T15:02:49.867610+0000","last_peered":"2024-03-09T15:02:49.867610+0000","last_clean":"2024-03-09T15:02:49.867610+0000","last_became_active":"2024-03-09T14:28:57.606062+0000","last_became_peered":"2024-03-09T14:28:57.606062+0000","last_unstale":"2024-03-09T15:02:49.867610+0000","last_undegraded":"2024-03-09T15:02:49.867610+0000","last_fullsized":"2024-03-09T15:02:49.867610+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:20:55.983665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'319","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.207933+0000","last_change":"2024-03-09T14:28:59.622695+0000","last_active":"2024-03-09T15:07:05.207933+0000","last_peered":"2024-03-09T15:07:05.207933+0000","last_clean":"2024-03-09T15:07:05.207933+0000","last_became_active":"2024-03-09T14:28:59.622357+0000","last_became_peered":"2024-03-09T14:28:59.622357+0000","last_unstale":"2024-03-09T15:07:05.207933+0000","last_undegraded":"2024-03-09T15:07:05.207933+0000","last_fullsized":"2024-03-09T15:07:05.207933+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":1106,"num_write":404,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.902045+0000","last_change":"2024-03-09T14:29:01.637387+0000","last_active":"2024-03-09T15:02:54.902045+0000","last_peered":"2024-03-09T15:02:54.902045+0000","last_clean":"2024-03-09T15:02:54.902045+0000","last_became_active":"2024-03-09T14:29:01.636497+0000","last_became_peered":"2024-03-09T14:29:01.636497+0000","last_unstale":"2024-03-09T15:02:54.902045+0000","last_undegraded":"2024-03-09T15:02:54.902045+0000","last_fullsized":"2024-03-09T15:02:54.902045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:20:55.356981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2460","reported_seq":4883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.842069+0000","last_change":"2024-03-09T14:29:03.667138+0000","last_active":"2024-03-09T15:06:53.842069+0000","last_peered":"2024-03-09T15:06:53.842069+0000","last_clean":"2024-03-09T15:06:53.842069+0000","last_became_active":"2024-03-09T14:29:03.664933+0000","last_became_peered":"2024-03-09T14:29:03.664933+0000","last_unstale":"2024-03-09T15:06:53.842069+0000","last_undegraded":"2024-03-09T15:06:53.842069+0000","last_fullsized":"2024-03-09T15:06:53.842069+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":2400,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:18:59.045000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6733,"num_read_kb":6729,"num_write":4969,"num_write_kb":1822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'420","reported_seq":1996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.091742+0000","last_change":"2024-03-09T14:28:55.595855+0000","last_active":"2024-03-09T15:06:27.091742+0000","last_peered":"2024-03-09T15:06:27.091742+0000","last_clean":"2024-03-09T15:06:27.091742+0000","last_became_active":"2024-03-09T14:28:55.594120+0000","last_became_peered":"2024-03-09T14:28:55.594120+0000","last_unstale":"2024-03-09T15:06:27.091742+0000","last_undegraded":"2024-03-09T15:06:27.091742+0000","last_fullsized":"2024-03-09T15:06:27.091742+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:33:22.109526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2334,"num_read_kb":2217,"num_write":521,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'343","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.391337+0000","last_change":"2024-03-09T14:28:53.592039+0000","last_active":"2024-03-09T15:07:05.391337+0000","last_peered":"2024-03-09T15:07:05.391337+0000","last_clean":"2024-03-09T15:07:05.391337+0000","last_became_active":"2024-03-09T14:28:53.589914+0000","last_became_peered":"2024-03-09T14:28:53.589914+0000","last_unstale":"2024-03-09T15:07:05.391337+0000","last_undegraded":"2024-03-09T15:07:05.391337+0000","last_fullsized":"2024-03-09T15:07:05.391337+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097178,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":36278,"num_write":1215,"num_write_kb":26714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.939219+0000","last_change":"2024-03-09T14:28:57.609556+0000","last_active":"2024-03-09T15:04:04.939219+0000","last_peered":"2024-03-09T15:04:04.939219+0000","last_clean":"2024-03-09T15:04:04.939219+0000","last_became_active":"2024-03-09T14:28:57.608444+0000","last_became_peered":"2024-03-09T14:28:57.608444+0000","last_unstale":"2024-03-09T15:04:04.939219+0000","last_undegraded":"2024-03-09T15:04:04.939219+0000","last_fullsized":"2024-03-09T15:04:04.939219+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:54.351478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'65","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.201008+0000","last_change":"2024-03-09T14:28:59.615503+0000","last_active":"2024-03-09T15:04:49.201008+0000","last_peered":"2024-03-09T15:04:49.201008+0000","last_clean":"2024-03-09T15:04:49.201008+0000","last_became_active":"2024-03-09T14:28:59.614144+0000","last_became_peered":"2024-03-09T14:28:59.614144+0000","last_unstale":"2024-03-09T15:04:49.201008+0000","last_undegraded":"2024-03-09T15:04:49.201008+0000","last_fullsized":"2024-03-09T15:04:49.201008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:26:26.621561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":74,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:54.684839+0000","last_change":"2024-03-09T14:29:01.650515+0000","last_active":"2024-03-09T15:02:54.684839+0000","last_peered":"2024-03-09T15:02:54.684839+0000","last_clean":"2024-03-09T15:02:54.684839+0000","last_became_active":"2024-03-09T14:29:01.649716+0000","last_became_peered":"2024-03-09T14:29:01.649716+0000","last_unstale":"2024-03-09T15:02:54.684839+0000","last_undegraded":"2024-03-09T15:02:54.684839+0000","last_fullsized":"2024-03-09T15:02:54.684839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:50:00.172206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'128","reported_seq":626,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.744881+0000","last_change":"2024-03-09T14:29:03.677339+0000","last_active":"2024-03-09T15:06:34.744881+0000","last_peered":"2024-03-09T15:06:34.744881+0000","last_clean":"2024-03-09T15:06:34.744881+0000","last_became_active":"2024-03-09T14:29:03.676427+0000","last_became_peered":"2024-03-09T14:29:03.676427+0000","last_unstale":"2024-03-09T15:06:34.744881+0000","last_undegraded":"2024-03-09T15:06:34.744881+0000","last_fullsized":"2024-03-09T15:06:34.744881+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":126,"num_write":288,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'348","reported_seq":1730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:28.258356+0000","last_change":"2024-03-09T14:29:28.734389+0000","last_active":"2024-03-09T15:06:28.258356+0000","last_peered":"2024-03-09T15:06:28.258356+0000","last_clean":"2024-03-09T15:06:28.258356+0000","last_became_active":"2024-03-09T14:29:28.733522+0000","last_became_peered":"2024-03-09T14:29:28.733522+0000","last_unstale":"2024-03-09T15:06:28.258356+0000","last_undegraded":"2024-03-09T15:06:28.258356+0000","last_fullsized":"2024-03-09T15:06:28.258356+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1907,"num_read_kb":1804,"num_write":410,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'332","reported_seq":946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.249709+0000","last_change":"2024-03-09T14:28:53.633910+0000","last_active":"2024-03-09T15:07:05.249709+0000","last_peered":"2024-03-09T15:07:05.249709+0000","last_clean":"2024-03-09T15:07:05.249709+0000","last_became_active":"2024-03-09T14:28:53.633368+0000","last_became_peered":"2024-03-09T14:28:53.633368+0000","last_unstale":"2024-03-09T15:07:05.249709+0000","last_undegraded":"2024-03-09T15:07:05.249709+0000","last_fullsized":"2024-03-09T15:07:05.249709+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:26.540977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1917981,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":440,"num_read_kb":7245,"num_write":1144,"num_write_kb":29598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.920522+0000","last_change":"2024-03-09T14:28:57.614611+0000","last_active":"2024-03-09T15:02:49.920522+0000","last_peered":"2024-03-09T15:02:49.920522+0000","last_clean":"2024-03-09T15:02:49.920522+0000","last_became_active":"2024-03-09T14:28:57.613841+0000","last_became_peered":"2024-03-09T14:28:57.613841+0000","last_unstale":"2024-03-09T15:02:49.920522+0000","last_undegraded":"2024-03-09T15:02:49.920522+0000","last_fullsized":"2024-03-09T15:02:49.920522+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:44.586932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'103","reported_seq":630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.727031+0000","last_change":"2024-03-09T14:28:59.619913+0000","last_active":"2024-03-09T15:06:29.727031+0000","last_peered":"2024-03-09T15:06:29.727031+0000","last_clean":"2024-03-09T15:06:29.727031+0000","last_became_active":"2024-03-09T14:28:59.619147+0000","last_became_peered":"2024-03-09T14:28:59.619147+0000","last_unstale":"2024-03-09T15:06:29.727031+0000","last_undegraded":"2024-03-09T15:06:29.727031+0000","last_fullsized":"2024-03-09T15:06:29.727031+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:54:42.905183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":102,"num_write":78,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'535","reported_seq":3848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.910201+0000","last_change":"2024-03-09T14:29:01.637642+0000","last_active":"2024-03-09T15:07:04.910201+0000","last_peered":"2024-03-09T15:07:04.910201+0000","last_clean":"2024-03-09T15:07:04.910201+0000","last_became_active":"2024-03-09T14:29:01.636743+0000","last_became_peered":"2024-03-09T14:29:01.636743+0000","last_unstale":"2024-03-09T15:07:04.910201+0000","last_undegraded":"2024-03-09T15:07:04.910201+0000","last_fullsized":"2024-03-09T15:07:04.910201+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:58:02.166987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'197","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:20.713069+0000","last_change":"2024-03-09T14:29:03.649992+0000","last_active":"2024-03-09T15:06:20.713069+0000","last_peered":"2024-03-09T15:06:20.713069+0000","last_clean":"2024-03-09T15:06:20.713069+0000","last_became_active":"2024-03-09T14:29:03.649194+0000","last_became_peered":"2024-03-09T14:29:03.649194+0000","last_unstale":"2024-03-09T15:06:20.713069+0000","last_undegraded":"2024-03-09T15:06:20.713069+0000","last_fullsized":"2024-03-09T15:06:20.713069+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:30:46.290792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":551,"num_read_kb":549,"num_write":426,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'370","reported_seq":1843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:56.287432+0000","last_change":"2024-03-09T14:28:55.597244+0000","last_active":"2024-03-09T15:05:56.287432+0000","last_peered":"2024-03-09T15:05:56.287432+0000","last_clean":"2024-03-09T15:05:56.287432+0000","last_became_active":"2024-03-09T14:28:55.592359+0000","last_became_peered":"2024-03-09T14:28:55.592359+0000","last_unstale":"2024-03-09T15:05:56.287432+0000","last_undegraded":"2024-03-09T15:05:56.287432+0000","last_fullsized":"2024-03-09T15:05:56.287432+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:59.078312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2105,"num_read_kb":2015,"num_write":416,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'285","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.379062+0000","last_change":"2024-03-09T14:28:53.632702+0000","last_active":"2024-03-09T15:07:05.379062+0000","last_peered":"2024-03-09T15:07:05.379062+0000","last_clean":"2024-03-09T15:07:05.379062+0000","last_became_active":"2024-03-09T14:28:53.631559+0000","last_became_peered":"2024-03-09T14:28:53.631559+0000","last_unstale":"2024-03-09T15:07:05.379062+0000","last_undegraded":"2024-03-09T15:07:05.379062+0000","last_fullsized":"2024-03-09T15:07:05.379062+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:01:04.705294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8554550,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":396,"num_read_kb":6712,"num_write":1052,"num_write_kb":20730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.867656+0000","last_change":"2024-03-09T14:28:57.606488+0000","last_active":"2024-03-09T15:02:49.867656+0000","last_peered":"2024-03-09T15:02:49.867656+0000","last_clean":"2024-03-09T15:02:49.867656+0000","last_became_active":"2024-03-09T14:28:57.605787+0000","last_became_peered":"2024-03-09T14:28:57.605787+0000","last_unstale":"2024-03-09T15:02:49.867656+0000","last_undegraded":"2024-03-09T15:02:49.867656+0000","last_fullsized":"2024-03-09T15:02:49.867656+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:36:26.152998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'243","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.807389+0000","last_change":"2024-03-09T14:28:59.627011+0000","last_active":"2024-03-09T15:07:04.807389+0000","last_peered":"2024-03-09T15:07:04.807389+0000","last_clean":"2024-03-09T15:07:04.807389+0000","last_became_active":"2024-03-09T14:28:59.626279+0000","last_became_peered":"2024-03-09T14:28:59.626279+0000","last_unstale":"2024-03-09T15:07:04.807389+0000","last_undegraded":"2024-03-09T15:07:04.807389+0000","last_fullsized":"2024-03-09T15:07:04.807389+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:16:34.909728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":970,"num_write":334,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'586","reported_seq":1929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.239983+0000","last_change":"2024-03-09T14:29:01.629131+0000","last_active":"2024-03-09T15:07:05.239983+0000","last_peered":"2024-03-09T15:07:05.239983+0000","last_clean":"2024-03-09T15:07:05.239983+0000","last_became_active":"2024-03-09T14:29:01.628420+0000","last_became_peered":"2024-03-09T14:29:01.628420+0000","last_unstale":"2024-03-09T15:07:05.239983+0000","last_undegraded":"2024-03-09T15:07:05.239983+0000","last_fullsized":"2024-03-09T15:07:05.239983+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:38.918481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'514","reported_seq":2116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:33.802719+0000","last_change":"2024-03-09T14:28:55.583472+0000","last_active":"2024-03-09T15:06:33.802719+0000","last_peered":"2024-03-09T15:06:33.802719+0000","last_clean":"2024-03-09T15:06:33.802719+0000","last_became_active":"2024-03-09T14:28:55.582638+0000","last_became_peered":"2024-03-09T14:28:55.582638+0000","last_unstale":"2024-03-09T15:06:33.802719+0000","last_undegraded":"2024-03-09T15:06:33.802719+0000","last_fullsized":"2024-03-09T15:06:33.802719+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:37:10.517715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2835,"num_read_kb":2627,"num_write":675,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'339","reported_seq":960,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.226873+0000","last_change":"2024-03-09T14:28:53.615478+0000","last_active":"2024-03-09T15:07:05.226873+0000","last_peered":"2024-03-09T15:07:05.226873+0000","last_clean":"2024-03-09T15:07:05.226873+0000","last_became_active":"2024-03-09T14:28:53.614586+0000","last_became_peered":"2024-03-09T14:28:53.614586+0000","last_unstale":"2024-03-09T15:07:05.226873+0000","last_undegraded":"2024-03-09T15:07:05.226873+0000","last_fullsized":"2024-03-09T15:07:05.226873+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:26:26.454638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180167,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":10439,"num_write":1256,"num_write_kb":25392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:39.698275+0000","last_change":"2024-03-09T14:28:57.604178+0000","last_active":"2024-03-09T15:03:39.698275+0000","last_peered":"2024-03-09T15:03:39.698275+0000","last_clean":"2024-03-09T15:03:39.698275+0000","last_became_active":"2024-03-09T14:28:57.603233+0000","last_became_peered":"2024-03-09T14:28:57.603233+0000","last_unstale":"2024-03-09T15:03:39.698275+0000","last_undegraded":"2024-03-09T15:03:39.698275+0000","last_fullsized":"2024-03-09T15:03:39.698275+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:12.919139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'332","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.751254+0000","last_change":"2024-03-09T14:28:59.627283+0000","last_active":"2024-03-09T15:07:02.751254+0000","last_peered":"2024-03-09T15:07:02.751254+0000","last_clean":"2024-03-09T15:07:02.751254+0000","last_became_active":"2024-03-09T14:28:59.626371+0000","last_became_peered":"2024-03-09T14:28:59.626371+0000","last_unstale":"2024-03-09T15:07:02.751254+0000","last_undegraded":"2024-03-09T15:07:02.751254+0000","last_fullsized":"2024-03-09T15:07:02.751254+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:29:20.179850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46990,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":561,"num_read_kb":1214,"num_write":446,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:05.073027+0000","last_change":"2024-03-09T14:29:01.637753+0000","last_active":"2024-03-09T15:05:05.073027+0000","last_peered":"2024-03-09T15:05:05.073027+0000","last_clean":"2024-03-09T15:05:05.073027+0000","last_became_active":"2024-03-09T14:29:01.636735+0000","last_became_peered":"2024-03-09T14:29:01.636735+0000","last_unstale":"2024-03-09T15:05:05.073027+0000","last_undegraded":"2024-03-09T15:05:05.073027+0000","last_fullsized":"2024-03-09T15:05:05.073027+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'542","reported_seq":1364,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.504334+0000","last_change":"2024-03-09T14:29:03.676776+0000","last_active":"2024-03-09T15:06:55.504334+0000","last_peered":"2024-03-09T15:06:55.504334+0000","last_clean":"2024-03-09T15:06:55.504334+0000","last_became_active":"2024-03-09T14:29:03.676068+0000","last_became_peered":"2024-03-09T14:29:03.676068+0000","last_unstale":"2024-03-09T15:06:55.504334+0000","last_undegraded":"2024-03-09T15:06:55.504334+0000","last_fullsized":"2024-03-09T15:06:55.504334+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:53:03.331837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1331,"num_read_kb":1310,"num_write":1143,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'505","reported_seq":2110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.476263+0000","last_change":"2024-03-09T14:28:55.563572+0000","last_active":"2024-03-09T15:06:53.476263+0000","last_peered":"2024-03-09T15:06:53.476263+0000","last_clean":"2024-03-09T15:06:53.476263+0000","last_became_active":"2024-03-09T14:28:55.562782+0000","last_became_peered":"2024-03-09T14:28:55.562782+0000","last_unstale":"2024-03-09T15:06:53.476263+0000","last_undegraded":"2024-03-09T15:06:53.476263+0000","last_fullsized":"2024-03-09T15:06:53.476263+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:34:08.148515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2703,"num_read_kb":2505,"num_write":654,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'320","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.422050+0000","last_change":"2024-03-09T14:28:53.614539+0000","last_active":"2024-03-09T15:07:05.422050+0000","last_peered":"2024-03-09T15:07:05.422050+0000","last_clean":"2024-03-09T15:07:05.422050+0000","last_became_active":"2024-03-09T14:28:53.613015+0000","last_became_peered":"2024-03-09T14:28:53.613015+0000","last_unstale":"2024-03-09T15:07:05.422050+0000","last_undegraded":"2024-03-09T15:07:05.422050+0000","last_fullsized":"2024-03-09T15:07:05.422050+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:43:30.232179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":493,"num_read_kb":9909,"num_write":1175,"num_write_kb":22337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:39.689387+0000","last_change":"2024-03-09T14:28:57.605938+0000","last_active":"2024-03-09T15:03:39.689387+0000","last_peered":"2024-03-09T15:03:39.689387+0000","last_clean":"2024-03-09T15:03:39.689387+0000","last_became_active":"2024-03-09T14:28:57.605493+0000","last_became_peered":"2024-03-09T14:28:57.605493+0000","last_unstale":"2024-03-09T15:03:39.689387+0000","last_undegraded":"2024-03-09T15:03:39.689387+0000","last_fullsized":"2024-03-09T15:03:39.689387+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:08:58.747971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'263","reported_seq":821,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.976449+0000","last_change":"2024-03-09T14:28:59.615074+0000","last_active":"2024-03-09T15:07:03.976449+0000","last_peered":"2024-03-09T15:07:03.976449+0000","last_clean":"2024-03-09T15:07:03.976449+0000","last_became_active":"2024-03-09T14:28:59.614640+0000","last_became_peered":"2024-03-09T14:28:59.614640+0000","last_unstale":"2024-03-09T15:07:03.976449+0000","last_undegraded":"2024-03-09T15:07:03.976449+0000","last_fullsized":"2024-03-09T15:07:03.976449+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:55:14.804093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43961,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1047,"num_write":356,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.934983+0000","last_change":"2024-03-09T14:29:01.628631+0000","last_active":"2024-03-09T15:03:49.934983+0000","last_peered":"2024-03-09T15:03:49.934983+0000","last_clean":"2024-03-09T15:03:49.934983+0000","last_became_active":"2024-03-09T14:29:01.627897+0000","last_became_peered":"2024-03-09T14:29:01.627897+0000","last_unstale":"2024-03-09T15:03:49.934983+0000","last_undegraded":"2024-03-09T15:03:49.934983+0000","last_fullsized":"2024-03-09T15:03:49.934983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:56:12.214362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'106","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:21.867785+0000","last_change":"2024-03-09T14:29:03.673997+0000","last_active":"2024-03-09T15:06:21.867785+0000","last_peered":"2024-03-09T15:06:21.867785+0000","last_clean":"2024-03-09T15:06:21.867785+0000","last_became_active":"2024-03-09T14:29:03.673265+0000","last_became_peered":"2024-03-09T14:29:03.673265+0000","last_unstale":"2024-03-09T15:06:21.867785+0000","last_undegraded":"2024-03-09T15:06:21.867785+0000","last_fullsized":"2024-03-09T15:06:21.867785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:26:29.254697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":93,"num_write":248,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'556","reported_seq":2185,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.336610+0000","last_change":"2024-03-09T14:28:55.595155+0000","last_active":"2024-03-09T15:06:24.336610+0000","last_peered":"2024-03-09T15:06:24.336610+0000","last_clean":"2024-03-09T15:06:24.336610+0000","last_became_active":"2024-03-09T14:28:55.588092+0000","last_became_peered":"2024-03-09T14:28:55.588092+0000","last_unstale":"2024-03-09T15:06:24.336610+0000","last_undegraded":"2024-03-09T15:06:24.336610+0000","last_fullsized":"2024-03-09T15:06:24.336610+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:04:55.020928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2916,"num_read_kb":2661,"num_write":728,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'301","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.381471+0000","last_change":"2024-03-09T14:29:28.824146+0000","last_active":"2024-03-09T15:07:05.381471+0000","last_peered":"2024-03-09T15:07:05.381471+0000","last_clean":"2024-03-09T15:07:05.381471+0000","last_became_active":"2024-03-09T14:29:28.822971+0000","last_became_peered":"2024-03-09T14:29:28.822971+0000","last_unstale":"2024-03-09T15:07:05.381471+0000","last_undegraded":"2024-03-09T15:07:05.381471+0000","last_fullsized":"2024-03-09T15:07:05.381471+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:05:04.090335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262197,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":365,"num_read_kb":22880,"num_write":991,"num_write_kb":75728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:44.677095+0000","last_change":"2024-03-09T14:28:57.610888+0000","last_active":"2024-03-09T15:02:44.677095+0000","last_peered":"2024-03-09T15:02:44.677095+0000","last_clean":"2024-03-09T15:02:44.677095+0000","last_became_active":"2024-03-09T14:28:57.610472+0000","last_became_peered":"2024-03-09T14:28:57.610472+0000","last_unstale":"2024-03-09T15:02:44.677095+0000","last_undegraded":"2024-03-09T15:02:44.677095+0000","last_fullsized":"2024-03-09T15:02:44.677095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:44:44.084587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'303","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.936163+0000","last_change":"2024-03-09T14:28:59.613949+0000","last_active":"2024-03-09T15:07:02.936163+0000","last_peered":"2024-03-09T15:07:02.936163+0000","last_clean":"2024-03-09T15:07:02.936163+0000","last_became_active":"2024-03-09T14:28:59.610930+0000","last_became_peered":"2024-03-09T14:28:59.610930+0000","last_unstale":"2024-03-09T15:07:02.936163+0000","last_undegraded":"2024-03-09T15:07:02.936163+0000","last_fullsized":"2024-03-09T15:07:02.936163+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:18:06.308383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48936,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":498,"num_read_kb":1136,"num_write":410,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'561","reported_seq":2054,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.435911+0000","last_change":"2024-03-09T14:29:01.648142+0000","last_active":"2024-03-09T15:07:05.435911+0000","last_peered":"2024-03-09T15:07:05.435911+0000","last_clean":"2024-03-09T15:07:05.435911+0000","last_became_active":"2024-03-09T14:29:01.647361+0000","last_became_peered":"2024-03-09T14:29:01.647361+0000","last_unstale":"2024-03-09T15:07:05.435911+0000","last_undegraded":"2024-03-09T15:07:05.435911+0000","last_fullsized":"2024-03-09T15:07:05.435911+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'137","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:30.949164+0000","last_change":"2024-03-09T14:29:03.666545+0000","last_active":"2024-03-09T15:06:30.949164+0000","last_peered":"2024-03-09T15:06:30.949164+0000","last_clean":"2024-03-09T15:06:30.949164+0000","last_became_active":"2024-03-09T14:29:03.665744+0000","last_became_peered":"2024-03-09T14:29:03.665744+0000","last_unstale":"2024-03-09T15:06:30.949164+0000","last_undegraded":"2024-03-09T15:06:30.949164+0000","last_fullsized":"2024-03-09T15:06:30.949164+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'380","reported_seq":1994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.437294+0000","last_change":"2024-03-09T14:28:55.587716+0000","last_active":"2024-03-09T15:07:09.437294+0000","last_peered":"2024-03-09T15:07:09.437294+0000","last_clean":"2024-03-09T15:07:09.437294+0000","last_became_active":"2024-03-09T14:28:55.587413+0000","last_became_peered":"2024-03-09T14:28:55.587413+0000","last_unstale":"2024-03-09T15:07:09.437294+0000","last_undegraded":"2024-03-09T15:07:09.437294+0000","last_fullsized":"2024-03-09T15:07:09.437294+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2251,"num_read_kb":2175,"num_write":432,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'286","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.242579+0000","last_change":"2024-03-09T14:28:53.640425+0000","last_active":"2024-03-09T15:07:05.242579+0000","last_peered":"2024-03-09T15:07:05.242579+0000","last_clean":"2024-03-09T15:07:05.242579+0000","last_became_active":"2024-03-09T14:28:53.639073+0000","last_became_peered":"2024-03-09T14:28:53.639073+0000","last_unstale":"2024-03-09T15:07:05.242579+0000","last_undegraded":"2024-03-09T15:07:05.242579+0000","last_fullsized":"2024-03-09T15:07:05.242579+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:47:18.874857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656710,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":422,"num_read_kb":3405,"num_write":1144,"num_write_kb":27946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:49.691482+0000","last_change":"2024-03-09T14:28:57.620565+0000","last_active":"2024-03-09T15:03:49.691482+0000","last_peered":"2024-03-09T15:03:49.691482+0000","last_clean":"2024-03-09T15:03:49.691482+0000","last_became_active":"2024-03-09T14:28:57.620037+0000","last_became_peered":"2024-03-09T14:28:57.620037+0000","last_unstale":"2024-03-09T15:03:49.691482+0000","last_undegraded":"2024-03-09T15:03:49.691482+0000","last_fullsized":"2024-03-09T15:03:49.691482+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:17:42.157517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'470","reported_seq":1091,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.264346+0000","last_change":"2024-03-09T14:28:59.626702+0000","last_active":"2024-03-09T15:07:04.264346+0000","last_peered":"2024-03-09T15:07:04.264346+0000","last_clean":"2024-03-09T15:07:04.264346+0000","last_became_active":"2024-03-09T14:28:59.625949+0000","last_became_peered":"2024-03-09T14:28:59.625949+0000","last_unstale":"2024-03-09T15:07:04.264346+0000","last_undegraded":"2024-03-09T15:07:04.264346+0000","last_fullsized":"2024-03-09T15:07:04.264346+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84476,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":828,"num_read_kb":2021,"num_write":686,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:44.690461+0000","last_change":"2024-03-09T14:29:01.620598+0000","last_active":"2024-03-09T15:03:44.690461+0000","last_peered":"2024-03-09T15:03:44.690461+0000","last_clean":"2024-03-09T15:03:44.690461+0000","last_became_active":"2024-03-09T14:29:01.620136+0000","last_became_peered":"2024-03-09T14:29:01.620136+0000","last_unstale":"2024-03-09T15:03:44.690461+0000","last_undegraded":"2024-03-09T15:03:44.690461+0000","last_fullsized":"2024-03-09T15:03:44.690461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:15:33.969272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'157","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.923153+0000","last_change":"2024-03-09T14:29:03.674681+0000","last_active":"2024-03-09T15:06:39.923153+0000","last_peered":"2024-03-09T15:06:39.923153+0000","last_clean":"2024-03-09T15:06:39.923153+0000","last_became_active":"2024-03-09T14:29:03.673216+0000","last_became_peered":"2024-03-09T14:29:03.673216+0000","last_unstale":"2024-03-09T15:06:39.923153+0000","last_undegraded":"2024-03-09T15:06:39.923153+0000","last_fullsized":"2024-03-09T15:06:39.923153+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":100,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":716,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":343,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'284","reported_seq":1636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.459636+0000","last_change":"2024-03-09T14:28:55.575944+0000","last_active":"2024-03-09T15:06:42.459636+0000","last_peered":"2024-03-09T15:06:42.459636+0000","last_clean":"2024-03-09T15:06:42.459636+0000","last_became_active":"2024-03-09T14:28:55.575211+0000","last_became_peered":"2024-03-09T14:28:55.575211+0000","last_unstale":"2024-03-09T15:06:42.459636+0000","last_undegraded":"2024-03-09T15:06:42.459636+0000","last_fullsized":"2024-03-09T15:06:42.459636+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:01:47.496592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1639,"num_read_kb":1592,"num_write":307,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'315","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.422578+0000","last_change":"2024-03-09T14:28:53.562474+0000","last_active":"2024-03-09T15:07:05.422578+0000","last_peered":"2024-03-09T15:07:05.422578+0000","last_clean":"2024-03-09T15:07:05.422578+0000","last_became_active":"2024-03-09T14:28:53.561769+0000","last_became_peered":"2024-03-09T14:28:53.561769+0000","last_unstale":"2024-03-09T15:07:05.422578+0000","last_undegraded":"2024-03-09T15:07:05.422578+0000","last_fullsized":"2024-03-09T15:07:05.422578+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:49:13.573028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":556,"num_read_kb":46371,"num_write":1232,"num_write_kb":14767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:44.677212+0000","last_change":"2024-03-09T14:28:57.606747+0000","last_active":"2024-03-09T15:02:44.677212+0000","last_peered":"2024-03-09T15:02:44.677212+0000","last_clean":"2024-03-09T15:02:44.677212+0000","last_became_active":"2024-03-09T14:28:57.606029+0000","last_became_peered":"2024-03-09T14:28:57.606029+0000","last_unstale":"2024-03-09T15:02:44.677212+0000","last_undegraded":"2024-03-09T15:02:44.677212+0000","last_fullsized":"2024-03-09T15:02:44.677212+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:37:28.933755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'272","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.364674+0000","last_change":"2024-03-09T14:28:59.630783+0000","last_active":"2024-03-09T15:07:04.364674+0000","last_peered":"2024-03-09T15:07:04.364674+0000","last_clean":"2024-03-09T15:07:04.364674+0000","last_became_active":"2024-03-09T14:28:59.630097+0000","last_became_peered":"2024-03-09T14:28:59.630097+0000","last_unstale":"2024-03-09T15:07:04.364674+0000","last_undegraded":"2024-03-09T15:07:04.364674+0000","last_fullsized":"2024-03-09T15:07:04.364674+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:59:00.777817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42990,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":1018,"num_write":414,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:09.725012+0000","last_change":"2024-03-09T14:29:01.648762+0000","last_active":"2024-03-09T15:05:09.725012+0000","last_peered":"2024-03-09T15:05:09.725012+0000","last_clean":"2024-03-09T15:05:09.725012+0000","last_became_active":"2024-03-09T14:29:01.647375+0000","last_became_peered":"2024-03-09T14:29:01.647375+0000","last_unstale":"2024-03-09T15:05:09.725012+0000","last_undegraded":"2024-03-09T15:05:09.725012+0000","last_fullsized":"2024-03-09T15:05:09.725012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'128","reported_seq":608,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.484033+0000","last_change":"2024-03-09T14:29:03.678484+0000","last_active":"2024-03-09T15:06:53.484033+0000","last_peered":"2024-03-09T15:06:53.484033+0000","last_clean":"2024-03-09T15:06:53.484033+0000","last_became_active":"2024-03-09T14:29:03.677704+0000","last_became_peered":"2024-03-09T14:29:03.677704+0000","last_unstale":"2024-03-09T15:06:53.484033+0000","last_undegraded":"2024-03-09T15:06:53.484033+0000","last_fullsized":"2024-03-09T15:06:53.484033+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:15:25.512736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":309,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'396","reported_seq":2039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:08.391191+0000","last_change":"2024-03-09T14:28:55.578548+0000","last_active":"2024-03-09T15:06:08.391191+0000","last_peered":"2024-03-09T15:06:08.391191+0000","last_clean":"2024-03-09T15:06:08.391191+0000","last_became_active":"2024-03-09T14:28:55.577690+0000","last_became_peered":"2024-03-09T14:28:55.577690+0000","last_unstale":"2024-03-09T15:06:08.391191+0000","last_undegraded":"2024-03-09T15:06:08.391191+0000","last_fullsized":"2024-03-09T15:06:08.391191+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:48:46.933238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2493,"num_read_kb":2366,"num_write":474,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'293","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.301842+0000","last_change":"2024-03-09T14:28:53.631261+0000","last_active":"2024-03-09T15:07:05.301842+0000","last_peered":"2024-03-09T15:07:05.301842+0000","last_clean":"2024-03-09T15:07:05.301842+0000","last_became_active":"2024-03-09T14:28:53.627013+0000","last_became_peered":"2024-03-09T14:28:53.627013+0000","last_unstale":"2024-03-09T15:07:05.301842+0000","last_undegraded":"2024-03-09T15:07:05.301842+0000","last_fullsized":"2024-03-09T15:07:05.301842+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:05:48.407861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242906,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":6489,"num_write":1122,"num_write_kb":11469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:00.071966+0000","last_change":"2024-03-09T14:28:57.614495+0000","last_active":"2024-03-09T15:05:00.071966+0000","last_peered":"2024-03-09T15:05:00.071966+0000","last_clean":"2024-03-09T15:05:00.071966+0000","last_became_active":"2024-03-09T14:28:57.614028+0000","last_became_peered":"2024-03-09T14:28:57.614028+0000","last_unstale":"2024-03-09T15:05:00.071966+0000","last_undegraded":"2024-03-09T15:05:00.071966+0000","last_fullsized":"2024-03-09T15:05:00.071966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'260","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.705827+0000","last_change":"2024-03-09T14:28:59.613701+0000","last_active":"2024-03-09T15:07:03.705827+0000","last_peered":"2024-03-09T15:07:03.705827+0000","last_clean":"2024-03-09T15:07:03.705827+0000","last_became_active":"2024-03-09T14:28:59.613169+0000","last_became_peered":"2024-03-09T14:28:59.613169+0000","last_unstale":"2024-03-09T15:07:03.705827+0000","last_undegraded":"2024-03-09T15:07:03.705827+0000","last_fullsized":"2024-03-09T15:07:03.705827+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:29:04.658643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":434,"num_read_kb":985,"num_write":344,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'525","reported_seq":4074,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.479355+0000","last_change":"2024-03-09T14:29:01.634092+0000","last_active":"2024-03-09T15:07:02.479355+0000","last_peered":"2024-03-09T15:07:02.479355+0000","last_clean":"2024-03-09T15:07:02.479355+0000","last_became_active":"2024-03-09T14:29:01.633363+0000","last_became_peered":"2024-03-09T14:29:01.633363+0000","last_unstale":"2024-03-09T15:07:02.479355+0000","last_undegraded":"2024-03-09T15:07:02.479355+0000","last_fullsized":"2024-03-09T15:07:02.479355+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:17:29.117930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'114","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.380978+0000","last_change":"2024-03-09T14:29:03.680649+0000","last_active":"2024-03-09T15:06:41.380978+0000","last_peered":"2024-03-09T15:06:41.380978+0000","last_clean":"2024-03-09T15:06:41.380978+0000","last_became_active":"2024-03-09T14:29:03.679941+0000","last_became_peered":"2024-03-09T14:29:03.679941+0000","last_unstale":"2024-03-09T15:06:41.380978+0000","last_undegraded":"2024-03-09T15:06:41.380978+0000","last_fullsized":"2024-03-09T15:06:41.380978+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1871,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":265,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'457","reported_seq":2151,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.397244+0000","last_change":"2024-03-09T14:28:55.590773+0000","last_active":"2024-03-09T15:06:38.397244+0000","last_peered":"2024-03-09T15:06:38.397244+0000","last_clean":"2024-03-09T15:06:38.397244+0000","last_became_active":"2024-03-09T14:28:55.589982+0000","last_became_peered":"2024-03-09T14:28:55.589982+0000","last_unstale":"2024-03-09T15:06:38.397244+0000","last_undegraded":"2024-03-09T15:06:38.397244+0000","last_fullsized":"2024-03-09T15:06:38.397244+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:13:42.061416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2457,"num_read_kb":2347,"num_write":517,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'336","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.366037+0000","last_change":"2024-03-09T14:28:53.603618+0000","last_active":"2024-03-09T15:07:05.366037+0000","last_peered":"2024-03-09T15:07:05.366037+0000","last_clean":"2024-03-09T15:07:05.366037+0000","last_became_active":"2024-03-09T14:28:53.596847+0000","last_became_peered":"2024-03-09T14:28:53.596847+0000","last_unstale":"2024-03-09T15:07:05.366037+0000","last_undegraded":"2024-03-09T15:07:05.366037+0000","last_fullsized":"2024-03-09T15:07:05.366037+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:28:50.808652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243083,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":7047,"num_write":1167,"num_write_kb":21742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.022324+0000","last_change":"2024-03-09T14:28:57.619309+0000","last_active":"2024-03-09T15:07:02.022324+0000","last_peered":"2024-03-09T15:07:02.022324+0000","last_clean":"2024-03-09T15:07:02.022324+0000","last_became_active":"2024-03-09T14:28:57.618459+0000","last_became_peered":"2024-03-09T14:28:57.618459+0000","last_unstale":"2024-03-09T15:07:02.022324+0000","last_undegraded":"2024-03-09T15:07:02.022324+0000","last_fullsized":"2024-03-09T15:07:02.022324+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:07:02.519797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":640,"num_read_kb":640,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'56","reported_seq":561,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:59.953770+0000","last_change":"2024-03-09T14:28:59.635240+0000","last_active":"2024-03-09T15:04:59.953770+0000","last_peered":"2024-03-09T15:04:59.953770+0000","last_clean":"2024-03-09T15:04:59.953770+0000","last_became_active":"2024-03-09T14:28:59.634653+0000","last_became_peered":"2024-03-09T14:28:59.634653+0000","last_unstale":"2024-03-09T15:04:59.953770+0000","last_undegraded":"2024-03-09T15:04:59.953770+0000","last_fullsized":"2024-03-09T15:04:59.953770+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:14:05.243868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'537","reported_seq":1986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.191006+0000","last_change":"2024-03-09T14:29:01.656750+0000","last_active":"2024-03-09T15:07:03.191006+0000","last_peered":"2024-03-09T15:07:03.191006+0000","last_clean":"2024-03-09T15:07:03.191006+0000","last_became_active":"2024-03-09T14:29:01.656177+0000","last_became_peered":"2024-03-09T14:29:01.656177+0000","last_unstale":"2024-03-09T15:07:03.191006+0000","last_undegraded":"2024-03-09T15:07:03.191006+0000","last_fullsized":"2024-03-09T15:07:03.191006+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:14:48.749660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'149","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.627725+0000","last_change":"2024-03-09T14:29:03.673147+0000","last_active":"2024-03-09T15:06:29.627725+0000","last_peered":"2024-03-09T15:06:29.627725+0000","last_clean":"2024-03-09T15:06:29.627725+0000","last_became_active":"2024-03-09T14:29:03.672416+0000","last_became_peered":"2024-03-09T14:29:03.672416+0000","last_unstale":"2024-03-09T15:06:29.627725+0000","last_undegraded":"2024-03-09T15:06:29.627725+0000","last_fullsized":"2024-03-09T15:06:29.627725+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:33.857671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":118,"num_read_kb":112,"num_write":348,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'860","reported_seq":2475,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.893656+0000","last_change":"2024-03-09T14:28:55.584166+0000","last_active":"2024-03-09T15:07:09.893656+0000","last_peered":"2024-03-09T15:07:09.893656+0000","last_clean":"2024-03-09T15:07:09.893656+0000","last_became_active":"2024-03-09T14:28:55.583618+0000","last_became_peered":"2024-03-09T14:28:55.583618+0000","last_unstale":"2024-03-09T15:07:09.893656+0000","last_undegraded":"2024-03-09T15:07:09.893656+0000","last_fullsized":"2024-03-09T15:07:09.893656+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4083,"num_read_kb":3643,"num_write":1199,"num_write_kb":506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'316","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.400101+0000","last_change":"2024-03-09T14:28:53.568437+0000","last_active":"2024-03-09T15:07:05.400101+0000","last_peered":"2024-03-09T15:07:05.400101+0000","last_clean":"2024-03-09T15:07:05.400101+0000","last_became_active":"2024-03-09T14:28:53.568002+0000","last_became_peered":"2024-03-09T14:28:53.568002+0000","last_unstale":"2024-03-09T15:07:05.400101+0000","last_undegraded":"2024-03-09T15:07:05.400101+0000","last_fullsized":"2024-03-09T15:07:05.400101+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:23:32.756336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":642,"num_read_kb":26434,"num_write":1119,"num_write_kb":51619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:44.682741+0000","last_change":"2024-03-09T14:28:57.616235+0000","last_active":"2024-03-09T15:02:44.682741+0000","last_peered":"2024-03-09T15:02:44.682741+0000","last_clean":"2024-03-09T15:02:44.682741+0000","last_became_active":"2024-03-09T14:28:57.615518+0000","last_became_peered":"2024-03-09T14:28:57.615518+0000","last_unstale":"2024-03-09T15:02:44.682741+0000","last_undegraded":"2024-03-09T15:02:44.682741+0000","last_fullsized":"2024-03-09T15:02:44.682741+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:42:54.401600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'359","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.288507+0000","last_change":"2024-03-09T14:28:59.607936+0000","last_active":"2024-03-09T15:07:05.288507+0000","last_peered":"2024-03-09T15:07:05.288507+0000","last_clean":"2024-03-09T15:07:05.288507+0000","last_became_active":"2024-03-09T14:28:59.607095+0000","last_became_peered":"2024-03-09T14:28:59.607095+0000","last_unstale":"2024-03-09T15:07:05.288507+0000","last_undegraded":"2024-03-09T15:07:05.288507+0000","last_fullsized":"2024-03-09T15:07:05.288507+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:16:14.902005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47607,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1194,"num_read_kb":1839,"num_write":1728,"num_write_kb":1610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.682241+0000","last_change":"2024-03-09T14:29:01.650586+0000","last_active":"2024-03-09T15:02:49.682241+0000","last_peered":"2024-03-09T15:02:49.682241+0000","last_clean":"2024-03-09T15:02:49.682241+0000","last_became_active":"2024-03-09T14:29:01.649769+0000","last_became_peered":"2024-03-09T14:29:01.649769+0000","last_unstale":"2024-03-09T15:02:49.682241+0000","last_undegraded":"2024-03-09T15:02:49.682241+0000","last_fullsized":"2024-03-09T15:02:49.682241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:07:16.076604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'142","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:35.098026+0000","last_change":"2024-03-09T14:29:03.678921+0000","last_active":"2024-03-09T15:06:35.098026+0000","last_peered":"2024-03-09T15:06:35.098026+0000","last_clean":"2024-03-09T15:06:35.098026+0000","last_became_active":"2024-03-09T14:29:03.678140+0000","last_became_peered":"2024-03-09T14:29:03.678140+0000","last_unstale":"2024-03-09T15:06:35.098026+0000","last_undegraded":"2024-03-09T15:06:35.098026+0000","last_fullsized":"2024-03-09T15:06:35.098026+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":150,"num_write":332,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'1639","reported_seq":3308,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.109281+0000","last_change":"2024-03-09T14:28:55.597191+0000","last_active":"2024-03-09T15:06:27.109281+0000","last_peered":"2024-03-09T15:06:27.109281+0000","last_clean":"2024-03-09T15:06:27.109281+0000","last_became_active":"2024-03-09T14:28:55.596219+0000","last_became_peered":"2024-03-09T14:28:55.596219+0000","last_unstale":"2024-03-09T15:06:27.109281+0000","last_undegraded":"2024-03-09T15:06:27.109281+0000","last_fullsized":"2024-03-09T15:06:27.109281+0000","mapping_epoch":25,"log_start":"264'1600","ondisk_log_start":"264'1600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:18:39.978742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6749,"num_read_kb":5786,"num_write":2314,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":669,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:49.715671+0000","last_change":"2024-03-09T14:28:36.802806+0000","last_active":"2024-03-09T15:04:49.715671+0000","last_peered":"2024-03-09T15:04:49.715671+0000","last_clean":"2024-03-09T15:04:49.715671+0000","last_became_active":"2024-03-09T14:28:36.802270+0000","last_became_peered":"2024-03-09T14:28:36.802270+0000","last_unstale":"2024-03-09T15:04:49.715671+0000","last_undegraded":"2024-03-09T15:04:49.715671+0000","last_fullsized":"2024-03-09T15:04:49.715671+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:35.777784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:35.777784+0000","last_clean_scrub_stamp":"2024-03-09T14:28:35.777784+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:02:15.668382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.886372+0000","last_change":"2024-03-09T14:28:41.842055+0000","last_active":"2024-03-09T15:04:09.886372+0000","last_peered":"2024-03-09T15:04:09.886372+0000","last_clean":"2024-03-09T15:04:09.886372+0000","last_became_active":"2024-03-09T14:28:41.841153+0000","last_became_peered":"2024-03-09T14:28:41.841153+0000","last_unstale":"2024-03-09T15:04:09.886372+0000","last_undegraded":"2024-03-09T15:04:09.886372+0000","last_fullsized":"2024-03-09T15:04:09.886372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:49.085946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'346","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.403222+0000","last_change":"2024-03-09T14:28:53.623164+0000","last_active":"2024-03-09T15:07:05.403222+0000","last_peered":"2024-03-09T15:07:05.403222+0000","last_clean":"2024-03-09T15:07:05.403222+0000","last_became_active":"2024-03-09T14:28:53.622700+0000","last_became_peered":"2024-03-09T14:28:53.622700+0000","last_unstale":"2024-03-09T15:07:05.403222+0000","last_undegraded":"2024-03-09T15:07:05.403222+0000","last_fullsized":"2024-03-09T15:07:05.403222+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:03:47.434250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":555,"num_read_kb":30203,"num_write":1261,"num_write_kb":35948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.709259+0000","last_change":"2024-03-09T14:28:57.607452+0000","last_active":"2024-03-09T15:04:24.709259+0000","last_peered":"2024-03-09T15:04:24.709259+0000","last_clean":"2024-03-09T15:04:24.709259+0000","last_became_active":"2024-03-09T14:28:57.606611+0000","last_became_peered":"2024-03-09T14:28:57.606611+0000","last_unstale":"2024-03-09T15:04:24.709259+0000","last_undegraded":"2024-03-09T15:04:24.709259+0000","last_fullsized":"2024-03-09T15:04:24.709259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:02:18.757444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'693","reported_seq":1389,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.426474+0000","last_change":"2024-03-09T14:28:59.604427+0000","last_active":"2024-03-09T15:07:05.426474+0000","last_peered":"2024-03-09T15:07:05.426474+0000","last_clean":"2024-03-09T15:07:05.426474+0000","last_became_active":"2024-03-09T14:28:59.603722+0000","last_became_peered":"2024-03-09T14:28:59.603722+0000","last_unstale":"2024-03-09T15:07:05.426474+0000","last_undegraded":"2024-03-09T15:07:05.426474+0000","last_fullsized":"2024-03-09T15:07:05.426474+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":600,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:32:43.960476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140709,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1362,"num_read_kb":3109,"num_write":1278,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:54.735333+0000","last_change":"2024-03-09T14:29:01.648470+0000","last_active":"2024-03-09T15:05:54.735333+0000","last_peered":"2024-03-09T15:05:54.735333+0000","last_clean":"2024-03-09T15:05:54.735333+0000","last_became_active":"2024-03-09T14:29:01.647958+0000","last_became_peered":"2024-03-09T14:29:01.647958+0000","last_unstale":"2024-03-09T15:05:54.735333+0000","last_undegraded":"2024-03-09T15:05:54.735333+0000","last_fullsized":"2024-03-09T15:05:54.735333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'226","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:22.522461+0000","last_change":"2024-03-09T14:29:03.681803+0000","last_active":"2024-03-09T15:06:22.522461+0000","last_peered":"2024-03-09T15:06:22.522461+0000","last_clean":"2024-03-09T15:06:22.522461+0000","last_became_active":"2024-03-09T14:29:03.680962+0000","last_became_peered":"2024-03-09T14:29:03.680962+0000","last_unstale":"2024-03-09T15:06:22.522461+0000","last_undegraded":"2024-03-09T15:06:22.522461+0000","last_fullsized":"2024-03-09T15:06:22.522461+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:28:12.130155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":425,"num_read_kb":422,"num_write":485,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'387","reported_seq":1945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.458531+0000","last_change":"2024-03-09T14:28:55.575679+0000","last_active":"2024-03-09T15:06:42.458531+0000","last_peered":"2024-03-09T15:06:42.458531+0000","last_clean":"2024-03-09T15:06:42.458531+0000","last_became_active":"2024-03-09T14:28:55.575229+0000","last_became_peered":"2024-03-09T14:28:55.575229+0000","last_unstale":"2024-03-09T15:06:42.458531+0000","last_undegraded":"2024-03-09T15:06:42.458531+0000","last_fullsized":"2024-03-09T15:06:42.458531+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2264,"num_read_kb":2158,"num_write":447,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:54.716837+0000","last_change":"2024-03-09T14:28:41.839813+0000","last_active":"2024-03-09T15:04:54.716837+0000","last_peered":"2024-03-09T15:04:54.716837+0000","last_clean":"2024-03-09T15:04:54.716837+0000","last_became_active":"2024-03-09T14:28:41.838669+0000","last_became_peered":"2024-03-09T14:28:41.838669+0000","last_unstale":"2024-03-09T15:04:54.716837+0000","last_undegraded":"2024-03-09T15:04:54.716837+0000","last_fullsized":"2024-03-09T15:04:54.716837+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:52:50.503614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'309","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.387394+0000","last_change":"2024-03-09T14:28:53.587759+0000","last_active":"2024-03-09T15:07:05.387394+0000","last_peered":"2024-03-09T15:07:05.387394+0000","last_clean":"2024-03-09T15:07:05.387394+0000","last_became_active":"2024-03-09T14:28:53.587201+0000","last_became_peered":"2024-03-09T14:28:53.587201+0000","last_unstale":"2024-03-09T15:07:05.387394+0000","last_undegraded":"2024-03-09T15:07:05.387394+0000","last_fullsized":"2024-03-09T15:07:05.387394+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245344,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":38281,"num_write":1125,"num_write_kb":47895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:39.879966+0000","last_change":"2024-03-09T14:28:57.613708+0000","last_active":"2024-03-09T15:03:39.879966+0000","last_peered":"2024-03-09T15:03:39.879966+0000","last_clean":"2024-03-09T15:03:39.879966+0000","last_became_active":"2024-03-09T14:28:57.612854+0000","last_became_peered":"2024-03-09T14:28:57.612854+0000","last_unstale":"2024-03-09T15:03:39.879966+0000","last_undegraded":"2024-03-09T15:03:39.879966+0000","last_fullsized":"2024-03-09T15:03:39.879966+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:41:11.322298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1076","reported_seq":2390,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.427840+0000","last_change":"2024-03-09T14:28:59.601211+0000","last_active":"2024-03-09T15:07:05.427840+0000","last_peered":"2024-03-09T15:07:05.427840+0000","last_clean":"2024-03-09T15:07:05.427840+0000","last_became_active":"2024-03-09T14:28:59.599819+0000","last_became_peered":"2024-03-09T14:28:59.599819+0000","last_unstale":"2024-03-09T15:07:05.427840+0000","last_undegraded":"2024-03-09T15:07:05.427840+0000","last_fullsized":"2024-03-09T15:07:05.427840+0000","mapping_epoch":29,"log_start":"264'1000","ondisk_log_start":"264'1000","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":1000,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132519,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1702,"num_read_kb":3355,"num_write":1050,"num_write_kb":895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:39.712987+0000","last_change":"2024-03-09T14:29:01.628141+0000","last_active":"2024-03-09T15:04:39.712987+0000","last_peered":"2024-03-09T15:04:39.712987+0000","last_clean":"2024-03-09T15:04:39.712987+0000","last_became_active":"2024-03-09T14:29:01.626582+0000","last_became_peered":"2024-03-09T14:29:01.626582+0000","last_unstale":"2024-03-09T15:04:39.712987+0000","last_undegraded":"2024-03-09T15:04:39.712987+0000","last_fullsized":"2024-03-09T15:04:39.712987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:05:36.345657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'109","reported_seq":609,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.534574+0000","last_change":"2024-03-09T14:29:03.660377+0000","last_active":"2024-03-09T15:06:32.534574+0000","last_peered":"2024-03-09T15:06:32.534574+0000","last_clean":"2024-03-09T15:06:32.534574+0000","last_became_active":"2024-03-09T14:29:03.659633+0000","last_became_peered":"2024-03-09T14:29:03.659633+0000","last_unstale":"2024-03-09T15:06:32.534574+0000","last_undegraded":"2024-03-09T15:06:32.534574+0000","last_fullsized":"2024-03-09T15:06:32.534574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":112,"num_read_kb":106,"num_write":262,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'372","reported_seq":1938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.108540+0000","last_change":"2024-03-09T14:28:55.585014+0000","last_active":"2024-03-09T15:06:27.108540+0000","last_peered":"2024-03-09T15:06:27.108540+0000","last_clean":"2024-03-09T15:06:27.108540+0000","last_became_active":"2024-03-09T14:28:55.584347+0000","last_became_peered":"2024-03-09T14:28:55.584347+0000","last_unstale":"2024-03-09T15:06:27.108540+0000","last_undegraded":"2024-03-09T15:06:27.108540+0000","last_fullsized":"2024-03-09T15:06:27.108540+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2124,"num_read_kb":2043,"num_write":421,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.695024+0000","last_change":"2024-03-09T14:28:41.837266+0000","last_active":"2024-03-09T15:04:04.695024+0000","last_peered":"2024-03-09T15:04:04.695024+0000","last_clean":"2024-03-09T15:04:04.695024+0000","last_became_active":"2024-03-09T14:28:41.836544+0000","last_became_peered":"2024-03-09T14:28:41.836544+0000","last_unstale":"2024-03-09T15:04:04.695024+0000","last_undegraded":"2024-03-09T15:04:04.695024+0000","last_fullsized":"2024-03-09T15:04:04.695024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:40.144949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'334","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.396560+0000","last_change":"2024-03-09T14:28:53.626870+0000","last_active":"2024-03-09T15:07:05.396560+0000","last_peered":"2024-03-09T15:07:05.396560+0000","last_clean":"2024-03-09T15:07:05.396560+0000","last_became_active":"2024-03-09T14:28:53.626472+0000","last_became_peered":"2024-03-09T14:28:53.626472+0000","last_unstale":"2024-03-09T15:07:05.396560+0000","last_undegraded":"2024-03-09T15:07:05.396560+0000","last_fullsized":"2024-03-09T15:07:05.396560+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":555,"num_read_kb":1460,"num_write":1312,"num_write_kb":27243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:39.689548+0000","last_change":"2024-03-09T14:28:57.610715+0000","last_active":"2024-03-09T15:03:39.689548+0000","last_peered":"2024-03-09T15:03:39.689548+0000","last_clean":"2024-03-09T15:03:39.689548+0000","last_became_active":"2024-03-09T14:28:57.609908+0000","last_became_peered":"2024-03-09T14:28:57.609908+0000","last_unstale":"2024-03-09T15:03:39.689548+0000","last_undegraded":"2024-03-09T15:03:39.689548+0000","last_fullsized":"2024-03-09T15:03:39.689548+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:42:15.361989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'225","reported_seq":1219,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.681224+0000","last_change":"2024-03-09T14:28:59.628581+0000","last_active":"2024-03-09T15:06:55.681224+0000","last_peered":"2024-03-09T15:06:55.681224+0000","last_clean":"2024-03-09T15:06:55.681224+0000","last_became_active":"2024-03-09T14:28:59.627810+0000","last_became_peered":"2024-03-09T14:28:59.627810+0000","last_unstale":"2024-03-09T15:06:55.681224+0000","last_undegraded":"2024-03-09T15:06:55.681224+0000","last_fullsized":"2024-03-09T15:06:55.681224+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:38:33.367082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":165,"num_read_kb":157,"num_write":151,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.745107+0000","last_change":"2024-03-09T14:29:01.647816+0000","last_active":"2024-03-09T15:06:34.745107+0000","last_peered":"2024-03-09T15:06:34.745107+0000","last_clean":"2024-03-09T15:06:34.745107+0000","last_became_active":"2024-03-09T14:29:01.647228+0000","last_became_peered":"2024-03-09T14:29:01.647228+0000","last_unstale":"2024-03-09T15:06:34.745107+0000","last_undegraded":"2024-03-09T15:06:34.745107+0000","last_fullsized":"2024-03-09T15:06:34.745107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'248","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:33.164698+0000","last_change":"2024-03-09T14:29:03.659156+0000","last_active":"2024-03-09T15:06:33.164698+0000","last_peered":"2024-03-09T15:06:33.164698+0000","last_clean":"2024-03-09T15:06:33.164698+0000","last_became_active":"2024-03-09T14:29:03.654872+0000","last_became_peered":"2024-03-09T14:29:03.654872+0000","last_unstale":"2024-03-09T15:06:33.164698+0000","last_undegraded":"2024-03-09T15:06:33.164698+0000","last_fullsized":"2024-03-09T15:06:33.164698+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:31:12.618967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":497,"num_write":533,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'463","reported_seq":2015,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.397215+0000","last_change":"2024-03-09T14:28:55.578525+0000","last_active":"2024-03-09T15:06:38.397215+0000","last_peered":"2024-03-09T15:06:38.397215+0000","last_clean":"2024-03-09T15:06:38.397215+0000","last_became_active":"2024-03-09T14:28:55.577946+0000","last_became_peered":"2024-03-09T14:28:55.577946+0000","last_unstale":"2024-03-09T15:06:38.397215+0000","last_undegraded":"2024-03-09T15:06:38.397215+0000","last_fullsized":"2024-03-09T15:06:38.397215+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2440,"num_read_kb":2271,"num_write":585,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:09.886323+0000","last_change":"2024-03-09T14:28:41.843028+0000","last_active":"2024-03-09T15:04:09.886323+0000","last_peered":"2024-03-09T15:04:09.886323+0000","last_clean":"2024-03-09T15:04:09.886323+0000","last_became_active":"2024-03-09T14:28:41.842251+0000","last_became_peered":"2024-03-09T14:28:41.842251+0000","last_unstale":"2024-03-09T15:04:09.886323+0000","last_undegraded":"2024-03-09T15:04:09.886323+0000","last_fullsized":"2024-03-09T15:04:09.886323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:09:29.190170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'329","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.273221+0000","last_change":"2024-03-09T14:28:53.622441+0000","last_active":"2024-03-09T15:07:05.273221+0000","last_peered":"2024-03-09T15:07:05.273221+0000","last_clean":"2024-03-09T15:07:05.273221+0000","last_became_active":"2024-03-09T14:28:53.621914+0000","last_became_peered":"2024-03-09T14:28:53.621914+0000","last_unstale":"2024-03-09T15:07:05.273221+0000","last_undegraded":"2024-03-09T15:07:05.273221+0000","last_fullsized":"2024-03-09T15:07:05.273221+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:19:35.698441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1292088,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":22951,"num_write":1137,"num_write_kb":34708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.745146+0000","last_change":"2024-03-09T14:28:57.613906+0000","last_active":"2024-03-09T15:06:34.745146+0000","last_peered":"2024-03-09T15:06:34.745146+0000","last_clean":"2024-03-09T15:06:34.745146+0000","last_became_active":"2024-03-09T14:28:57.613407+0000","last_became_peered":"2024-03-09T14:28:57.613407+0000","last_unstale":"2024-03-09T15:06:34.745146+0000","last_undegraded":"2024-03-09T15:06:34.745146+0000","last_fullsized":"2024-03-09T15:06:34.745146+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'110","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:01.825035+0000","last_change":"2024-03-09T14:28:59.619709+0000","last_active":"2024-03-09T15:06:01.825035+0000","last_peered":"2024-03-09T15:06:01.825035+0000","last_clean":"2024-03-09T15:06:01.825035+0000","last_became_active":"2024-03-09T14:28:59.619291+0000","last_became_peered":"2024-03-09T14:28:59.619291+0000","last_unstale":"2024-03-09T15:06:01.825035+0000","last_undegraded":"2024-03-09T15:06:01.825035+0000","last_fullsized":"2024-03-09T15:06:01.825035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:25.604984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":110,"num_write":80,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:44.694699+0000","last_change":"2024-03-09T14:29:01.657586+0000","last_active":"2024-03-09T15:03:44.694699+0000","last_peered":"2024-03-09T15:03:44.694699+0000","last_clean":"2024-03-09T15:03:44.694699+0000","last_became_active":"2024-03-09T14:29:01.656672+0000","last_became_peered":"2024-03-09T14:29:01.656672+0000","last_unstale":"2024-03-09T15:03:44.694699+0000","last_undegraded":"2024-03-09T15:03:44.694699+0000","last_fullsized":"2024-03-09T15:03:44.694699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:15:26.411549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'104","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:31.620441+0000","last_change":"2024-03-09T14:29:03.673314+0000","last_active":"2024-03-09T15:06:31.620441+0000","last_peered":"2024-03-09T15:06:31.620441+0000","last_clean":"2024-03-09T15:06:31.620441+0000","last_became_active":"2024-03-09T14:29:03.672534+0000","last_became_peered":"2024-03-09T14:29:03.672534+0000","last_unstale":"2024-03-09T15:06:31.620441+0000","last_undegraded":"2024-03-09T15:06:31.620441+0000","last_fullsized":"2024-03-09T15:06:31.620441+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:59:22.964887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":109,"num_write":236,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'463","reported_seq":2132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.169983+0000","last_change":"2024-03-09T14:28:55.584898+0000","last_active":"2024-03-09T15:06:36.169983+0000","last_peered":"2024-03-09T15:06:36.169983+0000","last_clean":"2024-03-09T15:06:36.169983+0000","last_became_active":"2024-03-09T14:28:55.583536+0000","last_became_peered":"2024-03-09T14:28:55.583536+0000","last_unstale":"2024-03-09T15:06:36.169983+0000","last_undegraded":"2024-03-09T15:06:36.169983+0000","last_fullsized":"2024-03-09T15:06:36.169983+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2714,"num_read_kb":2554,"num_write":561,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'357","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.321675+0000","last_change":"2024-03-09T14:28:53.629100+0000","last_active":"2024-03-09T15:07:05.321675+0000","last_peered":"2024-03-09T15:07:05.321675+0000","last_clean":"2024-03-09T15:07:05.321675+0000","last_became_active":"2024-03-09T14:28:53.626879+0000","last_became_peered":"2024-03-09T14:28:53.626879+0000","last_unstale":"2024-03-09T15:07:05.321675+0000","last_undegraded":"2024-03-09T15:07:05.321675+0000","last_fullsized":"2024-03-09T15:07:05.321675+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:04:10.643317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8554715,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":520,"num_read_kb":4755,"num_write":1359,"num_write_kb":47511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:15.092851+0000","last_change":"2024-03-09T14:28:42.127635+0000","last_active":"2024-03-09T15:06:15.092851+0000","last_peered":"2024-03-09T15:06:15.092851+0000","last_clean":"2024-03-09T15:06:15.092851+0000","last_became_active":"2024-03-09T14:28:42.126799+0000","last_became_peered":"2024-03-09T14:28:42.126799+0000","last_unstale":"2024-03-09T15:06:15.092851+0000","last_undegraded":"2024-03-09T15:06:15.092851+0000","last_fullsized":"2024-03-09T15:06:15.092851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.743519+0000","last_change":"2024-03-09T14:28:57.609247+0000","last_active":"2024-03-09T15:06:29.743519+0000","last_peered":"2024-03-09T15:06:29.743519+0000","last_clean":"2024-03-09T15:06:29.743519+0000","last_became_active":"2024-03-09T14:28:57.608723+0000","last_became_peered":"2024-03-09T14:28:57.608723+0000","last_unstale":"2024-03-09T15:06:29.743519+0000","last_undegraded":"2024-03-09T15:06:29.743519+0000","last_fullsized":"2024-03-09T15:06:29.743519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'530","reported_seq":1180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.889991+0000","last_change":"2024-03-09T14:28:59.625137+0000","last_active":"2024-03-09T15:07:04.889991+0000","last_peered":"2024-03-09T15:07:04.889991+0000","last_clean":"2024-03-09T15:07:04.889991+0000","last_became_active":"2024-03-09T14:28:59.624680+0000","last_became_peered":"2024-03-09T14:28:59.624680+0000","last_unstale":"2024-03-09T15:07:04.889991+0000","last_undegraded":"2024-03-09T15:07:04.889991+0000","last_fullsized":"2024-03-09T15:07:04.889991+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87910,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":952,"num_read_kb":2224,"num_write":784,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.706169+0000","last_change":"2024-03-09T14:29:01.641583+0000","last_active":"2024-03-09T15:04:29.706169+0000","last_peered":"2024-03-09T15:04:29.706169+0000","last_clean":"2024-03-09T15:04:29.706169+0000","last_became_active":"2024-03-09T14:29:01.640485+0000","last_became_peered":"2024-03-09T14:29:01.640485+0000","last_unstale":"2024-03-09T15:04:29.706169+0000","last_undegraded":"2024-03-09T15:04:29.706169+0000","last_fullsized":"2024-03-09T15:04:29.706169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:42:25.734918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'141","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.451232+0000","last_change":"2024-03-09T14:29:03.676884+0000","last_active":"2024-03-09T15:06:42.451232+0000","last_peered":"2024-03-09T15:06:42.451232+0000","last_clean":"2024-03-09T15:06:42.451232+0000","last_became_active":"2024-03-09T14:29:03.676032+0000","last_became_peered":"2024-03-09T14:29:03.676032+0000","last_unstale":"2024-03-09T15:06:42.451232+0000","last_undegraded":"2024-03-09T15:06:42.451232+0000","last_fullsized":"2024-03-09T15:06:42.451232+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":195,"num_read_kb":176,"num_write":349,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'352","reported_seq":1745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.458885+0000","last_change":"2024-03-09T14:28:55.583629+0000","last_active":"2024-03-09T15:06:42.458885+0000","last_peered":"2024-03-09T15:06:42.458885+0000","last_clean":"2024-03-09T15:06:42.458885+0000","last_became_active":"2024-03-09T14:28:55.582743+0000","last_became_peered":"2024-03-09T14:28:55.582743+0000","last_unstale":"2024-03-09T15:06:42.458885+0000","last_undegraded":"2024-03-09T15:06:42.458885+0000","last_fullsized":"2024-03-09T15:06:42.458885+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1869,"num_read_kb":1781,"num_write":409,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'326","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.421281+0000","last_change":"2024-03-09T14:28:53.590149+0000","last_active":"2024-03-09T15:07:05.421281+0000","last_peered":"2024-03-09T15:07:05.421281+0000","last_clean":"2024-03-09T15:07:05.421281+0000","last_became_active":"2024-03-09T14:28:53.589640+0000","last_became_peered":"2024-03-09T14:28:53.589640+0000","last_unstale":"2024-03-09T15:07:05.421281+0000","last_undegraded":"2024-03-09T15:07:05.421281+0000","last_fullsized":"2024-03-09T15:07:05.421281+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048928,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":38844,"num_write":1128,"num_write_kb":48736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":512,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:19.707999+0000","last_change":"2024-03-09T14:28:42.127115+0000","last_active":"2024-03-09T15:04:19.707999+0000","last_peered":"2024-03-09T15:04:19.707999+0000","last_clean":"2024-03-09T15:04:19.707999+0000","last_became_active":"2024-03-09T14:28:42.126201+0000","last_became_peered":"2024-03-09T14:28:42.126201+0000","last_unstale":"2024-03-09T15:04:19.707999+0000","last_undegraded":"2024-03-09T15:04:19.707999+0000","last_fullsized":"2024-03-09T15:04:19.707999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:57.954868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.703353+0000","last_change":"2024-03-09T14:28:57.607498+0000","last_active":"2024-03-09T15:04:24.703353+0000","last_peered":"2024-03-09T15:04:24.703353+0000","last_clean":"2024-03-09T15:04:24.703353+0000","last_became_active":"2024-03-09T14:28:57.606429+0000","last_became_peered":"2024-03-09T14:28:57.606429+0000","last_unstale":"2024-03-09T15:04:24.703353+0000","last_undegraded":"2024-03-09T15:04:24.703353+0000","last_fullsized":"2024-03-09T15:04:24.703353+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:11:59.349598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'174","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.691928+0000","last_change":"2024-03-09T14:28:59.627298+0000","last_active":"2024-03-09T15:06:55.691928+0000","last_peered":"2024-03-09T15:06:55.691928+0000","last_clean":"2024-03-09T15:06:55.691928+0000","last_became_active":"2024-03-09T14:28:59.626697+0000","last_became_peered":"2024-03-09T14:28:59.626697+0000","last_unstale":"2024-03-09T15:06:55.691928+0000","last_undegraded":"2024-03-09T15:06:55.691928+0000","last_fullsized":"2024-03-09T15:06:55.691928+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":207,"num_read_kb":198,"num_write":186,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'565","reported_seq":2141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.431297+0000","last_change":"2024-03-09T14:29:01.637730+0000","last_active":"2024-03-09T15:07:05.431297+0000","last_peered":"2024-03-09T15:07:05.431297+0000","last_clean":"2024-03-09T15:07:05.431297+0000","last_became_active":"2024-03-09T14:29:01.636912+0000","last_became_peered":"2024-03-09T14:29:01.636912+0000","last_unstale":"2024-03-09T15:07:05.431297+0000","last_undegraded":"2024-03-09T15:07:05.431297+0000","last_fullsized":"2024-03-09T15:07:05.431297+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:03:38.907925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'95","reported_seq":578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:28.252100+0000","last_change":"2024-03-09T14:29:03.665396+0000","last_active":"2024-03-09T15:06:28.252100+0000","last_peered":"2024-03-09T15:06:28.252100+0000","last_clean":"2024-03-09T15:06:28.252100+0000","last_became_active":"2024-03-09T14:29:03.664665+0000","last_became_peered":"2024-03-09T14:29:03.664665+0000","last_unstale":"2024-03-09T15:06:28.252100+0000","last_undegraded":"2024-03-09T15:06:28.252100+0000","last_fullsized":"2024-03-09T15:06:28.252100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:09:45.489579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":223,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'343","reported_seq":1825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.542652+0000","last_change":"2024-03-09T14:28:55.603920+0000","last_active":"2024-03-09T15:06:32.542652+0000","last_peered":"2024-03-09T15:06:32.542652+0000","last_clean":"2024-03-09T15:06:32.542652+0000","last_became_active":"2024-03-09T14:28:55.601355+0000","last_became_peered":"2024-03-09T14:28:55.601355+0000","last_unstale":"2024-03-09T15:06:32.542652+0000","last_undegraded":"2024-03-09T15:06:32.542652+0000","last_fullsized":"2024-03-09T15:06:32.542652+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:34.833891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1977,"num_read_kb":1906,"num_write":384,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'330","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.338354+0000","last_change":"2024-03-09T14:28:53.585247+0000","last_active":"2024-03-09T15:07:05.338354+0000","last_peered":"2024-03-09T15:07:05.338354+0000","last_clean":"2024-03-09T15:07:05.338354+0000","last_became_active":"2024-03-09T14:28:53.584728+0000","last_became_peered":"2024-03-09T14:28:53.584728+0000","last_unstale":"2024-03-09T15:07:05.338354+0000","last_undegraded":"2024-03-09T15:07:05.338354+0000","last_fullsized":"2024-03-09T15:07:05.338354+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:07:55.413559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918035,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":514,"num_read_kb":33595,"num_write":1176,"num_write_kb":22083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:30.081851+0000","last_change":"2024-03-09T14:28:41.840785+0000","last_active":"2024-03-09T15:05:30.081851+0000","last_peered":"2024-03-09T15:05:30.081851+0000","last_clean":"2024-03-09T15:05:30.081851+0000","last_became_active":"2024-03-09T14:28:41.840168+0000","last_became_peered":"2024-03-09T14:28:41.840168+0000","last_unstale":"2024-03-09T15:05:30.081851+0000","last_undegraded":"2024-03-09T15:05:30.081851+0000","last_fullsized":"2024-03-09T15:05:30.081851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"35'5","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.007346+0000","last_change":"2024-03-09T14:28:57.613265+0000","last_active":"2024-03-09T15:07:02.007346+0000","last_peered":"2024-03-09T15:07:02.007346+0000","last_clean":"2024-03-09T15:07:02.007346+0000","last_became_active":"2024-03-09T14:28:57.610373+0000","last_became_peered":"2024-03-09T14:28:57.610373+0000","last_unstale":"2024-03-09T15:07:02.007346+0000","last_undegraded":"2024-03-09T15:07:02.007346+0000","last_fullsized":"2024-03-09T15:07:02.007346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:29.212547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":492,"num_read_kb":799,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'102","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:04.229619+0000","last_change":"2024-03-09T14:28:59.616174+0000","last_active":"2024-03-09T15:06:04.229619+0000","last_peered":"2024-03-09T15:06:04.229619+0000","last_clean":"2024-03-09T15:06:04.229619+0000","last_became_active":"2024-03-09T14:28:59.615084+0000","last_became_peered":"2024-03-09T14:28:59.615084+0000","last_unstale":"2024-03-09T15:06:04.229619+0000","last_undegraded":"2024-03-09T15:06:04.229619+0000","last_fullsized":"2024-03-09T15:06:04.229619+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:06:53.932808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":100,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'584","reported_seq":2175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.239954+0000","last_change":"2024-03-09T14:29:01.631333+0000","last_active":"2024-03-09T15:07:05.239954+0000","last_peered":"2024-03-09T15:07:05.239954+0000","last_clean":"2024-03-09T15:07:05.239954+0000","last_became_active":"2024-03-09T14:29:01.630598+0000","last_became_peered":"2024-03-09T14:29:01.630598+0000","last_unstale":"2024-03-09T15:07:05.239954+0000","last_undegraded":"2024-03-09T15:07:05.239954+0000","last_fullsized":"2024-03-09T15:07:05.239954+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:04:45.034915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'228","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.631682+0000","last_change":"2024-03-09T14:29:03.684917+0000","last_active":"2024-03-09T15:06:29.631682+0000","last_peered":"2024-03-09T15:06:29.631682+0000","last_clean":"2024-03-09T15:06:29.631682+0000","last_became_active":"2024-03-09T14:29:03.684294+0000","last_became_peered":"2024-03-09T14:29:03.684294+0000","last_unstale":"2024-03-09T15:06:29.631682+0000","last_undegraded":"2024-03-09T15:06:29.631682+0000","last_fullsized":"2024-03-09T15:06:29.631682+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":199,"num_write":480,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'364","reported_seq":2033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.910397+0000","last_change":"2024-03-09T14:28:55.569425+0000","last_active":"2024-03-09T15:06:39.910397+0000","last_peered":"2024-03-09T15:06:39.910397+0000","last_clean":"2024-03-09T15:06:39.910397+0000","last_became_active":"2024-03-09T14:28:55.568430+0000","last_became_peered":"2024-03-09T14:28:55.568430+0000","last_unstale":"2024-03-09T15:06:39.910397+0000","last_undegraded":"2024-03-09T15:06:39.910397+0000","last_fullsized":"2024-03-09T15:06:39.910397+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:22:01.506801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2357,"num_read_kb":2282,"num_write":412,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'367","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.344429+0000","last_change":"2024-03-09T14:28:53.589944+0000","last_active":"2024-03-09T15:07:05.344429+0000","last_peered":"2024-03-09T15:07:05.344429+0000","last_clean":"2024-03-09T15:07:05.344429+0000","last_became_active":"2024-03-09T14:28:53.589491+0000","last_became_peered":"2024-03-09T14:28:53.589491+0000","last_unstale":"2024-03-09T15:07:05.344429+0000","last_undegraded":"2024-03-09T15:07:05.344429+0000","last_fullsized":"2024-03-09T15:07:05.344429+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12403936,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":473,"num_read_kb":37359,"num_write":1237,"num_write_kb":47489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:24.690049+0000","last_change":"2024-03-09T14:28:41.841410+0000","last_active":"2024-03-09T15:03:24.690049+0000","last_peered":"2024-03-09T15:03:24.690049+0000","last_clean":"2024-03-09T15:03:24.690049+0000","last_became_active":"2024-03-09T14:28:41.840575+0000","last_became_peered":"2024-03-09T14:28:41.840575+0000","last_unstale":"2024-03-09T15:03:24.690049+0000","last_undegraded":"2024-03-09T15:03:24.690049+0000","last_fullsized":"2024-03-09T15:03:24.690049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:57.501425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"35'3","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.461344+0000","last_change":"2024-03-09T14:28:57.605420+0000","last_active":"2024-03-09T15:07:02.461344+0000","last_peered":"2024-03-09T15:07:02.461344+0000","last_clean":"2024-03-09T15:07:02.461344+0000","last_became_active":"2024-03-09T14:28:57.604511+0000","last_became_peered":"2024-03-09T14:28:57.604511+0000","last_unstale":"2024-03-09T15:07:02.461344+0000","last_undegraded":"2024-03-09T15:07:02.461344+0000","last_fullsized":"2024-03-09T15:07:02.461344+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:27:24.834782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":488,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'682","reported_seq":1390,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.132413+0000","last_change":"2024-03-09T14:28:59.630805+0000","last_active":"2024-03-09T15:07:05.132413+0000","last_peered":"2024-03-09T15:07:05.132413+0000","last_clean":"2024-03-09T15:07:05.132413+0000","last_became_active":"2024-03-09T14:28:59.630044+0000","last_became_peered":"2024-03-09T14:28:59.630044+0000","last_unstale":"2024-03-09T15:07:05.132413+0000","last_undegraded":"2024-03-09T15:07:05.132413+0000","last_fullsized":"2024-03-09T15:07:05.132413+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":600,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:29:17.068940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140779,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1221,"num_read_kb":2881,"num_write":988,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:29.946142+0000","last_change":"2024-03-09T14:29:01.639091+0000","last_active":"2024-03-09T15:04:29.946142+0000","last_peered":"2024-03-09T15:04:29.946142+0000","last_clean":"2024-03-09T15:04:29.946142+0000","last_became_active":"2024-03-09T14:29:01.638590+0000","last_became_peered":"2024-03-09T14:29:01.638590+0000","last_unstale":"2024-03-09T15:04:29.946142+0000","last_undegraded":"2024-03-09T15:04:29.946142+0000","last_fullsized":"2024-03-09T15:04:29.946142+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:05:05.637460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'122","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:16.433331+0000","last_change":"2024-03-09T14:29:03.671961+0000","last_active":"2024-03-09T15:05:16.433331+0000","last_peered":"2024-03-09T15:05:16.433331+0000","last_clean":"2024-03-09T15:05:16.433331+0000","last_became_active":"2024-03-09T14:29:03.671138+0000","last_became_peered":"2024-03-09T14:29:03.671138+0000","last_unstale":"2024-03-09T15:05:16.433331+0000","last_undegraded":"2024-03-09T15:05:16.433331+0000","last_fullsized":"2024-03-09T15:05:16.433331+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:11.482213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":309,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'132","reported_seq":680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.745404+0000","last_change":"2024-03-09T14:29:03.682511+0000","last_active":"2024-03-09T15:06:34.745404+0000","last_peered":"2024-03-09T15:06:34.745404+0000","last_clean":"2024-03-09T15:06:34.745404+0000","last_became_active":"2024-03-09T14:29:03.681920+0000","last_became_peered":"2024-03-09T14:29:03.681920+0000","last_unstale":"2024-03-09T15:06:34.745404+0000","last_undegraded":"2024-03-09T15:06:34.745404+0000","last_fullsized":"2024-03-09T15:06:34.745404+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":222,"num_write":331,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'713","reported_seq":2210,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.478578+0000","last_change":"2024-03-09T14:28:55.590020+0000","last_active":"2024-03-09T15:06:53.478578+0000","last_peered":"2024-03-09T15:06:53.478578+0000","last_clean":"2024-03-09T15:06:53.478578+0000","last_became_active":"2024-03-09T14:28:55.589278+0000","last_became_peered":"2024-03-09T14:28:55.589278+0000","last_unstale":"2024-03-09T15:06:53.478578+0000","last_undegraded":"2024-03-09T15:06:53.478578+0000","last_fullsized":"2024-03-09T15:06:53.478578+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":700,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:16:27.469317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3302,"num_read_kb":2973,"num_write":944,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'315","reported_seq":981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.395701+0000","last_change":"2024-03-09T14:28:53.624761+0000","last_active":"2024-03-09T15:07:05.395701+0000","last_peered":"2024-03-09T15:07:05.395701+0000","last_clean":"2024-03-09T15:07:05.395701+0000","last_became_active":"2024-03-09T14:28:53.624231+0000","last_became_peered":"2024-03-09T14:28:53.624231+0000","last_unstale":"2024-03-09T15:07:05.395701+0000","last_undegraded":"2024-03-09T15:07:05.395701+0000","last_fullsized":"2024-03-09T15:07:05.395701+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:01:48.466150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":535,"num_read_kb":58598,"num_write":1161,"num_write_kb":63743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:20.094503+0000","last_change":"2024-03-09T14:28:57.616817+0000","last_active":"2024-03-09T15:06:20.094503+0000","last_peered":"2024-03-09T15:06:20.094503+0000","last_clean":"2024-03-09T15:06:20.094503+0000","last_became_active":"2024-03-09T14:28:57.616045+0000","last_became_peered":"2024-03-09T14:28:57.616045+0000","last_unstale":"2024-03-09T15:06:20.094503+0000","last_undegraded":"2024-03-09T15:06:20.094503+0000","last_fullsized":"2024-03-09T15:06:20.094503+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'251","reported_seq":813,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.836638+0000","last_change":"2024-03-09T14:28:59.615640+0000","last_active":"2024-03-09T15:07:02.836638+0000","last_peered":"2024-03-09T15:07:02.836638+0000","last_clean":"2024-03-09T15:07:02.836638+0000","last_became_active":"2024-03-09T14:28:59.615265+0000","last_became_peered":"2024-03-09T14:28:59.615265+0000","last_unstale":"2024-03-09T15:07:02.836638+0000","last_undegraded":"2024-03-09T15:07:02.836638+0000","last_fullsized":"2024-03-09T15:07:02.836638+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:29:10.543045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41654,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":398,"num_read_kb":895,"num_write":318,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.938921+0000","last_change":"2024-03-09T14:29:01.630945+0000","last_active":"2024-03-09T15:04:04.938921+0000","last_peered":"2024-03-09T15:04:04.938921+0000","last_clean":"2024-03-09T15:04:04.938921+0000","last_became_active":"2024-03-09T14:29:01.630021+0000","last_became_peered":"2024-03-09T14:29:01.630021+0000","last_unstale":"2024-03-09T15:04:04.938921+0000","last_undegraded":"2024-03-09T15:04:04.938921+0000","last_fullsized":"2024-03-09T15:04:04.938921+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:51.210479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'124","reported_seq":609,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.506092+0000","last_change":"2024-03-09T14:29:03.661082+0000","last_active":"2024-03-09T15:06:55.506092+0000","last_peered":"2024-03-09T15:06:55.506092+0000","last_clean":"2024-03-09T15:06:55.506092+0000","last_became_active":"2024-03-09T14:29:03.660356+0000","last_became_peered":"2024-03-09T14:29:03.660356+0000","last_unstale":"2024-03-09T15:06:55.506092+0000","last_undegraded":"2024-03-09T15:06:55.506092+0000","last_fullsized":"2024-03-09T15:06:55.506092+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:48:43.599086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'835","reported_seq":2444,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.398060+0000","last_change":"2024-03-09T14:28:55.592219+0000","last_active":"2024-03-09T15:06:38.398060+0000","last_peered":"2024-03-09T15:06:38.398060+0000","last_clean":"2024-03-09T15:06:38.398060+0000","last_became_active":"2024-03-09T14:28:55.591498+0000","last_became_peered":"2024-03-09T14:28:55.591498+0000","last_unstale":"2024-03-09T15:06:38.398060+0000","last_undegraded":"2024-03-09T15:06:38.398060+0000","last_fullsized":"2024-03-09T15:06:38.398060+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":800,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3847,"num_read_kb":3445,"num_write":1140,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'322","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.399706+0000","last_change":"2024-03-09T14:29:28.731900+0000","last_active":"2024-03-09T15:07:05.399706+0000","last_peered":"2024-03-09T15:07:05.399706+0000","last_clean":"2024-03-09T15:07:05.399706+0000","last_became_active":"2024-03-09T14:29:28.729906+0000","last_became_peered":"2024-03-09T14:29:28.729906+0000","last_unstale":"2024-03-09T15:07:05.399706+0000","last_undegraded":"2024-03-09T15:07:05.399706+0000","last_fullsized":"2024-03-09T15:07:05.399706+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:32:05.771889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":3449,"num_write":1268,"num_write_kb":20441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,4],"acting":[2,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.937932+0000","last_change":"2024-03-09T14:28:57.609587+0000","last_active":"2024-03-09T15:03:59.937932+0000","last_peered":"2024-03-09T15:03:59.937932+0000","last_clean":"2024-03-09T15:03:59.937932+0000","last_became_active":"2024-03-09T14:28:57.608697+0000","last_became_peered":"2024-03-09T14:28:57.608697+0000","last_unstale":"2024-03-09T15:03:59.937932+0000","last_undegraded":"2024-03-09T15:03:59.937932+0000","last_fullsized":"2024-03-09T15:03:59.937932+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:57.108279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'48","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.175886+0000","last_change":"2024-03-09T14:28:59.621455+0000","last_active":"2024-03-09T15:06:36.175886+0000","last_peered":"2024-03-09T15:06:36.175886+0000","last_clean":"2024-03-09T15:06:36.175886+0000","last_became_active":"2024-03-09T14:28:59.620907+0000","last_became_peered":"2024-03-09T14:28:59.620907+0000","last_unstale":"2024-03-09T15:06:36.175886+0000","last_undegraded":"2024-03-09T15:06:36.175886+0000","last_fullsized":"2024-03-09T15:06:36.175886+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.704294+0000","last_change":"2024-03-09T14:29:01.651271+0000","last_active":"2024-03-09T15:04:04.704294+0000","last_peered":"2024-03-09T15:04:04.704294+0000","last_clean":"2024-03-09T15:04:04.704294+0000","last_became_active":"2024-03-09T14:29:01.650734+0000","last_became_peered":"2024-03-09T14:29:01.650734+0000","last_unstale":"2024-03-09T15:04:04.704294+0000","last_undegraded":"2024-03-09T15:04:04.704294+0000","last_fullsized":"2024-03-09T15:04:04.704294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:42:30.232634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'222","reported_seq":779,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.745196+0000","last_change":"2024-03-09T14:29:03.687235+0000","last_active":"2024-03-09T15:06:34.745196+0000","last_peered":"2024-03-09T15:06:34.745196+0000","last_clean":"2024-03-09T15:06:34.745196+0000","last_became_active":"2024-03-09T14:29:03.686455+0000","last_became_peered":"2024-03-09T14:29:03.686455+0000","last_unstale":"2024-03-09T15:06:34.745196+0000","last_undegraded":"2024-03-09T15:06:34.745196+0000","last_fullsized":"2024-03-09T15:06:34.745196+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":435,"num_write":508,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'405","reported_seq":1934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:21.863481+0000","last_change":"2024-03-09T14:28:55.591974+0000","last_active":"2024-03-09T15:06:21.863481+0000","last_peered":"2024-03-09T15:06:21.863481+0000","last_clean":"2024-03-09T15:06:21.863481+0000","last_became_active":"2024-03-09T14:28:55.591649+0000","last_became_peered":"2024-03-09T14:28:55.591649+0000","last_unstale":"2024-03-09T15:06:21.863481+0000","last_undegraded":"2024-03-09T15:06:21.863481+0000","last_fullsized":"2024-03-09T15:06:21.863481+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:01:16.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2197,"num_read_kb":2083,"num_write":469,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'286","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.381960+0000","last_change":"2024-03-09T14:28:53.600254+0000","last_active":"2024-03-09T15:07:05.381960+0000","last_peered":"2024-03-09T15:07:05.381960+0000","last_clean":"2024-03-09T15:07:05.381960+0000","last_became_active":"2024-03-09T14:28:53.598990+0000","last_became_peered":"2024-03-09T14:28:53.598990+0000","last_unstale":"2024-03-09T15:07:05.381960+0000","last_undegraded":"2024-03-09T15:07:05.381960+0000","last_fullsized":"2024-03-09T15:07:05.381960+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:19:25.865137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245594,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":365,"num_read_kb":35562,"num_write":1017,"num_write_kb":44906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.702952+0000","last_change":"2024-03-09T14:28:57.615933+0000","last_active":"2024-03-09T15:03:59.702952+0000","last_peered":"2024-03-09T15:03:59.702952+0000","last_clean":"2024-03-09T15:03:59.702952+0000","last_became_active":"2024-03-09T14:28:57.615229+0000","last_became_peered":"2024-03-09T14:28:57.615229+0000","last_unstale":"2024-03-09T15:03:59.702952+0000","last_undegraded":"2024-03-09T15:03:59.702952+0000","last_fullsized":"2024-03-09T15:03:59.702952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:53:06.887398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'270","reported_seq":847,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.728834+0000","last_change":"2024-03-09T14:28:59.617614+0000","last_active":"2024-03-09T15:07:04.728834+0000","last_peered":"2024-03-09T15:07:04.728834+0000","last_clean":"2024-03-09T15:07:04.728834+0000","last_became_active":"2024-03-09T14:28:59.615881+0000","last_became_peered":"2024-03-09T14:28:59.615881+0000","last_unstale":"2024-03-09T15:07:04.728834+0000","last_undegraded":"2024-03-09T15:07:04.728834+0000","last_fullsized":"2024-03-09T15:07:04.728834+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:14.844823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48426,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":988,"num_write":356,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.699216+0000","last_change":"2024-03-09T14:29:01.657350+0000","last_active":"2024-03-09T15:04:04.699216+0000","last_peered":"2024-03-09T15:04:04.699216+0000","last_clean":"2024-03-09T15:04:04.699216+0000","last_became_active":"2024-03-09T14:29:01.656740+0000","last_became_peered":"2024-03-09T14:29:01.656740+0000","last_unstale":"2024-03-09T15:04:04.699216+0000","last_undegraded":"2024-03-09T15:04:04.699216+0000","last_fullsized":"2024-03-09T15:04:04.699216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:51.984064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'189","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:40.560043+0000","last_change":"2024-03-09T14:29:03.674368+0000","last_active":"2024-03-09T15:06:40.560043+0000","last_peered":"2024-03-09T15:06:40.560043+0000","last_clean":"2024-03-09T15:06:40.560043+0000","last_became_active":"2024-03-09T14:29:03.671571+0000","last_became_peered":"2024-03-09T14:29:03.671571+0000","last_unstale":"2024-03-09T15:06:40.560043+0000","last_undegraded":"2024-03-09T15:06:40.560043+0000","last_fullsized":"2024-03-09T15:06:40.560043+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:55:55.769903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":257,"num_read_kb":221,"num_write":372,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'1158","reported_seq":2774,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.374429+0000","last_change":"2024-03-09T14:28:55.596769+0000","last_active":"2024-03-09T15:06:38.374429+0000","last_peered":"2024-03-09T15:06:38.374429+0000","last_clean":"2024-03-09T15:06:38.374429+0000","last_became_active":"2024-03-09T14:28:55.592387+0000","last_became_peered":"2024-03-09T14:28:55.592387+0000","last_unstale":"2024-03-09T15:06:38.374429+0000","last_undegraded":"2024-03-09T15:06:38.374429+0000","last_fullsized":"2024-03-09T15:06:38.374429+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":1100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:32:02.543520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4979,"num_read_kb":4357,"num_write":1600,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'325","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.407849+0000","last_change":"2024-03-09T14:28:53.627197+0000","last_active":"2024-03-09T15:07:05.407849+0000","last_peered":"2024-03-09T15:07:05.407849+0000","last_clean":"2024-03-09T15:07:05.407849+0000","last_became_active":"2024-03-09T14:28:53.626736+0000","last_became_peered":"2024-03-09T14:28:53.626736+0000","last_unstale":"2024-03-09T15:07:05.407849+0000","last_undegraded":"2024-03-09T15:07:05.407849+0000","last_fullsized":"2024-03-09T15:07:05.407849+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655827,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":493,"num_read_kb":7830,"num_write":1223,"num_write_kb":47405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.698154+0000","last_change":"2024-03-09T14:28:57.614929+0000","last_active":"2024-03-09T15:03:59.698154+0000","last_peered":"2024-03-09T15:03:59.698154+0000","last_clean":"2024-03-09T15:03:59.698154+0000","last_became_active":"2024-03-09T14:28:57.613999+0000","last_became_peered":"2024-03-09T14:28:57.613999+0000","last_unstale":"2024-03-09T15:03:59.698154+0000","last_undegraded":"2024-03-09T15:03:59.698154+0000","last_fullsized":"2024-03-09T15:03:59.698154+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T14:36:44.418823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'255","reported_seq":816,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.517558+0000","last_change":"2024-03-09T14:28:59.615487+0000","last_active":"2024-03-09T15:07:04.517558+0000","last_peered":"2024-03-09T15:07:04.517558+0000","last_clean":"2024-03-09T15:07:04.517558+0000","last_became_active":"2024-03-09T14:28:59.614754+0000","last_became_peered":"2024-03-09T14:28:59.614754+0000","last_unstale":"2024-03-09T15:07:04.517558+0000","last_undegraded":"2024-03-09T15:07:04.517558+0000","last_fullsized":"2024-03-09T15:07:04.517558+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:55:46.151434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43227,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":1017,"num_write":350,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.742023+0000","last_change":"2024-03-09T14:29:01.648210+0000","last_active":"2024-03-09T15:06:24.742023+0000","last_peered":"2024-03-09T15:06:24.742023+0000","last_clean":"2024-03-09T15:06:24.742023+0000","last_became_active":"2024-03-09T14:29:01.647570+0000","last_became_peered":"2024-03-09T14:29:01.647570+0000","last_unstale":"2024-03-09T15:06:24.742023+0000","last_undegraded":"2024-03-09T15:06:24.742023+0000","last_fullsized":"2024-03-09T15:06:24.742023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'814","reported_seq":2349,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:30.930229+0000","last_change":"2024-03-09T14:28:55.600454+0000","last_active":"2024-03-09T15:06:30.930229+0000","last_peered":"2024-03-09T15:06:30.930229+0000","last_clean":"2024-03-09T15:06:30.930229+0000","last_became_active":"2024-03-09T14:28:55.599825+0000","last_became_peered":"2024-03-09T14:28:55.599825+0000","last_unstale":"2024-03-09T15:06:30.930229+0000","last_undegraded":"2024-03-09T15:06:30.930229+0000","last_fullsized":"2024-03-09T15:06:30.930229+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":800,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:16:30.042238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3687,"num_read_kb":3276,"num_write":1113,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'290","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.365176+0000","last_change":"2024-03-09T14:28:53.565880+0000","last_active":"2024-03-09T15:07:05.365176+0000","last_peered":"2024-03-09T15:07:05.365176+0000","last_clean":"2024-03-09T15:07:05.365176+0000","last_became_active":"2024-03-09T14:28:53.565431+0000","last_became_peered":"2024-03-09T14:28:53.565431+0000","last_unstale":"2024-03-09T15:07:05.365176+0000","last_undegraded":"2024-03-09T15:07:05.365176+0000","last_fullsized":"2024-03-09T15:07:05.365176+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:17:59.099392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655871,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":381,"num_read_kb":7268,"num_write":971,"num_write_kb":31379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.752374+0000","last_change":"2024-03-09T14:28:57.611182+0000","last_active":"2024-03-09T15:07:04.752374+0000","last_peered":"2024-03-09T15:07:04.752374+0000","last_clean":"2024-03-09T15:07:04.752374+0000","last_became_active":"2024-03-09T14:28:57.610126+0000","last_became_peered":"2024-03-09T14:28:57.610126+0000","last_unstale":"2024-03-09T15:07:04.752374+0000","last_undegraded":"2024-03-09T15:07:04.752374+0000","last_fullsized":"2024-03-09T15:07:04.752374+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'474","reported_seq":1101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.439006+0000","last_change":"2024-03-09T14:28:59.614860+0000","last_active":"2024-03-09T15:07:04.439006+0000","last_peered":"2024-03-09T15:07:04.439006+0000","last_clean":"2024-03-09T15:07:04.439006+0000","last_became_active":"2024-03-09T14:28:59.614069+0000","last_became_peered":"2024-03-09T14:28:59.614069+0000","last_unstale":"2024-03-09T15:07:04.439006+0000","last_undegraded":"2024-03-09T15:07:04.439006+0000","last_fullsized":"2024-03-09T15:07:04.439006+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88057,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":2100,"num_write":750,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.885313+0000","last_change":"2024-03-09T14:29:01.640843+0000","last_active":"2024-03-09T15:04:04.885313+0000","last_peered":"2024-03-09T15:04:04.885313+0000","last_clean":"2024-03-09T15:04:04.885313+0000","last_became_active":"2024-03-09T14:29:01.639825+0000","last_became_peered":"2024-03-09T14:29:01.639825+0000","last_unstale":"2024-03-09T15:04:04.885313+0000","last_undegraded":"2024-03-09T15:04:04.885313+0000","last_fullsized":"2024-03-09T15:04:04.885313+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:39:04.267480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'149","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.868628+0000","last_change":"2024-03-09T14:29:03.667287+0000","last_active":"2024-03-09T15:06:36.868628+0000","last_peered":"2024-03-09T15:06:36.868628+0000","last_clean":"2024-03-09T15:06:36.868628+0000","last_became_active":"2024-03-09T14:29:03.666515+0000","last_became_peered":"2024-03-09T14:29:03.666515+0000","last_unstale":"2024-03-09T15:06:36.868628+0000","last_undegraded":"2024-03-09T15:06:36.868628+0000","last_fullsized":"2024-03-09T15:06:36.868628+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:42.886520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":181,"num_write":332,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'874","reported_seq":2621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:59.751548+0000","last_change":"2024-03-09T14:28:55.586646+0000","last_active":"2024-03-09T15:06:59.751548+0000","last_peered":"2024-03-09T15:06:59.751548+0000","last_clean":"2024-03-09T15:06:59.751548+0000","last_became_active":"2024-03-09T14:28:55.586247+0000","last_became_peered":"2024-03-09T14:28:55.586247+0000","last_unstale":"2024-03-09T15:06:59.751548+0000","last_undegraded":"2024-03-09T15:06:59.751548+0000","last_fullsized":"2024-03-09T15:06:59.751548+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4288,"num_read_kb":3851,"num_write":1208,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'317","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.402309+0000","last_change":"2024-03-09T14:28:53.618203+0000","last_active":"2024-03-09T15:07:05.402309+0000","last_peered":"2024-03-09T15:07:05.402309+0000","last_clean":"2024-03-09T15:07:05.402309+0000","last_became_active":"2024-03-09T14:28:53.617832+0000","last_became_peered":"2024-03-09T14:28:53.617832+0000","last_unstale":"2024-03-09T15:07:05.402309+0000","last_undegraded":"2024-03-09T15:07:05.402309+0000","last_fullsized":"2024-03-09T15:07:05.402309+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22651,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":36525,"num_write":1106,"num_write_kb":22031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:24.703460+0000","last_change":"2024-03-09T14:28:57.616765+0000","last_active":"2024-03-09T15:04:24.703460+0000","last_peered":"2024-03-09T15:04:24.703460+0000","last_clean":"2024-03-09T15:04:24.703460+0000","last_became_active":"2024-03-09T14:28:57.616057+0000","last_became_peered":"2024-03-09T14:28:57.616057+0000","last_unstale":"2024-03-09T15:04:24.703460+0000","last_undegraded":"2024-03-09T15:04:24.703460+0000","last_fullsized":"2024-03-09T15:04:24.703460+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:41:28.651737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'267","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.590358+0000","last_change":"2024-03-09T14:28:59.616152+0000","last_active":"2024-03-09T15:07:04.590358+0000","last_peered":"2024-03-09T15:07:04.590358+0000","last_clean":"2024-03-09T15:07:04.590358+0000","last_became_active":"2024-03-09T14:28:59.615193+0000","last_became_peered":"2024-03-09T14:28:59.615193+0000","last_unstale":"2024-03-09T15:07:04.590358+0000","last_undegraded":"2024-03-09T15:07:04.590358+0000","last_fullsized":"2024-03-09T15:07:04.590358+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:59:33.826109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43919,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":455,"num_read_kb":986,"num_write":382,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:35.098102+0000","last_change":"2024-03-09T14:29:01.661393+0000","last_active":"2024-03-09T15:06:35.098102+0000","last_peered":"2024-03-09T15:06:35.098102+0000","last_clean":"2024-03-09T15:06:35.098102+0000","last_became_active":"2024-03-09T14:29:01.660997+0000","last_became_peered":"2024-03-09T14:29:01.660997+0000","last_unstale":"2024-03-09T15:06:35.098102+0000","last_undegraded":"2024-03-09T15:06:35.098102+0000","last_fullsized":"2024-03-09T15:06:35.098102+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'181","reported_seq":1376,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.944898+0000","last_change":"2024-03-09T14:29:03.669572+0000","last_active":"2024-03-09T15:06:53.944898+0000","last_peered":"2024-03-09T15:06:53.944898+0000","last_clean":"2024-03-09T15:06:53.944898+0000","last_became_active":"2024-03-09T14:29:03.668833+0000","last_became_peered":"2024-03-09T14:29:03.668833+0000","last_unstale":"2024-03-09T15:06:53.944898+0000","last_undegraded":"2024-03-09T15:06:53.944898+0000","last_fullsized":"2024-03-09T15:06:53.944898+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:05:52.062869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2487,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":947,"num_read_kb":932,"num_write":509,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'486","reported_seq":2228,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.516678+0000","last_change":"2024-03-09T14:28:55.597840+0000","last_active":"2024-03-09T15:06:32.516678+0000","last_peered":"2024-03-09T15:06:32.516678+0000","last_clean":"2024-03-09T15:06:32.516678+0000","last_became_active":"2024-03-09T14:28:55.596538+0000","last_became_peered":"2024-03-09T14:28:55.596538+0000","last_unstale":"2024-03-09T15:06:32.516678+0000","last_undegraded":"2024-03-09T15:06:32.516678+0000","last_fullsized":"2024-03-09T15:06:32.516678+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:07:17.844183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2772,"num_read_kb":2616,"num_write":579,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'289","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.371716+0000","last_change":"2024-03-09T14:28:53.597236+0000","last_active":"2024-03-09T15:07:05.371716+0000","last_peered":"2024-03-09T15:07:05.371716+0000","last_clean":"2024-03-09T15:07:05.371716+0000","last_became_active":"2024-03-09T14:28:53.589932+0000","last_became_peered":"2024-03-09T14:28:53.589932+0000","last_unstale":"2024-03-09T15:07:05.371716+0000","last_undegraded":"2024-03-09T15:07:05.371716+0000","last_fullsized":"2024-03-09T15:07:05.371716+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:18:23.444910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10486772,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":425,"num_read_kb":14456,"num_write":988,"num_write_kb":42013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.699471+0000","last_change":"2024-03-09T14:28:57.610733+0000","last_active":"2024-03-09T15:03:59.699471+0000","last_peered":"2024-03-09T15:03:59.699471+0000","last_clean":"2024-03-09T15:03:59.699471+0000","last_became_active":"2024-03-09T14:28:57.609903+0000","last_became_peered":"2024-03-09T14:28:57.609903+0000","last_unstale":"2024-03-09T15:03:59.699471+0000","last_undegraded":"2024-03-09T15:03:59.699471+0000","last_fullsized":"2024-03-09T15:03:59.699471+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:06:42.154492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'259","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.245145+0000","last_change":"2024-03-09T14:28:59.631074+0000","last_active":"2024-03-09T15:07:03.245145+0000","last_peered":"2024-03-09T15:07:03.245145+0000","last_clean":"2024-03-09T15:07:03.245145+0000","last_became_active":"2024-03-09T14:28:59.630460+0000","last_became_peered":"2024-03-09T14:28:59.630460+0000","last_unstale":"2024-03-09T15:07:03.245145+0000","last_undegraded":"2024-03-09T15:07:03.245145+0000","last_fullsized":"2024-03-09T15:07:03.245145+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:43:09.212045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":1036,"num_write":360,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.104168+0000","last_change":"2024-03-09T14:29:01.636817+0000","last_active":"2024-03-09T15:07:05.104168+0000","last_peered":"2024-03-09T15:07:05.104168+0000","last_clean":"2024-03-09T15:07:05.104168+0000","last_became_active":"2024-03-09T14:29:01.636083+0000","last_became_peered":"2024-03-09T14:29:01.636083+0000","last_unstale":"2024-03-09T15:07:05.104168+0000","last_undegraded":"2024-03-09T15:07:05.104168+0000","last_fullsized":"2024-03-09T15:07:05.104168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'121","reported_seq":604,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.502593+0000","last_change":"2024-03-09T14:29:03.678242+0000","last_active":"2024-03-09T15:06:55.502593+0000","last_peered":"2024-03-09T15:06:55.502593+0000","last_clean":"2024-03-09T15:06:55.502593+0000","last_became_active":"2024-03-09T14:29:03.677376+0000","last_became_peered":"2024-03-09T14:29:03.677376+0000","last_unstale":"2024-03-09T15:06:55.502593+0000","last_undegraded":"2024-03-09T15:06:55.502593+0000","last_fullsized":"2024-03-09T15:06:55.502593+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:47.054570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":93,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'1138","reported_seq":2990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:01.820596+0000","last_change":"2024-03-09T14:28:55.588136+0000","last_active":"2024-03-09T15:06:01.820596+0000","last_peered":"2024-03-09T15:06:01.820596+0000","last_clean":"2024-03-09T15:06:01.820596+0000","last_became_active":"2024-03-09T14:28:55.587547+0000","last_became_peered":"2024-03-09T14:28:55.587547+0000","last_unstale":"2024-03-09T15:06:01.820596+0000","last_undegraded":"2024-03-09T15:06:01.820596+0000","last_fullsized":"2024-03-09T15:06:01.820596+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:58:51.176419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5366,"num_read_kb":4772,"num_write":1564,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'284","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.283858+0000","last_change":"2024-03-09T14:28:53.589911+0000","last_active":"2024-03-09T15:07:05.283858+0000","last_peered":"2024-03-09T15:07:05.283858+0000","last_clean":"2024-03-09T15:07:05.283858+0000","last_became_active":"2024-03-09T14:28:53.589407+0000","last_became_peered":"2024-03-09T14:28:53.589407+0000","last_unstale":"2024-03-09T15:07:05.283858+0000","last_undegraded":"2024-03-09T15:07:05.283858+0000","last_fullsized":"2024-03-09T15:07:05.283858+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":59464,"num_write":1037,"num_write_kb":28198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:30.096937+0000","last_change":"2024-03-09T14:28:57.620777+0000","last_active":"2024-03-09T15:06:30.096937+0000","last_peered":"2024-03-09T15:06:30.096937+0000","last_clean":"2024-03-09T15:06:30.096937+0000","last_became_active":"2024-03-09T14:28:57.620140+0000","last_became_peered":"2024-03-09T14:28:57.620140+0000","last_unstale":"2024-03-09T15:06:30.096937+0000","last_undegraded":"2024-03-09T15:06:30.096937+0000","last_fullsized":"2024-03-09T15:06:30.096937+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'72","reported_seq":584,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:19.385761+0000","last_change":"2024-03-09T14:28:59.630490+0000","last_active":"2024-03-09T15:06:19.385761+0000","last_peered":"2024-03-09T15:06:19.385761+0000","last_clean":"2024-03-09T15:06:19.385761+0000","last_became_active":"2024-03-09T14:28:59.629734+0000","last_became_peered":"2024-03-09T14:28:59.629734+0000","last_unstale":"2024-03-09T15:06:19.385761+0000","last_undegraded":"2024-03-09T15:06:19.385761+0000","last_fullsized":"2024-03-09T15:06:19.385761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:44:21.794038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":70,"num_read_kb":63,"num_write":56,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'540","reported_seq":2054,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.190993+0000","last_change":"2024-03-09T14:29:01.651371+0000","last_active":"2024-03-09T15:07:03.190993+0000","last_peered":"2024-03-09T15:07:03.190993+0000","last_clean":"2024-03-09T15:07:03.190993+0000","last_became_active":"2024-03-09T14:29:01.650590+0000","last_became_peered":"2024-03-09T14:29:01.650590+0000","last_unstale":"2024-03-09T15:07:03.190993+0000","last_undegraded":"2024-03-09T15:07:03.190993+0000","last_fullsized":"2024-03-09T15:07:03.190993+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:16:18.239400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'124","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.980854+0000","last_change":"2024-03-09T14:29:03.677895+0000","last_active":"2024-03-09T15:06:24.980854+0000","last_peered":"2024-03-09T15:06:24.980854+0000","last_clean":"2024-03-09T15:06:24.980854+0000","last_became_active":"2024-03-09T14:29:03.677064+0000","last_became_peered":"2024-03-09T14:29:03.677064+0000","last_unstale":"2024-03-09T15:06:24.980854+0000","last_undegraded":"2024-03-09T15:06:24.980854+0000","last_fullsized":"2024-03-09T15:06:24.980854+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:21:06.747179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":150,"num_write":318,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'509","reported_seq":1975,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.288260+0000","last_change":"2024-03-09T14:28:55.610871+0000","last_active":"2024-03-09T15:06:41.288260+0000","last_peered":"2024-03-09T15:06:41.288260+0000","last_clean":"2024-03-09T15:06:41.288260+0000","last_became_active":"2024-03-09T14:28:55.610134+0000","last_became_peered":"2024-03-09T14:28:55.610134+0000","last_unstale":"2024-03-09T15:06:41.288260+0000","last_undegraded":"2024-03-09T15:06:41.288260+0000","last_fullsized":"2024-03-09T15:06:41.288260+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:52:17.579543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2571,"num_read_kb":2332,"num_write":699,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'430","reported_seq":1148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.377930+0000","last_change":"2024-03-09T14:28:53.637554+0000","last_active":"2024-03-09T15:07:05.377930+0000","last_peered":"2024-03-09T15:07:05.377930+0000","last_clean":"2024-03-09T15:07:05.377930+0000","last_became_active":"2024-03-09T14:28:53.636761+0000","last_became_peered":"2024-03-09T14:28:53.636761+0000","last_unstale":"2024-03-09T15:07:05.377930+0000","last_undegraded":"2024-03-09T15:07:05.377930+0000","last_fullsized":"2024-03-09T15:07:05.377930+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:52:47.651977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":788,"num_read_kb":7041,"num_write":1515,"num_write_kb":16792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.703042+0000","last_change":"2024-03-09T14:28:57.613685+0000","last_active":"2024-03-09T15:03:59.703042+0000","last_peered":"2024-03-09T15:03:59.703042+0000","last_clean":"2024-03-09T15:03:59.703042+0000","last_became_active":"2024-03-09T14:28:57.612982+0000","last_became_peered":"2024-03-09T14:28:57.612982+0000","last_unstale":"2024-03-09T15:03:59.703042+0000","last_undegraded":"2024-03-09T15:03:59.703042+0000","last_fullsized":"2024-03-09T15:03:59.703042+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:06:42.400023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'288","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.799108+0000","last_change":"2024-03-09T14:28:59.601758+0000","last_active":"2024-03-09T15:07:03.799108+0000","last_peered":"2024-03-09T15:07:03.799108+0000","last_clean":"2024-03-09T15:07:03.799108+0000","last_became_active":"2024-03-09T14:28:59.601007+0000","last_became_peered":"2024-03-09T14:28:59.601007+0000","last_unstale":"2024-03-09T15:07:03.799108+0000","last_undegraded":"2024-03-09T15:07:03.799108+0000","last_fullsized":"2024-03-09T15:07:03.799108+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:49:57.069347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58554,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":1103,"num_write":386,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:19.727153+0000","last_change":"2024-03-09T14:29:01.657738+0000","last_active":"2024-03-09T15:05:19.727153+0000","last_peered":"2024-03-09T15:05:19.727153+0000","last_clean":"2024-03-09T15:05:19.727153+0000","last_became_active":"2024-03-09T14:29:01.657169+0000","last_became_peered":"2024-03-09T14:29:01.657169+0000","last_unstale":"2024-03-09T15:05:19.727153+0000","last_undegraded":"2024-03-09T15:05:19.727153+0000","last_fullsized":"2024-03-09T15:05:19.727153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'122","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:51.348829+0000","last_change":"2024-03-09T14:29:03.670802+0000","last_active":"2024-03-09T15:06:51.348829+0000","last_peered":"2024-03-09T15:06:51.348829+0000","last_clean":"2024-03-09T15:06:51.348829+0000","last_became_active":"2024-03-09T14:29:03.669978+0000","last_became_peered":"2024-03-09T14:29:03.669978+0000","last_unstale":"2024-03-09T15:06:51.348829+0000","last_undegraded":"2024-03-09T15:06:51.348829+0000","last_fullsized":"2024-03-09T15:06:51.348829+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:24:30.237273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":289,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'771","reported_seq":2297,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.376951+0000","last_change":"2024-03-09T14:28:55.570920+0000","last_active":"2024-03-09T15:06:38.376951+0000","last_peered":"2024-03-09T15:06:38.376951+0000","last_clean":"2024-03-09T15:06:38.376951+0000","last_became_active":"2024-03-09T14:28:55.570161+0000","last_became_peered":"2024-03-09T14:28:55.570161+0000","last_unstale":"2024-03-09T15:06:38.376951+0000","last_undegraded":"2024-03-09T15:06:38.376951+0000","last_fullsized":"2024-03-09T15:06:38.376951+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:42:17.825813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3636,"num_read_kb":3267,"num_write":1033,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'351","reported_seq":1010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.264856+0000","last_change":"2024-03-09T14:29:28.825741+0000","last_active":"2024-03-09T15:07:05.264856+0000","last_peered":"2024-03-09T15:07:05.264856+0000","last_clean":"2024-03-09T15:07:05.264856+0000","last_became_active":"2024-03-09T14:29:28.824399+0000","last_became_peered":"2024-03-09T14:29:28.824399+0000","last_unstale":"2024-03-09T15:07:05.264856+0000","last_undegraded":"2024-03-09T15:07:05.264856+0000","last_fullsized":"2024-03-09T15:07:05.264856+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:08:57.826548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":600,"num_read_kb":66383,"num_write":1403,"num_write_kb":58469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:59.884189+0000","last_change":"2024-03-09T14:28:57.609386+0000","last_active":"2024-03-09T15:03:59.884189+0000","last_peered":"2024-03-09T15:03:59.884189+0000","last_clean":"2024-03-09T15:03:59.884189+0000","last_became_active":"2024-03-09T14:28:57.608639+0000","last_became_peered":"2024-03-09T14:28:57.608639+0000","last_unstale":"2024-03-09T15:03:59.884189+0000","last_undegraded":"2024-03-09T15:03:59.884189+0000","last_fullsized":"2024-03-09T15:03:59.884189+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:26:53.678171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'267","reported_seq":825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.884558+0000","last_change":"2024-03-09T14:28:59.624561+0000","last_active":"2024-03-09T15:07:03.884558+0000","last_peered":"2024-03-09T15:07:03.884558+0000","last_clean":"2024-03-09T15:07:03.884558+0000","last_became_active":"2024-03-09T14:28:59.623529+0000","last_became_peered":"2024-03-09T14:28:59.623529+0000","last_unstale":"2024-03-09T15:07:03.884558+0000","last_undegraded":"2024-03-09T15:07:03.884558+0000","last_fullsized":"2024-03-09T15:07:03.884558+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":971,"num_write":346,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:03:04.685658+0000","last_change":"2024-03-09T14:29:01.651867+0000","last_active":"2024-03-09T15:03:04.685658+0000","last_peered":"2024-03-09T15:03:04.685658+0000","last_clean":"2024-03-09T15:03:04.685658+0000","last_became_active":"2024-03-09T14:29:01.651183+0000","last_became_peered":"2024-03-09T14:29:01.651183+0000","last_unstale":"2024-03-09T15:03:04.685658+0000","last_undegraded":"2024-03-09T15:03:04.685658+0000","last_fullsized":"2024-03-09T15:03:04.685658+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:00:28.916197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'121","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:50.981576+0000","last_change":"2024-03-09T14:29:03.662620+0000","last_active":"2024-03-09T15:04:50.981576+0000","last_peered":"2024-03-09T15:04:50.981576+0000","last_clean":"2024-03-09T15:04:50.981576+0000","last_became_active":"2024-03-09T14:29:03.661848+0000","last_became_peered":"2024-03-09T14:29:03.661848+0000","last_unstale":"2024-03-09T15:04:50.981576+0000","last_undegraded":"2024-03-09T15:04:50.981576+0000","last_fullsized":"2024-03-09T15:04:50.981576+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:22:12.693452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":975,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":172,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'742","reported_seq":2302,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:22.942126+0000","last_change":"2024-03-09T14:28:55.582020+0000","last_active":"2024-03-09T15:06:22.942126+0000","last_peered":"2024-03-09T15:06:22.942126+0000","last_clean":"2024-03-09T15:06:22.942126+0000","last_became_active":"2024-03-09T14:28:55.580902+0000","last_became_peered":"2024-03-09T14:28:55.580902+0000","last_unstale":"2024-03-09T15:06:22.942126+0000","last_undegraded":"2024-03-09T15:06:22.942126+0000","last_fullsized":"2024-03-09T15:06:22.942126+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:36:35.032329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3409,"num_read_kb":3074,"num_write":976,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'296","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.387565+0000","last_change":"2024-03-09T14:28:53.619086+0000","last_active":"2024-03-09T15:07:05.387565+0000","last_peered":"2024-03-09T15:07:05.387565+0000","last_clean":"2024-03-09T15:07:05.387565+0000","last_became_active":"2024-03-09T14:28:53.618470+0000","last_became_peered":"2024-03-09T14:28:53.618470+0000","last_unstale":"2024-03-09T15:07:05.387565+0000","last_undegraded":"2024-03-09T15:07:05.387565+0000","last_fullsized":"2024-03-09T15:07:05.387565+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:00:32.753851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243044,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":49463,"num_write":1149,"num_write_kb":38192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:02:49.683621+0000","last_change":"2024-03-09T14:28:57.612579+0000","last_active":"2024-03-09T15:02:49.683621+0000","last_peered":"2024-03-09T15:02:49.683621+0000","last_clean":"2024-03-09T15:02:49.683621+0000","last_became_active":"2024-03-09T14:28:57.611745+0000","last_became_peered":"2024-03-09T14:28:57.611745+0000","last_unstale":"2024-03-09T15:02:49.683621+0000","last_undegraded":"2024-03-09T15:02:49.683621+0000","last_fullsized":"2024-03-09T15:02:49.683621+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:31:50.123606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'213","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.032335+0000","last_change":"2024-03-09T14:28:59.617486+0000","last_active":"2024-03-09T15:07:03.032335+0000","last_peered":"2024-03-09T15:07:03.032335+0000","last_clean":"2024-03-09T15:07:03.032335+0000","last_became_active":"2024-03-09T14:28:59.615400+0000","last_became_peered":"2024-03-09T14:28:59.615400+0000","last_unstale":"2024-03-09T15:07:03.032335+0000","last_undegraded":"2024-03-09T15:07:03.032335+0000","last_fullsized":"2024-03-09T15:07:03.032335+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:18:51.266792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41975,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":356,"num_read_kb":841,"num_write":286,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:04:04.700482+0000","last_change":"2024-03-09T14:29:01.657829+0000","last_active":"2024-03-09T15:04:04.700482+0000","last_peered":"2024-03-09T15:04:04.700482+0000","last_clean":"2024-03-09T15:04:04.700482+0000","last_became_active":"2024-03-09T14:29:01.657117+0000","last_became_peered":"2024-03-09T14:29:01.657117+0000","last_unstale":"2024-03-09T15:04:04.700482+0000","last_undegraded":"2024-03-09T15:04:04.700482+0000","last_fullsized":"2024-03-09T15:04:04.700482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:43:59.466343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'133","reported_seq":1791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.893900+0000","last_change":"2024-03-09T14:29:03.660649+0000","last_active":"2024-03-09T15:06:53.893900+0000","last_peered":"2024-03-09T15:06:53.893900+0000","last_clean":"2024-03-09T15:06:53.893900+0000","last_became_active":"2024-03-09T14:29:03.659930+0000","last_became_peered":"2024-03-09T14:29:03.659930+0000","last_unstale":"2024-03-09T15:06:53.893900+0000","last_undegraded":"2024-03-09T15:06:53.893900+0000","last_fullsized":"2024-03-09T15:06:53.893900+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:47.922788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1320,"num_read_kb":1317,"num_write":320,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'484","reported_seq":2147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.154286+0000","last_change":"2024-03-09T14:28:55.599386+0000","last_active":"2024-03-09T15:06:36.154286+0000","last_peered":"2024-03-09T15:06:36.154286+0000","last_clean":"2024-03-09T15:06:36.154286+0000","last_became_active":"2024-03-09T14:28:55.598822+0000","last_became_peered":"2024-03-09T14:28:55.598822+0000","last_unstale":"2024-03-09T15:06:36.154286+0000","last_undegraded":"2024-03-09T15:06:36.154286+0000","last_fullsized":"2024-03-09T15:06:36.154286+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:50:22.447249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2615,"num_read_kb":2447,"num_write":578,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'291","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.423247+0000","last_change":"2024-03-09T14:28:53.595926+0000","last_active":"2024-03-09T15:07:05.423247+0000","last_peered":"2024-03-09T15:07:05.423247+0000","last_clean":"2024-03-09T15:07:05.423247+0000","last_became_active":"2024-03-09T14:28:53.595479+0000","last_became_peered":"2024-03-09T14:28:53.595479+0000","last_unstale":"2024-03-09T15:07:05.423247+0000","last_undegraded":"2024-03-09T15:07:05.423247+0000","last_fullsized":"2024-03-09T15:07:05.423247+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311401,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":399,"num_read_kb":37243,"num_write":1062,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:15.075301+0000","last_change":"2024-03-09T14:28:57.608989+0000","last_active":"2024-03-09T15:05:15.075301+0000","last_peered":"2024-03-09T15:05:15.075301+0000","last_clean":"2024-03-09T15:05:15.075301+0000","last_became_active":"2024-03-09T14:28:57.608170+0000","last_became_peered":"2024-03-09T14:28:57.608170+0000","last_unstale":"2024-03-09T15:05:15.075301+0000","last_undegraded":"2024-03-09T15:05:15.075301+0000","last_fullsized":"2024-03-09T15:05:15.075301+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'254","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.336978+0000","last_change":"2024-03-09T14:28:59.615602+0000","last_active":"2024-03-09T15:07:03.336978+0000","last_peered":"2024-03-09T15:07:03.336978+0000","last_clean":"2024-03-09T15:07:03.336978+0000","last_became_active":"2024-03-09T14:28:59.614271+0000","last_became_peered":"2024-03-09T14:28:59.614271+0000","last_unstale":"2024-03-09T15:07:03.336978+0000","last_undegraded":"2024-03-09T15:07:03.336978+0000","last_fullsized":"2024-03-09T15:07:03.336978+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":200,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:53:14.078880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45957,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":426,"num_read_kb":925,"num_write":332,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.744961+0000","last_change":"2024-03-09T14:29:01.652400+0000","last_active":"2024-03-09T15:06:34.744961+0000","last_peered":"2024-03-09T15:06:34.744961+0000","last_clean":"2024-03-09T15:06:34.744961+0000","last_became_active":"2024-03-09T14:29:01.648467+0000","last_became_peered":"2024-03-09T14:29:01.648467+0000","last_unstale":"2024-03-09T15:06:34.744961+0000","last_undegraded":"2024-03-09T15:06:34.744961+0000","last_fullsized":"2024-03-09T15:06:34.744961+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'89","reported_seq":573,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.103203+0000","last_change":"2024-03-09T14:29:03.666859+0000","last_active":"2024-03-09T15:06:27.103203+0000","last_peered":"2024-03-09T15:06:27.103203+0000","last_clean":"2024-03-09T15:06:27.103203+0000","last_became_active":"2024-03-09T14:29:03.666157+0000","last_became_peered":"2024-03-09T14:29:03.666157+0000","last_unstale":"2024-03-09T15:06:27.103203+0000","last_undegraded":"2024-03-09T15:06:27.103203+0000","last_fullsized":"2024-03-09T15:06:27.103203+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:26:26.981367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":67,"num_write":211,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'502","reported_seq":2002,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.399288+0000","last_change":"2024-03-09T14:28:55.591379+0000","last_active":"2024-03-09T15:06:38.399288+0000","last_peered":"2024-03-09T15:06:38.399288+0000","last_clean":"2024-03-09T15:06:38.399288+0000","last_became_active":"2024-03-09T14:28:55.591054+0000","last_became_peered":"2024-03-09T14:28:55.591054+0000","last_unstale":"2024-03-09T15:06:38.399288+0000","last_undegraded":"2024-03-09T15:06:38.399288+0000","last_fullsized":"2024-03-09T15:06:38.399288+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2590,"num_read_kb":2449,"num_write":673,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'308","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.378642+0000","last_change":"2024-03-09T14:28:53.640090+0000","last_active":"2024-03-09T15:07:05.378642+0000","last_peered":"2024-03-09T15:07:05.378642+0000","last_clean":"2024-03-09T15:07:05.378642+0000","last_became_active":"2024-03-09T14:28:53.638941+0000","last_became_peered":"2024-03-09T14:28:53.638941+0000","last_unstale":"2024-03-09T15:07:05.378642+0000","last_undegraded":"2024-03-09T15:07:05.378642+0000","last_fullsized":"2024-03-09T15:07:05.378642+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:03:53.299755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505214,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":466,"num_read_kb":10894,"num_write":1166,"num_write_kb":33356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'698","reported_seq":2159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.637861+0000","last_change":"2024-03-09T14:28:55.582893+0000","last_active":"2024-03-09T15:06:29.637861+0000","last_peered":"2024-03-09T15:06:29.637861+0000","last_clean":"2024-03-09T15:06:29.637861+0000","last_became_active":"2024-03-09T14:28:55.578705+0000","last_became_peered":"2024-03-09T14:28:55.578705+0000","last_unstale":"2024-03-09T15:06:29.637861+0000","last_undegraded":"2024-03-09T15:06:29.637861+0000","last_fullsized":"2024-03-09T15:06:29.637861+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3212,"num_read_kb":2884,"num_write":923,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'308","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.239870+0000","last_change":"2024-03-09T14:28:53.618037+0000","last_active":"2024-03-09T15:07:05.239870+0000","last_peered":"2024-03-09T15:07:05.239870+0000","last_clean":"2024-03-09T15:07:05.239870+0000","last_became_active":"2024-03-09T14:28:53.617469+0000","last_became_peered":"2024-03-09T14:28:53.617469+0000","last_unstale":"2024-03-09T15:07:05.239870+0000","last_undegraded":"2024-03-09T15:07:05.239870+0000","last_fullsized":"2024-03-09T15:07:05.239870+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:13:32.235158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":486,"num_read_kb":96508,"num_write":1206,"num_write_kb":39289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'474","reported_seq":2150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.920469+0000","last_change":"2024-03-09T14:28:55.595276+0000","last_active":"2024-03-09T15:06:39.920469+0000","last_peered":"2024-03-09T15:06:39.920469+0000","last_clean":"2024-03-09T15:06:39.920469+0000","last_became_active":"2024-03-09T14:28:55.594171+0000","last_became_peered":"2024-03-09T14:28:55.594171+0000","last_unstale":"2024-03-09T15:06:39.920469+0000","last_undegraded":"2024-03-09T15:06:39.920469+0000","last_fullsized":"2024-03-09T15:06:39.920469+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:59.297943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2696,"num_read_kb":2529,"num_write":600,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'314","reported_seq":1023,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.408686+0000","last_change":"2024-03-09T14:28:53.627660+0000","last_active":"2024-03-09T15:07:05.408686+0000","last_peered":"2024-03-09T15:07:05.408686+0000","last_clean":"2024-03-09T15:07:05.408686+0000","last_became_active":"2024-03-09T14:28:53.627011+0000","last_became_peered":"2024-03-09T14:28:53.627011+0000","last_unstale":"2024-03-09T15:07:05.408686+0000","last_undegraded":"2024-03-09T15:07:05.408686+0000","last_fullsized":"2024-03-09T15:07:05.408686+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:28:43.144281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524303,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":582,"num_read_kb":86707,"num_write":1181,"num_write_kb":21935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'404","reported_seq":2037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:28.259387+0000","last_change":"2024-03-09T14:28:55.578260+0000","last_active":"2024-03-09T15:06:28.259387+0000","last_peered":"2024-03-09T15:06:28.259387+0000","last_clean":"2024-03-09T15:06:28.259387+0000","last_became_active":"2024-03-09T14:28:55.577524+0000","last_became_peered":"2024-03-09T14:28:55.577524+0000","last_unstale":"2024-03-09T15:06:28.259387+0000","last_undegraded":"2024-03-09T15:06:28.259387+0000","last_fullsized":"2024-03-09T15:06:28.259387+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2346,"num_read_kb":2237,"num_write":463,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'369","reported_seq":1129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.365261+0000","last_change":"2024-03-09T14:28:53.579012+0000","last_active":"2024-03-09T15:07:05.365261+0000","last_peered":"2024-03-09T15:07:05.365261+0000","last_clean":"2024-03-09T15:07:05.365261+0000","last_became_active":"2024-03-09T14:28:53.578574+0000","last_became_peered":"2024-03-09T14:28:53.578574+0000","last_unstale":"2024-03-09T15:07:05.365261+0000","last_undegraded":"2024-03-09T15:07:05.365261+0000","last_fullsized":"2024-03-09T15:07:05.365261+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269860,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":896,"num_read_kb":59109,"num_write":1337,"num_write_kb":49113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'697","reported_seq":2179,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:20.724401+0000","last_change":"2024-03-09T14:28:55.597239+0000","last_active":"2024-03-09T15:06:20.724401+0000","last_peered":"2024-03-09T15:06:20.724401+0000","last_clean":"2024-03-09T15:06:20.724401+0000","last_became_active":"2024-03-09T14:28:55.596637+0000","last_became_peered":"2024-03-09T14:28:55.596637+0000","last_unstale":"2024-03-09T15:06:20.724401+0000","last_undegraded":"2024-03-09T15:06:20.724401+0000","last_fullsized":"2024-03-09T15:06:20.724401+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:18:02.596150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3232,"num_read_kb":2910,"num_write":917,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'266","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.376593+0000","last_change":"2024-03-09T14:28:53.578550+0000","last_active":"2024-03-09T15:07:05.376593+0000","last_peered":"2024-03-09T15:07:05.376593+0000","last_clean":"2024-03-09T15:07:05.376593+0000","last_became_active":"2024-03-09T14:28:53.577994+0000","last_became_peered":"2024-03-09T14:28:53.577994+0000","last_unstale":"2024-03-09T15:07:05.376593+0000","last_undegraded":"2024-03-09T15:07:05.376593+0000","last_fullsized":"2024-03-09T15:07:05.376593+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:04:14.265275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22703,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":387,"num_read_kb":10775,"num_write":997,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'1034","reported_seq":2409,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.913055+0000","last_change":"2024-03-09T14:28:55.598885+0000","last_active":"2024-03-09T15:06:39.913055+0000","last_peered":"2024-03-09T15:06:39.913055+0000","last_clean":"2024-03-09T15:06:39.913055+0000","last_became_active":"2024-03-09T14:28:55.598235+0000","last_became_peered":"2024-03-09T14:28:55.598235+0000","last_unstale":"2024-03-09T15:06:39.913055+0000","last_undegraded":"2024-03-09T15:06:39.913055+0000","last_fullsized":"2024-03-09T15:06:39.913055+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1000,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:31.960386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4348,"num_read_kb":3780,"num_write":1436,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'378","reported_seq":1065,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.380489+0000","last_change":"2024-03-09T14:28:53.591761+0000","last_active":"2024-03-09T15:07:05.380489+0000","last_peered":"2024-03-09T15:07:05.380489+0000","last_clean":"2024-03-09T15:07:05.380489+0000","last_became_active":"2024-03-09T14:28:53.591365+0000","last_became_peered":"2024-03-09T14:28:53.591365+0000","last_unstale":"2024-03-09T15:07:05.380489+0000","last_undegraded":"2024-03-09T15:07:05.380489+0000","last_fullsized":"2024-03-09T15:07:05.380489+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262246,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":674,"num_read_kb":645,"num_write":1631,"num_write_kb":21789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'476","reported_seq":1840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.471455+0000","last_change":"2024-03-09T14:29:28.739085+0000","last_active":"2024-03-09T15:06:53.471455+0000","last_peered":"2024-03-09T15:06:53.471455+0000","last_clean":"2024-03-09T15:06:53.471455+0000","last_became_active":"2024-03-09T14:29:28.738427+0000","last_became_peered":"2024-03-09T14:29:28.738427+0000","last_unstale":"2024-03-09T15:06:53.471455+0000","last_undegraded":"2024-03-09T15:06:53.471455+0000","last_fullsized":"2024-03-09T15:06:53.471455+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:33:07.046397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2425,"num_read_kb":2201,"num_write":660,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'336","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.397531+0000","last_change":"2024-03-09T14:28:53.638759+0000","last_active":"2024-03-09T15:07:05.397531+0000","last_peered":"2024-03-09T15:07:05.397531+0000","last_clean":"2024-03-09T15:07:05.397531+0000","last_became_active":"2024-03-09T14:28:53.635866+0000","last_became_peered":"2024-03-09T14:28:53.635866+0000","last_unstale":"2024-03-09T15:07:05.397531+0000","last_undegraded":"2024-03-09T15:07:05.397531+0000","last_fullsized":"2024-03-09T15:07:05.397531+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:08:50.346352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049633,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":549,"num_read_kb":68120,"num_write":1314,"num_write_kb":51277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'625","reported_seq":2293,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.477485+0000","last_change":"2024-03-09T14:28:55.597656+0000","last_active":"2024-03-09T15:06:53.477485+0000","last_peered":"2024-03-09T15:06:53.477485+0000","last_clean":"2024-03-09T15:06:53.477485+0000","last_became_active":"2024-03-09T14:28:55.596430+0000","last_became_peered":"2024-03-09T14:28:55.596430+0000","last_unstale":"2024-03-09T15:06:53.477485+0000","last_undegraded":"2024-03-09T15:06:53.477485+0000","last_fullsized":"2024-03-09T15:06:53.477485+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":600,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:16:10.976172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3224,"num_read_kb":2919,"num_write":927,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'306","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.316597+0000","last_change":"2024-03-09T14:28:53.585196+0000","last_active":"2024-03-09T15:07:05.316597+0000","last_peered":"2024-03-09T15:07:05.316597+0000","last_clean":"2024-03-09T15:07:05.316597+0000","last_became_active":"2024-03-09T14:28:53.584780+0000","last_became_peered":"2024-03-09T14:28:53.584780+0000","last_unstale":"2024-03-09T15:07:05.316597+0000","last_undegraded":"2024-03-09T15:07:05.316597+0000","last_fullsized":"2024-03-09T15:07:05.316597+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:17:52.899385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262191,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":406,"num_read_kb":4504,"num_write":1224,"num_write_kb":43139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1138","reported_seq":2641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.306194+0000","last_change":"2024-03-09T14:28:55.585579+0000","last_active":"2024-03-09T15:06:41.306194+0000","last_peered":"2024-03-09T15:06:41.306194+0000","last_clean":"2024-03-09T15:06:41.306194+0000","last_became_active":"2024-03-09T14:28:55.582655+0000","last_became_peered":"2024-03-09T14:28:55.582655+0000","last_unstale":"2024-03-09T15:06:41.306194+0000","last_undegraded":"2024-03-09T15:06:41.306194+0000","last_fullsized":"2024-03-09T15:06:41.306194+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4834,"num_read_kb":4203,"num_write":1586,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'421","reported_seq":1122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.377954+0000","last_change":"2024-03-09T14:28:53.627517+0000","last_active":"2024-03-09T15:07:05.377954+0000","last_peered":"2024-03-09T15:07:05.377954+0000","last_clean":"2024-03-09T15:07:05.377954+0000","last_became_active":"2024-03-09T14:28:53.626746+0000","last_became_peered":"2024-03-09T14:28:53.626746+0000","last_unstale":"2024-03-09T15:07:05.377954+0000","last_undegraded":"2024-03-09T15:07:05.377954+0000","last_fullsized":"2024-03-09T15:07:05.377954+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:13:12.536809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262222,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":818,"num_read_kb":5936,"num_write":1494,"num_write_kb":27133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'403","reported_seq":2031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.290762+0000","last_change":"2024-03-09T14:28:55.575483+0000","last_active":"2024-03-09T15:06:41.290762+0000","last_peered":"2024-03-09T15:06:41.290762+0000","last_clean":"2024-03-09T15:06:41.290762+0000","last_became_active":"2024-03-09T14:28:55.574723+0000","last_became_peered":"2024-03-09T14:28:55.574723+0000","last_unstale":"2024-03-09T15:06:41.290762+0000","last_undegraded":"2024-03-09T15:06:41.290762+0000","last_fullsized":"2024-03-09T15:06:41.290762+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:21:08.880858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2270,"num_read_kb":2181,"num_write":450,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'371","reported_seq":1248,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.423938+0000","last_change":"2024-03-09T14:28:53.565397+0000","last_active":"2024-03-09T15:07:05.423938+0000","last_peered":"2024-03-09T15:07:05.423938+0000","last_clean":"2024-03-09T15:07:05.423938+0000","last_became_active":"2024-03-09T14:28:53.564605+0000","last_became_peered":"2024-03-09T14:28:53.564605+0000","last_unstale":"2024-03-09T15:07:05.423938+0000","last_undegraded":"2024-03-09T15:07:05.423938+0000","last_fullsized":"2024-03-09T15:07:05.423938+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:27:21.297821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1026,"num_read_kb":12227,"num_write":1373,"num_write_kb":35283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'474","reported_seq":2092,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.442041+0000","last_change":"2024-03-09T14:28:55.596361+0000","last_active":"2024-03-09T15:06:42.442041+0000","last_peered":"2024-03-09T15:06:42.442041+0000","last_clean":"2024-03-09T15:06:42.442041+0000","last_became_active":"2024-03-09T14:28:55.596007+0000","last_became_peered":"2024-03-09T14:28:55.596007+0000","last_unstale":"2024-03-09T15:06:42.442041+0000","last_undegraded":"2024-03-09T15:06:42.442041+0000","last_fullsized":"2024-03-09T15:06:42.442041+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:09.008168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2627,"num_read_kb":2464,"num_write":596,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'263","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.377808+0000","last_change":"2024-03-09T14:28:53.638536+0000","last_active":"2024-03-09T15:07:05.377808+0000","last_peered":"2024-03-09T15:07:05.377808+0000","last_clean":"2024-03-09T15:07:05.377808+0000","last_became_active":"2024-03-09T14:28:53.637905+0000","last_became_peered":"2024-03-09T14:28:53.637905+0000","last_unstale":"2024-03-09T15:07:05.377808+0000","last_undegraded":"2024-03-09T15:07:05.377808+0000","last_fullsized":"2024-03-09T15:07:05.377808+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:24:14.058362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":369,"num_read_kb":388,"num_write":1032,"num_write_kb":15956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'865","reported_seq":2403,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:30.958416+0000","last_change":"2024-03-09T14:28:55.590315+0000","last_active":"2024-03-09T15:06:30.958416+0000","last_peered":"2024-03-09T15:06:30.958416+0000","last_clean":"2024-03-09T15:06:30.958416+0000","last_became_active":"2024-03-09T14:28:55.589596+0000","last_became_peered":"2024-03-09T14:28:55.589596+0000","last_unstale":"2024-03-09T15:06:30.958416+0000","last_undegraded":"2024-03-09T15:06:30.958416+0000","last_fullsized":"2024-03-09T15:06:30.958416+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:18:51.702482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4032,"num_read_kb":3559,"num_write":1203,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'316","reported_seq":1056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.437485+0000","last_change":"2024-03-09T14:28:53.627710+0000","last_active":"2024-03-09T15:07:09.437485+0000","last_peered":"2024-03-09T15:07:09.437485+0000","last_clean":"2024-03-09T15:07:09.437485+0000","last_became_active":"2024-03-09T14:28:53.626673+0000","last_became_peered":"2024-03-09T14:28:53.626673+0000","last_unstale":"2024-03-09T15:07:09.437485+0000","last_undegraded":"2024-03-09T15:07:09.437485+0000","last_fullsized":"2024-03-09T15:07:09.437485+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":573,"num_read_kb":94146,"num_write":1092,"num_write_kb":28965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'470","reported_seq":1981,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.398860+0000","last_change":"2024-03-09T14:28:55.610858+0000","last_active":"2024-03-09T15:06:38.398860+0000","last_peered":"2024-03-09T15:06:38.398860+0000","last_clean":"2024-03-09T15:06:38.398860+0000","last_became_active":"2024-03-09T14:28:55.610314+0000","last_became_peered":"2024-03-09T14:28:55.610314+0000","last_unstale":"2024-03-09T15:06:38.398860+0000","last_undegraded":"2024-03-09T15:06:38.398860+0000","last_fullsized":"2024-03-09T15:06:38.398860+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:48.765613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2645,"num_read_kb":2435,"num_write":625,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'356","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.399361+0000","last_change":"2024-03-09T14:28:53.632280+0000","last_active":"2024-03-09T15:07:05.399361+0000","last_peered":"2024-03-09T15:07:05.399361+0000","last_clean":"2024-03-09T15:07:05.399361+0000","last_became_active":"2024-03-09T14:28:53.631327+0000","last_became_peered":"2024-03-09T14:28:53.631327+0000","last_unstale":"2024-03-09T15:07:05.399361+0000","last_undegraded":"2024-03-09T15:07:05.399361+0000","last_fullsized":"2024-03-09T15:07:05.399361+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:34:05.226694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":582,"num_read_kb":48859,"num_write":1226,"num_write_kb":49653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'386","reported_seq":1871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.437099+0000","last_change":"2024-03-09T14:28:55.587624+0000","last_active":"2024-03-09T15:07:09.437099+0000","last_peered":"2024-03-09T15:07:09.437099+0000","last_clean":"2024-03-09T15:07:09.437099+0000","last_became_active":"2024-03-09T14:28:55.587355+0000","last_became_peered":"2024-03-09T14:28:55.587355+0000","last_unstale":"2024-03-09T15:07:09.437099+0000","last_undegraded":"2024-03-09T15:07:09.437099+0000","last_fullsized":"2024-03-09T15:07:09.437099+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2078,"num_read_kb":1975,"num_write":455,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'395","reported_seq":1047,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.317200+0000","last_change":"2024-03-09T14:28:53.624013+0000","last_active":"2024-03-09T15:07:05.317200+0000","last_peered":"2024-03-09T15:07:05.317200+0000","last_clean":"2024-03-09T15:07:05.317200+0000","last_became_active":"2024-03-09T14:28:53.622624+0000","last_became_peered":"2024-03-09T14:28:53.622624+0000","last_unstale":"2024-03-09T15:07:05.317200+0000","last_undegraded":"2024-03-09T15:07:05.317200+0000","last_fullsized":"2024-03-09T15:07:05.317200+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:47:00.573989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262192,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":653,"num_read_kb":22046,"num_write":1243,"num_write_kb":48993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'1099","reported_seq":2574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.171266+0000","last_change":"2024-03-09T14:28:55.591286+0000","last_active":"2024-03-09T15:06:36.171266+0000","last_peered":"2024-03-09T15:06:36.171266+0000","last_clean":"2024-03-09T15:06:36.171266+0000","last_became_active":"2024-03-09T14:28:55.582143+0000","last_became_peered":"2024-03-09T14:28:55.582143+0000","last_unstale":"2024-03-09T15:06:36.171266+0000","last_undegraded":"2024-03-09T15:06:36.171266+0000","last_fullsized":"2024-03-09T15:06:36.171266+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":1000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:02:27.150531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4588,"num_read_kb":3996,"num_write":1519,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'363","reported_seq":1088,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.410936+0000","last_change":"2024-03-09T14:28:53.633628+0000","last_active":"2024-03-09T15:07:05.410936+0000","last_peered":"2024-03-09T15:07:05.410936+0000","last_clean":"2024-03-09T15:07:05.410936+0000","last_became_active":"2024-03-09T14:28:53.633121+0000","last_became_peered":"2024-03-09T14:28:53.633121+0000","last_unstale":"2024-03-09T15:07:05.410936+0000","last_undegraded":"2024-03-09T15:07:05.410936+0000","last_fullsized":"2024-03-09T15:07:05.410936+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:08:16.219438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3312503,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":707,"num_read_kb":9275,"num_write":1371,"num_write_kb":66964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'676","reported_seq":2114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.284688+0000","last_change":"2024-03-09T14:28:55.602146+0000","last_active":"2024-03-09T15:06:41.284688+0000","last_peered":"2024-03-09T15:06:41.284688+0000","last_clean":"2024-03-09T15:06:41.284688+0000","last_became_active":"2024-03-09T14:28:55.601622+0000","last_became_peered":"2024-03-09T14:28:55.601622+0000","last_unstale":"2024-03-09T15:06:41.284688+0000","last_undegraded":"2024-03-09T15:06:41.284688+0000","last_fullsized":"2024-03-09T15:06:41.284688+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":600,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:03:29.881841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3103,"num_read_kb":2796,"num_write":889,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'405","reported_seq":1131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.326374+0000","last_change":"2024-03-09T14:29:28.829008+0000","last_active":"2024-03-09T15:07:05.326374+0000","last_peered":"2024-03-09T15:07:05.326374+0000","last_clean":"2024-03-09T15:07:05.326374+0000","last_became_active":"2024-03-09T14:29:28.827826+0000","last_became_peered":"2024-03-09T14:29:28.827826+0000","last_unstale":"2024-03-09T15:07:05.326374+0000","last_undegraded":"2024-03-09T15:07:05.326374+0000","last_fullsized":"2024-03-09T15:07:05.326374+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:23.249436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918827,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":881,"num_read_kb":41003,"num_write":1564,"num_write_kb":37571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"264'297","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.365371+0000","last_change":"2024-03-09T14:28:53.603932+0000","last_active":"2024-03-09T15:07:05.365371+0000","last_peered":"2024-03-09T15:07:05.365371+0000","last_clean":"2024-03-09T15:07:05.365371+0000","last_became_active":"2024-03-09T14:28:53.602502+0000","last_became_peered":"2024-03-09T14:28:53.602502+0000","last_unstale":"2024-03-09T15:07:05.365371+0000","last_undegraded":"2024-03-09T15:07:05.365371+0000","last_fullsized":"2024-03-09T15:07:05.365371+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:03:28.530349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":396,"num_read_kb":11977,"num_write":1066,"num_write_kb":41245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'855","reported_seq":2304,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.353753+0000","last_change":"2024-03-09T14:28:55.602029+0000","last_active":"2024-03-09T15:06:24.353753+0000","last_peered":"2024-03-09T15:06:24.353753+0000","last_clean":"2024-03-09T15:06:24.353753+0000","last_became_active":"2024-03-09T14:28:55.601537+0000","last_became_peered":"2024-03-09T14:28:55.601537+0000","last_unstale":"2024-03-09T15:06:24.353753+0000","last_undegraded":"2024-03-09T15:06:24.353753+0000","last_fullsized":"2024-03-09T15:06:24.353753+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3890,"num_read_kb":3404,"num_write":1199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'348","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.407237+0000","last_change":"2024-03-09T14:28:53.589127+0000","last_active":"2024-03-09T15:07:05.407237+0000","last_peered":"2024-03-09T15:07:05.407237+0000","last_clean":"2024-03-09T15:07:05.407237+0000","last_became_active":"2024-03-09T14:28:53.588717+0000","last_became_peered":"2024-03-09T14:28:53.588717+0000","last_unstale":"2024-03-09T15:07:05.407237+0000","last_undegraded":"2024-03-09T15:07:05.407237+0000","last_fullsized":"2024-03-09T15:07:05.407237+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286749,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":569,"num_read_kb":5745,"num_write":1174,"num_write_kb":28449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'1155","reported_seq":2682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.479714+0000","last_change":"2024-03-09T14:28:55.583336+0000","last_active":"2024-03-09T15:06:53.479714+0000","last_peered":"2024-03-09T15:06:53.479714+0000","last_clean":"2024-03-09T15:06:53.479714+0000","last_became_active":"2024-03-09T14:28:55.582541+0000","last_became_peered":"2024-03-09T14:28:55.582541+0000","last_unstale":"2024-03-09T15:06:53.479714+0000","last_undegraded":"2024-03-09T15:06:53.479714+0000","last_fullsized":"2024-03-09T15:06:53.479714+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:25:40.752757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4871,"num_read_kb":4234,"num_write":1610,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5930,"num_read_kb":4217,"num_write":2190,"num_write_kb":844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1123,"ondisk_log_size":1123,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":13413,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":15557,"num_read_kb":15326,"num_write":16235,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":26826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1560,"ondisk_log_size":1560,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":433,"ondisk_log_size":433,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1466895,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":16241,"num_read_kb":34652,"num_write":13827,"num_write_kb":11138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2055,"ondisk_log_size":2055,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1622,"num_read_kb":1927,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":194579,"num_read_kb":177681,"num_write":51390,"num_write_kb":17534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":132,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4061,"ondisk_log_size":4061,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":142827823,"num_objects":361,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":361,"num_whiteouts":0,"num_read":34808,"num_read_kb":1970678,"num_write":77579,"num_write_kb":2252311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":193282048,"data_stored":193282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3795,"ondisk_log_size":3795,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":180405,"num_write":150,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":133,"num_read_kb":177288,"num_write":150,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575317,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":361144,"kb_used_data":41016,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":94010696,"statfs":{"total":96636764160,"available":96266952704,"internally_reserved":0,"allocated":42000384,"data_stored":40009750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":327612874},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575314,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":346448,"kb_used_data":35984,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":94025392,"statfs":{"total":96636764160,"available":96282001408,"internally_reserved":0,"allocated":36847616,"data_stored":34892402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":317651398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575318,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":193368,"kb_used_data":41304,"kb_used_omap":1,"kb_used_meta":151870,"kb_avail":94178472,"statfs":{"total":96636764160,"available":96438755328,"internally_reserved":0,"allocated":42295296,"data_stored":40303321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":155515333},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575315,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173556,"kb_used_data":43736,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94198284,"statfs":{"total":96636764160,"available":96459042816,"internally_reserved":0,"allocated":44785664,"data_stored":42869751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575317,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301504,"kb_used_data":35560,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94070336,"statfs":{"total":96636764160,"available":96328024064,"internally_reserved":0,"allocated":36413440,"data_stored":34419369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":272169415},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[5],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575313,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":135436,"kb_used_data":27908,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94236404,"statfs":{"total":96636764160,"available":96498077696,"internally_reserved":0,"allocated":28577792,"data_stored":26654129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575317,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209636,"kb_used_data":34100,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94162204,"statfs":{"total":96636764160,"available":96422096896,"internally_reserved":0,"allocated":34918400,"data_stored":32958583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575314,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":294704,"kb_used_data":28904,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94077136,"statfs":{"total":96636764160,"available":96334987264,"internally_reserved":0,"allocated":29597696,"data_stored":27607131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23699456,"data_stored":23699456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24399872,"data_stored":24399872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19144704,"data_stored":19144704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21663744,"data_stored":21663744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24875008,"data_stored":24875008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21258240,"data_stored":21258240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27381760,"data_stored":27381760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":30859264,"data_stored":30859264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:07:13.243 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.243 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.243 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.244 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.244 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.244 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.244 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.244 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.244 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.245 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.245 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.245 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.245 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.246 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.246 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.246 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.246 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.246 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.246 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.247 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.247 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.247 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.247 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.248 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.248 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.248 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.248 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.248 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.248 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.249 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.249 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.249 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.249 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.249 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.249 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.250 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.250 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.250 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.250 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.250 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.250 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.251 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.251 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.251 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.251 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.251 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.251 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.251 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.252 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.252 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.252 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.252 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.252 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.252 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.253 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.253 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.253 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.253 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.253 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.253 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.254 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.254 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.254 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.254 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.254 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.254 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.254 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.255 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.255 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.255 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.256 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.256 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.256 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.256 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.256 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.256 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.257 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.257 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.257 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.257 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.257 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.257 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.257 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.258 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.258 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.258 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.258 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.258 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.258 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.259 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.259 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.259 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.259 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.259 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.259 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.260 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.260 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.260 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.260 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.260 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.260 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.260 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.261 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.261 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.261 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.261 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.261 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.261 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.262 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.262 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.262 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.262 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.262 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.262 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.263 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.263 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.263 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.263 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.263 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.263 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.263 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.264 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.264 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.264 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.264 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.264 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.264 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.264 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.265 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.265 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.265 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.265 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.265 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.265 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.266 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.266 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.266 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.266 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.266 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.266 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.267 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.267 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.267 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.267 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.267 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.267 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.267 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.268 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.268 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.268 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.268 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.268 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.268 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.268 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.269 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.269 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.269 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.269 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.269 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.269 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.270 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.270 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.270 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.270 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.270 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.270 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.271 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.271 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.271 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.271 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.271 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.271 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.271 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.272 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.272 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.272 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.272 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.272 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.272 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.273 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.273 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.273 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.273 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.273 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.273 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.273 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.274 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.274 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.274 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.274 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.274 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.274 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.275 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.275 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.275 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.275 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.275 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.275 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.275 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.276 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.276 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.276 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.276 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.276 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.276 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.277 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.277 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.277 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.277 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.277 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.277 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.277 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.278 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.278 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.278 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.278 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.278 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.278 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.279 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.279 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.279 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.279 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.279 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.279 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.280 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.280 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.280 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.280 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-09T14:28:35.777784+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.280 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-09T14:28:40.805752+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.280 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.280 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.281 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.281 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.281 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.281 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.281 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-09T14:28:40.805752+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.281 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.281 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.282 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.282 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.282 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.282 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.282 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-09T14:28:40.805752+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.282 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.283 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.283 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.283 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.283 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.283 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.283 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-09T14:28:40.805752+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.283 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.284 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.284 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.284 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.284 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.284 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.284 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.285 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-09T14:28:40.805752+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.285 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.285 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.285 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.285 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.285 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.285 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.286 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-09T14:28:40.805752+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.286 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.286 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.286 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.286 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.286 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.287 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.287 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-09T14:28:40.805752+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.287 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.287 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.287 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.287 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.287 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.288 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.288 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-09T14:28:40.805752+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.288 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.288 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.288 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.288 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.289 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.289 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.289 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.289 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.289 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.289 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.290 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.290 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.290 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.290 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.290 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.290 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.290 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.291 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.291 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.291 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.291 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.291 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.291 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.292 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.292 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.292 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.292 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.292 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.292 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.293 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.293 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.293 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.293 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.293 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.293 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.293 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.294 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.294 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.294 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.294 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.294 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.294 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.295 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.295 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.295 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.295 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.295 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.295 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.295 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.296 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.296 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.296 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.296 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.296 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.296 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.297 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.297 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.297 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.297 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.297 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.297 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.297 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.298 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.298 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.298 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.298 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.298 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.298 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.299 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.299 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.299 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.299 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.299 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.299 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.300 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.300 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.300 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.300 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.300 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.300 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.301 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.301 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.301 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.301 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.301 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.301 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.301 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.302 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.302 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.302 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.302 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.302 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.302 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.303 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.303 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.303 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.303 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.303 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.303 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.304 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.304 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.304 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.304 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.304 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.304 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.305 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.305 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.305 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.305 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.305 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.305 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.305 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:13.306 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-09T15:07:33.307 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:07:33.688 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:07:33.701 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-09T15:07:33.704 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":1426,"stamp":"2024-03-09T15:07:32.863373+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":178454650,"num_objects":799,"num_object_clones":0,"num_object_copies":2320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":799,"num_whiteouts":0,"num_read":269134,"num_read_kb":2562286,"num_write":161720,"num_write_kb":2520695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":176,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":643126,"num_omap_keys":1513,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13396,"ondisk_log_size":13396,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1998272,"kb_used_data":288512,"kb_used_omap":12,"kb_used_meta":1709683,"kb_avail":752976448,"statfs":{"total":773094113280,"available":771047882752,"internally_reserved":0,"allocated":295436288,"data_stored":279714436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1750715952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":637862,"num_omap_keys":1499,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009755"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.954755+0000","last_change":"2024-03-09T14:49:53.659913+0000","last_active":"2024-03-09T15:07:11.954755+0000","last_peered":"2024-03-09T15:07:11.954755+0000","last_clean":"2024-03-09T15:07:11.954755+0000","last_became_active":"2024-03-09T14:49:53.656173+0000","last_became_peered":"2024-03-09T14:49:53.656173+0000","last_unstale":"2024-03-09T15:07:11.954755+0000","last_undegraded":"2024-03-09T15:07:11.954755+0000","last_fullsized":"2024-03-09T15:07:11.954755+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.954531+0000","last_change":"2024-03-09T14:42:19.006802+0000","last_active":"2024-03-09T15:07:11.954531+0000","last_peered":"2024-03-09T15:07:11.954531+0000","last_clean":"2024-03-09T15:07:11.954531+0000","last_became_active":"2024-03-09T14:42:19.006064+0000","last_became_peered":"2024-03-09T14:42:19.006064+0000","last_unstale":"2024-03-09T15:07:11.954531+0000","last_undegraded":"2024-03-09T15:07:11.954531+0000","last_fullsized":"2024-03-09T15:07:11.954531+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.016424+0000","last_change":"2024-03-09T15:07:13.016424+0000","last_active":"2024-03-09T15:07:13.016424+0000","last_peered":"2024-03-09T15:07:13.016424+0000","last_clean":"2024-03-09T15:07:13.016424+0000","last_became_active":"2024-03-09T14:42:15.928518+0000","last_became_peered":"2024-03-09T14:42:15.928518+0000","last_unstale":"2024-03-09T15:07:13.016424+0000","last_undegraded":"2024-03-09T15:07:13.016424+0000","last_fullsized":"2024-03-09T15:07:13.016424+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:13.016259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:13.016259+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.016259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:32:55.901082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'49","reported_seq":165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.732265+0000","last_change":"2024-03-09T15:07:09.732293+0000","last_active":"2024-03-09T15:07:09.732265+0000","last_peered":"2024-03-09T15:07:09.732265+0000","last_clean":"2024-03-09T15:07:09.732265+0000","last_became_active":"2024-03-09T14:39:57.901879+0000","last_became_peered":"2024-03-09T14:39:57.901879+0000","last_unstale":"2024-03-09T15:07:09.732265+0000","last_undegraded":"2024-03-09T15:07:09.732265+0000","last_fullsized":"2024-03-09T15:07:09.732265+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-03-09T15:07:09.732154+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-03-09T15:07:09.732154+0000","last_clean_scrub_stamp":"2024-03-09T15:07:09.732154+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:47.058510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":129,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.360167+0000","last_change":"2024-03-09T14:49:53.685563+0000","last_active":"2024-03-09T15:07:10.360167+0000","last_peered":"2024-03-09T15:07:10.360167+0000","last_clean":"2024-03-09T15:07:10.360167+0000","last_became_active":"2024-03-09T14:49:53.684941+0000","last_became_peered":"2024-03-09T14:49:53.684941+0000","last_unstale":"2024-03-09T15:07:10.360167+0000","last_undegraded":"2024-03-09T15:07:10.360167+0000","last_fullsized":"2024-03-09T15:07:10.360167+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.265626+0000","last_change":"2024-03-09T14:42:19.016523+0000","last_active":"2024-03-09T15:07:11.265626+0000","last_peered":"2024-03-09T15:07:11.265626+0000","last_clean":"2024-03-09T15:07:11.265626+0000","last_became_active":"2024-03-09T14:42:19.011453+0000","last_became_peered":"2024-03-09T14:42:19.011453+0000","last_unstale":"2024-03-09T15:07:11.265626+0000","last_undegraded":"2024-03-09T15:07:11.265626+0000","last_fullsized":"2024-03-09T15:07:11.265626+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.004521+0000","last_change":"2024-03-09T15:07:16.004521+0000","last_active":"2024-03-09T15:07:16.004521+0000","last_peered":"2024-03-09T15:07:16.004521+0000","last_clean":"2024-03-09T15:07:16.004521+0000","last_became_active":"2024-03-09T14:42:15.970720+0000","last_became_peered":"2024-03-09T14:42:15.970720+0000","last_unstale":"2024-03-09T15:07:16.004521+0000","last_undegraded":"2024-03-09T15:07:16.004521+0000","last_fullsized":"2024-03-09T15:07:16.004521+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:16.004189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:16.004189+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.004189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:56:28.921839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'3","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.474413+0000","last_change":"2024-03-09T15:07:25.474480+0000","last_active":"2024-03-09T15:07:25.474413+0000","last_peered":"2024-03-09T15:07:25.474413+0000","last_clean":"2024-03-09T15:07:25.474413+0000","last_became_active":"2024-03-09T14:39:57.894022+0000","last_became_peered":"2024-03-09T14:39:57.894022+0000","last_unstale":"2024-03-09T15:07:25.474413+0000","last_undegraded":"2024-03-09T15:07:25.474413+0000","last_fullsized":"2024-03-09T15:07:25.474413+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:25.474217+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:25.474217+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.474217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:13.689373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:49.734993+0000","last_change":"2024-03-09T14:49:53.677659+0000","last_active":"2024-03-09T15:06:49.734993+0000","last_peered":"2024-03-09T15:06:49.734993+0000","last_clean":"2024-03-09T15:06:49.734993+0000","last_became_active":"2024-03-09T14:49:53.676530+0000","last_became_peered":"2024-03-09T14:49:53.676530+0000","last_unstale":"2024-03-09T15:06:49.734993+0000","last_undegraded":"2024-03-09T15:06:49.734993+0000","last_fullsized":"2024-03-09T15:06:49.734993+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.438181+0000","last_change":"2024-03-09T14:42:19.295942+0000","last_active":"2024-03-09T15:07:09.438181+0000","last_peered":"2024-03-09T15:07:09.438181+0000","last_clean":"2024-03-09T15:07:09.438181+0000","last_became_active":"2024-03-09T14:42:19.295218+0000","last_became_peered":"2024-03-09T14:42:19.295218+0000","last_unstale":"2024-03-09T15:07:09.438181+0000","last_undegraded":"2024-03-09T15:07:09.438181+0000","last_fullsized":"2024-03-09T15:07:09.438181+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":63,"num_write":4,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"261'2","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.753005+0000","last_change":"2024-03-09T15:07:10.753071+0000","last_active":"2024-03-09T15:07:10.753005+0000","last_peered":"2024-03-09T15:07:10.753005+0000","last_clean":"2024-03-09T15:07:10.753005+0000","last_became_active":"2024-03-09T14:42:15.958052+0000","last_became_peered":"2024-03-09T14:42:15.958052+0000","last_unstale":"2024-03-09T15:07:10.753005+0000","last_undegraded":"2024-03-09T15:07:10.753005+0000","last_fullsized":"2024-03-09T15:07:10.753005+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:07:10.752824+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:07:10.752824+0000","last_clean_scrub_stamp":"2024-03-09T15:07:10.752824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:38:40.918092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'67","reported_seq":215,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.601652+0000","last_change":"2024-03-09T15:07:14.601652+0000","last_active":"2024-03-09T15:07:14.601652+0000","last_peered":"2024-03-09T15:07:14.601652+0000","last_clean":"2024-03-09T15:07:14.601652+0000","last_became_active":"2024-03-09T14:39:57.890452+0000","last_became_peered":"2024-03-09T14:39:57.890452+0000","last_unstale":"2024-03-09T15:07:14.601652+0000","last_undegraded":"2024-03-09T15:07:14.601652+0000","last_fullsized":"2024-03-09T15:07:14.601652+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'67","last_scrub_stamp":"2024-03-09T15:07:14.601392+0000","last_deep_scrub":"264'67","last_deep_scrub_stamp":"2024-03-09T15:07:14.601392+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.601392+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:28:58.020853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":205,"num_write":124,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:49.979500+0000","last_change":"2024-03-09T14:49:53.669862+0000","last_active":"2024-03-09T15:06:49.979500+0000","last_peered":"2024-03-09T15:06:49.979500+0000","last_clean":"2024-03-09T15:06:49.979500+0000","last_became_active":"2024-03-09T14:49:53.669178+0000","last_became_peered":"2024-03-09T14:49:53.669178+0000","last_unstale":"2024-03-09T15:06:49.979500+0000","last_undegraded":"2024-03-09T15:06:49.979500+0000","last_fullsized":"2024-03-09T15:06:49.979500+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'6","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.974138+0000","last_change":"2024-03-09T14:42:19.295020+0000","last_active":"2024-03-09T15:06:24.974138+0000","last_peered":"2024-03-09T15:06:24.974138+0000","last_clean":"2024-03-09T15:06:24.974138+0000","last_became_active":"2024-03-09T14:42:19.294235+0000","last_became_peered":"2024-03-09T14:42:19.294235+0000","last_unstale":"2024-03-09T15:06:24.974138+0000","last_undegraded":"2024-03-09T15:06:24.974138+0000","last_fullsized":"2024-03-09T15:06:24.974138+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.265412+0000","last_change":"2024-03-09T14:42:15.958787+0000","last_active":"2024-03-09T15:07:11.265412+0000","last_peered":"2024-03-09T15:07:11.265412+0000","last_clean":"2024-03-09T15:07:11.265412+0000","last_became_active":"2024-03-09T14:42:15.957974+0000","last_became_peered":"2024-03-09T14:42:15.957974+0000","last_unstale":"2024-03-09T15:07:11.265412+0000","last_undegraded":"2024-03-09T15:07:11.265412+0000","last_fullsized":"2024-03-09T15:07:11.265412+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'35","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.986504+0000","last_change":"2024-03-09T15:07:15.986504+0000","last_active":"2024-03-09T15:07:15.986504+0000","last_peered":"2024-03-09T15:07:15.986504+0000","last_clean":"2024-03-09T15:07:15.986504+0000","last_became_active":"2024-03-09T14:39:57.909761+0000","last_became_peered":"2024-03-09T14:39:57.909761+0000","last_unstale":"2024-03-09T15:07:15.986504+0000","last_undegraded":"2024-03-09T15:07:15.986504+0000","last_fullsized":"2024-03-09T15:07:15.986504+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-03-09T15:07:15.986243+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-03-09T15:07:15.986243+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.986243+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:35:47.596327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":109,"num_write":58,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:54.967654+0000","last_change":"2024-03-09T14:49:53.678276+0000","last_active":"2024-03-09T15:05:54.967654+0000","last_peered":"2024-03-09T15:05:54.967654+0000","last_clean":"2024-03-09T15:05:54.967654+0000","last_became_active":"2024-03-09T14:49:53.676902+0000","last_became_peered":"2024-03-09T14:49:53.676902+0000","last_unstale":"2024-03-09T15:05:54.967654+0000","last_undegraded":"2024-03-09T15:05:54.967654+0000","last_fullsized":"2024-03-09T15:05:54.967654+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.919307+0000","last_change":"2024-03-09T14:42:19.008196+0000","last_active":"2024-03-09T15:06:34.919307+0000","last_peered":"2024-03-09T15:06:34.919307+0000","last_clean":"2024-03-09T15:06:34.919307+0000","last_became_active":"2024-03-09T14:42:19.006923+0000","last_became_peered":"2024-03-09T14:42:19.006923+0000","last_unstale":"2024-03-09T15:06:34.919307+0000","last_undegraded":"2024-03-09T15:06:34.919307+0000","last_fullsized":"2024-03-09T15:06:34.919307+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.638355+0000","last_change":"2024-03-09T15:07:23.638415+0000","last_active":"2024-03-09T15:07:23.638355+0000","last_peered":"2024-03-09T15:07:23.638355+0000","last_clean":"2024-03-09T15:07:23.638355+0000","last_became_active":"2024-03-09T14:42:15.971499+0000","last_became_peered":"2024-03-09T14:42:15.971499+0000","last_unstale":"2024-03-09T15:07:23.638355+0000","last_undegraded":"2024-03-09T15:07:23.638355+0000","last_fullsized":"2024-03-09T15:07:23.638355+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:23.638161+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:23.638161+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.638161+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:30:40.124428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'33","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.984015+0000","last_change":"2024-03-09T15:07:20.984015+0000","last_active":"2024-03-09T15:07:20.984015+0000","last_peered":"2024-03-09T15:07:20.984015+0000","last_clean":"2024-03-09T15:07:20.984015+0000","last_became_active":"2024-03-09T14:39:57.898849+0000","last_became_peered":"2024-03-09T14:39:57.898849+0000","last_unstale":"2024-03-09T15:07:20.984015+0000","last_undegraded":"2024-03-09T15:07:20.984015+0000","last_fullsized":"2024-03-09T15:07:20.984015+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-03-09T15:07:20.983762+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-03-09T15:07:20.983762+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.983762+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:55:54.652512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":100,"num_write":52,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:35.098171+0000","last_change":"2024-03-09T14:49:53.660759+0000","last_active":"2024-03-09T15:06:35.098171+0000","last_peered":"2024-03-09T15:06:35.098171+0000","last_clean":"2024-03-09T15:06:35.098171+0000","last_became_active":"2024-03-09T14:49:53.648332+0000","last_became_peered":"2024-03-09T14:49:53.648332+0000","last_unstale":"2024-03-09T15:06:35.098171+0000","last_undegraded":"2024-03-09T15:06:35.098171+0000","last_fullsized":"2024-03-09T15:06:35.098171+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'6","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.072222+0000","last_change":"2024-03-09T14:42:19.004615+0000","last_active":"2024-03-09T15:07:05.072222+0000","last_peered":"2024-03-09T15:07:05.072222+0000","last_clean":"2024-03-09T15:07:05.072222+0000","last_became_active":"2024-03-09T14:42:19.003868+0000","last_became_peered":"2024-03-09T14:42:19.003868+0000","last_unstale":"2024-03-09T15:07:05.072222+0000","last_undegraded":"2024-03-09T15:07:05.072222+0000","last_fullsized":"2024-03-09T15:07:05.072222+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.794551+0000","last_change":"2024-03-09T15:07:26.794615+0000","last_active":"2024-03-09T15:07:26.794551+0000","last_peered":"2024-03-09T15:07:26.794551+0000","last_clean":"2024-03-09T15:07:26.794551+0000","last_became_active":"2024-03-09T14:42:15.947888+0000","last_became_peered":"2024-03-09T14:42:15.947888+0000","last_unstale":"2024-03-09T15:07:26.794551+0000","last_undegraded":"2024-03-09T15:07:26.794551+0000","last_fullsized":"2024-03-09T15:07:26.794551+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:26.794359+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:26.794359+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.794359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:52:28.250795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'23","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.281807+0000","last_change":"2024-03-09T15:07:13.281807+0000","last_active":"2024-03-09T15:07:13.281807+0000","last_peered":"2024-03-09T15:07:13.281807+0000","last_clean":"2024-03-09T15:07:13.281807+0000","last_became_active":"2024-03-09T14:39:57.907530+0000","last_became_peered":"2024-03-09T14:39:57.907530+0000","last_unstale":"2024-03-09T15:07:13.281807+0000","last_undegraded":"2024-03-09T15:07:13.281807+0000","last_fullsized":"2024-03-09T15:07:13.281807+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-03-09T15:07:13.281542+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-03-09T15:07:13.281542+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.281542+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:47:39.457125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":69,"num_write":39,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.841878+0000","last_change":"2024-03-09T14:49:53.677579+0000","last_active":"2024-03-09T15:07:12.841878+0000","last_peered":"2024-03-09T15:07:12.841878+0000","last_clean":"2024-03-09T15:07:12.841878+0000","last_became_active":"2024-03-09T14:49:53.676976+0000","last_became_peered":"2024-03-09T14:49:53.676976+0000","last_unstale":"2024-03-09T15:07:12.841878+0000","last_undegraded":"2024-03-09T15:07:12.841878+0000","last_fullsized":"2024-03-09T15:07:12.841878+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.404028+0000","last_change":"2024-03-09T14:42:19.017355+0000","last_active":"2024-03-09T15:07:12.404028+0000","last_peered":"2024-03-09T15:07:12.404028+0000","last_clean":"2024-03-09T15:07:12.404028+0000","last_became_active":"2024-03-09T14:42:19.008779+0000","last_became_peered":"2024-03-09T14:42:19.008779+0000","last_unstale":"2024-03-09T15:07:12.404028+0000","last_undegraded":"2024-03-09T15:07:12.404028+0000","last_fullsized":"2024-03-09T15:07:12.404028+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'6","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.768833+0000","last_change":"2024-03-09T15:07:22.768898+0000","last_active":"2024-03-09T15:07:22.768833+0000","last_peered":"2024-03-09T15:07:22.768833+0000","last_clean":"2024-03-09T15:07:22.768833+0000","last_became_active":"2024-03-09T14:42:15.943177+0000","last_became_peered":"2024-03-09T14:42:15.943177+0000","last_unstale":"2024-03-09T15:07:22.768833+0000","last_undegraded":"2024-03-09T15:07:22.768833+0000","last_fullsized":"2024-03-09T15:07:22.768833+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:22.768655+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:22.768655+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.768655+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:13:44.014557+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'28","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.611668+0000","last_change":"2024-03-09T15:07:13.611732+0000","last_active":"2024-03-09T15:07:13.611668+0000","last_peered":"2024-03-09T15:07:13.611668+0000","last_clean":"2024-03-09T15:07:13.611668+0000","last_became_active":"2024-03-09T14:39:57.894343+0000","last_became_peered":"2024-03-09T14:39:57.894343+0000","last_unstale":"2024-03-09T15:07:13.611668+0000","last_undegraded":"2024-03-09T15:07:13.611668+0000","last_fullsized":"2024-03-09T15:07:13.611668+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-03-09T15:07:13.611465+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-03-09T15:07:13.611465+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.611465+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:20:23.924452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":82,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.841898+0000","last_change":"2024-03-09T14:49:53.666909+0000","last_active":"2024-03-09T15:07:12.841898+0000","last_peered":"2024-03-09T15:07:12.841898+0000","last_clean":"2024-03-09T15:07:12.841898+0000","last_became_active":"2024-03-09T14:49:53.666178+0000","last_became_peered":"2024-03-09T14:49:53.666178+0000","last_unstale":"2024-03-09T15:07:12.841898+0000","last_undegraded":"2024-03-09T15:07:12.841898+0000","last_fullsized":"2024-03-09T15:07:12.841898+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.975264+0000","last_change":"2024-03-09T15:07:18.975264+0000","last_active":"2024-03-09T15:07:18.975264+0000","last_peered":"2024-03-09T15:07:18.975264+0000","last_clean":"2024-03-09T15:07:18.975264+0000","last_became_active":"2024-03-09T14:42:19.004684+0000","last_became_peered":"2024-03-09T14:42:19.004684+0000","last_unstale":"2024-03-09T15:07:18.975264+0000","last_undegraded":"2024-03-09T15:07:18.975264+0000","last_fullsized":"2024-03-09T15:07:18.975264+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:18.974984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:18.974984+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.974984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:41:00.527205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.624316+0000","last_change":"2024-03-09T15:07:19.624316+0000","last_active":"2024-03-09T15:07:19.624316+0000","last_peered":"2024-03-09T15:07:19.624316+0000","last_clean":"2024-03-09T15:07:19.624316+0000","last_became_active":"2024-03-09T14:42:15.972713+0000","last_became_peered":"2024-03-09T14:42:15.972713+0000","last_unstale":"2024-03-09T15:07:19.624316+0000","last_undegraded":"2024-03-09T15:07:19.624316+0000","last_fullsized":"2024-03-09T15:07:19.624316+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:19.624058+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:19.624058+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.624058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:28:05.245432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'37","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.004401+0000","last_change":"2024-03-09T15:07:14.004463+0000","last_active":"2024-03-09T15:07:14.004401+0000","last_peered":"2024-03-09T15:07:14.004401+0000","last_clean":"2024-03-09T15:07:14.004401+0000","last_became_active":"2024-03-09T14:39:57.869392+0000","last_became_peered":"2024-03-09T14:39:57.869392+0000","last_unstale":"2024-03-09T15:07:14.004401+0000","last_undegraded":"2024-03-09T15:07:14.004401+0000","last_fullsized":"2024-03-09T15:07:14.004401+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-03-09T15:07:14.004204+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-03-09T15:07:14.004204+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.004204+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:16:31.384571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":118,"num_write":73,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:15.092778+0000","last_change":"2024-03-09T14:49:53.652690+0000","last_active":"2024-03-09T15:06:15.092778+0000","last_peered":"2024-03-09T15:06:15.092778+0000","last_clean":"2024-03-09T15:06:15.092778+0000","last_became_active":"2024-03-09T14:49:53.651987+0000","last_became_peered":"2024-03-09T14:49:53.651987+0000","last_unstale":"2024-03-09T15:06:15.092778+0000","last_undegraded":"2024-03-09T15:06:15.092778+0000","last_fullsized":"2024-03-09T15:06:15.092778+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.072849+0000","last_change":"2024-03-09T14:42:19.294955+0000","last_active":"2024-03-09T15:07:05.072849+0000","last_peered":"2024-03-09T15:07:05.072849+0000","last_clean":"2024-03-09T15:07:05.072849+0000","last_became_active":"2024-03-09T14:42:19.294108+0000","last_became_peered":"2024-03-09T14:42:19.294108+0000","last_unstale":"2024-03-09T15:07:05.072849+0000","last_undegraded":"2024-03-09T15:07:05.072849+0000","last_fullsized":"2024-03-09T15:07:05.072849+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.453353+0000","last_change":"2024-03-09T15:07:21.453408+0000","last_active":"2024-03-09T15:07:21.453353+0000","last_peered":"2024-03-09T15:07:21.453353+0000","last_clean":"2024-03-09T15:07:21.453353+0000","last_became_active":"2024-03-09T14:42:15.947591+0000","last_became_peered":"2024-03-09T14:42:15.947591+0000","last_unstale":"2024-03-09T15:07:21.453353+0000","last_undegraded":"2024-03-09T15:07:21.453353+0000","last_fullsized":"2024-03-09T15:07:21.453353+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:21.453160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:21.453160+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.453160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:19:14.273952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'56","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.641889+0000","last_change":"2024-03-09T15:07:12.641912+0000","last_active":"2024-03-09T15:07:12.641889+0000","last_peered":"2024-03-09T15:07:12.641889+0000","last_clean":"2024-03-09T15:07:12.641889+0000","last_became_active":"2024-03-09T14:39:57.894370+0000","last_became_peered":"2024-03-09T14:39:57.894370+0000","last_unstale":"2024-03-09T15:07:12.641889+0000","last_undegraded":"2024-03-09T15:07:12.641889+0000","last_fullsized":"2024-03-09T15:07:12.641889+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'56","last_scrub_stamp":"2024-03-09T15:07:12.641818+0000","last_deep_scrub":"264'56","last_deep_scrub_stamp":"2024-03-09T15:07:12.641818+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.641818+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:59:17.273282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":182,"num_write":87,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:14.723632+0000","last_change":"2024-03-09T14:49:53.661026+0000","last_active":"2024-03-09T15:06:14.723632+0000","last_peered":"2024-03-09T15:06:14.723632+0000","last_clean":"2024-03-09T15:06:14.723632+0000","last_became_active":"2024-03-09T14:49:53.660291+0000","last_became_peered":"2024-03-09T14:49:53.660291+0000","last_unstale":"2024-03-09T15:06:14.723632+0000","last_undegraded":"2024-03-09T15:06:14.723632+0000","last_fullsized":"2024-03-09T15:06:14.723632+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:44.965075+0000","last_change":"2024-03-09T14:42:19.299865+0000","last_active":"2024-03-09T15:05:44.965075+0000","last_peered":"2024-03-09T15:05:44.965075+0000","last_clean":"2024-03-09T15:05:44.965075+0000","last_became_active":"2024-03-09T14:42:19.294391+0000","last_became_peered":"2024-03-09T14:42:19.294391+0000","last_unstale":"2024-03-09T15:05:44.965075+0000","last_undegraded":"2024-03-09T15:05:44.965075+0000","last_fullsized":"2024-03-09T15:05:44.965075+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.885508+0000","last_change":"2024-03-09T15:07:15.885570+0000","last_active":"2024-03-09T15:07:15.885508+0000","last_peered":"2024-03-09T15:07:15.885508+0000","last_clean":"2024-03-09T15:07:15.885508+0000","last_became_active":"2024-03-09T14:42:15.961751+0000","last_became_peered":"2024-03-09T14:42:15.961751+0000","last_unstale":"2024-03-09T15:07:15.885508+0000","last_undegraded":"2024-03-09T15:07:15.885508+0000","last_fullsized":"2024-03-09T15:07:15.885508+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:07:15.885308+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:07:15.885308+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.885308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:17.771916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'41","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.989966+0000","last_change":"2024-03-09T15:07:19.990026+0000","last_active":"2024-03-09T15:07:19.989966+0000","last_peered":"2024-03-09T15:07:19.989966+0000","last_clean":"2024-03-09T15:07:19.989966+0000","last_became_active":"2024-03-09T14:39:57.898651+0000","last_became_peered":"2024-03-09T14:39:57.898651+0000","last_unstale":"2024-03-09T15:07:19.989966+0000","last_undegraded":"2024-03-09T15:07:19.989966+0000","last_fullsized":"2024-03-09T15:07:19.989966+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-03-09T15:07:19.989775+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-03-09T15:07:19.989775+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.989775+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:09:21.062799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":141,"num_write":58,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:14.736693+0000","last_change":"2024-03-09T14:49:53.677983+0000","last_active":"2024-03-09T15:06:14.736693+0000","last_peered":"2024-03-09T15:06:14.736693+0000","last_clean":"2024-03-09T15:06:14.736693+0000","last_became_active":"2024-03-09T14:49:53.677160+0000","last_became_peered":"2024-03-09T14:49:53.677160+0000","last_unstale":"2024-03-09T15:06:14.736693+0000","last_undegraded":"2024-03-09T15:06:14.736693+0000","last_fullsized":"2024-03-09T15:06:14.736693+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.975218+0000","last_change":"2024-03-09T14:42:19.298779+0000","last_active":"2024-03-09T15:06:29.975218+0000","last_peered":"2024-03-09T15:06:29.975218+0000","last_clean":"2024-03-09T15:06:29.975218+0000","last_became_active":"2024-03-09T14:42:19.297984+0000","last_became_peered":"2024-03-09T14:42:19.297984+0000","last_unstale":"2024-03-09T15:06:29.975218+0000","last_undegraded":"2024-03-09T15:06:29.975218+0000","last_fullsized":"2024-03-09T15:06:29.975218+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.727163+0000","last_change":"2024-03-09T14:42:15.959256+0000","last_active":"2024-03-09T15:06:29.727163+0000","last_peered":"2024-03-09T15:06:29.727163+0000","last_clean":"2024-03-09T15:06:29.727163+0000","last_became_active":"2024-03-09T14:42:15.958476+0000","last_became_peered":"2024-03-09T14:42:15.958476+0000","last_unstale":"2024-03-09T15:06:29.727163+0000","last_undegraded":"2024-03-09T15:06:29.727163+0000","last_fullsized":"2024-03-09T15:06:29.727163+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'112","reported_seq":384,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.534327+0000","last_change":"2024-03-09T15:07:23.534450+0000","last_active":"2024-03-09T15:07:23.534327+0000","last_peered":"2024-03-09T15:07:23.534327+0000","last_clean":"2024-03-09T15:07:23.534327+0000","last_became_active":"2024-03-09T14:39:57.872922+0000","last_became_peered":"2024-03-09T14:39:57.872922+0000","last_unstale":"2024-03-09T15:07:23.534327+0000","last_undegraded":"2024-03-09T15:07:23.534327+0000","last_fullsized":"2024-03-09T15:07:23.534327+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-03-09T15:07:23.534072+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-03-09T15:07:23.534072+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.534072+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:12:24.305321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":634,"num_read_kb":458,"num_write":138,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2790,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:14.914506+0000","last_change":"2024-03-09T14:49:53.652070+0000","last_active":"2024-03-09T15:06:14.914506+0000","last_peered":"2024-03-09T15:06:14.914506+0000","last_clean":"2024-03-09T15:06:14.914506+0000","last_became_active":"2024-03-09T14:49:53.651353+0000","last_became_peered":"2024-03-09T14:49:53.651353+0000","last_unstale":"2024-03-09T15:06:14.914506+0000","last_undegraded":"2024-03-09T15:06:14.914506+0000","last_fullsized":"2024-03-09T15:06:14.914506+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.733317+0000","last_change":"2024-03-09T14:42:19.015145+0000","last_active":"2024-03-09T15:06:29.733317+0000","last_peered":"2024-03-09T15:06:29.733317+0000","last_clean":"2024-03-09T15:06:29.733317+0000","last_became_active":"2024-03-09T14:42:19.011213+0000","last_became_peered":"2024-03-09T14:42:19.011213+0000","last_unstale":"2024-03-09T15:06:29.733317+0000","last_undegraded":"2024-03-09T15:06:29.733317+0000","last_fullsized":"2024-03-09T15:06:29.733317+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'3","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.047855+0000","last_change":"2024-03-09T14:42:15.975026+0000","last_active":"2024-03-09T15:07:03.047855+0000","last_peered":"2024-03-09T15:07:03.047855+0000","last_clean":"2024-03-09T15:07:03.047855+0000","last_became_active":"2024-03-09T14:42:15.974300+0000","last_became_peered":"2024-03-09T14:42:15.974300+0000","last_unstale":"2024-03-09T15:07:03.047855+0000","last_undegraded":"2024-03-09T15:07:03.047855+0000","last_fullsized":"2024-03-09T15:07:03.047855+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'10","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.953643+0000","last_change":"2024-03-09T15:07:20.953816+0000","last_active":"2024-03-09T15:07:20.953643+0000","last_peered":"2024-03-09T15:07:20.953643+0000","last_clean":"2024-03-09T15:07:20.953643+0000","last_became_active":"2024-03-09T14:39:57.905161+0000","last_became_peered":"2024-03-09T14:39:57.905161+0000","last_unstale":"2024-03-09T15:07:20.953643+0000","last_undegraded":"2024-03-09T15:07:20.953643+0000","last_fullsized":"2024-03-09T15:07:20.953643+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-03-09T15:07:20.953411+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-03-09T15:07:20.953411+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.953411+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:35:23.607004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:49.979711+0000","last_change":"2024-03-09T14:49:53.677779+0000","last_active":"2024-03-09T15:06:49.979711+0000","last_peered":"2024-03-09T15:06:49.979711+0000","last_clean":"2024-03-09T15:06:49.979711+0000","last_became_active":"2024-03-09T14:49:53.676180+0000","last_became_peered":"2024-03-09T14:49:53.676180+0000","last_unstale":"2024-03-09T15:06:49.979711+0000","last_undegraded":"2024-03-09T15:06:49.979711+0000","last_fullsized":"2024-03-09T15:06:49.979711+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'15","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.711976+0000","last_change":"2024-03-09T14:42:19.015638+0000","last_active":"2024-03-09T15:07:03.711976+0000","last_peered":"2024-03-09T15:07:03.711976+0000","last_clean":"2024-03-09T15:07:03.711976+0000","last_became_active":"2024-03-09T14:42:19.015001+0000","last_became_peered":"2024-03-09T14:42:19.015001+0000","last_unstale":"2024-03-09T15:07:03.711976+0000","last_undegraded":"2024-03-09T15:07:03.711976+0000","last_fullsized":"2024-03-09T15:07:03.711976+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":18444,"num_write":29,"num_write_kb":15365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'9","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.826615+0000","last_change":"2024-03-09T15:07:14.826689+0000","last_active":"2024-03-09T15:07:14.826615+0000","last_peered":"2024-03-09T15:07:14.826615+0000","last_clean":"2024-03-09T15:07:14.826615+0000","last_became_active":"2024-03-09T14:42:15.936690+0000","last_became_peered":"2024-03-09T14:42:15.936690+0000","last_unstale":"2024-03-09T15:07:14.826615+0000","last_undegraded":"2024-03-09T15:07:14.826615+0000","last_fullsized":"2024-03-09T15:07:14.826615+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-03-09T15:07:14.826428+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-03-09T15:07:14.826428+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.826428+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:10:49.901286+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'45","reported_seq":163,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.922946+0000","last_change":"2024-03-09T15:07:23.923011+0000","last_active":"2024-03-09T15:07:23.922946+0000","last_peered":"2024-03-09T15:07:23.922946+0000","last_clean":"2024-03-09T15:07:23.922946+0000","last_became_active":"2024-03-09T14:39:57.900112+0000","last_became_peered":"2024-03-09T14:39:57.900112+0000","last_unstale":"2024-03-09T15:07:23.922946+0000","last_undegraded":"2024-03-09T15:07:23.922946+0000","last_fullsized":"2024-03-09T15:07:23.922946+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-03-09T15:07:23.922739+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-03-09T15:07:23.922739+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.922739+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:54:20.010708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":133,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:49.748959+0000","last_change":"2024-03-09T14:49:53.687062+0000","last_active":"2024-03-09T15:06:49.748959+0000","last_peered":"2024-03-09T15:06:49.748959+0000","last_clean":"2024-03-09T15:06:49.748959+0000","last_became_active":"2024-03-09T14:49:53.683189+0000","last_became_peered":"2024-03-09T14:49:53.683189+0000","last_unstale":"2024-03-09T15:06:49.748959+0000","last_undegraded":"2024-03-09T15:06:49.748959+0000","last_fullsized":"2024-03-09T15:06:49.748959+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.982645+0000","last_change":"2024-03-09T14:42:19.009789+0000","last_active":"2024-03-09T15:07:03.982645+0000","last_peered":"2024-03-09T15:07:03.982645+0000","last_clean":"2024-03-09T15:07:03.982645+0000","last_became_active":"2024-03-09T14:42:19.009159+0000","last_became_peered":"2024-03-09T14:42:19.009159+0000","last_unstale":"2024-03-09T15:07:03.982645+0000","last_undegraded":"2024-03-09T15:07:03.982645+0000","last_fullsized":"2024-03-09T15:07:03.982645+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'12","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.992983+0000","last_change":"2024-03-09T15:07:14.993120+0000","last_active":"2024-03-09T15:07:14.992983+0000","last_peered":"2024-03-09T15:07:14.992983+0000","last_clean":"2024-03-09T15:07:14.992983+0000","last_became_active":"2024-03-09T14:42:15.953580+0000","last_became_peered":"2024-03-09T14:42:15.953580+0000","last_unstale":"2024-03-09T15:07:14.992983+0000","last_undegraded":"2024-03-09T15:07:14.992983+0000","last_fullsized":"2024-03-09T15:07:14.992983+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-03-09T15:07:14.992761+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-03-09T15:07:14.992761+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.992761+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:19:32.196578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":25600,"num_write":27,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'39","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.687486+0000","last_change":"2024-03-09T15:07:10.687519+0000","last_active":"2024-03-09T15:07:10.687486+0000","last_peered":"2024-03-09T15:07:10.687486+0000","last_clean":"2024-03-09T15:07:10.687486+0000","last_became_active":"2024-03-09T14:39:57.896549+0000","last_became_peered":"2024-03-09T14:39:57.896549+0000","last_unstale":"2024-03-09T15:07:10.687486+0000","last_undegraded":"2024-03-09T15:07:10.687486+0000","last_fullsized":"2024-03-09T15:07:10.687486+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-03-09T15:07:10.687377+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-03-09T15:07:10.687377+0000","last_clean_scrub_stamp":"2024-03-09T15:07:10.687377+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:37.398766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":110,"num_write":67,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:19.740889+0000","last_change":"2024-03-09T14:49:53.674470+0000","last_active":"2024-03-09T15:06:19.740889+0000","last_peered":"2024-03-09T15:06:19.740889+0000","last_clean":"2024-03-09T15:06:19.740889+0000","last_became_active":"2024-03-09T14:49:53.673345+0000","last_became_peered":"2024-03-09T14:49:53.673345+0000","last_unstale":"2024-03-09T15:06:19.740889+0000","last_undegraded":"2024-03-09T15:06:19.740889+0000","last_fullsized":"2024-03-09T15:06:19.740889+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.370089+0000","last_change":"2024-03-09T14:42:19.021679+0000","last_active":"2024-03-09T15:07:04.370089+0000","last_peered":"2024-03-09T15:07:04.370089+0000","last_clean":"2024-03-09T15:07:04.370089+0000","last_became_active":"2024-03-09T14:42:19.020650+0000","last_became_peered":"2024-03-09T14:42:19.020650+0000","last_unstale":"2024-03-09T15:07:04.370089+0000","last_undegraded":"2024-03-09T15:07:04.370089+0000","last_fullsized":"2024-03-09T15:07:04.370089+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.232265+0000","last_change":"2024-03-09T15:07:17.232318+0000","last_active":"2024-03-09T15:07:17.232265+0000","last_peered":"2024-03-09T15:07:17.232265+0000","last_clean":"2024-03-09T15:07:17.232265+0000","last_became_active":"2024-03-09T14:42:15.958276+0000","last_became_peered":"2024-03-09T14:42:15.958276+0000","last_unstale":"2024-03-09T15:07:17.232265+0000","last_undegraded":"2024-03-09T15:07:17.232265+0000","last_fullsized":"2024-03-09T15:07:17.232265+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:17.232075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:17.232075+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.232075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:59:22.106180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'35","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.832224+0000","last_change":"2024-03-09T15:07:12.832292+0000","last_active":"2024-03-09T15:07:12.832224+0000","last_peered":"2024-03-09T15:07:12.832224+0000","last_clean":"2024-03-09T15:07:12.832224+0000","last_became_active":"2024-03-09T14:39:57.891706+0000","last_became_peered":"2024-03-09T14:39:57.891706+0000","last_unstale":"2024-03-09T15:07:12.832224+0000","last_undegraded":"2024-03-09T15:07:12.832224+0000","last_fullsized":"2024-03-09T15:07:12.832224+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-03-09T15:07:12.832019+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-03-09T15:07:12.832019+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.832019+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:50:16.384247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":98,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:49.979658+0000","last_change":"2024-03-09T14:49:53.678730+0000","last_active":"2024-03-09T15:06:49.979658+0000","last_peered":"2024-03-09T15:06:49.979658+0000","last_clean":"2024-03-09T15:06:49.979658+0000","last_became_active":"2024-03-09T14:49:53.670121+0000","last_became_peered":"2024-03-09T14:49:53.670121+0000","last_unstale":"2024-03-09T15:06:49.979658+0000","last_undegraded":"2024-03-09T15:06:49.979658+0000","last_fullsized":"2024-03-09T15:06:49.979658+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:39.719356+0000","last_change":"2024-03-09T14:42:18.993764+0000","last_active":"2024-03-09T15:05:39.719356+0000","last_peered":"2024-03-09T15:05:39.719356+0000","last_clean":"2024-03-09T15:05:39.719356+0000","last_became_active":"2024-03-09T14:42:18.992996+0000","last_became_peered":"2024-03-09T14:42:18.992996+0000","last_unstale":"2024-03-09T15:05:39.719356+0000","last_undegraded":"2024-03-09T15:05:39.719356+0000","last_fullsized":"2024-03-09T15:05:39.719356+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.485177+0000","last_change":"2024-03-09T15:07:25.485241+0000","last_active":"2024-03-09T15:07:25.485177+0000","last_peered":"2024-03-09T15:07:25.485177+0000","last_clean":"2024-03-09T15:07:25.485177+0000","last_became_active":"2024-03-09T14:42:15.950001+0000","last_became_peered":"2024-03-09T14:42:15.950001+0000","last_unstale":"2024-03-09T15:07:25.485177+0000","last_undegraded":"2024-03-09T15:07:25.485177+0000","last_fullsized":"2024-03-09T15:07:25.485177+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:25.484949+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:25.484949+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.484949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:42.285163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'55","reported_seq":177,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.041497+0000","last_change":"2024-03-09T15:07:14.041637+0000","last_active":"2024-03-09T15:07:14.041497+0000","last_peered":"2024-03-09T15:07:14.041497+0000","last_clean":"2024-03-09T15:07:14.041497+0000","last_became_active":"2024-03-09T14:39:57.909827+0000","last_became_peered":"2024-03-09T14:39:57.909827+0000","last_unstale":"2024-03-09T15:07:14.041497+0000","last_undegraded":"2024-03-09T15:07:14.041497+0000","last_fullsized":"2024-03-09T15:07:14.041497+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'55","last_scrub_stamp":"2024-03-09T15:07:14.041251+0000","last_deep_scrub":"264'55","last_deep_scrub_stamp":"2024-03-09T15:07:14.041251+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.041251+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:44:17.414317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":147,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.360040+0000","last_change":"2024-03-09T14:49:53.642413+0000","last_active":"2024-03-09T15:07:10.360040+0000","last_peered":"2024-03-09T15:07:10.360040+0000","last_clean":"2024-03-09T15:07:10.360040+0000","last_became_active":"2024-03-09T14:49:53.641152+0000","last_became_peered":"2024-03-09T14:49:53.641152+0000","last_unstale":"2024-03-09T15:07:10.360040+0000","last_undegraded":"2024-03-09T15:07:10.360040+0000","last_fullsized":"2024-03-09T15:07:10.360040+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.014761+0000","last_change":"2024-03-09T15:07:23.014822+0000","last_active":"2024-03-09T15:07:23.014761+0000","last_peered":"2024-03-09T15:07:23.014761+0000","last_clean":"2024-03-09T15:07:23.014761+0000","last_became_active":"2024-03-09T14:42:19.013356+0000","last_became_peered":"2024-03-09T14:42:19.013356+0000","last_unstale":"2024-03-09T15:07:23.014761+0000","last_undegraded":"2024-03-09T15:07:23.014761+0000","last_fullsized":"2024-03-09T15:07:23.014761+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:07:23.014568+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:07:23.014568+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.014568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:32:57.682164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.863792+0000","last_change":"2024-03-09T15:07:12.863850+0000","last_active":"2024-03-09T15:07:12.863792+0000","last_peered":"2024-03-09T15:07:12.863792+0000","last_clean":"2024-03-09T15:07:12.863792+0000","last_became_active":"2024-03-09T14:42:15.964591+0000","last_became_peered":"2024-03-09T14:42:15.964591+0000","last_unstale":"2024-03-09T15:07:12.863792+0000","last_undegraded":"2024-03-09T15:07:12.863792+0000","last_fullsized":"2024-03-09T15:07:12.863792+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:12.863592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:12.863592+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.863592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:43:17.329732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'15","reported_seq":93,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.946943+0000","last_change":"2024-03-09T15:07:16.947005+0000","last_active":"2024-03-09T15:07:16.946943+0000","last_peered":"2024-03-09T15:07:16.946943+0000","last_clean":"2024-03-09T15:07:16.946943+0000","last_became_active":"2024-03-09T14:39:57.898952+0000","last_became_peered":"2024-03-09T14:39:57.898952+0000","last_unstale":"2024-03-09T15:07:16.946943+0000","last_undegraded":"2024-03-09T15:07:16.946943+0000","last_fullsized":"2024-03-09T15:07:16.946943+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'15","last_scrub_stamp":"2024-03-09T15:07:16.946726+0000","last_deep_scrub":"264'15","last_deep_scrub_stamp":"2024-03-09T15:07:16.946726+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.946726+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:32.769206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":52,"num_write":21,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:39.727810+0000","last_change":"2024-03-09T14:49:53.654700+0000","last_active":"2024-03-09T15:05:39.727810+0000","last_peered":"2024-03-09T15:05:39.727810+0000","last_clean":"2024-03-09T15:05:39.727810+0000","last_became_active":"2024-03-09T14:49:53.653943+0000","last_became_peered":"2024-03-09T14:49:53.653943+0000","last_unstale":"2024-03-09T15:05:39.727810+0000","last_undegraded":"2024-03-09T15:05:39.727810+0000","last_fullsized":"2024-03-09T15:05:39.727810+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.975883+0000","last_change":"2024-03-09T15:07:26.975946+0000","last_active":"2024-03-09T15:07:26.975883+0000","last_peered":"2024-03-09T15:07:26.975883+0000","last_clean":"2024-03-09T15:07:26.975883+0000","last_became_active":"2024-03-09T14:42:19.008729+0000","last_became_peered":"2024-03-09T14:42:19.008729+0000","last_unstale":"2024-03-09T15:07:26.975883+0000","last_undegraded":"2024-03-09T15:07:26.975883+0000","last_fullsized":"2024-03-09T15:07:26.975883+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:26.975688+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:26.975688+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.975688+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:22:03.596581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.734897+0000","last_change":"2024-03-09T14:42:15.979152+0000","last_active":"2024-03-09T15:07:04.734897+0000","last_peered":"2024-03-09T15:07:04.734897+0000","last_clean":"2024-03-09T15:07:04.734897+0000","last_became_active":"2024-03-09T14:42:15.978166+0000","last_became_peered":"2024-03-09T14:42:15.978166+0000","last_unstale":"2024-03-09T15:07:04.734897+0000","last_undegraded":"2024-03-09T15:07:04.734897+0000","last_fullsized":"2024-03-09T15:07:04.734897+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'46","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.531125+0000","last_change":"2024-03-09T15:07:17.531186+0000","last_active":"2024-03-09T15:07:17.531125+0000","last_peered":"2024-03-09T15:07:17.531125+0000","last_clean":"2024-03-09T15:07:17.531125+0000","last_became_active":"2024-03-09T14:39:57.904012+0000","last_became_peered":"2024-03-09T14:39:57.904012+0000","last_unstale":"2024-03-09T15:07:17.531125+0000","last_undegraded":"2024-03-09T15:07:17.531125+0000","last_fullsized":"2024-03-09T15:07:17.531125+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'46","last_scrub_stamp":"2024-03-09T15:07:17.530930+0000","last_deep_scrub":"264'46","last_deep_scrub_stamp":"2024-03-09T15:07:17.530930+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.530930+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:03:28.425445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":131,"num_write":86,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.404165+0000","last_change":"2024-03-09T14:49:53.680169+0000","last_active":"2024-03-09T15:07:12.404165+0000","last_peered":"2024-03-09T15:07:12.404165+0000","last_clean":"2024-03-09T15:07:12.404165+0000","last_became_active":"2024-03-09T14:49:53.678157+0000","last_became_peered":"2024-03-09T14:49:53.678157+0000","last_unstale":"2024-03-09T15:07:12.404165+0000","last_undegraded":"2024-03-09T15:07:12.404165+0000","last_fullsized":"2024-03-09T15:07:12.404165+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.104208+0000","last_change":"2024-03-09T14:42:19.296270+0000","last_active":"2024-03-09T15:07:05.104208+0000","last_peered":"2024-03-09T15:07:05.104208+0000","last_clean":"2024-03-09T15:07:05.104208+0000","last_became_active":"2024-03-09T14:42:19.295533+0000","last_became_peered":"2024-03-09T14:42:19.295533+0000","last_unstale":"2024-03-09T15:07:05.104208+0000","last_undegraded":"2024-03-09T15:07:05.104208+0000","last_fullsized":"2024-03-09T15:07:05.104208+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"261'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.565280+0000","last_change":"2024-03-09T15:07:15.565345+0000","last_active":"2024-03-09T15:07:15.565280+0000","last_peered":"2024-03-09T15:07:15.565280+0000","last_clean":"2024-03-09T15:07:15.565280+0000","last_became_active":"2024-03-09T14:42:15.968323+0000","last_became_peered":"2024-03-09T14:42:15.968323+0000","last_unstale":"2024-03-09T15:07:15.565280+0000","last_undegraded":"2024-03-09T15:07:15.565280+0000","last_fullsized":"2024-03-09T15:07:15.565280+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-03-09T15:07:15.565071+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-03-09T15:07:15.565071+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.565071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:55:13.724228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'40","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.239744+0000","last_change":"2024-03-09T15:07:15.239878+0000","last_active":"2024-03-09T15:07:15.239744+0000","last_peered":"2024-03-09T15:07:15.239744+0000","last_clean":"2024-03-09T15:07:15.239744+0000","last_became_active":"2024-03-09T14:39:57.898234+0000","last_became_peered":"2024-03-09T14:39:57.898234+0000","last_unstale":"2024-03-09T15:07:15.239744+0000","last_undegraded":"2024-03-09T15:07:15.239744+0000","last_fullsized":"2024-03-09T15:07:15.239744+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-03-09T15:07:15.239453+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-03-09T15:07:15.239453+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.239453+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:16.397508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":111,"num_write":71,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.841672+0000","last_change":"2024-03-09T14:49:53.663589+0000","last_active":"2024-03-09T15:07:12.841672+0000","last_peered":"2024-03-09T15:07:12.841672+0000","last_clean":"2024-03-09T15:07:12.841672+0000","last_became_active":"2024-03-09T14:49:53.662812+0000","last_became_peered":"2024-03-09T14:49:53.662812+0000","last_unstale":"2024-03-09T15:07:12.841672+0000","last_undegraded":"2024-03-09T15:07:12.841672+0000","last_fullsized":"2024-03-09T15:07:12.841672+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'7","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.293560+0000","last_change":"2024-03-09T14:42:19.018301+0000","last_active":"2024-03-09T15:07:05.293560+0000","last_peered":"2024-03-09T15:07:05.293560+0000","last_clean":"2024-03-09T15:07:05.293560+0000","last_became_active":"2024-03-09T14:42:19.017434+0000","last_became_peered":"2024-03-09T14:42:19.017434+0000","last_unstale":"2024-03-09T15:07:05.293560+0000","last_undegraded":"2024-03-09T15:07:05.293560+0000","last_fullsized":"2024-03-09T15:07:05.293560+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8272,"num_write":12,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.908491+0000","last_change":"2024-03-09T15:07:10.908536+0000","last_active":"2024-03-09T15:07:10.908491+0000","last_peered":"2024-03-09T15:07:10.908491+0000","last_clean":"2024-03-09T15:07:10.908491+0000","last_became_active":"2024-03-09T14:42:15.945565+0000","last_became_peered":"2024-03-09T14:42:15.945565+0000","last_unstale":"2024-03-09T15:07:10.908491+0000","last_undegraded":"2024-03-09T15:07:10.908491+0000","last_fullsized":"2024-03-09T15:07:10.908491+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:07:10.908404+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:07:10.908404+0000","last_clean_scrub_stamp":"2024-03-09T15:07:10.908404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:19.761717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1029,"num_write":10,"num_write_kb":1029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'55","reported_seq":176,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:59.733566+0000","last_change":"2024-03-09T14:39:57.901411+0000","last_active":"2024-03-09T15:06:59.733566+0000","last_peered":"2024-03-09T15:06:59.733566+0000","last_clean":"2024-03-09T15:06:59.733566+0000","last_became_active":"2024-03-09T14:39:57.900659+0000","last_became_peered":"2024-03-09T14:39:57.900659+0000","last_unstale":"2024-03-09T15:06:59.733566+0000","last_undegraded":"2024-03-09T15:06:59.733566+0000","last_fullsized":"2024-03-09T15:06:59.733566+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:39:56.844736+0000","last_clean_scrub_stamp":"2024-03-09T14:39:56.844736+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":161,"num_write":89,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:39.963976+0000","last_change":"2024-03-09T14:49:53.683045+0000","last_active":"2024-03-09T15:05:39.963976+0000","last_peered":"2024-03-09T15:05:39.963976+0000","last_clean":"2024-03-09T15:05:39.963976+0000","last_became_active":"2024-03-09T14:49:53.678822+0000","last_became_peered":"2024-03-09T14:49:53.678822+0000","last_unstale":"2024-03-09T15:05:39.963976+0000","last_undegraded":"2024-03-09T15:05:39.963976+0000","last_fullsized":"2024-03-09T15:05:39.963976+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.297488+0000","last_change":"2024-03-09T14:42:19.021170+0000","last_active":"2024-03-09T15:07:05.297488+0000","last_peered":"2024-03-09T15:07:05.297488+0000","last_clean":"2024-03-09T15:07:05.297488+0000","last_became_active":"2024-03-09T14:42:19.016262+0000","last_became_peered":"2024-03-09T14:42:19.016262+0000","last_unstale":"2024-03-09T15:07:05.297488+0000","last_undegraded":"2024-03-09T15:07:05.297488+0000","last_fullsized":"2024-03-09T15:07:05.297488+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.649801+0000","last_change":"2024-03-09T15:07:11.649832+0000","last_active":"2024-03-09T15:07:11.649801+0000","last_peered":"2024-03-09T15:07:11.649801+0000","last_clean":"2024-03-09T15:07:11.649801+0000","last_became_active":"2024-03-09T14:42:15.963496+0000","last_became_peered":"2024-03-09T14:42:15.963496+0000","last_unstale":"2024-03-09T15:07:11.649801+0000","last_undegraded":"2024-03-09T15:07:11.649801+0000","last_fullsized":"2024-03-09T15:07:11.649801+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:11.649700+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:11.649700+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.649700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:54:34.580055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'33","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.595715+0000","last_change":"2024-03-09T15:07:17.595774+0000","last_active":"2024-03-09T15:07:17.595715+0000","last_peered":"2024-03-09T15:07:17.595715+0000","last_clean":"2024-03-09T15:07:17.595715+0000","last_became_active":"2024-03-09T14:39:57.879068+0000","last_became_peered":"2024-03-09T14:39:57.879068+0000","last_unstale":"2024-03-09T15:07:17.595715+0000","last_undegraded":"2024-03-09T15:07:17.595715+0000","last_fullsized":"2024-03-09T15:07:17.595715+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-03-09T15:07:17.595518+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-03-09T15:07:17.595518+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.595518+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:22:14.173013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":89,"num_write":57,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:44.729225+0000","last_change":"2024-03-09T14:49:53.666848+0000","last_active":"2024-03-09T15:05:44.729225+0000","last_peered":"2024-03-09T15:05:44.729225+0000","last_clean":"2024-03-09T15:05:44.729225+0000","last_became_active":"2024-03-09T14:49:53.666088+0000","last_became_peered":"2024-03-09T14:49:53.666088+0000","last_unstale":"2024-03-09T15:05:44.729225+0000","last_undegraded":"2024-03-09T15:05:44.729225+0000","last_fullsized":"2024-03-09T15:05:44.729225+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.901537+0000","last_change":"2024-03-09T15:07:18.901598+0000","last_active":"2024-03-09T15:07:18.901537+0000","last_peered":"2024-03-09T15:07:18.901537+0000","last_clean":"2024-03-09T15:07:18.901537+0000","last_became_active":"2024-03-09T14:42:19.288155+0000","last_became_peered":"2024-03-09T14:42:19.288155+0000","last_unstale":"2024-03-09T15:07:18.901537+0000","last_undegraded":"2024-03-09T15:07:18.901537+0000","last_fullsized":"2024-03-09T15:07:18.901537+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:18.901334+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:18.901334+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.901334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:16.864340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.955208+0000","last_change":"2024-03-09T15:07:11.955237+0000","last_active":"2024-03-09T15:07:11.955208+0000","last_peered":"2024-03-09T15:07:11.955208+0000","last_clean":"2024-03-09T15:07:11.955208+0000","last_became_active":"2024-03-09T14:42:15.962004+0000","last_became_peered":"2024-03-09T14:42:15.962004+0000","last_unstale":"2024-03-09T15:07:11.955208+0000","last_undegraded":"2024-03-09T15:07:11.955208+0000","last_fullsized":"2024-03-09T15:07:11.955208+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:11.955103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:11.955103+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.955103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:20:11.932735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.945988+0000","last_change":"2024-03-09T15:07:19.946048+0000","last_active":"2024-03-09T15:07:19.945988+0000","last_peered":"2024-03-09T15:07:19.945988+0000","last_clean":"2024-03-09T15:07:19.945988+0000","last_became_active":"2024-03-09T14:39:57.906043+0000","last_became_peered":"2024-03-09T14:39:57.906043+0000","last_unstale":"2024-03-09T15:07:19.945988+0000","last_undegraded":"2024-03-09T15:07:19.945988+0000","last_fullsized":"2024-03-09T15:07:19.945988+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-03-09T15:07:19.945806+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-03-09T15:07:19.945806+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.945806+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:28:12.471486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":86,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:39.727926+0000","last_change":"2024-03-09T14:49:53.666880+0000","last_active":"2024-03-09T15:05:39.727926+0000","last_peered":"2024-03-09T15:05:39.727926+0000","last_clean":"2024-03-09T15:05:39.727926+0000","last_became_active":"2024-03-09T14:49:53.666251+0000","last_became_peered":"2024-03-09T14:49:53.666251+0000","last_unstale":"2024-03-09T15:05:39.727926+0000","last_undegraded":"2024-03-09T15:05:39.727926+0000","last_fullsized":"2024-03-09T15:05:39.727926+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.906150+0000","last_change":"2024-03-09T15:07:19.906205+0000","last_active":"2024-03-09T15:07:19.906150+0000","last_peered":"2024-03-09T15:07:19.906150+0000","last_clean":"2024-03-09T15:07:19.906150+0000","last_became_active":"2024-03-09T14:42:18.998145+0000","last_became_peered":"2024-03-09T14:42:18.998145+0000","last_unstale":"2024-03-09T15:07:19.906150+0000","last_undegraded":"2024-03-09T15:07:19.906150+0000","last_fullsized":"2024-03-09T15:07:19.906150+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:19.905948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:19.905948+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.905948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:21:38.351715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.663537+0000","last_change":"2024-03-09T15:07:27.663618+0000","last_active":"2024-03-09T15:07:27.663537+0000","last_peered":"2024-03-09T15:07:27.663537+0000","last_clean":"2024-03-09T15:07:27.663537+0000","last_became_active":"2024-03-09T14:42:15.973793+0000","last_became_peered":"2024-03-09T14:42:15.973793+0000","last_unstale":"2024-03-09T15:07:27.663537+0000","last_undegraded":"2024-03-09T15:07:27.663537+0000","last_fullsized":"2024-03-09T15:07:27.663537+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:07:27.663315+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:07:27.663315+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.663315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:07.805577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'18","reported_seq":95,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.978077+0000","last_change":"2024-03-09T15:07:17.978140+0000","last_active":"2024-03-09T15:07:17.978077+0000","last_peered":"2024-03-09T15:07:17.978077+0000","last_clean":"2024-03-09T15:07:17.978077+0000","last_became_active":"2024-03-09T14:39:57.895347+0000","last_became_peered":"2024-03-09T14:39:57.895347+0000","last_unstale":"2024-03-09T15:07:17.978077+0000","last_undegraded":"2024-03-09T15:07:17.978077+0000","last_fullsized":"2024-03-09T15:07:17.978077+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-03-09T15:07:17.977877+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-03-09T15:07:17.977877+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.977877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:10:27.720426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":49,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:39.731670+0000","last_change":"2024-03-09T14:49:53.680516+0000","last_active":"2024-03-09T15:05:39.731670+0000","last_peered":"2024-03-09T15:05:39.731670+0000","last_clean":"2024-03-09T15:05:39.731670+0000","last_became_active":"2024-03-09T14:49:53.676907+0000","last_became_peered":"2024-03-09T14:49:53.676907+0000","last_unstale":"2024-03-09T15:05:39.731670+0000","last_undegraded":"2024-03-09T15:05:39.731670+0000","last_fullsized":"2024-03-09T15:05:39.731670+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.983530+0000","last_change":"2024-03-09T15:07:26.983592+0000","last_active":"2024-03-09T15:07:26.983530+0000","last_peered":"2024-03-09T15:07:26.983530+0000","last_clean":"2024-03-09T15:07:26.983530+0000","last_became_active":"2024-03-09T14:42:29.984595+0000","last_became_peered":"2024-03-09T14:42:29.984595+0000","last_unstale":"2024-03-09T15:07:26.983530+0000","last_undegraded":"2024-03-09T15:07:26.983530+0000","last_fullsized":"2024-03-09T15:07:26.983530+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:26.983320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:26.983320+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.983320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:58:22.547118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'6","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.789750+0000","last_change":"2024-03-09T15:07:18.789875+0000","last_active":"2024-03-09T15:07:18.789750+0000","last_peered":"2024-03-09T15:07:18.789750+0000","last_clean":"2024-03-09T15:07:18.789750+0000","last_became_active":"2024-03-09T14:42:15.941583+0000","last_became_peered":"2024-03-09T14:42:15.941583+0000","last_unstale":"2024-03-09T15:07:18.789750+0000","last_undegraded":"2024-03-09T15:07:18.789750+0000","last_fullsized":"2024-03-09T15:07:18.789750+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:18.789520+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:18.789520+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.789520+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:04.840942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'16","reported_seq":97,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.198006+0000","last_change":"2024-03-09T15:07:18.198066+0000","last_active":"2024-03-09T15:07:18.198006+0000","last_peered":"2024-03-09T15:07:18.198006+0000","last_clean":"2024-03-09T15:07:18.198006+0000","last_became_active":"2024-03-09T14:39:57.884479+0000","last_became_peered":"2024-03-09T14:39:57.884479+0000","last_unstale":"2024-03-09T15:07:18.198006+0000","last_undegraded":"2024-03-09T15:07:18.198006+0000","last_fullsized":"2024-03-09T15:07:18.198006+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-03-09T15:07:18.197804+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-03-09T15:07:18.197804+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.197804+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:28:01.332954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":55,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.742182+0000","last_change":"2024-03-09T14:49:53.664600+0000","last_active":"2024-03-09T15:06:34.742182+0000","last_peered":"2024-03-09T15:06:34.742182+0000","last_clean":"2024-03-09T15:06:34.742182+0000","last_became_active":"2024-03-09T14:49:53.663825+0000","last_became_peered":"2024-03-09T14:49:53.663825+0000","last_unstale":"2024-03-09T15:06:34.742182+0000","last_undegraded":"2024-03-09T15:06:34.742182+0000","last_fullsized":"2024-03-09T15:06:34.742182+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.438182+0000","last_change":"2024-03-09T14:42:18.996069+0000","last_active":"2024-03-09T15:07:09.438182+0000","last_peered":"2024-03-09T15:07:09.438182+0000","last_clean":"2024-03-09T15:07:09.438182+0000","last_became_active":"2024-03-09T14:42:18.995340+0000","last_became_peered":"2024-03-09T14:42:18.995340+0000","last_unstale":"2024-03-09T15:07:09.438182+0000","last_undegraded":"2024-03-09T15:07:09.438182+0000","last_fullsized":"2024-03-09T15:07:09.438182+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.891508+0000","last_change":"2024-03-09T15:07:13.891508+0000","last_active":"2024-03-09T15:07:13.891508+0000","last_peered":"2024-03-09T15:07:13.891508+0000","last_clean":"2024-03-09T15:07:13.891508+0000","last_became_active":"2024-03-09T14:42:15.963155+0000","last_became_peered":"2024-03-09T14:42:15.963155+0000","last_unstale":"2024-03-09T15:07:13.891508+0000","last_undegraded":"2024-03-09T15:07:13.891508+0000","last_fullsized":"2024-03-09T15:07:13.891508+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:13.891243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:13.891243+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.891243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:23:55.637502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'33","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.561191+0000","last_change":"2024-03-09T15:07:16.561251+0000","last_active":"2024-03-09T15:07:16.561191+0000","last_peered":"2024-03-09T15:07:16.561191+0000","last_clean":"2024-03-09T15:07:16.561191+0000","last_became_active":"2024-03-09T14:39:57.888467+0000","last_became_peered":"2024-03-09T14:39:57.888467+0000","last_unstale":"2024-03-09T15:07:16.561191+0000","last_undegraded":"2024-03-09T15:07:16.561191+0000","last_fullsized":"2024-03-09T15:07:16.561191+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-03-09T15:07:16.560999+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-03-09T15:07:16.560999+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.560999+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:39.875129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":106,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.919405+0000","last_change":"2024-03-09T14:49:53.659073+0000","last_active":"2024-03-09T15:06:34.919405+0000","last_peered":"2024-03-09T15:06:34.919405+0000","last_clean":"2024-03-09T15:06:34.919405+0000","last_became_active":"2024-03-09T14:49:53.658183+0000","last_became_peered":"2024-03-09T14:49:53.658183+0000","last_unstale":"2024-03-09T15:06:34.919405+0000","last_undegraded":"2024-03-09T15:06:34.919405+0000","last_fullsized":"2024-03-09T15:06:34.919405+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.438254+0000","last_change":"2024-03-09T14:42:19.295167+0000","last_active":"2024-03-09T15:07:09.438254+0000","last_peered":"2024-03-09T15:07:09.438254+0000","last_clean":"2024-03-09T15:07:09.438254+0000","last_became_active":"2024-03-09T14:42:19.294401+0000","last_became_peered":"2024-03-09T14:42:19.294401+0000","last_unstale":"2024-03-09T15:07:09.438254+0000","last_undegraded":"2024-03-09T15:07:09.438254+0000","last_fullsized":"2024-03-09T15:07:09.438254+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'7","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.360270+0000","last_change":"2024-03-09T14:42:15.975168+0000","last_active":"2024-03-09T15:07:10.360270+0000","last_peered":"2024-03-09T15:07:10.360270+0000","last_clean":"2024-03-09T15:07:10.360270+0000","last_became_active":"2024-03-09T14:42:15.974493+0000","last_became_peered":"2024-03-09T14:42:15.974493+0000","last_unstale":"2024-03-09T15:07:10.360270+0000","last_undegraded":"2024-03-09T15:07:10.360270+0000","last_fullsized":"2024-03-09T15:07:10.360270+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5160,"num_write":12,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'28","reported_seq":116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.277964+0000","last_change":"2024-03-09T15:07:14.278092+0000","last_active":"2024-03-09T15:07:14.277964+0000","last_peered":"2024-03-09T15:07:14.277964+0000","last_clean":"2024-03-09T15:07:14.277964+0000","last_became_active":"2024-03-09T14:39:57.907009+0000","last_became_peered":"2024-03-09T14:39:57.907009+0000","last_unstale":"2024-03-09T15:07:14.277964+0000","last_undegraded":"2024-03-09T15:07:14.277964+0000","last_fullsized":"2024-03-09T15:07:14.277964+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-03-09T15:07:14.277744+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-03-09T15:07:14.277744+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.277744+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:52:23.159850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":74,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:55.087821+0000","last_change":"2024-03-09T14:49:53.681028+0000","last_active":"2024-03-09T15:05:55.087821+0000","last_peered":"2024-03-09T15:05:55.087821+0000","last_clean":"2024-03-09T15:05:55.087821+0000","last_became_active":"2024-03-09T14:49:53.680477+0000","last_became_peered":"2024-03-09T14:49:53.680477+0000","last_unstale":"2024-03-09T15:05:55.087821+0000","last_undegraded":"2024-03-09T15:05:55.087821+0000","last_fullsized":"2024-03-09T15:05:55.087821+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.930221+0000","last_change":"2024-03-09T15:07:22.930279+0000","last_active":"2024-03-09T15:07:22.930221+0000","last_peered":"2024-03-09T15:07:22.930221+0000","last_clean":"2024-03-09T15:07:22.930221+0000","last_became_active":"2024-03-09T14:42:19.289487+0000","last_became_peered":"2024-03-09T14:42:19.289487+0000","last_unstale":"2024-03-09T15:07:22.930221+0000","last_undegraded":"2024-03-09T15:07:22.930221+0000","last_fullsized":"2024-03-09T15:07:22.930221+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:22.930020+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:22.930020+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.930020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:09:50.336731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.297582+0000","last_change":"2024-03-09T14:42:15.957344+0000","last_active":"2024-03-09T15:07:05.297582+0000","last_peered":"2024-03-09T15:07:05.297582+0000","last_clean":"2024-03-09T15:07:05.297582+0000","last_became_active":"2024-03-09T14:42:15.956648+0000","last_became_peered":"2024-03-09T14:42:15.956648+0000","last_unstale":"2024-03-09T15:07:05.297582+0000","last_undegraded":"2024-03-09T15:07:05.297582+0000","last_fullsized":"2024-03-09T15:07:05.297582+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'62","reported_seq":208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.950093+0000","last_change":"2024-03-09T15:07:21.950162+0000","last_active":"2024-03-09T15:07:21.950093+0000","last_peered":"2024-03-09T15:07:21.950093+0000","last_clean":"2024-03-09T15:07:21.950093+0000","last_became_active":"2024-03-09T14:39:57.905410+0000","last_became_peered":"2024-03-09T14:39:57.905410+0000","last_unstale":"2024-03-09T15:07:21.950093+0000","last_undegraded":"2024-03-09T15:07:21.950093+0000","last_fullsized":"2024-03-09T15:07:21.950093+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'62","last_scrub_stamp":"2024-03-09T15:07:21.949871+0000","last_deep_scrub":"264'62","last_deep_scrub_stamp":"2024-03-09T15:07:21.949871+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.949871+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:41:26.110415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":193,"num_write":94,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.734204+0000","last_change":"2024-03-09T14:49:53.658895+0000","last_active":"2024-03-09T15:06:34.734204+0000","last_peered":"2024-03-09T15:06:34.734204+0000","last_clean":"2024-03-09T15:06:34.734204+0000","last_became_active":"2024-03-09T14:49:53.658190+0000","last_became_peered":"2024-03-09T14:49:53.658190+0000","last_unstale":"2024-03-09T15:06:34.734204+0000","last_undegraded":"2024-03-09T15:06:34.734204+0000","last_fullsized":"2024-03-09T15:06:34.734204+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.075418+0000","last_change":"2024-03-09T14:42:19.020830+0000","last_active":"2024-03-09T15:07:04.075418+0000","last_peered":"2024-03-09T15:07:04.075418+0000","last_clean":"2024-03-09T15:07:04.075418+0000","last_became_active":"2024-03-09T14:42:19.013977+0000","last_became_peered":"2024-03-09T14:42:19.013977+0000","last_unstale":"2024-03-09T15:07:04.075418+0000","last_undegraded":"2024-03-09T15:07:04.075418+0000","last_fullsized":"2024-03-09T15:07:04.075418+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":5,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.857181+0000","last_change":"2024-03-09T15:07:16.857285+0000","last_active":"2024-03-09T15:07:16.857181+0000","last_peered":"2024-03-09T15:07:16.857181+0000","last_clean":"2024-03-09T15:07:16.857181+0000","last_became_active":"2024-03-09T14:42:15.960225+0000","last_became_peered":"2024-03-09T14:42:15.960225+0000","last_unstale":"2024-03-09T15:07:16.857181+0000","last_undegraded":"2024-03-09T15:07:16.857181+0000","last_fullsized":"2024-03-09T15:07:16.857181+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:16.856929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:16.856929+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.856929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:51:38.551264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'131","reported_seq":441,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.963128+0000","last_change":"2024-03-09T15:07:12.963188+0000","last_active":"2024-03-09T15:07:12.963128+0000","last_peered":"2024-03-09T15:07:12.963128+0000","last_clean":"2024-03-09T15:07:12.963128+0000","last_became_active":"2024-03-09T14:39:57.892592+0000","last_became_peered":"2024-03-09T14:39:57.892592+0000","last_unstale":"2024-03-09T15:07:12.963128+0000","last_undegraded":"2024-03-09T15:07:12.963128+0000","last_fullsized":"2024-03-09T15:07:12.963128+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-03-09T15:07:12.962987+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-03-09T15:07:12.962987+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.962987+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:14:19.463214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":739,"num_read_kb":529,"num_write":173,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4473,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.360286+0000","last_change":"2024-03-09T14:49:53.672983+0000","last_active":"2024-03-09T15:07:10.360286+0000","last_peered":"2024-03-09T15:07:10.360286+0000","last_clean":"2024-03-09T15:07:10.360286+0000","last_became_active":"2024-03-09T14:49:53.672292+0000","last_became_peered":"2024-03-09T14:49:53.672292+0000","last_unstale":"2024-03-09T15:07:10.360286+0000","last_undegraded":"2024-03-09T15:07:10.360286+0000","last_fullsized":"2024-03-09T15:07:10.360286+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.894286+0000","last_change":"2024-03-09T14:42:19.004206+0000","last_active":"2024-03-09T15:07:09.894286+0000","last_peered":"2024-03-09T15:07:09.894286+0000","last_clean":"2024-03-09T15:07:09.894286+0000","last_became_active":"2024-03-09T14:42:19.002083+0000","last_became_peered":"2024-03-09T14:42:19.002083+0000","last_unstale":"2024-03-09T15:07:09.894286+0000","last_undegraded":"2024-03-09T15:07:09.894286+0000","last_fullsized":"2024-03-09T15:07:09.894286+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'6","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.934056+0000","last_change":"2024-03-09T15:07:14.934126+0000","last_active":"2024-03-09T15:07:14.934056+0000","last_peered":"2024-03-09T15:07:14.934056+0000","last_clean":"2024-03-09T15:07:14.934056+0000","last_became_active":"2024-03-09T14:42:15.975956+0000","last_became_peered":"2024-03-09T14:42:15.975956+0000","last_unstale":"2024-03-09T15:07:14.934056+0000","last_undegraded":"2024-03-09T15:07:14.934056+0000","last_fullsized":"2024-03-09T15:07:14.934056+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:14.933844+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:14.933844+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.933844+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:53:21.393505+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'35","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.516936+0000","last_change":"2024-03-09T15:07:13.517001+0000","last_active":"2024-03-09T15:07:13.516936+0000","last_peered":"2024-03-09T15:07:13.516936+0000","last_clean":"2024-03-09T15:07:13.516936+0000","last_became_active":"2024-03-09T14:39:57.886792+0000","last_became_peered":"2024-03-09T14:39:57.886792+0000","last_unstale":"2024-03-09T15:07:13.516936+0000","last_undegraded":"2024-03-09T15:07:13.516936+0000","last_fullsized":"2024-03-09T15:07:13.516936+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-03-09T15:07:13.516719+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-03-09T15:07:13.516719+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.516719+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:17:49.955637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":107,"num_write":66,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.438270+0000","last_change":"2024-03-09T14:49:53.687783+0000","last_active":"2024-03-09T15:07:09.438270+0000","last_peered":"2024-03-09T15:07:09.438270+0000","last_clean":"2024-03-09T15:07:09.438270+0000","last_became_active":"2024-03-09T14:49:53.683703+0000","last_became_peered":"2024-03-09T14:49:53.683703+0000","last_unstale":"2024-03-09T15:07:09.438270+0000","last_undegraded":"2024-03-09T15:07:09.438270+0000","last_fullsized":"2024-03-09T15:07:09.438270+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'8","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.371272+0000","last_change":"2024-03-09T14:42:19.014096+0000","last_active":"2024-03-09T15:07:04.371272+0000","last_peered":"2024-03-09T15:07:04.371272+0000","last_clean":"2024-03-09T15:07:04.371272+0000","last_became_active":"2024-03-09T14:42:19.013372+0000","last_became_peered":"2024-03-09T14:42:19.013372+0000","last_unstale":"2024-03-09T15:07:04.371272+0000","last_undegraded":"2024-03-09T15:07:04.371272+0000","last_fullsized":"2024-03-09T15:07:04.371272+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"261'3","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.905609+0000","last_change":"2024-03-09T15:07:17.905609+0000","last_active":"2024-03-09T15:07:17.905609+0000","last_peered":"2024-03-09T15:07:17.905609+0000","last_clean":"2024-03-09T15:07:17.905609+0000","last_became_active":"2024-03-09T14:42:15.954274+0000","last_became_peered":"2024-03-09T14:42:15.954274+0000","last_unstale":"2024-03-09T15:07:17.905609+0000","last_undegraded":"2024-03-09T15:07:17.905609+0000","last_fullsized":"2024-03-09T15:07:17.905609+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:17.905341+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:17.905341+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.905341+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:09.793662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'59","reported_seq":208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.867257+0000","last_change":"2024-03-09T15:07:11.867317+0000","last_active":"2024-03-09T15:07:11.867257+0000","last_peered":"2024-03-09T15:07:11.867257+0000","last_clean":"2024-03-09T15:07:11.867257+0000","last_became_active":"2024-03-09T14:39:57.901599+0000","last_became_peered":"2024-03-09T14:39:57.901599+0000","last_unstale":"2024-03-09T15:07:11.867257+0000","last_undegraded":"2024-03-09T15:07:11.867257+0000","last_fullsized":"2024-03-09T15:07:11.867257+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'59","last_scrub_stamp":"2024-03-09T15:07:11.867056+0000","last_deep_scrub":"264'59","last_deep_scrub_stamp":"2024-03-09T15:07:11.867056+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.867056+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:38:36.066989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":206,"num_write":96,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.745057+0000","last_change":"2024-03-09T14:49:53.681958+0000","last_active":"2024-03-09T15:06:34.745057+0000","last_peered":"2024-03-09T15:06:34.745057+0000","last_clean":"2024-03-09T15:06:34.745057+0000","last_became_active":"2024-03-09T14:49:53.681327+0000","last_became_peered":"2024-03-09T14:49:53.681327+0000","last_unstale":"2024-03-09T15:06:34.745057+0000","last_undegraded":"2024-03-09T15:06:34.745057+0000","last_fullsized":"2024-03-09T15:06:34.745057+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.403967+0000","last_change":"2024-03-09T14:42:19.020053+0000","last_active":"2024-03-09T15:07:12.403967+0000","last_peered":"2024-03-09T15:07:12.403967+0000","last_clean":"2024-03-09T15:07:12.403967+0000","last_became_active":"2024-03-09T14:42:19.019151+0000","last_became_peered":"2024-03-09T14:42:19.019151+0000","last_unstale":"2024-03-09T15:07:12.403967+0000","last_undegraded":"2024-03-09T15:07:12.403967+0000","last_fullsized":"2024-03-09T15:07:12.403967+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.917661+0000","last_change":"2024-03-09T15:07:09.917661+0000","last_active":"2024-03-09T15:07:09.917661+0000","last_peered":"2024-03-09T15:07:09.917661+0000","last_clean":"2024-03-09T15:07:09.917661+0000","last_became_active":"2024-03-09T14:42:15.959503+0000","last_became_peered":"2024-03-09T14:42:15.959503+0000","last_unstale":"2024-03-09T15:07:09.917661+0000","last_undegraded":"2024-03-09T15:07:09.917661+0000","last_fullsized":"2024-03-09T15:07:09.917661+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:09.917534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:09.917534+0000","last_clean_scrub_stamp":"2024-03-09T15:07:09.917534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:08.292151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'13","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.270252+0000","last_change":"2024-03-09T15:07:16.270315+0000","last_active":"2024-03-09T15:07:16.270252+0000","last_peered":"2024-03-09T15:07:16.270252+0000","last_clean":"2024-03-09T15:07:16.270252+0000","last_became_active":"2024-03-09T14:39:57.895579+0000","last_became_peered":"2024-03-09T14:39:57.895579+0000","last_unstale":"2024-03-09T15:07:16.270252+0000","last_undegraded":"2024-03-09T15:07:16.270252+0000","last_fullsized":"2024-03-09T15:07:16.270252+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-03-09T15:07:16.270056+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-03-09T15:07:16.270056+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.270056+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:06:45.756532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.743573+0000","last_change":"2024-03-09T14:49:53.681449+0000","last_active":"2024-03-09T15:06:39.743573+0000","last_peered":"2024-03-09T15:06:39.743573+0000","last_clean":"2024-03-09T15:06:39.743573+0000","last_became_active":"2024-03-09T14:49:53.680782+0000","last_became_peered":"2024-03-09T14:49:53.680782+0000","last_unstale":"2024-03-09T15:06:39.743573+0000","last_undegraded":"2024-03-09T15:06:39.743573+0000","last_fullsized":"2024-03-09T15:06:39.743573+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.265711+0000","last_change":"2024-03-09T14:42:19.021910+0000","last_active":"2024-03-09T15:07:11.265711+0000","last_peered":"2024-03-09T15:07:11.265711+0000","last_clean":"2024-03-09T15:07:11.265711+0000","last_became_active":"2024-03-09T14:42:19.020789+0000","last_became_peered":"2024-03-09T14:42:19.020789+0000","last_unstale":"2024-03-09T15:07:11.265711+0000","last_undegraded":"2024-03-09T15:07:11.265711+0000","last_fullsized":"2024-03-09T15:07:11.265711+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'7","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.403819+0000","last_change":"2024-03-09T14:42:15.961112+0000","last_active":"2024-03-09T15:07:12.403819+0000","last_peered":"2024-03-09T15:07:12.403819+0000","last_clean":"2024-03-09T15:07:12.403819+0000","last_became_active":"2024-03-09T14:42:15.960341+0000","last_became_peered":"2024-03-09T14:42:15.960341+0000","last_unstale":"2024-03-09T15:07:12.403819+0000","last_undegraded":"2024-03-09T15:07:12.403819+0000","last_fullsized":"2024-03-09T15:07:12.403819+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":20522,"num_write":11,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'42","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.969183+0000","last_change":"2024-03-09T15:07:24.969299+0000","last_active":"2024-03-09T15:07:24.969183+0000","last_peered":"2024-03-09T15:07:24.969183+0000","last_clean":"2024-03-09T15:07:24.969183+0000","last_became_active":"2024-03-09T14:39:57.898267+0000","last_became_peered":"2024-03-09T14:39:57.898267+0000","last_unstale":"2024-03-09T15:07:24.969183+0000","last_undegraded":"2024-03-09T15:07:24.969183+0000","last_fullsized":"2024-03-09T15:07:24.969183+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-03-09T15:07:24.968847+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-03-09T15:07:24.968847+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.968847+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:29.161194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":119,"num_write":82,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'300","reported_seq":1041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.309991+0000","last_change":"2024-03-09T14:28:53.624341+0000","last_active":"2024-03-09T15:07:05.309991+0000","last_peered":"2024-03-09T15:07:05.309991+0000","last_clean":"2024-03-09T15:07:05.309991+0000","last_became_active":"2024-03-09T14:28:53.623701+0000","last_became_peered":"2024-03-09T14:28:53.623701+0000","last_unstale":"2024-03-09T15:07:05.309991+0000","last_undegraded":"2024-03-09T15:07:05.309991+0000","last_fullsized":"2024-03-09T15:07:05.309991+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":756,"num_read_kb":36473,"num_write":1139,"num_write_kb":31503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'692","reported_seq":2208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.459321+0000","last_change":"2024-03-09T14:28:55.575692+0000","last_active":"2024-03-09T15:06:42.459321+0000","last_peered":"2024-03-09T15:06:42.459321+0000","last_clean":"2024-03-09T15:06:42.459321+0000","last_became_active":"2024-03-09T14:28:55.574984+0000","last_became_peered":"2024-03-09T14:28:55.574984+0000","last_unstale":"2024-03-09T15:06:42.459321+0000","last_undegraded":"2024-03-09T15:06:42.459321+0000","last_fullsized":"2024-03-09T15:06:42.459321+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3313,"num_read_kb":2995,"num_write":917,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'302","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.383582+0000","last_change":"2024-03-09T14:28:53.626962+0000","last_active":"2024-03-09T15:07:05.383582+0000","last_peered":"2024-03-09T15:07:05.383582+0000","last_clean":"2024-03-09T15:07:05.383582+0000","last_became_active":"2024-03-09T14:28:53.626490+0000","last_became_peered":"2024-03-09T14:28:53.626490+0000","last_unstale":"2024-03-09T15:07:05.383582+0000","last_undegraded":"2024-03-09T15:07:05.383582+0000","last_fullsized":"2024-03-09T15:07:05.383582+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5265769,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":463,"num_read_kb":36382,"num_write":1100,"num_write_kb":36054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'348","reported_seq":1730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.542006+0000","last_change":"2024-03-09T14:28:55.592370+0000","last_active":"2024-03-09T15:06:32.542006+0000","last_peered":"2024-03-09T15:06:32.542006+0000","last_clean":"2024-03-09T15:06:32.542006+0000","last_became_active":"2024-03-09T14:28:55.591640+0000","last_became_peered":"2024-03-09T14:28:55.591640+0000","last_unstale":"2024-03-09T15:06:32.542006+0000","last_undegraded":"2024-03-09T15:06:32.542006+0000","last_fullsized":"2024-03-09T15:06:32.542006+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1906,"num_read_kb":1805,"num_write":411,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'330","reported_seq":1054,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.971074+0000","last_change":"2024-03-09T15:07:21.971278+0000","last_active":"2024-03-09T15:07:21.971074+0000","last_peered":"2024-03-09T15:07:21.971074+0000","last_clean":"2024-03-09T15:07:21.971074+0000","last_became_active":"2024-03-09T14:29:28.827096+0000","last_became_peered":"2024-03-09T14:29:28.827096+0000","last_unstale":"2024-03-09T15:07:21.971074+0000","last_undegraded":"2024-03-09T15:07:21.971074+0000","last_fullsized":"2024-03-09T15:07:21.971074+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'330","last_scrub_stamp":"2024-03-09T15:07:21.970830+0000","last_deep_scrub":"264'330","last_deep_scrub_stamp":"2024-03-09T15:07:21.970830+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.970830+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:14:08.492056+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262173,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":589,"num_read_kb":23096,"num_write":1233,"num_write_kb":39906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,7],"acting":[3,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"264'398","reported_seq":1883,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.460146+0000","last_change":"2024-03-09T14:28:55.571747+0000","last_active":"2024-03-09T15:06:42.460146+0000","last_peered":"2024-03-09T15:06:42.460146+0000","last_clean":"2024-03-09T15:06:42.460146+0000","last_became_active":"2024-03-09T14:28:55.570930+0000","last_became_peered":"2024-03-09T14:28:55.570930+0000","last_unstale":"2024-03-09T15:06:42.460146+0000","last_undegraded":"2024-03-09T15:06:42.460146+0000","last_fullsized":"2024-03-09T15:06:42.460146+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2164,"num_read_kb":2043,"num_write":472,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'297","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.354159+0000","last_change":"2024-03-09T14:28:53.605127+0000","last_active":"2024-03-09T15:07:05.354159+0000","last_peered":"2024-03-09T15:07:05.354159+0000","last_clean":"2024-03-09T15:07:05.354159+0000","last_became_active":"2024-03-09T14:28:53.603454+0000","last_became_peered":"2024-03-09T14:28:53.603454+0000","last_unstale":"2024-03-09T15:07:05.354159+0000","last_undegraded":"2024-03-09T15:07:05.354159+0000","last_fullsized":"2024-03-09T15:07:05.354159+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":6538,"num_write":1185,"num_write_kb":12238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'433","reported_seq":1936,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.742151+0000","last_change":"2024-03-09T14:28:55.611079+0000","last_active":"2024-03-09T15:06:24.742151+0000","last_peered":"2024-03-09T15:06:24.742151+0000","last_clean":"2024-03-09T15:06:24.742151+0000","last_became_active":"2024-03-09T14:28:55.610360+0000","last_became_peered":"2024-03-09T14:28:55.610360+0000","last_unstale":"2024-03-09T15:06:24.742151+0000","last_undegraded":"2024-03-09T15:06:24.742151+0000","last_fullsized":"2024-03-09T15:06:24.742151+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":400,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2375,"num_read_kb":2224,"num_write":558,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'339","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.306662+0000","last_change":"2024-03-09T14:28:53.624123+0000","last_active":"2024-03-09T15:07:05.306662+0000","last_peered":"2024-03-09T15:07:05.306662+0000","last_clean":"2024-03-09T15:07:05.306662+0000","last_became_active":"2024-03-09T14:28:53.622689+0000","last_became_peered":"2024-03-09T14:28:53.622689+0000","last_unstale":"2024-03-09T15:07:05.306662+0000","last_undegraded":"2024-03-09T15:07:05.306662+0000","last_fullsized":"2024-03-09T15:07:05.306662+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9722121,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":529,"num_read_kb":7528,"num_write":1253,"num_write_kb":32260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'361","reported_seq":1917,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.737881+0000","last_change":"2024-03-09T14:28:55.594992+0000","last_active":"2024-03-09T15:07:04.737881+0000","last_peered":"2024-03-09T15:07:04.737881+0000","last_clean":"2024-03-09T15:07:04.737881+0000","last_became_active":"2024-03-09T14:28:55.588204+0000","last_became_peered":"2024-03-09T14:28:55.588204+0000","last_unstale":"2024-03-09T15:07:04.737881+0000","last_undegraded":"2024-03-09T15:07:04.737881+0000","last_fullsized":"2024-03-09T15:07:04.737881+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2088,"num_read_kb":2012,"num_write":400,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'366","reported_seq":1070,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.332635+0000","last_change":"2024-03-09T14:28:53.605882+0000","last_active":"2024-03-09T15:07:05.332635+0000","last_peered":"2024-03-09T15:07:05.332635+0000","last_clean":"2024-03-09T15:07:05.332635+0000","last_became_active":"2024-03-09T14:28:53.604391+0000","last_became_peered":"2024-03-09T14:28:53.604391+0000","last_unstale":"2024-03-09T15:07:05.332635+0000","last_undegraded":"2024-03-09T15:07:05.332635+0000","last_fullsized":"2024-03-09T15:07:05.332635+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":836,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":748,"num_read_kb":3295,"num_write":1231,"num_write_kb":34124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'790","reported_seq":2518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.545474+0000","last_change":"2024-03-09T14:28:55.572158+0000","last_active":"2024-03-09T15:06:32.545474+0000","last_peered":"2024-03-09T15:06:32.545474+0000","last_clean":"2024-03-09T15:06:32.545474+0000","last_became_active":"2024-03-09T14:28:55.571291+0000","last_became_peered":"2024-03-09T14:28:55.571291+0000","last_unstale":"2024-03-09T15:06:32.545474+0000","last_undegraded":"2024-03-09T15:06:32.545474+0000","last_fullsized":"2024-03-09T15:06:32.545474+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3843,"num_read_kb":3494,"num_write":1039,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'393","reported_seq":1055,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.421110+0000","last_change":"2024-03-09T14:28:53.619197+0000","last_active":"2024-03-09T15:07:05.421110+0000","last_peered":"2024-03-09T15:07:05.421110+0000","last_clean":"2024-03-09T15:07:05.421110+0000","last_became_active":"2024-03-09T14:28:53.618259+0000","last_became_peered":"2024-03-09T14:28:53.618259+0000","last_unstale":"2024-03-09T15:07:05.421110+0000","last_undegraded":"2024-03-09T15:07:05.421110+0000","last_fullsized":"2024-03-09T15:07:05.421110+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243711,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":574,"num_read_kb":8008,"num_write":1507,"num_write_kb":37535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'418","reported_seq":2029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.552305+0000","last_change":"2024-03-09T15:07:28.552375+0000","last_active":"2024-03-09T15:07:28.552305+0000","last_peered":"2024-03-09T15:07:28.552305+0000","last_clean":"2024-03-09T15:07:28.552305+0000","last_became_active":"2024-03-09T14:28:55.587626+0000","last_became_peered":"2024-03-09T14:28:55.587626+0000","last_unstale":"2024-03-09T15:07:28.552305+0000","last_undegraded":"2024-03-09T15:07:28.552305+0000","last_fullsized":"2024-03-09T15:07:28.552305+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'418","last_scrub_stamp":"2024-03-09T15:07:28.552126+0000","last_deep_scrub":"264'418","last_deep_scrub_stamp":"2024-03-09T15:07:28.552126+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.552126+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:50:47.846392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2314,"num_read_kb":2202,"num_write":483,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'331","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.402496+0000","last_change":"2024-03-09T14:28:53.589649+0000","last_active":"2024-03-09T15:07:05.402496+0000","last_peered":"2024-03-09T15:07:05.402496+0000","last_clean":"2024-03-09T15:07:05.402496+0000","last_became_active":"2024-03-09T14:28:53.589232+0000","last_became_peered":"2024-03-09T14:28:53.589232+0000","last_unstale":"2024-03-09T15:07:05.402496+0000","last_undegraded":"2024-03-09T15:07:05.402496+0000","last_fullsized":"2024-03-09T15:07:05.402496+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":42616,"num_write":1235,"num_write_kb":40647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'928","reported_seq":2693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.496510+0000","last_change":"2024-03-09T14:28:55.603210+0000","last_active":"2024-03-09T15:06:53.496510+0000","last_peered":"2024-03-09T15:06:53.496510+0000","last_clean":"2024-03-09T15:06:53.496510+0000","last_became_active":"2024-03-09T14:28:55.602477+0000","last_became_peered":"2024-03-09T14:28:55.602477+0000","last_unstale":"2024-03-09T15:06:53.496510+0000","last_undegraded":"2024-03-09T15:06:53.496510+0000","last_fullsized":"2024-03-09T15:06:53.496510+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":900,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4605,"num_read_kb":4102,"num_write":1299,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'353","reported_seq":1798,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.460155+0000","last_change":"2024-03-09T14:28:55.571793+0000","last_active":"2024-03-09T15:06:42.460155+0000","last_peered":"2024-03-09T15:06:42.460155+0000","last_clean":"2024-03-09T15:06:42.460155+0000","last_became_active":"2024-03-09T14:28:55.570861+0000","last_became_peered":"2024-03-09T14:28:55.570861+0000","last_unstale":"2024-03-09T15:06:42.460155+0000","last_undegraded":"2024-03-09T15:06:42.460155+0000","last_fullsized":"2024-03-09T15:06:42.460155+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1960,"num_read_kb":1866,"num_write":405,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'351","reported_seq":1039,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.412226+0000","last_change":"2024-03-09T14:28:53.608951+0000","last_active":"2024-03-09T15:07:05.412226+0000","last_peered":"2024-03-09T15:07:05.412226+0000","last_clean":"2024-03-09T15:07:05.412226+0000","last_became_active":"2024-03-09T14:28:53.607915+0000","last_became_peered":"2024-03-09T14:28:53.607915+0000","last_unstale":"2024-03-09T15:07:05.412226+0000","last_undegraded":"2024-03-09T15:07:05.412226+0000","last_fullsized":"2024-03-09T15:07:05.412226+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5273368,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":78573,"num_write":1337,"num_write_kb":47168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'819","reported_seq":2222,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.497424+0000","last_change":"2024-03-09T14:28:55.592675+0000","last_active":"2024-03-09T15:06:53.497424+0000","last_peered":"2024-03-09T15:06:53.497424+0000","last_clean":"2024-03-09T15:06:53.497424+0000","last_became_active":"2024-03-09T14:28:55.591884+0000","last_became_peered":"2024-03-09T14:28:55.591884+0000","last_unstale":"2024-03-09T15:06:53.497424+0000","last_undegraded":"2024-03-09T15:06:53.497424+0000","last_fullsized":"2024-03-09T15:06:53.497424+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3579,"num_read_kb":3134,"num_write":1128,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'247","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.386755+0000","last_change":"2024-03-09T14:28:53.638241+0000","last_active":"2024-03-09T15:07:05.386755+0000","last_peered":"2024-03-09T15:07:05.386755+0000","last_clean":"2024-03-09T15:07:05.386755+0000","last_became_active":"2024-03-09T14:28:53.635735+0000","last_became_peered":"2024-03-09T14:28:53.635735+0000","last_unstale":"2024-03-09T15:07:05.386755+0000","last_undegraded":"2024-03-09T15:07:05.386755+0000","last_fullsized":"2024-03-09T15:07:05.386755+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":452,"num_read_kb":101132,"num_write":981,"num_write_kb":27272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'366","reported_seq":1878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.515340+0000","last_change":"2024-03-09T15:07:27.515488+0000","last_active":"2024-03-09T15:07:27.515340+0000","last_peered":"2024-03-09T15:07:27.515340+0000","last_clean":"2024-03-09T15:07:27.515340+0000","last_became_active":"2024-03-09T14:28:55.589360+0000","last_became_peered":"2024-03-09T14:28:55.589360+0000","last_unstale":"2024-03-09T15:07:27.515340+0000","last_undegraded":"2024-03-09T15:07:27.515340+0000","last_fullsized":"2024-03-09T15:07:27.515340+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-03-09T15:07:27.515111+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-03-09T15:07:27.515111+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.515111+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:24:53.377750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2092,"num_write":426,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'318","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.420983+0000","last_change":"2024-03-09T14:28:53.638187+0000","last_active":"2024-03-09T15:07:05.420983+0000","last_peered":"2024-03-09T15:07:05.420983+0000","last_clean":"2024-03-09T15:07:05.420983+0000","last_became_active":"2024-03-09T14:28:53.635713+0000","last_became_peered":"2024-03-09T14:28:53.635713+0000","last_unstale":"2024-03-09T15:07:05.420983+0000","last_undegraded":"2024-03-09T15:07:05.420983+0000","last_fullsized":"2024-03-09T15:07:05.420983+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1830670,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":532,"num_read_kb":101700,"num_write":1117,"num_write_kb":55747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'1330","reported_seq":3000,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.496597+0000","last_change":"2024-03-09T14:28:55.602534+0000","last_active":"2024-03-09T15:06:53.496597+0000","last_peered":"2024-03-09T15:06:53.496597+0000","last_clean":"2024-03-09T15:06:53.496597+0000","last_became_active":"2024-03-09T14:28:55.602235+0000","last_became_peered":"2024-03-09T14:28:55.602235+0000","last_unstale":"2024-03-09T15:06:53.496597+0000","last_undegraded":"2024-03-09T15:06:53.496597+0000","last_fullsized":"2024-03-09T15:06:53.496597+0000","mapping_epoch":25,"log_start":"264'1300","ondisk_log_start":"264'1300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":1300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5607,"num_read_kb":4937,"num_write":1889,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'441","reported_seq":1117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.687761+0000","last_change":"2024-03-09T15:07:17.687949+0000","last_active":"2024-03-09T15:07:17.687761+0000","last_peered":"2024-03-09T15:07:17.687761+0000","last_clean":"2024-03-09T15:07:17.687761+0000","last_became_active":"2024-03-09T14:29:28.823751+0000","last_became_peered":"2024-03-09T14:29:28.823751+0000","last_unstale":"2024-03-09T15:07:17.687761+0000","last_undegraded":"2024-03-09T15:07:17.687761+0000","last_fullsized":"2024-03-09T15:07:17.687761+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'441","last_scrub_stamp":"2024-03-09T15:07:17.687334+0000","last_deep_scrub":"264'441","last_deep_scrub_stamp":"2024-03-09T15:07:17.687334+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.687334+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:15:40.736410+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262230,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":811,"num_read_kb":6645,"num_write":1426,"num_write_kb":15242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,0],"acting":[2,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"264'438","reported_seq":2022,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.396916+0000","last_change":"2024-03-09T14:28:55.575476+0000","last_active":"2024-03-09T15:06:38.396916+0000","last_peered":"2024-03-09T15:06:38.396916+0000","last_clean":"2024-03-09T15:06:38.396916+0000","last_became_active":"2024-03-09T14:28:55.574645+0000","last_became_peered":"2024-03-09T14:28:55.574645+0000","last_unstale":"2024-03-09T15:06:38.396916+0000","last_undegraded":"2024-03-09T15:06:38.396916+0000","last_fullsized":"2024-03-09T15:06:38.396916+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2503,"num_read_kb":2358,"num_write":585,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'378","reported_seq":1047,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.406207+0000","last_change":"2024-03-09T14:28:53.619764+0000","last_active":"2024-03-09T15:07:05.406207+0000","last_peered":"2024-03-09T15:07:05.406207+0000","last_clean":"2024-03-09T15:07:05.406207+0000","last_became_active":"2024-03-09T14:28:53.619291+0000","last_became_peered":"2024-03-09T14:28:53.619291+0000","last_unstale":"2024-03-09T15:07:05.406207+0000","last_undegraded":"2024-03-09T15:07:05.406207+0000","last_fullsized":"2024-03-09T15:07:05.406207+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505224,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":587,"num_read_kb":88953,"num_write":1364,"num_write_kb":34328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'358","reported_seq":1903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.498182+0000","last_change":"2024-03-09T14:28:55.563774+0000","last_active":"2024-03-09T15:06:53.498182+0000","last_peered":"2024-03-09T15:06:53.498182+0000","last_clean":"2024-03-09T15:06:53.498182+0000","last_became_active":"2024-03-09T14:28:55.563041+0000","last_became_peered":"2024-03-09T14:28:55.563041+0000","last_unstale":"2024-03-09T15:06:53.498182+0000","last_undegraded":"2024-03-09T15:06:53.498182+0000","last_fullsized":"2024-03-09T15:06:53.498182+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2055,"num_read_kb":1986,"num_write":393,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'413","reported_seq":1095,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.391552+0000","last_change":"2024-03-09T14:28:53.586359+0000","last_active":"2024-03-09T15:07:05.391552+0000","last_peered":"2024-03-09T15:07:05.391552+0000","last_clean":"2024-03-09T15:07:05.391552+0000","last_became_active":"2024-03-09T14:28:53.585880+0000","last_became_peered":"2024-03-09T14:28:53.585880+0000","last_unstale":"2024-03-09T15:07:05.391552+0000","last_undegraded":"2024-03-09T15:07:05.391552+0000","last_fullsized":"2024-03-09T15:07:05.391552+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22734,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":653,"num_read_kb":65524,"num_write":1383,"num_write_kb":24882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'121","reported_seq":621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.742377+0000","last_change":"2024-03-09T15:07:16.742500+0000","last_active":"2024-03-09T15:07:16.742377+0000","last_peered":"2024-03-09T15:07:16.742377+0000","last_clean":"2024-03-09T15:07:16.742377+0000","last_became_active":"2024-03-09T14:29:03.660224+0000","last_became_peered":"2024-03-09T14:29:03.660224+0000","last_unstale":"2024-03-09T15:07:16.742377+0000","last_undegraded":"2024-03-09T15:07:16.742377+0000","last_fullsized":"2024-03-09T15:07:16.742377+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-03-09T15:07:16.742103+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-03-09T15:07:16.742103+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.742103+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:21.302474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":112,"num_write":285,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'399","reported_seq":1865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.305565+0000","last_change":"2024-03-09T14:28:55.598495+0000","last_active":"2024-03-09T15:06:41.305565+0000","last_peered":"2024-03-09T15:06:41.305565+0000","last_clean":"2024-03-09T15:06:41.305565+0000","last_became_active":"2024-03-09T14:28:55.596404+0000","last_became_peered":"2024-03-09T14:28:55.596404+0000","last_unstale":"2024-03-09T15:06:41.305565+0000","last_undegraded":"2024-03-09T15:06:41.305565+0000","last_fullsized":"2024-03-09T15:06:41.305565+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":300,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2183,"num_read_kb":2049,"num_write":485,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'309","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.402785+0000","last_change":"2024-03-09T14:28:53.610969+0000","last_active":"2024-03-09T15:07:05.402785+0000","last_peered":"2024-03-09T15:07:05.402785+0000","last_clean":"2024-03-09T15:07:05.402785+0000","last_became_active":"2024-03-09T14:28:53.610073+0000","last_became_peered":"2024-03-09T14:28:53.610073+0000","last_unstale":"2024-03-09T15:07:05.402785+0000","last_undegraded":"2024-03-09T15:07:05.402785+0000","last_fullsized":"2024-03-09T15:07:05.402785+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145852,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":1412,"num_write":1145,"num_write_kb":31021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:14.901113+0000","last_change":"2024-03-09T14:28:57.606795+0000","last_active":"2024-03-09T15:05:14.901113+0000","last_peered":"2024-03-09T15:05:14.901113+0000","last_clean":"2024-03-09T15:05:14.901113+0000","last_became_active":"2024-03-09T14:28:57.606062+0000","last_became_peered":"2024-03-09T14:28:57.606062+0000","last_unstale":"2024-03-09T15:05:14.901113+0000","last_undegraded":"2024-03-09T15:05:14.901113+0000","last_fullsized":"2024-03-09T15:05:14.901113+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'319","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.207933+0000","last_change":"2024-03-09T14:28:59.622695+0000","last_active":"2024-03-09T15:07:05.207933+0000","last_peered":"2024-03-09T15:07:05.207933+0000","last_clean":"2024-03-09T15:07:05.207933+0000","last_became_active":"2024-03-09T14:28:59.622357+0000","last_became_peered":"2024-03-09T14:28:59.622357+0000","last_unstale":"2024-03-09T15:07:05.207933+0000","last_undegraded":"2024-03-09T15:07:05.207933+0000","last_fullsized":"2024-03-09T15:07:05.207933+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":1106,"num_write":404,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:19.723390+0000","last_change":"2024-03-09T14:29:01.637387+0000","last_active":"2024-03-09T15:05:19.723390+0000","last_peered":"2024-03-09T15:05:19.723390+0000","last_clean":"2024-03-09T15:05:19.723390+0000","last_became_active":"2024-03-09T14:29:01.636497+0000","last_became_peered":"2024-03-09T14:29:01.636497+0000","last_unstale":"2024-03-09T15:05:19.723390+0000","last_undegraded":"2024-03-09T15:05:19.723390+0000","last_fullsized":"2024-03-09T15:05:19.723390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2461","reported_seq":4893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.488702+0000","last_change":"2024-03-09T15:07:19.488869+0000","last_active":"2024-03-09T15:07:19.488702+0000","last_peered":"2024-03-09T15:07:19.488702+0000","last_clean":"2024-03-09T15:07:19.488702+0000","last_became_active":"2024-03-09T14:29:03.664933+0000","last_became_peered":"2024-03-09T14:29:03.664933+0000","last_unstale":"2024-03-09T15:07:19.488702+0000","last_undegraded":"2024-03-09T15:07:19.488702+0000","last_fullsized":"2024-03-09T15:07:19.488702+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2461","last_scrub_stamp":"2024-03-09T15:07:19.488484+0000","last_deep_scrub":"264'2461","last_deep_scrub_stamp":"2024-03-09T15:07:19.488484+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.488484+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":2400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:36:54.865691+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6733,"num_read_kb":6729,"num_write":4969,"num_write_kb":1822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'420","reported_seq":1997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:27.109890+0000","last_change":"2024-03-09T14:28:55.595855+0000","last_active":"2024-03-09T15:06:27.109890+0000","last_peered":"2024-03-09T15:06:27.109890+0000","last_clean":"2024-03-09T15:06:27.109890+0000","last_became_active":"2024-03-09T14:28:55.594120+0000","last_became_peered":"2024-03-09T14:28:55.594120+0000","last_unstale":"2024-03-09T15:06:27.109890+0000","last_undegraded":"2024-03-09T15:06:27.109890+0000","last_fullsized":"2024-03-09T15:06:27.109890+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2334,"num_read_kb":2217,"num_write":521,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'343","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.391337+0000","last_change":"2024-03-09T14:28:53.592039+0000","last_active":"2024-03-09T15:07:05.391337+0000","last_peered":"2024-03-09T15:07:05.391337+0000","last_clean":"2024-03-09T15:07:05.391337+0000","last_became_active":"2024-03-09T14:28:53.589914+0000","last_became_peered":"2024-03-09T14:28:53.589914+0000","last_unstale":"2024-03-09T15:07:05.391337+0000","last_undegraded":"2024-03-09T15:07:05.391337+0000","last_fullsized":"2024-03-09T15:07:05.391337+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097178,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":36278,"num_write":1215,"num_write_kb":26714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.974004+0000","last_change":"2024-03-09T14:28:57.609556+0000","last_active":"2024-03-09T15:06:24.974004+0000","last_peered":"2024-03-09T15:06:24.974004+0000","last_clean":"2024-03-09T15:06:24.974004+0000","last_became_active":"2024-03-09T14:28:57.608444+0000","last_became_peered":"2024-03-09T14:28:57.608444+0000","last_unstale":"2024-03-09T15:06:24.974004+0000","last_undegraded":"2024-03-09T15:06:24.974004+0000","last_fullsized":"2024-03-09T15:06:24.974004+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'65","reported_seq":581,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:14.716266+0000","last_change":"2024-03-09T14:28:59.615503+0000","last_active":"2024-03-09T15:05:14.716266+0000","last_peered":"2024-03-09T15:05:14.716266+0000","last_clean":"2024-03-09T15:05:14.716266+0000","last_became_active":"2024-03-09T14:28:59.614144+0000","last_became_peered":"2024-03-09T14:28:59.614144+0000","last_unstale":"2024-03-09T15:05:14.716266+0000","last_undegraded":"2024-03-09T15:05:14.716266+0000","last_fullsized":"2024-03-09T15:05:14.716266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":74,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.728568+0000","last_change":"2024-03-09T15:07:20.728621+0000","last_active":"2024-03-09T15:07:20.728568+0000","last_peered":"2024-03-09T15:07:20.728568+0000","last_clean":"2024-03-09T15:07:20.728568+0000","last_became_active":"2024-03-09T14:29:01.649716+0000","last_became_peered":"2024-03-09T14:29:01.649716+0000","last_unstale":"2024-03-09T15:07:20.728568+0000","last_undegraded":"2024-03-09T15:07:20.728568+0000","last_fullsized":"2024-03-09T15:07:20.728568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.728337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.728337+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.728337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:51:28.102346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'133","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.618295+0000","last_change":"2024-03-09T15:07:24.618367+0000","last_active":"2024-03-09T15:07:24.618295+0000","last_peered":"2024-03-09T15:07:24.618295+0000","last_clean":"2024-03-09T15:07:24.618295+0000","last_became_active":"2024-03-09T14:29:03.676427+0000","last_became_peered":"2024-03-09T14:29:03.676427+0000","last_unstale":"2024-03-09T15:07:24.618295+0000","last_undegraded":"2024-03-09T15:07:24.618295+0000","last_fullsized":"2024-03-09T15:07:24.618295+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'133","last_scrub_stamp":"2024-03-09T15:07:24.618110+0000","last_deep_scrub":"264'133","last_deep_scrub_stamp":"2024-03-09T15:07:24.618110+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.618110+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:34.633535+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":126,"num_write":288,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'348","reported_seq":1738,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.642796+0000","last_change":"2024-03-09T15:07:18.642855+0000","last_active":"2024-03-09T15:07:18.642796+0000","last_peered":"2024-03-09T15:07:18.642796+0000","last_clean":"2024-03-09T15:07:18.642796+0000","last_became_active":"2024-03-09T14:29:28.733522+0000","last_became_peered":"2024-03-09T14:29:28.733522+0000","last_unstale":"2024-03-09T15:07:18.642796+0000","last_undegraded":"2024-03-09T15:07:18.642796+0000","last_fullsized":"2024-03-09T15:07:18.642796+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-03-09T15:07:18.642582+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-03-09T15:07:18.642582+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.642582+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:41:22.443747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1907,"num_read_kb":1804,"num_write":410,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'332","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.308168+0000","last_change":"2024-03-09T14:28:53.633910+0000","last_active":"2024-03-09T15:07:05.308168+0000","last_peered":"2024-03-09T15:07:05.308168+0000","last_clean":"2024-03-09T15:07:05.308168+0000","last_became_active":"2024-03-09T14:28:53.633368+0000","last_became_peered":"2024-03-09T14:28:53.633368+0000","last_unstale":"2024-03-09T15:07:05.308168+0000","last_undegraded":"2024-03-09T15:07:05.308168+0000","last_fullsized":"2024-03-09T15:07:05.308168+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1917981,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":440,"num_read_kb":7245,"num_write":1144,"num_write_kb":29598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:14.957694+0000","last_change":"2024-03-09T14:28:57.614611+0000","last_active":"2024-03-09T15:05:14.957694+0000","last_peered":"2024-03-09T15:05:14.957694+0000","last_clean":"2024-03-09T15:05:14.957694+0000","last_became_active":"2024-03-09T14:28:57.613841+0000","last_became_peered":"2024-03-09T14:28:57.613841+0000","last_unstale":"2024-03-09T15:05:14.957694+0000","last_undegraded":"2024-03-09T15:05:14.957694+0000","last_fullsized":"2024-03-09T15:05:14.957694+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'109","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.725975+0000","last_change":"2024-03-09T15:07:14.726059+0000","last_active":"2024-03-09T15:07:14.725975+0000","last_peered":"2024-03-09T15:07:14.725975+0000","last_clean":"2024-03-09T15:07:14.725975+0000","last_became_active":"2024-03-09T14:28:59.619147+0000","last_became_peered":"2024-03-09T14:28:59.619147+0000","last_unstale":"2024-03-09T15:07:14.725975+0000","last_undegraded":"2024-03-09T15:07:14.725975+0000","last_fullsized":"2024-03-09T15:07:14.725975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-03-09T15:07:14.725790+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-03-09T15:07:14.725790+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.725790+0000","objects_scrubbed":6,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:39:52.182703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":102,"num_write":78,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'535","reported_seq":3849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.432246+0000","last_change":"2024-03-09T14:29:01.637642+0000","last_active":"2024-03-09T15:07:05.432246+0000","last_peered":"2024-03-09T15:07:05.432246+0000","last_clean":"2024-03-09T15:07:05.432246+0000","last_became_active":"2024-03-09T14:29:01.636743+0000","last_became_peered":"2024-03-09T14:29:01.636743+0000","last_unstale":"2024-03-09T15:07:05.432246+0000","last_undegraded":"2024-03-09T15:07:05.432246+0000","last_fullsized":"2024-03-09T15:07:05.432246+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'199","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.779254+0000","last_change":"2024-03-09T15:07:17.779323+0000","last_active":"2024-03-09T15:07:17.779254+0000","last_peered":"2024-03-09T15:07:17.779254+0000","last_clean":"2024-03-09T15:07:17.779254+0000","last_became_active":"2024-03-09T14:29:03.649194+0000","last_became_peered":"2024-03-09T14:29:03.649194+0000","last_unstale":"2024-03-09T15:07:17.779254+0000","last_undegraded":"2024-03-09T15:07:17.779254+0000","last_fullsized":"2024-03-09T15:07:17.779254+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-03-09T15:07:17.779057+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-03-09T15:07:17.779057+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.779057+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:30:24.656524+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":551,"num_read_kb":549,"num_write":426,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'370","reported_seq":1844,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:56.306593+0000","last_change":"2024-03-09T14:28:55.597244+0000","last_active":"2024-03-09T15:05:56.306593+0000","last_peered":"2024-03-09T15:05:56.306593+0000","last_clean":"2024-03-09T15:05:56.306593+0000","last_became_active":"2024-03-09T14:28:55.592359+0000","last_became_peered":"2024-03-09T14:28:55.592359+0000","last_unstale":"2024-03-09T15:05:56.306593+0000","last_undegraded":"2024-03-09T15:05:56.306593+0000","last_fullsized":"2024-03-09T15:05:56.306593+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2105,"num_read_kb":2015,"num_write":416,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'285","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.384692+0000","last_change":"2024-03-09T14:28:53.632702+0000","last_active":"2024-03-09T15:07:05.384692+0000","last_peered":"2024-03-09T15:07:05.384692+0000","last_clean":"2024-03-09T15:07:05.384692+0000","last_became_active":"2024-03-09T14:28:53.631559+0000","last_became_peered":"2024-03-09T14:28:53.631559+0000","last_unstale":"2024-03-09T15:07:05.384692+0000","last_undegraded":"2024-03-09T15:07:05.384692+0000","last_fullsized":"2024-03-09T15:07:05.384692+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8554550,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":396,"num_read_kb":6712,"num_write":1052,"num_write_kb":20730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:14.901176+0000","last_change":"2024-03-09T14:28:57.606488+0000","last_active":"2024-03-09T15:05:14.901176+0000","last_peered":"2024-03-09T15:05:14.901176+0000","last_clean":"2024-03-09T15:05:14.901176+0000","last_became_active":"2024-03-09T14:28:57.605787+0000","last_became_peered":"2024-03-09T14:28:57.605787+0000","last_unstale":"2024-03-09T15:05:14.901176+0000","last_undegraded":"2024-03-09T15:05:14.901176+0000","last_fullsized":"2024-03-09T15:05:14.901176+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'243","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.808320+0000","last_change":"2024-03-09T14:28:59.627011+0000","last_active":"2024-03-09T15:07:04.808320+0000","last_peered":"2024-03-09T15:07:04.808320+0000","last_clean":"2024-03-09T15:07:04.808320+0000","last_became_active":"2024-03-09T14:28:59.626279+0000","last_became_peered":"2024-03-09T14:28:59.626279+0000","last_unstale":"2024-03-09T15:07:04.808320+0000","last_undegraded":"2024-03-09T15:07:04.808320+0000","last_fullsized":"2024-03-09T15:07:04.808320+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":970,"num_write":334,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'586","reported_seq":1930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.434903+0000","last_change":"2024-03-09T14:29:01.629131+0000","last_active":"2024-03-09T15:07:05.434903+0000","last_peered":"2024-03-09T15:07:05.434903+0000","last_clean":"2024-03-09T15:07:05.434903+0000","last_became_active":"2024-03-09T14:29:01.628420+0000","last_became_peered":"2024-03-09T14:29:01.628420+0000","last_unstale":"2024-03-09T15:07:05.434903+0000","last_undegraded":"2024-03-09T15:07:05.434903+0000","last_fullsized":"2024-03-09T15:07:05.434903+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'514","reported_seq":2117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:33.828588+0000","last_change":"2024-03-09T14:28:55.583472+0000","last_active":"2024-03-09T15:06:33.828588+0000","last_peered":"2024-03-09T15:06:33.828588+0000","last_clean":"2024-03-09T15:06:33.828588+0000","last_became_active":"2024-03-09T14:28:55.582638+0000","last_became_peered":"2024-03-09T14:28:55.582638+0000","last_unstale":"2024-03-09T15:06:33.828588+0000","last_undegraded":"2024-03-09T15:06:33.828588+0000","last_fullsized":"2024-03-09T15:06:33.828588+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":500,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2835,"num_read_kb":2627,"num_write":675,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'339","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.840021+0000","last_change":"2024-03-09T14:28:53.615478+0000","last_active":"2024-03-09T15:07:12.840021+0000","last_peered":"2024-03-09T15:07:12.840021+0000","last_clean":"2024-03-09T15:07:12.840021+0000","last_became_active":"2024-03-09T14:28:53.614586+0000","last_became_peered":"2024-03-09T14:28:53.614586+0000","last_unstale":"2024-03-09T15:07:12.840021+0000","last_undegraded":"2024-03-09T15:07:12.840021+0000","last_fullsized":"2024-03-09T15:07:12.840021+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180167,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":10439,"num_write":1256,"num_write_kb":25392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:49.730612+0000","last_change":"2024-03-09T14:28:57.604178+0000","last_active":"2024-03-09T15:05:49.730612+0000","last_peered":"2024-03-09T15:05:49.730612+0000","last_clean":"2024-03-09T15:05:49.730612+0000","last_became_active":"2024-03-09T14:28:57.603233+0000","last_became_peered":"2024-03-09T14:28:57.603233+0000","last_unstale":"2024-03-09T15:05:49.730612+0000","last_undegraded":"2024-03-09T15:05:49.730612+0000","last_fullsized":"2024-03-09T15:05:49.730612+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'340","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.485546+0000","last_change":"2024-03-09T15:07:23.485642+0000","last_active":"2024-03-09T15:07:23.485546+0000","last_peered":"2024-03-09T15:07:23.485546+0000","last_clean":"2024-03-09T15:07:23.485546+0000","last_became_active":"2024-03-09T14:28:59.626371+0000","last_became_peered":"2024-03-09T14:28:59.626371+0000","last_unstale":"2024-03-09T15:07:23.485546+0000","last_undegraded":"2024-03-09T15:07:23.485546+0000","last_fullsized":"2024-03-09T15:07:23.485546+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'340","last_scrub_stamp":"2024-03-09T15:07:23.485354+0000","last_deep_scrub":"264'340","last_deep_scrub_stamp":"2024-03-09T15:07:23.485354+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.485354+0000","objects_scrubbed":9,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:58:29.645072+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46990,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":561,"num_read_kb":1214,"num_write":446,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.893758+0000","last_change":"2024-03-09T14:29:01.637753+0000","last_active":"2024-03-09T15:07:09.893758+0000","last_peered":"2024-03-09T15:07:09.893758+0000","last_clean":"2024-03-09T15:07:09.893758+0000","last_became_active":"2024-03-09T14:29:01.636735+0000","last_became_peered":"2024-03-09T14:29:01.636735+0000","last_unstale":"2024-03-09T15:07:09.893758+0000","last_undegraded":"2024-03-09T15:07:09.893758+0000","last_fullsized":"2024-03-09T15:07:09.893758+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'545","reported_seq":1376,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.508731+0000","last_change":"2024-03-09T15:07:14.508801+0000","last_active":"2024-03-09T15:07:14.508731+0000","last_peered":"2024-03-09T15:07:14.508731+0000","last_clean":"2024-03-09T15:07:14.508731+0000","last_became_active":"2024-03-09T14:29:03.676068+0000","last_became_peered":"2024-03-09T14:29:03.676068+0000","last_unstale":"2024-03-09T15:07:14.508731+0000","last_undegraded":"2024-03-09T15:07:14.508731+0000","last_fullsized":"2024-03-09T15:07:14.508731+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'545","last_scrub_stamp":"2024-03-09T15:07:14.508537+0000","last_deep_scrub":"264'545","last_deep_scrub_stamp":"2024-03-09T15:07:14.508537+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.508537+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:06:49.609530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1331,"num_read_kb":1310,"num_write":1143,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'505","reported_seq":2111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.499064+0000","last_change":"2024-03-09T14:28:55.563572+0000","last_active":"2024-03-09T15:06:53.499064+0000","last_peered":"2024-03-09T15:06:53.499064+0000","last_clean":"2024-03-09T15:06:53.499064+0000","last_became_active":"2024-03-09T14:28:55.562782+0000","last_became_peered":"2024-03-09T14:28:55.562782+0000","last_unstale":"2024-03-09T15:06:53.499064+0000","last_undegraded":"2024-03-09T15:06:53.499064+0000","last_fullsized":"2024-03-09T15:06:53.499064+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2703,"num_read_kb":2505,"num_write":654,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'320","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.750654+0000","last_change":"2024-03-09T14:28:53.614539+0000","last_active":"2024-03-09T15:07:09.750654+0000","last_peered":"2024-03-09T15:07:09.750654+0000","last_clean":"2024-03-09T15:07:09.750654+0000","last_became_active":"2024-03-09T14:28:53.613015+0000","last_became_peered":"2024-03-09T14:28:53.613015+0000","last_unstale":"2024-03-09T15:07:09.750654+0000","last_undegraded":"2024-03-09T15:07:09.750654+0000","last_fullsized":"2024-03-09T15:07:09.750654+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":493,"num_read_kb":9909,"num_write":1175,"num_write_kb":22337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.500050+0000","last_change":"2024-03-09T15:07:26.500103+0000","last_active":"2024-03-09T15:07:26.500050+0000","last_peered":"2024-03-09T15:07:26.500050+0000","last_clean":"2024-03-09T15:07:26.500050+0000","last_became_active":"2024-03-09T14:28:57.605493+0000","last_became_peered":"2024-03-09T14:28:57.605493+0000","last_unstale":"2024-03-09T15:07:26.500050+0000","last_undegraded":"2024-03-09T15:07:26.500050+0000","last_fullsized":"2024-03-09T15:07:26.500050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:26.499852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:26.499852+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.499852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:50:05.246070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'263","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.809727+0000","last_change":"2024-03-09T14:28:59.615074+0000","last_active":"2024-03-09T15:07:10.809727+0000","last_peered":"2024-03-09T15:07:10.809727+0000","last_clean":"2024-03-09T15:07:10.809727+0000","last_became_active":"2024-03-09T14:28:59.614640+0000","last_became_peered":"2024-03-09T14:28:59.614640+0000","last_unstale":"2024-03-09T15:07:10.809727+0000","last_undegraded":"2024-03-09T15:07:10.809727+0000","last_fullsized":"2024-03-09T15:07:10.809727+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43961,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1047,"num_write":356,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:59.968763+0000","last_change":"2024-03-09T14:29:01.628631+0000","last_active":"2024-03-09T15:05:59.968763+0000","last_peered":"2024-03-09T15:05:59.968763+0000","last_clean":"2024-03-09T15:05:59.968763+0000","last_became_active":"2024-03-09T14:29:01.627897+0000","last_became_peered":"2024-03-09T14:29:01.627897+0000","last_unstale":"2024-03-09T15:05:59.968763+0000","last_undegraded":"2024-03-09T15:05:59.968763+0000","last_fullsized":"2024-03-09T15:05:59.968763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'106","reported_seq":594,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:44.734065+0000","last_change":"2024-03-09T14:29:03.673997+0000","last_active":"2024-03-09T15:06:44.734065+0000","last_peered":"2024-03-09T15:06:44.734065+0000","last_clean":"2024-03-09T15:06:44.734065+0000","last_became_active":"2024-03-09T14:29:03.673265+0000","last_became_peered":"2024-03-09T14:29:03.673265+0000","last_unstale":"2024-03-09T15:06:44.734065+0000","last_undegraded":"2024-03-09T15:06:44.734065+0000","last_fullsized":"2024-03-09T15:06:44.734065+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":93,"num_write":248,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'556","reported_seq":2186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.355399+0000","last_change":"2024-03-09T14:28:55.595155+0000","last_active":"2024-03-09T15:06:24.355399+0000","last_peered":"2024-03-09T15:06:24.355399+0000","last_clean":"2024-03-09T15:06:24.355399+0000","last_became_active":"2024-03-09T14:28:55.588092+0000","last_became_peered":"2024-03-09T14:28:55.588092+0000","last_unstale":"2024-03-09T15:06:24.355399+0000","last_undegraded":"2024-03-09T15:06:24.355399+0000","last_fullsized":"2024-03-09T15:06:24.355399+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2916,"num_read_kb":2661,"num_write":728,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'301","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.675822+0000","last_change":"2024-03-09T15:07:15.675925+0000","last_active":"2024-03-09T15:07:15.675822+0000","last_peered":"2024-03-09T15:07:15.675822+0000","last_clean":"2024-03-09T15:07:15.675822+0000","last_became_active":"2024-03-09T14:29:28.822971+0000","last_became_peered":"2024-03-09T14:29:28.822971+0000","last_unstale":"2024-03-09T15:07:15.675822+0000","last_undegraded":"2024-03-09T15:07:15.675822+0000","last_fullsized":"2024-03-09T15:07:15.675822+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'301","last_scrub_stamp":"2024-03-09T15:07:15.675604+0000","last_deep_scrub":"264'301","last_deep_scrub_stamp":"2024-03-09T15:07:15.675604+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.675604+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:44.567227+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262197,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":365,"num_read_kb":22880,"num_write":991,"num_write_kb":75728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.593360+0000","last_change":"2024-03-09T15:07:20.593411+0000","last_active":"2024-03-09T15:07:20.593360+0000","last_peered":"2024-03-09T15:07:20.593360+0000","last_clean":"2024-03-09T15:07:20.593360+0000","last_became_active":"2024-03-09T14:28:57.610472+0000","last_became_peered":"2024-03-09T14:28:57.610472+0000","last_unstale":"2024-03-09T15:07:20.593360+0000","last_undegraded":"2024-03-09T15:07:20.593360+0000","last_fullsized":"2024-03-09T15:07:20.593360+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.593168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.593168+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.593168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:29:16.398211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'303","reported_seq":878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.938933+0000","last_change":"2024-03-09T14:28:59.613949+0000","last_active":"2024-03-09T15:07:02.938933+0000","last_peered":"2024-03-09T15:07:02.938933+0000","last_clean":"2024-03-09T15:07:02.938933+0000","last_became_active":"2024-03-09T14:28:59.610930+0000","last_became_peered":"2024-03-09T14:28:59.610930+0000","last_unstale":"2024-03-09T15:07:02.938933+0000","last_undegraded":"2024-03-09T15:07:02.938933+0000","last_fullsized":"2024-03-09T15:07:02.938933+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48936,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":498,"num_read_kb":1136,"num_write":410,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'561","reported_seq":2054,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.435911+0000","last_change":"2024-03-09T14:29:01.648142+0000","last_active":"2024-03-09T15:07:05.435911+0000","last_peered":"2024-03-09T15:07:05.435911+0000","last_clean":"2024-03-09T15:07:05.435911+0000","last_became_active":"2024-03-09T14:29:01.647361+0000","last_became_peered":"2024-03-09T14:29:01.647361+0000","last_unstale":"2024-03-09T15:07:05.435911+0000","last_undegraded":"2024-03-09T15:07:05.435911+0000","last_fullsized":"2024-03-09T15:07:05.435911+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'138","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.680719+0000","last_change":"2024-03-09T15:07:26.680790+0000","last_active":"2024-03-09T15:07:26.680719+0000","last_peered":"2024-03-09T15:07:26.680719+0000","last_clean":"2024-03-09T15:07:26.680719+0000","last_became_active":"2024-03-09T14:29:03.665744+0000","last_became_peered":"2024-03-09T14:29:03.665744+0000","last_unstale":"2024-03-09T15:07:26.680719+0000","last_undegraded":"2024-03-09T15:07:26.680719+0000","last_fullsized":"2024-03-09T15:07:26.680719+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-03-09T15:07:26.680521+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-03-09T15:07:26.680521+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.680521+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:01.192699+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'380","reported_seq":1994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.437294+0000","last_change":"2024-03-09T14:28:55.587716+0000","last_active":"2024-03-09T15:07:09.437294+0000","last_peered":"2024-03-09T15:07:09.437294+0000","last_clean":"2024-03-09T15:07:09.437294+0000","last_became_active":"2024-03-09T14:28:55.587413+0000","last_became_peered":"2024-03-09T14:28:55.587413+0000","last_unstale":"2024-03-09T15:07:09.437294+0000","last_undegraded":"2024-03-09T15:07:09.437294+0000","last_fullsized":"2024-03-09T15:07:09.437294+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2251,"num_read_kb":2175,"num_write":432,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'286","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.927026+0000","last_change":"2024-03-09T14:28:53.640425+0000","last_active":"2024-03-09T15:07:09.927026+0000","last_peered":"2024-03-09T15:07:09.927026+0000","last_clean":"2024-03-09T15:07:09.927026+0000","last_became_active":"2024-03-09T14:28:53.639073+0000","last_became_peered":"2024-03-09T14:28:53.639073+0000","last_unstale":"2024-03-09T15:07:09.927026+0000","last_undegraded":"2024-03-09T15:07:09.927026+0000","last_fullsized":"2024-03-09T15:07:09.927026+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656710,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":422,"num_read_kb":3405,"num_write":1144,"num_write_kb":27946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.643197+0000","last_change":"2024-03-09T15:07:18.643287+0000","last_active":"2024-03-09T15:07:18.643197+0000","last_peered":"2024-03-09T15:07:18.643197+0000","last_clean":"2024-03-09T15:07:18.643197+0000","last_became_active":"2024-03-09T14:28:57.620037+0000","last_became_peered":"2024-03-09T14:28:57.620037+0000","last_unstale":"2024-03-09T15:07:18.643197+0000","last_undegraded":"2024-03-09T15:07:18.643197+0000","last_fullsized":"2024-03-09T15:07:18.643197+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:18.642943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:18.642943+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.642943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:49:35.857746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'470","reported_seq":1091,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.264346+0000","last_change":"2024-03-09T14:28:59.626702+0000","last_active":"2024-03-09T15:07:04.264346+0000","last_peered":"2024-03-09T15:07:04.264346+0000","last_clean":"2024-03-09T15:07:04.264346+0000","last_became_active":"2024-03-09T14:28:59.625949+0000","last_became_peered":"2024-03-09T14:28:59.625949+0000","last_unstale":"2024-03-09T15:07:04.264346+0000","last_undegraded":"2024-03-09T15:07:04.264346+0000","last_fullsized":"2024-03-09T15:07:04.264346+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84476,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":828,"num_read_kb":2021,"num_write":686,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.761473+0000","last_change":"2024-03-09T15:07:12.761532+0000","last_active":"2024-03-09T15:07:12.761473+0000","last_peered":"2024-03-09T15:07:12.761473+0000","last_clean":"2024-03-09T15:07:12.761473+0000","last_became_active":"2024-03-09T14:29:01.620136+0000","last_became_peered":"2024-03-09T14:29:01.620136+0000","last_unstale":"2024-03-09T15:07:12.761473+0000","last_undegraded":"2024-03-09T15:07:12.761473+0000","last_fullsized":"2024-03-09T15:07:12.761473+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:12.761261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:12.761261+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.761261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:22:11.707212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'161","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.963973+0000","last_change":"2024-03-09T15:07:17.964042+0000","last_active":"2024-03-09T15:07:17.963973+0000","last_peered":"2024-03-09T15:07:17.963973+0000","last_clean":"2024-03-09T15:07:17.963973+0000","last_became_active":"2024-03-09T14:29:03.673216+0000","last_became_peered":"2024-03-09T14:29:03.673216+0000","last_unstale":"2024-03-09T15:07:17.963973+0000","last_undegraded":"2024-03-09T15:07:17.963973+0000","last_fullsized":"2024-03-09T15:07:17.963973+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'161","last_scrub_stamp":"2024-03-09T15:07:17.963795+0000","last_deep_scrub":"264'161","last_deep_scrub_stamp":"2024-03-09T15:07:17.963795+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.963795+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:47:11.924876+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":716,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":343,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'284","reported_seq":1637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.741615+0000","last_change":"2024-03-09T14:28:55.575944+0000","last_active":"2024-03-09T15:07:09.741615+0000","last_peered":"2024-03-09T15:07:09.741615+0000","last_clean":"2024-03-09T15:07:09.741615+0000","last_became_active":"2024-03-09T14:28:55.575211+0000","last_became_peered":"2024-03-09T14:28:55.575211+0000","last_unstale":"2024-03-09T15:07:09.741615+0000","last_undegraded":"2024-03-09T15:07:09.741615+0000","last_fullsized":"2024-03-09T15:07:09.741615+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1639,"num_read_kb":1592,"num_write":307,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'315","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.983675+0000","last_change":"2024-03-09T14:28:53.562474+0000","last_active":"2024-03-09T15:07:09.983675+0000","last_peered":"2024-03-09T15:07:09.983675+0000","last_clean":"2024-03-09T15:07:09.983675+0000","last_became_active":"2024-03-09T14:28:53.561769+0000","last_became_peered":"2024-03-09T14:28:53.561769+0000","last_unstale":"2024-03-09T15:07:09.983675+0000","last_undegraded":"2024-03-09T15:07:09.983675+0000","last_fullsized":"2024-03-09T15:07:09.983675+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":556,"num_read_kb":46371,"num_write":1232,"num_write_kb":14767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.518216+0000","last_change":"2024-03-09T15:07:24.518273+0000","last_active":"2024-03-09T15:07:24.518216+0000","last_peered":"2024-03-09T15:07:24.518216+0000","last_clean":"2024-03-09T15:07:24.518216+0000","last_became_active":"2024-03-09T14:28:57.606029+0000","last_became_peered":"2024-03-09T14:28:57.606029+0000","last_unstale":"2024-03-09T15:07:24.518216+0000","last_undegraded":"2024-03-09T15:07:24.518216+0000","last_fullsized":"2024-03-09T15:07:24.518216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:24.517981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:24.517981+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.517981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:03.615664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'277","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.729802+0000","last_change":"2024-03-09T15:07:23.729911+0000","last_active":"2024-03-09T15:07:23.729802+0000","last_peered":"2024-03-09T15:07:23.729802+0000","last_clean":"2024-03-09T15:07:23.729802+0000","last_became_active":"2024-03-09T14:28:59.630097+0000","last_became_peered":"2024-03-09T14:28:59.630097+0000","last_unstale":"2024-03-09T15:07:23.729802+0000","last_undegraded":"2024-03-09T15:07:23.729802+0000","last_fullsized":"2024-03-09T15:07:23.729802+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'277","last_scrub_stamp":"2024-03-09T15:07:23.729634+0000","last_deep_scrub":"264'277","last_deep_scrub_stamp":"2024-03-09T15:07:23.729634+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.729634+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:54:34.396344+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42990,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":1018,"num_write":414,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13964,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.437541+0000","last_change":"2024-03-09T14:29:01.648762+0000","last_active":"2024-03-09T15:07:09.437541+0000","last_peered":"2024-03-09T15:07:09.437541+0000","last_clean":"2024-03-09T15:07:09.437541+0000","last_became_active":"2024-03-09T14:29:01.647375+0000","last_became_peered":"2024-03-09T14:29:01.647375+0000","last_unstale":"2024-03-09T15:07:09.437541+0000","last_undegraded":"2024-03-09T15:07:09.437541+0000","last_fullsized":"2024-03-09T15:07:09.437541+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'131","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.012999+0000","last_change":"2024-03-09T15:07:11.013027+0000","last_active":"2024-03-09T15:07:11.012999+0000","last_peered":"2024-03-09T15:07:11.012999+0000","last_clean":"2024-03-09T15:07:11.012999+0000","last_became_active":"2024-03-09T14:29:03.677704+0000","last_became_peered":"2024-03-09T14:29:03.677704+0000","last_unstale":"2024-03-09T15:07:11.012999+0000","last_undegraded":"2024-03-09T15:07:11.012999+0000","last_fullsized":"2024-03-09T15:07:11.012999+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-03-09T15:07:11.012928+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-03-09T15:07:11.012928+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.012928+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:47:36.358128+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":309,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'396","reported_seq":2040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.741646+0000","last_change":"2024-03-09T14:28:55.578548+0000","last_active":"2024-03-09T15:07:09.741646+0000","last_peered":"2024-03-09T15:07:09.741646+0000","last_clean":"2024-03-09T15:07:09.741646+0000","last_became_active":"2024-03-09T14:28:55.577690+0000","last_became_peered":"2024-03-09T14:28:55.577690+0000","last_unstale":"2024-03-09T15:07:09.741646+0000","last_undegraded":"2024-03-09T15:07:09.741646+0000","last_fullsized":"2024-03-09T15:07:09.741646+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":300,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2493,"num_read_kb":2366,"num_write":474,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'293","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.308775+0000","last_change":"2024-03-09T14:28:53.631261+0000","last_active":"2024-03-09T15:07:05.308775+0000","last_peered":"2024-03-09T15:07:05.308775+0000","last_clean":"2024-03-09T15:07:05.308775+0000","last_became_active":"2024-03-09T14:28:53.627013+0000","last_became_peered":"2024-03-09T14:28:53.627013+0000","last_unstale":"2024-03-09T15:07:05.308775+0000","last_undegraded":"2024-03-09T15:07:05.308775+0000","last_fullsized":"2024-03-09T15:07:05.308775+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242906,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":6489,"num_write":1122,"num_write_kb":11469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.827752+0000","last_change":"2024-03-09T15:07:23.827856+0000","last_active":"2024-03-09T15:07:23.827752+0000","last_peered":"2024-03-09T15:07:23.827752+0000","last_clean":"2024-03-09T15:07:23.827752+0000","last_became_active":"2024-03-09T14:28:57.614028+0000","last_became_peered":"2024-03-09T14:28:57.614028+0000","last_unstale":"2024-03-09T15:07:23.827752+0000","last_undegraded":"2024-03-09T15:07:23.827752+0000","last_fullsized":"2024-03-09T15:07:23.827752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:23.827525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:23.827525+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.827525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:24:15.966605+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'266","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.640027+0000","last_change":"2024-03-09T15:07:16.640027+0000","last_active":"2024-03-09T15:07:16.640027+0000","last_peered":"2024-03-09T15:07:16.640027+0000","last_clean":"2024-03-09T15:07:16.640027+0000","last_became_active":"2024-03-09T14:28:59.613169+0000","last_became_peered":"2024-03-09T14:28:59.613169+0000","last_unstale":"2024-03-09T15:07:16.640027+0000","last_undegraded":"2024-03-09T15:07:16.640027+0000","last_fullsized":"2024-03-09T15:07:16.640027+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-03-09T15:07:16.639752+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-03-09T15:07:16.639752+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.639752+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:43.931037+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":434,"num_read_kb":985,"num_write":344,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'525","reported_seq":4084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.761709+0000","last_change":"2024-03-09T15:07:11.761709+0000","last_active":"2024-03-09T15:07:11.761709+0000","last_peered":"2024-03-09T15:07:11.761709+0000","last_clean":"2024-03-09T15:07:11.761709+0000","last_became_active":"2024-03-09T14:29:01.633363+0000","last_became_peered":"2024-03-09T14:29:01.633363+0000","last_unstale":"2024-03-09T15:07:11.761709+0000","last_undegraded":"2024-03-09T15:07:11.761709+0000","last_fullsized":"2024-03-09T15:07:11.761709+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'525","last_scrub_stamp":"2024-03-09T15:07:11.761590+0000","last_deep_scrub":"264'525","last_deep_scrub_stamp":"2024-03-09T15:07:11.761590+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.761590+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:01.906869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'120","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.054420+0000","last_change":"2024-03-09T15:07:15.054514+0000","last_active":"2024-03-09T15:07:15.054420+0000","last_peered":"2024-03-09T15:07:15.054420+0000","last_clean":"2024-03-09T15:07:15.054420+0000","last_became_active":"2024-03-09T14:29:03.679941+0000","last_became_peered":"2024-03-09T14:29:03.679941+0000","last_unstale":"2024-03-09T15:07:15.054420+0000","last_undegraded":"2024-03-09T15:07:15.054420+0000","last_fullsized":"2024-03-09T15:07:15.054420+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-03-09T15:07:15.054218+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-03-09T15:07:15.054218+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.054218+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:13:22.609108+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1871,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":265,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'459","reported_seq":2162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.779128+0000","last_change":"2024-03-09T15:07:28.779197+0000","last_active":"2024-03-09T15:07:28.779128+0000","last_peered":"2024-03-09T15:07:28.779128+0000","last_clean":"2024-03-09T15:07:28.779128+0000","last_became_active":"2024-03-09T14:28:55.589982+0000","last_became_peered":"2024-03-09T14:28:55.589982+0000","last_unstale":"2024-03-09T15:07:28.779128+0000","last_undegraded":"2024-03-09T15:07:28.779128+0000","last_fullsized":"2024-03-09T15:07:28.779128+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'459","last_scrub_stamp":"2024-03-09T15:07:28.778936+0000","last_deep_scrub":"264'459","last_deep_scrub_stamp":"2024-03-09T15:07:28.778936+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.778936+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:20:52.811305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2457,"num_read_kb":2347,"num_write":517,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'336","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.392006+0000","last_change":"2024-03-09T14:28:53.603618+0000","last_active":"2024-03-09T15:07:05.392006+0000","last_peered":"2024-03-09T15:07:05.392006+0000","last_clean":"2024-03-09T15:07:05.392006+0000","last_became_active":"2024-03-09T14:28:53.596847+0000","last_became_peered":"2024-03-09T14:28:53.596847+0000","last_unstale":"2024-03-09T15:07:05.392006+0000","last_undegraded":"2024-03-09T15:07:05.392006+0000","last_fullsized":"2024-03-09T15:07:05.392006+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243083,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":7047,"num_write":1167,"num_write_kb":21742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.953788+0000","last_change":"2024-03-09T14:28:57.619309+0000","last_active":"2024-03-09T15:07:11.953788+0000","last_peered":"2024-03-09T15:07:11.953788+0000","last_clean":"2024-03-09T15:07:11.953788+0000","last_became_active":"2024-03-09T14:28:57.618459+0000","last_became_peered":"2024-03-09T14:28:57.618459+0000","last_unstale":"2024-03-09T15:07:11.953788+0000","last_undegraded":"2024-03-09T15:07:11.953788+0000","last_fullsized":"2024-03-09T15:07:11.953788+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":640,"num_read_kb":640,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'56","reported_seq":563,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.809889+0000","last_change":"2024-03-09T14:28:59.635240+0000","last_active":"2024-03-09T15:07:10.809889+0000","last_peered":"2024-03-09T15:07:10.809889+0000","last_clean":"2024-03-09T15:07:10.809889+0000","last_became_active":"2024-03-09T14:28:59.634653+0000","last_became_peered":"2024-03-09T14:28:59.634653+0000","last_unstale":"2024-03-09T15:07:10.809889+0000","last_undegraded":"2024-03-09T15:07:10.809889+0000","last_fullsized":"2024-03-09T15:07:10.809889+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'537","reported_seq":1996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.258519+0000","last_change":"2024-03-09T15:07:25.258582+0000","last_active":"2024-03-09T15:07:25.258519+0000","last_peered":"2024-03-09T15:07:25.258519+0000","last_clean":"2024-03-09T15:07:25.258519+0000","last_became_active":"2024-03-09T14:29:01.656177+0000","last_became_peered":"2024-03-09T14:29:01.656177+0000","last_unstale":"2024-03-09T15:07:25.258519+0000","last_undegraded":"2024-03-09T15:07:25.258519+0000","last_fullsized":"2024-03-09T15:07:25.258519+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'537","last_scrub_stamp":"2024-03-09T15:07:25.258322+0000","last_deep_scrub":"264'537","last_deep_scrub_stamp":"2024-03-09T15:07:25.258322+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.258322+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:08:40.564114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'150","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.798479+0000","last_change":"2024-03-09T15:07:13.798635+0000","last_active":"2024-03-09T15:07:13.798479+0000","last_peered":"2024-03-09T15:07:13.798479+0000","last_clean":"2024-03-09T15:07:13.798479+0000","last_became_active":"2024-03-09T14:29:03.672416+0000","last_became_peered":"2024-03-09T14:29:03.672416+0000","last_unstale":"2024-03-09T15:07:13.798479+0000","last_undegraded":"2024-03-09T15:07:13.798479+0000","last_fullsized":"2024-03-09T15:07:13.798479+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'150","last_scrub_stamp":"2024-03-09T15:07:13.798260+0000","last_deep_scrub":"264'150","last_deep_scrub_stamp":"2024-03-09T15:07:13.798260+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.798260+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:30:31.358279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":118,"num_read_kb":112,"num_write":348,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'860","reported_seq":2475,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.893656+0000","last_change":"2024-03-09T14:28:55.584166+0000","last_active":"2024-03-09T15:07:09.893656+0000","last_peered":"2024-03-09T15:07:09.893656+0000","last_clean":"2024-03-09T15:07:09.893656+0000","last_became_active":"2024-03-09T14:28:55.583618+0000","last_became_peered":"2024-03-09T14:28:55.583618+0000","last_unstale":"2024-03-09T15:07:09.893656+0000","last_undegraded":"2024-03-09T15:07:09.893656+0000","last_fullsized":"2024-03-09T15:07:09.893656+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":800,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4083,"num_read_kb":3643,"num_write":1199,"num_write_kb":506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'316","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.420805+0000","last_change":"2024-03-09T14:28:53.568437+0000","last_active":"2024-03-09T15:07:05.420805+0000","last_peered":"2024-03-09T15:07:05.420805+0000","last_clean":"2024-03-09T15:07:05.420805+0000","last_became_active":"2024-03-09T14:28:53.568002+0000","last_became_peered":"2024-03-09T14:28:53.568002+0000","last_unstale":"2024-03-09T15:07:05.420805+0000","last_undegraded":"2024-03-09T15:07:05.420805+0000","last_fullsized":"2024-03-09T15:07:05.420805+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":642,"num_read_kb":26434,"num_write":1119,"num_write_kb":51619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.264647+0000","last_change":"2024-03-09T14:28:57.616235+0000","last_active":"2024-03-09T15:07:11.264647+0000","last_peered":"2024-03-09T15:07:11.264647+0000","last_clean":"2024-03-09T15:07:11.264647+0000","last_became_active":"2024-03-09T14:28:57.615518+0000","last_became_peered":"2024-03-09T14:28:57.615518+0000","last_unstale":"2024-03-09T15:07:11.264647+0000","last_undegraded":"2024-03-09T15:07:11.264647+0000","last_fullsized":"2024-03-09T15:07:11.264647+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'366","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.533931+0000","last_change":"2024-03-09T15:07:24.534001+0000","last_active":"2024-03-09T15:07:24.533931+0000","last_peered":"2024-03-09T15:07:24.533931+0000","last_clean":"2024-03-09T15:07:24.533931+0000","last_became_active":"2024-03-09T14:28:59.607095+0000","last_became_peered":"2024-03-09T14:28:59.607095+0000","last_unstale":"2024-03-09T15:07:24.533931+0000","last_undegraded":"2024-03-09T15:07:24.533931+0000","last_fullsized":"2024-03-09T15:07:24.533931+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-03-09T15:07:24.533841+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-03-09T15:07:24.533841+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.533841+0000","objects_scrubbed":9,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:56:28.568205+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47607,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1194,"num_read_kb":1839,"num_write":1728,"num_write_kb":1610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":509628,"num_omap_keys":1178,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.241687+0000","last_change":"2024-03-09T15:07:19.241687+0000","last_active":"2024-03-09T15:07:19.241687+0000","last_peered":"2024-03-09T15:07:19.241687+0000","last_clean":"2024-03-09T15:07:19.241687+0000","last_became_active":"2024-03-09T14:29:01.649769+0000","last_became_peered":"2024-03-09T14:29:01.649769+0000","last_unstale":"2024-03-09T15:07:19.241687+0000","last_undegraded":"2024-03-09T15:07:19.241687+0000","last_fullsized":"2024-03-09T15:07:19.241687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:19.241439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:19.241439+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.241439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:46.292381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'143","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.002404+0000","last_change":"2024-03-09T15:07:17.002467+0000","last_active":"2024-03-09T15:07:17.002404+0000","last_peered":"2024-03-09T15:07:17.002404+0000","last_clean":"2024-03-09T15:07:17.002404+0000","last_became_active":"2024-03-09T14:29:03.678140+0000","last_became_peered":"2024-03-09T14:29:03.678140+0000","last_unstale":"2024-03-09T15:07:17.002404+0000","last_undegraded":"2024-03-09T15:07:17.002404+0000","last_fullsized":"2024-03-09T15:07:17.002404+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'143","last_scrub_stamp":"2024-03-09T15:07:17.002216+0000","last_deep_scrub":"264'143","last_deep_scrub_stamp":"2024-03-09T15:07:17.002216+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.002216+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:57.619898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":150,"num_write":332,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'1639","reported_seq":3309,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.731900+0000","last_change":"2024-03-09T14:28:55.597191+0000","last_active":"2024-03-09T15:06:34.731900+0000","last_peered":"2024-03-09T15:06:34.731900+0000","last_clean":"2024-03-09T15:06:34.731900+0000","last_became_active":"2024-03-09T14:28:55.596219+0000","last_became_peered":"2024-03-09T14:28:55.596219+0000","last_unstale":"2024-03-09T15:06:34.731900+0000","last_undegraded":"2024-03-09T15:06:34.731900+0000","last_fullsized":"2024-03-09T15:06:34.731900+0000","mapping_epoch":25,"log_start":"264'1600","ondisk_log_start":"264'1600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":1600,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6749,"num_read_kb":5786,"num_write":2314,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":670,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:49.745880+0000","last_change":"2024-03-09T14:28:36.802806+0000","last_active":"2024-03-09T15:06:49.745880+0000","last_peered":"2024-03-09T15:06:49.745880+0000","last_clean":"2024-03-09T15:06:49.745880+0000","last_became_active":"2024-03-09T14:28:36.802270+0000","last_became_peered":"2024-03-09T14:28:36.802270+0000","last_unstale":"2024-03-09T15:06:49.745880+0000","last_undegraded":"2024-03-09T15:06:49.745880+0000","last_fullsized":"2024-03-09T15:06:49.745880+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:35.777784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:35.777784+0000","last_clean_scrub_stamp":"2024-03-09T14:28:35.777784+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:14.914594+0000","last_change":"2024-03-09T14:28:41.842055+0000","last_active":"2024-03-09T15:06:14.914594+0000","last_peered":"2024-03-09T15:06:14.914594+0000","last_clean":"2024-03-09T15:06:14.914594+0000","last_became_active":"2024-03-09T14:28:41.841153+0000","last_became_peered":"2024-03-09T14:28:41.841153+0000","last_unstale":"2024-03-09T15:06:14.914594+0000","last_undegraded":"2024-03-09T15:06:14.914594+0000","last_fullsized":"2024-03-09T15:06:14.914594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'346","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.412982+0000","last_change":"2024-03-09T14:28:53.623164+0000","last_active":"2024-03-09T15:07:05.412982+0000","last_peered":"2024-03-09T15:07:05.412982+0000","last_clean":"2024-03-09T15:07:05.412982+0000","last_became_active":"2024-03-09T14:28:53.622700+0000","last_became_peered":"2024-03-09T14:28:53.622700+0000","last_unstale":"2024-03-09T15:07:05.412982+0000","last_undegraded":"2024-03-09T15:07:05.412982+0000","last_fullsized":"2024-03-09T15:07:05.412982+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":555,"num_read_kb":30203,"num_write":1261,"num_write_kb":35948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.740874+0000","last_change":"2024-03-09T14:28:57.607452+0000","last_active":"2024-03-09T15:06:29.740874+0000","last_peered":"2024-03-09T15:06:29.740874+0000","last_clean":"2024-03-09T15:06:29.740874+0000","last_became_active":"2024-03-09T14:28:57.606611+0000","last_became_peered":"2024-03-09T14:28:57.606611+0000","last_unstale":"2024-03-09T15:06:29.740874+0000","last_undegraded":"2024-03-09T15:06:29.740874+0000","last_fullsized":"2024-03-09T15:06:29.740874+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'696","reported_seq":1401,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.524465+0000","last_change":"2024-03-09T15:07:26.524638+0000","last_active":"2024-03-09T15:07:26.524465+0000","last_peered":"2024-03-09T15:07:26.524465+0000","last_clean":"2024-03-09T15:07:26.524465+0000","last_became_active":"2024-03-09T14:28:59.603722+0000","last_became_peered":"2024-03-09T14:28:59.603722+0000","last_unstale":"2024-03-09T15:07:26.524465+0000","last_undegraded":"2024-03-09T15:07:26.524465+0000","last_fullsized":"2024-03-09T15:07:26.524465+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'696","last_scrub_stamp":"2024-03-09T15:07:26.524181+0000","last_deep_scrub":"264'696","last_deep_scrub_stamp":"2024-03-09T15:07:26.524181+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.524181+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:03.721380+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140709,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1362,"num_read_kb":3109,"num_write":1278,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99738,"num_omap_keys":240,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:54.735333+0000","last_change":"2024-03-09T14:29:01.648470+0000","last_active":"2024-03-09T15:05:54.735333+0000","last_peered":"2024-03-09T15:05:54.735333+0000","last_clean":"2024-03-09T15:05:54.735333+0000","last_became_active":"2024-03-09T14:29:01.647958+0000","last_became_peered":"2024-03-09T14:29:01.647958+0000","last_unstale":"2024-03-09T15:05:54.735333+0000","last_undegraded":"2024-03-09T15:05:54.735333+0000","last_fullsized":"2024-03-09T15:05:54.735333+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'226","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:22.953442+0000","last_change":"2024-03-09T14:29:03.681803+0000","last_active":"2024-03-09T15:06:22.953442+0000","last_peered":"2024-03-09T15:06:22.953442+0000","last_clean":"2024-03-09T15:06:22.953442+0000","last_became_active":"2024-03-09T14:29:03.680962+0000","last_became_peered":"2024-03-09T14:29:03.680962+0000","last_unstale":"2024-03-09T15:06:22.953442+0000","last_undegraded":"2024-03-09T15:06:22.953442+0000","last_fullsized":"2024-03-09T15:06:22.953442+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":425,"num_read_kb":422,"num_write":485,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'387","reported_seq":1945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.458531+0000","last_change":"2024-03-09T14:28:55.575679+0000","last_active":"2024-03-09T15:06:42.458531+0000","last_peered":"2024-03-09T15:06:42.458531+0000","last_clean":"2024-03-09T15:06:42.458531+0000","last_became_active":"2024-03-09T14:28:55.575229+0000","last_became_peered":"2024-03-09T14:28:55.575229+0000","last_unstale":"2024-03-09T15:06:42.458531+0000","last_undegraded":"2024-03-09T15:06:42.458531+0000","last_fullsized":"2024-03-09T15:06:42.458531+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2264,"num_read_kb":2158,"num_write":447,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:54.747026+0000","last_change":"2024-03-09T14:28:41.839813+0000","last_active":"2024-03-09T15:06:54.747026+0000","last_peered":"2024-03-09T15:06:54.747026+0000","last_clean":"2024-03-09T15:06:54.747026+0000","last_became_active":"2024-03-09T14:28:41.838669+0000","last_became_peered":"2024-03-09T14:28:41.838669+0000","last_unstale":"2024-03-09T15:06:54.747026+0000","last_undegraded":"2024-03-09T15:06:54.747026+0000","last_fullsized":"2024-03-09T15:06:54.747026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'309","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.387394+0000","last_change":"2024-03-09T14:28:53.587759+0000","last_active":"2024-03-09T15:07:05.387394+0000","last_peered":"2024-03-09T15:07:05.387394+0000","last_clean":"2024-03-09T15:07:05.387394+0000","last_became_active":"2024-03-09T14:28:53.587201+0000","last_became_peered":"2024-03-09T14:28:53.587201+0000","last_unstale":"2024-03-09T15:07:05.387394+0000","last_undegraded":"2024-03-09T15:07:05.387394+0000","last_fullsized":"2024-03-09T15:07:05.387394+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245344,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":38281,"num_write":1125,"num_write_kb":47895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:49.909149+0000","last_change":"2024-03-09T14:28:57.613708+0000","last_active":"2024-03-09T15:05:49.909149+0000","last_peered":"2024-03-09T15:05:49.909149+0000","last_clean":"2024-03-09T15:05:49.909149+0000","last_became_active":"2024-03-09T14:28:57.612854+0000","last_became_peered":"2024-03-09T14:28:57.612854+0000","last_unstale":"2024-03-09T15:05:49.909149+0000","last_undegraded":"2024-03-09T15:05:49.909149+0000","last_fullsized":"2024-03-09T15:05:49.909149+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1083","reported_seq":2405,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.896179+0000","last_change":"2024-03-09T15:07:29.896270+0000","last_active":"2024-03-09T15:07:29.896179+0000","last_peered":"2024-03-09T15:07:29.896179+0000","last_clean":"2024-03-09T15:07:29.896179+0000","last_became_active":"2024-03-09T14:28:59.599819+0000","last_became_peered":"2024-03-09T14:28:59.599819+0000","last_unstale":"2024-03-09T15:07:29.896179+0000","last_undegraded":"2024-03-09T15:07:29.896179+0000","last_fullsized":"2024-03-09T15:07:29.896179+0000","mapping_epoch":29,"log_start":"264'1000","ondisk_log_start":"264'1000","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1083","last_scrub_stamp":"2024-03-09T15:07:29.895998+0000","last_deep_scrub":"264'1083","last_deep_scrub_stamp":"2024-03-09T15:07:29.895998+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.895998+0000","objects_scrubbed":11,"log_size":83,"log_dups_size":1000,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:45:02.942611+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132519,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1702,"num_read_kb":3355,"num_write":1050,"num_write_kb":895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:44.744890+0000","last_change":"2024-03-09T14:29:01.628141+0000","last_active":"2024-03-09T15:06:44.744890+0000","last_peered":"2024-03-09T15:06:44.744890+0000","last_clean":"2024-03-09T15:06:44.744890+0000","last_became_active":"2024-03-09T14:29:01.626582+0000","last_became_peered":"2024-03-09T14:29:01.626582+0000","last_unstale":"2024-03-09T15:06:44.744890+0000","last_undegraded":"2024-03-09T15:06:44.744890+0000","last_fullsized":"2024-03-09T15:06:44.744890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'110","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.925863+0000","last_change":"2024-03-09T15:07:18.925928+0000","last_active":"2024-03-09T15:07:18.925863+0000","last_peered":"2024-03-09T15:07:18.925863+0000","last_clean":"2024-03-09T15:07:18.925863+0000","last_became_active":"2024-03-09T14:29:03.659633+0000","last_became_peered":"2024-03-09T14:29:03.659633+0000","last_unstale":"2024-03-09T15:07:18.925863+0000","last_undegraded":"2024-03-09T15:07:18.925863+0000","last_fullsized":"2024-03-09T15:07:18.925863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-03-09T15:07:18.925667+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-03-09T15:07:18.925667+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.925667+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:44:07.120542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":112,"num_read_kb":106,"num_write":262,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'373","reported_seq":1947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.864669+0000","last_change":"2024-03-09T15:07:26.864736+0000","last_active":"2024-03-09T15:07:26.864669+0000","last_peered":"2024-03-09T15:07:26.864669+0000","last_clean":"2024-03-09T15:07:26.864669+0000","last_became_active":"2024-03-09T14:28:55.584347+0000","last_became_peered":"2024-03-09T14:28:55.584347+0000","last_unstale":"2024-03-09T15:07:26.864669+0000","last_undegraded":"2024-03-09T15:07:26.864669+0000","last_fullsized":"2024-03-09T15:07:26.864669+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-03-09T15:07:26.864470+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-03-09T15:07:26.864470+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.864470+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:25:03.787698+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2124,"num_read_kb":2043,"num_write":421,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.462815+0000","last_change":"2024-03-09T15:07:27.462867+0000","last_active":"2024-03-09T15:07:27.462815+0000","last_peered":"2024-03-09T15:07:27.462815+0000","last_clean":"2024-03-09T15:07:27.462815+0000","last_became_active":"2024-03-09T14:28:41.836544+0000","last_became_peered":"2024-03-09T14:28:41.836544+0000","last_unstale":"2024-03-09T15:07:27.462815+0000","last_undegraded":"2024-03-09T15:07:27.462815+0000","last_fullsized":"2024-03-09T15:07:27.462815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:27.462629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:27.462629+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.462629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:59.961585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'334","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.396560+0000","last_change":"2024-03-09T14:28:53.626870+0000","last_active":"2024-03-09T15:07:05.396560+0000","last_peered":"2024-03-09T15:07:05.396560+0000","last_clean":"2024-03-09T15:07:05.396560+0000","last_became_active":"2024-03-09T14:28:53.626472+0000","last_became_peered":"2024-03-09T14:28:53.626472+0000","last_unstale":"2024-03-09T15:07:05.396560+0000","last_undegraded":"2024-03-09T15:07:05.396560+0000","last_fullsized":"2024-03-09T15:07:05.396560+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":555,"num_read_kb":1460,"num_write":1312,"num_write_kb":27243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.547163+0000","last_change":"2024-03-09T15:07:22.547225+0000","last_active":"2024-03-09T15:07:22.547163+0000","last_peered":"2024-03-09T15:07:22.547163+0000","last_clean":"2024-03-09T15:07:22.547163+0000","last_became_active":"2024-03-09T14:28:57.609908+0000","last_became_peered":"2024-03-09T14:28:57.609908+0000","last_unstale":"2024-03-09T15:07:22.547163+0000","last_undegraded":"2024-03-09T15:07:22.547163+0000","last_fullsized":"2024-03-09T15:07:22.547163+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:22.546969+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:22.546969+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.546969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:51:05.917154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'225","reported_seq":1220,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.690515+0000","last_change":"2024-03-09T14:28:59.628581+0000","last_active":"2024-03-09T15:06:55.690515+0000","last_peered":"2024-03-09T15:06:55.690515+0000","last_clean":"2024-03-09T15:06:55.690515+0000","last_became_active":"2024-03-09T14:28:59.627810+0000","last_became_peered":"2024-03-09T14:28:59.627810+0000","last_unstale":"2024-03-09T15:06:55.690515+0000","last_undegraded":"2024-03-09T15:06:55.690515+0000","last_fullsized":"2024-03-09T15:06:55.690515+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":165,"num_read_kb":157,"num_write":151,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.745107+0000","last_change":"2024-03-09T14:29:01.647816+0000","last_active":"2024-03-09T15:06:34.745107+0000","last_peered":"2024-03-09T15:06:34.745107+0000","last_clean":"2024-03-09T15:06:34.745107+0000","last_became_active":"2024-03-09T14:29:01.647228+0000","last_became_peered":"2024-03-09T14:29:01.647228+0000","last_unstale":"2024-03-09T15:06:34.745107+0000","last_undegraded":"2024-03-09T15:06:34.745107+0000","last_fullsized":"2024-03-09T15:06:34.745107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'252","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.987315+0000","last_change":"2024-03-09T15:07:28.987395+0000","last_active":"2024-03-09T15:07:28.987315+0000","last_peered":"2024-03-09T15:07:28.987315+0000","last_clean":"2024-03-09T15:07:28.987315+0000","last_became_active":"2024-03-09T14:29:03.654872+0000","last_became_peered":"2024-03-09T14:29:03.654872+0000","last_unstale":"2024-03-09T15:07:28.987315+0000","last_undegraded":"2024-03-09T15:07:28.987315+0000","last_fullsized":"2024-03-09T15:07:28.987315+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'252","last_scrub_stamp":"2024-03-09T15:07:28.987137+0000","last_deep_scrub":"264'252","last_deep_scrub_stamp":"2024-03-09T15:07:28.987137+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.987137+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:25:09.761733+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":497,"num_write":533,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'463","reported_seq":2015,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.397215+0000","last_change":"2024-03-09T14:28:55.578525+0000","last_active":"2024-03-09T15:06:38.397215+0000","last_peered":"2024-03-09T15:06:38.397215+0000","last_clean":"2024-03-09T15:06:38.397215+0000","last_became_active":"2024-03-09T14:28:55.577946+0000","last_became_peered":"2024-03-09T14:28:55.577946+0000","last_unstale":"2024-03-09T15:06:38.397215+0000","last_undegraded":"2024-03-09T15:06:38.397215+0000","last_fullsized":"2024-03-09T15:06:38.397215+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2440,"num_read_kb":2271,"num_write":585,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:14.914551+0000","last_change":"2024-03-09T14:28:41.843028+0000","last_active":"2024-03-09T15:06:14.914551+0000","last_peered":"2024-03-09T15:06:14.914551+0000","last_clean":"2024-03-09T15:06:14.914551+0000","last_became_active":"2024-03-09T14:28:41.842251+0000","last_became_peered":"2024-03-09T14:28:41.842251+0000","last_unstale":"2024-03-09T15:06:14.914551+0000","last_undegraded":"2024-03-09T15:06:14.914551+0000","last_fullsized":"2024-03-09T15:06:14.914551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'329","reported_seq":980,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.307632+0000","last_change":"2024-03-09T14:28:53.622441+0000","last_active":"2024-03-09T15:07:05.307632+0000","last_peered":"2024-03-09T15:07:05.307632+0000","last_clean":"2024-03-09T15:07:05.307632+0000","last_became_active":"2024-03-09T14:28:53.621914+0000","last_became_peered":"2024-03-09T14:28:53.621914+0000","last_unstale":"2024-03-09T15:07:05.307632+0000","last_undegraded":"2024-03-09T15:07:05.307632+0000","last_fullsized":"2024-03-09T15:07:05.307632+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1292088,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":22951,"num_write":1137,"num_write_kb":34708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.745146+0000","last_change":"2024-03-09T14:28:57.613906+0000","last_active":"2024-03-09T15:06:34.745146+0000","last_peered":"2024-03-09T15:06:34.745146+0000","last_clean":"2024-03-09T15:06:34.745146+0000","last_became_active":"2024-03-09T14:28:57.613407+0000","last_became_peered":"2024-03-09T14:28:57.613407+0000","last_unstale":"2024-03-09T15:06:34.745146+0000","last_undegraded":"2024-03-09T15:06:34.745146+0000","last_fullsized":"2024-03-09T15:06:34.745146+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'110","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.645329+0000","last_change":"2024-03-09T14:28:59.619709+0000","last_active":"2024-03-09T15:06:29.645329+0000","last_peered":"2024-03-09T15:06:29.645329+0000","last_clean":"2024-03-09T15:06:29.645329+0000","last_became_active":"2024-03-09T14:28:59.619291+0000","last_became_peered":"2024-03-09T14:28:59.619291+0000","last_unstale":"2024-03-09T15:06:29.645329+0000","last_undegraded":"2024-03-09T15:06:29.645329+0000","last_fullsized":"2024-03-09T15:06:29.645329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":110,"num_write":80,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.267499+0000","last_change":"2024-03-09T15:07:29.267550+0000","last_active":"2024-03-09T15:07:29.267499+0000","last_peered":"2024-03-09T15:07:29.267499+0000","last_clean":"2024-03-09T15:07:29.267499+0000","last_became_active":"2024-03-09T14:29:01.656672+0000","last_became_peered":"2024-03-09T14:29:01.656672+0000","last_unstale":"2024-03-09T15:07:29.267499+0000","last_undegraded":"2024-03-09T15:07:29.267499+0000","last_fullsized":"2024-03-09T15:07:29.267499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:29.267314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:29.267314+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.267314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:32:52.363075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'104","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.524886+0000","last_change":"2024-03-09T15:07:16.524946+0000","last_active":"2024-03-09T15:07:16.524886+0000","last_peered":"2024-03-09T15:07:16.524886+0000","last_clean":"2024-03-09T15:07:16.524886+0000","last_became_active":"2024-03-09T14:29:03.672534+0000","last_became_peered":"2024-03-09T14:29:03.672534+0000","last_unstale":"2024-03-09T15:07:16.524886+0000","last_undegraded":"2024-03-09T15:07:16.524886+0000","last_fullsized":"2024-03-09T15:07:16.524886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'104","last_scrub_stamp":"2024-03-09T15:07:16.524692+0000","last_deep_scrub":"264'104","last_deep_scrub_stamp":"2024-03-09T15:07:16.524692+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.524692+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:15:41.281947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":109,"num_write":236,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'464","reported_seq":2141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.862776+0000","last_change":"2024-03-09T15:07:28.862841+0000","last_active":"2024-03-09T15:07:28.862776+0000","last_peered":"2024-03-09T15:07:28.862776+0000","last_clean":"2024-03-09T15:07:28.862776+0000","last_became_active":"2024-03-09T14:28:55.583536+0000","last_became_peered":"2024-03-09T14:28:55.583536+0000","last_unstale":"2024-03-09T15:07:28.862776+0000","last_undegraded":"2024-03-09T15:07:28.862776+0000","last_fullsized":"2024-03-09T15:07:28.862776+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'464","last_scrub_stamp":"2024-03-09T15:07:28.862584+0000","last_deep_scrub":"264'464","last_deep_scrub_stamp":"2024-03-09T15:07:28.862584+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.862584+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:42:09.282270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2714,"num_read_kb":2554,"num_write":561,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'357","reported_seq":986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.407644+0000","last_change":"2024-03-09T14:28:53.629100+0000","last_active":"2024-03-09T15:07:05.407644+0000","last_peered":"2024-03-09T15:07:05.407644+0000","last_clean":"2024-03-09T15:07:05.407644+0000","last_became_active":"2024-03-09T14:28:53.626879+0000","last_became_peered":"2024-03-09T14:28:53.626879+0000","last_unstale":"2024-03-09T15:07:05.407644+0000","last_undegraded":"2024-03-09T15:07:05.407644+0000","last_fullsized":"2024-03-09T15:07:05.407644+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8554715,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":520,"num_read_kb":4755,"num_write":1359,"num_write_kb":47511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":518,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:15.092851+0000","last_change":"2024-03-09T14:28:42.127635+0000","last_active":"2024-03-09T15:06:15.092851+0000","last_peered":"2024-03-09T15:06:15.092851+0000","last_clean":"2024-03-09T15:06:15.092851+0000","last_became_active":"2024-03-09T14:28:42.126799+0000","last_became_peered":"2024-03-09T14:28:42.126799+0000","last_unstale":"2024-03-09T15:06:15.092851+0000","last_undegraded":"2024-03-09T15:06:15.092851+0000","last_fullsized":"2024-03-09T15:06:15.092851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.743519+0000","last_change":"2024-03-09T14:28:57.609247+0000","last_active":"2024-03-09T15:06:29.743519+0000","last_peered":"2024-03-09T15:06:29.743519+0000","last_clean":"2024-03-09T15:06:29.743519+0000","last_became_active":"2024-03-09T14:28:57.608723+0000","last_became_peered":"2024-03-09T14:28:57.608723+0000","last_unstale":"2024-03-09T15:06:29.743519+0000","last_undegraded":"2024-03-09T15:06:29.743519+0000","last_fullsized":"2024-03-09T15:06:29.743519+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'530","reported_seq":1180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.889991+0000","last_change":"2024-03-09T14:28:59.625137+0000","last_active":"2024-03-09T15:07:04.889991+0000","last_peered":"2024-03-09T15:07:04.889991+0000","last_clean":"2024-03-09T15:07:04.889991+0000","last_became_active":"2024-03-09T14:28:59.624680+0000","last_became_peered":"2024-03-09T14:28:59.624680+0000","last_unstale":"2024-03-09T15:07:04.889991+0000","last_undegraded":"2024-03-09T15:07:04.889991+0000","last_fullsized":"2024-03-09T15:07:04.889991+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87910,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":952,"num_read_kb":2224,"num_write":784,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.713529+0000","last_change":"2024-03-09T15:07:21.713581+0000","last_active":"2024-03-09T15:07:21.713529+0000","last_peered":"2024-03-09T15:07:21.713529+0000","last_clean":"2024-03-09T15:07:21.713529+0000","last_became_active":"2024-03-09T14:29:01.640485+0000","last_became_peered":"2024-03-09T14:29:01.640485+0000","last_unstale":"2024-03-09T15:07:21.713529+0000","last_undegraded":"2024-03-09T15:07:21.713529+0000","last_fullsized":"2024-03-09T15:07:21.713529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:21.713332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:21.713332+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.713332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:28:08.038103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'144","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.644986+0000","last_change":"2024-03-09T15:07:25.645062+0000","last_active":"2024-03-09T15:07:25.644986+0000","last_peered":"2024-03-09T15:07:25.644986+0000","last_clean":"2024-03-09T15:07:25.644986+0000","last_became_active":"2024-03-09T14:29:03.676032+0000","last_became_peered":"2024-03-09T14:29:03.676032+0000","last_unstale":"2024-03-09T15:07:25.644986+0000","last_undegraded":"2024-03-09T15:07:25.644986+0000","last_fullsized":"2024-03-09T15:07:25.644986+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-03-09T15:07:25.644805+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-03-09T15:07:25.644805+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.644805+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:18.054345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":195,"num_read_kb":176,"num_write":349,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'352","reported_seq":1745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.458885+0000","last_change":"2024-03-09T14:28:55.583629+0000","last_active":"2024-03-09T15:06:42.458885+0000","last_peered":"2024-03-09T15:06:42.458885+0000","last_clean":"2024-03-09T15:06:42.458885+0000","last_became_active":"2024-03-09T14:28:55.582743+0000","last_became_peered":"2024-03-09T14:28:55.582743+0000","last_unstale":"2024-03-09T15:06:42.458885+0000","last_undegraded":"2024-03-09T15:06:42.458885+0000","last_fullsized":"2024-03-09T15:06:42.458885+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1869,"num_read_kb":1781,"num_write":409,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'326","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.421281+0000","last_change":"2024-03-09T14:28:53.590149+0000","last_active":"2024-03-09T15:07:05.421281+0000","last_peered":"2024-03-09T15:07:05.421281+0000","last_clean":"2024-03-09T15:07:05.421281+0000","last_became_active":"2024-03-09T14:28:53.589640+0000","last_became_peered":"2024-03-09T14:28:53.589640+0000","last_unstale":"2024-03-09T15:07:05.421281+0000","last_undegraded":"2024-03-09T15:07:05.421281+0000","last_fullsized":"2024-03-09T15:07:05.421281+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048928,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":38844,"num_write":1128,"num_write_kb":48736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.739348+0000","last_change":"2024-03-09T14:28:42.127115+0000","last_active":"2024-03-09T15:06:24.739348+0000","last_peered":"2024-03-09T15:06:24.739348+0000","last_clean":"2024-03-09T15:06:24.739348+0000","last_became_active":"2024-03-09T14:28:42.126201+0000","last_became_peered":"2024-03-09T14:28:42.126201+0000","last_unstale":"2024-03-09T15:06:24.739348+0000","last_undegraded":"2024-03-09T15:06:24.739348+0000","last_fullsized":"2024-03-09T15:06:24.739348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.254102+0000","last_change":"2024-03-09T15:07:24.254156+0000","last_active":"2024-03-09T15:07:24.254102+0000","last_peered":"2024-03-09T15:07:24.254102+0000","last_clean":"2024-03-09T15:07:24.254102+0000","last_became_active":"2024-03-09T14:28:57.606429+0000","last_became_peered":"2024-03-09T14:28:57.606429+0000","last_unstale":"2024-03-09T15:07:24.254102+0000","last_undegraded":"2024-03-09T15:07:24.254102+0000","last_fullsized":"2024-03-09T15:07:24.254102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:24.253912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:24.253912+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.253912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:22.015872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'174","reported_seq":728,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.691928+0000","last_change":"2024-03-09T14:28:59.627298+0000","last_active":"2024-03-09T15:06:55.691928+0000","last_peered":"2024-03-09T15:06:55.691928+0000","last_clean":"2024-03-09T15:06:55.691928+0000","last_became_active":"2024-03-09T14:28:59.626697+0000","last_became_peered":"2024-03-09T14:28:59.626697+0000","last_unstale":"2024-03-09T15:06:55.691928+0000","last_undegraded":"2024-03-09T15:06:55.691928+0000","last_fullsized":"2024-03-09T15:06:55.691928+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":207,"num_read_kb":198,"num_write":186,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'565","reported_seq":2150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.440280+0000","last_change":"2024-03-09T15:07:22.440344+0000","last_active":"2024-03-09T15:07:22.440280+0000","last_peered":"2024-03-09T15:07:22.440280+0000","last_clean":"2024-03-09T15:07:22.440280+0000","last_became_active":"2024-03-09T14:29:01.636912+0000","last_became_peered":"2024-03-09T14:29:01.636912+0000","last_unstale":"2024-03-09T15:07:22.440280+0000","last_undegraded":"2024-03-09T15:07:22.440280+0000","last_fullsized":"2024-03-09T15:07:22.440280+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'565","last_scrub_stamp":"2024-03-09T15:07:22.440085+0000","last_deep_scrub":"264'565","last_deep_scrub_stamp":"2024-03-09T15:07:22.440085+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.440085+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:53.676606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'97","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.003413+0000","last_change":"2024-03-09T15:07:25.003480+0000","last_active":"2024-03-09T15:07:25.003413+0000","last_peered":"2024-03-09T15:07:25.003413+0000","last_clean":"2024-03-09T15:07:25.003413+0000","last_became_active":"2024-03-09T14:29:03.664665+0000","last_became_peered":"2024-03-09T14:29:03.664665+0000","last_unstale":"2024-03-09T15:07:25.003413+0000","last_undegraded":"2024-03-09T15:07:25.003413+0000","last_fullsized":"2024-03-09T15:07:25.003413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-03-09T15:07:25.003215+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-03-09T15:07:25.003215+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.003215+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:36:56.787006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":223,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'343","reported_seq":1826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:59.981398+0000","last_change":"2024-03-09T14:28:55.603920+0000","last_active":"2024-03-09T15:06:59.981398+0000","last_peered":"2024-03-09T15:06:59.981398+0000","last_clean":"2024-03-09T15:06:59.981398+0000","last_became_active":"2024-03-09T14:28:55.601355+0000","last_became_peered":"2024-03-09T14:28:55.601355+0000","last_unstale":"2024-03-09T15:06:59.981398+0000","last_undegraded":"2024-03-09T15:06:59.981398+0000","last_fullsized":"2024-03-09T15:06:59.981398+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1977,"num_read_kb":1906,"num_write":384,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'330","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.371597+0000","last_change":"2024-03-09T14:28:53.585247+0000","last_active":"2024-03-09T15:07:05.371597+0000","last_peered":"2024-03-09T15:07:05.371597+0000","last_clean":"2024-03-09T15:07:05.371597+0000","last_became_active":"2024-03-09T14:28:53.584728+0000","last_became_peered":"2024-03-09T14:28:53.584728+0000","last_unstale":"2024-03-09T15:07:05.371597+0000","last_undegraded":"2024-03-09T15:07:05.371597+0000","last_fullsized":"2024-03-09T15:07:05.371597+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918035,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":514,"num_read_kb":33595,"num_write":1176,"num_write_kb":22083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:30.081851+0000","last_change":"2024-03-09T14:28:41.840785+0000","last_active":"2024-03-09T15:05:30.081851+0000","last_peered":"2024-03-09T15:05:30.081851+0000","last_clean":"2024-03-09T15:05:30.081851+0000","last_became_active":"2024-03-09T14:28:41.840168+0000","last_became_peered":"2024-03-09T14:28:41.840168+0000","last_unstale":"2024-03-09T15:05:30.081851+0000","last_undegraded":"2024-03-09T15:05:30.081851+0000","last_fullsized":"2024-03-09T15:05:30.081851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"35'5","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.023888+0000","last_change":"2024-03-09T14:28:57.613265+0000","last_active":"2024-03-09T15:07:02.023888+0000","last_peered":"2024-03-09T15:07:02.023888+0000","last_clean":"2024-03-09T15:07:02.023888+0000","last_became_active":"2024-03-09T14:28:57.610373+0000","last_became_peered":"2024-03-09T14:28:57.610373+0000","last_unstale":"2024-03-09T15:07:02.023888+0000","last_undegraded":"2024-03-09T15:07:02.023888+0000","last_fullsized":"2024-03-09T15:07:02.023888+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":492,"num_read_kb":799,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'107","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.768275+0000","last_change":"2024-03-09T15:07:25.768414+0000","last_active":"2024-03-09T15:07:25.768275+0000","last_peered":"2024-03-09T15:07:25.768275+0000","last_clean":"2024-03-09T15:07:25.768275+0000","last_became_active":"2024-03-09T14:28:59.615084+0000","last_became_peered":"2024-03-09T14:28:59.615084+0000","last_unstale":"2024-03-09T15:07:25.768275+0000","last_undegraded":"2024-03-09T15:07:25.768275+0000","last_fullsized":"2024-03-09T15:07:25.768275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-03-09T15:07:25.767984+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-03-09T15:07:25.767984+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.767984+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:01:01.855185+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":100,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'584","reported_seq":2176,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.433974+0000","last_change":"2024-03-09T14:29:01.631333+0000","last_active":"2024-03-09T15:07:05.433974+0000","last_peered":"2024-03-09T15:07:05.433974+0000","last_clean":"2024-03-09T15:07:05.433974+0000","last_became_active":"2024-03-09T14:29:01.630598+0000","last_became_peered":"2024-03-09T14:29:01.630598+0000","last_unstale":"2024-03-09T15:07:05.433974+0000","last_undegraded":"2024-03-09T15:07:05.433974+0000","last_fullsized":"2024-03-09T15:07:05.433974+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'232","reported_seq":734,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.646284+0000","last_change":"2024-03-09T15:07:21.646416+0000","last_active":"2024-03-09T15:07:21.646284+0000","last_peered":"2024-03-09T15:07:21.646284+0000","last_clean":"2024-03-09T15:07:21.646284+0000","last_became_active":"2024-03-09T14:29:03.684294+0000","last_became_peered":"2024-03-09T14:29:03.684294+0000","last_unstale":"2024-03-09T15:07:21.646284+0000","last_undegraded":"2024-03-09T15:07:21.646284+0000","last_fullsized":"2024-03-09T15:07:21.646284+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'232","last_scrub_stamp":"2024-03-09T15:07:21.646037+0000","last_deep_scrub":"264'232","last_deep_scrub_stamp":"2024-03-09T15:07:21.646037+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.646037+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:01.441895+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":199,"num_write":480,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'364","reported_seq":2034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.935851+0000","last_change":"2024-03-09T14:28:55.569425+0000","last_active":"2024-03-09T15:06:39.935851+0000","last_peered":"2024-03-09T15:06:39.935851+0000","last_clean":"2024-03-09T15:06:39.935851+0000","last_became_active":"2024-03-09T14:28:55.568430+0000","last_became_peered":"2024-03-09T14:28:55.568430+0000","last_unstale":"2024-03-09T15:06:39.935851+0000","last_undegraded":"2024-03-09T15:06:39.935851+0000","last_fullsized":"2024-03-09T15:06:39.935851+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2357,"num_read_kb":2282,"num_write":412,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'367","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.344429+0000","last_change":"2024-03-09T14:28:53.589944+0000","last_active":"2024-03-09T15:07:05.344429+0000","last_peered":"2024-03-09T15:07:05.344429+0000","last_clean":"2024-03-09T15:07:05.344429+0000","last_became_active":"2024-03-09T14:28:53.589491+0000","last_became_peered":"2024-03-09T14:28:53.589491+0000","last_unstale":"2024-03-09T15:07:05.344429+0000","last_undegraded":"2024-03-09T15:07:05.344429+0000","last_fullsized":"2024-03-09T15:07:05.344429+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12403936,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":473,"num_read_kb":37359,"num_write":1237,"num_write_kb":47489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":510,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:34.718380+0000","last_change":"2024-03-09T14:28:41.841410+0000","last_active":"2024-03-09T15:05:34.718380+0000","last_peered":"2024-03-09T15:05:34.718380+0000","last_clean":"2024-03-09T15:05:34.718380+0000","last_became_active":"2024-03-09T14:28:41.840575+0000","last_became_peered":"2024-03-09T14:28:41.840575+0000","last_unstale":"2024-03-09T15:05:34.718380+0000","last_undegraded":"2024-03-09T15:05:34.718380+0000","last_fullsized":"2024-03-09T15:05:34.718380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"35'3","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.982711+0000","last_change":"2024-03-09T14:28:57.605420+0000","last_active":"2024-03-09T15:07:04.982711+0000","last_peered":"2024-03-09T15:07:04.982711+0000","last_clean":"2024-03-09T15:07:04.982711+0000","last_became_active":"2024-03-09T14:28:57.604511+0000","last_became_peered":"2024-03-09T14:28:57.604511+0000","last_unstale":"2024-03-09T15:07:04.982711+0000","last_undegraded":"2024-03-09T15:07:04.982711+0000","last_fullsized":"2024-03-09T15:07:04.982711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":488,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'682","reported_seq":1391,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.133358+0000","last_change":"2024-03-09T14:28:59.630805+0000","last_active":"2024-03-09T15:07:05.133358+0000","last_peered":"2024-03-09T15:07:05.133358+0000","last_clean":"2024-03-09T15:07:05.133358+0000","last_became_active":"2024-03-09T14:28:59.630044+0000","last_became_peered":"2024-03-09T14:28:59.630044+0000","last_unstale":"2024-03-09T15:07:05.133358+0000","last_undegraded":"2024-03-09T15:07:05.133358+0000","last_fullsized":"2024-03-09T15:07:05.133358+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":600,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140779,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1221,"num_read_kb":2881,"num_write":988,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.943368+0000","last_change":"2024-03-09T15:07:29.943408+0000","last_active":"2024-03-09T15:07:29.943368+0000","last_peered":"2024-03-09T15:07:29.943368+0000","last_clean":"2024-03-09T15:07:29.943368+0000","last_became_active":"2024-03-09T14:29:01.638590+0000","last_became_peered":"2024-03-09T14:29:01.638590+0000","last_unstale":"2024-03-09T15:07:29.943368+0000","last_undegraded":"2024-03-09T15:07:29.943368+0000","last_fullsized":"2024-03-09T15:07:29.943368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:29.943233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:29.943233+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.943233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:27.603634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'124","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.492955+0000","last_change":"2024-03-09T15:07:18.492955+0000","last_active":"2024-03-09T15:07:18.492955+0000","last_peered":"2024-03-09T15:07:18.492955+0000","last_clean":"2024-03-09T15:07:18.492955+0000","last_became_active":"2024-03-09T14:29:03.671138+0000","last_became_peered":"2024-03-09T14:29:03.671138+0000","last_unstale":"2024-03-09T15:07:18.492955+0000","last_undegraded":"2024-03-09T15:07:18.492955+0000","last_fullsized":"2024-03-09T15:07:18.492955+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:18.492696+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:18.492696+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.492696+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:49.039401+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":309,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'134","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.600532+0000","last_change":"2024-03-09T15:07:22.600598+0000","last_active":"2024-03-09T15:07:22.600532+0000","last_peered":"2024-03-09T15:07:22.600532+0000","last_clean":"2024-03-09T15:07:22.600532+0000","last_became_active":"2024-03-09T14:29:03.681920+0000","last_became_peered":"2024-03-09T14:29:03.681920+0000","last_unstale":"2024-03-09T15:07:22.600532+0000","last_undegraded":"2024-03-09T15:07:22.600532+0000","last_fullsized":"2024-03-09T15:07:22.600532+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-03-09T15:07:22.600362+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-03-09T15:07:22.600362+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.600362+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:36:58.000733+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":222,"num_write":331,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'713","reported_seq":2211,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.497794+0000","last_change":"2024-03-09T14:28:55.590020+0000","last_active":"2024-03-09T15:06:53.497794+0000","last_peered":"2024-03-09T15:06:53.497794+0000","last_clean":"2024-03-09T15:06:53.497794+0000","last_became_active":"2024-03-09T14:28:55.589278+0000","last_became_peered":"2024-03-09T14:28:55.589278+0000","last_unstale":"2024-03-09T15:06:53.497794+0000","last_undegraded":"2024-03-09T15:06:53.497794+0000","last_fullsized":"2024-03-09T15:06:53.497794+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":700,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3302,"num_read_kb":2973,"num_write":944,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'315","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.401299+0000","last_change":"2024-03-09T14:28:53.624761+0000","last_active":"2024-03-09T15:07:05.401299+0000","last_peered":"2024-03-09T15:07:05.401299+0000","last_clean":"2024-03-09T15:07:05.401299+0000","last_became_active":"2024-03-09T14:28:53.624231+0000","last_became_peered":"2024-03-09T14:28:53.624231+0000","last_unstale":"2024-03-09T15:07:05.401299+0000","last_undegraded":"2024-03-09T15:07:05.401299+0000","last_fullsized":"2024-03-09T15:07:05.401299+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":535,"num_read_kb":58598,"num_write":1161,"num_write_kb":63743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.820780+0000","last_change":"2024-03-09T15:07:25.820832+0000","last_active":"2024-03-09T15:07:25.820780+0000","last_peered":"2024-03-09T15:07:25.820780+0000","last_clean":"2024-03-09T15:07:25.820780+0000","last_became_active":"2024-03-09T14:28:57.616045+0000","last_became_peered":"2024-03-09T14:28:57.616045+0000","last_unstale":"2024-03-09T15:07:25.820780+0000","last_undegraded":"2024-03-09T15:07:25.820780+0000","last_fullsized":"2024-03-09T15:07:25.820780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:25.820588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:25.820588+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.820588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:45:34.309358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'251","reported_seq":814,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:02.837648+0000","last_change":"2024-03-09T14:28:59.615640+0000","last_active":"2024-03-09T15:07:02.837648+0000","last_peered":"2024-03-09T15:07:02.837648+0000","last_clean":"2024-03-09T15:07:02.837648+0000","last_became_active":"2024-03-09T14:28:59.615265+0000","last_became_peered":"2024-03-09T14:28:59.615265+0000","last_unstale":"2024-03-09T15:07:02.837648+0000","last_undegraded":"2024-03-09T15:07:02.837648+0000","last_fullsized":"2024-03-09T15:07:02.837648+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41654,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":398,"num_read_kb":895,"num_write":318,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.973692+0000","last_change":"2024-03-09T14:29:01.630945+0000","last_active":"2024-03-09T15:06:24.973692+0000","last_peered":"2024-03-09T15:06:24.973692+0000","last_clean":"2024-03-09T15:06:24.973692+0000","last_became_active":"2024-03-09T14:29:01.630021+0000","last_became_peered":"2024-03-09T14:29:01.630021+0000","last_unstale":"2024-03-09T15:06:24.973692+0000","last_undegraded":"2024-03-09T15:06:24.973692+0000","last_fullsized":"2024-03-09T15:06:24.973692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'124","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.936675+0000","last_change":"2024-03-09T15:07:27.936739+0000","last_active":"2024-03-09T15:07:27.936675+0000","last_peered":"2024-03-09T15:07:27.936675+0000","last_clean":"2024-03-09T15:07:27.936675+0000","last_became_active":"2024-03-09T14:29:03.660356+0000","last_became_peered":"2024-03-09T14:29:03.660356+0000","last_unstale":"2024-03-09T15:07:27.936675+0000","last_undegraded":"2024-03-09T15:07:27.936675+0000","last_fullsized":"2024-03-09T15:07:27.936675+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:27.936481+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:27.936481+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.936481+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:22:37.729626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'836","reported_seq":2453,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.874067+0000","last_change":"2024-03-09T15:07:22.874136+0000","last_active":"2024-03-09T15:07:22.874067+0000","last_peered":"2024-03-09T15:07:22.874067+0000","last_clean":"2024-03-09T15:07:22.874067+0000","last_became_active":"2024-03-09T14:28:55.591498+0000","last_became_peered":"2024-03-09T14:28:55.591498+0000","last_unstale":"2024-03-09T15:07:22.874067+0000","last_undegraded":"2024-03-09T15:07:22.874067+0000","last_fullsized":"2024-03-09T15:07:22.874067+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'836","last_scrub_stamp":"2024-03-09T15:07:22.873855+0000","last_deep_scrub":"264'836","last_deep_scrub_stamp":"2024-03-09T15:07:22.873855+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.873855+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:25:50.937533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3847,"num_read_kb":3445,"num_write":1140,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'322","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.766227+0000","last_change":"2024-03-09T15:07:13.766359+0000","last_active":"2024-03-09T15:07:13.766227+0000","last_peered":"2024-03-09T15:07:13.766227+0000","last_clean":"2024-03-09T15:07:13.766227+0000","last_became_active":"2024-03-09T14:29:28.729906+0000","last_became_peered":"2024-03-09T14:29:28.729906+0000","last_unstale":"2024-03-09T15:07:13.766227+0000","last_undegraded":"2024-03-09T15:07:13.766227+0000","last_fullsized":"2024-03-09T15:07:13.766227+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'322","last_scrub_stamp":"2024-03-09T15:07:13.766011+0000","last_deep_scrub":"264'322","last_deep_scrub_stamp":"2024-03-09T15:07:13.766011+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.766011+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:54.155006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":3449,"num_write":1268,"num_write_kb":20441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,4],"acting":[2,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:19.972825+0000","last_change":"2024-03-09T14:28:57.609587+0000","last_active":"2024-03-09T15:06:19.972825+0000","last_peered":"2024-03-09T15:06:19.972825+0000","last_clean":"2024-03-09T15:06:19.972825+0000","last_became_active":"2024-03-09T14:28:57.608697+0000","last_became_peered":"2024-03-09T14:28:57.608697+0000","last_unstale":"2024-03-09T15:06:19.972825+0000","last_undegraded":"2024-03-09T15:06:19.972825+0000","last_fullsized":"2024-03-09T15:06:19.972825+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'48","reported_seq":542,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.175886+0000","last_change":"2024-03-09T14:28:59.621455+0000","last_active":"2024-03-09T15:06:36.175886+0000","last_peered":"2024-03-09T15:06:36.175886+0000","last_clean":"2024-03-09T15:06:36.175886+0000","last_became_active":"2024-03-09T14:28:59.620907+0000","last_became_peered":"2024-03-09T14:28:59.620907+0000","last_unstale":"2024-03-09T15:06:36.175886+0000","last_undegraded":"2024-03-09T15:06:36.175886+0000","last_fullsized":"2024-03-09T15:06:36.175886+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.739225+0000","last_change":"2024-03-09T14:29:01.651271+0000","last_active":"2024-03-09T15:06:24.739225+0000","last_peered":"2024-03-09T15:06:24.739225+0000","last_clean":"2024-03-09T15:06:24.739225+0000","last_became_active":"2024-03-09T14:29:01.650734+0000","last_became_peered":"2024-03-09T14:29:01.650734+0000","last_unstale":"2024-03-09T15:06:24.739225+0000","last_undegraded":"2024-03-09T15:06:24.739225+0000","last_fullsized":"2024-03-09T15:06:24.739225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'223","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.630726+0000","last_change":"2024-03-09T15:07:20.630792+0000","last_active":"2024-03-09T15:07:20.630726+0000","last_peered":"2024-03-09T15:07:20.630726+0000","last_clean":"2024-03-09T15:07:20.630726+0000","last_became_active":"2024-03-09T14:29:03.686455+0000","last_became_peered":"2024-03-09T14:29:03.686455+0000","last_unstale":"2024-03-09T15:07:20.630726+0000","last_undegraded":"2024-03-09T15:07:20.630726+0000","last_fullsized":"2024-03-09T15:07:20.630726+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-03-09T15:07:20.630528+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-03-09T15:07:20.630528+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.630528+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:48.600710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":435,"num_write":508,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'405","reported_seq":1935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:21.878355+0000","last_change":"2024-03-09T14:28:55.591974+0000","last_active":"2024-03-09T15:06:21.878355+0000","last_peered":"2024-03-09T15:06:21.878355+0000","last_clean":"2024-03-09T15:06:21.878355+0000","last_became_active":"2024-03-09T14:28:55.591649+0000","last_became_peered":"2024-03-09T14:28:55.591649+0000","last_unstale":"2024-03-09T15:06:21.878355+0000","last_undegraded":"2024-03-09T15:06:21.878355+0000","last_fullsized":"2024-03-09T15:06:21.878355+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2197,"num_read_kb":2083,"num_write":469,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'286","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.412811+0000","last_change":"2024-03-09T14:28:53.600254+0000","last_active":"2024-03-09T15:07:05.412811+0000","last_peered":"2024-03-09T15:07:05.412811+0000","last_clean":"2024-03-09T15:07:05.412811+0000","last_became_active":"2024-03-09T14:28:53.598990+0000","last_became_peered":"2024-03-09T14:28:53.598990+0000","last_unstale":"2024-03-09T15:07:05.412811+0000","last_undegraded":"2024-03-09T15:07:05.412811+0000","last_fullsized":"2024-03-09T15:07:05.412811+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245594,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":365,"num_read_kb":35562,"num_write":1017,"num_write_kb":44906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:19.737943+0000","last_change":"2024-03-09T14:28:57.615933+0000","last_active":"2024-03-09T15:06:19.737943+0000","last_peered":"2024-03-09T15:06:19.737943+0000","last_clean":"2024-03-09T15:06:19.737943+0000","last_became_active":"2024-03-09T14:28:57.615229+0000","last_became_peered":"2024-03-09T14:28:57.615229+0000","last_unstale":"2024-03-09T15:06:19.737943+0000","last_undegraded":"2024-03-09T15:06:19.737943+0000","last_fullsized":"2024-03-09T15:06:19.737943+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'270","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.729697+0000","last_change":"2024-03-09T14:28:59.617614+0000","last_active":"2024-03-09T15:07:04.729697+0000","last_peered":"2024-03-09T15:07:04.729697+0000","last_clean":"2024-03-09T15:07:04.729697+0000","last_became_active":"2024-03-09T14:28:59.615881+0000","last_became_peered":"2024-03-09T14:28:59.615881+0000","last_unstale":"2024-03-09T15:07:04.729697+0000","last_undegraded":"2024-03-09T15:07:04.729697+0000","last_fullsized":"2024-03-09T15:07:04.729697+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48426,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":988,"num_write":356,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.254320+0000","last_change":"2024-03-09T15:07:27.254373+0000","last_active":"2024-03-09T15:07:27.254320+0000","last_peered":"2024-03-09T15:07:27.254320+0000","last_clean":"2024-03-09T15:07:27.254320+0000","last_became_active":"2024-03-09T14:29:01.656740+0000","last_became_peered":"2024-03-09T14:29:01.656740+0000","last_unstale":"2024-03-09T15:07:27.254320+0000","last_undegraded":"2024-03-09T15:07:27.254320+0000","last_fullsized":"2024-03-09T15:07:27.254320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:27.254123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:27.254123+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.254123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:56:48.423472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'192","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.487174+0000","last_change":"2024-03-09T15:07:15.487243+0000","last_active":"2024-03-09T15:07:15.487174+0000","last_peered":"2024-03-09T15:07:15.487174+0000","last_clean":"2024-03-09T15:07:15.487174+0000","last_became_active":"2024-03-09T14:29:03.671571+0000","last_became_peered":"2024-03-09T14:29:03.671571+0000","last_unstale":"2024-03-09T15:07:15.487174+0000","last_undegraded":"2024-03-09T15:07:15.487174+0000","last_fullsized":"2024-03-09T15:07:15.487174+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-03-09T15:07:15.486986+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-03-09T15:07:15.486986+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.486986+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:03.941307+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":257,"num_read_kb":221,"num_write":372,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'1158","reported_seq":2775,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.397618+0000","last_change":"2024-03-09T14:28:55.596769+0000","last_active":"2024-03-09T15:06:38.397618+0000","last_peered":"2024-03-09T15:06:38.397618+0000","last_clean":"2024-03-09T15:06:38.397618+0000","last_became_active":"2024-03-09T14:28:55.592387+0000","last_became_peered":"2024-03-09T14:28:55.592387+0000","last_unstale":"2024-03-09T15:06:38.397618+0000","last_undegraded":"2024-03-09T15:06:38.397618+0000","last_fullsized":"2024-03-09T15:06:38.397618+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":1100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4979,"num_read_kb":4357,"num_write":1600,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'325","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.407849+0000","last_change":"2024-03-09T14:28:53.627197+0000","last_active":"2024-03-09T15:07:05.407849+0000","last_peered":"2024-03-09T15:07:05.407849+0000","last_clean":"2024-03-09T15:07:05.407849+0000","last_became_active":"2024-03-09T14:28:53.626736+0000","last_became_peered":"2024-03-09T14:28:53.626736+0000","last_unstale":"2024-03-09T15:07:05.407849+0000","last_undegraded":"2024-03-09T15:07:05.407849+0000","last_fullsized":"2024-03-09T15:07:05.407849+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655827,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":493,"num_read_kb":7830,"num_write":1223,"num_write_kb":47405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.172754+0000","last_change":"2024-03-09T15:07:22.172813+0000","last_active":"2024-03-09T15:07:22.172754+0000","last_peered":"2024-03-09T15:07:22.172754+0000","last_clean":"2024-03-09T15:07:22.172754+0000","last_became_active":"2024-03-09T14:28:57.613999+0000","last_became_peered":"2024-03-09T14:28:57.613999+0000","last_unstale":"2024-03-09T15:07:22.172754+0000","last_undegraded":"2024-03-09T15:07:22.172754+0000","last_fullsized":"2024-03-09T15:07:22.172754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:22.172539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:22.172539+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.172539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:10:05.619875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'255","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.518420+0000","last_change":"2024-03-09T14:28:59.615487+0000","last_active":"2024-03-09T15:07:04.518420+0000","last_peered":"2024-03-09T15:07:04.518420+0000","last_clean":"2024-03-09T15:07:04.518420+0000","last_became_active":"2024-03-09T14:28:59.614754+0000","last_became_peered":"2024-03-09T14:28:59.614754+0000","last_unstale":"2024-03-09T15:07:04.518420+0000","last_undegraded":"2024-03-09T15:07:04.518420+0000","last_fullsized":"2024-03-09T15:07:04.518420+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43227,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":1017,"num_write":350,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.742023+0000","last_change":"2024-03-09T14:29:01.648210+0000","last_active":"2024-03-09T15:06:24.742023+0000","last_peered":"2024-03-09T15:06:24.742023+0000","last_clean":"2024-03-09T15:06:24.742023+0000","last_became_active":"2024-03-09T14:29:01.647570+0000","last_became_peered":"2024-03-09T14:29:01.647570+0000","last_unstale":"2024-03-09T15:06:24.742023+0000","last_undegraded":"2024-03-09T15:06:24.742023+0000","last_fullsized":"2024-03-09T15:06:24.742023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'815","reported_seq":2359,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.286495+0000","last_change":"2024-03-09T15:07:26.286639+0000","last_active":"2024-03-09T15:07:26.286495+0000","last_peered":"2024-03-09T15:07:26.286495+0000","last_clean":"2024-03-09T15:07:26.286495+0000","last_became_active":"2024-03-09T14:28:55.599825+0000","last_became_peered":"2024-03-09T14:28:55.599825+0000","last_unstale":"2024-03-09T15:07:26.286495+0000","last_undegraded":"2024-03-09T15:07:26.286495+0000","last_fullsized":"2024-03-09T15:07:26.286495+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'815","last_scrub_stamp":"2024-03-09T15:07:26.286264+0000","last_deep_scrub":"264'815","last_deep_scrub_stamp":"2024-03-09T15:07:26.286264+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.286264+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:29:09.000713+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3687,"num_read_kb":3276,"num_write":1113,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'290","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.423983+0000","last_change":"2024-03-09T14:28:53.565880+0000","last_active":"2024-03-09T15:07:05.423983+0000","last_peered":"2024-03-09T15:07:05.423983+0000","last_clean":"2024-03-09T15:07:05.423983+0000","last_became_active":"2024-03-09T14:28:53.565431+0000","last_became_peered":"2024-03-09T14:28:53.565431+0000","last_unstale":"2024-03-09T15:07:05.423983+0000","last_undegraded":"2024-03-09T15:07:05.423983+0000","last_fullsized":"2024-03-09T15:07:05.423983+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655871,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":381,"num_read_kb":7268,"num_write":971,"num_write_kb":31379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.752374+0000","last_change":"2024-03-09T14:28:57.611182+0000","last_active":"2024-03-09T15:07:04.752374+0000","last_peered":"2024-03-09T15:07:04.752374+0000","last_clean":"2024-03-09T15:07:04.752374+0000","last_became_active":"2024-03-09T14:28:57.610126+0000","last_became_peered":"2024-03-09T14:28:57.610126+0000","last_unstale":"2024-03-09T15:07:04.752374+0000","last_undegraded":"2024-03-09T15:07:04.752374+0000","last_fullsized":"2024-03-09T15:07:04.752374+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'474","reported_seq":1101,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.439006+0000","last_change":"2024-03-09T14:28:59.614860+0000","last_active":"2024-03-09T15:07:04.439006+0000","last_peered":"2024-03-09T15:07:04.439006+0000","last_clean":"2024-03-09T15:07:04.439006+0000","last_became_active":"2024-03-09T14:28:59.614069+0000","last_became_peered":"2024-03-09T14:28:59.614069+0000","last_unstale":"2024-03-09T15:07:04.439006+0000","last_undegraded":"2024-03-09T15:07:04.439006+0000","last_fullsized":"2024-03-09T15:07:04.439006+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88057,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":2100,"num_write":750,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.444264+0000","last_change":"2024-03-09T15:07:20.444317+0000","last_active":"2024-03-09T15:07:20.444264+0000","last_peered":"2024-03-09T15:07:20.444264+0000","last_clean":"2024-03-09T15:07:20.444264+0000","last_became_active":"2024-03-09T14:29:01.639825+0000","last_became_peered":"2024-03-09T14:29:01.639825+0000","last_unstale":"2024-03-09T15:07:20.444264+0000","last_undegraded":"2024-03-09T15:07:20.444264+0000","last_fullsized":"2024-03-09T15:07:20.444264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.444069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.444069+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.444069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:07:45.858578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'151","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.014709+0000","last_change":"2024-03-09T15:07:12.014741+0000","last_active":"2024-03-09T15:07:12.014709+0000","last_peered":"2024-03-09T15:07:12.014709+0000","last_clean":"2024-03-09T15:07:12.014709+0000","last_became_active":"2024-03-09T14:29:03.666515+0000","last_became_peered":"2024-03-09T14:29:03.666515+0000","last_unstale":"2024-03-09T15:07:12.014709+0000","last_undegraded":"2024-03-09T15:07:12.014709+0000","last_fullsized":"2024-03-09T15:07:12.014709+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-03-09T15:07:12.014625+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-03-09T15:07:12.014625+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.014625+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:12:44.954675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":181,"num_write":332,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'874","reported_seq":2621,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:59.751548+0000","last_change":"2024-03-09T14:28:55.586646+0000","last_active":"2024-03-09T15:06:59.751548+0000","last_peered":"2024-03-09T15:06:59.751548+0000","last_clean":"2024-03-09T15:06:59.751548+0000","last_became_active":"2024-03-09T14:28:55.586247+0000","last_became_peered":"2024-03-09T14:28:55.586247+0000","last_unstale":"2024-03-09T15:06:59.751548+0000","last_undegraded":"2024-03-09T15:06:59.751548+0000","last_fullsized":"2024-03-09T15:06:59.751548+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":800,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4288,"num_read_kb":3851,"num_write":1208,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'317","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.402309+0000","last_change":"2024-03-09T14:28:53.618203+0000","last_active":"2024-03-09T15:07:05.402309+0000","last_peered":"2024-03-09T15:07:05.402309+0000","last_clean":"2024-03-09T15:07:05.402309+0000","last_became_active":"2024-03-09T14:28:53.617832+0000","last_became_peered":"2024-03-09T14:28:53.617832+0000","last_unstale":"2024-03-09T15:07:05.402309+0000","last_undegraded":"2024-03-09T15:07:05.402309+0000","last_fullsized":"2024-03-09T15:07:05.402309+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22651,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":36525,"num_write":1106,"num_write_kb":22031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.221144+0000","last_change":"2024-03-09T15:07:20.221198+0000","last_active":"2024-03-09T15:07:20.221144+0000","last_peered":"2024-03-09T15:07:20.221144+0000","last_clean":"2024-03-09T15:07:20.221144+0000","last_became_active":"2024-03-09T14:28:57.616057+0000","last_became_peered":"2024-03-09T14:28:57.616057+0000","last_unstale":"2024-03-09T15:07:20.221144+0000","last_undegraded":"2024-03-09T15:07:20.221144+0000","last_fullsized":"2024-03-09T15:07:20.221144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.220901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.220901+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.220901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:26:17.180137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'267","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.591320+0000","last_change":"2024-03-09T14:28:59.616152+0000","last_active":"2024-03-09T15:07:04.591320+0000","last_peered":"2024-03-09T15:07:04.591320+0000","last_clean":"2024-03-09T15:07:04.591320+0000","last_became_active":"2024-03-09T14:28:59.615193+0000","last_became_peered":"2024-03-09T14:28:59.615193+0000","last_unstale":"2024-03-09T15:07:04.591320+0000","last_undegraded":"2024-03-09T15:07:04.591320+0000","last_fullsized":"2024-03-09T15:07:04.591320+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43919,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":455,"num_read_kb":986,"num_write":382,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.859441+0000","last_change":"2024-03-09T15:07:20.859552+0000","last_active":"2024-03-09T15:07:20.859441+0000","last_peered":"2024-03-09T15:07:20.859441+0000","last_clean":"2024-03-09T15:07:20.859441+0000","last_became_active":"2024-03-09T14:29:01.660997+0000","last_became_peered":"2024-03-09T14:29:01.660997+0000","last_unstale":"2024-03-09T15:07:20.859441+0000","last_undegraded":"2024-03-09T15:07:20.859441+0000","last_fullsized":"2024-03-09T15:07:20.859441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.859205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.859205+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.859205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:57:46.682370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'181","reported_seq":1377,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:54.135323+0000","last_change":"2024-03-09T14:29:03.669572+0000","last_active":"2024-03-09T15:06:54.135323+0000","last_peered":"2024-03-09T15:06:54.135323+0000","last_clean":"2024-03-09T15:06:54.135323+0000","last_became_active":"2024-03-09T14:29:03.668833+0000","last_became_peered":"2024-03-09T14:29:03.668833+0000","last_unstale":"2024-03-09T15:06:54.135323+0000","last_undegraded":"2024-03-09T15:06:54.135323+0000","last_fullsized":"2024-03-09T15:06:54.135323+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:02.604578+0000","last_clean_scrub_stamp":"2024-03-09T14:29:02.604578+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2487,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":947,"num_read_kb":932,"num_write":509,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'486","reported_seq":2229,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:32.541714+0000","last_change":"2024-03-09T14:28:55.597840+0000","last_active":"2024-03-09T15:06:32.541714+0000","last_peered":"2024-03-09T15:06:32.541714+0000","last_clean":"2024-03-09T15:06:32.541714+0000","last_became_active":"2024-03-09T14:28:55.596538+0000","last_became_peered":"2024-03-09T14:28:55.596538+0000","last_unstale":"2024-03-09T15:06:32.541714+0000","last_undegraded":"2024-03-09T15:06:32.541714+0000","last_fullsized":"2024-03-09T15:06:32.541714+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2772,"num_read_kb":2616,"num_write":579,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'289","reported_seq":905,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.384279+0000","last_change":"2024-03-09T14:28:53.597236+0000","last_active":"2024-03-09T15:07:05.384279+0000","last_peered":"2024-03-09T15:07:05.384279+0000","last_clean":"2024-03-09T15:07:05.384279+0000","last_became_active":"2024-03-09T14:28:53.589932+0000","last_became_peered":"2024-03-09T14:28:53.589932+0000","last_unstale":"2024-03-09T15:07:05.384279+0000","last_undegraded":"2024-03-09T15:07:05.384279+0000","last_fullsized":"2024-03-09T15:07:05.384279+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10486772,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":425,"num_read_kb":14456,"num_write":988,"num_write_kb":42013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.733257+0000","last_change":"2024-03-09T14:28:57.610733+0000","last_active":"2024-03-09T15:06:29.733257+0000","last_peered":"2024-03-09T15:06:29.733257+0000","last_clean":"2024-03-09T15:06:29.733257+0000","last_became_active":"2024-03-09T14:28:57.609903+0000","last_became_peered":"2024-03-09T14:28:57.609903+0000","last_unstale":"2024-03-09T15:06:29.733257+0000","last_undegraded":"2024-03-09T15:06:29.733257+0000","last_fullsized":"2024-03-09T15:06:29.733257+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'259","reported_seq":824,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.246182+0000","last_change":"2024-03-09T14:28:59.631074+0000","last_active":"2024-03-09T15:07:03.246182+0000","last_peered":"2024-03-09T15:07:03.246182+0000","last_clean":"2024-03-09T15:07:03.246182+0000","last_became_active":"2024-03-09T14:28:59.630460+0000","last_became_peered":"2024-03-09T14:28:59.630460+0000","last_unstale":"2024-03-09T15:07:03.246182+0000","last_undegraded":"2024-03-09T15:07:03.246182+0000","last_fullsized":"2024-03-09T15:07:03.246182+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":1036,"num_write":360,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.104168+0000","last_change":"2024-03-09T14:29:01.636817+0000","last_active":"2024-03-09T15:07:05.104168+0000","last_peered":"2024-03-09T15:07:05.104168+0000","last_clean":"2024-03-09T15:07:05.104168+0000","last_became_active":"2024-03-09T14:29:01.636083+0000","last_became_peered":"2024-03-09T14:29:01.636083+0000","last_unstale":"2024-03-09T15:07:05.104168+0000","last_undegraded":"2024-03-09T15:07:05.104168+0000","last_fullsized":"2024-03-09T15:07:05.104168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:29:00.586122+0000","last_clean_scrub_stamp":"2024-03-09T14:29:00.586122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'124","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.549045+0000","last_change":"2024-03-09T15:07:12.549133+0000","last_active":"2024-03-09T15:07:12.549045+0000","last_peered":"2024-03-09T15:07:12.549045+0000","last_clean":"2024-03-09T15:07:12.549045+0000","last_became_active":"2024-03-09T14:29:03.677376+0000","last_became_peered":"2024-03-09T14:29:03.677376+0000","last_unstale":"2024-03-09T15:07:12.549045+0000","last_undegraded":"2024-03-09T15:07:12.549045+0000","last_fullsized":"2024-03-09T15:07:12.549045+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:12.548825+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:12.548825+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.548825+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:01:19.400821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":93,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'1138","reported_seq":2991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.725834+0000","last_change":"2024-03-09T14:28:55.588136+0000","last_active":"2024-03-09T15:06:24.725834+0000","last_peered":"2024-03-09T15:06:24.725834+0000","last_clean":"2024-03-09T15:06:24.725834+0000","last_became_active":"2024-03-09T14:28:55.587547+0000","last_became_peered":"2024-03-09T14:28:55.587547+0000","last_unstale":"2024-03-09T15:06:24.725834+0000","last_undegraded":"2024-03-09T15:06:24.725834+0000","last_fullsized":"2024-03-09T15:06:24.725834+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5366,"num_read_kb":4772,"num_write":1564,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'284","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.283858+0000","last_change":"2024-03-09T14:28:53.589911+0000","last_active":"2024-03-09T15:07:05.283858+0000","last_peered":"2024-03-09T15:07:05.283858+0000","last_clean":"2024-03-09T15:07:05.283858+0000","last_became_active":"2024-03-09T14:28:53.589407+0000","last_became_peered":"2024-03-09T14:28:53.589407+0000","last_unstale":"2024-03-09T15:07:05.283858+0000","last_undegraded":"2024-03-09T15:07:05.283858+0000","last_fullsized":"2024-03-09T15:07:05.283858+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":59464,"num_write":1037,"num_write_kb":28198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.818475+0000","last_change":"2024-03-09T15:07:27.818528+0000","last_active":"2024-03-09T15:07:27.818475+0000","last_peered":"2024-03-09T15:07:27.818475+0000","last_clean":"2024-03-09T15:07:27.818475+0000","last_became_active":"2024-03-09T14:28:57.620140+0000","last_became_peered":"2024-03-09T14:28:57.620140+0000","last_unstale":"2024-03-09T15:07:27.818475+0000","last_undegraded":"2024-03-09T15:07:27.818475+0000","last_fullsized":"2024-03-09T15:07:27.818475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:27.818272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:27.818272+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.818272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:07:47.066746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'79","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.737047+0000","last_change":"2024-03-09T15:07:24.737205+0000","last_active":"2024-03-09T15:07:24.737047+0000","last_peered":"2024-03-09T15:07:24.737047+0000","last_clean":"2024-03-09T15:07:24.737047+0000","last_became_active":"2024-03-09T14:28:59.629734+0000","last_became_peered":"2024-03-09T14:28:59.629734+0000","last_unstale":"2024-03-09T15:07:24.737047+0000","last_undegraded":"2024-03-09T15:07:24.737047+0000","last_fullsized":"2024-03-09T15:07:24.737047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'79","last_scrub_stamp":"2024-03-09T15:07:24.736784+0000","last_deep_scrub":"264'79","last_deep_scrub_stamp":"2024-03-09T15:07:24.736784+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.736784+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:02:04.246917+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":70,"num_read_kb":63,"num_write":56,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'540","reported_seq":2063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.197995+0000","last_change":"2024-03-09T15:07:21.198058+0000","last_active":"2024-03-09T15:07:21.197995+0000","last_peered":"2024-03-09T15:07:21.197995+0000","last_clean":"2024-03-09T15:07:21.197995+0000","last_became_active":"2024-03-09T14:29:01.650590+0000","last_became_peered":"2024-03-09T14:29:01.650590+0000","last_unstale":"2024-03-09T15:07:21.197995+0000","last_undegraded":"2024-03-09T15:07:21.197995+0000","last_fullsized":"2024-03-09T15:07:21.197995+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'540","last_scrub_stamp":"2024-03-09T15:07:21.197799+0000","last_deep_scrub":"264'540","last_deep_scrub_stamp":"2024-03-09T15:07:21.197799+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.197799+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:33:51.367630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'124","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.011441+0000","last_change":"2024-03-09T15:07:26.011504+0000","last_active":"2024-03-09T15:07:26.011441+0000","last_peered":"2024-03-09T15:07:26.011441+0000","last_clean":"2024-03-09T15:07:26.011441+0000","last_became_active":"2024-03-09T14:29:03.677064+0000","last_became_peered":"2024-03-09T14:29:03.677064+0000","last_unstale":"2024-03-09T15:07:26.011441+0000","last_undegraded":"2024-03-09T15:07:26.011441+0000","last_fullsized":"2024-03-09T15:07:26.011441+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:26.011253+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:26.011253+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.011253+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:04:51.610682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":150,"num_write":318,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'509","reported_seq":1976,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.307959+0000","last_change":"2024-03-09T14:28:55.610871+0000","last_active":"2024-03-09T15:06:41.307959+0000","last_peered":"2024-03-09T15:06:41.307959+0000","last_clean":"2024-03-09T15:06:41.307959+0000","last_became_active":"2024-03-09T14:28:55.610134+0000","last_became_peered":"2024-03-09T14:28:55.610134+0000","last_unstale":"2024-03-09T15:06:41.307959+0000","last_undegraded":"2024-03-09T15:06:41.307959+0000","last_fullsized":"2024-03-09T15:06:41.307959+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":400,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2571,"num_read_kb":2332,"num_write":699,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'430","reported_seq":1149,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.421511+0000","last_change":"2024-03-09T14:28:53.637554+0000","last_active":"2024-03-09T15:07:05.421511+0000","last_peered":"2024-03-09T15:07:05.421511+0000","last_clean":"2024-03-09T15:07:05.421511+0000","last_became_active":"2024-03-09T14:28:53.636761+0000","last_became_peered":"2024-03-09T14:28:53.636761+0000","last_unstale":"2024-03-09T15:07:05.421511+0000","last_undegraded":"2024-03-09T15:07:05.421511+0000","last_fullsized":"2024-03-09T15:07:05.421511+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":788,"num_read_kb":7041,"num_write":1515,"num_write_kb":16792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.740774+0000","last_change":"2024-03-09T14:28:57.613685+0000","last_active":"2024-03-09T15:06:29.740774+0000","last_peered":"2024-03-09T15:06:29.740774+0000","last_clean":"2024-03-09T15:06:29.740774+0000","last_became_active":"2024-03-09T14:28:57.612982+0000","last_became_peered":"2024-03-09T14:28:57.612982+0000","last_unstale":"2024-03-09T15:06:29.740774+0000","last_undegraded":"2024-03-09T15:06:29.740774+0000","last_fullsized":"2024-03-09T15:06:29.740774+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'288","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.800203+0000","last_change":"2024-03-09T14:28:59.601758+0000","last_active":"2024-03-09T15:07:03.800203+0000","last_peered":"2024-03-09T15:07:03.800203+0000","last_clean":"2024-03-09T15:07:03.800203+0000","last_became_active":"2024-03-09T14:28:59.601007+0000","last_became_peered":"2024-03-09T14:28:59.601007+0000","last_unstale":"2024-03-09T15:07:03.800203+0000","last_undegraded":"2024-03-09T15:07:03.800203+0000","last_fullsized":"2024-03-09T15:07:03.800203+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58554,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":1103,"num_write":386,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.710631+0000","last_change":"2024-03-09T15:07:28.710682+0000","last_active":"2024-03-09T15:07:28.710631+0000","last_peered":"2024-03-09T15:07:28.710631+0000","last_clean":"2024-03-09T15:07:28.710631+0000","last_became_active":"2024-03-09T14:29:01.657169+0000","last_became_peered":"2024-03-09T14:29:01.657169+0000","last_unstale":"2024-03-09T15:07:28.710631+0000","last_undegraded":"2024-03-09T15:07:28.710631+0000","last_fullsized":"2024-03-09T15:07:28.710631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:28.710441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:28.710441+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.710441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:06:51.547173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'124","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.984339+0000","last_change":"2024-03-09T15:07:27.984410+0000","last_active":"2024-03-09T15:07:27.984339+0000","last_peered":"2024-03-09T15:07:27.984339+0000","last_clean":"2024-03-09T15:07:27.984339+0000","last_became_active":"2024-03-09T14:29:03.669978+0000","last_became_peered":"2024-03-09T14:29:03.669978+0000","last_unstale":"2024-03-09T15:07:27.984339+0000","last_undegraded":"2024-03-09T15:07:27.984339+0000","last_fullsized":"2024-03-09T15:07:27.984339+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:27.984137+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:27.984137+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.984137+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:41:49.859618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":289,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'771","reported_seq":2298,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.398007+0000","last_change":"2024-03-09T14:28:55.570920+0000","last_active":"2024-03-09T15:06:38.398007+0000","last_peered":"2024-03-09T15:06:38.398007+0000","last_clean":"2024-03-09T15:06:38.398007+0000","last_became_active":"2024-03-09T14:28:55.570161+0000","last_became_peered":"2024-03-09T14:28:55.570161+0000","last_unstale":"2024-03-09T15:06:38.398007+0000","last_undegraded":"2024-03-09T15:06:38.398007+0000","last_fullsized":"2024-03-09T15:06:38.398007+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3636,"num_read_kb":3267,"num_write":1033,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'351","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.608643+0000","last_change":"2024-03-09T15:07:19.608740+0000","last_active":"2024-03-09T15:07:19.608643+0000","last_peered":"2024-03-09T15:07:19.608643+0000","last_clean":"2024-03-09T15:07:19.608643+0000","last_became_active":"2024-03-09T14:29:28.824399+0000","last_became_peered":"2024-03-09T14:29:28.824399+0000","last_unstale":"2024-03-09T15:07:19.608643+0000","last_undegraded":"2024-03-09T15:07:19.608643+0000","last_fullsized":"2024-03-09T15:07:19.608643+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-03-09T15:07:19.608431+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-03-09T15:07:19.608431+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.608431+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:55:03.616832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":600,"num_read_kb":66383,"num_write":1403,"num_write_kb":58469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.918131+0000","last_change":"2024-03-09T14:28:57.609386+0000","last_active":"2024-03-09T15:06:29.918131+0000","last_peered":"2024-03-09T15:06:29.918131+0000","last_clean":"2024-03-09T15:06:29.918131+0000","last_became_active":"2024-03-09T14:28:57.608639+0000","last_became_peered":"2024-03-09T14:28:57.608639+0000","last_unstale":"2024-03-09T15:06:29.918131+0000","last_undegraded":"2024-03-09T15:06:29.918131+0000","last_fullsized":"2024-03-09T15:06:29.918131+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'267","reported_seq":825,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.884558+0000","last_change":"2024-03-09T14:28:59.624561+0000","last_active":"2024-03-09T15:07:03.884558+0000","last_peered":"2024-03-09T15:07:03.884558+0000","last_clean":"2024-03-09T15:07:03.884558+0000","last_became_active":"2024-03-09T14:28:59.623529+0000","last_became_peered":"2024-03-09T14:28:59.623529+0000","last_unstale":"2024-03-09T15:07:03.884558+0000","last_undegraded":"2024-03-09T15:07:03.884558+0000","last_fullsized":"2024-03-09T15:07:03.884558+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":971,"num_write":346,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.212269+0000","last_change":"2024-03-09T15:07:23.212326+0000","last_active":"2024-03-09T15:07:23.212269+0000","last_peered":"2024-03-09T15:07:23.212269+0000","last_clean":"2024-03-09T15:07:23.212269+0000","last_became_active":"2024-03-09T14:29:01.651183+0000","last_became_peered":"2024-03-09T14:29:01.651183+0000","last_unstale":"2024-03-09T15:07:23.212269+0000","last_undegraded":"2024-03-09T15:07:23.212269+0000","last_fullsized":"2024-03-09T15:07:23.212269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:23.212084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:23.212084+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.212084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:52:31.699504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'124","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.965442+0000","last_change":"2024-03-09T15:07:25.965517+0000","last_active":"2024-03-09T15:07:25.965442+0000","last_peered":"2024-03-09T15:07:25.965442+0000","last_clean":"2024-03-09T15:07:25.965442+0000","last_became_active":"2024-03-09T14:29:03.661848+0000","last_became_peered":"2024-03-09T14:29:03.661848+0000","last_unstale":"2024-03-09T15:07:25.965442+0000","last_undegraded":"2024-03-09T15:07:25.965442+0000","last_fullsized":"2024-03-09T15:07:25.965442+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:25.965247+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:25.965247+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.965247+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:36:26.246320+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":975,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":172,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'742","reported_seq":2303,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:22.966466+0000","last_change":"2024-03-09T14:28:55.582020+0000","last_active":"2024-03-09T15:06:22.966466+0000","last_peered":"2024-03-09T15:06:22.966466+0000","last_clean":"2024-03-09T15:06:22.966466+0000","last_became_active":"2024-03-09T14:28:55.580902+0000","last_became_peered":"2024-03-09T14:28:55.580902+0000","last_unstale":"2024-03-09T15:06:22.966466+0000","last_undegraded":"2024-03-09T15:06:22.966466+0000","last_fullsized":"2024-03-09T15:06:22.966466+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3409,"num_read_kb":3074,"num_write":976,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'296","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.405967+0000","last_change":"2024-03-09T14:28:53.619086+0000","last_active":"2024-03-09T15:07:05.405967+0000","last_peered":"2024-03-09T15:07:05.405967+0000","last_clean":"2024-03-09T15:07:05.405967+0000","last_became_active":"2024-03-09T14:28:53.618470+0000","last_became_peered":"2024-03-09T14:28:53.618470+0000","last_unstale":"2024-03-09T15:07:05.405967+0000","last_undegraded":"2024-03-09T15:07:05.405967+0000","last_fullsized":"2024-03-09T15:07:05.405967+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243044,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":49463,"num_write":1149,"num_write_kb":38192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:14.715973+0000","last_change":"2024-03-09T14:28:57.612579+0000","last_active":"2024-03-09T15:05:14.715973+0000","last_peered":"2024-03-09T15:05:14.715973+0000","last_clean":"2024-03-09T15:05:14.715973+0000","last_became_active":"2024-03-09T14:28:57.611745+0000","last_became_peered":"2024-03-09T14:28:57.611745+0000","last_unstale":"2024-03-09T15:05:14.715973+0000","last_undegraded":"2024-03-09T15:05:14.715973+0000","last_fullsized":"2024-03-09T15:05:14.715973+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'213","reported_seq":763,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:03.034869+0000","last_change":"2024-03-09T14:28:59.617486+0000","last_active":"2024-03-09T15:07:03.034869+0000","last_peered":"2024-03-09T15:07:03.034869+0000","last_clean":"2024-03-09T15:07:03.034869+0000","last_became_active":"2024-03-09T14:28:59.615400+0000","last_became_peered":"2024-03-09T14:28:59.615400+0000","last_unstale":"2024-03-09T15:07:03.034869+0000","last_undegraded":"2024-03-09T15:07:03.034869+0000","last_fullsized":"2024-03-09T15:07:03.034869+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41975,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":356,"num_read_kb":841,"num_write":286,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.763802+0000","last_change":"2024-03-09T15:07:19.763934+0000","last_active":"2024-03-09T15:07:19.763802+0000","last_peered":"2024-03-09T15:07:19.763802+0000","last_clean":"2024-03-09T15:07:19.763802+0000","last_became_active":"2024-03-09T14:29:01.657117+0000","last_became_peered":"2024-03-09T14:29:01.657117+0000","last_unstale":"2024-03-09T15:07:19.763802+0000","last_undegraded":"2024-03-09T15:07:19.763802+0000","last_fullsized":"2024-03-09T15:07:19.763802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:19.763551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:19.763551+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.763551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:00:56.266543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'135","reported_seq":1802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.938601+0000","last_change":"2024-03-09T15:07:28.938669+0000","last_active":"2024-03-09T15:07:28.938601+0000","last_peered":"2024-03-09T15:07:28.938601+0000","last_clean":"2024-03-09T15:07:28.938601+0000","last_became_active":"2024-03-09T14:29:03.659930+0000","last_became_peered":"2024-03-09T14:29:03.659930+0000","last_unstale":"2024-03-09T15:07:28.938601+0000","last_undegraded":"2024-03-09T15:07:28.938601+0000","last_fullsized":"2024-03-09T15:07:28.938601+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'135","last_scrub_stamp":"2024-03-09T15:07:28.938414+0000","last_deep_scrub":"264'135","last_deep_scrub_stamp":"2024-03-09T15:07:28.938414+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.938414+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:57.834645+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1320,"num_read_kb":1317,"num_write":320,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'484","reported_seq":2148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:36.170924+0000","last_change":"2024-03-09T14:28:55.599386+0000","last_active":"2024-03-09T15:06:36.170924+0000","last_peered":"2024-03-09T15:06:36.170924+0000","last_clean":"2024-03-09T15:06:36.170924+0000","last_became_active":"2024-03-09T14:28:55.598822+0000","last_became_peered":"2024-03-09T14:28:55.598822+0000","last_unstale":"2024-03-09T15:06:36.170924+0000","last_undegraded":"2024-03-09T15:06:36.170924+0000","last_fullsized":"2024-03-09T15:06:36.170924+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2615,"num_read_kb":2447,"num_write":578,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'291","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.423247+0000","last_change":"2024-03-09T14:28:53.595926+0000","last_active":"2024-03-09T15:07:05.423247+0000","last_peered":"2024-03-09T15:07:05.423247+0000","last_clean":"2024-03-09T15:07:05.423247+0000","last_became_active":"2024-03-09T14:28:53.595479+0000","last_became_peered":"2024-03-09T14:28:53.595479+0000","last_unstale":"2024-03-09T15:07:05.423247+0000","last_undegraded":"2024-03-09T15:07:05.423247+0000","last_fullsized":"2024-03-09T15:07:05.423247+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311401,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":399,"num_read_kb":37243,"num_write":1062,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.908396+0000","last_change":"2024-03-09T15:07:21.908465+0000","last_active":"2024-03-09T15:07:21.908396+0000","last_peered":"2024-03-09T15:07:21.908396+0000","last_clean":"2024-03-09T15:07:21.908396+0000","last_became_active":"2024-03-09T14:28:57.608170+0000","last_became_peered":"2024-03-09T14:28:57.608170+0000","last_unstale":"2024-03-09T15:07:21.908396+0000","last_undegraded":"2024-03-09T15:07:21.908396+0000","last_fullsized":"2024-03-09T15:07:21.908396+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:21.908209+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:21.908209+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.908209+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:46:15.136572+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'257","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.774386+0000","last_change":"2024-03-09T15:07:27.774468+0000","last_active":"2024-03-09T15:07:27.774386+0000","last_peered":"2024-03-09T15:07:27.774386+0000","last_clean":"2024-03-09T15:07:27.774386+0000","last_became_active":"2024-03-09T14:28:59.614271+0000","last_became_peered":"2024-03-09T14:28:59.614271+0000","last_unstale":"2024-03-09T15:07:27.774386+0000","last_undegraded":"2024-03-09T15:07:27.774386+0000","last_fullsized":"2024-03-09T15:07:27.774386+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-03-09T15:07:27.774203+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-03-09T15:07:27.774203+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.774203+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:16:51.240318+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45957,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":426,"num_read_kb":925,"num_write":332,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.731942+0000","last_change":"2024-03-09T15:07:29.732043+0000","last_active":"2024-03-09T15:07:29.731942+0000","last_peered":"2024-03-09T15:07:29.731942+0000","last_clean":"2024-03-09T15:07:29.731942+0000","last_became_active":"2024-03-09T14:29:01.648467+0000","last_became_peered":"2024-03-09T14:29:01.648467+0000","last_unstale":"2024-03-09T15:07:29.731942+0000","last_undegraded":"2024-03-09T15:07:29.731942+0000","last_fullsized":"2024-03-09T15:07:29.731942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:29.731652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:29.731652+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.731652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:24:49.823183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'90","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.791592+0000","last_change":"2024-03-09T15:07:15.791657+0000","last_active":"2024-03-09T15:07:15.791592+0000","last_peered":"2024-03-09T15:07:15.791592+0000","last_clean":"2024-03-09T15:07:15.791592+0000","last_became_active":"2024-03-09T14:29:03.666157+0000","last_became_peered":"2024-03-09T14:29:03.666157+0000","last_unstale":"2024-03-09T15:07:15.791592+0000","last_undegraded":"2024-03-09T15:07:15.791592+0000","last_fullsized":"2024-03-09T15:07:15.791592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'90","last_scrub_stamp":"2024-03-09T15:07:15.791376+0000","last_deep_scrub":"264'90","last_deep_scrub_stamp":"2024-03-09T15:07:15.791376+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.791376+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:02:26.244687+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":67,"num_write":211,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'505","reported_seq":2013,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.872932+0000","last_change":"2024-03-09T15:07:24.873003+0000","last_active":"2024-03-09T15:07:24.872932+0000","last_peered":"2024-03-09T15:07:24.872932+0000","last_clean":"2024-03-09T15:07:24.872932+0000","last_became_active":"2024-03-09T14:28:55.591054+0000","last_became_peered":"2024-03-09T14:28:55.591054+0000","last_unstale":"2024-03-09T15:07:24.872932+0000","last_undegraded":"2024-03-09T15:07:24.872932+0000","last_fullsized":"2024-03-09T15:07:24.872932+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'505","last_scrub_stamp":"2024-03-09T15:07:24.872742+0000","last_deep_scrub":"264'505","last_deep_scrub_stamp":"2024-03-09T15:07:24.872742+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.872742+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:44:42.985766+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2590,"num_read_kb":2449,"num_write":673,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'308","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.403293+0000","last_change":"2024-03-09T14:28:53.640090+0000","last_active":"2024-03-09T15:07:05.403293+0000","last_peered":"2024-03-09T15:07:05.403293+0000","last_clean":"2024-03-09T15:07:05.403293+0000","last_became_active":"2024-03-09T14:28:53.638941+0000","last_became_peered":"2024-03-09T14:28:53.638941+0000","last_unstale":"2024-03-09T15:07:05.403293+0000","last_undegraded":"2024-03-09T15:07:05.403293+0000","last_fullsized":"2024-03-09T15:07:05.403293+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505214,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":466,"num_read_kb":10894,"num_write":1166,"num_write_kb":33356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'698","reported_seq":2159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.637861+0000","last_change":"2024-03-09T14:28:55.582893+0000","last_active":"2024-03-09T15:06:29.637861+0000","last_peered":"2024-03-09T15:06:29.637861+0000","last_clean":"2024-03-09T15:06:29.637861+0000","last_became_active":"2024-03-09T14:28:55.578705+0000","last_became_peered":"2024-03-09T14:28:55.578705+0000","last_unstale":"2024-03-09T15:06:29.637861+0000","last_undegraded":"2024-03-09T15:06:29.637861+0000","last_fullsized":"2024-03-09T15:06:29.637861+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":600,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3212,"num_read_kb":2884,"num_write":923,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'308","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.480688+0000","last_change":"2024-03-09T15:07:28.480771+0000","last_active":"2024-03-09T15:07:28.480688+0000","last_peered":"2024-03-09T15:07:28.480688+0000","last_clean":"2024-03-09T15:07:28.480688+0000","last_became_active":"2024-03-09T14:28:53.617469+0000","last_became_peered":"2024-03-09T14:28:53.617469+0000","last_unstale":"2024-03-09T15:07:28.480688+0000","last_undegraded":"2024-03-09T15:07:28.480688+0000","last_fullsized":"2024-03-09T15:07:28.480688+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-03-09T15:07:28.480493+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-03-09T15:07:28.480493+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.480493+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:02:21.546672+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":486,"num_read_kb":96508,"num_write":1206,"num_write_kb":39289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'478","reported_seq":2163,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.553822+0000","last_change":"2024-03-09T15:07:29.553974+0000","last_active":"2024-03-09T15:07:29.553822+0000","last_peered":"2024-03-09T15:07:29.553822+0000","last_clean":"2024-03-09T15:07:29.553822+0000","last_became_active":"2024-03-09T14:28:55.594171+0000","last_became_peered":"2024-03-09T14:28:55.594171+0000","last_unstale":"2024-03-09T15:07:29.553822+0000","last_undegraded":"2024-03-09T15:07:29.553822+0000","last_fullsized":"2024-03-09T15:07:29.553822+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'478","last_scrub_stamp":"2024-03-09T15:07:29.553598+0000","last_deep_scrub":"264'478","last_deep_scrub_stamp":"2024-03-09T15:07:29.553598+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.553598+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:23:50.963569+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2696,"num_read_kb":2529,"num_write":600,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'314","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.421497+0000","last_change":"2024-03-09T14:28:53.627660+0000","last_active":"2024-03-09T15:07:05.421497+0000","last_peered":"2024-03-09T15:07:05.421497+0000","last_clean":"2024-03-09T15:07:05.421497+0000","last_became_active":"2024-03-09T14:28:53.627011+0000","last_became_peered":"2024-03-09T14:28:53.627011+0000","last_unstale":"2024-03-09T15:07:05.421497+0000","last_undegraded":"2024-03-09T15:07:05.421497+0000","last_fullsized":"2024-03-09T15:07:05.421497+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524303,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":582,"num_read_kb":86707,"num_write":1181,"num_write_kb":21935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'404","reported_seq":2037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:28.259387+0000","last_change":"2024-03-09T14:28:55.578260+0000","last_active":"2024-03-09T15:06:28.259387+0000","last_peered":"2024-03-09T15:06:28.259387+0000","last_clean":"2024-03-09T15:06:28.259387+0000","last_became_active":"2024-03-09T14:28:55.577524+0000","last_became_peered":"2024-03-09T14:28:55.577524+0000","last_unstale":"2024-03-09T15:06:28.259387+0000","last_undegraded":"2024-03-09T15:06:28.259387+0000","last_fullsized":"2024-03-09T15:06:28.259387+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2346,"num_read_kb":2237,"num_write":463,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'369","reported_seq":1129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.365261+0000","last_change":"2024-03-09T14:28:53.579012+0000","last_active":"2024-03-09T15:07:05.365261+0000","last_peered":"2024-03-09T15:07:05.365261+0000","last_clean":"2024-03-09T15:07:05.365261+0000","last_became_active":"2024-03-09T14:28:53.578574+0000","last_became_peered":"2024-03-09T14:28:53.578574+0000","last_unstale":"2024-03-09T15:07:05.365261+0000","last_undegraded":"2024-03-09T15:07:05.365261+0000","last_fullsized":"2024-03-09T15:07:05.365261+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269860,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":896,"num_read_kb":59109,"num_write":1337,"num_write_kb":49113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'697","reported_seq":2180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.975058+0000","last_change":"2024-03-09T14:28:55.597239+0000","last_active":"2024-03-09T15:06:29.975058+0000","last_peered":"2024-03-09T15:06:29.975058+0000","last_clean":"2024-03-09T15:06:29.975058+0000","last_became_active":"2024-03-09T14:28:55.596637+0000","last_became_peered":"2024-03-09T14:28:55.596637+0000","last_unstale":"2024-03-09T15:06:29.975058+0000","last_undegraded":"2024-03-09T15:06:29.975058+0000","last_fullsized":"2024-03-09T15:06:29.975058+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3232,"num_read_kb":2910,"num_write":917,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'266","reported_seq":864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.388562+0000","last_change":"2024-03-09T14:28:53.578550+0000","last_active":"2024-03-09T15:07:05.388562+0000","last_peered":"2024-03-09T15:07:05.388562+0000","last_clean":"2024-03-09T15:07:05.388562+0000","last_became_active":"2024-03-09T14:28:53.577994+0000","last_became_peered":"2024-03-09T14:28:53.577994+0000","last_unstale":"2024-03-09T15:07:05.388562+0000","last_undegraded":"2024-03-09T15:07:05.388562+0000","last_fullsized":"2024-03-09T15:07:05.388562+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22703,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":387,"num_read_kb":10775,"num_write":997,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'1034","reported_seq":2410,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.937850+0000","last_change":"2024-03-09T14:28:55.598885+0000","last_active":"2024-03-09T15:06:39.937850+0000","last_peered":"2024-03-09T15:06:39.937850+0000","last_clean":"2024-03-09T15:06:39.937850+0000","last_became_active":"2024-03-09T14:28:55.598235+0000","last_became_peered":"2024-03-09T14:28:55.598235+0000","last_unstale":"2024-03-09T15:06:39.937850+0000","last_undegraded":"2024-03-09T15:06:39.937850+0000","last_fullsized":"2024-03-09T15:06:39.937850+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":1000,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4348,"num_read_kb":3780,"num_write":1436,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'378","reported_seq":1065,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.380489+0000","last_change":"2024-03-09T14:28:53.591761+0000","last_active":"2024-03-09T15:07:05.380489+0000","last_peered":"2024-03-09T15:07:05.380489+0000","last_clean":"2024-03-09T15:07:05.380489+0000","last_became_active":"2024-03-09T14:28:53.591365+0000","last_became_peered":"2024-03-09T14:28:53.591365+0000","last_unstale":"2024-03-09T15:07:05.380489+0000","last_undegraded":"2024-03-09T15:07:05.380489+0000","last_fullsized":"2024-03-09T15:07:05.380489+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262246,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":674,"num_read_kb":645,"num_write":1631,"num_write_kb":21789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'477","reported_seq":1850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.034862+0000","last_change":"2024-03-09T15:07:24.034950+0000","last_active":"2024-03-09T15:07:24.034862+0000","last_peered":"2024-03-09T15:07:24.034862+0000","last_clean":"2024-03-09T15:07:24.034862+0000","last_became_active":"2024-03-09T14:29:28.738427+0000","last_became_peered":"2024-03-09T14:29:28.738427+0000","last_unstale":"2024-03-09T15:07:24.034862+0000","last_undegraded":"2024-03-09T15:07:24.034862+0000","last_fullsized":"2024-03-09T15:07:24.034862+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'477","last_scrub_stamp":"2024-03-09T15:07:24.034674+0000","last_deep_scrub":"264'477","last_deep_scrub_stamp":"2024-03-09T15:07:24.034674+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.034674+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:11:05.508803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2425,"num_read_kb":2201,"num_write":660,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'336","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.420874+0000","last_change":"2024-03-09T14:28:53.638759+0000","last_active":"2024-03-09T15:07:05.420874+0000","last_peered":"2024-03-09T15:07:05.420874+0000","last_clean":"2024-03-09T15:07:05.420874+0000","last_became_active":"2024-03-09T14:28:53.635866+0000","last_became_peered":"2024-03-09T14:28:53.635866+0000","last_unstale":"2024-03-09T15:07:05.420874+0000","last_undegraded":"2024-03-09T15:07:05.420874+0000","last_fullsized":"2024-03-09T15:07:05.420874+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049633,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":549,"num_read_kb":68120,"num_write":1314,"num_write_kb":51277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'627","reported_seq":2304,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.266360+0000","last_change":"2024-03-09T15:07:28.266429+0000","last_active":"2024-03-09T15:07:28.266360+0000","last_peered":"2024-03-09T15:07:28.266360+0000","last_clean":"2024-03-09T15:07:28.266360+0000","last_became_active":"2024-03-09T14:28:55.596430+0000","last_became_peered":"2024-03-09T14:28:55.596430+0000","last_unstale":"2024-03-09T15:07:28.266360+0000","last_undegraded":"2024-03-09T15:07:28.266360+0000","last_fullsized":"2024-03-09T15:07:28.266360+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'627","last_scrub_stamp":"2024-03-09T15:07:28.266175+0000","last_deep_scrub":"264'627","last_deep_scrub_stamp":"2024-03-09T15:07:28.266175+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.266175+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":600,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:02:30.550543+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3224,"num_read_kb":2919,"num_write":927,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'306","reported_seq":917,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.412588+0000","last_change":"2024-03-09T14:28:53.585196+0000","last_active":"2024-03-09T15:07:05.412588+0000","last_peered":"2024-03-09T15:07:05.412588+0000","last_clean":"2024-03-09T15:07:05.412588+0000","last_became_active":"2024-03-09T14:28:53.584780+0000","last_became_peered":"2024-03-09T14:28:53.584780+0000","last_unstale":"2024-03-09T15:07:05.412588+0000","last_undegraded":"2024-03-09T15:07:05.412588+0000","last_fullsized":"2024-03-09T15:07:05.412588+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262191,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":406,"num_read_kb":4504,"num_write":1224,"num_write_kb":43139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1138","reported_seq":2641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.306194+0000","last_change":"2024-03-09T14:28:55.585579+0000","last_active":"2024-03-09T15:06:41.306194+0000","last_peered":"2024-03-09T15:06:41.306194+0000","last_clean":"2024-03-09T15:06:41.306194+0000","last_became_active":"2024-03-09T14:28:55.582655+0000","last_became_peered":"2024-03-09T14:28:55.582655+0000","last_unstale":"2024-03-09T15:06:41.306194+0000","last_undegraded":"2024-03-09T15:06:41.306194+0000","last_fullsized":"2024-03-09T15:06:41.306194+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":1100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4834,"num_read_kb":4203,"num_write":1586,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'421","reported_seq":1123,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.378056+0000","last_change":"2024-03-09T14:28:53.627517+0000","last_active":"2024-03-09T15:07:05.378056+0000","last_peered":"2024-03-09T15:07:05.378056+0000","last_clean":"2024-03-09T15:07:05.378056+0000","last_became_active":"2024-03-09T14:28:53.626746+0000","last_became_peered":"2024-03-09T14:28:53.626746+0000","last_unstale":"2024-03-09T15:07:05.378056+0000","last_undegraded":"2024-03-09T15:07:05.378056+0000","last_fullsized":"2024-03-09T15:07:05.378056+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262222,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":818,"num_read_kb":5936,"num_write":1494,"num_write_kb":27133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'403","reported_seq":2032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.307914+0000","last_change":"2024-03-09T14:28:55.575483+0000","last_active":"2024-03-09T15:06:41.307914+0000","last_peered":"2024-03-09T15:06:41.307914+0000","last_clean":"2024-03-09T15:06:41.307914+0000","last_became_active":"2024-03-09T14:28:55.574723+0000","last_became_peered":"2024-03-09T14:28:55.574723+0000","last_unstale":"2024-03-09T15:06:41.307914+0000","last_undegraded":"2024-03-09T15:06:41.307914+0000","last_fullsized":"2024-03-09T15:06:41.307914+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2270,"num_read_kb":2181,"num_write":450,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'371","reported_seq":1249,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.983603+0000","last_change":"2024-03-09T14:28:53.565397+0000","last_active":"2024-03-09T15:07:09.983603+0000","last_peered":"2024-03-09T15:07:09.983603+0000","last_clean":"2024-03-09T15:07:09.983603+0000","last_became_active":"2024-03-09T14:28:53.564605+0000","last_became_peered":"2024-03-09T14:28:53.564605+0000","last_unstale":"2024-03-09T15:07:09.983603+0000","last_undegraded":"2024-03-09T15:07:09.983603+0000","last_fullsized":"2024-03-09T15:07:09.983603+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1026,"num_read_kb":12227,"num_write":1373,"num_write_kb":35283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'474","reported_seq":2094,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.359842+0000","last_change":"2024-03-09T14:28:55.596361+0000","last_active":"2024-03-09T15:07:10.359842+0000","last_peered":"2024-03-09T15:07:10.359842+0000","last_clean":"2024-03-09T15:07:10.359842+0000","last_became_active":"2024-03-09T14:28:55.596007+0000","last_became_peered":"2024-03-09T14:28:55.596007+0000","last_unstale":"2024-03-09T15:07:10.359842+0000","last_undegraded":"2024-03-09T15:07:10.359842+0000","last_fullsized":"2024-03-09T15:07:10.359842+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2627,"num_read_kb":2464,"num_write":596,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'263","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.926942+0000","last_change":"2024-03-09T14:28:53.638536+0000","last_active":"2024-03-09T15:07:09.926942+0000","last_peered":"2024-03-09T15:07:09.926942+0000","last_clean":"2024-03-09T15:07:09.926942+0000","last_became_active":"2024-03-09T14:28:53.637905+0000","last_became_peered":"2024-03-09T14:28:53.637905+0000","last_unstale":"2024-03-09T15:07:09.926942+0000","last_undegraded":"2024-03-09T15:07:09.926942+0000","last_fullsized":"2024-03-09T15:07:09.926942+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":369,"num_read_kb":388,"num_write":1032,"num_write_kb":15956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'865","reported_seq":2404,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.741570+0000","last_change":"2024-03-09T14:28:55.590315+0000","last_active":"2024-03-09T15:07:09.741570+0000","last_peered":"2024-03-09T15:07:09.741570+0000","last_clean":"2024-03-09T15:07:09.741570+0000","last_became_active":"2024-03-09T14:28:55.589596+0000","last_became_peered":"2024-03-09T14:28:55.589596+0000","last_unstale":"2024-03-09T15:07:09.741570+0000","last_undegraded":"2024-03-09T15:07:09.741570+0000","last_fullsized":"2024-03-09T15:07:09.741570+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":800,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4032,"num_read_kb":3559,"num_write":1203,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'316","reported_seq":1056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.437485+0000","last_change":"2024-03-09T14:28:53.627710+0000","last_active":"2024-03-09T15:07:09.437485+0000","last_peered":"2024-03-09T15:07:09.437485+0000","last_clean":"2024-03-09T15:07:09.437485+0000","last_became_active":"2024-03-09T14:28:53.626673+0000","last_became_peered":"2024-03-09T14:28:53.626673+0000","last_unstale":"2024-03-09T15:07:09.437485+0000","last_undegraded":"2024-03-09T15:07:09.437485+0000","last_fullsized":"2024-03-09T15:07:09.437485+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":573,"num_read_kb":94146,"num_write":1092,"num_write_kb":28965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'470","reported_seq":1982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.750550+0000","last_change":"2024-03-09T14:28:55.610858+0000","last_active":"2024-03-09T15:07:09.750550+0000","last_peered":"2024-03-09T15:07:09.750550+0000","last_clean":"2024-03-09T15:07:09.750550+0000","last_became_active":"2024-03-09T14:28:55.610314+0000","last_became_peered":"2024-03-09T14:28:55.610314+0000","last_unstale":"2024-03-09T15:07:09.750550+0000","last_undegraded":"2024-03-09T15:07:09.750550+0000","last_fullsized":"2024-03-09T15:07:09.750550+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2645,"num_read_kb":2435,"num_write":625,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'356","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.738918+0000","last_change":"2024-03-09T14:28:53.632280+0000","last_active":"2024-03-09T15:07:09.738918+0000","last_peered":"2024-03-09T15:07:09.738918+0000","last_clean":"2024-03-09T15:07:09.738918+0000","last_became_active":"2024-03-09T14:28:53.631327+0000","last_became_peered":"2024-03-09T14:28:53.631327+0000","last_unstale":"2024-03-09T15:07:09.738918+0000","last_undegraded":"2024-03-09T15:07:09.738918+0000","last_fullsized":"2024-03-09T15:07:09.738918+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":582,"num_read_kb":48859,"num_write":1226,"num_write_kb":49653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'386","reported_seq":1871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.437099+0000","last_change":"2024-03-09T14:28:55.587624+0000","last_active":"2024-03-09T15:07:09.437099+0000","last_peered":"2024-03-09T15:07:09.437099+0000","last_clean":"2024-03-09T15:07:09.437099+0000","last_became_active":"2024-03-09T14:28:55.587355+0000","last_became_peered":"2024-03-09T14:28:55.587355+0000","last_unstale":"2024-03-09T15:07:09.437099+0000","last_undegraded":"2024-03-09T15:07:09.437099+0000","last_fullsized":"2024-03-09T15:07:09.437099+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2078,"num_read_kb":1975,"num_write":455,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'395","reported_seq":1049,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.840206+0000","last_change":"2024-03-09T14:28:53.624013+0000","last_active":"2024-03-09T15:07:12.840206+0000","last_peered":"2024-03-09T15:07:12.840206+0000","last_clean":"2024-03-09T15:07:12.840206+0000","last_became_active":"2024-03-09T14:28:53.622624+0000","last_became_peered":"2024-03-09T14:28:53.622624+0000","last_unstale":"2024-03-09T15:07:12.840206+0000","last_undegraded":"2024-03-09T15:07:12.840206+0000","last_fullsized":"2024-03-09T15:07:12.840206+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262192,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":653,"num_read_kb":22046,"num_write":1243,"num_write_kb":48993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'1099","reported_seq":2575,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.983632+0000","last_change":"2024-03-09T14:28:55.591286+0000","last_active":"2024-03-09T15:07:09.983632+0000","last_peered":"2024-03-09T15:07:09.983632+0000","last_clean":"2024-03-09T15:07:09.983632+0000","last_became_active":"2024-03-09T14:28:55.582143+0000","last_became_peered":"2024-03-09T14:28:55.582143+0000","last_unstale":"2024-03-09T15:07:09.983632+0000","last_undegraded":"2024-03-09T15:07:09.983632+0000","last_fullsized":"2024-03-09T15:07:09.983632+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":1000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4588,"num_read_kb":3996,"num_write":1519,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'363","reported_seq":1097,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.530647+0000","last_change":"2024-03-09T15:07:29.530760+0000","last_active":"2024-03-09T15:07:29.530647+0000","last_peered":"2024-03-09T15:07:29.530647+0000","last_clean":"2024-03-09T15:07:29.530647+0000","last_became_active":"2024-03-09T14:28:53.633121+0000","last_became_peered":"2024-03-09T14:28:53.633121+0000","last_unstale":"2024-03-09T15:07:29.530647+0000","last_undegraded":"2024-03-09T15:07:29.530647+0000","last_fullsized":"2024-03-09T15:07:29.530647+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'363","last_scrub_stamp":"2024-03-09T15:07:29.530472+0000","last_deep_scrub":"264'363","last_deep_scrub_stamp":"2024-03-09T15:07:29.530472+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.530472+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:42:58.011768+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3312503,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":707,"num_read_kb":9275,"num_write":1371,"num_write_kb":66964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'676","reported_seq":2115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:41.306819+0000","last_change":"2024-03-09T14:28:55.602146+0000","last_active":"2024-03-09T15:06:41.306819+0000","last_peered":"2024-03-09T15:06:41.306819+0000","last_clean":"2024-03-09T15:06:41.306819+0000","last_became_active":"2024-03-09T14:28:55.601622+0000","last_became_peered":"2024-03-09T14:28:55.601622+0000","last_unstale":"2024-03-09T15:06:41.306819+0000","last_undegraded":"2024-03-09T15:06:41.306819+0000","last_fullsized":"2024-03-09T15:06:41.306819+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":600,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3103,"num_read_kb":2796,"num_write":889,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'405","reported_seq":1140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.604375+0000","last_change":"2024-03-09T15:07:21.604740+0000","last_active":"2024-03-09T15:07:21.604375+0000","last_peered":"2024-03-09T15:07:21.604375+0000","last_clean":"2024-03-09T15:07:21.604375+0000","last_became_active":"2024-03-09T14:29:28.827826+0000","last_became_peered":"2024-03-09T14:29:28.827826+0000","last_unstale":"2024-03-09T15:07:21.604375+0000","last_undegraded":"2024-03-09T15:07:21.604375+0000","last_fullsized":"2024-03-09T15:07:21.604375+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-03-09T15:07:21.604112+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-03-09T15:07:21.604112+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.604112+0000","objects_scrubbed":10,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:36:26.048379+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918827,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":881,"num_read_kb":41003,"num_write":1564,"num_write_kb":37571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"264'297","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.372813+0000","last_change":"2024-03-09T14:28:53.603932+0000","last_active":"2024-03-09T15:07:05.372813+0000","last_peered":"2024-03-09T15:07:05.372813+0000","last_clean":"2024-03-09T15:07:05.372813+0000","last_became_active":"2024-03-09T14:28:53.602502+0000","last_became_peered":"2024-03-09T14:28:53.602502+0000","last_unstale":"2024-03-09T15:07:05.372813+0000","last_undegraded":"2024-03-09T15:07:05.372813+0000","last_fullsized":"2024-03-09T15:07:05.372813+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":396,"num_read_kb":11977,"num_write":1066,"num_write_kb":41245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'855","reported_seq":2304,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.353753+0000","last_change":"2024-03-09T14:28:55.602029+0000","last_active":"2024-03-09T15:06:24.353753+0000","last_peered":"2024-03-09T15:06:24.353753+0000","last_clean":"2024-03-09T15:06:24.353753+0000","last_became_active":"2024-03-09T14:28:55.601537+0000","last_became_peered":"2024-03-09T14:28:55.601537+0000","last_unstale":"2024-03-09T15:06:24.353753+0000","last_undegraded":"2024-03-09T15:06:24.353753+0000","last_fullsized":"2024-03-09T15:06:24.353753+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":800,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3890,"num_read_kb":3404,"num_write":1199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'348","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.407237+0000","last_change":"2024-03-09T14:28:53.589127+0000","last_active":"2024-03-09T15:07:05.407237+0000","last_peered":"2024-03-09T15:07:05.407237+0000","last_clean":"2024-03-09T15:07:05.407237+0000","last_became_active":"2024-03-09T14:28:53.588717+0000","last_became_peered":"2024-03-09T14:28:53.588717+0000","last_unstale":"2024-03-09T15:07:05.407237+0000","last_undegraded":"2024-03-09T15:07:05.407237+0000","last_fullsized":"2024-03-09T15:07:05.407237+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286749,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":569,"num_read_kb":5745,"num_write":1174,"num_write_kb":28449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'1155","reported_seq":2683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:53.497112+0000","last_change":"2024-03-09T14:28:55.583336+0000","last_active":"2024-03-09T15:06:53.497112+0000","last_peered":"2024-03-09T15:06:53.497112+0000","last_clean":"2024-03-09T15:06:53.497112+0000","last_became_active":"2024-03-09T14:28:55.582541+0000","last_became_peered":"2024-03-09T14:28:55.582541+0000","last_unstale":"2024-03-09T15:06:53.497112+0000","last_undegraded":"2024-03-09T15:06:53.497112+0000","last_fullsized":"2024-03-09T15:06:53.497112+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4871,"num_read_kb":4234,"num_write":1610,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5930,"num_read_kb":4217,"num_write":2190,"num_write_kb":844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7263,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1125,"ondisk_log_size":1125,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":13413,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":15557,"num_read_kb":15326,"num_write":16235,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2218,"num_omap_keys":13,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":26826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1623,"ondisk_log_size":1623,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":433,"ondisk_log_size":433,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1466895,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":16241,"num_read_kb":34652,"num_write":13827,"num_write_kb":11138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":631348,"num_omap_keys":1476,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2112,"ondisk_log_size":2112,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1622,"num_read_kb":1927,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14,"ondisk_log_size":14,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":194579,"num_read_kb":177681,"num_write":51390,"num_write_kb":17534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":132,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4080,"ondisk_log_size":4080,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":142827823,"num_objects":361,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":361,"num_whiteouts":0,"num_read":34808,"num_read_kb":1970678,"num_write":77579,"num_write_kb":2252311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":193282048,"data_stored":193282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3795,"ondisk_log_size":3795,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":180405,"num_write":150,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":133,"num_read_kb":177288,"num_write":150,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575321,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":360960,"kb_used_data":41016,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":94010880,"statfs":{"total":96636764160,"available":96267141120,"internally_reserved":0,"allocated":42000384,"data_stored":40009750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":327612874},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575318,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":346200,"kb_used_data":35984,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":94025640,"statfs":{"total":96636764160,"available":96282255360,"internally_reserved":0,"allocated":36847616,"data_stored":34892402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":317651398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575322,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":176544,"kb_used_data":41304,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94195296,"statfs":{"total":96636764160,"available":96455983104,"internally_reserved":0,"allocated":42295296,"data_stored":40303321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575319,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173472,"kb_used_data":43736,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94198368,"statfs":{"total":96636764160,"available":96459128832,"internally_reserved":0,"allocated":44785664,"data_stored":42869751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575321,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301360,"kb_used_data":35560,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94070480,"statfs":{"total":96636764160,"available":96328171520,"internally_reserved":0,"allocated":36413440,"data_stored":34419369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":272169415},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575317,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":135436,"kb_used_data":27908,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94236404,"statfs":{"total":96636764160,"available":96498077696,"internally_reserved":0,"allocated":28577792,"data_stored":26654129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575321,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209596,"kb_used_data":34100,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94162244,"statfs":{"total":96636764160,"available":96422137856,"internally_reserved":0,"allocated":34918400,"data_stored":32958583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575318,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":294704,"kb_used_data":28904,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94077136,"statfs":{"total":96636764160,"available":96334987264,"internally_reserved":0,"allocated":29597696,"data_stored":27607131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23699456,"data_stored":23699456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24399872,"data_stored":24399872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19144704,"data_stored":19144704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21663744,"data_stored":21663744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24875008,"data_stored":24875008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21258240,"data_stored":21258240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27381760,"data_stored":27381760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":30859264,"data_stored":30859264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:07:33.719 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.720 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.720 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.720 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.720 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.720 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.721 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.721 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.721 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.721 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.721 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.721 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.722 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.722 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.722 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.722 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.722 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.722 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.723 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.723 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.723 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.723 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.723 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.723 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.724 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.724 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.724 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.724 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.724 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.724 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.725 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.725 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.725 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.725 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.726 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.726 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.726 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.726 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.727 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.727 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.727 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.727 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-03-09T14:39:56.844736+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=39, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.727 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.727 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.728 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.728 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.728 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.728 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.728 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.729 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.729 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.729 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.729 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.729 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.729 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.730 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.730 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.730 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.730 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.730 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.730 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.731 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.731 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.731 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.731 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.731 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.731 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.732 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.732 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.732 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.732 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.732 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.732 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.733 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.733 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.733 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.733 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.733 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.733 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.734 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.734 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.734 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.734 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.734 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.734 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.735 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.735 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.735 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.735 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.735 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.735 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.736 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.736 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.736 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.736 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.736 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.736 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.737 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.737 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.737 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.737 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.737 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.737 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.738 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.738 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.738 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.738 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.738 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.738 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.739 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.739 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.739 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.739 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.739 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.739 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.740 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.740 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.740 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.740 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.740 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.740 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.741 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.741 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.741 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.741 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.741 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.742 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.742 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.742 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.742 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.742 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.742 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.743 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.743 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-09T14:28:35.777784+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.743 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-09T14:28:40.805752+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.743 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.743 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.743 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.744 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.744 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.744 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-09T14:28:40.805752+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.744 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.744 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.744 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.745 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.745 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.745 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.745 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.745 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-09T14:28:40.805752+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.745 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.746 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.746 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.746 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.746 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-09T14:28:40.805752+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.746 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.746 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.747 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.747 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.747 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-09T14:28:40.805752+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.747 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.747 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.748 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.748 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-09T14:28:40.805752+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.748 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.748 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.748 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.748 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.748 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-09T14:28:40.805752+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.749 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.749 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.749 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.749 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.749 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.749 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.750 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.750 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.750 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.750 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.750 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.751 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.751 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.751 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.751 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.751 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.751 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.752 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.752 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.752 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.752 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.752 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.752 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.753 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-09T14:29:02.604578+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=2, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.753 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.753 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.753 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.753 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.753 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-03-09T14:29:00.586122+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=29, tm_sec=0, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.754 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.754 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.754 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.754 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.754 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.754 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.755 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.755 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.755 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.755 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.755 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.755 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.756 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.756 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.756 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.756 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.756 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.756 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.757 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.757 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.757 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.757 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.757 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.757 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.758 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.758 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.758 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.758 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.758 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.758 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.759 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.759 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.759 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.759 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.759 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.759 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.760 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.760 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.760 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.760 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.760 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.760 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.761 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.761 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:33.761 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-09T15:07:53.762 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:07:54.140 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:07:54.153 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-09T15:07:54.157 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":1436,"stamp":"2024-03-09T15:07:52.878238+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":178454650,"num_objects":799,"num_object_clones":0,"num_object_copies":2320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":799,"num_whiteouts":0,"num_read":269134,"num_read_kb":2562286,"num_write":161720,"num_write_kb":2520695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":176,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709154,"num_omap_keys":1706,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13293,"ondisk_log_size":13293,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1998272,"kb_used_data":288512,"kb_used_omap":12,"kb_used_meta":1709683,"kb_avail":752976448,"statfs":{"total":773094113280,"available":771047882752,"internally_reserved":0,"allocated":295436288,"data_stored":279714436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1750715952},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":19953,"num_omap_keys":62,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010050"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.954755+0000","last_change":"2024-03-09T14:49:53.659913+0000","last_active":"2024-03-09T15:07:11.954755+0000","last_peered":"2024-03-09T15:07:11.954755+0000","last_clean":"2024-03-09T15:07:11.954755+0000","last_became_active":"2024-03-09T14:49:53.656173+0000","last_became_peered":"2024-03-09T14:49:53.656173+0000","last_unstale":"2024-03-09T15:07:11.954755+0000","last_undegraded":"2024-03-09T15:07:11.954755+0000","last_fullsized":"2024-03-09T15:07:11.954755+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.954531+0000","last_change":"2024-03-09T14:42:19.006802+0000","last_active":"2024-03-09T15:07:11.954531+0000","last_peered":"2024-03-09T15:07:11.954531+0000","last_clean":"2024-03-09T15:07:11.954531+0000","last_became_active":"2024-03-09T14:42:19.006064+0000","last_became_peered":"2024-03-09T14:42:19.006064+0000","last_unstale":"2024-03-09T15:07:11.954531+0000","last_undegraded":"2024-03-09T15:07:11.954531+0000","last_fullsized":"2024-03-09T15:07:11.954531+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.016424+0000","last_change":"2024-03-09T15:07:13.016424+0000","last_active":"2024-03-09T15:07:13.016424+0000","last_peered":"2024-03-09T15:07:13.016424+0000","last_clean":"2024-03-09T15:07:13.016424+0000","last_became_active":"2024-03-09T14:42:15.928518+0000","last_became_peered":"2024-03-09T14:42:15.928518+0000","last_unstale":"2024-03-09T15:07:13.016424+0000","last_undegraded":"2024-03-09T15:07:13.016424+0000","last_fullsized":"2024-03-09T15:07:13.016424+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:13.016259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:13.016259+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.016259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:32:55.901082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'49","reported_seq":165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.732265+0000","last_change":"2024-03-09T15:07:09.732293+0000","last_active":"2024-03-09T15:07:09.732265+0000","last_peered":"2024-03-09T15:07:09.732265+0000","last_clean":"2024-03-09T15:07:09.732265+0000","last_became_active":"2024-03-09T14:39:57.901879+0000","last_became_peered":"2024-03-09T14:39:57.901879+0000","last_unstale":"2024-03-09T15:07:09.732265+0000","last_undegraded":"2024-03-09T15:07:09.732265+0000","last_fullsized":"2024-03-09T15:07:09.732265+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-03-09T15:07:09.732154+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-03-09T15:07:09.732154+0000","last_clean_scrub_stamp":"2024-03-09T15:07:09.732154+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:47.058510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":129,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.487794+0000","last_change":"2024-03-09T15:07:42.487849+0000","last_active":"2024-03-09T15:07:42.487794+0000","last_peered":"2024-03-09T15:07:42.487794+0000","last_clean":"2024-03-09T15:07:42.487794+0000","last_became_active":"2024-03-09T14:49:53.684941+0000","last_became_peered":"2024-03-09T14:49:53.684941+0000","last_unstale":"2024-03-09T15:07:42.487794+0000","last_undegraded":"2024-03-09T15:07:42.487794+0000","last_fullsized":"2024-03-09T15:07:42.487794+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:42.487592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:42.487592+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.487592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:52.648364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.265626+0000","last_change":"2024-03-09T14:42:19.016523+0000","last_active":"2024-03-09T15:07:11.265626+0000","last_peered":"2024-03-09T15:07:11.265626+0000","last_clean":"2024-03-09T15:07:11.265626+0000","last_became_active":"2024-03-09T14:42:19.011453+0000","last_became_peered":"2024-03-09T14:42:19.011453+0000","last_unstale":"2024-03-09T15:07:11.265626+0000","last_undegraded":"2024-03-09T15:07:11.265626+0000","last_fullsized":"2024-03-09T15:07:11.265626+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.004521+0000","last_change":"2024-03-09T15:07:16.004521+0000","last_active":"2024-03-09T15:07:16.004521+0000","last_peered":"2024-03-09T15:07:16.004521+0000","last_clean":"2024-03-09T15:07:16.004521+0000","last_became_active":"2024-03-09T14:42:15.970720+0000","last_became_peered":"2024-03-09T14:42:15.970720+0000","last_unstale":"2024-03-09T15:07:16.004521+0000","last_undegraded":"2024-03-09T15:07:16.004521+0000","last_fullsized":"2024-03-09T15:07:16.004521+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:16.004189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:16.004189+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.004189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:56:28.921839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'3","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.474413+0000","last_change":"2024-03-09T15:07:25.474480+0000","last_active":"2024-03-09T15:07:25.474413+0000","last_peered":"2024-03-09T15:07:25.474413+0000","last_clean":"2024-03-09T15:07:25.474413+0000","last_became_active":"2024-03-09T14:39:57.894022+0000","last_became_peered":"2024-03-09T14:39:57.894022+0000","last_unstale":"2024-03-09T15:07:25.474413+0000","last_undegraded":"2024-03-09T15:07:25.474413+0000","last_fullsized":"2024-03-09T15:07:25.474413+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:25.474217+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:25.474217+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.474217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:13.689373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.013882+0000","last_change":"2024-03-09T15:07:49.013988+0000","last_active":"2024-03-09T15:07:49.013882+0000","last_peered":"2024-03-09T15:07:49.013882+0000","last_clean":"2024-03-09T15:07:49.013882+0000","last_became_active":"2024-03-09T14:49:53.676530+0000","last_became_peered":"2024-03-09T14:49:53.676530+0000","last_unstale":"2024-03-09T15:07:49.013882+0000","last_undegraded":"2024-03-09T15:07:49.013882+0000","last_fullsized":"2024-03-09T15:07:49.013882+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:49.013657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:49.013657+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.013657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:05:49.238949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.438181+0000","last_change":"2024-03-09T14:42:19.295942+0000","last_active":"2024-03-09T15:07:09.438181+0000","last_peered":"2024-03-09T15:07:09.438181+0000","last_clean":"2024-03-09T15:07:09.438181+0000","last_became_active":"2024-03-09T14:42:19.295218+0000","last_became_peered":"2024-03-09T14:42:19.295218+0000","last_unstale":"2024-03-09T15:07:09.438181+0000","last_undegraded":"2024-03-09T15:07:09.438181+0000","last_fullsized":"2024-03-09T15:07:09.438181+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":63,"num_write":4,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"261'2","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.753005+0000","last_change":"2024-03-09T15:07:10.753071+0000","last_active":"2024-03-09T15:07:10.753005+0000","last_peered":"2024-03-09T15:07:10.753005+0000","last_clean":"2024-03-09T15:07:10.753005+0000","last_became_active":"2024-03-09T14:42:15.958052+0000","last_became_peered":"2024-03-09T14:42:15.958052+0000","last_unstale":"2024-03-09T15:07:10.753005+0000","last_undegraded":"2024-03-09T15:07:10.753005+0000","last_fullsized":"2024-03-09T15:07:10.753005+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:07:10.752824+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:07:10.752824+0000","last_clean_scrub_stamp":"2024-03-09T15:07:10.752824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:38:40.918092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'67","reported_seq":215,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.601652+0000","last_change":"2024-03-09T15:07:14.601652+0000","last_active":"2024-03-09T15:07:14.601652+0000","last_peered":"2024-03-09T15:07:14.601652+0000","last_clean":"2024-03-09T15:07:14.601652+0000","last_became_active":"2024-03-09T14:39:57.890452+0000","last_became_peered":"2024-03-09T14:39:57.890452+0000","last_unstale":"2024-03-09T15:07:14.601652+0000","last_undegraded":"2024-03-09T15:07:14.601652+0000","last_fullsized":"2024-03-09T15:07:14.601652+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'67","last_scrub_stamp":"2024-03-09T15:07:14.601392+0000","last_deep_scrub":"264'67","last_deep_scrub_stamp":"2024-03-09T15:07:14.601392+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.601392+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:28:58.020853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":205,"num_write":124,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:49.979500+0000","last_change":"2024-03-09T14:49:53.669862+0000","last_active":"2024-03-09T15:06:49.979500+0000","last_peered":"2024-03-09T15:06:49.979500+0000","last_clean":"2024-03-09T15:06:49.979500+0000","last_became_active":"2024-03-09T14:49:53.669178+0000","last_became_peered":"2024-03-09T14:49:53.669178+0000","last_unstale":"2024-03-09T15:06:49.979500+0000","last_undegraded":"2024-03-09T15:06:49.979500+0000","last_fullsized":"2024-03-09T15:06:49.979500+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'6","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.015521+0000","last_change":"2024-03-09T15:07:43.015583+0000","last_active":"2024-03-09T15:07:43.015521+0000","last_peered":"2024-03-09T15:07:43.015521+0000","last_clean":"2024-03-09T15:07:43.015521+0000","last_became_active":"2024-03-09T14:42:19.294235+0000","last_became_peered":"2024-03-09T14:42:19.294235+0000","last_unstale":"2024-03-09T15:07:43.015521+0000","last_undegraded":"2024-03-09T15:07:43.015521+0000","last_fullsized":"2024-03-09T15:07:43.015521+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-03-09T15:07:43.015317+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-03-09T15:07:43.015317+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.015317+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:23:53.260315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.265412+0000","last_change":"2024-03-09T14:42:15.958787+0000","last_active":"2024-03-09T15:07:11.265412+0000","last_peered":"2024-03-09T15:07:11.265412+0000","last_clean":"2024-03-09T15:07:11.265412+0000","last_became_active":"2024-03-09T14:42:15.957974+0000","last_became_peered":"2024-03-09T14:42:15.957974+0000","last_unstale":"2024-03-09T15:07:11.265412+0000","last_undegraded":"2024-03-09T15:07:11.265412+0000","last_fullsized":"2024-03-09T15:07:11.265412+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'35","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.986504+0000","last_change":"2024-03-09T15:07:15.986504+0000","last_active":"2024-03-09T15:07:15.986504+0000","last_peered":"2024-03-09T15:07:15.986504+0000","last_clean":"2024-03-09T15:07:15.986504+0000","last_became_active":"2024-03-09T14:39:57.909761+0000","last_became_peered":"2024-03-09T14:39:57.909761+0000","last_unstale":"2024-03-09T15:07:15.986504+0000","last_undegraded":"2024-03-09T15:07:15.986504+0000","last_fullsized":"2024-03-09T15:07:15.986504+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-03-09T15:07:15.986243+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-03-09T15:07:15.986243+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.986243+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:35:47.596327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":109,"num_write":58,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:54.967654+0000","last_change":"2024-03-09T14:49:53.678276+0000","last_active":"2024-03-09T15:05:54.967654+0000","last_peered":"2024-03-09T15:05:54.967654+0000","last_clean":"2024-03-09T15:05:54.967654+0000","last_became_active":"2024-03-09T14:49:53.676902+0000","last_became_peered":"2024-03-09T14:49:53.676902+0000","last_unstale":"2024-03-09T15:05:54.967654+0000","last_undegraded":"2024-03-09T15:05:54.967654+0000","last_fullsized":"2024-03-09T15:05:54.967654+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.919307+0000","last_change":"2024-03-09T14:42:19.008196+0000","last_active":"2024-03-09T15:06:34.919307+0000","last_peered":"2024-03-09T15:06:34.919307+0000","last_clean":"2024-03-09T15:06:34.919307+0000","last_became_active":"2024-03-09T14:42:19.006923+0000","last_became_peered":"2024-03-09T14:42:19.006923+0000","last_unstale":"2024-03-09T15:06:34.919307+0000","last_undegraded":"2024-03-09T15:06:34.919307+0000","last_fullsized":"2024-03-09T15:06:34.919307+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.638355+0000","last_change":"2024-03-09T15:07:23.638415+0000","last_active":"2024-03-09T15:07:23.638355+0000","last_peered":"2024-03-09T15:07:23.638355+0000","last_clean":"2024-03-09T15:07:23.638355+0000","last_became_active":"2024-03-09T14:42:15.971499+0000","last_became_peered":"2024-03-09T14:42:15.971499+0000","last_unstale":"2024-03-09T15:07:23.638355+0000","last_undegraded":"2024-03-09T15:07:23.638355+0000","last_fullsized":"2024-03-09T15:07:23.638355+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:23.638161+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:23.638161+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.638161+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:30:40.124428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'33","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.984015+0000","last_change":"2024-03-09T15:07:20.984015+0000","last_active":"2024-03-09T15:07:20.984015+0000","last_peered":"2024-03-09T15:07:20.984015+0000","last_clean":"2024-03-09T15:07:20.984015+0000","last_became_active":"2024-03-09T14:39:57.898849+0000","last_became_peered":"2024-03-09T14:39:57.898849+0000","last_unstale":"2024-03-09T15:07:20.984015+0000","last_undegraded":"2024-03-09T15:07:20.984015+0000","last_fullsized":"2024-03-09T15:07:20.984015+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-03-09T15:07:20.983762+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-03-09T15:07:20.983762+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.983762+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:55:54.652512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":100,"num_write":52,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:35.098171+0000","last_change":"2024-03-09T14:49:53.660759+0000","last_active":"2024-03-09T15:06:35.098171+0000","last_peered":"2024-03-09T15:06:35.098171+0000","last_clean":"2024-03-09T15:06:35.098171+0000","last_became_active":"2024-03-09T14:49:53.648332+0000","last_became_peered":"2024-03-09T14:49:53.648332+0000","last_unstale":"2024-03-09T15:06:35.098171+0000","last_undegraded":"2024-03-09T15:06:35.098171+0000","last_fullsized":"2024-03-09T15:06:35.098171+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'6","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.051703+0000","last_change":"2024-03-09T15:07:46.051767+0000","last_active":"2024-03-09T15:07:46.051703+0000","last_peered":"2024-03-09T15:07:46.051703+0000","last_clean":"2024-03-09T15:07:46.051703+0000","last_became_active":"2024-03-09T14:42:19.003868+0000","last_became_peered":"2024-03-09T14:42:19.003868+0000","last_unstale":"2024-03-09T15:07:46.051703+0000","last_undegraded":"2024-03-09T15:07:46.051703+0000","last_fullsized":"2024-03-09T15:07:46.051703+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:46.051508+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:46.051508+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.051508+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:32:25.347512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.794551+0000","last_change":"2024-03-09T15:07:26.794615+0000","last_active":"2024-03-09T15:07:26.794551+0000","last_peered":"2024-03-09T15:07:26.794551+0000","last_clean":"2024-03-09T15:07:26.794551+0000","last_became_active":"2024-03-09T14:42:15.947888+0000","last_became_peered":"2024-03-09T14:42:15.947888+0000","last_unstale":"2024-03-09T15:07:26.794551+0000","last_undegraded":"2024-03-09T15:07:26.794551+0000","last_fullsized":"2024-03-09T15:07:26.794551+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:26.794359+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:26.794359+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.794359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:52:28.250795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'23","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.281807+0000","last_change":"2024-03-09T15:07:13.281807+0000","last_active":"2024-03-09T15:07:13.281807+0000","last_peered":"2024-03-09T15:07:13.281807+0000","last_clean":"2024-03-09T15:07:13.281807+0000","last_became_active":"2024-03-09T14:39:57.907530+0000","last_became_peered":"2024-03-09T14:39:57.907530+0000","last_unstale":"2024-03-09T15:07:13.281807+0000","last_undegraded":"2024-03-09T15:07:13.281807+0000","last_fullsized":"2024-03-09T15:07:13.281807+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-03-09T15:07:13.281542+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-03-09T15:07:13.281542+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.281542+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:47:39.457125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":69,"num_write":39,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.841878+0000","last_change":"2024-03-09T14:49:53.677579+0000","last_active":"2024-03-09T15:07:12.841878+0000","last_peered":"2024-03-09T15:07:12.841878+0000","last_clean":"2024-03-09T15:07:12.841878+0000","last_became_active":"2024-03-09T14:49:53.676976+0000","last_became_peered":"2024-03-09T14:49:53.676976+0000","last_unstale":"2024-03-09T15:07:12.841878+0000","last_undegraded":"2024-03-09T15:07:12.841878+0000","last_fullsized":"2024-03-09T15:07:12.841878+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.028481+0000","last_change":"2024-03-09T15:07:47.028535+0000","last_active":"2024-03-09T15:07:47.028481+0000","last_peered":"2024-03-09T15:07:47.028481+0000","last_clean":"2024-03-09T15:07:47.028481+0000","last_became_active":"2024-03-09T14:42:19.008779+0000","last_became_peered":"2024-03-09T14:42:19.008779+0000","last_unstale":"2024-03-09T15:07:47.028481+0000","last_undegraded":"2024-03-09T15:07:47.028481+0000","last_fullsized":"2024-03-09T15:07:47.028481+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:47.028278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:47.028278+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.028278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:10:14.953446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'6","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.768833+0000","last_change":"2024-03-09T15:07:22.768898+0000","last_active":"2024-03-09T15:07:22.768833+0000","last_peered":"2024-03-09T15:07:22.768833+0000","last_clean":"2024-03-09T15:07:22.768833+0000","last_became_active":"2024-03-09T14:42:15.943177+0000","last_became_peered":"2024-03-09T14:42:15.943177+0000","last_unstale":"2024-03-09T15:07:22.768833+0000","last_undegraded":"2024-03-09T15:07:22.768833+0000","last_fullsized":"2024-03-09T15:07:22.768833+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:22.768655+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:22.768655+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.768655+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:13:44.014557+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'28","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.611668+0000","last_change":"2024-03-09T15:07:13.611732+0000","last_active":"2024-03-09T15:07:13.611668+0000","last_peered":"2024-03-09T15:07:13.611668+0000","last_clean":"2024-03-09T15:07:13.611668+0000","last_became_active":"2024-03-09T14:39:57.894343+0000","last_became_peered":"2024-03-09T14:39:57.894343+0000","last_unstale":"2024-03-09T15:07:13.611668+0000","last_undegraded":"2024-03-09T15:07:13.611668+0000","last_fullsized":"2024-03-09T15:07:13.611668+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-03-09T15:07:13.611465+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-03-09T15:07:13.611465+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.611465+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:20:23.924452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":82,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.841898+0000","last_change":"2024-03-09T14:49:53.666909+0000","last_active":"2024-03-09T15:07:12.841898+0000","last_peered":"2024-03-09T15:07:12.841898+0000","last_clean":"2024-03-09T15:07:12.841898+0000","last_became_active":"2024-03-09T14:49:53.666178+0000","last_became_peered":"2024-03-09T14:49:53.666178+0000","last_unstale":"2024-03-09T15:07:12.841898+0000","last_undegraded":"2024-03-09T15:07:12.841898+0000","last_fullsized":"2024-03-09T15:07:12.841898+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.975264+0000","last_change":"2024-03-09T15:07:18.975264+0000","last_active":"2024-03-09T15:07:18.975264+0000","last_peered":"2024-03-09T15:07:18.975264+0000","last_clean":"2024-03-09T15:07:18.975264+0000","last_became_active":"2024-03-09T14:42:19.004684+0000","last_became_peered":"2024-03-09T14:42:19.004684+0000","last_unstale":"2024-03-09T15:07:18.975264+0000","last_undegraded":"2024-03-09T15:07:18.975264+0000","last_fullsized":"2024-03-09T15:07:18.975264+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:18.974984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:18.974984+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.974984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:41:00.527205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.624316+0000","last_change":"2024-03-09T15:07:19.624316+0000","last_active":"2024-03-09T15:07:19.624316+0000","last_peered":"2024-03-09T15:07:19.624316+0000","last_clean":"2024-03-09T15:07:19.624316+0000","last_became_active":"2024-03-09T14:42:15.972713+0000","last_became_peered":"2024-03-09T14:42:15.972713+0000","last_unstale":"2024-03-09T15:07:19.624316+0000","last_undegraded":"2024-03-09T15:07:19.624316+0000","last_fullsized":"2024-03-09T15:07:19.624316+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:19.624058+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:19.624058+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.624058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:28:05.245432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'37","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.004401+0000","last_change":"2024-03-09T15:07:14.004463+0000","last_active":"2024-03-09T15:07:14.004401+0000","last_peered":"2024-03-09T15:07:14.004401+0000","last_clean":"2024-03-09T15:07:14.004401+0000","last_became_active":"2024-03-09T14:39:57.869392+0000","last_became_peered":"2024-03-09T14:39:57.869392+0000","last_unstale":"2024-03-09T15:07:14.004401+0000","last_undegraded":"2024-03-09T15:07:14.004401+0000","last_fullsized":"2024-03-09T15:07:14.004401+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-03-09T15:07:14.004204+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-03-09T15:07:14.004204+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.004204+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:16:31.384571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":118,"num_write":73,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:15.092778+0000","last_change":"2024-03-09T14:49:53.652690+0000","last_active":"2024-03-09T15:06:15.092778+0000","last_peered":"2024-03-09T15:06:15.092778+0000","last_clean":"2024-03-09T15:06:15.092778+0000","last_became_active":"2024-03-09T14:49:53.651987+0000","last_became_peered":"2024-03-09T14:49:53.651987+0000","last_unstale":"2024-03-09T15:06:15.092778+0000","last_undegraded":"2024-03-09T15:06:15.092778+0000","last_fullsized":"2024-03-09T15:06:15.092778+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.961311+0000","last_change":"2024-03-09T15:07:38.961370+0000","last_active":"2024-03-09T15:07:38.961311+0000","last_peered":"2024-03-09T15:07:38.961311+0000","last_clean":"2024-03-09T15:07:38.961311+0000","last_became_active":"2024-03-09T14:42:19.294108+0000","last_became_peered":"2024-03-09T14:42:19.294108+0000","last_unstale":"2024-03-09T15:07:38.961311+0000","last_undegraded":"2024-03-09T15:07:38.961311+0000","last_fullsized":"2024-03-09T15:07:38.961311+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:38.961118+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:38.961118+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.961118+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:08:36.096432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.453353+0000","last_change":"2024-03-09T15:07:21.453408+0000","last_active":"2024-03-09T15:07:21.453353+0000","last_peered":"2024-03-09T15:07:21.453353+0000","last_clean":"2024-03-09T15:07:21.453353+0000","last_became_active":"2024-03-09T14:42:15.947591+0000","last_became_peered":"2024-03-09T14:42:15.947591+0000","last_unstale":"2024-03-09T15:07:21.453353+0000","last_undegraded":"2024-03-09T15:07:21.453353+0000","last_fullsized":"2024-03-09T15:07:21.453353+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:21.453160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:21.453160+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.453160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:19:14.273952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'56","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.641889+0000","last_change":"2024-03-09T15:07:12.641912+0000","last_active":"2024-03-09T15:07:12.641889+0000","last_peered":"2024-03-09T15:07:12.641889+0000","last_clean":"2024-03-09T15:07:12.641889+0000","last_became_active":"2024-03-09T14:39:57.894370+0000","last_became_peered":"2024-03-09T14:39:57.894370+0000","last_unstale":"2024-03-09T15:07:12.641889+0000","last_undegraded":"2024-03-09T15:07:12.641889+0000","last_fullsized":"2024-03-09T15:07:12.641889+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'56","last_scrub_stamp":"2024-03-09T15:07:12.641818+0000","last_deep_scrub":"264'56","last_deep_scrub_stamp":"2024-03-09T15:07:12.641818+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.641818+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:59:17.273282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":182,"num_write":87,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.558058+0000","last_change":"2024-03-09T15:07:40.558197+0000","last_active":"2024-03-09T15:07:40.558058+0000","last_peered":"2024-03-09T15:07:40.558058+0000","last_clean":"2024-03-09T15:07:40.558058+0000","last_became_active":"2024-03-09T14:49:53.660291+0000","last_became_peered":"2024-03-09T14:49:53.660291+0000","last_unstale":"2024-03-09T15:07:40.558058+0000","last_undegraded":"2024-03-09T15:07:40.558058+0000","last_fullsized":"2024-03-09T15:07:40.558058+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:40.557831+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:40.557831+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.557831+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:16:49.067897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:44.965075+0000","last_change":"2024-03-09T14:42:19.299865+0000","last_active":"2024-03-09T15:05:44.965075+0000","last_peered":"2024-03-09T15:05:44.965075+0000","last_clean":"2024-03-09T15:05:44.965075+0000","last_became_active":"2024-03-09T14:42:19.294391+0000","last_became_peered":"2024-03-09T14:42:19.294391+0000","last_unstale":"2024-03-09T15:05:44.965075+0000","last_undegraded":"2024-03-09T15:05:44.965075+0000","last_fullsized":"2024-03-09T15:05:44.965075+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.885508+0000","last_change":"2024-03-09T15:07:15.885570+0000","last_active":"2024-03-09T15:07:15.885508+0000","last_peered":"2024-03-09T15:07:15.885508+0000","last_clean":"2024-03-09T15:07:15.885508+0000","last_became_active":"2024-03-09T14:42:15.961751+0000","last_became_peered":"2024-03-09T14:42:15.961751+0000","last_unstale":"2024-03-09T15:07:15.885508+0000","last_undegraded":"2024-03-09T15:07:15.885508+0000","last_fullsized":"2024-03-09T15:07:15.885508+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:07:15.885308+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:07:15.885308+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.885308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:17.771916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'41","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.989966+0000","last_change":"2024-03-09T15:07:19.990026+0000","last_active":"2024-03-09T15:07:19.989966+0000","last_peered":"2024-03-09T15:07:19.989966+0000","last_clean":"2024-03-09T15:07:19.989966+0000","last_became_active":"2024-03-09T14:39:57.898651+0000","last_became_peered":"2024-03-09T14:39:57.898651+0000","last_unstale":"2024-03-09T15:07:19.989966+0000","last_undegraded":"2024-03-09T15:07:19.989966+0000","last_fullsized":"2024-03-09T15:07:19.989966+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-03-09T15:07:19.989775+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-03-09T15:07:19.989775+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.989775+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:09:21.062799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":141,"num_write":58,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:14.736693+0000","last_change":"2024-03-09T14:49:53.677983+0000","last_active":"2024-03-09T15:06:14.736693+0000","last_peered":"2024-03-09T15:06:14.736693+0000","last_clean":"2024-03-09T15:06:14.736693+0000","last_became_active":"2024-03-09T14:49:53.677160+0000","last_became_peered":"2024-03-09T14:49:53.677160+0000","last_unstale":"2024-03-09T15:06:14.736693+0000","last_undegraded":"2024-03-09T15:06:14.736693+0000","last_fullsized":"2024-03-09T15:06:14.736693+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.975218+0000","last_change":"2024-03-09T14:42:19.298779+0000","last_active":"2024-03-09T15:06:29.975218+0000","last_peered":"2024-03-09T15:06:29.975218+0000","last_clean":"2024-03-09T15:06:29.975218+0000","last_became_active":"2024-03-09T14:42:19.297984+0000","last_became_peered":"2024-03-09T14:42:19.297984+0000","last_unstale":"2024-03-09T15:06:29.975218+0000","last_undegraded":"2024-03-09T15:06:29.975218+0000","last_fullsized":"2024-03-09T15:06:29.975218+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.589530+0000","last_change":"2024-03-09T15:07:36.589592+0000","last_active":"2024-03-09T15:07:36.589530+0000","last_peered":"2024-03-09T15:07:36.589530+0000","last_clean":"2024-03-09T15:07:36.589530+0000","last_became_active":"2024-03-09T14:42:15.958476+0000","last_became_peered":"2024-03-09T14:42:15.958476+0000","last_unstale":"2024-03-09T15:07:36.589530+0000","last_undegraded":"2024-03-09T15:07:36.589530+0000","last_fullsized":"2024-03-09T15:07:36.589530+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:36.589303+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:36.589303+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.589303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:11:36.067313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'112","reported_seq":384,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.534327+0000","last_change":"2024-03-09T15:07:23.534450+0000","last_active":"2024-03-09T15:07:23.534327+0000","last_peered":"2024-03-09T15:07:23.534327+0000","last_clean":"2024-03-09T15:07:23.534327+0000","last_became_active":"2024-03-09T14:39:57.872922+0000","last_became_peered":"2024-03-09T14:39:57.872922+0000","last_unstale":"2024-03-09T15:07:23.534327+0000","last_undegraded":"2024-03-09T15:07:23.534327+0000","last_fullsized":"2024-03-09T15:07:23.534327+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-03-09T15:07:23.534072+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-03-09T15:07:23.534072+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.534072+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:12:24.305321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":634,"num_read_kb":458,"num_write":138,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2790,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:14.914506+0000","last_change":"2024-03-09T14:49:53.652070+0000","last_active":"2024-03-09T15:06:14.914506+0000","last_peered":"2024-03-09T15:06:14.914506+0000","last_clean":"2024-03-09T15:06:14.914506+0000","last_became_active":"2024-03-09T14:49:53.651353+0000","last_became_peered":"2024-03-09T14:49:53.651353+0000","last_unstale":"2024-03-09T15:06:14.914506+0000","last_undegraded":"2024-03-09T15:06:14.914506+0000","last_fullsized":"2024-03-09T15:06:14.914506+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.733317+0000","last_change":"2024-03-09T14:42:19.015145+0000","last_active":"2024-03-09T15:06:29.733317+0000","last_peered":"2024-03-09T15:06:29.733317+0000","last_clean":"2024-03-09T15:06:29.733317+0000","last_became_active":"2024-03-09T14:42:19.011213+0000","last_became_peered":"2024-03-09T14:42:19.011213+0000","last_unstale":"2024-03-09T15:06:29.733317+0000","last_undegraded":"2024-03-09T15:06:29.733317+0000","last_fullsized":"2024-03-09T15:06:29.733317+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.761253+0000","last_change":"2024-03-09T15:07:31.761371+0000","last_active":"2024-03-09T15:07:31.761253+0000","last_peered":"2024-03-09T15:07:31.761253+0000","last_clean":"2024-03-09T15:07:31.761253+0000","last_became_active":"2024-03-09T14:42:15.974300+0000","last_became_peered":"2024-03-09T14:42:15.974300+0000","last_unstale":"2024-03-09T15:07:31.761253+0000","last_undegraded":"2024-03-09T15:07:31.761253+0000","last_fullsized":"2024-03-09T15:07:31.761253+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:31.760972+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:31.760972+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.760972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:56.025111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'10","reported_seq":75,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.953643+0000","last_change":"2024-03-09T15:07:20.953816+0000","last_active":"2024-03-09T15:07:20.953643+0000","last_peered":"2024-03-09T15:07:20.953643+0000","last_clean":"2024-03-09T15:07:20.953643+0000","last_became_active":"2024-03-09T14:39:57.905161+0000","last_became_peered":"2024-03-09T14:39:57.905161+0000","last_unstale":"2024-03-09T15:07:20.953643+0000","last_undegraded":"2024-03-09T15:07:20.953643+0000","last_fullsized":"2024-03-09T15:07:20.953643+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-03-09T15:07:20.953411+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-03-09T15:07:20.953411+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.953411+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:35:23.607004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:49.979711+0000","last_change":"2024-03-09T14:49:53.677779+0000","last_active":"2024-03-09T15:06:49.979711+0000","last_peered":"2024-03-09T15:06:49.979711+0000","last_clean":"2024-03-09T15:06:49.979711+0000","last_became_active":"2024-03-09T14:49:53.676180+0000","last_became_peered":"2024-03-09T14:49:53.676180+0000","last_unstale":"2024-03-09T15:06:49.979711+0000","last_undegraded":"2024-03-09T15:06:49.979711+0000","last_fullsized":"2024-03-09T15:06:49.979711+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'16","reported_seq":73,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.574638+0000","last_change":"2024-03-09T15:07:48.574709+0000","last_active":"2024-03-09T15:07:48.574638+0000","last_peered":"2024-03-09T15:07:48.574638+0000","last_clean":"2024-03-09T15:07:48.574638+0000","last_became_active":"2024-03-09T14:42:19.015001+0000","last_became_peered":"2024-03-09T14:42:19.015001+0000","last_unstale":"2024-03-09T15:07:48.574638+0000","last_undegraded":"2024-03-09T15:07:48.574638+0000","last_fullsized":"2024-03-09T15:07:48.574638+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-03-09T15:07:48.574446+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-03-09T15:07:48.574446+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.574446+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:43:43.889282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":18444,"num_write":29,"num_write_kb":15365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'9","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.826615+0000","last_change":"2024-03-09T15:07:14.826689+0000","last_active":"2024-03-09T15:07:14.826615+0000","last_peered":"2024-03-09T15:07:14.826615+0000","last_clean":"2024-03-09T15:07:14.826615+0000","last_became_active":"2024-03-09T14:42:15.936690+0000","last_became_peered":"2024-03-09T14:42:15.936690+0000","last_unstale":"2024-03-09T15:07:14.826615+0000","last_undegraded":"2024-03-09T15:07:14.826615+0000","last_fullsized":"2024-03-09T15:07:14.826615+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-03-09T15:07:14.826428+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-03-09T15:07:14.826428+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.826428+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:10:49.901286+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'45","reported_seq":163,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.922946+0000","last_change":"2024-03-09T15:07:23.923011+0000","last_active":"2024-03-09T15:07:23.922946+0000","last_peered":"2024-03-09T15:07:23.922946+0000","last_clean":"2024-03-09T15:07:23.922946+0000","last_became_active":"2024-03-09T14:39:57.900112+0000","last_became_peered":"2024-03-09T14:39:57.900112+0000","last_unstale":"2024-03-09T15:07:23.922946+0000","last_undegraded":"2024-03-09T15:07:23.922946+0000","last_fullsized":"2024-03-09T15:07:23.922946+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-03-09T15:07:23.922739+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-03-09T15:07:23.922739+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.922739+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:54:20.010708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":133,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:49.748959+0000","last_change":"2024-03-09T14:49:53.687062+0000","last_active":"2024-03-09T15:06:49.748959+0000","last_peered":"2024-03-09T15:06:49.748959+0000","last_clean":"2024-03-09T15:06:49.748959+0000","last_became_active":"2024-03-09T14:49:53.683189+0000","last_became_peered":"2024-03-09T14:49:53.683189+0000","last_unstale":"2024-03-09T15:06:49.748959+0000","last_undegraded":"2024-03-09T15:06:49.748959+0000","last_fullsized":"2024-03-09T15:06:49.748959+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.589645+0000","last_change":"2024-03-09T15:07:47.589711+0000","last_active":"2024-03-09T15:07:47.589645+0000","last_peered":"2024-03-09T15:07:47.589645+0000","last_clean":"2024-03-09T15:07:47.589645+0000","last_became_active":"2024-03-09T14:42:19.009159+0000","last_became_peered":"2024-03-09T14:42:19.009159+0000","last_unstale":"2024-03-09T15:07:47.589645+0000","last_undegraded":"2024-03-09T15:07:47.589645+0000","last_fullsized":"2024-03-09T15:07:47.589645+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:47.589448+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:47.589448+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.589448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:13:12.302460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'12","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.992983+0000","last_change":"2024-03-09T15:07:14.993120+0000","last_active":"2024-03-09T15:07:14.992983+0000","last_peered":"2024-03-09T15:07:14.992983+0000","last_clean":"2024-03-09T15:07:14.992983+0000","last_became_active":"2024-03-09T14:42:15.953580+0000","last_became_peered":"2024-03-09T14:42:15.953580+0000","last_unstale":"2024-03-09T15:07:14.992983+0000","last_undegraded":"2024-03-09T15:07:14.992983+0000","last_fullsized":"2024-03-09T15:07:14.992983+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-03-09T15:07:14.992761+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-03-09T15:07:14.992761+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.992761+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:19:32.196578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":25600,"num_write":27,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'39","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.687486+0000","last_change":"2024-03-09T15:07:10.687519+0000","last_active":"2024-03-09T15:07:10.687486+0000","last_peered":"2024-03-09T15:07:10.687486+0000","last_clean":"2024-03-09T15:07:10.687486+0000","last_became_active":"2024-03-09T14:39:57.896549+0000","last_became_peered":"2024-03-09T14:39:57.896549+0000","last_unstale":"2024-03-09T15:07:10.687486+0000","last_undegraded":"2024-03-09T15:07:10.687486+0000","last_fullsized":"2024-03-09T15:07:10.687486+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-03-09T15:07:10.687377+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-03-09T15:07:10.687377+0000","last_clean_scrub_stamp":"2024-03-09T15:07:10.687377+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:37.398766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":110,"num_write":67,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:19.740889+0000","last_change":"2024-03-09T14:49:53.674470+0000","last_active":"2024-03-09T15:06:19.740889+0000","last_peered":"2024-03-09T15:06:19.740889+0000","last_clean":"2024-03-09T15:06:19.740889+0000","last_became_active":"2024-03-09T14:49:53.673345+0000","last_became_peered":"2024-03-09T14:49:53.673345+0000","last_unstale":"2024-03-09T15:06:19.740889+0000","last_undegraded":"2024-03-09T15:06:19.740889+0000","last_fullsized":"2024-03-09T15:06:19.740889+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'3","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.919797+0000","last_change":"2024-03-09T15:07:34.919863+0000","last_active":"2024-03-09T15:07:34.919797+0000","last_peered":"2024-03-09T15:07:34.919797+0000","last_clean":"2024-03-09T15:07:34.919797+0000","last_became_active":"2024-03-09T14:42:19.020650+0000","last_became_peered":"2024-03-09T14:42:19.020650+0000","last_unstale":"2024-03-09T15:07:34.919797+0000","last_undegraded":"2024-03-09T15:07:34.919797+0000","last_fullsized":"2024-03-09T15:07:34.919797+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:34.919605+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:34.919605+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.919605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:46:15.256187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.232265+0000","last_change":"2024-03-09T15:07:17.232318+0000","last_active":"2024-03-09T15:07:17.232265+0000","last_peered":"2024-03-09T15:07:17.232265+0000","last_clean":"2024-03-09T15:07:17.232265+0000","last_became_active":"2024-03-09T14:42:15.958276+0000","last_became_peered":"2024-03-09T14:42:15.958276+0000","last_unstale":"2024-03-09T15:07:17.232265+0000","last_undegraded":"2024-03-09T15:07:17.232265+0000","last_fullsized":"2024-03-09T15:07:17.232265+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:17.232075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:17.232075+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.232075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:59:22.106180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'35","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.832224+0000","last_change":"2024-03-09T15:07:12.832292+0000","last_active":"2024-03-09T15:07:12.832224+0000","last_peered":"2024-03-09T15:07:12.832224+0000","last_clean":"2024-03-09T15:07:12.832224+0000","last_became_active":"2024-03-09T14:39:57.891706+0000","last_became_peered":"2024-03-09T14:39:57.891706+0000","last_unstale":"2024-03-09T15:07:12.832224+0000","last_undegraded":"2024-03-09T15:07:12.832224+0000","last_fullsized":"2024-03-09T15:07:12.832224+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-03-09T15:07:12.832019+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-03-09T15:07:12.832019+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.832019+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:50:16.384247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":98,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:49.979658+0000","last_change":"2024-03-09T14:49:53.678730+0000","last_active":"2024-03-09T15:06:49.979658+0000","last_peered":"2024-03-09T15:06:49.979658+0000","last_clean":"2024-03-09T15:06:49.979658+0000","last_became_active":"2024-03-09T14:49:53.670121+0000","last_became_peered":"2024-03-09T14:49:53.670121+0000","last_unstale":"2024-03-09T15:06:49.979658+0000","last_undegraded":"2024-03-09T15:06:49.979658+0000","last_fullsized":"2024-03-09T15:06:49.979658+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.092944+0000","last_change":"2024-03-09T15:07:45.092997+0000","last_active":"2024-03-09T15:07:45.092944+0000","last_peered":"2024-03-09T15:07:45.092944+0000","last_clean":"2024-03-09T15:07:45.092944+0000","last_became_active":"2024-03-09T14:42:18.992996+0000","last_became_peered":"2024-03-09T14:42:18.992996+0000","last_unstale":"2024-03-09T15:07:45.092944+0000","last_undegraded":"2024-03-09T15:07:45.092944+0000","last_fullsized":"2024-03-09T15:07:45.092944+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:45.092754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:45.092754+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.092754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:48:28.791963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.485177+0000","last_change":"2024-03-09T15:07:25.485241+0000","last_active":"2024-03-09T15:07:25.485177+0000","last_peered":"2024-03-09T15:07:25.485177+0000","last_clean":"2024-03-09T15:07:25.485177+0000","last_became_active":"2024-03-09T14:42:15.950001+0000","last_became_peered":"2024-03-09T14:42:15.950001+0000","last_unstale":"2024-03-09T15:07:25.485177+0000","last_undegraded":"2024-03-09T15:07:25.485177+0000","last_fullsized":"2024-03-09T15:07:25.485177+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:25.484949+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:25.484949+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.484949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:42.285163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'55","reported_seq":177,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.041497+0000","last_change":"2024-03-09T15:07:14.041637+0000","last_active":"2024-03-09T15:07:14.041497+0000","last_peered":"2024-03-09T15:07:14.041497+0000","last_clean":"2024-03-09T15:07:14.041497+0000","last_became_active":"2024-03-09T14:39:57.909827+0000","last_became_peered":"2024-03-09T14:39:57.909827+0000","last_unstale":"2024-03-09T15:07:14.041497+0000","last_undegraded":"2024-03-09T15:07:14.041497+0000","last_fullsized":"2024-03-09T15:07:14.041497+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'55","last_scrub_stamp":"2024-03-09T15:07:14.041251+0000","last_deep_scrub":"264'55","last_deep_scrub_stamp":"2024-03-09T15:07:14.041251+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.041251+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:44:17.414317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":147,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.566069+0000","last_change":"2024-03-09T15:07:39.566127+0000","last_active":"2024-03-09T15:07:39.566069+0000","last_peered":"2024-03-09T15:07:39.566069+0000","last_clean":"2024-03-09T15:07:39.566069+0000","last_became_active":"2024-03-09T14:49:53.641152+0000","last_became_peered":"2024-03-09T14:49:53.641152+0000","last_unstale":"2024-03-09T15:07:39.566069+0000","last_undegraded":"2024-03-09T15:07:39.566069+0000","last_fullsized":"2024-03-09T15:07:39.566069+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:39.565858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:39.565858+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.565858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:11:49.699057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.014761+0000","last_change":"2024-03-09T15:07:23.014822+0000","last_active":"2024-03-09T15:07:23.014761+0000","last_peered":"2024-03-09T15:07:23.014761+0000","last_clean":"2024-03-09T15:07:23.014761+0000","last_became_active":"2024-03-09T14:42:19.013356+0000","last_became_peered":"2024-03-09T14:42:19.013356+0000","last_unstale":"2024-03-09T15:07:23.014761+0000","last_undegraded":"2024-03-09T15:07:23.014761+0000","last_fullsized":"2024-03-09T15:07:23.014761+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:07:23.014568+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:07:23.014568+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.014568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:32:57.682164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.863792+0000","last_change":"2024-03-09T15:07:12.863850+0000","last_active":"2024-03-09T15:07:12.863792+0000","last_peered":"2024-03-09T15:07:12.863792+0000","last_clean":"2024-03-09T15:07:12.863792+0000","last_became_active":"2024-03-09T14:42:15.964591+0000","last_became_peered":"2024-03-09T14:42:15.964591+0000","last_unstale":"2024-03-09T15:07:12.863792+0000","last_undegraded":"2024-03-09T15:07:12.863792+0000","last_fullsized":"2024-03-09T15:07:12.863792+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:12.863592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:12.863592+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.863592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:43:17.329732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'15","reported_seq":93,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.946943+0000","last_change":"2024-03-09T15:07:16.947005+0000","last_active":"2024-03-09T15:07:16.946943+0000","last_peered":"2024-03-09T15:07:16.946943+0000","last_clean":"2024-03-09T15:07:16.946943+0000","last_became_active":"2024-03-09T14:39:57.898952+0000","last_became_peered":"2024-03-09T14:39:57.898952+0000","last_unstale":"2024-03-09T15:07:16.946943+0000","last_undegraded":"2024-03-09T15:07:16.946943+0000","last_fullsized":"2024-03-09T15:07:16.946943+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'15","last_scrub_stamp":"2024-03-09T15:07:16.946726+0000","last_deep_scrub":"264'15","last_deep_scrub_stamp":"2024-03-09T15:07:16.946726+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.946726+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:32.769206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":52,"num_write":21,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.026699+0000","last_change":"2024-03-09T15:07:31.026757+0000","last_active":"2024-03-09T15:07:31.026699+0000","last_peered":"2024-03-09T15:07:31.026699+0000","last_clean":"2024-03-09T15:07:31.026699+0000","last_became_active":"2024-03-09T14:49:53.653943+0000","last_became_peered":"2024-03-09T14:49:53.653943+0000","last_unstale":"2024-03-09T15:07:31.026699+0000","last_undegraded":"2024-03-09T15:07:31.026699+0000","last_fullsized":"2024-03-09T15:07:31.026699+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:31.026484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:31.026484+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.026484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:58.692908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.975883+0000","last_change":"2024-03-09T15:07:26.975946+0000","last_active":"2024-03-09T15:07:26.975883+0000","last_peered":"2024-03-09T15:07:26.975883+0000","last_clean":"2024-03-09T15:07:26.975883+0000","last_became_active":"2024-03-09T14:42:19.008729+0000","last_became_peered":"2024-03-09T14:42:19.008729+0000","last_unstale":"2024-03-09T15:07:26.975883+0000","last_undegraded":"2024-03-09T15:07:26.975883+0000","last_fullsized":"2024-03-09T15:07:26.975883+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:26.975688+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:26.975688+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.975688+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:22:03.596581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.538842+0000","last_change":"2024-03-09T15:07:38.538897+0000","last_active":"2024-03-09T15:07:38.538842+0000","last_peered":"2024-03-09T15:07:38.538842+0000","last_clean":"2024-03-09T15:07:38.538842+0000","last_became_active":"2024-03-09T14:42:15.978166+0000","last_became_peered":"2024-03-09T14:42:15.978166+0000","last_unstale":"2024-03-09T15:07:38.538842+0000","last_undegraded":"2024-03-09T15:07:38.538842+0000","last_fullsized":"2024-03-09T15:07:38.538842+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:38.538641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:38.538641+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.538641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:15:02.484560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'46","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.531125+0000","last_change":"2024-03-09T15:07:17.531186+0000","last_active":"2024-03-09T15:07:17.531125+0000","last_peered":"2024-03-09T15:07:17.531125+0000","last_clean":"2024-03-09T15:07:17.531125+0000","last_became_active":"2024-03-09T14:39:57.904012+0000","last_became_peered":"2024-03-09T14:39:57.904012+0000","last_unstale":"2024-03-09T15:07:17.531125+0000","last_undegraded":"2024-03-09T15:07:17.531125+0000","last_fullsized":"2024-03-09T15:07:17.531125+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'46","last_scrub_stamp":"2024-03-09T15:07:17.530930+0000","last_deep_scrub":"264'46","last_deep_scrub_stamp":"2024-03-09T15:07:17.530930+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.530930+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:03:28.425445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":131,"num_write":86,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.404165+0000","last_change":"2024-03-09T14:49:53.680169+0000","last_active":"2024-03-09T15:07:12.404165+0000","last_peered":"2024-03-09T15:07:12.404165+0000","last_clean":"2024-03-09T15:07:12.404165+0000","last_became_active":"2024-03-09T14:49:53.678157+0000","last_became_peered":"2024-03-09T14:49:53.678157+0000","last_unstale":"2024-03-09T15:07:12.404165+0000","last_undegraded":"2024-03-09T15:07:12.404165+0000","last_fullsized":"2024-03-09T15:07:12.404165+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.548576+0000","last_change":"2024-03-09T15:07:49.548630+0000","last_active":"2024-03-09T15:07:49.548576+0000","last_peered":"2024-03-09T15:07:49.548576+0000","last_clean":"2024-03-09T15:07:49.548576+0000","last_became_active":"2024-03-09T14:42:19.295533+0000","last_became_peered":"2024-03-09T14:42:19.295533+0000","last_unstale":"2024-03-09T15:07:49.548576+0000","last_undegraded":"2024-03-09T15:07:49.548576+0000","last_fullsized":"2024-03-09T15:07:49.548576+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:49.548387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:49.548387+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.548387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:11:17.213530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"261'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.565280+0000","last_change":"2024-03-09T15:07:15.565345+0000","last_active":"2024-03-09T15:07:15.565280+0000","last_peered":"2024-03-09T15:07:15.565280+0000","last_clean":"2024-03-09T15:07:15.565280+0000","last_became_active":"2024-03-09T14:42:15.968323+0000","last_became_peered":"2024-03-09T14:42:15.968323+0000","last_unstale":"2024-03-09T15:07:15.565280+0000","last_undegraded":"2024-03-09T15:07:15.565280+0000","last_fullsized":"2024-03-09T15:07:15.565280+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-03-09T15:07:15.565071+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-03-09T15:07:15.565071+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.565071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:55:13.724228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'40","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.239744+0000","last_change":"2024-03-09T15:07:15.239878+0000","last_active":"2024-03-09T15:07:15.239744+0000","last_peered":"2024-03-09T15:07:15.239744+0000","last_clean":"2024-03-09T15:07:15.239744+0000","last_became_active":"2024-03-09T14:39:57.898234+0000","last_became_peered":"2024-03-09T14:39:57.898234+0000","last_unstale":"2024-03-09T15:07:15.239744+0000","last_undegraded":"2024-03-09T15:07:15.239744+0000","last_fullsized":"2024-03-09T15:07:15.239744+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-03-09T15:07:15.239453+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-03-09T15:07:15.239453+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.239453+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:16.397508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":111,"num_write":71,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.018870+0000","last_change":"2024-03-09T15:07:35.018930+0000","last_active":"2024-03-09T15:07:35.018870+0000","last_peered":"2024-03-09T15:07:35.018870+0000","last_clean":"2024-03-09T15:07:35.018870+0000","last_became_active":"2024-03-09T14:49:53.662812+0000","last_became_peered":"2024-03-09T14:49:53.662812+0000","last_unstale":"2024-03-09T15:07:35.018870+0000","last_undegraded":"2024-03-09T15:07:35.018870+0000","last_fullsized":"2024-03-09T15:07:35.018870+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.018672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.018672+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.018672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:49:46.866451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'7","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.984757+0000","last_change":"2024-03-09T15:07:30.984820+0000","last_active":"2024-03-09T15:07:30.984757+0000","last_peered":"2024-03-09T15:07:30.984757+0000","last_clean":"2024-03-09T15:07:30.984757+0000","last_became_active":"2024-03-09T14:42:19.017434+0000","last_became_peered":"2024-03-09T14:42:19.017434+0000","last_unstale":"2024-03-09T15:07:30.984757+0000","last_undegraded":"2024-03-09T15:07:30.984757+0000","last_fullsized":"2024-03-09T15:07:30.984757+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-03-09T15:07:30.984571+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-03-09T15:07:30.984571+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.984571+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:06:03.083175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8272,"num_write":12,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.908491+0000","last_change":"2024-03-09T15:07:10.908536+0000","last_active":"2024-03-09T15:07:10.908491+0000","last_peered":"2024-03-09T15:07:10.908491+0000","last_clean":"2024-03-09T15:07:10.908491+0000","last_became_active":"2024-03-09T14:42:15.945565+0000","last_became_peered":"2024-03-09T14:42:15.945565+0000","last_unstale":"2024-03-09T15:07:10.908491+0000","last_undegraded":"2024-03-09T15:07:10.908491+0000","last_fullsized":"2024-03-09T15:07:10.908491+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:07:10.908404+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:07:10.908404+0000","last_clean_scrub_stamp":"2024-03-09T15:07:10.908404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:19.761717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1029,"num_write":10,"num_write_kb":1029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'55","reported_seq":184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.571140+0000","last_change":"2024-03-09T15:07:35.571202+0000","last_active":"2024-03-09T15:07:35.571140+0000","last_peered":"2024-03-09T15:07:35.571140+0000","last_clean":"2024-03-09T15:07:35.571140+0000","last_became_active":"2024-03-09T14:39:57.900659+0000","last_became_peered":"2024-03-09T14:39:57.900659+0000","last_unstale":"2024-03-09T15:07:35.571140+0000","last_undegraded":"2024-03-09T15:07:35.571140+0000","last_fullsized":"2024-03-09T15:07:35.571140+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'55","last_scrub_stamp":"2024-03-09T15:07:35.570944+0000","last_deep_scrub":"264'55","last_deep_scrub_stamp":"2024-03-09T15:07:35.570944+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.570944+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:53:47.902666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":161,"num_write":89,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:39.963976+0000","last_change":"2024-03-09T14:49:53.683045+0000","last_active":"2024-03-09T15:05:39.963976+0000","last_peered":"2024-03-09T15:05:39.963976+0000","last_clean":"2024-03-09T15:05:39.963976+0000","last_became_active":"2024-03-09T14:49:53.678822+0000","last_became_peered":"2024-03-09T14:49:53.678822+0000","last_unstale":"2024-03-09T15:05:39.963976+0000","last_undegraded":"2024-03-09T15:05:39.963976+0000","last_fullsized":"2024-03-09T15:05:39.963976+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.297488+0000","last_change":"2024-03-09T14:42:19.021170+0000","last_active":"2024-03-09T15:07:05.297488+0000","last_peered":"2024-03-09T15:07:05.297488+0000","last_clean":"2024-03-09T15:07:05.297488+0000","last_became_active":"2024-03-09T14:42:19.016262+0000","last_became_peered":"2024-03-09T14:42:19.016262+0000","last_unstale":"2024-03-09T15:07:05.297488+0000","last_undegraded":"2024-03-09T15:07:05.297488+0000","last_fullsized":"2024-03-09T15:07:05.297488+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.649801+0000","last_change":"2024-03-09T15:07:11.649832+0000","last_active":"2024-03-09T15:07:11.649801+0000","last_peered":"2024-03-09T15:07:11.649801+0000","last_clean":"2024-03-09T15:07:11.649801+0000","last_became_active":"2024-03-09T14:42:15.963496+0000","last_became_peered":"2024-03-09T14:42:15.963496+0000","last_unstale":"2024-03-09T15:07:11.649801+0000","last_undegraded":"2024-03-09T15:07:11.649801+0000","last_fullsized":"2024-03-09T15:07:11.649801+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:11.649700+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:11.649700+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.649700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:54:34.580055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'33","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.595715+0000","last_change":"2024-03-09T15:07:17.595774+0000","last_active":"2024-03-09T15:07:17.595715+0000","last_peered":"2024-03-09T15:07:17.595715+0000","last_clean":"2024-03-09T15:07:17.595715+0000","last_became_active":"2024-03-09T14:39:57.879068+0000","last_became_peered":"2024-03-09T14:39:57.879068+0000","last_unstale":"2024-03-09T15:07:17.595715+0000","last_undegraded":"2024-03-09T15:07:17.595715+0000","last_fullsized":"2024-03-09T15:07:17.595715+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-03-09T15:07:17.595518+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-03-09T15:07:17.595518+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.595518+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:22:14.173013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":89,"num_write":57,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:44.729225+0000","last_change":"2024-03-09T14:49:53.666848+0000","last_active":"2024-03-09T15:05:44.729225+0000","last_peered":"2024-03-09T15:05:44.729225+0000","last_clean":"2024-03-09T15:05:44.729225+0000","last_became_active":"2024-03-09T14:49:53.666088+0000","last_became_peered":"2024-03-09T14:49:53.666088+0000","last_unstale":"2024-03-09T15:05:44.729225+0000","last_undegraded":"2024-03-09T15:05:44.729225+0000","last_fullsized":"2024-03-09T15:05:44.729225+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.901537+0000","last_change":"2024-03-09T15:07:18.901598+0000","last_active":"2024-03-09T15:07:18.901537+0000","last_peered":"2024-03-09T15:07:18.901537+0000","last_clean":"2024-03-09T15:07:18.901537+0000","last_became_active":"2024-03-09T14:42:19.288155+0000","last_became_peered":"2024-03-09T14:42:19.288155+0000","last_unstale":"2024-03-09T15:07:18.901537+0000","last_undegraded":"2024-03-09T15:07:18.901537+0000","last_fullsized":"2024-03-09T15:07:18.901537+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:18.901334+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:18.901334+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.901334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:16.864340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.955208+0000","last_change":"2024-03-09T15:07:11.955237+0000","last_active":"2024-03-09T15:07:11.955208+0000","last_peered":"2024-03-09T15:07:11.955208+0000","last_clean":"2024-03-09T15:07:11.955208+0000","last_became_active":"2024-03-09T14:42:15.962004+0000","last_became_peered":"2024-03-09T14:42:15.962004+0000","last_unstale":"2024-03-09T15:07:11.955208+0000","last_undegraded":"2024-03-09T15:07:11.955208+0000","last_fullsized":"2024-03-09T15:07:11.955208+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:11.955103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:11.955103+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.955103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:20:11.932735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.945988+0000","last_change":"2024-03-09T15:07:19.946048+0000","last_active":"2024-03-09T15:07:19.945988+0000","last_peered":"2024-03-09T15:07:19.945988+0000","last_clean":"2024-03-09T15:07:19.945988+0000","last_became_active":"2024-03-09T14:39:57.906043+0000","last_became_peered":"2024-03-09T14:39:57.906043+0000","last_unstale":"2024-03-09T15:07:19.945988+0000","last_undegraded":"2024-03-09T15:07:19.945988+0000","last_fullsized":"2024-03-09T15:07:19.945988+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-03-09T15:07:19.945806+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-03-09T15:07:19.945806+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.945806+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:28:12.471486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":86,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:39.727926+0000","last_change":"2024-03-09T14:49:53.666880+0000","last_active":"2024-03-09T15:05:39.727926+0000","last_peered":"2024-03-09T15:05:39.727926+0000","last_clean":"2024-03-09T15:05:39.727926+0000","last_became_active":"2024-03-09T14:49:53.666251+0000","last_became_peered":"2024-03-09T14:49:53.666251+0000","last_unstale":"2024-03-09T15:05:39.727926+0000","last_undegraded":"2024-03-09T15:05:39.727926+0000","last_fullsized":"2024-03-09T15:05:39.727926+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.906150+0000","last_change":"2024-03-09T15:07:19.906205+0000","last_active":"2024-03-09T15:07:19.906150+0000","last_peered":"2024-03-09T15:07:19.906150+0000","last_clean":"2024-03-09T15:07:19.906150+0000","last_became_active":"2024-03-09T14:42:18.998145+0000","last_became_peered":"2024-03-09T14:42:18.998145+0000","last_unstale":"2024-03-09T15:07:19.906150+0000","last_undegraded":"2024-03-09T15:07:19.906150+0000","last_fullsized":"2024-03-09T15:07:19.906150+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:19.905948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:19.905948+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.905948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:21:38.351715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.663537+0000","last_change":"2024-03-09T15:07:27.663618+0000","last_active":"2024-03-09T15:07:27.663537+0000","last_peered":"2024-03-09T15:07:27.663537+0000","last_clean":"2024-03-09T15:07:27.663537+0000","last_became_active":"2024-03-09T14:42:15.973793+0000","last_became_peered":"2024-03-09T14:42:15.973793+0000","last_unstale":"2024-03-09T15:07:27.663537+0000","last_undegraded":"2024-03-09T15:07:27.663537+0000","last_fullsized":"2024-03-09T15:07:27.663537+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:07:27.663315+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:07:27.663315+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.663315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:07.805577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'18","reported_seq":95,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.978077+0000","last_change":"2024-03-09T15:07:17.978140+0000","last_active":"2024-03-09T15:07:17.978077+0000","last_peered":"2024-03-09T15:07:17.978077+0000","last_clean":"2024-03-09T15:07:17.978077+0000","last_became_active":"2024-03-09T14:39:57.895347+0000","last_became_peered":"2024-03-09T14:39:57.895347+0000","last_unstale":"2024-03-09T15:07:17.978077+0000","last_undegraded":"2024-03-09T15:07:17.978077+0000","last_fullsized":"2024-03-09T15:07:17.978077+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-03-09T15:07:17.977877+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-03-09T15:07:17.977877+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.977877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:10:27.720426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":49,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:39.731670+0000","last_change":"2024-03-09T14:49:53.680516+0000","last_active":"2024-03-09T15:05:39.731670+0000","last_peered":"2024-03-09T15:05:39.731670+0000","last_clean":"2024-03-09T15:05:39.731670+0000","last_became_active":"2024-03-09T14:49:53.676907+0000","last_became_peered":"2024-03-09T14:49:53.676907+0000","last_unstale":"2024-03-09T15:05:39.731670+0000","last_undegraded":"2024-03-09T15:05:39.731670+0000","last_fullsized":"2024-03-09T15:05:39.731670+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.983530+0000","last_change":"2024-03-09T15:07:26.983592+0000","last_active":"2024-03-09T15:07:26.983530+0000","last_peered":"2024-03-09T15:07:26.983530+0000","last_clean":"2024-03-09T15:07:26.983530+0000","last_became_active":"2024-03-09T14:42:29.984595+0000","last_became_peered":"2024-03-09T14:42:29.984595+0000","last_unstale":"2024-03-09T15:07:26.983530+0000","last_undegraded":"2024-03-09T15:07:26.983530+0000","last_fullsized":"2024-03-09T15:07:26.983530+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:26.983320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:26.983320+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.983320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:58:22.547118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'6","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.789750+0000","last_change":"2024-03-09T15:07:18.789875+0000","last_active":"2024-03-09T15:07:18.789750+0000","last_peered":"2024-03-09T15:07:18.789750+0000","last_clean":"2024-03-09T15:07:18.789750+0000","last_became_active":"2024-03-09T14:42:15.941583+0000","last_became_peered":"2024-03-09T14:42:15.941583+0000","last_unstale":"2024-03-09T15:07:18.789750+0000","last_undegraded":"2024-03-09T15:07:18.789750+0000","last_fullsized":"2024-03-09T15:07:18.789750+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:18.789520+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:18.789520+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.789520+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:04.840942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'16","reported_seq":97,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.198006+0000","last_change":"2024-03-09T15:07:18.198066+0000","last_active":"2024-03-09T15:07:18.198006+0000","last_peered":"2024-03-09T15:07:18.198006+0000","last_clean":"2024-03-09T15:07:18.198006+0000","last_became_active":"2024-03-09T14:39:57.884479+0000","last_became_peered":"2024-03-09T14:39:57.884479+0000","last_unstale":"2024-03-09T15:07:18.198006+0000","last_undegraded":"2024-03-09T15:07:18.198006+0000","last_fullsized":"2024-03-09T15:07:18.198006+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-03-09T15:07:18.197804+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-03-09T15:07:18.197804+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.197804+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:28:01.332954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":55,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.742182+0000","last_change":"2024-03-09T14:49:53.664600+0000","last_active":"2024-03-09T15:06:34.742182+0000","last_peered":"2024-03-09T15:06:34.742182+0000","last_clean":"2024-03-09T15:06:34.742182+0000","last_became_active":"2024-03-09T14:49:53.663825+0000","last_became_peered":"2024-03-09T14:49:53.663825+0000","last_unstale":"2024-03-09T15:06:34.742182+0000","last_undegraded":"2024-03-09T15:06:34.742182+0000","last_fullsized":"2024-03-09T15:06:34.742182+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.764079+0000","last_change":"2024-03-09T15:07:35.764139+0000","last_active":"2024-03-09T15:07:35.764079+0000","last_peered":"2024-03-09T15:07:35.764079+0000","last_clean":"2024-03-09T15:07:35.764079+0000","last_became_active":"2024-03-09T14:42:18.995340+0000","last_became_peered":"2024-03-09T14:42:18.995340+0000","last_unstale":"2024-03-09T15:07:35.764079+0000","last_undegraded":"2024-03-09T15:07:35.764079+0000","last_fullsized":"2024-03-09T15:07:35.764079+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.763876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.763876+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.763876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:25:43.872448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.891508+0000","last_change":"2024-03-09T15:07:13.891508+0000","last_active":"2024-03-09T15:07:13.891508+0000","last_peered":"2024-03-09T15:07:13.891508+0000","last_clean":"2024-03-09T15:07:13.891508+0000","last_became_active":"2024-03-09T14:42:15.963155+0000","last_became_peered":"2024-03-09T14:42:15.963155+0000","last_unstale":"2024-03-09T15:07:13.891508+0000","last_undegraded":"2024-03-09T15:07:13.891508+0000","last_fullsized":"2024-03-09T15:07:13.891508+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:13.891243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:13.891243+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.891243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:23:55.637502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'33","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.561191+0000","last_change":"2024-03-09T15:07:16.561251+0000","last_active":"2024-03-09T15:07:16.561191+0000","last_peered":"2024-03-09T15:07:16.561191+0000","last_clean":"2024-03-09T15:07:16.561191+0000","last_became_active":"2024-03-09T14:39:57.888467+0000","last_became_peered":"2024-03-09T14:39:57.888467+0000","last_unstale":"2024-03-09T15:07:16.561191+0000","last_undegraded":"2024-03-09T15:07:16.561191+0000","last_fullsized":"2024-03-09T15:07:16.561191+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-03-09T15:07:16.560999+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-03-09T15:07:16.560999+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.560999+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:39.875129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":106,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.919405+0000","last_change":"2024-03-09T14:49:53.659073+0000","last_active":"2024-03-09T15:06:34.919405+0000","last_peered":"2024-03-09T15:06:34.919405+0000","last_clean":"2024-03-09T15:06:34.919405+0000","last_became_active":"2024-03-09T14:49:53.658183+0000","last_became_peered":"2024-03-09T14:49:53.658183+0000","last_unstale":"2024-03-09T15:06:34.919405+0000","last_undegraded":"2024-03-09T15:06:34.919405+0000","last_fullsized":"2024-03-09T15:06:34.919405+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.438254+0000","last_change":"2024-03-09T14:42:19.295167+0000","last_active":"2024-03-09T15:07:09.438254+0000","last_peered":"2024-03-09T15:07:09.438254+0000","last_clean":"2024-03-09T15:07:09.438254+0000","last_became_active":"2024-03-09T14:42:19.294401+0000","last_became_peered":"2024-03-09T14:42:19.294401+0000","last_unstale":"2024-03-09T15:07:09.438254+0000","last_undegraded":"2024-03-09T15:07:09.438254+0000","last_fullsized":"2024-03-09T15:07:09.438254+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'7","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.582621+0000","last_change":"2024-03-09T15:07:37.582683+0000","last_active":"2024-03-09T15:07:37.582621+0000","last_peered":"2024-03-09T15:07:37.582621+0000","last_clean":"2024-03-09T15:07:37.582621+0000","last_became_active":"2024-03-09T14:42:15.974493+0000","last_became_peered":"2024-03-09T14:42:15.974493+0000","last_unstale":"2024-03-09T15:07:37.582621+0000","last_undegraded":"2024-03-09T15:07:37.582621+0000","last_fullsized":"2024-03-09T15:07:37.582621+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-03-09T15:07:37.582421+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-03-09T15:07:37.582421+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.582421+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:35:35.039619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5160,"num_write":12,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'28","reported_seq":116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.277964+0000","last_change":"2024-03-09T15:07:14.278092+0000","last_active":"2024-03-09T15:07:14.277964+0000","last_peered":"2024-03-09T15:07:14.277964+0000","last_clean":"2024-03-09T15:07:14.277964+0000","last_became_active":"2024-03-09T14:39:57.907009+0000","last_became_peered":"2024-03-09T14:39:57.907009+0000","last_unstale":"2024-03-09T15:07:14.277964+0000","last_undegraded":"2024-03-09T15:07:14.277964+0000","last_fullsized":"2024-03-09T15:07:14.277964+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-03-09T15:07:14.277744+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-03-09T15:07:14.277744+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.277744+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:52:23.159850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":74,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:05:55.087821+0000","last_change":"2024-03-09T14:49:53.681028+0000","last_active":"2024-03-09T15:05:55.087821+0000","last_peered":"2024-03-09T15:05:55.087821+0000","last_clean":"2024-03-09T15:05:55.087821+0000","last_became_active":"2024-03-09T14:49:53.680477+0000","last_became_peered":"2024-03-09T14:49:53.680477+0000","last_unstale":"2024-03-09T15:05:55.087821+0000","last_undegraded":"2024-03-09T15:05:55.087821+0000","last_fullsized":"2024-03-09T15:05:55.087821+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.930221+0000","last_change":"2024-03-09T15:07:22.930279+0000","last_active":"2024-03-09T15:07:22.930221+0000","last_peered":"2024-03-09T15:07:22.930221+0000","last_clean":"2024-03-09T15:07:22.930221+0000","last_became_active":"2024-03-09T14:42:19.289487+0000","last_became_peered":"2024-03-09T14:42:19.289487+0000","last_unstale":"2024-03-09T15:07:22.930221+0000","last_undegraded":"2024-03-09T15:07:22.930221+0000","last_fullsized":"2024-03-09T15:07:22.930221+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:22.930020+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:22.930020+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.930020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:09:50.336731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.297582+0000","last_change":"2024-03-09T14:42:15.957344+0000","last_active":"2024-03-09T15:07:05.297582+0000","last_peered":"2024-03-09T15:07:05.297582+0000","last_clean":"2024-03-09T15:07:05.297582+0000","last_became_active":"2024-03-09T14:42:15.956648+0000","last_became_peered":"2024-03-09T14:42:15.956648+0000","last_unstale":"2024-03-09T15:07:05.297582+0000","last_undegraded":"2024-03-09T15:07:05.297582+0000","last_fullsized":"2024-03-09T15:07:05.297582+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:14.906081+0000","last_clean_scrub_stamp":"2024-03-09T14:42:14.906081+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'62","reported_seq":208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.950093+0000","last_change":"2024-03-09T15:07:21.950162+0000","last_active":"2024-03-09T15:07:21.950093+0000","last_peered":"2024-03-09T15:07:21.950093+0000","last_clean":"2024-03-09T15:07:21.950093+0000","last_became_active":"2024-03-09T14:39:57.905410+0000","last_became_peered":"2024-03-09T14:39:57.905410+0000","last_unstale":"2024-03-09T15:07:21.950093+0000","last_undegraded":"2024-03-09T15:07:21.950093+0000","last_fullsized":"2024-03-09T15:07:21.950093+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'62","last_scrub_stamp":"2024-03-09T15:07:21.949871+0000","last_deep_scrub":"264'62","last_deep_scrub_stamp":"2024-03-09T15:07:21.949871+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.949871+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:41:26.110415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":193,"num_write":94,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.734204+0000","last_change":"2024-03-09T14:49:53.658895+0000","last_active":"2024-03-09T15:06:34.734204+0000","last_peered":"2024-03-09T15:06:34.734204+0000","last_clean":"2024-03-09T15:06:34.734204+0000","last_became_active":"2024-03-09T14:49:53.658190+0000","last_became_peered":"2024-03-09T14:49:53.658190+0000","last_unstale":"2024-03-09T15:06:34.734204+0000","last_undegraded":"2024-03-09T15:06:34.734204+0000","last_fullsized":"2024-03-09T15:06:34.734204+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'5","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.075418+0000","last_change":"2024-03-09T14:42:19.020830+0000","last_active":"2024-03-09T15:07:04.075418+0000","last_peered":"2024-03-09T15:07:04.075418+0000","last_clean":"2024-03-09T15:07:04.075418+0000","last_became_active":"2024-03-09T14:42:19.013977+0000","last_became_peered":"2024-03-09T14:42:19.013977+0000","last_unstale":"2024-03-09T15:07:04.075418+0000","last_undegraded":"2024-03-09T15:07:04.075418+0000","last_fullsized":"2024-03-09T15:07:04.075418+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":5,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.857181+0000","last_change":"2024-03-09T15:07:16.857285+0000","last_active":"2024-03-09T15:07:16.857181+0000","last_peered":"2024-03-09T15:07:16.857181+0000","last_clean":"2024-03-09T15:07:16.857181+0000","last_became_active":"2024-03-09T14:42:15.960225+0000","last_became_peered":"2024-03-09T14:42:15.960225+0000","last_unstale":"2024-03-09T15:07:16.857181+0000","last_undegraded":"2024-03-09T15:07:16.857181+0000","last_fullsized":"2024-03-09T15:07:16.857181+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:16.856929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:16.856929+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.856929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:51:38.551264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'131","reported_seq":441,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.963128+0000","last_change":"2024-03-09T15:07:12.963188+0000","last_active":"2024-03-09T15:07:12.963128+0000","last_peered":"2024-03-09T15:07:12.963128+0000","last_clean":"2024-03-09T15:07:12.963128+0000","last_became_active":"2024-03-09T14:39:57.892592+0000","last_became_peered":"2024-03-09T14:39:57.892592+0000","last_unstale":"2024-03-09T15:07:12.963128+0000","last_undegraded":"2024-03-09T15:07:12.963128+0000","last_fullsized":"2024-03-09T15:07:12.963128+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-03-09T15:07:12.962987+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-03-09T15:07:12.962987+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.962987+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:14:19.463214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":739,"num_read_kb":529,"num_write":173,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4473,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.513444+0000","last_change":"2024-03-09T15:07:41.513509+0000","last_active":"2024-03-09T15:07:41.513444+0000","last_peered":"2024-03-09T15:07:41.513444+0000","last_clean":"2024-03-09T15:07:41.513444+0000","last_became_active":"2024-03-09T14:49:53.672292+0000","last_became_peered":"2024-03-09T14:49:53.672292+0000","last_unstale":"2024-03-09T15:07:41.513444+0000","last_undegraded":"2024-03-09T15:07:41.513444+0000","last_fullsized":"2024-03-09T15:07:41.513444+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:41.513248+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:41.513248+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.513248+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:29:14.165196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.599526+0000","last_change":"2024-03-09T15:07:46.599582+0000","last_active":"2024-03-09T15:07:46.599526+0000","last_peered":"2024-03-09T15:07:46.599526+0000","last_clean":"2024-03-09T15:07:46.599526+0000","last_became_active":"2024-03-09T14:42:19.002083+0000","last_became_peered":"2024-03-09T14:42:19.002083+0000","last_unstale":"2024-03-09T15:07:46.599526+0000","last_undegraded":"2024-03-09T15:07:46.599526+0000","last_fullsized":"2024-03-09T15:07:46.599526+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:46.599325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:46.599325+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.599325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:03:50.389634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'6","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.934056+0000","last_change":"2024-03-09T15:07:14.934126+0000","last_active":"2024-03-09T15:07:14.934056+0000","last_peered":"2024-03-09T15:07:14.934056+0000","last_clean":"2024-03-09T15:07:14.934056+0000","last_became_active":"2024-03-09T14:42:15.975956+0000","last_became_peered":"2024-03-09T14:42:15.975956+0000","last_unstale":"2024-03-09T15:07:14.934056+0000","last_undegraded":"2024-03-09T15:07:14.934056+0000","last_fullsized":"2024-03-09T15:07:14.934056+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:14.933844+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:14.933844+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.933844+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:53:21.393505+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'35","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.516936+0000","last_change":"2024-03-09T15:07:13.517001+0000","last_active":"2024-03-09T15:07:13.516936+0000","last_peered":"2024-03-09T15:07:13.516936+0000","last_clean":"2024-03-09T15:07:13.516936+0000","last_became_active":"2024-03-09T14:39:57.886792+0000","last_became_peered":"2024-03-09T14:39:57.886792+0000","last_unstale":"2024-03-09T15:07:13.516936+0000","last_undegraded":"2024-03-09T15:07:13.516936+0000","last_fullsized":"2024-03-09T15:07:13.516936+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-03-09T15:07:13.516719+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-03-09T15:07:13.516719+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.516719+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:17:49.955637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":107,"num_write":66,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.438270+0000","last_change":"2024-03-09T14:49:53.687783+0000","last_active":"2024-03-09T15:07:09.438270+0000","last_peered":"2024-03-09T15:07:09.438270+0000","last_clean":"2024-03-09T15:07:09.438270+0000","last_became_active":"2024-03-09T14:49:53.683703+0000","last_became_peered":"2024-03-09T14:49:53.683703+0000","last_unstale":"2024-03-09T15:07:09.438270+0000","last_undegraded":"2024-03-09T15:07:09.438270+0000","last_fullsized":"2024-03-09T15:07:09.438270+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'8","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.371272+0000","last_change":"2024-03-09T14:42:19.014096+0000","last_active":"2024-03-09T15:07:04.371272+0000","last_peered":"2024-03-09T15:07:04.371272+0000","last_clean":"2024-03-09T15:07:04.371272+0000","last_became_active":"2024-03-09T14:42:19.013372+0000","last_became_peered":"2024-03-09T14:42:19.013372+0000","last_unstale":"2024-03-09T15:07:04.371272+0000","last_undegraded":"2024-03-09T15:07:04.371272+0000","last_fullsized":"2024-03-09T15:07:04.371272+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"261'3","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.905609+0000","last_change":"2024-03-09T15:07:17.905609+0000","last_active":"2024-03-09T15:07:17.905609+0000","last_peered":"2024-03-09T15:07:17.905609+0000","last_clean":"2024-03-09T15:07:17.905609+0000","last_became_active":"2024-03-09T14:42:15.954274+0000","last_became_peered":"2024-03-09T14:42:15.954274+0000","last_unstale":"2024-03-09T15:07:17.905609+0000","last_undegraded":"2024-03-09T15:07:17.905609+0000","last_fullsized":"2024-03-09T15:07:17.905609+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:17.905341+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:17.905341+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.905341+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:09.793662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'59","reported_seq":208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.867257+0000","last_change":"2024-03-09T15:07:11.867317+0000","last_active":"2024-03-09T15:07:11.867257+0000","last_peered":"2024-03-09T15:07:11.867257+0000","last_clean":"2024-03-09T15:07:11.867257+0000","last_became_active":"2024-03-09T14:39:57.901599+0000","last_became_peered":"2024-03-09T14:39:57.901599+0000","last_unstale":"2024-03-09T15:07:11.867257+0000","last_undegraded":"2024-03-09T15:07:11.867257+0000","last_fullsized":"2024-03-09T15:07:11.867257+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'59","last_scrub_stamp":"2024-03-09T15:07:11.867056+0000","last_deep_scrub":"264'59","last_deep_scrub_stamp":"2024-03-09T15:07:11.867056+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.867056+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:38:36.066989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":206,"num_write":96,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:34.745057+0000","last_change":"2024-03-09T14:49:53.681958+0000","last_active":"2024-03-09T15:06:34.745057+0000","last_peered":"2024-03-09T15:06:34.745057+0000","last_clean":"2024-03-09T15:06:34.745057+0000","last_became_active":"2024-03-09T14:49:53.681327+0000","last_became_peered":"2024-03-09T14:49:53.681327+0000","last_unstale":"2024-03-09T15:06:34.745057+0000","last_undegraded":"2024-03-09T15:06:34.745057+0000","last_fullsized":"2024-03-09T15:06:34.745057+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.052590+0000","last_change":"2024-03-09T15:07:48.052643+0000","last_active":"2024-03-09T15:07:48.052590+0000","last_peered":"2024-03-09T15:07:48.052590+0000","last_clean":"2024-03-09T15:07:48.052590+0000","last_became_active":"2024-03-09T14:42:19.019151+0000","last_became_peered":"2024-03-09T14:42:19.019151+0000","last_unstale":"2024-03-09T15:07:48.052590+0000","last_undegraded":"2024-03-09T15:07:48.052590+0000","last_fullsized":"2024-03-09T15:07:48.052590+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:48.052391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:48.052391+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.052391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:22:16.557124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.917661+0000","last_change":"2024-03-09T15:07:09.917661+0000","last_active":"2024-03-09T15:07:09.917661+0000","last_peered":"2024-03-09T15:07:09.917661+0000","last_clean":"2024-03-09T15:07:09.917661+0000","last_became_active":"2024-03-09T14:42:15.959503+0000","last_became_peered":"2024-03-09T14:42:15.959503+0000","last_unstale":"2024-03-09T15:07:09.917661+0000","last_undegraded":"2024-03-09T15:07:09.917661+0000","last_fullsized":"2024-03-09T15:07:09.917661+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:09.917534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:09.917534+0000","last_clean_scrub_stamp":"2024-03-09T15:07:09.917534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:08.292151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'13","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.270252+0000","last_change":"2024-03-09T15:07:16.270315+0000","last_active":"2024-03-09T15:07:16.270252+0000","last_peered":"2024-03-09T15:07:16.270252+0000","last_clean":"2024-03-09T15:07:16.270252+0000","last_became_active":"2024-03-09T14:39:57.895579+0000","last_became_peered":"2024-03-09T14:39:57.895579+0000","last_unstale":"2024-03-09T15:07:16.270252+0000","last_undegraded":"2024-03-09T15:07:16.270252+0000","last_fullsized":"2024-03-09T15:07:16.270252+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-03-09T15:07:16.270056+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-03-09T15:07:16.270056+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.270056+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:06:45.756532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.743573+0000","last_change":"2024-03-09T14:49:53.681449+0000","last_active":"2024-03-09T15:06:39.743573+0000","last_peered":"2024-03-09T15:06:39.743573+0000","last_clean":"2024-03-09T15:06:39.743573+0000","last_became_active":"2024-03-09T14:49:53.680782+0000","last_became_peered":"2024-03-09T14:49:53.680782+0000","last_unstale":"2024-03-09T15:06:39.743573+0000","last_undegraded":"2024-03-09T15:06:39.743573+0000","last_fullsized":"2024-03-09T15:06:39.743573+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.265711+0000","last_change":"2024-03-09T14:42:19.021910+0000","last_active":"2024-03-09T15:07:11.265711+0000","last_peered":"2024-03-09T15:07:11.265711+0000","last_clean":"2024-03-09T15:07:11.265711+0000","last_became_active":"2024-03-09T14:42:19.020789+0000","last_became_peered":"2024-03-09T14:42:19.020789+0000","last_unstale":"2024-03-09T15:07:11.265711+0000","last_undegraded":"2024-03-09T15:07:11.265711+0000","last_fullsized":"2024-03-09T15:07:11.265711+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'8","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.151321+0000","last_change":"2024-03-09T15:07:44.151501+0000","last_active":"2024-03-09T15:07:44.151321+0000","last_peered":"2024-03-09T15:07:44.151321+0000","last_clean":"2024-03-09T15:07:44.151321+0000","last_became_active":"2024-03-09T14:42:15.960341+0000","last_became_peered":"2024-03-09T14:42:15.960341+0000","last_unstale":"2024-03-09T15:07:44.151321+0000","last_undegraded":"2024-03-09T15:07:44.151321+0000","last_fullsized":"2024-03-09T15:07:44.151321+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-03-09T15:07:44.151029+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-03-09T15:07:44.151029+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.151029+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:57:06.290808+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":20522,"num_write":11,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'42","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.969183+0000","last_change":"2024-03-09T15:07:24.969299+0000","last_active":"2024-03-09T15:07:24.969183+0000","last_peered":"2024-03-09T15:07:24.969183+0000","last_clean":"2024-03-09T15:07:24.969183+0000","last_became_active":"2024-03-09T14:39:57.898267+0000","last_became_peered":"2024-03-09T14:39:57.898267+0000","last_unstale":"2024-03-09T15:07:24.969183+0000","last_undegraded":"2024-03-09T15:07:24.969183+0000","last_fullsized":"2024-03-09T15:07:24.969183+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-03-09T15:07:24.968847+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-03-09T15:07:24.968847+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.968847+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:29.161194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":119,"num_write":82,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'300","reported_seq":1049,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.887674+0000","last_change":"2024-03-09T15:07:47.887782+0000","last_active":"2024-03-09T15:07:47.887674+0000","last_peered":"2024-03-09T15:07:47.887674+0000","last_clean":"2024-03-09T15:07:47.887674+0000","last_became_active":"2024-03-09T14:28:53.623701+0000","last_became_peered":"2024-03-09T14:28:53.623701+0000","last_unstale":"2024-03-09T15:07:47.887674+0000","last_undegraded":"2024-03-09T15:07:47.887674+0000","last_fullsized":"2024-03-09T15:07:47.887674+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'300","last_scrub_stamp":"2024-03-09T15:07:47.887473+0000","last_deep_scrub":"264'300","last_deep_scrub_stamp":"2024-03-09T15:07:47.887473+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.887473+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:14:51.229382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":756,"num_read_kb":36473,"num_write":1139,"num_write_kb":31503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'697","reported_seq":2221,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.460139+0000","last_change":"2024-03-09T15:07:34.460243+0000","last_active":"2024-03-09T15:07:34.460139+0000","last_peered":"2024-03-09T15:07:34.460139+0000","last_clean":"2024-03-09T15:07:34.460139+0000","last_became_active":"2024-03-09T14:28:55.574984+0000","last_became_peered":"2024-03-09T14:28:55.574984+0000","last_unstale":"2024-03-09T15:07:34.460139+0000","last_undegraded":"2024-03-09T15:07:34.460139+0000","last_fullsized":"2024-03-09T15:07:34.460139+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'697","last_scrub_stamp":"2024-03-09T15:07:34.459929+0000","last_deep_scrub":"264'697","last_deep_scrub_stamp":"2024-03-09T15:07:34.459929+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.459929+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:15:13.773840+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3313,"num_read_kb":2995,"num_write":917,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'302","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.559374+0000","last_change":"2024-03-09T15:07:44.559549+0000","last_active":"2024-03-09T15:07:44.559374+0000","last_peered":"2024-03-09T15:07:44.559374+0000","last_clean":"2024-03-09T15:07:44.559374+0000","last_became_active":"2024-03-09T14:28:53.626490+0000","last_became_peered":"2024-03-09T14:28:53.626490+0000","last_unstale":"2024-03-09T15:07:44.559374+0000","last_undegraded":"2024-03-09T15:07:44.559374+0000","last_fullsized":"2024-03-09T15:07:44.559374+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'302","last_scrub_stamp":"2024-03-09T15:07:44.559054+0000","last_deep_scrub":"264'302","last_deep_scrub_stamp":"2024-03-09T15:07:44.559054+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.559054+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:09:37.627354+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5265769,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":463,"num_read_kb":36382,"num_write":1100,"num_write_kb":36054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'348","reported_seq":1738,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.835595+0000","last_change":"2024-03-09T15:07:43.835654+0000","last_active":"2024-03-09T15:07:43.835595+0000","last_peered":"2024-03-09T15:07:43.835595+0000","last_clean":"2024-03-09T15:07:43.835595+0000","last_became_active":"2024-03-09T14:28:55.591640+0000","last_became_peered":"2024-03-09T14:28:55.591640+0000","last_unstale":"2024-03-09T15:07:43.835595+0000","last_undegraded":"2024-03-09T15:07:43.835595+0000","last_fullsized":"2024-03-09T15:07:43.835595+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-03-09T15:07:43.835382+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-03-09T15:07:43.835382+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.835382+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:09:20.349660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1906,"num_read_kb":1805,"num_write":411,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'330","reported_seq":1054,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.971074+0000","last_change":"2024-03-09T15:07:21.971278+0000","last_active":"2024-03-09T15:07:21.971074+0000","last_peered":"2024-03-09T15:07:21.971074+0000","last_clean":"2024-03-09T15:07:21.971074+0000","last_became_active":"2024-03-09T14:29:28.827096+0000","last_became_peered":"2024-03-09T14:29:28.827096+0000","last_unstale":"2024-03-09T15:07:21.971074+0000","last_undegraded":"2024-03-09T15:07:21.971074+0000","last_fullsized":"2024-03-09T15:07:21.971074+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'330","last_scrub_stamp":"2024-03-09T15:07:21.970830+0000","last_deep_scrub":"264'330","last_deep_scrub_stamp":"2024-03-09T15:07:21.970830+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.970830+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:14:08.492056+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262173,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":589,"num_read_kb":23096,"num_write":1233,"num_write_kb":39906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,7],"acting":[3,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"264'401","reported_seq":1894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.888513+0000","last_change":"2024-03-09T15:07:43.888581+0000","last_active":"2024-03-09T15:07:43.888513+0000","last_peered":"2024-03-09T15:07:43.888513+0000","last_clean":"2024-03-09T15:07:43.888513+0000","last_became_active":"2024-03-09T14:28:55.570930+0000","last_became_peered":"2024-03-09T14:28:55.570930+0000","last_unstale":"2024-03-09T15:07:43.888513+0000","last_undegraded":"2024-03-09T15:07:43.888513+0000","last_fullsized":"2024-03-09T15:07:43.888513+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'401","last_scrub_stamp":"2024-03-09T15:07:43.888331+0000","last_deep_scrub":"264'401","last_deep_scrub_stamp":"2024-03-09T15:07:43.888331+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.888331+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:35:42.968547+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2164,"num_read_kb":2043,"num_write":472,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":148,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'297","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.521643+0000","last_change":"2024-03-09T15:07:47.521739+0000","last_active":"2024-03-09T15:07:47.521643+0000","last_peered":"2024-03-09T15:07:47.521643+0000","last_clean":"2024-03-09T15:07:47.521643+0000","last_became_active":"2024-03-09T14:28:53.603454+0000","last_became_peered":"2024-03-09T14:28:53.603454+0000","last_unstale":"2024-03-09T15:07:47.521643+0000","last_undegraded":"2024-03-09T15:07:47.521643+0000","last_fullsized":"2024-03-09T15:07:47.521643+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'297","last_scrub_stamp":"2024-03-09T15:07:47.521438+0000","last_deep_scrub":"264'297","last_deep_scrub_stamp":"2024-03-09T15:07:47.521438+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.521438+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:53:52.031727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":6538,"num_write":1185,"num_write_kb":12238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'435","reported_seq":1946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.704192+0000","last_change":"2024-03-09T15:07:37.704264+0000","last_active":"2024-03-09T15:07:37.704192+0000","last_peered":"2024-03-09T15:07:37.704192+0000","last_clean":"2024-03-09T15:07:37.704192+0000","last_became_active":"2024-03-09T14:28:55.610360+0000","last_became_peered":"2024-03-09T14:28:55.610360+0000","last_unstale":"2024-03-09T15:07:37.704192+0000","last_undegraded":"2024-03-09T15:07:37.704192+0000","last_fullsized":"2024-03-09T15:07:37.704192+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'435","last_scrub_stamp":"2024-03-09T15:07:37.704007+0000","last_deep_scrub":"264'435","last_deep_scrub_stamp":"2024-03-09T15:07:37.704007+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.704007+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:38:19.113285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2375,"num_read_kb":2224,"num_write":558,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'339","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.306662+0000","last_change":"2024-03-09T14:28:53.624123+0000","last_active":"2024-03-09T15:07:05.306662+0000","last_peered":"2024-03-09T15:07:05.306662+0000","last_clean":"2024-03-09T15:07:05.306662+0000","last_became_active":"2024-03-09T14:28:53.622689+0000","last_became_peered":"2024-03-09T14:28:53.622689+0000","last_unstale":"2024-03-09T15:07:05.306662+0000","last_undegraded":"2024-03-09T15:07:05.306662+0000","last_fullsized":"2024-03-09T15:07:05.306662+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9722121,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":529,"num_read_kb":7528,"num_write":1253,"num_write_kb":32260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'365","reported_seq":1929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.198857+0000","last_change":"2024-03-09T15:07:34.199037+0000","last_active":"2024-03-09T15:07:34.198857+0000","last_peered":"2024-03-09T15:07:34.198857+0000","last_clean":"2024-03-09T15:07:34.198857+0000","last_became_active":"2024-03-09T14:28:55.588204+0000","last_became_peered":"2024-03-09T14:28:55.588204+0000","last_unstale":"2024-03-09T15:07:34.198857+0000","last_undegraded":"2024-03-09T15:07:34.198857+0000","last_fullsized":"2024-03-09T15:07:34.198857+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'365","last_scrub_stamp":"2024-03-09T15:07:34.198627+0000","last_deep_scrub":"264'365","last_deep_scrub_stamp":"2024-03-09T15:07:34.198627+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.198627+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:51:37.155815+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2088,"num_read_kb":2012,"num_write":400,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'366","reported_seq":1078,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.548236+0000","last_change":"2024-03-09T15:07:48.548329+0000","last_active":"2024-03-09T15:07:48.548236+0000","last_peered":"2024-03-09T15:07:48.548236+0000","last_clean":"2024-03-09T15:07:48.548236+0000","last_became_active":"2024-03-09T14:28:53.604391+0000","last_became_peered":"2024-03-09T14:28:53.604391+0000","last_unstale":"2024-03-09T15:07:48.548236+0000","last_undegraded":"2024-03-09T15:07:48.548236+0000","last_fullsized":"2024-03-09T15:07:48.548236+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-03-09T15:07:48.548012+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-03-09T15:07:48.548012+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.548012+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:56:53.501630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":836,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":748,"num_read_kb":3295,"num_write":1231,"num_write_kb":34124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'791","reported_seq":2527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.781834+0000","last_change":"2024-03-09T15:07:39.781900+0000","last_active":"2024-03-09T15:07:39.781834+0000","last_peered":"2024-03-09T15:07:39.781834+0000","last_clean":"2024-03-09T15:07:39.781834+0000","last_became_active":"2024-03-09T14:28:55.571291+0000","last_became_peered":"2024-03-09T14:28:55.571291+0000","last_unstale":"2024-03-09T15:07:39.781834+0000","last_undegraded":"2024-03-09T15:07:39.781834+0000","last_fullsized":"2024-03-09T15:07:39.781834+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'791","last_scrub_stamp":"2024-03-09T15:07:39.781646+0000","last_deep_scrub":"264'791","last_deep_scrub_stamp":"2024-03-09T15:07:39.781646+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.781646+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:27:42.910884+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3843,"num_read_kb":3494,"num_write":1039,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'393","reported_seq":1055,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.421110+0000","last_change":"2024-03-09T14:28:53.619197+0000","last_active":"2024-03-09T15:07:05.421110+0000","last_peered":"2024-03-09T15:07:05.421110+0000","last_clean":"2024-03-09T15:07:05.421110+0000","last_became_active":"2024-03-09T14:28:53.618259+0000","last_became_peered":"2024-03-09T14:28:53.618259+0000","last_unstale":"2024-03-09T15:07:05.421110+0000","last_undegraded":"2024-03-09T15:07:05.421110+0000","last_fullsized":"2024-03-09T15:07:05.421110+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243711,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":574,"num_read_kb":8008,"num_write":1507,"num_write_kb":37535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'418","reported_seq":2029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.552305+0000","last_change":"2024-03-09T15:07:28.552375+0000","last_active":"2024-03-09T15:07:28.552305+0000","last_peered":"2024-03-09T15:07:28.552305+0000","last_clean":"2024-03-09T15:07:28.552305+0000","last_became_active":"2024-03-09T14:28:55.587626+0000","last_became_peered":"2024-03-09T14:28:55.587626+0000","last_unstale":"2024-03-09T15:07:28.552305+0000","last_undegraded":"2024-03-09T15:07:28.552305+0000","last_fullsized":"2024-03-09T15:07:28.552305+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'418","last_scrub_stamp":"2024-03-09T15:07:28.552126+0000","last_deep_scrub":"264'418","last_deep_scrub_stamp":"2024-03-09T15:07:28.552126+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.552126+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:50:47.846392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2314,"num_read_kb":2202,"num_write":483,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'331","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.402496+0000","last_change":"2024-03-09T14:28:53.589649+0000","last_active":"2024-03-09T15:07:05.402496+0000","last_peered":"2024-03-09T15:07:05.402496+0000","last_clean":"2024-03-09T15:07:05.402496+0000","last_became_active":"2024-03-09T14:28:53.589232+0000","last_became_peered":"2024-03-09T14:28:53.589232+0000","last_unstale":"2024-03-09T15:07:05.402496+0000","last_undegraded":"2024-03-09T15:07:05.402496+0000","last_fullsized":"2024-03-09T15:07:05.402496+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":42616,"num_write":1235,"num_write_kb":40647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'933","reported_seq":2706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.596632+0000","last_change":"2024-03-09T15:07:34.596714+0000","last_active":"2024-03-09T15:07:34.596632+0000","last_peered":"2024-03-09T15:07:34.596632+0000","last_clean":"2024-03-09T15:07:34.596632+0000","last_became_active":"2024-03-09T14:28:55.602477+0000","last_became_peered":"2024-03-09T14:28:55.602477+0000","last_unstale":"2024-03-09T15:07:34.596632+0000","last_undegraded":"2024-03-09T15:07:34.596632+0000","last_fullsized":"2024-03-09T15:07:34.596632+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'933","last_scrub_stamp":"2024-03-09T15:07:34.596435+0000","last_deep_scrub":"264'933","last_deep_scrub_stamp":"2024-03-09T15:07:34.596435+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.596435+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:19:48.629634+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4605,"num_read_kb":4102,"num_write":1299,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4073,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'355","reported_seq":1808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.824626+0000","last_change":"2024-03-09T15:07:41.824699+0000","last_active":"2024-03-09T15:07:41.824626+0000","last_peered":"2024-03-09T15:07:41.824626+0000","last_clean":"2024-03-09T15:07:41.824626+0000","last_became_active":"2024-03-09T14:28:55.570861+0000","last_became_peered":"2024-03-09T14:28:55.570861+0000","last_unstale":"2024-03-09T15:07:41.824626+0000","last_undegraded":"2024-03-09T15:07:41.824626+0000","last_fullsized":"2024-03-09T15:07:41.824626+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'355","last_scrub_stamp":"2024-03-09T15:07:41.824438+0000","last_deep_scrub":"264'355","last_deep_scrub_stamp":"2024-03-09T15:07:41.824438+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.824438+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:32.514751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1960,"num_read_kb":1866,"num_write":405,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'351","reported_seq":1040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.840256+0000","last_change":"2024-03-09T14:28:53.608951+0000","last_active":"2024-03-09T15:07:12.840256+0000","last_peered":"2024-03-09T15:07:12.840256+0000","last_clean":"2024-03-09T15:07:12.840256+0000","last_became_active":"2024-03-09T14:28:53.607915+0000","last_became_peered":"2024-03-09T14:28:53.607915+0000","last_unstale":"2024-03-09T15:07:12.840256+0000","last_undegraded":"2024-03-09T15:07:12.840256+0000","last_fullsized":"2024-03-09T15:07:12.840256+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5273368,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":78573,"num_write":1337,"num_write_kb":47168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'820","reported_seq":2231,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.912291+0000","last_change":"2024-03-09T15:07:41.912358+0000","last_active":"2024-03-09T15:07:41.912291+0000","last_peered":"2024-03-09T15:07:41.912291+0000","last_clean":"2024-03-09T15:07:41.912291+0000","last_became_active":"2024-03-09T14:28:55.591884+0000","last_became_peered":"2024-03-09T14:28:55.591884+0000","last_unstale":"2024-03-09T15:07:41.912291+0000","last_undegraded":"2024-03-09T15:07:41.912291+0000","last_fullsized":"2024-03-09T15:07:41.912291+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'820","last_scrub_stamp":"2024-03-09T15:07:41.912096+0000","last_deep_scrub":"264'820","last_deep_scrub_stamp":"2024-03-09T15:07:41.912096+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.912096+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:43:11.982031+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3579,"num_read_kb":3134,"num_write":1128,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'247","reported_seq":917,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.227197+0000","last_change":"2024-03-09T15:07:40.227401+0000","last_active":"2024-03-09T15:07:40.227197+0000","last_peered":"2024-03-09T15:07:40.227197+0000","last_clean":"2024-03-09T15:07:40.227197+0000","last_became_active":"2024-03-09T14:28:53.635735+0000","last_became_peered":"2024-03-09T14:28:53.635735+0000","last_unstale":"2024-03-09T15:07:40.227197+0000","last_undegraded":"2024-03-09T15:07:40.227197+0000","last_fullsized":"2024-03-09T15:07:40.227197+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'247","last_scrub_stamp":"2024-03-09T15:07:40.226926+0000","last_deep_scrub":"264'247","last_deep_scrub_stamp":"2024-03-09T15:07:40.226926+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.226926+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:45:25.062019+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":452,"num_read_kb":101132,"num_write":981,"num_write_kb":27272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'366","reported_seq":1878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.515340+0000","last_change":"2024-03-09T15:07:27.515488+0000","last_active":"2024-03-09T15:07:27.515340+0000","last_peered":"2024-03-09T15:07:27.515340+0000","last_clean":"2024-03-09T15:07:27.515340+0000","last_became_active":"2024-03-09T14:28:55.589360+0000","last_became_peered":"2024-03-09T14:28:55.589360+0000","last_unstale":"2024-03-09T15:07:27.515340+0000","last_undegraded":"2024-03-09T15:07:27.515340+0000","last_fullsized":"2024-03-09T15:07:27.515340+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-03-09T15:07:27.515111+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-03-09T15:07:27.515111+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.515111+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:24:53.377750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2092,"num_write":426,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'318","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.266460+0000","last_change":"2024-03-09T15:07:39.266548+0000","last_active":"2024-03-09T15:07:39.266460+0000","last_peered":"2024-03-09T15:07:39.266460+0000","last_clean":"2024-03-09T15:07:39.266460+0000","last_became_active":"2024-03-09T14:28:53.635713+0000","last_became_peered":"2024-03-09T14:28:53.635713+0000","last_unstale":"2024-03-09T15:07:39.266460+0000","last_undegraded":"2024-03-09T15:07:39.266460+0000","last_fullsized":"2024-03-09T15:07:39.266460+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-03-09T15:07:39.266259+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-03-09T15:07:39.266259+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.266259+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:45:23.058863+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1830670,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":532,"num_read_kb":101700,"num_write":1117,"num_write_kb":55747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'1332","reported_seq":3011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.551298+0000","last_change":"2024-03-09T15:07:33.551298+0000","last_active":"2024-03-09T15:07:33.551298+0000","last_peered":"2024-03-09T15:07:33.551298+0000","last_clean":"2024-03-09T15:07:33.551298+0000","last_became_active":"2024-03-09T14:28:55.602235+0000","last_became_peered":"2024-03-09T14:28:55.602235+0000","last_unstale":"2024-03-09T15:07:33.551298+0000","last_undegraded":"2024-03-09T15:07:33.551298+0000","last_fullsized":"2024-03-09T15:07:33.551298+0000","mapping_epoch":25,"log_start":"264'1300","ondisk_log_start":"264'1300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1332","last_scrub_stamp":"2024-03-09T15:07:33.551044+0000","last_deep_scrub":"264'1332","last_deep_scrub_stamp":"2024-03-09T15:07:33.551044+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.551044+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":1300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:12:12.573620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5607,"num_read_kb":4937,"num_write":1889,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'441","reported_seq":1117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.687761+0000","last_change":"2024-03-09T15:07:17.687949+0000","last_active":"2024-03-09T15:07:17.687761+0000","last_peered":"2024-03-09T15:07:17.687761+0000","last_clean":"2024-03-09T15:07:17.687761+0000","last_became_active":"2024-03-09T14:29:28.823751+0000","last_became_peered":"2024-03-09T14:29:28.823751+0000","last_unstale":"2024-03-09T15:07:17.687761+0000","last_undegraded":"2024-03-09T15:07:17.687761+0000","last_fullsized":"2024-03-09T15:07:17.687761+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'441","last_scrub_stamp":"2024-03-09T15:07:17.687334+0000","last_deep_scrub":"264'441","last_deep_scrub_stamp":"2024-03-09T15:07:17.687334+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.687334+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:15:40.736410+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262230,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":811,"num_read_kb":6645,"num_write":1426,"num_write_kb":15242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,0],"acting":[2,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"264'439","reported_seq":2032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.574184+0000","last_change":"2024-03-09T15:07:30.574184+0000","last_active":"2024-03-09T15:07:30.574184+0000","last_peered":"2024-03-09T15:07:30.574184+0000","last_clean":"2024-03-09T15:07:30.574184+0000","last_became_active":"2024-03-09T14:28:55.574645+0000","last_became_peered":"2024-03-09T14:28:55.574645+0000","last_unstale":"2024-03-09T15:07:30.574184+0000","last_undegraded":"2024-03-09T15:07:30.574184+0000","last_fullsized":"2024-03-09T15:07:30.574184+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'439","last_scrub_stamp":"2024-03-09T15:07:30.573900+0000","last_deep_scrub":"264'439","last_deep_scrub_stamp":"2024-03-09T15:07:30.573900+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.573900+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:27:16.783946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2503,"num_read_kb":2358,"num_write":585,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":218,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'378","reported_seq":1048,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.809196+0000","last_change":"2024-03-09T14:28:53.619764+0000","last_active":"2024-03-09T15:07:10.809196+0000","last_peered":"2024-03-09T15:07:10.809196+0000","last_clean":"2024-03-09T15:07:10.809196+0000","last_became_active":"2024-03-09T14:28:53.619291+0000","last_became_peered":"2024-03-09T14:28:53.619291+0000","last_unstale":"2024-03-09T15:07:10.809196+0000","last_undegraded":"2024-03-09T15:07:10.809196+0000","last_fullsized":"2024-03-09T15:07:10.809196+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505224,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":587,"num_read_kb":88953,"num_write":1364,"num_write_kb":34328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'358","reported_seq":1904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.264669+0000","last_change":"2024-03-09T14:28:55.563774+0000","last_active":"2024-03-09T15:07:11.264669+0000","last_peered":"2024-03-09T15:07:11.264669+0000","last_clean":"2024-03-09T15:07:11.264669+0000","last_became_active":"2024-03-09T14:28:55.563041+0000","last_became_peered":"2024-03-09T14:28:55.563041+0000","last_unstale":"2024-03-09T15:07:11.264669+0000","last_undegraded":"2024-03-09T15:07:11.264669+0000","last_fullsized":"2024-03-09T15:07:11.264669+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2055,"num_read_kb":1986,"num_write":393,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'413","reported_seq":1095,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.391552+0000","last_change":"2024-03-09T14:28:53.586359+0000","last_active":"2024-03-09T15:07:05.391552+0000","last_peered":"2024-03-09T15:07:05.391552+0000","last_clean":"2024-03-09T15:07:05.391552+0000","last_became_active":"2024-03-09T14:28:53.585880+0000","last_became_peered":"2024-03-09T14:28:53.585880+0000","last_unstale":"2024-03-09T15:07:05.391552+0000","last_undegraded":"2024-03-09T15:07:05.391552+0000","last_fullsized":"2024-03-09T15:07:05.391552+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22734,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":653,"num_read_kb":65524,"num_write":1383,"num_write_kb":24882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'121","reported_seq":622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.742500+0000","last_change":"2024-03-09T15:07:16.742500+0000","last_active":"2024-03-09T15:07:16.742500+0000","last_peered":"2024-03-09T15:07:16.742500+0000","last_clean":"2024-03-09T15:07:16.742500+0000","last_became_active":"2024-03-09T14:29:03.660224+0000","last_became_peered":"2024-03-09T14:29:03.660224+0000","last_unstale":"2024-03-09T15:07:16.742500+0000","last_undegraded":"2024-03-09T15:07:16.742500+0000","last_fullsized":"2024-03-09T15:07:16.742500+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-03-09T15:07:16.742103+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-03-09T15:07:16.742103+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.742103+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:21.302474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":112,"num_write":285,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'400","reported_seq":1874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.993238+0000","last_change":"2024-03-09T15:07:48.993307+0000","last_active":"2024-03-09T15:07:48.993238+0000","last_peered":"2024-03-09T15:07:48.993238+0000","last_clean":"2024-03-09T15:07:48.993238+0000","last_became_active":"2024-03-09T14:28:55.596404+0000","last_became_peered":"2024-03-09T14:28:55.596404+0000","last_unstale":"2024-03-09T15:07:48.993238+0000","last_undegraded":"2024-03-09T15:07:48.993238+0000","last_fullsized":"2024-03-09T15:07:48.993238+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'400","last_scrub_stamp":"2024-03-09T15:07:48.993015+0000","last_deep_scrub":"264'400","last_deep_scrub_stamp":"2024-03-09T15:07:48.993015+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.993015+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:24.326671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2183,"num_read_kb":2049,"num_write":485,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'309","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.402785+0000","last_change":"2024-03-09T14:28:53.610969+0000","last_active":"2024-03-09T15:07:05.402785+0000","last_peered":"2024-03-09T15:07:05.402785+0000","last_clean":"2024-03-09T15:07:05.402785+0000","last_became_active":"2024-03-09T14:28:53.610073+0000","last_became_peered":"2024-03-09T14:28:53.610073+0000","last_unstale":"2024-03-09T15:07:05.402785+0000","last_undegraded":"2024-03-09T15:07:05.402785+0000","last_fullsized":"2024-03-09T15:07:05.402785+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145852,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":1412,"num_write":1145,"num_write_kb":31021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.452439+0000","last_change":"2024-03-09T15:07:35.452439+0000","last_active":"2024-03-09T15:07:35.452439+0000","last_peered":"2024-03-09T15:07:35.452439+0000","last_clean":"2024-03-09T15:07:35.452439+0000","last_became_active":"2024-03-09T14:28:57.606062+0000","last_became_peered":"2024-03-09T14:28:57.606062+0000","last_unstale":"2024-03-09T15:07:35.452439+0000","last_undegraded":"2024-03-09T15:07:35.452439+0000","last_fullsized":"2024-03-09T15:07:35.452439+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.452193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.452193+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.452193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:44:33.485368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'323","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.627696+0000","last_change":"2024-03-09T15:07:47.627857+0000","last_active":"2024-03-09T15:07:47.627696+0000","last_peered":"2024-03-09T15:07:47.627696+0000","last_clean":"2024-03-09T15:07:47.627696+0000","last_became_active":"2024-03-09T14:28:59.622357+0000","last_became_peered":"2024-03-09T14:28:59.622357+0000","last_unstale":"2024-03-09T15:07:47.627696+0000","last_undegraded":"2024-03-09T15:07:47.627696+0000","last_fullsized":"2024-03-09T15:07:47.627696+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-03-09T15:07:47.627486+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-03-09T15:07:47.627486+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.627486+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:28:27.637878+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":1106,"num_write":404,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.020481+0000","last_change":"2024-03-09T15:07:33.020481+0000","last_active":"2024-03-09T15:07:33.020481+0000","last_peered":"2024-03-09T15:07:33.020481+0000","last_clean":"2024-03-09T15:07:33.020481+0000","last_became_active":"2024-03-09T14:29:01.636497+0000","last_became_peered":"2024-03-09T14:29:01.636497+0000","last_unstale":"2024-03-09T15:07:33.020481+0000","last_undegraded":"2024-03-09T15:07:33.020481+0000","last_fullsized":"2024-03-09T15:07:33.020481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:33.020229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:33.020229+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.020229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:11:56.405268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2461","reported_seq":4894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.488869+0000","last_change":"2024-03-09T15:07:19.488869+0000","last_active":"2024-03-09T15:07:19.488869+0000","last_peered":"2024-03-09T15:07:19.488869+0000","last_clean":"2024-03-09T15:07:19.488869+0000","last_became_active":"2024-03-09T14:29:03.664933+0000","last_became_peered":"2024-03-09T14:29:03.664933+0000","last_unstale":"2024-03-09T15:07:19.488869+0000","last_undegraded":"2024-03-09T15:07:19.488869+0000","last_fullsized":"2024-03-09T15:07:19.488869+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2461","last_scrub_stamp":"2024-03-09T15:07:19.488484+0000","last_deep_scrub":"264'2461","last_deep_scrub_stamp":"2024-03-09T15:07:19.488484+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.488484+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":2400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:36:54.865691+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6733,"num_read_kb":6729,"num_write":4969,"num_write_kb":1822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'424","reported_seq":2010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.536092+0000","last_change":"2024-03-09T15:07:31.536092+0000","last_active":"2024-03-09T15:07:31.536092+0000","last_peered":"2024-03-09T15:07:31.536092+0000","last_clean":"2024-03-09T15:07:31.536092+0000","last_became_active":"2024-03-09T14:28:55.594120+0000","last_became_peered":"2024-03-09T14:28:55.594120+0000","last_unstale":"2024-03-09T15:07:31.536092+0000","last_undegraded":"2024-03-09T15:07:31.536092+0000","last_fullsized":"2024-03-09T15:07:31.536092+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'424","last_scrub_stamp":"2024-03-09T15:07:31.535813+0000","last_deep_scrub":"264'424","last_deep_scrub_stamp":"2024-03-09T15:07:31.535813+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.535813+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:44:00.860601+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2334,"num_read_kb":2217,"num_write":521,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'343","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.391337+0000","last_change":"2024-03-09T14:28:53.592039+0000","last_active":"2024-03-09T15:07:05.391337+0000","last_peered":"2024-03-09T15:07:05.391337+0000","last_clean":"2024-03-09T15:07:05.391337+0000","last_became_active":"2024-03-09T14:28:53.589914+0000","last_became_peered":"2024-03-09T14:28:53.589914+0000","last_unstale":"2024-03-09T15:07:05.391337+0000","last_undegraded":"2024-03-09T15:07:05.391337+0000","last_fullsized":"2024-03-09T15:07:05.391337+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097178,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":36278,"num_write":1215,"num_write_kb":26714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.974004+0000","last_change":"2024-03-09T14:28:57.609556+0000","last_active":"2024-03-09T15:06:24.974004+0000","last_peered":"2024-03-09T15:06:24.974004+0000","last_clean":"2024-03-09T15:06:24.974004+0000","last_became_active":"2024-03-09T14:28:57.608444+0000","last_became_peered":"2024-03-09T14:28:57.608444+0000","last_unstale":"2024-03-09T15:06:24.974004+0000","last_undegraded":"2024-03-09T15:06:24.974004+0000","last_fullsized":"2024-03-09T15:06:24.974004+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'65","reported_seq":582,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.264878+0000","last_change":"2024-03-09T14:28:59.615503+0000","last_active":"2024-03-09T15:07:11.264878+0000","last_peered":"2024-03-09T15:07:11.264878+0000","last_clean":"2024-03-09T15:07:11.264878+0000","last_became_active":"2024-03-09T14:28:59.614144+0000","last_became_peered":"2024-03-09T14:28:59.614144+0000","last_unstale":"2024-03-09T15:07:11.264878+0000","last_undegraded":"2024-03-09T15:07:11.264878+0000","last_fullsized":"2024-03-09T15:07:11.264878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":74,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.728621+0000","last_change":"2024-03-09T15:07:20.728621+0000","last_active":"2024-03-09T15:07:20.728621+0000","last_peered":"2024-03-09T15:07:20.728621+0000","last_clean":"2024-03-09T15:07:20.728621+0000","last_became_active":"2024-03-09T14:29:01.649716+0000","last_became_peered":"2024-03-09T14:29:01.649716+0000","last_unstale":"2024-03-09T15:07:20.728621+0000","last_undegraded":"2024-03-09T15:07:20.728621+0000","last_fullsized":"2024-03-09T15:07:20.728621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.728337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.728337+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.728337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:51:28.102346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'133","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.618295+0000","last_change":"2024-03-09T15:07:24.618367+0000","last_active":"2024-03-09T15:07:24.618295+0000","last_peered":"2024-03-09T15:07:24.618295+0000","last_clean":"2024-03-09T15:07:24.618295+0000","last_became_active":"2024-03-09T14:29:03.676427+0000","last_became_peered":"2024-03-09T14:29:03.676427+0000","last_unstale":"2024-03-09T15:07:24.618295+0000","last_undegraded":"2024-03-09T15:07:24.618295+0000","last_fullsized":"2024-03-09T15:07:24.618295+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'133","last_scrub_stamp":"2024-03-09T15:07:24.618110+0000","last_deep_scrub":"264'133","last_deep_scrub_stamp":"2024-03-09T15:07:24.618110+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.618110+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:34.633535+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":126,"num_write":288,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'348","reported_seq":1739,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.642855+0000","last_change":"2024-03-09T15:07:18.642855+0000","last_active":"2024-03-09T15:07:18.642855+0000","last_peered":"2024-03-09T15:07:18.642855+0000","last_clean":"2024-03-09T15:07:18.642855+0000","last_became_active":"2024-03-09T14:29:28.733522+0000","last_became_peered":"2024-03-09T14:29:28.733522+0000","last_unstale":"2024-03-09T15:07:18.642855+0000","last_undegraded":"2024-03-09T15:07:18.642855+0000","last_fullsized":"2024-03-09T15:07:18.642855+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-03-09T15:07:18.642582+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-03-09T15:07:18.642582+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.642582+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:41:22.443747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1907,"num_read_kb":1804,"num_write":410,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'332","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.877121+0000","last_change":"2024-03-09T15:07:45.877359+0000","last_active":"2024-03-09T15:07:45.877121+0000","last_peered":"2024-03-09T15:07:45.877121+0000","last_clean":"2024-03-09T15:07:45.877121+0000","last_became_active":"2024-03-09T14:28:53.633368+0000","last_became_peered":"2024-03-09T14:28:53.633368+0000","last_unstale":"2024-03-09T15:07:45.877121+0000","last_undegraded":"2024-03-09T15:07:45.877121+0000","last_fullsized":"2024-03-09T15:07:45.877121+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-03-09T15:07:45.876836+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-03-09T15:07:45.876836+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.876836+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:18.348571+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1917981,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":440,"num_read_kb":7245,"num_write":1144,"num_write_kb":29598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.809605+0000","last_change":"2024-03-09T14:28:57.614611+0000","last_active":"2024-03-09T15:07:10.809605+0000","last_peered":"2024-03-09T15:07:10.809605+0000","last_clean":"2024-03-09T15:07:10.809605+0000","last_became_active":"2024-03-09T14:28:57.613841+0000","last_became_peered":"2024-03-09T14:28:57.613841+0000","last_unstale":"2024-03-09T15:07:10.809605+0000","last_undegraded":"2024-03-09T15:07:10.809605+0000","last_fullsized":"2024-03-09T15:07:10.809605+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'109","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.725975+0000","last_change":"2024-03-09T15:07:14.726059+0000","last_active":"2024-03-09T15:07:14.725975+0000","last_peered":"2024-03-09T15:07:14.725975+0000","last_clean":"2024-03-09T15:07:14.725975+0000","last_became_active":"2024-03-09T14:28:59.619147+0000","last_became_peered":"2024-03-09T14:28:59.619147+0000","last_unstale":"2024-03-09T15:07:14.725975+0000","last_undegraded":"2024-03-09T15:07:14.725975+0000","last_fullsized":"2024-03-09T15:07:14.725975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-03-09T15:07:14.725790+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-03-09T15:07:14.725790+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.725790+0000","objects_scrubbed":6,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:39:52.182703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":102,"num_write":78,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'535","reported_seq":3858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.998546+0000","last_change":"2024-03-09T15:07:31.998546+0000","last_active":"2024-03-09T15:07:31.998546+0000","last_peered":"2024-03-09T15:07:31.998546+0000","last_clean":"2024-03-09T15:07:31.998546+0000","last_became_active":"2024-03-09T14:29:01.636743+0000","last_became_peered":"2024-03-09T14:29:01.636743+0000","last_unstale":"2024-03-09T15:07:31.998546+0000","last_undegraded":"2024-03-09T15:07:31.998546+0000","last_fullsized":"2024-03-09T15:07:31.998546+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'535","last_scrub_stamp":"2024-03-09T15:07:31.998158+0000","last_deep_scrub":"264'535","last_deep_scrub_stamp":"2024-03-09T15:07:31.998158+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.998158+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:35:25.070046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'199","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.779254+0000","last_change":"2024-03-09T15:07:17.779323+0000","last_active":"2024-03-09T15:07:17.779254+0000","last_peered":"2024-03-09T15:07:17.779254+0000","last_clean":"2024-03-09T15:07:17.779254+0000","last_became_active":"2024-03-09T14:29:03.649194+0000","last_became_peered":"2024-03-09T14:29:03.649194+0000","last_unstale":"2024-03-09T15:07:17.779254+0000","last_undegraded":"2024-03-09T15:07:17.779254+0000","last_fullsized":"2024-03-09T15:07:17.779254+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-03-09T15:07:17.779057+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-03-09T15:07:17.779057+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.779057+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:30:24.656524+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":551,"num_read_kb":549,"num_write":426,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'372","reported_seq":1855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.998850+0000","last_change":"2024-03-09T15:07:45.998944+0000","last_active":"2024-03-09T15:07:45.998850+0000","last_peered":"2024-03-09T15:07:45.998850+0000","last_clean":"2024-03-09T15:07:45.998850+0000","last_became_active":"2024-03-09T14:28:55.592359+0000","last_became_peered":"2024-03-09T14:28:55.592359+0000","last_unstale":"2024-03-09T15:07:45.998850+0000","last_undegraded":"2024-03-09T15:07:45.998850+0000","last_fullsized":"2024-03-09T15:07:45.998850+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-03-09T15:07:45.998658+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-03-09T15:07:45.998658+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.998658+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:30.189276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2105,"num_read_kb":2015,"num_write":416,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'285","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.227860+0000","last_change":"2024-03-09T15:07:38.228128+0000","last_active":"2024-03-09T15:07:38.227860+0000","last_peered":"2024-03-09T15:07:38.227860+0000","last_clean":"2024-03-09T15:07:38.227860+0000","last_became_active":"2024-03-09T14:28:53.631559+0000","last_became_peered":"2024-03-09T14:28:53.631559+0000","last_unstale":"2024-03-09T15:07:38.227860+0000","last_undegraded":"2024-03-09T15:07:38.227860+0000","last_fullsized":"2024-03-09T15:07:38.227860+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'285","last_scrub_stamp":"2024-03-09T15:07:38.227622+0000","last_deep_scrub":"264'285","last_deep_scrub_stamp":"2024-03-09T15:07:38.227622+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.227622+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:56:47.419876+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8554550,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":396,"num_read_kb":6712,"num_write":1052,"num_write_kb":20730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.462553+0000","last_change":"2024-03-09T15:07:33.462553+0000","last_active":"2024-03-09T15:07:33.462553+0000","last_peered":"2024-03-09T15:07:33.462553+0000","last_clean":"2024-03-09T15:07:33.462553+0000","last_became_active":"2024-03-09T14:28:57.605787+0000","last_became_peered":"2024-03-09T14:28:57.605787+0000","last_unstale":"2024-03-09T15:07:33.462553+0000","last_undegraded":"2024-03-09T15:07:33.462553+0000","last_fullsized":"2024-03-09T15:07:33.462553+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:33.462302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:33.462302+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.462302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:32:24.678793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'243","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.840777+0000","last_change":"2024-03-09T14:28:59.627011+0000","last_active":"2024-03-09T15:07:12.840777+0000","last_peered":"2024-03-09T15:07:12.840777+0000","last_clean":"2024-03-09T15:07:12.840777+0000","last_became_active":"2024-03-09T14:28:59.626279+0000","last_became_peered":"2024-03-09T14:28:59.626279+0000","last_unstale":"2024-03-09T15:07:12.840777+0000","last_undegraded":"2024-03-09T15:07:12.840777+0000","last_fullsized":"2024-03-09T15:07:12.840777+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":970,"num_write":334,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'586","reported_seq":1938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.892927+0000","last_change":"2024-03-09T15:07:33.893056+0000","last_active":"2024-03-09T15:07:33.892927+0000","last_peered":"2024-03-09T15:07:33.892927+0000","last_clean":"2024-03-09T15:07:33.892927+0000","last_became_active":"2024-03-09T14:29:01.628420+0000","last_became_peered":"2024-03-09T14:29:01.628420+0000","last_unstale":"2024-03-09T15:07:33.892927+0000","last_undegraded":"2024-03-09T15:07:33.892927+0000","last_fullsized":"2024-03-09T15:07:33.892927+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'586","last_scrub_stamp":"2024-03-09T15:07:33.892638+0000","last_deep_scrub":"264'586","last_deep_scrub_stamp":"2024-03-09T15:07:33.892638+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.892638+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:25:30.954705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'515","reported_seq":2126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.519569+0000","last_change":"2024-03-09T15:07:30.519735+0000","last_active":"2024-03-09T15:07:30.519569+0000","last_peered":"2024-03-09T15:07:30.519569+0000","last_clean":"2024-03-09T15:07:30.519569+0000","last_became_active":"2024-03-09T14:28:55.582638+0000","last_became_peered":"2024-03-09T14:28:55.582638+0000","last_unstale":"2024-03-09T15:07:30.519569+0000","last_undegraded":"2024-03-09T15:07:30.519569+0000","last_fullsized":"2024-03-09T15:07:30.519569+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'515","last_scrub_stamp":"2024-03-09T15:07:30.519356+0000","last_deep_scrub":"264'515","last_deep_scrub_stamp":"2024-03-09T15:07:30.519356+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.519356+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:46:41.715786+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2835,"num_read_kb":2627,"num_write":675,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'339","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.840021+0000","last_change":"2024-03-09T14:28:53.615478+0000","last_active":"2024-03-09T15:07:12.840021+0000","last_peered":"2024-03-09T15:07:12.840021+0000","last_clean":"2024-03-09T15:07:12.840021+0000","last_became_active":"2024-03-09T14:28:53.614586+0000","last_became_peered":"2024-03-09T14:28:53.614586+0000","last_unstale":"2024-03-09T15:07:12.840021+0000","last_undegraded":"2024-03-09T15:07:12.840021+0000","last_fullsized":"2024-03-09T15:07:12.840021+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180167,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":10439,"num_write":1256,"num_write_kb":25392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.993598+0000","last_change":"2024-03-09T15:07:36.993744+0000","last_active":"2024-03-09T15:07:36.993598+0000","last_peered":"2024-03-09T15:07:36.993598+0000","last_clean":"2024-03-09T15:07:36.993598+0000","last_became_active":"2024-03-09T14:28:57.603233+0000","last_became_peered":"2024-03-09T14:28:57.603233+0000","last_unstale":"2024-03-09T15:07:36.993598+0000","last_undegraded":"2024-03-09T15:07:36.993598+0000","last_fullsized":"2024-03-09T15:07:36.993598+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:36.993362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:36.993362+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.993362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:50:38.382666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'340","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.485546+0000","last_change":"2024-03-09T15:07:23.485642+0000","last_active":"2024-03-09T15:07:23.485546+0000","last_peered":"2024-03-09T15:07:23.485546+0000","last_clean":"2024-03-09T15:07:23.485546+0000","last_became_active":"2024-03-09T14:28:59.626371+0000","last_became_peered":"2024-03-09T14:28:59.626371+0000","last_unstale":"2024-03-09T15:07:23.485546+0000","last_undegraded":"2024-03-09T15:07:23.485546+0000","last_fullsized":"2024-03-09T15:07:23.485546+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'340","last_scrub_stamp":"2024-03-09T15:07:23.485354+0000","last_deep_scrub":"264'340","last_deep_scrub_stamp":"2024-03-09T15:07:23.485354+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.485354+0000","objects_scrubbed":9,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:58:29.645072+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46990,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":561,"num_read_kb":1214,"num_write":446,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.556181+0000","last_change":"2024-03-09T15:07:45.556234+0000","last_active":"2024-03-09T15:07:45.556181+0000","last_peered":"2024-03-09T15:07:45.556181+0000","last_clean":"2024-03-09T15:07:45.556181+0000","last_became_active":"2024-03-09T14:29:01.636735+0000","last_became_peered":"2024-03-09T14:29:01.636735+0000","last_unstale":"2024-03-09T15:07:45.556181+0000","last_undegraded":"2024-03-09T15:07:45.556181+0000","last_fullsized":"2024-03-09T15:07:45.556181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:45.555980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:45.555980+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.555980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:49:20.562981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'545","reported_seq":1376,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.508731+0000","last_change":"2024-03-09T15:07:14.508801+0000","last_active":"2024-03-09T15:07:14.508731+0000","last_peered":"2024-03-09T15:07:14.508731+0000","last_clean":"2024-03-09T15:07:14.508731+0000","last_became_active":"2024-03-09T14:29:03.676068+0000","last_became_peered":"2024-03-09T14:29:03.676068+0000","last_unstale":"2024-03-09T15:07:14.508731+0000","last_undegraded":"2024-03-09T15:07:14.508731+0000","last_fullsized":"2024-03-09T15:07:14.508731+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'545","last_scrub_stamp":"2024-03-09T15:07:14.508537+0000","last_deep_scrub":"264'545","last_deep_scrub_stamp":"2024-03-09T15:07:14.508537+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.508537+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:06:49.609530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1331,"num_read_kb":1310,"num_write":1143,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'507","reported_seq":2121,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.851251+0000","last_change":"2024-03-09T15:07:48.851323+0000","last_active":"2024-03-09T15:07:48.851251+0000","last_peered":"2024-03-09T15:07:48.851251+0000","last_clean":"2024-03-09T15:07:48.851251+0000","last_became_active":"2024-03-09T14:28:55.562782+0000","last_became_peered":"2024-03-09T14:28:55.562782+0000","last_unstale":"2024-03-09T15:07:48.851251+0000","last_undegraded":"2024-03-09T15:07:48.851251+0000","last_fullsized":"2024-03-09T15:07:48.851251+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'507","last_scrub_stamp":"2024-03-09T15:07:48.851059+0000","last_deep_scrub":"264'507","last_deep_scrub_stamp":"2024-03-09T15:07:48.851059+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.851059+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:43:04.936838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2703,"num_read_kb":2505,"num_write":654,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'320","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.750654+0000","last_change":"2024-03-09T14:28:53.614539+0000","last_active":"2024-03-09T15:07:09.750654+0000","last_peered":"2024-03-09T15:07:09.750654+0000","last_clean":"2024-03-09T15:07:09.750654+0000","last_became_active":"2024-03-09T14:28:53.613015+0000","last_became_peered":"2024-03-09T14:28:53.613015+0000","last_unstale":"2024-03-09T15:07:09.750654+0000","last_undegraded":"2024-03-09T15:07:09.750654+0000","last_fullsized":"2024-03-09T15:07:09.750654+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":493,"num_read_kb":9909,"num_write":1175,"num_write_kb":22337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.500050+0000","last_change":"2024-03-09T15:07:26.500103+0000","last_active":"2024-03-09T15:07:26.500050+0000","last_peered":"2024-03-09T15:07:26.500050+0000","last_clean":"2024-03-09T15:07:26.500050+0000","last_became_active":"2024-03-09T14:28:57.605493+0000","last_became_peered":"2024-03-09T14:28:57.605493+0000","last_unstale":"2024-03-09T15:07:26.500050+0000","last_undegraded":"2024-03-09T15:07:26.500050+0000","last_fullsized":"2024-03-09T15:07:26.500050+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:26.499852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:26.499852+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.499852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:50:05.246070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'263","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.809727+0000","last_change":"2024-03-09T14:28:59.615074+0000","last_active":"2024-03-09T15:07:10.809727+0000","last_peered":"2024-03-09T15:07:10.809727+0000","last_clean":"2024-03-09T15:07:10.809727+0000","last_became_active":"2024-03-09T14:28:59.614640+0000","last_became_peered":"2024-03-09T14:28:59.614640+0000","last_unstale":"2024-03-09T15:07:10.809727+0000","last_undegraded":"2024-03-09T15:07:10.809727+0000","last_fullsized":"2024-03-09T15:07:10.809727+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43961,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1047,"num_write":356,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.964727+0000","last_change":"2024-03-09T15:07:35.964788+0000","last_active":"2024-03-09T15:07:35.964727+0000","last_peered":"2024-03-09T15:07:35.964727+0000","last_clean":"2024-03-09T15:07:35.964727+0000","last_became_active":"2024-03-09T14:29:01.627897+0000","last_became_peered":"2024-03-09T14:29:01.627897+0000","last_unstale":"2024-03-09T15:07:35.964727+0000","last_undegraded":"2024-03-09T15:07:35.964727+0000","last_fullsized":"2024-03-09T15:07:35.964727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.964526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.964526+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.964526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:44:17.279534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'107","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.239481+0000","last_change":"2024-03-09T15:07:33.239545+0000","last_active":"2024-03-09T15:07:33.239481+0000","last_peered":"2024-03-09T15:07:33.239481+0000","last_clean":"2024-03-09T15:07:33.239481+0000","last_became_active":"2024-03-09T14:29:03.673265+0000","last_became_peered":"2024-03-09T14:29:03.673265+0000","last_unstale":"2024-03-09T15:07:33.239481+0000","last_undegraded":"2024-03-09T15:07:33.239481+0000","last_fullsized":"2024-03-09T15:07:33.239481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-03-09T15:07:33.239261+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-03-09T15:07:33.239261+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.239261+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:39:44.261038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":93,"num_write":248,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'558","reported_seq":2196,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.192013+0000","last_change":"2024-03-09T15:07:32.192096+0000","last_active":"2024-03-09T15:07:32.192013+0000","last_peered":"2024-03-09T15:07:32.192013+0000","last_clean":"2024-03-09T15:07:32.192013+0000","last_became_active":"2024-03-09T14:28:55.588092+0000","last_became_peered":"2024-03-09T14:28:55.588092+0000","last_unstale":"2024-03-09T15:07:32.192013+0000","last_undegraded":"2024-03-09T15:07:32.192013+0000","last_fullsized":"2024-03-09T15:07:32.192013+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'558","last_scrub_stamp":"2024-03-09T15:07:32.191808+0000","last_deep_scrub":"264'558","last_deep_scrub_stamp":"2024-03-09T15:07:32.191808+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.191808+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:52:46.626276+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2916,"num_read_kb":2661,"num_write":728,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":556,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'301","reported_seq":887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.675925+0000","last_change":"2024-03-09T15:07:15.675925+0000","last_active":"2024-03-09T15:07:15.675925+0000","last_peered":"2024-03-09T15:07:15.675925+0000","last_clean":"2024-03-09T15:07:15.675925+0000","last_became_active":"2024-03-09T14:29:28.822971+0000","last_became_peered":"2024-03-09T14:29:28.822971+0000","last_unstale":"2024-03-09T15:07:15.675925+0000","last_undegraded":"2024-03-09T15:07:15.675925+0000","last_fullsized":"2024-03-09T15:07:15.675925+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'301","last_scrub_stamp":"2024-03-09T15:07:15.675604+0000","last_deep_scrub":"264'301","last_deep_scrub_stamp":"2024-03-09T15:07:15.675604+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.675604+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:44.567227+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262197,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":365,"num_read_kb":22880,"num_write":991,"num_write_kb":75728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.593360+0000","last_change":"2024-03-09T15:07:20.593411+0000","last_active":"2024-03-09T15:07:20.593360+0000","last_peered":"2024-03-09T15:07:20.593360+0000","last_clean":"2024-03-09T15:07:20.593360+0000","last_became_active":"2024-03-09T14:28:57.610472+0000","last_became_peered":"2024-03-09T14:28:57.610472+0000","last_unstale":"2024-03-09T15:07:20.593360+0000","last_undegraded":"2024-03-09T15:07:20.593360+0000","last_fullsized":"2024-03-09T15:07:20.593360+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.593168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.593168+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.593168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:29:16.398211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'311","reported_seq":894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.838619+0000","last_change":"2024-03-09T15:07:44.838773+0000","last_active":"2024-03-09T15:07:44.838619+0000","last_peered":"2024-03-09T15:07:44.838619+0000","last_clean":"2024-03-09T15:07:44.838619+0000","last_became_active":"2024-03-09T14:28:59.610930+0000","last_became_peered":"2024-03-09T14:28:59.610930+0000","last_unstale":"2024-03-09T15:07:44.838619+0000","last_undegraded":"2024-03-09T15:07:44.838619+0000","last_fullsized":"2024-03-09T15:07:44.838619+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'311","last_scrub_stamp":"2024-03-09T15:07:44.838298+0000","last_deep_scrub":"264'311","last_deep_scrub_stamp":"2024-03-09T15:07:44.838298+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.838298+0000","objects_scrubbed":8,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:31:47.870542+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48936,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":498,"num_read_kb":1136,"num_write":410,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'561","reported_seq":2062,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.783833+0000","last_change":"2024-03-09T15:07:34.783893+0000","last_active":"2024-03-09T15:07:34.783833+0000","last_peered":"2024-03-09T15:07:34.783833+0000","last_clean":"2024-03-09T15:07:34.783833+0000","last_became_active":"2024-03-09T14:29:01.647361+0000","last_became_peered":"2024-03-09T14:29:01.647361+0000","last_unstale":"2024-03-09T15:07:34.783833+0000","last_undegraded":"2024-03-09T15:07:34.783833+0000","last_fullsized":"2024-03-09T15:07:34.783833+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'561","last_scrub_stamp":"2024-03-09T15:07:34.783640+0000","last_deep_scrub":"264'561","last_deep_scrub_stamp":"2024-03-09T15:07:34.783640+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.783640+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:39:17.912636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'138","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.680719+0000","last_change":"2024-03-09T15:07:26.680790+0000","last_active":"2024-03-09T15:07:26.680719+0000","last_peered":"2024-03-09T15:07:26.680719+0000","last_clean":"2024-03-09T15:07:26.680719+0000","last_became_active":"2024-03-09T14:29:03.665744+0000","last_became_peered":"2024-03-09T14:29:03.665744+0000","last_unstale":"2024-03-09T15:07:26.680719+0000","last_undegraded":"2024-03-09T15:07:26.680719+0000","last_fullsized":"2024-03-09T15:07:26.680719+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-03-09T15:07:26.680521+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-03-09T15:07:26.680521+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.680521+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:01.192699+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'383","reported_seq":2005,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.736800+0000","last_change":"2024-03-09T15:07:40.736871+0000","last_active":"2024-03-09T15:07:40.736800+0000","last_peered":"2024-03-09T15:07:40.736800+0000","last_clean":"2024-03-09T15:07:40.736800+0000","last_became_active":"2024-03-09T14:28:55.587413+0000","last_became_peered":"2024-03-09T14:28:55.587413+0000","last_unstale":"2024-03-09T15:07:40.736800+0000","last_undegraded":"2024-03-09T15:07:40.736800+0000","last_fullsized":"2024-03-09T15:07:40.736800+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'383","last_scrub_stamp":"2024-03-09T15:07:40.736592+0000","last_deep_scrub":"264'383","last_deep_scrub_stamp":"2024-03-09T15:07:40.736592+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.736592+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:21:16.406333+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2251,"num_read_kb":2175,"num_write":432,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2785,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'286","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.503429+0000","last_change":"2024-03-09T15:07:36.503537+0000","last_active":"2024-03-09T15:07:36.503429+0000","last_peered":"2024-03-09T15:07:36.503429+0000","last_clean":"2024-03-09T15:07:36.503429+0000","last_became_active":"2024-03-09T14:28:53.639073+0000","last_became_peered":"2024-03-09T14:28:53.639073+0000","last_unstale":"2024-03-09T15:07:36.503429+0000","last_undegraded":"2024-03-09T15:07:36.503429+0000","last_fullsized":"2024-03-09T15:07:36.503429+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'286","last_scrub_stamp":"2024-03-09T15:07:36.503200+0000","last_deep_scrub":"264'286","last_deep_scrub_stamp":"2024-03-09T15:07:36.503200+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.503200+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:19:59.978473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656710,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":422,"num_read_kb":3405,"num_write":1144,"num_write_kb":27946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.643197+0000","last_change":"2024-03-09T15:07:18.643287+0000","last_active":"2024-03-09T15:07:18.643197+0000","last_peered":"2024-03-09T15:07:18.643197+0000","last_clean":"2024-03-09T15:07:18.643197+0000","last_became_active":"2024-03-09T14:28:57.620037+0000","last_became_peered":"2024-03-09T14:28:57.620037+0000","last_unstale":"2024-03-09T15:07:18.643197+0000","last_undegraded":"2024-03-09T15:07:18.643197+0000","last_fullsized":"2024-03-09T15:07:18.643197+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:18.642943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:18.642943+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.642943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:49:35.857746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'470","reported_seq":1091,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.264346+0000","last_change":"2024-03-09T14:28:59.626702+0000","last_active":"2024-03-09T15:07:04.264346+0000","last_peered":"2024-03-09T15:07:04.264346+0000","last_clean":"2024-03-09T15:07:04.264346+0000","last_became_active":"2024-03-09T14:28:59.625949+0000","last_became_peered":"2024-03-09T14:28:59.625949+0000","last_unstale":"2024-03-09T15:07:04.264346+0000","last_undegraded":"2024-03-09T15:07:04.264346+0000","last_fullsized":"2024-03-09T15:07:04.264346+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":400,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84476,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":828,"num_read_kb":2021,"num_write":686,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.761473+0000","last_change":"2024-03-09T15:07:12.761532+0000","last_active":"2024-03-09T15:07:12.761473+0000","last_peered":"2024-03-09T15:07:12.761473+0000","last_clean":"2024-03-09T15:07:12.761473+0000","last_became_active":"2024-03-09T14:29:01.620136+0000","last_became_peered":"2024-03-09T14:29:01.620136+0000","last_unstale":"2024-03-09T15:07:12.761473+0000","last_undegraded":"2024-03-09T15:07:12.761473+0000","last_fullsized":"2024-03-09T15:07:12.761473+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:12.761261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:12.761261+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.761261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:22:11.707212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'161","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.963973+0000","last_change":"2024-03-09T15:07:17.964042+0000","last_active":"2024-03-09T15:07:17.963973+0000","last_peered":"2024-03-09T15:07:17.963973+0000","last_clean":"2024-03-09T15:07:17.963973+0000","last_became_active":"2024-03-09T14:29:03.673216+0000","last_became_peered":"2024-03-09T14:29:03.673216+0000","last_unstale":"2024-03-09T15:07:17.963973+0000","last_undegraded":"2024-03-09T15:07:17.963973+0000","last_fullsized":"2024-03-09T15:07:17.963973+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'161","last_scrub_stamp":"2024-03-09T15:07:17.963795+0000","last_deep_scrub":"264'161","last_deep_scrub_stamp":"2024-03-09T15:07:17.963795+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.963795+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:47:11.924876+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":716,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":343,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'285","reported_seq":1646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.776038+0000","last_change":"2024-03-09T15:07:35.776186+0000","last_active":"2024-03-09T15:07:35.776038+0000","last_peered":"2024-03-09T15:07:35.776038+0000","last_clean":"2024-03-09T15:07:35.776038+0000","last_became_active":"2024-03-09T14:28:55.575211+0000","last_became_peered":"2024-03-09T14:28:55.575211+0000","last_unstale":"2024-03-09T15:07:35.776038+0000","last_undegraded":"2024-03-09T15:07:35.776038+0000","last_fullsized":"2024-03-09T15:07:35.776038+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'285","last_scrub_stamp":"2024-03-09T15:07:35.775806+0000","last_deep_scrub":"264'285","last_deep_scrub_stamp":"2024-03-09T15:07:35.775806+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.775806+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:52:28.874528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1639,"num_read_kb":1592,"num_write":307,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'315","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.983675+0000","last_change":"2024-03-09T14:28:53.562474+0000","last_active":"2024-03-09T15:07:09.983675+0000","last_peered":"2024-03-09T15:07:09.983675+0000","last_clean":"2024-03-09T15:07:09.983675+0000","last_became_active":"2024-03-09T14:28:53.561769+0000","last_became_peered":"2024-03-09T14:28:53.561769+0000","last_unstale":"2024-03-09T15:07:09.983675+0000","last_undegraded":"2024-03-09T15:07:09.983675+0000","last_fullsized":"2024-03-09T15:07:09.983675+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":556,"num_read_kb":46371,"num_write":1232,"num_write_kb":14767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.518216+0000","last_change":"2024-03-09T15:07:24.518273+0000","last_active":"2024-03-09T15:07:24.518216+0000","last_peered":"2024-03-09T15:07:24.518216+0000","last_clean":"2024-03-09T15:07:24.518216+0000","last_became_active":"2024-03-09T14:28:57.606029+0000","last_became_peered":"2024-03-09T14:28:57.606029+0000","last_unstale":"2024-03-09T15:07:24.518216+0000","last_undegraded":"2024-03-09T15:07:24.518216+0000","last_fullsized":"2024-03-09T15:07:24.518216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:24.517981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:24.517981+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.517981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:03.615664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'277","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.729802+0000","last_change":"2024-03-09T15:07:23.729911+0000","last_active":"2024-03-09T15:07:23.729802+0000","last_peered":"2024-03-09T15:07:23.729802+0000","last_clean":"2024-03-09T15:07:23.729802+0000","last_became_active":"2024-03-09T14:28:59.630097+0000","last_became_peered":"2024-03-09T14:28:59.630097+0000","last_unstale":"2024-03-09T15:07:23.729802+0000","last_undegraded":"2024-03-09T15:07:23.729802+0000","last_fullsized":"2024-03-09T15:07:23.729802+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'277","last_scrub_stamp":"2024-03-09T15:07:23.729634+0000","last_deep_scrub":"264'277","last_deep_scrub_stamp":"2024-03-09T15:07:23.729634+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.729634+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:54:34.396344+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42990,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":1018,"num_write":414,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13964,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.735309+0000","last_change":"2024-03-09T15:07:30.735368+0000","last_active":"2024-03-09T15:07:30.735309+0000","last_peered":"2024-03-09T15:07:30.735309+0000","last_clean":"2024-03-09T15:07:30.735309+0000","last_became_active":"2024-03-09T14:29:01.647375+0000","last_became_peered":"2024-03-09T14:29:01.647375+0000","last_unstale":"2024-03-09T15:07:30.735309+0000","last_undegraded":"2024-03-09T15:07:30.735309+0000","last_fullsized":"2024-03-09T15:07:30.735309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:30.735096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:30.735096+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.735096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:02:27.562547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'131","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.012999+0000","last_change":"2024-03-09T15:07:11.013027+0000","last_active":"2024-03-09T15:07:11.012999+0000","last_peered":"2024-03-09T15:07:11.012999+0000","last_clean":"2024-03-09T15:07:11.012999+0000","last_became_active":"2024-03-09T14:29:03.677704+0000","last_became_peered":"2024-03-09T14:29:03.677704+0000","last_unstale":"2024-03-09T15:07:11.012999+0000","last_undegraded":"2024-03-09T15:07:11.012999+0000","last_fullsized":"2024-03-09T15:07:11.012999+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-03-09T15:07:11.012928+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-03-09T15:07:11.012928+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.012928+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:47:36.358128+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":309,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'401","reported_seq":2053,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.749796+0000","last_change":"2024-03-09T15:07:33.749866+0000","last_active":"2024-03-09T15:07:33.749796+0000","last_peered":"2024-03-09T15:07:33.749796+0000","last_clean":"2024-03-09T15:07:33.749796+0000","last_became_active":"2024-03-09T14:28:55.577690+0000","last_became_peered":"2024-03-09T14:28:55.577690+0000","last_unstale":"2024-03-09T15:07:33.749796+0000","last_undegraded":"2024-03-09T15:07:33.749796+0000","last_fullsized":"2024-03-09T15:07:33.749796+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'401","last_scrub_stamp":"2024-03-09T15:07:33.749602+0000","last_deep_scrub":"264'401","last_deep_scrub_stamp":"2024-03-09T15:07:33.749602+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.749602+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:10:47.176225+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2493,"num_read_kb":2366,"num_write":474,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2864,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'293","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.224335+0000","last_change":"2024-03-09T15:07:36.224450+0000","last_active":"2024-03-09T15:07:36.224335+0000","last_peered":"2024-03-09T15:07:36.224335+0000","last_clean":"2024-03-09T15:07:36.224335+0000","last_became_active":"2024-03-09T14:28:53.627013+0000","last_became_peered":"2024-03-09T14:28:53.627013+0000","last_unstale":"2024-03-09T15:07:36.224335+0000","last_undegraded":"2024-03-09T15:07:36.224335+0000","last_fullsized":"2024-03-09T15:07:36.224335+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'293","last_scrub_stamp":"2024-03-09T15:07:36.224112+0000","last_deep_scrub":"264'293","last_deep_scrub_stamp":"2024-03-09T15:07:36.224112+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.224112+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:02:25.648110+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242906,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":6489,"num_write":1122,"num_write_kb":11469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.827752+0000","last_change":"2024-03-09T15:07:23.827856+0000","last_active":"2024-03-09T15:07:23.827752+0000","last_peered":"2024-03-09T15:07:23.827752+0000","last_clean":"2024-03-09T15:07:23.827752+0000","last_became_active":"2024-03-09T14:28:57.614028+0000","last_became_peered":"2024-03-09T14:28:57.614028+0000","last_unstale":"2024-03-09T15:07:23.827752+0000","last_undegraded":"2024-03-09T15:07:23.827752+0000","last_fullsized":"2024-03-09T15:07:23.827752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:23.827525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:23.827525+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.827525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:24:15.966605+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'266","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.640027+0000","last_change":"2024-03-09T15:07:16.640027+0000","last_active":"2024-03-09T15:07:16.640027+0000","last_peered":"2024-03-09T15:07:16.640027+0000","last_clean":"2024-03-09T15:07:16.640027+0000","last_became_active":"2024-03-09T14:28:59.613169+0000","last_became_peered":"2024-03-09T14:28:59.613169+0000","last_unstale":"2024-03-09T15:07:16.640027+0000","last_undegraded":"2024-03-09T15:07:16.640027+0000","last_fullsized":"2024-03-09T15:07:16.640027+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-03-09T15:07:16.639752+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-03-09T15:07:16.639752+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.639752+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:43.931037+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":434,"num_read_kb":985,"num_write":344,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'525","reported_seq":4084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.761709+0000","last_change":"2024-03-09T15:07:11.761709+0000","last_active":"2024-03-09T15:07:11.761709+0000","last_peered":"2024-03-09T15:07:11.761709+0000","last_clean":"2024-03-09T15:07:11.761709+0000","last_became_active":"2024-03-09T14:29:01.633363+0000","last_became_peered":"2024-03-09T14:29:01.633363+0000","last_unstale":"2024-03-09T15:07:11.761709+0000","last_undegraded":"2024-03-09T15:07:11.761709+0000","last_fullsized":"2024-03-09T15:07:11.761709+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'525","last_scrub_stamp":"2024-03-09T15:07:11.761590+0000","last_deep_scrub":"264'525","last_deep_scrub_stamp":"2024-03-09T15:07:11.761590+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.761590+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:01.906869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'120","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.054420+0000","last_change":"2024-03-09T15:07:15.054514+0000","last_active":"2024-03-09T15:07:15.054420+0000","last_peered":"2024-03-09T15:07:15.054420+0000","last_clean":"2024-03-09T15:07:15.054420+0000","last_became_active":"2024-03-09T14:29:03.679941+0000","last_became_peered":"2024-03-09T14:29:03.679941+0000","last_unstale":"2024-03-09T15:07:15.054420+0000","last_undegraded":"2024-03-09T15:07:15.054420+0000","last_fullsized":"2024-03-09T15:07:15.054420+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-03-09T15:07:15.054218+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-03-09T15:07:15.054218+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.054218+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:13:22.609108+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1871,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":265,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'459","reported_seq":2162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.779128+0000","last_change":"2024-03-09T15:07:28.779197+0000","last_active":"2024-03-09T15:07:28.779128+0000","last_peered":"2024-03-09T15:07:28.779128+0000","last_clean":"2024-03-09T15:07:28.779128+0000","last_became_active":"2024-03-09T14:28:55.589982+0000","last_became_peered":"2024-03-09T14:28:55.589982+0000","last_unstale":"2024-03-09T15:07:28.779128+0000","last_undegraded":"2024-03-09T15:07:28.779128+0000","last_fullsized":"2024-03-09T15:07:28.779128+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'459","last_scrub_stamp":"2024-03-09T15:07:28.778936+0000","last_deep_scrub":"264'459","last_deep_scrub_stamp":"2024-03-09T15:07:28.778936+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.778936+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:20:52.811305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2457,"num_read_kb":2347,"num_write":517,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'336","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.849526+0000","last_change":"2024-03-09T15:07:45.849767+0000","last_active":"2024-03-09T15:07:45.849526+0000","last_peered":"2024-03-09T15:07:45.849526+0000","last_clean":"2024-03-09T15:07:45.849526+0000","last_became_active":"2024-03-09T14:28:53.596847+0000","last_became_peered":"2024-03-09T14:28:53.596847+0000","last_unstale":"2024-03-09T15:07:45.849526+0000","last_undegraded":"2024-03-09T15:07:45.849526+0000","last_fullsized":"2024-03-09T15:07:45.849526+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-03-09T15:07:45.849293+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-03-09T15:07:45.849293+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.849293+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:11:45.242419+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243083,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":7047,"num_write":1167,"num_write_kb":21742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.572847+0000","last_change":"2024-03-09T15:07:41.572994+0000","last_active":"2024-03-09T15:07:41.572847+0000","last_peered":"2024-03-09T15:07:41.572847+0000","last_clean":"2024-03-09T15:07:41.572847+0000","last_became_active":"2024-03-09T14:28:57.618459+0000","last_became_peered":"2024-03-09T14:28:57.618459+0000","last_unstale":"2024-03-09T15:07:41.572847+0000","last_undegraded":"2024-03-09T15:07:41.572847+0000","last_fullsized":"2024-03-09T15:07:41.572847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:07:41.572624+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:07:41.572624+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.572624+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:59:03.798948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":640,"num_read_kb":640,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'61","reported_seq":576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.019811+0000","last_change":"2024-03-09T15:07:37.019886+0000","last_active":"2024-03-09T15:07:37.019811+0000","last_peered":"2024-03-09T15:07:37.019811+0000","last_clean":"2024-03-09T15:07:37.019811+0000","last_became_active":"2024-03-09T14:28:59.634653+0000","last_became_peered":"2024-03-09T14:28:59.634653+0000","last_unstale":"2024-03-09T15:07:37.019811+0000","last_undegraded":"2024-03-09T15:07:37.019811+0000","last_fullsized":"2024-03-09T15:07:37.019811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'61","last_scrub_stamp":"2024-03-09T15:07:37.019629+0000","last_deep_scrub":"264'61","last_deep_scrub_stamp":"2024-03-09T15:07:37.019629+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.019629+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:56:39.123329+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'537","reported_seq":1996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.258519+0000","last_change":"2024-03-09T15:07:25.258582+0000","last_active":"2024-03-09T15:07:25.258519+0000","last_peered":"2024-03-09T15:07:25.258519+0000","last_clean":"2024-03-09T15:07:25.258519+0000","last_became_active":"2024-03-09T14:29:01.656177+0000","last_became_peered":"2024-03-09T14:29:01.656177+0000","last_unstale":"2024-03-09T15:07:25.258519+0000","last_undegraded":"2024-03-09T15:07:25.258519+0000","last_fullsized":"2024-03-09T15:07:25.258519+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'537","last_scrub_stamp":"2024-03-09T15:07:25.258322+0000","last_deep_scrub":"264'537","last_deep_scrub_stamp":"2024-03-09T15:07:25.258322+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.258322+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:08:40.564114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'150","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.798479+0000","last_change":"2024-03-09T15:07:13.798635+0000","last_active":"2024-03-09T15:07:13.798479+0000","last_peered":"2024-03-09T15:07:13.798479+0000","last_clean":"2024-03-09T15:07:13.798479+0000","last_became_active":"2024-03-09T14:29:03.672416+0000","last_became_peered":"2024-03-09T14:29:03.672416+0000","last_unstale":"2024-03-09T15:07:13.798479+0000","last_undegraded":"2024-03-09T15:07:13.798479+0000","last_fullsized":"2024-03-09T15:07:13.798479+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'150","last_scrub_stamp":"2024-03-09T15:07:13.798260+0000","last_deep_scrub":"264'150","last_deep_scrub_stamp":"2024-03-09T15:07:13.798260+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.798260+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:30:31.358279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":118,"num_read_kb":112,"num_write":348,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'862","reported_seq":2485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.889037+0000","last_change":"2024-03-09T15:07:32.889198+0000","last_active":"2024-03-09T15:07:32.889037+0000","last_peered":"2024-03-09T15:07:32.889037+0000","last_clean":"2024-03-09T15:07:32.889037+0000","last_became_active":"2024-03-09T14:28:55.583618+0000","last_became_peered":"2024-03-09T14:28:55.583618+0000","last_unstale":"2024-03-09T15:07:32.889037+0000","last_undegraded":"2024-03-09T15:07:32.889037+0000","last_fullsized":"2024-03-09T15:07:32.889037+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'862","last_scrub_stamp":"2024-03-09T15:07:32.888792+0000","last_deep_scrub":"264'862","last_deep_scrub_stamp":"2024-03-09T15:07:32.888792+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.888792+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:39:33.341783+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4083,"num_read_kb":3643,"num_write":1199,"num_write_kb":506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'316","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.420805+0000","last_change":"2024-03-09T14:28:53.568437+0000","last_active":"2024-03-09T15:07:05.420805+0000","last_peered":"2024-03-09T15:07:05.420805+0000","last_clean":"2024-03-09T15:07:05.420805+0000","last_became_active":"2024-03-09T14:28:53.568002+0000","last_became_peered":"2024-03-09T14:28:53.568002+0000","last_unstale":"2024-03-09T15:07:05.420805+0000","last_undegraded":"2024-03-09T15:07:05.420805+0000","last_fullsized":"2024-03-09T15:07:05.420805+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":642,"num_read_kb":26434,"num_write":1119,"num_write_kb":51619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.851109+0000","last_change":"2024-03-09T15:07:42.851170+0000","last_active":"2024-03-09T15:07:42.851109+0000","last_peered":"2024-03-09T15:07:42.851109+0000","last_clean":"2024-03-09T15:07:42.851109+0000","last_became_active":"2024-03-09T14:28:57.615518+0000","last_became_peered":"2024-03-09T14:28:57.615518+0000","last_unstale":"2024-03-09T15:07:42.851109+0000","last_undegraded":"2024-03-09T15:07:42.851109+0000","last_fullsized":"2024-03-09T15:07:42.851109+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:42.850886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:42.850886+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.850886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:31:54.652894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'366","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.533931+0000","last_change":"2024-03-09T15:07:24.534001+0000","last_active":"2024-03-09T15:07:24.533931+0000","last_peered":"2024-03-09T15:07:24.533931+0000","last_clean":"2024-03-09T15:07:24.533931+0000","last_became_active":"2024-03-09T14:28:59.607095+0000","last_became_peered":"2024-03-09T14:28:59.607095+0000","last_unstale":"2024-03-09T15:07:24.533931+0000","last_undegraded":"2024-03-09T15:07:24.533931+0000","last_fullsized":"2024-03-09T15:07:24.533931+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-03-09T15:07:24.533841+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-03-09T15:07:24.533841+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.533841+0000","objects_scrubbed":9,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:56:28.568205+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47607,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1194,"num_read_kb":1839,"num_write":1728,"num_write_kb":1610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":509628,"num_omap_keys":1178,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.241687+0000","last_change":"2024-03-09T15:07:19.241687+0000","last_active":"2024-03-09T15:07:19.241687+0000","last_peered":"2024-03-09T15:07:19.241687+0000","last_clean":"2024-03-09T15:07:19.241687+0000","last_became_active":"2024-03-09T14:29:01.649769+0000","last_became_peered":"2024-03-09T14:29:01.649769+0000","last_unstale":"2024-03-09T15:07:19.241687+0000","last_undegraded":"2024-03-09T15:07:19.241687+0000","last_fullsized":"2024-03-09T15:07:19.241687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:19.241439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:19.241439+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.241439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:46.292381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'143","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.002404+0000","last_change":"2024-03-09T15:07:17.002467+0000","last_active":"2024-03-09T15:07:17.002404+0000","last_peered":"2024-03-09T15:07:17.002404+0000","last_clean":"2024-03-09T15:07:17.002404+0000","last_became_active":"2024-03-09T14:29:03.678140+0000","last_became_peered":"2024-03-09T14:29:03.678140+0000","last_unstale":"2024-03-09T15:07:17.002404+0000","last_undegraded":"2024-03-09T15:07:17.002404+0000","last_fullsized":"2024-03-09T15:07:17.002404+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'143","last_scrub_stamp":"2024-03-09T15:07:17.002216+0000","last_deep_scrub":"264'143","last_deep_scrub_stamp":"2024-03-09T15:07:17.002216+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.002216+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:57.619898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":150,"num_write":332,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'1641","reported_seq":3319,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.234223+0000","last_change":"2024-03-09T15:07:30.234293+0000","last_active":"2024-03-09T15:07:30.234223+0000","last_peered":"2024-03-09T15:07:30.234223+0000","last_clean":"2024-03-09T15:07:30.234223+0000","last_became_active":"2024-03-09T14:28:55.596219+0000","last_became_peered":"2024-03-09T14:28:55.596219+0000","last_unstale":"2024-03-09T15:07:30.234223+0000","last_undegraded":"2024-03-09T15:07:30.234223+0000","last_fullsized":"2024-03-09T15:07:30.234223+0000","mapping_epoch":25,"log_start":"264'1600","ondisk_log_start":"264'1600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1641","last_scrub_stamp":"2024-03-09T15:07:30.234005+0000","last_deep_scrub":"264'1641","last_deep_scrub_stamp":"2024-03-09T15:07:30.234005+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.234005+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":1600,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:38:17.905569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6749,"num_read_kb":5786,"num_write":2314,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":670,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:49.745880+0000","last_change":"2024-03-09T14:28:36.802806+0000","last_active":"2024-03-09T15:06:49.745880+0000","last_peered":"2024-03-09T15:06:49.745880+0000","last_clean":"2024-03-09T15:06:49.745880+0000","last_became_active":"2024-03-09T14:28:36.802270+0000","last_became_peered":"2024-03-09T14:28:36.802270+0000","last_unstale":"2024-03-09T15:06:49.745880+0000","last_undegraded":"2024-03-09T15:06:49.745880+0000","last_fullsized":"2024-03-09T15:06:49.745880+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:35.777784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:35.777784+0000","last_clean_scrub_stamp":"2024-03-09T14:28:35.777784+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.539631+0000","last_change":"2024-03-09T15:07:43.539692+0000","last_active":"2024-03-09T15:07:43.539631+0000","last_peered":"2024-03-09T15:07:43.539631+0000","last_clean":"2024-03-09T15:07:43.539631+0000","last_became_active":"2024-03-09T14:28:41.841153+0000","last_became_peered":"2024-03-09T14:28:41.841153+0000","last_unstale":"2024-03-09T15:07:43.539631+0000","last_undegraded":"2024-03-09T15:07:43.539631+0000","last_fullsized":"2024-03-09T15:07:43.539631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:43.539429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:43.539429+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.539429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:00:06.582546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'346","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.412982+0000","last_change":"2024-03-09T14:28:53.623164+0000","last_active":"2024-03-09T15:07:05.412982+0000","last_peered":"2024-03-09T15:07:05.412982+0000","last_clean":"2024-03-09T15:07:05.412982+0000","last_became_active":"2024-03-09T14:28:53.622700+0000","last_became_peered":"2024-03-09T14:28:53.622700+0000","last_unstale":"2024-03-09T15:07:05.412982+0000","last_undegraded":"2024-03-09T15:07:05.412982+0000","last_fullsized":"2024-03-09T15:07:05.412982+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":555,"num_read_kb":30203,"num_write":1261,"num_write_kb":35948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.914090+0000","last_change":"2024-03-09T15:07:38.914142+0000","last_active":"2024-03-09T15:07:38.914090+0000","last_peered":"2024-03-09T15:07:38.914090+0000","last_clean":"2024-03-09T15:07:38.914090+0000","last_became_active":"2024-03-09T14:28:57.606611+0000","last_became_peered":"2024-03-09T14:28:57.606611+0000","last_unstale":"2024-03-09T15:07:38.914090+0000","last_undegraded":"2024-03-09T15:07:38.914090+0000","last_fullsized":"2024-03-09T15:07:38.914090+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:38.913898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:38.913898+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.913898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:16:15.907103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'696","reported_seq":1401,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.524465+0000","last_change":"2024-03-09T15:07:26.524638+0000","last_active":"2024-03-09T15:07:26.524465+0000","last_peered":"2024-03-09T15:07:26.524465+0000","last_clean":"2024-03-09T15:07:26.524465+0000","last_became_active":"2024-03-09T14:28:59.603722+0000","last_became_peered":"2024-03-09T14:28:59.603722+0000","last_unstale":"2024-03-09T15:07:26.524465+0000","last_undegraded":"2024-03-09T15:07:26.524465+0000","last_fullsized":"2024-03-09T15:07:26.524465+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'696","last_scrub_stamp":"2024-03-09T15:07:26.524181+0000","last_deep_scrub":"264'696","last_deep_scrub_stamp":"2024-03-09T15:07:26.524181+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.524181+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:03.721380+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140709,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1362,"num_read_kb":3109,"num_write":1278,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99738,"num_omap_keys":240,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.762317+0000","last_change":"2024-03-09T15:07:33.762353+0000","last_active":"2024-03-09T15:07:33.762317+0000","last_peered":"2024-03-09T15:07:33.762317+0000","last_clean":"2024-03-09T15:07:33.762317+0000","last_became_active":"2024-03-09T14:29:01.647958+0000","last_became_peered":"2024-03-09T14:29:01.647958+0000","last_unstale":"2024-03-09T15:07:33.762317+0000","last_undegraded":"2024-03-09T15:07:33.762317+0000","last_fullsized":"2024-03-09T15:07:33.762317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:33.762182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:33.762182+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.762182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:08:56.374158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'228","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.186584+0000","last_change":"2024-03-09T15:07:43.186660+0000","last_active":"2024-03-09T15:07:43.186584+0000","last_peered":"2024-03-09T15:07:43.186584+0000","last_clean":"2024-03-09T15:07:43.186584+0000","last_became_active":"2024-03-09T14:29:03.680962+0000","last_became_peered":"2024-03-09T14:29:03.680962+0000","last_unstale":"2024-03-09T15:07:43.186584+0000","last_undegraded":"2024-03-09T15:07:43.186584+0000","last_fullsized":"2024-03-09T15:07:43.186584+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'228","last_scrub_stamp":"2024-03-09T15:07:43.186373+0000","last_deep_scrub":"264'228","last_deep_scrub_stamp":"2024-03-09T15:07:43.186373+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.186373+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:20:27.696864+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":425,"num_read_kb":422,"num_write":485,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'387","reported_seq":1945,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:42.458531+0000","last_change":"2024-03-09T14:28:55.575679+0000","last_active":"2024-03-09T15:06:42.458531+0000","last_peered":"2024-03-09T15:06:42.458531+0000","last_clean":"2024-03-09T15:06:42.458531+0000","last_became_active":"2024-03-09T14:28:55.575229+0000","last_became_peered":"2024-03-09T14:28:55.575229+0000","last_unstale":"2024-03-09T15:06:42.458531+0000","last_undegraded":"2024-03-09T15:06:42.458531+0000","last_fullsized":"2024-03-09T15:06:42.458531+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2264,"num_read_kb":2158,"num_write":447,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:54.747026+0000","last_change":"2024-03-09T14:28:41.839813+0000","last_active":"2024-03-09T15:06:54.747026+0000","last_peered":"2024-03-09T15:06:54.747026+0000","last_clean":"2024-03-09T15:06:54.747026+0000","last_became_active":"2024-03-09T14:28:41.838669+0000","last_became_peered":"2024-03-09T14:28:41.838669+0000","last_unstale":"2024-03-09T15:06:54.747026+0000","last_undegraded":"2024-03-09T15:06:54.747026+0000","last_fullsized":"2024-03-09T15:06:54.747026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'309","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.387394+0000","last_change":"2024-03-09T14:28:53.587759+0000","last_active":"2024-03-09T15:07:05.387394+0000","last_peered":"2024-03-09T15:07:05.387394+0000","last_clean":"2024-03-09T15:07:05.387394+0000","last_became_active":"2024-03-09T14:28:53.587201+0000","last_became_peered":"2024-03-09T14:28:53.587201+0000","last_unstale":"2024-03-09T15:07:05.387394+0000","last_undegraded":"2024-03-09T15:07:05.387394+0000","last_fullsized":"2024-03-09T15:07:05.387394+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245344,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":38281,"num_write":1125,"num_write_kb":47895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.507017+0000","last_change":"2024-03-09T15:07:39.507070+0000","last_active":"2024-03-09T15:07:39.507017+0000","last_peered":"2024-03-09T15:07:39.507017+0000","last_clean":"2024-03-09T15:07:39.507017+0000","last_became_active":"2024-03-09T14:28:57.612854+0000","last_became_peered":"2024-03-09T14:28:57.612854+0000","last_unstale":"2024-03-09T15:07:39.507017+0000","last_undegraded":"2024-03-09T15:07:39.507017+0000","last_fullsized":"2024-03-09T15:07:39.507017+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:39.506818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:39.506818+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.506818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:10:15.651737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1083","reported_seq":2405,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.896179+0000","last_change":"2024-03-09T15:07:29.896270+0000","last_active":"2024-03-09T15:07:29.896179+0000","last_peered":"2024-03-09T15:07:29.896179+0000","last_clean":"2024-03-09T15:07:29.896179+0000","last_became_active":"2024-03-09T14:28:59.599819+0000","last_became_peered":"2024-03-09T14:28:59.599819+0000","last_unstale":"2024-03-09T15:07:29.896179+0000","last_undegraded":"2024-03-09T15:07:29.896179+0000","last_fullsized":"2024-03-09T15:07:29.896179+0000","mapping_epoch":29,"log_start":"264'1000","ondisk_log_start":"264'1000","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1083","last_scrub_stamp":"2024-03-09T15:07:29.895998+0000","last_deep_scrub":"264'1083","last_deep_scrub_stamp":"2024-03-09T15:07:29.895998+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.895998+0000","objects_scrubbed":11,"log_size":83,"log_dups_size":1000,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:45:02.942611+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132519,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1702,"num_read_kb":3355,"num_write":1050,"num_write_kb":895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.009894+0000","last_change":"2024-03-09T15:07:34.009944+0000","last_active":"2024-03-09T15:07:34.009894+0000","last_peered":"2024-03-09T15:07:34.009894+0000","last_clean":"2024-03-09T15:07:34.009894+0000","last_became_active":"2024-03-09T14:29:01.626582+0000","last_became_peered":"2024-03-09T14:29:01.626582+0000","last_unstale":"2024-03-09T15:07:34.009894+0000","last_undegraded":"2024-03-09T15:07:34.009894+0000","last_fullsized":"2024-03-09T15:07:34.009894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:34.009700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:34.009700+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.009700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:18:35.601769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'110","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.925863+0000","last_change":"2024-03-09T15:07:18.925928+0000","last_active":"2024-03-09T15:07:18.925863+0000","last_peered":"2024-03-09T15:07:18.925863+0000","last_clean":"2024-03-09T15:07:18.925863+0000","last_became_active":"2024-03-09T14:29:03.659633+0000","last_became_peered":"2024-03-09T14:29:03.659633+0000","last_unstale":"2024-03-09T15:07:18.925863+0000","last_undegraded":"2024-03-09T15:07:18.925863+0000","last_fullsized":"2024-03-09T15:07:18.925863+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-03-09T15:07:18.925667+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-03-09T15:07:18.925667+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.925667+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:44:07.120542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":112,"num_read_kb":106,"num_write":262,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'373","reported_seq":1947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.864669+0000","last_change":"2024-03-09T15:07:26.864736+0000","last_active":"2024-03-09T15:07:26.864669+0000","last_peered":"2024-03-09T15:07:26.864669+0000","last_clean":"2024-03-09T15:07:26.864669+0000","last_became_active":"2024-03-09T14:28:55.584347+0000","last_became_peered":"2024-03-09T14:28:55.584347+0000","last_unstale":"2024-03-09T15:07:26.864669+0000","last_undegraded":"2024-03-09T15:07:26.864669+0000","last_fullsized":"2024-03-09T15:07:26.864669+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-03-09T15:07:26.864470+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-03-09T15:07:26.864470+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.864470+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:25:03.787698+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2124,"num_read_kb":2043,"num_write":421,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.462815+0000","last_change":"2024-03-09T15:07:27.462867+0000","last_active":"2024-03-09T15:07:27.462815+0000","last_peered":"2024-03-09T15:07:27.462815+0000","last_clean":"2024-03-09T15:07:27.462815+0000","last_became_active":"2024-03-09T14:28:41.836544+0000","last_became_peered":"2024-03-09T14:28:41.836544+0000","last_unstale":"2024-03-09T15:07:27.462815+0000","last_undegraded":"2024-03-09T15:07:27.462815+0000","last_fullsized":"2024-03-09T15:07:27.462815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:27.462629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:27.462629+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.462629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:59.961585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'334","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.600297+0000","last_change":"2024-03-09T15:07:43.600403+0000","last_active":"2024-03-09T15:07:43.600297+0000","last_peered":"2024-03-09T15:07:43.600297+0000","last_clean":"2024-03-09T15:07:43.600297+0000","last_became_active":"2024-03-09T14:28:53.626472+0000","last_became_peered":"2024-03-09T14:28:53.626472+0000","last_unstale":"2024-03-09T15:07:43.600297+0000","last_undegraded":"2024-03-09T15:07:43.600297+0000","last_fullsized":"2024-03-09T15:07:43.600297+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'334","last_scrub_stamp":"2024-03-09T15:07:43.600113+0000","last_deep_scrub":"264'334","last_deep_scrub_stamp":"2024-03-09T15:07:43.600113+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.600113+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:29:46.005440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":555,"num_read_kb":1460,"num_write":1312,"num_write_kb":27243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.547163+0000","last_change":"2024-03-09T15:07:22.547225+0000","last_active":"2024-03-09T15:07:22.547163+0000","last_peered":"2024-03-09T15:07:22.547163+0000","last_clean":"2024-03-09T15:07:22.547163+0000","last_became_active":"2024-03-09T14:28:57.609908+0000","last_became_peered":"2024-03-09T14:28:57.609908+0000","last_unstale":"2024-03-09T15:07:22.547163+0000","last_undegraded":"2024-03-09T15:07:22.547163+0000","last_fullsized":"2024-03-09T15:07:22.547163+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:22.546969+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:22.546969+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.546969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:51:05.917154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'225","reported_seq":1220,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:55.690515+0000","last_change":"2024-03-09T14:28:59.628581+0000","last_active":"2024-03-09T15:06:55.690515+0000","last_peered":"2024-03-09T15:06:55.690515+0000","last_clean":"2024-03-09T15:06:55.690515+0000","last_became_active":"2024-03-09T14:28:59.627810+0000","last_became_peered":"2024-03-09T14:28:59.627810+0000","last_unstale":"2024-03-09T15:06:55.690515+0000","last_undegraded":"2024-03-09T15:06:55.690515+0000","last_fullsized":"2024-03-09T15:06:55.690515+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":165,"num_read_kb":157,"num_write":151,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.745470+0000","last_change":"2024-03-09T15:07:36.745529+0000","last_active":"2024-03-09T15:07:36.745470+0000","last_peered":"2024-03-09T15:07:36.745470+0000","last_clean":"2024-03-09T15:07:36.745470+0000","last_became_active":"2024-03-09T14:29:01.647228+0000","last_became_peered":"2024-03-09T14:29:01.647228+0000","last_unstale":"2024-03-09T15:07:36.745470+0000","last_undegraded":"2024-03-09T15:07:36.745470+0000","last_fullsized":"2024-03-09T15:07:36.745470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:36.745263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:36.745263+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.745263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:58.138619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'252","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.987315+0000","last_change":"2024-03-09T15:07:28.987395+0000","last_active":"2024-03-09T15:07:28.987315+0000","last_peered":"2024-03-09T15:07:28.987315+0000","last_clean":"2024-03-09T15:07:28.987315+0000","last_became_active":"2024-03-09T14:29:03.654872+0000","last_became_peered":"2024-03-09T14:29:03.654872+0000","last_unstale":"2024-03-09T15:07:28.987315+0000","last_undegraded":"2024-03-09T15:07:28.987315+0000","last_fullsized":"2024-03-09T15:07:28.987315+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'252","last_scrub_stamp":"2024-03-09T15:07:28.987137+0000","last_deep_scrub":"264'252","last_deep_scrub_stamp":"2024-03-09T15:07:28.987137+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.987137+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:25:09.761733+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":497,"num_write":533,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'465","reported_seq":2025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.829931+0000","last_change":"2024-03-09T15:07:34.830096+0000","last_active":"2024-03-09T15:07:34.829931+0000","last_peered":"2024-03-09T15:07:34.829931+0000","last_clean":"2024-03-09T15:07:34.829931+0000","last_became_active":"2024-03-09T14:28:55.577946+0000","last_became_peered":"2024-03-09T14:28:55.577946+0000","last_unstale":"2024-03-09T15:07:34.829931+0000","last_undegraded":"2024-03-09T15:07:34.829931+0000","last_fullsized":"2024-03-09T15:07:34.829931+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'465","last_scrub_stamp":"2024-03-09T15:07:34.829644+0000","last_deep_scrub":"264'465","last_deep_scrub_stamp":"2024-03-09T15:07:34.829644+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.829644+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:22:52.836038+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2440,"num_read_kb":2271,"num_write":585,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.510608+0000","last_change":"2024-03-09T15:07:44.510661+0000","last_active":"2024-03-09T15:07:44.510608+0000","last_peered":"2024-03-09T15:07:44.510608+0000","last_clean":"2024-03-09T15:07:44.510608+0000","last_became_active":"2024-03-09T14:28:41.842251+0000","last_became_peered":"2024-03-09T14:28:41.842251+0000","last_unstale":"2024-03-09T15:07:44.510608+0000","last_undegraded":"2024-03-09T15:07:44.510608+0000","last_fullsized":"2024-03-09T15:07:44.510608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:44.510412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:44.510412+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.510412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:26:13.565490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'329","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.874878+0000","last_change":"2024-03-09T15:07:46.875059+0000","last_active":"2024-03-09T15:07:46.874878+0000","last_peered":"2024-03-09T15:07:46.874878+0000","last_clean":"2024-03-09T15:07:46.874878+0000","last_became_active":"2024-03-09T14:28:53.621914+0000","last_became_peered":"2024-03-09T14:28:53.621914+0000","last_unstale":"2024-03-09T15:07:46.874878+0000","last_undegraded":"2024-03-09T15:07:46.874878+0000","last_fullsized":"2024-03-09T15:07:46.874878+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-03-09T15:07:46.874650+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-03-09T15:07:46.874650+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.874650+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:45:33.688916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1292088,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":22951,"num_write":1137,"num_write_kb":34708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.767830+0000","last_change":"2024-03-09T15:07:43.767890+0000","last_active":"2024-03-09T15:07:43.767830+0000","last_peered":"2024-03-09T15:07:43.767830+0000","last_clean":"2024-03-09T15:07:43.767830+0000","last_became_active":"2024-03-09T14:28:57.613407+0000","last_became_peered":"2024-03-09T14:28:57.613407+0000","last_unstale":"2024-03-09T15:07:43.767830+0000","last_undegraded":"2024-03-09T15:07:43.767830+0000","last_fullsized":"2024-03-09T15:07:43.767830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:43.767632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:43.767632+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.767632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:41.541733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'117","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.986621+0000","last_change":"2024-03-09T15:07:39.986728+0000","last_active":"2024-03-09T15:07:39.986621+0000","last_peered":"2024-03-09T15:07:39.986621+0000","last_clean":"2024-03-09T15:07:39.986621+0000","last_became_active":"2024-03-09T14:28:59.619291+0000","last_became_peered":"2024-03-09T14:28:59.619291+0000","last_unstale":"2024-03-09T15:07:39.986621+0000","last_undegraded":"2024-03-09T15:07:39.986621+0000","last_fullsized":"2024-03-09T15:07:39.986621+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-03-09T15:07:39.986428+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-03-09T15:07:39.986428+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.986428+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:04:35.155185+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":110,"num_write":80,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1510,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.267499+0000","last_change":"2024-03-09T15:07:29.267550+0000","last_active":"2024-03-09T15:07:29.267499+0000","last_peered":"2024-03-09T15:07:29.267499+0000","last_clean":"2024-03-09T15:07:29.267499+0000","last_became_active":"2024-03-09T14:29:01.656672+0000","last_became_peered":"2024-03-09T14:29:01.656672+0000","last_unstale":"2024-03-09T15:07:29.267499+0000","last_undegraded":"2024-03-09T15:07:29.267499+0000","last_fullsized":"2024-03-09T15:07:29.267499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:29.267314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:29.267314+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.267314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:32:52.363075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'104","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.524886+0000","last_change":"2024-03-09T15:07:16.524946+0000","last_active":"2024-03-09T15:07:16.524886+0000","last_peered":"2024-03-09T15:07:16.524886+0000","last_clean":"2024-03-09T15:07:16.524886+0000","last_became_active":"2024-03-09T14:29:03.672534+0000","last_became_peered":"2024-03-09T14:29:03.672534+0000","last_unstale":"2024-03-09T15:07:16.524886+0000","last_undegraded":"2024-03-09T15:07:16.524886+0000","last_fullsized":"2024-03-09T15:07:16.524886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'104","last_scrub_stamp":"2024-03-09T15:07:16.524692+0000","last_deep_scrub":"264'104","last_deep_scrub_stamp":"2024-03-09T15:07:16.524692+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.524692+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:15:41.281947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":109,"num_write":236,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'464","reported_seq":2141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.862776+0000","last_change":"2024-03-09T15:07:28.862841+0000","last_active":"2024-03-09T15:07:28.862776+0000","last_peered":"2024-03-09T15:07:28.862776+0000","last_clean":"2024-03-09T15:07:28.862776+0000","last_became_active":"2024-03-09T14:28:55.583536+0000","last_became_peered":"2024-03-09T14:28:55.583536+0000","last_unstale":"2024-03-09T15:07:28.862776+0000","last_undegraded":"2024-03-09T15:07:28.862776+0000","last_fullsized":"2024-03-09T15:07:28.862776+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'464","last_scrub_stamp":"2024-03-09T15:07:28.862584+0000","last_deep_scrub":"264'464","last_deep_scrub_stamp":"2024-03-09T15:07:28.862584+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.862584+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:42:09.282270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2714,"num_read_kb":2554,"num_write":561,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'357","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.539456+0000","last_change":"2024-03-09T15:07:42.539682+0000","last_active":"2024-03-09T15:07:42.539456+0000","last_peered":"2024-03-09T15:07:42.539456+0000","last_clean":"2024-03-09T15:07:42.539456+0000","last_became_active":"2024-03-09T14:28:53.626879+0000","last_became_peered":"2024-03-09T14:28:53.626879+0000","last_unstale":"2024-03-09T15:07:42.539456+0000","last_undegraded":"2024-03-09T15:07:42.539456+0000","last_fullsized":"2024-03-09T15:07:42.539456+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-03-09T15:07:42.539208+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-03-09T15:07:42.539208+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.539208+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:40:01.889170+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8554715,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":520,"num_read_kb":4755,"num_write":1359,"num_write_kb":47511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.747925+0000","last_change":"2024-03-09T15:07:38.748027+0000","last_active":"2024-03-09T15:07:38.747925+0000","last_peered":"2024-03-09T15:07:38.747925+0000","last_clean":"2024-03-09T15:07:38.747925+0000","last_became_active":"2024-03-09T14:28:42.126799+0000","last_became_peered":"2024-03-09T14:28:42.126799+0000","last_unstale":"2024-03-09T15:07:38.747925+0000","last_undegraded":"2024-03-09T15:07:38.747925+0000","last_fullsized":"2024-03-09T15:07:38.747925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:38.747638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:38.747638+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.747638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:02:07.045997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.756044+0000","last_change":"2024-03-09T15:07:39.756100+0000","last_active":"2024-03-09T15:07:39.756044+0000","last_peered":"2024-03-09T15:07:39.756044+0000","last_clean":"2024-03-09T15:07:39.756044+0000","last_became_active":"2024-03-09T14:28:57.608723+0000","last_became_peered":"2024-03-09T14:28:57.608723+0000","last_unstale":"2024-03-09T15:07:39.756044+0000","last_undegraded":"2024-03-09T15:07:39.756044+0000","last_fullsized":"2024-03-09T15:07:39.756044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:39.755832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:39.755832+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.755832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:20:01.073720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'530","reported_seq":1180,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.889991+0000","last_change":"2024-03-09T14:28:59.625137+0000","last_active":"2024-03-09T15:07:04.889991+0000","last_peered":"2024-03-09T15:07:04.889991+0000","last_clean":"2024-03-09T15:07:04.889991+0000","last_became_active":"2024-03-09T14:28:59.624680+0000","last_became_peered":"2024-03-09T14:28:59.624680+0000","last_unstale":"2024-03-09T15:07:04.889991+0000","last_undegraded":"2024-03-09T15:07:04.889991+0000","last_fullsized":"2024-03-09T15:07:04.889991+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":500,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87910,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":952,"num_read_kb":2224,"num_write":784,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.713529+0000","last_change":"2024-03-09T15:07:21.713581+0000","last_active":"2024-03-09T15:07:21.713529+0000","last_peered":"2024-03-09T15:07:21.713529+0000","last_clean":"2024-03-09T15:07:21.713529+0000","last_became_active":"2024-03-09T14:29:01.640485+0000","last_became_peered":"2024-03-09T14:29:01.640485+0000","last_unstale":"2024-03-09T15:07:21.713529+0000","last_undegraded":"2024-03-09T15:07:21.713529+0000","last_fullsized":"2024-03-09T15:07:21.713529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:21.713332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:21.713332+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.713332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:28:08.038103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'144","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.644986+0000","last_change":"2024-03-09T15:07:25.645062+0000","last_active":"2024-03-09T15:07:25.644986+0000","last_peered":"2024-03-09T15:07:25.644986+0000","last_clean":"2024-03-09T15:07:25.644986+0000","last_became_active":"2024-03-09T14:29:03.676032+0000","last_became_peered":"2024-03-09T14:29:03.676032+0000","last_unstale":"2024-03-09T15:07:25.644986+0000","last_undegraded":"2024-03-09T15:07:25.644986+0000","last_fullsized":"2024-03-09T15:07:25.644986+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-03-09T15:07:25.644805+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-03-09T15:07:25.644805+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.644805+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:18.054345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":195,"num_read_kb":176,"num_write":349,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'353","reported_seq":1754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.636412+0000","last_change":"2024-03-09T15:07:48.636572+0000","last_active":"2024-03-09T15:07:48.636412+0000","last_peered":"2024-03-09T15:07:48.636412+0000","last_clean":"2024-03-09T15:07:48.636412+0000","last_became_active":"2024-03-09T14:28:55.582743+0000","last_became_peered":"2024-03-09T14:28:55.582743+0000","last_unstale":"2024-03-09T15:07:48.636412+0000","last_undegraded":"2024-03-09T15:07:48.636412+0000","last_fullsized":"2024-03-09T15:07:48.636412+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'353","last_scrub_stamp":"2024-03-09T15:07:48.636186+0000","last_deep_scrub":"264'353","last_deep_scrub_stamp":"2024-03-09T15:07:48.636186+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.636186+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:25:47.111839+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1869,"num_read_kb":1781,"num_write":409,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'326","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.709252+0000","last_change":"2024-03-09T15:07:40.709441+0000","last_active":"2024-03-09T15:07:40.709252+0000","last_peered":"2024-03-09T15:07:40.709252+0000","last_clean":"2024-03-09T15:07:40.709252+0000","last_became_active":"2024-03-09T14:28:53.589640+0000","last_became_peered":"2024-03-09T14:28:53.589640+0000","last_unstale":"2024-03-09T15:07:40.709252+0000","last_undegraded":"2024-03-09T15:07:40.709252+0000","last_fullsized":"2024-03-09T15:07:40.709252+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-03-09T15:07:40.708947+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-03-09T15:07:40.708947+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.708947+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:22.140344+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048928,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":38844,"num_write":1128,"num_write_kb":48736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":513,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:24.739348+0000","last_change":"2024-03-09T14:28:42.127115+0000","last_active":"2024-03-09T15:06:24.739348+0000","last_peered":"2024-03-09T15:06:24.739348+0000","last_clean":"2024-03-09T15:06:24.739348+0000","last_became_active":"2024-03-09T14:28:42.126201+0000","last_became_peered":"2024-03-09T14:28:42.126201+0000","last_unstale":"2024-03-09T15:06:24.739348+0000","last_undegraded":"2024-03-09T15:06:24.739348+0000","last_fullsized":"2024-03-09T15:06:24.739348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:40.805752+0000","last_clean_scrub_stamp":"2024-03-09T14:28:40.805752+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.254102+0000","last_change":"2024-03-09T15:07:24.254156+0000","last_active":"2024-03-09T15:07:24.254102+0000","last_peered":"2024-03-09T15:07:24.254102+0000","last_clean":"2024-03-09T15:07:24.254102+0000","last_became_active":"2024-03-09T14:28:57.606429+0000","last_became_peered":"2024-03-09T14:28:57.606429+0000","last_unstale":"2024-03-09T15:07:24.254102+0000","last_undegraded":"2024-03-09T15:07:24.254102+0000","last_fullsized":"2024-03-09T15:07:24.254102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:24.253912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:24.253912+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.253912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:22.015872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'182","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.874432+0000","last_change":"2024-03-09T15:07:33.874519+0000","last_active":"2024-03-09T15:07:33.874432+0000","last_peered":"2024-03-09T15:07:33.874432+0000","last_clean":"2024-03-09T15:07:33.874432+0000","last_became_active":"2024-03-09T14:28:59.626697+0000","last_became_peered":"2024-03-09T14:28:59.626697+0000","last_unstale":"2024-03-09T15:07:33.874432+0000","last_undegraded":"2024-03-09T15:07:33.874432+0000","last_fullsized":"2024-03-09T15:07:33.874432+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-03-09T15:07:33.874235+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-03-09T15:07:33.874235+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.874235+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:05:53.317316+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":207,"num_read_kb":198,"num_write":186,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5650,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'565","reported_seq":2150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.440280+0000","last_change":"2024-03-09T15:07:22.440344+0000","last_active":"2024-03-09T15:07:22.440280+0000","last_peered":"2024-03-09T15:07:22.440280+0000","last_clean":"2024-03-09T15:07:22.440280+0000","last_became_active":"2024-03-09T14:29:01.636912+0000","last_became_peered":"2024-03-09T14:29:01.636912+0000","last_unstale":"2024-03-09T15:07:22.440280+0000","last_undegraded":"2024-03-09T15:07:22.440280+0000","last_fullsized":"2024-03-09T15:07:22.440280+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'565","last_scrub_stamp":"2024-03-09T15:07:22.440085+0000","last_deep_scrub":"264'565","last_deep_scrub_stamp":"2024-03-09T15:07:22.440085+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.440085+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:53.676606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'97","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.003413+0000","last_change":"2024-03-09T15:07:25.003480+0000","last_active":"2024-03-09T15:07:25.003413+0000","last_peered":"2024-03-09T15:07:25.003413+0000","last_clean":"2024-03-09T15:07:25.003413+0000","last_became_active":"2024-03-09T14:29:03.664665+0000","last_became_peered":"2024-03-09T14:29:03.664665+0000","last_unstale":"2024-03-09T15:07:25.003413+0000","last_undegraded":"2024-03-09T15:07:25.003413+0000","last_fullsized":"2024-03-09T15:07:25.003413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-03-09T15:07:25.003215+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-03-09T15:07:25.003215+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.003215+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:36:56.787006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":223,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'343","reported_seq":1826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:59.981398+0000","last_change":"2024-03-09T14:28:55.603920+0000","last_active":"2024-03-09T15:06:59.981398+0000","last_peered":"2024-03-09T15:06:59.981398+0000","last_clean":"2024-03-09T15:06:59.981398+0000","last_became_active":"2024-03-09T14:28:55.601355+0000","last_became_peered":"2024-03-09T14:28:55.601355+0000","last_unstale":"2024-03-09T15:06:59.981398+0000","last_undegraded":"2024-03-09T15:06:59.981398+0000","last_fullsized":"2024-03-09T15:06:59.981398+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1977,"num_read_kb":1906,"num_write":384,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'330","reported_seq":985,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.371597+0000","last_change":"2024-03-09T14:28:53.585247+0000","last_active":"2024-03-09T15:07:05.371597+0000","last_peered":"2024-03-09T15:07:05.371597+0000","last_clean":"2024-03-09T15:07:05.371597+0000","last_became_active":"2024-03-09T14:28:53.584728+0000","last_became_peered":"2024-03-09T14:28:53.584728+0000","last_unstale":"2024-03-09T15:07:05.371597+0000","last_undegraded":"2024-03-09T15:07:05.371597+0000","last_fullsized":"2024-03-09T15:07:05.371597+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918035,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":514,"num_read_kb":33595,"num_write":1176,"num_write_kb":22083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.796384+0000","last_change":"2024-03-09T15:07:37.796384+0000","last_active":"2024-03-09T15:07:37.796384+0000","last_peered":"2024-03-09T15:07:37.796384+0000","last_clean":"2024-03-09T15:07:37.796384+0000","last_became_active":"2024-03-09T14:28:41.840168+0000","last_became_peered":"2024-03-09T14:28:41.840168+0000","last_unstale":"2024-03-09T15:07:37.796384+0000","last_undegraded":"2024-03-09T15:07:37.796384+0000","last_fullsized":"2024-03-09T15:07:37.796384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:37.796028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:37.796028+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.796028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:41:01.164969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"264'6","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.810535+0000","last_change":"2024-03-09T15:07:40.810597+0000","last_active":"2024-03-09T15:07:40.810535+0000","last_peered":"2024-03-09T15:07:40.810535+0000","last_clean":"2024-03-09T15:07:40.810535+0000","last_became_active":"2024-03-09T14:28:57.610373+0000","last_became_peered":"2024-03-09T14:28:57.610373+0000","last_unstale":"2024-03-09T15:07:40.810535+0000","last_undegraded":"2024-03-09T15:07:40.810535+0000","last_fullsized":"2024-03-09T15:07:40.810535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:40.810347+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:40.810347+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.810347+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:42:20.739928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":492,"num_read_kb":799,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'107","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.768275+0000","last_change":"2024-03-09T15:07:25.768414+0000","last_active":"2024-03-09T15:07:25.768275+0000","last_peered":"2024-03-09T15:07:25.768275+0000","last_clean":"2024-03-09T15:07:25.768275+0000","last_became_active":"2024-03-09T14:28:59.615084+0000","last_became_peered":"2024-03-09T14:28:59.615084+0000","last_unstale":"2024-03-09T15:07:25.768275+0000","last_undegraded":"2024-03-09T15:07:25.768275+0000","last_fullsized":"2024-03-09T15:07:25.768275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-03-09T15:07:25.767984+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-03-09T15:07:25.767984+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.767984+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:01:01.855185+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":100,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'584","reported_seq":2184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.955536+0000","last_change":"2024-03-09T15:07:31.955639+0000","last_active":"2024-03-09T15:07:31.955536+0000","last_peered":"2024-03-09T15:07:31.955536+0000","last_clean":"2024-03-09T15:07:31.955536+0000","last_became_active":"2024-03-09T14:29:01.630598+0000","last_became_peered":"2024-03-09T14:29:01.630598+0000","last_unstale":"2024-03-09T15:07:31.955536+0000","last_undegraded":"2024-03-09T15:07:31.955536+0000","last_fullsized":"2024-03-09T15:07:31.955536+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'584","last_scrub_stamp":"2024-03-09T15:07:31.955337+0000","last_deep_scrub":"264'584","last_deep_scrub_stamp":"2024-03-09T15:07:31.955337+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.955337+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:21.545376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'232","reported_seq":734,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.646284+0000","last_change":"2024-03-09T15:07:21.646416+0000","last_active":"2024-03-09T15:07:21.646284+0000","last_peered":"2024-03-09T15:07:21.646284+0000","last_clean":"2024-03-09T15:07:21.646284+0000","last_became_active":"2024-03-09T14:29:03.684294+0000","last_became_peered":"2024-03-09T14:29:03.684294+0000","last_unstale":"2024-03-09T15:07:21.646284+0000","last_undegraded":"2024-03-09T15:07:21.646284+0000","last_fullsized":"2024-03-09T15:07:21.646284+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'232","last_scrub_stamp":"2024-03-09T15:07:21.646037+0000","last_deep_scrub":"264'232","last_deep_scrub_stamp":"2024-03-09T15:07:21.646037+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.646037+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:01.441895+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":199,"num_write":480,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'364","reported_seq":2034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:39.935851+0000","last_change":"2024-03-09T14:28:55.569425+0000","last_active":"2024-03-09T15:06:39.935851+0000","last_peered":"2024-03-09T15:06:39.935851+0000","last_clean":"2024-03-09T15:06:39.935851+0000","last_became_active":"2024-03-09T14:28:55.568430+0000","last_became_peered":"2024-03-09T14:28:55.568430+0000","last_unstale":"2024-03-09T15:06:39.935851+0000","last_undegraded":"2024-03-09T15:06:39.935851+0000","last_fullsized":"2024-03-09T15:06:39.935851+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2357,"num_read_kb":2282,"num_write":412,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'367","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.344429+0000","last_change":"2024-03-09T14:28:53.589944+0000","last_active":"2024-03-09T15:07:05.344429+0000","last_peered":"2024-03-09T15:07:05.344429+0000","last_clean":"2024-03-09T15:07:05.344429+0000","last_became_active":"2024-03-09T14:28:53.589491+0000","last_became_peered":"2024-03-09T14:28:53.589491+0000","last_unstale":"2024-03-09T15:07:05.344429+0000","last_undegraded":"2024-03-09T15:07:05.344429+0000","last_fullsized":"2024-03-09T15:07:05.344429+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12403936,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":473,"num_read_kb":37359,"num_write":1237,"num_write_kb":47489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.219447+0000","last_change":"2024-03-09T15:07:35.219447+0000","last_active":"2024-03-09T15:07:35.219447+0000","last_peered":"2024-03-09T15:07:35.219447+0000","last_clean":"2024-03-09T15:07:35.219447+0000","last_became_active":"2024-03-09T14:28:41.840575+0000","last_became_peered":"2024-03-09T14:28:41.840575+0000","last_unstale":"2024-03-09T15:07:35.219447+0000","last_undegraded":"2024-03-09T15:07:35.219447+0000","last_fullsized":"2024-03-09T15:07:35.219447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.219124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.219124+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.219124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:52.826920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"35'3","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:04.982711+0000","last_change":"2024-03-09T14:28:57.605420+0000","last_active":"2024-03-09T15:07:04.982711+0000","last_peered":"2024-03-09T15:07:04.982711+0000","last_clean":"2024-03-09T15:07:04.982711+0000","last_became_active":"2024-03-09T14:28:57.604511+0000","last_became_peered":"2024-03-09T14:28:57.604511+0000","last_unstale":"2024-03-09T15:07:04.982711+0000","last_undegraded":"2024-03-09T15:07:04.982711+0000","last_fullsized":"2024-03-09T15:07:04.982711+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":488,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'690","reported_seq":1407,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.989885+0000","last_change":"2024-03-09T15:07:35.989973+0000","last_active":"2024-03-09T15:07:35.989885+0000","last_peered":"2024-03-09T15:07:35.989885+0000","last_clean":"2024-03-09T15:07:35.989885+0000","last_became_active":"2024-03-09T14:28:59.630044+0000","last_became_peered":"2024-03-09T14:28:59.630044+0000","last_unstale":"2024-03-09T15:07:35.989885+0000","last_undegraded":"2024-03-09T15:07:35.989885+0000","last_fullsized":"2024-03-09T15:07:35.989885+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'690","last_scrub_stamp":"2024-03-09T15:07:35.989694+0000","last_deep_scrub":"264'690","last_deep_scrub_stamp":"2024-03-09T15:07:35.989694+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.989694+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:09:36.304072+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140779,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1221,"num_read_kb":2881,"num_write":988,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.943368+0000","last_change":"2024-03-09T15:07:29.943408+0000","last_active":"2024-03-09T15:07:29.943368+0000","last_peered":"2024-03-09T15:07:29.943368+0000","last_clean":"2024-03-09T15:07:29.943368+0000","last_became_active":"2024-03-09T14:29:01.638590+0000","last_became_peered":"2024-03-09T14:29:01.638590+0000","last_unstale":"2024-03-09T15:07:29.943368+0000","last_undegraded":"2024-03-09T15:07:29.943368+0000","last_fullsized":"2024-03-09T15:07:29.943368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:29.943233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:29.943233+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.943233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:27.603634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'124","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.492955+0000","last_change":"2024-03-09T15:07:18.492955+0000","last_active":"2024-03-09T15:07:18.492955+0000","last_peered":"2024-03-09T15:07:18.492955+0000","last_clean":"2024-03-09T15:07:18.492955+0000","last_became_active":"2024-03-09T14:29:03.671138+0000","last_became_peered":"2024-03-09T14:29:03.671138+0000","last_unstale":"2024-03-09T15:07:18.492955+0000","last_undegraded":"2024-03-09T15:07:18.492955+0000","last_fullsized":"2024-03-09T15:07:18.492955+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:18.492696+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:18.492696+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.492696+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:49.039401+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":309,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'134","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.600532+0000","last_change":"2024-03-09T15:07:22.600598+0000","last_active":"2024-03-09T15:07:22.600532+0000","last_peered":"2024-03-09T15:07:22.600532+0000","last_clean":"2024-03-09T15:07:22.600532+0000","last_became_active":"2024-03-09T14:29:03.681920+0000","last_became_peered":"2024-03-09T14:29:03.681920+0000","last_unstale":"2024-03-09T15:07:22.600532+0000","last_undegraded":"2024-03-09T15:07:22.600532+0000","last_fullsized":"2024-03-09T15:07:22.600532+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-03-09T15:07:22.600362+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-03-09T15:07:22.600362+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.600362+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:36:58.000733+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":222,"num_write":331,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'715","reported_seq":2221,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.739180+0000","last_change":"2024-03-09T15:07:31.739283+0000","last_active":"2024-03-09T15:07:31.739180+0000","last_peered":"2024-03-09T15:07:31.739180+0000","last_clean":"2024-03-09T15:07:31.739180+0000","last_became_active":"2024-03-09T14:28:55.589278+0000","last_became_peered":"2024-03-09T14:28:55.589278+0000","last_unstale":"2024-03-09T15:07:31.739180+0000","last_undegraded":"2024-03-09T15:07:31.739180+0000","last_fullsized":"2024-03-09T15:07:31.739180+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'715","last_scrub_stamp":"2024-03-09T15:07:31.738969+0000","last_deep_scrub":"264'715","last_deep_scrub_stamp":"2024-03-09T15:07:31.738969+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.738969+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":700,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:13.359109+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3302,"num_read_kb":2973,"num_write":944,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'315","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.895274+0000","last_change":"2024-03-09T15:07:47.895374+0000","last_active":"2024-03-09T15:07:47.895274+0000","last_peered":"2024-03-09T15:07:47.895274+0000","last_clean":"2024-03-09T15:07:47.895274+0000","last_became_active":"2024-03-09T14:28:53.624231+0000","last_became_peered":"2024-03-09T14:28:53.624231+0000","last_unstale":"2024-03-09T15:07:47.895274+0000","last_undegraded":"2024-03-09T15:07:47.895274+0000","last_fullsized":"2024-03-09T15:07:47.895274+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'315","last_scrub_stamp":"2024-03-09T15:07:47.895072+0000","last_deep_scrub":"264'315","last_deep_scrub_stamp":"2024-03-09T15:07:47.895072+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.895072+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:09:38.205079+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":535,"num_read_kb":58598,"num_write":1161,"num_write_kb":63743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.820780+0000","last_change":"2024-03-09T15:07:25.820832+0000","last_active":"2024-03-09T15:07:25.820780+0000","last_peered":"2024-03-09T15:07:25.820780+0000","last_clean":"2024-03-09T15:07:25.820780+0000","last_became_active":"2024-03-09T14:28:57.616045+0000","last_became_peered":"2024-03-09T14:28:57.616045+0000","last_unstale":"2024-03-09T15:07:25.820780+0000","last_undegraded":"2024-03-09T15:07:25.820780+0000","last_fullsized":"2024-03-09T15:07:25.820780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:25.820588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:25.820588+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.820588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:45:34.309358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'257","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.979858+0000","last_change":"2024-03-09T15:07:43.979942+0000","last_active":"2024-03-09T15:07:43.979858+0000","last_peered":"2024-03-09T15:07:43.979858+0000","last_clean":"2024-03-09T15:07:43.979858+0000","last_became_active":"2024-03-09T14:28:59.615265+0000","last_became_peered":"2024-03-09T14:28:59.615265+0000","last_unstale":"2024-03-09T15:07:43.979858+0000","last_undegraded":"2024-03-09T15:07:43.979858+0000","last_fullsized":"2024-03-09T15:07:43.979858+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-03-09T15:07:43.979641+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-03-09T15:07:43.979641+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.979641+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:01:35.067889+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41654,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":398,"num_read_kb":895,"num_write":318,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.921590+0000","last_change":"2024-03-09T15:07:32.921646+0000","last_active":"2024-03-09T15:07:32.921590+0000","last_peered":"2024-03-09T15:07:32.921590+0000","last_clean":"2024-03-09T15:07:32.921590+0000","last_became_active":"2024-03-09T14:29:01.630021+0000","last_became_peered":"2024-03-09T14:29:01.630021+0000","last_unstale":"2024-03-09T15:07:32.921590+0000","last_undegraded":"2024-03-09T15:07:32.921590+0000","last_fullsized":"2024-03-09T15:07:32.921590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:32.921402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:32.921402+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.921402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:33.388771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'124","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.936675+0000","last_change":"2024-03-09T15:07:27.936739+0000","last_active":"2024-03-09T15:07:27.936675+0000","last_peered":"2024-03-09T15:07:27.936675+0000","last_clean":"2024-03-09T15:07:27.936675+0000","last_became_active":"2024-03-09T14:29:03.660356+0000","last_became_peered":"2024-03-09T14:29:03.660356+0000","last_unstale":"2024-03-09T15:07:27.936675+0000","last_undegraded":"2024-03-09T15:07:27.936675+0000","last_fullsized":"2024-03-09T15:07:27.936675+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:27.936481+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:27.936481+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.936481+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:22:37.729626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'836","reported_seq":2453,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.874067+0000","last_change":"2024-03-09T15:07:22.874136+0000","last_active":"2024-03-09T15:07:22.874067+0000","last_peered":"2024-03-09T15:07:22.874067+0000","last_clean":"2024-03-09T15:07:22.874067+0000","last_became_active":"2024-03-09T14:28:55.591498+0000","last_became_peered":"2024-03-09T14:28:55.591498+0000","last_unstale":"2024-03-09T15:07:22.874067+0000","last_undegraded":"2024-03-09T15:07:22.874067+0000","last_fullsized":"2024-03-09T15:07:22.874067+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'836","last_scrub_stamp":"2024-03-09T15:07:22.873855+0000","last_deep_scrub":"264'836","last_deep_scrub_stamp":"2024-03-09T15:07:22.873855+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.873855+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:25:50.937533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3847,"num_read_kb":3445,"num_write":1140,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'322","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.766227+0000","last_change":"2024-03-09T15:07:13.766359+0000","last_active":"2024-03-09T15:07:13.766227+0000","last_peered":"2024-03-09T15:07:13.766227+0000","last_clean":"2024-03-09T15:07:13.766227+0000","last_became_active":"2024-03-09T14:29:28.729906+0000","last_became_peered":"2024-03-09T14:29:28.729906+0000","last_unstale":"2024-03-09T15:07:13.766227+0000","last_undegraded":"2024-03-09T15:07:13.766227+0000","last_fullsized":"2024-03-09T15:07:13.766227+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'322","last_scrub_stamp":"2024-03-09T15:07:13.766011+0000","last_deep_scrub":"264'322","last_deep_scrub_stamp":"2024-03-09T15:07:13.766011+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.766011+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:54.155006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":3449,"num_write":1268,"num_write_kb":20441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,4],"acting":[2,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:19.972825+0000","last_change":"2024-03-09T14:28:57.609587+0000","last_active":"2024-03-09T15:06:19.972825+0000","last_peered":"2024-03-09T15:06:19.972825+0000","last_clean":"2024-03-09T15:06:19.972825+0000","last_became_active":"2024-03-09T14:28:57.608697+0000","last_became_peered":"2024-03-09T14:28:57.608697+0000","last_unstale":"2024-03-09T15:06:19.972825+0000","last_undegraded":"2024-03-09T15:06:19.972825+0000","last_fullsized":"2024-03-09T15:06:19.972825+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:56.570767+0000","last_clean_scrub_stamp":"2024-03-09T14:28:56.570767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'51","reported_seq":553,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.701194+0000","last_change":"2024-03-09T15:07:45.701288+0000","last_active":"2024-03-09T15:07:45.701194+0000","last_peered":"2024-03-09T15:07:45.701194+0000","last_clean":"2024-03-09T15:07:45.701194+0000","last_became_active":"2024-03-09T14:28:59.620907+0000","last_became_peered":"2024-03-09T14:28:59.620907+0000","last_unstale":"2024-03-09T15:07:45.701194+0000","last_undegraded":"2024-03-09T15:07:45.701194+0000","last_fullsized":"2024-03-09T15:07:45.701194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'51","last_scrub_stamp":"2024-03-09T15:07:45.700978+0000","last_deep_scrub":"264'51","last_deep_scrub_stamp":"2024-03-09T15:07:45.700978+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.700978+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:34:33.303483+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.979609+0000","last_change":"2024-03-09T15:07:29.979666+0000","last_active":"2024-03-09T15:07:29.979609+0000","last_peered":"2024-03-09T15:07:29.979609+0000","last_clean":"2024-03-09T15:07:29.979609+0000","last_became_active":"2024-03-09T14:29:01.650734+0000","last_became_peered":"2024-03-09T14:29:01.650734+0000","last_unstale":"2024-03-09T15:07:29.979609+0000","last_undegraded":"2024-03-09T15:07:29.979609+0000","last_fullsized":"2024-03-09T15:07:29.979609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:29.979414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:29.979414+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.979414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:52.407738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'223","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.630726+0000","last_change":"2024-03-09T15:07:20.630792+0000","last_active":"2024-03-09T15:07:20.630726+0000","last_peered":"2024-03-09T15:07:20.630726+0000","last_clean":"2024-03-09T15:07:20.630726+0000","last_became_active":"2024-03-09T14:29:03.686455+0000","last_became_peered":"2024-03-09T14:29:03.686455+0000","last_unstale":"2024-03-09T15:07:20.630726+0000","last_undegraded":"2024-03-09T15:07:20.630726+0000","last_fullsized":"2024-03-09T15:07:20.630726+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-03-09T15:07:20.630528+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-03-09T15:07:20.630528+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.630528+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:48.600710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":435,"num_write":508,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'405","reported_seq":1935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:21.878355+0000","last_change":"2024-03-09T14:28:55.591974+0000","last_active":"2024-03-09T15:06:21.878355+0000","last_peered":"2024-03-09T15:06:21.878355+0000","last_clean":"2024-03-09T15:06:21.878355+0000","last_became_active":"2024-03-09T14:28:55.591649+0000","last_became_peered":"2024-03-09T14:28:55.591649+0000","last_unstale":"2024-03-09T15:06:21.878355+0000","last_undegraded":"2024-03-09T15:06:21.878355+0000","last_fullsized":"2024-03-09T15:06:21.878355+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2197,"num_read_kb":2083,"num_write":469,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'286","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.511247+0000","last_change":"2024-03-09T15:07:45.511618+0000","last_active":"2024-03-09T15:07:45.511247+0000","last_peered":"2024-03-09T15:07:45.511247+0000","last_clean":"2024-03-09T15:07:45.511247+0000","last_became_active":"2024-03-09T14:28:53.598990+0000","last_became_peered":"2024-03-09T14:28:53.598990+0000","last_unstale":"2024-03-09T15:07:45.511247+0000","last_undegraded":"2024-03-09T15:07:45.511247+0000","last_fullsized":"2024-03-09T15:07:45.511247+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'286","last_scrub_stamp":"2024-03-09T15:07:45.510984+0000","last_deep_scrub":"264'286","last_deep_scrub_stamp":"2024-03-09T15:07:45.510984+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.510984+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:35:31.097171+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245594,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":365,"num_read_kb":35562,"num_write":1017,"num_write_kb":44906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.858098+0000","last_change":"2024-03-09T15:07:42.858153+0000","last_active":"2024-03-09T15:07:42.858098+0000","last_peered":"2024-03-09T15:07:42.858098+0000","last_clean":"2024-03-09T15:07:42.858098+0000","last_became_active":"2024-03-09T14:28:57.615229+0000","last_became_peered":"2024-03-09T14:28:57.615229+0000","last_unstale":"2024-03-09T15:07:42.858098+0000","last_undegraded":"2024-03-09T15:07:42.858098+0000","last_fullsized":"2024-03-09T15:07:42.858098+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:42.857894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:42.857894+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.857894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:18.550366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'275","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.021627+0000","last_change":"2024-03-09T15:07:41.021709+0000","last_active":"2024-03-09T15:07:41.021627+0000","last_peered":"2024-03-09T15:07:41.021627+0000","last_clean":"2024-03-09T15:07:41.021627+0000","last_became_active":"2024-03-09T14:28:59.615881+0000","last_became_peered":"2024-03-09T14:28:59.615881+0000","last_unstale":"2024-03-09T15:07:41.021627+0000","last_undegraded":"2024-03-09T15:07:41.021627+0000","last_fullsized":"2024-03-09T15:07:41.021627+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'275","last_scrub_stamp":"2024-03-09T15:07:41.021439+0000","last_deep_scrub":"264'275","last_deep_scrub_stamp":"2024-03-09T15:07:41.021439+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.021439+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:37:08.339561+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48426,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":988,"num_write":356,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.254320+0000","last_change":"2024-03-09T15:07:27.254373+0000","last_active":"2024-03-09T15:07:27.254320+0000","last_peered":"2024-03-09T15:07:27.254320+0000","last_clean":"2024-03-09T15:07:27.254320+0000","last_became_active":"2024-03-09T14:29:01.656740+0000","last_became_peered":"2024-03-09T14:29:01.656740+0000","last_unstale":"2024-03-09T15:07:27.254320+0000","last_undegraded":"2024-03-09T15:07:27.254320+0000","last_fullsized":"2024-03-09T15:07:27.254320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:27.254123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:27.254123+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.254123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:56:48.423472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'192","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.487174+0000","last_change":"2024-03-09T15:07:15.487243+0000","last_active":"2024-03-09T15:07:15.487174+0000","last_peered":"2024-03-09T15:07:15.487174+0000","last_clean":"2024-03-09T15:07:15.487174+0000","last_became_active":"2024-03-09T14:29:03.671571+0000","last_became_peered":"2024-03-09T14:29:03.671571+0000","last_unstale":"2024-03-09T15:07:15.487174+0000","last_undegraded":"2024-03-09T15:07:15.487174+0000","last_fullsized":"2024-03-09T15:07:15.487174+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-03-09T15:07:15.486986+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-03-09T15:07:15.486986+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.486986+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:03.941307+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":257,"num_read_kb":221,"num_write":372,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'1161","reported_seq":2786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.950589+0000","last_change":"2024-03-09T15:07:47.950665+0000","last_active":"2024-03-09T15:07:47.950589+0000","last_peered":"2024-03-09T15:07:47.950589+0000","last_clean":"2024-03-09T15:07:47.950589+0000","last_became_active":"2024-03-09T14:28:55.592387+0000","last_became_peered":"2024-03-09T14:28:55.592387+0000","last_unstale":"2024-03-09T15:07:47.950589+0000","last_undegraded":"2024-03-09T15:07:47.950589+0000","last_fullsized":"2024-03-09T15:07:47.950589+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1161","last_scrub_stamp":"2024-03-09T15:07:47.950405+0000","last_deep_scrub":"264'1161","last_deep_scrub_stamp":"2024-03-09T15:07:47.950405+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.950405+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":1100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:16:34.259847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4979,"num_read_kb":4357,"num_write":1600,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'325","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.437477+0000","last_change":"2024-03-09T14:28:53.627197+0000","last_active":"2024-03-09T15:07:09.437477+0000","last_peered":"2024-03-09T15:07:09.437477+0000","last_clean":"2024-03-09T15:07:09.437477+0000","last_became_active":"2024-03-09T14:28:53.626736+0000","last_became_peered":"2024-03-09T14:28:53.626736+0000","last_unstale":"2024-03-09T15:07:09.437477+0000","last_undegraded":"2024-03-09T15:07:09.437477+0000","last_fullsized":"2024-03-09T15:07:09.437477+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655827,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":493,"num_read_kb":7830,"num_write":1223,"num_write_kb":47405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.172754+0000","last_change":"2024-03-09T15:07:22.172813+0000","last_active":"2024-03-09T15:07:22.172754+0000","last_peered":"2024-03-09T15:07:22.172754+0000","last_clean":"2024-03-09T15:07:22.172754+0000","last_became_active":"2024-03-09T14:28:57.613999+0000","last_became_peered":"2024-03-09T14:28:57.613999+0000","last_unstale":"2024-03-09T15:07:22.172754+0000","last_undegraded":"2024-03-09T15:07:22.172754+0000","last_fullsized":"2024-03-09T15:07:22.172754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:22.172539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:22.172539+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.172539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:10:05.619875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'259","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.892202+0000","last_change":"2024-03-09T15:07:46.892278+0000","last_active":"2024-03-09T15:07:46.892202+0000","last_peered":"2024-03-09T15:07:46.892202+0000","last_clean":"2024-03-09T15:07:46.892202+0000","last_became_active":"2024-03-09T14:28:59.614754+0000","last_became_peered":"2024-03-09T14:28:59.614754+0000","last_unstale":"2024-03-09T15:07:46.892202+0000","last_undegraded":"2024-03-09T15:07:46.892202+0000","last_fullsized":"2024-03-09T15:07:46.892202+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'259","last_scrub_stamp":"2024-03-09T15:07:46.891972+0000","last_deep_scrub":"264'259","last_deep_scrub_stamp":"2024-03-09T15:07:46.891972+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.891972+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:00:32.451554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43227,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":1017,"num_write":350,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.747798+0000","last_change":"2024-03-09T15:07:32.747857+0000","last_active":"2024-03-09T15:07:32.747798+0000","last_peered":"2024-03-09T15:07:32.747798+0000","last_clean":"2024-03-09T15:07:32.747798+0000","last_became_active":"2024-03-09T14:29:01.647570+0000","last_became_peered":"2024-03-09T14:29:01.647570+0000","last_unstale":"2024-03-09T15:07:32.747798+0000","last_undegraded":"2024-03-09T15:07:32.747798+0000","last_fullsized":"2024-03-09T15:07:32.747798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:32.747585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:32.747585+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.747585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:15:24.826316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'815","reported_seq":2359,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.286495+0000","last_change":"2024-03-09T15:07:26.286639+0000","last_active":"2024-03-09T15:07:26.286495+0000","last_peered":"2024-03-09T15:07:26.286495+0000","last_clean":"2024-03-09T15:07:26.286495+0000","last_became_active":"2024-03-09T14:28:55.599825+0000","last_became_peered":"2024-03-09T14:28:55.599825+0000","last_unstale":"2024-03-09T15:07:26.286495+0000","last_undegraded":"2024-03-09T15:07:26.286495+0000","last_fullsized":"2024-03-09T15:07:26.286495+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'815","last_scrub_stamp":"2024-03-09T15:07:26.286264+0000","last_deep_scrub":"264'815","last_deep_scrub_stamp":"2024-03-09T15:07:26.286264+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.286264+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:29:09.000713+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3687,"num_read_kb":3276,"num_write":1113,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'290","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.809073+0000","last_change":"2024-03-09T14:28:53.565880+0000","last_active":"2024-03-09T15:07:10.809073+0000","last_peered":"2024-03-09T15:07:10.809073+0000","last_clean":"2024-03-09T15:07:10.809073+0000","last_became_active":"2024-03-09T14:28:53.565431+0000","last_became_peered":"2024-03-09T14:28:53.565431+0000","last_unstale":"2024-03-09T15:07:10.809073+0000","last_undegraded":"2024-03-09T15:07:10.809073+0000","last_fullsized":"2024-03-09T15:07:10.809073+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655871,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":381,"num_read_kb":7268,"num_write":971,"num_write_kb":31379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.697187+0000","last_change":"2024-03-09T15:07:41.697282+0000","last_active":"2024-03-09T15:07:41.697187+0000","last_peered":"2024-03-09T15:07:41.697187+0000","last_clean":"2024-03-09T15:07:41.697187+0000","last_became_active":"2024-03-09T14:28:57.610126+0000","last_became_peered":"2024-03-09T14:28:57.610126+0000","last_unstale":"2024-03-09T15:07:41.697187+0000","last_undegraded":"2024-03-09T15:07:41.697187+0000","last_fullsized":"2024-03-09T15:07:41.697187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:41.696945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:41.696945+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.696945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:48:55.597106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'478","reported_seq":1113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.906803+0000","last_change":"2024-03-09T15:07:31.906875+0000","last_active":"2024-03-09T15:07:31.906803+0000","last_peered":"2024-03-09T15:07:31.906803+0000","last_clean":"2024-03-09T15:07:31.906803+0000","last_became_active":"2024-03-09T14:28:59.614069+0000","last_became_peered":"2024-03-09T14:28:59.614069+0000","last_unstale":"2024-03-09T15:07:31.906803+0000","last_undegraded":"2024-03-09T15:07:31.906803+0000","last_fullsized":"2024-03-09T15:07:31.906803+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'478","last_scrub_stamp":"2024-03-09T15:07:31.906625+0000","last_deep_scrub":"264'478","last_deep_scrub_stamp":"2024-03-09T15:07:31.906625+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.906625+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:20:10.104166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88057,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":2100,"num_write":750,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22450,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.444264+0000","last_change":"2024-03-09T15:07:20.444317+0000","last_active":"2024-03-09T15:07:20.444264+0000","last_peered":"2024-03-09T15:07:20.444264+0000","last_clean":"2024-03-09T15:07:20.444264+0000","last_became_active":"2024-03-09T14:29:01.639825+0000","last_became_peered":"2024-03-09T14:29:01.639825+0000","last_unstale":"2024-03-09T15:07:20.444264+0000","last_undegraded":"2024-03-09T15:07:20.444264+0000","last_fullsized":"2024-03-09T15:07:20.444264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.444069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.444069+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.444069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:07:45.858578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'151","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.014709+0000","last_change":"2024-03-09T15:07:12.014741+0000","last_active":"2024-03-09T15:07:12.014709+0000","last_peered":"2024-03-09T15:07:12.014709+0000","last_clean":"2024-03-09T15:07:12.014709+0000","last_became_active":"2024-03-09T14:29:03.666515+0000","last_became_peered":"2024-03-09T14:29:03.666515+0000","last_unstale":"2024-03-09T15:07:12.014709+0000","last_undegraded":"2024-03-09T15:07:12.014709+0000","last_fullsized":"2024-03-09T15:07:12.014709+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-03-09T15:07:12.014625+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-03-09T15:07:12.014625+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.014625+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:12:44.954675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":181,"num_write":332,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'875","reported_seq":2630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.730570+0000","last_change":"2024-03-09T15:07:44.730707+0000","last_active":"2024-03-09T15:07:44.730570+0000","last_peered":"2024-03-09T15:07:44.730570+0000","last_clean":"2024-03-09T15:07:44.730570+0000","last_became_active":"2024-03-09T14:28:55.586247+0000","last_became_peered":"2024-03-09T14:28:55.586247+0000","last_unstale":"2024-03-09T15:07:44.730570+0000","last_undegraded":"2024-03-09T15:07:44.730570+0000","last_fullsized":"2024-03-09T15:07:44.730570+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'875","last_scrub_stamp":"2024-03-09T15:07:44.730351+0000","last_deep_scrub":"264'875","last_deep_scrub_stamp":"2024-03-09T15:07:44.730351+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.730351+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:19.053933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4288,"num_read_kb":3851,"num_write":1208,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'317","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.645786+0000","last_change":"2024-03-09T15:07:42.645879+0000","last_active":"2024-03-09T15:07:42.645786+0000","last_peered":"2024-03-09T15:07:42.645786+0000","last_clean":"2024-03-09T15:07:42.645786+0000","last_became_active":"2024-03-09T14:28:53.617832+0000","last_became_peered":"2024-03-09T14:28:53.617832+0000","last_unstale":"2024-03-09T15:07:42.645786+0000","last_undegraded":"2024-03-09T15:07:42.645786+0000","last_fullsized":"2024-03-09T15:07:42.645786+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-03-09T15:07:42.645586+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-03-09T15:07:42.645586+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.645586+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:14:32.395572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22651,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":36525,"num_write":1106,"num_write_kb":22031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.221144+0000","last_change":"2024-03-09T15:07:20.221198+0000","last_active":"2024-03-09T15:07:20.221144+0000","last_peered":"2024-03-09T15:07:20.221144+0000","last_clean":"2024-03-09T15:07:20.221144+0000","last_became_active":"2024-03-09T14:28:57.616057+0000","last_became_peered":"2024-03-09T14:28:57.616057+0000","last_unstale":"2024-03-09T15:07:20.221144+0000","last_undegraded":"2024-03-09T15:07:20.221144+0000","last_fullsized":"2024-03-09T15:07:20.221144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.220901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.220901+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.220901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:26:17.180137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'275","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.848902+0000","last_change":"2024-03-09T15:07:48.849006+0000","last_active":"2024-03-09T15:07:48.848902+0000","last_peered":"2024-03-09T15:07:48.848902+0000","last_clean":"2024-03-09T15:07:48.848902+0000","last_became_active":"2024-03-09T14:28:59.615193+0000","last_became_peered":"2024-03-09T14:28:59.615193+0000","last_unstale":"2024-03-09T15:07:48.848902+0000","last_undegraded":"2024-03-09T15:07:48.848902+0000","last_fullsized":"2024-03-09T15:07:48.848902+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'275","last_scrub_stamp":"2024-03-09T15:07:48.848686+0000","last_deep_scrub":"264'275","last_deep_scrub_stamp":"2024-03-09T15:07:48.848686+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.848686+0000","objects_scrubbed":8,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:47:07.814657+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43919,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":455,"num_read_kb":986,"num_write":382,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.859441+0000","last_change":"2024-03-09T15:07:20.859552+0000","last_active":"2024-03-09T15:07:20.859441+0000","last_peered":"2024-03-09T15:07:20.859441+0000","last_clean":"2024-03-09T15:07:20.859441+0000","last_became_active":"2024-03-09T14:29:01.660997+0000","last_became_peered":"2024-03-09T14:29:01.660997+0000","last_unstale":"2024-03-09T15:07:20.859441+0000","last_undegraded":"2024-03-09T15:07:20.859441+0000","last_fullsized":"2024-03-09T15:07:20.859441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.859205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.859205+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.859205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:57:46.682370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'190","reported_seq":1394,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.219927+0000","last_change":"2024-03-09T15:07:31.220024+0000","last_active":"2024-03-09T15:07:31.219927+0000","last_peered":"2024-03-09T15:07:31.219927+0000","last_clean":"2024-03-09T15:07:31.219927+0000","last_became_active":"2024-03-09T14:29:03.668833+0000","last_became_peered":"2024-03-09T14:29:03.668833+0000","last_unstale":"2024-03-09T15:07:31.219927+0000","last_undegraded":"2024-03-09T15:07:31.219927+0000","last_fullsized":"2024-03-09T15:07:31.219927+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-03-09T15:07:31.219733+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-03-09T15:07:31.219733+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.219733+0000","objects_scrubbed":9,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:12:05.817079+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2487,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":947,"num_read_kb":932,"num_write":509,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'489","reported_seq":2240,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.976906+0000","last_change":"2024-03-09T15:07:44.976984+0000","last_active":"2024-03-09T15:07:44.976906+0000","last_peered":"2024-03-09T15:07:44.976906+0000","last_clean":"2024-03-09T15:07:44.976906+0000","last_became_active":"2024-03-09T14:28:55.596538+0000","last_became_peered":"2024-03-09T14:28:55.596538+0000","last_unstale":"2024-03-09T15:07:44.976906+0000","last_undegraded":"2024-03-09T15:07:44.976906+0000","last_fullsized":"2024-03-09T15:07:44.976906+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'489","last_scrub_stamp":"2024-03-09T15:07:44.976709+0000","last_deep_scrub":"264'489","last_deep_scrub_stamp":"2024-03-09T15:07:44.976709+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.976709+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:27:06.380305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2772,"num_read_kb":2616,"num_write":579,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2039,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'289","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.857265+0000","last_change":"2024-03-09T15:07:44.857389+0000","last_active":"2024-03-09T15:07:44.857265+0000","last_peered":"2024-03-09T15:07:44.857265+0000","last_clean":"2024-03-09T15:07:44.857265+0000","last_became_active":"2024-03-09T14:28:53.589932+0000","last_became_peered":"2024-03-09T14:28:53.589932+0000","last_unstale":"2024-03-09T15:07:44.857265+0000","last_undegraded":"2024-03-09T15:07:44.857265+0000","last_fullsized":"2024-03-09T15:07:44.857265+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-03-09T15:07:44.857059+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-03-09T15:07:44.857059+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.857059+0000","objects_scrubbed":8,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:57:25.367913+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10486772,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":425,"num_read_kb":14456,"num_write":988,"num_write_kb":42013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.779509+0000","last_change":"2024-03-09T15:07:36.779562+0000","last_active":"2024-03-09T15:07:36.779509+0000","last_peered":"2024-03-09T15:07:36.779509+0000","last_clean":"2024-03-09T15:07:36.779509+0000","last_became_active":"2024-03-09T14:28:57.609903+0000","last_became_peered":"2024-03-09T14:28:57.609903+0000","last_unstale":"2024-03-09T15:07:36.779509+0000","last_undegraded":"2024-03-09T15:07:36.779509+0000","last_fullsized":"2024-03-09T15:07:36.779509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:36.779312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:36.779312+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.779312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:06:51.314999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'264","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.988771+0000","last_change":"2024-03-09T15:07:37.988841+0000","last_active":"2024-03-09T15:07:37.988771+0000","last_peered":"2024-03-09T15:07:37.988771+0000","last_clean":"2024-03-09T15:07:37.988771+0000","last_became_active":"2024-03-09T14:28:59.630460+0000","last_became_peered":"2024-03-09T14:28:59.630460+0000","last_unstale":"2024-03-09T15:07:37.988771+0000","last_undegraded":"2024-03-09T15:07:37.988771+0000","last_fullsized":"2024-03-09T15:07:37.988771+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'264","last_scrub_stamp":"2024-03-09T15:07:37.988583+0000","last_deep_scrub":"264'264","last_deep_scrub_stamp":"2024-03-09T15:07:37.988583+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.988583+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:46.575367+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":1036,"num_write":360,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.818762+0000","last_change":"2024-03-09T15:07:35.818818+0000","last_active":"2024-03-09T15:07:35.818762+0000","last_peered":"2024-03-09T15:07:35.818762+0000","last_clean":"2024-03-09T15:07:35.818762+0000","last_became_active":"2024-03-09T14:29:01.636083+0000","last_became_peered":"2024-03-09T14:29:01.636083+0000","last_unstale":"2024-03-09T15:07:35.818762+0000","last_undegraded":"2024-03-09T15:07:35.818762+0000","last_fullsized":"2024-03-09T15:07:35.818762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.818570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.818570+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.818570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:41:15.118693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'124","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.549045+0000","last_change":"2024-03-09T15:07:12.549133+0000","last_active":"2024-03-09T15:07:12.549045+0000","last_peered":"2024-03-09T15:07:12.549045+0000","last_clean":"2024-03-09T15:07:12.549045+0000","last_became_active":"2024-03-09T14:29:03.677376+0000","last_became_peered":"2024-03-09T14:29:03.677376+0000","last_unstale":"2024-03-09T15:07:12.549045+0000","last_undegraded":"2024-03-09T15:07:12.549045+0000","last_fullsized":"2024-03-09T15:07:12.549045+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:12.548825+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:12.548825+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.548825+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:01:19.400821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":93,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'1142","reported_seq":3003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.617476+0000","last_change":"2024-03-09T15:07:31.617551+0000","last_active":"2024-03-09T15:07:31.617476+0000","last_peered":"2024-03-09T15:07:31.617476+0000","last_clean":"2024-03-09T15:07:31.617476+0000","last_became_active":"2024-03-09T14:28:55.587547+0000","last_became_peered":"2024-03-09T14:28:55.587547+0000","last_unstale":"2024-03-09T15:07:31.617476+0000","last_undegraded":"2024-03-09T15:07:31.617476+0000","last_fullsized":"2024-03-09T15:07:31.617476+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1142","last_scrub_stamp":"2024-03-09T15:07:31.617284+0000","last_deep_scrub":"264'1142","last_deep_scrub_stamp":"2024-03-09T15:07:31.617284+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.617284+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:24.394435+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5366,"num_read_kb":4772,"num_write":1564,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4191,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'284","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.283858+0000","last_change":"2024-03-09T14:28:53.589911+0000","last_active":"2024-03-09T15:07:05.283858+0000","last_peered":"2024-03-09T15:07:05.283858+0000","last_clean":"2024-03-09T15:07:05.283858+0000","last_became_active":"2024-03-09T14:28:53.589407+0000","last_became_peered":"2024-03-09T14:28:53.589407+0000","last_unstale":"2024-03-09T15:07:05.283858+0000","last_undegraded":"2024-03-09T15:07:05.283858+0000","last_fullsized":"2024-03-09T15:07:05.283858+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":59464,"num_write":1037,"num_write_kb":28198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.818475+0000","last_change":"2024-03-09T15:07:27.818528+0000","last_active":"2024-03-09T15:07:27.818475+0000","last_peered":"2024-03-09T15:07:27.818475+0000","last_clean":"2024-03-09T15:07:27.818475+0000","last_became_active":"2024-03-09T14:28:57.620140+0000","last_became_peered":"2024-03-09T14:28:57.620140+0000","last_unstale":"2024-03-09T15:07:27.818475+0000","last_undegraded":"2024-03-09T15:07:27.818475+0000","last_fullsized":"2024-03-09T15:07:27.818475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:27.818272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:27.818272+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.818272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:07:47.066746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'79","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.737047+0000","last_change":"2024-03-09T15:07:24.737205+0000","last_active":"2024-03-09T15:07:24.737047+0000","last_peered":"2024-03-09T15:07:24.737047+0000","last_clean":"2024-03-09T15:07:24.737047+0000","last_became_active":"2024-03-09T14:28:59.629734+0000","last_became_peered":"2024-03-09T14:28:59.629734+0000","last_unstale":"2024-03-09T15:07:24.737047+0000","last_undegraded":"2024-03-09T15:07:24.737047+0000","last_fullsized":"2024-03-09T15:07:24.737047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'79","last_scrub_stamp":"2024-03-09T15:07:24.736784+0000","last_deep_scrub":"264'79","last_deep_scrub_stamp":"2024-03-09T15:07:24.736784+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.736784+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:02:04.246917+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":70,"num_read_kb":63,"num_write":56,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'540","reported_seq":2063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.197995+0000","last_change":"2024-03-09T15:07:21.198058+0000","last_active":"2024-03-09T15:07:21.197995+0000","last_peered":"2024-03-09T15:07:21.197995+0000","last_clean":"2024-03-09T15:07:21.197995+0000","last_became_active":"2024-03-09T14:29:01.650590+0000","last_became_peered":"2024-03-09T14:29:01.650590+0000","last_unstale":"2024-03-09T15:07:21.197995+0000","last_undegraded":"2024-03-09T15:07:21.197995+0000","last_fullsized":"2024-03-09T15:07:21.197995+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'540","last_scrub_stamp":"2024-03-09T15:07:21.197799+0000","last_deep_scrub":"264'540","last_deep_scrub_stamp":"2024-03-09T15:07:21.197799+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.197799+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:33:51.367630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'124","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.011441+0000","last_change":"2024-03-09T15:07:26.011504+0000","last_active":"2024-03-09T15:07:26.011441+0000","last_peered":"2024-03-09T15:07:26.011441+0000","last_clean":"2024-03-09T15:07:26.011441+0000","last_became_active":"2024-03-09T14:29:03.677064+0000","last_became_peered":"2024-03-09T14:29:03.677064+0000","last_unstale":"2024-03-09T15:07:26.011441+0000","last_undegraded":"2024-03-09T15:07:26.011441+0000","last_fullsized":"2024-03-09T15:07:26.011441+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:26.011253+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:26.011253+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.011253+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:04:51.610682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":150,"num_write":318,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'511","reported_seq":1986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.763467+0000","last_change":"2024-03-09T15:07:34.763605+0000","last_active":"2024-03-09T15:07:34.763467+0000","last_peered":"2024-03-09T15:07:34.763467+0000","last_clean":"2024-03-09T15:07:34.763467+0000","last_became_active":"2024-03-09T14:28:55.610134+0000","last_became_peered":"2024-03-09T14:28:55.610134+0000","last_unstale":"2024-03-09T15:07:34.763467+0000","last_undegraded":"2024-03-09T15:07:34.763467+0000","last_fullsized":"2024-03-09T15:07:34.763467+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'511","last_scrub_stamp":"2024-03-09T15:07:34.763210+0000","last_deep_scrub":"264'511","last_deep_scrub_stamp":"2024-03-09T15:07:34.763210+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.763210+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:43.942046+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2571,"num_read_kb":2332,"num_write":699,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":228,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'430","reported_seq":1157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.545102+0000","last_change":"2024-03-09T15:07:40.545239+0000","last_active":"2024-03-09T15:07:40.545102+0000","last_peered":"2024-03-09T15:07:40.545102+0000","last_clean":"2024-03-09T15:07:40.545102+0000","last_became_active":"2024-03-09T14:28:53.636761+0000","last_became_peered":"2024-03-09T14:28:53.636761+0000","last_unstale":"2024-03-09T15:07:40.545102+0000","last_undegraded":"2024-03-09T15:07:40.545102+0000","last_fullsized":"2024-03-09T15:07:40.545102+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'430","last_scrub_stamp":"2024-03-09T15:07:40.544850+0000","last_deep_scrub":"264'430","last_deep_scrub_stamp":"2024-03-09T15:07:40.544850+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.544850+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:56:02.288859+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":788,"num_read_kb":7041,"num_write":1515,"num_write_kb":16792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.905560+0000","last_change":"2024-03-09T15:07:40.905670+0000","last_active":"2024-03-09T15:07:40.905560+0000","last_peered":"2024-03-09T15:07:40.905560+0000","last_clean":"2024-03-09T15:07:40.905560+0000","last_became_active":"2024-03-09T14:28:57.612982+0000","last_became_peered":"2024-03-09T14:28:57.612982+0000","last_unstale":"2024-03-09T15:07:40.905560+0000","last_undegraded":"2024-03-09T15:07:40.905560+0000","last_fullsized":"2024-03-09T15:07:40.905560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:40.905311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:40.905311+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.905311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:23:55.643584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'288","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.953881+0000","last_change":"2024-03-09T14:28:59.601758+0000","last_active":"2024-03-09T15:07:11.953881+0000","last_peered":"2024-03-09T15:07:11.953881+0000","last_clean":"2024-03-09T15:07:11.953881+0000","last_became_active":"2024-03-09T14:28:59.601007+0000","last_became_peered":"2024-03-09T14:28:59.601007+0000","last_unstale":"2024-03-09T15:07:11.953881+0000","last_undegraded":"2024-03-09T15:07:11.953881+0000","last_fullsized":"2024-03-09T15:07:11.953881+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:58.579079+0000","last_clean_scrub_stamp":"2024-03-09T14:28:58.579079+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58554,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":1103,"num_write":386,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.710682+0000","last_change":"2024-03-09T15:07:28.710682+0000","last_active":"2024-03-09T15:07:28.710682+0000","last_peered":"2024-03-09T15:07:28.710682+0000","last_clean":"2024-03-09T15:07:28.710682+0000","last_became_active":"2024-03-09T14:29:01.657169+0000","last_became_peered":"2024-03-09T14:29:01.657169+0000","last_unstale":"2024-03-09T15:07:28.710682+0000","last_undegraded":"2024-03-09T15:07:28.710682+0000","last_fullsized":"2024-03-09T15:07:28.710682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:28.710441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:28.710441+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.710441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:06:51.547173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'124","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.984410+0000","last_change":"2024-03-09T15:07:27.984410+0000","last_active":"2024-03-09T15:07:27.984410+0000","last_peered":"2024-03-09T15:07:27.984410+0000","last_clean":"2024-03-09T15:07:27.984410+0000","last_became_active":"2024-03-09T14:29:03.669978+0000","last_became_peered":"2024-03-09T14:29:03.669978+0000","last_unstale":"2024-03-09T15:07:27.984410+0000","last_undegraded":"2024-03-09T15:07:27.984410+0000","last_fullsized":"2024-03-09T15:07:27.984410+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:27.984137+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:27.984137+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.984137+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:41:49.859618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":289,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'771","reported_seq":2298,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:38.398007+0000","last_change":"2024-03-09T14:28:55.570920+0000","last_active":"2024-03-09T15:06:38.398007+0000","last_peered":"2024-03-09T15:06:38.398007+0000","last_clean":"2024-03-09T15:06:38.398007+0000","last_became_active":"2024-03-09T14:28:55.570161+0000","last_became_peered":"2024-03-09T14:28:55.570161+0000","last_unstale":"2024-03-09T15:06:38.398007+0000","last_undegraded":"2024-03-09T15:06:38.398007+0000","last_fullsized":"2024-03-09T15:06:38.398007+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3636,"num_read_kb":3267,"num_write":1033,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'351","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.608643+0000","last_change":"2024-03-09T15:07:19.608740+0000","last_active":"2024-03-09T15:07:19.608643+0000","last_peered":"2024-03-09T15:07:19.608643+0000","last_clean":"2024-03-09T15:07:19.608643+0000","last_became_active":"2024-03-09T14:29:28.824399+0000","last_became_peered":"2024-03-09T14:29:28.824399+0000","last_unstale":"2024-03-09T15:07:19.608643+0000","last_undegraded":"2024-03-09T15:07:19.608643+0000","last_fullsized":"2024-03-09T15:07:19.608643+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-03-09T15:07:19.608431+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-03-09T15:07:19.608431+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.608431+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:55:03.616832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":600,"num_read_kb":66383,"num_write":1403,"num_write_kb":58469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.513168+0000","last_change":"2024-03-09T15:07:37.513222+0000","last_active":"2024-03-09T15:07:37.513168+0000","last_peered":"2024-03-09T15:07:37.513168+0000","last_clean":"2024-03-09T15:07:37.513168+0000","last_became_active":"2024-03-09T14:28:57.608639+0000","last_became_peered":"2024-03-09T14:28:57.608639+0000","last_unstale":"2024-03-09T15:07:37.513168+0000","last_undegraded":"2024-03-09T15:07:37.513168+0000","last_fullsized":"2024-03-09T15:07:37.513168+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:37.512944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:37.512944+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.512944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:58:03.637550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'272","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.663652+0000","last_change":"2024-03-09T15:07:49.663738+0000","last_active":"2024-03-09T15:07:49.663652+0000","last_peered":"2024-03-09T15:07:49.663652+0000","last_clean":"2024-03-09T15:07:49.663652+0000","last_became_active":"2024-03-09T14:28:59.623529+0000","last_became_peered":"2024-03-09T14:28:59.623529+0000","last_unstale":"2024-03-09T15:07:49.663652+0000","last_undegraded":"2024-03-09T15:07:49.663652+0000","last_fullsized":"2024-03-09T15:07:49.663652+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'272","last_scrub_stamp":"2024-03-09T15:07:49.663434+0000","last_deep_scrub":"264'272","last_deep_scrub_stamp":"2024-03-09T15:07:49.663434+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.663434+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:32:05.951813+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":971,"num_write":346,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.212269+0000","last_change":"2024-03-09T15:07:23.212326+0000","last_active":"2024-03-09T15:07:23.212269+0000","last_peered":"2024-03-09T15:07:23.212269+0000","last_clean":"2024-03-09T15:07:23.212269+0000","last_became_active":"2024-03-09T14:29:01.651183+0000","last_became_peered":"2024-03-09T14:29:01.651183+0000","last_unstale":"2024-03-09T15:07:23.212269+0000","last_undegraded":"2024-03-09T15:07:23.212269+0000","last_fullsized":"2024-03-09T15:07:23.212269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:23.212084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:23.212084+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.212084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:52:31.699504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'124","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.965517+0000","last_change":"2024-03-09T15:07:25.965517+0000","last_active":"2024-03-09T15:07:25.965517+0000","last_peered":"2024-03-09T15:07:25.965517+0000","last_clean":"2024-03-09T15:07:25.965517+0000","last_became_active":"2024-03-09T14:29:03.661848+0000","last_became_peered":"2024-03-09T14:29:03.661848+0000","last_unstale":"2024-03-09T15:07:25.965517+0000","last_undegraded":"2024-03-09T15:07:25.965517+0000","last_fullsized":"2024-03-09T15:07:25.965517+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:25.965247+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:25.965247+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.965247+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:36:26.246320+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":975,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":172,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'742","reported_seq":2304,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.809487+0000","last_change":"2024-03-09T14:28:55.582020+0000","last_active":"2024-03-09T15:07:10.809487+0000","last_peered":"2024-03-09T15:07:10.809487+0000","last_clean":"2024-03-09T15:07:10.809487+0000","last_became_active":"2024-03-09T14:28:55.580902+0000","last_became_peered":"2024-03-09T14:28:55.580902+0000","last_unstale":"2024-03-09T15:07:10.809487+0000","last_undegraded":"2024-03-09T15:07:10.809487+0000","last_fullsized":"2024-03-09T15:07:10.809487+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3409,"num_read_kb":3074,"num_write":976,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'296","reported_seq":931,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.405967+0000","last_change":"2024-03-09T14:28:53.619086+0000","last_active":"2024-03-09T15:07:05.405967+0000","last_peered":"2024-03-09T15:07:05.405967+0000","last_clean":"2024-03-09T15:07:05.405967+0000","last_became_active":"2024-03-09T14:28:53.618470+0000","last_became_peered":"2024-03-09T14:28:53.618470+0000","last_unstale":"2024-03-09T15:07:05.405967+0000","last_undegraded":"2024-03-09T15:07:05.405967+0000","last_fullsized":"2024-03-09T15:07:05.405967+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243044,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":49463,"num_write":1149,"num_write_kb":38192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.743133+0000","last_change":"2024-03-09T15:07:38.743133+0000","last_active":"2024-03-09T15:07:38.743133+0000","last_peered":"2024-03-09T15:07:38.743133+0000","last_clean":"2024-03-09T15:07:38.743133+0000","last_became_active":"2024-03-09T14:28:57.611745+0000","last_became_peered":"2024-03-09T14:28:57.611745+0000","last_unstale":"2024-03-09T15:07:38.743133+0000","last_undegraded":"2024-03-09T15:07:38.743133+0000","last_fullsized":"2024-03-09T15:07:38.743133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:38.742764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:38.742764+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.742764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:41:17.394565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'215","reported_seq":773,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.007685+0000","last_change":"2024-03-09T15:07:42.007752+0000","last_active":"2024-03-09T15:07:42.007685+0000","last_peered":"2024-03-09T15:07:42.007685+0000","last_clean":"2024-03-09T15:07:42.007685+0000","last_became_active":"2024-03-09T14:28:59.615400+0000","last_became_peered":"2024-03-09T14:28:59.615400+0000","last_unstale":"2024-03-09T15:07:42.007685+0000","last_undegraded":"2024-03-09T15:07:42.007685+0000","last_fullsized":"2024-03-09T15:07:42.007685+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'215","last_scrub_stamp":"2024-03-09T15:07:42.007505+0000","last_deep_scrub":"264'215","last_deep_scrub_stamp":"2024-03-09T15:07:42.007505+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.007505+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:40:23.332625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41975,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":356,"num_read_kb":841,"num_write":286,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.763802+0000","last_change":"2024-03-09T15:07:19.763934+0000","last_active":"2024-03-09T15:07:19.763802+0000","last_peered":"2024-03-09T15:07:19.763802+0000","last_clean":"2024-03-09T15:07:19.763802+0000","last_became_active":"2024-03-09T14:29:01.657117+0000","last_became_peered":"2024-03-09T14:29:01.657117+0000","last_unstale":"2024-03-09T15:07:19.763802+0000","last_undegraded":"2024-03-09T15:07:19.763802+0000","last_fullsized":"2024-03-09T15:07:19.763802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:19.763551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:19.763551+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.763551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:00:56.266543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'135","reported_seq":1803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.938669+0000","last_change":"2024-03-09T15:07:28.938669+0000","last_active":"2024-03-09T15:07:28.938669+0000","last_peered":"2024-03-09T15:07:28.938669+0000","last_clean":"2024-03-09T15:07:28.938669+0000","last_became_active":"2024-03-09T14:29:03.659930+0000","last_became_peered":"2024-03-09T14:29:03.659930+0000","last_unstale":"2024-03-09T15:07:28.938669+0000","last_undegraded":"2024-03-09T15:07:28.938669+0000","last_fullsized":"2024-03-09T15:07:28.938669+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'135","last_scrub_stamp":"2024-03-09T15:07:28.938414+0000","last_deep_scrub":"264'135","last_deep_scrub_stamp":"2024-03-09T15:07:28.938414+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.938414+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:57.834645+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1320,"num_read_kb":1317,"num_write":320,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'484","reported_seq":2157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.745370+0000","last_change":"2024-03-09T15:07:32.745370+0000","last_active":"2024-03-09T15:07:32.745370+0000","last_peered":"2024-03-09T15:07:32.745370+0000","last_clean":"2024-03-09T15:07:32.745370+0000","last_became_active":"2024-03-09T14:28:55.598822+0000","last_became_peered":"2024-03-09T14:28:55.598822+0000","last_unstale":"2024-03-09T15:07:32.745370+0000","last_undegraded":"2024-03-09T15:07:32.745370+0000","last_fullsized":"2024-03-09T15:07:32.745370+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'484","last_scrub_stamp":"2024-03-09T15:07:32.745104+0000","last_deep_scrub":"264'484","last_deep_scrub_stamp":"2024-03-09T15:07:32.745104+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.745104+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:12:38.011733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2615,"num_read_kb":2447,"num_write":578,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'291","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.423247+0000","last_change":"2024-03-09T14:28:53.595926+0000","last_active":"2024-03-09T15:07:05.423247+0000","last_peered":"2024-03-09T15:07:05.423247+0000","last_clean":"2024-03-09T15:07:05.423247+0000","last_became_active":"2024-03-09T14:28:53.595479+0000","last_became_peered":"2024-03-09T14:28:53.595479+0000","last_unstale":"2024-03-09T15:07:05.423247+0000","last_undegraded":"2024-03-09T15:07:05.423247+0000","last_fullsized":"2024-03-09T15:07:05.423247+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311401,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":399,"num_read_kb":37243,"num_write":1062,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.908465+0000","last_change":"2024-03-09T15:07:21.908465+0000","last_active":"2024-03-09T15:07:21.908465+0000","last_peered":"2024-03-09T15:07:21.908465+0000","last_clean":"2024-03-09T15:07:21.908465+0000","last_became_active":"2024-03-09T14:28:57.608170+0000","last_became_peered":"2024-03-09T14:28:57.608170+0000","last_unstale":"2024-03-09T15:07:21.908465+0000","last_undegraded":"2024-03-09T15:07:21.908465+0000","last_fullsized":"2024-03-09T15:07:21.908465+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:21.908209+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:21.908209+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.908209+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:46:15.136572+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'257","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.774386+0000","last_change":"2024-03-09T15:07:27.774468+0000","last_active":"2024-03-09T15:07:27.774386+0000","last_peered":"2024-03-09T15:07:27.774386+0000","last_clean":"2024-03-09T15:07:27.774386+0000","last_became_active":"2024-03-09T14:28:59.614271+0000","last_became_peered":"2024-03-09T14:28:59.614271+0000","last_unstale":"2024-03-09T15:07:27.774386+0000","last_undegraded":"2024-03-09T15:07:27.774386+0000","last_fullsized":"2024-03-09T15:07:27.774386+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-03-09T15:07:27.774203+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-03-09T15:07:27.774203+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.774203+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:16:51.240318+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45957,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":426,"num_read_kb":925,"num_write":332,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.731942+0000","last_change":"2024-03-09T15:07:29.732043+0000","last_active":"2024-03-09T15:07:29.731942+0000","last_peered":"2024-03-09T15:07:29.731942+0000","last_clean":"2024-03-09T15:07:29.731942+0000","last_became_active":"2024-03-09T14:29:01.648467+0000","last_became_peered":"2024-03-09T14:29:01.648467+0000","last_unstale":"2024-03-09T15:07:29.731942+0000","last_undegraded":"2024-03-09T15:07:29.731942+0000","last_fullsized":"2024-03-09T15:07:29.731942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:29.731652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:29.731652+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.731652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:24:49.823183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'90","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.791592+0000","last_change":"2024-03-09T15:07:15.791657+0000","last_active":"2024-03-09T15:07:15.791592+0000","last_peered":"2024-03-09T15:07:15.791592+0000","last_clean":"2024-03-09T15:07:15.791592+0000","last_became_active":"2024-03-09T14:29:03.666157+0000","last_became_peered":"2024-03-09T14:29:03.666157+0000","last_unstale":"2024-03-09T15:07:15.791592+0000","last_undegraded":"2024-03-09T15:07:15.791592+0000","last_fullsized":"2024-03-09T15:07:15.791592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'90","last_scrub_stamp":"2024-03-09T15:07:15.791376+0000","last_deep_scrub":"264'90","last_deep_scrub_stamp":"2024-03-09T15:07:15.791376+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.791376+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:02:26.244687+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":67,"num_write":211,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'505","reported_seq":2013,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.872932+0000","last_change":"2024-03-09T15:07:24.873003+0000","last_active":"2024-03-09T15:07:24.872932+0000","last_peered":"2024-03-09T15:07:24.872932+0000","last_clean":"2024-03-09T15:07:24.872932+0000","last_became_active":"2024-03-09T14:28:55.591054+0000","last_became_peered":"2024-03-09T14:28:55.591054+0000","last_unstale":"2024-03-09T15:07:24.872932+0000","last_undegraded":"2024-03-09T15:07:24.872932+0000","last_fullsized":"2024-03-09T15:07:24.872932+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'505","last_scrub_stamp":"2024-03-09T15:07:24.872742+0000","last_deep_scrub":"264'505","last_deep_scrub_stamp":"2024-03-09T15:07:24.872742+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.872742+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:44:42.985766+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2590,"num_read_kb":2449,"num_write":673,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'308","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.187042+0000","last_change":"2024-03-09T15:07:42.187232+0000","last_active":"2024-03-09T15:07:42.187042+0000","last_peered":"2024-03-09T15:07:42.187042+0000","last_clean":"2024-03-09T15:07:42.187042+0000","last_became_active":"2024-03-09T14:28:53.638941+0000","last_became_peered":"2024-03-09T14:28:53.638941+0000","last_unstale":"2024-03-09T15:07:42.187042+0000","last_undegraded":"2024-03-09T15:07:42.187042+0000","last_fullsized":"2024-03-09T15:07:42.187042+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-03-09T15:07:42.186800+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-03-09T15:07:42.186800+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.186800+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:40:08.305555+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505214,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":466,"num_read_kb":10894,"num_write":1166,"num_write_kb":33356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'699","reported_seq":2168,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.909220+0000","last_change":"2024-03-09T15:07:30.909285+0000","last_active":"2024-03-09T15:07:30.909220+0000","last_peered":"2024-03-09T15:07:30.909220+0000","last_clean":"2024-03-09T15:07:30.909220+0000","last_became_active":"2024-03-09T14:28:55.578705+0000","last_became_peered":"2024-03-09T14:28:55.578705+0000","last_unstale":"2024-03-09T15:07:30.909220+0000","last_undegraded":"2024-03-09T15:07:30.909220+0000","last_fullsized":"2024-03-09T15:07:30.909220+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'699","last_scrub_stamp":"2024-03-09T15:07:30.909041+0000","last_deep_scrub":"264'699","last_deep_scrub_stamp":"2024-03-09T15:07:30.909041+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.909041+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":600,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:54:02.289892+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3212,"num_read_kb":2884,"num_write":923,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'308","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.480688+0000","last_change":"2024-03-09T15:07:28.480771+0000","last_active":"2024-03-09T15:07:28.480688+0000","last_peered":"2024-03-09T15:07:28.480688+0000","last_clean":"2024-03-09T15:07:28.480688+0000","last_became_active":"2024-03-09T14:28:53.617469+0000","last_became_peered":"2024-03-09T14:28:53.617469+0000","last_unstale":"2024-03-09T15:07:28.480688+0000","last_undegraded":"2024-03-09T15:07:28.480688+0000","last_fullsized":"2024-03-09T15:07:28.480688+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-03-09T15:07:28.480493+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-03-09T15:07:28.480493+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.480493+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:02:21.546672+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":486,"num_read_kb":96508,"num_write":1206,"num_write_kb":39289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'478","reported_seq":2163,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.553822+0000","last_change":"2024-03-09T15:07:29.553974+0000","last_active":"2024-03-09T15:07:29.553822+0000","last_peered":"2024-03-09T15:07:29.553822+0000","last_clean":"2024-03-09T15:07:29.553822+0000","last_became_active":"2024-03-09T14:28:55.594171+0000","last_became_peered":"2024-03-09T14:28:55.594171+0000","last_unstale":"2024-03-09T15:07:29.553822+0000","last_undegraded":"2024-03-09T15:07:29.553822+0000","last_fullsized":"2024-03-09T15:07:29.553822+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'478","last_scrub_stamp":"2024-03-09T15:07:29.553598+0000","last_deep_scrub":"264'478","last_deep_scrub_stamp":"2024-03-09T15:07:29.553598+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.553598+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:23:50.963569+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2696,"num_read_kb":2529,"num_write":600,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'314","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.421497+0000","last_change":"2024-03-09T14:28:53.627660+0000","last_active":"2024-03-09T15:07:05.421497+0000","last_peered":"2024-03-09T15:07:05.421497+0000","last_clean":"2024-03-09T15:07:05.421497+0000","last_became_active":"2024-03-09T14:28:53.627011+0000","last_became_peered":"2024-03-09T14:28:53.627011+0000","last_unstale":"2024-03-09T15:07:05.421497+0000","last_undegraded":"2024-03-09T15:07:05.421497+0000","last_fullsized":"2024-03-09T15:07:05.421497+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524303,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":582,"num_read_kb":86707,"num_write":1181,"num_write_kb":21935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'405","reported_seq":2046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.783579+0000","last_change":"2024-03-09T15:07:36.783640+0000","last_active":"2024-03-09T15:07:36.783579+0000","last_peered":"2024-03-09T15:07:36.783579+0000","last_clean":"2024-03-09T15:07:36.783579+0000","last_became_active":"2024-03-09T14:28:55.577524+0000","last_became_peered":"2024-03-09T14:28:55.577524+0000","last_unstale":"2024-03-09T15:07:36.783579+0000","last_undegraded":"2024-03-09T15:07:36.783579+0000","last_fullsized":"2024-03-09T15:07:36.783579+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-03-09T15:07:36.783400+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-03-09T15:07:36.783400+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.783400+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:22:53.289585+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2346,"num_read_kb":2237,"num_write":463,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'369","reported_seq":1129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.365261+0000","last_change":"2024-03-09T14:28:53.579012+0000","last_active":"2024-03-09T15:07:05.365261+0000","last_peered":"2024-03-09T15:07:05.365261+0000","last_clean":"2024-03-09T15:07:05.365261+0000","last_became_active":"2024-03-09T14:28:53.578574+0000","last_became_peered":"2024-03-09T14:28:53.578574+0000","last_unstale":"2024-03-09T15:07:05.365261+0000","last_undegraded":"2024-03-09T15:07:05.365261+0000","last_fullsized":"2024-03-09T15:07:05.365261+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269860,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":896,"num_read_kb":59109,"num_write":1337,"num_write_kb":49113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'697","reported_seq":2188,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.959079+0000","last_change":"2024-03-09T15:07:46.959143+0000","last_active":"2024-03-09T15:07:46.959079+0000","last_peered":"2024-03-09T15:07:46.959079+0000","last_clean":"2024-03-09T15:07:46.959079+0000","last_became_active":"2024-03-09T14:28:55.596637+0000","last_became_peered":"2024-03-09T14:28:55.596637+0000","last_unstale":"2024-03-09T15:07:46.959079+0000","last_undegraded":"2024-03-09T15:07:46.959079+0000","last_fullsized":"2024-03-09T15:07:46.959079+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'697","last_scrub_stamp":"2024-03-09T15:07:46.958846+0000","last_deep_scrub":"264'697","last_deep_scrub_stamp":"2024-03-09T15:07:46.958846+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.958846+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:40:48.271858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3232,"num_read_kb":2910,"num_write":917,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'266","reported_seq":864,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.388562+0000","last_change":"2024-03-09T14:28:53.578550+0000","last_active":"2024-03-09T15:07:05.388562+0000","last_peered":"2024-03-09T15:07:05.388562+0000","last_clean":"2024-03-09T15:07:05.388562+0000","last_became_active":"2024-03-09T14:28:53.577994+0000","last_became_peered":"2024-03-09T14:28:53.577994+0000","last_unstale":"2024-03-09T15:07:05.388562+0000","last_undegraded":"2024-03-09T15:07:05.388562+0000","last_fullsized":"2024-03-09T15:07:05.388562+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22703,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":387,"num_read_kb":10775,"num_write":997,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'1035","reported_seq":2419,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.737218+0000","last_change":"2024-03-09T15:07:30.737283+0000","last_active":"2024-03-09T15:07:30.737218+0000","last_peered":"2024-03-09T15:07:30.737218+0000","last_clean":"2024-03-09T15:07:30.737218+0000","last_became_active":"2024-03-09T14:28:55.598235+0000","last_became_peered":"2024-03-09T14:28:55.598235+0000","last_unstale":"2024-03-09T15:07:30.737218+0000","last_undegraded":"2024-03-09T15:07:30.737218+0000","last_fullsized":"2024-03-09T15:07:30.737218+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1035","last_scrub_stamp":"2024-03-09T15:07:30.737007+0000","last_deep_scrub":"264'1035","last_deep_scrub_stamp":"2024-03-09T15:07:30.737007+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.737007+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":1000,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:31.427701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4348,"num_read_kb":3780,"num_write":1436,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'378","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.699238+0000","last_change":"2024-03-09T15:07:41.699380+0000","last_active":"2024-03-09T15:07:41.699238+0000","last_peered":"2024-03-09T15:07:41.699238+0000","last_clean":"2024-03-09T15:07:41.699238+0000","last_became_active":"2024-03-09T14:28:53.591365+0000","last_became_peered":"2024-03-09T14:28:53.591365+0000","last_unstale":"2024-03-09T15:07:41.699238+0000","last_undegraded":"2024-03-09T15:07:41.699238+0000","last_fullsized":"2024-03-09T15:07:41.699238+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-03-09T15:07:41.699036+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-03-09T15:07:41.699036+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.699036+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:36:08.438868+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262246,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":674,"num_read_kb":645,"num_write":1631,"num_write_kb":21789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'477","reported_seq":1850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.034862+0000","last_change":"2024-03-09T15:07:24.034950+0000","last_active":"2024-03-09T15:07:24.034862+0000","last_peered":"2024-03-09T15:07:24.034862+0000","last_clean":"2024-03-09T15:07:24.034862+0000","last_became_active":"2024-03-09T14:29:28.738427+0000","last_became_peered":"2024-03-09T14:29:28.738427+0000","last_unstale":"2024-03-09T15:07:24.034862+0000","last_undegraded":"2024-03-09T15:07:24.034862+0000","last_fullsized":"2024-03-09T15:07:24.034862+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'477","last_scrub_stamp":"2024-03-09T15:07:24.034674+0000","last_deep_scrub":"264'477","last_deep_scrub_stamp":"2024-03-09T15:07:24.034674+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.034674+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:11:05.508803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2425,"num_read_kb":2201,"num_write":660,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'336","reported_seq":1001,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.229022+0000","last_change":"2024-03-09T15:07:41.229156+0000","last_active":"2024-03-09T15:07:41.229022+0000","last_peered":"2024-03-09T15:07:41.229022+0000","last_clean":"2024-03-09T15:07:41.229022+0000","last_became_active":"2024-03-09T14:28:53.635866+0000","last_became_peered":"2024-03-09T14:28:53.635866+0000","last_unstale":"2024-03-09T15:07:41.229022+0000","last_undegraded":"2024-03-09T15:07:41.229022+0000","last_fullsized":"2024-03-09T15:07:41.229022+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-03-09T15:07:41.228798+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-03-09T15:07:41.228798+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.228798+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:53:45.772020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049633,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":549,"num_read_kb":68120,"num_write":1314,"num_write_kb":51277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'627","reported_seq":2304,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.266360+0000","last_change":"2024-03-09T15:07:28.266429+0000","last_active":"2024-03-09T15:07:28.266360+0000","last_peered":"2024-03-09T15:07:28.266360+0000","last_clean":"2024-03-09T15:07:28.266360+0000","last_became_active":"2024-03-09T14:28:55.596430+0000","last_became_peered":"2024-03-09T14:28:55.596430+0000","last_unstale":"2024-03-09T15:07:28.266360+0000","last_undegraded":"2024-03-09T15:07:28.266360+0000","last_fullsized":"2024-03-09T15:07:28.266360+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'627","last_scrub_stamp":"2024-03-09T15:07:28.266175+0000","last_deep_scrub":"264'627","last_deep_scrub_stamp":"2024-03-09T15:07:28.266175+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.266175+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":600,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:02:30.550543+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3224,"num_read_kb":2919,"num_write":927,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'306","reported_seq":917,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:05.412588+0000","last_change":"2024-03-09T14:28:53.585196+0000","last_active":"2024-03-09T15:07:05.412588+0000","last_peered":"2024-03-09T15:07:05.412588+0000","last_clean":"2024-03-09T15:07:05.412588+0000","last_became_active":"2024-03-09T14:28:53.584780+0000","last_became_peered":"2024-03-09T14:28:53.584780+0000","last_unstale":"2024-03-09T15:07:05.412588+0000","last_undegraded":"2024-03-09T15:07:05.412588+0000","last_fullsized":"2024-03-09T15:07:05.412588+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262191,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":406,"num_read_kb":4504,"num_write":1224,"num_write_kb":43139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1140","reported_seq":2651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.662704+0000","last_change":"2024-03-09T15:07:46.662771+0000","last_active":"2024-03-09T15:07:46.662704+0000","last_peered":"2024-03-09T15:07:46.662704+0000","last_clean":"2024-03-09T15:07:46.662704+0000","last_became_active":"2024-03-09T14:28:55.582655+0000","last_became_peered":"2024-03-09T14:28:55.582655+0000","last_unstale":"2024-03-09T15:07:46.662704+0000","last_undegraded":"2024-03-09T15:07:46.662704+0000","last_fullsized":"2024-03-09T15:07:46.662704+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1140","last_scrub_stamp":"2024-03-09T15:07:46.662508+0000","last_deep_scrub":"264'1140","last_deep_scrub_stamp":"2024-03-09T15:07:46.662508+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.662508+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":1100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:55:19.168051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4834,"num_read_kb":4203,"num_write":1586,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'421","reported_seq":1131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.518176+0000","last_change":"2024-03-09T15:07:49.518327+0000","last_active":"2024-03-09T15:07:49.518176+0000","last_peered":"2024-03-09T15:07:49.518176+0000","last_clean":"2024-03-09T15:07:49.518176+0000","last_became_active":"2024-03-09T14:28:53.626746+0000","last_became_peered":"2024-03-09T14:28:53.626746+0000","last_unstale":"2024-03-09T15:07:49.518176+0000","last_undegraded":"2024-03-09T15:07:49.518176+0000","last_fullsized":"2024-03-09T15:07:49.518176+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'421","last_scrub_stamp":"2024-03-09T15:07:49.517967+0000","last_deep_scrub":"264'421","last_deep_scrub_stamp":"2024-03-09T15:07:49.517967+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.517967+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:49.761015+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262222,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":818,"num_read_kb":5936,"num_write":1494,"num_write_kb":27133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'406","reported_seq":2043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.756420+0000","last_change":"2024-03-09T15:07:37.756486+0000","last_active":"2024-03-09T15:07:37.756420+0000","last_peered":"2024-03-09T15:07:37.756420+0000","last_clean":"2024-03-09T15:07:37.756420+0000","last_became_active":"2024-03-09T14:28:55.574723+0000","last_became_peered":"2024-03-09T14:28:55.574723+0000","last_unstale":"2024-03-09T15:07:37.756420+0000","last_undegraded":"2024-03-09T15:07:37.756420+0000","last_fullsized":"2024-03-09T15:07:37.756420+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'406","last_scrub_stamp":"2024-03-09T15:07:37.756246+0000","last_deep_scrub":"264'406","last_deep_scrub_stamp":"2024-03-09T15:07:37.756246+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.756246+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:58:40.677052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2270,"num_read_kb":2181,"num_write":450,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'371","reported_seq":1249,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.983603+0000","last_change":"2024-03-09T14:28:53.565397+0000","last_active":"2024-03-09T15:07:09.983603+0000","last_peered":"2024-03-09T15:07:09.983603+0000","last_clean":"2024-03-09T15:07:09.983603+0000","last_became_active":"2024-03-09T14:28:53.564605+0000","last_became_peered":"2024-03-09T14:28:53.564605+0000","last_unstale":"2024-03-09T15:07:09.983603+0000","last_undegraded":"2024-03-09T15:07:09.983603+0000","last_fullsized":"2024-03-09T15:07:09.983603+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1026,"num_read_kb":12227,"num_write":1373,"num_write_kb":35283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'476","reported_seq":2104,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.574007+0000","last_change":"2024-03-09T15:07:32.574074+0000","last_active":"2024-03-09T15:07:32.574007+0000","last_peered":"2024-03-09T15:07:32.574007+0000","last_clean":"2024-03-09T15:07:32.574007+0000","last_became_active":"2024-03-09T14:28:55.596007+0000","last_became_peered":"2024-03-09T14:28:55.596007+0000","last_unstale":"2024-03-09T15:07:32.574007+0000","last_undegraded":"2024-03-09T15:07:32.574007+0000","last_fullsized":"2024-03-09T15:07:32.574007+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'476","last_scrub_stamp":"2024-03-09T15:07:32.573821+0000","last_deep_scrub":"264'476","last_deep_scrub_stamp":"2024-03-09T15:07:32.573821+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.573821+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:44:44.602915+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2627,"num_read_kb":2464,"num_write":596,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'263","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.551083+0000","last_change":"2024-03-09T15:07:38.551163+0000","last_active":"2024-03-09T15:07:38.551083+0000","last_peered":"2024-03-09T15:07:38.551083+0000","last_clean":"2024-03-09T15:07:38.551083+0000","last_became_active":"2024-03-09T14:28:53.637905+0000","last_became_peered":"2024-03-09T14:28:53.637905+0000","last_unstale":"2024-03-09T15:07:38.551083+0000","last_undegraded":"2024-03-09T15:07:38.551083+0000","last_fullsized":"2024-03-09T15:07:38.551083+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'263","last_scrub_stamp":"2024-03-09T15:07:38.550886+0000","last_deep_scrub":"264'263","last_deep_scrub_stamp":"2024-03-09T15:07:38.550886+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.550886+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:31:06.940143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":369,"num_read_kb":388,"num_write":1032,"num_write_kb":15956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'869","reported_seq":2416,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.773222+0000","last_change":"2024-03-09T15:07:29.773298+0000","last_active":"2024-03-09T15:07:29.773222+0000","last_peered":"2024-03-09T15:07:29.773222+0000","last_clean":"2024-03-09T15:07:29.773222+0000","last_became_active":"2024-03-09T14:28:55.589596+0000","last_became_peered":"2024-03-09T14:28:55.589596+0000","last_unstale":"2024-03-09T15:07:29.773222+0000","last_undegraded":"2024-03-09T15:07:29.773222+0000","last_fullsized":"2024-03-09T15:07:29.773222+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'869","last_scrub_stamp":"2024-03-09T15:07:29.773012+0000","last_deep_scrub":"264'869","last_deep_scrub_stamp":"2024-03-09T15:07:29.773012+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.773012+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:16:43.898214+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4032,"num_read_kb":3559,"num_write":1203,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'316","reported_seq":1056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.437485+0000","last_change":"2024-03-09T14:28:53.627710+0000","last_active":"2024-03-09T15:07:09.437485+0000","last_peered":"2024-03-09T15:07:09.437485+0000","last_clean":"2024-03-09T15:07:09.437485+0000","last_became_active":"2024-03-09T14:28:53.626673+0000","last_became_peered":"2024-03-09T14:28:53.626673+0000","last_unstale":"2024-03-09T15:07:09.437485+0000","last_undegraded":"2024-03-09T15:07:09.437485+0000","last_fullsized":"2024-03-09T15:07:09.437485+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":573,"num_read_kb":94146,"num_write":1092,"num_write_kb":28965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'474","reported_seq":1994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.959577+0000","last_change":"2024-03-09T15:07:37.959645+0000","last_active":"2024-03-09T15:07:37.959577+0000","last_peered":"2024-03-09T15:07:37.959577+0000","last_clean":"2024-03-09T15:07:37.959577+0000","last_became_active":"2024-03-09T14:28:55.610314+0000","last_became_peered":"2024-03-09T14:28:55.610314+0000","last_unstale":"2024-03-09T15:07:37.959577+0000","last_undegraded":"2024-03-09T15:07:37.959577+0000","last_fullsized":"2024-03-09T15:07:37.959577+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'474","last_scrub_stamp":"2024-03-09T15:07:37.959395+0000","last_deep_scrub":"264'474","last_deep_scrub_stamp":"2024-03-09T15:07:37.959395+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.959395+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:05:39.306030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2645,"num_read_kb":2435,"num_write":625,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'356","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.243758+0000","last_change":"2024-03-09T15:07:37.243890+0000","last_active":"2024-03-09T15:07:37.243758+0000","last_peered":"2024-03-09T15:07:37.243758+0000","last_clean":"2024-03-09T15:07:37.243758+0000","last_became_active":"2024-03-09T14:28:53.631327+0000","last_became_peered":"2024-03-09T14:28:53.631327+0000","last_unstale":"2024-03-09T15:07:37.243758+0000","last_undegraded":"2024-03-09T15:07:37.243758+0000","last_fullsized":"2024-03-09T15:07:37.243758+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-03-09T15:07:37.243537+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-03-09T15:07:37.243537+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.243537+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:57:08.377852+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":582,"num_read_kb":48859,"num_write":1226,"num_write_kb":49653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'389","reported_seq":1882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.751998+0000","last_change":"2024-03-09T15:07:42.752137+0000","last_active":"2024-03-09T15:07:42.751998+0000","last_peered":"2024-03-09T15:07:42.751998+0000","last_clean":"2024-03-09T15:07:42.751998+0000","last_became_active":"2024-03-09T14:28:55.587355+0000","last_became_peered":"2024-03-09T14:28:55.587355+0000","last_unstale":"2024-03-09T15:07:42.751998+0000","last_undegraded":"2024-03-09T15:07:42.751998+0000","last_fullsized":"2024-03-09T15:07:42.751998+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'389","last_scrub_stamp":"2024-03-09T15:07:42.751743+0000","last_deep_scrub":"264'389","last_deep_scrub_stamp":"2024-03-09T15:07:42.751743+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.751743+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:32:06.938642+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2078,"num_read_kb":1975,"num_write":455,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'395","reported_seq":1049,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.840206+0000","last_change":"2024-03-09T14:28:53.624013+0000","last_active":"2024-03-09T15:07:12.840206+0000","last_peered":"2024-03-09T15:07:12.840206+0000","last_clean":"2024-03-09T15:07:12.840206+0000","last_became_active":"2024-03-09T14:28:53.622624+0000","last_became_peered":"2024-03-09T14:28:53.622624+0000","last_unstale":"2024-03-09T15:07:12.840206+0000","last_undegraded":"2024-03-09T15:07:12.840206+0000","last_fullsized":"2024-03-09T15:07:12.840206+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:52.514766+0000","last_clean_scrub_stamp":"2024-03-09T14:28:52.514766+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262192,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":653,"num_read_kb":22046,"num_write":1243,"num_write_kb":48993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'1099","reported_seq":2575,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.983632+0000","last_change":"2024-03-09T14:28:55.591286+0000","last_active":"2024-03-09T15:07:09.983632+0000","last_peered":"2024-03-09T15:07:09.983632+0000","last_clean":"2024-03-09T15:07:09.983632+0000","last_became_active":"2024-03-09T14:28:55.582143+0000","last_became_peered":"2024-03-09T14:28:55.582143+0000","last_unstale":"2024-03-09T15:07:09.983632+0000","last_undegraded":"2024-03-09T15:07:09.983632+0000","last_fullsized":"2024-03-09T15:07:09.983632+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:28:54.534532+0000","last_clean_scrub_stamp":"2024-03-09T14:28:54.534532+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":1000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4588,"num_read_kb":3996,"num_write":1519,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'363","reported_seq":1097,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.530647+0000","last_change":"2024-03-09T15:07:29.530760+0000","last_active":"2024-03-09T15:07:29.530647+0000","last_peered":"2024-03-09T15:07:29.530647+0000","last_clean":"2024-03-09T15:07:29.530647+0000","last_became_active":"2024-03-09T14:28:53.633121+0000","last_became_peered":"2024-03-09T14:28:53.633121+0000","last_unstale":"2024-03-09T15:07:29.530647+0000","last_undegraded":"2024-03-09T15:07:29.530647+0000","last_fullsized":"2024-03-09T15:07:29.530647+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'363","last_scrub_stamp":"2024-03-09T15:07:29.530472+0000","last_deep_scrub":"264'363","last_deep_scrub_stamp":"2024-03-09T15:07:29.530472+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.530472+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:42:58.011768+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3312503,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":707,"num_read_kb":9275,"num_write":1371,"num_write_kb":66964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'678","reported_seq":2125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.948617+0000","last_change":"2024-03-09T15:07:39.948685+0000","last_active":"2024-03-09T15:07:39.948617+0000","last_peered":"2024-03-09T15:07:39.948617+0000","last_clean":"2024-03-09T15:07:39.948617+0000","last_became_active":"2024-03-09T14:28:55.601622+0000","last_became_peered":"2024-03-09T14:28:55.601622+0000","last_unstale":"2024-03-09T15:07:39.948617+0000","last_undegraded":"2024-03-09T15:07:39.948617+0000","last_fullsized":"2024-03-09T15:07:39.948617+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'678","last_scrub_stamp":"2024-03-09T15:07:39.948430+0000","last_deep_scrub":"264'678","last_deep_scrub_stamp":"2024-03-09T15:07:39.948430+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.948430+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:45:16.720446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3103,"num_read_kb":2796,"num_write":889,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'405","reported_seq":1140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.604375+0000","last_change":"2024-03-09T15:07:21.604740+0000","last_active":"2024-03-09T15:07:21.604375+0000","last_peered":"2024-03-09T15:07:21.604375+0000","last_clean":"2024-03-09T15:07:21.604375+0000","last_became_active":"2024-03-09T14:29:28.827826+0000","last_became_peered":"2024-03-09T14:29:28.827826+0000","last_unstale":"2024-03-09T15:07:21.604375+0000","last_undegraded":"2024-03-09T15:07:21.604375+0000","last_fullsized":"2024-03-09T15:07:21.604375+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-03-09T15:07:21.604112+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-03-09T15:07:21.604112+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.604112+0000","objects_scrubbed":10,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:36:26.048379+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918827,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":881,"num_read_kb":41003,"num_write":1564,"num_write_kb":37571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"264'297","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.549879+0000","last_change":"2024-03-09T15:07:46.549960+0000","last_active":"2024-03-09T15:07:46.549879+0000","last_peered":"2024-03-09T15:07:46.549879+0000","last_clean":"2024-03-09T15:07:46.549879+0000","last_became_active":"2024-03-09T14:28:53.602502+0000","last_became_peered":"2024-03-09T14:28:53.602502+0000","last_unstale":"2024-03-09T15:07:46.549879+0000","last_undegraded":"2024-03-09T15:07:46.549879+0000","last_fullsized":"2024-03-09T15:07:46.549879+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'297","last_scrub_stamp":"2024-03-09T15:07:46.549673+0000","last_deep_scrub":"264'297","last_deep_scrub_stamp":"2024-03-09T15:07:46.549673+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.549673+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:19:30.953593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":396,"num_read_kb":11977,"num_write":1066,"num_write_kb":41245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'858","reported_seq":2316,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.751039+0000","last_change":"2024-03-09T15:07:38.751039+0000","last_active":"2024-03-09T15:07:38.751039+0000","last_peered":"2024-03-09T15:07:38.751039+0000","last_clean":"2024-03-09T15:07:38.751039+0000","last_became_active":"2024-03-09T14:28:55.601537+0000","last_became_peered":"2024-03-09T14:28:55.601537+0000","last_unstale":"2024-03-09T15:07:38.751039+0000","last_undegraded":"2024-03-09T15:07:38.751039+0000","last_fullsized":"2024-03-09T15:07:38.751039+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'858","last_scrub_stamp":"2024-03-09T15:07:38.750716+0000","last_deep_scrub":"264'858","last_deep_scrub_stamp":"2024-03-09T15:07:38.750716+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.750716+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:01:30.209754+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3890,"num_read_kb":3404,"num_write":1199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'348","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.714091+0000","last_change":"2024-03-09T15:07:39.714220+0000","last_active":"2024-03-09T15:07:39.714091+0000","last_peered":"2024-03-09T15:07:39.714091+0000","last_clean":"2024-03-09T15:07:39.714091+0000","last_became_active":"2024-03-09T14:28:53.588717+0000","last_became_peered":"2024-03-09T14:28:53.588717+0000","last_unstale":"2024-03-09T15:07:39.714091+0000","last_undegraded":"2024-03-09T15:07:39.714091+0000","last_fullsized":"2024-03-09T15:07:39.714091+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-03-09T15:07:39.713890+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-03-09T15:07:39.713890+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.713890+0000","objects_scrubbed":12,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:51.804676+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286749,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":569,"num_read_kb":5745,"num_write":1174,"num_write_kb":28449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'1156","reported_seq":2693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.497285+0000","last_change":"2024-03-09T15:07:32.497285+0000","last_active":"2024-03-09T15:07:32.497285+0000","last_peered":"2024-03-09T15:07:32.497285+0000","last_clean":"2024-03-09T15:07:32.497285+0000","last_became_active":"2024-03-09T14:28:55.582541+0000","last_became_peered":"2024-03-09T14:28:55.582541+0000","last_unstale":"2024-03-09T15:07:32.497285+0000","last_undegraded":"2024-03-09T15:07:32.497285+0000","last_fullsized":"2024-03-09T15:07:32.497285+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1156","last_scrub_stamp":"2024-03-09T15:07:32.497013+0000","last_deep_scrub":"264'1156","last_deep_scrub_stamp":"2024-03-09T15:07:32.497013+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.497013+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":1100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:11.099274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4871,"num_read_kb":4234,"num_write":1610,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5930,"num_read_kb":4217,"num_write":2190,"num_write_kb":844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7263,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1125,"ondisk_log_size":1125,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":13413,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":15557,"num_read_kb":15326,"num_write":16235,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2284,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":26826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1635,"ondisk_log_size":1635,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":433,"ondisk_log_size":433,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1466895,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":16241,"num_read_kb":34652,"num_write":13827,"num_write_kb":11138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":672712,"num_omap_keys":1562,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1994,"ondisk_log_size":1994,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1622,"num_read_kb":1927,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":194579,"num_read_kb":177681,"num_write":51390,"num_write_kb":17534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":132,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":26519,"num_omap_keys":111,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4076,"ondisk_log_size":4076,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":142827823,"num_objects":361,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":361,"num_whiteouts":0,"num_read":34808,"num_read_kb":1970678,"num_write":77579,"num_write_kb":2252311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":193282048,"data_stored":193282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3795,"ondisk_log_size":3795,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":180405,"num_write":150,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":95,"ondisk_log_size":95,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":133,"num_read_kb":177288,"num_write":150,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575325,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":360960,"kb_used_data":41016,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":94010880,"statfs":{"total":96636764160,"available":96267141120,"internally_reserved":0,"allocated":42000384,"data_stored":40009750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":327612874},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575322,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":346200,"kb_used_data":35984,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":94025640,"statfs":{"total":96636764160,"available":96282255360,"internally_reserved":0,"allocated":36847616,"data_stored":34892402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":317651398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575326,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":176544,"kb_used_data":41304,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94195296,"statfs":{"total":96636764160,"available":96455983104,"internally_reserved":0,"allocated":42295296,"data_stored":40303321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575323,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":173472,"kb_used_data":43736,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94198368,"statfs":{"total":96636764160,"available":96459128832,"internally_reserved":0,"allocated":44785664,"data_stored":42869751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575325,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301360,"kb_used_data":35560,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94070480,"statfs":{"total":96636764160,"available":96328171520,"internally_reserved":0,"allocated":36413440,"data_stored":34419369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":272169415},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575321,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":135436,"kb_used_data":27908,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94236404,"statfs":{"total":96636764160,"available":96498077696,"internally_reserved":0,"allocated":28577792,"data_stored":26654129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575325,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209596,"kb_used_data":34100,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94162244,"statfs":{"total":96636764160,"available":96422137856,"internally_reserved":0,"allocated":34918400,"data_stored":32958583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575322,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":294704,"kb_used_data":28904,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94077136,"statfs":{"total":96636764160,"available":96334987264,"internally_reserved":0,"allocated":29597696,"data_stored":27607131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23699456,"data_stored":23699456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24399872,"data_stored":24399872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19144704,"data_stored":19144704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21663744,"data_stored":21663744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24875008,"data_stored":24875008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21258240,"data_stored":21258240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27381760,"data_stored":27381760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":30859264,"data_stored":30859264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:07:54.176 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.177 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.177 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.177 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.177 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.178 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.178 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.178 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.178 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.178 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.179 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.179 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.179 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.179 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.179 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.180 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.180 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.180 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.180 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.180 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.180 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.181 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.181 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.181 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.181 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.182 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.182 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.182 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.182 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.182 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.183 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.183 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-03-09T14:42:14.906081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=14, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.183 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.183 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.183 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.183 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.184 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.184 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.184 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.184 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.184 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.185 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.185 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.185 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.185 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.185 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.186 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.186 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.186 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.186 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.186 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.187 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.187 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.187 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.187 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.187 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.188 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.188 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.188 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-09T14:28:35.777784+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=35, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.189 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.189 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.189 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-09T14:28:40.805752+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.189 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.189 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.190 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.190 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-09T14:28:40.805752+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.190 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.190 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.190 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.191 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.191 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.191 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-09T14:28:56.570767+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=56, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.191 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.191 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.192 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.192 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.192 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-03-09T14:28:58.579079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=58, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.192 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.193 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.193 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.193 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.193 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.194 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.194 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.194 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.194 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.194 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.195 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-09T14:28:52.514766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.195 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-03-09T14:28:54.534532+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=28, tm_sec=54, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:07:54.195 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-09T15:08:14.196 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:08:14.572 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:08:14.585 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-09T15:08:14.594 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":1446,"stamp":"2024-03-09T15:08:12.892715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":178454650,"num_objects":799,"num_object_clones":0,"num_object_copies":2320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":799,"num_whiteouts":0,"num_read":269134,"num_read_kb":2562286,"num_write":161720,"num_write_kb":2520695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":176,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":724630,"num_omap_keys":1757,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13362,"ondisk_log_size":13362,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2002432,"kb_used_data":288512,"kb_used_omap":12,"kb_used_meta":1713843,"kb_avail":752972288,"statfs":{"total":773094113280,"available":771043622912,"internally_reserved":0,"allocated":295436288,"data_stored":279714436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1754975792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6388,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009745"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:58.576865+0000","last_change":"2024-03-09T15:07:58.576964+0000","last_active":"2024-03-09T15:07:58.576865+0000","last_peered":"2024-03-09T15:07:58.576865+0000","last_clean":"2024-03-09T15:07:58.576865+0000","last_became_active":"2024-03-09T14:49:53.656173+0000","last_became_peered":"2024-03-09T14:49:53.656173+0000","last_unstale":"2024-03-09T15:07:58.576865+0000","last_undegraded":"2024-03-09T15:07:58.576865+0000","last_fullsized":"2024-03-09T15:07:58.576865+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:58.576557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:58.576557+0000","last_clean_scrub_stamp":"2024-03-09T15:07:58.576557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:45:42.587164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:53.578143+0000","last_change":"2024-03-09T15:07:53.578272+0000","last_active":"2024-03-09T15:07:53.578143+0000","last_peered":"2024-03-09T15:07:53.578143+0000","last_clean":"2024-03-09T15:07:53.578143+0000","last_became_active":"2024-03-09T14:42:19.006064+0000","last_became_peered":"2024-03-09T14:42:19.006064+0000","last_unstale":"2024-03-09T15:07:53.578143+0000","last_undegraded":"2024-03-09T15:07:53.578143+0000","last_fullsized":"2024-03-09T15:07:53.578143+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:53.577898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:53.577898+0000","last_clean_scrub_stamp":"2024-03-09T15:07:53.577898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:15:17.415813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.016424+0000","last_change":"2024-03-09T15:07:13.016424+0000","last_active":"2024-03-09T15:07:13.016424+0000","last_peered":"2024-03-09T15:07:13.016424+0000","last_clean":"2024-03-09T15:07:13.016424+0000","last_became_active":"2024-03-09T14:42:15.928518+0000","last_became_peered":"2024-03-09T14:42:15.928518+0000","last_unstale":"2024-03-09T15:07:13.016424+0000","last_undegraded":"2024-03-09T15:07:13.016424+0000","last_fullsized":"2024-03-09T15:07:13.016424+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:13.016259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:13.016259+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.016259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:32:55.901082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'49","reported_seq":165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.732265+0000","last_change":"2024-03-09T15:07:09.732293+0000","last_active":"2024-03-09T15:07:09.732265+0000","last_peered":"2024-03-09T15:07:09.732265+0000","last_clean":"2024-03-09T15:07:09.732265+0000","last_became_active":"2024-03-09T14:39:57.901879+0000","last_became_peered":"2024-03-09T14:39:57.901879+0000","last_unstale":"2024-03-09T15:07:09.732265+0000","last_undegraded":"2024-03-09T15:07:09.732265+0000","last_fullsized":"2024-03-09T15:07:09.732265+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-03-09T15:07:09.732154+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-03-09T15:07:09.732154+0000","last_clean_scrub_stamp":"2024-03-09T15:07:09.732154+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:47.058510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":129,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.487794+0000","last_change":"2024-03-09T15:07:42.487849+0000","last_active":"2024-03-09T15:07:42.487794+0000","last_peered":"2024-03-09T15:07:42.487794+0000","last_clean":"2024-03-09T15:07:42.487794+0000","last_became_active":"2024-03-09T14:49:53.684941+0000","last_became_peered":"2024-03-09T14:49:53.684941+0000","last_unstale":"2024-03-09T15:07:42.487794+0000","last_undegraded":"2024-03-09T15:07:42.487794+0000","last_fullsized":"2024-03-09T15:07:42.487794+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:42.487592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:42.487592+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.487592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:52.648364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:55.778080+0000","last_change":"2024-03-09T15:07:55.778134+0000","last_active":"2024-03-09T15:07:55.778080+0000","last_peered":"2024-03-09T15:07:55.778080+0000","last_clean":"2024-03-09T15:07:55.778080+0000","last_became_active":"2024-03-09T14:42:19.011453+0000","last_became_peered":"2024-03-09T14:42:19.011453+0000","last_unstale":"2024-03-09T15:07:55.778080+0000","last_undegraded":"2024-03-09T15:07:55.778080+0000","last_fullsized":"2024-03-09T15:07:55.778080+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:55.777881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:55.777881+0000","last_clean_scrub_stamp":"2024-03-09T15:07:55.777881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:39.838953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.004521+0000","last_change":"2024-03-09T15:07:16.004521+0000","last_active":"2024-03-09T15:07:16.004521+0000","last_peered":"2024-03-09T15:07:16.004521+0000","last_clean":"2024-03-09T15:07:16.004521+0000","last_became_active":"2024-03-09T14:42:15.970720+0000","last_became_peered":"2024-03-09T14:42:15.970720+0000","last_unstale":"2024-03-09T15:07:16.004521+0000","last_undegraded":"2024-03-09T15:07:16.004521+0000","last_fullsized":"2024-03-09T15:07:16.004521+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:16.004189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:16.004189+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.004189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:56:28.921839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'3","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.474480+0000","last_change":"2024-03-09T15:07:25.474480+0000","last_active":"2024-03-09T15:07:25.474480+0000","last_peered":"2024-03-09T15:07:25.474480+0000","last_clean":"2024-03-09T15:07:25.474480+0000","last_became_active":"2024-03-09T14:39:57.894022+0000","last_became_peered":"2024-03-09T14:39:57.894022+0000","last_unstale":"2024-03-09T15:07:25.474480+0000","last_undegraded":"2024-03-09T15:07:25.474480+0000","last_fullsized":"2024-03-09T15:07:25.474480+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:25.474217+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:25.474217+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.474217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:13.689373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.013882+0000","last_change":"2024-03-09T15:07:49.013988+0000","last_active":"2024-03-09T15:07:49.013882+0000","last_peered":"2024-03-09T15:07:49.013882+0000","last_clean":"2024-03-09T15:07:49.013882+0000","last_became_active":"2024-03-09T14:49:53.676530+0000","last_became_peered":"2024-03-09T14:49:53.676530+0000","last_unstale":"2024-03-09T15:07:49.013882+0000","last_undegraded":"2024-03-09T15:07:49.013882+0000","last_fullsized":"2024-03-09T15:07:49.013882+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:49.013657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:49.013657+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.013657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:05:49.238949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:03.603096+0000","last_change":"2024-03-09T15:08:03.603159+0000","last_active":"2024-03-09T15:08:03.603096+0000","last_peered":"2024-03-09T15:08:03.603096+0000","last_clean":"2024-03-09T15:08:03.603096+0000","last_became_active":"2024-03-09T14:42:19.295218+0000","last_became_peered":"2024-03-09T14:42:19.295218+0000","last_unstale":"2024-03-09T15:08:03.603096+0000","last_undegraded":"2024-03-09T15:08:03.603096+0000","last_fullsized":"2024-03-09T15:08:03.603096+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:08:03.602882+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:08:03.602882+0000","last_clean_scrub_stamp":"2024-03-09T15:08:03.602882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:38:35.909562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":63,"num_write":4,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"261'2","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.753005+0000","last_change":"2024-03-09T15:07:10.753071+0000","last_active":"2024-03-09T15:07:10.753005+0000","last_peered":"2024-03-09T15:07:10.753005+0000","last_clean":"2024-03-09T15:07:10.753005+0000","last_became_active":"2024-03-09T14:42:15.958052+0000","last_became_peered":"2024-03-09T14:42:15.958052+0000","last_unstale":"2024-03-09T15:07:10.753005+0000","last_undegraded":"2024-03-09T15:07:10.753005+0000","last_fullsized":"2024-03-09T15:07:10.753005+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:07:10.752824+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:07:10.752824+0000","last_clean_scrub_stamp":"2024-03-09T15:07:10.752824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:38:40.918092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'67","reported_seq":215,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.601652+0000","last_change":"2024-03-09T15:07:14.601652+0000","last_active":"2024-03-09T15:07:14.601652+0000","last_peered":"2024-03-09T15:07:14.601652+0000","last_clean":"2024-03-09T15:07:14.601652+0000","last_became_active":"2024-03-09T14:39:57.890452+0000","last_became_peered":"2024-03-09T14:39:57.890452+0000","last_unstale":"2024-03-09T15:07:14.601652+0000","last_undegraded":"2024-03-09T15:07:14.601652+0000","last_fullsized":"2024-03-09T15:07:14.601652+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'67","last_scrub_stamp":"2024-03-09T15:07:14.601392+0000","last_deep_scrub":"264'67","last_deep_scrub_stamp":"2024-03-09T15:07:14.601392+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.601392+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:28:58.020853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":205,"num_write":124,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:49.979500+0000","last_change":"2024-03-09T14:49:53.669862+0000","last_active":"2024-03-09T15:06:49.979500+0000","last_peered":"2024-03-09T15:06:49.979500+0000","last_clean":"2024-03-09T15:06:49.979500+0000","last_became_active":"2024-03-09T14:49:53.669178+0000","last_became_peered":"2024-03-09T14:49:53.669178+0000","last_unstale":"2024-03-09T15:06:49.979500+0000","last_undegraded":"2024-03-09T15:06:49.979500+0000","last_fullsized":"2024-03-09T15:06:49.979500+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'6","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.015521+0000","last_change":"2024-03-09T15:07:43.015583+0000","last_active":"2024-03-09T15:07:43.015521+0000","last_peered":"2024-03-09T15:07:43.015521+0000","last_clean":"2024-03-09T15:07:43.015521+0000","last_became_active":"2024-03-09T14:42:19.294235+0000","last_became_peered":"2024-03-09T14:42:19.294235+0000","last_unstale":"2024-03-09T15:07:43.015521+0000","last_undegraded":"2024-03-09T15:07:43.015521+0000","last_fullsized":"2024-03-09T15:07:43.015521+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-03-09T15:07:43.015317+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-03-09T15:07:43.015317+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.015317+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:23:53.260315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:53.836398+0000","last_change":"2024-03-09T15:07:53.836455+0000","last_active":"2024-03-09T15:07:53.836398+0000","last_peered":"2024-03-09T15:07:53.836398+0000","last_clean":"2024-03-09T15:07:53.836398+0000","last_became_active":"2024-03-09T14:42:15.957974+0000","last_became_peered":"2024-03-09T14:42:15.957974+0000","last_unstale":"2024-03-09T15:07:53.836398+0000","last_undegraded":"2024-03-09T15:07:53.836398+0000","last_fullsized":"2024-03-09T15:07:53.836398+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:53.836198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:53.836198+0000","last_clean_scrub_stamp":"2024-03-09T15:07:53.836198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:53:35.661598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'35","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.986504+0000","last_change":"2024-03-09T15:07:15.986504+0000","last_active":"2024-03-09T15:07:15.986504+0000","last_peered":"2024-03-09T15:07:15.986504+0000","last_clean":"2024-03-09T15:07:15.986504+0000","last_became_active":"2024-03-09T14:39:57.909761+0000","last_became_peered":"2024-03-09T14:39:57.909761+0000","last_unstale":"2024-03-09T15:07:15.986504+0000","last_undegraded":"2024-03-09T15:07:15.986504+0000","last_fullsized":"2024-03-09T15:07:15.986504+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-03-09T15:07:15.986243+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-03-09T15:07:15.986243+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.986243+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:35:47.596327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":109,"num_write":58,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":22,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.811215+0000","last_change":"2024-03-09T14:49:53.678276+0000","last_active":"2024-03-09T15:07:10.811215+0000","last_peered":"2024-03-09T15:07:10.811215+0000","last_clean":"2024-03-09T15:07:10.811215+0000","last_became_active":"2024-03-09T14:49:53.676902+0000","last_became_peered":"2024-03-09T14:49:53.676902+0000","last_unstale":"2024-03-09T15:07:10.811215+0000","last_undegraded":"2024-03-09T15:07:10.811215+0000","last_fullsized":"2024-03-09T15:07:10.811215+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:54.614746+0000","last_change":"2024-03-09T15:07:54.614895+0000","last_active":"2024-03-09T15:07:54.614746+0000","last_peered":"2024-03-09T15:07:54.614746+0000","last_clean":"2024-03-09T15:07:54.614746+0000","last_became_active":"2024-03-09T14:42:19.006923+0000","last_became_peered":"2024-03-09T14:42:19.006923+0000","last_unstale":"2024-03-09T15:07:54.614746+0000","last_undegraded":"2024-03-09T15:07:54.614746+0000","last_fullsized":"2024-03-09T15:07:54.614746+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:54.614510+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:54.614510+0000","last_clean_scrub_stamp":"2024-03-09T15:07:54.614510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:17:02.782598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.638355+0000","last_change":"2024-03-09T15:07:23.638415+0000","last_active":"2024-03-09T15:07:23.638355+0000","last_peered":"2024-03-09T15:07:23.638355+0000","last_clean":"2024-03-09T15:07:23.638355+0000","last_became_active":"2024-03-09T14:42:15.971499+0000","last_became_peered":"2024-03-09T14:42:15.971499+0000","last_unstale":"2024-03-09T15:07:23.638355+0000","last_undegraded":"2024-03-09T15:07:23.638355+0000","last_fullsized":"2024-03-09T15:07:23.638355+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:23.638161+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:23.638161+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.638161+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:30:40.124428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'33","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.984015+0000","last_change":"2024-03-09T15:07:20.984015+0000","last_active":"2024-03-09T15:07:20.984015+0000","last_peered":"2024-03-09T15:07:20.984015+0000","last_clean":"2024-03-09T15:07:20.984015+0000","last_became_active":"2024-03-09T14:39:57.898849+0000","last_became_peered":"2024-03-09T14:39:57.898849+0000","last_unstale":"2024-03-09T15:07:20.984015+0000","last_undegraded":"2024-03-09T15:07:20.984015+0000","last_fullsized":"2024-03-09T15:07:20.984015+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-03-09T15:07:20.983762+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-03-09T15:07:20.983762+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.983762+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:55:54.652512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":100,"num_write":52,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.575680+0000","last_change":"2024-03-09T15:07:51.575734+0000","last_active":"2024-03-09T15:07:51.575680+0000","last_peered":"2024-03-09T15:07:51.575680+0000","last_clean":"2024-03-09T15:07:51.575680+0000","last_became_active":"2024-03-09T14:49:53.648332+0000","last_became_peered":"2024-03-09T14:49:53.648332+0000","last_unstale":"2024-03-09T15:07:51.575680+0000","last_undegraded":"2024-03-09T15:07:51.575680+0000","last_fullsized":"2024-03-09T15:07:51.575680+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:51.575477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:51.575477+0000","last_clean_scrub_stamp":"2024-03-09T15:07:51.575477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:18.458379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'6","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.051703+0000","last_change":"2024-03-09T15:07:46.051767+0000","last_active":"2024-03-09T15:07:46.051703+0000","last_peered":"2024-03-09T15:07:46.051703+0000","last_clean":"2024-03-09T15:07:46.051703+0000","last_became_active":"2024-03-09T14:42:19.003868+0000","last_became_peered":"2024-03-09T14:42:19.003868+0000","last_unstale":"2024-03-09T15:07:46.051703+0000","last_undegraded":"2024-03-09T15:07:46.051703+0000","last_fullsized":"2024-03-09T15:07:46.051703+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:46.051508+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:46.051508+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.051508+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:32:25.347512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.794551+0000","last_change":"2024-03-09T15:07:26.794615+0000","last_active":"2024-03-09T15:07:26.794551+0000","last_peered":"2024-03-09T15:07:26.794551+0000","last_clean":"2024-03-09T15:07:26.794551+0000","last_became_active":"2024-03-09T14:42:15.947888+0000","last_became_peered":"2024-03-09T14:42:15.947888+0000","last_unstale":"2024-03-09T15:07:26.794551+0000","last_undegraded":"2024-03-09T15:07:26.794551+0000","last_fullsized":"2024-03-09T15:07:26.794551+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:26.794359+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:26.794359+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.794359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:52:28.250795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'23","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.281807+0000","last_change":"2024-03-09T15:07:13.281807+0000","last_active":"2024-03-09T15:07:13.281807+0000","last_peered":"2024-03-09T15:07:13.281807+0000","last_clean":"2024-03-09T15:07:13.281807+0000","last_became_active":"2024-03-09T14:39:57.907530+0000","last_became_peered":"2024-03-09T14:39:57.907530+0000","last_unstale":"2024-03-09T15:07:13.281807+0000","last_undegraded":"2024-03-09T15:07:13.281807+0000","last_fullsized":"2024-03-09T15:07:13.281807+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-03-09T15:07:13.281542+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-03-09T15:07:13.281542+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.281542+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:47:39.457125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":69,"num_write":39,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:05.788200+0000","last_change":"2024-03-09T15:08:05.788263+0000","last_active":"2024-03-09T15:08:05.788200+0000","last_peered":"2024-03-09T15:08:05.788200+0000","last_clean":"2024-03-09T15:08:05.788200+0000","last_became_active":"2024-03-09T14:49:53.676976+0000","last_became_peered":"2024-03-09T14:49:53.676976+0000","last_unstale":"2024-03-09T15:08:05.788200+0000","last_undegraded":"2024-03-09T15:08:05.788200+0000","last_fullsized":"2024-03-09T15:08:05.788200+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:08:05.787980+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:08:05.787980+0000","last_clean_scrub_stamp":"2024-03-09T15:08:05.787980+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:27.664140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.028481+0000","last_change":"2024-03-09T15:07:47.028535+0000","last_active":"2024-03-09T15:07:47.028481+0000","last_peered":"2024-03-09T15:07:47.028481+0000","last_clean":"2024-03-09T15:07:47.028481+0000","last_became_active":"2024-03-09T14:42:19.008779+0000","last_became_peered":"2024-03-09T14:42:19.008779+0000","last_unstale":"2024-03-09T15:07:47.028481+0000","last_undegraded":"2024-03-09T15:07:47.028481+0000","last_fullsized":"2024-03-09T15:07:47.028481+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:47.028278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:47.028278+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.028278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:10:14.953446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'6","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.768833+0000","last_change":"2024-03-09T15:07:22.768898+0000","last_active":"2024-03-09T15:07:22.768833+0000","last_peered":"2024-03-09T15:07:22.768833+0000","last_clean":"2024-03-09T15:07:22.768833+0000","last_became_active":"2024-03-09T14:42:15.943177+0000","last_became_peered":"2024-03-09T14:42:15.943177+0000","last_unstale":"2024-03-09T15:07:22.768833+0000","last_undegraded":"2024-03-09T15:07:22.768833+0000","last_fullsized":"2024-03-09T15:07:22.768833+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:22.768655+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:22.768655+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.768655+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:13:44.014557+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'28","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.611668+0000","last_change":"2024-03-09T15:07:13.611732+0000","last_active":"2024-03-09T15:07:13.611668+0000","last_peered":"2024-03-09T15:07:13.611668+0000","last_clean":"2024-03-09T15:07:13.611668+0000","last_became_active":"2024-03-09T14:39:57.894343+0000","last_became_peered":"2024-03-09T14:39:57.894343+0000","last_unstale":"2024-03-09T15:07:13.611668+0000","last_undegraded":"2024-03-09T15:07:13.611668+0000","last_fullsized":"2024-03-09T15:07:13.611668+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-03-09T15:07:13.611465+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-03-09T15:07:13.611465+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.611465+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:20:23.924452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":82,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:04.796262+0000","last_change":"2024-03-09T15:08:04.796341+0000","last_active":"2024-03-09T15:08:04.796262+0000","last_peered":"2024-03-09T15:08:04.796262+0000","last_clean":"2024-03-09T15:08:04.796262+0000","last_became_active":"2024-03-09T14:49:53.666178+0000","last_became_peered":"2024-03-09T14:49:53.666178+0000","last_unstale":"2024-03-09T15:08:04.796262+0000","last_undegraded":"2024-03-09T15:08:04.796262+0000","last_fullsized":"2024-03-09T15:08:04.796262+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:04.796062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:04.796062+0000","last_clean_scrub_stamp":"2024-03-09T15:08:04.796062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:58.862813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.975264+0000","last_change":"2024-03-09T15:07:18.975264+0000","last_active":"2024-03-09T15:07:18.975264+0000","last_peered":"2024-03-09T15:07:18.975264+0000","last_clean":"2024-03-09T15:07:18.975264+0000","last_became_active":"2024-03-09T14:42:19.004684+0000","last_became_peered":"2024-03-09T14:42:19.004684+0000","last_unstale":"2024-03-09T15:07:18.975264+0000","last_undegraded":"2024-03-09T15:07:18.975264+0000","last_fullsized":"2024-03-09T15:07:18.975264+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:18.974984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:18.974984+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.974984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:41:00.527205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.624316+0000","last_change":"2024-03-09T15:07:19.624316+0000","last_active":"2024-03-09T15:07:19.624316+0000","last_peered":"2024-03-09T15:07:19.624316+0000","last_clean":"2024-03-09T15:07:19.624316+0000","last_became_active":"2024-03-09T14:42:15.972713+0000","last_became_peered":"2024-03-09T14:42:15.972713+0000","last_unstale":"2024-03-09T15:07:19.624316+0000","last_undegraded":"2024-03-09T15:07:19.624316+0000","last_fullsized":"2024-03-09T15:07:19.624316+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:19.624058+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:19.624058+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.624058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:28:05.245432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'37","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.004401+0000","last_change":"2024-03-09T15:07:14.004463+0000","last_active":"2024-03-09T15:07:14.004401+0000","last_peered":"2024-03-09T15:07:14.004401+0000","last_clean":"2024-03-09T15:07:14.004401+0000","last_became_active":"2024-03-09T14:39:57.869392+0000","last_became_peered":"2024-03-09T14:39:57.869392+0000","last_unstale":"2024-03-09T15:07:14.004401+0000","last_undegraded":"2024-03-09T15:07:14.004401+0000","last_fullsized":"2024-03-09T15:07:14.004401+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-03-09T15:07:14.004204+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-03-09T15:07:14.004204+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.004204+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:16:31.384571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":118,"num_write":73,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:50.571013+0000","last_change":"2024-03-09T15:07:50.571128+0000","last_active":"2024-03-09T15:07:50.571013+0000","last_peered":"2024-03-09T15:07:50.571013+0000","last_clean":"2024-03-09T15:07:50.571013+0000","last_became_active":"2024-03-09T14:49:53.651987+0000","last_became_peered":"2024-03-09T14:49:53.651987+0000","last_unstale":"2024-03-09T15:07:50.571013+0000","last_undegraded":"2024-03-09T15:07:50.571013+0000","last_fullsized":"2024-03-09T15:07:50.571013+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:50.570738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:50.570738+0000","last_clean_scrub_stamp":"2024-03-09T15:07:50.570738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:27:46.662438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.961311+0000","last_change":"2024-03-09T15:07:38.961370+0000","last_active":"2024-03-09T15:07:38.961311+0000","last_peered":"2024-03-09T15:07:38.961311+0000","last_clean":"2024-03-09T15:07:38.961311+0000","last_became_active":"2024-03-09T14:42:19.294108+0000","last_became_peered":"2024-03-09T14:42:19.294108+0000","last_unstale":"2024-03-09T15:07:38.961311+0000","last_undegraded":"2024-03-09T15:07:38.961311+0000","last_fullsized":"2024-03-09T15:07:38.961311+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:38.961118+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:38.961118+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.961118+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:08:36.096432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.453408+0000","last_change":"2024-03-09T15:07:21.453408+0000","last_active":"2024-03-09T15:07:21.453408+0000","last_peered":"2024-03-09T15:07:21.453408+0000","last_clean":"2024-03-09T15:07:21.453408+0000","last_became_active":"2024-03-09T14:42:15.947591+0000","last_became_peered":"2024-03-09T14:42:15.947591+0000","last_unstale":"2024-03-09T15:07:21.453408+0000","last_undegraded":"2024-03-09T15:07:21.453408+0000","last_fullsized":"2024-03-09T15:07:21.453408+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:21.453160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:21.453160+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.453160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:19:14.273952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'56","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.641889+0000","last_change":"2024-03-09T15:07:12.641912+0000","last_active":"2024-03-09T15:07:12.641889+0000","last_peered":"2024-03-09T15:07:12.641889+0000","last_clean":"2024-03-09T15:07:12.641889+0000","last_became_active":"2024-03-09T14:39:57.894370+0000","last_became_peered":"2024-03-09T14:39:57.894370+0000","last_unstale":"2024-03-09T15:07:12.641889+0000","last_undegraded":"2024-03-09T15:07:12.641889+0000","last_fullsized":"2024-03-09T15:07:12.641889+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'56","last_scrub_stamp":"2024-03-09T15:07:12.641818+0000","last_deep_scrub":"264'56","last_deep_scrub_stamp":"2024-03-09T15:07:12.641818+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.641818+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:59:17.273282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":182,"num_write":87,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.558058+0000","last_change":"2024-03-09T15:07:40.558197+0000","last_active":"2024-03-09T15:07:40.558058+0000","last_peered":"2024-03-09T15:07:40.558058+0000","last_clean":"2024-03-09T15:07:40.558058+0000","last_became_active":"2024-03-09T14:49:53.660291+0000","last_became_peered":"2024-03-09T14:49:53.660291+0000","last_unstale":"2024-03-09T15:07:40.558058+0000","last_undegraded":"2024-03-09T15:07:40.558058+0000","last_fullsized":"2024-03-09T15:07:40.558058+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:40.557831+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:40.557831+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.557831+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:16:49.067897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"261'5","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.810833+0000","last_change":"2024-03-09T14:42:19.299865+0000","last_active":"2024-03-09T15:07:10.810833+0000","last_peered":"2024-03-09T15:07:10.810833+0000","last_clean":"2024-03-09T15:07:10.810833+0000","last_became_active":"2024-03-09T14:42:19.294391+0000","last_became_peered":"2024-03-09T14:42:19.294391+0000","last_unstale":"2024-03-09T15:07:10.810833+0000","last_undegraded":"2024-03-09T15:07:10.810833+0000","last_fullsized":"2024-03-09T15:07:10.810833+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.885508+0000","last_change":"2024-03-09T15:07:15.885570+0000","last_active":"2024-03-09T15:07:15.885508+0000","last_peered":"2024-03-09T15:07:15.885508+0000","last_clean":"2024-03-09T15:07:15.885508+0000","last_became_active":"2024-03-09T14:42:15.961751+0000","last_became_peered":"2024-03-09T14:42:15.961751+0000","last_unstale":"2024-03-09T15:07:15.885508+0000","last_undegraded":"2024-03-09T15:07:15.885508+0000","last_fullsized":"2024-03-09T15:07:15.885508+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:07:15.885308+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:07:15.885308+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.885308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:17.771916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'41","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.989966+0000","last_change":"2024-03-09T15:07:19.990026+0000","last_active":"2024-03-09T15:07:19.989966+0000","last_peered":"2024-03-09T15:07:19.989966+0000","last_clean":"2024-03-09T15:07:19.989966+0000","last_became_active":"2024-03-09T14:39:57.898651+0000","last_became_peered":"2024-03-09T14:39:57.898651+0000","last_unstale":"2024-03-09T15:07:19.989966+0000","last_undegraded":"2024-03-09T15:07:19.989966+0000","last_fullsized":"2024-03-09T15:07:19.989966+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-03-09T15:07:19.989775+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-03-09T15:07:19.989775+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.989775+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:09:21.062799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":141,"num_write":58,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.817958+0000","last_change":"2024-03-09T15:08:06.818017+0000","last_active":"2024-03-09T15:08:06.817958+0000","last_peered":"2024-03-09T15:08:06.817958+0000","last_clean":"2024-03-09T15:08:06.817958+0000","last_became_active":"2024-03-09T14:49:53.677160+0000","last_became_peered":"2024-03-09T14:49:53.677160+0000","last_unstale":"2024-03-09T15:08:06.817958+0000","last_undegraded":"2024-03-09T15:08:06.817958+0000","last_fullsized":"2024-03-09T15:08:06.817958+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:06.817739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:06.817739+0000","last_clean_scrub_stamp":"2024-03-09T15:08:06.817739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:12:06.766396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:29.975218+0000","last_change":"2024-03-09T14:42:19.298779+0000","last_active":"2024-03-09T15:06:29.975218+0000","last_peered":"2024-03-09T15:06:29.975218+0000","last_clean":"2024-03-09T15:06:29.975218+0000","last_became_active":"2024-03-09T14:42:19.297984+0000","last_became_peered":"2024-03-09T14:42:19.297984+0000","last_unstale":"2024-03-09T15:06:29.975218+0000","last_undegraded":"2024-03-09T15:06:29.975218+0000","last_fullsized":"2024-03-09T15:06:29.975218+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:42:17.960960+0000","last_clean_scrub_stamp":"2024-03-09T14:42:17.960960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.589530+0000","last_change":"2024-03-09T15:07:36.589592+0000","last_active":"2024-03-09T15:07:36.589530+0000","last_peered":"2024-03-09T15:07:36.589530+0000","last_clean":"2024-03-09T15:07:36.589530+0000","last_became_active":"2024-03-09T14:42:15.958476+0000","last_became_peered":"2024-03-09T14:42:15.958476+0000","last_unstale":"2024-03-09T15:07:36.589530+0000","last_undegraded":"2024-03-09T15:07:36.589530+0000","last_fullsized":"2024-03-09T15:07:36.589530+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:36.589303+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:36.589303+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.589303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:11:36.067313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'112","reported_seq":384,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.534327+0000","last_change":"2024-03-09T15:07:23.534450+0000","last_active":"2024-03-09T15:07:23.534327+0000","last_peered":"2024-03-09T15:07:23.534327+0000","last_clean":"2024-03-09T15:07:23.534327+0000","last_became_active":"2024-03-09T14:39:57.872922+0000","last_became_peered":"2024-03-09T14:39:57.872922+0000","last_unstale":"2024-03-09T15:07:23.534327+0000","last_undegraded":"2024-03-09T15:07:23.534327+0000","last_fullsized":"2024-03-09T15:07:23.534327+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-03-09T15:07:23.534072+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-03-09T15:07:23.534072+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.534072+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:12:24.305321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":634,"num_read_kb":458,"num_write":138,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2790,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.628753+0000","last_change":"2024-03-09T15:07:56.628807+0000","last_active":"2024-03-09T15:07:56.628753+0000","last_peered":"2024-03-09T15:07:56.628753+0000","last_clean":"2024-03-09T15:07:56.628753+0000","last_became_active":"2024-03-09T14:49:53.651353+0000","last_became_peered":"2024-03-09T14:49:53.651353+0000","last_unstale":"2024-03-09T15:07:56.628753+0000","last_undegraded":"2024-03-09T15:07:56.628753+0000","last_fullsized":"2024-03-09T15:07:56.628753+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:56.628557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:56.628557+0000","last_clean_scrub_stamp":"2024-03-09T15:07:56.628557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:56:12.794658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"264'6","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:54.806040+0000","last_change":"2024-03-09T15:07:54.806113+0000","last_active":"2024-03-09T15:07:54.806040+0000","last_peered":"2024-03-09T15:07:54.806040+0000","last_clean":"2024-03-09T15:07:54.806040+0000","last_became_active":"2024-03-09T14:42:19.011213+0000","last_became_peered":"2024-03-09T14:42:19.011213+0000","last_unstale":"2024-03-09T15:07:54.806040+0000","last_undegraded":"2024-03-09T15:07:54.806040+0000","last_fullsized":"2024-03-09T15:07:54.806040+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:54.805844+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:54.805844+0000","last_clean_scrub_stamp":"2024-03-09T15:07:54.805844+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:36:57.733045+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.761253+0000","last_change":"2024-03-09T15:07:31.761371+0000","last_active":"2024-03-09T15:07:31.761253+0000","last_peered":"2024-03-09T15:07:31.761253+0000","last_clean":"2024-03-09T15:07:31.761253+0000","last_became_active":"2024-03-09T14:42:15.974300+0000","last_became_peered":"2024-03-09T14:42:15.974300+0000","last_unstale":"2024-03-09T15:07:31.761253+0000","last_undegraded":"2024-03-09T15:07:31.761253+0000","last_fullsized":"2024-03-09T15:07:31.761253+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:31.760972+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:31.760972+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.760972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:56.025111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'10","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.953816+0000","last_change":"2024-03-09T15:07:20.953816+0000","last_active":"2024-03-09T15:07:20.953816+0000","last_peered":"2024-03-09T15:07:20.953816+0000","last_clean":"2024-03-09T15:07:20.953816+0000","last_became_active":"2024-03-09T14:39:57.905161+0000","last_became_peered":"2024-03-09T14:39:57.905161+0000","last_unstale":"2024-03-09T15:07:20.953816+0000","last_undegraded":"2024-03-09T15:07:20.953816+0000","last_fullsized":"2024-03-09T15:07:20.953816+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-03-09T15:07:20.953411+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-03-09T15:07:20.953411+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.953411+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:35:23.607004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:49.979711+0000","last_change":"2024-03-09T14:49:53.677779+0000","last_active":"2024-03-09T15:06:49.979711+0000","last_peered":"2024-03-09T15:06:49.979711+0000","last_clean":"2024-03-09T15:06:49.979711+0000","last_became_active":"2024-03-09T14:49:53.676180+0000","last_became_peered":"2024-03-09T14:49:53.676180+0000","last_unstale":"2024-03-09T15:06:49.979711+0000","last_undegraded":"2024-03-09T15:06:49.979711+0000","last_fullsized":"2024-03-09T15:06:49.979711+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'16","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.574709+0000","last_change":"2024-03-09T15:07:48.574709+0000","last_active":"2024-03-09T15:07:48.574709+0000","last_peered":"2024-03-09T15:07:48.574709+0000","last_clean":"2024-03-09T15:07:48.574709+0000","last_became_active":"2024-03-09T14:42:19.015001+0000","last_became_peered":"2024-03-09T14:42:19.015001+0000","last_unstale":"2024-03-09T15:07:48.574709+0000","last_undegraded":"2024-03-09T15:07:48.574709+0000","last_fullsized":"2024-03-09T15:07:48.574709+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-03-09T15:07:48.574446+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-03-09T15:07:48.574446+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.574446+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:43:43.889282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":18444,"num_write":29,"num_write_kb":15365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'9","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.826689+0000","last_change":"2024-03-09T15:07:14.826689+0000","last_active":"2024-03-09T15:07:14.826689+0000","last_peered":"2024-03-09T15:07:14.826689+0000","last_clean":"2024-03-09T15:07:14.826689+0000","last_became_active":"2024-03-09T14:42:15.936690+0000","last_became_peered":"2024-03-09T14:42:15.936690+0000","last_unstale":"2024-03-09T15:07:14.826689+0000","last_undegraded":"2024-03-09T15:07:14.826689+0000","last_fullsized":"2024-03-09T15:07:14.826689+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-03-09T15:07:14.826428+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-03-09T15:07:14.826428+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.826428+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:10:49.901286+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'45","reported_seq":164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.923011+0000","last_change":"2024-03-09T15:07:23.923011+0000","last_active":"2024-03-09T15:07:23.923011+0000","last_peered":"2024-03-09T15:07:23.923011+0000","last_clean":"2024-03-09T15:07:23.923011+0000","last_became_active":"2024-03-09T14:39:57.900112+0000","last_became_peered":"2024-03-09T14:39:57.900112+0000","last_unstale":"2024-03-09T15:07:23.923011+0000","last_undegraded":"2024-03-09T15:07:23.923011+0000","last_fullsized":"2024-03-09T15:07:23.923011+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-03-09T15:07:23.922739+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-03-09T15:07:23.922739+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.922739+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:54:20.010708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":133,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:07.690792+0000","last_change":"2024-03-09T15:08:07.690847+0000","last_active":"2024-03-09T15:08:07.690792+0000","last_peered":"2024-03-09T15:08:07.690792+0000","last_clean":"2024-03-09T15:08:07.690792+0000","last_became_active":"2024-03-09T14:49:53.683189+0000","last_became_peered":"2024-03-09T14:49:53.683189+0000","last_unstale":"2024-03-09T15:08:07.690792+0000","last_undegraded":"2024-03-09T15:08:07.690792+0000","last_fullsized":"2024-03-09T15:08:07.690792+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:07.690596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:07.690596+0000","last_clean_scrub_stamp":"2024-03-09T15:08:07.690596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:40:57.377757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.589711+0000","last_change":"2024-03-09T15:07:47.589711+0000","last_active":"2024-03-09T15:07:47.589711+0000","last_peered":"2024-03-09T15:07:47.589711+0000","last_clean":"2024-03-09T15:07:47.589711+0000","last_became_active":"2024-03-09T14:42:19.009159+0000","last_became_peered":"2024-03-09T14:42:19.009159+0000","last_unstale":"2024-03-09T15:07:47.589711+0000","last_undegraded":"2024-03-09T15:07:47.589711+0000","last_fullsized":"2024-03-09T15:07:47.589711+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:47.589448+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:47.589448+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.589448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:13:12.302460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'12","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.993120+0000","last_change":"2024-03-09T15:07:14.993120+0000","last_active":"2024-03-09T15:07:14.993120+0000","last_peered":"2024-03-09T15:07:14.993120+0000","last_clean":"2024-03-09T15:07:14.993120+0000","last_became_active":"2024-03-09T14:42:15.953580+0000","last_became_peered":"2024-03-09T14:42:15.953580+0000","last_unstale":"2024-03-09T15:07:14.993120+0000","last_undegraded":"2024-03-09T15:07:14.993120+0000","last_fullsized":"2024-03-09T15:07:14.993120+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-03-09T15:07:14.992761+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-03-09T15:07:14.992761+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.992761+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:19:32.196578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":25600,"num_write":27,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'39","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.687519+0000","last_change":"2024-03-09T15:07:10.687519+0000","last_active":"2024-03-09T15:07:10.687519+0000","last_peered":"2024-03-09T15:07:10.687519+0000","last_clean":"2024-03-09T15:07:10.687519+0000","last_became_active":"2024-03-09T14:39:57.896549+0000","last_became_peered":"2024-03-09T14:39:57.896549+0000","last_unstale":"2024-03-09T15:07:10.687519+0000","last_undegraded":"2024-03-09T15:07:10.687519+0000","last_fullsized":"2024-03-09T15:07:10.687519+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-03-09T15:07:10.687377+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-03-09T15:07:10.687377+0000","last_clean_scrub_stamp":"2024-03-09T15:07:10.687377+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:37.398766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":110,"num_write":67,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:04.640763+0000","last_change":"2024-03-09T15:08:04.640849+0000","last_active":"2024-03-09T15:08:04.640763+0000","last_peered":"2024-03-09T15:08:04.640763+0000","last_clean":"2024-03-09T15:08:04.640763+0000","last_became_active":"2024-03-09T14:49:53.673345+0000","last_became_peered":"2024-03-09T14:49:53.673345+0000","last_unstale":"2024-03-09T15:08:04.640763+0000","last_undegraded":"2024-03-09T15:08:04.640763+0000","last_fullsized":"2024-03-09T15:08:04.640763+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:08:04.640569+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:08:04.640569+0000","last_clean_scrub_stamp":"2024-03-09T15:08:04.640569+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:28:57.286313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.919863+0000","last_change":"2024-03-09T15:07:34.919863+0000","last_active":"2024-03-09T15:07:34.919863+0000","last_peered":"2024-03-09T15:07:34.919863+0000","last_clean":"2024-03-09T15:07:34.919863+0000","last_became_active":"2024-03-09T14:42:19.020650+0000","last_became_peered":"2024-03-09T14:42:19.020650+0000","last_unstale":"2024-03-09T15:07:34.919863+0000","last_undegraded":"2024-03-09T15:07:34.919863+0000","last_fullsized":"2024-03-09T15:07:34.919863+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:34.919605+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:34.919605+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.919605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:46:15.256187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.232318+0000","last_change":"2024-03-09T15:07:17.232318+0000","last_active":"2024-03-09T15:07:17.232318+0000","last_peered":"2024-03-09T15:07:17.232318+0000","last_clean":"2024-03-09T15:07:17.232318+0000","last_became_active":"2024-03-09T14:42:15.958276+0000","last_became_peered":"2024-03-09T14:42:15.958276+0000","last_unstale":"2024-03-09T15:07:17.232318+0000","last_undegraded":"2024-03-09T15:07:17.232318+0000","last_fullsized":"2024-03-09T15:07:17.232318+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:17.232075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:17.232075+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.232075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:59:22.106180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'35","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.832292+0000","last_change":"2024-03-09T15:07:12.832292+0000","last_active":"2024-03-09T15:07:12.832292+0000","last_peered":"2024-03-09T15:07:12.832292+0000","last_clean":"2024-03-09T15:07:12.832292+0000","last_became_active":"2024-03-09T14:39:57.891706+0000","last_became_peered":"2024-03-09T14:39:57.891706+0000","last_unstale":"2024-03-09T15:07:12.832292+0000","last_undegraded":"2024-03-09T15:07:12.832292+0000","last_fullsized":"2024-03-09T15:07:12.832292+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-03-09T15:07:12.832019+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-03-09T15:07:12.832019+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.832019+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:50:16.384247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":98,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:06:49.979658+0000","last_change":"2024-03-09T14:49:53.678730+0000","last_active":"2024-03-09T15:06:49.979658+0000","last_peered":"2024-03-09T15:06:49.979658+0000","last_clean":"2024-03-09T15:06:49.979658+0000","last_became_active":"2024-03-09T14:49:53.670121+0000","last_became_peered":"2024-03-09T14:49:53.670121+0000","last_unstale":"2024-03-09T15:06:49.979658+0000","last_undegraded":"2024-03-09T15:06:49.979658+0000","last_fullsized":"2024-03-09T15:06:49.979658+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.092997+0000","last_change":"2024-03-09T15:07:45.092997+0000","last_active":"2024-03-09T15:07:45.092997+0000","last_peered":"2024-03-09T15:07:45.092997+0000","last_clean":"2024-03-09T15:07:45.092997+0000","last_became_active":"2024-03-09T14:42:18.992996+0000","last_became_peered":"2024-03-09T14:42:18.992996+0000","last_unstale":"2024-03-09T15:07:45.092997+0000","last_undegraded":"2024-03-09T15:07:45.092997+0000","last_fullsized":"2024-03-09T15:07:45.092997+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:45.092754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:45.092754+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.092754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:48:28.791963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"261'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.485241+0000","last_change":"2024-03-09T15:07:25.485241+0000","last_active":"2024-03-09T15:07:25.485241+0000","last_peered":"2024-03-09T15:07:25.485241+0000","last_clean":"2024-03-09T15:07:25.485241+0000","last_became_active":"2024-03-09T14:42:15.950001+0000","last_became_peered":"2024-03-09T14:42:15.950001+0000","last_unstale":"2024-03-09T15:07:25.485241+0000","last_undegraded":"2024-03-09T15:07:25.485241+0000","last_fullsized":"2024-03-09T15:07:25.485241+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:25.484949+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:25.484949+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.484949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:42.285163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'55","reported_seq":178,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.041637+0000","last_change":"2024-03-09T15:07:14.041637+0000","last_active":"2024-03-09T15:07:14.041637+0000","last_peered":"2024-03-09T15:07:14.041637+0000","last_clean":"2024-03-09T15:07:14.041637+0000","last_became_active":"2024-03-09T14:39:57.909827+0000","last_became_peered":"2024-03-09T14:39:57.909827+0000","last_unstale":"2024-03-09T15:07:14.041637+0000","last_undegraded":"2024-03-09T15:07:14.041637+0000","last_fullsized":"2024-03-09T15:07:14.041637+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'55","last_scrub_stamp":"2024-03-09T15:07:14.041251+0000","last_deep_scrub":"264'55","last_deep_scrub_stamp":"2024-03-09T15:07:14.041251+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.041251+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:44:17.414317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":147,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.566069+0000","last_change":"2024-03-09T15:07:39.566127+0000","last_active":"2024-03-09T15:07:39.566069+0000","last_peered":"2024-03-09T15:07:39.566069+0000","last_clean":"2024-03-09T15:07:39.566069+0000","last_became_active":"2024-03-09T14:49:53.641152+0000","last_became_peered":"2024-03-09T14:49:53.641152+0000","last_unstale":"2024-03-09T15:07:39.566069+0000","last_undegraded":"2024-03-09T15:07:39.566069+0000","last_fullsized":"2024-03-09T15:07:39.566069+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:39.565858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:39.565858+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.565858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:11:49.699057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.014761+0000","last_change":"2024-03-09T15:07:23.014822+0000","last_active":"2024-03-09T15:07:23.014761+0000","last_peered":"2024-03-09T15:07:23.014761+0000","last_clean":"2024-03-09T15:07:23.014761+0000","last_became_active":"2024-03-09T14:42:19.013356+0000","last_became_peered":"2024-03-09T14:42:19.013356+0000","last_unstale":"2024-03-09T15:07:23.014761+0000","last_undegraded":"2024-03-09T15:07:23.014761+0000","last_fullsized":"2024-03-09T15:07:23.014761+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:07:23.014568+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:07:23.014568+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.014568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:32:57.682164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.863792+0000","last_change":"2024-03-09T15:07:12.863850+0000","last_active":"2024-03-09T15:07:12.863792+0000","last_peered":"2024-03-09T15:07:12.863792+0000","last_clean":"2024-03-09T15:07:12.863792+0000","last_became_active":"2024-03-09T14:42:15.964591+0000","last_became_peered":"2024-03-09T14:42:15.964591+0000","last_unstale":"2024-03-09T15:07:12.863792+0000","last_undegraded":"2024-03-09T15:07:12.863792+0000","last_fullsized":"2024-03-09T15:07:12.863792+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:12.863592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:12.863592+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.863592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:43:17.329732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'15","reported_seq":93,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.946943+0000","last_change":"2024-03-09T15:07:16.947005+0000","last_active":"2024-03-09T15:07:16.946943+0000","last_peered":"2024-03-09T15:07:16.946943+0000","last_clean":"2024-03-09T15:07:16.946943+0000","last_became_active":"2024-03-09T14:39:57.898952+0000","last_became_peered":"2024-03-09T14:39:57.898952+0000","last_unstale":"2024-03-09T15:07:16.946943+0000","last_undegraded":"2024-03-09T15:07:16.946943+0000","last_fullsized":"2024-03-09T15:07:16.946943+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'15","last_scrub_stamp":"2024-03-09T15:07:16.946726+0000","last_deep_scrub":"264'15","last_deep_scrub_stamp":"2024-03-09T15:07:16.946726+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.946726+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:32.769206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":52,"num_write":21,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.026757+0000","last_change":"2024-03-09T15:07:31.026757+0000","last_active":"2024-03-09T15:07:31.026757+0000","last_peered":"2024-03-09T15:07:31.026757+0000","last_clean":"2024-03-09T15:07:31.026757+0000","last_became_active":"2024-03-09T14:49:53.653943+0000","last_became_peered":"2024-03-09T14:49:53.653943+0000","last_unstale":"2024-03-09T15:07:31.026757+0000","last_undegraded":"2024-03-09T15:07:31.026757+0000","last_fullsized":"2024-03-09T15:07:31.026757+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:31.026484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:31.026484+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.026484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:58.692908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.975883+0000","last_change":"2024-03-09T15:07:26.975946+0000","last_active":"2024-03-09T15:07:26.975883+0000","last_peered":"2024-03-09T15:07:26.975883+0000","last_clean":"2024-03-09T15:07:26.975883+0000","last_became_active":"2024-03-09T14:42:19.008729+0000","last_became_peered":"2024-03-09T14:42:19.008729+0000","last_unstale":"2024-03-09T15:07:26.975883+0000","last_undegraded":"2024-03-09T15:07:26.975883+0000","last_fullsized":"2024-03-09T15:07:26.975883+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:26.975688+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:26.975688+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.975688+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:22:03.596581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.538842+0000","last_change":"2024-03-09T15:07:38.538897+0000","last_active":"2024-03-09T15:07:38.538842+0000","last_peered":"2024-03-09T15:07:38.538842+0000","last_clean":"2024-03-09T15:07:38.538842+0000","last_became_active":"2024-03-09T14:42:15.978166+0000","last_became_peered":"2024-03-09T14:42:15.978166+0000","last_unstale":"2024-03-09T15:07:38.538842+0000","last_undegraded":"2024-03-09T15:07:38.538842+0000","last_fullsized":"2024-03-09T15:07:38.538842+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:38.538641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:38.538641+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.538641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:15:02.484560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'46","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.531125+0000","last_change":"2024-03-09T15:07:17.531186+0000","last_active":"2024-03-09T15:07:17.531125+0000","last_peered":"2024-03-09T15:07:17.531125+0000","last_clean":"2024-03-09T15:07:17.531125+0000","last_became_active":"2024-03-09T14:39:57.904012+0000","last_became_peered":"2024-03-09T14:39:57.904012+0000","last_unstale":"2024-03-09T15:07:17.531125+0000","last_undegraded":"2024-03-09T15:07:17.531125+0000","last_fullsized":"2024-03-09T15:07:17.531125+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'46","last_scrub_stamp":"2024-03-09T15:07:17.530930+0000","last_deep_scrub":"264'46","last_deep_scrub_stamp":"2024-03-09T15:07:17.530930+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.530930+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:03:28.425445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":131,"num_write":86,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.993104+0000","last_change":"2024-03-09T15:07:49.993157+0000","last_active":"2024-03-09T15:07:49.993104+0000","last_peered":"2024-03-09T15:07:49.993104+0000","last_clean":"2024-03-09T15:07:49.993104+0000","last_became_active":"2024-03-09T14:49:53.678157+0000","last_became_peered":"2024-03-09T14:49:53.678157+0000","last_unstale":"2024-03-09T15:07:49.993104+0000","last_undegraded":"2024-03-09T15:07:49.993104+0000","last_fullsized":"2024-03-09T15:07:49.993104+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:49.992886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:49.992886+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.992886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:52:39.799702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.548576+0000","last_change":"2024-03-09T15:07:49.548630+0000","last_active":"2024-03-09T15:07:49.548576+0000","last_peered":"2024-03-09T15:07:49.548576+0000","last_clean":"2024-03-09T15:07:49.548576+0000","last_became_active":"2024-03-09T14:42:19.295533+0000","last_became_peered":"2024-03-09T14:42:19.295533+0000","last_unstale":"2024-03-09T15:07:49.548576+0000","last_undegraded":"2024-03-09T15:07:49.548576+0000","last_fullsized":"2024-03-09T15:07:49.548576+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:49.548387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:49.548387+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.548387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:11:17.213530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"261'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.565280+0000","last_change":"2024-03-09T15:07:15.565345+0000","last_active":"2024-03-09T15:07:15.565280+0000","last_peered":"2024-03-09T15:07:15.565280+0000","last_clean":"2024-03-09T15:07:15.565280+0000","last_became_active":"2024-03-09T14:42:15.968323+0000","last_became_peered":"2024-03-09T14:42:15.968323+0000","last_unstale":"2024-03-09T15:07:15.565280+0000","last_undegraded":"2024-03-09T15:07:15.565280+0000","last_fullsized":"2024-03-09T15:07:15.565280+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-03-09T15:07:15.565071+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-03-09T15:07:15.565071+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.565071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:55:13.724228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'40","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.239744+0000","last_change":"2024-03-09T15:07:15.239878+0000","last_active":"2024-03-09T15:07:15.239744+0000","last_peered":"2024-03-09T15:07:15.239744+0000","last_clean":"2024-03-09T15:07:15.239744+0000","last_became_active":"2024-03-09T14:39:57.898234+0000","last_became_peered":"2024-03-09T14:39:57.898234+0000","last_unstale":"2024-03-09T15:07:15.239744+0000","last_undegraded":"2024-03-09T15:07:15.239744+0000","last_fullsized":"2024-03-09T15:07:15.239744+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-03-09T15:07:15.239453+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-03-09T15:07:15.239453+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.239453+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:16.397508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":111,"num_write":71,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.018870+0000","last_change":"2024-03-09T15:07:35.018930+0000","last_active":"2024-03-09T15:07:35.018870+0000","last_peered":"2024-03-09T15:07:35.018870+0000","last_clean":"2024-03-09T15:07:35.018870+0000","last_became_active":"2024-03-09T14:49:53.662812+0000","last_became_peered":"2024-03-09T14:49:53.662812+0000","last_unstale":"2024-03-09T15:07:35.018870+0000","last_undegraded":"2024-03-09T15:07:35.018870+0000","last_fullsized":"2024-03-09T15:07:35.018870+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.018672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.018672+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.018672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:49:46.866451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'7","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.984757+0000","last_change":"2024-03-09T15:07:30.984820+0000","last_active":"2024-03-09T15:07:30.984757+0000","last_peered":"2024-03-09T15:07:30.984757+0000","last_clean":"2024-03-09T15:07:30.984757+0000","last_became_active":"2024-03-09T14:42:19.017434+0000","last_became_peered":"2024-03-09T14:42:19.017434+0000","last_unstale":"2024-03-09T15:07:30.984757+0000","last_undegraded":"2024-03-09T15:07:30.984757+0000","last_fullsized":"2024-03-09T15:07:30.984757+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-03-09T15:07:30.984571+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-03-09T15:07:30.984571+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.984571+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:06:03.083175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8272,"num_write":12,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.908491+0000","last_change":"2024-03-09T15:07:10.908536+0000","last_active":"2024-03-09T15:07:10.908491+0000","last_peered":"2024-03-09T15:07:10.908491+0000","last_clean":"2024-03-09T15:07:10.908491+0000","last_became_active":"2024-03-09T14:42:15.945565+0000","last_became_peered":"2024-03-09T14:42:15.945565+0000","last_unstale":"2024-03-09T15:07:10.908491+0000","last_undegraded":"2024-03-09T15:07:10.908491+0000","last_fullsized":"2024-03-09T15:07:10.908491+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:07:10.908404+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:07:10.908404+0000","last_clean_scrub_stamp":"2024-03-09T15:07:10.908404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:19.761717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1029,"num_write":10,"num_write_kb":1029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'55","reported_seq":184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.571140+0000","last_change":"2024-03-09T15:07:35.571202+0000","last_active":"2024-03-09T15:07:35.571140+0000","last_peered":"2024-03-09T15:07:35.571140+0000","last_clean":"2024-03-09T15:07:35.571140+0000","last_became_active":"2024-03-09T14:39:57.900659+0000","last_became_peered":"2024-03-09T14:39:57.900659+0000","last_unstale":"2024-03-09T15:07:35.571140+0000","last_undegraded":"2024-03-09T15:07:35.571140+0000","last_fullsized":"2024-03-09T15:07:35.571140+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'55","last_scrub_stamp":"2024-03-09T15:07:35.570944+0000","last_deep_scrub":"264'55","last_deep_scrub_stamp":"2024-03-09T15:07:35.570944+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.570944+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:53:47.902666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":161,"num_write":89,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.811069+0000","last_change":"2024-03-09T14:49:53.683045+0000","last_active":"2024-03-09T15:07:10.811069+0000","last_peered":"2024-03-09T15:07:10.811069+0000","last_clean":"2024-03-09T15:07:10.811069+0000","last_became_active":"2024-03-09T14:49:53.678822+0000","last_became_peered":"2024-03-09T14:49:53.678822+0000","last_unstale":"2024-03-09T15:07:10.811069+0000","last_undegraded":"2024-03-09T15:07:10.811069+0000","last_fullsized":"2024-03-09T15:07:10.811069+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T14:49:52.610299+0000","last_clean_scrub_stamp":"2024-03-09T14:49:52.610299+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:57.760812+0000","last_change":"2024-03-09T15:07:57.760875+0000","last_active":"2024-03-09T15:07:57.760812+0000","last_peered":"2024-03-09T15:07:57.760812+0000","last_clean":"2024-03-09T15:07:57.760812+0000","last_became_active":"2024-03-09T14:42:19.016262+0000","last_became_peered":"2024-03-09T14:42:19.016262+0000","last_unstale":"2024-03-09T15:07:57.760812+0000","last_undegraded":"2024-03-09T15:07:57.760812+0000","last_fullsized":"2024-03-09T15:07:57.760812+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:57.760618+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:57.760618+0000","last_clean_scrub_stamp":"2024-03-09T15:07:57.760618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:14.671953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.649801+0000","last_change":"2024-03-09T15:07:11.649832+0000","last_active":"2024-03-09T15:07:11.649801+0000","last_peered":"2024-03-09T15:07:11.649801+0000","last_clean":"2024-03-09T15:07:11.649801+0000","last_became_active":"2024-03-09T14:42:15.963496+0000","last_became_peered":"2024-03-09T14:42:15.963496+0000","last_unstale":"2024-03-09T15:07:11.649801+0000","last_undegraded":"2024-03-09T15:07:11.649801+0000","last_fullsized":"2024-03-09T15:07:11.649801+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:11.649700+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:11.649700+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.649700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:54:34.580055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'33","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.595715+0000","last_change":"2024-03-09T15:07:17.595774+0000","last_active":"2024-03-09T15:07:17.595715+0000","last_peered":"2024-03-09T15:07:17.595715+0000","last_clean":"2024-03-09T15:07:17.595715+0000","last_became_active":"2024-03-09T14:39:57.879068+0000","last_became_peered":"2024-03-09T14:39:57.879068+0000","last_unstale":"2024-03-09T15:07:17.595715+0000","last_undegraded":"2024-03-09T15:07:17.595715+0000","last_fullsized":"2024-03-09T15:07:17.595715+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-03-09T15:07:17.595518+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-03-09T15:07:17.595518+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.595518+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:22:14.173013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":89,"num_write":57,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:02.811957+0000","last_change":"2024-03-09T15:08:02.812009+0000","last_active":"2024-03-09T15:08:02.811957+0000","last_peered":"2024-03-09T15:08:02.811957+0000","last_clean":"2024-03-09T15:08:02.811957+0000","last_became_active":"2024-03-09T14:49:53.666088+0000","last_became_peered":"2024-03-09T14:49:53.666088+0000","last_unstale":"2024-03-09T15:08:02.811957+0000","last_undegraded":"2024-03-09T15:08:02.811957+0000","last_fullsized":"2024-03-09T15:08:02.811957+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:02.811762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:02.811762+0000","last_clean_scrub_stamp":"2024-03-09T15:08:02.811762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:39:30.236101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.901537+0000","last_change":"2024-03-09T15:07:18.901598+0000","last_active":"2024-03-09T15:07:18.901537+0000","last_peered":"2024-03-09T15:07:18.901537+0000","last_clean":"2024-03-09T15:07:18.901537+0000","last_became_active":"2024-03-09T14:42:19.288155+0000","last_became_peered":"2024-03-09T14:42:19.288155+0000","last_unstale":"2024-03-09T15:07:18.901537+0000","last_undegraded":"2024-03-09T15:07:18.901537+0000","last_fullsized":"2024-03-09T15:07:18.901537+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:18.901334+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:18.901334+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.901334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:16.864340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.955208+0000","last_change":"2024-03-09T15:07:11.955237+0000","last_active":"2024-03-09T15:07:11.955208+0000","last_peered":"2024-03-09T15:07:11.955208+0000","last_clean":"2024-03-09T15:07:11.955208+0000","last_became_active":"2024-03-09T14:42:15.962004+0000","last_became_peered":"2024-03-09T14:42:15.962004+0000","last_unstale":"2024-03-09T15:07:11.955208+0000","last_undegraded":"2024-03-09T15:07:11.955208+0000","last_fullsized":"2024-03-09T15:07:11.955208+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:11.955103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:11.955103+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.955103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:20:11.932735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.945988+0000","last_change":"2024-03-09T15:07:19.946048+0000","last_active":"2024-03-09T15:07:19.945988+0000","last_peered":"2024-03-09T15:07:19.945988+0000","last_clean":"2024-03-09T15:07:19.945988+0000","last_became_active":"2024-03-09T14:39:57.906043+0000","last_became_peered":"2024-03-09T14:39:57.906043+0000","last_unstale":"2024-03-09T15:07:19.945988+0000","last_undegraded":"2024-03-09T15:07:19.945988+0000","last_fullsized":"2024-03-09T15:07:19.945988+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-03-09T15:07:19.945806+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-03-09T15:07:19.945806+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.945806+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:28:12.471486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":86,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:03.822220+0000","last_change":"2024-03-09T15:08:03.822297+0000","last_active":"2024-03-09T15:08:03.822220+0000","last_peered":"2024-03-09T15:08:03.822220+0000","last_clean":"2024-03-09T15:08:03.822220+0000","last_became_active":"2024-03-09T14:49:53.666251+0000","last_became_peered":"2024-03-09T14:49:53.666251+0000","last_unstale":"2024-03-09T15:08:03.822220+0000","last_undegraded":"2024-03-09T15:08:03.822220+0000","last_fullsized":"2024-03-09T15:08:03.822220+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:08:03.822015+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:08:03.822015+0000","last_clean_scrub_stamp":"2024-03-09T15:08:03.822015+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:11:37.264514+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.906150+0000","last_change":"2024-03-09T15:07:19.906205+0000","last_active":"2024-03-09T15:07:19.906150+0000","last_peered":"2024-03-09T15:07:19.906150+0000","last_clean":"2024-03-09T15:07:19.906150+0000","last_became_active":"2024-03-09T14:42:18.998145+0000","last_became_peered":"2024-03-09T14:42:18.998145+0000","last_unstale":"2024-03-09T15:07:19.906150+0000","last_undegraded":"2024-03-09T15:07:19.906150+0000","last_fullsized":"2024-03-09T15:07:19.906150+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:19.905948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:19.905948+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.905948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:21:38.351715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.663537+0000","last_change":"2024-03-09T15:07:27.663618+0000","last_active":"2024-03-09T15:07:27.663537+0000","last_peered":"2024-03-09T15:07:27.663537+0000","last_clean":"2024-03-09T15:07:27.663537+0000","last_became_active":"2024-03-09T14:42:15.973793+0000","last_became_peered":"2024-03-09T14:42:15.973793+0000","last_unstale":"2024-03-09T15:07:27.663537+0000","last_undegraded":"2024-03-09T15:07:27.663537+0000","last_fullsized":"2024-03-09T15:07:27.663537+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:07:27.663315+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:07:27.663315+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.663315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:07.805577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'18","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.978140+0000","last_change":"2024-03-09T15:07:17.978140+0000","last_active":"2024-03-09T15:07:17.978140+0000","last_peered":"2024-03-09T15:07:17.978140+0000","last_clean":"2024-03-09T15:07:17.978140+0000","last_became_active":"2024-03-09T14:39:57.895347+0000","last_became_peered":"2024-03-09T14:39:57.895347+0000","last_unstale":"2024-03-09T15:07:17.978140+0000","last_undegraded":"2024-03-09T15:07:17.978140+0000","last_fullsized":"2024-03-09T15:07:17.978140+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-03-09T15:07:17.977877+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-03-09T15:07:17.977877+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.977877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:10:27.720426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":49,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:05.676241+0000","last_change":"2024-03-09T15:08:05.676308+0000","last_active":"2024-03-09T15:08:05.676241+0000","last_peered":"2024-03-09T15:08:05.676241+0000","last_clean":"2024-03-09T15:08:05.676241+0000","last_became_active":"2024-03-09T14:49:53.676907+0000","last_became_peered":"2024-03-09T14:49:53.676907+0000","last_unstale":"2024-03-09T15:08:05.676241+0000","last_undegraded":"2024-03-09T15:08:05.676241+0000","last_fullsized":"2024-03-09T15:08:05.676241+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:05.676020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:05.676020+0000","last_clean_scrub_stamp":"2024-03-09T15:08:05.676020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:25:30.962462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.983530+0000","last_change":"2024-03-09T15:07:26.983592+0000","last_active":"2024-03-09T15:07:26.983530+0000","last_peered":"2024-03-09T15:07:26.983530+0000","last_clean":"2024-03-09T15:07:26.983530+0000","last_became_active":"2024-03-09T14:42:29.984595+0000","last_became_peered":"2024-03-09T14:42:29.984595+0000","last_unstale":"2024-03-09T15:07:26.983530+0000","last_undegraded":"2024-03-09T15:07:26.983530+0000","last_fullsized":"2024-03-09T15:07:26.983530+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:26.983320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:26.983320+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.983320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:58:22.547118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'6","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.789750+0000","last_change":"2024-03-09T15:07:18.789875+0000","last_active":"2024-03-09T15:07:18.789750+0000","last_peered":"2024-03-09T15:07:18.789750+0000","last_clean":"2024-03-09T15:07:18.789750+0000","last_became_active":"2024-03-09T14:42:15.941583+0000","last_became_peered":"2024-03-09T14:42:15.941583+0000","last_unstale":"2024-03-09T15:07:18.789750+0000","last_undegraded":"2024-03-09T15:07:18.789750+0000","last_fullsized":"2024-03-09T15:07:18.789750+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:18.789520+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:18.789520+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.789520+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:04.840942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'16","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.198066+0000","last_change":"2024-03-09T15:07:18.198066+0000","last_active":"2024-03-09T15:07:18.198066+0000","last_peered":"2024-03-09T15:07:18.198066+0000","last_clean":"2024-03-09T15:07:18.198066+0000","last_became_active":"2024-03-09T14:39:57.884479+0000","last_became_peered":"2024-03-09T14:39:57.884479+0000","last_unstale":"2024-03-09T15:07:18.198066+0000","last_undegraded":"2024-03-09T15:07:18.198066+0000","last_fullsized":"2024-03-09T15:07:18.198066+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-03-09T15:07:18.197804+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-03-09T15:07:18.197804+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.197804+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:28:01.332954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":55,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.787730+0000","last_change":"2024-03-09T15:08:01.787781+0000","last_active":"2024-03-09T15:08:01.787730+0000","last_peered":"2024-03-09T15:08:01.787730+0000","last_clean":"2024-03-09T15:08:01.787730+0000","last_became_active":"2024-03-09T14:49:53.663825+0000","last_became_peered":"2024-03-09T14:49:53.663825+0000","last_unstale":"2024-03-09T15:08:01.787730+0000","last_undegraded":"2024-03-09T15:08:01.787730+0000","last_fullsized":"2024-03-09T15:08:01.787730+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:01.787551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:01.787551+0000","last_clean_scrub_stamp":"2024-03-09T15:08:01.787551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:21:44.185235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.764079+0000","last_change":"2024-03-09T15:07:35.764139+0000","last_active":"2024-03-09T15:07:35.764079+0000","last_peered":"2024-03-09T15:07:35.764079+0000","last_clean":"2024-03-09T15:07:35.764079+0000","last_became_active":"2024-03-09T14:42:18.995340+0000","last_became_peered":"2024-03-09T14:42:18.995340+0000","last_unstale":"2024-03-09T15:07:35.764079+0000","last_undegraded":"2024-03-09T15:07:35.764079+0000","last_fullsized":"2024-03-09T15:07:35.764079+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.763876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.763876+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.763876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:25:43.872448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.891508+0000","last_change":"2024-03-09T15:07:13.891508+0000","last_active":"2024-03-09T15:07:13.891508+0000","last_peered":"2024-03-09T15:07:13.891508+0000","last_clean":"2024-03-09T15:07:13.891508+0000","last_became_active":"2024-03-09T14:42:15.963155+0000","last_became_peered":"2024-03-09T14:42:15.963155+0000","last_unstale":"2024-03-09T15:07:13.891508+0000","last_undegraded":"2024-03-09T15:07:13.891508+0000","last_fullsized":"2024-03-09T15:07:13.891508+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:13.891243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:13.891243+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.891243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:23:55.637502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'33","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.561251+0000","last_change":"2024-03-09T15:07:16.561251+0000","last_active":"2024-03-09T15:07:16.561251+0000","last_peered":"2024-03-09T15:07:16.561251+0000","last_clean":"2024-03-09T15:07:16.561251+0000","last_became_active":"2024-03-09T14:39:57.888467+0000","last_became_peered":"2024-03-09T14:39:57.888467+0000","last_unstale":"2024-03-09T15:07:16.561251+0000","last_undegraded":"2024-03-09T15:07:16.561251+0000","last_fullsized":"2024-03-09T15:07:16.561251+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-03-09T15:07:16.560999+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-03-09T15:07:16.560999+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.560999+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:39.875129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":106,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:57.598442+0000","last_change":"2024-03-09T15:07:57.598497+0000","last_active":"2024-03-09T15:07:57.598442+0000","last_peered":"2024-03-09T15:07:57.598442+0000","last_clean":"2024-03-09T15:07:57.598442+0000","last_became_active":"2024-03-09T14:49:53.658183+0000","last_became_peered":"2024-03-09T14:49:53.658183+0000","last_unstale":"2024-03-09T15:07:57.598442+0000","last_undegraded":"2024-03-09T15:07:57.598442+0000","last_fullsized":"2024-03-09T15:07:57.598442+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:57.598235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:57.598235+0000","last_clean_scrub_stamp":"2024-03-09T15:07:57.598235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:00:50.823751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:02.570051+0000","last_change":"2024-03-09T15:08:02.570199+0000","last_active":"2024-03-09T15:08:02.570051+0000","last_peered":"2024-03-09T15:08:02.570051+0000","last_clean":"2024-03-09T15:08:02.570051+0000","last_became_active":"2024-03-09T14:42:19.294401+0000","last_became_peered":"2024-03-09T14:42:19.294401+0000","last_unstale":"2024-03-09T15:08:02.570051+0000","last_undegraded":"2024-03-09T15:08:02.570051+0000","last_fullsized":"2024-03-09T15:08:02.570051+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:08:02.569830+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:08:02.569830+0000","last_clean_scrub_stamp":"2024-03-09T15:08:02.569830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:51:43.380877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'7","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.582621+0000","last_change":"2024-03-09T15:07:37.582683+0000","last_active":"2024-03-09T15:07:37.582621+0000","last_peered":"2024-03-09T15:07:37.582621+0000","last_clean":"2024-03-09T15:07:37.582621+0000","last_became_active":"2024-03-09T14:42:15.974493+0000","last_became_peered":"2024-03-09T14:42:15.974493+0000","last_unstale":"2024-03-09T15:07:37.582621+0000","last_undegraded":"2024-03-09T15:07:37.582621+0000","last_fullsized":"2024-03-09T15:07:37.582621+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-03-09T15:07:37.582421+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-03-09T15:07:37.582421+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.582421+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:35:35.039619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5160,"num_write":12,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'28","reported_seq":117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.278092+0000","last_change":"2024-03-09T15:07:14.278092+0000","last_active":"2024-03-09T15:07:14.278092+0000","last_peered":"2024-03-09T15:07:14.278092+0000","last_clean":"2024-03-09T15:07:14.278092+0000","last_became_active":"2024-03-09T14:39:57.907009+0000","last_became_peered":"2024-03-09T14:39:57.907009+0000","last_unstale":"2024-03-09T15:07:14.278092+0000","last_undegraded":"2024-03-09T15:07:14.278092+0000","last_fullsized":"2024-03-09T15:07:14.278092+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-03-09T15:07:14.277744+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-03-09T15:07:14.277744+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.277744+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:52:23.159850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":74,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:52.597619+0000","last_change":"2024-03-09T15:07:52.597619+0000","last_active":"2024-03-09T15:07:52.597619+0000","last_peered":"2024-03-09T15:07:52.597619+0000","last_clean":"2024-03-09T15:07:52.597619+0000","last_became_active":"2024-03-09T14:49:53.680477+0000","last_became_peered":"2024-03-09T14:49:53.680477+0000","last_unstale":"2024-03-09T15:07:52.597619+0000","last_undegraded":"2024-03-09T15:07:52.597619+0000","last_fullsized":"2024-03-09T15:07:52.597619+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:52.597262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:52.597262+0000","last_clean_scrub_stamp":"2024-03-09T15:07:52.597262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:55:29.342309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.930221+0000","last_change":"2024-03-09T15:07:22.930279+0000","last_active":"2024-03-09T15:07:22.930221+0000","last_peered":"2024-03-09T15:07:22.930221+0000","last_clean":"2024-03-09T15:07:22.930221+0000","last_became_active":"2024-03-09T14:42:19.289487+0000","last_became_peered":"2024-03-09T14:42:19.289487+0000","last_unstale":"2024-03-09T15:07:22.930221+0000","last_undegraded":"2024-03-09T15:07:22.930221+0000","last_fullsized":"2024-03-09T15:07:22.930221+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:22.930020+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:22.930020+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.930020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:09:50.336731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:52.528831+0000","last_change":"2024-03-09T15:07:52.528898+0000","last_active":"2024-03-09T15:07:52.528831+0000","last_peered":"2024-03-09T15:07:52.528831+0000","last_clean":"2024-03-09T15:07:52.528831+0000","last_became_active":"2024-03-09T14:42:15.956648+0000","last_became_peered":"2024-03-09T14:42:15.956648+0000","last_unstale":"2024-03-09T15:07:52.528831+0000","last_undegraded":"2024-03-09T15:07:52.528831+0000","last_fullsized":"2024-03-09T15:07:52.528831+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:52.528630+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:52.528630+0000","last_clean_scrub_stamp":"2024-03-09T15:07:52.528630+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:41.439810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'62","reported_seq":208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.950093+0000","last_change":"2024-03-09T15:07:21.950162+0000","last_active":"2024-03-09T15:07:21.950093+0000","last_peered":"2024-03-09T15:07:21.950093+0000","last_clean":"2024-03-09T15:07:21.950093+0000","last_became_active":"2024-03-09T14:39:57.905410+0000","last_became_peered":"2024-03-09T14:39:57.905410+0000","last_unstale":"2024-03-09T15:07:21.950093+0000","last_undegraded":"2024-03-09T15:07:21.950093+0000","last_fullsized":"2024-03-09T15:07:21.950093+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'62","last_scrub_stamp":"2024-03-09T15:07:21.949871+0000","last_deep_scrub":"264'62","last_deep_scrub_stamp":"2024-03-09T15:07:21.949871+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.949871+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:41:26.110415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":193,"num_write":94,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:59.839810+0000","last_change":"2024-03-09T15:07:59.839864+0000","last_active":"2024-03-09T15:07:59.839810+0000","last_peered":"2024-03-09T15:07:59.839810+0000","last_clean":"2024-03-09T15:07:59.839810+0000","last_became_active":"2024-03-09T14:49:53.658190+0000","last_became_peered":"2024-03-09T14:49:53.658190+0000","last_unstale":"2024-03-09T15:07:59.839810+0000","last_undegraded":"2024-03-09T15:07:59.839810+0000","last_fullsized":"2024-03-09T15:07:59.839810+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:59.839619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:59.839619+0000","last_clean_scrub_stamp":"2024-03-09T15:07:59.839619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:02:03.546692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'5","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.802757+0000","last_change":"2024-03-09T15:07:56.802907+0000","last_active":"2024-03-09T15:07:56.802757+0000","last_peered":"2024-03-09T15:07:56.802757+0000","last_clean":"2024-03-09T15:07:56.802757+0000","last_became_active":"2024-03-09T14:42:19.013977+0000","last_became_peered":"2024-03-09T14:42:19.013977+0000","last_unstale":"2024-03-09T15:07:56.802757+0000","last_undegraded":"2024-03-09T15:07:56.802757+0000","last_fullsized":"2024-03-09T15:07:56.802757+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:07:56.802501+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:07:56.802501+0000","last_clean_scrub_stamp":"2024-03-09T15:07:56.802501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:03:23.831112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":5,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.857181+0000","last_change":"2024-03-09T15:07:16.857285+0000","last_active":"2024-03-09T15:07:16.857181+0000","last_peered":"2024-03-09T15:07:16.857181+0000","last_clean":"2024-03-09T15:07:16.857181+0000","last_became_active":"2024-03-09T14:42:15.960225+0000","last_became_peered":"2024-03-09T14:42:15.960225+0000","last_unstale":"2024-03-09T15:07:16.857181+0000","last_undegraded":"2024-03-09T15:07:16.857181+0000","last_fullsized":"2024-03-09T15:07:16.857181+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:16.856929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:16.856929+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.856929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:51:38.551264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'131","reported_seq":441,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.963128+0000","last_change":"2024-03-09T15:07:12.963188+0000","last_active":"2024-03-09T15:07:12.963128+0000","last_peered":"2024-03-09T15:07:12.963128+0000","last_clean":"2024-03-09T15:07:12.963128+0000","last_became_active":"2024-03-09T14:39:57.892592+0000","last_became_peered":"2024-03-09T14:39:57.892592+0000","last_unstale":"2024-03-09T15:07:12.963128+0000","last_undegraded":"2024-03-09T15:07:12.963128+0000","last_fullsized":"2024-03-09T15:07:12.963128+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-03-09T15:07:12.962987+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-03-09T15:07:12.962987+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.962987+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:14:19.463214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":739,"num_read_kb":529,"num_write":173,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4473,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.513444+0000","last_change":"2024-03-09T15:07:41.513509+0000","last_active":"2024-03-09T15:07:41.513444+0000","last_peered":"2024-03-09T15:07:41.513444+0000","last_clean":"2024-03-09T15:07:41.513444+0000","last_became_active":"2024-03-09T14:49:53.672292+0000","last_became_peered":"2024-03-09T14:49:53.672292+0000","last_unstale":"2024-03-09T15:07:41.513444+0000","last_undegraded":"2024-03-09T15:07:41.513444+0000","last_fullsized":"2024-03-09T15:07:41.513444+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:41.513248+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:41.513248+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.513248+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:29:14.165196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.599526+0000","last_change":"2024-03-09T15:07:46.599582+0000","last_active":"2024-03-09T15:07:46.599526+0000","last_peered":"2024-03-09T15:07:46.599526+0000","last_clean":"2024-03-09T15:07:46.599526+0000","last_became_active":"2024-03-09T14:42:19.002083+0000","last_became_peered":"2024-03-09T14:42:19.002083+0000","last_unstale":"2024-03-09T15:07:46.599526+0000","last_undegraded":"2024-03-09T15:07:46.599526+0000","last_fullsized":"2024-03-09T15:07:46.599526+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:46.599325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:46.599325+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.599325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:03:50.389634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'6","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.934056+0000","last_change":"2024-03-09T15:07:14.934126+0000","last_active":"2024-03-09T15:07:14.934056+0000","last_peered":"2024-03-09T15:07:14.934056+0000","last_clean":"2024-03-09T15:07:14.934056+0000","last_became_active":"2024-03-09T14:42:15.975956+0000","last_became_peered":"2024-03-09T14:42:15.975956+0000","last_unstale":"2024-03-09T15:07:14.934056+0000","last_undegraded":"2024-03-09T15:07:14.934056+0000","last_fullsized":"2024-03-09T15:07:14.934056+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:14.933844+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:14.933844+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.933844+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:53:21.393505+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'35","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.516936+0000","last_change":"2024-03-09T15:07:13.517001+0000","last_active":"2024-03-09T15:07:13.516936+0000","last_peered":"2024-03-09T15:07:13.516936+0000","last_clean":"2024-03-09T15:07:13.516936+0000","last_became_active":"2024-03-09T14:39:57.886792+0000","last_became_peered":"2024-03-09T14:39:57.886792+0000","last_unstale":"2024-03-09T15:07:13.516936+0000","last_undegraded":"2024-03-09T15:07:13.516936+0000","last_fullsized":"2024-03-09T15:07:13.516936+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-03-09T15:07:13.516719+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-03-09T15:07:13.516719+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.516719+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:17:49.955637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":107,"num_write":66,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:08.698702+0000","last_change":"2024-03-09T15:08:08.698756+0000","last_active":"2024-03-09T15:08:08.698702+0000","last_peered":"2024-03-09T15:08:08.698702+0000","last_clean":"2024-03-09T15:08:08.698702+0000","last_became_active":"2024-03-09T14:49:53.683703+0000","last_became_peered":"2024-03-09T14:49:53.683703+0000","last_unstale":"2024-03-09T15:08:08.698702+0000","last_undegraded":"2024-03-09T15:08:08.698702+0000","last_fullsized":"2024-03-09T15:08:08.698702+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:08.698505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:08.698505+0000","last_clean_scrub_stamp":"2024-03-09T15:08:08.698505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:01.251182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'9","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:55.608868+0000","last_change":"2024-03-09T15:07:55.609002+0000","last_active":"2024-03-09T15:07:55.608868+0000","last_peered":"2024-03-09T15:07:55.608868+0000","last_clean":"2024-03-09T15:07:55.608868+0000","last_became_active":"2024-03-09T14:42:19.013372+0000","last_became_peered":"2024-03-09T14:42:19.013372+0000","last_unstale":"2024-03-09T15:07:55.608868+0000","last_undegraded":"2024-03-09T15:07:55.608868+0000","last_fullsized":"2024-03-09T15:07:55.608868+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-03-09T15:07:55.608576+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-03-09T15:07:55.608576+0000","last_clean_scrub_stamp":"2024-03-09T15:07:55.608576+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:05:38.805300+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"261'3","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.905609+0000","last_change":"2024-03-09T15:07:17.905609+0000","last_active":"2024-03-09T15:07:17.905609+0000","last_peered":"2024-03-09T15:07:17.905609+0000","last_clean":"2024-03-09T15:07:17.905609+0000","last_became_active":"2024-03-09T14:42:15.954274+0000","last_became_peered":"2024-03-09T14:42:15.954274+0000","last_unstale":"2024-03-09T15:07:17.905609+0000","last_undegraded":"2024-03-09T15:07:17.905609+0000","last_fullsized":"2024-03-09T15:07:17.905609+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:17.905341+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:17.905341+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.905341+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:09.793662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'59","reported_seq":208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.867257+0000","last_change":"2024-03-09T15:07:11.867317+0000","last_active":"2024-03-09T15:07:11.867257+0000","last_peered":"2024-03-09T15:07:11.867257+0000","last_clean":"2024-03-09T15:07:11.867257+0000","last_became_active":"2024-03-09T14:39:57.901599+0000","last_became_peered":"2024-03-09T14:39:57.901599+0000","last_unstale":"2024-03-09T15:07:11.867257+0000","last_undegraded":"2024-03-09T15:07:11.867257+0000","last_fullsized":"2024-03-09T15:07:11.867257+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'59","last_scrub_stamp":"2024-03-09T15:07:11.867056+0000","last_deep_scrub":"264'59","last_deep_scrub_stamp":"2024-03-09T15:07:11.867056+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.867056+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:38:36.066989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":206,"num_write":96,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.659404+0000","last_change":"2024-03-09T15:08:06.659458+0000","last_active":"2024-03-09T15:08:06.659404+0000","last_peered":"2024-03-09T15:08:06.659404+0000","last_clean":"2024-03-09T15:08:06.659404+0000","last_became_active":"2024-03-09T14:49:53.681327+0000","last_became_peered":"2024-03-09T14:49:53.681327+0000","last_unstale":"2024-03-09T15:08:06.659404+0000","last_undegraded":"2024-03-09T15:08:06.659404+0000","last_fullsized":"2024-03-09T15:08:06.659404+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:06.659202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:06.659202+0000","last_clean_scrub_stamp":"2024-03-09T15:08:06.659202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:30:21.838459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.052590+0000","last_change":"2024-03-09T15:07:48.052643+0000","last_active":"2024-03-09T15:07:48.052590+0000","last_peered":"2024-03-09T15:07:48.052590+0000","last_clean":"2024-03-09T15:07:48.052590+0000","last_became_active":"2024-03-09T14:42:19.019151+0000","last_became_peered":"2024-03-09T14:42:19.019151+0000","last_unstale":"2024-03-09T15:07:48.052590+0000","last_undegraded":"2024-03-09T15:07:48.052590+0000","last_fullsized":"2024-03-09T15:07:48.052590+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:48.052391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:48.052391+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.052391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:22:16.557124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.917661+0000","last_change":"2024-03-09T15:07:09.917661+0000","last_active":"2024-03-09T15:07:09.917661+0000","last_peered":"2024-03-09T15:07:09.917661+0000","last_clean":"2024-03-09T15:07:09.917661+0000","last_became_active":"2024-03-09T14:42:15.959503+0000","last_became_peered":"2024-03-09T14:42:15.959503+0000","last_unstale":"2024-03-09T15:07:09.917661+0000","last_undegraded":"2024-03-09T15:07:09.917661+0000","last_fullsized":"2024-03-09T15:07:09.917661+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:09.917534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:09.917534+0000","last_clean_scrub_stamp":"2024-03-09T15:07:09.917534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:08.292151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'13","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.270252+0000","last_change":"2024-03-09T15:07:16.270315+0000","last_active":"2024-03-09T15:07:16.270252+0000","last_peered":"2024-03-09T15:07:16.270252+0000","last_clean":"2024-03-09T15:07:16.270252+0000","last_became_active":"2024-03-09T14:39:57.895579+0000","last_became_peered":"2024-03-09T14:39:57.895579+0000","last_unstale":"2024-03-09T15:07:16.270252+0000","last_undegraded":"2024-03-09T15:07:16.270252+0000","last_fullsized":"2024-03-09T15:07:16.270252+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-03-09T15:07:16.270056+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-03-09T15:07:16.270056+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.270056+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:06:45.756532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:07.842863+0000","last_change":"2024-03-09T15:08:07.842916+0000","last_active":"2024-03-09T15:08:07.842863+0000","last_peered":"2024-03-09T15:08:07.842863+0000","last_clean":"2024-03-09T15:08:07.842863+0000","last_became_active":"2024-03-09T14:49:53.680782+0000","last_became_peered":"2024-03-09T14:49:53.680782+0000","last_unstale":"2024-03-09T15:08:07.842863+0000","last_undegraded":"2024-03-09T15:08:07.842863+0000","last_fullsized":"2024-03-09T15:08:07.842863+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:07.842659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:07.842659+0000","last_clean_scrub_stamp":"2024-03-09T15:08:07.842659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:02:13.023112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:58.807363+0000","last_change":"2024-03-09T15:07:58.807427+0000","last_active":"2024-03-09T15:07:58.807363+0000","last_peered":"2024-03-09T15:07:58.807363+0000","last_clean":"2024-03-09T15:07:58.807363+0000","last_became_active":"2024-03-09T14:42:19.020789+0000","last_became_peered":"2024-03-09T14:42:19.020789+0000","last_unstale":"2024-03-09T15:07:58.807363+0000","last_undegraded":"2024-03-09T15:07:58.807363+0000","last_fullsized":"2024-03-09T15:07:58.807363+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:58.807169+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:58.807169+0000","last_clean_scrub_stamp":"2024-03-09T15:07:58.807169+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:30.580261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'8","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.151321+0000","last_change":"2024-03-09T15:07:44.151501+0000","last_active":"2024-03-09T15:07:44.151321+0000","last_peered":"2024-03-09T15:07:44.151321+0000","last_clean":"2024-03-09T15:07:44.151321+0000","last_became_active":"2024-03-09T14:42:15.960341+0000","last_became_peered":"2024-03-09T14:42:15.960341+0000","last_unstale":"2024-03-09T15:07:44.151321+0000","last_undegraded":"2024-03-09T15:07:44.151321+0000","last_fullsized":"2024-03-09T15:07:44.151321+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-03-09T15:07:44.151029+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-03-09T15:07:44.151029+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.151029+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:57:06.290808+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":20522,"num_write":11,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'42","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.969299+0000","last_change":"2024-03-09T15:07:24.969299+0000","last_active":"2024-03-09T15:07:24.969299+0000","last_peered":"2024-03-09T15:07:24.969299+0000","last_clean":"2024-03-09T15:07:24.969299+0000","last_became_active":"2024-03-09T14:39:57.898267+0000","last_became_peered":"2024-03-09T14:39:57.898267+0000","last_unstale":"2024-03-09T15:07:24.969299+0000","last_undegraded":"2024-03-09T15:07:24.969299+0000","last_fullsized":"2024-03-09T15:07:24.969299+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-03-09T15:07:24.968847+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-03-09T15:07:24.968847+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.968847+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:29.161194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":119,"num_write":82,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'300","reported_seq":1049,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.887674+0000","last_change":"2024-03-09T15:07:47.887782+0000","last_active":"2024-03-09T15:07:47.887674+0000","last_peered":"2024-03-09T15:07:47.887674+0000","last_clean":"2024-03-09T15:07:47.887674+0000","last_became_active":"2024-03-09T14:28:53.623701+0000","last_became_peered":"2024-03-09T14:28:53.623701+0000","last_unstale":"2024-03-09T15:07:47.887674+0000","last_undegraded":"2024-03-09T15:07:47.887674+0000","last_fullsized":"2024-03-09T15:07:47.887674+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'300","last_scrub_stamp":"2024-03-09T15:07:47.887473+0000","last_deep_scrub":"264'300","last_deep_scrub_stamp":"2024-03-09T15:07:47.887473+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.887473+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:14:51.229382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":756,"num_read_kb":36473,"num_write":1139,"num_write_kb":31503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'697","reported_seq":2221,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.460139+0000","last_change":"2024-03-09T15:07:34.460243+0000","last_active":"2024-03-09T15:07:34.460139+0000","last_peered":"2024-03-09T15:07:34.460139+0000","last_clean":"2024-03-09T15:07:34.460139+0000","last_became_active":"2024-03-09T14:28:55.574984+0000","last_became_peered":"2024-03-09T14:28:55.574984+0000","last_unstale":"2024-03-09T15:07:34.460139+0000","last_undegraded":"2024-03-09T15:07:34.460139+0000","last_fullsized":"2024-03-09T15:07:34.460139+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'697","last_scrub_stamp":"2024-03-09T15:07:34.459929+0000","last_deep_scrub":"264'697","last_deep_scrub_stamp":"2024-03-09T15:07:34.459929+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.459929+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:15:13.773840+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3313,"num_read_kb":2995,"num_write":917,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'302","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.559374+0000","last_change":"2024-03-09T15:07:44.559549+0000","last_active":"2024-03-09T15:07:44.559374+0000","last_peered":"2024-03-09T15:07:44.559374+0000","last_clean":"2024-03-09T15:07:44.559374+0000","last_became_active":"2024-03-09T14:28:53.626490+0000","last_became_peered":"2024-03-09T14:28:53.626490+0000","last_unstale":"2024-03-09T15:07:44.559374+0000","last_undegraded":"2024-03-09T15:07:44.559374+0000","last_fullsized":"2024-03-09T15:07:44.559374+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'302","last_scrub_stamp":"2024-03-09T15:07:44.559054+0000","last_deep_scrub":"264'302","last_deep_scrub_stamp":"2024-03-09T15:07:44.559054+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.559054+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:09:37.627354+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5265769,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":463,"num_read_kb":36382,"num_write":1100,"num_write_kb":36054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'348","reported_seq":1738,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.835595+0000","last_change":"2024-03-09T15:07:43.835654+0000","last_active":"2024-03-09T15:07:43.835595+0000","last_peered":"2024-03-09T15:07:43.835595+0000","last_clean":"2024-03-09T15:07:43.835595+0000","last_became_active":"2024-03-09T14:28:55.591640+0000","last_became_peered":"2024-03-09T14:28:55.591640+0000","last_unstale":"2024-03-09T15:07:43.835595+0000","last_undegraded":"2024-03-09T15:07:43.835595+0000","last_fullsized":"2024-03-09T15:07:43.835595+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-03-09T15:07:43.835382+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-03-09T15:07:43.835382+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.835382+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:09:20.349660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1906,"num_read_kb":1805,"num_write":411,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'330","reported_seq":1054,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.971074+0000","last_change":"2024-03-09T15:07:21.971278+0000","last_active":"2024-03-09T15:07:21.971074+0000","last_peered":"2024-03-09T15:07:21.971074+0000","last_clean":"2024-03-09T15:07:21.971074+0000","last_became_active":"2024-03-09T14:29:28.827096+0000","last_became_peered":"2024-03-09T14:29:28.827096+0000","last_unstale":"2024-03-09T15:07:21.971074+0000","last_undegraded":"2024-03-09T15:07:21.971074+0000","last_fullsized":"2024-03-09T15:07:21.971074+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'330","last_scrub_stamp":"2024-03-09T15:07:21.970830+0000","last_deep_scrub":"264'330","last_deep_scrub_stamp":"2024-03-09T15:07:21.970830+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.970830+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:14:08.492056+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262173,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":589,"num_read_kb":23096,"num_write":1233,"num_write_kb":39906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,7],"acting":[3,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"264'401","reported_seq":1894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.888513+0000","last_change":"2024-03-09T15:07:43.888581+0000","last_active":"2024-03-09T15:07:43.888513+0000","last_peered":"2024-03-09T15:07:43.888513+0000","last_clean":"2024-03-09T15:07:43.888513+0000","last_became_active":"2024-03-09T14:28:55.570930+0000","last_became_peered":"2024-03-09T14:28:55.570930+0000","last_unstale":"2024-03-09T15:07:43.888513+0000","last_undegraded":"2024-03-09T15:07:43.888513+0000","last_fullsized":"2024-03-09T15:07:43.888513+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'401","last_scrub_stamp":"2024-03-09T15:07:43.888331+0000","last_deep_scrub":"264'401","last_deep_scrub_stamp":"2024-03-09T15:07:43.888331+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.888331+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:35:42.968547+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2164,"num_read_kb":2043,"num_write":472,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":148,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'297","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.521643+0000","last_change":"2024-03-09T15:07:47.521739+0000","last_active":"2024-03-09T15:07:47.521643+0000","last_peered":"2024-03-09T15:07:47.521643+0000","last_clean":"2024-03-09T15:07:47.521643+0000","last_became_active":"2024-03-09T14:28:53.603454+0000","last_became_peered":"2024-03-09T14:28:53.603454+0000","last_unstale":"2024-03-09T15:07:47.521643+0000","last_undegraded":"2024-03-09T15:07:47.521643+0000","last_fullsized":"2024-03-09T15:07:47.521643+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'297","last_scrub_stamp":"2024-03-09T15:07:47.521438+0000","last_deep_scrub":"264'297","last_deep_scrub_stamp":"2024-03-09T15:07:47.521438+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.521438+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:53:52.031727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":6538,"num_write":1185,"num_write_kb":12238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'435","reported_seq":1946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.704192+0000","last_change":"2024-03-09T15:07:37.704264+0000","last_active":"2024-03-09T15:07:37.704192+0000","last_peered":"2024-03-09T15:07:37.704192+0000","last_clean":"2024-03-09T15:07:37.704192+0000","last_became_active":"2024-03-09T14:28:55.610360+0000","last_became_peered":"2024-03-09T14:28:55.610360+0000","last_unstale":"2024-03-09T15:07:37.704192+0000","last_undegraded":"2024-03-09T15:07:37.704192+0000","last_fullsized":"2024-03-09T15:07:37.704192+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'435","last_scrub_stamp":"2024-03-09T15:07:37.704007+0000","last_deep_scrub":"264'435","last_deep_scrub_stamp":"2024-03-09T15:07:37.704007+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.704007+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:38:19.113285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2375,"num_read_kb":2224,"num_write":558,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'339","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.899197+0000","last_change":"2024-03-09T15:07:49.899332+0000","last_active":"2024-03-09T15:07:49.899197+0000","last_peered":"2024-03-09T15:07:49.899197+0000","last_clean":"2024-03-09T15:07:49.899197+0000","last_became_active":"2024-03-09T14:28:53.622689+0000","last_became_peered":"2024-03-09T14:28:53.622689+0000","last_unstale":"2024-03-09T15:07:49.899197+0000","last_undegraded":"2024-03-09T15:07:49.899197+0000","last_fullsized":"2024-03-09T15:07:49.899197+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-03-09T15:07:49.898980+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-03-09T15:07:49.898980+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.898980+0000","objects_scrubbed":10,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:57:41.508017+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9722121,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":529,"num_read_kb":7528,"num_write":1253,"num_write_kb":32260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'365","reported_seq":1929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.198857+0000","last_change":"2024-03-09T15:07:34.199037+0000","last_active":"2024-03-09T15:07:34.198857+0000","last_peered":"2024-03-09T15:07:34.198857+0000","last_clean":"2024-03-09T15:07:34.198857+0000","last_became_active":"2024-03-09T14:28:55.588204+0000","last_became_peered":"2024-03-09T14:28:55.588204+0000","last_unstale":"2024-03-09T15:07:34.198857+0000","last_undegraded":"2024-03-09T15:07:34.198857+0000","last_fullsized":"2024-03-09T15:07:34.198857+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'365","last_scrub_stamp":"2024-03-09T15:07:34.198627+0000","last_deep_scrub":"264'365","last_deep_scrub_stamp":"2024-03-09T15:07:34.198627+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.198627+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:51:37.155815+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2088,"num_read_kb":2012,"num_write":400,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'366","reported_seq":1078,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.548236+0000","last_change":"2024-03-09T15:07:48.548329+0000","last_active":"2024-03-09T15:07:48.548236+0000","last_peered":"2024-03-09T15:07:48.548236+0000","last_clean":"2024-03-09T15:07:48.548236+0000","last_became_active":"2024-03-09T14:28:53.604391+0000","last_became_peered":"2024-03-09T14:28:53.604391+0000","last_unstale":"2024-03-09T15:07:48.548236+0000","last_undegraded":"2024-03-09T15:07:48.548236+0000","last_fullsized":"2024-03-09T15:07:48.548236+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-03-09T15:07:48.548012+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-03-09T15:07:48.548012+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.548012+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:56:53.501630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":836,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":748,"num_read_kb":3295,"num_write":1231,"num_write_kb":34124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'791","reported_seq":2527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.781834+0000","last_change":"2024-03-09T15:07:39.781900+0000","last_active":"2024-03-09T15:07:39.781834+0000","last_peered":"2024-03-09T15:07:39.781834+0000","last_clean":"2024-03-09T15:07:39.781834+0000","last_became_active":"2024-03-09T14:28:55.571291+0000","last_became_peered":"2024-03-09T14:28:55.571291+0000","last_unstale":"2024-03-09T15:07:39.781834+0000","last_undegraded":"2024-03-09T15:07:39.781834+0000","last_fullsized":"2024-03-09T15:07:39.781834+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'791","last_scrub_stamp":"2024-03-09T15:07:39.781646+0000","last_deep_scrub":"264'791","last_deep_scrub_stamp":"2024-03-09T15:07:39.781646+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.781646+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:27:42.910884+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3843,"num_read_kb":3494,"num_write":1039,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'393","reported_seq":1064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:59.768268+0000","last_change":"2024-03-09T15:07:59.768386+0000","last_active":"2024-03-09T15:07:59.768268+0000","last_peered":"2024-03-09T15:07:59.768268+0000","last_clean":"2024-03-09T15:07:59.768268+0000","last_became_active":"2024-03-09T14:28:53.618259+0000","last_became_peered":"2024-03-09T14:28:53.618259+0000","last_unstale":"2024-03-09T15:07:59.768268+0000","last_undegraded":"2024-03-09T15:07:59.768268+0000","last_fullsized":"2024-03-09T15:07:59.768268+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-03-09T15:07:59.768028+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-03-09T15:07:59.768028+0000","last_clean_scrub_stamp":"2024-03-09T15:07:59.768028+0000","objects_scrubbed":8,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:08:15.036887+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243711,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":574,"num_read_kb":8008,"num_write":1507,"num_write_kb":37535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'418","reported_seq":2029,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.552305+0000","last_change":"2024-03-09T15:07:28.552375+0000","last_active":"2024-03-09T15:07:28.552305+0000","last_peered":"2024-03-09T15:07:28.552305+0000","last_clean":"2024-03-09T15:07:28.552305+0000","last_became_active":"2024-03-09T14:28:55.587626+0000","last_became_peered":"2024-03-09T14:28:55.587626+0000","last_unstale":"2024-03-09T15:07:28.552305+0000","last_undegraded":"2024-03-09T15:07:28.552305+0000","last_fullsized":"2024-03-09T15:07:28.552305+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'418","last_scrub_stamp":"2024-03-09T15:07:28.552126+0000","last_deep_scrub":"264'418","last_deep_scrub_stamp":"2024-03-09T15:07:28.552126+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.552126+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:50:47.846392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2314,"num_read_kb":2202,"num_write":483,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'331","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:08.119114+0000","last_change":"2024-03-09T15:08:08.119216+0000","last_active":"2024-03-09T15:08:08.119114+0000","last_peered":"2024-03-09T15:08:08.119114+0000","last_clean":"2024-03-09T15:08:08.119114+0000","last_became_active":"2024-03-09T14:28:53.589232+0000","last_became_peered":"2024-03-09T14:28:53.589232+0000","last_unstale":"2024-03-09T15:08:08.119114+0000","last_undegraded":"2024-03-09T15:08:08.119114+0000","last_fullsized":"2024-03-09T15:08:08.119114+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'331","last_scrub_stamp":"2024-03-09T15:08:08.118885+0000","last_deep_scrub":"264'331","last_deep_scrub_stamp":"2024-03-09T15:08:08.118885+0000","last_clean_scrub_stamp":"2024-03-09T15:08:08.118885+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:12.056626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":42616,"num_write":1235,"num_write_kb":40647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'933","reported_seq":2706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.596632+0000","last_change":"2024-03-09T15:07:34.596714+0000","last_active":"2024-03-09T15:07:34.596632+0000","last_peered":"2024-03-09T15:07:34.596632+0000","last_clean":"2024-03-09T15:07:34.596632+0000","last_became_active":"2024-03-09T14:28:55.602477+0000","last_became_peered":"2024-03-09T14:28:55.602477+0000","last_unstale":"2024-03-09T15:07:34.596632+0000","last_undegraded":"2024-03-09T15:07:34.596632+0000","last_fullsized":"2024-03-09T15:07:34.596632+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'933","last_scrub_stamp":"2024-03-09T15:07:34.596435+0000","last_deep_scrub":"264'933","last_deep_scrub_stamp":"2024-03-09T15:07:34.596435+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.596435+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:19:48.629634+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4605,"num_read_kb":4102,"num_write":1299,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4073,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'355","reported_seq":1808,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.824626+0000","last_change":"2024-03-09T15:07:41.824699+0000","last_active":"2024-03-09T15:07:41.824626+0000","last_peered":"2024-03-09T15:07:41.824626+0000","last_clean":"2024-03-09T15:07:41.824626+0000","last_became_active":"2024-03-09T14:28:55.570861+0000","last_became_peered":"2024-03-09T14:28:55.570861+0000","last_unstale":"2024-03-09T15:07:41.824626+0000","last_undegraded":"2024-03-09T15:07:41.824626+0000","last_fullsized":"2024-03-09T15:07:41.824626+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'355","last_scrub_stamp":"2024-03-09T15:07:41.824438+0000","last_deep_scrub":"264'355","last_deep_scrub_stamp":"2024-03-09T15:07:41.824438+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.824438+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:32.514751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1960,"num_read_kb":1866,"num_write":405,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'351","reported_seq":1048,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:55.816945+0000","last_change":"2024-03-09T15:07:55.817117+0000","last_active":"2024-03-09T15:07:55.816945+0000","last_peered":"2024-03-09T15:07:55.816945+0000","last_clean":"2024-03-09T15:07:55.816945+0000","last_became_active":"2024-03-09T14:28:53.607915+0000","last_became_peered":"2024-03-09T14:28:53.607915+0000","last_unstale":"2024-03-09T15:07:55.816945+0000","last_undegraded":"2024-03-09T15:07:55.816945+0000","last_fullsized":"2024-03-09T15:07:55.816945+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-03-09T15:07:55.816715+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-03-09T15:07:55.816715+0000","last_clean_scrub_stamp":"2024-03-09T15:07:55.816715+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:47:39.883611+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5273368,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":78573,"num_write":1337,"num_write_kb":47168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'820","reported_seq":2231,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.912291+0000","last_change":"2024-03-09T15:07:41.912358+0000","last_active":"2024-03-09T15:07:41.912291+0000","last_peered":"2024-03-09T15:07:41.912291+0000","last_clean":"2024-03-09T15:07:41.912291+0000","last_became_active":"2024-03-09T14:28:55.591884+0000","last_became_peered":"2024-03-09T14:28:55.591884+0000","last_unstale":"2024-03-09T15:07:41.912291+0000","last_undegraded":"2024-03-09T15:07:41.912291+0000","last_fullsized":"2024-03-09T15:07:41.912291+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'820","last_scrub_stamp":"2024-03-09T15:07:41.912096+0000","last_deep_scrub":"264'820","last_deep_scrub_stamp":"2024-03-09T15:07:41.912096+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.912096+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:43:11.982031+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3579,"num_read_kb":3134,"num_write":1128,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'247","reported_seq":917,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.227197+0000","last_change":"2024-03-09T15:07:40.227401+0000","last_active":"2024-03-09T15:07:40.227197+0000","last_peered":"2024-03-09T15:07:40.227197+0000","last_clean":"2024-03-09T15:07:40.227197+0000","last_became_active":"2024-03-09T14:28:53.635735+0000","last_became_peered":"2024-03-09T14:28:53.635735+0000","last_unstale":"2024-03-09T15:07:40.227197+0000","last_undegraded":"2024-03-09T15:07:40.227197+0000","last_fullsized":"2024-03-09T15:07:40.227197+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'247","last_scrub_stamp":"2024-03-09T15:07:40.226926+0000","last_deep_scrub":"264'247","last_deep_scrub_stamp":"2024-03-09T15:07:40.226926+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.226926+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:45:25.062019+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":452,"num_read_kb":101132,"num_write":981,"num_write_kb":27272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'366","reported_seq":1878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.515340+0000","last_change":"2024-03-09T15:07:27.515488+0000","last_active":"2024-03-09T15:07:27.515340+0000","last_peered":"2024-03-09T15:07:27.515340+0000","last_clean":"2024-03-09T15:07:27.515340+0000","last_became_active":"2024-03-09T14:28:55.589360+0000","last_became_peered":"2024-03-09T14:28:55.589360+0000","last_unstale":"2024-03-09T15:07:27.515340+0000","last_undegraded":"2024-03-09T15:07:27.515340+0000","last_fullsized":"2024-03-09T15:07:27.515340+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-03-09T15:07:27.515111+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-03-09T15:07:27.515111+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.515111+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:24:53.377750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2092,"num_write":426,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'318","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.266460+0000","last_change":"2024-03-09T15:07:39.266548+0000","last_active":"2024-03-09T15:07:39.266460+0000","last_peered":"2024-03-09T15:07:39.266460+0000","last_clean":"2024-03-09T15:07:39.266460+0000","last_became_active":"2024-03-09T14:28:53.635713+0000","last_became_peered":"2024-03-09T14:28:53.635713+0000","last_unstale":"2024-03-09T15:07:39.266460+0000","last_undegraded":"2024-03-09T15:07:39.266460+0000","last_fullsized":"2024-03-09T15:07:39.266460+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-03-09T15:07:39.266259+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-03-09T15:07:39.266259+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.266259+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:45:23.058863+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1830670,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":532,"num_read_kb":101700,"num_write":1117,"num_write_kb":55747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'1332","reported_seq":3011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.551298+0000","last_change":"2024-03-09T15:07:33.551298+0000","last_active":"2024-03-09T15:07:33.551298+0000","last_peered":"2024-03-09T15:07:33.551298+0000","last_clean":"2024-03-09T15:07:33.551298+0000","last_became_active":"2024-03-09T14:28:55.602235+0000","last_became_peered":"2024-03-09T14:28:55.602235+0000","last_unstale":"2024-03-09T15:07:33.551298+0000","last_undegraded":"2024-03-09T15:07:33.551298+0000","last_fullsized":"2024-03-09T15:07:33.551298+0000","mapping_epoch":25,"log_start":"264'1300","ondisk_log_start":"264'1300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1332","last_scrub_stamp":"2024-03-09T15:07:33.551044+0000","last_deep_scrub":"264'1332","last_deep_scrub_stamp":"2024-03-09T15:07:33.551044+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.551044+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":1300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:12:12.573620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5607,"num_read_kb":4937,"num_write":1889,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'441","reported_seq":1118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.687949+0000","last_change":"2024-03-09T15:07:17.687949+0000","last_active":"2024-03-09T15:07:17.687949+0000","last_peered":"2024-03-09T15:07:17.687949+0000","last_clean":"2024-03-09T15:07:17.687949+0000","last_became_active":"2024-03-09T14:29:28.823751+0000","last_became_peered":"2024-03-09T14:29:28.823751+0000","last_unstale":"2024-03-09T15:07:17.687949+0000","last_undegraded":"2024-03-09T15:07:17.687949+0000","last_fullsized":"2024-03-09T15:07:17.687949+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'441","last_scrub_stamp":"2024-03-09T15:07:17.687334+0000","last_deep_scrub":"264'441","last_deep_scrub_stamp":"2024-03-09T15:07:17.687334+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.687334+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:15:40.736410+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262230,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":811,"num_read_kb":6645,"num_write":1426,"num_write_kb":15242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,0],"acting":[2,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"264'439","reported_seq":2032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.574184+0000","last_change":"2024-03-09T15:07:30.574184+0000","last_active":"2024-03-09T15:07:30.574184+0000","last_peered":"2024-03-09T15:07:30.574184+0000","last_clean":"2024-03-09T15:07:30.574184+0000","last_became_active":"2024-03-09T14:28:55.574645+0000","last_became_peered":"2024-03-09T14:28:55.574645+0000","last_unstale":"2024-03-09T15:07:30.574184+0000","last_undegraded":"2024-03-09T15:07:30.574184+0000","last_fullsized":"2024-03-09T15:07:30.574184+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'439","last_scrub_stamp":"2024-03-09T15:07:30.573900+0000","last_deep_scrub":"264'439","last_deep_scrub_stamp":"2024-03-09T15:07:30.573900+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.573900+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:27:16.783946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2503,"num_read_kb":2358,"num_write":585,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":218,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'378","reported_seq":1056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:58.056211+0000","last_change":"2024-03-09T15:07:58.056377+0000","last_active":"2024-03-09T15:07:58.056211+0000","last_peered":"2024-03-09T15:07:58.056211+0000","last_clean":"2024-03-09T15:07:58.056211+0000","last_became_active":"2024-03-09T14:28:53.619291+0000","last_became_peered":"2024-03-09T14:28:53.619291+0000","last_unstale":"2024-03-09T15:07:58.056211+0000","last_undegraded":"2024-03-09T15:07:58.056211+0000","last_fullsized":"2024-03-09T15:07:58.056211+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-03-09T15:07:58.055990+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-03-09T15:07:58.055990+0000","last_clean_scrub_stamp":"2024-03-09T15:07:58.055990+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:43:17.532190+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505224,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":587,"num_read_kb":88953,"num_write":1364,"num_write_kb":34328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'359","reported_seq":1913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.857058+0000","last_change":"2024-03-09T15:07:49.857195+0000","last_active":"2024-03-09T15:07:49.857058+0000","last_peered":"2024-03-09T15:07:49.857058+0000","last_clean":"2024-03-09T15:07:49.857058+0000","last_became_active":"2024-03-09T14:28:55.563041+0000","last_became_peered":"2024-03-09T14:28:55.563041+0000","last_unstale":"2024-03-09T15:07:49.857058+0000","last_undegraded":"2024-03-09T15:07:49.857058+0000","last_fullsized":"2024-03-09T15:07:49.857058+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'359","last_scrub_stamp":"2024-03-09T15:07:49.856755+0000","last_deep_scrub":"264'359","last_deep_scrub_stamp":"2024-03-09T15:07:49.856755+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.856755+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:25:39.917609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2055,"num_read_kb":1986,"num_write":393,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'413","reported_seq":1103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:54.638831+0000","last_change":"2024-03-09T15:07:54.639042+0000","last_active":"2024-03-09T15:07:54.638831+0000","last_peered":"2024-03-09T15:07:54.638831+0000","last_clean":"2024-03-09T15:07:54.638831+0000","last_became_active":"2024-03-09T14:28:53.585880+0000","last_became_peered":"2024-03-09T14:28:53.585880+0000","last_unstale":"2024-03-09T15:07:54.638831+0000","last_undegraded":"2024-03-09T15:07:54.638831+0000","last_fullsized":"2024-03-09T15:07:54.638831+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'413","last_scrub_stamp":"2024-03-09T15:07:54.638591+0000","last_deep_scrub":"264'413","last_deep_scrub_stamp":"2024-03-09T15:07:54.638591+0000","last_clean_scrub_stamp":"2024-03-09T15:07:54.638591+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:24:12.481557+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22734,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":653,"num_read_kb":65524,"num_write":1383,"num_write_kb":24882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'121","reported_seq":622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.742500+0000","last_change":"2024-03-09T15:07:16.742500+0000","last_active":"2024-03-09T15:07:16.742500+0000","last_peered":"2024-03-09T15:07:16.742500+0000","last_clean":"2024-03-09T15:07:16.742500+0000","last_became_active":"2024-03-09T14:29:03.660224+0000","last_became_peered":"2024-03-09T14:29:03.660224+0000","last_unstale":"2024-03-09T15:07:16.742500+0000","last_undegraded":"2024-03-09T15:07:16.742500+0000","last_fullsized":"2024-03-09T15:07:16.742500+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-03-09T15:07:16.742103+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-03-09T15:07:16.742103+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.742103+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:21.302474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":112,"num_write":285,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'400","reported_seq":1874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.993238+0000","last_change":"2024-03-09T15:07:48.993307+0000","last_active":"2024-03-09T15:07:48.993238+0000","last_peered":"2024-03-09T15:07:48.993238+0000","last_clean":"2024-03-09T15:07:48.993238+0000","last_became_active":"2024-03-09T14:28:55.596404+0000","last_became_peered":"2024-03-09T14:28:55.596404+0000","last_unstale":"2024-03-09T15:07:48.993238+0000","last_undegraded":"2024-03-09T15:07:48.993238+0000","last_fullsized":"2024-03-09T15:07:48.993238+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'400","last_scrub_stamp":"2024-03-09T15:07:48.993015+0000","last_deep_scrub":"264'400","last_deep_scrub_stamp":"2024-03-09T15:07:48.993015+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.993015+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:24.326671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2183,"num_read_kb":2049,"num_write":485,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'309","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.842272+0000","last_change":"2024-03-09T15:07:56.842399+0000","last_active":"2024-03-09T15:07:56.842272+0000","last_peered":"2024-03-09T15:07:56.842272+0000","last_clean":"2024-03-09T15:07:56.842272+0000","last_became_active":"2024-03-09T14:28:53.610073+0000","last_became_peered":"2024-03-09T14:28:53.610073+0000","last_unstale":"2024-03-09T15:07:56.842272+0000","last_undegraded":"2024-03-09T15:07:56.842272+0000","last_fullsized":"2024-03-09T15:07:56.842272+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'309","last_scrub_stamp":"2024-03-09T15:07:56.842056+0000","last_deep_scrub":"264'309","last_deep_scrub_stamp":"2024-03-09T15:07:56.842056+0000","last_clean_scrub_stamp":"2024-03-09T15:07:56.842056+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:23.088490+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145852,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":1412,"num_write":1145,"num_write_kb":31021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.452439+0000","last_change":"2024-03-09T15:07:35.452439+0000","last_active":"2024-03-09T15:07:35.452439+0000","last_peered":"2024-03-09T15:07:35.452439+0000","last_clean":"2024-03-09T15:07:35.452439+0000","last_became_active":"2024-03-09T14:28:57.606062+0000","last_became_peered":"2024-03-09T14:28:57.606062+0000","last_unstale":"2024-03-09T15:07:35.452439+0000","last_undegraded":"2024-03-09T15:07:35.452439+0000","last_fullsized":"2024-03-09T15:07:35.452439+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.452193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.452193+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.452193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:44:33.485368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'323","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.627696+0000","last_change":"2024-03-09T15:07:47.627857+0000","last_active":"2024-03-09T15:07:47.627696+0000","last_peered":"2024-03-09T15:07:47.627696+0000","last_clean":"2024-03-09T15:07:47.627696+0000","last_became_active":"2024-03-09T14:28:59.622357+0000","last_became_peered":"2024-03-09T14:28:59.622357+0000","last_unstale":"2024-03-09T15:07:47.627696+0000","last_undegraded":"2024-03-09T15:07:47.627696+0000","last_fullsized":"2024-03-09T15:07:47.627696+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-03-09T15:07:47.627486+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-03-09T15:07:47.627486+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.627486+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:28:27.637878+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":1106,"num_write":404,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.020481+0000","last_change":"2024-03-09T15:07:33.020481+0000","last_active":"2024-03-09T15:07:33.020481+0000","last_peered":"2024-03-09T15:07:33.020481+0000","last_clean":"2024-03-09T15:07:33.020481+0000","last_became_active":"2024-03-09T14:29:01.636497+0000","last_became_peered":"2024-03-09T14:29:01.636497+0000","last_unstale":"2024-03-09T15:07:33.020481+0000","last_undegraded":"2024-03-09T15:07:33.020481+0000","last_fullsized":"2024-03-09T15:07:33.020481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:33.020229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:33.020229+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.020229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:11:56.405268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2461","reported_seq":4894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.488869+0000","last_change":"2024-03-09T15:07:19.488869+0000","last_active":"2024-03-09T15:07:19.488869+0000","last_peered":"2024-03-09T15:07:19.488869+0000","last_clean":"2024-03-09T15:07:19.488869+0000","last_became_active":"2024-03-09T14:29:03.664933+0000","last_became_peered":"2024-03-09T14:29:03.664933+0000","last_unstale":"2024-03-09T15:07:19.488869+0000","last_undegraded":"2024-03-09T15:07:19.488869+0000","last_fullsized":"2024-03-09T15:07:19.488869+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2461","last_scrub_stamp":"2024-03-09T15:07:19.488484+0000","last_deep_scrub":"264'2461","last_deep_scrub_stamp":"2024-03-09T15:07:19.488484+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.488484+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":2400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:36:54.865691+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6733,"num_read_kb":6729,"num_write":4969,"num_write_kb":1822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'424","reported_seq":2010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.536092+0000","last_change":"2024-03-09T15:07:31.536092+0000","last_active":"2024-03-09T15:07:31.536092+0000","last_peered":"2024-03-09T15:07:31.536092+0000","last_clean":"2024-03-09T15:07:31.536092+0000","last_became_active":"2024-03-09T14:28:55.594120+0000","last_became_peered":"2024-03-09T14:28:55.594120+0000","last_unstale":"2024-03-09T15:07:31.536092+0000","last_undegraded":"2024-03-09T15:07:31.536092+0000","last_fullsized":"2024-03-09T15:07:31.536092+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'424","last_scrub_stamp":"2024-03-09T15:07:31.535813+0000","last_deep_scrub":"264'424","last_deep_scrub_stamp":"2024-03-09T15:07:31.535813+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.535813+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:44:00.860601+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2334,"num_read_kb":2217,"num_write":521,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'343","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:58.525288+0000","last_change":"2024-03-09T15:07:58.525510+0000","last_active":"2024-03-09T15:07:58.525288+0000","last_peered":"2024-03-09T15:07:58.525288+0000","last_clean":"2024-03-09T15:07:58.525288+0000","last_became_active":"2024-03-09T14:28:53.589914+0000","last_became_peered":"2024-03-09T14:28:53.589914+0000","last_unstale":"2024-03-09T15:07:58.525288+0000","last_undegraded":"2024-03-09T15:07:58.525288+0000","last_fullsized":"2024-03-09T15:07:58.525288+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-03-09T15:07:58.525078+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-03-09T15:07:58.525078+0000","last_clean_scrub_stamp":"2024-03-09T15:07:58.525078+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:23.200320+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097178,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":36278,"num_write":1215,"num_write_kb":26714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:55.001887+0000","last_change":"2024-03-09T15:07:55.001946+0000","last_active":"2024-03-09T15:07:55.001887+0000","last_peered":"2024-03-09T15:07:55.001887+0000","last_clean":"2024-03-09T15:07:55.001887+0000","last_became_active":"2024-03-09T14:28:57.608444+0000","last_became_peered":"2024-03-09T14:28:57.608444+0000","last_unstale":"2024-03-09T15:07:55.001887+0000","last_undegraded":"2024-03-09T15:07:55.001887+0000","last_fullsized":"2024-03-09T15:07:55.001887+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:55.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:55.001685+0000","last_clean_scrub_stamp":"2024-03-09T15:07:55.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:40:08.442011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'68","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:52.865622+0000","last_change":"2024-03-09T15:07:52.865695+0000","last_active":"2024-03-09T15:07:52.865622+0000","last_peered":"2024-03-09T15:07:52.865622+0000","last_clean":"2024-03-09T15:07:52.865622+0000","last_became_active":"2024-03-09T14:28:59.614144+0000","last_became_peered":"2024-03-09T14:28:59.614144+0000","last_unstale":"2024-03-09T15:07:52.865622+0000","last_undegraded":"2024-03-09T15:07:52.865622+0000","last_fullsized":"2024-03-09T15:07:52.865622+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'68","last_scrub_stamp":"2024-03-09T15:07:52.865425+0000","last_deep_scrub":"264'68","last_deep_scrub_stamp":"2024-03-09T15:07:52.865425+0000","last_clean_scrub_stamp":"2024-03-09T15:07:52.865425+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:22:59.674950+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":74,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.728621+0000","last_change":"2024-03-09T15:07:20.728621+0000","last_active":"2024-03-09T15:07:20.728621+0000","last_peered":"2024-03-09T15:07:20.728621+0000","last_clean":"2024-03-09T15:07:20.728621+0000","last_became_active":"2024-03-09T14:29:01.649716+0000","last_became_peered":"2024-03-09T14:29:01.649716+0000","last_unstale":"2024-03-09T15:07:20.728621+0000","last_undegraded":"2024-03-09T15:07:20.728621+0000","last_fullsized":"2024-03-09T15:07:20.728621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.728337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.728337+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.728337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:51:28.102346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'133","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.618295+0000","last_change":"2024-03-09T15:07:24.618367+0000","last_active":"2024-03-09T15:07:24.618295+0000","last_peered":"2024-03-09T15:07:24.618295+0000","last_clean":"2024-03-09T15:07:24.618295+0000","last_became_active":"2024-03-09T14:29:03.676427+0000","last_became_peered":"2024-03-09T14:29:03.676427+0000","last_unstale":"2024-03-09T15:07:24.618295+0000","last_undegraded":"2024-03-09T15:07:24.618295+0000","last_fullsized":"2024-03-09T15:07:24.618295+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'133","last_scrub_stamp":"2024-03-09T15:07:24.618110+0000","last_deep_scrub":"264'133","last_deep_scrub_stamp":"2024-03-09T15:07:24.618110+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.618110+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:34.633535+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":126,"num_write":288,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'348","reported_seq":1739,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.642855+0000","last_change":"2024-03-09T15:07:18.642855+0000","last_active":"2024-03-09T15:07:18.642855+0000","last_peered":"2024-03-09T15:07:18.642855+0000","last_clean":"2024-03-09T15:07:18.642855+0000","last_became_active":"2024-03-09T14:29:28.733522+0000","last_became_peered":"2024-03-09T14:29:28.733522+0000","last_unstale":"2024-03-09T15:07:18.642855+0000","last_undegraded":"2024-03-09T15:07:18.642855+0000","last_fullsized":"2024-03-09T15:07:18.642855+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-03-09T15:07:18.642582+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-03-09T15:07:18.642582+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.642582+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:41:22.443747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1907,"num_read_kb":1804,"num_write":410,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'332","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.877121+0000","last_change":"2024-03-09T15:07:45.877359+0000","last_active":"2024-03-09T15:07:45.877121+0000","last_peered":"2024-03-09T15:07:45.877121+0000","last_clean":"2024-03-09T15:07:45.877121+0000","last_became_active":"2024-03-09T14:28:53.633368+0000","last_became_peered":"2024-03-09T14:28:53.633368+0000","last_unstale":"2024-03-09T15:07:45.877121+0000","last_undegraded":"2024-03-09T15:07:45.877121+0000","last_fullsized":"2024-03-09T15:07:45.877121+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-03-09T15:07:45.876836+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-03-09T15:07:45.876836+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.876836+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:18.348571+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1917981,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":440,"num_read_kb":7245,"num_write":1144,"num_write_kb":29598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:59.092470+0000","last_change":"2024-03-09T15:07:59.092525+0000","last_active":"2024-03-09T15:07:59.092470+0000","last_peered":"2024-03-09T15:07:59.092470+0000","last_clean":"2024-03-09T15:07:59.092470+0000","last_became_active":"2024-03-09T14:28:57.613841+0000","last_became_peered":"2024-03-09T14:28:57.613841+0000","last_unstale":"2024-03-09T15:07:59.092470+0000","last_undegraded":"2024-03-09T15:07:59.092470+0000","last_fullsized":"2024-03-09T15:07:59.092470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:59.092283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:59.092283+0000","last_clean_scrub_stamp":"2024-03-09T15:07:59.092283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:55:18.707256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'109","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.725975+0000","last_change":"2024-03-09T15:07:14.726059+0000","last_active":"2024-03-09T15:07:14.725975+0000","last_peered":"2024-03-09T15:07:14.725975+0000","last_clean":"2024-03-09T15:07:14.725975+0000","last_became_active":"2024-03-09T14:28:59.619147+0000","last_became_peered":"2024-03-09T14:28:59.619147+0000","last_unstale":"2024-03-09T15:07:14.725975+0000","last_undegraded":"2024-03-09T15:07:14.725975+0000","last_fullsized":"2024-03-09T15:07:14.725975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-03-09T15:07:14.725790+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-03-09T15:07:14.725790+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.725790+0000","objects_scrubbed":6,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:39:52.182703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":102,"num_write":78,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'535","reported_seq":3858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.998546+0000","last_change":"2024-03-09T15:07:31.998546+0000","last_active":"2024-03-09T15:07:31.998546+0000","last_peered":"2024-03-09T15:07:31.998546+0000","last_clean":"2024-03-09T15:07:31.998546+0000","last_became_active":"2024-03-09T14:29:01.636743+0000","last_became_peered":"2024-03-09T14:29:01.636743+0000","last_unstale":"2024-03-09T15:07:31.998546+0000","last_undegraded":"2024-03-09T15:07:31.998546+0000","last_fullsized":"2024-03-09T15:07:31.998546+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'535","last_scrub_stamp":"2024-03-09T15:07:31.998158+0000","last_deep_scrub":"264'535","last_deep_scrub_stamp":"2024-03-09T15:07:31.998158+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.998158+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:35:25.070046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'199","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.779254+0000","last_change":"2024-03-09T15:07:17.779323+0000","last_active":"2024-03-09T15:07:17.779254+0000","last_peered":"2024-03-09T15:07:17.779254+0000","last_clean":"2024-03-09T15:07:17.779254+0000","last_became_active":"2024-03-09T14:29:03.649194+0000","last_became_peered":"2024-03-09T14:29:03.649194+0000","last_unstale":"2024-03-09T15:07:17.779254+0000","last_undegraded":"2024-03-09T15:07:17.779254+0000","last_fullsized":"2024-03-09T15:07:17.779254+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-03-09T15:07:17.779057+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-03-09T15:07:17.779057+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.779057+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:30:24.656524+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":551,"num_read_kb":549,"num_write":426,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'372","reported_seq":1855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.998850+0000","last_change":"2024-03-09T15:07:45.998944+0000","last_active":"2024-03-09T15:07:45.998850+0000","last_peered":"2024-03-09T15:07:45.998850+0000","last_clean":"2024-03-09T15:07:45.998850+0000","last_became_active":"2024-03-09T14:28:55.592359+0000","last_became_peered":"2024-03-09T14:28:55.592359+0000","last_unstale":"2024-03-09T15:07:45.998850+0000","last_undegraded":"2024-03-09T15:07:45.998850+0000","last_fullsized":"2024-03-09T15:07:45.998850+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-03-09T15:07:45.998658+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-03-09T15:07:45.998658+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.998658+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:30.189276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2105,"num_read_kb":2015,"num_write":416,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'285","reported_seq":902,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.227860+0000","last_change":"2024-03-09T15:07:38.228128+0000","last_active":"2024-03-09T15:07:38.227860+0000","last_peered":"2024-03-09T15:07:38.227860+0000","last_clean":"2024-03-09T15:07:38.227860+0000","last_became_active":"2024-03-09T14:28:53.631559+0000","last_became_peered":"2024-03-09T14:28:53.631559+0000","last_unstale":"2024-03-09T15:07:38.227860+0000","last_undegraded":"2024-03-09T15:07:38.227860+0000","last_fullsized":"2024-03-09T15:07:38.227860+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'285","last_scrub_stamp":"2024-03-09T15:07:38.227622+0000","last_deep_scrub":"264'285","last_deep_scrub_stamp":"2024-03-09T15:07:38.227622+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.227622+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:56:47.419876+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8554550,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":396,"num_read_kb":6712,"num_write":1052,"num_write_kb":20730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.462553+0000","last_change":"2024-03-09T15:07:33.462553+0000","last_active":"2024-03-09T15:07:33.462553+0000","last_peered":"2024-03-09T15:07:33.462553+0000","last_clean":"2024-03-09T15:07:33.462553+0000","last_became_active":"2024-03-09T14:28:57.605787+0000","last_became_peered":"2024-03-09T14:28:57.605787+0000","last_unstale":"2024-03-09T15:07:33.462553+0000","last_undegraded":"2024-03-09T15:07:33.462553+0000","last_fullsized":"2024-03-09T15:07:33.462553+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:33.462302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:33.462302+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.462302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:32:24.678793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'247","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:50.888665+0000","last_change":"2024-03-09T15:07:50.888752+0000","last_active":"2024-03-09T15:07:50.888665+0000","last_peered":"2024-03-09T15:07:50.888665+0000","last_clean":"2024-03-09T15:07:50.888665+0000","last_became_active":"2024-03-09T14:28:59.626279+0000","last_became_peered":"2024-03-09T14:28:59.626279+0000","last_unstale":"2024-03-09T15:07:50.888665+0000","last_undegraded":"2024-03-09T15:07:50.888665+0000","last_fullsized":"2024-03-09T15:07:50.888665+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'247","last_scrub_stamp":"2024-03-09T15:07:50.888461+0000","last_deep_scrub":"264'247","last_deep_scrub_stamp":"2024-03-09T15:07:50.888461+0000","last_clean_scrub_stamp":"2024-03-09T15:07:50.888461+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:57:19.272093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":970,"num_write":334,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'586","reported_seq":1938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.892927+0000","last_change":"2024-03-09T15:07:33.893056+0000","last_active":"2024-03-09T15:07:33.892927+0000","last_peered":"2024-03-09T15:07:33.892927+0000","last_clean":"2024-03-09T15:07:33.892927+0000","last_became_active":"2024-03-09T14:29:01.628420+0000","last_became_peered":"2024-03-09T14:29:01.628420+0000","last_unstale":"2024-03-09T15:07:33.892927+0000","last_undegraded":"2024-03-09T15:07:33.892927+0000","last_fullsized":"2024-03-09T15:07:33.892927+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'586","last_scrub_stamp":"2024-03-09T15:07:33.892638+0000","last_deep_scrub":"264'586","last_deep_scrub_stamp":"2024-03-09T15:07:33.892638+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.892638+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:25:30.954705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'515","reported_seq":2127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.519735+0000","last_change":"2024-03-09T15:07:30.519735+0000","last_active":"2024-03-09T15:07:30.519735+0000","last_peered":"2024-03-09T15:07:30.519735+0000","last_clean":"2024-03-09T15:07:30.519735+0000","last_became_active":"2024-03-09T14:28:55.582638+0000","last_became_peered":"2024-03-09T14:28:55.582638+0000","last_unstale":"2024-03-09T15:07:30.519735+0000","last_undegraded":"2024-03-09T15:07:30.519735+0000","last_fullsized":"2024-03-09T15:07:30.519735+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'515","last_scrub_stamp":"2024-03-09T15:07:30.519356+0000","last_deep_scrub":"264'515","last_deep_scrub_stamp":"2024-03-09T15:07:30.519356+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.519356+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:46:41.715786+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2835,"num_read_kb":2627,"num_write":675,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'339","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:58.810650+0000","last_change":"2024-03-09T15:07:58.810780+0000","last_active":"2024-03-09T15:07:58.810650+0000","last_peered":"2024-03-09T15:07:58.810650+0000","last_clean":"2024-03-09T15:07:58.810650+0000","last_became_active":"2024-03-09T14:28:53.614586+0000","last_became_peered":"2024-03-09T14:28:53.614586+0000","last_unstale":"2024-03-09T15:07:58.810650+0000","last_undegraded":"2024-03-09T15:07:58.810650+0000","last_fullsized":"2024-03-09T15:07:58.810650+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-03-09T15:07:58.810454+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-03-09T15:07:58.810454+0000","last_clean_scrub_stamp":"2024-03-09T15:07:58.810454+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:19:53.323648+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180167,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":10439,"num_write":1256,"num_write_kb":25392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.993744+0000","last_change":"2024-03-09T15:07:36.993744+0000","last_active":"2024-03-09T15:07:36.993744+0000","last_peered":"2024-03-09T15:07:36.993744+0000","last_clean":"2024-03-09T15:07:36.993744+0000","last_became_active":"2024-03-09T14:28:57.603233+0000","last_became_peered":"2024-03-09T14:28:57.603233+0000","last_unstale":"2024-03-09T15:07:36.993744+0000","last_undegraded":"2024-03-09T15:07:36.993744+0000","last_fullsized":"2024-03-09T15:07:36.993744+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:36.993362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:36.993362+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.993362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:50:38.382666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'340","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.485642+0000","last_change":"2024-03-09T15:07:23.485642+0000","last_active":"2024-03-09T15:07:23.485642+0000","last_peered":"2024-03-09T15:07:23.485642+0000","last_clean":"2024-03-09T15:07:23.485642+0000","last_became_active":"2024-03-09T14:28:59.626371+0000","last_became_peered":"2024-03-09T14:28:59.626371+0000","last_unstale":"2024-03-09T15:07:23.485642+0000","last_undegraded":"2024-03-09T15:07:23.485642+0000","last_fullsized":"2024-03-09T15:07:23.485642+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'340","last_scrub_stamp":"2024-03-09T15:07:23.485354+0000","last_deep_scrub":"264'340","last_deep_scrub_stamp":"2024-03-09T15:07:23.485354+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.485354+0000","objects_scrubbed":9,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:58:29.645072+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46990,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":561,"num_read_kb":1214,"num_write":446,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.556181+0000","last_change":"2024-03-09T15:07:45.556234+0000","last_active":"2024-03-09T15:07:45.556181+0000","last_peered":"2024-03-09T15:07:45.556181+0000","last_clean":"2024-03-09T15:07:45.556181+0000","last_became_active":"2024-03-09T14:29:01.636735+0000","last_became_peered":"2024-03-09T14:29:01.636735+0000","last_unstale":"2024-03-09T15:07:45.556181+0000","last_undegraded":"2024-03-09T15:07:45.556181+0000","last_fullsized":"2024-03-09T15:07:45.556181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:45.555980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:45.555980+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.555980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:49:20.562981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'545","reported_seq":1376,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.508731+0000","last_change":"2024-03-09T15:07:14.508801+0000","last_active":"2024-03-09T15:07:14.508731+0000","last_peered":"2024-03-09T15:07:14.508731+0000","last_clean":"2024-03-09T15:07:14.508731+0000","last_became_active":"2024-03-09T14:29:03.676068+0000","last_became_peered":"2024-03-09T14:29:03.676068+0000","last_unstale":"2024-03-09T15:07:14.508731+0000","last_undegraded":"2024-03-09T15:07:14.508731+0000","last_fullsized":"2024-03-09T15:07:14.508731+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'545","last_scrub_stamp":"2024-03-09T15:07:14.508537+0000","last_deep_scrub":"264'545","last_deep_scrub_stamp":"2024-03-09T15:07:14.508537+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.508537+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:06:49.609530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1331,"num_read_kb":1310,"num_write":1143,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'507","reported_seq":2122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.851323+0000","last_change":"2024-03-09T15:07:48.851323+0000","last_active":"2024-03-09T15:07:48.851323+0000","last_peered":"2024-03-09T15:07:48.851323+0000","last_clean":"2024-03-09T15:07:48.851323+0000","last_became_active":"2024-03-09T14:28:55.562782+0000","last_became_peered":"2024-03-09T14:28:55.562782+0000","last_unstale":"2024-03-09T15:07:48.851323+0000","last_undegraded":"2024-03-09T15:07:48.851323+0000","last_fullsized":"2024-03-09T15:07:48.851323+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'507","last_scrub_stamp":"2024-03-09T15:07:48.851059+0000","last_deep_scrub":"264'507","last_deep_scrub_stamp":"2024-03-09T15:07:48.851059+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.851059+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:43:04.936838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2703,"num_read_kb":2505,"num_write":654,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'320","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:57.809612+0000","last_change":"2024-03-09T15:07:57.809702+0000","last_active":"2024-03-09T15:07:57.809612+0000","last_peered":"2024-03-09T15:07:57.809612+0000","last_clean":"2024-03-09T15:07:57.809612+0000","last_became_active":"2024-03-09T14:28:53.613015+0000","last_became_peered":"2024-03-09T14:28:53.613015+0000","last_unstale":"2024-03-09T15:07:57.809612+0000","last_undegraded":"2024-03-09T15:07:57.809612+0000","last_fullsized":"2024-03-09T15:07:57.809612+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'320","last_scrub_stamp":"2024-03-09T15:07:57.809423+0000","last_deep_scrub":"264'320","last_deep_scrub_stamp":"2024-03-09T15:07:57.809423+0000","last_clean_scrub_stamp":"2024-03-09T15:07:57.809423+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:40:06.906489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":493,"num_read_kb":9909,"num_write":1175,"num_write_kb":22337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.500103+0000","last_change":"2024-03-09T15:07:26.500103+0000","last_active":"2024-03-09T15:07:26.500103+0000","last_peered":"2024-03-09T15:07:26.500103+0000","last_clean":"2024-03-09T15:07:26.500103+0000","last_became_active":"2024-03-09T14:28:57.605493+0000","last_became_peered":"2024-03-09T14:28:57.605493+0000","last_unstale":"2024-03-09T15:07:26.500103+0000","last_undegraded":"2024-03-09T15:07:26.500103+0000","last_fullsized":"2024-03-09T15:07:26.500103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:26.499852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:26.499852+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.499852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:50:05.246070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'267","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:09.129873+0000","last_change":"2024-03-09T15:08:09.129948+0000","last_active":"2024-03-09T15:08:09.129873+0000","last_peered":"2024-03-09T15:08:09.129873+0000","last_clean":"2024-03-09T15:08:09.129873+0000","last_became_active":"2024-03-09T14:28:59.614640+0000","last_became_peered":"2024-03-09T14:28:59.614640+0000","last_unstale":"2024-03-09T15:08:09.129873+0000","last_undegraded":"2024-03-09T15:08:09.129873+0000","last_fullsized":"2024-03-09T15:08:09.129873+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'267","last_scrub_stamp":"2024-03-09T15:08:09.129697+0000","last_deep_scrub":"264'267","last_deep_scrub_stamp":"2024-03-09T15:08:09.129697+0000","last_clean_scrub_stamp":"2024-03-09T15:08:09.129697+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:19:39.398013+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43961,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1047,"num_write":356,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.964788+0000","last_change":"2024-03-09T15:07:35.964788+0000","last_active":"2024-03-09T15:07:35.964788+0000","last_peered":"2024-03-09T15:07:35.964788+0000","last_clean":"2024-03-09T15:07:35.964788+0000","last_became_active":"2024-03-09T14:29:01.627897+0000","last_became_peered":"2024-03-09T14:29:01.627897+0000","last_unstale":"2024-03-09T15:07:35.964788+0000","last_undegraded":"2024-03-09T15:07:35.964788+0000","last_fullsized":"2024-03-09T15:07:35.964788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.964526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.964526+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.964526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:44:17.279534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'107","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.239481+0000","last_change":"2024-03-09T15:07:33.239545+0000","last_active":"2024-03-09T15:07:33.239481+0000","last_peered":"2024-03-09T15:07:33.239481+0000","last_clean":"2024-03-09T15:07:33.239481+0000","last_became_active":"2024-03-09T14:29:03.673265+0000","last_became_peered":"2024-03-09T14:29:03.673265+0000","last_unstale":"2024-03-09T15:07:33.239481+0000","last_undegraded":"2024-03-09T15:07:33.239481+0000","last_fullsized":"2024-03-09T15:07:33.239481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-03-09T15:07:33.239261+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-03-09T15:07:33.239261+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.239261+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:39:44.261038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":93,"num_write":248,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'558","reported_seq":2197,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.192096+0000","last_change":"2024-03-09T15:07:32.192096+0000","last_active":"2024-03-09T15:07:32.192096+0000","last_peered":"2024-03-09T15:07:32.192096+0000","last_clean":"2024-03-09T15:07:32.192096+0000","last_became_active":"2024-03-09T14:28:55.588092+0000","last_became_peered":"2024-03-09T14:28:55.588092+0000","last_unstale":"2024-03-09T15:07:32.192096+0000","last_undegraded":"2024-03-09T15:07:32.192096+0000","last_fullsized":"2024-03-09T15:07:32.192096+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'558","last_scrub_stamp":"2024-03-09T15:07:32.191808+0000","last_deep_scrub":"264'558","last_deep_scrub_stamp":"2024-03-09T15:07:32.191808+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.191808+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:52:46.626276+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2916,"num_read_kb":2661,"num_write":728,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":556,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'301","reported_seq":887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.675925+0000","last_change":"2024-03-09T15:07:15.675925+0000","last_active":"2024-03-09T15:07:15.675925+0000","last_peered":"2024-03-09T15:07:15.675925+0000","last_clean":"2024-03-09T15:07:15.675925+0000","last_became_active":"2024-03-09T14:29:28.822971+0000","last_became_peered":"2024-03-09T14:29:28.822971+0000","last_unstale":"2024-03-09T15:07:15.675925+0000","last_undegraded":"2024-03-09T15:07:15.675925+0000","last_fullsized":"2024-03-09T15:07:15.675925+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'301","last_scrub_stamp":"2024-03-09T15:07:15.675604+0000","last_deep_scrub":"264'301","last_deep_scrub_stamp":"2024-03-09T15:07:15.675604+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.675604+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:44.567227+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262197,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":365,"num_read_kb":22880,"num_write":991,"num_write_kb":75728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.593360+0000","last_change":"2024-03-09T15:07:20.593411+0000","last_active":"2024-03-09T15:07:20.593360+0000","last_peered":"2024-03-09T15:07:20.593360+0000","last_clean":"2024-03-09T15:07:20.593360+0000","last_became_active":"2024-03-09T14:28:57.610472+0000","last_became_peered":"2024-03-09T14:28:57.610472+0000","last_unstale":"2024-03-09T15:07:20.593360+0000","last_undegraded":"2024-03-09T15:07:20.593360+0000","last_fullsized":"2024-03-09T15:07:20.593360+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.593168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.593168+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.593168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:29:16.398211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'311","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.838773+0000","last_change":"2024-03-09T15:07:44.838773+0000","last_active":"2024-03-09T15:07:44.838773+0000","last_peered":"2024-03-09T15:07:44.838773+0000","last_clean":"2024-03-09T15:07:44.838773+0000","last_became_active":"2024-03-09T14:28:59.610930+0000","last_became_peered":"2024-03-09T14:28:59.610930+0000","last_unstale":"2024-03-09T15:07:44.838773+0000","last_undegraded":"2024-03-09T15:07:44.838773+0000","last_fullsized":"2024-03-09T15:07:44.838773+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'311","last_scrub_stamp":"2024-03-09T15:07:44.838298+0000","last_deep_scrub":"264'311","last_deep_scrub_stamp":"2024-03-09T15:07:44.838298+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.838298+0000","objects_scrubbed":8,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:31:47.870542+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48936,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":498,"num_read_kb":1136,"num_write":410,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'561","reported_seq":2063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.783893+0000","last_change":"2024-03-09T15:07:34.783893+0000","last_active":"2024-03-09T15:07:34.783893+0000","last_peered":"2024-03-09T15:07:34.783893+0000","last_clean":"2024-03-09T15:07:34.783893+0000","last_became_active":"2024-03-09T14:29:01.647361+0000","last_became_peered":"2024-03-09T14:29:01.647361+0000","last_unstale":"2024-03-09T15:07:34.783893+0000","last_undegraded":"2024-03-09T15:07:34.783893+0000","last_fullsized":"2024-03-09T15:07:34.783893+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'561","last_scrub_stamp":"2024-03-09T15:07:34.783640+0000","last_deep_scrub":"264'561","last_deep_scrub_stamp":"2024-03-09T15:07:34.783640+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.783640+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:39:17.912636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'138","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.680790+0000","last_change":"2024-03-09T15:07:26.680790+0000","last_active":"2024-03-09T15:07:26.680790+0000","last_peered":"2024-03-09T15:07:26.680790+0000","last_clean":"2024-03-09T15:07:26.680790+0000","last_became_active":"2024-03-09T14:29:03.665744+0000","last_became_peered":"2024-03-09T14:29:03.665744+0000","last_unstale":"2024-03-09T15:07:26.680790+0000","last_undegraded":"2024-03-09T15:07:26.680790+0000","last_fullsized":"2024-03-09T15:07:26.680790+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-03-09T15:07:26.680521+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-03-09T15:07:26.680521+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.680521+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:01.192699+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'383","reported_seq":2005,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.736800+0000","last_change":"2024-03-09T15:07:40.736871+0000","last_active":"2024-03-09T15:07:40.736800+0000","last_peered":"2024-03-09T15:07:40.736800+0000","last_clean":"2024-03-09T15:07:40.736800+0000","last_became_active":"2024-03-09T14:28:55.587413+0000","last_became_peered":"2024-03-09T14:28:55.587413+0000","last_unstale":"2024-03-09T15:07:40.736800+0000","last_undegraded":"2024-03-09T15:07:40.736800+0000","last_fullsized":"2024-03-09T15:07:40.736800+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'383","last_scrub_stamp":"2024-03-09T15:07:40.736592+0000","last_deep_scrub":"264'383","last_deep_scrub_stamp":"2024-03-09T15:07:40.736592+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.736592+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:21:16.406333+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2251,"num_read_kb":2175,"num_write":432,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2785,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'286","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.503429+0000","last_change":"2024-03-09T15:07:36.503537+0000","last_active":"2024-03-09T15:07:36.503429+0000","last_peered":"2024-03-09T15:07:36.503429+0000","last_clean":"2024-03-09T15:07:36.503429+0000","last_became_active":"2024-03-09T14:28:53.639073+0000","last_became_peered":"2024-03-09T14:28:53.639073+0000","last_unstale":"2024-03-09T15:07:36.503429+0000","last_undegraded":"2024-03-09T15:07:36.503429+0000","last_fullsized":"2024-03-09T15:07:36.503429+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'286","last_scrub_stamp":"2024-03-09T15:07:36.503200+0000","last_deep_scrub":"264'286","last_deep_scrub_stamp":"2024-03-09T15:07:36.503200+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.503200+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:19:59.978473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656710,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":422,"num_read_kb":3405,"num_write":1144,"num_write_kb":27946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.643287+0000","last_change":"2024-03-09T15:07:18.643287+0000","last_active":"2024-03-09T15:07:18.643287+0000","last_peered":"2024-03-09T15:07:18.643287+0000","last_clean":"2024-03-09T15:07:18.643287+0000","last_became_active":"2024-03-09T14:28:57.620037+0000","last_became_peered":"2024-03-09T14:28:57.620037+0000","last_unstale":"2024-03-09T15:07:18.643287+0000","last_undegraded":"2024-03-09T15:07:18.643287+0000","last_fullsized":"2024-03-09T15:07:18.643287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:18.642943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:18.642943+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.642943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:49:35.857746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'476","reported_seq":1106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.532891+0000","last_change":"2024-03-09T15:08:01.532969+0000","last_active":"2024-03-09T15:08:01.532891+0000","last_peered":"2024-03-09T15:08:01.532891+0000","last_clean":"2024-03-09T15:08:01.532891+0000","last_became_active":"2024-03-09T14:28:59.625949+0000","last_became_peered":"2024-03-09T14:28:59.625949+0000","last_unstale":"2024-03-09T15:08:01.532891+0000","last_undegraded":"2024-03-09T15:08:01.532891+0000","last_fullsized":"2024-03-09T15:08:01.532891+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'476","last_scrub_stamp":"2024-03-09T15:08:01.532695+0000","last_deep_scrub":"264'476","last_deep_scrub_stamp":"2024-03-09T15:08:01.532695+0000","last_clean_scrub_stamp":"2024-03-09T15:08:01.532695+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:34.450834+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84476,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":828,"num_read_kb":2021,"num_write":686,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.761532+0000","last_change":"2024-03-09T15:07:12.761532+0000","last_active":"2024-03-09T15:07:12.761532+0000","last_peered":"2024-03-09T15:07:12.761532+0000","last_clean":"2024-03-09T15:07:12.761532+0000","last_became_active":"2024-03-09T14:29:01.620136+0000","last_became_peered":"2024-03-09T14:29:01.620136+0000","last_unstale":"2024-03-09T15:07:12.761532+0000","last_undegraded":"2024-03-09T15:07:12.761532+0000","last_fullsized":"2024-03-09T15:07:12.761532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:12.761261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:12.761261+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.761261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:22:11.707212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'161","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.964042+0000","last_change":"2024-03-09T15:07:17.964042+0000","last_active":"2024-03-09T15:07:17.964042+0000","last_peered":"2024-03-09T15:07:17.964042+0000","last_clean":"2024-03-09T15:07:17.964042+0000","last_became_active":"2024-03-09T14:29:03.673216+0000","last_became_peered":"2024-03-09T14:29:03.673216+0000","last_unstale":"2024-03-09T15:07:17.964042+0000","last_undegraded":"2024-03-09T15:07:17.964042+0000","last_fullsized":"2024-03-09T15:07:17.964042+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'161","last_scrub_stamp":"2024-03-09T15:07:17.963795+0000","last_deep_scrub":"264'161","last_deep_scrub_stamp":"2024-03-09T15:07:17.963795+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.963795+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:47:11.924876+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":716,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":343,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'285","reported_seq":1646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.776038+0000","last_change":"2024-03-09T15:07:35.776186+0000","last_active":"2024-03-09T15:07:35.776038+0000","last_peered":"2024-03-09T15:07:35.776038+0000","last_clean":"2024-03-09T15:07:35.776038+0000","last_became_active":"2024-03-09T14:28:55.575211+0000","last_became_peered":"2024-03-09T14:28:55.575211+0000","last_unstale":"2024-03-09T15:07:35.776038+0000","last_undegraded":"2024-03-09T15:07:35.776038+0000","last_fullsized":"2024-03-09T15:07:35.776038+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'285","last_scrub_stamp":"2024-03-09T15:07:35.775806+0000","last_deep_scrub":"264'285","last_deep_scrub_stamp":"2024-03-09T15:07:35.775806+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.775806+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:52:28.874528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1639,"num_read_kb":1592,"num_write":307,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'315","reported_seq":1002,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.125196+0000","last_change":"2024-03-09T15:08:01.125345+0000","last_active":"2024-03-09T15:08:01.125196+0000","last_peered":"2024-03-09T15:08:01.125196+0000","last_clean":"2024-03-09T15:08:01.125196+0000","last_became_active":"2024-03-09T14:28:53.561769+0000","last_became_peered":"2024-03-09T14:28:53.561769+0000","last_unstale":"2024-03-09T15:08:01.125196+0000","last_undegraded":"2024-03-09T15:08:01.125196+0000","last_fullsized":"2024-03-09T15:08:01.125196+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'315","last_scrub_stamp":"2024-03-09T15:08:01.124996+0000","last_deep_scrub":"264'315","last_deep_scrub_stamp":"2024-03-09T15:08:01.124996+0000","last_clean_scrub_stamp":"2024-03-09T15:08:01.124996+0000","objects_scrubbed":9,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:07:56.606095+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":556,"num_read_kb":46371,"num_write":1232,"num_write_kb":14767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.518216+0000","last_change":"2024-03-09T15:07:24.518273+0000","last_active":"2024-03-09T15:07:24.518216+0000","last_peered":"2024-03-09T15:07:24.518216+0000","last_clean":"2024-03-09T15:07:24.518216+0000","last_became_active":"2024-03-09T14:28:57.606029+0000","last_became_peered":"2024-03-09T14:28:57.606029+0000","last_unstale":"2024-03-09T15:07:24.518216+0000","last_undegraded":"2024-03-09T15:07:24.518216+0000","last_fullsized":"2024-03-09T15:07:24.518216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:24.517981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:24.517981+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.517981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:03.615664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'277","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.729802+0000","last_change":"2024-03-09T15:07:23.729911+0000","last_active":"2024-03-09T15:07:23.729802+0000","last_peered":"2024-03-09T15:07:23.729802+0000","last_clean":"2024-03-09T15:07:23.729802+0000","last_became_active":"2024-03-09T14:28:59.630097+0000","last_became_peered":"2024-03-09T14:28:59.630097+0000","last_unstale":"2024-03-09T15:07:23.729802+0000","last_undegraded":"2024-03-09T15:07:23.729802+0000","last_fullsized":"2024-03-09T15:07:23.729802+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'277","last_scrub_stamp":"2024-03-09T15:07:23.729634+0000","last_deep_scrub":"264'277","last_deep_scrub_stamp":"2024-03-09T15:07:23.729634+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.729634+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:54:34.396344+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42990,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":1018,"num_write":414,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13964,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.735309+0000","last_change":"2024-03-09T15:07:30.735368+0000","last_active":"2024-03-09T15:07:30.735309+0000","last_peered":"2024-03-09T15:07:30.735309+0000","last_clean":"2024-03-09T15:07:30.735309+0000","last_became_active":"2024-03-09T14:29:01.647375+0000","last_became_peered":"2024-03-09T14:29:01.647375+0000","last_unstale":"2024-03-09T15:07:30.735309+0000","last_undegraded":"2024-03-09T15:07:30.735309+0000","last_fullsized":"2024-03-09T15:07:30.735309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:30.735096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:30.735096+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.735096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:02:27.562547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'131","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.012999+0000","last_change":"2024-03-09T15:07:11.013027+0000","last_active":"2024-03-09T15:07:11.012999+0000","last_peered":"2024-03-09T15:07:11.012999+0000","last_clean":"2024-03-09T15:07:11.012999+0000","last_became_active":"2024-03-09T14:29:03.677704+0000","last_became_peered":"2024-03-09T14:29:03.677704+0000","last_unstale":"2024-03-09T15:07:11.012999+0000","last_undegraded":"2024-03-09T15:07:11.012999+0000","last_fullsized":"2024-03-09T15:07:11.012999+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-03-09T15:07:11.012928+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-03-09T15:07:11.012928+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.012928+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:47:36.358128+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":309,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'401","reported_seq":2053,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.749796+0000","last_change":"2024-03-09T15:07:33.749866+0000","last_active":"2024-03-09T15:07:33.749796+0000","last_peered":"2024-03-09T15:07:33.749796+0000","last_clean":"2024-03-09T15:07:33.749796+0000","last_became_active":"2024-03-09T14:28:55.577690+0000","last_became_peered":"2024-03-09T14:28:55.577690+0000","last_unstale":"2024-03-09T15:07:33.749796+0000","last_undegraded":"2024-03-09T15:07:33.749796+0000","last_fullsized":"2024-03-09T15:07:33.749796+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'401","last_scrub_stamp":"2024-03-09T15:07:33.749602+0000","last_deep_scrub":"264'401","last_deep_scrub_stamp":"2024-03-09T15:07:33.749602+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.749602+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:10:47.176225+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2493,"num_read_kb":2366,"num_write":474,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2864,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'293","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.224450+0000","last_change":"2024-03-09T15:07:36.224450+0000","last_active":"2024-03-09T15:07:36.224450+0000","last_peered":"2024-03-09T15:07:36.224450+0000","last_clean":"2024-03-09T15:07:36.224450+0000","last_became_active":"2024-03-09T14:28:53.627013+0000","last_became_peered":"2024-03-09T14:28:53.627013+0000","last_unstale":"2024-03-09T15:07:36.224450+0000","last_undegraded":"2024-03-09T15:07:36.224450+0000","last_fullsized":"2024-03-09T15:07:36.224450+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'293","last_scrub_stamp":"2024-03-09T15:07:36.224112+0000","last_deep_scrub":"264'293","last_deep_scrub_stamp":"2024-03-09T15:07:36.224112+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.224112+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:02:25.648110+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242906,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":6489,"num_write":1122,"num_write_kb":11469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.827752+0000","last_change":"2024-03-09T15:07:23.827856+0000","last_active":"2024-03-09T15:07:23.827752+0000","last_peered":"2024-03-09T15:07:23.827752+0000","last_clean":"2024-03-09T15:07:23.827752+0000","last_became_active":"2024-03-09T14:28:57.614028+0000","last_became_peered":"2024-03-09T14:28:57.614028+0000","last_unstale":"2024-03-09T15:07:23.827752+0000","last_undegraded":"2024-03-09T15:07:23.827752+0000","last_fullsized":"2024-03-09T15:07:23.827752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:23.827525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:23.827525+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.827525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:24:15.966605+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'266","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.640027+0000","last_change":"2024-03-09T15:07:16.640027+0000","last_active":"2024-03-09T15:07:16.640027+0000","last_peered":"2024-03-09T15:07:16.640027+0000","last_clean":"2024-03-09T15:07:16.640027+0000","last_became_active":"2024-03-09T14:28:59.613169+0000","last_became_peered":"2024-03-09T14:28:59.613169+0000","last_unstale":"2024-03-09T15:07:16.640027+0000","last_undegraded":"2024-03-09T15:07:16.640027+0000","last_fullsized":"2024-03-09T15:07:16.640027+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-03-09T15:07:16.639752+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-03-09T15:07:16.639752+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.639752+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:43.931037+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":434,"num_read_kb":985,"num_write":344,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'525","reported_seq":4084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.761709+0000","last_change":"2024-03-09T15:07:11.761709+0000","last_active":"2024-03-09T15:07:11.761709+0000","last_peered":"2024-03-09T15:07:11.761709+0000","last_clean":"2024-03-09T15:07:11.761709+0000","last_became_active":"2024-03-09T14:29:01.633363+0000","last_became_peered":"2024-03-09T14:29:01.633363+0000","last_unstale":"2024-03-09T15:07:11.761709+0000","last_undegraded":"2024-03-09T15:07:11.761709+0000","last_fullsized":"2024-03-09T15:07:11.761709+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'525","last_scrub_stamp":"2024-03-09T15:07:11.761590+0000","last_deep_scrub":"264'525","last_deep_scrub_stamp":"2024-03-09T15:07:11.761590+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.761590+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:01.906869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'120","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.054420+0000","last_change":"2024-03-09T15:07:15.054514+0000","last_active":"2024-03-09T15:07:15.054420+0000","last_peered":"2024-03-09T15:07:15.054420+0000","last_clean":"2024-03-09T15:07:15.054420+0000","last_became_active":"2024-03-09T14:29:03.679941+0000","last_became_peered":"2024-03-09T14:29:03.679941+0000","last_unstale":"2024-03-09T15:07:15.054420+0000","last_undegraded":"2024-03-09T15:07:15.054420+0000","last_fullsized":"2024-03-09T15:07:15.054420+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-03-09T15:07:15.054218+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-03-09T15:07:15.054218+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.054218+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:13:22.609108+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1871,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":265,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'459","reported_seq":2162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.779128+0000","last_change":"2024-03-09T15:07:28.779197+0000","last_active":"2024-03-09T15:07:28.779128+0000","last_peered":"2024-03-09T15:07:28.779128+0000","last_clean":"2024-03-09T15:07:28.779128+0000","last_became_active":"2024-03-09T14:28:55.589982+0000","last_became_peered":"2024-03-09T14:28:55.589982+0000","last_unstale":"2024-03-09T15:07:28.779128+0000","last_undegraded":"2024-03-09T15:07:28.779128+0000","last_fullsized":"2024-03-09T15:07:28.779128+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'459","last_scrub_stamp":"2024-03-09T15:07:28.778936+0000","last_deep_scrub":"264'459","last_deep_scrub_stamp":"2024-03-09T15:07:28.778936+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.778936+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:20:52.811305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2457,"num_read_kb":2347,"num_write":517,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'336","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.849767+0000","last_change":"2024-03-09T15:07:45.849767+0000","last_active":"2024-03-09T15:07:45.849767+0000","last_peered":"2024-03-09T15:07:45.849767+0000","last_clean":"2024-03-09T15:07:45.849767+0000","last_became_active":"2024-03-09T14:28:53.596847+0000","last_became_peered":"2024-03-09T14:28:53.596847+0000","last_unstale":"2024-03-09T15:07:45.849767+0000","last_undegraded":"2024-03-09T15:07:45.849767+0000","last_fullsized":"2024-03-09T15:07:45.849767+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-03-09T15:07:45.849293+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-03-09T15:07:45.849293+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.849293+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:11:45.242419+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243083,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":7047,"num_write":1167,"num_write_kb":21742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.572847+0000","last_change":"2024-03-09T15:07:41.572994+0000","last_active":"2024-03-09T15:07:41.572847+0000","last_peered":"2024-03-09T15:07:41.572847+0000","last_clean":"2024-03-09T15:07:41.572847+0000","last_became_active":"2024-03-09T14:28:57.618459+0000","last_became_peered":"2024-03-09T14:28:57.618459+0000","last_unstale":"2024-03-09T15:07:41.572847+0000","last_undegraded":"2024-03-09T15:07:41.572847+0000","last_fullsized":"2024-03-09T15:07:41.572847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:07:41.572624+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:07:41.572624+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.572624+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:59:03.798948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":640,"num_read_kb":640,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'61","reported_seq":576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.019811+0000","last_change":"2024-03-09T15:07:37.019886+0000","last_active":"2024-03-09T15:07:37.019811+0000","last_peered":"2024-03-09T15:07:37.019811+0000","last_clean":"2024-03-09T15:07:37.019811+0000","last_became_active":"2024-03-09T14:28:59.634653+0000","last_became_peered":"2024-03-09T14:28:59.634653+0000","last_unstale":"2024-03-09T15:07:37.019811+0000","last_undegraded":"2024-03-09T15:07:37.019811+0000","last_fullsized":"2024-03-09T15:07:37.019811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'61","last_scrub_stamp":"2024-03-09T15:07:37.019629+0000","last_deep_scrub":"264'61","last_deep_scrub_stamp":"2024-03-09T15:07:37.019629+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.019629+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:56:39.123329+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'537","reported_seq":1996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.258519+0000","last_change":"2024-03-09T15:07:25.258582+0000","last_active":"2024-03-09T15:07:25.258519+0000","last_peered":"2024-03-09T15:07:25.258519+0000","last_clean":"2024-03-09T15:07:25.258519+0000","last_became_active":"2024-03-09T14:29:01.656177+0000","last_became_peered":"2024-03-09T14:29:01.656177+0000","last_unstale":"2024-03-09T15:07:25.258519+0000","last_undegraded":"2024-03-09T15:07:25.258519+0000","last_fullsized":"2024-03-09T15:07:25.258519+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'537","last_scrub_stamp":"2024-03-09T15:07:25.258322+0000","last_deep_scrub":"264'537","last_deep_scrub_stamp":"2024-03-09T15:07:25.258322+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.258322+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:08:40.564114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'150","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.798479+0000","last_change":"2024-03-09T15:07:13.798635+0000","last_active":"2024-03-09T15:07:13.798479+0000","last_peered":"2024-03-09T15:07:13.798479+0000","last_clean":"2024-03-09T15:07:13.798479+0000","last_became_active":"2024-03-09T14:29:03.672416+0000","last_became_peered":"2024-03-09T14:29:03.672416+0000","last_unstale":"2024-03-09T15:07:13.798479+0000","last_undegraded":"2024-03-09T15:07:13.798479+0000","last_fullsized":"2024-03-09T15:07:13.798479+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'150","last_scrub_stamp":"2024-03-09T15:07:13.798260+0000","last_deep_scrub":"264'150","last_deep_scrub_stamp":"2024-03-09T15:07:13.798260+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.798260+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:30:31.358279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":118,"num_read_kb":112,"num_write":348,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'862","reported_seq":2485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.889037+0000","last_change":"2024-03-09T15:07:32.889198+0000","last_active":"2024-03-09T15:07:32.889037+0000","last_peered":"2024-03-09T15:07:32.889037+0000","last_clean":"2024-03-09T15:07:32.889037+0000","last_became_active":"2024-03-09T14:28:55.583618+0000","last_became_peered":"2024-03-09T14:28:55.583618+0000","last_unstale":"2024-03-09T15:07:32.889037+0000","last_undegraded":"2024-03-09T15:07:32.889037+0000","last_fullsized":"2024-03-09T15:07:32.889037+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'862","last_scrub_stamp":"2024-03-09T15:07:32.888792+0000","last_deep_scrub":"264'862","last_deep_scrub_stamp":"2024-03-09T15:07:32.888792+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.888792+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:39:33.341783+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4083,"num_read_kb":3643,"num_write":1199,"num_write_kb":506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'316","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:04.057323+0000","last_change":"2024-03-09T15:08:04.057446+0000","last_active":"2024-03-09T15:08:04.057323+0000","last_peered":"2024-03-09T15:08:04.057323+0000","last_clean":"2024-03-09T15:08:04.057323+0000","last_became_active":"2024-03-09T14:28:53.568002+0000","last_became_peered":"2024-03-09T14:28:53.568002+0000","last_unstale":"2024-03-09T15:08:04.057323+0000","last_undegraded":"2024-03-09T15:08:04.057323+0000","last_fullsized":"2024-03-09T15:08:04.057323+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-03-09T15:08:04.057113+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-03-09T15:08:04.057113+0000","last_clean_scrub_stamp":"2024-03-09T15:08:04.057113+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:20:05.103717+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":642,"num_read_kb":26434,"num_write":1119,"num_write_kb":51619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.851109+0000","last_change":"2024-03-09T15:07:42.851170+0000","last_active":"2024-03-09T15:07:42.851109+0000","last_peered":"2024-03-09T15:07:42.851109+0000","last_clean":"2024-03-09T15:07:42.851109+0000","last_became_active":"2024-03-09T14:28:57.615518+0000","last_became_peered":"2024-03-09T14:28:57.615518+0000","last_unstale":"2024-03-09T15:07:42.851109+0000","last_undegraded":"2024-03-09T15:07:42.851109+0000","last_fullsized":"2024-03-09T15:07:42.851109+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:42.850886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:42.850886+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.850886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:31:54.652894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'366","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.533931+0000","last_change":"2024-03-09T15:07:24.534001+0000","last_active":"2024-03-09T15:07:24.533931+0000","last_peered":"2024-03-09T15:07:24.533931+0000","last_clean":"2024-03-09T15:07:24.533931+0000","last_became_active":"2024-03-09T14:28:59.607095+0000","last_became_peered":"2024-03-09T14:28:59.607095+0000","last_unstale":"2024-03-09T15:07:24.533931+0000","last_undegraded":"2024-03-09T15:07:24.533931+0000","last_fullsized":"2024-03-09T15:07:24.533931+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-03-09T15:07:24.533841+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-03-09T15:07:24.533841+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.533841+0000","objects_scrubbed":9,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:56:28.568205+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47607,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1194,"num_read_kb":1839,"num_write":1728,"num_write_kb":1610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":509628,"num_omap_keys":1178,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.241687+0000","last_change":"2024-03-09T15:07:19.241687+0000","last_active":"2024-03-09T15:07:19.241687+0000","last_peered":"2024-03-09T15:07:19.241687+0000","last_clean":"2024-03-09T15:07:19.241687+0000","last_became_active":"2024-03-09T14:29:01.649769+0000","last_became_peered":"2024-03-09T14:29:01.649769+0000","last_unstale":"2024-03-09T15:07:19.241687+0000","last_undegraded":"2024-03-09T15:07:19.241687+0000","last_fullsized":"2024-03-09T15:07:19.241687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:19.241439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:19.241439+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.241439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:46.292381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'143","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.002404+0000","last_change":"2024-03-09T15:07:17.002467+0000","last_active":"2024-03-09T15:07:17.002404+0000","last_peered":"2024-03-09T15:07:17.002404+0000","last_clean":"2024-03-09T15:07:17.002404+0000","last_became_active":"2024-03-09T14:29:03.678140+0000","last_became_peered":"2024-03-09T14:29:03.678140+0000","last_unstale":"2024-03-09T15:07:17.002404+0000","last_undegraded":"2024-03-09T15:07:17.002404+0000","last_fullsized":"2024-03-09T15:07:17.002404+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'143","last_scrub_stamp":"2024-03-09T15:07:17.002216+0000","last_deep_scrub":"264'143","last_deep_scrub_stamp":"2024-03-09T15:07:17.002216+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.002216+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:57.619898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":150,"num_write":332,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'1641","reported_seq":3319,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.234223+0000","last_change":"2024-03-09T15:07:30.234293+0000","last_active":"2024-03-09T15:07:30.234223+0000","last_peered":"2024-03-09T15:07:30.234223+0000","last_clean":"2024-03-09T15:07:30.234223+0000","last_became_active":"2024-03-09T14:28:55.596219+0000","last_became_peered":"2024-03-09T14:28:55.596219+0000","last_unstale":"2024-03-09T15:07:30.234223+0000","last_undegraded":"2024-03-09T15:07:30.234223+0000","last_fullsized":"2024-03-09T15:07:30.234223+0000","mapping_epoch":25,"log_start":"264'1600","ondisk_log_start":"264'1600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1641","last_scrub_stamp":"2024-03-09T15:07:30.234005+0000","last_deep_scrub":"264'1641","last_deep_scrub_stamp":"2024-03-09T15:07:30.234005+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.234005+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":1600,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:38:17.905569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6749,"num_read_kb":5786,"num_write":2314,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'119","reported_seq":680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:52.943960+0000","last_change":"2024-03-09T15:07:52.944051+0000","last_active":"2024-03-09T15:07:52.943960+0000","last_peered":"2024-03-09T15:07:52.943960+0000","last_clean":"2024-03-09T15:07:52.943960+0000","last_became_active":"2024-03-09T14:28:36.802270+0000","last_became_peered":"2024-03-09T14:28:36.802270+0000","last_unstale":"2024-03-09T15:07:52.943960+0000","last_undegraded":"2024-03-09T15:07:52.943960+0000","last_fullsized":"2024-03-09T15:07:52.943960+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-03-09T15:07:52.943749+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-03-09T15:07:52.943749+0000","last_clean_scrub_stamp":"2024-03-09T15:07:52.943749+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:47.954863+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.539631+0000","last_change":"2024-03-09T15:07:43.539692+0000","last_active":"2024-03-09T15:07:43.539631+0000","last_peered":"2024-03-09T15:07:43.539631+0000","last_clean":"2024-03-09T15:07:43.539631+0000","last_became_active":"2024-03-09T14:28:41.841153+0000","last_became_peered":"2024-03-09T14:28:41.841153+0000","last_unstale":"2024-03-09T15:07:43.539631+0000","last_undegraded":"2024-03-09T15:07:43.539631+0000","last_fullsized":"2024-03-09T15:07:43.539631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:43.539429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:43.539429+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.539429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:00:06.582546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'346","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.045037+0000","last_change":"2024-03-09T15:07:56.045130+0000","last_active":"2024-03-09T15:07:56.045037+0000","last_peered":"2024-03-09T15:07:56.045037+0000","last_clean":"2024-03-09T15:07:56.045037+0000","last_became_active":"2024-03-09T14:28:53.622700+0000","last_became_peered":"2024-03-09T14:28:53.622700+0000","last_unstale":"2024-03-09T15:07:56.045037+0000","last_undegraded":"2024-03-09T15:07:56.045037+0000","last_fullsized":"2024-03-09T15:07:56.045037+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-03-09T15:07:56.044829+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-03-09T15:07:56.044829+0000","last_clean_scrub_stamp":"2024-03-09T15:07:56.044829+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:50:12.996584+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":555,"num_read_kb":30203,"num_write":1261,"num_write_kb":35948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.914090+0000","last_change":"2024-03-09T15:07:38.914142+0000","last_active":"2024-03-09T15:07:38.914090+0000","last_peered":"2024-03-09T15:07:38.914090+0000","last_clean":"2024-03-09T15:07:38.914090+0000","last_became_active":"2024-03-09T14:28:57.606611+0000","last_became_peered":"2024-03-09T14:28:57.606611+0000","last_unstale":"2024-03-09T15:07:38.914090+0000","last_undegraded":"2024-03-09T15:07:38.914090+0000","last_fullsized":"2024-03-09T15:07:38.914090+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:38.913898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:38.913898+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.913898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:16:15.907103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'696","reported_seq":1402,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.524638+0000","last_change":"2024-03-09T15:07:26.524638+0000","last_active":"2024-03-09T15:07:26.524638+0000","last_peered":"2024-03-09T15:07:26.524638+0000","last_clean":"2024-03-09T15:07:26.524638+0000","last_became_active":"2024-03-09T14:28:59.603722+0000","last_became_peered":"2024-03-09T14:28:59.603722+0000","last_unstale":"2024-03-09T15:07:26.524638+0000","last_undegraded":"2024-03-09T15:07:26.524638+0000","last_fullsized":"2024-03-09T15:07:26.524638+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'696","last_scrub_stamp":"2024-03-09T15:07:26.524181+0000","last_deep_scrub":"264'696","last_deep_scrub_stamp":"2024-03-09T15:07:26.524181+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.524181+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:03.721380+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140709,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1362,"num_read_kb":3109,"num_write":1278,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99738,"num_omap_keys":240,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.762353+0000","last_change":"2024-03-09T15:07:33.762353+0000","last_active":"2024-03-09T15:07:33.762353+0000","last_peered":"2024-03-09T15:07:33.762353+0000","last_clean":"2024-03-09T15:07:33.762353+0000","last_became_active":"2024-03-09T14:29:01.647958+0000","last_became_peered":"2024-03-09T14:29:01.647958+0000","last_unstale":"2024-03-09T15:07:33.762353+0000","last_undegraded":"2024-03-09T15:07:33.762353+0000","last_fullsized":"2024-03-09T15:07:33.762353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:33.762182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:33.762182+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.762182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:08:56.374158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'228","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.186660+0000","last_change":"2024-03-09T15:07:43.186660+0000","last_active":"2024-03-09T15:07:43.186660+0000","last_peered":"2024-03-09T15:07:43.186660+0000","last_clean":"2024-03-09T15:07:43.186660+0000","last_became_active":"2024-03-09T14:29:03.680962+0000","last_became_peered":"2024-03-09T14:29:03.680962+0000","last_unstale":"2024-03-09T15:07:43.186660+0000","last_undegraded":"2024-03-09T15:07:43.186660+0000","last_fullsized":"2024-03-09T15:07:43.186660+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'228","last_scrub_stamp":"2024-03-09T15:07:43.186373+0000","last_deep_scrub":"264'228","last_deep_scrub_stamp":"2024-03-09T15:07:43.186373+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.186373+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:20:27.696864+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":425,"num_read_kb":422,"num_write":485,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'390","reported_seq":1957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:50.658757+0000","last_change":"2024-03-09T15:07:50.658757+0000","last_active":"2024-03-09T15:07:50.658757+0000","last_peered":"2024-03-09T15:07:50.658757+0000","last_clean":"2024-03-09T15:07:50.658757+0000","last_became_active":"2024-03-09T14:28:55.575229+0000","last_became_peered":"2024-03-09T14:28:55.575229+0000","last_unstale":"2024-03-09T15:07:50.658757+0000","last_undegraded":"2024-03-09T15:07:50.658757+0000","last_fullsized":"2024-03-09T15:07:50.658757+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'390","last_scrub_stamp":"2024-03-09T15:07:50.658464+0000","last_deep_scrub":"264'390","last_deep_scrub_stamp":"2024-03-09T15:07:50.658464+0000","last_clean_scrub_stamp":"2024-03-09T15:07:50.658464+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:12:48.272493+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2264,"num_read_kb":2158,"num_write":447,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:53.893111+0000","last_change":"2024-03-09T15:07:53.893170+0000","last_active":"2024-03-09T15:07:53.893111+0000","last_peered":"2024-03-09T15:07:53.893111+0000","last_clean":"2024-03-09T15:07:53.893111+0000","last_became_active":"2024-03-09T14:28:41.838669+0000","last_became_peered":"2024-03-09T14:28:41.838669+0000","last_unstale":"2024-03-09T15:07:53.893111+0000","last_undegraded":"2024-03-09T15:07:53.893111+0000","last_fullsized":"2024-03-09T15:07:53.893111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:53.892893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:53.892893+0000","last_clean_scrub_stamp":"2024-03-09T15:07:53.892893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:02:45.298652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'309","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:55.614927+0000","last_change":"2024-03-09T15:07:55.615049+0000","last_active":"2024-03-09T15:07:55.614927+0000","last_peered":"2024-03-09T15:07:55.614927+0000","last_clean":"2024-03-09T15:07:55.614927+0000","last_became_active":"2024-03-09T14:28:53.587201+0000","last_became_peered":"2024-03-09T14:28:53.587201+0000","last_unstale":"2024-03-09T15:07:55.614927+0000","last_undegraded":"2024-03-09T15:07:55.614927+0000","last_fullsized":"2024-03-09T15:07:55.614927+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'309","last_scrub_stamp":"2024-03-09T15:07:55.614703+0000","last_deep_scrub":"264'309","last_deep_scrub_stamp":"2024-03-09T15:07:55.614703+0000","last_clean_scrub_stamp":"2024-03-09T15:07:55.614703+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:12:03.088165+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245344,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":38281,"num_write":1125,"num_write_kb":47895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.507070+0000","last_change":"2024-03-09T15:07:39.507070+0000","last_active":"2024-03-09T15:07:39.507070+0000","last_peered":"2024-03-09T15:07:39.507070+0000","last_clean":"2024-03-09T15:07:39.507070+0000","last_became_active":"2024-03-09T14:28:57.612854+0000","last_became_peered":"2024-03-09T14:28:57.612854+0000","last_unstale":"2024-03-09T15:07:39.507070+0000","last_undegraded":"2024-03-09T15:07:39.507070+0000","last_fullsized":"2024-03-09T15:07:39.507070+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:39.506818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:39.506818+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.506818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:10:15.651737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1083","reported_seq":2405,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.896179+0000","last_change":"2024-03-09T15:07:29.896270+0000","last_active":"2024-03-09T15:07:29.896179+0000","last_peered":"2024-03-09T15:07:29.896179+0000","last_clean":"2024-03-09T15:07:29.896179+0000","last_became_active":"2024-03-09T14:28:59.599819+0000","last_became_peered":"2024-03-09T14:28:59.599819+0000","last_unstale":"2024-03-09T15:07:29.896179+0000","last_undegraded":"2024-03-09T15:07:29.896179+0000","last_fullsized":"2024-03-09T15:07:29.896179+0000","mapping_epoch":29,"log_start":"264'1000","ondisk_log_start":"264'1000","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1083","last_scrub_stamp":"2024-03-09T15:07:29.895998+0000","last_deep_scrub":"264'1083","last_deep_scrub_stamp":"2024-03-09T15:07:29.895998+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.895998+0000","objects_scrubbed":11,"log_size":83,"log_dups_size":1000,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:45:02.942611+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132519,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1702,"num_read_kb":3355,"num_write":1050,"num_write_kb":895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.009894+0000","last_change":"2024-03-09T15:07:34.009944+0000","last_active":"2024-03-09T15:07:34.009894+0000","last_peered":"2024-03-09T15:07:34.009894+0000","last_clean":"2024-03-09T15:07:34.009894+0000","last_became_active":"2024-03-09T14:29:01.626582+0000","last_became_peered":"2024-03-09T14:29:01.626582+0000","last_unstale":"2024-03-09T15:07:34.009894+0000","last_undegraded":"2024-03-09T15:07:34.009894+0000","last_fullsized":"2024-03-09T15:07:34.009894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:34.009700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:34.009700+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.009700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:18:35.601769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'110","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.925928+0000","last_change":"2024-03-09T15:07:18.925928+0000","last_active":"2024-03-09T15:07:18.925928+0000","last_peered":"2024-03-09T15:07:18.925928+0000","last_clean":"2024-03-09T15:07:18.925928+0000","last_became_active":"2024-03-09T14:29:03.659633+0000","last_became_peered":"2024-03-09T14:29:03.659633+0000","last_unstale":"2024-03-09T15:07:18.925928+0000","last_undegraded":"2024-03-09T15:07:18.925928+0000","last_fullsized":"2024-03-09T15:07:18.925928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-03-09T15:07:18.925667+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-03-09T15:07:18.925667+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.925667+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:44:07.120542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":112,"num_read_kb":106,"num_write":262,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'373","reported_seq":1948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.864736+0000","last_change":"2024-03-09T15:07:26.864736+0000","last_active":"2024-03-09T15:07:26.864736+0000","last_peered":"2024-03-09T15:07:26.864736+0000","last_clean":"2024-03-09T15:07:26.864736+0000","last_became_active":"2024-03-09T14:28:55.584347+0000","last_became_peered":"2024-03-09T14:28:55.584347+0000","last_unstale":"2024-03-09T15:07:26.864736+0000","last_undegraded":"2024-03-09T15:07:26.864736+0000","last_fullsized":"2024-03-09T15:07:26.864736+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-03-09T15:07:26.864470+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-03-09T15:07:26.864470+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.864470+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:25:03.787698+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2124,"num_read_kb":2043,"num_write":421,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.462815+0000","last_change":"2024-03-09T15:07:27.462867+0000","last_active":"2024-03-09T15:07:27.462815+0000","last_peered":"2024-03-09T15:07:27.462815+0000","last_clean":"2024-03-09T15:07:27.462815+0000","last_became_active":"2024-03-09T14:28:41.836544+0000","last_became_peered":"2024-03-09T14:28:41.836544+0000","last_unstale":"2024-03-09T15:07:27.462815+0000","last_undegraded":"2024-03-09T15:07:27.462815+0000","last_fullsized":"2024-03-09T15:07:27.462815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:27.462629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:27.462629+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.462629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:59.961585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'334","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.600297+0000","last_change":"2024-03-09T15:07:43.600403+0000","last_active":"2024-03-09T15:07:43.600297+0000","last_peered":"2024-03-09T15:07:43.600297+0000","last_clean":"2024-03-09T15:07:43.600297+0000","last_became_active":"2024-03-09T14:28:53.626472+0000","last_became_peered":"2024-03-09T14:28:53.626472+0000","last_unstale":"2024-03-09T15:07:43.600297+0000","last_undegraded":"2024-03-09T15:07:43.600297+0000","last_fullsized":"2024-03-09T15:07:43.600297+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'334","last_scrub_stamp":"2024-03-09T15:07:43.600113+0000","last_deep_scrub":"264'334","last_deep_scrub_stamp":"2024-03-09T15:07:43.600113+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.600113+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:29:46.005440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":555,"num_read_kb":1460,"num_write":1312,"num_write_kb":27243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.547225+0000","last_change":"2024-03-09T15:07:22.547225+0000","last_active":"2024-03-09T15:07:22.547225+0000","last_peered":"2024-03-09T15:07:22.547225+0000","last_clean":"2024-03-09T15:07:22.547225+0000","last_became_active":"2024-03-09T14:28:57.609908+0000","last_became_peered":"2024-03-09T14:28:57.609908+0000","last_unstale":"2024-03-09T15:07:22.547225+0000","last_undegraded":"2024-03-09T15:07:22.547225+0000","last_fullsized":"2024-03-09T15:07:22.547225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:22.546969+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:22.546969+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.546969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:51:05.917154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'234","reported_seq":1237,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:00.770457+0000","last_change":"2024-03-09T15:08:00.770549+0000","last_active":"2024-03-09T15:08:00.770457+0000","last_peered":"2024-03-09T15:08:00.770457+0000","last_clean":"2024-03-09T15:08:00.770457+0000","last_became_active":"2024-03-09T14:28:59.627810+0000","last_became_peered":"2024-03-09T14:28:59.627810+0000","last_unstale":"2024-03-09T15:08:00.770457+0000","last_undegraded":"2024-03-09T15:08:00.770457+0000","last_fullsized":"2024-03-09T15:08:00.770457+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'234","last_scrub_stamp":"2024-03-09T15:08:00.770258+0000","last_deep_scrub":"264'234","last_deep_scrub_stamp":"2024-03-09T15:08:00.770258+0000","last_clean_scrub_stamp":"2024-03-09T15:08:00.770258+0000","objects_scrubbed":9,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:23.348807+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":165,"num_read_kb":157,"num_write":151,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.745470+0000","last_change":"2024-03-09T15:07:36.745529+0000","last_active":"2024-03-09T15:07:36.745470+0000","last_peered":"2024-03-09T15:07:36.745470+0000","last_clean":"2024-03-09T15:07:36.745470+0000","last_became_active":"2024-03-09T14:29:01.647228+0000","last_became_peered":"2024-03-09T14:29:01.647228+0000","last_unstale":"2024-03-09T15:07:36.745470+0000","last_undegraded":"2024-03-09T15:07:36.745470+0000","last_fullsized":"2024-03-09T15:07:36.745470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:36.745263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:36.745263+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.745263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:58.138619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'252","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.987315+0000","last_change":"2024-03-09T15:07:28.987395+0000","last_active":"2024-03-09T15:07:28.987315+0000","last_peered":"2024-03-09T15:07:28.987315+0000","last_clean":"2024-03-09T15:07:28.987315+0000","last_became_active":"2024-03-09T14:29:03.654872+0000","last_became_peered":"2024-03-09T14:29:03.654872+0000","last_unstale":"2024-03-09T15:07:28.987315+0000","last_undegraded":"2024-03-09T15:07:28.987315+0000","last_fullsized":"2024-03-09T15:07:28.987315+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'252","last_scrub_stamp":"2024-03-09T15:07:28.987137+0000","last_deep_scrub":"264'252","last_deep_scrub_stamp":"2024-03-09T15:07:28.987137+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.987137+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:25:09.761733+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":497,"num_write":533,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'465","reported_seq":2025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.829931+0000","last_change":"2024-03-09T15:07:34.830096+0000","last_active":"2024-03-09T15:07:34.829931+0000","last_peered":"2024-03-09T15:07:34.829931+0000","last_clean":"2024-03-09T15:07:34.829931+0000","last_became_active":"2024-03-09T14:28:55.577946+0000","last_became_peered":"2024-03-09T14:28:55.577946+0000","last_unstale":"2024-03-09T15:07:34.829931+0000","last_undegraded":"2024-03-09T15:07:34.829931+0000","last_fullsized":"2024-03-09T15:07:34.829931+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'465","last_scrub_stamp":"2024-03-09T15:07:34.829644+0000","last_deep_scrub":"264'465","last_deep_scrub_stamp":"2024-03-09T15:07:34.829644+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.829644+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:22:52.836038+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2440,"num_read_kb":2271,"num_write":585,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.510608+0000","last_change":"2024-03-09T15:07:44.510661+0000","last_active":"2024-03-09T15:07:44.510608+0000","last_peered":"2024-03-09T15:07:44.510608+0000","last_clean":"2024-03-09T15:07:44.510608+0000","last_became_active":"2024-03-09T14:28:41.842251+0000","last_became_peered":"2024-03-09T14:28:41.842251+0000","last_unstale":"2024-03-09T15:07:44.510608+0000","last_undegraded":"2024-03-09T15:07:44.510608+0000","last_fullsized":"2024-03-09T15:07:44.510608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:44.510412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:44.510412+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.510412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:26:13.565490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'329","reported_seq":988,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.874878+0000","last_change":"2024-03-09T15:07:46.875059+0000","last_active":"2024-03-09T15:07:46.874878+0000","last_peered":"2024-03-09T15:07:46.874878+0000","last_clean":"2024-03-09T15:07:46.874878+0000","last_became_active":"2024-03-09T14:28:53.621914+0000","last_became_peered":"2024-03-09T14:28:53.621914+0000","last_unstale":"2024-03-09T15:07:46.874878+0000","last_undegraded":"2024-03-09T15:07:46.874878+0000","last_fullsized":"2024-03-09T15:07:46.874878+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-03-09T15:07:46.874650+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-03-09T15:07:46.874650+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.874650+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:45:33.688916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1292088,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":22951,"num_write":1137,"num_write_kb":34708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.767830+0000","last_change":"2024-03-09T15:07:43.767890+0000","last_active":"2024-03-09T15:07:43.767830+0000","last_peered":"2024-03-09T15:07:43.767830+0000","last_clean":"2024-03-09T15:07:43.767830+0000","last_became_active":"2024-03-09T14:28:57.613407+0000","last_became_peered":"2024-03-09T14:28:57.613407+0000","last_unstale":"2024-03-09T15:07:43.767830+0000","last_undegraded":"2024-03-09T15:07:43.767830+0000","last_fullsized":"2024-03-09T15:07:43.767830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:43.767632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:43.767632+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.767632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:41.541733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'117","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.986728+0000","last_change":"2024-03-09T15:07:39.986728+0000","last_active":"2024-03-09T15:07:39.986728+0000","last_peered":"2024-03-09T15:07:39.986728+0000","last_clean":"2024-03-09T15:07:39.986728+0000","last_became_active":"2024-03-09T14:28:59.619291+0000","last_became_peered":"2024-03-09T14:28:59.619291+0000","last_unstale":"2024-03-09T15:07:39.986728+0000","last_undegraded":"2024-03-09T15:07:39.986728+0000","last_fullsized":"2024-03-09T15:07:39.986728+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-03-09T15:07:39.986428+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-03-09T15:07:39.986428+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.986428+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:04:35.155185+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":110,"num_write":80,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1510,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.267550+0000","last_change":"2024-03-09T15:07:29.267550+0000","last_active":"2024-03-09T15:07:29.267550+0000","last_peered":"2024-03-09T15:07:29.267550+0000","last_clean":"2024-03-09T15:07:29.267550+0000","last_became_active":"2024-03-09T14:29:01.656672+0000","last_became_peered":"2024-03-09T14:29:01.656672+0000","last_unstale":"2024-03-09T15:07:29.267550+0000","last_undegraded":"2024-03-09T15:07:29.267550+0000","last_fullsized":"2024-03-09T15:07:29.267550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:29.267314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:29.267314+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.267314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:32:52.363075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'104","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.524946+0000","last_change":"2024-03-09T15:07:16.524946+0000","last_active":"2024-03-09T15:07:16.524946+0000","last_peered":"2024-03-09T15:07:16.524946+0000","last_clean":"2024-03-09T15:07:16.524946+0000","last_became_active":"2024-03-09T14:29:03.672534+0000","last_became_peered":"2024-03-09T14:29:03.672534+0000","last_unstale":"2024-03-09T15:07:16.524946+0000","last_undegraded":"2024-03-09T15:07:16.524946+0000","last_fullsized":"2024-03-09T15:07:16.524946+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'104","last_scrub_stamp":"2024-03-09T15:07:16.524692+0000","last_deep_scrub":"264'104","last_deep_scrub_stamp":"2024-03-09T15:07:16.524692+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.524692+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:15:41.281947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":109,"num_write":236,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'464","reported_seq":2141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.862776+0000","last_change":"2024-03-09T15:07:28.862841+0000","last_active":"2024-03-09T15:07:28.862776+0000","last_peered":"2024-03-09T15:07:28.862776+0000","last_clean":"2024-03-09T15:07:28.862776+0000","last_became_active":"2024-03-09T14:28:55.583536+0000","last_became_peered":"2024-03-09T14:28:55.583536+0000","last_unstale":"2024-03-09T15:07:28.862776+0000","last_undegraded":"2024-03-09T15:07:28.862776+0000","last_fullsized":"2024-03-09T15:07:28.862776+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'464","last_scrub_stamp":"2024-03-09T15:07:28.862584+0000","last_deep_scrub":"264'464","last_deep_scrub_stamp":"2024-03-09T15:07:28.862584+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.862584+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:42:09.282270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2714,"num_read_kb":2554,"num_write":561,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'357","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.539456+0000","last_change":"2024-03-09T15:07:42.539682+0000","last_active":"2024-03-09T15:07:42.539456+0000","last_peered":"2024-03-09T15:07:42.539456+0000","last_clean":"2024-03-09T15:07:42.539456+0000","last_became_active":"2024-03-09T14:28:53.626879+0000","last_became_peered":"2024-03-09T14:28:53.626879+0000","last_unstale":"2024-03-09T15:07:42.539456+0000","last_undegraded":"2024-03-09T15:07:42.539456+0000","last_fullsized":"2024-03-09T15:07:42.539456+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-03-09T15:07:42.539208+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-03-09T15:07:42.539208+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.539208+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:40:01.889170+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8554715,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":520,"num_read_kb":4755,"num_write":1359,"num_write_kb":47511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.747925+0000","last_change":"2024-03-09T15:07:38.748027+0000","last_active":"2024-03-09T15:07:38.747925+0000","last_peered":"2024-03-09T15:07:38.747925+0000","last_clean":"2024-03-09T15:07:38.747925+0000","last_became_active":"2024-03-09T14:28:42.126799+0000","last_became_peered":"2024-03-09T14:28:42.126799+0000","last_unstale":"2024-03-09T15:07:38.747925+0000","last_undegraded":"2024-03-09T15:07:38.747925+0000","last_fullsized":"2024-03-09T15:07:38.747925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:38.747638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:38.747638+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.747638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:02:07.045997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.756044+0000","last_change":"2024-03-09T15:07:39.756100+0000","last_active":"2024-03-09T15:07:39.756044+0000","last_peered":"2024-03-09T15:07:39.756044+0000","last_clean":"2024-03-09T15:07:39.756044+0000","last_became_active":"2024-03-09T14:28:57.608723+0000","last_became_peered":"2024-03-09T14:28:57.608723+0000","last_unstale":"2024-03-09T15:07:39.756044+0000","last_undegraded":"2024-03-09T15:07:39.756044+0000","last_fullsized":"2024-03-09T15:07:39.756044+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:39.755832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:39.755832+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.755832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:20:01.073720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'540","reported_seq":1198,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.649192+0000","last_change":"2024-03-09T15:07:51.649288+0000","last_active":"2024-03-09T15:07:51.649192+0000","last_peered":"2024-03-09T15:07:51.649192+0000","last_clean":"2024-03-09T15:07:51.649192+0000","last_became_active":"2024-03-09T14:28:59.624680+0000","last_became_peered":"2024-03-09T14:28:59.624680+0000","last_unstale":"2024-03-09T15:07:51.649192+0000","last_undegraded":"2024-03-09T15:07:51.649192+0000","last_fullsized":"2024-03-09T15:07:51.649192+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'540","last_scrub_stamp":"2024-03-09T15:07:51.649006+0000","last_deep_scrub":"264'540","last_deep_scrub_stamp":"2024-03-09T15:07:51.649006+0000","last_clean_scrub_stamp":"2024-03-09T15:07:51.649006+0000","objects_scrubbed":10,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:14:56.811972+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87910,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":952,"num_read_kb":2224,"num_write":784,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2284,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.713529+0000","last_change":"2024-03-09T15:07:21.713581+0000","last_active":"2024-03-09T15:07:21.713529+0000","last_peered":"2024-03-09T15:07:21.713529+0000","last_clean":"2024-03-09T15:07:21.713529+0000","last_became_active":"2024-03-09T14:29:01.640485+0000","last_became_peered":"2024-03-09T14:29:01.640485+0000","last_unstale":"2024-03-09T15:07:21.713529+0000","last_undegraded":"2024-03-09T15:07:21.713529+0000","last_fullsized":"2024-03-09T15:07:21.713529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:21.713332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:21.713332+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.713332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:28:08.038103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'144","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.644986+0000","last_change":"2024-03-09T15:07:25.645062+0000","last_active":"2024-03-09T15:07:25.644986+0000","last_peered":"2024-03-09T15:07:25.644986+0000","last_clean":"2024-03-09T15:07:25.644986+0000","last_became_active":"2024-03-09T14:29:03.676032+0000","last_became_peered":"2024-03-09T14:29:03.676032+0000","last_unstale":"2024-03-09T15:07:25.644986+0000","last_undegraded":"2024-03-09T15:07:25.644986+0000","last_fullsized":"2024-03-09T15:07:25.644986+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-03-09T15:07:25.644805+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-03-09T15:07:25.644805+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.644805+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:18.054345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":195,"num_read_kb":176,"num_write":349,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'353","reported_seq":1754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.636412+0000","last_change":"2024-03-09T15:07:48.636572+0000","last_active":"2024-03-09T15:07:48.636412+0000","last_peered":"2024-03-09T15:07:48.636412+0000","last_clean":"2024-03-09T15:07:48.636412+0000","last_became_active":"2024-03-09T14:28:55.582743+0000","last_became_peered":"2024-03-09T14:28:55.582743+0000","last_unstale":"2024-03-09T15:07:48.636412+0000","last_undegraded":"2024-03-09T15:07:48.636412+0000","last_fullsized":"2024-03-09T15:07:48.636412+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'353","last_scrub_stamp":"2024-03-09T15:07:48.636186+0000","last_deep_scrub":"264'353","last_deep_scrub_stamp":"2024-03-09T15:07:48.636186+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.636186+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:25:47.111839+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1869,"num_read_kb":1781,"num_write":409,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'326","reported_seq":996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.709252+0000","last_change":"2024-03-09T15:07:40.709441+0000","last_active":"2024-03-09T15:07:40.709252+0000","last_peered":"2024-03-09T15:07:40.709252+0000","last_clean":"2024-03-09T15:07:40.709252+0000","last_became_active":"2024-03-09T14:28:53.589640+0000","last_became_peered":"2024-03-09T14:28:53.589640+0000","last_unstale":"2024-03-09T15:07:40.709252+0000","last_undegraded":"2024-03-09T15:07:40.709252+0000","last_fullsized":"2024-03-09T15:07:40.709252+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-03-09T15:07:40.708947+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-03-09T15:07:40.708947+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.708947+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:22.140344+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048928,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":38844,"num_write":1128,"num_write_kb":48736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":521,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:54.848754+0000","last_change":"2024-03-09T15:07:54.848806+0000","last_active":"2024-03-09T15:07:54.848754+0000","last_peered":"2024-03-09T15:07:54.848754+0000","last_clean":"2024-03-09T15:07:54.848754+0000","last_became_active":"2024-03-09T14:28:42.126201+0000","last_became_peered":"2024-03-09T14:28:42.126201+0000","last_unstale":"2024-03-09T15:07:54.848754+0000","last_undegraded":"2024-03-09T15:07:54.848754+0000","last_fullsized":"2024-03-09T15:07:54.848754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:54.848570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:54.848570+0000","last_clean_scrub_stamp":"2024-03-09T15:07:54.848570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:22:43.845947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.254102+0000","last_change":"2024-03-09T15:07:24.254156+0000","last_active":"2024-03-09T15:07:24.254102+0000","last_peered":"2024-03-09T15:07:24.254102+0000","last_clean":"2024-03-09T15:07:24.254102+0000","last_became_active":"2024-03-09T14:28:57.606429+0000","last_became_peered":"2024-03-09T14:28:57.606429+0000","last_unstale":"2024-03-09T15:07:24.254102+0000","last_undegraded":"2024-03-09T15:07:24.254102+0000","last_fullsized":"2024-03-09T15:07:24.254102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:24.253912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:24.253912+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.253912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:22.015872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'182","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.874432+0000","last_change":"2024-03-09T15:07:33.874519+0000","last_active":"2024-03-09T15:07:33.874432+0000","last_peered":"2024-03-09T15:07:33.874432+0000","last_clean":"2024-03-09T15:07:33.874432+0000","last_became_active":"2024-03-09T14:28:59.626697+0000","last_became_peered":"2024-03-09T14:28:59.626697+0000","last_unstale":"2024-03-09T15:07:33.874432+0000","last_undegraded":"2024-03-09T15:07:33.874432+0000","last_fullsized":"2024-03-09T15:07:33.874432+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-03-09T15:07:33.874235+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-03-09T15:07:33.874235+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.874235+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:05:53.317316+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":207,"num_read_kb":198,"num_write":186,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5650,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'565","reported_seq":2150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.440280+0000","last_change":"2024-03-09T15:07:22.440344+0000","last_active":"2024-03-09T15:07:22.440280+0000","last_peered":"2024-03-09T15:07:22.440280+0000","last_clean":"2024-03-09T15:07:22.440280+0000","last_became_active":"2024-03-09T14:29:01.636912+0000","last_became_peered":"2024-03-09T14:29:01.636912+0000","last_unstale":"2024-03-09T15:07:22.440280+0000","last_undegraded":"2024-03-09T15:07:22.440280+0000","last_fullsized":"2024-03-09T15:07:22.440280+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'565","last_scrub_stamp":"2024-03-09T15:07:22.440085+0000","last_deep_scrub":"264'565","last_deep_scrub_stamp":"2024-03-09T15:07:22.440085+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.440085+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:53.676606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'97","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.003413+0000","last_change":"2024-03-09T15:07:25.003480+0000","last_active":"2024-03-09T15:07:25.003413+0000","last_peered":"2024-03-09T15:07:25.003413+0000","last_clean":"2024-03-09T15:07:25.003413+0000","last_became_active":"2024-03-09T14:29:03.664665+0000","last_became_peered":"2024-03-09T14:29:03.664665+0000","last_unstale":"2024-03-09T15:07:25.003413+0000","last_undegraded":"2024-03-09T15:07:25.003413+0000","last_fullsized":"2024-03-09T15:07:25.003413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-03-09T15:07:25.003215+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-03-09T15:07:25.003215+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.003215+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:36:56.787006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":223,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'346","reported_seq":1837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:50.998894+0000","last_change":"2024-03-09T15:07:50.998986+0000","last_active":"2024-03-09T15:07:50.998894+0000","last_peered":"2024-03-09T15:07:50.998894+0000","last_clean":"2024-03-09T15:07:50.998894+0000","last_became_active":"2024-03-09T14:28:55.601355+0000","last_became_peered":"2024-03-09T14:28:55.601355+0000","last_unstale":"2024-03-09T15:07:50.998894+0000","last_undegraded":"2024-03-09T15:07:50.998894+0000","last_fullsized":"2024-03-09T15:07:50.998894+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-03-09T15:07:50.998673+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-03-09T15:07:50.998673+0000","last_clean_scrub_stamp":"2024-03-09T15:07:50.998673+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:51:30.315116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1977,"num_read_kb":1906,"num_write":384,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'330","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:07.078754+0000","last_change":"2024-03-09T15:08:07.078853+0000","last_active":"2024-03-09T15:08:07.078754+0000","last_peered":"2024-03-09T15:08:07.078754+0000","last_clean":"2024-03-09T15:08:07.078754+0000","last_became_active":"2024-03-09T14:28:53.584728+0000","last_became_peered":"2024-03-09T14:28:53.584728+0000","last_unstale":"2024-03-09T15:08:07.078754+0000","last_undegraded":"2024-03-09T15:08:07.078754+0000","last_fullsized":"2024-03-09T15:08:07.078754+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'330","last_scrub_stamp":"2024-03-09T15:08:07.078538+0000","last_deep_scrub":"264'330","last_deep_scrub_stamp":"2024-03-09T15:08:07.078538+0000","last_clean_scrub_stamp":"2024-03-09T15:08:07.078538+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:46:03.610099+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918035,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":514,"num_read_kb":33595,"num_write":1176,"num_write_kb":22083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.796384+0000","last_change":"2024-03-09T15:07:37.796384+0000","last_active":"2024-03-09T15:07:37.796384+0000","last_peered":"2024-03-09T15:07:37.796384+0000","last_clean":"2024-03-09T15:07:37.796384+0000","last_became_active":"2024-03-09T14:28:41.840168+0000","last_became_peered":"2024-03-09T14:28:41.840168+0000","last_unstale":"2024-03-09T15:07:37.796384+0000","last_undegraded":"2024-03-09T15:07:37.796384+0000","last_fullsized":"2024-03-09T15:07:37.796384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:37.796028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:37.796028+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.796028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:41:01.164969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"264'6","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.810535+0000","last_change":"2024-03-09T15:07:40.810597+0000","last_active":"2024-03-09T15:07:40.810535+0000","last_peered":"2024-03-09T15:07:40.810535+0000","last_clean":"2024-03-09T15:07:40.810535+0000","last_became_active":"2024-03-09T14:28:57.610373+0000","last_became_peered":"2024-03-09T14:28:57.610373+0000","last_unstale":"2024-03-09T15:07:40.810535+0000","last_undegraded":"2024-03-09T15:07:40.810535+0000","last_fullsized":"2024-03-09T15:07:40.810535+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:40.810347+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:40.810347+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.810347+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:42:20.739928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":492,"num_read_kb":799,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'107","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.768275+0000","last_change":"2024-03-09T15:07:25.768414+0000","last_active":"2024-03-09T15:07:25.768275+0000","last_peered":"2024-03-09T15:07:25.768275+0000","last_clean":"2024-03-09T15:07:25.768275+0000","last_became_active":"2024-03-09T14:28:59.615084+0000","last_became_peered":"2024-03-09T14:28:59.615084+0000","last_unstale":"2024-03-09T15:07:25.768275+0000","last_undegraded":"2024-03-09T15:07:25.768275+0000","last_fullsized":"2024-03-09T15:07:25.768275+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-03-09T15:07:25.767984+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-03-09T15:07:25.767984+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.767984+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:01:01.855185+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":100,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'584","reported_seq":2184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.955536+0000","last_change":"2024-03-09T15:07:31.955639+0000","last_active":"2024-03-09T15:07:31.955536+0000","last_peered":"2024-03-09T15:07:31.955536+0000","last_clean":"2024-03-09T15:07:31.955536+0000","last_became_active":"2024-03-09T14:29:01.630598+0000","last_became_peered":"2024-03-09T14:29:01.630598+0000","last_unstale":"2024-03-09T15:07:31.955536+0000","last_undegraded":"2024-03-09T15:07:31.955536+0000","last_fullsized":"2024-03-09T15:07:31.955536+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'584","last_scrub_stamp":"2024-03-09T15:07:31.955337+0000","last_deep_scrub":"264'584","last_deep_scrub_stamp":"2024-03-09T15:07:31.955337+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.955337+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:21.545376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'232","reported_seq":734,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.646284+0000","last_change":"2024-03-09T15:07:21.646416+0000","last_active":"2024-03-09T15:07:21.646284+0000","last_peered":"2024-03-09T15:07:21.646284+0000","last_clean":"2024-03-09T15:07:21.646284+0000","last_became_active":"2024-03-09T14:29:03.684294+0000","last_became_peered":"2024-03-09T14:29:03.684294+0000","last_unstale":"2024-03-09T15:07:21.646284+0000","last_undegraded":"2024-03-09T15:07:21.646284+0000","last_fullsized":"2024-03-09T15:07:21.646284+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'232","last_scrub_stamp":"2024-03-09T15:07:21.646037+0000","last_deep_scrub":"264'232","last_deep_scrub_stamp":"2024-03-09T15:07:21.646037+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.646037+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:01.441895+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":199,"num_write":480,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'366","reported_seq":2044,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:50.906194+0000","last_change":"2024-03-09T15:07:50.906260+0000","last_active":"2024-03-09T15:07:50.906194+0000","last_peered":"2024-03-09T15:07:50.906194+0000","last_clean":"2024-03-09T15:07:50.906194+0000","last_became_active":"2024-03-09T14:28:55.568430+0000","last_became_peered":"2024-03-09T14:28:55.568430+0000","last_unstale":"2024-03-09T15:07:50.906194+0000","last_undegraded":"2024-03-09T15:07:50.906194+0000","last_fullsized":"2024-03-09T15:07:50.906194+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-03-09T15:07:50.906016+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-03-09T15:07:50.906016+0000","last_clean_scrub_stamp":"2024-03-09T15:07:50.906016+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:45:08.495295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2357,"num_read_kb":2282,"num_write":412,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'367","reported_seq":1004,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:57.582970+0000","last_change":"2024-03-09T15:07:57.583185+0000","last_active":"2024-03-09T15:07:57.582970+0000","last_peered":"2024-03-09T15:07:57.582970+0000","last_clean":"2024-03-09T15:07:57.582970+0000","last_became_active":"2024-03-09T14:28:53.589491+0000","last_became_peered":"2024-03-09T14:28:53.589491+0000","last_unstale":"2024-03-09T15:07:57.582970+0000","last_undegraded":"2024-03-09T15:07:57.582970+0000","last_fullsized":"2024-03-09T15:07:57.582970+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'367","last_scrub_stamp":"2024-03-09T15:07:57.582644+0000","last_deep_scrub":"264'367","last_deep_scrub_stamp":"2024-03-09T15:07:57.582644+0000","last_clean_scrub_stamp":"2024-03-09T15:07:57.582644+0000","objects_scrubbed":10,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:15:25.926084+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12403936,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":473,"num_read_kb":37359,"num_write":1237,"num_write_kb":47489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.219447+0000","last_change":"2024-03-09T15:07:35.219447+0000","last_active":"2024-03-09T15:07:35.219447+0000","last_peered":"2024-03-09T15:07:35.219447+0000","last_clean":"2024-03-09T15:07:35.219447+0000","last_became_active":"2024-03-09T14:28:41.840575+0000","last_became_peered":"2024-03-09T14:28:41.840575+0000","last_unstale":"2024-03-09T15:07:35.219447+0000","last_undegraded":"2024-03-09T15:07:35.219447+0000","last_fullsized":"2024-03-09T15:07:35.219447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.219124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.219124+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.219124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:52.826920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"264'4","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:53.027415+0000","last_change":"2024-03-09T15:07:53.027479+0000","last_active":"2024-03-09T15:07:53.027415+0000","last_peered":"2024-03-09T15:07:53.027415+0000","last_clean":"2024-03-09T15:07:53.027415+0000","last_became_active":"2024-03-09T14:28:57.604511+0000","last_became_peered":"2024-03-09T14:28:57.604511+0000","last_unstale":"2024-03-09T15:07:53.027415+0000","last_undegraded":"2024-03-09T15:07:53.027415+0000","last_fullsized":"2024-03-09T15:07:53.027415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:07:53.027214+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:07:53.027214+0000","last_clean_scrub_stamp":"2024-03-09T15:07:53.027214+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:48:31.538028+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":488,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'690","reported_seq":1407,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.989885+0000","last_change":"2024-03-09T15:07:35.989973+0000","last_active":"2024-03-09T15:07:35.989885+0000","last_peered":"2024-03-09T15:07:35.989885+0000","last_clean":"2024-03-09T15:07:35.989885+0000","last_became_active":"2024-03-09T14:28:59.630044+0000","last_became_peered":"2024-03-09T14:28:59.630044+0000","last_unstale":"2024-03-09T15:07:35.989885+0000","last_undegraded":"2024-03-09T15:07:35.989885+0000","last_fullsized":"2024-03-09T15:07:35.989885+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'690","last_scrub_stamp":"2024-03-09T15:07:35.989694+0000","last_deep_scrub":"264'690","last_deep_scrub_stamp":"2024-03-09T15:07:35.989694+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.989694+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:09:36.304072+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140779,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1221,"num_read_kb":2881,"num_write":988,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.943368+0000","last_change":"2024-03-09T15:07:29.943408+0000","last_active":"2024-03-09T15:07:29.943368+0000","last_peered":"2024-03-09T15:07:29.943368+0000","last_clean":"2024-03-09T15:07:29.943368+0000","last_became_active":"2024-03-09T14:29:01.638590+0000","last_became_peered":"2024-03-09T14:29:01.638590+0000","last_unstale":"2024-03-09T15:07:29.943368+0000","last_undegraded":"2024-03-09T15:07:29.943368+0000","last_fullsized":"2024-03-09T15:07:29.943368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:29.943233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:29.943233+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.943233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:27.603634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'124","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.492955+0000","last_change":"2024-03-09T15:07:18.492955+0000","last_active":"2024-03-09T15:07:18.492955+0000","last_peered":"2024-03-09T15:07:18.492955+0000","last_clean":"2024-03-09T15:07:18.492955+0000","last_became_active":"2024-03-09T14:29:03.671138+0000","last_became_peered":"2024-03-09T14:29:03.671138+0000","last_unstale":"2024-03-09T15:07:18.492955+0000","last_undegraded":"2024-03-09T15:07:18.492955+0000","last_fullsized":"2024-03-09T15:07:18.492955+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:18.492696+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:18.492696+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.492696+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:49.039401+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":309,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'134","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.600532+0000","last_change":"2024-03-09T15:07:22.600598+0000","last_active":"2024-03-09T15:07:22.600532+0000","last_peered":"2024-03-09T15:07:22.600532+0000","last_clean":"2024-03-09T15:07:22.600532+0000","last_became_active":"2024-03-09T14:29:03.681920+0000","last_became_peered":"2024-03-09T14:29:03.681920+0000","last_unstale":"2024-03-09T15:07:22.600532+0000","last_undegraded":"2024-03-09T15:07:22.600532+0000","last_fullsized":"2024-03-09T15:07:22.600532+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-03-09T15:07:22.600362+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-03-09T15:07:22.600362+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.600362+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:36:58.000733+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":222,"num_write":331,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'715","reported_seq":2221,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.739180+0000","last_change":"2024-03-09T15:07:31.739283+0000","last_active":"2024-03-09T15:07:31.739180+0000","last_peered":"2024-03-09T15:07:31.739180+0000","last_clean":"2024-03-09T15:07:31.739180+0000","last_became_active":"2024-03-09T14:28:55.589278+0000","last_became_peered":"2024-03-09T14:28:55.589278+0000","last_unstale":"2024-03-09T15:07:31.739180+0000","last_undegraded":"2024-03-09T15:07:31.739180+0000","last_fullsized":"2024-03-09T15:07:31.739180+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'715","last_scrub_stamp":"2024-03-09T15:07:31.738969+0000","last_deep_scrub":"264'715","last_deep_scrub_stamp":"2024-03-09T15:07:31.738969+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.738969+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":700,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:13.359109+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3302,"num_read_kb":2973,"num_write":944,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'315","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.895274+0000","last_change":"2024-03-09T15:07:47.895374+0000","last_active":"2024-03-09T15:07:47.895274+0000","last_peered":"2024-03-09T15:07:47.895274+0000","last_clean":"2024-03-09T15:07:47.895274+0000","last_became_active":"2024-03-09T14:28:53.624231+0000","last_became_peered":"2024-03-09T14:28:53.624231+0000","last_unstale":"2024-03-09T15:07:47.895274+0000","last_undegraded":"2024-03-09T15:07:47.895274+0000","last_fullsized":"2024-03-09T15:07:47.895274+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'315","last_scrub_stamp":"2024-03-09T15:07:47.895072+0000","last_deep_scrub":"264'315","last_deep_scrub_stamp":"2024-03-09T15:07:47.895072+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.895072+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:09:38.205079+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":535,"num_read_kb":58598,"num_write":1161,"num_write_kb":63743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.820780+0000","last_change":"2024-03-09T15:07:25.820832+0000","last_active":"2024-03-09T15:07:25.820780+0000","last_peered":"2024-03-09T15:07:25.820780+0000","last_clean":"2024-03-09T15:07:25.820780+0000","last_became_active":"2024-03-09T14:28:57.616045+0000","last_became_peered":"2024-03-09T14:28:57.616045+0000","last_unstale":"2024-03-09T15:07:25.820780+0000","last_undegraded":"2024-03-09T15:07:25.820780+0000","last_fullsized":"2024-03-09T15:07:25.820780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:25.820588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:25.820588+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.820588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:45:34.309358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'257","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.979858+0000","last_change":"2024-03-09T15:07:43.979942+0000","last_active":"2024-03-09T15:07:43.979858+0000","last_peered":"2024-03-09T15:07:43.979858+0000","last_clean":"2024-03-09T15:07:43.979858+0000","last_became_active":"2024-03-09T14:28:59.615265+0000","last_became_peered":"2024-03-09T14:28:59.615265+0000","last_unstale":"2024-03-09T15:07:43.979858+0000","last_undegraded":"2024-03-09T15:07:43.979858+0000","last_fullsized":"2024-03-09T15:07:43.979858+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-03-09T15:07:43.979641+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-03-09T15:07:43.979641+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.979641+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:01:35.067889+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41654,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":398,"num_read_kb":895,"num_write":318,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.921590+0000","last_change":"2024-03-09T15:07:32.921646+0000","last_active":"2024-03-09T15:07:32.921590+0000","last_peered":"2024-03-09T15:07:32.921590+0000","last_clean":"2024-03-09T15:07:32.921590+0000","last_became_active":"2024-03-09T14:29:01.630021+0000","last_became_peered":"2024-03-09T14:29:01.630021+0000","last_unstale":"2024-03-09T15:07:32.921590+0000","last_undegraded":"2024-03-09T15:07:32.921590+0000","last_fullsized":"2024-03-09T15:07:32.921590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:32.921402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:32.921402+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.921402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:33.388771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'124","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.936675+0000","last_change":"2024-03-09T15:07:27.936739+0000","last_active":"2024-03-09T15:07:27.936675+0000","last_peered":"2024-03-09T15:07:27.936675+0000","last_clean":"2024-03-09T15:07:27.936675+0000","last_became_active":"2024-03-09T14:29:03.660356+0000","last_became_peered":"2024-03-09T14:29:03.660356+0000","last_unstale":"2024-03-09T15:07:27.936675+0000","last_undegraded":"2024-03-09T15:07:27.936675+0000","last_fullsized":"2024-03-09T15:07:27.936675+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:27.936481+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:27.936481+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.936481+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:22:37.729626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'836","reported_seq":2453,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.874067+0000","last_change":"2024-03-09T15:07:22.874136+0000","last_active":"2024-03-09T15:07:22.874067+0000","last_peered":"2024-03-09T15:07:22.874067+0000","last_clean":"2024-03-09T15:07:22.874067+0000","last_became_active":"2024-03-09T14:28:55.591498+0000","last_became_peered":"2024-03-09T14:28:55.591498+0000","last_unstale":"2024-03-09T15:07:22.874067+0000","last_undegraded":"2024-03-09T15:07:22.874067+0000","last_fullsized":"2024-03-09T15:07:22.874067+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'836","last_scrub_stamp":"2024-03-09T15:07:22.873855+0000","last_deep_scrub":"264'836","last_deep_scrub_stamp":"2024-03-09T15:07:22.873855+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.873855+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:25:50.937533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3847,"num_read_kb":3445,"num_write":1140,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'322","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.766359+0000","last_change":"2024-03-09T15:07:13.766359+0000","last_active":"2024-03-09T15:07:13.766359+0000","last_peered":"2024-03-09T15:07:13.766359+0000","last_clean":"2024-03-09T15:07:13.766359+0000","last_became_active":"2024-03-09T14:29:28.729906+0000","last_became_peered":"2024-03-09T14:29:28.729906+0000","last_unstale":"2024-03-09T15:07:13.766359+0000","last_undegraded":"2024-03-09T15:07:13.766359+0000","last_fullsized":"2024-03-09T15:07:13.766359+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'322","last_scrub_stamp":"2024-03-09T15:07:13.766011+0000","last_deep_scrub":"264'322","last_deep_scrub_stamp":"2024-03-09T15:07:13.766011+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.766011+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:54.155006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":3449,"num_write":1268,"num_write_kb":20441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,4],"acting":[2,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:57.026873+0000","last_change":"2024-03-09T15:07:57.026956+0000","last_active":"2024-03-09T15:07:57.026873+0000","last_peered":"2024-03-09T15:07:57.026873+0000","last_clean":"2024-03-09T15:07:57.026873+0000","last_became_active":"2024-03-09T14:28:57.608697+0000","last_became_peered":"2024-03-09T14:28:57.608697+0000","last_unstale":"2024-03-09T15:07:57.026873+0000","last_undegraded":"2024-03-09T15:07:57.026873+0000","last_fullsized":"2024-03-09T15:07:57.026873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:57.026649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:57.026649+0000","last_clean_scrub_stamp":"2024-03-09T15:07:57.026649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:39:02.544082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'51","reported_seq":553,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.701194+0000","last_change":"2024-03-09T15:07:45.701288+0000","last_active":"2024-03-09T15:07:45.701194+0000","last_peered":"2024-03-09T15:07:45.701194+0000","last_clean":"2024-03-09T15:07:45.701194+0000","last_became_active":"2024-03-09T14:28:59.620907+0000","last_became_peered":"2024-03-09T14:28:59.620907+0000","last_unstale":"2024-03-09T15:07:45.701194+0000","last_undegraded":"2024-03-09T15:07:45.701194+0000","last_fullsized":"2024-03-09T15:07:45.701194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'51","last_scrub_stamp":"2024-03-09T15:07:45.700978+0000","last_deep_scrub":"264'51","last_deep_scrub_stamp":"2024-03-09T15:07:45.700978+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.700978+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:34:33.303483+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.979609+0000","last_change":"2024-03-09T15:07:29.979666+0000","last_active":"2024-03-09T15:07:29.979609+0000","last_peered":"2024-03-09T15:07:29.979609+0000","last_clean":"2024-03-09T15:07:29.979609+0000","last_became_active":"2024-03-09T14:29:01.650734+0000","last_became_peered":"2024-03-09T14:29:01.650734+0000","last_unstale":"2024-03-09T15:07:29.979609+0000","last_undegraded":"2024-03-09T15:07:29.979609+0000","last_fullsized":"2024-03-09T15:07:29.979609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:29.979414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:29.979414+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.979414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:52.407738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'223","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.630726+0000","last_change":"2024-03-09T15:07:20.630792+0000","last_active":"2024-03-09T15:07:20.630726+0000","last_peered":"2024-03-09T15:07:20.630726+0000","last_clean":"2024-03-09T15:07:20.630726+0000","last_became_active":"2024-03-09T14:29:03.686455+0000","last_became_peered":"2024-03-09T14:29:03.686455+0000","last_unstale":"2024-03-09T15:07:20.630726+0000","last_undegraded":"2024-03-09T15:07:20.630726+0000","last_fullsized":"2024-03-09T15:07:20.630726+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-03-09T15:07:20.630528+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-03-09T15:07:20.630528+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.630528+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:48.600710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":435,"num_write":508,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'408","reported_seq":1946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:50.018723+0000","last_change":"2024-03-09T15:07:50.018788+0000","last_active":"2024-03-09T15:07:50.018723+0000","last_peered":"2024-03-09T15:07:50.018723+0000","last_clean":"2024-03-09T15:07:50.018723+0000","last_became_active":"2024-03-09T14:28:55.591649+0000","last_became_peered":"2024-03-09T14:28:55.591649+0000","last_unstale":"2024-03-09T15:07:50.018723+0000","last_undegraded":"2024-03-09T15:07:50.018723+0000","last_fullsized":"2024-03-09T15:07:50.018723+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'408","last_scrub_stamp":"2024-03-09T15:07:50.018533+0000","last_deep_scrub":"264'408","last_deep_scrub_stamp":"2024-03-09T15:07:50.018533+0000","last_clean_scrub_stamp":"2024-03-09T15:07:50.018533+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:08:59.558043+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2197,"num_read_kb":2083,"num_write":469,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'286","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.511247+0000","last_change":"2024-03-09T15:07:45.511618+0000","last_active":"2024-03-09T15:07:45.511247+0000","last_peered":"2024-03-09T15:07:45.511247+0000","last_clean":"2024-03-09T15:07:45.511247+0000","last_became_active":"2024-03-09T14:28:53.598990+0000","last_became_peered":"2024-03-09T14:28:53.598990+0000","last_unstale":"2024-03-09T15:07:45.511247+0000","last_undegraded":"2024-03-09T15:07:45.511247+0000","last_fullsized":"2024-03-09T15:07:45.511247+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'286","last_scrub_stamp":"2024-03-09T15:07:45.510984+0000","last_deep_scrub":"264'286","last_deep_scrub_stamp":"2024-03-09T15:07:45.510984+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.510984+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:35:31.097171+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245594,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":365,"num_read_kb":35562,"num_write":1017,"num_write_kb":44906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.858098+0000","last_change":"2024-03-09T15:07:42.858153+0000","last_active":"2024-03-09T15:07:42.858098+0000","last_peered":"2024-03-09T15:07:42.858098+0000","last_clean":"2024-03-09T15:07:42.858098+0000","last_became_active":"2024-03-09T14:28:57.615229+0000","last_became_peered":"2024-03-09T14:28:57.615229+0000","last_unstale":"2024-03-09T15:07:42.858098+0000","last_undegraded":"2024-03-09T15:07:42.858098+0000","last_fullsized":"2024-03-09T15:07:42.858098+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:42.857894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:42.857894+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.857894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:18.550366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'275","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.021627+0000","last_change":"2024-03-09T15:07:41.021709+0000","last_active":"2024-03-09T15:07:41.021627+0000","last_peered":"2024-03-09T15:07:41.021627+0000","last_clean":"2024-03-09T15:07:41.021627+0000","last_became_active":"2024-03-09T14:28:59.615881+0000","last_became_peered":"2024-03-09T14:28:59.615881+0000","last_unstale":"2024-03-09T15:07:41.021627+0000","last_undegraded":"2024-03-09T15:07:41.021627+0000","last_fullsized":"2024-03-09T15:07:41.021627+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'275","last_scrub_stamp":"2024-03-09T15:07:41.021439+0000","last_deep_scrub":"264'275","last_deep_scrub_stamp":"2024-03-09T15:07:41.021439+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.021439+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:37:08.339561+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48426,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":988,"num_write":356,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.254320+0000","last_change":"2024-03-09T15:07:27.254373+0000","last_active":"2024-03-09T15:07:27.254320+0000","last_peered":"2024-03-09T15:07:27.254320+0000","last_clean":"2024-03-09T15:07:27.254320+0000","last_became_active":"2024-03-09T14:29:01.656740+0000","last_became_peered":"2024-03-09T14:29:01.656740+0000","last_unstale":"2024-03-09T15:07:27.254320+0000","last_undegraded":"2024-03-09T15:07:27.254320+0000","last_fullsized":"2024-03-09T15:07:27.254320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:27.254123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:27.254123+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.254123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:56:48.423472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'192","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.487174+0000","last_change":"2024-03-09T15:07:15.487243+0000","last_active":"2024-03-09T15:07:15.487174+0000","last_peered":"2024-03-09T15:07:15.487174+0000","last_clean":"2024-03-09T15:07:15.487174+0000","last_became_active":"2024-03-09T14:29:03.671571+0000","last_became_peered":"2024-03-09T14:29:03.671571+0000","last_unstale":"2024-03-09T15:07:15.487174+0000","last_undegraded":"2024-03-09T15:07:15.487174+0000","last_fullsized":"2024-03-09T15:07:15.487174+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-03-09T15:07:15.486986+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-03-09T15:07:15.486986+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.486986+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:03.941307+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":257,"num_read_kb":221,"num_write":372,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'1161","reported_seq":2786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.950589+0000","last_change":"2024-03-09T15:07:47.950665+0000","last_active":"2024-03-09T15:07:47.950589+0000","last_peered":"2024-03-09T15:07:47.950589+0000","last_clean":"2024-03-09T15:07:47.950589+0000","last_became_active":"2024-03-09T14:28:55.592387+0000","last_became_peered":"2024-03-09T14:28:55.592387+0000","last_unstale":"2024-03-09T15:07:47.950589+0000","last_undegraded":"2024-03-09T15:07:47.950589+0000","last_fullsized":"2024-03-09T15:07:47.950589+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1161","last_scrub_stamp":"2024-03-09T15:07:47.950405+0000","last_deep_scrub":"264'1161","last_deep_scrub_stamp":"2024-03-09T15:07:47.950405+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.950405+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":1100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:16:34.259847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4979,"num_read_kb":4357,"num_write":1600,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'325","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:00.487410+0000","last_change":"2024-03-09T15:08:00.487521+0000","last_active":"2024-03-09T15:08:00.487410+0000","last_peered":"2024-03-09T15:08:00.487410+0000","last_clean":"2024-03-09T15:08:00.487410+0000","last_became_active":"2024-03-09T14:28:53.626736+0000","last_became_peered":"2024-03-09T14:28:53.626736+0000","last_unstale":"2024-03-09T15:08:00.487410+0000","last_undegraded":"2024-03-09T15:08:00.487410+0000","last_fullsized":"2024-03-09T15:08:00.487410+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-03-09T15:08:00.487198+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-03-09T15:08:00.487198+0000","last_clean_scrub_stamp":"2024-03-09T15:08:00.487198+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:39:30.404221+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655827,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":493,"num_read_kb":7830,"num_write":1223,"num_write_kb":47405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.172754+0000","last_change":"2024-03-09T15:07:22.172813+0000","last_active":"2024-03-09T15:07:22.172754+0000","last_peered":"2024-03-09T15:07:22.172754+0000","last_clean":"2024-03-09T15:07:22.172754+0000","last_became_active":"2024-03-09T14:28:57.613999+0000","last_became_peered":"2024-03-09T14:28:57.613999+0000","last_unstale":"2024-03-09T15:07:22.172754+0000","last_undegraded":"2024-03-09T15:07:22.172754+0000","last_fullsized":"2024-03-09T15:07:22.172754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:22.172539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:22.172539+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.172539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:10:05.619875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'259","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.892202+0000","last_change":"2024-03-09T15:07:46.892278+0000","last_active":"2024-03-09T15:07:46.892202+0000","last_peered":"2024-03-09T15:07:46.892202+0000","last_clean":"2024-03-09T15:07:46.892202+0000","last_became_active":"2024-03-09T14:28:59.614754+0000","last_became_peered":"2024-03-09T14:28:59.614754+0000","last_unstale":"2024-03-09T15:07:46.892202+0000","last_undegraded":"2024-03-09T15:07:46.892202+0000","last_fullsized":"2024-03-09T15:07:46.892202+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'259","last_scrub_stamp":"2024-03-09T15:07:46.891972+0000","last_deep_scrub":"264'259","last_deep_scrub_stamp":"2024-03-09T15:07:46.891972+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.891972+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:00:32.451554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43227,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":1017,"num_write":350,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.747798+0000","last_change":"2024-03-09T15:07:32.747857+0000","last_active":"2024-03-09T15:07:32.747798+0000","last_peered":"2024-03-09T15:07:32.747798+0000","last_clean":"2024-03-09T15:07:32.747798+0000","last_became_active":"2024-03-09T14:29:01.647570+0000","last_became_peered":"2024-03-09T14:29:01.647570+0000","last_unstale":"2024-03-09T15:07:32.747798+0000","last_undegraded":"2024-03-09T15:07:32.747798+0000","last_fullsized":"2024-03-09T15:07:32.747798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:32.747585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:32.747585+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.747585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:15:24.826316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'815","reported_seq":2359,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.286495+0000","last_change":"2024-03-09T15:07:26.286639+0000","last_active":"2024-03-09T15:07:26.286495+0000","last_peered":"2024-03-09T15:07:26.286495+0000","last_clean":"2024-03-09T15:07:26.286495+0000","last_became_active":"2024-03-09T14:28:55.599825+0000","last_became_peered":"2024-03-09T14:28:55.599825+0000","last_unstale":"2024-03-09T15:07:26.286495+0000","last_undegraded":"2024-03-09T15:07:26.286495+0000","last_fullsized":"2024-03-09T15:07:26.286495+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'815","last_scrub_stamp":"2024-03-09T15:07:26.286264+0000","last_deep_scrub":"264'815","last_deep_scrub_stamp":"2024-03-09T15:07:26.286264+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.286264+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:29:09.000713+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3687,"num_read_kb":3276,"num_write":1113,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'290","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:03.094619+0000","last_change":"2024-03-09T15:08:03.094763+0000","last_active":"2024-03-09T15:08:03.094619+0000","last_peered":"2024-03-09T15:08:03.094619+0000","last_clean":"2024-03-09T15:08:03.094619+0000","last_became_active":"2024-03-09T14:28:53.565431+0000","last_became_peered":"2024-03-09T14:28:53.565431+0000","last_unstale":"2024-03-09T15:08:03.094619+0000","last_undegraded":"2024-03-09T15:08:03.094619+0000","last_fullsized":"2024-03-09T15:08:03.094619+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'290","last_scrub_stamp":"2024-03-09T15:08:03.094412+0000","last_deep_scrub":"264'290","last_deep_scrub_stamp":"2024-03-09T15:08:03.094412+0000","last_clean_scrub_stamp":"2024-03-09T15:08:03.094412+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:00:27.486382+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655871,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":381,"num_read_kb":7268,"num_write":971,"num_write_kb":31379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.697187+0000","last_change":"2024-03-09T15:07:41.697282+0000","last_active":"2024-03-09T15:07:41.697187+0000","last_peered":"2024-03-09T15:07:41.697187+0000","last_clean":"2024-03-09T15:07:41.697187+0000","last_became_active":"2024-03-09T14:28:57.610126+0000","last_became_peered":"2024-03-09T14:28:57.610126+0000","last_unstale":"2024-03-09T15:07:41.697187+0000","last_undegraded":"2024-03-09T15:07:41.697187+0000","last_fullsized":"2024-03-09T15:07:41.697187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:41.696945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:41.696945+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.696945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:48:55.597106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'478","reported_seq":1113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.906803+0000","last_change":"2024-03-09T15:07:31.906875+0000","last_active":"2024-03-09T15:07:31.906803+0000","last_peered":"2024-03-09T15:07:31.906803+0000","last_clean":"2024-03-09T15:07:31.906803+0000","last_became_active":"2024-03-09T14:28:59.614069+0000","last_became_peered":"2024-03-09T14:28:59.614069+0000","last_unstale":"2024-03-09T15:07:31.906803+0000","last_undegraded":"2024-03-09T15:07:31.906803+0000","last_fullsized":"2024-03-09T15:07:31.906803+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'478","last_scrub_stamp":"2024-03-09T15:07:31.906625+0000","last_deep_scrub":"264'478","last_deep_scrub_stamp":"2024-03-09T15:07:31.906625+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.906625+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:20:10.104166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88057,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":2100,"num_write":750,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22450,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.444264+0000","last_change":"2024-03-09T15:07:20.444317+0000","last_active":"2024-03-09T15:07:20.444264+0000","last_peered":"2024-03-09T15:07:20.444264+0000","last_clean":"2024-03-09T15:07:20.444264+0000","last_became_active":"2024-03-09T14:29:01.639825+0000","last_became_peered":"2024-03-09T14:29:01.639825+0000","last_unstale":"2024-03-09T15:07:20.444264+0000","last_undegraded":"2024-03-09T15:07:20.444264+0000","last_fullsized":"2024-03-09T15:07:20.444264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.444069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.444069+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.444069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:07:45.858578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'151","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.014709+0000","last_change":"2024-03-09T15:07:12.014741+0000","last_active":"2024-03-09T15:07:12.014709+0000","last_peered":"2024-03-09T15:07:12.014709+0000","last_clean":"2024-03-09T15:07:12.014709+0000","last_became_active":"2024-03-09T14:29:03.666515+0000","last_became_peered":"2024-03-09T14:29:03.666515+0000","last_unstale":"2024-03-09T15:07:12.014709+0000","last_undegraded":"2024-03-09T15:07:12.014709+0000","last_fullsized":"2024-03-09T15:07:12.014709+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-03-09T15:07:12.014625+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-03-09T15:07:12.014625+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.014625+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:12:44.954675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":181,"num_write":332,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'875","reported_seq":2630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.730570+0000","last_change":"2024-03-09T15:07:44.730707+0000","last_active":"2024-03-09T15:07:44.730570+0000","last_peered":"2024-03-09T15:07:44.730570+0000","last_clean":"2024-03-09T15:07:44.730570+0000","last_became_active":"2024-03-09T14:28:55.586247+0000","last_became_peered":"2024-03-09T14:28:55.586247+0000","last_unstale":"2024-03-09T15:07:44.730570+0000","last_undegraded":"2024-03-09T15:07:44.730570+0000","last_fullsized":"2024-03-09T15:07:44.730570+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'875","last_scrub_stamp":"2024-03-09T15:07:44.730351+0000","last_deep_scrub":"264'875","last_deep_scrub_stamp":"2024-03-09T15:07:44.730351+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.730351+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:19.053933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4288,"num_read_kb":3851,"num_write":1208,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'317","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.645786+0000","last_change":"2024-03-09T15:07:42.645879+0000","last_active":"2024-03-09T15:07:42.645786+0000","last_peered":"2024-03-09T15:07:42.645786+0000","last_clean":"2024-03-09T15:07:42.645786+0000","last_became_active":"2024-03-09T14:28:53.617832+0000","last_became_peered":"2024-03-09T14:28:53.617832+0000","last_unstale":"2024-03-09T15:07:42.645786+0000","last_undegraded":"2024-03-09T15:07:42.645786+0000","last_fullsized":"2024-03-09T15:07:42.645786+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-03-09T15:07:42.645586+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-03-09T15:07:42.645586+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.645586+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:14:32.395572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22651,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":36525,"num_write":1106,"num_write_kb":22031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.221144+0000","last_change":"2024-03-09T15:07:20.221198+0000","last_active":"2024-03-09T15:07:20.221144+0000","last_peered":"2024-03-09T15:07:20.221144+0000","last_clean":"2024-03-09T15:07:20.221144+0000","last_became_active":"2024-03-09T14:28:57.616057+0000","last_became_peered":"2024-03-09T14:28:57.616057+0000","last_unstale":"2024-03-09T15:07:20.221144+0000","last_undegraded":"2024-03-09T15:07:20.221144+0000","last_fullsized":"2024-03-09T15:07:20.221144+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.220901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.220901+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.220901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:26:17.180137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'275","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.848902+0000","last_change":"2024-03-09T15:07:48.849006+0000","last_active":"2024-03-09T15:07:48.848902+0000","last_peered":"2024-03-09T15:07:48.848902+0000","last_clean":"2024-03-09T15:07:48.848902+0000","last_became_active":"2024-03-09T14:28:59.615193+0000","last_became_peered":"2024-03-09T14:28:59.615193+0000","last_unstale":"2024-03-09T15:07:48.848902+0000","last_undegraded":"2024-03-09T15:07:48.848902+0000","last_fullsized":"2024-03-09T15:07:48.848902+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'275","last_scrub_stamp":"2024-03-09T15:07:48.848686+0000","last_deep_scrub":"264'275","last_deep_scrub_stamp":"2024-03-09T15:07:48.848686+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.848686+0000","objects_scrubbed":8,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:47:07.814657+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43919,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":455,"num_read_kb":986,"num_write":382,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.859441+0000","last_change":"2024-03-09T15:07:20.859552+0000","last_active":"2024-03-09T15:07:20.859441+0000","last_peered":"2024-03-09T15:07:20.859441+0000","last_clean":"2024-03-09T15:07:20.859441+0000","last_became_active":"2024-03-09T14:29:01.660997+0000","last_became_peered":"2024-03-09T14:29:01.660997+0000","last_unstale":"2024-03-09T15:07:20.859441+0000","last_undegraded":"2024-03-09T15:07:20.859441+0000","last_fullsized":"2024-03-09T15:07:20.859441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.859205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.859205+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.859205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:57:46.682370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'190","reported_seq":1394,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.219927+0000","last_change":"2024-03-09T15:07:31.220024+0000","last_active":"2024-03-09T15:07:31.219927+0000","last_peered":"2024-03-09T15:07:31.219927+0000","last_clean":"2024-03-09T15:07:31.219927+0000","last_became_active":"2024-03-09T14:29:03.668833+0000","last_became_peered":"2024-03-09T14:29:03.668833+0000","last_unstale":"2024-03-09T15:07:31.219927+0000","last_undegraded":"2024-03-09T15:07:31.219927+0000","last_fullsized":"2024-03-09T15:07:31.219927+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-03-09T15:07:31.219733+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-03-09T15:07:31.219733+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.219733+0000","objects_scrubbed":9,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:12:05.817079+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2487,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":947,"num_read_kb":932,"num_write":509,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'489","reported_seq":2240,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.976906+0000","last_change":"2024-03-09T15:07:44.976984+0000","last_active":"2024-03-09T15:07:44.976906+0000","last_peered":"2024-03-09T15:07:44.976906+0000","last_clean":"2024-03-09T15:07:44.976906+0000","last_became_active":"2024-03-09T14:28:55.596538+0000","last_became_peered":"2024-03-09T14:28:55.596538+0000","last_unstale":"2024-03-09T15:07:44.976906+0000","last_undegraded":"2024-03-09T15:07:44.976906+0000","last_fullsized":"2024-03-09T15:07:44.976906+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'489","last_scrub_stamp":"2024-03-09T15:07:44.976709+0000","last_deep_scrub":"264'489","last_deep_scrub_stamp":"2024-03-09T15:07:44.976709+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.976709+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:27:06.380305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2772,"num_read_kb":2616,"num_write":579,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2039,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'289","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.857265+0000","last_change":"2024-03-09T15:07:44.857389+0000","last_active":"2024-03-09T15:07:44.857265+0000","last_peered":"2024-03-09T15:07:44.857265+0000","last_clean":"2024-03-09T15:07:44.857265+0000","last_became_active":"2024-03-09T14:28:53.589932+0000","last_became_peered":"2024-03-09T14:28:53.589932+0000","last_unstale":"2024-03-09T15:07:44.857265+0000","last_undegraded":"2024-03-09T15:07:44.857265+0000","last_fullsized":"2024-03-09T15:07:44.857265+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-03-09T15:07:44.857059+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-03-09T15:07:44.857059+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.857059+0000","objects_scrubbed":8,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:57:25.367913+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10486772,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":425,"num_read_kb":14456,"num_write":988,"num_write_kb":42013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.779509+0000","last_change":"2024-03-09T15:07:36.779562+0000","last_active":"2024-03-09T15:07:36.779509+0000","last_peered":"2024-03-09T15:07:36.779509+0000","last_clean":"2024-03-09T15:07:36.779509+0000","last_became_active":"2024-03-09T14:28:57.609903+0000","last_became_peered":"2024-03-09T14:28:57.609903+0000","last_unstale":"2024-03-09T15:07:36.779509+0000","last_undegraded":"2024-03-09T15:07:36.779509+0000","last_fullsized":"2024-03-09T15:07:36.779509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:36.779312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:36.779312+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.779312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:06:51.314999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'264","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.988771+0000","last_change":"2024-03-09T15:07:37.988841+0000","last_active":"2024-03-09T15:07:37.988771+0000","last_peered":"2024-03-09T15:07:37.988771+0000","last_clean":"2024-03-09T15:07:37.988771+0000","last_became_active":"2024-03-09T14:28:59.630460+0000","last_became_peered":"2024-03-09T14:28:59.630460+0000","last_unstale":"2024-03-09T15:07:37.988771+0000","last_undegraded":"2024-03-09T15:07:37.988771+0000","last_fullsized":"2024-03-09T15:07:37.988771+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'264","last_scrub_stamp":"2024-03-09T15:07:37.988583+0000","last_deep_scrub":"264'264","last_deep_scrub_stamp":"2024-03-09T15:07:37.988583+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.988583+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:46.575367+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":1036,"num_write":360,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.818762+0000","last_change":"2024-03-09T15:07:35.818818+0000","last_active":"2024-03-09T15:07:35.818762+0000","last_peered":"2024-03-09T15:07:35.818762+0000","last_clean":"2024-03-09T15:07:35.818762+0000","last_became_active":"2024-03-09T14:29:01.636083+0000","last_became_peered":"2024-03-09T14:29:01.636083+0000","last_unstale":"2024-03-09T15:07:35.818762+0000","last_undegraded":"2024-03-09T15:07:35.818762+0000","last_fullsized":"2024-03-09T15:07:35.818762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.818570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.818570+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.818570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:41:15.118693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'124","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.549045+0000","last_change":"2024-03-09T15:07:12.549133+0000","last_active":"2024-03-09T15:07:12.549045+0000","last_peered":"2024-03-09T15:07:12.549045+0000","last_clean":"2024-03-09T15:07:12.549045+0000","last_became_active":"2024-03-09T14:29:03.677376+0000","last_became_peered":"2024-03-09T14:29:03.677376+0000","last_unstale":"2024-03-09T15:07:12.549045+0000","last_undegraded":"2024-03-09T15:07:12.549045+0000","last_fullsized":"2024-03-09T15:07:12.549045+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:12.548825+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:12.548825+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.548825+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:01:19.400821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":93,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'1142","reported_seq":3003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.617476+0000","last_change":"2024-03-09T15:07:31.617551+0000","last_active":"2024-03-09T15:07:31.617476+0000","last_peered":"2024-03-09T15:07:31.617476+0000","last_clean":"2024-03-09T15:07:31.617476+0000","last_became_active":"2024-03-09T14:28:55.587547+0000","last_became_peered":"2024-03-09T14:28:55.587547+0000","last_unstale":"2024-03-09T15:07:31.617476+0000","last_undegraded":"2024-03-09T15:07:31.617476+0000","last_fullsized":"2024-03-09T15:07:31.617476+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1142","last_scrub_stamp":"2024-03-09T15:07:31.617284+0000","last_deep_scrub":"264'1142","last_deep_scrub_stamp":"2024-03-09T15:07:31.617284+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.617284+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:24.394435+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5366,"num_read_kb":4772,"num_write":1564,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4191,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'284","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.602075+0000","last_change":"2024-03-09T15:07:56.602157+0000","last_active":"2024-03-09T15:07:56.602075+0000","last_peered":"2024-03-09T15:07:56.602075+0000","last_clean":"2024-03-09T15:07:56.602075+0000","last_became_active":"2024-03-09T14:28:53.589407+0000","last_became_peered":"2024-03-09T14:28:53.589407+0000","last_unstale":"2024-03-09T15:07:56.602075+0000","last_undegraded":"2024-03-09T15:07:56.602075+0000","last_fullsized":"2024-03-09T15:07:56.602075+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'284","last_scrub_stamp":"2024-03-09T15:07:56.601879+0000","last_deep_scrub":"264'284","last_deep_scrub_stamp":"2024-03-09T15:07:56.601879+0000","last_clean_scrub_stamp":"2024-03-09T15:07:56.601879+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:09.140840+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":59464,"num_write":1037,"num_write_kb":28198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.818475+0000","last_change":"2024-03-09T15:07:27.818528+0000","last_active":"2024-03-09T15:07:27.818475+0000","last_peered":"2024-03-09T15:07:27.818475+0000","last_clean":"2024-03-09T15:07:27.818475+0000","last_became_active":"2024-03-09T14:28:57.620140+0000","last_became_peered":"2024-03-09T14:28:57.620140+0000","last_unstale":"2024-03-09T15:07:27.818475+0000","last_undegraded":"2024-03-09T15:07:27.818475+0000","last_fullsized":"2024-03-09T15:07:27.818475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:27.818272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:27.818272+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.818272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:07:47.066746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'79","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.737047+0000","last_change":"2024-03-09T15:07:24.737205+0000","last_active":"2024-03-09T15:07:24.737047+0000","last_peered":"2024-03-09T15:07:24.737047+0000","last_clean":"2024-03-09T15:07:24.737047+0000","last_became_active":"2024-03-09T14:28:59.629734+0000","last_became_peered":"2024-03-09T14:28:59.629734+0000","last_unstale":"2024-03-09T15:07:24.737047+0000","last_undegraded":"2024-03-09T15:07:24.737047+0000","last_fullsized":"2024-03-09T15:07:24.737047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'79","last_scrub_stamp":"2024-03-09T15:07:24.736784+0000","last_deep_scrub":"264'79","last_deep_scrub_stamp":"2024-03-09T15:07:24.736784+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.736784+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:02:04.246917+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":70,"num_read_kb":63,"num_write":56,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'540","reported_seq":2063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.197995+0000","last_change":"2024-03-09T15:07:21.198058+0000","last_active":"2024-03-09T15:07:21.197995+0000","last_peered":"2024-03-09T15:07:21.197995+0000","last_clean":"2024-03-09T15:07:21.197995+0000","last_became_active":"2024-03-09T14:29:01.650590+0000","last_became_peered":"2024-03-09T14:29:01.650590+0000","last_unstale":"2024-03-09T15:07:21.197995+0000","last_undegraded":"2024-03-09T15:07:21.197995+0000","last_fullsized":"2024-03-09T15:07:21.197995+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'540","last_scrub_stamp":"2024-03-09T15:07:21.197799+0000","last_deep_scrub":"264'540","last_deep_scrub_stamp":"2024-03-09T15:07:21.197799+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.197799+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:33:51.367630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'124","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.011441+0000","last_change":"2024-03-09T15:07:26.011504+0000","last_active":"2024-03-09T15:07:26.011441+0000","last_peered":"2024-03-09T15:07:26.011441+0000","last_clean":"2024-03-09T15:07:26.011441+0000","last_became_active":"2024-03-09T14:29:03.677064+0000","last_became_peered":"2024-03-09T14:29:03.677064+0000","last_unstale":"2024-03-09T15:07:26.011441+0000","last_undegraded":"2024-03-09T15:07:26.011441+0000","last_fullsized":"2024-03-09T15:07:26.011441+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:26.011253+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:26.011253+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.011253+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:04:51.610682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":150,"num_write":318,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'511","reported_seq":1986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.763467+0000","last_change":"2024-03-09T15:07:34.763605+0000","last_active":"2024-03-09T15:07:34.763467+0000","last_peered":"2024-03-09T15:07:34.763467+0000","last_clean":"2024-03-09T15:07:34.763467+0000","last_became_active":"2024-03-09T14:28:55.610134+0000","last_became_peered":"2024-03-09T14:28:55.610134+0000","last_unstale":"2024-03-09T15:07:34.763467+0000","last_undegraded":"2024-03-09T15:07:34.763467+0000","last_fullsized":"2024-03-09T15:07:34.763467+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'511","last_scrub_stamp":"2024-03-09T15:07:34.763210+0000","last_deep_scrub":"264'511","last_deep_scrub_stamp":"2024-03-09T15:07:34.763210+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.763210+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:43.942046+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2571,"num_read_kb":2332,"num_write":699,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":228,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'430","reported_seq":1157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.545102+0000","last_change":"2024-03-09T15:07:40.545239+0000","last_active":"2024-03-09T15:07:40.545102+0000","last_peered":"2024-03-09T15:07:40.545102+0000","last_clean":"2024-03-09T15:07:40.545102+0000","last_became_active":"2024-03-09T14:28:53.636761+0000","last_became_peered":"2024-03-09T14:28:53.636761+0000","last_unstale":"2024-03-09T15:07:40.545102+0000","last_undegraded":"2024-03-09T15:07:40.545102+0000","last_fullsized":"2024-03-09T15:07:40.545102+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'430","last_scrub_stamp":"2024-03-09T15:07:40.544850+0000","last_deep_scrub":"264'430","last_deep_scrub_stamp":"2024-03-09T15:07:40.544850+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.544850+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:56:02.288859+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":788,"num_read_kb":7041,"num_write":1515,"num_write_kb":16792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.905560+0000","last_change":"2024-03-09T15:07:40.905670+0000","last_active":"2024-03-09T15:07:40.905560+0000","last_peered":"2024-03-09T15:07:40.905560+0000","last_clean":"2024-03-09T15:07:40.905560+0000","last_became_active":"2024-03-09T14:28:57.612982+0000","last_became_peered":"2024-03-09T14:28:57.612982+0000","last_unstale":"2024-03-09T15:07:40.905560+0000","last_undegraded":"2024-03-09T15:07:40.905560+0000","last_fullsized":"2024-03-09T15:07:40.905560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:40.905311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:40.905311+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.905311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:23:55.643584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'296","reported_seq":879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.585872+0000","last_change":"2024-03-09T15:07:51.585960+0000","last_active":"2024-03-09T15:07:51.585872+0000","last_peered":"2024-03-09T15:07:51.585872+0000","last_clean":"2024-03-09T15:07:51.585872+0000","last_became_active":"2024-03-09T14:28:59.601007+0000","last_became_peered":"2024-03-09T14:28:59.601007+0000","last_unstale":"2024-03-09T15:07:51.585872+0000","last_undegraded":"2024-03-09T15:07:51.585872+0000","last_fullsized":"2024-03-09T15:07:51.585872+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'296","last_scrub_stamp":"2024-03-09T15:07:51.585640+0000","last_deep_scrub":"264'296","last_deep_scrub_stamp":"2024-03-09T15:07:51.585640+0000","last_clean_scrub_stamp":"2024-03-09T15:07:51.585640+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:49:09.577984+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58554,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":1103,"num_write":386,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.710682+0000","last_change":"2024-03-09T15:07:28.710682+0000","last_active":"2024-03-09T15:07:28.710682+0000","last_peered":"2024-03-09T15:07:28.710682+0000","last_clean":"2024-03-09T15:07:28.710682+0000","last_became_active":"2024-03-09T14:29:01.657169+0000","last_became_peered":"2024-03-09T14:29:01.657169+0000","last_unstale":"2024-03-09T15:07:28.710682+0000","last_undegraded":"2024-03-09T15:07:28.710682+0000","last_fullsized":"2024-03-09T15:07:28.710682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:28.710441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:28.710441+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.710441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:06:51.547173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'124","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.984410+0000","last_change":"2024-03-09T15:07:27.984410+0000","last_active":"2024-03-09T15:07:27.984410+0000","last_peered":"2024-03-09T15:07:27.984410+0000","last_clean":"2024-03-09T15:07:27.984410+0000","last_became_active":"2024-03-09T14:29:03.669978+0000","last_became_peered":"2024-03-09T14:29:03.669978+0000","last_unstale":"2024-03-09T15:07:27.984410+0000","last_undegraded":"2024-03-09T15:07:27.984410+0000","last_fullsized":"2024-03-09T15:07:27.984410+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:27.984137+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:27.984137+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.984137+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:41:49.859618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":289,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'774","reported_seq":2309,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.881876+0000","last_change":"2024-03-09T15:07:51.881962+0000","last_active":"2024-03-09T15:07:51.881876+0000","last_peered":"2024-03-09T15:07:51.881876+0000","last_clean":"2024-03-09T15:07:51.881876+0000","last_became_active":"2024-03-09T14:28:55.570161+0000","last_became_peered":"2024-03-09T14:28:55.570161+0000","last_unstale":"2024-03-09T15:07:51.881876+0000","last_undegraded":"2024-03-09T15:07:51.881876+0000","last_fullsized":"2024-03-09T15:07:51.881876+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'774","last_scrub_stamp":"2024-03-09T15:07:51.881697+0000","last_deep_scrub":"264'774","last_deep_scrub_stamp":"2024-03-09T15:07:51.881697+0000","last_clean_scrub_stamp":"2024-03-09T15:07:51.881697+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:25.741621+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3636,"num_read_kb":3267,"num_write":1033,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1209,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'351","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.608643+0000","last_change":"2024-03-09T15:07:19.608740+0000","last_active":"2024-03-09T15:07:19.608643+0000","last_peered":"2024-03-09T15:07:19.608643+0000","last_clean":"2024-03-09T15:07:19.608643+0000","last_became_active":"2024-03-09T14:29:28.824399+0000","last_became_peered":"2024-03-09T14:29:28.824399+0000","last_unstale":"2024-03-09T15:07:19.608643+0000","last_undegraded":"2024-03-09T15:07:19.608643+0000","last_fullsized":"2024-03-09T15:07:19.608643+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-03-09T15:07:19.608431+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-03-09T15:07:19.608431+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.608431+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:55:03.616832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":600,"num_read_kb":66383,"num_write":1403,"num_write_kb":58469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.513168+0000","last_change":"2024-03-09T15:07:37.513222+0000","last_active":"2024-03-09T15:07:37.513168+0000","last_peered":"2024-03-09T15:07:37.513168+0000","last_clean":"2024-03-09T15:07:37.513168+0000","last_became_active":"2024-03-09T14:28:57.608639+0000","last_became_peered":"2024-03-09T14:28:57.608639+0000","last_unstale":"2024-03-09T15:07:37.513168+0000","last_undegraded":"2024-03-09T15:07:37.513168+0000","last_fullsized":"2024-03-09T15:07:37.513168+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:37.512944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:37.512944+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.512944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:58:03.637550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'272","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.663652+0000","last_change":"2024-03-09T15:07:49.663738+0000","last_active":"2024-03-09T15:07:49.663652+0000","last_peered":"2024-03-09T15:07:49.663652+0000","last_clean":"2024-03-09T15:07:49.663652+0000","last_became_active":"2024-03-09T14:28:59.623529+0000","last_became_peered":"2024-03-09T14:28:59.623529+0000","last_unstale":"2024-03-09T15:07:49.663652+0000","last_undegraded":"2024-03-09T15:07:49.663652+0000","last_fullsized":"2024-03-09T15:07:49.663652+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'272","last_scrub_stamp":"2024-03-09T15:07:49.663434+0000","last_deep_scrub":"264'272","last_deep_scrub_stamp":"2024-03-09T15:07:49.663434+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.663434+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:32:05.951813+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":971,"num_write":346,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.212326+0000","last_change":"2024-03-09T15:07:23.212326+0000","last_active":"2024-03-09T15:07:23.212326+0000","last_peered":"2024-03-09T15:07:23.212326+0000","last_clean":"2024-03-09T15:07:23.212326+0000","last_became_active":"2024-03-09T14:29:01.651183+0000","last_became_peered":"2024-03-09T14:29:01.651183+0000","last_unstale":"2024-03-09T15:07:23.212326+0000","last_undegraded":"2024-03-09T15:07:23.212326+0000","last_fullsized":"2024-03-09T15:07:23.212326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:23.212084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:23.212084+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.212084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:52:31.699504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'124","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.965517+0000","last_change":"2024-03-09T15:07:25.965517+0000","last_active":"2024-03-09T15:07:25.965517+0000","last_peered":"2024-03-09T15:07:25.965517+0000","last_clean":"2024-03-09T15:07:25.965517+0000","last_became_active":"2024-03-09T14:29:03.661848+0000","last_became_peered":"2024-03-09T14:29:03.661848+0000","last_unstale":"2024-03-09T15:07:25.965517+0000","last_undegraded":"2024-03-09T15:07:25.965517+0000","last_fullsized":"2024-03-09T15:07:25.965517+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:25.965247+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:25.965247+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.965247+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:36:26.246320+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":975,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":172,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'742","reported_seq":2312,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:54.007475+0000","last_change":"2024-03-09T15:07:54.007539+0000","last_active":"2024-03-09T15:07:54.007475+0000","last_peered":"2024-03-09T15:07:54.007475+0000","last_clean":"2024-03-09T15:07:54.007475+0000","last_became_active":"2024-03-09T14:28:55.580902+0000","last_became_peered":"2024-03-09T14:28:55.580902+0000","last_unstale":"2024-03-09T15:07:54.007475+0000","last_undegraded":"2024-03-09T15:07:54.007475+0000","last_fullsized":"2024-03-09T15:07:54.007475+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'742","last_scrub_stamp":"2024-03-09T15:07:54.007293+0000","last_deep_scrub":"264'742","last_deep_scrub_stamp":"2024-03-09T15:07:54.007293+0000","last_clean_scrub_stamp":"2024-03-09T15:07:54.007293+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:26:40.984544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3409,"num_read_kb":3074,"num_write":976,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'296","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:00.091073+0000","last_change":"2024-03-09T15:08:00.091176+0000","last_active":"2024-03-09T15:08:00.091073+0000","last_peered":"2024-03-09T15:08:00.091073+0000","last_clean":"2024-03-09T15:08:00.091073+0000","last_became_active":"2024-03-09T14:28:53.618470+0000","last_became_peered":"2024-03-09T14:28:53.618470+0000","last_unstale":"2024-03-09T15:08:00.091073+0000","last_undegraded":"2024-03-09T15:08:00.091073+0000","last_fullsized":"2024-03-09T15:08:00.091073+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'296","last_scrub_stamp":"2024-03-09T15:08:00.090846+0000","last_deep_scrub":"264'296","last_deep_scrub_stamp":"2024-03-09T15:08:00.090846+0000","last_clean_scrub_stamp":"2024-03-09T15:08:00.090846+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:13:02.331237+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243044,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":49463,"num_write":1149,"num_write_kb":38192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.743133+0000","last_change":"2024-03-09T15:07:38.743133+0000","last_active":"2024-03-09T15:07:38.743133+0000","last_peered":"2024-03-09T15:07:38.743133+0000","last_clean":"2024-03-09T15:07:38.743133+0000","last_became_active":"2024-03-09T14:28:57.611745+0000","last_became_peered":"2024-03-09T14:28:57.611745+0000","last_unstale":"2024-03-09T15:07:38.743133+0000","last_undegraded":"2024-03-09T15:07:38.743133+0000","last_fullsized":"2024-03-09T15:07:38.743133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:38.742764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:38.742764+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.742764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:41:17.394565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'215","reported_seq":773,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.007685+0000","last_change":"2024-03-09T15:07:42.007752+0000","last_active":"2024-03-09T15:07:42.007685+0000","last_peered":"2024-03-09T15:07:42.007685+0000","last_clean":"2024-03-09T15:07:42.007685+0000","last_became_active":"2024-03-09T14:28:59.615400+0000","last_became_peered":"2024-03-09T14:28:59.615400+0000","last_unstale":"2024-03-09T15:07:42.007685+0000","last_undegraded":"2024-03-09T15:07:42.007685+0000","last_fullsized":"2024-03-09T15:07:42.007685+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'215","last_scrub_stamp":"2024-03-09T15:07:42.007505+0000","last_deep_scrub":"264'215","last_deep_scrub_stamp":"2024-03-09T15:07:42.007505+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.007505+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:40:23.332625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41975,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":356,"num_read_kb":841,"num_write":286,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.763802+0000","last_change":"2024-03-09T15:07:19.763934+0000","last_active":"2024-03-09T15:07:19.763802+0000","last_peered":"2024-03-09T15:07:19.763802+0000","last_clean":"2024-03-09T15:07:19.763802+0000","last_became_active":"2024-03-09T14:29:01.657117+0000","last_became_peered":"2024-03-09T14:29:01.657117+0000","last_unstale":"2024-03-09T15:07:19.763802+0000","last_undegraded":"2024-03-09T15:07:19.763802+0000","last_fullsized":"2024-03-09T15:07:19.763802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:19.763551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:19.763551+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.763551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:00:56.266543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'135","reported_seq":1803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.938669+0000","last_change":"2024-03-09T15:07:28.938669+0000","last_active":"2024-03-09T15:07:28.938669+0000","last_peered":"2024-03-09T15:07:28.938669+0000","last_clean":"2024-03-09T15:07:28.938669+0000","last_became_active":"2024-03-09T14:29:03.659930+0000","last_became_peered":"2024-03-09T14:29:03.659930+0000","last_unstale":"2024-03-09T15:07:28.938669+0000","last_undegraded":"2024-03-09T15:07:28.938669+0000","last_fullsized":"2024-03-09T15:07:28.938669+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'135","last_scrub_stamp":"2024-03-09T15:07:28.938414+0000","last_deep_scrub":"264'135","last_deep_scrub_stamp":"2024-03-09T15:07:28.938414+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.938414+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:57.834645+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1320,"num_read_kb":1317,"num_write":320,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'484","reported_seq":2157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.745370+0000","last_change":"2024-03-09T15:07:32.745370+0000","last_active":"2024-03-09T15:07:32.745370+0000","last_peered":"2024-03-09T15:07:32.745370+0000","last_clean":"2024-03-09T15:07:32.745370+0000","last_became_active":"2024-03-09T14:28:55.598822+0000","last_became_peered":"2024-03-09T14:28:55.598822+0000","last_unstale":"2024-03-09T15:07:32.745370+0000","last_undegraded":"2024-03-09T15:07:32.745370+0000","last_fullsized":"2024-03-09T15:07:32.745370+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'484","last_scrub_stamp":"2024-03-09T15:07:32.745104+0000","last_deep_scrub":"264'484","last_deep_scrub_stamp":"2024-03-09T15:07:32.745104+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.745104+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:12:38.011733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2615,"num_read_kb":2447,"num_write":578,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'291","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:59.487598+0000","last_change":"2024-03-09T15:07:59.487701+0000","last_active":"2024-03-09T15:07:59.487598+0000","last_peered":"2024-03-09T15:07:59.487598+0000","last_clean":"2024-03-09T15:07:59.487598+0000","last_became_active":"2024-03-09T14:28:53.595479+0000","last_became_peered":"2024-03-09T14:28:53.595479+0000","last_unstale":"2024-03-09T15:07:59.487598+0000","last_undegraded":"2024-03-09T15:07:59.487598+0000","last_fullsized":"2024-03-09T15:07:59.487598+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'291","last_scrub_stamp":"2024-03-09T15:07:59.487376+0000","last_deep_scrub":"264'291","last_deep_scrub_stamp":"2024-03-09T15:07:59.487376+0000","last_clean_scrub_stamp":"2024-03-09T15:07:59.487376+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:31.970994+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311401,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":399,"num_read_kb":37243,"num_write":1062,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.908465+0000","last_change":"2024-03-09T15:07:21.908465+0000","last_active":"2024-03-09T15:07:21.908465+0000","last_peered":"2024-03-09T15:07:21.908465+0000","last_clean":"2024-03-09T15:07:21.908465+0000","last_became_active":"2024-03-09T14:28:57.608170+0000","last_became_peered":"2024-03-09T14:28:57.608170+0000","last_unstale":"2024-03-09T15:07:21.908465+0000","last_undegraded":"2024-03-09T15:07:21.908465+0000","last_fullsized":"2024-03-09T15:07:21.908465+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:21.908209+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:21.908209+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.908209+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:46:15.136572+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'257","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.774386+0000","last_change":"2024-03-09T15:07:27.774468+0000","last_active":"2024-03-09T15:07:27.774386+0000","last_peered":"2024-03-09T15:07:27.774386+0000","last_clean":"2024-03-09T15:07:27.774386+0000","last_became_active":"2024-03-09T14:28:59.614271+0000","last_became_peered":"2024-03-09T14:28:59.614271+0000","last_unstale":"2024-03-09T15:07:27.774386+0000","last_undegraded":"2024-03-09T15:07:27.774386+0000","last_fullsized":"2024-03-09T15:07:27.774386+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-03-09T15:07:27.774203+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-03-09T15:07:27.774203+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.774203+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:16:51.240318+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45957,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":426,"num_read_kb":925,"num_write":332,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.731942+0000","last_change":"2024-03-09T15:07:29.732043+0000","last_active":"2024-03-09T15:07:29.731942+0000","last_peered":"2024-03-09T15:07:29.731942+0000","last_clean":"2024-03-09T15:07:29.731942+0000","last_became_active":"2024-03-09T14:29:01.648467+0000","last_became_peered":"2024-03-09T14:29:01.648467+0000","last_unstale":"2024-03-09T15:07:29.731942+0000","last_undegraded":"2024-03-09T15:07:29.731942+0000","last_fullsized":"2024-03-09T15:07:29.731942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:29.731652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:29.731652+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.731652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:24:49.823183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'90","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.791592+0000","last_change":"2024-03-09T15:07:15.791657+0000","last_active":"2024-03-09T15:07:15.791592+0000","last_peered":"2024-03-09T15:07:15.791592+0000","last_clean":"2024-03-09T15:07:15.791592+0000","last_became_active":"2024-03-09T14:29:03.666157+0000","last_became_peered":"2024-03-09T14:29:03.666157+0000","last_unstale":"2024-03-09T15:07:15.791592+0000","last_undegraded":"2024-03-09T15:07:15.791592+0000","last_fullsized":"2024-03-09T15:07:15.791592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'90","last_scrub_stamp":"2024-03-09T15:07:15.791376+0000","last_deep_scrub":"264'90","last_deep_scrub_stamp":"2024-03-09T15:07:15.791376+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.791376+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:02:26.244687+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":67,"num_write":211,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'505","reported_seq":2014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.873003+0000","last_change":"2024-03-09T15:07:24.873003+0000","last_active":"2024-03-09T15:07:24.873003+0000","last_peered":"2024-03-09T15:07:24.873003+0000","last_clean":"2024-03-09T15:07:24.873003+0000","last_became_active":"2024-03-09T14:28:55.591054+0000","last_became_peered":"2024-03-09T14:28:55.591054+0000","last_unstale":"2024-03-09T15:07:24.873003+0000","last_undegraded":"2024-03-09T15:07:24.873003+0000","last_fullsized":"2024-03-09T15:07:24.873003+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'505","last_scrub_stamp":"2024-03-09T15:07:24.872742+0000","last_deep_scrub":"264'505","last_deep_scrub_stamp":"2024-03-09T15:07:24.872742+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.872742+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:44:42.985766+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2590,"num_read_kb":2449,"num_write":673,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'308","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.187042+0000","last_change":"2024-03-09T15:07:42.187232+0000","last_active":"2024-03-09T15:07:42.187042+0000","last_peered":"2024-03-09T15:07:42.187042+0000","last_clean":"2024-03-09T15:07:42.187042+0000","last_became_active":"2024-03-09T14:28:53.638941+0000","last_became_peered":"2024-03-09T14:28:53.638941+0000","last_unstale":"2024-03-09T15:07:42.187042+0000","last_undegraded":"2024-03-09T15:07:42.187042+0000","last_fullsized":"2024-03-09T15:07:42.187042+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-03-09T15:07:42.186800+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-03-09T15:07:42.186800+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.186800+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:40:08.305555+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505214,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":466,"num_read_kb":10894,"num_write":1166,"num_write_kb":33356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'699","reported_seq":2169,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.909285+0000","last_change":"2024-03-09T15:07:30.909285+0000","last_active":"2024-03-09T15:07:30.909285+0000","last_peered":"2024-03-09T15:07:30.909285+0000","last_clean":"2024-03-09T15:07:30.909285+0000","last_became_active":"2024-03-09T14:28:55.578705+0000","last_became_peered":"2024-03-09T14:28:55.578705+0000","last_unstale":"2024-03-09T15:07:30.909285+0000","last_undegraded":"2024-03-09T15:07:30.909285+0000","last_fullsized":"2024-03-09T15:07:30.909285+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'699","last_scrub_stamp":"2024-03-09T15:07:30.909041+0000","last_deep_scrub":"264'699","last_deep_scrub_stamp":"2024-03-09T15:07:30.909041+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.909041+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":600,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:54:02.289892+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3212,"num_read_kb":2884,"num_write":923,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'308","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.480688+0000","last_change":"2024-03-09T15:07:28.480771+0000","last_active":"2024-03-09T15:07:28.480688+0000","last_peered":"2024-03-09T15:07:28.480688+0000","last_clean":"2024-03-09T15:07:28.480688+0000","last_became_active":"2024-03-09T14:28:53.617469+0000","last_became_peered":"2024-03-09T14:28:53.617469+0000","last_unstale":"2024-03-09T15:07:28.480688+0000","last_undegraded":"2024-03-09T15:07:28.480688+0000","last_fullsized":"2024-03-09T15:07:28.480688+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-03-09T15:07:28.480493+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-03-09T15:07:28.480493+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.480493+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:02:21.546672+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":486,"num_read_kb":96508,"num_write":1206,"num_write_kb":39289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'478","reported_seq":2164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.553974+0000","last_change":"2024-03-09T15:07:29.553974+0000","last_active":"2024-03-09T15:07:29.553974+0000","last_peered":"2024-03-09T15:07:29.553974+0000","last_clean":"2024-03-09T15:07:29.553974+0000","last_became_active":"2024-03-09T14:28:55.594171+0000","last_became_peered":"2024-03-09T14:28:55.594171+0000","last_unstale":"2024-03-09T15:07:29.553974+0000","last_undegraded":"2024-03-09T15:07:29.553974+0000","last_fullsized":"2024-03-09T15:07:29.553974+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'478","last_scrub_stamp":"2024-03-09T15:07:29.553598+0000","last_deep_scrub":"264'478","last_deep_scrub_stamp":"2024-03-09T15:07:29.553598+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.553598+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:23:50.963569+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2696,"num_read_kb":2529,"num_write":600,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'314","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:50.554944+0000","last_change":"2024-03-09T15:07:50.555105+0000","last_active":"2024-03-09T15:07:50.554944+0000","last_peered":"2024-03-09T15:07:50.554944+0000","last_clean":"2024-03-09T15:07:50.554944+0000","last_became_active":"2024-03-09T14:28:53.627011+0000","last_became_peered":"2024-03-09T14:28:53.627011+0000","last_unstale":"2024-03-09T15:07:50.554944+0000","last_undegraded":"2024-03-09T15:07:50.554944+0000","last_fullsized":"2024-03-09T15:07:50.554944+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-03-09T15:07:50.554642+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-03-09T15:07:50.554642+0000","last_clean_scrub_stamp":"2024-03-09T15:07:50.554642+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:16:02.786215+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524303,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":582,"num_read_kb":86707,"num_write":1181,"num_write_kb":21935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'405","reported_seq":2047,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.783640+0000","last_change":"2024-03-09T15:07:36.783640+0000","last_active":"2024-03-09T15:07:36.783640+0000","last_peered":"2024-03-09T15:07:36.783640+0000","last_clean":"2024-03-09T15:07:36.783640+0000","last_became_active":"2024-03-09T14:28:55.577524+0000","last_became_peered":"2024-03-09T14:28:55.577524+0000","last_unstale":"2024-03-09T15:07:36.783640+0000","last_undegraded":"2024-03-09T15:07:36.783640+0000","last_fullsized":"2024-03-09T15:07:36.783640+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-03-09T15:07:36.783400+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-03-09T15:07:36.783400+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.783400+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:22:53.289585+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2346,"num_read_kb":2237,"num_write":463,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'369","reported_seq":1137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:53.616205+0000","last_change":"2024-03-09T15:07:53.616443+0000","last_active":"2024-03-09T15:07:53.616205+0000","last_peered":"2024-03-09T15:07:53.616205+0000","last_clean":"2024-03-09T15:07:53.616205+0000","last_became_active":"2024-03-09T14:28:53.578574+0000","last_became_peered":"2024-03-09T14:28:53.578574+0000","last_unstale":"2024-03-09T15:07:53.616205+0000","last_undegraded":"2024-03-09T15:07:53.616205+0000","last_fullsized":"2024-03-09T15:07:53.616205+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-03-09T15:07:53.615959+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-03-09T15:07:53.615959+0000","last_clean_scrub_stamp":"2024-03-09T15:07:53.615959+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:00:20.478126+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269860,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":896,"num_read_kb":59109,"num_write":1337,"num_write_kb":49113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'697","reported_seq":2188,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.959079+0000","last_change":"2024-03-09T15:07:46.959143+0000","last_active":"2024-03-09T15:07:46.959079+0000","last_peered":"2024-03-09T15:07:46.959079+0000","last_clean":"2024-03-09T15:07:46.959079+0000","last_became_active":"2024-03-09T14:28:55.596637+0000","last_became_peered":"2024-03-09T14:28:55.596637+0000","last_unstale":"2024-03-09T15:07:46.959079+0000","last_undegraded":"2024-03-09T15:07:46.959079+0000","last_fullsized":"2024-03-09T15:07:46.959079+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'697","last_scrub_stamp":"2024-03-09T15:07:46.958846+0000","last_deep_scrub":"264'697","last_deep_scrub_stamp":"2024-03-09T15:07:46.958846+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.958846+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:40:48.271858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3232,"num_read_kb":2910,"num_write":917,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'266","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:05.062484+0000","last_change":"2024-03-09T15:08:05.062692+0000","last_active":"2024-03-09T15:08:05.062484+0000","last_peered":"2024-03-09T15:08:05.062484+0000","last_clean":"2024-03-09T15:08:05.062484+0000","last_became_active":"2024-03-09T14:28:53.577994+0000","last_became_peered":"2024-03-09T14:28:53.577994+0000","last_unstale":"2024-03-09T15:08:05.062484+0000","last_undegraded":"2024-03-09T15:08:05.062484+0000","last_fullsized":"2024-03-09T15:08:05.062484+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-03-09T15:08:05.062247+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-03-09T15:08:05.062247+0000","last_clean_scrub_stamp":"2024-03-09T15:08:05.062247+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:45.279033+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22703,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":387,"num_read_kb":10775,"num_write":997,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'1035","reported_seq":2419,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.737218+0000","last_change":"2024-03-09T15:07:30.737283+0000","last_active":"2024-03-09T15:07:30.737218+0000","last_peered":"2024-03-09T15:07:30.737218+0000","last_clean":"2024-03-09T15:07:30.737218+0000","last_became_active":"2024-03-09T14:28:55.598235+0000","last_became_peered":"2024-03-09T14:28:55.598235+0000","last_unstale":"2024-03-09T15:07:30.737218+0000","last_undegraded":"2024-03-09T15:07:30.737218+0000","last_fullsized":"2024-03-09T15:07:30.737218+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1035","last_scrub_stamp":"2024-03-09T15:07:30.737007+0000","last_deep_scrub":"264'1035","last_deep_scrub_stamp":"2024-03-09T15:07:30.737007+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.737007+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":1000,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:31.427701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4348,"num_read_kb":3780,"num_write":1436,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'378","reported_seq":1074,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.699380+0000","last_change":"2024-03-09T15:07:41.699380+0000","last_active":"2024-03-09T15:07:41.699380+0000","last_peered":"2024-03-09T15:07:41.699380+0000","last_clean":"2024-03-09T15:07:41.699380+0000","last_became_active":"2024-03-09T14:28:53.591365+0000","last_became_peered":"2024-03-09T14:28:53.591365+0000","last_unstale":"2024-03-09T15:07:41.699380+0000","last_undegraded":"2024-03-09T15:07:41.699380+0000","last_fullsized":"2024-03-09T15:07:41.699380+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-03-09T15:07:41.699036+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-03-09T15:07:41.699036+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.699036+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:36:08.438868+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262246,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":674,"num_read_kb":645,"num_write":1631,"num_write_kb":21789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'477","reported_seq":1850,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.034862+0000","last_change":"2024-03-09T15:07:24.034950+0000","last_active":"2024-03-09T15:07:24.034862+0000","last_peered":"2024-03-09T15:07:24.034862+0000","last_clean":"2024-03-09T15:07:24.034862+0000","last_became_active":"2024-03-09T14:29:28.738427+0000","last_became_peered":"2024-03-09T14:29:28.738427+0000","last_unstale":"2024-03-09T15:07:24.034862+0000","last_undegraded":"2024-03-09T15:07:24.034862+0000","last_fullsized":"2024-03-09T15:07:24.034862+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'477","last_scrub_stamp":"2024-03-09T15:07:24.034674+0000","last_deep_scrub":"264'477","last_deep_scrub_stamp":"2024-03-09T15:07:24.034674+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.034674+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:11:05.508803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2425,"num_read_kb":2201,"num_write":660,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'336","reported_seq":1002,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.229156+0000","last_change":"2024-03-09T15:07:41.229156+0000","last_active":"2024-03-09T15:07:41.229156+0000","last_peered":"2024-03-09T15:07:41.229156+0000","last_clean":"2024-03-09T15:07:41.229156+0000","last_became_active":"2024-03-09T14:28:53.635866+0000","last_became_peered":"2024-03-09T14:28:53.635866+0000","last_unstale":"2024-03-09T15:07:41.229156+0000","last_undegraded":"2024-03-09T15:07:41.229156+0000","last_fullsized":"2024-03-09T15:07:41.229156+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-03-09T15:07:41.228798+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-03-09T15:07:41.228798+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.228798+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:53:45.772020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049633,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":549,"num_read_kb":68120,"num_write":1314,"num_write_kb":51277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'627","reported_seq":2304,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.266360+0000","last_change":"2024-03-09T15:07:28.266429+0000","last_active":"2024-03-09T15:07:28.266360+0000","last_peered":"2024-03-09T15:07:28.266360+0000","last_clean":"2024-03-09T15:07:28.266360+0000","last_became_active":"2024-03-09T14:28:55.596430+0000","last_became_peered":"2024-03-09T14:28:55.596430+0000","last_unstale":"2024-03-09T15:07:28.266360+0000","last_undegraded":"2024-03-09T15:07:28.266360+0000","last_fullsized":"2024-03-09T15:07:28.266360+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'627","last_scrub_stamp":"2024-03-09T15:07:28.266175+0000","last_deep_scrub":"264'627","last_deep_scrub_stamp":"2024-03-09T15:07:28.266175+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.266175+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":600,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:02:30.550543+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3224,"num_read_kb":2919,"num_write":927,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'306","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.088515+0000","last_change":"2024-03-09T15:08:06.088753+0000","last_active":"2024-03-09T15:08:06.088515+0000","last_peered":"2024-03-09T15:08:06.088515+0000","last_clean":"2024-03-09T15:08:06.088515+0000","last_became_active":"2024-03-09T14:28:53.584780+0000","last_became_peered":"2024-03-09T14:28:53.584780+0000","last_unstale":"2024-03-09T15:08:06.088515+0000","last_undegraded":"2024-03-09T15:08:06.088515+0000","last_fullsized":"2024-03-09T15:08:06.088515+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-03-09T15:08:06.088202+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-03-09T15:08:06.088202+0000","last_clean_scrub_stamp":"2024-03-09T15:08:06.088202+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:09:46.396051+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262191,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":406,"num_read_kb":4504,"num_write":1224,"num_write_kb":43139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1140","reported_seq":2651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.662704+0000","last_change":"2024-03-09T15:07:46.662771+0000","last_active":"2024-03-09T15:07:46.662704+0000","last_peered":"2024-03-09T15:07:46.662704+0000","last_clean":"2024-03-09T15:07:46.662704+0000","last_became_active":"2024-03-09T14:28:55.582655+0000","last_became_peered":"2024-03-09T14:28:55.582655+0000","last_unstale":"2024-03-09T15:07:46.662704+0000","last_undegraded":"2024-03-09T15:07:46.662704+0000","last_fullsized":"2024-03-09T15:07:46.662704+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1140","last_scrub_stamp":"2024-03-09T15:07:46.662508+0000","last_deep_scrub":"264'1140","last_deep_scrub_stamp":"2024-03-09T15:07:46.662508+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.662508+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":1100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:55:19.168051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4834,"num_read_kb":4203,"num_write":1586,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'421","reported_seq":1132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.518327+0000","last_change":"2024-03-09T15:07:49.518327+0000","last_active":"2024-03-09T15:07:49.518327+0000","last_peered":"2024-03-09T15:07:49.518327+0000","last_clean":"2024-03-09T15:07:49.518327+0000","last_became_active":"2024-03-09T14:28:53.626746+0000","last_became_peered":"2024-03-09T14:28:53.626746+0000","last_unstale":"2024-03-09T15:07:49.518327+0000","last_undegraded":"2024-03-09T15:07:49.518327+0000","last_fullsized":"2024-03-09T15:07:49.518327+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'421","last_scrub_stamp":"2024-03-09T15:07:49.517967+0000","last_deep_scrub":"264'421","last_deep_scrub_stamp":"2024-03-09T15:07:49.517967+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.517967+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:49.761015+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262222,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":818,"num_read_kb":5936,"num_write":1494,"num_write_kb":27133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'406","reported_seq":2043,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.756420+0000","last_change":"2024-03-09T15:07:37.756486+0000","last_active":"2024-03-09T15:07:37.756420+0000","last_peered":"2024-03-09T15:07:37.756420+0000","last_clean":"2024-03-09T15:07:37.756420+0000","last_became_active":"2024-03-09T14:28:55.574723+0000","last_became_peered":"2024-03-09T14:28:55.574723+0000","last_unstale":"2024-03-09T15:07:37.756420+0000","last_undegraded":"2024-03-09T15:07:37.756420+0000","last_fullsized":"2024-03-09T15:07:37.756420+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'406","last_scrub_stamp":"2024-03-09T15:07:37.756246+0000","last_deep_scrub":"264'406","last_deep_scrub_stamp":"2024-03-09T15:07:37.756246+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.756246+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:58:40.677052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2270,"num_read_kb":2181,"num_write":450,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'371","reported_seq":1257,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:02.100824+0000","last_change":"2024-03-09T15:08:02.100997+0000","last_active":"2024-03-09T15:08:02.100824+0000","last_peered":"2024-03-09T15:08:02.100824+0000","last_clean":"2024-03-09T15:08:02.100824+0000","last_became_active":"2024-03-09T14:28:53.564605+0000","last_became_peered":"2024-03-09T14:28:53.564605+0000","last_unstale":"2024-03-09T15:08:02.100824+0000","last_undegraded":"2024-03-09T15:08:02.100824+0000","last_fullsized":"2024-03-09T15:08:02.100824+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'371","last_scrub_stamp":"2024-03-09T15:08:02.100622+0000","last_deep_scrub":"264'371","last_deep_scrub_stamp":"2024-03-09T15:08:02.100622+0000","last_clean_scrub_stamp":"2024-03-09T15:08:02.100622+0000","objects_scrubbed":10,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:46:34.440289+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1026,"num_read_kb":12227,"num_write":1373,"num_write_kb":35283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'476","reported_seq":2104,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.574007+0000","last_change":"2024-03-09T15:07:32.574074+0000","last_active":"2024-03-09T15:07:32.574007+0000","last_peered":"2024-03-09T15:07:32.574007+0000","last_clean":"2024-03-09T15:07:32.574007+0000","last_became_active":"2024-03-09T14:28:55.596007+0000","last_became_peered":"2024-03-09T14:28:55.596007+0000","last_unstale":"2024-03-09T15:07:32.574007+0000","last_undegraded":"2024-03-09T15:07:32.574007+0000","last_fullsized":"2024-03-09T15:07:32.574007+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'476","last_scrub_stamp":"2024-03-09T15:07:32.573821+0000","last_deep_scrub":"264'476","last_deep_scrub_stamp":"2024-03-09T15:07:32.573821+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.573821+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:44:44.602915+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2627,"num_read_kb":2464,"num_write":596,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'263","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.551083+0000","last_change":"2024-03-09T15:07:38.551163+0000","last_active":"2024-03-09T15:07:38.551083+0000","last_peered":"2024-03-09T15:07:38.551083+0000","last_clean":"2024-03-09T15:07:38.551083+0000","last_became_active":"2024-03-09T14:28:53.637905+0000","last_became_peered":"2024-03-09T14:28:53.637905+0000","last_unstale":"2024-03-09T15:07:38.551083+0000","last_undegraded":"2024-03-09T15:07:38.551083+0000","last_fullsized":"2024-03-09T15:07:38.551083+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'263","last_scrub_stamp":"2024-03-09T15:07:38.550886+0000","last_deep_scrub":"264'263","last_deep_scrub_stamp":"2024-03-09T15:07:38.550886+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.550886+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:31:06.940143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":369,"num_read_kb":388,"num_write":1032,"num_write_kb":15956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'869","reported_seq":2416,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.773222+0000","last_change":"2024-03-09T15:07:29.773298+0000","last_active":"2024-03-09T15:07:29.773222+0000","last_peered":"2024-03-09T15:07:29.773222+0000","last_clean":"2024-03-09T15:07:29.773222+0000","last_became_active":"2024-03-09T14:28:55.589596+0000","last_became_peered":"2024-03-09T14:28:55.589596+0000","last_unstale":"2024-03-09T15:07:29.773222+0000","last_undegraded":"2024-03-09T15:07:29.773222+0000","last_fullsized":"2024-03-09T15:07:29.773222+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'869","last_scrub_stamp":"2024-03-09T15:07:29.773012+0000","last_deep_scrub":"264'869","last_deep_scrub_stamp":"2024-03-09T15:07:29.773012+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.773012+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:16:43.898214+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4032,"num_read_kb":3559,"num_write":1203,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'316","reported_seq":1064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:52.632231+0000","last_change":"2024-03-09T15:07:52.632322+0000","last_active":"2024-03-09T15:07:52.632231+0000","last_peered":"2024-03-09T15:07:52.632231+0000","last_clean":"2024-03-09T15:07:52.632231+0000","last_became_active":"2024-03-09T14:28:53.626673+0000","last_became_peered":"2024-03-09T14:28:53.626673+0000","last_unstale":"2024-03-09T15:07:52.632231+0000","last_undegraded":"2024-03-09T15:07:52.632231+0000","last_fullsized":"2024-03-09T15:07:52.632231+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-03-09T15:07:52.632033+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-03-09T15:07:52.632033+0000","last_clean_scrub_stamp":"2024-03-09T15:07:52.632033+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:17:12.432663+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":573,"num_read_kb":94146,"num_write":1092,"num_write_kb":28965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'474","reported_seq":1994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.959577+0000","last_change":"2024-03-09T15:07:37.959645+0000","last_active":"2024-03-09T15:07:37.959577+0000","last_peered":"2024-03-09T15:07:37.959577+0000","last_clean":"2024-03-09T15:07:37.959577+0000","last_became_active":"2024-03-09T14:28:55.610314+0000","last_became_peered":"2024-03-09T14:28:55.610314+0000","last_unstale":"2024-03-09T15:07:37.959577+0000","last_undegraded":"2024-03-09T15:07:37.959577+0000","last_fullsized":"2024-03-09T15:07:37.959577+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'474","last_scrub_stamp":"2024-03-09T15:07:37.959395+0000","last_deep_scrub":"264'474","last_deep_scrub_stamp":"2024-03-09T15:07:37.959395+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.959395+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:05:39.306030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2645,"num_read_kb":2435,"num_write":625,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'356","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.243758+0000","last_change":"2024-03-09T15:07:37.243890+0000","last_active":"2024-03-09T15:07:37.243758+0000","last_peered":"2024-03-09T15:07:37.243758+0000","last_clean":"2024-03-09T15:07:37.243758+0000","last_became_active":"2024-03-09T14:28:53.631327+0000","last_became_peered":"2024-03-09T14:28:53.631327+0000","last_unstale":"2024-03-09T15:07:37.243758+0000","last_undegraded":"2024-03-09T15:07:37.243758+0000","last_fullsized":"2024-03-09T15:07:37.243758+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-03-09T15:07:37.243537+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-03-09T15:07:37.243537+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.243537+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:57:08.377852+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":582,"num_read_kb":48859,"num_write":1226,"num_write_kb":49653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'389","reported_seq":1882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.751998+0000","last_change":"2024-03-09T15:07:42.752137+0000","last_active":"2024-03-09T15:07:42.751998+0000","last_peered":"2024-03-09T15:07:42.751998+0000","last_clean":"2024-03-09T15:07:42.751998+0000","last_became_active":"2024-03-09T14:28:55.587355+0000","last_became_peered":"2024-03-09T14:28:55.587355+0000","last_unstale":"2024-03-09T15:07:42.751998+0000","last_undegraded":"2024-03-09T15:07:42.751998+0000","last_fullsized":"2024-03-09T15:07:42.751998+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'389","last_scrub_stamp":"2024-03-09T15:07:42.751743+0000","last_deep_scrub":"264'389","last_deep_scrub_stamp":"2024-03-09T15:07:42.751743+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.751743+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:32:06.938642+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2078,"num_read_kb":1975,"num_write":455,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'395","reported_seq":1057,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.912024+0000","last_change":"2024-03-09T15:07:51.912158+0000","last_active":"2024-03-09T15:07:51.912024+0000","last_peered":"2024-03-09T15:07:51.912024+0000","last_clean":"2024-03-09T15:07:51.912024+0000","last_became_active":"2024-03-09T14:28:53.622624+0000","last_became_peered":"2024-03-09T14:28:53.622624+0000","last_unstale":"2024-03-09T15:07:51.912024+0000","last_undegraded":"2024-03-09T15:07:51.912024+0000","last_fullsized":"2024-03-09T15:07:51.912024+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-03-09T15:07:51.911822+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-03-09T15:07:51.911822+0000","last_clean_scrub_stamp":"2024-03-09T15:07:51.911822+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:39:29.808921+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262192,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":653,"num_read_kb":22046,"num_write":1243,"num_write_kb":48993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'1101","reported_seq":2585,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.994450+0000","last_change":"2024-03-09T15:07:51.994520+0000","last_active":"2024-03-09T15:07:51.994450+0000","last_peered":"2024-03-09T15:07:51.994450+0000","last_clean":"2024-03-09T15:07:51.994450+0000","last_became_active":"2024-03-09T14:28:55.582143+0000","last_became_peered":"2024-03-09T14:28:55.582143+0000","last_unstale":"2024-03-09T15:07:51.994450+0000","last_undegraded":"2024-03-09T15:07:51.994450+0000","last_fullsized":"2024-03-09T15:07:51.994450+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1101","last_scrub_stamp":"2024-03-09T15:07:51.994225+0000","last_deep_scrub":"264'1101","last_deep_scrub_stamp":"2024-03-09T15:07:51.994225+0000","last_clean_scrub_stamp":"2024-03-09T15:07:51.994225+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":1000,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:13:21.082744+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4588,"num_read_kb":3996,"num_write":1519,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'363","reported_seq":1097,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.530647+0000","last_change":"2024-03-09T15:07:29.530760+0000","last_active":"2024-03-09T15:07:29.530647+0000","last_peered":"2024-03-09T15:07:29.530647+0000","last_clean":"2024-03-09T15:07:29.530647+0000","last_became_active":"2024-03-09T14:28:53.633121+0000","last_became_peered":"2024-03-09T14:28:53.633121+0000","last_unstale":"2024-03-09T15:07:29.530647+0000","last_undegraded":"2024-03-09T15:07:29.530647+0000","last_fullsized":"2024-03-09T15:07:29.530647+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'363","last_scrub_stamp":"2024-03-09T15:07:29.530472+0000","last_deep_scrub":"264'363","last_deep_scrub_stamp":"2024-03-09T15:07:29.530472+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.530472+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:42:58.011768+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3312503,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":707,"num_read_kb":9275,"num_write":1371,"num_write_kb":66964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'678","reported_seq":2126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.948685+0000","last_change":"2024-03-09T15:07:39.948685+0000","last_active":"2024-03-09T15:07:39.948685+0000","last_peered":"2024-03-09T15:07:39.948685+0000","last_clean":"2024-03-09T15:07:39.948685+0000","last_became_active":"2024-03-09T14:28:55.601622+0000","last_became_peered":"2024-03-09T14:28:55.601622+0000","last_unstale":"2024-03-09T15:07:39.948685+0000","last_undegraded":"2024-03-09T15:07:39.948685+0000","last_fullsized":"2024-03-09T15:07:39.948685+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'678","last_scrub_stamp":"2024-03-09T15:07:39.948430+0000","last_deep_scrub":"264'678","last_deep_scrub_stamp":"2024-03-09T15:07:39.948430+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.948430+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:45:16.720446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3103,"num_read_kb":2796,"num_write":889,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'405","reported_seq":1140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.604375+0000","last_change":"2024-03-09T15:07:21.604740+0000","last_active":"2024-03-09T15:07:21.604375+0000","last_peered":"2024-03-09T15:07:21.604375+0000","last_clean":"2024-03-09T15:07:21.604375+0000","last_became_active":"2024-03-09T14:29:28.827826+0000","last_became_peered":"2024-03-09T14:29:28.827826+0000","last_unstale":"2024-03-09T15:07:21.604375+0000","last_undegraded":"2024-03-09T15:07:21.604375+0000","last_fullsized":"2024-03-09T15:07:21.604375+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-03-09T15:07:21.604112+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-03-09T15:07:21.604112+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.604112+0000","objects_scrubbed":10,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:36:26.048379+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918827,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":881,"num_read_kb":41003,"num_write":1564,"num_write_kb":37571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"264'297","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.549879+0000","last_change":"2024-03-09T15:07:46.549960+0000","last_active":"2024-03-09T15:07:46.549879+0000","last_peered":"2024-03-09T15:07:46.549879+0000","last_clean":"2024-03-09T15:07:46.549879+0000","last_became_active":"2024-03-09T14:28:53.602502+0000","last_became_peered":"2024-03-09T14:28:53.602502+0000","last_unstale":"2024-03-09T15:07:46.549879+0000","last_undegraded":"2024-03-09T15:07:46.549879+0000","last_fullsized":"2024-03-09T15:07:46.549879+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'297","last_scrub_stamp":"2024-03-09T15:07:46.549673+0000","last_deep_scrub":"264'297","last_deep_scrub_stamp":"2024-03-09T15:07:46.549673+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.549673+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:19:30.953593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":396,"num_read_kb":11977,"num_write":1066,"num_write_kb":41245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'858","reported_seq":2316,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.751039+0000","last_change":"2024-03-09T15:07:38.751039+0000","last_active":"2024-03-09T15:07:38.751039+0000","last_peered":"2024-03-09T15:07:38.751039+0000","last_clean":"2024-03-09T15:07:38.751039+0000","last_became_active":"2024-03-09T14:28:55.601537+0000","last_became_peered":"2024-03-09T14:28:55.601537+0000","last_unstale":"2024-03-09T15:07:38.751039+0000","last_undegraded":"2024-03-09T15:07:38.751039+0000","last_fullsized":"2024-03-09T15:07:38.751039+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'858","last_scrub_stamp":"2024-03-09T15:07:38.750716+0000","last_deep_scrub":"264'858","last_deep_scrub_stamp":"2024-03-09T15:07:38.750716+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.750716+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:01:30.209754+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3890,"num_read_kb":3404,"num_write":1199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'348","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.714091+0000","last_change":"2024-03-09T15:07:39.714220+0000","last_active":"2024-03-09T15:07:39.714091+0000","last_peered":"2024-03-09T15:07:39.714091+0000","last_clean":"2024-03-09T15:07:39.714091+0000","last_became_active":"2024-03-09T14:28:53.588717+0000","last_became_peered":"2024-03-09T14:28:53.588717+0000","last_unstale":"2024-03-09T15:07:39.714091+0000","last_undegraded":"2024-03-09T15:07:39.714091+0000","last_fullsized":"2024-03-09T15:07:39.714091+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-03-09T15:07:39.713890+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-03-09T15:07:39.713890+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.713890+0000","objects_scrubbed":12,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:51.804676+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286749,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":569,"num_read_kb":5745,"num_write":1174,"num_write_kb":28449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'1156","reported_seq":2693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.497285+0000","last_change":"2024-03-09T15:07:32.497285+0000","last_active":"2024-03-09T15:07:32.497285+0000","last_peered":"2024-03-09T15:07:32.497285+0000","last_clean":"2024-03-09T15:07:32.497285+0000","last_became_active":"2024-03-09T14:28:55.582541+0000","last_became_peered":"2024-03-09T14:28:55.582541+0000","last_unstale":"2024-03-09T15:07:32.497285+0000","last_undegraded":"2024-03-09T15:07:32.497285+0000","last_fullsized":"2024-03-09T15:07:32.497285+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1156","last_scrub_stamp":"2024-03-09T15:07:32.497013+0000","last_deep_scrub":"264'1156","last_deep_scrub_stamp":"2024-03-09T15:07:32.497013+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.497013+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":1100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:11.099274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4871,"num_read_kb":4234,"num_write":1610,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5930,"num_read_kb":4217,"num_write":2190,"num_write_kb":844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7263,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1125,"ondisk_log_size":1125,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":13413,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":15557,"num_read_kb":15326,"num_write":16235,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2284,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":26826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1635,"ondisk_log_size":1635,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":433,"ondisk_log_size":433,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1466895,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":16241,"num_read_kb":34652,"num_write":13827,"num_write_kb":11138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":680820,"num_omap_keys":1580,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2038,"ondisk_log_size":2038,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1622,"num_read_kb":1927,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":194579,"num_read_kb":177681,"num_write":51390,"num_write_kb":17534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":132,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":33323,"num_omap_keys":138,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4093,"ondisk_log_size":4093,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":940,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":142827823,"num_objects":361,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":361,"num_whiteouts":0,"num_read":34808,"num_read_kb":1970678,"num_write":77579,"num_write_kb":2252311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":193282048,"data_stored":193282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3795,"ondisk_log_size":3795,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":180405,"num_write":150,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":133,"num_read_kb":177288,"num_write":150,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575329,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":360960,"kb_used_data":41016,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":94010880,"statfs":{"total":96636764160,"available":96267141120,"internally_reserved":0,"allocated":42000384,"data_stored":40009750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":327612874},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575326,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":346200,"kb_used_data":35984,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":94025640,"statfs":{"total":96636764160,"available":96282255360,"internally_reserved":0,"allocated":36847616,"data_stored":34892402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":317651398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575330,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":176544,"kb_used_data":41304,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94195296,"statfs":{"total":96636764160,"available":96455983104,"internally_reserved":0,"allocated":42295296,"data_stored":40303321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575327,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177632,"kb_used_data":43736,"kb_used_omap":1,"kb_used_meta":133886,"kb_avail":94194208,"statfs":{"total":96636764160,"available":96454868992,"internally_reserved":0,"allocated":44785664,"data_stored":42869751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":137099717},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575329,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301360,"kb_used_data":35560,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94070480,"statfs":{"total":96636764160,"available":96328171520,"internally_reserved":0,"allocated":36413440,"data_stored":34419369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":272169415},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575325,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":135436,"kb_used_data":27908,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94236404,"statfs":{"total":96636764160,"available":96498077696,"internally_reserved":0,"allocated":28577792,"data_stored":26654129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575329,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209596,"kb_used_data":34100,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94162244,"statfs":{"total":96636764160,"available":96422137856,"internally_reserved":0,"allocated":34918400,"data_stored":32958583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575326,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":294704,"kb_used_data":28904,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94077136,"statfs":{"total":96636764160,"available":96334987264,"internally_reserved":0,"allocated":29597696,"data_stored":27607131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23699456,"data_stored":23699456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24399872,"data_stored":24399872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19144704,"data_stored":19144704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21663744,"data_stored":21663744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24875008,"data_stored":24875008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21258240,"data_stored":21258240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27381760,"data_stored":27381760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":30859264,"data_stored":30859264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:08:14.616 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:08:14.616 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:08:14.617 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:08:14.617 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-03-09T14:42:17.960960+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=42, tm_sec=17, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:08:14.618 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:08:14.618 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:08:14.619 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-03-09T14:49:52.610299+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=14, tm_min=49, tm_sec=52, tm_wday=5, tm_yday=69, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=9, tm_hour=15, tm_min=7, tm_sec=7, tm_wday=5, tm_yday=69, tm_isdst=0) 2024-03-09T15:08:14.623 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-09T15:08:34.623 DEBUG:teuthology.orchestra.run.smithi099:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-09T15:08:34.961 INFO:teuthology.orchestra.run.smithi099.stdout: 2024-03-09T15:08:34.975 INFO:teuthology.orchestra.run.smithi099.stderr:dumped all 2024-03-09T15:08:34.984 INFO:teuthology.orchestra.run.smithi099.stdout:{"pg_ready":true,"pg_map":{"version":1457,"stamp":"2024-03-09T15:08:34.907758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":178454650,"num_objects":799,"num_object_clones":0,"num_object_copies":2320,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":799,"num_whiteouts":0,"num_read":269134,"num_read_kb":2562286,"num_write":161720,"num_write_kb":2520695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":176,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":724818,"num_omap_keys":1759,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13364,"ondisk_log_size":13364,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2002432,"kb_used_data":288512,"kb_used_omap":12,"kb_used_meta":1713843,"kb_avail":752972288,"statfs":{"total":773094113280,"available":771043622912,"internally_reserved":0,"allocated":295436288,"data_stored":279714436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1754975792},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007797"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:58.576865+0000","last_change":"2024-03-09T15:07:58.576964+0000","last_active":"2024-03-09T15:07:58.576865+0000","last_peered":"2024-03-09T15:07:58.576865+0000","last_clean":"2024-03-09T15:07:58.576865+0000","last_became_active":"2024-03-09T14:49:53.656173+0000","last_became_peered":"2024-03-09T14:49:53.656173+0000","last_unstale":"2024-03-09T15:07:58.576865+0000","last_undegraded":"2024-03-09T15:07:58.576865+0000","last_fullsized":"2024-03-09T15:07:58.576865+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:58.576557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:58.576557+0000","last_clean_scrub_stamp":"2024-03-09T15:07:58.576557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:45:42.587164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:53.578143+0000","last_change":"2024-03-09T15:07:53.578272+0000","last_active":"2024-03-09T15:07:53.578143+0000","last_peered":"2024-03-09T15:07:53.578143+0000","last_clean":"2024-03-09T15:07:53.578143+0000","last_became_active":"2024-03-09T14:42:19.006064+0000","last_became_peered":"2024-03-09T14:42:19.006064+0000","last_unstale":"2024-03-09T15:07:53.578143+0000","last_undegraded":"2024-03-09T15:07:53.578143+0000","last_fullsized":"2024-03-09T15:07:53.578143+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:53.577898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:53.577898+0000","last_clean_scrub_stamp":"2024-03-09T15:07:53.577898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:15:17.415813+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.016424+0000","last_change":"2024-03-09T15:07:13.016424+0000","last_active":"2024-03-09T15:07:13.016424+0000","last_peered":"2024-03-09T15:07:13.016424+0000","last_clean":"2024-03-09T15:07:13.016424+0000","last_became_active":"2024-03-09T14:42:15.928518+0000","last_became_peered":"2024-03-09T14:42:15.928518+0000","last_unstale":"2024-03-09T15:07:13.016424+0000","last_undegraded":"2024-03-09T15:07:13.016424+0000","last_fullsized":"2024-03-09T15:07:13.016424+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:13.016259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:13.016259+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.016259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:32:55.901082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'49","reported_seq":165,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.732265+0000","last_change":"2024-03-09T15:07:09.732293+0000","last_active":"2024-03-09T15:07:09.732265+0000","last_peered":"2024-03-09T15:07:09.732265+0000","last_clean":"2024-03-09T15:07:09.732265+0000","last_became_active":"2024-03-09T14:39:57.901879+0000","last_became_peered":"2024-03-09T14:39:57.901879+0000","last_unstale":"2024-03-09T15:07:09.732265+0000","last_undegraded":"2024-03-09T15:07:09.732265+0000","last_fullsized":"2024-03-09T15:07:09.732265+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'49","last_scrub_stamp":"2024-03-09T15:07:09.732154+0000","last_deep_scrub":"264'49","last_deep_scrub_stamp":"2024-03-09T15:07:09.732154+0000","last_clean_scrub_stamp":"2024-03-09T15:07:09.732154+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:18:47.058510+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":185,"num_read_kb":129,"num_write":88,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.487794+0000","last_change":"2024-03-09T15:07:42.487849+0000","last_active":"2024-03-09T15:07:42.487794+0000","last_peered":"2024-03-09T15:07:42.487794+0000","last_clean":"2024-03-09T15:07:42.487794+0000","last_became_active":"2024-03-09T14:49:53.684941+0000","last_became_peered":"2024-03-09T14:49:53.684941+0000","last_unstale":"2024-03-09T15:07:42.487794+0000","last_undegraded":"2024-03-09T15:07:42.487794+0000","last_fullsized":"2024-03-09T15:07:42.487794+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:42.487592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:42.487592+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.487592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:52.648364+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:55.778080+0000","last_change":"2024-03-09T15:07:55.778134+0000","last_active":"2024-03-09T15:07:55.778080+0000","last_peered":"2024-03-09T15:07:55.778080+0000","last_clean":"2024-03-09T15:07:55.778080+0000","last_became_active":"2024-03-09T14:42:19.011453+0000","last_became_peered":"2024-03-09T14:42:19.011453+0000","last_unstale":"2024-03-09T15:07:55.778080+0000","last_undegraded":"2024-03-09T15:07:55.778080+0000","last_fullsized":"2024-03-09T15:07:55.778080+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:55.777881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:55.777881+0000","last_clean_scrub_stamp":"2024-03-09T15:07:55.777881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:39.838953+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.004521+0000","last_change":"2024-03-09T15:07:16.004521+0000","last_active":"2024-03-09T15:07:16.004521+0000","last_peered":"2024-03-09T15:07:16.004521+0000","last_clean":"2024-03-09T15:07:16.004521+0000","last_became_active":"2024-03-09T14:42:15.970720+0000","last_became_peered":"2024-03-09T14:42:15.970720+0000","last_unstale":"2024-03-09T15:07:16.004521+0000","last_undegraded":"2024-03-09T15:07:16.004521+0000","last_fullsized":"2024-03-09T15:07:16.004521+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:16.004189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:16.004189+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.004189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:56:28.921839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'3","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.474480+0000","last_change":"2024-03-09T15:07:25.474480+0000","last_active":"2024-03-09T15:07:25.474480+0000","last_peered":"2024-03-09T15:07:25.474480+0000","last_clean":"2024-03-09T15:07:25.474480+0000","last_became_active":"2024-03-09T14:39:57.894022+0000","last_became_peered":"2024-03-09T14:39:57.894022+0000","last_unstale":"2024-03-09T15:07:25.474480+0000","last_undegraded":"2024-03-09T15:07:25.474480+0000","last_fullsized":"2024-03-09T15:07:25.474480+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:25.474217+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:25.474217+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.474217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:13.689373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":8,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.013882+0000","last_change":"2024-03-09T15:07:49.013988+0000","last_active":"2024-03-09T15:07:49.013882+0000","last_peered":"2024-03-09T15:07:49.013882+0000","last_clean":"2024-03-09T15:07:49.013882+0000","last_became_active":"2024-03-09T14:49:53.676530+0000","last_became_peered":"2024-03-09T14:49:53.676530+0000","last_unstale":"2024-03-09T15:07:49.013882+0000","last_undegraded":"2024-03-09T15:07:49.013882+0000","last_fullsized":"2024-03-09T15:07:49.013882+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:49.013657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:49.013657+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.013657+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:05:49.238949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:03.603096+0000","last_change":"2024-03-09T15:08:03.603159+0000","last_active":"2024-03-09T15:08:03.603096+0000","last_peered":"2024-03-09T15:08:03.603096+0000","last_clean":"2024-03-09T15:08:03.603096+0000","last_became_active":"2024-03-09T14:42:19.295218+0000","last_became_peered":"2024-03-09T14:42:19.295218+0000","last_unstale":"2024-03-09T15:08:03.603096+0000","last_undegraded":"2024-03-09T15:08:03.603096+0000","last_fullsized":"2024-03-09T15:08:03.603096+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:08:03.602882+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:08:03.602882+0000","last_clean_scrub_stamp":"2024-03-09T15:08:03.602882+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:38:35.909562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":63,"num_write":4,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"261'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.753071+0000","last_change":"2024-03-09T15:07:10.753071+0000","last_active":"2024-03-09T15:07:10.753071+0000","last_peered":"2024-03-09T15:07:10.753071+0000","last_clean":"2024-03-09T15:07:10.753071+0000","last_became_active":"2024-03-09T14:42:15.958052+0000","last_became_peered":"2024-03-09T14:42:15.958052+0000","last_unstale":"2024-03-09T15:07:10.753071+0000","last_undegraded":"2024-03-09T15:07:10.753071+0000","last_fullsized":"2024-03-09T15:07:10.753071+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:07:10.752824+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:07:10.752824+0000","last_clean_scrub_stamp":"2024-03-09T15:07:10.752824+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:38:40.918092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'67","reported_seq":215,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.601652+0000","last_change":"2024-03-09T15:07:14.601652+0000","last_active":"2024-03-09T15:07:14.601652+0000","last_peered":"2024-03-09T15:07:14.601652+0000","last_clean":"2024-03-09T15:07:14.601652+0000","last_became_active":"2024-03-09T14:39:57.890452+0000","last_became_peered":"2024-03-09T14:39:57.890452+0000","last_unstale":"2024-03-09T15:07:14.601652+0000","last_undegraded":"2024-03-09T15:07:14.601652+0000","last_fullsized":"2024-03-09T15:07:14.601652+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'67","last_scrub_stamp":"2024-03-09T15:07:14.601392+0000","last_deep_scrub":"264'67","last_deep_scrub_stamp":"2024-03-09T15:07:14.601392+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.601392+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:28:58.020853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":288,"num_read_kb":205,"num_write":124,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:12.109341+0000","last_change":"2024-03-09T15:08:12.109394+0000","last_active":"2024-03-09T15:08:12.109341+0000","last_peered":"2024-03-09T15:08:12.109341+0000","last_clean":"2024-03-09T15:08:12.109341+0000","last_became_active":"2024-03-09T14:49:53.669178+0000","last_became_peered":"2024-03-09T14:49:53.669178+0000","last_unstale":"2024-03-09T15:08:12.109341+0000","last_undegraded":"2024-03-09T15:08:12.109341+0000","last_fullsized":"2024-03-09T15:08:12.109341+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:12.109146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:12.109146+0000","last_clean_scrub_stamp":"2024-03-09T15:08:12.109146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:41:41.948225+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"261'6","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.015583+0000","last_change":"2024-03-09T15:07:43.015583+0000","last_active":"2024-03-09T15:07:43.015583+0000","last_peered":"2024-03-09T15:07:43.015583+0000","last_clean":"2024-03-09T15:07:43.015583+0000","last_became_active":"2024-03-09T14:42:19.294235+0000","last_became_peered":"2024-03-09T14:42:19.294235+0000","last_unstale":"2024-03-09T15:07:43.015583+0000","last_undegraded":"2024-03-09T15:07:43.015583+0000","last_fullsized":"2024-03-09T15:07:43.015583+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-03-09T15:07:43.015317+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-03-09T15:07:43.015317+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.015317+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:23:53.260315+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6144,"num_write":11,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:53.836398+0000","last_change":"2024-03-09T15:07:53.836455+0000","last_active":"2024-03-09T15:07:53.836398+0000","last_peered":"2024-03-09T15:07:53.836398+0000","last_clean":"2024-03-09T15:07:53.836398+0000","last_became_active":"2024-03-09T14:42:15.957974+0000","last_became_peered":"2024-03-09T14:42:15.957974+0000","last_unstale":"2024-03-09T15:07:53.836398+0000","last_undegraded":"2024-03-09T15:07:53.836398+0000","last_fullsized":"2024-03-09T15:07:53.836398+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:53.836198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:53.836198+0000","last_clean_scrub_stamp":"2024-03-09T15:07:53.836198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:53:35.661598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'35","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.986504+0000","last_change":"2024-03-09T15:07:15.986504+0000","last_active":"2024-03-09T15:07:15.986504+0000","last_peered":"2024-03-09T15:07:15.986504+0000","last_clean":"2024-03-09T15:07:15.986504+0000","last_became_active":"2024-03-09T14:39:57.909761+0000","last_became_peered":"2024-03-09T14:39:57.909761+0000","last_unstale":"2024-03-09T15:07:15.986504+0000","last_undegraded":"2024-03-09T15:07:15.986504+0000","last_fullsized":"2024-03-09T15:07:15.986504+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-03-09T15:07:15.986243+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-03-09T15:07:15.986243+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.986243+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:35:47.596327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":153,"num_read_kb":109,"num_write":58,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:14.119338+0000","last_change":"2024-03-09T15:08:14.119392+0000","last_active":"2024-03-09T15:08:14.119338+0000","last_peered":"2024-03-09T15:08:14.119338+0000","last_clean":"2024-03-09T15:08:14.119338+0000","last_became_active":"2024-03-09T14:49:53.676902+0000","last_became_peered":"2024-03-09T14:49:53.676902+0000","last_unstale":"2024-03-09T15:08:14.119338+0000","last_undegraded":"2024-03-09T15:08:14.119338+0000","last_fullsized":"2024-03-09T15:08:14.119338+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:14.119134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:14.119134+0000","last_clean_scrub_stamp":"2024-03-09T15:08:14.119134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:22:57.500184+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:54.614746+0000","last_change":"2024-03-09T15:07:54.614895+0000","last_active":"2024-03-09T15:07:54.614746+0000","last_peered":"2024-03-09T15:07:54.614746+0000","last_clean":"2024-03-09T15:07:54.614746+0000","last_became_active":"2024-03-09T14:42:19.006923+0000","last_became_peered":"2024-03-09T14:42:19.006923+0000","last_unstale":"2024-03-09T15:07:54.614746+0000","last_undegraded":"2024-03-09T15:07:54.614746+0000","last_fullsized":"2024-03-09T15:07:54.614746+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:54.614510+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:54.614510+0000","last_clean_scrub_stamp":"2024-03-09T15:07:54.614510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:17:02.782598+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"264'3","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.638355+0000","last_change":"2024-03-09T15:07:23.638415+0000","last_active":"2024-03-09T15:07:23.638355+0000","last_peered":"2024-03-09T15:07:23.638355+0000","last_clean":"2024-03-09T15:07:23.638355+0000","last_became_active":"2024-03-09T14:42:15.971499+0000","last_became_peered":"2024-03-09T14:42:15.971499+0000","last_unstale":"2024-03-09T15:07:23.638355+0000","last_undegraded":"2024-03-09T15:07:23.638355+0000","last_fullsized":"2024-03-09T15:07:23.638355+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:23.638161+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:23.638161+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.638161+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:30:40.124428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'33","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.984015+0000","last_change":"2024-03-09T15:07:20.984015+0000","last_active":"2024-03-09T15:07:20.984015+0000","last_peered":"2024-03-09T15:07:20.984015+0000","last_clean":"2024-03-09T15:07:20.984015+0000","last_became_active":"2024-03-09T14:39:57.898849+0000","last_became_peered":"2024-03-09T14:39:57.898849+0000","last_unstale":"2024-03-09T15:07:20.984015+0000","last_undegraded":"2024-03-09T15:07:20.984015+0000","last_fullsized":"2024-03-09T15:07:20.984015+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-03-09T15:07:20.983762+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-03-09T15:07:20.983762+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.983762+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:55:54.652512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":100,"num_write":52,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.575680+0000","last_change":"2024-03-09T15:07:51.575734+0000","last_active":"2024-03-09T15:07:51.575680+0000","last_peered":"2024-03-09T15:07:51.575680+0000","last_clean":"2024-03-09T15:07:51.575680+0000","last_became_active":"2024-03-09T14:49:53.648332+0000","last_became_peered":"2024-03-09T14:49:53.648332+0000","last_unstale":"2024-03-09T15:07:51.575680+0000","last_undegraded":"2024-03-09T15:07:51.575680+0000","last_fullsized":"2024-03-09T15:07:51.575680+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:51.575477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:51.575477+0000","last_clean_scrub_stamp":"2024-03-09T15:07:51.575477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:57:18.458379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"264'6","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.051703+0000","last_change":"2024-03-09T15:07:46.051767+0000","last_active":"2024-03-09T15:07:46.051703+0000","last_peered":"2024-03-09T15:07:46.051703+0000","last_clean":"2024-03-09T15:07:46.051703+0000","last_became_active":"2024-03-09T14:42:19.003868+0000","last_became_peered":"2024-03-09T14:42:19.003868+0000","last_unstale":"2024-03-09T15:07:46.051703+0000","last_undegraded":"2024-03-09T15:07:46.051703+0000","last_fullsized":"2024-03-09T15:07:46.051703+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:46.051508+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:46.051508+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.051508+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:32:25.347512+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6144,"num_write":11,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"264'2","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.794551+0000","last_change":"2024-03-09T15:07:26.794615+0000","last_active":"2024-03-09T15:07:26.794551+0000","last_peered":"2024-03-09T15:07:26.794551+0000","last_clean":"2024-03-09T15:07:26.794551+0000","last_became_active":"2024-03-09T14:42:15.947888+0000","last_became_peered":"2024-03-09T14:42:15.947888+0000","last_unstale":"2024-03-09T15:07:26.794551+0000","last_undegraded":"2024-03-09T15:07:26.794551+0000","last_fullsized":"2024-03-09T15:07:26.794551+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:26.794359+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:26.794359+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.794359+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:52:28.250795+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'23","reported_seq":109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.281807+0000","last_change":"2024-03-09T15:07:13.281807+0000","last_active":"2024-03-09T15:07:13.281807+0000","last_peered":"2024-03-09T15:07:13.281807+0000","last_clean":"2024-03-09T15:07:13.281807+0000","last_became_active":"2024-03-09T14:39:57.907530+0000","last_became_peered":"2024-03-09T14:39:57.907530+0000","last_unstale":"2024-03-09T15:07:13.281807+0000","last_undegraded":"2024-03-09T15:07:13.281807+0000","last_fullsized":"2024-03-09T15:07:13.281807+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-03-09T15:07:13.281542+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-03-09T15:07:13.281542+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.281542+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:47:39.457125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":69,"num_write":39,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:05.788200+0000","last_change":"2024-03-09T15:08:05.788263+0000","last_active":"2024-03-09T15:08:05.788200+0000","last_peered":"2024-03-09T15:08:05.788200+0000","last_clean":"2024-03-09T15:08:05.788200+0000","last_became_active":"2024-03-09T14:49:53.676976+0000","last_became_peered":"2024-03-09T14:49:53.676976+0000","last_unstale":"2024-03-09T15:08:05.788200+0000","last_undegraded":"2024-03-09T15:08:05.788200+0000","last_fullsized":"2024-03-09T15:08:05.788200+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:08:05.787980+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:08:05.787980+0000","last_clean_scrub_stamp":"2024-03-09T15:08:05.787980+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:27.664140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.028481+0000","last_change":"2024-03-09T15:07:47.028535+0000","last_active":"2024-03-09T15:07:47.028481+0000","last_peered":"2024-03-09T15:07:47.028481+0000","last_clean":"2024-03-09T15:07:47.028481+0000","last_became_active":"2024-03-09T14:42:19.008779+0000","last_became_peered":"2024-03-09T14:42:19.008779+0000","last_unstale":"2024-03-09T15:07:47.028481+0000","last_undegraded":"2024-03-09T15:07:47.028481+0000","last_fullsized":"2024-03-09T15:07:47.028481+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:47.028278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:47.028278+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.028278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:10:14.953446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"264'6","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.768833+0000","last_change":"2024-03-09T15:07:22.768898+0000","last_active":"2024-03-09T15:07:22.768833+0000","last_peered":"2024-03-09T15:07:22.768833+0000","last_clean":"2024-03-09T15:07:22.768833+0000","last_became_active":"2024-03-09T14:42:15.943177+0000","last_became_peered":"2024-03-09T14:42:15.943177+0000","last_unstale":"2024-03-09T15:07:22.768833+0000","last_undegraded":"2024-03-09T15:07:22.768833+0000","last_fullsized":"2024-03-09T15:07:22.768833+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:22.768655+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:22.768655+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.768655+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:13:44.014557+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'28","reported_seq":120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.611668+0000","last_change":"2024-03-09T15:07:13.611732+0000","last_active":"2024-03-09T15:07:13.611668+0000","last_peered":"2024-03-09T15:07:13.611668+0000","last_clean":"2024-03-09T15:07:13.611668+0000","last_became_active":"2024-03-09T14:39:57.894343+0000","last_became_peered":"2024-03-09T14:39:57.894343+0000","last_unstale":"2024-03-09T15:07:13.611668+0000","last_undegraded":"2024-03-09T15:07:13.611668+0000","last_fullsized":"2024-03-09T15:07:13.611668+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-03-09T15:07:13.611465+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-03-09T15:07:13.611465+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.611465+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:20:23.924452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":82,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:04.796262+0000","last_change":"2024-03-09T15:08:04.796341+0000","last_active":"2024-03-09T15:08:04.796262+0000","last_peered":"2024-03-09T15:08:04.796262+0000","last_clean":"2024-03-09T15:08:04.796262+0000","last_became_active":"2024-03-09T14:49:53.666178+0000","last_became_peered":"2024-03-09T14:49:53.666178+0000","last_unstale":"2024-03-09T15:08:04.796262+0000","last_undegraded":"2024-03-09T15:08:04.796262+0000","last_fullsized":"2024-03-09T15:08:04.796262+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:04.796062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:04.796062+0000","last_clean_scrub_stamp":"2024-03-09T15:08:04.796062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:35:58.862813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.975264+0000","last_change":"2024-03-09T15:07:18.975264+0000","last_active":"2024-03-09T15:07:18.975264+0000","last_peered":"2024-03-09T15:07:18.975264+0000","last_clean":"2024-03-09T15:07:18.975264+0000","last_became_active":"2024-03-09T14:42:19.004684+0000","last_became_peered":"2024-03-09T14:42:19.004684+0000","last_unstale":"2024-03-09T15:07:18.975264+0000","last_undegraded":"2024-03-09T15:07:18.975264+0000","last_fullsized":"2024-03-09T15:07:18.975264+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:18.974984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:18.974984+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.974984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:41:00.527205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1b","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.624316+0000","last_change":"2024-03-09T15:07:19.624316+0000","last_active":"2024-03-09T15:07:19.624316+0000","last_peered":"2024-03-09T15:07:19.624316+0000","last_clean":"2024-03-09T15:07:19.624316+0000","last_became_active":"2024-03-09T14:42:15.972713+0000","last_became_peered":"2024-03-09T14:42:15.972713+0000","last_unstale":"2024-03-09T15:07:19.624316+0000","last_undegraded":"2024-03-09T15:07:19.624316+0000","last_fullsized":"2024-03-09T15:07:19.624316+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:19.624058+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:19.624058+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.624058+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:28:05.245432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'37","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.004401+0000","last_change":"2024-03-09T15:07:14.004463+0000","last_active":"2024-03-09T15:07:14.004401+0000","last_peered":"2024-03-09T15:07:14.004401+0000","last_clean":"2024-03-09T15:07:14.004401+0000","last_became_active":"2024-03-09T14:39:57.869392+0000","last_became_peered":"2024-03-09T14:39:57.869392+0000","last_unstale":"2024-03-09T15:07:14.004401+0000","last_undegraded":"2024-03-09T15:07:14.004401+0000","last_fullsized":"2024-03-09T15:07:14.004401+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'37","last_scrub_stamp":"2024-03-09T15:07:14.004204+0000","last_deep_scrub":"264'37","last_deep_scrub_stamp":"2024-03-09T15:07:14.004204+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.004204+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:16:31.384571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":118,"num_write":73,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:50.571013+0000","last_change":"2024-03-09T15:07:50.571128+0000","last_active":"2024-03-09T15:07:50.571013+0000","last_peered":"2024-03-09T15:07:50.571013+0000","last_clean":"2024-03-09T15:07:50.571013+0000","last_became_active":"2024-03-09T14:49:53.651987+0000","last_became_peered":"2024-03-09T14:49:53.651987+0000","last_unstale":"2024-03-09T15:07:50.571013+0000","last_undegraded":"2024-03-09T15:07:50.571013+0000","last_fullsized":"2024-03-09T15:07:50.571013+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:50.570738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:50.570738+0000","last_clean_scrub_stamp":"2024-03-09T15:07:50.570738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:27:46.662438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.961311+0000","last_change":"2024-03-09T15:07:38.961370+0000","last_active":"2024-03-09T15:07:38.961311+0000","last_peered":"2024-03-09T15:07:38.961311+0000","last_clean":"2024-03-09T15:07:38.961311+0000","last_became_active":"2024-03-09T14:42:19.294108+0000","last_became_peered":"2024-03-09T14:42:19.294108+0000","last_unstale":"2024-03-09T15:07:38.961311+0000","last_undegraded":"2024-03-09T15:07:38.961311+0000","last_fullsized":"2024-03-09T15:07:38.961311+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:38.961118+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:38.961118+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.961118+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:08:36.096432+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.453408+0000","last_change":"2024-03-09T15:07:21.453408+0000","last_active":"2024-03-09T15:07:21.453408+0000","last_peered":"2024-03-09T15:07:21.453408+0000","last_clean":"2024-03-09T15:07:21.453408+0000","last_became_active":"2024-03-09T14:42:15.947591+0000","last_became_peered":"2024-03-09T14:42:15.947591+0000","last_unstale":"2024-03-09T15:07:21.453408+0000","last_undegraded":"2024-03-09T15:07:21.453408+0000","last_fullsized":"2024-03-09T15:07:21.453408+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:21.453160+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:21.453160+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.453160+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:19:14.273952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'56","reported_seq":194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.641889+0000","last_change":"2024-03-09T15:07:12.641912+0000","last_active":"2024-03-09T15:07:12.641889+0000","last_peered":"2024-03-09T15:07:12.641889+0000","last_clean":"2024-03-09T15:07:12.641889+0000","last_became_active":"2024-03-09T14:39:57.894370+0000","last_became_peered":"2024-03-09T14:39:57.894370+0000","last_unstale":"2024-03-09T15:07:12.641889+0000","last_undegraded":"2024-03-09T15:07:12.641889+0000","last_fullsized":"2024-03-09T15:07:12.641889+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'56","last_scrub_stamp":"2024-03-09T15:07:12.641818+0000","last_deep_scrub":"264'56","last_deep_scrub_stamp":"2024-03-09T15:07:12.641818+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.641818+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:59:17.273282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":255,"num_read_kb":182,"num_write":87,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.558197+0000","last_change":"2024-03-09T15:07:40.558197+0000","last_active":"2024-03-09T15:07:40.558197+0000","last_peered":"2024-03-09T15:07:40.558197+0000","last_clean":"2024-03-09T15:07:40.558197+0000","last_became_active":"2024-03-09T14:49:53.660291+0000","last_became_peered":"2024-03-09T14:49:53.660291+0000","last_unstale":"2024-03-09T15:07:40.558197+0000","last_undegraded":"2024-03-09T15:07:40.558197+0000","last_fullsized":"2024-03-09T15:07:40.558197+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:40.557831+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:40.557831+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.557831+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:16:49.067897+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'6","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:11.080437+0000","last_change":"2024-03-09T15:08:11.080610+0000","last_active":"2024-03-09T15:08:11.080437+0000","last_peered":"2024-03-09T15:08:11.080437+0000","last_clean":"2024-03-09T15:08:11.080437+0000","last_became_active":"2024-03-09T14:42:19.294391+0000","last_became_peered":"2024-03-09T14:42:19.294391+0000","last_unstale":"2024-03-09T15:08:11.080437+0000","last_undegraded":"2024-03-09T15:08:11.080437+0000","last_fullsized":"2024-03-09T15:08:11.080437+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:08:11.080189+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:08:11.080189+0000","last_clean_scrub_stamp":"2024-03-09T15:08:11.080189+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:43:06.658160+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"261'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.885508+0000","last_change":"2024-03-09T15:07:15.885570+0000","last_active":"2024-03-09T15:07:15.885508+0000","last_peered":"2024-03-09T15:07:15.885508+0000","last_clean":"2024-03-09T15:07:15.885508+0000","last_became_active":"2024-03-09T14:42:15.961751+0000","last_became_peered":"2024-03-09T14:42:15.961751+0000","last_unstale":"2024-03-09T15:07:15.885508+0000","last_undegraded":"2024-03-09T15:07:15.885508+0000","last_fullsized":"2024-03-09T15:07:15.885508+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-03-09T15:07:15.885308+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-03-09T15:07:15.885308+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.885308+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:45:17.771916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":23,"num_write":2,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'41","reported_seq":159,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.989966+0000","last_change":"2024-03-09T15:07:19.990026+0000","last_active":"2024-03-09T15:07:19.989966+0000","last_peered":"2024-03-09T15:07:19.989966+0000","last_clean":"2024-03-09T15:07:19.989966+0000","last_became_active":"2024-03-09T14:39:57.898651+0000","last_became_peered":"2024-03-09T14:39:57.898651+0000","last_unstale":"2024-03-09T15:07:19.989966+0000","last_undegraded":"2024-03-09T15:07:19.989966+0000","last_fullsized":"2024-03-09T15:07:19.989966+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'41","last_scrub_stamp":"2024-03-09T15:07:19.989775+0000","last_deep_scrub":"264'41","last_deep_scrub_stamp":"2024-03-09T15:07:19.989775+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.989775+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:09:21.062799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":141,"num_write":58,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.818017+0000","last_change":"2024-03-09T15:08:06.818017+0000","last_active":"2024-03-09T15:08:06.818017+0000","last_peered":"2024-03-09T15:08:06.818017+0000","last_clean":"2024-03-09T15:08:06.818017+0000","last_became_active":"2024-03-09T14:49:53.677160+0000","last_became_peered":"2024-03-09T14:49:53.677160+0000","last_unstale":"2024-03-09T15:08:06.818017+0000","last_undegraded":"2024-03-09T15:08:06.818017+0000","last_fullsized":"2024-03-09T15:08:06.818017+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:06.817739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:06.817739+0000","last_clean_scrub_stamp":"2024-03-09T15:08:06.817739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:12:06.766396+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:10.090148+0000","last_change":"2024-03-09T15:08:10.090204+0000","last_active":"2024-03-09T15:08:10.090148+0000","last_peered":"2024-03-09T15:08:10.090148+0000","last_clean":"2024-03-09T15:08:10.090148+0000","last_became_active":"2024-03-09T14:42:19.297984+0000","last_became_peered":"2024-03-09T14:42:19.297984+0000","last_unstale":"2024-03-09T15:08:10.090148+0000","last_undegraded":"2024-03-09T15:08:10.090148+0000","last_fullsized":"2024-03-09T15:08:10.090148+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:10.089923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:10.089923+0000","last_clean_scrub_stamp":"2024-03-09T15:08:10.089923+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:26:36.733151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.589530+0000","last_change":"2024-03-09T15:07:36.589592+0000","last_active":"2024-03-09T15:07:36.589530+0000","last_peered":"2024-03-09T15:07:36.589530+0000","last_clean":"2024-03-09T15:07:36.589530+0000","last_became_active":"2024-03-09T14:42:15.958476+0000","last_became_peered":"2024-03-09T14:42:15.958476+0000","last_unstale":"2024-03-09T15:07:36.589530+0000","last_undegraded":"2024-03-09T15:07:36.589530+0000","last_fullsized":"2024-03-09T15:07:36.589530+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:36.589303+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:36.589303+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.589303+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:11:36.067313+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'112","reported_seq":384,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.534327+0000","last_change":"2024-03-09T15:07:23.534450+0000","last_active":"2024-03-09T15:07:23.534327+0000","last_peered":"2024-03-09T15:07:23.534327+0000","last_clean":"2024-03-09T15:07:23.534327+0000","last_became_active":"2024-03-09T14:39:57.872922+0000","last_became_peered":"2024-03-09T14:39:57.872922+0000","last_unstale":"2024-03-09T15:07:23.534327+0000","last_undegraded":"2024-03-09T15:07:23.534327+0000","last_fullsized":"2024-03-09T15:07:23.534327+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-03-09T15:07:23.534072+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-03-09T15:07:23.534072+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.534072+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:12:24.305321+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":634,"num_read_kb":458,"num_write":138,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2790,"num_omap_keys":6,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.628753+0000","last_change":"2024-03-09T15:07:56.628807+0000","last_active":"2024-03-09T15:07:56.628753+0000","last_peered":"2024-03-09T15:07:56.628753+0000","last_clean":"2024-03-09T15:07:56.628753+0000","last_became_active":"2024-03-09T14:49:53.651353+0000","last_became_peered":"2024-03-09T14:49:53.651353+0000","last_unstale":"2024-03-09T15:07:56.628753+0000","last_undegraded":"2024-03-09T15:07:56.628753+0000","last_fullsized":"2024-03-09T15:07:56.628753+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:56.628557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:56.628557+0000","last_clean_scrub_stamp":"2024-03-09T15:07:56.628557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:56:12.794658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"264'6","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:54.806040+0000","last_change":"2024-03-09T15:07:54.806113+0000","last_active":"2024-03-09T15:07:54.806040+0000","last_peered":"2024-03-09T15:07:54.806040+0000","last_clean":"2024-03-09T15:07:54.806040+0000","last_became_active":"2024-03-09T14:42:19.011213+0000","last_became_peered":"2024-03-09T14:42:19.011213+0000","last_unstale":"2024-03-09T15:07:54.806040+0000","last_undegraded":"2024-03-09T15:07:54.806040+0000","last_fullsized":"2024-03-09T15:07:54.806040+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:54.805844+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:54.805844+0000","last_clean_scrub_stamp":"2024-03-09T15:07:54.805844+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:36:57.733045+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"264'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.761253+0000","last_change":"2024-03-09T15:07:31.761371+0000","last_active":"2024-03-09T15:07:31.761253+0000","last_peered":"2024-03-09T15:07:31.761253+0000","last_clean":"2024-03-09T15:07:31.761253+0000","last_became_active":"2024-03-09T14:42:15.974300+0000","last_became_peered":"2024-03-09T14:42:15.974300+0000","last_unstale":"2024-03-09T15:07:31.761253+0000","last_undegraded":"2024-03-09T15:07:31.761253+0000","last_fullsized":"2024-03-09T15:07:31.761253+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:31.760972+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:31.760972+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.760972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:01:56.025111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'10","reported_seq":76,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.953816+0000","last_change":"2024-03-09T15:07:20.953816+0000","last_active":"2024-03-09T15:07:20.953816+0000","last_peered":"2024-03-09T15:07:20.953816+0000","last_clean":"2024-03-09T15:07:20.953816+0000","last_became_active":"2024-03-09T14:39:57.905161+0000","last_became_peered":"2024-03-09T14:39:57.905161+0000","last_unstale":"2024-03-09T15:07:20.953816+0000","last_undegraded":"2024-03-09T15:07:20.953816+0000","last_fullsized":"2024-03-09T15:07:20.953816+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'10","last_scrub_stamp":"2024-03-09T15:07:20.953411+0000","last_deep_scrub":"264'10","last_deep_scrub_stamp":"2024-03-09T15:07:20.953411+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.953411+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:35:23.607004+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":23,"num_write":23,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:13.080049+0000","last_change":"2024-03-09T15:08:13.080103+0000","last_active":"2024-03-09T15:08:13.080049+0000","last_peered":"2024-03-09T15:08:13.080049+0000","last_clean":"2024-03-09T15:08:13.080049+0000","last_became_active":"2024-03-09T14:49:53.676180+0000","last_became_peered":"2024-03-09T14:49:53.676180+0000","last_unstale":"2024-03-09T15:08:13.080049+0000","last_undegraded":"2024-03-09T15:08:13.080049+0000","last_fullsized":"2024-03-09T15:08:13.080049+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:13.079851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:13.079851+0000","last_clean_scrub_stamp":"2024-03-09T15:08:13.079851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:54.224855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"264'16","reported_seq":74,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.574709+0000","last_change":"2024-03-09T15:07:48.574709+0000","last_active":"2024-03-09T15:07:48.574709+0000","last_peered":"2024-03-09T15:07:48.574709+0000","last_clean":"2024-03-09T15:07:48.574709+0000","last_became_active":"2024-03-09T14:42:19.015001+0000","last_became_peered":"2024-03-09T14:42:19.015001+0000","last_unstale":"2024-03-09T15:07:48.574709+0000","last_undegraded":"2024-03-09T15:07:48.574709+0000","last_fullsized":"2024-03-09T15:07:48.574709+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-03-09T15:07:48.574446+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-03-09T15:07:48.574446+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.574446+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:43:43.889282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":18444,"num_write":29,"num_write_kb":15365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"264'9","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.826689+0000","last_change":"2024-03-09T15:07:14.826689+0000","last_active":"2024-03-09T15:07:14.826689+0000","last_peered":"2024-03-09T15:07:14.826689+0000","last_clean":"2024-03-09T15:07:14.826689+0000","last_became_active":"2024-03-09T14:42:15.936690+0000","last_became_peered":"2024-03-09T14:42:15.936690+0000","last_unstale":"2024-03-09T15:07:14.826689+0000","last_undegraded":"2024-03-09T15:07:14.826689+0000","last_fullsized":"2024-03-09T15:07:14.826689+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-03-09T15:07:14.826428+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-03-09T15:07:14.826428+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.826428+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:10:49.901286+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"264'45","reported_seq":164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.923011+0000","last_change":"2024-03-09T15:07:23.923011+0000","last_active":"2024-03-09T15:07:23.923011+0000","last_peered":"2024-03-09T15:07:23.923011+0000","last_clean":"2024-03-09T15:07:23.923011+0000","last_became_active":"2024-03-09T14:39:57.900112+0000","last_became_peered":"2024-03-09T14:39:57.900112+0000","last_unstale":"2024-03-09T15:07:23.923011+0000","last_undegraded":"2024-03-09T15:07:23.923011+0000","last_fullsized":"2024-03-09T15:07:23.923011+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-03-09T15:07:23.922739+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-03-09T15:07:23.922739+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.922739+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:54:20.010708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":191,"num_read_kb":133,"num_write":83,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:07.690792+0000","last_change":"2024-03-09T15:08:07.690847+0000","last_active":"2024-03-09T15:08:07.690792+0000","last_peered":"2024-03-09T15:08:07.690792+0000","last_clean":"2024-03-09T15:08:07.690792+0000","last_became_active":"2024-03-09T14:49:53.683189+0000","last_became_peered":"2024-03-09T14:49:53.683189+0000","last_unstale":"2024-03-09T15:08:07.690792+0000","last_undegraded":"2024-03-09T15:08:07.690792+0000","last_fullsized":"2024-03-09T15:08:07.690792+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:07.690596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:07.690596+0000","last_clean_scrub_stamp":"2024-03-09T15:08:07.690596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:40:57.377757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"264'2","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.589711+0000","last_change":"2024-03-09T15:07:47.589711+0000","last_active":"2024-03-09T15:07:47.589711+0000","last_peered":"2024-03-09T15:07:47.589711+0000","last_clean":"2024-03-09T15:07:47.589711+0000","last_became_active":"2024-03-09T14:42:19.009159+0000","last_became_peered":"2024-03-09T14:42:19.009159+0000","last_unstale":"2024-03-09T15:07:47.589711+0000","last_undegraded":"2024-03-09T15:07:47.589711+0000","last_fullsized":"2024-03-09T15:07:47.589711+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:47.589448+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:47.589448+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.589448+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:13:12.302460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"264'12","reported_seq":70,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.993120+0000","last_change":"2024-03-09T15:07:14.993120+0000","last_active":"2024-03-09T15:07:14.993120+0000","last_peered":"2024-03-09T15:07:14.993120+0000","last_clean":"2024-03-09T15:07:14.993120+0000","last_became_active":"2024-03-09T14:42:15.953580+0000","last_became_peered":"2024-03-09T14:42:15.953580+0000","last_unstale":"2024-03-09T15:07:14.993120+0000","last_undegraded":"2024-03-09T15:07:14.993120+0000","last_fullsized":"2024-03-09T15:07:14.993120+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-03-09T15:07:14.992761+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-03-09T15:07:14.992761+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.992761+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:19:32.196578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":25600,"num_write":27,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'39","reported_seq":144,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.687519+0000","last_change":"2024-03-09T15:07:10.687519+0000","last_active":"2024-03-09T15:07:10.687519+0000","last_peered":"2024-03-09T15:07:10.687519+0000","last_clean":"2024-03-09T15:07:10.687519+0000","last_became_active":"2024-03-09T14:39:57.896549+0000","last_became_peered":"2024-03-09T14:39:57.896549+0000","last_unstale":"2024-03-09T15:07:10.687519+0000","last_undegraded":"2024-03-09T15:07:10.687519+0000","last_fullsized":"2024-03-09T15:07:10.687519+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'39","last_scrub_stamp":"2024-03-09T15:07:10.687377+0000","last_deep_scrub":"264'39","last_deep_scrub_stamp":"2024-03-09T15:07:10.687377+0000","last_clean_scrub_stamp":"2024-03-09T15:07:10.687377+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:57:37.398766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":110,"num_write":67,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:04.640763+0000","last_change":"2024-03-09T15:08:04.640849+0000","last_active":"2024-03-09T15:08:04.640763+0000","last_peered":"2024-03-09T15:08:04.640763+0000","last_clean":"2024-03-09T15:08:04.640763+0000","last_became_active":"2024-03-09T14:49:53.673345+0000","last_became_peered":"2024-03-09T14:49:53.673345+0000","last_unstale":"2024-03-09T15:08:04.640763+0000","last_undegraded":"2024-03-09T15:08:04.640763+0000","last_fullsized":"2024-03-09T15:08:04.640763+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:08:04.640569+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:08:04.640569+0000","last_clean_scrub_stamp":"2024-03-09T15:08:04.640569+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:28:57.286313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"264'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.919863+0000","last_change":"2024-03-09T15:07:34.919863+0000","last_active":"2024-03-09T15:07:34.919863+0000","last_peered":"2024-03-09T15:07:34.919863+0000","last_clean":"2024-03-09T15:07:34.919863+0000","last_became_active":"2024-03-09T14:42:19.020650+0000","last_became_peered":"2024-03-09T14:42:19.020650+0000","last_unstale":"2024-03-09T15:07:34.919863+0000","last_undegraded":"2024-03-09T15:07:34.919863+0000","last_fullsized":"2024-03-09T15:07:34.919863+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:34.919605+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:34.919605+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.919605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:46:15.256187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.232318+0000","last_change":"2024-03-09T15:07:17.232318+0000","last_active":"2024-03-09T15:07:17.232318+0000","last_peered":"2024-03-09T15:07:17.232318+0000","last_clean":"2024-03-09T15:07:17.232318+0000","last_became_active":"2024-03-09T14:42:15.958276+0000","last_became_peered":"2024-03-09T14:42:15.958276+0000","last_unstale":"2024-03-09T15:07:17.232318+0000","last_undegraded":"2024-03-09T15:07:17.232318+0000","last_fullsized":"2024-03-09T15:07:17.232318+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:17.232075+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:17.232075+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.232075+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:59:22.106180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'35","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.832292+0000","last_change":"2024-03-09T15:07:12.832292+0000","last_active":"2024-03-09T15:07:12.832292+0000","last_peered":"2024-03-09T15:07:12.832292+0000","last_clean":"2024-03-09T15:07:12.832292+0000","last_became_active":"2024-03-09T14:39:57.891706+0000","last_became_peered":"2024-03-09T14:39:57.891706+0000","last_unstale":"2024-03-09T15:07:12.832292+0000","last_undegraded":"2024-03-09T15:07:12.832292+0000","last_fullsized":"2024-03-09T15:07:12.832292+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-03-09T15:07:12.832019+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-03-09T15:07:12.832019+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.832019+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:50:16.384247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":140,"num_read_kb":98,"num_write":60,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:15.154749+0000","last_change":"2024-03-09T15:08:15.154824+0000","last_active":"2024-03-09T15:08:15.154749+0000","last_peered":"2024-03-09T15:08:15.154749+0000","last_clean":"2024-03-09T15:08:15.154749+0000","last_became_active":"2024-03-09T14:49:53.670121+0000","last_became_peered":"2024-03-09T14:49:53.670121+0000","last_unstale":"2024-03-09T15:08:15.154749+0000","last_undegraded":"2024-03-09T15:08:15.154749+0000","last_fullsized":"2024-03-09T15:08:15.154749+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:08:15.154542+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:08:15.154542+0000","last_clean_scrub_stamp":"2024-03-09T15:08:15.154542+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:59:21.067798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.092997+0000","last_change":"2024-03-09T15:07:45.092997+0000","last_active":"2024-03-09T15:07:45.092997+0000","last_peered":"2024-03-09T15:07:45.092997+0000","last_clean":"2024-03-09T15:07:45.092997+0000","last_became_active":"2024-03-09T14:42:18.992996+0000","last_became_peered":"2024-03-09T14:42:18.992996+0000","last_unstale":"2024-03-09T15:07:45.092997+0000","last_undegraded":"2024-03-09T15:07:45.092997+0000","last_fullsized":"2024-03-09T15:07:45.092997+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:45.092754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:45.092754+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.092754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:48:28.791963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"261'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.485241+0000","last_change":"2024-03-09T15:07:25.485241+0000","last_active":"2024-03-09T15:07:25.485241+0000","last_peered":"2024-03-09T15:07:25.485241+0000","last_clean":"2024-03-09T15:07:25.485241+0000","last_became_active":"2024-03-09T14:42:15.950001+0000","last_became_peered":"2024-03-09T14:42:15.950001+0000","last_unstale":"2024-03-09T15:07:25.485241+0000","last_undegraded":"2024-03-09T15:07:25.485241+0000","last_fullsized":"2024-03-09T15:07:25.485241+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:25.484949+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:25.484949+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.484949+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:42.285163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'55","reported_seq":178,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.041637+0000","last_change":"2024-03-09T15:07:14.041637+0000","last_active":"2024-03-09T15:07:14.041637+0000","last_peered":"2024-03-09T15:07:14.041637+0000","last_clean":"2024-03-09T15:07:14.041637+0000","last_became_active":"2024-03-09T14:39:57.909827+0000","last_became_peered":"2024-03-09T14:39:57.909827+0000","last_unstale":"2024-03-09T15:07:14.041637+0000","last_undegraded":"2024-03-09T15:07:14.041637+0000","last_fullsized":"2024-03-09T15:07:14.041637+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'55","last_scrub_stamp":"2024-03-09T15:07:14.041251+0000","last_deep_scrub":"264'55","last_deep_scrub_stamp":"2024-03-09T15:07:14.041251+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.041251+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:44:17.414317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":212,"num_read_kb":147,"num_write":99,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.566069+0000","last_change":"2024-03-09T15:07:39.566127+0000","last_active":"2024-03-09T15:07:39.566069+0000","last_peered":"2024-03-09T15:07:39.566069+0000","last_clean":"2024-03-09T15:07:39.566069+0000","last_became_active":"2024-03-09T14:49:53.641152+0000","last_became_peered":"2024-03-09T14:49:53.641152+0000","last_unstale":"2024-03-09T15:07:39.566069+0000","last_undegraded":"2024-03-09T15:07:39.566069+0000","last_fullsized":"2024-03-09T15:07:39.566069+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:39.565858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:39.565858+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.565858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:11:49.699057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"264'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.014761+0000","last_change":"2024-03-09T15:07:23.014822+0000","last_active":"2024-03-09T15:07:23.014761+0000","last_peered":"2024-03-09T15:07:23.014761+0000","last_clean":"2024-03-09T15:07:23.014761+0000","last_became_active":"2024-03-09T14:42:19.013356+0000","last_became_peered":"2024-03-09T14:42:19.013356+0000","last_unstale":"2024-03-09T15:07:23.014761+0000","last_undegraded":"2024-03-09T15:07:23.014761+0000","last_fullsized":"2024-03-09T15:07:23.014761+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:07:23.014568+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:07:23.014568+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.014568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:32:57.682164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.863792+0000","last_change":"2024-03-09T15:07:12.863850+0000","last_active":"2024-03-09T15:07:12.863792+0000","last_peered":"2024-03-09T15:07:12.863792+0000","last_clean":"2024-03-09T15:07:12.863792+0000","last_became_active":"2024-03-09T14:42:15.964591+0000","last_became_peered":"2024-03-09T14:42:15.964591+0000","last_unstale":"2024-03-09T15:07:12.863792+0000","last_undegraded":"2024-03-09T15:07:12.863792+0000","last_fullsized":"2024-03-09T15:07:12.863792+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:12.863592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:12.863592+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.863592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:43:17.329732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'15","reported_seq":93,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.946943+0000","last_change":"2024-03-09T15:07:16.947005+0000","last_active":"2024-03-09T15:07:16.946943+0000","last_peered":"2024-03-09T15:07:16.946943+0000","last_clean":"2024-03-09T15:07:16.946943+0000","last_became_active":"2024-03-09T14:39:57.898952+0000","last_became_peered":"2024-03-09T14:39:57.898952+0000","last_unstale":"2024-03-09T15:07:16.946943+0000","last_undegraded":"2024-03-09T15:07:16.946943+0000","last_fullsized":"2024-03-09T15:07:16.946943+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'15","last_scrub_stamp":"2024-03-09T15:07:16.946726+0000","last_deep_scrub":"264'15","last_deep_scrub_stamp":"2024-03-09T15:07:16.946726+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.946726+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:32.769206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":52,"num_write":21,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.026757+0000","last_change":"2024-03-09T15:07:31.026757+0000","last_active":"2024-03-09T15:07:31.026757+0000","last_peered":"2024-03-09T15:07:31.026757+0000","last_clean":"2024-03-09T15:07:31.026757+0000","last_became_active":"2024-03-09T14:49:53.653943+0000","last_became_peered":"2024-03-09T14:49:53.653943+0000","last_unstale":"2024-03-09T15:07:31.026757+0000","last_undegraded":"2024-03-09T15:07:31.026757+0000","last_fullsized":"2024-03-09T15:07:31.026757+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:31.026484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:31.026484+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.026484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:21:58.692908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"264'3","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.975883+0000","last_change":"2024-03-09T15:07:26.975946+0000","last_active":"2024-03-09T15:07:26.975883+0000","last_peered":"2024-03-09T15:07:26.975883+0000","last_clean":"2024-03-09T15:07:26.975883+0000","last_became_active":"2024-03-09T14:42:19.008729+0000","last_became_peered":"2024-03-09T14:42:19.008729+0000","last_unstale":"2024-03-09T15:07:26.975883+0000","last_undegraded":"2024-03-09T15:07:26.975883+0000","last_fullsized":"2024-03-09T15:07:26.975883+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:26.975688+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:26.975688+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.975688+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:22:03.596581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.538842+0000","last_change":"2024-03-09T15:07:38.538897+0000","last_active":"2024-03-09T15:07:38.538842+0000","last_peered":"2024-03-09T15:07:38.538842+0000","last_clean":"2024-03-09T15:07:38.538842+0000","last_became_active":"2024-03-09T14:42:15.978166+0000","last_became_peered":"2024-03-09T14:42:15.978166+0000","last_unstale":"2024-03-09T15:07:38.538842+0000","last_undegraded":"2024-03-09T15:07:38.538842+0000","last_fullsized":"2024-03-09T15:07:38.538842+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:38.538641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:38.538641+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.538641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:15:02.484560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'46","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.531125+0000","last_change":"2024-03-09T15:07:17.531186+0000","last_active":"2024-03-09T15:07:17.531125+0000","last_peered":"2024-03-09T15:07:17.531125+0000","last_clean":"2024-03-09T15:07:17.531125+0000","last_became_active":"2024-03-09T14:39:57.904012+0000","last_became_peered":"2024-03-09T14:39:57.904012+0000","last_unstale":"2024-03-09T15:07:17.531125+0000","last_undegraded":"2024-03-09T15:07:17.531125+0000","last_fullsized":"2024-03-09T15:07:17.531125+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'46","last_scrub_stamp":"2024-03-09T15:07:17.530930+0000","last_deep_scrub":"264'46","last_deep_scrub_stamp":"2024-03-09T15:07:17.530930+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.530930+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:03:28.425445+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":186,"num_read_kb":131,"num_write":86,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.993104+0000","last_change":"2024-03-09T15:07:49.993157+0000","last_active":"2024-03-09T15:07:49.993104+0000","last_peered":"2024-03-09T15:07:49.993104+0000","last_clean":"2024-03-09T15:07:49.993104+0000","last_became_active":"2024-03-09T14:49:53.678157+0000","last_became_peered":"2024-03-09T14:49:53.678157+0000","last_unstale":"2024-03-09T15:07:49.993104+0000","last_undegraded":"2024-03-09T15:07:49.993104+0000","last_fullsized":"2024-03-09T15:07:49.993104+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:49.992886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:49.992886+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.992886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:52:39.799702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.548576+0000","last_change":"2024-03-09T15:07:49.548630+0000","last_active":"2024-03-09T15:07:49.548576+0000","last_peered":"2024-03-09T15:07:49.548576+0000","last_clean":"2024-03-09T15:07:49.548576+0000","last_became_active":"2024-03-09T14:42:19.295533+0000","last_became_peered":"2024-03-09T14:42:19.295533+0000","last_unstale":"2024-03-09T15:07:49.548576+0000","last_undegraded":"2024-03-09T15:07:49.548576+0000","last_fullsized":"2024-03-09T15:07:49.548576+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:49.548387+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:49.548387+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.548387+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:11:17.213530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"261'6","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.565280+0000","last_change":"2024-03-09T15:07:15.565345+0000","last_active":"2024-03-09T15:07:15.565280+0000","last_peered":"2024-03-09T15:07:15.565280+0000","last_clean":"2024-03-09T15:07:15.565280+0000","last_became_active":"2024-03-09T14:42:15.968323+0000","last_became_peered":"2024-03-09T14:42:15.968323+0000","last_unstale":"2024-03-09T15:07:15.565280+0000","last_undegraded":"2024-03-09T15:07:15.565280+0000","last_fullsized":"2024-03-09T15:07:15.565280+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-03-09T15:07:15.565071+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-03-09T15:07:15.565071+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.565071+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:55:13.724228+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'40","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.239744+0000","last_change":"2024-03-09T15:07:15.239878+0000","last_active":"2024-03-09T15:07:15.239744+0000","last_peered":"2024-03-09T15:07:15.239744+0000","last_clean":"2024-03-09T15:07:15.239744+0000","last_became_active":"2024-03-09T14:39:57.898234+0000","last_became_peered":"2024-03-09T14:39:57.898234+0000","last_unstale":"2024-03-09T15:07:15.239744+0000","last_undegraded":"2024-03-09T15:07:15.239744+0000","last_fullsized":"2024-03-09T15:07:15.239744+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-03-09T15:07:15.239453+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-03-09T15:07:15.239453+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.239453+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:59:16.397508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":157,"num_read_kb":111,"num_write":71,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.018870+0000","last_change":"2024-03-09T15:07:35.018930+0000","last_active":"2024-03-09T15:07:35.018870+0000","last_peered":"2024-03-09T15:07:35.018870+0000","last_clean":"2024-03-09T15:07:35.018870+0000","last_became_active":"2024-03-09T14:49:53.662812+0000","last_became_peered":"2024-03-09T14:49:53.662812+0000","last_unstale":"2024-03-09T15:07:35.018870+0000","last_undegraded":"2024-03-09T15:07:35.018870+0000","last_fullsized":"2024-03-09T15:07:35.018870+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.018672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.018672+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.018672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:49:46.866451+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'7","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.984757+0000","last_change":"2024-03-09T15:07:30.984820+0000","last_active":"2024-03-09T15:07:30.984757+0000","last_peered":"2024-03-09T15:07:30.984757+0000","last_clean":"2024-03-09T15:07:30.984757+0000","last_became_active":"2024-03-09T14:42:19.017434+0000","last_became_peered":"2024-03-09T14:42:19.017434+0000","last_unstale":"2024-03-09T15:07:30.984757+0000","last_undegraded":"2024-03-09T15:07:30.984757+0000","last_fullsized":"2024-03-09T15:07:30.984757+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-03-09T15:07:30.984571+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-03-09T15:07:30.984571+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.984571+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:06:03.083175+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":8272,"num_write":12,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:10.908491+0000","last_change":"2024-03-09T15:07:10.908536+0000","last_active":"2024-03-09T15:07:10.908491+0000","last_peered":"2024-03-09T15:07:10.908491+0000","last_clean":"2024-03-09T15:07:10.908491+0000","last_became_active":"2024-03-09T14:42:15.945565+0000","last_became_peered":"2024-03-09T14:42:15.945565+0000","last_unstale":"2024-03-09T15:07:10.908491+0000","last_undegraded":"2024-03-09T15:07:10.908491+0000","last_fullsized":"2024-03-09T15:07:10.908491+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:07:10.908404+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:07:10.908404+0000","last_clean_scrub_stamp":"2024-03-09T15:07:10.908404+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:53:19.761717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1029,"num_write":10,"num_write_kb":1029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'55","reported_seq":184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.571140+0000","last_change":"2024-03-09T15:07:35.571202+0000","last_active":"2024-03-09T15:07:35.571140+0000","last_peered":"2024-03-09T15:07:35.571140+0000","last_clean":"2024-03-09T15:07:35.571140+0000","last_became_active":"2024-03-09T14:39:57.900659+0000","last_became_peered":"2024-03-09T14:39:57.900659+0000","last_unstale":"2024-03-09T15:07:35.571140+0000","last_undegraded":"2024-03-09T15:07:35.571140+0000","last_fullsized":"2024-03-09T15:07:35.571140+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'55","last_scrub_stamp":"2024-03-09T15:07:35.570944+0000","last_deep_scrub":"264'55","last_deep_scrub_stamp":"2024-03-09T15:07:35.570944+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.570944+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:53:47.902666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":228,"num_read_kb":161,"num_write":89,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:16.163025+0000","last_change":"2024-03-09T15:08:16.163085+0000","last_active":"2024-03-09T15:08:16.163025+0000","last_peered":"2024-03-09T15:08:16.163025+0000","last_clean":"2024-03-09T15:08:16.163025+0000","last_became_active":"2024-03-09T14:49:53.678822+0000","last_became_peered":"2024-03-09T14:49:53.678822+0000","last_unstale":"2024-03-09T15:08:16.163025+0000","last_undegraded":"2024-03-09T15:08:16.163025+0000","last_fullsized":"2024-03-09T15:08:16.163025+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:16.162769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:16.162769+0000","last_clean_scrub_stamp":"2024-03-09T15:08:16.162769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:57:04.394767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'3","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:57.760875+0000","last_change":"2024-03-09T15:07:57.760875+0000","last_active":"2024-03-09T15:07:57.760875+0000","last_peered":"2024-03-09T15:07:57.760875+0000","last_clean":"2024-03-09T15:07:57.760875+0000","last_became_active":"2024-03-09T14:42:19.016262+0000","last_became_peered":"2024-03-09T14:42:19.016262+0000","last_unstale":"2024-03-09T15:07:57.760875+0000","last_undegraded":"2024-03-09T15:07:57.760875+0000","last_fullsized":"2024-03-09T15:07:57.760875+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:57.760618+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:57.760618+0000","last_clean_scrub_stamp":"2024-03-09T15:07:57.760618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:14.671953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"264'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.649832+0000","last_change":"2024-03-09T15:07:11.649832+0000","last_active":"2024-03-09T15:07:11.649832+0000","last_peered":"2024-03-09T15:07:11.649832+0000","last_clean":"2024-03-09T15:07:11.649832+0000","last_became_active":"2024-03-09T14:42:15.963496+0000","last_became_peered":"2024-03-09T14:42:15.963496+0000","last_unstale":"2024-03-09T15:07:11.649832+0000","last_undegraded":"2024-03-09T15:07:11.649832+0000","last_fullsized":"2024-03-09T15:07:11.649832+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:11.649700+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:11.649700+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.649700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:54:34.580055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'33","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.595715+0000","last_change":"2024-03-09T15:07:17.595774+0000","last_active":"2024-03-09T15:07:17.595715+0000","last_peered":"2024-03-09T15:07:17.595715+0000","last_clean":"2024-03-09T15:07:17.595715+0000","last_became_active":"2024-03-09T14:39:57.879068+0000","last_became_peered":"2024-03-09T14:39:57.879068+0000","last_unstale":"2024-03-09T15:07:17.595715+0000","last_undegraded":"2024-03-09T15:07:17.595715+0000","last_fullsized":"2024-03-09T15:07:17.595715+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-03-09T15:07:17.595518+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-03-09T15:07:17.595518+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.595518+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:22:14.173013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":89,"num_write":57,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:02.811957+0000","last_change":"2024-03-09T15:08:02.812009+0000","last_active":"2024-03-09T15:08:02.811957+0000","last_peered":"2024-03-09T15:08:02.811957+0000","last_clean":"2024-03-09T15:08:02.811957+0000","last_became_active":"2024-03-09T14:49:53.666088+0000","last_became_peered":"2024-03-09T14:49:53.666088+0000","last_unstale":"2024-03-09T15:08:02.811957+0000","last_undegraded":"2024-03-09T15:08:02.811957+0000","last_fullsized":"2024-03-09T15:08:02.811957+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:02.811762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:02.811762+0000","last_clean_scrub_stamp":"2024-03-09T15:08:02.811762+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:39:30.236101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'3","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.901598+0000","last_change":"2024-03-09T15:07:18.901598+0000","last_active":"2024-03-09T15:07:18.901598+0000","last_peered":"2024-03-09T15:07:18.901598+0000","last_clean":"2024-03-09T15:07:18.901598+0000","last_became_active":"2024-03-09T14:42:19.288155+0000","last_became_peered":"2024-03-09T14:42:19.288155+0000","last_unstale":"2024-03-09T15:07:18.901598+0000","last_undegraded":"2024-03-09T15:07:18.901598+0000","last_fullsized":"2024-03-09T15:07:18.901598+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:18.901334+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:18.901334+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.901334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:16.864340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.955237+0000","last_change":"2024-03-09T15:07:11.955237+0000","last_active":"2024-03-09T15:07:11.955237+0000","last_peered":"2024-03-09T15:07:11.955237+0000","last_clean":"2024-03-09T15:07:11.955237+0000","last_became_active":"2024-03-09T14:42:15.962004+0000","last_became_peered":"2024-03-09T14:42:15.962004+0000","last_unstale":"2024-03-09T15:07:11.955237+0000","last_undegraded":"2024-03-09T15:07:11.955237+0000","last_fullsized":"2024-03-09T15:07:11.955237+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:11.955103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:11.955103+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.955103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:20:11.932735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'31","reported_seq":126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.946048+0000","last_change":"2024-03-09T15:07:19.946048+0000","last_active":"2024-03-09T15:07:19.946048+0000","last_peered":"2024-03-09T15:07:19.946048+0000","last_clean":"2024-03-09T15:07:19.946048+0000","last_became_active":"2024-03-09T14:39:57.906043+0000","last_became_peered":"2024-03-09T14:39:57.906043+0000","last_unstale":"2024-03-09T15:07:19.946048+0000","last_undegraded":"2024-03-09T15:07:19.946048+0000","last_fullsized":"2024-03-09T15:07:19.946048+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-03-09T15:07:19.945806+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-03-09T15:07:19.945806+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.945806+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:28:12.471486+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":86,"num_write":59,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:03.822220+0000","last_change":"2024-03-09T15:08:03.822297+0000","last_active":"2024-03-09T15:08:03.822220+0000","last_peered":"2024-03-09T15:08:03.822220+0000","last_clean":"2024-03-09T15:08:03.822220+0000","last_became_active":"2024-03-09T14:49:53.666251+0000","last_became_peered":"2024-03-09T14:49:53.666251+0000","last_unstale":"2024-03-09T15:08:03.822220+0000","last_undegraded":"2024-03-09T15:08:03.822220+0000","last_fullsized":"2024-03-09T15:08:03.822220+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:08:03.822015+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:08:03.822015+0000","last_clean_scrub_stamp":"2024-03-09T15:08:03.822015+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:11:37.264514+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.906150+0000","last_change":"2024-03-09T15:07:19.906205+0000","last_active":"2024-03-09T15:07:19.906150+0000","last_peered":"2024-03-09T15:07:19.906150+0000","last_clean":"2024-03-09T15:07:19.906150+0000","last_became_active":"2024-03-09T14:42:18.998145+0000","last_became_peered":"2024-03-09T14:42:18.998145+0000","last_unstale":"2024-03-09T15:07:19.906150+0000","last_undegraded":"2024-03-09T15:07:19.906150+0000","last_fullsized":"2024-03-09T15:07:19.906150+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:19.905948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:19.905948+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.905948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:21:38.351715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"264'4","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.663618+0000","last_change":"2024-03-09T15:07:27.663618+0000","last_active":"2024-03-09T15:07:27.663618+0000","last_peered":"2024-03-09T15:07:27.663618+0000","last_clean":"2024-03-09T15:07:27.663618+0000","last_became_active":"2024-03-09T14:42:15.973793+0000","last_became_peered":"2024-03-09T14:42:15.973793+0000","last_unstale":"2024-03-09T15:07:27.663618+0000","last_undegraded":"2024-03-09T15:07:27.663618+0000","last_fullsized":"2024-03-09T15:07:27.663618+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:07:27.663315+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:07:27.663315+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.663315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:07.805577+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":13312,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'18","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.978140+0000","last_change":"2024-03-09T15:07:17.978140+0000","last_active":"2024-03-09T15:07:17.978140+0000","last_peered":"2024-03-09T15:07:17.978140+0000","last_clean":"2024-03-09T15:07:17.978140+0000","last_became_active":"2024-03-09T14:39:57.895347+0000","last_became_peered":"2024-03-09T14:39:57.895347+0000","last_unstale":"2024-03-09T15:07:17.978140+0000","last_undegraded":"2024-03-09T15:07:17.978140+0000","last_fullsized":"2024-03-09T15:07:17.978140+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'18","last_scrub_stamp":"2024-03-09T15:07:17.977877+0000","last_deep_scrub":"264'18","last_deep_scrub_stamp":"2024-03-09T15:07:17.977877+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.977877+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:10:27.720426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":49,"num_write":32,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:05.676241+0000","last_change":"2024-03-09T15:08:05.676308+0000","last_active":"2024-03-09T15:08:05.676241+0000","last_peered":"2024-03-09T15:08:05.676241+0000","last_clean":"2024-03-09T15:08:05.676241+0000","last_became_active":"2024-03-09T14:49:53.676907+0000","last_became_peered":"2024-03-09T14:49:53.676907+0000","last_unstale":"2024-03-09T15:08:05.676241+0000","last_undegraded":"2024-03-09T15:08:05.676241+0000","last_fullsized":"2024-03-09T15:08:05.676241+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:05.676020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:05.676020+0000","last_clean_scrub_stamp":"2024-03-09T15:08:05.676020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:25:30.962462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.983592+0000","last_change":"2024-03-09T15:07:26.983592+0000","last_active":"2024-03-09T15:07:26.983592+0000","last_peered":"2024-03-09T15:07:26.983592+0000","last_clean":"2024-03-09T15:07:26.983592+0000","last_became_active":"2024-03-09T14:42:29.984595+0000","last_became_peered":"2024-03-09T14:42:29.984595+0000","last_unstale":"2024-03-09T15:07:26.983592+0000","last_undegraded":"2024-03-09T15:07:26.983592+0000","last_fullsized":"2024-03-09T15:07:26.983592+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:26.983320+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:26.983320+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.983320+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:58:22.547118+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"264'6","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.789750+0000","last_change":"2024-03-09T15:07:18.789875+0000","last_active":"2024-03-09T15:07:18.789750+0000","last_peered":"2024-03-09T15:07:18.789750+0000","last_clean":"2024-03-09T15:07:18.789750+0000","last_became_active":"2024-03-09T14:42:15.941583+0000","last_became_peered":"2024-03-09T14:42:15.941583+0000","last_unstale":"2024-03-09T15:07:18.789750+0000","last_undegraded":"2024-03-09T15:07:18.789750+0000","last_fullsized":"2024-03-09T15:07:18.789750+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:18.789520+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:18.789520+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.789520+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:04.840942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":16,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'16","reported_seq":98,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.198066+0000","last_change":"2024-03-09T15:07:18.198066+0000","last_active":"2024-03-09T15:07:18.198066+0000","last_peered":"2024-03-09T15:07:18.198066+0000","last_clean":"2024-03-09T15:07:18.198066+0000","last_became_active":"2024-03-09T14:39:57.884479+0000","last_became_peered":"2024-03-09T14:39:57.884479+0000","last_unstale":"2024-03-09T15:07:18.198066+0000","last_undegraded":"2024-03-09T15:07:18.198066+0000","last_fullsized":"2024-03-09T15:07:18.198066+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'16","last_scrub_stamp":"2024-03-09T15:07:18.197804+0000","last_deep_scrub":"264'16","last_deep_scrub_stamp":"2024-03-09T15:07:18.197804+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.197804+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:28:01.332954+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":55,"num_write":35,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.787730+0000","last_change":"2024-03-09T15:08:01.787781+0000","last_active":"2024-03-09T15:08:01.787730+0000","last_peered":"2024-03-09T15:08:01.787730+0000","last_clean":"2024-03-09T15:08:01.787730+0000","last_became_active":"2024-03-09T14:49:53.663825+0000","last_became_peered":"2024-03-09T14:49:53.663825+0000","last_unstale":"2024-03-09T15:08:01.787730+0000","last_undegraded":"2024-03-09T15:08:01.787730+0000","last_fullsized":"2024-03-09T15:08:01.787730+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:01.787551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:01.787551+0000","last_clean_scrub_stamp":"2024-03-09T15:08:01.787551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:21:44.185235+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.764079+0000","last_change":"2024-03-09T15:07:35.764139+0000","last_active":"2024-03-09T15:07:35.764079+0000","last_peered":"2024-03-09T15:07:35.764079+0000","last_clean":"2024-03-09T15:07:35.764079+0000","last_became_active":"2024-03-09T14:42:18.995340+0000","last_became_peered":"2024-03-09T14:42:18.995340+0000","last_unstale":"2024-03-09T15:07:35.764079+0000","last_undegraded":"2024-03-09T15:07:35.764079+0000","last_fullsized":"2024-03-09T15:07:35.764079+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.763876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.763876+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.763876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:25:43.872448+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.891508+0000","last_change":"2024-03-09T15:07:13.891508+0000","last_active":"2024-03-09T15:07:13.891508+0000","last_peered":"2024-03-09T15:07:13.891508+0000","last_clean":"2024-03-09T15:07:13.891508+0000","last_became_active":"2024-03-09T14:42:15.963155+0000","last_became_peered":"2024-03-09T14:42:15.963155+0000","last_unstale":"2024-03-09T15:07:13.891508+0000","last_undegraded":"2024-03-09T15:07:13.891508+0000","last_fullsized":"2024-03-09T15:07:13.891508+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:13.891243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:13.891243+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.891243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:23:55.637502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'33","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.561251+0000","last_change":"2024-03-09T15:07:16.561251+0000","last_active":"2024-03-09T15:07:16.561251+0000","last_peered":"2024-03-09T15:07:16.561251+0000","last_clean":"2024-03-09T15:07:16.561251+0000","last_became_active":"2024-03-09T14:39:57.888467+0000","last_became_peered":"2024-03-09T14:39:57.888467+0000","last_unstale":"2024-03-09T15:07:16.561251+0000","last_undegraded":"2024-03-09T15:07:16.561251+0000","last_fullsized":"2024-03-09T15:07:16.561251+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-03-09T15:07:16.560999+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-03-09T15:07:16.560999+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.560999+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:39.875129+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":106,"num_write":49,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:57.598442+0000","last_change":"2024-03-09T15:07:57.598497+0000","last_active":"2024-03-09T15:07:57.598442+0000","last_peered":"2024-03-09T15:07:57.598442+0000","last_clean":"2024-03-09T15:07:57.598442+0000","last_became_active":"2024-03-09T14:49:53.658183+0000","last_became_peered":"2024-03-09T14:49:53.658183+0000","last_unstale":"2024-03-09T15:07:57.598442+0000","last_undegraded":"2024-03-09T15:07:57.598442+0000","last_fullsized":"2024-03-09T15:07:57.598442+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:57.598235+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:57.598235+0000","last_clean_scrub_stamp":"2024-03-09T15:07:57.598235+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:00:50.823751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"264'3","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:02.570051+0000","last_change":"2024-03-09T15:08:02.570199+0000","last_active":"2024-03-09T15:08:02.570051+0000","last_peered":"2024-03-09T15:08:02.570051+0000","last_clean":"2024-03-09T15:08:02.570051+0000","last_became_active":"2024-03-09T14:42:19.294401+0000","last_became_peered":"2024-03-09T14:42:19.294401+0000","last_unstale":"2024-03-09T15:08:02.570051+0000","last_undegraded":"2024-03-09T15:08:02.570051+0000","last_fullsized":"2024-03-09T15:08:02.570051+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:08:02.569830+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:08:02.569830+0000","last_clean_scrub_stamp":"2024-03-09T15:08:02.569830+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:51:43.380877+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'7","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.582621+0000","last_change":"2024-03-09T15:07:37.582683+0000","last_active":"2024-03-09T15:07:37.582621+0000","last_peered":"2024-03-09T15:07:37.582621+0000","last_clean":"2024-03-09T15:07:37.582621+0000","last_became_active":"2024-03-09T14:42:15.974493+0000","last_became_peered":"2024-03-09T14:42:15.974493+0000","last_unstale":"2024-03-09T15:07:37.582621+0000","last_undegraded":"2024-03-09T15:07:37.582621+0000","last_fullsized":"2024-03-09T15:07:37.582621+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-03-09T15:07:37.582421+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-03-09T15:07:37.582421+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.582421+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:35:35.039619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5160,"num_write":12,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'28","reported_seq":117,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.278092+0000","last_change":"2024-03-09T15:07:14.278092+0000","last_active":"2024-03-09T15:07:14.278092+0000","last_peered":"2024-03-09T15:07:14.278092+0000","last_clean":"2024-03-09T15:07:14.278092+0000","last_became_active":"2024-03-09T14:39:57.907009+0000","last_became_peered":"2024-03-09T14:39:57.907009+0000","last_unstale":"2024-03-09T15:07:14.278092+0000","last_undegraded":"2024-03-09T15:07:14.278092+0000","last_fullsized":"2024-03-09T15:07:14.278092+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'28","last_scrub_stamp":"2024-03-09T15:07:14.277744+0000","last_deep_scrub":"264'28","last_deep_scrub_stamp":"2024-03-09T15:07:14.277744+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.277744+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:52:23.159850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":74,"num_write":45,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:52.597619+0000","last_change":"2024-03-09T15:07:52.597619+0000","last_active":"2024-03-09T15:07:52.597619+0000","last_peered":"2024-03-09T15:07:52.597619+0000","last_clean":"2024-03-09T15:07:52.597619+0000","last_became_active":"2024-03-09T14:49:53.680477+0000","last_became_peered":"2024-03-09T14:49:53.680477+0000","last_unstale":"2024-03-09T15:07:52.597619+0000","last_undegraded":"2024-03-09T15:07:52.597619+0000","last_fullsized":"2024-03-09T15:07:52.597619+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:52.597262+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:52.597262+0000","last_clean_scrub_stamp":"2024-03-09T15:07:52.597262+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:55:29.342309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"261'3","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.930279+0000","last_change":"2024-03-09T15:07:22.930279+0000","last_active":"2024-03-09T15:07:22.930279+0000","last_peered":"2024-03-09T15:07:22.930279+0000","last_clean":"2024-03-09T15:07:22.930279+0000","last_became_active":"2024-03-09T14:42:19.289487+0000","last_became_peered":"2024-03-09T14:42:19.289487+0000","last_unstale":"2024-03-09T15:07:22.930279+0000","last_undegraded":"2024-03-09T15:07:22.930279+0000","last_fullsized":"2024-03-09T15:07:22.930279+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:22.930020+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:22.930020+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.930020+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:09:50.336731+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:52.528898+0000","last_change":"2024-03-09T15:07:52.528898+0000","last_active":"2024-03-09T15:07:52.528898+0000","last_peered":"2024-03-09T15:07:52.528898+0000","last_clean":"2024-03-09T15:07:52.528898+0000","last_became_active":"2024-03-09T14:42:15.956648+0000","last_became_peered":"2024-03-09T14:42:15.956648+0000","last_unstale":"2024-03-09T15:07:52.528898+0000","last_undegraded":"2024-03-09T15:07:52.528898+0000","last_fullsized":"2024-03-09T15:07:52.528898+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-03-09T15:07:52.528630+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-03-09T15:07:52.528630+0000","last_clean_scrub_stamp":"2024-03-09T15:07:52.528630+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:39:41.439810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'62","reported_seq":208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.950093+0000","last_change":"2024-03-09T15:07:21.950162+0000","last_active":"2024-03-09T15:07:21.950093+0000","last_peered":"2024-03-09T15:07:21.950093+0000","last_clean":"2024-03-09T15:07:21.950093+0000","last_became_active":"2024-03-09T14:39:57.905410+0000","last_became_peered":"2024-03-09T14:39:57.905410+0000","last_unstale":"2024-03-09T15:07:21.950093+0000","last_undegraded":"2024-03-09T15:07:21.950093+0000","last_fullsized":"2024-03-09T15:07:21.950093+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'62","last_scrub_stamp":"2024-03-09T15:07:21.949871+0000","last_deep_scrub":"264'62","last_deep_scrub_stamp":"2024-03-09T15:07:21.949871+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.949871+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:41:26.110415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":274,"num_read_kb":193,"num_write":94,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:59.839810+0000","last_change":"2024-03-09T15:07:59.839864+0000","last_active":"2024-03-09T15:07:59.839810+0000","last_peered":"2024-03-09T15:07:59.839810+0000","last_clean":"2024-03-09T15:07:59.839810+0000","last_became_active":"2024-03-09T14:49:53.658190+0000","last_became_peered":"2024-03-09T14:49:53.658190+0000","last_unstale":"2024-03-09T15:07:59.839810+0000","last_undegraded":"2024-03-09T15:07:59.839810+0000","last_fullsized":"2024-03-09T15:07:59.839810+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:59.839619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:59.839619+0000","last_clean_scrub_stamp":"2024-03-09T15:07:59.839619+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:02:03.546692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"264'5","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.802907+0000","last_change":"2024-03-09T15:07:56.802907+0000","last_active":"2024-03-09T15:07:56.802907+0000","last_peered":"2024-03-09T15:07:56.802907+0000","last_clean":"2024-03-09T15:07:56.802907+0000","last_became_active":"2024-03-09T14:42:19.013977+0000","last_became_peered":"2024-03-09T14:42:19.013977+0000","last_unstale":"2024-03-09T15:07:56.802907+0000","last_undegraded":"2024-03-09T15:07:56.802907+0000","last_fullsized":"2024-03-09T15:07:56.802907+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-03-09T15:07:56.802501+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-03-09T15:07:56.802501+0000","last_clean_scrub_stamp":"2024-03-09T15:07:56.802501+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:03:23.831112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":5,"num_write_kb":6160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.857285+0000","last_change":"2024-03-09T15:07:16.857285+0000","last_active":"2024-03-09T15:07:16.857285+0000","last_peered":"2024-03-09T15:07:16.857285+0000","last_clean":"2024-03-09T15:07:16.857285+0000","last_became_active":"2024-03-09T14:42:15.960225+0000","last_became_peered":"2024-03-09T14:42:15.960225+0000","last_unstale":"2024-03-09T15:07:16.857285+0000","last_undegraded":"2024-03-09T15:07:16.857285+0000","last_fullsized":"2024-03-09T15:07:16.857285+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:16.856929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:16.856929+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.856929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:51:38.551264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'131","reported_seq":441,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.963128+0000","last_change":"2024-03-09T15:07:12.963188+0000","last_active":"2024-03-09T15:07:12.963128+0000","last_peered":"2024-03-09T15:07:12.963128+0000","last_clean":"2024-03-09T15:07:12.963128+0000","last_became_active":"2024-03-09T14:39:57.892592+0000","last_became_peered":"2024-03-09T14:39:57.892592+0000","last_unstale":"2024-03-09T15:07:12.963128+0000","last_undegraded":"2024-03-09T15:07:12.963128+0000","last_fullsized":"2024-03-09T15:07:12.963128+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-03-09T15:07:12.962987+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-03-09T15:07:12.962987+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.962987+0000","objects_scrubbed":1,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:14:19.463214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":739,"num_read_kb":529,"num_write":173,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4473,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":31,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.513444+0000","last_change":"2024-03-09T15:07:41.513509+0000","last_active":"2024-03-09T15:07:41.513444+0000","last_peered":"2024-03-09T15:07:41.513444+0000","last_clean":"2024-03-09T15:07:41.513444+0000","last_became_active":"2024-03-09T14:49:53.672292+0000","last_became_peered":"2024-03-09T14:49:53.672292+0000","last_unstale":"2024-03-09T15:07:41.513444+0000","last_undegraded":"2024-03-09T15:07:41.513444+0000","last_fullsized":"2024-03-09T15:07:41.513444+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:41.513248+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:41.513248+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.513248+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:29:14.165196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.599526+0000","last_change":"2024-03-09T15:07:46.599582+0000","last_active":"2024-03-09T15:07:46.599526+0000","last_peered":"2024-03-09T15:07:46.599526+0000","last_clean":"2024-03-09T15:07:46.599526+0000","last_became_active":"2024-03-09T14:42:19.002083+0000","last_became_peered":"2024-03-09T14:42:19.002083+0000","last_unstale":"2024-03-09T15:07:46.599526+0000","last_undegraded":"2024-03-09T15:07:46.599526+0000","last_fullsized":"2024-03-09T15:07:46.599526+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:46.599325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:46.599325+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.599325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:03:50.389634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"264'6","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.934126+0000","last_change":"2024-03-09T15:07:14.934126+0000","last_active":"2024-03-09T15:07:14.934126+0000","last_peered":"2024-03-09T15:07:14.934126+0000","last_clean":"2024-03-09T15:07:14.934126+0000","last_became_active":"2024-03-09T14:42:15.975956+0000","last_became_peered":"2024-03-09T14:42:15.975956+0000","last_unstale":"2024-03-09T15:07:14.934126+0000","last_undegraded":"2024-03-09T15:07:14.934126+0000","last_fullsized":"2024-03-09T15:07:14.934126+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:14.933844+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:14.933844+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.933844+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:53:21.393505+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":9,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'35","reported_seq":141,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.516936+0000","last_change":"2024-03-09T15:07:13.517001+0000","last_active":"2024-03-09T15:07:13.516936+0000","last_peered":"2024-03-09T15:07:13.516936+0000","last_clean":"2024-03-09T15:07:13.516936+0000","last_became_active":"2024-03-09T14:39:57.886792+0000","last_became_peered":"2024-03-09T14:39:57.886792+0000","last_unstale":"2024-03-09T15:07:13.516936+0000","last_undegraded":"2024-03-09T15:07:13.516936+0000","last_fullsized":"2024-03-09T15:07:13.516936+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'35","last_scrub_stamp":"2024-03-09T15:07:13.516719+0000","last_deep_scrub":"264'35","last_deep_scrub_stamp":"2024-03-09T15:07:13.516719+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.516719+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:17:49.955637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":107,"num_write":66,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:08.698702+0000","last_change":"2024-03-09T15:08:08.698756+0000","last_active":"2024-03-09T15:08:08.698702+0000","last_peered":"2024-03-09T15:08:08.698702+0000","last_clean":"2024-03-09T15:08:08.698702+0000","last_became_active":"2024-03-09T14:49:53.683703+0000","last_became_peered":"2024-03-09T14:49:53.683703+0000","last_unstale":"2024-03-09T15:08:08.698702+0000","last_undegraded":"2024-03-09T15:08:08.698702+0000","last_fullsized":"2024-03-09T15:08:08.698702+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:08.698505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:08.698505+0000","last_clean_scrub_stamp":"2024-03-09T15:08:08.698505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:01.251182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"264'9","reported_seq":65,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:55.609002+0000","last_change":"2024-03-09T15:07:55.609002+0000","last_active":"2024-03-09T15:07:55.609002+0000","last_peered":"2024-03-09T15:07:55.609002+0000","last_clean":"2024-03-09T15:07:55.609002+0000","last_became_active":"2024-03-09T14:42:19.013372+0000","last_became_peered":"2024-03-09T14:42:19.013372+0000","last_unstale":"2024-03-09T15:07:55.609002+0000","last_undegraded":"2024-03-09T15:07:55.609002+0000","last_fullsized":"2024-03-09T15:07:55.609002+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-03-09T15:07:55.608576+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-03-09T15:07:55.608576+0000","last_clean_scrub_stamp":"2024-03-09T15:07:55.608576+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:05:38.805300+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":25602,"num_write":12,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"261'3","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.905609+0000","last_change":"2024-03-09T15:07:17.905609+0000","last_active":"2024-03-09T15:07:17.905609+0000","last_peered":"2024-03-09T15:07:17.905609+0000","last_clean":"2024-03-09T15:07:17.905609+0000","last_became_active":"2024-03-09T14:42:15.954274+0000","last_became_peered":"2024-03-09T14:42:15.954274+0000","last_unstale":"2024-03-09T15:07:17.905609+0000","last_undegraded":"2024-03-09T15:07:17.905609+0000","last_fullsized":"2024-03-09T15:07:17.905609+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-03-09T15:07:17.905341+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-03-09T15:07:17.905341+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.905341+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:09.793662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'59","reported_seq":208,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.867257+0000","last_change":"2024-03-09T15:07:11.867317+0000","last_active":"2024-03-09T15:07:11.867257+0000","last_peered":"2024-03-09T15:07:11.867257+0000","last_clean":"2024-03-09T15:07:11.867257+0000","last_became_active":"2024-03-09T14:39:57.901599+0000","last_became_peered":"2024-03-09T14:39:57.901599+0000","last_unstale":"2024-03-09T15:07:11.867257+0000","last_undegraded":"2024-03-09T15:07:11.867257+0000","last_fullsized":"2024-03-09T15:07:11.867257+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'59","last_scrub_stamp":"2024-03-09T15:07:11.867056+0000","last_deep_scrub":"264'59","last_deep_scrub_stamp":"2024-03-09T15:07:11.867056+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.867056+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:38:36.066989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":284,"num_read_kb":206,"num_write":96,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.659404+0000","last_change":"2024-03-09T15:08:06.659458+0000","last_active":"2024-03-09T15:08:06.659404+0000","last_peered":"2024-03-09T15:08:06.659404+0000","last_clean":"2024-03-09T15:08:06.659404+0000","last_became_active":"2024-03-09T14:49:53.681327+0000","last_became_peered":"2024-03-09T14:49:53.681327+0000","last_unstale":"2024-03-09T15:08:06.659404+0000","last_undegraded":"2024-03-09T15:08:06.659404+0000","last_fullsized":"2024-03-09T15:08:06.659404+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:06.659202+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:06.659202+0000","last_clean_scrub_stamp":"2024-03-09T15:08:06.659202+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:30:21.838459+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.052590+0000","last_change":"2024-03-09T15:07:48.052643+0000","last_active":"2024-03-09T15:07:48.052590+0000","last_peered":"2024-03-09T15:07:48.052590+0000","last_clean":"2024-03-09T15:07:48.052590+0000","last_became_active":"2024-03-09T14:42:19.019151+0000","last_became_peered":"2024-03-09T14:42:19.019151+0000","last_unstale":"2024-03-09T15:07:48.052590+0000","last_undegraded":"2024-03-09T15:07:48.052590+0000","last_fullsized":"2024-03-09T15:07:48.052590+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:48.052391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:48.052391+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.052391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:22:16.557124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:09.917661+0000","last_change":"2024-03-09T15:07:09.917661+0000","last_active":"2024-03-09T15:07:09.917661+0000","last_peered":"2024-03-09T15:07:09.917661+0000","last_clean":"2024-03-09T15:07:09.917661+0000","last_became_active":"2024-03-09T14:42:15.959503+0000","last_became_peered":"2024-03-09T14:42:15.959503+0000","last_unstale":"2024-03-09T15:07:09.917661+0000","last_undegraded":"2024-03-09T15:07:09.917661+0000","last_fullsized":"2024-03-09T15:07:09.917661+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:09.917534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:09.917534+0000","last_clean_scrub_stamp":"2024-03-09T15:07:09.917534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:08:08.292151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'13","reported_seq":86,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.270252+0000","last_change":"2024-03-09T15:07:16.270315+0000","last_active":"2024-03-09T15:07:16.270252+0000","last_peered":"2024-03-09T15:07:16.270252+0000","last_clean":"2024-03-09T15:07:16.270252+0000","last_became_active":"2024-03-09T14:39:57.895579+0000","last_became_peered":"2024-03-09T14:39:57.895579+0000","last_unstale":"2024-03-09T15:07:16.270252+0000","last_undegraded":"2024-03-09T15:07:16.270252+0000","last_fullsized":"2024-03-09T15:07:16.270252+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'13","last_scrub_stamp":"2024-03-09T15:07:16.270056+0000","last_deep_scrub":"264'13","last_deep_scrub_stamp":"2024-03-09T15:07:16.270056+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.270056+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:06:45.756532+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":37,"num_write":30,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:07.842863+0000","last_change":"2024-03-09T15:08:07.842916+0000","last_active":"2024-03-09T15:08:07.842863+0000","last_peered":"2024-03-09T15:08:07.842863+0000","last_clean":"2024-03-09T15:08:07.842863+0000","last_became_active":"2024-03-09T14:49:53.680782+0000","last_became_peered":"2024-03-09T14:49:53.680782+0000","last_unstale":"2024-03-09T15:08:07.842863+0000","last_undegraded":"2024-03-09T15:08:07.842863+0000","last_fullsized":"2024-03-09T15:08:07.842863+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:08:07.842659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:08:07.842659+0000","last_clean_scrub_stamp":"2024-03-09T15:08:07.842659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:02:13.023112+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:58.807363+0000","last_change":"2024-03-09T15:07:58.807427+0000","last_active":"2024-03-09T15:07:58.807363+0000","last_peered":"2024-03-09T15:07:58.807363+0000","last_clean":"2024-03-09T15:07:58.807363+0000","last_became_active":"2024-03-09T14:42:19.020789+0000","last_became_peered":"2024-03-09T14:42:19.020789+0000","last_unstale":"2024-03-09T15:07:58.807363+0000","last_undegraded":"2024-03-09T15:07:58.807363+0000","last_fullsized":"2024-03-09T15:07:58.807363+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:58.807169+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:58.807169+0000","last_clean_scrub_stamp":"2024-03-09T15:07:58.807169+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:10:30.580261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'8","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.151321+0000","last_change":"2024-03-09T15:07:44.151501+0000","last_active":"2024-03-09T15:07:44.151321+0000","last_peered":"2024-03-09T15:07:44.151321+0000","last_clean":"2024-03-09T15:07:44.151321+0000","last_became_active":"2024-03-09T14:42:15.960341+0000","last_became_peered":"2024-03-09T14:42:15.960341+0000","last_unstale":"2024-03-09T15:07:44.151321+0000","last_undegraded":"2024-03-09T15:07:44.151321+0000","last_fullsized":"2024-03-09T15:07:44.151321+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-03-09T15:07:44.151029+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-03-09T15:07:44.151029+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.151029+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:57:06.290808+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":20522,"num_write":11,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'42","reported_seq":153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.969299+0000","last_change":"2024-03-09T15:07:24.969299+0000","last_active":"2024-03-09T15:07:24.969299+0000","last_peered":"2024-03-09T15:07:24.969299+0000","last_clean":"2024-03-09T15:07:24.969299+0000","last_became_active":"2024-03-09T14:39:57.898267+0000","last_became_peered":"2024-03-09T14:39:57.898267+0000","last_unstale":"2024-03-09T15:07:24.969299+0000","last_undegraded":"2024-03-09T15:07:24.969299+0000","last_fullsized":"2024-03-09T15:07:24.969299+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'42","last_scrub_stamp":"2024-03-09T15:07:24.968847+0000","last_deep_scrub":"264'42","last_deep_scrub_stamp":"2024-03-09T15:07:24.968847+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.968847+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:44:29.161194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":169,"num_read_kb":119,"num_write":82,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'300","reported_seq":1050,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.887782+0000","last_change":"2024-03-09T15:07:47.887782+0000","last_active":"2024-03-09T15:07:47.887782+0000","last_peered":"2024-03-09T15:07:47.887782+0000","last_clean":"2024-03-09T15:07:47.887782+0000","last_became_active":"2024-03-09T14:28:53.623701+0000","last_became_peered":"2024-03-09T14:28:53.623701+0000","last_unstale":"2024-03-09T15:07:47.887782+0000","last_undegraded":"2024-03-09T15:07:47.887782+0000","last_fullsized":"2024-03-09T15:07:47.887782+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'300","last_scrub_stamp":"2024-03-09T15:07:47.887473+0000","last_deep_scrub":"264'300","last_deep_scrub_stamp":"2024-03-09T15:07:47.887473+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.887473+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:14:51.229382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":756,"num_read_kb":36473,"num_write":1139,"num_write_kb":31503,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,5],"acting":[7,6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'697","reported_seq":2221,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.460139+0000","last_change":"2024-03-09T15:07:34.460243+0000","last_active":"2024-03-09T15:07:34.460139+0000","last_peered":"2024-03-09T15:07:34.460139+0000","last_clean":"2024-03-09T15:07:34.460139+0000","last_became_active":"2024-03-09T14:28:55.574984+0000","last_became_peered":"2024-03-09T14:28:55.574984+0000","last_unstale":"2024-03-09T15:07:34.460139+0000","last_undegraded":"2024-03-09T15:07:34.460139+0000","last_fullsized":"2024-03-09T15:07:34.460139+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'697","last_scrub_stamp":"2024-03-09T15:07:34.459929+0000","last_deep_scrub":"264'697","last_deep_scrub_stamp":"2024-03-09T15:07:34.459929+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.459929+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:15:13.773840+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3313,"num_read_kb":2995,"num_write":917,"num_write_kb":332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":235,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'302","reported_seq":965,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.559549+0000","last_change":"2024-03-09T15:07:44.559549+0000","last_active":"2024-03-09T15:07:44.559549+0000","last_peered":"2024-03-09T15:07:44.559549+0000","last_clean":"2024-03-09T15:07:44.559549+0000","last_became_active":"2024-03-09T14:28:53.626490+0000","last_became_peered":"2024-03-09T14:28:53.626490+0000","last_unstale":"2024-03-09T15:07:44.559549+0000","last_undegraded":"2024-03-09T15:07:44.559549+0000","last_fullsized":"2024-03-09T15:07:44.559549+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'302","last_scrub_stamp":"2024-03-09T15:07:44.559054+0000","last_deep_scrub":"264'302","last_deep_scrub_stamp":"2024-03-09T15:07:44.559054+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.559054+0000","objects_scrubbed":7,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:09:37.627354+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5265769,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":463,"num_read_kb":36382,"num_write":1100,"num_write_kb":36054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,6,4],"acting":[1,0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'348","reported_seq":1738,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.835595+0000","last_change":"2024-03-09T15:07:43.835654+0000","last_active":"2024-03-09T15:07:43.835595+0000","last_peered":"2024-03-09T15:07:43.835595+0000","last_clean":"2024-03-09T15:07:43.835595+0000","last_became_active":"2024-03-09T14:28:55.591640+0000","last_became_peered":"2024-03-09T14:28:55.591640+0000","last_unstale":"2024-03-09T15:07:43.835595+0000","last_undegraded":"2024-03-09T15:07:43.835595+0000","last_fullsized":"2024-03-09T15:07:43.835595+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-03-09T15:07:43.835382+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-03-09T15:07:43.835382+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.835382+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:09:20.349660+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1906,"num_read_kb":1805,"num_write":411,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'330","reported_seq":1054,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.971074+0000","last_change":"2024-03-09T15:07:21.971278+0000","last_active":"2024-03-09T15:07:21.971074+0000","last_peered":"2024-03-09T15:07:21.971074+0000","last_clean":"2024-03-09T15:07:21.971074+0000","last_became_active":"2024-03-09T14:29:28.827096+0000","last_became_peered":"2024-03-09T14:29:28.827096+0000","last_unstale":"2024-03-09T15:07:21.971074+0000","last_undegraded":"2024-03-09T15:07:21.971074+0000","last_fullsized":"2024-03-09T15:07:21.971074+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'330","last_scrub_stamp":"2024-03-09T15:07:21.970830+0000","last_deep_scrub":"264'330","last_deep_scrub_stamp":"2024-03-09T15:07:21.970830+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.970830+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:14:08.492056+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262173,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":589,"num_read_kb":23096,"num_write":1233,"num_write_kb":39906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,7],"acting":[3,2,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"264'401","reported_seq":1894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.888513+0000","last_change":"2024-03-09T15:07:43.888581+0000","last_active":"2024-03-09T15:07:43.888513+0000","last_peered":"2024-03-09T15:07:43.888513+0000","last_clean":"2024-03-09T15:07:43.888513+0000","last_became_active":"2024-03-09T14:28:55.570930+0000","last_became_peered":"2024-03-09T14:28:55.570930+0000","last_unstale":"2024-03-09T15:07:43.888513+0000","last_undegraded":"2024-03-09T15:07:43.888513+0000","last_fullsized":"2024-03-09T15:07:43.888513+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'401","last_scrub_stamp":"2024-03-09T15:07:43.888331+0000","last_deep_scrub":"264'401","last_deep_scrub_stamp":"2024-03-09T15:07:43.888331+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.888331+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:35:42.968547+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2164,"num_read_kb":2043,"num_write":472,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":148,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'297","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.521643+0000","last_change":"2024-03-09T15:07:47.521739+0000","last_active":"2024-03-09T15:07:47.521643+0000","last_peered":"2024-03-09T15:07:47.521643+0000","last_clean":"2024-03-09T15:07:47.521643+0000","last_became_active":"2024-03-09T14:28:53.603454+0000","last_became_peered":"2024-03-09T14:28:53.603454+0000","last_unstale":"2024-03-09T15:07:47.521643+0000","last_undegraded":"2024-03-09T15:07:47.521643+0000","last_fullsized":"2024-03-09T15:07:47.521643+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'297","last_scrub_stamp":"2024-03-09T15:07:47.521438+0000","last_deep_scrub":"264'297","last_deep_scrub_stamp":"2024-03-09T15:07:47.521438+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.521438+0000","objects_scrubbed":3,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:53:52.031727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":477,"num_read_kb":6538,"num_write":1185,"num_write_kb":12238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7,2],"acting":[5,3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"264'435","reported_seq":1946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.704192+0000","last_change":"2024-03-09T15:07:37.704264+0000","last_active":"2024-03-09T15:07:37.704192+0000","last_peered":"2024-03-09T15:07:37.704192+0000","last_clean":"2024-03-09T15:07:37.704192+0000","last_became_active":"2024-03-09T14:28:55.610360+0000","last_became_peered":"2024-03-09T14:28:55.610360+0000","last_unstale":"2024-03-09T15:07:37.704192+0000","last_undegraded":"2024-03-09T15:07:37.704192+0000","last_fullsized":"2024-03-09T15:07:37.704192+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'435","last_scrub_stamp":"2024-03-09T15:07:37.704007+0000","last_deep_scrub":"264'435","last_deep_scrub_stamp":"2024-03-09T15:07:37.704007+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.704007+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:38:19.113285+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2375,"num_read_kb":2224,"num_write":558,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":477,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'339","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.899197+0000","last_change":"2024-03-09T15:07:49.899332+0000","last_active":"2024-03-09T15:07:49.899197+0000","last_peered":"2024-03-09T15:07:49.899197+0000","last_clean":"2024-03-09T15:07:49.899197+0000","last_became_active":"2024-03-09T14:28:53.622689+0000","last_became_peered":"2024-03-09T14:28:53.622689+0000","last_unstale":"2024-03-09T15:07:49.899197+0000","last_undegraded":"2024-03-09T15:07:49.899197+0000","last_fullsized":"2024-03-09T15:07:49.899197+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-03-09T15:07:49.898980+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-03-09T15:07:49.898980+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.898980+0000","objects_scrubbed":10,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:57:41.508017+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9722121,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":529,"num_read_kb":7528,"num_write":1253,"num_write_kb":32260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,6],"acting":[7,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'365","reported_seq":1929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.198857+0000","last_change":"2024-03-09T15:07:34.199037+0000","last_active":"2024-03-09T15:07:34.198857+0000","last_peered":"2024-03-09T15:07:34.198857+0000","last_clean":"2024-03-09T15:07:34.198857+0000","last_became_active":"2024-03-09T14:28:55.588204+0000","last_became_peered":"2024-03-09T14:28:55.588204+0000","last_unstale":"2024-03-09T15:07:34.198857+0000","last_undegraded":"2024-03-09T15:07:34.198857+0000","last_fullsized":"2024-03-09T15:07:34.198857+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'365","last_scrub_stamp":"2024-03-09T15:07:34.198627+0000","last_deep_scrub":"264'365","last_deep_scrub_stamp":"2024-03-09T15:07:34.198627+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.198627+0000","objects_scrubbed":4,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:51:37.155815+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2088,"num_read_kb":2012,"num_write":400,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'366","reported_seq":1078,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.548236+0000","last_change":"2024-03-09T15:07:48.548329+0000","last_active":"2024-03-09T15:07:48.548236+0000","last_peered":"2024-03-09T15:07:48.548236+0000","last_clean":"2024-03-09T15:07:48.548236+0000","last_became_active":"2024-03-09T14:28:53.604391+0000","last_became_peered":"2024-03-09T14:28:53.604391+0000","last_unstale":"2024-03-09T15:07:48.548236+0000","last_undegraded":"2024-03-09T15:07:48.548236+0000","last_fullsized":"2024-03-09T15:07:48.548236+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-03-09T15:07:48.548012+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-03-09T15:07:48.548012+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.548012+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:56:53.501630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":836,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":748,"num_read_kb":3295,"num_write":1231,"num_write_kb":34124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,4,1],"acting":[5,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'791","reported_seq":2528,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.781900+0000","last_change":"2024-03-09T15:07:39.781900+0000","last_active":"2024-03-09T15:07:39.781900+0000","last_peered":"2024-03-09T15:07:39.781900+0000","last_clean":"2024-03-09T15:07:39.781900+0000","last_became_active":"2024-03-09T14:28:55.571291+0000","last_became_peered":"2024-03-09T14:28:55.571291+0000","last_unstale":"2024-03-09T15:07:39.781900+0000","last_undegraded":"2024-03-09T15:07:39.781900+0000","last_fullsized":"2024-03-09T15:07:39.781900+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'791","last_scrub_stamp":"2024-03-09T15:07:39.781646+0000","last_deep_scrub":"264'791","last_deep_scrub_stamp":"2024-03-09T15:07:39.781646+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.781646+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:27:42.910884+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3843,"num_read_kb":3494,"num_write":1039,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'393","reported_seq":1064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:59.768268+0000","last_change":"2024-03-09T15:07:59.768386+0000","last_active":"2024-03-09T15:07:59.768268+0000","last_peered":"2024-03-09T15:07:59.768268+0000","last_clean":"2024-03-09T15:07:59.768268+0000","last_became_active":"2024-03-09T14:28:53.618259+0000","last_became_peered":"2024-03-09T14:28:53.618259+0000","last_unstale":"2024-03-09T15:07:59.768268+0000","last_undegraded":"2024-03-09T15:07:59.768268+0000","last_fullsized":"2024-03-09T15:07:59.768268+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'393","last_scrub_stamp":"2024-03-09T15:07:59.768028+0000","last_deep_scrub":"264'393","last_deep_scrub_stamp":"2024-03-09T15:07:59.768028+0000","last_clean_scrub_stamp":"2024-03-09T15:07:59.768028+0000","objects_scrubbed":8,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:08:15.036887+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243711,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":574,"num_read_kb":8008,"num_write":1507,"num_write_kb":37535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,6],"acting":[7,0,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'418","reported_seq":2030,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.552375+0000","last_change":"2024-03-09T15:07:28.552375+0000","last_active":"2024-03-09T15:07:28.552375+0000","last_peered":"2024-03-09T15:07:28.552375+0000","last_clean":"2024-03-09T15:07:28.552375+0000","last_became_active":"2024-03-09T14:28:55.587626+0000","last_became_peered":"2024-03-09T14:28:55.587626+0000","last_unstale":"2024-03-09T15:07:28.552375+0000","last_undegraded":"2024-03-09T15:07:28.552375+0000","last_fullsized":"2024-03-09T15:07:28.552375+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'418","last_scrub_stamp":"2024-03-09T15:07:28.552126+0000","last_deep_scrub":"264'418","last_deep_scrub_stamp":"2024-03-09T15:07:28.552126+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.552126+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":400,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:50:47.846392+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2314,"num_read_kb":2202,"num_write":483,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'331","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:08.119114+0000","last_change":"2024-03-09T15:08:08.119216+0000","last_active":"2024-03-09T15:08:08.119114+0000","last_peered":"2024-03-09T15:08:08.119114+0000","last_clean":"2024-03-09T15:08:08.119114+0000","last_became_active":"2024-03-09T14:28:53.589232+0000","last_became_peered":"2024-03-09T14:28:53.589232+0000","last_unstale":"2024-03-09T15:08:08.119114+0000","last_undegraded":"2024-03-09T15:08:08.119114+0000","last_fullsized":"2024-03-09T15:08:08.119114+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'331","last_scrub_stamp":"2024-03-09T15:08:08.118885+0000","last_deep_scrub":"264'331","last_deep_scrub_stamp":"2024-03-09T15:08:08.118885+0000","last_clean_scrub_stamp":"2024-03-09T15:08:08.118885+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:12.056626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":483,"num_read_kb":42616,"num_write":1235,"num_write_kb":40647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,2],"acting":[3,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'933","reported_seq":2707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.596714+0000","last_change":"2024-03-09T15:07:34.596714+0000","last_active":"2024-03-09T15:07:34.596714+0000","last_peered":"2024-03-09T15:07:34.596714+0000","last_clean":"2024-03-09T15:07:34.596714+0000","last_became_active":"2024-03-09T14:28:55.602477+0000","last_became_peered":"2024-03-09T14:28:55.602477+0000","last_unstale":"2024-03-09T15:07:34.596714+0000","last_undegraded":"2024-03-09T15:07:34.596714+0000","last_fullsized":"2024-03-09T15:07:34.596714+0000","mapping_epoch":25,"log_start":"264'900","ondisk_log_start":"264'900","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'933","last_scrub_stamp":"2024-03-09T15:07:34.596435+0000","last_deep_scrub":"264'933","last_deep_scrub_stamp":"2024-03-09T15:07:34.596435+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.596435+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":900,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:19:48.629634+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4605,"num_read_kb":4102,"num_write":1299,"num_write_kb":524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4073,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'355","reported_seq":1809,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.824699+0000","last_change":"2024-03-09T15:07:41.824699+0000","last_active":"2024-03-09T15:07:41.824699+0000","last_peered":"2024-03-09T15:07:41.824699+0000","last_clean":"2024-03-09T15:07:41.824699+0000","last_became_active":"2024-03-09T14:28:55.570861+0000","last_became_peered":"2024-03-09T14:28:55.570861+0000","last_unstale":"2024-03-09T15:07:41.824699+0000","last_undegraded":"2024-03-09T15:07:41.824699+0000","last_fullsized":"2024-03-09T15:07:41.824699+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'355","last_scrub_stamp":"2024-03-09T15:07:41.824438+0000","last_deep_scrub":"264'355","last_deep_scrub_stamp":"2024-03-09T15:07:41.824438+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.824438+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:32.514751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1960,"num_read_kb":1866,"num_write":405,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'351","reported_seq":1048,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:55.816945+0000","last_change":"2024-03-09T15:07:55.817117+0000","last_active":"2024-03-09T15:07:55.816945+0000","last_peered":"2024-03-09T15:07:55.816945+0000","last_clean":"2024-03-09T15:07:55.816945+0000","last_became_active":"2024-03-09T14:28:53.607915+0000","last_became_peered":"2024-03-09T14:28:53.607915+0000","last_unstale":"2024-03-09T15:07:55.816945+0000","last_undegraded":"2024-03-09T15:07:55.816945+0000","last_fullsized":"2024-03-09T15:07:55.816945+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-03-09T15:07:55.816715+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-03-09T15:07:55.816715+0000","last_clean_scrub_stamp":"2024-03-09T15:07:55.816715+0000","objects_scrubbed":5,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:47:39.883611+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5273368,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":551,"num_read_kb":78573,"num_write":1337,"num_write_kb":47168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,0,1],"acting":[7,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"264'820","reported_seq":2232,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.912358+0000","last_change":"2024-03-09T15:07:41.912358+0000","last_active":"2024-03-09T15:07:41.912358+0000","last_peered":"2024-03-09T15:07:41.912358+0000","last_clean":"2024-03-09T15:07:41.912358+0000","last_became_active":"2024-03-09T14:28:55.591884+0000","last_became_peered":"2024-03-09T14:28:55.591884+0000","last_unstale":"2024-03-09T15:07:41.912358+0000","last_undegraded":"2024-03-09T15:07:41.912358+0000","last_fullsized":"2024-03-09T15:07:41.912358+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'820","last_scrub_stamp":"2024-03-09T15:07:41.912096+0000","last_deep_scrub":"264'820","last_deep_scrub_stamp":"2024-03-09T15:07:41.912096+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.912096+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:43:11.982031+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3579,"num_read_kb":3134,"num_write":1128,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'247","reported_seq":917,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.227197+0000","last_change":"2024-03-09T15:07:40.227401+0000","last_active":"2024-03-09T15:07:40.227197+0000","last_peered":"2024-03-09T15:07:40.227197+0000","last_clean":"2024-03-09T15:07:40.227197+0000","last_became_active":"2024-03-09T14:28:53.635735+0000","last_became_peered":"2024-03-09T14:28:53.635735+0000","last_unstale":"2024-03-09T15:07:40.227197+0000","last_undegraded":"2024-03-09T15:07:40.227197+0000","last_fullsized":"2024-03-09T15:07:40.227197+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'247","last_scrub_stamp":"2024-03-09T15:07:40.226926+0000","last_deep_scrub":"264'247","last_deep_scrub_stamp":"2024-03-09T15:07:40.226926+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.226926+0000","objects_scrubbed":3,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:45:25.062019+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":452,"num_read_kb":101132,"num_write":981,"num_write_kb":27272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2,1],"acting":[6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'366","reported_seq":1878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.515340+0000","last_change":"2024-03-09T15:07:27.515488+0000","last_active":"2024-03-09T15:07:27.515340+0000","last_peered":"2024-03-09T15:07:27.515340+0000","last_clean":"2024-03-09T15:07:27.515340+0000","last_became_active":"2024-03-09T14:28:55.589360+0000","last_became_peered":"2024-03-09T14:28:55.589360+0000","last_unstale":"2024-03-09T15:07:27.515340+0000","last_undegraded":"2024-03-09T15:07:27.515340+0000","last_fullsized":"2024-03-09T15:07:27.515340+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-03-09T15:07:27.515111+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-03-09T15:07:27.515111+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.515111+0000","objects_scrubbed":1,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:24:53.377750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2187,"num_read_kb":2092,"num_write":426,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'318","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.266460+0000","last_change":"2024-03-09T15:07:39.266548+0000","last_active":"2024-03-09T15:07:39.266460+0000","last_peered":"2024-03-09T15:07:39.266460+0000","last_clean":"2024-03-09T15:07:39.266460+0000","last_became_active":"2024-03-09T14:28:53.635713+0000","last_became_peered":"2024-03-09T14:28:53.635713+0000","last_unstale":"2024-03-09T15:07:39.266460+0000","last_undegraded":"2024-03-09T15:07:39.266460+0000","last_fullsized":"2024-03-09T15:07:39.266460+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-03-09T15:07:39.266259+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-03-09T15:07:39.266259+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.266259+0000","objects_scrubbed":4,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:45:23.058863+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1830670,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":532,"num_read_kb":101700,"num_write":1117,"num_write_kb":55747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3],"acting":[6,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'1332","reported_seq":3011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.551298+0000","last_change":"2024-03-09T15:07:33.551298+0000","last_active":"2024-03-09T15:07:33.551298+0000","last_peered":"2024-03-09T15:07:33.551298+0000","last_clean":"2024-03-09T15:07:33.551298+0000","last_became_active":"2024-03-09T14:28:55.602235+0000","last_became_peered":"2024-03-09T14:28:55.602235+0000","last_unstale":"2024-03-09T15:07:33.551298+0000","last_undegraded":"2024-03-09T15:07:33.551298+0000","last_fullsized":"2024-03-09T15:07:33.551298+0000","mapping_epoch":25,"log_start":"264'1300","ondisk_log_start":"264'1300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1332","last_scrub_stamp":"2024-03-09T15:07:33.551044+0000","last_deep_scrub":"264'1332","last_deep_scrub_stamp":"2024-03-09T15:07:33.551044+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.551044+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":1300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:12:12.573620+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5607,"num_read_kb":4937,"num_write":1889,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'441","reported_seq":1118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.687949+0000","last_change":"2024-03-09T15:07:17.687949+0000","last_active":"2024-03-09T15:07:17.687949+0000","last_peered":"2024-03-09T15:07:17.687949+0000","last_clean":"2024-03-09T15:07:17.687949+0000","last_became_active":"2024-03-09T14:29:28.823751+0000","last_became_peered":"2024-03-09T14:29:28.823751+0000","last_unstale":"2024-03-09T15:07:17.687949+0000","last_undegraded":"2024-03-09T15:07:17.687949+0000","last_fullsized":"2024-03-09T15:07:17.687949+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'441","last_scrub_stamp":"2024-03-09T15:07:17.687334+0000","last_deep_scrub":"264'441","last_deep_scrub_stamp":"2024-03-09T15:07:17.687334+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.687334+0000","objects_scrubbed":4,"log_size":41,"log_dups_size":400,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:15:40.736410+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262230,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":811,"num_read_kb":6645,"num_write":1426,"num_write_kb":15242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6,0],"acting":[2,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"264'439","reported_seq":2032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.574184+0000","last_change":"2024-03-09T15:07:30.574184+0000","last_active":"2024-03-09T15:07:30.574184+0000","last_peered":"2024-03-09T15:07:30.574184+0000","last_clean":"2024-03-09T15:07:30.574184+0000","last_became_active":"2024-03-09T14:28:55.574645+0000","last_became_peered":"2024-03-09T14:28:55.574645+0000","last_unstale":"2024-03-09T15:07:30.574184+0000","last_undegraded":"2024-03-09T15:07:30.574184+0000","last_fullsized":"2024-03-09T15:07:30.574184+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'439","last_scrub_stamp":"2024-03-09T15:07:30.573900+0000","last_deep_scrub":"264'439","last_deep_scrub_stamp":"2024-03-09T15:07:30.573900+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.573900+0000","objects_scrubbed":1,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:27:16.783946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2503,"num_read_kb":2358,"num_write":585,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":218,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'378","reported_seq":1056,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:58.056211+0000","last_change":"2024-03-09T15:07:58.056377+0000","last_active":"2024-03-09T15:07:58.056211+0000","last_peered":"2024-03-09T15:07:58.056211+0000","last_clean":"2024-03-09T15:07:58.056211+0000","last_became_active":"2024-03-09T14:28:53.619291+0000","last_became_peered":"2024-03-09T14:28:53.619291+0000","last_unstale":"2024-03-09T15:07:58.056211+0000","last_undegraded":"2024-03-09T15:07:58.056211+0000","last_fullsized":"2024-03-09T15:07:58.056211+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-03-09T15:07:58.055990+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-03-09T15:07:58.055990+0000","last_clean_scrub_stamp":"2024-03-09T15:07:58.055990+0000","objects_scrubbed":7,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:43:17.532190+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505224,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":587,"num_read_kb":88953,"num_write":1364,"num_write_kb":34328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,5],"acting":[3,6,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'359","reported_seq":1913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.857058+0000","last_change":"2024-03-09T15:07:49.857195+0000","last_active":"2024-03-09T15:07:49.857058+0000","last_peered":"2024-03-09T15:07:49.857058+0000","last_clean":"2024-03-09T15:07:49.857058+0000","last_became_active":"2024-03-09T14:28:55.563041+0000","last_became_peered":"2024-03-09T14:28:55.563041+0000","last_unstale":"2024-03-09T15:07:49.857058+0000","last_undegraded":"2024-03-09T15:07:49.857058+0000","last_fullsized":"2024-03-09T15:07:49.857058+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'359","last_scrub_stamp":"2024-03-09T15:07:49.856755+0000","last_deep_scrub":"264'359","last_deep_scrub_stamp":"2024-03-09T15:07:49.856755+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.856755+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:25:39.917609+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2055,"num_read_kb":1986,"num_write":393,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'413","reported_seq":1103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:54.638831+0000","last_change":"2024-03-09T15:07:54.639042+0000","last_active":"2024-03-09T15:07:54.638831+0000","last_peered":"2024-03-09T15:07:54.638831+0000","last_clean":"2024-03-09T15:07:54.638831+0000","last_became_active":"2024-03-09T14:28:53.585880+0000","last_became_peered":"2024-03-09T14:28:53.585880+0000","last_unstale":"2024-03-09T15:07:54.638831+0000","last_undegraded":"2024-03-09T15:07:54.638831+0000","last_fullsized":"2024-03-09T15:07:54.638831+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'413","last_scrub_stamp":"2024-03-09T15:07:54.638591+0000","last_deep_scrub":"264'413","last_deep_scrub_stamp":"2024-03-09T15:07:54.638591+0000","last_clean_scrub_stamp":"2024-03-09T15:07:54.638591+0000","objects_scrubbed":8,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:24:12.481557+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22734,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":653,"num_read_kb":65524,"num_write":1383,"num_write_kb":24882,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,5],"acting":[0,4,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'121","reported_seq":622,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.742500+0000","last_change":"2024-03-09T15:07:16.742500+0000","last_active":"2024-03-09T15:07:16.742500+0000","last_peered":"2024-03-09T15:07:16.742500+0000","last_clean":"2024-03-09T15:07:16.742500+0000","last_became_active":"2024-03-09T14:29:03.660224+0000","last_became_peered":"2024-03-09T14:29:03.660224+0000","last_unstale":"2024-03-09T15:07:16.742500+0000","last_undegraded":"2024-03-09T15:07:16.742500+0000","last_fullsized":"2024-03-09T15:07:16.742500+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'121","last_scrub_stamp":"2024-03-09T15:07:16.742103+0000","last_deep_scrub":"264'121","last_deep_scrub_stamp":"2024-03-09T15:07:16.742103+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.742103+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:04:21.302474+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":114,"num_read_kb":112,"num_write":285,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'400","reported_seq":1874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.993238+0000","last_change":"2024-03-09T15:07:48.993307+0000","last_active":"2024-03-09T15:07:48.993238+0000","last_peered":"2024-03-09T15:07:48.993238+0000","last_clean":"2024-03-09T15:07:48.993238+0000","last_became_active":"2024-03-09T14:28:55.596404+0000","last_became_peered":"2024-03-09T14:28:55.596404+0000","last_unstale":"2024-03-09T15:07:48.993238+0000","last_undegraded":"2024-03-09T15:07:48.993238+0000","last_fullsized":"2024-03-09T15:07:48.993238+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'400","last_scrub_stamp":"2024-03-09T15:07:48.993015+0000","last_deep_scrub":"264'400","last_deep_scrub_stamp":"2024-03-09T15:07:48.993015+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.993015+0000","objects_scrubbed":1,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:11:24.326671+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2183,"num_read_kb":2049,"num_write":485,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'309","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.842399+0000","last_change":"2024-03-09T15:07:56.842399+0000","last_active":"2024-03-09T15:07:56.842399+0000","last_peered":"2024-03-09T15:07:56.842399+0000","last_clean":"2024-03-09T15:07:56.842399+0000","last_became_active":"2024-03-09T14:28:53.610073+0000","last_became_peered":"2024-03-09T14:28:53.610073+0000","last_unstale":"2024-03-09T15:07:56.842399+0000","last_undegraded":"2024-03-09T15:07:56.842399+0000","last_fullsized":"2024-03-09T15:07:56.842399+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'309","last_scrub_stamp":"2024-03-09T15:07:56.842056+0000","last_deep_scrub":"264'309","last_deep_scrub_stamp":"2024-03-09T15:07:56.842056+0000","last_clean_scrub_stamp":"2024-03-09T15:07:56.842056+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:23.088490+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145852,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":572,"num_read_kb":1412,"num_write":1145,"num_write_kb":31021,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2],"acting":[7,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.452439+0000","last_change":"2024-03-09T15:07:35.452439+0000","last_active":"2024-03-09T15:07:35.452439+0000","last_peered":"2024-03-09T15:07:35.452439+0000","last_clean":"2024-03-09T15:07:35.452439+0000","last_became_active":"2024-03-09T14:28:57.606062+0000","last_became_peered":"2024-03-09T14:28:57.606062+0000","last_unstale":"2024-03-09T15:07:35.452439+0000","last_undegraded":"2024-03-09T15:07:35.452439+0000","last_fullsized":"2024-03-09T15:07:35.452439+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.452193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.452193+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.452193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:44:33.485368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'323","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.627696+0000","last_change":"2024-03-09T15:07:47.627857+0000","last_active":"2024-03-09T15:07:47.627696+0000","last_peered":"2024-03-09T15:07:47.627696+0000","last_clean":"2024-03-09T15:07:47.627696+0000","last_became_active":"2024-03-09T14:28:59.622357+0000","last_became_peered":"2024-03-09T14:28:59.622357+0000","last_unstale":"2024-03-09T15:07:47.627696+0000","last_undegraded":"2024-03-09T15:07:47.627696+0000","last_fullsized":"2024-03-09T15:07:47.627696+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-03-09T15:07:47.627486+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-03-09T15:07:47.627486+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.627486+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:28:27.637878+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":511,"num_read_kb":1106,"num_write":404,"num_write_kb":296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.020481+0000","last_change":"2024-03-09T15:07:33.020481+0000","last_active":"2024-03-09T15:07:33.020481+0000","last_peered":"2024-03-09T15:07:33.020481+0000","last_clean":"2024-03-09T15:07:33.020481+0000","last_became_active":"2024-03-09T14:29:01.636497+0000","last_became_peered":"2024-03-09T14:29:01.636497+0000","last_unstale":"2024-03-09T15:07:33.020481+0000","last_undegraded":"2024-03-09T15:07:33.020481+0000","last_fullsized":"2024-03-09T15:07:33.020481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:33.020229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:33.020229+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.020229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:11:56.405268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2461","reported_seq":4894,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.488869+0000","last_change":"2024-03-09T15:07:19.488869+0000","last_active":"2024-03-09T15:07:19.488869+0000","last_peered":"2024-03-09T15:07:19.488869+0000","last_clean":"2024-03-09T15:07:19.488869+0000","last_became_active":"2024-03-09T14:29:03.664933+0000","last_became_peered":"2024-03-09T14:29:03.664933+0000","last_unstale":"2024-03-09T15:07:19.488869+0000","last_undegraded":"2024-03-09T15:07:19.488869+0000","last_fullsized":"2024-03-09T15:07:19.488869+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2461","last_scrub_stamp":"2024-03-09T15:07:19.488484+0000","last_deep_scrub":"264'2461","last_deep_scrub_stamp":"2024-03-09T15:07:19.488484+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.488484+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":2400,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:36:54.865691+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6733,"num_read_kb":6729,"num_write":4969,"num_write_kb":1822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'424","reported_seq":2010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.536092+0000","last_change":"2024-03-09T15:07:31.536092+0000","last_active":"2024-03-09T15:07:31.536092+0000","last_peered":"2024-03-09T15:07:31.536092+0000","last_clean":"2024-03-09T15:07:31.536092+0000","last_became_active":"2024-03-09T14:28:55.594120+0000","last_became_peered":"2024-03-09T14:28:55.594120+0000","last_unstale":"2024-03-09T15:07:31.536092+0000","last_undegraded":"2024-03-09T15:07:31.536092+0000","last_fullsized":"2024-03-09T15:07:31.536092+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'424","last_scrub_stamp":"2024-03-09T15:07:31.535813+0000","last_deep_scrub":"264'424","last_deep_scrub_stamp":"2024-03-09T15:07:31.535813+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.535813+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:44:00.860601+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2334,"num_read_kb":2217,"num_write":521,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'343","reported_seq":963,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:58.525510+0000","last_change":"2024-03-09T15:07:58.525510+0000","last_active":"2024-03-09T15:07:58.525510+0000","last_peered":"2024-03-09T15:07:58.525510+0000","last_clean":"2024-03-09T15:07:58.525510+0000","last_became_active":"2024-03-09T14:28:53.589914+0000","last_became_peered":"2024-03-09T14:28:53.589914+0000","last_unstale":"2024-03-09T15:07:58.525510+0000","last_undegraded":"2024-03-09T15:07:58.525510+0000","last_fullsized":"2024-03-09T15:07:58.525510+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'343","last_scrub_stamp":"2024-03-09T15:07:58.525078+0000","last_deep_scrub":"264'343","last_deep_scrub_stamp":"2024-03-09T15:07:58.525078+0000","last_clean_scrub_stamp":"2024-03-09T15:07:58.525078+0000","objects_scrubbed":5,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:42:23.200320+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097178,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":462,"num_read_kb":36278,"num_write":1215,"num_write_kb":26714,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:55.001887+0000","last_change":"2024-03-09T15:07:55.001946+0000","last_active":"2024-03-09T15:07:55.001887+0000","last_peered":"2024-03-09T15:07:55.001887+0000","last_clean":"2024-03-09T15:07:55.001887+0000","last_became_active":"2024-03-09T14:28:57.608444+0000","last_became_peered":"2024-03-09T14:28:57.608444+0000","last_unstale":"2024-03-09T15:07:55.001887+0000","last_undegraded":"2024-03-09T15:07:55.001887+0000","last_fullsized":"2024-03-09T15:07:55.001887+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:55.001685+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:55.001685+0000","last_clean_scrub_stamp":"2024-03-09T15:07:55.001685+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:40:08.442011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'68","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:52.865622+0000","last_change":"2024-03-09T15:07:52.865695+0000","last_active":"2024-03-09T15:07:52.865622+0000","last_peered":"2024-03-09T15:07:52.865622+0000","last_clean":"2024-03-09T15:07:52.865622+0000","last_became_active":"2024-03-09T14:28:59.614144+0000","last_became_peered":"2024-03-09T14:28:59.614144+0000","last_unstale":"2024-03-09T15:07:52.865622+0000","last_undegraded":"2024-03-09T15:07:52.865622+0000","last_fullsized":"2024-03-09T15:07:52.865622+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'68","last_scrub_stamp":"2024-03-09T15:07:52.865425+0000","last_deep_scrub":"264'68","last_deep_scrub_stamp":"2024-03-09T15:07:52.865425+0000","last_clean_scrub_stamp":"2024-03-09T15:07:52.865425+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:22:59.674950+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":77,"num_read_kb":74,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.728621+0000","last_change":"2024-03-09T15:07:20.728621+0000","last_active":"2024-03-09T15:07:20.728621+0000","last_peered":"2024-03-09T15:07:20.728621+0000","last_clean":"2024-03-09T15:07:20.728621+0000","last_became_active":"2024-03-09T14:29:01.649716+0000","last_became_peered":"2024-03-09T14:29:01.649716+0000","last_unstale":"2024-03-09T15:07:20.728621+0000","last_undegraded":"2024-03-09T15:07:20.728621+0000","last_fullsized":"2024-03-09T15:07:20.728621+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.728337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.728337+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.728337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:51:28.102346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'133","reported_seq":639,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.618295+0000","last_change":"2024-03-09T15:07:24.618367+0000","last_active":"2024-03-09T15:07:24.618295+0000","last_peered":"2024-03-09T15:07:24.618295+0000","last_clean":"2024-03-09T15:07:24.618295+0000","last_became_active":"2024-03-09T14:29:03.676427+0000","last_became_peered":"2024-03-09T14:29:03.676427+0000","last_unstale":"2024-03-09T15:07:24.618295+0000","last_undegraded":"2024-03-09T15:07:24.618295+0000","last_fullsized":"2024-03-09T15:07:24.618295+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'133","last_scrub_stamp":"2024-03-09T15:07:24.618110+0000","last_deep_scrub":"264'133","last_deep_scrub_stamp":"2024-03-09T15:07:24.618110+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.618110+0000","objects_scrubbed":5,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:09:34.633535+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":473,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":127,"num_read_kb":126,"num_write":288,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'348","reported_seq":1739,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.642855+0000","last_change":"2024-03-09T15:07:18.642855+0000","last_active":"2024-03-09T15:07:18.642855+0000","last_peered":"2024-03-09T15:07:18.642855+0000","last_clean":"2024-03-09T15:07:18.642855+0000","last_became_active":"2024-03-09T14:29:28.733522+0000","last_became_peered":"2024-03-09T14:29:28.733522+0000","last_unstale":"2024-03-09T15:07:18.642855+0000","last_undegraded":"2024-03-09T15:07:18.642855+0000","last_fullsized":"2024-03-09T15:07:18.642855+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-03-09T15:07:18.642582+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-03-09T15:07:18.642582+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.642582+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:41:22.443747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1907,"num_read_kb":1804,"num_write":410,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'332","reported_seq":956,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.877359+0000","last_change":"2024-03-09T15:07:45.877359+0000","last_active":"2024-03-09T15:07:45.877359+0000","last_peered":"2024-03-09T15:07:45.877359+0000","last_clean":"2024-03-09T15:07:45.877359+0000","last_became_active":"2024-03-09T14:28:53.633368+0000","last_became_peered":"2024-03-09T14:28:53.633368+0000","last_unstale":"2024-03-09T15:07:45.877359+0000","last_undegraded":"2024-03-09T15:07:45.877359+0000","last_fullsized":"2024-03-09T15:07:45.877359+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-03-09T15:07:45.876836+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-03-09T15:07:45.876836+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.876836+0000","objects_scrubbed":6,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:19:18.348571+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1917981,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":440,"num_read_kb":7245,"num_write":1144,"num_write_kb":29598,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:59.092470+0000","last_change":"2024-03-09T15:07:59.092525+0000","last_active":"2024-03-09T15:07:59.092470+0000","last_peered":"2024-03-09T15:07:59.092470+0000","last_clean":"2024-03-09T15:07:59.092470+0000","last_became_active":"2024-03-09T14:28:57.613841+0000","last_became_peered":"2024-03-09T14:28:57.613841+0000","last_unstale":"2024-03-09T15:07:59.092470+0000","last_undegraded":"2024-03-09T15:07:59.092470+0000","last_fullsized":"2024-03-09T15:07:59.092470+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:59.092283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:59.092283+0000","last_clean_scrub_stamp":"2024-03-09T15:07:59.092283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:55:18.707256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'109","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.725975+0000","last_change":"2024-03-09T15:07:14.726059+0000","last_active":"2024-03-09T15:07:14.725975+0000","last_peered":"2024-03-09T15:07:14.725975+0000","last_clean":"2024-03-09T15:07:14.725975+0000","last_became_active":"2024-03-09T14:28:59.619147+0000","last_became_peered":"2024-03-09T14:28:59.619147+0000","last_unstale":"2024-03-09T15:07:14.725975+0000","last_undegraded":"2024-03-09T15:07:14.725975+0000","last_fullsized":"2024-03-09T15:07:14.725975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-03-09T15:07:14.725790+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-03-09T15:07:14.725790+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.725790+0000","objects_scrubbed":6,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:39:52.182703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":102,"num_write":78,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'535","reported_seq":3858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.998546+0000","last_change":"2024-03-09T15:07:31.998546+0000","last_active":"2024-03-09T15:07:31.998546+0000","last_peered":"2024-03-09T15:07:31.998546+0000","last_clean":"2024-03-09T15:07:31.998546+0000","last_became_active":"2024-03-09T14:29:01.636743+0000","last_became_peered":"2024-03-09T14:29:01.636743+0000","last_unstale":"2024-03-09T15:07:31.998546+0000","last_undegraded":"2024-03-09T15:07:31.998546+0000","last_fullsized":"2024-03-09T15:07:31.998546+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'535","last_scrub_stamp":"2024-03-09T15:07:31.998158+0000","last_deep_scrub":"264'535","last_deep_scrub_stamp":"2024-03-09T15:07:31.998158+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.998158+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":500,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:35:25.070046+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'199","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.779254+0000","last_change":"2024-03-09T15:07:17.779323+0000","last_active":"2024-03-09T15:07:17.779254+0000","last_peered":"2024-03-09T15:07:17.779254+0000","last_clean":"2024-03-09T15:07:17.779254+0000","last_became_active":"2024-03-09T14:29:03.649194+0000","last_became_peered":"2024-03-09T14:29:03.649194+0000","last_unstale":"2024-03-09T15:07:17.779254+0000","last_undegraded":"2024-03-09T15:07:17.779254+0000","last_fullsized":"2024-03-09T15:07:17.779254+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-03-09T15:07:17.779057+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-03-09T15:07:17.779057+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.779057+0000","objects_scrubbed":2,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:30:24.656524+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":551,"num_read_kb":549,"num_write":426,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'372","reported_seq":1855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.998850+0000","last_change":"2024-03-09T15:07:45.998944+0000","last_active":"2024-03-09T15:07:45.998850+0000","last_peered":"2024-03-09T15:07:45.998850+0000","last_clean":"2024-03-09T15:07:45.998850+0000","last_became_active":"2024-03-09T14:28:55.592359+0000","last_became_peered":"2024-03-09T14:28:55.592359+0000","last_unstale":"2024-03-09T15:07:45.998850+0000","last_undegraded":"2024-03-09T15:07:45.998850+0000","last_fullsized":"2024-03-09T15:07:45.998850+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-03-09T15:07:45.998658+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-03-09T15:07:45.998658+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.998658+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:30.189276+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2105,"num_read_kb":2015,"num_write":416,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'285","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.228128+0000","last_change":"2024-03-09T15:07:38.228128+0000","last_active":"2024-03-09T15:07:38.228128+0000","last_peered":"2024-03-09T15:07:38.228128+0000","last_clean":"2024-03-09T15:07:38.228128+0000","last_became_active":"2024-03-09T14:28:53.631559+0000","last_became_peered":"2024-03-09T14:28:53.631559+0000","last_unstale":"2024-03-09T15:07:38.228128+0000","last_undegraded":"2024-03-09T15:07:38.228128+0000","last_fullsized":"2024-03-09T15:07:38.228128+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'285","last_scrub_stamp":"2024-03-09T15:07:38.227622+0000","last_deep_scrub":"264'285","last_deep_scrub_stamp":"2024-03-09T15:07:38.227622+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.227622+0000","objects_scrubbed":6,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:56:47.419876+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8554550,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":396,"num_read_kb":6712,"num_write":1052,"num_write_kb":20730,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,3],"acting":[6,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.462553+0000","last_change":"2024-03-09T15:07:33.462553+0000","last_active":"2024-03-09T15:07:33.462553+0000","last_peered":"2024-03-09T15:07:33.462553+0000","last_clean":"2024-03-09T15:07:33.462553+0000","last_became_active":"2024-03-09T14:28:57.605787+0000","last_became_peered":"2024-03-09T14:28:57.605787+0000","last_unstale":"2024-03-09T15:07:33.462553+0000","last_undegraded":"2024-03-09T15:07:33.462553+0000","last_fullsized":"2024-03-09T15:07:33.462553+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:33.462302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:33.462302+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.462302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:32:24.678793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'247","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:50.888665+0000","last_change":"2024-03-09T15:07:50.888752+0000","last_active":"2024-03-09T15:07:50.888665+0000","last_peered":"2024-03-09T15:07:50.888665+0000","last_clean":"2024-03-09T15:07:50.888665+0000","last_became_active":"2024-03-09T14:28:59.626279+0000","last_became_peered":"2024-03-09T14:28:59.626279+0000","last_unstale":"2024-03-09T15:07:50.888665+0000","last_undegraded":"2024-03-09T15:07:50.888665+0000","last_fullsized":"2024-03-09T15:07:50.888665+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'247","last_scrub_stamp":"2024-03-09T15:07:50.888461+0000","last_deep_scrub":"264'247","last_deep_scrub_stamp":"2024-03-09T15:07:50.888461+0000","last_clean_scrub_stamp":"2024-03-09T15:07:50.888461+0000","objects_scrubbed":4,"log_size":47,"log_dups_size":200,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:57:19.272093+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":413,"num_read_kb":970,"num_write":334,"num_write_kb":275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'586","reported_seq":1938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.892927+0000","last_change":"2024-03-09T15:07:33.893056+0000","last_active":"2024-03-09T15:07:33.892927+0000","last_peered":"2024-03-09T15:07:33.892927+0000","last_clean":"2024-03-09T15:07:33.892927+0000","last_became_active":"2024-03-09T14:29:01.628420+0000","last_became_peered":"2024-03-09T14:29:01.628420+0000","last_unstale":"2024-03-09T15:07:33.892927+0000","last_undegraded":"2024-03-09T15:07:33.892927+0000","last_fullsized":"2024-03-09T15:07:33.892927+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'586","last_scrub_stamp":"2024-03-09T15:07:33.892638+0000","last_deep_scrub":"264'586","last_deep_scrub_stamp":"2024-03-09T15:07:33.892638+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.892638+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":500,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:25:30.954705+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'515","reported_seq":2127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.519735+0000","last_change":"2024-03-09T15:07:30.519735+0000","last_active":"2024-03-09T15:07:30.519735+0000","last_peered":"2024-03-09T15:07:30.519735+0000","last_clean":"2024-03-09T15:07:30.519735+0000","last_became_active":"2024-03-09T14:28:55.582638+0000","last_became_peered":"2024-03-09T14:28:55.582638+0000","last_unstale":"2024-03-09T15:07:30.519735+0000","last_undegraded":"2024-03-09T15:07:30.519735+0000","last_fullsized":"2024-03-09T15:07:30.519735+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'515","last_scrub_stamp":"2024-03-09T15:07:30.519356+0000","last_deep_scrub":"264'515","last_deep_scrub_stamp":"2024-03-09T15:07:30.519356+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.519356+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:46:41.715786+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2835,"num_read_kb":2627,"num_write":675,"num_write_kb":236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'339","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:58.810650+0000","last_change":"2024-03-09T15:07:58.810780+0000","last_active":"2024-03-09T15:07:58.810650+0000","last_peered":"2024-03-09T15:07:58.810650+0000","last_clean":"2024-03-09T15:07:58.810650+0000","last_became_active":"2024-03-09T14:28:53.614586+0000","last_became_peered":"2024-03-09T14:28:53.614586+0000","last_unstale":"2024-03-09T15:07:58.810650+0000","last_undegraded":"2024-03-09T15:07:58.810650+0000","last_fullsized":"2024-03-09T15:07:58.810650+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-03-09T15:07:58.810454+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-03-09T15:07:58.810454+0000","last_clean_scrub_stamp":"2024-03-09T15:07:58.810454+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:19:53.323648+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2180167,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":462,"num_read_kb":10439,"num_write":1256,"num_write_kb":25392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0,1],"acting":[7,4,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.993744+0000","last_change":"2024-03-09T15:07:36.993744+0000","last_active":"2024-03-09T15:07:36.993744+0000","last_peered":"2024-03-09T15:07:36.993744+0000","last_clean":"2024-03-09T15:07:36.993744+0000","last_became_active":"2024-03-09T14:28:57.603233+0000","last_became_peered":"2024-03-09T14:28:57.603233+0000","last_unstale":"2024-03-09T15:07:36.993744+0000","last_undegraded":"2024-03-09T15:07:36.993744+0000","last_fullsized":"2024-03-09T15:07:36.993744+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:36.993362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:36.993362+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.993362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:50:38.382666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'340","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.485642+0000","last_change":"2024-03-09T15:07:23.485642+0000","last_active":"2024-03-09T15:07:23.485642+0000","last_peered":"2024-03-09T15:07:23.485642+0000","last_clean":"2024-03-09T15:07:23.485642+0000","last_became_active":"2024-03-09T14:28:59.626371+0000","last_became_peered":"2024-03-09T14:28:59.626371+0000","last_unstale":"2024-03-09T15:07:23.485642+0000","last_undegraded":"2024-03-09T15:07:23.485642+0000","last_fullsized":"2024-03-09T15:07:23.485642+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'340","last_scrub_stamp":"2024-03-09T15:07:23.485354+0000","last_deep_scrub":"264'340","last_deep_scrub_stamp":"2024-03-09T15:07:23.485354+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.485354+0000","objects_scrubbed":9,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:58:29.645072+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46990,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":561,"num_read_kb":1214,"num_write":446,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.556181+0000","last_change":"2024-03-09T15:07:45.556234+0000","last_active":"2024-03-09T15:07:45.556181+0000","last_peered":"2024-03-09T15:07:45.556181+0000","last_clean":"2024-03-09T15:07:45.556181+0000","last_became_active":"2024-03-09T14:29:01.636735+0000","last_became_peered":"2024-03-09T14:29:01.636735+0000","last_unstale":"2024-03-09T15:07:45.556181+0000","last_undegraded":"2024-03-09T15:07:45.556181+0000","last_fullsized":"2024-03-09T15:07:45.556181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:45.555980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:45.555980+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.555980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:49:20.562981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'545","reported_seq":1376,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:14.508731+0000","last_change":"2024-03-09T15:07:14.508801+0000","last_active":"2024-03-09T15:07:14.508731+0000","last_peered":"2024-03-09T15:07:14.508731+0000","last_clean":"2024-03-09T15:07:14.508731+0000","last_became_active":"2024-03-09T14:29:03.676068+0000","last_became_peered":"2024-03-09T14:29:03.676068+0000","last_unstale":"2024-03-09T15:07:14.508731+0000","last_undegraded":"2024-03-09T15:07:14.508731+0000","last_fullsized":"2024-03-09T15:07:14.508731+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'545","last_scrub_stamp":"2024-03-09T15:07:14.508537+0000","last_deep_scrub":"264'545","last_deep_scrub_stamp":"2024-03-09T15:07:14.508537+0000","last_clean_scrub_stamp":"2024-03-09T15:07:14.508537+0000","objects_scrubbed":3,"log_size":45,"log_dups_size":500,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:06:49.609530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1331,"num_read_kb":1310,"num_write":1143,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'507","reported_seq":2122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.851323+0000","last_change":"2024-03-09T15:07:48.851323+0000","last_active":"2024-03-09T15:07:48.851323+0000","last_peered":"2024-03-09T15:07:48.851323+0000","last_clean":"2024-03-09T15:07:48.851323+0000","last_became_active":"2024-03-09T14:28:55.562782+0000","last_became_peered":"2024-03-09T14:28:55.562782+0000","last_unstale":"2024-03-09T15:07:48.851323+0000","last_undegraded":"2024-03-09T15:07:48.851323+0000","last_fullsized":"2024-03-09T15:07:48.851323+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'507","last_scrub_stamp":"2024-03-09T15:07:48.851059+0000","last_deep_scrub":"264'507","last_deep_scrub_stamp":"2024-03-09T15:07:48.851059+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.851059+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":400,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:43:04.936838+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2703,"num_read_kb":2505,"num_write":654,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":488,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'320","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:57.809612+0000","last_change":"2024-03-09T15:07:57.809702+0000","last_active":"2024-03-09T15:07:57.809612+0000","last_peered":"2024-03-09T15:07:57.809612+0000","last_clean":"2024-03-09T15:07:57.809612+0000","last_became_active":"2024-03-09T14:28:53.613015+0000","last_became_peered":"2024-03-09T14:28:53.613015+0000","last_unstale":"2024-03-09T15:07:57.809612+0000","last_undegraded":"2024-03-09T15:07:57.809612+0000","last_fullsized":"2024-03-09T15:07:57.809612+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'320","last_scrub_stamp":"2024-03-09T15:07:57.809423+0000","last_deep_scrub":"264'320","last_deep_scrub_stamp":"2024-03-09T15:07:57.809423+0000","last_clean_scrub_stamp":"2024-03-09T15:07:57.809423+0000","objects_scrubbed":3,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:40:06.906489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":493,"num_read_kb":9909,"num_write":1175,"num_write_kb":22337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,2],"acting":[7,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.500103+0000","last_change":"2024-03-09T15:07:26.500103+0000","last_active":"2024-03-09T15:07:26.500103+0000","last_peered":"2024-03-09T15:07:26.500103+0000","last_clean":"2024-03-09T15:07:26.500103+0000","last_became_active":"2024-03-09T14:28:57.605493+0000","last_became_peered":"2024-03-09T14:28:57.605493+0000","last_unstale":"2024-03-09T15:07:26.500103+0000","last_undegraded":"2024-03-09T15:07:26.500103+0000","last_fullsized":"2024-03-09T15:07:26.500103+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:26.499852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:26.499852+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.499852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:50:05.246070+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'267","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:09.129873+0000","last_change":"2024-03-09T15:08:09.129948+0000","last_active":"2024-03-09T15:08:09.129873+0000","last_peered":"2024-03-09T15:08:09.129873+0000","last_clean":"2024-03-09T15:08:09.129873+0000","last_became_active":"2024-03-09T14:28:59.614640+0000","last_became_peered":"2024-03-09T14:28:59.614640+0000","last_unstale":"2024-03-09T15:08:09.129873+0000","last_undegraded":"2024-03-09T15:08:09.129873+0000","last_fullsized":"2024-03-09T15:08:09.129873+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'267","last_scrub_stamp":"2024-03-09T15:08:09.129697+0000","last_deep_scrub":"264'267","last_deep_scrub_stamp":"2024-03-09T15:08:09.129697+0000","last_clean_scrub_stamp":"2024-03-09T15:08:09.129697+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:19:39.398013+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43961,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":1047,"num_write":356,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.964788+0000","last_change":"2024-03-09T15:07:35.964788+0000","last_active":"2024-03-09T15:07:35.964788+0000","last_peered":"2024-03-09T15:07:35.964788+0000","last_clean":"2024-03-09T15:07:35.964788+0000","last_became_active":"2024-03-09T14:29:01.627897+0000","last_became_peered":"2024-03-09T14:29:01.627897+0000","last_unstale":"2024-03-09T15:07:35.964788+0000","last_undegraded":"2024-03-09T15:07:35.964788+0000","last_fullsized":"2024-03-09T15:07:35.964788+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.964526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.964526+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.964526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:44:17.279534+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'107","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.239481+0000","last_change":"2024-03-09T15:07:33.239545+0000","last_active":"2024-03-09T15:07:33.239481+0000","last_peered":"2024-03-09T15:07:33.239481+0000","last_clean":"2024-03-09T15:07:33.239481+0000","last_became_active":"2024-03-09T14:29:03.673265+0000","last_became_peered":"2024-03-09T14:29:03.673265+0000","last_unstale":"2024-03-09T15:07:33.239481+0000","last_undegraded":"2024-03-09T15:07:33.239481+0000","last_fullsized":"2024-03-09T15:07:33.239481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-03-09T15:07:33.239261+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-03-09T15:07:33.239261+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.239261+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:39:44.261038+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":99,"num_read_kb":93,"num_write":248,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'558","reported_seq":2197,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.192096+0000","last_change":"2024-03-09T15:07:32.192096+0000","last_active":"2024-03-09T15:07:32.192096+0000","last_peered":"2024-03-09T15:07:32.192096+0000","last_clean":"2024-03-09T15:07:32.192096+0000","last_became_active":"2024-03-09T14:28:55.588092+0000","last_became_peered":"2024-03-09T14:28:55.588092+0000","last_unstale":"2024-03-09T15:07:32.192096+0000","last_undegraded":"2024-03-09T15:07:32.192096+0000","last_fullsized":"2024-03-09T15:07:32.192096+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'558","last_scrub_stamp":"2024-03-09T15:07:32.191808+0000","last_deep_scrub":"264'558","last_deep_scrub_stamp":"2024-03-09T15:07:32.191808+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.191808+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":500,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:52:46.626276+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2916,"num_read_kb":2661,"num_write":728,"num_write_kb":225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":556,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'301","reported_seq":887,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.675925+0000","last_change":"2024-03-09T15:07:15.675925+0000","last_active":"2024-03-09T15:07:15.675925+0000","last_peered":"2024-03-09T15:07:15.675925+0000","last_clean":"2024-03-09T15:07:15.675925+0000","last_became_active":"2024-03-09T14:29:28.822971+0000","last_became_peered":"2024-03-09T14:29:28.822971+0000","last_unstale":"2024-03-09T15:07:15.675925+0000","last_undegraded":"2024-03-09T15:07:15.675925+0000","last_fullsized":"2024-03-09T15:07:15.675925+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'301","last_scrub_stamp":"2024-03-09T15:07:15.675604+0000","last_deep_scrub":"264'301","last_deep_scrub_stamp":"2024-03-09T15:07:15.675604+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.675604+0000","objects_scrubbed":6,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:44.567227+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262197,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":365,"num_read_kb":22880,"num_write":991,"num_write_kb":75728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4,6],"acting":[2,5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.593360+0000","last_change":"2024-03-09T15:07:20.593411+0000","last_active":"2024-03-09T15:07:20.593360+0000","last_peered":"2024-03-09T15:07:20.593360+0000","last_clean":"2024-03-09T15:07:20.593360+0000","last_became_active":"2024-03-09T14:28:57.610472+0000","last_became_peered":"2024-03-09T14:28:57.610472+0000","last_unstale":"2024-03-09T15:07:20.593360+0000","last_undegraded":"2024-03-09T15:07:20.593360+0000","last_fullsized":"2024-03-09T15:07:20.593360+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.593168+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.593168+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.593168+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:29:16.398211+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'311","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.838773+0000","last_change":"2024-03-09T15:07:44.838773+0000","last_active":"2024-03-09T15:07:44.838773+0000","last_peered":"2024-03-09T15:07:44.838773+0000","last_clean":"2024-03-09T15:07:44.838773+0000","last_became_active":"2024-03-09T14:28:59.610930+0000","last_became_peered":"2024-03-09T14:28:59.610930+0000","last_unstale":"2024-03-09T15:07:44.838773+0000","last_undegraded":"2024-03-09T15:07:44.838773+0000","last_fullsized":"2024-03-09T15:07:44.838773+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'311","last_scrub_stamp":"2024-03-09T15:07:44.838298+0000","last_deep_scrub":"264'311","last_deep_scrub_stamp":"2024-03-09T15:07:44.838298+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.838298+0000","objects_scrubbed":8,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:31:47.870542+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48936,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":498,"num_read_kb":1136,"num_write":410,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'561","reported_seq":2063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.783893+0000","last_change":"2024-03-09T15:07:34.783893+0000","last_active":"2024-03-09T15:07:34.783893+0000","last_peered":"2024-03-09T15:07:34.783893+0000","last_clean":"2024-03-09T15:07:34.783893+0000","last_became_active":"2024-03-09T14:29:01.647361+0000","last_became_peered":"2024-03-09T14:29:01.647361+0000","last_unstale":"2024-03-09T15:07:34.783893+0000","last_undegraded":"2024-03-09T15:07:34.783893+0000","last_fullsized":"2024-03-09T15:07:34.783893+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'561","last_scrub_stamp":"2024-03-09T15:07:34.783640+0000","last_deep_scrub":"264'561","last_deep_scrub_stamp":"2024-03-09T15:07:34.783640+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.783640+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":500,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:39:17.912636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'138","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.680790+0000","last_change":"2024-03-09T15:07:26.680790+0000","last_active":"2024-03-09T15:07:26.680790+0000","last_peered":"2024-03-09T15:07:26.680790+0000","last_clean":"2024-03-09T15:07:26.680790+0000","last_became_active":"2024-03-09T14:29:03.665744+0000","last_became_peered":"2024-03-09T14:29:03.665744+0000","last_unstale":"2024-03-09T15:07:26.680790+0000","last_undegraded":"2024-03-09T15:07:26.680790+0000","last_fullsized":"2024-03-09T15:07:26.680790+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-03-09T15:07:26.680521+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-03-09T15:07:26.680521+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.680521+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:25:01.192699+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":416,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":116,"num_read_kb":113,"num_write":338,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'383","reported_seq":2005,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.736800+0000","last_change":"2024-03-09T15:07:40.736871+0000","last_active":"2024-03-09T15:07:40.736800+0000","last_peered":"2024-03-09T15:07:40.736800+0000","last_clean":"2024-03-09T15:07:40.736800+0000","last_became_active":"2024-03-09T14:28:55.587413+0000","last_became_peered":"2024-03-09T14:28:55.587413+0000","last_unstale":"2024-03-09T15:07:40.736800+0000","last_undegraded":"2024-03-09T15:07:40.736800+0000","last_fullsized":"2024-03-09T15:07:40.736800+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'383","last_scrub_stamp":"2024-03-09T15:07:40.736592+0000","last_deep_scrub":"264'383","last_deep_scrub_stamp":"2024-03-09T15:07:40.736592+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.736592+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:21:16.406333+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2251,"num_read_kb":2175,"num_write":432,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2785,"num_omap_keys":11,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'286","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.503429+0000","last_change":"2024-03-09T15:07:36.503537+0000","last_active":"2024-03-09T15:07:36.503429+0000","last_peered":"2024-03-09T15:07:36.503429+0000","last_clean":"2024-03-09T15:07:36.503429+0000","last_became_active":"2024-03-09T14:28:53.639073+0000","last_became_peered":"2024-03-09T14:28:53.639073+0000","last_unstale":"2024-03-09T15:07:36.503429+0000","last_undegraded":"2024-03-09T15:07:36.503429+0000","last_fullsized":"2024-03-09T15:07:36.503429+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'286","last_scrub_stamp":"2024-03-09T15:07:36.503200+0000","last_deep_scrub":"264'286","last_deep_scrub_stamp":"2024-03-09T15:07:36.503200+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.503200+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:19:59.978473+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1656710,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":422,"num_read_kb":3405,"num_write":1144,"num_write_kb":27946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6,1],"acting":[5,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.643287+0000","last_change":"2024-03-09T15:07:18.643287+0000","last_active":"2024-03-09T15:07:18.643287+0000","last_peered":"2024-03-09T15:07:18.643287+0000","last_clean":"2024-03-09T15:07:18.643287+0000","last_became_active":"2024-03-09T14:28:57.620037+0000","last_became_peered":"2024-03-09T14:28:57.620037+0000","last_unstale":"2024-03-09T15:07:18.643287+0000","last_undegraded":"2024-03-09T15:07:18.643287+0000","last_fullsized":"2024-03-09T15:07:18.643287+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:18.642943+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:18.642943+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.642943+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:49:35.857746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'476","reported_seq":1106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.532891+0000","last_change":"2024-03-09T15:08:01.532969+0000","last_active":"2024-03-09T15:08:01.532891+0000","last_peered":"2024-03-09T15:08:01.532891+0000","last_clean":"2024-03-09T15:08:01.532891+0000","last_became_active":"2024-03-09T14:28:59.625949+0000","last_became_peered":"2024-03-09T14:28:59.625949+0000","last_unstale":"2024-03-09T15:08:01.532891+0000","last_undegraded":"2024-03-09T15:08:01.532891+0000","last_fullsized":"2024-03-09T15:08:01.532891+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'476","last_scrub_stamp":"2024-03-09T15:08:01.532695+0000","last_deep_scrub":"264'476","last_deep_scrub_stamp":"2024-03-09T15:08:01.532695+0000","last_clean_scrub_stamp":"2024-03-09T15:08:01.532695+0000","objects_scrubbed":6,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:35:34.450834+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84476,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":828,"num_read_kb":2021,"num_write":686,"num_write_kb":588,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.761532+0000","last_change":"2024-03-09T15:07:12.761532+0000","last_active":"2024-03-09T15:07:12.761532+0000","last_peered":"2024-03-09T15:07:12.761532+0000","last_clean":"2024-03-09T15:07:12.761532+0000","last_became_active":"2024-03-09T14:29:01.620136+0000","last_became_peered":"2024-03-09T14:29:01.620136+0000","last_unstale":"2024-03-09T15:07:12.761532+0000","last_undegraded":"2024-03-09T15:07:12.761532+0000","last_fullsized":"2024-03-09T15:07:12.761532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:12.761261+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:12.761261+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.761261+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:22:11.707212+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'161","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.964042+0000","last_change":"2024-03-09T15:07:17.964042+0000","last_active":"2024-03-09T15:07:17.964042+0000","last_peered":"2024-03-09T15:07:17.964042+0000","last_clean":"2024-03-09T15:07:17.964042+0000","last_became_active":"2024-03-09T14:29:03.673216+0000","last_became_peered":"2024-03-09T14:29:03.673216+0000","last_unstale":"2024-03-09T15:07:17.964042+0000","last_undegraded":"2024-03-09T15:07:17.964042+0000","last_fullsized":"2024-03-09T15:07:17.964042+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'161","last_scrub_stamp":"2024-03-09T15:07:17.963795+0000","last_deep_scrub":"264'161","last_deep_scrub_stamp":"2024-03-09T15:07:17.963795+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.963795+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:47:11.924876+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":716,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":343,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'285","reported_seq":1646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.776038+0000","last_change":"2024-03-09T15:07:35.776186+0000","last_active":"2024-03-09T15:07:35.776038+0000","last_peered":"2024-03-09T15:07:35.776038+0000","last_clean":"2024-03-09T15:07:35.776038+0000","last_became_active":"2024-03-09T14:28:55.575211+0000","last_became_peered":"2024-03-09T14:28:55.575211+0000","last_unstale":"2024-03-09T15:07:35.776038+0000","last_undegraded":"2024-03-09T15:07:35.776038+0000","last_fullsized":"2024-03-09T15:07:35.776038+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'285","last_scrub_stamp":"2024-03-09T15:07:35.775806+0000","last_deep_scrub":"264'285","last_deep_scrub_stamp":"2024-03-09T15:07:35.775806+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.775806+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:52:28.874528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1639,"num_read_kb":1592,"num_write":307,"num_write_kb":35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'315","reported_seq":1002,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:01.125196+0000","last_change":"2024-03-09T15:08:01.125345+0000","last_active":"2024-03-09T15:08:01.125196+0000","last_peered":"2024-03-09T15:08:01.125196+0000","last_clean":"2024-03-09T15:08:01.125196+0000","last_became_active":"2024-03-09T14:28:53.561769+0000","last_became_peered":"2024-03-09T14:28:53.561769+0000","last_unstale":"2024-03-09T15:08:01.125196+0000","last_undegraded":"2024-03-09T15:08:01.125196+0000","last_fullsized":"2024-03-09T15:08:01.125196+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'315","last_scrub_stamp":"2024-03-09T15:08:01.124996+0000","last_deep_scrub":"264'315","last_deep_scrub_stamp":"2024-03-09T15:08:01.124996+0000","last_clean_scrub_stamp":"2024-03-09T15:08:01.124996+0000","objects_scrubbed":9,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:07:56.606095+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":556,"num_read_kb":46371,"num_write":1232,"num_write_kb":14767,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4,7],"acting":[3,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.518216+0000","last_change":"2024-03-09T15:07:24.518273+0000","last_active":"2024-03-09T15:07:24.518216+0000","last_peered":"2024-03-09T15:07:24.518216+0000","last_clean":"2024-03-09T15:07:24.518216+0000","last_became_active":"2024-03-09T14:28:57.606029+0000","last_became_peered":"2024-03-09T14:28:57.606029+0000","last_unstale":"2024-03-09T15:07:24.518216+0000","last_undegraded":"2024-03-09T15:07:24.518216+0000","last_fullsized":"2024-03-09T15:07:24.518216+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:24.517981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:24.517981+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.517981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:21:03.615664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'277","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.729802+0000","last_change":"2024-03-09T15:07:23.729911+0000","last_active":"2024-03-09T15:07:23.729802+0000","last_peered":"2024-03-09T15:07:23.729802+0000","last_clean":"2024-03-09T15:07:23.729802+0000","last_became_active":"2024-03-09T14:28:59.630097+0000","last_became_peered":"2024-03-09T14:28:59.630097+0000","last_unstale":"2024-03-09T15:07:23.729802+0000","last_undegraded":"2024-03-09T15:07:23.729802+0000","last_fullsized":"2024-03-09T15:07:23.729802+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'277","last_scrub_stamp":"2024-03-09T15:07:23.729634+0000","last_deep_scrub":"264'277","last_deep_scrub_stamp":"2024-03-09T15:07:23.729634+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.729634+0000","objects_scrubbed":6,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:54:34.396344+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42990,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":461,"num_read_kb":1018,"num_write":414,"num_write_kb":345,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":13964,"num_omap_keys":34,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.735309+0000","last_change":"2024-03-09T15:07:30.735368+0000","last_active":"2024-03-09T15:07:30.735309+0000","last_peered":"2024-03-09T15:07:30.735309+0000","last_clean":"2024-03-09T15:07:30.735309+0000","last_became_active":"2024-03-09T14:29:01.647375+0000","last_became_peered":"2024-03-09T14:29:01.647375+0000","last_unstale":"2024-03-09T15:07:30.735309+0000","last_undegraded":"2024-03-09T15:07:30.735309+0000","last_fullsized":"2024-03-09T15:07:30.735309+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:30.735096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:30.735096+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.735096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:02:27.562547+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'131","reported_seq":620,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.012999+0000","last_change":"2024-03-09T15:07:11.013027+0000","last_active":"2024-03-09T15:07:11.012999+0000","last_peered":"2024-03-09T15:07:11.012999+0000","last_clean":"2024-03-09T15:07:11.012999+0000","last_became_active":"2024-03-09T14:29:03.677704+0000","last_became_peered":"2024-03-09T14:29:03.677704+0000","last_unstale":"2024-03-09T15:07:11.012999+0000","last_undegraded":"2024-03-09T15:07:11.012999+0000","last_fullsized":"2024-03-09T15:07:11.012999+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-03-09T15:07:11.012928+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-03-09T15:07:11.012928+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.012928+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:47:36.358128+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":91,"num_read_kb":91,"num_write":309,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'401","reported_seq":2053,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.749796+0000","last_change":"2024-03-09T15:07:33.749866+0000","last_active":"2024-03-09T15:07:33.749796+0000","last_peered":"2024-03-09T15:07:33.749796+0000","last_clean":"2024-03-09T15:07:33.749796+0000","last_became_active":"2024-03-09T14:28:55.577690+0000","last_became_peered":"2024-03-09T14:28:55.577690+0000","last_unstale":"2024-03-09T15:07:33.749796+0000","last_undegraded":"2024-03-09T15:07:33.749796+0000","last_fullsized":"2024-03-09T15:07:33.749796+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'401","last_scrub_stamp":"2024-03-09T15:07:33.749602+0000","last_deep_scrub":"264'401","last_deep_scrub_stamp":"2024-03-09T15:07:33.749602+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.749602+0000","objects_scrubbed":5,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:10:47.176225+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2493,"num_read_kb":2366,"num_write":474,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2864,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'293","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.224450+0000","last_change":"2024-03-09T15:07:36.224450+0000","last_active":"2024-03-09T15:07:36.224450+0000","last_peered":"2024-03-09T15:07:36.224450+0000","last_clean":"2024-03-09T15:07:36.224450+0000","last_became_active":"2024-03-09T14:28:53.627013+0000","last_became_peered":"2024-03-09T14:28:53.627013+0000","last_unstale":"2024-03-09T15:07:36.224450+0000","last_undegraded":"2024-03-09T15:07:36.224450+0000","last_fullsized":"2024-03-09T15:07:36.224450+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'293","last_scrub_stamp":"2024-03-09T15:07:36.224112+0000","last_deep_scrub":"264'293","last_deep_scrub_stamp":"2024-03-09T15:07:36.224112+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.224112+0000","objects_scrubbed":3,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:02:25.648110+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242906,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":6489,"num_write":1122,"num_write_kb":11469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1,7],"acting":[6,4,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.827752+0000","last_change":"2024-03-09T15:07:23.827856+0000","last_active":"2024-03-09T15:07:23.827752+0000","last_peered":"2024-03-09T15:07:23.827752+0000","last_clean":"2024-03-09T15:07:23.827752+0000","last_became_active":"2024-03-09T14:28:57.614028+0000","last_became_peered":"2024-03-09T14:28:57.614028+0000","last_unstale":"2024-03-09T15:07:23.827752+0000","last_undegraded":"2024-03-09T15:07:23.827752+0000","last_fullsized":"2024-03-09T15:07:23.827752+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:23.827525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:23.827525+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.827525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:24:15.966605+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'266","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.640027+0000","last_change":"2024-03-09T15:07:16.640027+0000","last_active":"2024-03-09T15:07:16.640027+0000","last_peered":"2024-03-09T15:07:16.640027+0000","last_clean":"2024-03-09T15:07:16.640027+0000","last_became_active":"2024-03-09T14:28:59.613169+0000","last_became_peered":"2024-03-09T14:28:59.613169+0000","last_unstale":"2024-03-09T15:07:16.640027+0000","last_undegraded":"2024-03-09T15:07:16.640027+0000","last_fullsized":"2024-03-09T15:07:16.640027+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-03-09T15:07:16.639752+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-03-09T15:07:16.639752+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.639752+0000","objects_scrubbed":7,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:43.931037+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59017,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":434,"num_read_kb":985,"num_write":344,"num_write_kb":277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'525","reported_seq":4084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:11.761709+0000","last_change":"2024-03-09T15:07:11.761709+0000","last_active":"2024-03-09T15:07:11.761709+0000","last_peered":"2024-03-09T15:07:11.761709+0000","last_clean":"2024-03-09T15:07:11.761709+0000","last_became_active":"2024-03-09T14:29:01.633363+0000","last_became_peered":"2024-03-09T14:29:01.633363+0000","last_unstale":"2024-03-09T15:07:11.761709+0000","last_undegraded":"2024-03-09T15:07:11.761709+0000","last_fullsized":"2024-03-09T15:07:11.761709+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'525","last_scrub_stamp":"2024-03-09T15:07:11.761590+0000","last_deep_scrub":"264'525","last_deep_scrub_stamp":"2024-03-09T15:07:11.761590+0000","last_clean_scrub_stamp":"2024-03-09T15:07:11.761590+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:52:01.906869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'120","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.054420+0000","last_change":"2024-03-09T15:07:15.054514+0000","last_active":"2024-03-09T15:07:15.054420+0000","last_peered":"2024-03-09T15:07:15.054420+0000","last_clean":"2024-03-09T15:07:15.054420+0000","last_became_active":"2024-03-09T14:29:03.679941+0000","last_became_peered":"2024-03-09T14:29:03.679941+0000","last_unstale":"2024-03-09T15:07:15.054420+0000","last_undegraded":"2024-03-09T15:07:15.054420+0000","last_fullsized":"2024-03-09T15:07:15.054420+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'120","last_scrub_stamp":"2024-03-09T15:07:15.054218+0000","last_deep_scrub":"264'120","last_deep_scrub_stamp":"2024-03-09T15:07:15.054218+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.054218+0000","objects_scrubbed":6,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:13:22.609108+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1871,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":110,"num_read_kb":101,"num_write":265,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'459","reported_seq":2162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.779128+0000","last_change":"2024-03-09T15:07:28.779197+0000","last_active":"2024-03-09T15:07:28.779128+0000","last_peered":"2024-03-09T15:07:28.779128+0000","last_clean":"2024-03-09T15:07:28.779128+0000","last_became_active":"2024-03-09T14:28:55.589982+0000","last_became_peered":"2024-03-09T14:28:55.589982+0000","last_unstale":"2024-03-09T15:07:28.779128+0000","last_undegraded":"2024-03-09T15:07:28.779128+0000","last_fullsized":"2024-03-09T15:07:28.779128+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'459","last_scrub_stamp":"2024-03-09T15:07:28.778936+0000","last_deep_scrub":"264'459","last_deep_scrub_stamp":"2024-03-09T15:07:28.778936+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.778936+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:20:52.811305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2457,"num_read_kb":2347,"num_write":517,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'336","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.849767+0000","last_change":"2024-03-09T15:07:45.849767+0000","last_active":"2024-03-09T15:07:45.849767+0000","last_peered":"2024-03-09T15:07:45.849767+0000","last_clean":"2024-03-09T15:07:45.849767+0000","last_became_active":"2024-03-09T14:28:53.596847+0000","last_became_peered":"2024-03-09T14:28:53.596847+0000","last_unstale":"2024-03-09T15:07:45.849767+0000","last_undegraded":"2024-03-09T15:07:45.849767+0000","last_fullsized":"2024-03-09T15:07:45.849767+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-03-09T15:07:45.849293+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-03-09T15:07:45.849293+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.849293+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:11:45.242419+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243083,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":7047,"num_write":1167,"num_write_kb":21742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,1],"acting":[4,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1147,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.572847+0000","last_change":"2024-03-09T15:07:41.572994+0000","last_active":"2024-03-09T15:07:41.572847+0000","last_peered":"2024-03-09T15:07:41.572847+0000","last_clean":"2024-03-09T15:07:41.572847+0000","last_became_active":"2024-03-09T14:28:57.618459+0000","last_became_peered":"2024-03-09T14:28:57.618459+0000","last_unstale":"2024-03-09T15:07:41.572847+0000","last_undegraded":"2024-03-09T15:07:41.572847+0000","last_fullsized":"2024-03-09T15:07:41.572847+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:07:41.572624+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:07:41.572624+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.572624+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:59:03.798948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":640,"num_read_kb":640,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'61","reported_seq":576,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.019811+0000","last_change":"2024-03-09T15:07:37.019886+0000","last_active":"2024-03-09T15:07:37.019811+0000","last_peered":"2024-03-09T15:07:37.019811+0000","last_clean":"2024-03-09T15:07:37.019811+0000","last_became_active":"2024-03-09T14:28:59.634653+0000","last_became_peered":"2024-03-09T14:28:59.634653+0000","last_unstale":"2024-03-09T15:07:37.019811+0000","last_undegraded":"2024-03-09T15:07:37.019811+0000","last_fullsized":"2024-03-09T15:07:37.019811+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'61","last_scrub_stamp":"2024-03-09T15:07:37.019629+0000","last_deep_scrub":"264'61","last_deep_scrub_stamp":"2024-03-09T15:07:37.019629+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.019629+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:56:39.123329+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":60,"num_read_kb":55,"num_write":40,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'537","reported_seq":1996,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.258519+0000","last_change":"2024-03-09T15:07:25.258582+0000","last_active":"2024-03-09T15:07:25.258519+0000","last_peered":"2024-03-09T15:07:25.258519+0000","last_clean":"2024-03-09T15:07:25.258519+0000","last_became_active":"2024-03-09T14:29:01.656177+0000","last_became_peered":"2024-03-09T14:29:01.656177+0000","last_unstale":"2024-03-09T15:07:25.258519+0000","last_undegraded":"2024-03-09T15:07:25.258519+0000","last_fullsized":"2024-03-09T15:07:25.258519+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'537","last_scrub_stamp":"2024-03-09T15:07:25.258322+0000","last_deep_scrub":"264'537","last_deep_scrub_stamp":"2024-03-09T15:07:25.258322+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.258322+0000","objects_scrubbed":1,"log_size":37,"log_dups_size":500,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:08:40.564114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'150","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.798479+0000","last_change":"2024-03-09T15:07:13.798635+0000","last_active":"2024-03-09T15:07:13.798479+0000","last_peered":"2024-03-09T15:07:13.798479+0000","last_clean":"2024-03-09T15:07:13.798479+0000","last_became_active":"2024-03-09T14:29:03.672416+0000","last_became_peered":"2024-03-09T14:29:03.672416+0000","last_unstale":"2024-03-09T15:07:13.798479+0000","last_undegraded":"2024-03-09T15:07:13.798479+0000","last_fullsized":"2024-03-09T15:07:13.798479+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'150","last_scrub_stamp":"2024-03-09T15:07:13.798260+0000","last_deep_scrub":"264'150","last_deep_scrub_stamp":"2024-03-09T15:07:13.798260+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.798260+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:30:31.358279+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":118,"num_read_kb":112,"num_write":348,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'862","reported_seq":2485,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.889037+0000","last_change":"2024-03-09T15:07:32.889198+0000","last_active":"2024-03-09T15:07:32.889037+0000","last_peered":"2024-03-09T15:07:32.889037+0000","last_clean":"2024-03-09T15:07:32.889037+0000","last_became_active":"2024-03-09T14:28:55.583618+0000","last_became_peered":"2024-03-09T14:28:55.583618+0000","last_unstale":"2024-03-09T15:07:32.889037+0000","last_undegraded":"2024-03-09T15:07:32.889037+0000","last_fullsized":"2024-03-09T15:07:32.889037+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'862","last_scrub_stamp":"2024-03-09T15:07:32.888792+0000","last_deep_scrub":"264'862","last_deep_scrub_stamp":"2024-03-09T15:07:32.888792+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.888792+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":800,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:39:33.341783+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4083,"num_read_kb":3643,"num_write":1199,"num_write_kb":506,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'316","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:04.057323+0000","last_change":"2024-03-09T15:08:04.057446+0000","last_active":"2024-03-09T15:08:04.057323+0000","last_peered":"2024-03-09T15:08:04.057323+0000","last_clean":"2024-03-09T15:08:04.057323+0000","last_became_active":"2024-03-09T14:28:53.568002+0000","last_became_peered":"2024-03-09T14:28:53.568002+0000","last_unstale":"2024-03-09T15:08:04.057323+0000","last_undegraded":"2024-03-09T15:08:04.057323+0000","last_fullsized":"2024-03-09T15:08:04.057323+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-03-09T15:08:04.057113+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-03-09T15:08:04.057113+0000","last_clean_scrub_stamp":"2024-03-09T15:08:04.057113+0000","objects_scrubbed":6,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:20:05.103717+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":642,"num_read_kb":26434,"num_write":1119,"num_write_kb":51619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,4],"acting":[3,1,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":503,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.851109+0000","last_change":"2024-03-09T15:07:42.851170+0000","last_active":"2024-03-09T15:07:42.851109+0000","last_peered":"2024-03-09T15:07:42.851109+0000","last_clean":"2024-03-09T15:07:42.851109+0000","last_became_active":"2024-03-09T14:28:57.615518+0000","last_became_peered":"2024-03-09T14:28:57.615518+0000","last_unstale":"2024-03-09T15:07:42.851109+0000","last_undegraded":"2024-03-09T15:07:42.851109+0000","last_fullsized":"2024-03-09T15:07:42.851109+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:42.850886+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:42.850886+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.850886+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:31:54.652894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'366","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.533931+0000","last_change":"2024-03-09T15:07:24.534001+0000","last_active":"2024-03-09T15:07:24.533931+0000","last_peered":"2024-03-09T15:07:24.533931+0000","last_clean":"2024-03-09T15:07:24.533931+0000","last_became_active":"2024-03-09T14:28:59.607095+0000","last_became_peered":"2024-03-09T14:28:59.607095+0000","last_unstale":"2024-03-09T15:07:24.533931+0000","last_undegraded":"2024-03-09T15:07:24.533931+0000","last_fullsized":"2024-03-09T15:07:24.533931+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-03-09T15:07:24.533841+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-03-09T15:07:24.533841+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.533841+0000","objects_scrubbed":9,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:56:28.568205+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47607,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1194,"num_read_kb":1839,"num_write":1728,"num_write_kb":1610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":509628,"num_omap_keys":1178,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.241687+0000","last_change":"2024-03-09T15:07:19.241687+0000","last_active":"2024-03-09T15:07:19.241687+0000","last_peered":"2024-03-09T15:07:19.241687+0000","last_clean":"2024-03-09T15:07:19.241687+0000","last_became_active":"2024-03-09T14:29:01.649769+0000","last_became_peered":"2024-03-09T14:29:01.649769+0000","last_unstale":"2024-03-09T15:07:19.241687+0000","last_undegraded":"2024-03-09T15:07:19.241687+0000","last_fullsized":"2024-03-09T15:07:19.241687+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:19.241439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:19.241439+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.241439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:46.292381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'143","reported_seq":650,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:17.002404+0000","last_change":"2024-03-09T15:07:17.002467+0000","last_active":"2024-03-09T15:07:17.002404+0000","last_peered":"2024-03-09T15:07:17.002404+0000","last_clean":"2024-03-09T15:07:17.002404+0000","last_became_active":"2024-03-09T14:29:03.678140+0000","last_became_peered":"2024-03-09T14:29:03.678140+0000","last_unstale":"2024-03-09T15:07:17.002404+0000","last_undegraded":"2024-03-09T15:07:17.002404+0000","last_fullsized":"2024-03-09T15:07:17.002404+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'143","last_scrub_stamp":"2024-03-09T15:07:17.002216+0000","last_deep_scrub":"264'143","last_deep_scrub_stamp":"2024-03-09T15:07:17.002216+0000","last_clean_scrub_stamp":"2024-03-09T15:07:17.002216+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:27:57.619898+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":155,"num_read_kb":150,"num_write":332,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'1641","reported_seq":3319,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.234223+0000","last_change":"2024-03-09T15:07:30.234293+0000","last_active":"2024-03-09T15:07:30.234223+0000","last_peered":"2024-03-09T15:07:30.234223+0000","last_clean":"2024-03-09T15:07:30.234223+0000","last_became_active":"2024-03-09T14:28:55.596219+0000","last_became_peered":"2024-03-09T14:28:55.596219+0000","last_unstale":"2024-03-09T15:07:30.234223+0000","last_undegraded":"2024-03-09T15:07:30.234223+0000","last_fullsized":"2024-03-09T15:07:30.234223+0000","mapping_epoch":25,"log_start":"264'1600","ondisk_log_start":"264'1600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1641","last_scrub_stamp":"2024-03-09T15:07:30.234005+0000","last_deep_scrub":"264'1641","last_deep_scrub_stamp":"2024-03-09T15:07:30.234005+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.234005+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":1600,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:38:17.905569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6749,"num_read_kb":5786,"num_write":2314,"num_write_kb":1014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'119","reported_seq":680,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:52.943960+0000","last_change":"2024-03-09T15:07:52.944051+0000","last_active":"2024-03-09T15:07:52.943960+0000","last_peered":"2024-03-09T15:07:52.943960+0000","last_clean":"2024-03-09T15:07:52.943960+0000","last_became_active":"2024-03-09T14:28:36.802270+0000","last_became_peered":"2024-03-09T14:28:36.802270+0000","last_unstale":"2024-03-09T15:07:52.943960+0000","last_undegraded":"2024-03-09T15:07:52.943960+0000","last_fullsized":"2024-03-09T15:07:52.943960+0000","mapping_epoch":15,"log_start":"16'100","ondisk_log_start":"16'100","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-03-09T15:07:52.943749+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-03-09T15:07:52.943749+0000","last_clean_scrub_stamp":"2024-03-09T15:07:52.943749+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:35:47.954863+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.539692+0000","last_change":"2024-03-09T15:07:43.539692+0000","last_active":"2024-03-09T15:07:43.539692+0000","last_peered":"2024-03-09T15:07:43.539692+0000","last_clean":"2024-03-09T15:07:43.539692+0000","last_became_active":"2024-03-09T14:28:41.841153+0000","last_became_peered":"2024-03-09T14:28:41.841153+0000","last_unstale":"2024-03-09T15:07:43.539692+0000","last_undegraded":"2024-03-09T15:07:43.539692+0000","last_fullsized":"2024-03-09T15:07:43.539692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:43.539429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:43.539429+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.539429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:00:06.582546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'346","reported_seq":999,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.045130+0000","last_change":"2024-03-09T15:07:56.045130+0000","last_active":"2024-03-09T15:07:56.045130+0000","last_peered":"2024-03-09T15:07:56.045130+0000","last_clean":"2024-03-09T15:07:56.045130+0000","last_became_active":"2024-03-09T14:28:53.622700+0000","last_became_peered":"2024-03-09T14:28:53.622700+0000","last_unstale":"2024-03-09T15:07:56.045130+0000","last_undegraded":"2024-03-09T15:07:56.045130+0000","last_fullsized":"2024-03-09T15:07:56.045130+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-03-09T15:07:56.044829+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-03-09T15:07:56.044829+0000","last_clean_scrub_stamp":"2024-03-09T15:07:56.044829+0000","objects_scrubbed":4,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:50:12.996584+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":555,"num_read_kb":30203,"num_write":1261,"num_write_kb":35948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4],"acting":[3,5,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.914142+0000","last_change":"2024-03-09T15:07:38.914142+0000","last_active":"2024-03-09T15:07:38.914142+0000","last_peered":"2024-03-09T15:07:38.914142+0000","last_clean":"2024-03-09T15:07:38.914142+0000","last_became_active":"2024-03-09T14:28:57.606611+0000","last_became_peered":"2024-03-09T14:28:57.606611+0000","last_unstale":"2024-03-09T15:07:38.914142+0000","last_undegraded":"2024-03-09T15:07:38.914142+0000","last_fullsized":"2024-03-09T15:07:38.914142+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:38.913898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:38.913898+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.913898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:16:15.907103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'696","reported_seq":1402,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.524638+0000","last_change":"2024-03-09T15:07:26.524638+0000","last_active":"2024-03-09T15:07:26.524638+0000","last_peered":"2024-03-09T15:07:26.524638+0000","last_clean":"2024-03-09T15:07:26.524638+0000","last_became_active":"2024-03-09T14:28:59.603722+0000","last_became_peered":"2024-03-09T14:28:59.603722+0000","last_unstale":"2024-03-09T15:07:26.524638+0000","last_undegraded":"2024-03-09T15:07:26.524638+0000","last_fullsized":"2024-03-09T15:07:26.524638+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'696","last_scrub_stamp":"2024-03-09T15:07:26.524181+0000","last_deep_scrub":"264'696","last_deep_scrub_stamp":"2024-03-09T15:07:26.524181+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.524181+0000","objects_scrubbed":6,"log_size":96,"log_dups_size":600,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:03.721380+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140709,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1362,"num_read_kb":3109,"num_write":1278,"num_write_kb":1136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":99738,"num_omap_keys":240,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.762353+0000","last_change":"2024-03-09T15:07:33.762353+0000","last_active":"2024-03-09T15:07:33.762353+0000","last_peered":"2024-03-09T15:07:33.762353+0000","last_clean":"2024-03-09T15:07:33.762353+0000","last_became_active":"2024-03-09T14:29:01.647958+0000","last_became_peered":"2024-03-09T14:29:01.647958+0000","last_unstale":"2024-03-09T15:07:33.762353+0000","last_undegraded":"2024-03-09T15:07:33.762353+0000","last_fullsized":"2024-03-09T15:07:33.762353+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:33.762182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:33.762182+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.762182+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:08:56.374158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'228","reported_seq":914,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.186660+0000","last_change":"2024-03-09T15:07:43.186660+0000","last_active":"2024-03-09T15:07:43.186660+0000","last_peered":"2024-03-09T15:07:43.186660+0000","last_clean":"2024-03-09T15:07:43.186660+0000","last_became_active":"2024-03-09T14:29:03.680962+0000","last_became_peered":"2024-03-09T14:29:03.680962+0000","last_unstale":"2024-03-09T15:07:43.186660+0000","last_undegraded":"2024-03-09T15:07:43.186660+0000","last_fullsized":"2024-03-09T15:07:43.186660+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'228","last_scrub_stamp":"2024-03-09T15:07:43.186373+0000","last_deep_scrub":"264'228","last_deep_scrub_stamp":"2024-03-09T15:07:43.186373+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.186373+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:20:27.696864+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":425,"num_read_kb":422,"num_write":485,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'390","reported_seq":1957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:50.658757+0000","last_change":"2024-03-09T15:07:50.658757+0000","last_active":"2024-03-09T15:07:50.658757+0000","last_peered":"2024-03-09T15:07:50.658757+0000","last_clean":"2024-03-09T15:07:50.658757+0000","last_became_active":"2024-03-09T14:28:55.575229+0000","last_became_peered":"2024-03-09T14:28:55.575229+0000","last_unstale":"2024-03-09T15:07:50.658757+0000","last_undegraded":"2024-03-09T15:07:50.658757+0000","last_fullsized":"2024-03-09T15:07:50.658757+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'390","last_scrub_stamp":"2024-03-09T15:07:50.658464+0000","last_deep_scrub":"264'390","last_deep_scrub_stamp":"2024-03-09T15:07:50.658464+0000","last_clean_scrub_stamp":"2024-03-09T15:07:50.658464+0000","objects_scrubbed":3,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:12:48.272493+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2264,"num_read_kb":2158,"num_write":447,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:53.893111+0000","last_change":"2024-03-09T15:07:53.893170+0000","last_active":"2024-03-09T15:07:53.893111+0000","last_peered":"2024-03-09T15:07:53.893111+0000","last_clean":"2024-03-09T15:07:53.893111+0000","last_became_active":"2024-03-09T14:28:41.838669+0000","last_became_peered":"2024-03-09T14:28:41.838669+0000","last_unstale":"2024-03-09T15:07:53.893111+0000","last_undegraded":"2024-03-09T15:07:53.893111+0000","last_fullsized":"2024-03-09T15:07:53.893111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:53.892893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:53.892893+0000","last_clean_scrub_stamp":"2024-03-09T15:07:53.892893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:02:45.298652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'309","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:55.615049+0000","last_change":"2024-03-09T15:07:55.615049+0000","last_active":"2024-03-09T15:07:55.615049+0000","last_peered":"2024-03-09T15:07:55.615049+0000","last_clean":"2024-03-09T15:07:55.615049+0000","last_became_active":"2024-03-09T14:28:53.587201+0000","last_became_peered":"2024-03-09T14:28:53.587201+0000","last_unstale":"2024-03-09T15:07:55.615049+0000","last_undegraded":"2024-03-09T15:07:55.615049+0000","last_fullsized":"2024-03-09T15:07:55.615049+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'309","last_scrub_stamp":"2024-03-09T15:07:55.614703+0000","last_deep_scrub":"264'309","last_deep_scrub_stamp":"2024-03-09T15:07:55.614703+0000","last_clean_scrub_stamp":"2024-03-09T15:07:55.614703+0000","objects_scrubbed":5,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:12:03.088165+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245344,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":38281,"num_write":1125,"num_write_kb":47895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3,5],"acting":[0,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.507070+0000","last_change":"2024-03-09T15:07:39.507070+0000","last_active":"2024-03-09T15:07:39.507070+0000","last_peered":"2024-03-09T15:07:39.507070+0000","last_clean":"2024-03-09T15:07:39.507070+0000","last_became_active":"2024-03-09T14:28:57.612854+0000","last_became_peered":"2024-03-09T14:28:57.612854+0000","last_unstale":"2024-03-09T15:07:39.507070+0000","last_undegraded":"2024-03-09T15:07:39.507070+0000","last_fullsized":"2024-03-09T15:07:39.507070+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:39.506818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:39.506818+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.506818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:10:15.651737+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1083","reported_seq":2405,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.896179+0000","last_change":"2024-03-09T15:07:29.896270+0000","last_active":"2024-03-09T15:07:29.896179+0000","last_peered":"2024-03-09T15:07:29.896179+0000","last_clean":"2024-03-09T15:07:29.896179+0000","last_became_active":"2024-03-09T14:28:59.599819+0000","last_became_peered":"2024-03-09T14:28:59.599819+0000","last_unstale":"2024-03-09T15:07:29.896179+0000","last_undegraded":"2024-03-09T15:07:29.896179+0000","last_fullsized":"2024-03-09T15:07:29.896179+0000","mapping_epoch":29,"log_start":"264'1000","ondisk_log_start":"264'1000","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1083","last_scrub_stamp":"2024-03-09T15:07:29.895998+0000","last_deep_scrub":"264'1083","last_deep_scrub_stamp":"2024-03-09T15:07:29.895998+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.895998+0000","objects_scrubbed":11,"log_size":83,"log_dups_size":1000,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:45:02.942611+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":132519,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1702,"num_read_kb":3355,"num_write":1050,"num_write_kb":895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6238,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.009894+0000","last_change":"2024-03-09T15:07:34.009944+0000","last_active":"2024-03-09T15:07:34.009894+0000","last_peered":"2024-03-09T15:07:34.009894+0000","last_clean":"2024-03-09T15:07:34.009894+0000","last_became_active":"2024-03-09T14:29:01.626582+0000","last_became_peered":"2024-03-09T14:29:01.626582+0000","last_unstale":"2024-03-09T15:07:34.009894+0000","last_undegraded":"2024-03-09T15:07:34.009894+0000","last_fullsized":"2024-03-09T15:07:34.009894+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:34.009700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:34.009700+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.009700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:18:35.601769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'110","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.925928+0000","last_change":"2024-03-09T15:07:18.925928+0000","last_active":"2024-03-09T15:07:18.925928+0000","last_peered":"2024-03-09T15:07:18.925928+0000","last_clean":"2024-03-09T15:07:18.925928+0000","last_became_active":"2024-03-09T14:29:03.659633+0000","last_became_peered":"2024-03-09T14:29:03.659633+0000","last_unstale":"2024-03-09T15:07:18.925928+0000","last_undegraded":"2024-03-09T15:07:18.925928+0000","last_fullsized":"2024-03-09T15:07:18.925928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-03-09T15:07:18.925667+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-03-09T15:07:18.925667+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.925667+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:44:07.120542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":112,"num_read_kb":106,"num_write":262,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'373","reported_seq":1948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.864736+0000","last_change":"2024-03-09T15:07:26.864736+0000","last_active":"2024-03-09T15:07:26.864736+0000","last_peered":"2024-03-09T15:07:26.864736+0000","last_clean":"2024-03-09T15:07:26.864736+0000","last_became_active":"2024-03-09T14:28:55.584347+0000","last_became_peered":"2024-03-09T14:28:55.584347+0000","last_unstale":"2024-03-09T15:07:26.864736+0000","last_undegraded":"2024-03-09T15:07:26.864736+0000","last_fullsized":"2024-03-09T15:07:26.864736+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'373","last_scrub_stamp":"2024-03-09T15:07:26.864470+0000","last_deep_scrub":"264'373","last_deep_scrub_stamp":"2024-03-09T15:07:26.864470+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.864470+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:25:03.787698+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2124,"num_read_kb":2043,"num_write":421,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.462867+0000","last_change":"2024-03-09T15:07:27.462867+0000","last_active":"2024-03-09T15:07:27.462867+0000","last_peered":"2024-03-09T15:07:27.462867+0000","last_clean":"2024-03-09T15:07:27.462867+0000","last_became_active":"2024-03-09T14:28:41.836544+0000","last_became_peered":"2024-03-09T14:28:41.836544+0000","last_unstale":"2024-03-09T15:07:27.462867+0000","last_undegraded":"2024-03-09T15:07:27.462867+0000","last_fullsized":"2024-03-09T15:07:27.462867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:27.462629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:27.462629+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.462629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:59.961585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'334","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.600297+0000","last_change":"2024-03-09T15:07:43.600403+0000","last_active":"2024-03-09T15:07:43.600297+0000","last_peered":"2024-03-09T15:07:43.600297+0000","last_clean":"2024-03-09T15:07:43.600297+0000","last_became_active":"2024-03-09T14:28:53.626472+0000","last_became_peered":"2024-03-09T14:28:53.626472+0000","last_unstale":"2024-03-09T15:07:43.600297+0000","last_undegraded":"2024-03-09T15:07:43.600297+0000","last_fullsized":"2024-03-09T15:07:43.600297+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'334","last_scrub_stamp":"2024-03-09T15:07:43.600113+0000","last_deep_scrub":"264'334","last_deep_scrub_stamp":"2024-03-09T15:07:43.600113+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.600113+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:29:46.005440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262185,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":555,"num_read_kb":1460,"num_write":1312,"num_write_kb":27243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6,5],"acting":[1,2,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.547225+0000","last_change":"2024-03-09T15:07:22.547225+0000","last_active":"2024-03-09T15:07:22.547225+0000","last_peered":"2024-03-09T15:07:22.547225+0000","last_clean":"2024-03-09T15:07:22.547225+0000","last_became_active":"2024-03-09T14:28:57.609908+0000","last_became_peered":"2024-03-09T14:28:57.609908+0000","last_unstale":"2024-03-09T15:07:22.547225+0000","last_undegraded":"2024-03-09T15:07:22.547225+0000","last_fullsized":"2024-03-09T15:07:22.547225+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:22.546969+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:22.546969+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.546969+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:51:05.917154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'234","reported_seq":1237,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:00.770457+0000","last_change":"2024-03-09T15:08:00.770549+0000","last_active":"2024-03-09T15:08:00.770457+0000","last_peered":"2024-03-09T15:08:00.770457+0000","last_clean":"2024-03-09T15:08:00.770457+0000","last_became_active":"2024-03-09T14:28:59.627810+0000","last_became_peered":"2024-03-09T14:28:59.627810+0000","last_unstale":"2024-03-09T15:08:00.770457+0000","last_undegraded":"2024-03-09T15:08:00.770457+0000","last_fullsized":"2024-03-09T15:08:00.770457+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'234","last_scrub_stamp":"2024-03-09T15:08:00.770258+0000","last_deep_scrub":"264'234","last_deep_scrub_stamp":"2024-03-09T15:08:00.770258+0000","last_clean_scrub_stamp":"2024-03-09T15:08:00.770258+0000","objects_scrubbed":9,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:40:23.348807+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":165,"num_read_kb":157,"num_write":151,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5824,"num_omap_keys":14,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.745470+0000","last_change":"2024-03-09T15:07:36.745529+0000","last_active":"2024-03-09T15:07:36.745470+0000","last_peered":"2024-03-09T15:07:36.745470+0000","last_clean":"2024-03-09T15:07:36.745470+0000","last_became_active":"2024-03-09T14:29:01.647228+0000","last_became_peered":"2024-03-09T14:29:01.647228+0000","last_unstale":"2024-03-09T15:07:36.745470+0000","last_undegraded":"2024-03-09T15:07:36.745470+0000","last_fullsized":"2024-03-09T15:07:36.745470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:36.745263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:36.745263+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.745263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:08:58.138619+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'252","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.987315+0000","last_change":"2024-03-09T15:07:28.987395+0000","last_active":"2024-03-09T15:07:28.987315+0000","last_peered":"2024-03-09T15:07:28.987315+0000","last_clean":"2024-03-09T15:07:28.987315+0000","last_became_active":"2024-03-09T14:29:03.654872+0000","last_became_peered":"2024-03-09T14:29:03.654872+0000","last_unstale":"2024-03-09T15:07:28.987315+0000","last_undegraded":"2024-03-09T15:07:28.987315+0000","last_fullsized":"2024-03-09T15:07:28.987315+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'252","last_scrub_stamp":"2024-03-09T15:07:28.987137+0000","last_deep_scrub":"264'252","last_deep_scrub_stamp":"2024-03-09T15:07:28.987137+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.987137+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:25:09.761733+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":497,"num_write":533,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":851,"num_omap_keys":5,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'465","reported_seq":2026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.830096+0000","last_change":"2024-03-09T15:07:34.830096+0000","last_active":"2024-03-09T15:07:34.830096+0000","last_peered":"2024-03-09T15:07:34.830096+0000","last_clean":"2024-03-09T15:07:34.830096+0000","last_became_active":"2024-03-09T14:28:55.577946+0000","last_became_peered":"2024-03-09T14:28:55.577946+0000","last_unstale":"2024-03-09T15:07:34.830096+0000","last_undegraded":"2024-03-09T15:07:34.830096+0000","last_fullsized":"2024-03-09T15:07:34.830096+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'465","last_scrub_stamp":"2024-03-09T15:07:34.829644+0000","last_deep_scrub":"264'465","last_deep_scrub_stamp":"2024-03-09T15:07:34.829644+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.829644+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:22:52.836038+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2440,"num_read_kb":2271,"num_write":585,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.510661+0000","last_change":"2024-03-09T15:07:44.510661+0000","last_active":"2024-03-09T15:07:44.510661+0000","last_peered":"2024-03-09T15:07:44.510661+0000","last_clean":"2024-03-09T15:07:44.510661+0000","last_became_active":"2024-03-09T14:28:41.842251+0000","last_became_peered":"2024-03-09T14:28:41.842251+0000","last_unstale":"2024-03-09T15:07:44.510661+0000","last_undegraded":"2024-03-09T15:07:44.510661+0000","last_fullsized":"2024-03-09T15:07:44.510661+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:44.510412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:44.510412+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.510412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:26:13.565490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'329","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.875059+0000","last_change":"2024-03-09T15:07:46.875059+0000","last_active":"2024-03-09T15:07:46.875059+0000","last_peered":"2024-03-09T15:07:46.875059+0000","last_clean":"2024-03-09T15:07:46.875059+0000","last_became_active":"2024-03-09T14:28:53.621914+0000","last_became_peered":"2024-03-09T14:28:53.621914+0000","last_unstale":"2024-03-09T15:07:46.875059+0000","last_undegraded":"2024-03-09T15:07:46.875059+0000","last_fullsized":"2024-03-09T15:07:46.875059+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-03-09T15:07:46.874650+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-03-09T15:07:46.874650+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.874650+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:45:33.688916+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1292088,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":536,"num_read_kb":22951,"num_write":1137,"num_write_kb":34708,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,6],"acting":[4,5,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.767830+0000","last_change":"2024-03-09T15:07:43.767890+0000","last_active":"2024-03-09T15:07:43.767830+0000","last_peered":"2024-03-09T15:07:43.767830+0000","last_clean":"2024-03-09T15:07:43.767830+0000","last_became_active":"2024-03-09T14:28:57.613407+0000","last_became_peered":"2024-03-09T14:28:57.613407+0000","last_unstale":"2024-03-09T15:07:43.767830+0000","last_undegraded":"2024-03-09T15:07:43.767830+0000","last_fullsized":"2024-03-09T15:07:43.767830+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:43.767632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:43.767632+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.767632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:27:41.541733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'117","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.986728+0000","last_change":"2024-03-09T15:07:39.986728+0000","last_active":"2024-03-09T15:07:39.986728+0000","last_peered":"2024-03-09T15:07:39.986728+0000","last_clean":"2024-03-09T15:07:39.986728+0000","last_became_active":"2024-03-09T14:28:59.619291+0000","last_became_peered":"2024-03-09T14:28:59.619291+0000","last_unstale":"2024-03-09T15:07:39.986728+0000","last_undegraded":"2024-03-09T15:07:39.986728+0000","last_fullsized":"2024-03-09T15:07:39.986728+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-03-09T15:07:39.986428+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-03-09T15:07:39.986428+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.986428+0000","objects_scrubbed":7,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:04:35.155185+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":116,"num_read_kb":110,"num_write":80,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1510,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.267550+0000","last_change":"2024-03-09T15:07:29.267550+0000","last_active":"2024-03-09T15:07:29.267550+0000","last_peered":"2024-03-09T15:07:29.267550+0000","last_clean":"2024-03-09T15:07:29.267550+0000","last_became_active":"2024-03-09T14:29:01.656672+0000","last_became_peered":"2024-03-09T14:29:01.656672+0000","last_unstale":"2024-03-09T15:07:29.267550+0000","last_undegraded":"2024-03-09T15:07:29.267550+0000","last_fullsized":"2024-03-09T15:07:29.267550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:29.267314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:29.267314+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.267314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:32:52.363075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'104","reported_seq":615,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:16.524946+0000","last_change":"2024-03-09T15:07:16.524946+0000","last_active":"2024-03-09T15:07:16.524946+0000","last_peered":"2024-03-09T15:07:16.524946+0000","last_clean":"2024-03-09T15:07:16.524946+0000","last_became_active":"2024-03-09T14:29:03.672534+0000","last_became_peered":"2024-03-09T14:29:03.672534+0000","last_unstale":"2024-03-09T15:07:16.524946+0000","last_undegraded":"2024-03-09T15:07:16.524946+0000","last_fullsized":"2024-03-09T15:07:16.524946+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'104","last_scrub_stamp":"2024-03-09T15:07:16.524692+0000","last_deep_scrub":"264'104","last_deep_scrub_stamp":"2024-03-09T15:07:16.524692+0000","last_clean_scrub_stamp":"2024-03-09T15:07:16.524692+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:15:41.281947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":109,"num_write":236,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'464","reported_seq":2142,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.862841+0000","last_change":"2024-03-09T15:07:28.862841+0000","last_active":"2024-03-09T15:07:28.862841+0000","last_peered":"2024-03-09T15:07:28.862841+0000","last_clean":"2024-03-09T15:07:28.862841+0000","last_became_active":"2024-03-09T14:28:55.583536+0000","last_became_peered":"2024-03-09T14:28:55.583536+0000","last_unstale":"2024-03-09T15:07:28.862841+0000","last_undegraded":"2024-03-09T15:07:28.862841+0000","last_fullsized":"2024-03-09T15:07:28.862841+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'464","last_scrub_stamp":"2024-03-09T15:07:28.862584+0000","last_deep_scrub":"264'464","last_deep_scrub_stamp":"2024-03-09T15:07:28.862584+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.862584+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:42:09.282270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2714,"num_read_kb":2554,"num_write":561,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'357","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.539456+0000","last_change":"2024-03-09T15:07:42.539682+0000","last_active":"2024-03-09T15:07:42.539456+0000","last_peered":"2024-03-09T15:07:42.539456+0000","last_clean":"2024-03-09T15:07:42.539456+0000","last_became_active":"2024-03-09T14:28:53.626879+0000","last_became_peered":"2024-03-09T14:28:53.626879+0000","last_unstale":"2024-03-09T15:07:42.539456+0000","last_undegraded":"2024-03-09T15:07:42.539456+0000","last_fullsized":"2024-03-09T15:07:42.539456+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-03-09T15:07:42.539208+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-03-09T15:07:42.539208+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.539208+0000","objects_scrubbed":7,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:40:01.889170+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8554715,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":520,"num_read_kb":4755,"num_write":1359,"num_write_kb":47511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":527,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.748027+0000","last_change":"2024-03-09T15:07:38.748027+0000","last_active":"2024-03-09T15:07:38.748027+0000","last_peered":"2024-03-09T15:07:38.748027+0000","last_clean":"2024-03-09T15:07:38.748027+0000","last_became_active":"2024-03-09T14:28:42.126799+0000","last_became_peered":"2024-03-09T14:28:42.126799+0000","last_unstale":"2024-03-09T15:07:38.748027+0000","last_undegraded":"2024-03-09T15:07:38.748027+0000","last_fullsized":"2024-03-09T15:07:38.748027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:38.747638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:38.747638+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.747638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:02:07.045997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.756100+0000","last_change":"2024-03-09T15:07:39.756100+0000","last_active":"2024-03-09T15:07:39.756100+0000","last_peered":"2024-03-09T15:07:39.756100+0000","last_clean":"2024-03-09T15:07:39.756100+0000","last_became_active":"2024-03-09T14:28:57.608723+0000","last_became_peered":"2024-03-09T14:28:57.608723+0000","last_unstale":"2024-03-09T15:07:39.756100+0000","last_undegraded":"2024-03-09T15:07:39.756100+0000","last_fullsized":"2024-03-09T15:07:39.756100+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:39.755832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:39.755832+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.755832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:20:01.073720+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'540","reported_seq":1198,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.649192+0000","last_change":"2024-03-09T15:07:51.649288+0000","last_active":"2024-03-09T15:07:51.649192+0000","last_peered":"2024-03-09T15:07:51.649192+0000","last_clean":"2024-03-09T15:07:51.649192+0000","last_became_active":"2024-03-09T14:28:59.624680+0000","last_became_peered":"2024-03-09T14:28:59.624680+0000","last_unstale":"2024-03-09T15:07:51.649192+0000","last_undegraded":"2024-03-09T15:07:51.649192+0000","last_fullsized":"2024-03-09T15:07:51.649192+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'540","last_scrub_stamp":"2024-03-09T15:07:51.649006+0000","last_deep_scrub":"264'540","last_deep_scrub_stamp":"2024-03-09T15:07:51.649006+0000","last_clean_scrub_stamp":"2024-03-09T15:07:51.649006+0000","objects_scrubbed":10,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:14:56.811972+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":87910,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":952,"num_read_kb":2224,"num_write":784,"num_write_kb":634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2284,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.713529+0000","last_change":"2024-03-09T15:07:21.713581+0000","last_active":"2024-03-09T15:07:21.713529+0000","last_peered":"2024-03-09T15:07:21.713529+0000","last_clean":"2024-03-09T15:07:21.713529+0000","last_became_active":"2024-03-09T14:29:01.640485+0000","last_became_peered":"2024-03-09T14:29:01.640485+0000","last_unstale":"2024-03-09T15:07:21.713529+0000","last_undegraded":"2024-03-09T15:07:21.713529+0000","last_fullsized":"2024-03-09T15:07:21.713529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:21.713332+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:21.713332+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.713332+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:28:08.038103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'144","reported_seq":661,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.644986+0000","last_change":"2024-03-09T15:07:25.645062+0000","last_active":"2024-03-09T15:07:25.644986+0000","last_peered":"2024-03-09T15:07:25.644986+0000","last_clean":"2024-03-09T15:07:25.644986+0000","last_became_active":"2024-03-09T14:29:03.676032+0000","last_became_peered":"2024-03-09T14:29:03.676032+0000","last_unstale":"2024-03-09T15:07:25.644986+0000","last_undegraded":"2024-03-09T15:07:25.644986+0000","last_fullsized":"2024-03-09T15:07:25.644986+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'144","last_scrub_stamp":"2024-03-09T15:07:25.644805+0000","last_deep_scrub":"264'144","last_deep_scrub_stamp":"2024-03-09T15:07:25.644805+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.644805+0000","objects_scrubbed":3,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:47:18.054345+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":884,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":195,"num_read_kb":176,"num_write":349,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'353","reported_seq":1755,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.636572+0000","last_change":"2024-03-09T15:07:48.636572+0000","last_active":"2024-03-09T15:07:48.636572+0000","last_peered":"2024-03-09T15:07:48.636572+0000","last_clean":"2024-03-09T15:07:48.636572+0000","last_became_active":"2024-03-09T14:28:55.582743+0000","last_became_peered":"2024-03-09T14:28:55.582743+0000","last_unstale":"2024-03-09T15:07:48.636572+0000","last_undegraded":"2024-03-09T15:07:48.636572+0000","last_fullsized":"2024-03-09T15:07:48.636572+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'353","last_scrub_stamp":"2024-03-09T15:07:48.636186+0000","last_deep_scrub":"264'353","last_deep_scrub_stamp":"2024-03-09T15:07:48.636186+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.636186+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:25:47.111839+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1869,"num_read_kb":1781,"num_write":409,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'326","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.709441+0000","last_change":"2024-03-09T15:07:40.709441+0000","last_active":"2024-03-09T15:07:40.709441+0000","last_peered":"2024-03-09T15:07:40.709441+0000","last_clean":"2024-03-09T15:07:40.709441+0000","last_became_active":"2024-03-09T14:28:53.589640+0000","last_became_peered":"2024-03-09T14:28:53.589640+0000","last_unstale":"2024-03-09T15:07:40.709441+0000","last_undegraded":"2024-03-09T15:07:40.709441+0000","last_fullsized":"2024-03-09T15:07:40.709441+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-03-09T15:07:40.708947+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-03-09T15:07:40.708947+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.708947+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:34:22.140344+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048928,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":38844,"num_write":1128,"num_write_kb":48736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,5],"acting":[1,2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":522,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:54.848806+0000","last_change":"2024-03-09T15:07:54.848806+0000","last_active":"2024-03-09T15:07:54.848806+0000","last_peered":"2024-03-09T15:07:54.848806+0000","last_clean":"2024-03-09T15:07:54.848806+0000","last_became_active":"2024-03-09T14:28:42.126201+0000","last_became_peered":"2024-03-09T14:28:42.126201+0000","last_unstale":"2024-03-09T15:07:54.848806+0000","last_undegraded":"2024-03-09T15:07:54.848806+0000","last_fullsized":"2024-03-09T15:07:54.848806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:54.848570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:54.848570+0000","last_clean_scrub_stamp":"2024-03-09T15:07:54.848570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:22:43.845947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.254156+0000","last_change":"2024-03-09T15:07:24.254156+0000","last_active":"2024-03-09T15:07:24.254156+0000","last_peered":"2024-03-09T15:07:24.254156+0000","last_clean":"2024-03-09T15:07:24.254156+0000","last_became_active":"2024-03-09T14:28:57.606429+0000","last_became_peered":"2024-03-09T14:28:57.606429+0000","last_unstale":"2024-03-09T15:07:24.254156+0000","last_undegraded":"2024-03-09T15:07:24.254156+0000","last_fullsized":"2024-03-09T15:07:24.254156+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:24.253912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:24.253912+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.253912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:22:22.015872+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'182","reported_seq":744,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:33.874432+0000","last_change":"2024-03-09T15:07:33.874519+0000","last_active":"2024-03-09T15:07:33.874432+0000","last_peered":"2024-03-09T15:07:33.874432+0000","last_clean":"2024-03-09T15:07:33.874432+0000","last_became_active":"2024-03-09T14:28:59.626697+0000","last_became_peered":"2024-03-09T14:28:59.626697+0000","last_unstale":"2024-03-09T15:07:33.874432+0000","last_undegraded":"2024-03-09T15:07:33.874432+0000","last_fullsized":"2024-03-09T15:07:33.874432+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'182","last_scrub_stamp":"2024-03-09T15:07:33.874235+0000","last_deep_scrub":"264'182","last_deep_scrub_stamp":"2024-03-09T15:07:33.874235+0000","last_clean_scrub_stamp":"2024-03-09T15:07:33.874235+0000","objects_scrubbed":8,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:05:53.317316+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":207,"num_read_kb":198,"num_write":186,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5650,"num_omap_keys":14,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'565","reported_seq":2150,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.440280+0000","last_change":"2024-03-09T15:07:22.440344+0000","last_active":"2024-03-09T15:07:22.440280+0000","last_peered":"2024-03-09T15:07:22.440280+0000","last_clean":"2024-03-09T15:07:22.440280+0000","last_became_active":"2024-03-09T14:29:01.636912+0000","last_became_peered":"2024-03-09T14:29:01.636912+0000","last_unstale":"2024-03-09T15:07:22.440280+0000","last_undegraded":"2024-03-09T15:07:22.440280+0000","last_fullsized":"2024-03-09T15:07:22.440280+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'565","last_scrub_stamp":"2024-03-09T15:07:22.440085+0000","last_deep_scrub":"264'565","last_deep_scrub_stamp":"2024-03-09T15:07:22.440085+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.440085+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:53.676606+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'97","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.003413+0000","last_change":"2024-03-09T15:07:25.003480+0000","last_active":"2024-03-09T15:07:25.003413+0000","last_peered":"2024-03-09T15:07:25.003413+0000","last_clean":"2024-03-09T15:07:25.003413+0000","last_became_active":"2024-03-09T14:29:03.664665+0000","last_became_peered":"2024-03-09T14:29:03.664665+0000","last_unstale":"2024-03-09T15:07:25.003413+0000","last_undegraded":"2024-03-09T15:07:25.003413+0000","last_fullsized":"2024-03-09T15:07:25.003413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-03-09T15:07:25.003215+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-03-09T15:07:25.003215+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.003215+0000","objects_scrubbed":2,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:36:56.787006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":223,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'346","reported_seq":1837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:50.998894+0000","last_change":"2024-03-09T15:07:50.998986+0000","last_active":"2024-03-09T15:07:50.998894+0000","last_peered":"2024-03-09T15:07:50.998894+0000","last_clean":"2024-03-09T15:07:50.998894+0000","last_became_active":"2024-03-09T14:28:55.601355+0000","last_became_peered":"2024-03-09T14:28:55.601355+0000","last_unstale":"2024-03-09T15:07:50.998894+0000","last_undegraded":"2024-03-09T15:07:50.998894+0000","last_fullsized":"2024-03-09T15:07:50.998894+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'346","last_scrub_stamp":"2024-03-09T15:07:50.998673+0000","last_deep_scrub":"264'346","last_deep_scrub_stamp":"2024-03-09T15:07:50.998673+0000","last_clean_scrub_stamp":"2024-03-09T15:07:50.998673+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":300,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:51:30.315116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1977,"num_read_kb":1906,"num_write":384,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":252,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'330","reported_seq":994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:07.078754+0000","last_change":"2024-03-09T15:08:07.078853+0000","last_active":"2024-03-09T15:08:07.078754+0000","last_peered":"2024-03-09T15:08:07.078754+0000","last_clean":"2024-03-09T15:08:07.078754+0000","last_became_active":"2024-03-09T14:28:53.584728+0000","last_became_peered":"2024-03-09T14:28:53.584728+0000","last_unstale":"2024-03-09T15:08:07.078754+0000","last_undegraded":"2024-03-09T15:08:07.078754+0000","last_fullsized":"2024-03-09T15:08:07.078754+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'330","last_scrub_stamp":"2024-03-09T15:08:07.078538+0000","last_deep_scrub":"264'330","last_deep_scrub_stamp":"2024-03-09T15:08:07.078538+0000","last_clean_scrub_stamp":"2024-03-09T15:08:07.078538+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:46:03.610099+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918035,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":514,"num_read_kb":33595,"num_write":1176,"num_write_kb":22083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,0],"acting":[3,5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":526,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.796384+0000","last_change":"2024-03-09T15:07:37.796384+0000","last_active":"2024-03-09T15:07:37.796384+0000","last_peered":"2024-03-09T15:07:37.796384+0000","last_clean":"2024-03-09T15:07:37.796384+0000","last_became_active":"2024-03-09T14:28:41.840168+0000","last_became_peered":"2024-03-09T14:28:41.840168+0000","last_unstale":"2024-03-09T15:07:37.796384+0000","last_undegraded":"2024-03-09T15:07:37.796384+0000","last_fullsized":"2024-03-09T15:07:37.796384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:37.796028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:37.796028+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.796028+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:41:01.164969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"264'6","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.810597+0000","last_change":"2024-03-09T15:07:40.810597+0000","last_active":"2024-03-09T15:07:40.810597+0000","last_peered":"2024-03-09T15:07:40.810597+0000","last_clean":"2024-03-09T15:07:40.810597+0000","last_became_active":"2024-03-09T14:28:57.610373+0000","last_became_peered":"2024-03-09T14:28:57.610373+0000","last_unstale":"2024-03-09T15:07:40.810597+0000","last_undegraded":"2024-03-09T15:07:40.810597+0000","last_fullsized":"2024-03-09T15:07:40.810597+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-03-09T15:07:40.810347+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-03-09T15:07:40.810347+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.810347+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:42:20.739928+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1103,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":492,"num_read_kb":799,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'107","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.768414+0000","last_change":"2024-03-09T15:07:25.768414+0000","last_active":"2024-03-09T15:07:25.768414+0000","last_peered":"2024-03-09T15:07:25.768414+0000","last_clean":"2024-03-09T15:07:25.768414+0000","last_became_active":"2024-03-09T14:28:59.615084+0000","last_became_peered":"2024-03-09T14:28:59.615084+0000","last_unstale":"2024-03-09T15:07:25.768414+0000","last_undegraded":"2024-03-09T15:07:25.768414+0000","last_fullsized":"2024-03-09T15:07:25.768414+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-03-09T15:07:25.767984+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-03-09T15:07:25.767984+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.767984+0000","objects_scrubbed":5,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:01:01.855185+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":100,"num_write":74,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'584","reported_seq":2184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.955536+0000","last_change":"2024-03-09T15:07:31.955639+0000","last_active":"2024-03-09T15:07:31.955536+0000","last_peered":"2024-03-09T15:07:31.955536+0000","last_clean":"2024-03-09T15:07:31.955536+0000","last_became_active":"2024-03-09T14:29:01.630598+0000","last_became_peered":"2024-03-09T14:29:01.630598+0000","last_unstale":"2024-03-09T15:07:31.955536+0000","last_undegraded":"2024-03-09T15:07:31.955536+0000","last_fullsized":"2024-03-09T15:07:31.955536+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'584","last_scrub_stamp":"2024-03-09T15:07:31.955337+0000","last_deep_scrub":"264'584","last_deep_scrub_stamp":"2024-03-09T15:07:31.955337+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.955337+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":500,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:21.545376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'232","reported_seq":734,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.646284+0000","last_change":"2024-03-09T15:07:21.646416+0000","last_active":"2024-03-09T15:07:21.646284+0000","last_peered":"2024-03-09T15:07:21.646284+0000","last_clean":"2024-03-09T15:07:21.646284+0000","last_became_active":"2024-03-09T14:29:03.684294+0000","last_became_peered":"2024-03-09T14:29:03.684294+0000","last_unstale":"2024-03-09T15:07:21.646284+0000","last_undegraded":"2024-03-09T15:07:21.646284+0000","last_fullsized":"2024-03-09T15:07:21.646284+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'232","last_scrub_stamp":"2024-03-09T15:07:21.646037+0000","last_deep_scrub":"264'232","last_deep_scrub_stamp":"2024-03-09T15:07:21.646037+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.646037+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:59:01.441895+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":201,"num_read_kb":199,"num_write":480,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":178,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'366","reported_seq":2045,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:50.906260+0000","last_change":"2024-03-09T15:07:50.906260+0000","last_active":"2024-03-09T15:07:50.906260+0000","last_peered":"2024-03-09T15:07:50.906260+0000","last_clean":"2024-03-09T15:07:50.906260+0000","last_became_active":"2024-03-09T14:28:55.568430+0000","last_became_peered":"2024-03-09T14:28:55.568430+0000","last_unstale":"2024-03-09T15:07:50.906260+0000","last_undegraded":"2024-03-09T15:07:50.906260+0000","last_fullsized":"2024-03-09T15:07:50.906260+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-03-09T15:07:50.906016+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-03-09T15:07:50.906016+0000","last_clean_scrub_stamp":"2024-03-09T15:07:50.906016+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:45:08.495295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2357,"num_read_kb":2282,"num_write":412,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'367","reported_seq":1004,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:57.582970+0000","last_change":"2024-03-09T15:07:57.583185+0000","last_active":"2024-03-09T15:07:57.582970+0000","last_peered":"2024-03-09T15:07:57.582970+0000","last_clean":"2024-03-09T15:07:57.582970+0000","last_became_active":"2024-03-09T14:28:53.589491+0000","last_became_peered":"2024-03-09T14:28:53.589491+0000","last_unstale":"2024-03-09T15:07:57.582970+0000","last_undegraded":"2024-03-09T15:07:57.582970+0000","last_fullsized":"2024-03-09T15:07:57.582970+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'367","last_scrub_stamp":"2024-03-09T15:07:57.582644+0000","last_deep_scrub":"264'367","last_deep_scrub_stamp":"2024-03-09T15:07:57.582644+0000","last_clean_scrub_stamp":"2024-03-09T15:07:57.582644+0000","objects_scrubbed":10,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:15:25.926084+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12403936,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":473,"num_read_kb":37359,"num_write":1237,"num_write_kb":47489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.219447+0000","last_change":"2024-03-09T15:07:35.219447+0000","last_active":"2024-03-09T15:07:35.219447+0000","last_peered":"2024-03-09T15:07:35.219447+0000","last_clean":"2024-03-09T15:07:35.219447+0000","last_became_active":"2024-03-09T14:28:41.840575+0000","last_became_peered":"2024-03-09T14:28:41.840575+0000","last_unstale":"2024-03-09T15:07:35.219447+0000","last_undegraded":"2024-03-09T15:07:35.219447+0000","last_fullsized":"2024-03-09T15:07:35.219447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.219124+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.219124+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.219124+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:52.826920+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"264'4","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:53.027415+0000","last_change":"2024-03-09T15:07:53.027479+0000","last_active":"2024-03-09T15:07:53.027415+0000","last_peered":"2024-03-09T15:07:53.027415+0000","last_clean":"2024-03-09T15:07:53.027415+0000","last_became_active":"2024-03-09T14:28:57.604511+0000","last_became_peered":"2024-03-09T14:28:57.604511+0000","last_unstale":"2024-03-09T15:07:53.027415+0000","last_undegraded":"2024-03-09T15:07:53.027415+0000","last_fullsized":"2024-03-09T15:07:53.027415+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-03-09T15:07:53.027214+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-03-09T15:07:53.027214+0000","last_clean_scrub_stamp":"2024-03-09T15:07:53.027214+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:48:31.538028+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":490,"num_read_kb":488,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'690","reported_seq":1408,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.989973+0000","last_change":"2024-03-09T15:07:35.989973+0000","last_active":"2024-03-09T15:07:35.989973+0000","last_peered":"2024-03-09T15:07:35.989973+0000","last_clean":"2024-03-09T15:07:35.989973+0000","last_became_active":"2024-03-09T14:28:59.630044+0000","last_became_peered":"2024-03-09T14:28:59.630044+0000","last_unstale":"2024-03-09T15:07:35.989973+0000","last_undegraded":"2024-03-09T15:07:35.989973+0000","last_fullsized":"2024-03-09T15:07:35.989973+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'690","last_scrub_stamp":"2024-03-09T15:07:35.989694+0000","last_deep_scrub":"264'690","last_deep_scrub_stamp":"2024-03-09T15:07:35.989694+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.989694+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:09:36.304072+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":140779,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1221,"num_read_kb":2881,"num_write":988,"num_write_kb":822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.943368+0000","last_change":"2024-03-09T15:07:29.943408+0000","last_active":"2024-03-09T15:07:29.943368+0000","last_peered":"2024-03-09T15:07:29.943368+0000","last_clean":"2024-03-09T15:07:29.943368+0000","last_became_active":"2024-03-09T14:29:01.638590+0000","last_became_peered":"2024-03-09T14:29:01.638590+0000","last_unstale":"2024-03-09T15:07:29.943368+0000","last_undegraded":"2024-03-09T15:07:29.943368+0000","last_fullsized":"2024-03-09T15:07:29.943368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:29.943233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:29.943233+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.943233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:11:27.603634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'124","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:18.492955+0000","last_change":"2024-03-09T15:07:18.492955+0000","last_active":"2024-03-09T15:07:18.492955+0000","last_peered":"2024-03-09T15:07:18.492955+0000","last_clean":"2024-03-09T15:07:18.492955+0000","last_became_active":"2024-03-09T14:29:03.671138+0000","last_became_peered":"2024-03-09T14:29:03.671138+0000","last_unstale":"2024-03-09T15:07:18.492955+0000","last_undegraded":"2024-03-09T15:07:18.492955+0000","last_fullsized":"2024-03-09T15:07:18.492955+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:18.492696+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:18.492696+0000","last_clean_scrub_stamp":"2024-03-09T15:07:18.492696+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:37:49.039401+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":139,"num_read_kb":130,"num_write":309,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'134","reported_seq":690,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.600532+0000","last_change":"2024-03-09T15:07:22.600598+0000","last_active":"2024-03-09T15:07:22.600532+0000","last_peered":"2024-03-09T15:07:22.600532+0000","last_clean":"2024-03-09T15:07:22.600532+0000","last_became_active":"2024-03-09T14:29:03.681920+0000","last_became_peered":"2024-03-09T14:29:03.681920+0000","last_unstale":"2024-03-09T15:07:22.600532+0000","last_undegraded":"2024-03-09T15:07:22.600532+0000","last_fullsized":"2024-03-09T15:07:22.600532+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'134","last_scrub_stamp":"2024-03-09T15:07:22.600362+0000","last_deep_scrub":"264'134","last_deep_scrub_stamp":"2024-03-09T15:07:22.600362+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.600362+0000","objects_scrubbed":2,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:36:58.000733+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":232,"num_read_kb":222,"num_write":331,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'715","reported_seq":2222,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.739283+0000","last_change":"2024-03-09T15:07:31.739283+0000","last_active":"2024-03-09T15:07:31.739283+0000","last_peered":"2024-03-09T15:07:31.739283+0000","last_clean":"2024-03-09T15:07:31.739283+0000","last_became_active":"2024-03-09T14:28:55.589278+0000","last_became_peered":"2024-03-09T14:28:55.589278+0000","last_unstale":"2024-03-09T15:07:31.739283+0000","last_undegraded":"2024-03-09T15:07:31.739283+0000","last_fullsized":"2024-03-09T15:07:31.739283+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'715","last_scrub_stamp":"2024-03-09T15:07:31.738969+0000","last_deep_scrub":"264'715","last_deep_scrub_stamp":"2024-03-09T15:07:31.738969+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.738969+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":700,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:05:13.359109+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3302,"num_read_kb":2973,"num_write":944,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'315","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.895274+0000","last_change":"2024-03-09T15:07:47.895374+0000","last_active":"2024-03-09T15:07:47.895274+0000","last_peered":"2024-03-09T15:07:47.895274+0000","last_clean":"2024-03-09T15:07:47.895274+0000","last_became_active":"2024-03-09T14:28:53.624231+0000","last_became_peered":"2024-03-09T14:28:53.624231+0000","last_unstale":"2024-03-09T15:07:47.895274+0000","last_undegraded":"2024-03-09T15:07:47.895274+0000","last_fullsized":"2024-03-09T15:07:47.895274+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'315","last_scrub_stamp":"2024-03-09T15:07:47.895072+0000","last_deep_scrub":"264'315","last_deep_scrub_stamp":"2024-03-09T15:07:47.895072+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.895072+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:09:38.205079+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":535,"num_read_kb":58598,"num_write":1161,"num_write_kb":63743,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.820780+0000","last_change":"2024-03-09T15:07:25.820832+0000","last_active":"2024-03-09T15:07:25.820780+0000","last_peered":"2024-03-09T15:07:25.820780+0000","last_clean":"2024-03-09T15:07:25.820780+0000","last_became_active":"2024-03-09T14:28:57.616045+0000","last_became_peered":"2024-03-09T14:28:57.616045+0000","last_unstale":"2024-03-09T15:07:25.820780+0000","last_undegraded":"2024-03-09T15:07:25.820780+0000","last_fullsized":"2024-03-09T15:07:25.820780+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:25.820588+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:25.820588+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.820588+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:45:34.309358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'257","reported_seq":828,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:43.979858+0000","last_change":"2024-03-09T15:07:43.979942+0000","last_active":"2024-03-09T15:07:43.979858+0000","last_peered":"2024-03-09T15:07:43.979858+0000","last_clean":"2024-03-09T15:07:43.979858+0000","last_became_active":"2024-03-09T14:28:59.615265+0000","last_became_peered":"2024-03-09T14:28:59.615265+0000","last_unstale":"2024-03-09T15:07:43.979858+0000","last_undegraded":"2024-03-09T15:07:43.979858+0000","last_fullsized":"2024-03-09T15:07:43.979858+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-03-09T15:07:43.979641+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-03-09T15:07:43.979641+0000","last_clean_scrub_stamp":"2024-03-09T15:07:43.979641+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:01:35.067889+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41654,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":398,"num_read_kb":895,"num_write":318,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.921590+0000","last_change":"2024-03-09T15:07:32.921646+0000","last_active":"2024-03-09T15:07:32.921590+0000","last_peered":"2024-03-09T15:07:32.921590+0000","last_clean":"2024-03-09T15:07:32.921590+0000","last_became_active":"2024-03-09T14:29:01.630021+0000","last_became_peered":"2024-03-09T14:29:01.630021+0000","last_unstale":"2024-03-09T15:07:32.921590+0000","last_undegraded":"2024-03-09T15:07:32.921590+0000","last_fullsized":"2024-03-09T15:07:32.921590+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:32.921402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:32.921402+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.921402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:00:33.388771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'124","reported_seq":618,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.936675+0000","last_change":"2024-03-09T15:07:27.936739+0000","last_active":"2024-03-09T15:07:27.936675+0000","last_peered":"2024-03-09T15:07:27.936675+0000","last_clean":"2024-03-09T15:07:27.936675+0000","last_became_active":"2024-03-09T14:29:03.660356+0000","last_became_peered":"2024-03-09T14:29:03.660356+0000","last_unstale":"2024-03-09T15:07:27.936675+0000","last_undegraded":"2024-03-09T15:07:27.936675+0000","last_fullsized":"2024-03-09T15:07:27.936675+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:27.936481+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:27.936481+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.936481+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:22:37.729626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":108,"num_read_kb":106,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'836","reported_seq":2453,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.874067+0000","last_change":"2024-03-09T15:07:22.874136+0000","last_active":"2024-03-09T15:07:22.874067+0000","last_peered":"2024-03-09T15:07:22.874067+0000","last_clean":"2024-03-09T15:07:22.874067+0000","last_became_active":"2024-03-09T14:28:55.591498+0000","last_became_peered":"2024-03-09T14:28:55.591498+0000","last_unstale":"2024-03-09T15:07:22.874067+0000","last_undegraded":"2024-03-09T15:07:22.874067+0000","last_fullsized":"2024-03-09T15:07:22.874067+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'836","last_scrub_stamp":"2024-03-09T15:07:22.873855+0000","last_deep_scrub":"264'836","last_deep_scrub_stamp":"2024-03-09T15:07:22.873855+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.873855+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":800,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:25:50.937533+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3847,"num_read_kb":3445,"num_write":1140,"num_write_kb":461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'322","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:13.766359+0000","last_change":"2024-03-09T15:07:13.766359+0000","last_active":"2024-03-09T15:07:13.766359+0000","last_peered":"2024-03-09T15:07:13.766359+0000","last_clean":"2024-03-09T15:07:13.766359+0000","last_became_active":"2024-03-09T14:29:28.729906+0000","last_became_peered":"2024-03-09T14:29:28.729906+0000","last_unstale":"2024-03-09T15:07:13.766359+0000","last_undegraded":"2024-03-09T15:07:13.766359+0000","last_fullsized":"2024-03-09T15:07:13.766359+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'322","last_scrub_stamp":"2024-03-09T15:07:13.766011+0000","last_deep_scrub":"264'322","last_deep_scrub_stamp":"2024-03-09T15:07:13.766011+0000","last_clean_scrub_stamp":"2024-03-09T15:07:13.766011+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:23:54.155006+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":487,"num_read_kb":3449,"num_write":1268,"num_write_kb":20441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,4],"acting":[2,3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:57.026873+0000","last_change":"2024-03-09T15:07:57.026956+0000","last_active":"2024-03-09T15:07:57.026873+0000","last_peered":"2024-03-09T15:07:57.026873+0000","last_clean":"2024-03-09T15:07:57.026873+0000","last_became_active":"2024-03-09T14:28:57.608697+0000","last_became_peered":"2024-03-09T14:28:57.608697+0000","last_unstale":"2024-03-09T15:07:57.026873+0000","last_undegraded":"2024-03-09T15:07:57.026873+0000","last_fullsized":"2024-03-09T15:07:57.026873+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:57.026649+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:57.026649+0000","last_clean_scrub_stamp":"2024-03-09T15:07:57.026649+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:39:02.544082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'51","reported_seq":553,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.701194+0000","last_change":"2024-03-09T15:07:45.701288+0000","last_active":"2024-03-09T15:07:45.701194+0000","last_peered":"2024-03-09T15:07:45.701194+0000","last_clean":"2024-03-09T15:07:45.701194+0000","last_became_active":"2024-03-09T14:28:59.620907+0000","last_became_peered":"2024-03-09T14:28:59.620907+0000","last_unstale":"2024-03-09T15:07:45.701194+0000","last_undegraded":"2024-03-09T15:07:45.701194+0000","last_fullsized":"2024-03-09T15:07:45.701194+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'51","last_scrub_stamp":"2024-03-09T15:07:45.700978+0000","last_deep_scrub":"264'51","last_deep_scrub_stamp":"2024-03-09T15:07:45.700978+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.700978+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:34:33.303483+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.979609+0000","last_change":"2024-03-09T15:07:29.979666+0000","last_active":"2024-03-09T15:07:29.979609+0000","last_peered":"2024-03-09T15:07:29.979609+0000","last_clean":"2024-03-09T15:07:29.979609+0000","last_became_active":"2024-03-09T14:29:01.650734+0000","last_became_peered":"2024-03-09T14:29:01.650734+0000","last_unstale":"2024-03-09T15:07:29.979609+0000","last_undegraded":"2024-03-09T15:07:29.979609+0000","last_fullsized":"2024-03-09T15:07:29.979609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:29.979414+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:29.979414+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.979414+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:29:52.407738+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'223","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.630726+0000","last_change":"2024-03-09T15:07:20.630792+0000","last_active":"2024-03-09T15:07:20.630726+0000","last_peered":"2024-03-09T15:07:20.630726+0000","last_clean":"2024-03-09T15:07:20.630726+0000","last_became_active":"2024-03-09T14:29:03.686455+0000","last_became_peered":"2024-03-09T14:29:03.686455+0000","last_unstale":"2024-03-09T15:07:20.630726+0000","last_undegraded":"2024-03-09T15:07:20.630726+0000","last_fullsized":"2024-03-09T15:07:20.630726+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'223","last_scrub_stamp":"2024-03-09T15:07:20.630528+0000","last_deep_scrub":"264'223","last_deep_scrub_stamp":"2024-03-09T15:07:20.630528+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.630528+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:50:48.600710+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":488,"num_read_kb":435,"num_write":508,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'408","reported_seq":1946,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:50.018723+0000","last_change":"2024-03-09T15:07:50.018788+0000","last_active":"2024-03-09T15:07:50.018723+0000","last_peered":"2024-03-09T15:07:50.018723+0000","last_clean":"2024-03-09T15:07:50.018723+0000","last_became_active":"2024-03-09T14:28:55.591649+0000","last_became_peered":"2024-03-09T14:28:55.591649+0000","last_unstale":"2024-03-09T15:07:50.018723+0000","last_undegraded":"2024-03-09T15:07:50.018723+0000","last_fullsized":"2024-03-09T15:07:50.018723+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'408","last_scrub_stamp":"2024-03-09T15:07:50.018533+0000","last_deep_scrub":"264'408","last_deep_scrub_stamp":"2024-03-09T15:07:50.018533+0000","last_clean_scrub_stamp":"2024-03-09T15:07:50.018533+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":300,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:08:59.558043+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2197,"num_read_kb":2083,"num_write":469,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'286","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:45.511247+0000","last_change":"2024-03-09T15:07:45.511618+0000","last_active":"2024-03-09T15:07:45.511247+0000","last_peered":"2024-03-09T15:07:45.511247+0000","last_clean":"2024-03-09T15:07:45.511247+0000","last_became_active":"2024-03-09T14:28:53.598990+0000","last_became_peered":"2024-03-09T14:28:53.598990+0000","last_unstale":"2024-03-09T15:07:45.511247+0000","last_undegraded":"2024-03-09T15:07:45.511247+0000","last_fullsized":"2024-03-09T15:07:45.511247+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'286","last_scrub_stamp":"2024-03-09T15:07:45.510984+0000","last_deep_scrub":"264'286","last_deep_scrub_stamp":"2024-03-09T15:07:45.510984+0000","last_clean_scrub_stamp":"2024-03-09T15:07:45.510984+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:35:31.097171+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5245594,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":365,"num_read_kb":35562,"num_write":1017,"num_write_kb":44906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,3],"acting":[5,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.858098+0000","last_change":"2024-03-09T15:07:42.858153+0000","last_active":"2024-03-09T15:07:42.858098+0000","last_peered":"2024-03-09T15:07:42.858098+0000","last_clean":"2024-03-09T15:07:42.858098+0000","last_became_active":"2024-03-09T14:28:57.615229+0000","last_became_peered":"2024-03-09T14:28:57.615229+0000","last_unstale":"2024-03-09T15:07:42.858098+0000","last_undegraded":"2024-03-09T15:07:42.858098+0000","last_fullsized":"2024-03-09T15:07:42.858098+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:42.857894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:42.857894+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.857894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:18.550366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'275","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.021627+0000","last_change":"2024-03-09T15:07:41.021709+0000","last_active":"2024-03-09T15:07:41.021627+0000","last_peered":"2024-03-09T15:07:41.021627+0000","last_clean":"2024-03-09T15:07:41.021627+0000","last_became_active":"2024-03-09T14:28:59.615881+0000","last_became_peered":"2024-03-09T14:28:59.615881+0000","last_unstale":"2024-03-09T15:07:41.021627+0000","last_undegraded":"2024-03-09T15:07:41.021627+0000","last_fullsized":"2024-03-09T15:07:41.021627+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'275","last_scrub_stamp":"2024-03-09T15:07:41.021439+0000","last_deep_scrub":"264'275","last_deep_scrub_stamp":"2024-03-09T15:07:41.021439+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.021439+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:37:08.339561+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48426,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":988,"num_write":356,"num_write_kb":267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.254320+0000","last_change":"2024-03-09T15:07:27.254373+0000","last_active":"2024-03-09T15:07:27.254320+0000","last_peered":"2024-03-09T15:07:27.254320+0000","last_clean":"2024-03-09T15:07:27.254320+0000","last_became_active":"2024-03-09T14:29:01.656740+0000","last_became_peered":"2024-03-09T14:29:01.656740+0000","last_unstale":"2024-03-09T15:07:27.254320+0000","last_undegraded":"2024-03-09T15:07:27.254320+0000","last_fullsized":"2024-03-09T15:07:27.254320+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:27.254123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:27.254123+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.254123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:56:48.423472+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'192","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.487174+0000","last_change":"2024-03-09T15:07:15.487243+0000","last_active":"2024-03-09T15:07:15.487174+0000","last_peered":"2024-03-09T15:07:15.487174+0000","last_clean":"2024-03-09T15:07:15.487174+0000","last_became_active":"2024-03-09T14:29:03.671571+0000","last_became_peered":"2024-03-09T14:29:03.671571+0000","last_unstale":"2024-03-09T15:07:15.487174+0000","last_undegraded":"2024-03-09T15:07:15.487174+0000","last_fullsized":"2024-03-09T15:07:15.487174+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'192","last_scrub_stamp":"2024-03-09T15:07:15.486986+0000","last_deep_scrub":"264'192","last_deep_scrub_stamp":"2024-03-09T15:07:15.486986+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.486986+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:03:03.941307+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":257,"num_read_kb":221,"num_write":372,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'1161","reported_seq":2786,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:47.950589+0000","last_change":"2024-03-09T15:07:47.950665+0000","last_active":"2024-03-09T15:07:47.950589+0000","last_peered":"2024-03-09T15:07:47.950589+0000","last_clean":"2024-03-09T15:07:47.950589+0000","last_became_active":"2024-03-09T14:28:55.592387+0000","last_became_peered":"2024-03-09T14:28:55.592387+0000","last_unstale":"2024-03-09T15:07:47.950589+0000","last_undegraded":"2024-03-09T15:07:47.950589+0000","last_fullsized":"2024-03-09T15:07:47.950589+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1161","last_scrub_stamp":"2024-03-09T15:07:47.950405+0000","last_deep_scrub":"264'1161","last_deep_scrub_stamp":"2024-03-09T15:07:47.950405+0000","last_clean_scrub_stamp":"2024-03-09T15:07:47.950405+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":1100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:16:34.259847+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4979,"num_read_kb":4357,"num_write":1600,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'325","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:00.487410+0000","last_change":"2024-03-09T15:08:00.487521+0000","last_active":"2024-03-09T15:08:00.487410+0000","last_peered":"2024-03-09T15:08:00.487410+0000","last_clean":"2024-03-09T15:08:00.487410+0000","last_became_active":"2024-03-09T14:28:53.626736+0000","last_became_peered":"2024-03-09T14:28:53.626736+0000","last_unstale":"2024-03-09T15:08:00.487410+0000","last_undegraded":"2024-03-09T15:08:00.487410+0000","last_fullsized":"2024-03-09T15:08:00.487410+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-03-09T15:08:00.487198+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-03-09T15:08:00.487198+0000","last_clean_scrub_stamp":"2024-03-09T15:08:00.487198+0000","objects_scrubbed":6,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:39:30.404221+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655827,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":493,"num_read_kb":7830,"num_write":1223,"num_write_kb":47405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,6,3],"acting":[0,5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:22.172754+0000","last_change":"2024-03-09T15:07:22.172813+0000","last_active":"2024-03-09T15:07:22.172754+0000","last_peered":"2024-03-09T15:07:22.172754+0000","last_clean":"2024-03-09T15:07:22.172754+0000","last_became_active":"2024-03-09T14:28:57.613999+0000","last_became_peered":"2024-03-09T14:28:57.613999+0000","last_unstale":"2024-03-09T15:07:22.172754+0000","last_undegraded":"2024-03-09T15:07:22.172754+0000","last_fullsized":"2024-03-09T15:07:22.172754+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:22.172539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:22.172539+0000","last_clean_scrub_stamp":"2024-03-09T15:07:22.172539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:10:05.619875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'259","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.892202+0000","last_change":"2024-03-09T15:07:46.892278+0000","last_active":"2024-03-09T15:07:46.892202+0000","last_peered":"2024-03-09T15:07:46.892202+0000","last_clean":"2024-03-09T15:07:46.892202+0000","last_became_active":"2024-03-09T14:28:59.614754+0000","last_became_peered":"2024-03-09T14:28:59.614754+0000","last_unstale":"2024-03-09T15:07:46.892202+0000","last_undegraded":"2024-03-09T15:07:46.892202+0000","last_fullsized":"2024-03-09T15:07:46.892202+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'259","last_scrub_stamp":"2024-03-09T15:07:46.891972+0000","last_deep_scrub":"264'259","last_deep_scrub_stamp":"2024-03-09T15:07:46.891972+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.891972+0000","objects_scrubbed":4,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:00:32.451554+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43227,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":428,"num_read_kb":1017,"num_write":350,"num_write_kb":291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.747798+0000","last_change":"2024-03-09T15:07:32.747857+0000","last_active":"2024-03-09T15:07:32.747798+0000","last_peered":"2024-03-09T15:07:32.747798+0000","last_clean":"2024-03-09T15:07:32.747798+0000","last_became_active":"2024-03-09T14:29:01.647570+0000","last_became_peered":"2024-03-09T14:29:01.647570+0000","last_unstale":"2024-03-09T15:07:32.747798+0000","last_undegraded":"2024-03-09T15:07:32.747798+0000","last_fullsized":"2024-03-09T15:07:32.747798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:32.747585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:32.747585+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.747585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:15:24.826316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'815","reported_seq":2360,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.286639+0000","last_change":"2024-03-09T15:07:26.286639+0000","last_active":"2024-03-09T15:07:26.286639+0000","last_peered":"2024-03-09T15:07:26.286639+0000","last_clean":"2024-03-09T15:07:26.286639+0000","last_became_active":"2024-03-09T14:28:55.599825+0000","last_became_peered":"2024-03-09T14:28:55.599825+0000","last_unstale":"2024-03-09T15:07:26.286639+0000","last_undegraded":"2024-03-09T15:07:26.286639+0000","last_fullsized":"2024-03-09T15:07:26.286639+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'815","last_scrub_stamp":"2024-03-09T15:07:26.286264+0000","last_deep_scrub":"264'815","last_deep_scrub_stamp":"2024-03-09T15:07:26.286264+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.286264+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":800,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:29:09.000713+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3687,"num_read_kb":3276,"num_write":1113,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'290","reported_seq":910,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:03.094619+0000","last_change":"2024-03-09T15:08:03.094763+0000","last_active":"2024-03-09T15:08:03.094619+0000","last_peered":"2024-03-09T15:08:03.094619+0000","last_clean":"2024-03-09T15:08:03.094619+0000","last_became_active":"2024-03-09T14:28:53.565431+0000","last_became_peered":"2024-03-09T14:28:53.565431+0000","last_unstale":"2024-03-09T15:08:03.094619+0000","last_undegraded":"2024-03-09T15:08:03.094619+0000","last_fullsized":"2024-03-09T15:08:03.094619+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'290","last_scrub_stamp":"2024-03-09T15:08:03.094412+0000","last_deep_scrub":"264'290","last_deep_scrub_stamp":"2024-03-09T15:08:03.094412+0000","last_clean_scrub_stamp":"2024-03-09T15:08:03.094412+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:00:27.486382+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655871,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":381,"num_read_kb":7268,"num_write":971,"num_write_kb":31379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.697187+0000","last_change":"2024-03-09T15:07:41.697282+0000","last_active":"2024-03-09T15:07:41.697187+0000","last_peered":"2024-03-09T15:07:41.697187+0000","last_clean":"2024-03-09T15:07:41.697187+0000","last_became_active":"2024-03-09T14:28:57.610126+0000","last_became_peered":"2024-03-09T14:28:57.610126+0000","last_unstale":"2024-03-09T15:07:41.697187+0000","last_undegraded":"2024-03-09T15:07:41.697187+0000","last_fullsized":"2024-03-09T15:07:41.697187+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:41.696945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:41.696945+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.696945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:48:55.597106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'478","reported_seq":1113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.906803+0000","last_change":"2024-03-09T15:07:31.906875+0000","last_active":"2024-03-09T15:07:31.906803+0000","last_peered":"2024-03-09T15:07:31.906803+0000","last_clean":"2024-03-09T15:07:31.906803+0000","last_became_active":"2024-03-09T14:28:59.614069+0000","last_became_peered":"2024-03-09T14:28:59.614069+0000","last_unstale":"2024-03-09T15:07:31.906803+0000","last_undegraded":"2024-03-09T15:07:31.906803+0000","last_fullsized":"2024-03-09T15:07:31.906803+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'478","last_scrub_stamp":"2024-03-09T15:07:31.906625+0000","last_deep_scrub":"264'478","last_deep_scrub_stamp":"2024-03-09T15:07:31.906625+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.906625+0000","objects_scrubbed":6,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:20:10.104166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88057,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":869,"num_read_kb":2100,"num_write":750,"num_write_kb":672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":22450,"num_omap_keys":42,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.444264+0000","last_change":"2024-03-09T15:07:20.444317+0000","last_active":"2024-03-09T15:07:20.444264+0000","last_peered":"2024-03-09T15:07:20.444264+0000","last_clean":"2024-03-09T15:07:20.444264+0000","last_became_active":"2024-03-09T14:29:01.639825+0000","last_became_peered":"2024-03-09T14:29:01.639825+0000","last_unstale":"2024-03-09T15:07:20.444264+0000","last_undegraded":"2024-03-09T15:07:20.444264+0000","last_fullsized":"2024-03-09T15:07:20.444264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.444069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.444069+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.444069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:07:45.858578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'151","reported_seq":651,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.014709+0000","last_change":"2024-03-09T15:07:12.014741+0000","last_active":"2024-03-09T15:07:12.014709+0000","last_peered":"2024-03-09T15:07:12.014709+0000","last_clean":"2024-03-09T15:07:12.014709+0000","last_became_active":"2024-03-09T14:29:03.666515+0000","last_became_peered":"2024-03-09T14:29:03.666515+0000","last_unstale":"2024-03-09T15:07:12.014709+0000","last_undegraded":"2024-03-09T15:07:12.014709+0000","last_fullsized":"2024-03-09T15:07:12.014709+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'151","last_scrub_stamp":"2024-03-09T15:07:12.014625+0000","last_deep_scrub":"264'151","last_deep_scrub_stamp":"2024-03-09T15:07:12.014625+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.014625+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:12:44.954675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":169,"num_read_kb":181,"num_write":332,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'875","reported_seq":2630,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.730570+0000","last_change":"2024-03-09T15:07:44.730707+0000","last_active":"2024-03-09T15:07:44.730570+0000","last_peered":"2024-03-09T15:07:44.730570+0000","last_clean":"2024-03-09T15:07:44.730570+0000","last_became_active":"2024-03-09T14:28:55.586247+0000","last_became_peered":"2024-03-09T14:28:55.586247+0000","last_unstale":"2024-03-09T15:07:44.730570+0000","last_undegraded":"2024-03-09T15:07:44.730570+0000","last_fullsized":"2024-03-09T15:07:44.730570+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'875","last_scrub_stamp":"2024-03-09T15:07:44.730351+0000","last_deep_scrub":"264'875","last_deep_scrub_stamp":"2024-03-09T15:07:44.730351+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.730351+0000","objects_scrubbed":1,"log_size":75,"log_dups_size":800,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:28:19.053933+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4288,"num_read_kb":3851,"num_write":1208,"num_write_kb":470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'317","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.645786+0000","last_change":"2024-03-09T15:07:42.645879+0000","last_active":"2024-03-09T15:07:42.645786+0000","last_peered":"2024-03-09T15:07:42.645786+0000","last_clean":"2024-03-09T15:07:42.645786+0000","last_became_active":"2024-03-09T14:28:53.617832+0000","last_became_peered":"2024-03-09T14:28:53.617832+0000","last_unstale":"2024-03-09T15:07:42.645786+0000","last_undegraded":"2024-03-09T15:07:42.645786+0000","last_fullsized":"2024-03-09T15:07:42.645786+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-03-09T15:07:42.645586+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-03-09T15:07:42.645586+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.645586+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":300,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:14:32.395572+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22651,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":36525,"num_write":1106,"num_write_kb":22031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,6],"acting":[1,3,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.221198+0000","last_change":"2024-03-09T15:07:20.221198+0000","last_active":"2024-03-09T15:07:20.221198+0000","last_peered":"2024-03-09T15:07:20.221198+0000","last_clean":"2024-03-09T15:07:20.221198+0000","last_became_active":"2024-03-09T14:28:57.616057+0000","last_became_peered":"2024-03-09T14:28:57.616057+0000","last_unstale":"2024-03-09T15:07:20.221198+0000","last_undegraded":"2024-03-09T15:07:20.221198+0000","last_fullsized":"2024-03-09T15:07:20.221198+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.220901+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.220901+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.220901+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:26:17.180137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'275","reported_seq":856,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:48.848902+0000","last_change":"2024-03-09T15:07:48.849006+0000","last_active":"2024-03-09T15:07:48.848902+0000","last_peered":"2024-03-09T15:07:48.848902+0000","last_clean":"2024-03-09T15:07:48.848902+0000","last_became_active":"2024-03-09T14:28:59.615193+0000","last_became_peered":"2024-03-09T14:28:59.615193+0000","last_unstale":"2024-03-09T15:07:48.848902+0000","last_undegraded":"2024-03-09T15:07:48.848902+0000","last_fullsized":"2024-03-09T15:07:48.848902+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'275","last_scrub_stamp":"2024-03-09T15:07:48.848686+0000","last_deep_scrub":"264'275","last_deep_scrub_stamp":"2024-03-09T15:07:48.848686+0000","last_clean_scrub_stamp":"2024-03-09T15:07:48.848686+0000","objects_scrubbed":8,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:47:07.814657+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43919,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":455,"num_read_kb":986,"num_write":382,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:20.859441+0000","last_change":"2024-03-09T15:07:20.859552+0000","last_active":"2024-03-09T15:07:20.859441+0000","last_peered":"2024-03-09T15:07:20.859441+0000","last_clean":"2024-03-09T15:07:20.859441+0000","last_became_active":"2024-03-09T14:29:01.660997+0000","last_became_peered":"2024-03-09T14:29:01.660997+0000","last_unstale":"2024-03-09T15:07:20.859441+0000","last_undegraded":"2024-03-09T15:07:20.859441+0000","last_fullsized":"2024-03-09T15:07:20.859441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:20.859205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:20.859205+0000","last_clean_scrub_stamp":"2024-03-09T15:07:20.859205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:57:46.682370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'190","reported_seq":1394,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.219927+0000","last_change":"2024-03-09T15:07:31.220024+0000","last_active":"2024-03-09T15:07:31.219927+0000","last_peered":"2024-03-09T15:07:31.219927+0000","last_clean":"2024-03-09T15:07:31.219927+0000","last_became_active":"2024-03-09T14:29:03.668833+0000","last_became_peered":"2024-03-09T14:29:03.668833+0000","last_unstale":"2024-03-09T15:07:31.219927+0000","last_undegraded":"2024-03-09T15:07:31.219927+0000","last_fullsized":"2024-03-09T15:07:31.219927+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'190","last_scrub_stamp":"2024-03-09T15:07:31.219733+0000","last_deep_scrub":"264'190","last_deep_scrub_stamp":"2024-03-09T15:07:31.219733+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.219733+0000","objects_scrubbed":9,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:12:05.817079+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2487,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":947,"num_read_kb":932,"num_write":509,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'489","reported_seq":2240,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.976906+0000","last_change":"2024-03-09T15:07:44.976984+0000","last_active":"2024-03-09T15:07:44.976906+0000","last_peered":"2024-03-09T15:07:44.976906+0000","last_clean":"2024-03-09T15:07:44.976906+0000","last_became_active":"2024-03-09T14:28:55.596538+0000","last_became_peered":"2024-03-09T14:28:55.596538+0000","last_unstale":"2024-03-09T15:07:44.976906+0000","last_undegraded":"2024-03-09T15:07:44.976906+0000","last_fullsized":"2024-03-09T15:07:44.976906+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'489","last_scrub_stamp":"2024-03-09T15:07:44.976709+0000","last_deep_scrub":"264'489","last_deep_scrub_stamp":"2024-03-09T15:07:44.976709+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.976709+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:27:06.380305+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2772,"num_read_kb":2616,"num_write":579,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2039,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'289","reported_seq":913,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:44.857265+0000","last_change":"2024-03-09T15:07:44.857389+0000","last_active":"2024-03-09T15:07:44.857265+0000","last_peered":"2024-03-09T15:07:44.857265+0000","last_clean":"2024-03-09T15:07:44.857265+0000","last_became_active":"2024-03-09T14:28:53.589932+0000","last_became_peered":"2024-03-09T14:28:53.589932+0000","last_unstale":"2024-03-09T15:07:44.857265+0000","last_undegraded":"2024-03-09T15:07:44.857265+0000","last_fullsized":"2024-03-09T15:07:44.857265+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'289","last_scrub_stamp":"2024-03-09T15:07:44.857059+0000","last_deep_scrub":"264'289","last_deep_scrub_stamp":"2024-03-09T15:07:44.857059+0000","last_clean_scrub_stamp":"2024-03-09T15:07:44.857059+0000","objects_scrubbed":8,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:57:25.367913+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10486772,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":425,"num_read_kb":14456,"num_write":988,"num_write_kb":42013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,7,2],"acting":[4,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.779509+0000","last_change":"2024-03-09T15:07:36.779562+0000","last_active":"2024-03-09T15:07:36.779509+0000","last_peered":"2024-03-09T15:07:36.779509+0000","last_clean":"2024-03-09T15:07:36.779509+0000","last_became_active":"2024-03-09T14:28:57.609903+0000","last_became_peered":"2024-03-09T14:28:57.609903+0000","last_unstale":"2024-03-09T15:07:36.779509+0000","last_undegraded":"2024-03-09T15:07:36.779509+0000","last_fullsized":"2024-03-09T15:07:36.779509+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:36.779312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:36.779312+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.779312+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:06:51.314999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'264","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.988771+0000","last_change":"2024-03-09T15:07:37.988841+0000","last_active":"2024-03-09T15:07:37.988771+0000","last_peered":"2024-03-09T15:07:37.988771+0000","last_clean":"2024-03-09T15:07:37.988771+0000","last_became_active":"2024-03-09T14:28:59.630460+0000","last_became_peered":"2024-03-09T14:28:59.630460+0000","last_unstale":"2024-03-09T15:07:37.988771+0000","last_undegraded":"2024-03-09T15:07:37.988771+0000","last_fullsized":"2024-03-09T15:07:37.988771+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'264","last_scrub_stamp":"2024-03-09T15:07:37.988583+0000","last_deep_scrub":"264'264","last_deep_scrub_stamp":"2024-03-09T15:07:37.988583+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.988583+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:38:46.575367+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41630,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":443,"num_read_kb":1036,"num_write":360,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:35.818762+0000","last_change":"2024-03-09T15:07:35.818818+0000","last_active":"2024-03-09T15:07:35.818762+0000","last_peered":"2024-03-09T15:07:35.818762+0000","last_clean":"2024-03-09T15:07:35.818762+0000","last_became_active":"2024-03-09T14:29:01.636083+0000","last_became_peered":"2024-03-09T14:29:01.636083+0000","last_unstale":"2024-03-09T15:07:35.818762+0000","last_undegraded":"2024-03-09T15:07:35.818762+0000","last_fullsized":"2024-03-09T15:07:35.818762+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:35.818570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:35.818570+0000","last_clean_scrub_stamp":"2024-03-09T15:07:35.818570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:41:15.118693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'124","reported_seq":616,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:12.549045+0000","last_change":"2024-03-09T15:07:12.549133+0000","last_active":"2024-03-09T15:07:12.549045+0000","last_peered":"2024-03-09T15:07:12.549045+0000","last_clean":"2024-03-09T15:07:12.549045+0000","last_became_active":"2024-03-09T14:29:03.677376+0000","last_became_peered":"2024-03-09T14:29:03.677376+0000","last_unstale":"2024-03-09T15:07:12.549045+0000","last_undegraded":"2024-03-09T15:07:12.549045+0000","last_fullsized":"2024-03-09T15:07:12.549045+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:12.548825+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:12.548825+0000","last_clean_scrub_stamp":"2024-03-09T15:07:12.548825+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:01:19.400821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":352,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":94,"num_read_kb":93,"num_write":293,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'1142","reported_seq":3003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:31.617476+0000","last_change":"2024-03-09T15:07:31.617551+0000","last_active":"2024-03-09T15:07:31.617476+0000","last_peered":"2024-03-09T15:07:31.617476+0000","last_clean":"2024-03-09T15:07:31.617476+0000","last_became_active":"2024-03-09T14:28:55.587547+0000","last_became_peered":"2024-03-09T14:28:55.587547+0000","last_unstale":"2024-03-09T15:07:31.617476+0000","last_undegraded":"2024-03-09T15:07:31.617476+0000","last_fullsized":"2024-03-09T15:07:31.617476+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1142","last_scrub_stamp":"2024-03-09T15:07:31.617284+0000","last_deep_scrub":"264'1142","last_deep_scrub_stamp":"2024-03-09T15:07:31.617284+0000","last_clean_scrub_stamp":"2024-03-09T15:07:31.617284+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":1100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:24.394435+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":5366,"num_read_kb":4772,"num_write":1564,"num_write_kb":649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4191,"num_omap_keys":18,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'284","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:56.602075+0000","last_change":"2024-03-09T15:07:56.602157+0000","last_active":"2024-03-09T15:07:56.602075+0000","last_peered":"2024-03-09T15:07:56.602075+0000","last_clean":"2024-03-09T15:07:56.602075+0000","last_became_active":"2024-03-09T14:28:53.589407+0000","last_became_peered":"2024-03-09T14:28:53.589407+0000","last_unstale":"2024-03-09T15:07:56.602075+0000","last_undegraded":"2024-03-09T15:07:56.602075+0000","last_fullsized":"2024-03-09T15:07:56.602075+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'284","last_scrub_stamp":"2024-03-09T15:07:56.601879+0000","last_deep_scrub":"264'284","last_deep_scrub_stamp":"2024-03-09T15:07:56.601879+0000","last_clean_scrub_stamp":"2024-03-09T15:07:56.601879+0000","objects_scrubbed":3,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:10:09.140840+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":447,"num_read_kb":59464,"num_write":1037,"num_write_kb":28198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,7,1],"acting":[0,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.818475+0000","last_change":"2024-03-09T15:07:27.818528+0000","last_active":"2024-03-09T15:07:27.818475+0000","last_peered":"2024-03-09T15:07:27.818475+0000","last_clean":"2024-03-09T15:07:27.818475+0000","last_became_active":"2024-03-09T14:28:57.620140+0000","last_became_peered":"2024-03-09T14:28:57.620140+0000","last_unstale":"2024-03-09T15:07:27.818475+0000","last_undegraded":"2024-03-09T15:07:27.818475+0000","last_fullsized":"2024-03-09T15:07:27.818475+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:27.818272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:27.818272+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.818272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:07:47.066746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'79","reported_seq":600,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.737047+0000","last_change":"2024-03-09T15:07:24.737205+0000","last_active":"2024-03-09T15:07:24.737047+0000","last_peered":"2024-03-09T15:07:24.737047+0000","last_clean":"2024-03-09T15:07:24.737047+0000","last_became_active":"2024-03-09T14:28:59.629734+0000","last_became_peered":"2024-03-09T14:28:59.629734+0000","last_unstale":"2024-03-09T15:07:24.737047+0000","last_undegraded":"2024-03-09T15:07:24.737047+0000","last_fullsized":"2024-03-09T15:07:24.737047+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'79","last_scrub_stamp":"2024-03-09T15:07:24.736784+0000","last_deep_scrub":"264'79","last_deep_scrub_stamp":"2024-03-09T15:07:24.736784+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.736784+0000","objects_scrubbed":7,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:02:04.246917+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":70,"num_read_kb":63,"num_write":56,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1780,"num_omap_keys":6,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'540","reported_seq":2063,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.197995+0000","last_change":"2024-03-09T15:07:21.198058+0000","last_active":"2024-03-09T15:07:21.197995+0000","last_peered":"2024-03-09T15:07:21.197995+0000","last_clean":"2024-03-09T15:07:21.197995+0000","last_became_active":"2024-03-09T14:29:01.650590+0000","last_became_peered":"2024-03-09T14:29:01.650590+0000","last_unstale":"2024-03-09T15:07:21.197995+0000","last_undegraded":"2024-03-09T15:07:21.197995+0000","last_fullsized":"2024-03-09T15:07:21.197995+0000","mapping_epoch":31,"log_start":"264'500","ondisk_log_start":"264'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'540","last_scrub_stamp":"2024-03-09T15:07:21.197799+0000","last_deep_scrub":"264'540","last_deep_scrub_stamp":"2024-03-09T15:07:21.197799+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.197799+0000","objects_scrubbed":1,"log_size":40,"log_dups_size":500,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:33:51.367630+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'124","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:26.011441+0000","last_change":"2024-03-09T15:07:26.011504+0000","last_active":"2024-03-09T15:07:26.011441+0000","last_peered":"2024-03-09T15:07:26.011441+0000","last_clean":"2024-03-09T15:07:26.011441+0000","last_became_active":"2024-03-09T14:29:03.677064+0000","last_became_peered":"2024-03-09T14:29:03.677064+0000","last_unstale":"2024-03-09T15:07:26.011441+0000","last_undegraded":"2024-03-09T15:07:26.011441+0000","last_fullsized":"2024-03-09T15:07:26.011441+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:26.011253+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:26.011253+0000","last_clean_scrub_stamp":"2024-03-09T15:07:26.011253+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:04:51.610682+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":150,"num_write":318,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'511","reported_seq":1986,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:34.763467+0000","last_change":"2024-03-09T15:07:34.763605+0000","last_active":"2024-03-09T15:07:34.763467+0000","last_peered":"2024-03-09T15:07:34.763467+0000","last_clean":"2024-03-09T15:07:34.763467+0000","last_became_active":"2024-03-09T14:28:55.610134+0000","last_became_peered":"2024-03-09T14:28:55.610134+0000","last_unstale":"2024-03-09T15:07:34.763467+0000","last_undegraded":"2024-03-09T15:07:34.763467+0000","last_fullsized":"2024-03-09T15:07:34.763467+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'511","last_scrub_stamp":"2024-03-09T15:07:34.763210+0000","last_deep_scrub":"264'511","last_deep_scrub_stamp":"2024-03-09T15:07:34.763210+0000","last_clean_scrub_stamp":"2024-03-09T15:07:34.763210+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:26:43.942046+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2571,"num_read_kb":2332,"num_write":699,"num_write_kb":219,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":228,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'430","reported_seq":1157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.545102+0000","last_change":"2024-03-09T15:07:40.545239+0000","last_active":"2024-03-09T15:07:40.545102+0000","last_peered":"2024-03-09T15:07:40.545102+0000","last_clean":"2024-03-09T15:07:40.545102+0000","last_became_active":"2024-03-09T14:28:53.636761+0000","last_became_peered":"2024-03-09T14:28:53.636761+0000","last_unstale":"2024-03-09T15:07:40.545102+0000","last_undegraded":"2024-03-09T15:07:40.545102+0000","last_fullsized":"2024-03-09T15:07:40.545102+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'430","last_scrub_stamp":"2024-03-09T15:07:40.544850+0000","last_deep_scrub":"264'430","last_deep_scrub_stamp":"2024-03-09T15:07:40.544850+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.544850+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":400,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:56:02.288859+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262219,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":788,"num_read_kb":7041,"num_write":1515,"num_write_kb":16792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,6],"acting":[5,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:40.905560+0000","last_change":"2024-03-09T15:07:40.905670+0000","last_active":"2024-03-09T15:07:40.905560+0000","last_peered":"2024-03-09T15:07:40.905560+0000","last_clean":"2024-03-09T15:07:40.905560+0000","last_became_active":"2024-03-09T14:28:57.612982+0000","last_became_peered":"2024-03-09T14:28:57.612982+0000","last_unstale":"2024-03-09T15:07:40.905560+0000","last_undegraded":"2024-03-09T15:07:40.905560+0000","last_fullsized":"2024-03-09T15:07:40.905560+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:40.905311+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:40.905311+0000","last_clean_scrub_stamp":"2024-03-09T15:07:40.905311+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:23:55.643584+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'296","reported_seq":879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.585872+0000","last_change":"2024-03-09T15:07:51.585960+0000","last_active":"2024-03-09T15:07:51.585872+0000","last_peered":"2024-03-09T15:07:51.585872+0000","last_clean":"2024-03-09T15:07:51.585872+0000","last_became_active":"2024-03-09T14:28:59.601007+0000","last_became_peered":"2024-03-09T14:28:59.601007+0000","last_unstale":"2024-03-09T15:07:51.585872+0000","last_undegraded":"2024-03-09T15:07:51.585872+0000","last_fullsized":"2024-03-09T15:07:51.585872+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'296","last_scrub_stamp":"2024-03-09T15:07:51.585640+0000","last_deep_scrub":"264'296","last_deep_scrub_stamp":"2024-03-09T15:07:51.585640+0000","last_clean_scrub_stamp":"2024-03-09T15:07:51.585640+0000","objects_scrubbed":8,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:49:09.577984+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58554,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":1103,"num_write":386,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.710682+0000","last_change":"2024-03-09T15:07:28.710682+0000","last_active":"2024-03-09T15:07:28.710682+0000","last_peered":"2024-03-09T15:07:28.710682+0000","last_clean":"2024-03-09T15:07:28.710682+0000","last_became_active":"2024-03-09T14:29:01.657169+0000","last_became_peered":"2024-03-09T14:29:01.657169+0000","last_unstale":"2024-03-09T15:07:28.710682+0000","last_undegraded":"2024-03-09T15:07:28.710682+0000","last_fullsized":"2024-03-09T15:07:28.710682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:28.710441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:28.710441+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.710441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:06:51.547173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'124","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.984410+0000","last_change":"2024-03-09T15:07:27.984410+0000","last_active":"2024-03-09T15:07:27.984410+0000","last_peered":"2024-03-09T15:07:27.984410+0000","last_clean":"2024-03-09T15:07:27.984410+0000","last_became_active":"2024-03-09T14:29:03.669978+0000","last_became_peered":"2024-03-09T14:29:03.669978+0000","last_unstale":"2024-03-09T15:07:27.984410+0000","last_undegraded":"2024-03-09T15:07:27.984410+0000","last_fullsized":"2024-03-09T15:07:27.984410+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:27.984137+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:27.984137+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.984137+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:41:49.859618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":112,"num_read_kb":110,"num_write":289,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'774","reported_seq":2309,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.881876+0000","last_change":"2024-03-09T15:07:51.881962+0000","last_active":"2024-03-09T15:07:51.881876+0000","last_peered":"2024-03-09T15:07:51.881876+0000","last_clean":"2024-03-09T15:07:51.881876+0000","last_became_active":"2024-03-09T14:28:55.570161+0000","last_became_peered":"2024-03-09T14:28:55.570161+0000","last_unstale":"2024-03-09T15:07:51.881876+0000","last_undegraded":"2024-03-09T15:07:51.881876+0000","last_fullsized":"2024-03-09T15:07:51.881876+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'774","last_scrub_stamp":"2024-03-09T15:07:51.881697+0000","last_deep_scrub":"264'774","last_deep_scrub_stamp":"2024-03-09T15:07:51.881697+0000","last_clean_scrub_stamp":"2024-03-09T15:07:51.881697+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:09:25.741621+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3636,"num_read_kb":3267,"num_write":1033,"num_write_kb":391,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1209,"num_omap_keys":5,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'351","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.608643+0000","last_change":"2024-03-09T15:07:19.608740+0000","last_active":"2024-03-09T15:07:19.608643+0000","last_peered":"2024-03-09T15:07:19.608643+0000","last_clean":"2024-03-09T15:07:19.608643+0000","last_became_active":"2024-03-09T14:29:28.824399+0000","last_became_peered":"2024-03-09T14:29:28.824399+0000","last_unstale":"2024-03-09T15:07:19.608643+0000","last_undegraded":"2024-03-09T15:07:19.608643+0000","last_fullsized":"2024-03-09T15:07:19.608643+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'351","last_scrub_stamp":"2024-03-09T15:07:19.608431+0000","last_deep_scrub":"264'351","last_deep_scrub_stamp":"2024-03-09T15:07:19.608431+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.608431+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:55:03.616832+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262175,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":600,"num_read_kb":66383,"num_write":1403,"num_write_kb":58469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,1,6],"acting":[2,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.513168+0000","last_change":"2024-03-09T15:07:37.513222+0000","last_active":"2024-03-09T15:07:37.513168+0000","last_peered":"2024-03-09T15:07:37.513168+0000","last_clean":"2024-03-09T15:07:37.513168+0000","last_became_active":"2024-03-09T14:28:57.608639+0000","last_became_peered":"2024-03-09T14:28:57.608639+0000","last_unstale":"2024-03-09T15:07:37.513168+0000","last_undegraded":"2024-03-09T15:07:37.513168+0000","last_fullsized":"2024-03-09T15:07:37.513168+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:37.512944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:37.512944+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.512944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:58:03.637550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'272","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.663652+0000","last_change":"2024-03-09T15:07:49.663738+0000","last_active":"2024-03-09T15:07:49.663652+0000","last_peered":"2024-03-09T15:07:49.663652+0000","last_clean":"2024-03-09T15:07:49.663652+0000","last_became_active":"2024-03-09T14:28:59.623529+0000","last_became_peered":"2024-03-09T14:28:59.623529+0000","last_unstale":"2024-03-09T15:07:49.663652+0000","last_undegraded":"2024-03-09T15:07:49.663652+0000","last_fullsized":"2024-03-09T15:07:49.663652+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'272","last_scrub_stamp":"2024-03-09T15:07:49.663434+0000","last_deep_scrub":"264'272","last_deep_scrub_stamp":"2024-03-09T15:07:49.663434+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.663434+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:32:05.951813+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45513,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":421,"num_read_kb":971,"num_write":346,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:23.212326+0000","last_change":"2024-03-09T15:07:23.212326+0000","last_active":"2024-03-09T15:07:23.212326+0000","last_peered":"2024-03-09T15:07:23.212326+0000","last_clean":"2024-03-09T15:07:23.212326+0000","last_became_active":"2024-03-09T14:29:01.651183+0000","last_became_peered":"2024-03-09T14:29:01.651183+0000","last_unstale":"2024-03-09T15:07:23.212326+0000","last_undegraded":"2024-03-09T15:07:23.212326+0000","last_fullsized":"2024-03-09T15:07:23.212326+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:23.212084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:23.212084+0000","last_clean_scrub_stamp":"2024-03-09T15:07:23.212084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:52:31.699504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'124","reported_seq":646,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:25.965517+0000","last_change":"2024-03-09T15:07:25.965517+0000","last_active":"2024-03-09T15:07:25.965517+0000","last_peered":"2024-03-09T15:07:25.965517+0000","last_clean":"2024-03-09T15:07:25.965517+0000","last_became_active":"2024-03-09T14:29:03.661848+0000","last_became_peered":"2024-03-09T14:29:03.661848+0000","last_unstale":"2024-03-09T15:07:25.965517+0000","last_undegraded":"2024-03-09T15:07:25.965517+0000","last_fullsized":"2024-03-09T15:07:25.965517+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-03-09T15:07:25.965247+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-03-09T15:07:25.965247+0000","last_clean_scrub_stamp":"2024-03-09T15:07:25.965247+0000","objects_scrubbed":3,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:36:26.246320+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":975,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":180,"num_read_kb":172,"num_write":289,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'742","reported_seq":2312,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:54.007475+0000","last_change":"2024-03-09T15:07:54.007539+0000","last_active":"2024-03-09T15:07:54.007475+0000","last_peered":"2024-03-09T15:07:54.007475+0000","last_clean":"2024-03-09T15:07:54.007475+0000","last_became_active":"2024-03-09T14:28:55.580902+0000","last_became_peered":"2024-03-09T14:28:55.580902+0000","last_unstale":"2024-03-09T15:07:54.007475+0000","last_undegraded":"2024-03-09T15:07:54.007475+0000","last_fullsized":"2024-03-09T15:07:54.007475+0000","mapping_epoch":25,"log_start":"264'700","ondisk_log_start":"264'700","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'742","last_scrub_stamp":"2024-03-09T15:07:54.007293+0000","last_deep_scrub":"264'742","last_deep_scrub_stamp":"2024-03-09T15:07:54.007293+0000","last_clean_scrub_stamp":"2024-03-09T15:07:54.007293+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:26:40.984544+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3409,"num_read_kb":3074,"num_write":976,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'296","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:00.091073+0000","last_change":"2024-03-09T15:08:00.091176+0000","last_active":"2024-03-09T15:08:00.091073+0000","last_peered":"2024-03-09T15:08:00.091073+0000","last_clean":"2024-03-09T15:08:00.091073+0000","last_became_active":"2024-03-09T14:28:53.618470+0000","last_became_peered":"2024-03-09T14:28:53.618470+0000","last_unstale":"2024-03-09T15:08:00.091073+0000","last_undegraded":"2024-03-09T15:08:00.091073+0000","last_fullsized":"2024-03-09T15:08:00.091073+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'296","last_scrub_stamp":"2024-03-09T15:08:00.090846+0000","last_deep_scrub":"264'296","last_deep_scrub_stamp":"2024-03-09T15:08:00.090846+0000","last_clean_scrub_stamp":"2024-03-09T15:08:00.090846+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:13:02.331237+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243044,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":432,"num_read_kb":49463,"num_write":1149,"num_write_kb":38192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,7,2],"acting":[3,6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.743133+0000","last_change":"2024-03-09T15:07:38.743133+0000","last_active":"2024-03-09T15:07:38.743133+0000","last_peered":"2024-03-09T15:07:38.743133+0000","last_clean":"2024-03-09T15:07:38.743133+0000","last_became_active":"2024-03-09T14:28:57.611745+0000","last_became_peered":"2024-03-09T14:28:57.611745+0000","last_unstale":"2024-03-09T15:07:38.743133+0000","last_undegraded":"2024-03-09T15:07:38.743133+0000","last_fullsized":"2024-03-09T15:07:38.743133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:38.742764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:38.742764+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.742764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:41:17.394565+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'215","reported_seq":773,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.007685+0000","last_change":"2024-03-09T15:07:42.007752+0000","last_active":"2024-03-09T15:07:42.007685+0000","last_peered":"2024-03-09T15:07:42.007685+0000","last_clean":"2024-03-09T15:07:42.007685+0000","last_became_active":"2024-03-09T14:28:59.615400+0000","last_became_peered":"2024-03-09T14:28:59.615400+0000","last_unstale":"2024-03-09T15:07:42.007685+0000","last_undegraded":"2024-03-09T15:07:42.007685+0000","last_fullsized":"2024-03-09T15:07:42.007685+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'215","last_scrub_stamp":"2024-03-09T15:07:42.007505+0000","last_deep_scrub":"264'215","last_deep_scrub_stamp":"2024-03-09T15:07:42.007505+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.007505+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:40:23.332625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41975,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":356,"num_read_kb":841,"num_write":286,"num_write_kb":242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:19.763802+0000","last_change":"2024-03-09T15:07:19.763934+0000","last_active":"2024-03-09T15:07:19.763802+0000","last_peered":"2024-03-09T15:07:19.763802+0000","last_clean":"2024-03-09T15:07:19.763802+0000","last_became_active":"2024-03-09T14:29:01.657117+0000","last_became_peered":"2024-03-09T14:29:01.657117+0000","last_unstale":"2024-03-09T15:07:19.763802+0000","last_undegraded":"2024-03-09T15:07:19.763802+0000","last_fullsized":"2024-03-09T15:07:19.763802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:19.763551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:19.763551+0000","last_clean_scrub_stamp":"2024-03-09T15:07:19.763551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:00:56.266543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'135","reported_seq":1803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.938669+0000","last_change":"2024-03-09T15:07:28.938669+0000","last_active":"2024-03-09T15:07:28.938669+0000","last_peered":"2024-03-09T15:07:28.938669+0000","last_clean":"2024-03-09T15:07:28.938669+0000","last_became_active":"2024-03-09T14:29:03.659930+0000","last_became_peered":"2024-03-09T14:29:03.659930+0000","last_unstale":"2024-03-09T15:07:28.938669+0000","last_undegraded":"2024-03-09T15:07:28.938669+0000","last_fullsized":"2024-03-09T15:07:28.938669+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'135","last_scrub_stamp":"2024-03-09T15:07:28.938414+0000","last_deep_scrub":"264'135","last_deep_scrub_stamp":"2024-03-09T15:07:28.938414+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.938414+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:37:57.834645+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1320,"num_read_kb":1317,"num_write":320,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'484","reported_seq":2157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.745370+0000","last_change":"2024-03-09T15:07:32.745370+0000","last_active":"2024-03-09T15:07:32.745370+0000","last_peered":"2024-03-09T15:07:32.745370+0000","last_clean":"2024-03-09T15:07:32.745370+0000","last_became_active":"2024-03-09T14:28:55.598822+0000","last_became_peered":"2024-03-09T14:28:55.598822+0000","last_unstale":"2024-03-09T15:07:32.745370+0000","last_undegraded":"2024-03-09T15:07:32.745370+0000","last_fullsized":"2024-03-09T15:07:32.745370+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'484","last_scrub_stamp":"2024-03-09T15:07:32.745104+0000","last_deep_scrub":"264'484","last_deep_scrub_stamp":"2024-03-09T15:07:32.745104+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.745104+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:12:38.011733+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2615,"num_read_kb":2447,"num_write":578,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'291","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:59.487701+0000","last_change":"2024-03-09T15:07:59.487701+0000","last_active":"2024-03-09T15:07:59.487701+0000","last_peered":"2024-03-09T15:07:59.487701+0000","last_clean":"2024-03-09T15:07:59.487701+0000","last_became_active":"2024-03-09T14:28:53.595479+0000","last_became_peered":"2024-03-09T14:28:53.595479+0000","last_unstale":"2024-03-09T15:07:59.487701+0000","last_undegraded":"2024-03-09T15:07:59.487701+0000","last_fullsized":"2024-03-09T15:07:59.487701+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'291","last_scrub_stamp":"2024-03-09T15:07:59.487376+0000","last_deep_scrub":"264'291","last_deep_scrub_stamp":"2024-03-09T15:07:59.487376+0000","last_clean_scrub_stamp":"2024-03-09T15:07:59.487376+0000","objects_scrubbed":6,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:09:31.970994+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":311401,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":399,"num_read_kb":37243,"num_write":1062,"num_write_kb":31681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,4,7],"acting":[0,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.908465+0000","last_change":"2024-03-09T15:07:21.908465+0000","last_active":"2024-03-09T15:07:21.908465+0000","last_peered":"2024-03-09T15:07:21.908465+0000","last_clean":"2024-03-09T15:07:21.908465+0000","last_became_active":"2024-03-09T14:28:57.608170+0000","last_became_peered":"2024-03-09T14:28:57.608170+0000","last_unstale":"2024-03-09T15:07:21.908465+0000","last_undegraded":"2024-03-09T15:07:21.908465+0000","last_fullsized":"2024-03-09T15:07:21.908465+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-03-09T15:07:21.908209+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-03-09T15:07:21.908209+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.908209+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:46:15.136572+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'257","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:27.774386+0000","last_change":"2024-03-09T15:07:27.774468+0000","last_active":"2024-03-09T15:07:27.774386+0000","last_peered":"2024-03-09T15:07:27.774386+0000","last_clean":"2024-03-09T15:07:27.774386+0000","last_became_active":"2024-03-09T14:28:59.614271+0000","last_became_peered":"2024-03-09T14:28:59.614271+0000","last_unstale":"2024-03-09T15:07:27.774386+0000","last_undegraded":"2024-03-09T15:07:27.774386+0000","last_fullsized":"2024-03-09T15:07:27.774386+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-03-09T15:07:27.774203+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-03-09T15:07:27.774203+0000","last_clean_scrub_stamp":"2024-03-09T15:07:27.774203+0000","objects_scrubbed":4,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:16:51.240318+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45957,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":426,"num_read_kb":925,"num_write":332,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.731942+0000","last_change":"2024-03-09T15:07:29.732043+0000","last_active":"2024-03-09T15:07:29.731942+0000","last_peered":"2024-03-09T15:07:29.731942+0000","last_clean":"2024-03-09T15:07:29.731942+0000","last_became_active":"2024-03-09T14:29:01.648467+0000","last_became_peered":"2024-03-09T14:29:01.648467+0000","last_unstale":"2024-03-09T15:07:29.731942+0000","last_undegraded":"2024-03-09T15:07:29.731942+0000","last_fullsized":"2024-03-09T15:07:29.731942+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-09T15:07:29.731652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-09T15:07:29.731652+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.731652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:24:49.823183+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'90","reported_seq":583,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:15.791592+0000","last_change":"2024-03-09T15:07:15.791657+0000","last_active":"2024-03-09T15:07:15.791592+0000","last_peered":"2024-03-09T15:07:15.791592+0000","last_clean":"2024-03-09T15:07:15.791592+0000","last_became_active":"2024-03-09T14:29:03.666157+0000","last_became_peered":"2024-03-09T14:29:03.666157+0000","last_unstale":"2024-03-09T15:07:15.791592+0000","last_undegraded":"2024-03-09T15:07:15.791592+0000","last_fullsized":"2024-03-09T15:07:15.791592+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'90","last_scrub_stamp":"2024-03-09T15:07:15.791376+0000","last_deep_scrub":"264'90","last_deep_scrub_stamp":"2024-03-09T15:07:15.791376+0000","last_clean_scrub_stamp":"2024-03-09T15:07:15.791376+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:02:26.244687+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":76,"num_read_kb":67,"num_write":211,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'505","reported_seq":2014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.873003+0000","last_change":"2024-03-09T15:07:24.873003+0000","last_active":"2024-03-09T15:07:24.873003+0000","last_peered":"2024-03-09T15:07:24.873003+0000","last_clean":"2024-03-09T15:07:24.873003+0000","last_became_active":"2024-03-09T14:28:55.591054+0000","last_became_peered":"2024-03-09T14:28:55.591054+0000","last_unstale":"2024-03-09T15:07:24.873003+0000","last_undegraded":"2024-03-09T15:07:24.873003+0000","last_fullsized":"2024-03-09T15:07:24.873003+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'505","last_scrub_stamp":"2024-03-09T15:07:24.872742+0000","last_deep_scrub":"264'505","last_deep_scrub_stamp":"2024-03-09T15:07:24.872742+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.872742+0000","objects_scrubbed":3,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:44:42.985766+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2590,"num_read_kb":2449,"num_write":673,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'308","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.187232+0000","last_change":"2024-03-09T15:07:42.187232+0000","last_active":"2024-03-09T15:07:42.187232+0000","last_peered":"2024-03-09T15:07:42.187232+0000","last_clean":"2024-03-09T15:07:42.187232+0000","last_became_active":"2024-03-09T14:28:53.638941+0000","last_became_peered":"2024-03-09T14:28:53.638941+0000","last_unstale":"2024-03-09T15:07:42.187232+0000","last_undegraded":"2024-03-09T15:07:42.187232+0000","last_fullsized":"2024-03-09T15:07:42.187232+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-03-09T15:07:42.186800+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-03-09T15:07:42.186800+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.186800+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:40:08.305555+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505214,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":466,"num_read_kb":10894,"num_write":1166,"num_write_kb":33356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,5],"acting":[6,0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'699","reported_seq":2169,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.909285+0000","last_change":"2024-03-09T15:07:30.909285+0000","last_active":"2024-03-09T15:07:30.909285+0000","last_peered":"2024-03-09T15:07:30.909285+0000","last_clean":"2024-03-09T15:07:30.909285+0000","last_became_active":"2024-03-09T14:28:55.578705+0000","last_became_peered":"2024-03-09T14:28:55.578705+0000","last_unstale":"2024-03-09T15:07:30.909285+0000","last_undegraded":"2024-03-09T15:07:30.909285+0000","last_fullsized":"2024-03-09T15:07:30.909285+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'699","last_scrub_stamp":"2024-03-09T15:07:30.909041+0000","last_deep_scrub":"264'699","last_deep_scrub_stamp":"2024-03-09T15:07:30.909041+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.909041+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":600,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:54:02.289892+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3212,"num_read_kb":2884,"num_write":923,"num_write_kb":335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'308","reported_seq":983,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.480771+0000","last_change":"2024-03-09T15:07:28.480771+0000","last_active":"2024-03-09T15:07:28.480771+0000","last_peered":"2024-03-09T15:07:28.480771+0000","last_clean":"2024-03-09T15:07:28.480771+0000","last_became_active":"2024-03-09T14:28:53.617469+0000","last_became_peered":"2024-03-09T14:28:53.617469+0000","last_unstale":"2024-03-09T15:07:28.480771+0000","last_undegraded":"2024-03-09T15:07:28.480771+0000","last_fullsized":"2024-03-09T15:07:28.480771+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'308","last_scrub_stamp":"2024-03-09T15:07:28.480493+0000","last_deep_scrub":"264'308","last_deep_scrub_stamp":"2024-03-09T15:07:28.480493+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.480493+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T03:02:21.546672+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":486,"num_read_kb":96508,"num_write":1206,"num_write_kb":39289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6,7],"acting":[2,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'478","reported_seq":2164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.553974+0000","last_change":"2024-03-09T15:07:29.553974+0000","last_active":"2024-03-09T15:07:29.553974+0000","last_peered":"2024-03-09T15:07:29.553974+0000","last_clean":"2024-03-09T15:07:29.553974+0000","last_became_active":"2024-03-09T14:28:55.594171+0000","last_became_peered":"2024-03-09T14:28:55.594171+0000","last_unstale":"2024-03-09T15:07:29.553974+0000","last_undegraded":"2024-03-09T15:07:29.553974+0000","last_fullsized":"2024-03-09T15:07:29.553974+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'478","last_scrub_stamp":"2024-03-09T15:07:29.553598+0000","last_deep_scrub":"264'478","last_deep_scrub_stamp":"2024-03-09T15:07:29.553598+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.553598+0000","objects_scrubbed":4,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:23:50.963569+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2696,"num_read_kb":2529,"num_write":600,"num_write_kb":190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2297,"num_omap_keys":9,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'314","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:50.555105+0000","last_change":"2024-03-09T15:07:50.555105+0000","last_active":"2024-03-09T15:07:50.555105+0000","last_peered":"2024-03-09T15:07:50.555105+0000","last_clean":"2024-03-09T15:07:50.555105+0000","last_became_active":"2024-03-09T14:28:53.627011+0000","last_became_peered":"2024-03-09T14:28:53.627011+0000","last_unstale":"2024-03-09T15:07:50.555105+0000","last_undegraded":"2024-03-09T15:07:50.555105+0000","last_fullsized":"2024-03-09T15:07:50.555105+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'314","last_scrub_stamp":"2024-03-09T15:07:50.554642+0000","last_deep_scrub":"264'314","last_deep_scrub_stamp":"2024-03-09T15:07:50.554642+0000","last_clean_scrub_stamp":"2024-03-09T15:07:50.554642+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:16:02.786215+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":524303,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":582,"num_read_kb":86707,"num_write":1181,"num_write_kb":21935,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,0,6],"acting":[5,3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'405","reported_seq":2047,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:36.783640+0000","last_change":"2024-03-09T15:07:36.783640+0000","last_active":"2024-03-09T15:07:36.783640+0000","last_peered":"2024-03-09T15:07:36.783640+0000","last_clean":"2024-03-09T15:07:36.783640+0000","last_became_active":"2024-03-09T14:28:55.577524+0000","last_became_peered":"2024-03-09T14:28:55.577524+0000","last_unstale":"2024-03-09T15:07:36.783640+0000","last_undegraded":"2024-03-09T15:07:36.783640+0000","last_fullsized":"2024-03-09T15:07:36.783640+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-03-09T15:07:36.783400+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-03-09T15:07:36.783400+0000","last_clean_scrub_stamp":"2024-03-09T15:07:36.783400+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:22:53.289585+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2346,"num_read_kb":2237,"num_write":463,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'369","reported_seq":1138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:53.616443+0000","last_change":"2024-03-09T15:07:53.616443+0000","last_active":"2024-03-09T15:07:53.616443+0000","last_peered":"2024-03-09T15:07:53.616443+0000","last_clean":"2024-03-09T15:07:53.616443+0000","last_became_active":"2024-03-09T14:28:53.578574+0000","last_became_peered":"2024-03-09T14:28:53.578574+0000","last_unstale":"2024-03-09T15:07:53.616443+0000","last_undegraded":"2024-03-09T15:07:53.616443+0000","last_fullsized":"2024-03-09T15:07:53.616443+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-03-09T15:07:53.615959+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-03-09T15:07:53.615959+0000","last_clean_scrub_stamp":"2024-03-09T15:07:53.615959+0000","objects_scrubbed":7,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:00:20.478126+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":269860,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":896,"num_read_kb":59109,"num_write":1337,"num_write_kb":49113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'697","reported_seq":2188,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.959079+0000","last_change":"2024-03-09T15:07:46.959143+0000","last_active":"2024-03-09T15:07:46.959079+0000","last_peered":"2024-03-09T15:07:46.959079+0000","last_clean":"2024-03-09T15:07:46.959079+0000","last_became_active":"2024-03-09T14:28:55.596637+0000","last_became_peered":"2024-03-09T14:28:55.596637+0000","last_unstale":"2024-03-09T15:07:46.959079+0000","last_undegraded":"2024-03-09T15:07:46.959079+0000","last_fullsized":"2024-03-09T15:07:46.959079+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'697","last_scrub_stamp":"2024-03-09T15:07:46.958846+0000","last_deep_scrub":"264'697","last_deep_scrub_stamp":"2024-03-09T15:07:46.958846+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.958846+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":600,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:40:48.271858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3232,"num_read_kb":2910,"num_write":917,"num_write_kb":327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'266","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:05.062484+0000","last_change":"2024-03-09T15:08:05.062692+0000","last_active":"2024-03-09T15:08:05.062484+0000","last_peered":"2024-03-09T15:08:05.062484+0000","last_clean":"2024-03-09T15:08:05.062484+0000","last_became_active":"2024-03-09T14:28:53.577994+0000","last_became_peered":"2024-03-09T14:28:53.577994+0000","last_unstale":"2024-03-09T15:08:05.062484+0000","last_undegraded":"2024-03-09T15:08:05.062484+0000","last_fullsized":"2024-03-09T15:08:05.062484+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'266","last_scrub_stamp":"2024-03-09T15:08:05.062247+0000","last_deep_scrub":"264'266","last_deep_scrub_stamp":"2024-03-09T15:08:05.062247+0000","last_clean_scrub_stamp":"2024-03-09T15:08:05.062247+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:20:45.279033+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22703,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":387,"num_read_kb":10775,"num_write":997,"num_write_kb":27369,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,7],"acting":[3,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'1035","reported_seq":2420,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:30.737283+0000","last_change":"2024-03-09T15:07:30.737283+0000","last_active":"2024-03-09T15:07:30.737283+0000","last_peered":"2024-03-09T15:07:30.737283+0000","last_clean":"2024-03-09T15:07:30.737283+0000","last_became_active":"2024-03-09T14:28:55.598235+0000","last_became_peered":"2024-03-09T14:28:55.598235+0000","last_unstale":"2024-03-09T15:07:30.737283+0000","last_undegraded":"2024-03-09T15:07:30.737283+0000","last_fullsized":"2024-03-09T15:07:30.737283+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1035","last_scrub_stamp":"2024-03-09T15:07:30.737007+0000","last_deep_scrub":"264'1035","last_deep_scrub_stamp":"2024-03-09T15:07:30.737007+0000","last_clean_scrub_stamp":"2024-03-09T15:07:30.737007+0000","objects_scrubbed":1,"log_size":35,"log_dups_size":1000,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:14:31.427701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4348,"num_read_kb":3780,"num_write":1436,"num_write_kb":604,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'378","reported_seq":1074,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.699380+0000","last_change":"2024-03-09T15:07:41.699380+0000","last_active":"2024-03-09T15:07:41.699380+0000","last_peered":"2024-03-09T15:07:41.699380+0000","last_clean":"2024-03-09T15:07:41.699380+0000","last_became_active":"2024-03-09T14:28:53.591365+0000","last_became_peered":"2024-03-09T14:28:53.591365+0000","last_unstale":"2024-03-09T15:07:41.699380+0000","last_undegraded":"2024-03-09T15:07:41.699380+0000","last_fullsized":"2024-03-09T15:07:41.699380+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-03-09T15:07:41.699036+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-03-09T15:07:41.699036+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.699036+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:36:08.438868+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262246,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":674,"num_read_kb":645,"num_write":1631,"num_write_kb":21789,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,5],"acting":[1,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'477","reported_seq":1851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:24.034950+0000","last_change":"2024-03-09T15:07:24.034950+0000","last_active":"2024-03-09T15:07:24.034950+0000","last_peered":"2024-03-09T15:07:24.034950+0000","last_clean":"2024-03-09T15:07:24.034950+0000","last_became_active":"2024-03-09T14:29:28.738427+0000","last_became_peered":"2024-03-09T14:29:28.738427+0000","last_unstale":"2024-03-09T15:07:24.034950+0000","last_undegraded":"2024-03-09T15:07:24.034950+0000","last_fullsized":"2024-03-09T15:07:24.034950+0000","mapping_epoch":36,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'477","last_scrub_stamp":"2024-03-09T15:07:24.034674+0000","last_deep_scrub":"264'477","last_deep_scrub_stamp":"2024-03-09T15:07:24.034674+0000","last_clean_scrub_stamp":"2024-03-09T15:07:24.034674+0000","objects_scrubbed":1,"log_size":77,"log_dups_size":400,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:11:05.508803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2425,"num_read_kb":2201,"num_write":660,"num_write_kb":259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'336","reported_seq":1002,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:41.229156+0000","last_change":"2024-03-09T15:07:41.229156+0000","last_active":"2024-03-09T15:07:41.229156+0000","last_peered":"2024-03-09T15:07:41.229156+0000","last_clean":"2024-03-09T15:07:41.229156+0000","last_became_active":"2024-03-09T14:28:53.635866+0000","last_became_peered":"2024-03-09T14:28:53.635866+0000","last_unstale":"2024-03-09T15:07:41.229156+0000","last_undegraded":"2024-03-09T15:07:41.229156+0000","last_fullsized":"2024-03-09T15:07:41.229156+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-03-09T15:07:41.228798+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-03-09T15:07:41.228798+0000","last_clean_scrub_stamp":"2024-03-09T15:07:41.228798+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:53:45.772020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049633,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":549,"num_read_kb":68120,"num_write":1314,"num_write_kb":51277,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,5],"acting":[6,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'627","reported_seq":2305,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:28.266429+0000","last_change":"2024-03-09T15:07:28.266429+0000","last_active":"2024-03-09T15:07:28.266429+0000","last_peered":"2024-03-09T15:07:28.266429+0000","last_clean":"2024-03-09T15:07:28.266429+0000","last_became_active":"2024-03-09T14:28:55.596430+0000","last_became_peered":"2024-03-09T14:28:55.596430+0000","last_unstale":"2024-03-09T15:07:28.266429+0000","last_undegraded":"2024-03-09T15:07:28.266429+0000","last_fullsized":"2024-03-09T15:07:28.266429+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'627","last_scrub_stamp":"2024-03-09T15:07:28.266175+0000","last_deep_scrub":"264'627","last_deep_scrub_stamp":"2024-03-09T15:07:28.266175+0000","last_clean_scrub_stamp":"2024-03-09T15:07:28.266175+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":600,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:02:30.550543+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3224,"num_read_kb":2919,"num_write":927,"num_write_kb":429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'306","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:06.088515+0000","last_change":"2024-03-09T15:08:06.088753+0000","last_active":"2024-03-09T15:08:06.088515+0000","last_peered":"2024-03-09T15:08:06.088515+0000","last_clean":"2024-03-09T15:08:06.088515+0000","last_became_active":"2024-03-09T14:28:53.584780+0000","last_became_peered":"2024-03-09T14:28:53.584780+0000","last_unstale":"2024-03-09T15:08:06.088515+0000","last_undegraded":"2024-03-09T15:08:06.088515+0000","last_fullsized":"2024-03-09T15:08:06.088515+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-03-09T15:08:06.088202+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-03-09T15:08:06.088202+0000","last_clean_scrub_stamp":"2024-03-09T15:08:06.088202+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:09:46.396051+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262191,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":406,"num_read_kb":4504,"num_write":1224,"num_write_kb":43139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'1140","reported_seq":2652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.662771+0000","last_change":"2024-03-09T15:07:46.662771+0000","last_active":"2024-03-09T15:07:46.662771+0000","last_peered":"2024-03-09T15:07:46.662771+0000","last_clean":"2024-03-09T15:07:46.662771+0000","last_became_active":"2024-03-09T14:28:55.582655+0000","last_became_peered":"2024-03-09T14:28:55.582655+0000","last_unstale":"2024-03-09T15:07:46.662771+0000","last_undegraded":"2024-03-09T15:07:46.662771+0000","last_fullsized":"2024-03-09T15:07:46.662771+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1140","last_scrub_stamp":"2024-03-09T15:07:46.662508+0000","last_deep_scrub":"264'1140","last_deep_scrub_stamp":"2024-03-09T15:07:46.662508+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.662508+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":1100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T02:55:19.168051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4834,"num_read_kb":4203,"num_write":1586,"num_write_kb":665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'421","reported_seq":1132,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:49.518327+0000","last_change":"2024-03-09T15:07:49.518327+0000","last_active":"2024-03-09T15:07:49.518327+0000","last_peered":"2024-03-09T15:07:49.518327+0000","last_clean":"2024-03-09T15:07:49.518327+0000","last_became_active":"2024-03-09T14:28:53.626746+0000","last_became_peered":"2024-03-09T14:28:53.626746+0000","last_unstale":"2024-03-09T15:07:49.518327+0000","last_undegraded":"2024-03-09T15:07:49.518327+0000","last_fullsized":"2024-03-09T15:07:49.518327+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'421","last_scrub_stamp":"2024-03-09T15:07:49.517967+0000","last_deep_scrub":"264'421","last_deep_scrub_stamp":"2024-03-09T15:07:49.517967+0000","last_clean_scrub_stamp":"2024-03-09T15:07:49.517967+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:24:49.761015+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262222,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":818,"num_read_kb":5936,"num_write":1494,"num_write_kb":27133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2,6],"acting":[5,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'406","reported_seq":2044,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.756486+0000","last_change":"2024-03-09T15:07:37.756486+0000","last_active":"2024-03-09T15:07:37.756486+0000","last_peered":"2024-03-09T15:07:37.756486+0000","last_clean":"2024-03-09T15:07:37.756486+0000","last_became_active":"2024-03-09T14:28:55.574723+0000","last_became_peered":"2024-03-09T14:28:55.574723+0000","last_unstale":"2024-03-09T15:07:37.756486+0000","last_undegraded":"2024-03-09T15:07:37.756486+0000","last_fullsized":"2024-03-09T15:07:37.756486+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'406","last_scrub_stamp":"2024-03-09T15:07:37.756246+0000","last_deep_scrub":"264'406","last_deep_scrub_stamp":"2024-03-09T15:07:37.756246+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.756246+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:58:40.677052+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2270,"num_read_kb":2181,"num_write":450,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'371","reported_seq":1257,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:08:02.100824+0000","last_change":"2024-03-09T15:08:02.100997+0000","last_active":"2024-03-09T15:08:02.100824+0000","last_peered":"2024-03-09T15:08:02.100824+0000","last_clean":"2024-03-09T15:08:02.100824+0000","last_became_active":"2024-03-09T14:28:53.564605+0000","last_became_peered":"2024-03-09T14:28:53.564605+0000","last_unstale":"2024-03-09T15:08:02.100824+0000","last_undegraded":"2024-03-09T15:08:02.100824+0000","last_fullsized":"2024-03-09T15:08:02.100824+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'371","last_scrub_stamp":"2024-03-09T15:08:02.100622+0000","last_deep_scrub":"264'371","last_deep_scrub_stamp":"2024-03-09T15:08:02.100622+0000","last_clean_scrub_stamp":"2024-03-09T15:08:02.100622+0000","objects_scrubbed":10,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:46:34.440289+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":894,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":1026,"num_read_kb":12227,"num_write":1373,"num_write_kb":35283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'476","reported_seq":2104,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.574007+0000","last_change":"2024-03-09T15:07:32.574074+0000","last_active":"2024-03-09T15:07:32.574007+0000","last_peered":"2024-03-09T15:07:32.574007+0000","last_clean":"2024-03-09T15:07:32.574007+0000","last_became_active":"2024-03-09T14:28:55.596007+0000","last_became_peered":"2024-03-09T14:28:55.596007+0000","last_unstale":"2024-03-09T15:07:32.574007+0000","last_undegraded":"2024-03-09T15:07:32.574007+0000","last_fullsized":"2024-03-09T15:07:32.574007+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'476","last_scrub_stamp":"2024-03-09T15:07:32.573821+0000","last_deep_scrub":"264'476","last_deep_scrub_stamp":"2024-03-09T15:07:32.573821+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.573821+0000","objects_scrubbed":2,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:44:44.602915+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2627,"num_read_kb":2464,"num_write":596,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2809,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'263","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.551083+0000","last_change":"2024-03-09T15:07:38.551163+0000","last_active":"2024-03-09T15:07:38.551083+0000","last_peered":"2024-03-09T15:07:38.551083+0000","last_clean":"2024-03-09T15:07:38.551083+0000","last_became_active":"2024-03-09T14:28:53.637905+0000","last_became_peered":"2024-03-09T14:28:53.637905+0000","last_unstale":"2024-03-09T15:07:38.551083+0000","last_undegraded":"2024-03-09T15:07:38.551083+0000","last_fullsized":"2024-03-09T15:07:38.551083+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'263","last_scrub_stamp":"2024-03-09T15:07:38.550886+0000","last_deep_scrub":"264'263","last_deep_scrub_stamp":"2024-03-09T15:07:38.550886+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.550886+0000","objects_scrubbed":2,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T19:31:06.940143+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262159,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":369,"num_read_kb":388,"num_write":1032,"num_write_kb":15956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,3],"acting":[5,7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'869","reported_seq":2416,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.773222+0000","last_change":"2024-03-09T15:07:29.773298+0000","last_active":"2024-03-09T15:07:29.773222+0000","last_peered":"2024-03-09T15:07:29.773222+0000","last_clean":"2024-03-09T15:07:29.773222+0000","last_became_active":"2024-03-09T14:28:55.589596+0000","last_became_peered":"2024-03-09T14:28:55.589596+0000","last_unstale":"2024-03-09T15:07:29.773222+0000","last_undegraded":"2024-03-09T15:07:29.773222+0000","last_fullsized":"2024-03-09T15:07:29.773222+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'869","last_scrub_stamp":"2024-03-09T15:07:29.773012+0000","last_deep_scrub":"264'869","last_deep_scrub_stamp":"2024-03-09T15:07:29.773012+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.773012+0000","objects_scrubbed":4,"log_size":69,"log_dups_size":800,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T01:16:43.898214+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4032,"num_read_kb":3559,"num_write":1203,"num_write_kb":491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":310,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'316","reported_seq":1064,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:52.632231+0000","last_change":"2024-03-09T15:07:52.632322+0000","last_active":"2024-03-09T15:07:52.632231+0000","last_peered":"2024-03-09T15:07:52.632231+0000","last_clean":"2024-03-09T15:07:52.632231+0000","last_became_active":"2024-03-09T14:28:53.626673+0000","last_became_peered":"2024-03-09T14:28:53.626673+0000","last_unstale":"2024-03-09T15:07:52.632231+0000","last_undegraded":"2024-03-09T15:07:52.632231+0000","last_fullsized":"2024-03-09T15:07:52.632231+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-03-09T15:07:52.632033+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-03-09T15:07:52.632033+0000","last_clean_scrub_stamp":"2024-03-09T15:07:52.632033+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:17:12.432663+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":573,"num_read_kb":94146,"num_write":1092,"num_write_kb":28965,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,6],"acting":[0,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'474","reported_seq":1994,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.959577+0000","last_change":"2024-03-09T15:07:37.959645+0000","last_active":"2024-03-09T15:07:37.959577+0000","last_peered":"2024-03-09T15:07:37.959577+0000","last_clean":"2024-03-09T15:07:37.959577+0000","last_became_active":"2024-03-09T14:28:55.610314+0000","last_became_peered":"2024-03-09T14:28:55.610314+0000","last_unstale":"2024-03-09T15:07:37.959577+0000","last_undegraded":"2024-03-09T15:07:37.959577+0000","last_fullsized":"2024-03-09T15:07:37.959577+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'474","last_scrub_stamp":"2024-03-09T15:07:37.959395+0000","last_deep_scrub":"264'474","last_deep_scrub_stamp":"2024-03-09T15:07:37.959395+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.959395+0000","objects_scrubbed":4,"log_size":74,"log_dups_size":400,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T18:05:39.306030+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2645,"num_read_kb":2435,"num_write":625,"num_write_kb":186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'356","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:37.243758+0000","last_change":"2024-03-09T15:07:37.243890+0000","last_active":"2024-03-09T15:07:37.243758+0000","last_peered":"2024-03-09T15:07:37.243758+0000","last_clean":"2024-03-09T15:07:37.243758+0000","last_became_active":"2024-03-09T14:28:53.631327+0000","last_became_peered":"2024-03-09T14:28:53.631327+0000","last_unstale":"2024-03-09T15:07:37.243758+0000","last_undegraded":"2024-03-09T15:07:37.243758+0000","last_fullsized":"2024-03-09T15:07:37.243758+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-03-09T15:07:37.243537+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-03-09T15:07:37.243537+0000","last_clean_scrub_stamp":"2024-03-09T15:07:37.243537+0000","objects_scrubbed":7,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:57:08.377852+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655861,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":582,"num_read_kb":48859,"num_write":1226,"num_write_kb":49653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'389","reported_seq":1882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:42.751998+0000","last_change":"2024-03-09T15:07:42.752137+0000","last_active":"2024-03-09T15:07:42.751998+0000","last_peered":"2024-03-09T15:07:42.751998+0000","last_clean":"2024-03-09T15:07:42.751998+0000","last_became_active":"2024-03-09T14:28:55.587355+0000","last_became_peered":"2024-03-09T14:28:55.587355+0000","last_unstale":"2024-03-09T15:07:42.751998+0000","last_undegraded":"2024-03-09T15:07:42.751998+0000","last_fullsized":"2024-03-09T15:07:42.751998+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'389","last_scrub_stamp":"2024-03-09T15:07:42.751743+0000","last_deep_scrub":"264'389","last_deep_scrub_stamp":"2024-03-09T15:07:42.751743+0000","last_clean_scrub_stamp":"2024-03-09T15:07:42.751743+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:32:06.938642+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2078,"num_read_kb":1975,"num_write":455,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'395","reported_seq":1057,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.912024+0000","last_change":"2024-03-09T15:07:51.912158+0000","last_active":"2024-03-09T15:07:51.912024+0000","last_peered":"2024-03-09T15:07:51.912024+0000","last_clean":"2024-03-09T15:07:51.912024+0000","last_became_active":"2024-03-09T14:28:53.622624+0000","last_became_peered":"2024-03-09T14:28:53.622624+0000","last_unstale":"2024-03-09T15:07:51.912024+0000","last_undegraded":"2024-03-09T15:07:51.912024+0000","last_fullsized":"2024-03-09T15:07:51.912024+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-03-09T15:07:51.911822+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-03-09T15:07:51.911822+0000","last_clean_scrub_stamp":"2024-03-09T15:07:51.911822+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T21:39:29.808921+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262192,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":653,"num_read_kb":22046,"num_write":1243,"num_write_kb":48993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,6,3],"acting":[7,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'1101","reported_seq":2585,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:51.994450+0000","last_change":"2024-03-09T15:07:51.994520+0000","last_active":"2024-03-09T15:07:51.994450+0000","last_peered":"2024-03-09T15:07:51.994450+0000","last_clean":"2024-03-09T15:07:51.994450+0000","last_became_active":"2024-03-09T14:28:55.582143+0000","last_became_peered":"2024-03-09T14:28:55.582143+0000","last_unstale":"2024-03-09T15:07:51.994450+0000","last_undegraded":"2024-03-09T15:07:51.994450+0000","last_fullsized":"2024-03-09T15:07:51.994450+0000","mapping_epoch":25,"log_start":"264'1000","ondisk_log_start":"264'1000","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1101","last_scrub_stamp":"2024-03-09T15:07:51.994225+0000","last_deep_scrub":"264'1101","last_deep_scrub_stamp":"2024-03-09T15:07:51.994225+0000","last_clean_scrub_stamp":"2024-03-09T15:07:51.994225+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":1000,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T15:13:21.082744+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4588,"num_read_kb":3996,"num_write":1519,"num_write_kb":624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'363","reported_seq":1098,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:29.530760+0000","last_change":"2024-03-09T15:07:29.530760+0000","last_active":"2024-03-09T15:07:29.530760+0000","last_peered":"2024-03-09T15:07:29.530760+0000","last_clean":"2024-03-09T15:07:29.530760+0000","last_became_active":"2024-03-09T14:28:53.633121+0000","last_became_peered":"2024-03-09T14:28:53.633121+0000","last_unstale":"2024-03-09T15:07:29.530760+0000","last_undegraded":"2024-03-09T15:07:29.530760+0000","last_fullsized":"2024-03-09T15:07:29.530760+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'363","last_scrub_stamp":"2024-03-09T15:07:29.530472+0000","last_deep_scrub":"264'363","last_deep_scrub_stamp":"2024-03-09T15:07:29.530472+0000","last_clean_scrub_stamp":"2024-03-09T15:07:29.530472+0000","objects_scrubbed":7,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T20:42:58.011768+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3312503,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":707,"num_read_kb":9275,"num_write":1371,"num_write_kb":66964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,1,7],"acting":[2,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'678","reported_seq":2126,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.948685+0000","last_change":"2024-03-09T15:07:39.948685+0000","last_active":"2024-03-09T15:07:39.948685+0000","last_peered":"2024-03-09T15:07:39.948685+0000","last_clean":"2024-03-09T15:07:39.948685+0000","last_became_active":"2024-03-09T14:28:55.601622+0000","last_became_peered":"2024-03-09T14:28:55.601622+0000","last_unstale":"2024-03-09T15:07:39.948685+0000","last_undegraded":"2024-03-09T15:07:39.948685+0000","last_fullsized":"2024-03-09T15:07:39.948685+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'678","last_scrub_stamp":"2024-03-09T15:07:39.948430+0000","last_deep_scrub":"264'678","last_deep_scrub_stamp":"2024-03-09T15:07:39.948430+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.948430+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":600,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T23:45:16.720446+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3103,"num_read_kb":2796,"num_write":889,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'405","reported_seq":1140,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:21.604375+0000","last_change":"2024-03-09T15:07:21.604740+0000","last_active":"2024-03-09T15:07:21.604375+0000","last_peered":"2024-03-09T15:07:21.604375+0000","last_clean":"2024-03-09T15:07:21.604375+0000","last_became_active":"2024-03-09T14:29:28.827826+0000","last_became_peered":"2024-03-09T14:29:28.827826+0000","last_unstale":"2024-03-09T15:07:21.604375+0000","last_undegraded":"2024-03-09T15:07:21.604375+0000","last_fullsized":"2024-03-09T15:07:21.604375+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-03-09T15:07:21.604112+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-03-09T15:07:21.604112+0000","last_clean_scrub_stamp":"2024-03-09T15:07:21.604112+0000","objects_scrubbed":10,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T17:36:26.048379+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1918827,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":881,"num_read_kb":41003,"num_write":1564,"num_write_kb":37571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.30","version":"264'297","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:46.549879+0000","last_change":"2024-03-09T15:07:46.549960+0000","last_active":"2024-03-09T15:07:46.549879+0000","last_peered":"2024-03-09T15:07:46.549879+0000","last_clean":"2024-03-09T15:07:46.549879+0000","last_became_active":"2024-03-09T14:28:53.602502+0000","last_became_peered":"2024-03-09T14:28:53.602502+0000","last_unstale":"2024-03-09T15:07:46.549879+0000","last_undegraded":"2024-03-09T15:07:46.549879+0000","last_fullsized":"2024-03-09T15:07:46.549879+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'297","last_scrub_stamp":"2024-03-09T15:07:46.549673+0000","last_deep_scrub":"264'297","last_deep_scrub_stamp":"2024-03-09T15:07:46.549673+0000","last_clean_scrub_stamp":"2024-03-09T15:07:46.549673+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-11T00:19:30.953593+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":396,"num_read_kb":11977,"num_write":1066,"num_write_kb":41245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,7],"acting":[5,1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"264'858","reported_seq":2316,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:38.751039+0000","last_change":"2024-03-09T15:07:38.751039+0000","last_active":"2024-03-09T15:07:38.751039+0000","last_peered":"2024-03-09T15:07:38.751039+0000","last_clean":"2024-03-09T15:07:38.751039+0000","last_became_active":"2024-03-09T14:28:55.601537+0000","last_became_peered":"2024-03-09T14:28:55.601537+0000","last_unstale":"2024-03-09T15:07:38.751039+0000","last_undegraded":"2024-03-09T15:07:38.751039+0000","last_fullsized":"2024-03-09T15:07:38.751039+0000","mapping_epoch":25,"log_start":"264'800","ondisk_log_start":"264'800","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'858","last_scrub_stamp":"2024-03-09T15:07:38.750716+0000","last_deep_scrub":"264'858","last_deep_scrub_stamp":"2024-03-09T15:07:38.750716+0000","last_clean_scrub_stamp":"2024-03-09T15:07:38.750716+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":800,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:01:30.209754+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3890,"num_read_kb":3404,"num_write":1199,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":504,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'348","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:39.714091+0000","last_change":"2024-03-09T15:07:39.714220+0000","last_active":"2024-03-09T15:07:39.714091+0000","last_peered":"2024-03-09T15:07:39.714091+0000","last_clean":"2024-03-09T15:07:39.714091+0000","last_became_active":"2024-03-09T14:28:53.588717+0000","last_became_peered":"2024-03-09T14:28:53.588717+0000","last_unstale":"2024-03-09T15:07:39.714091+0000","last_undegraded":"2024-03-09T15:07:39.714091+0000","last_fullsized":"2024-03-09T15:07:39.714091+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'348","last_scrub_stamp":"2024-03-09T15:07:39.713890+0000","last_deep_scrub":"264'348","last_deep_scrub_stamp":"2024-03-09T15:07:39.713890+0000","last_clean_scrub_stamp":"2024-03-09T15:07:39.713890+0000","objects_scrubbed":12,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T22:45:51.804676+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":286749,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":569,"num_read_kb":5745,"num_write":1174,"num_write_kb":28449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,5,0],"acting":[1,4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'1156","reported_seq":2693,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-03-09T15:07:32.497285+0000","last_change":"2024-03-09T15:07:32.497285+0000","last_active":"2024-03-09T15:07:32.497285+0000","last_peered":"2024-03-09T15:07:32.497285+0000","last_clean":"2024-03-09T15:07:32.497285+0000","last_became_active":"2024-03-09T14:28:55.582541+0000","last_became_peered":"2024-03-09T14:28:55.582541+0000","last_unstale":"2024-03-09T15:07:32.497285+0000","last_undegraded":"2024-03-09T15:07:32.497285+0000","last_fullsized":"2024-03-09T15:07:32.497285+0000","mapping_epoch":25,"log_start":"264'1100","ondisk_log_start":"264'1100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1156","last_scrub_stamp":"2024-03-09T15:07:32.497013+0000","last_deep_scrub":"264'1156","last_deep_scrub_stamp":"2024-03-09T15:07:32.497013+0000","last_clean_scrub_stamp":"2024-03-09T15:07:32.497013+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":1100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-10T16:00:11.099274+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4871,"num_read_kb":4234,"num_write":1610,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5930,"num_read_kb":4217,"num_write":2190,"num_write_kb":844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7263,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1125,"ondisk_log_size":1125,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":13413,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":15557,"num_read_kb":15326,"num_write":16235,"num_write_kb":4746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2284,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":499712,"data_stored":26826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1635,"ondisk_log_size":1635,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":433,"ondisk_log_size":433,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1466895,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":16241,"num_read_kb":34652,"num_write":13827,"num_write_kb":11138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":21,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":680820,"num_omap_keys":1580,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2038,"ondisk_log_size":2038,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1719,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1622,"num_read_kb":1927,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3438,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":194579,"num_read_kb":177681,"num_write":51390,"num_write_kb":17534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":132,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":33323,"num_omap_keys":138,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4093,"ondisk_log_size":4093,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":142827823,"num_objects":361,"num_object_clones":0,"num_object_copies":1444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":361,"num_whiteouts":0,"num_read":34808,"num_read_kb":1970678,"num_write":77579,"num_write_kb":2252311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":193282048,"data_stored":193282048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3795,"ondisk_log_size":3795,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":136,"num_read_kb":180405,"num_write":150,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":133,"num_read_kb":177288,"num_write":150,"num_write_kb":115840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33554432,"data_stored":33554432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575334,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":360960,"kb_used_data":41016,"kb_used_omap":1,"kb_used_meta":319934,"kb_avail":94010880,"statfs":{"total":96636764160,"available":96267141120,"internally_reserved":0,"allocated":42000384,"data_stored":40009750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":327612874},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575331,"num_pgs":108,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":346200,"kb_used_data":35984,"kb_used_omap":1,"kb_used_meta":310206,"kb_avail":94025640,"statfs":{"total":96636764160,"available":96282255360,"internally_reserved":0,"allocated":36847616,"data_stored":34892402,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":317651398},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575334,"num_pgs":114,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":176544,"kb_used_data":41304,"kb_used_omap":1,"kb_used_meta":135230,"kb_avail":94195296,"statfs":{"total":96636764160,"available":96455983104,"internally_reserved":0,"allocated":42295296,"data_stored":40303321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":138475973},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575332,"num_pgs":113,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177632,"kb_used_data":43736,"kb_used_omap":1,"kb_used_meta":133886,"kb_avail":94194208,"statfs":{"total":96636764160,"available":96454868992,"internally_reserved":0,"allocated":44785664,"data_stored":42869751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":137099717},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575333,"num_pgs":130,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301360,"kb_used_data":35560,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94070480,"statfs":{"total":96636764160,"available":96328171520,"internally_reserved":0,"allocated":36413440,"data_stored":34419369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":272169415},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575330,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":135436,"kb_used_data":27908,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94236404,"statfs":{"total":96636764160,"available":96498077696,"internally_reserved":0,"allocated":28577792,"data_stored":26654129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575333,"num_pgs":119,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":209596,"kb_used_data":34100,"kb_used_omap":1,"kb_used_meta":175486,"kb_avail":94162244,"statfs":{"total":96636764160,"available":96422137856,"internally_reserved":0,"allocated":34918400,"data_stored":32958583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":179698117},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575331,"num_pgs":116,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":294704,"kb_used_data":28904,"kb_used_omap":1,"kb_used_meta":265790,"kb_avail":94077136,"statfs":{"total":96636764160,"available":96334987264,"internally_reserved":0,"allocated":29597696,"data_stored":27607131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":272169413},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":23699456,"data_stored":23699456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24399872,"data_stored":24399872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":19144704,"data_stored":19144704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":21663744,"data_stored":21663744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24875008,"data_stored":24875008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21258240,"data_stored":21258240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":27381760,"data_stored":27381760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":30859264,"data_stored":30859264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":3980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-09T15:08:35.008 DEBUG:teuthology.orchestra.run.smithi099:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-09T15:08:35.355 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-09T15:08:35.356 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-09T15:08:35.356 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-09T15:08:35.356 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:08:39.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-03-09T15:08:41.458 INFO:tasks.ceph.osd.0:Stopped 2024-03-09T15:08:41.459 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-09T15:08:41.459 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:08:45.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-03-09T15:08:45.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-03-09T15:08:47.561 INFO:tasks.ceph.osd.1:Stopped 2024-03-09T15:08:47.561 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-09T15:08:47.561 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:08:47.643 INFO:tasks.ceph.osd.2:Stopped 2024-03-09T15:08:47.643 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-09T15:08:47.644 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:08:51.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-03-09T15:08:51.563 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-03-09T15:08:53.745 INFO:tasks.ceph.osd.3:Stopped 2024-03-09T15:08:53.746 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-09T15:08:53.746 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:08:53.825 INFO:tasks.ceph.osd.4:Stopped 2024-03-09T15:08:53.826 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-09T15:08:53.826 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:08:57.269 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-03-09T15:08:57.269 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-03-09T15:08:59.928 INFO:tasks.ceph.osd.5:Stopped 2024-03-09T15:08:59.929 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-09T15:08:59.929 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:09:00.005 INFO:tasks.ceph.osd.6:Stopped 2024-03-09T15:09:00.006 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-09T15:09:00.006 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:09:02.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-03-09T15:09:02.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-03-09T15:09:06.107 INFO:tasks.ceph.osd.7:Stopped 2024-03-09T15:09:06.108 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-09T15:09:06.108 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-09T15:09:06.108 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:09:06.140 INFO:tasks.ceph.mgr.y:Stopped 2024-03-09T15:09:06.140 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-09T15:09:06.140 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:09:06.168 INFO:tasks.ceph.mgr.x:Stopped 2024-03-09T15:09:06.169 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-09T15:09:06.169 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-09T15:09:06.169 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:09:06.202 INFO:tasks.ceph.mon.a:Stopped 2024-03-09T15:09:06.203 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-09T15:09:06.203 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:09:06.257 INFO:tasks.ceph.mon.c:Stopped 2024-03-09T15:09:06.258 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-09T15:09:06.258 INFO:teuthology.orchestra.run:waiting for 300 2024-03-09T15:09:06.278 INFO:tasks.ceph.mon.b:Stopped 2024-03-09T15:09:06.278 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-09T15:09:06.278 DEBUG:teuthology.orchestra.run.smithi099:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-03-09T15:09:06.314 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi099.front.sepia.ceph.com 2024-03-09T15:09:06.314 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-09T15:09:06.620 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi099.front.sepia.ceph.com 2024-03-09T15:09:06.621 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-09T15:09:06.847 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi099.front.sepia.ceph.com 2024-03-09T15:09:06.848 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-09T15:09:07.002 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi099.front.sepia.ceph.com 2024-03-09T15:09:07.002 DEBUG:teuthology.orchestra.run.smithi099:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-09T15:09:07.179 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi179.front.sepia.ceph.com 2024-03-09T15:09:07.179 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-09T15:09:07.540 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi179.front.sepia.ceph.com 2024-03-09T15:09:07.540 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-09T15:09:07.683 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi179.front.sepia.ceph.com 2024-03-09T15:09:07.683 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-09T15:09:07.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-03-09T15:09:07.845 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi179.front.sepia.ceph.com 2024-03-09T15:09:07.846 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-09T15:09:07.980 INFO:tasks.ceph:Archiving mon data... 2024-03-09T15:09:07.981 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588483/data/mon.a.tgz 2024-03-09T15:09:07.982 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-03-09T15:09:07.988 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.sYhwcsoZ8a 2024-03-09T15:09:07.988 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.sYhwcsoZ8a 2024-03-09T15:09:08.173 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.sYhwcsoZ8a 2024-03-09T15:09:08.238 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.sYhwcsoZ8a is 554KB 2024-03-09T15:09:08.302 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.sYhwcsoZ8a 2024-03-09T15:09:08.307 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588483/data/mon.c.tgz 2024-03-09T15:09:08.308 DEBUG:teuthology.orchestra.run.smithi099:> mktemp 2024-03-09T15:09:08.356 INFO:teuthology.orchestra.run.smithi099.stdout:/tmp/tmp.0oT45GUTl9 2024-03-09T15:09:08.357 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.0oT45GUTl9 2024-03-09T15:09:08.554 DEBUG:teuthology.orchestra.run.smithi099:> sudo chmod 0666 /tmp/tmp.0oT45GUTl9 2024-03-09T15:09:08.616 DEBUG:teuthology.orchestra.remote:smithi099:/tmp/tmp.0oT45GUTl9 is 569KB 2024-03-09T15:09:08.678 DEBUG:teuthology.orchestra.run.smithi099:> rm -fr /tmp/tmp.0oT45GUTl9 2024-03-09T15:09:08.683 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588483/data/mon.b.tgz 2024-03-09T15:09:08.684 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-03-09T15:09:08.689 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.wmNmcQp4Jt 2024-03-09T15:09:08.690 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.wmNmcQp4Jt 2024-03-09T15:09:08.880 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.wmNmcQp4Jt 2024-03-09T15:09:08.940 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.wmNmcQp4Jt is 569KB 2024-03-09T15:09:09.003 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.wmNmcQp4Jt 2024-03-09T15:09:09.008 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-09T15:09:09.008 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-09T15:09:09.010 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-09T15:09:09.070 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-09T15:09:09.113 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-09T15:09:09.113 INFO:tasks.ceph:Archiving crash dumps... 2024-03-09T15:09:09.115 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588483/remote/smithi099/crash 2024-03-09T15:09:09.116 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-09T15:09:09.129 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588483/remote/smithi179/crash 2024-03-09T15:09:09.130 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-09T15:09:09.169 INFO:tasks.ceph:Compressing logs... 2024-03-09T15:09:09.169 DEBUG:teuthology.orchestra.run.smithi099:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-09T15:09:09.173 DEBUG:teuthology.orchestra.run.smithi179:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-09T15:09:09.197 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109185.log 2024-03-09T15:09:09.198 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56636.log 2024-03-09T15:09:09.198 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.109185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135048.log 2024-03-09T15:09:09.199 INFO:teuthology.orchestra.run.smithi099.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.109185.log.gz 2024-03-09T15:09:09.199 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56636.log: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.56636.log.gz 2024-03-09T15:09:09.199 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-03-09T15:09:09.199 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31247.log 2024-03-09T15:09:09.202 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135048.log: /var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135282.log 2024-03-09T15:09:09.202 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135048.log.gz 2024-03-09T15:09:09.202 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31247.log.gz 2024-03-09T15:09:09.202 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36568.log 2024-03-09T15:09:09.202 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135490.log 2024-03-09T15:09:09.202 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135282.log.gz 2024-03-09T15:09:09.202 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.36568.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.36568.log.gz 2024-03-09T15:09:09.203 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120080.log 2024-03-09T15:09:09.203 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31466.log 2024-03-09T15:09:09.203 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135490.log.gz 2024-03-09T15:09:09.203 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.120080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.124508.log 2024-03-09T15:09:09.206 INFO:teuthology.orchestra.run.smithi099.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.120080.log.gz 2024-03-09T15:09:09.206 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31466.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-09T15:09:09.206 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31466.log.gz 2024-03-09T15:09:09.206 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.124508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55706.log 2024-03-09T15:09:09.207 INFO:teuthology.orchestra.run.smithi099.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.124508.log.gz 2024-03-09T15:09:09.207 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51785.log 2024-03-09T15:09:09.207 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31153.log 2024-03-09T15:09:09.207 INFO:teuthology.orchestra.run.smithi099.stderr: 57.5% -- replaced with /var/log/ceph/ceph-client.admin.55706.log.gz 2024-03-09T15:09:09.207 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31205.log 2024-03-09T15:09:09.207 INFO:teuthology.orchestra.run.smithi099.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.51785.log.gz 2024-03-09T15:09:09.207 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31153.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.31153.log.gz --verbose 2024-03-09T15:09:09.207 INFO:teuthology.orchestra.run.smithi099.stderr: -- /var/log/ceph/ceph-client.admin.67022.log 2024-03-09T15:09:09.208 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114597.log 2024-03-09T15:09:09.208 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31205.log.gz 2024-03-09T15:09:09.208 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.67022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54785.log 2024-03-09T15:09:09.208 INFO:teuthology.orchestra.run.smithi099.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.67022.log.gz 2024-03-09T15:09:09.208 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.114597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31692.log 2024-03-09T15:09:09.208 INFO:teuthology.orchestra.run.smithi099.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.114597.log.gz 2024-03-09T15:09:09.208 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.54785.log: -- /var/log/ceph/ceph-client.0.129820.log 2024-03-09T15:09:09.212 INFO:teuthology.orchestra.run.smithi099.stderr:gzip 82.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.54785.log.gz -- 2024-03-09T15:09:09.212 INFO:teuthology.orchestra.run.smithi099.stderr: /var/log/ceph/ceph-client.admin.57288.log 2024-03-09T15:09:09.213 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31692.log.gz 2024-03-09T15:09:09.213 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.129820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72578.log 2024-03-09T15:09:09.213 INFO:teuthology.orchestra.run.smithi099.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.129820.log.gz 2024-03-09T15:09:09.213 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135100.log 2024-03-09T15:09:09.213 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96181.log 2024-03-09T15:09:09.213 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.72578.log: /var/log/ceph/ceph-client.admin.135100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135100.log.gz 2024-03-09T15:09:09.213 INFO:teuthology.orchestra.run.smithi099.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.72578.log.gz 2024-03-09T15:09:09.214 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55977.log 2024-03-09T15:09:09.214 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63719.log 2024-03-09T15:09:09.214 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.96181.log: /var/log/ceph/ceph-client.admin.55977.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-09T15:09:09.214 INFO:teuthology.orchestra.run.smithi099.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.96181.log.gz 2024-03-09T15:09:09.214 INFO:teuthology.orchestra.run.smithi099.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.55977.log.gz 2024-03-09T15:09:09.214 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31179.log 2024-03-09T15:09:09.214 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113390.log 2024-03-09T15:09:09.214 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.31179.log: /var/log/ceph/ceph-client.admin.135334.log 2024-03-09T15:09:09.214 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31179.log.gz 2024-03-09T15:09:09.215 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.113390.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.63719.log.gz 2024-03-09T15:09:09.215 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113390.log.gz 2024-03-09T15:09:09.215 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111545.log 2024-03-09T15:09:09.215 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135334.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135334.log.gz -5 2024-03-09T15:09:09.215 INFO:teuthology.orchestra.run.smithi099.stderr: --verbose -- /var/log/ceph/ceph-client.admin.113415.log 2024-03-09T15:09:09.215 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97361.log 2024-03-09T15:09:09.215 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.111545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111545.log.gz 2024-03-09T15:09:09.215 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.113415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106213.log 2024-03-09T15:09:09.220 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.97361.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.113415.log.gz 2024-03-09T15:09:09.221 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86148.log 2024-03-09T15:09:09.221 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.106213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74348.log 2024-03-09T15:09:09.221 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.86148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56019.log 2024-03-09T15:09:09.221 INFO:teuthology.orchestra.run.smithi099.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.106213.log.gz 2024-03-09T15:09:09.221 INFO:teuthology.orchestra.run.smithi099.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.86148.log.gz 2024-03-09T15:09:09.221 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.74348.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.97361.log.gz 2024-03-09T15:09:09.221 INFO:teuthology.orchestra.run.smithi099.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.74348.log.gz 2024-03-09T15:09:09.221 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60503.log 2024-03-09T15:09:09.222 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.125100.log 2024-03-09T15:09:09.222 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56019.log.gz 2024-03-09T15:09:09.222 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.60503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53580.log 2024-03-09T15:09:09.222 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.125100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80248.log 2024-03-09T15:09:09.222 INFO:teuthology.orchestra.run.smithi099.stderr:gzip 84.4%/var/log/ceph/ceph-client.admin.53580.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.94411.log 2024-03-09T15:09:09.222 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.0.125100.log.gz 2024-03-09T15:09:09.222 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53580.log.gz 2024-03-09T15:09:09.222 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.80248.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.80248.log.gz 2024-03-09T15:09:09.223 INFO:teuthology.orchestra.run.smithi099.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60503.log.gz 2024-03-09T15:09:09.223 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.133581.log 2024-03-09T15:09:09.223 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.94411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59217.log 2024-03-09T15:09:09.223 INFO:teuthology.orchestra.run.smithi099.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.94411.log.gz 2024-03-09T15:09:09.223 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.133581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32962.log 2024-03-09T15:09:09.223 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32912.log 2024-03-09T15:09:09.223 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95591.log 2024-03-09T15:09:09.223 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32962.log.gz 2024-03-09T15:09:09.224 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32912.log.gz 2024-03-09T15:09:09.224 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45835.log 2024-03-09T15:09:09.231 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.95591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39114.log 2024-03-09T15:09:09.232 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.95591.log.gz/var/log/ceph/ceph-client.admin.45835.log: 2024-03-09T15:09:09.232 INFO:teuthology.orchestra.run.smithi099.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.45835.log.gz 2024-03-09T15:09:09.232 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31647.log 2024-03-09T15:09:09.232 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39114.log: 94.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44605.log 2024-03-09T15:09:09.232 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57288.log.gz 2024-03-09T15:09:09.232 INFO:teuthology.orchestra.run.smithi099.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.39114.log.gz 2024-03-09T15:09:09.232 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31647.log.gz 2024-03-09T15:09:09.233 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59860.log 2024-03-09T15:09:09.233 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.44605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64368.log 2024-03-09T15:09:09.233 INFO:teuthology.orchestra.run.smithi099.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.59217.log.gz 2024-03-09T15:09:09.233 INFO:teuthology.orchestra.run.smithi099.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.44605.log.gz 2024-03-09T15:09:09.233 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.59860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49375.log 2024-03-09T15:09:09.233 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.132180.log 2024-03-09T15:09:09.233 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.64368.log: 84.3%/var/log/ceph/ceph-client.admin.49375.log: -- replaced with /var/log/ceph/ceph-client.admin.64368.log.gz 2024-03-09T15:09:09.233 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44015.log 2024-03-09T15:09:09.233 INFO:teuthology.orchestra.run.smithi099.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.49375.log.gz 2024-03-09T15:09:09.234 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.132180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112775.log 2024-03-09T15:09:09.234 INFO:teuthology.orchestra.run.smithi099.stderr: 80.4%/var/log/ceph/ceph-client.admin.44015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99132.log 2024-03-09T15:09:09.234 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.0.132180.log.gz 2024-03-09T15:09:09.234 INFO:teuthology.orchestra.run.smithi099.stderr: 85.7%/var/log/ceph/ceph-client.admin.112775.log: -- replaced with /var/log/ceph/ceph-client.admin.44015.log.gz 2024-03-09T15:09:09.234 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135438.log 2024-03-09T15:09:09.234 INFO:teuthology.orchestra.run.smithi099.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112775.log.gz 2024-03-09T15:09:09.234 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.99132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74938.log 2024-03-09T15:09:09.234 INFO:teuthology.orchestra.run.smithi099.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.99132.log.gz 2024-03-09T15:09:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135438.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-09T15:09:09.235 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135438.log.gz 2024-03-09T15:09:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65840.log 2024-03-09T15:09:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.74938.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45220.log 2024-03-09T15:09:09.235 INFO:teuthology.orchestra.run.smithi099.stderr: 81.7%/var/log/ceph/ceph-client.admin.65840.log: -- replaced with /var/log/ceph/ceph-client.admin.74938.log.gz 2024-03-09T15:09:09.235 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71398.log 2024-03-09T15:09:09.235 INFO:teuthology.orchestra.run.smithi099.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.65840.log.gz 2024-03-09T15:09:09.235 INFO:teuthology.orchestra.run.smithi099.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.59860.log.gz 2024-03-09T15:09:09.236 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45220.log.gz 2024-03-09T15:09:09.236 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135256.log 2024-03-09T15:09:09.236 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.71398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87918.log 2024-03-09T15:09:09.236 INFO:teuthology.orchestra.run.smithi099.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.71398.log.gz 2024-03-09T15:09:09.236 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116085.log 2024-03-09T15:09:09.236 INFO:teuthology.orchestra.run.smithi099.stderr: 28.2% -- replaced with /var/log/ceph/ceph-client.admin.135256.log.gz 2024-03-09T15:09:09.236 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41605.log 2024-03-09T15:09:09.250 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-09T15:09:09.250 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-09T15:09:09.251 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-09T15:09:09.251 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25483.log 2024-03-09T15:09:09.251 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25555.log 2024-03-09T15:09:09.251 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.25483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25483.log.gz 2024-03-09T15:09:09.251 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25579.log 2024-03-09T15:09:09.251 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-09T15:09:09.251 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.25555.log: /var/log/ceph/ceph-client.admin.25579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25555.log.gz 2024-03-09T15:09:09.251 INFO:teuthology.orchestra.run.smithi179.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25579.log.gz 2024-03-09T15:09:09.252 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-09T15:09:09.252 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25459.log 2024-03-09T15:09:09.252 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-09T15:09:09.252 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.25459.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25459.log.gz 2024-03-09T15:09:09.252 INFO:teuthology.orchestra.run.smithi179.stderr: /var/log/ceph/ceph-client.admin.25419.log 2024-03-09T15:09:09.252 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25603.log 2024-03-09T15:09:09.252 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.25419.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-09T15:09:09.252 INFO:teuthology.orchestra.run.smithi179.stderr: -- replaced with /var/log/ceph/ceph-client.admin.25419.log.gz 2024-03-09T15:09:09.253 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.25603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25603.log.gz 2024-03-09T15:09:09.253 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-09T15:09:09.253 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25531.log 2024-03-09T15:09:09.253 INFO:teuthology.orchestra.run.smithi179.stderr: 90.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-09T15:09:09.253 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25507.log 2024-03-09T15:09:09.253 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.25531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25531.log.gz 2024-03-09T15:09:09.253 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.25507.log: 0.0% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.25507.log.gz 2024-03-09T15:09:09.253 INFO:teuthology.orchestra.run.smithi179.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-03-09T15:09:09.271 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.87918.log: /var/log/ceph/ceph-client.admin.116085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89098.log 2024-03-09T15:09:09.272 INFO:teuthology.orchestra.run.smithi099.stderr: 82.6%/var/log/ceph/ceph-client.admin.41605.log: -- replaced with /var/log/ceph/ceph-client.admin.87918.log.gz 2024-03-09T15:09:09.272 INFO:teuthology.orchestra.run.smithi099.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.41605.log.gz 2024-03-09T15:09:09.272 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109775.log 2024-03-09T15:09:09.272 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111570.log 2024-03-09T15:09:09.272 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.89098.log: /var/log/ceph/ceph-client.admin.109775.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.109775.log.gz 2024-03-09T15:09:09.272 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.116085.log.gz 2024-03-09T15:09:09.272 INFO:teuthology.orchestra.run.smithi099.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.89098.log.gz 2024-03-09T15:09:09.273 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69483.log 2024-03-09T15:09:09.273 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.111570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42195.log 2024-03-09T15:09:09.273 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111570.log.gz 2024-03-09T15:09:09.273 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.69483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96771.log 2024-03-09T15:09:09.273 INFO:teuthology.orchestra.run.smithi099.stderr: 49.4% -- replaced with /var/log/ceph/ceph-client.admin.69483.log.gz 2024-03-09T15:09:09.273 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90871.log 2024-03-09T15:09:09.273 INFO:teuthology.orchestra.run.smithi099.stderr: 84.5%/var/log/ceph/ceph-client.admin.96771.log: -- replaced with /var/log/ceph/ceph-client.admin.42195.log.gz 2024-03-09T15:09:09.273 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-09T15:09:09.274 INFO:teuthology.orchestra.run.smithi099.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.96771.log.gz 2024-03-09T15:09:09.274 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.90871.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.90871.log.gz 2024-03-09T15:09:09.274 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32986.log 2024-03-09T15:09:09.274 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52965.log 2024-03-09T15:09:09.274 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.32986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.127460.log 2024-03-09T15:09:09.274 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0%/var/log/ceph/ceph-client.admin.52965.log: -- replaced with /var/log/ceph/ceph-client.admin.32986.log.gz 2024-03-09T15:09:09.274 INFO:teuthology.orchestra.run.smithi099.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.52965.log.gz 2024-03-09T15:09:09.274 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51170.log 2024-03-09T15:09:09.275 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.127460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31450.log 2024-03-09T15:09:09.275 INFO:teuthology.orchestra.run.smithi099.stderr: 84.1%/var/log/ceph/ceph-client.admin.51170.log: -- replaced with /var/log/ceph/ceph-client.0.127460.log.gz 2024-03-09T15:09:09.275 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51170.log.gz 2024-03-09T15:09:09.275 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25549.log 2024-03-09T15:09:09.275 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.128640.log 2024-03-09T15:09:09.275 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31450.log.gz 2024-03-09T15:09:09.275 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.25549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25549.log.gz 2024-03-09T15:09:09.275 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.123918.log 2024-03-09T15:09:09.276 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.128640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33035.log 2024-03-09T15:09:09.276 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.123918.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.128640.log.gz 2024-03-09T15:09:09.276 INFO:teuthology.orchestra.run.smithi099.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.0.123918.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49965.log 2024-03-09T15:09:09.276 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-09T15:09:09.276 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.33035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113365.log 2024-03-09T15:09:09.276 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.49965.log: 86.9% 86.1% -- replaced with /var/log/ceph/ceph-client.admin.49965.log.gz 2024-03-09T15:09:09.276 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.0.133581.log.gz 2024-03-09T15:09:09.276 INFO:teuthology.orchestra.run.smithi099.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.0.33035.log.gz 2024-03-09T15:09:09.276 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31456.log 2024-03-09T15:09:09.277 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.113365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56699.log 2024-03-09T15:09:09.277 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113365.log.gz 2024-03-09T15:09:09.277 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34807.log 2024-03-09T15:09:09.277 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31456.log.gz 2024-03-09T15:09:09.277 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77298.log 2024-03-09T15:09:09.277 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.34807.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.56699.log.gz 2024-03-09T15:09:09.277 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102082.log 2024-03-09T15:09:09.277 INFO:teuthology.orchestra.run.smithi099.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.34807.log.gz/var/log/ceph/ceph-client.admin.77298.log: 2024-03-09T15:09:09.278 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135412.log 2024-03-09T15:09:09.278 INFO:teuthology.orchestra.run.smithi099.stderr: 82.3%/var/log/ceph/ceph-client.admin.102082.log: -- replaced with /var/log/ceph/ceph-client.admin.77298.log.gz 2024-03-09T15:09:09.278 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55785.log 2024-03-09T15:09:09.278 INFO:teuthology.orchestra.run.smithi099.stderr: 82.5%/var/log/ceph/ceph-client.admin.135412.log: -- replaced with /var/log/ceph/ceph-client.admin.102082.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76118.log 2024-03-09T15:09:09.278 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-09T15:09:09.278 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135412.log.gz 2024-03-09T15:09:09.278 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55785.log: 48.6% -- replaced with /var/log/ceph/ceph-client.admin.55785.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31101.log 2024-03-09T15:09:09.278 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-09T15:09:09.279 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.76118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31695.log 2024-03-09T15:09:09.279 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31101.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.76118.log.gz --verbose 2024-03-09T15:09:09.279 INFO:teuthology.orchestra.run.smithi099.stderr: -- /var/log/ceph/ceph-client.admin.135516.log 2024-03-09T15:09:09.279 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31101.log.gz 2024-03-09T15:09:09.279 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81428.log 2024-03-09T15:09:09.279 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31695.log.gz 2024-03-09T15:09:09.279 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83788.log 2024-03-09T15:09:09.279 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135516.log.gz 2024-03-09T15:09:09.280 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.81428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95001.log 2024-03-09T15:09:09.280 INFO:teuthology.orchestra.run.smithi099.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.81428.log.gz/var/log/ceph/ceph-client.admin.83788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31467.log 2024-03-09T15:09:09.280 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-09T15:09:09.280 INFO:teuthology.orchestra.run.smithi099.stderr: 81.6%/var/log/ceph/ceph-client.admin.95001.log: -- replaced with /var/log/ceph/ceph-client.admin.83788.log.gz 2024-03-09T15:09:09.280 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85558.log 2024-03-09T15:09:09.280 INFO:teuthology.orchestra.run.smithi099.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.95001.log.gz 2024-03-09T15:09:09.280 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31467.log.gz 2024-03-09T15:09:09.280 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31693.log 2024-03-09T15:09:09.281 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.85558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33633.log 2024-03-09T15:09:09.281 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31693.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.85558.log.gz 2024-03-09T15:09:09.281 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-09T15:09:09.281 INFO:teuthology.orchestra.run.smithi099.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31693.log.gz 2024-03-09T15:09:09.281 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.33633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104442.log 2024-03-09T15:09:09.281 INFO:teuthology.orchestra.run.smithi099.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.33633.log.gz 2024-03-09T15:09:09.281 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31076.log 2024-03-09T15:09:09.281 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.104442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31003.log 2024-03-09T15:09:09.282 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31076.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104442.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31076.log.gz 2024-03-09T15:09:09.282 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-09T15:09:09.282 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48785.log 2024-03-09T15:09:09.282 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56098.log 2024-03-09T15:09:09.282 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31003.log: /var/log/ceph/ceph-client.admin.48785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31003.log.gz 2024-03-09T15:09:09.282 INFO:teuthology.orchestra.run.smithi099.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.48785.log.gz 2024-03-09T15:09:09.282 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.131000.log 2024-03-09T15:09:09.282 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66432.log 2024-03-09T15:09:09.283 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56098.log: /var/log/ceph/ceph-client.0.131000.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.56098.log.gz 2024-03-09T15:09:09.283 INFO:teuthology.orchestra.run.smithi099.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.131000.log.gz 2024-03-09T15:09:09.283 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118186.log 2024-03-09T15:09:09.283 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32936.log 2024-03-09T15:09:09.283 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.66432.log: /var/log/ceph/ceph-client.admin.118186.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.118186.log.gz 2024-03-09T15:09:09.283 INFO:teuthology.orchestra.run.smithi099.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.66432.log.gz 2024-03-09T15:09:09.283 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87328.log 2024-03-09T15:09:09.283 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53605.log 2024-03-09T15:09:09.284 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.32936.log: /var/log/ceph/ceph-client.admin.87328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32936.log.gz 2024-03-09T15:09:09.284 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84968.log 2024-03-09T15:09:09.284 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.87328.log.gz 2024-03-09T15:09:09.284 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53605.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.53605.log.gz 2024-03-09T15:09:09.284 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79068.log 2024-03-09T15:09:09.284 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118775.log 2024-03-09T15:09:09.284 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84968.log: /var/log/ceph/ceph-client.admin.79068.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.84968.log.gz 2024-03-09T15:09:09.285 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.79068.log.gz 2024-03-09T15:09:09.285 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55470.log 2024-03-09T15:09:09.285 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.118775.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.118775.log.gz 2024-03-09T15:09:09.285 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98542.log 2024-03-09T15:09:09.285 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65251.log 2024-03-09T15:09:09.285 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.55470.log: /var/log/ceph/ceph-client.admin.98542.log: 58.8% -- replaced with /var/log/ceph/ceph-client.admin.55470.log.gz 2024-03-09T15:09:09.285 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98542.log.gzgzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-03-09T15:09:09.285 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-09T15:09:09.286 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.65251.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.65251.log.gz 2024-03-09T15:09:09.286 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101492.log 2024-03-09T15:09:09.286 INFO:teuthology.orchestra.run.smithi179.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-09T15:09:09.293 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35984.log 2024-03-09T15:09:09.294 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.101492.log: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-03-09T15:09:09.294 INFO:teuthology.orchestra.run.smithi099.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101492.log.gz 2024-03-09T15:09:09.294 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-09T15:09:09.294 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.35984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82608.log 2024-03-09T15:09:09.294 INFO:teuthology.orchestra.run.smithi099.stderr: 45.3% -- replaced with /var/log/ceph/ceph-client.0.35984.log.gz 2024-03-09T15:09:09.294 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112185.log 2024-03-09T15:09:09.294 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.82608.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.82608.log.gz 2024-03-09T15:09:09.295 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34217.log 2024-03-09T15:09:09.295 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.112185.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112185.log.gz 2024-03-09T15:09:09.295 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135152.log 2024-03-09T15:09:09.295 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.34217.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.34217.log.gz 2024-03-09T15:09:09.295 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97951.log 2024-03-09T15:09:09.295 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135152.log.gz 2024-03-09T15:09:09.295 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135540.log 2024-03-09T15:09:09.295 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.97951.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.97951.log.gz 2024-03-09T15:09:09.296 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108595.log 2024-03-09T15:09:09.296 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135540.log.gz 2024-03-09T15:09:09.296 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40425.log 2024-03-09T15:09:09.296 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.108595.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.108595.log.gz 2024-03-09T15:09:09.296 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89688.log 2024-03-09T15:09:09.296 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.40425.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.40425.log.gz 2024-03-09T15:09:09.296 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42835.log 2024-03-09T15:09:09.297 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.89688.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.89688.log.gz 2024-03-09T15:09:09.297 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91461.log 2024-03-09T15:09:09.297 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42835.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.42835.log.gz 2024-03-09T15:09:09.297 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61147.log 2024-03-09T15:09:09.297 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.91461.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.91461.log.gz 2024-03-09T15:09:09.297 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117597.log 2024-03-09T15:09:09.297 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61147.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61147.log.gz 2024-03-09T15:09:09.299 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43425.log 2024-03-09T15:09:09.299 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.117597.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.117597.log.gz 2024-03-09T15:09:09.299 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69521.log 2024-03-09T15:09:09.299 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.43425.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.43425.log.gz 2024-03-09T15:09:09.299 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135074.log 2024-03-09T15:09:09.300 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.69521.log: 92.0% -- replaced with /var/log/ceph/ceph-client.0.69521.log.gz 2024-03-09T15:09:09.301 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134892.log 2024-03-09T15:09:09.301 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135074.log.gz 2024-03-09T15:09:09.302 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105622.log 2024-03-09T15:09:09.302 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.134892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134892.log.gz 2024-03-09T15:09:09.303 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52375.log 2024-03-09T15:09:09.303 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.105622.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.105622.log.gz 2024-03-09T15:09:09.304 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.132985.log 2024-03-09T15:09:09.305 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.52375.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.52375.log.gz 2024-03-09T15:09:09.305 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84378.log 2024-03-09T15:09:09.306 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.132985.log: 81.1% -- replaced with /var/log/ceph/ceph-client.0.132985.log.gz 2024-03-09T15:09:09.306 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121258.log 2024-03-09T15:09:09.307 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.84378.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.84378.log.gz 2024-03-09T15:09:09.307 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123318.log 2024-03-09T15:09:09.308 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.121258.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.121258.log.gz 2024-03-09T15:09:09.309 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56663.log 2024-03-09T15:09:09.309 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.123318.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.123318.log.gz 2024-03-09T15:09:09.310 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68846.log 2024-03-09T15:09:09.310 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56663.log: 19.5% -- replaced with /var/log/ceph/ceph-client.admin.56663.log.gz 2024-03-09T15:09:09.311 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134918.log 2024-03-09T15:09:09.311 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.68846.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.68846.log.gz 2024-03-09T15:09:09.312 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134996.log 2024-03-09T15:09:09.313 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.134918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134918.log.gz 2024-03-09T15:09:09.313 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-09T15:09:09.313 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.134996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134996.log.gz 2024-03-09T15:09:09.314 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135178.log 2024-03-09T15:09:09.323 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82018.log 2024-03-09T15:09:09.323 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135178.log.gz 2024-03-09T15:09:09.325 INFO:teuthology.orchestra.run.smithi099.stderr: 93.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-09T15:09:09.325 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31855.log 2024-03-09T15:09:09.326 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.82018.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.82018.log.gz 2024-03-09T15:09:09.326 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99722.log 2024-03-09T15:09:09.327 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31855.log.gz 2024-03-09T15:09:09.327 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68256.log 2024-03-09T15:09:09.328 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.99722.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.99722.log.gz 2024-03-09T15:09:09.329 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103262.log 2024-03-09T15:09:09.329 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.68256.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.68256.log.gz 2024-03-09T15:09:09.329 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41015.log 2024-03-09T15:09:09.332 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.103262.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.103262.log.gz 2024-03-09T15:09:09.332 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105032.log 2024-03-09T15:09:09.333 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.41015.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.41015.log.gz 2024-03-09T15:09:09.333 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134944.log 2024-03-09T15:09:09.334 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.105032.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.105032.log.gz 2024-03-09T15:09:09.334 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25401.log 2024-03-09T15:09:09.335 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.134944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134944.log.gz 2024-03-09T15:09:09.335 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57931.log 2024-03-09T15:09:09.335 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.25401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25401.log.gz 2024-03-09T15:09:09.336 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90278.log 2024-03-09T15:09:09.337 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.57931.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.57931.log.gz 2024-03-09T15:09:09.337 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31449.log 2024-03-09T15:09:09.338 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.90278.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.90278.log.gz 2024-03-09T15:09:09.339 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108573.log 2024-03-09T15:09:09.339 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31449.log.gz 2024-03-09T15:09:09.340 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110955.log 2024-03-09T15:09:09.340 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.108573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108573.log.gz 2024-03-09T15:09:09.340 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31258.log 2024-03-09T15:09:09.341 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.110955.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110955.log.gz 2024-03-09T15:09:09.341 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56073.log 2024-03-09T15:09:09.342 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31258.log.gz 2024-03-09T15:09:09.342 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92641.log 2024-03-09T15:09:09.342 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56073.log: 52.8% -- replaced with /var/log/ceph/ceph-client.admin.56073.log.gz 2024-03-09T15:09:09.343 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107983.log 2024-03-09T15:09:09.343 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.92641.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.92641.log.gz 2024-03-09T15:09:09.344 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31435.log 2024-03-09T15:09:09.345 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.107983.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.107983.log.gz 2024-03-09T15:09:09.345 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103852.log 2024-03-09T15:09:09.346 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31435.log.gz 2024-03-09T15:09:09.346 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58574.log 2024-03-09T15:09:09.347 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.103852.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.103852.log.gz 2024-03-09T15:09:09.347 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31687.log 2024-03-09T15:09:09.354 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.58574.log: 93.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31257.log 2024-03-09T15:09:09.355 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31687.log.gz 2024-03-09T15:09:09.355 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.58574.log.gz 2024-03-09T15:09:09.356 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-09T15:09:09.356 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31257.log.gz 2024-03-09T15:09:09.356 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135360.log 2024-03-09T15:09:09.367 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.125690.log 2024-03-09T15:09:09.367 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135360.log.gz 2024-03-09T15:09:09.392 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33012.log 2024-03-09T15:09:09.393 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.125690.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.125690.log.gz 2024-03-09T15:09:09.400 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61790.log 2024-03-09T15:09:09.400 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.33012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33012.log.gz 2024-03-09T15:09:09.408 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.131590.log 2024-03-09T15:09:09.420 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.61790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31251.log 2024-03-09T15:09:09.420 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.131590.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.131590.log.gz 2024-03-09T15:09:09.428 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37736.log 2024-03-09T15:09:09.428 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31251.log.gz 2024-03-09T15:09:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45245.log 2024-03-09T15:09:09.436 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.37736.log: 43.2% -- replaced with /var/log/ceph/ceph-client.0.37736.log.gz 2024-03-09T15:09:09.444 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77888.log 2024-03-09T15:09:09.444 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45245.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.45245.log.gz 2024-03-09T15:09:09.452 INFO:teuthology.orchestra.run.smithi099.stderr: 95.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107393.log 2024-03-09T15:09:09.453 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.77888.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.77888.log.gz 2024-03-09T15:09:09.460 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35394.log 2024-03-09T15:09:09.461 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.107393.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.107393.log.gz 2024-03-09T15:09:09.464 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61790.log.gz 2024-03-09T15:09:09.473 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75528.log 2024-03-09T15:09:09.473 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.35394.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.35394.log.gz 2024-03-09T15:09:09.484 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73758.log 2024-03-09T15:09:09.485 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.75528.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.75528.log.gz 2024-03-09T15:09:09.492 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121847.log 2024-03-09T15:09:09.493 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.73758.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.73758.log.gz 2024-03-09T15:09:09.493 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70808.log 2024-03-09T15:09:09.494 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.121847.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.121847.log.gz 2024-03-09T15:09:09.500 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106803.log 2024-03-09T15:09:09.516 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.70808.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.70808.log.gz 2024-03-09T15:09:09.516 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-03-09T15:09:09.517 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.106803.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.106803.log.gz 2024-03-09T15:09:09.523 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50555.log 2024-03-09T15:09:09.532 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.115493.log 2024-03-09T15:09:09.533 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.50555.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.50555.log.gz 2024-03-09T15:09:09.540 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-09T15:09:09.540 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.115493.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.115493.log.gz 2024-03-09T15:09:09.548 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.128050.log 2024-03-09T15:09:09.551 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.audit.log: 94.5% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-09T15:09:09.556 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135308.log 2024-03-09T15:09:09.557 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.128050.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.128050.log.gz 2024-03-09T15:09:09.564 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.129230.log 2024-03-09T15:09:09.565 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135308.log.gz 2024-03-09T15:09:09.572 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42810.log 2024-03-09T15:09:09.573 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.129230.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.129230.log.gz 2024-03-09T15:09:09.580 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46425.log 2024-03-09T15:09:09.580 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42810.log.gz 2024-03-09T15:09:09.596 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70111.log 2024-03-09T15:09:09.597 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.46425.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.46425.log.gz 2024-03-09T15:09:09.597 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83198.log 2024-03-09T15:09:09.598 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.70111.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.70111.log.gz 2024-03-09T15:09:09.604 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51145.log 2024-03-09T15:09:09.616 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.83198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47015.log 2024-03-09T15:09:09.616 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51145.log.gz 2024-03-09T15:09:09.620 INFO:teuthology.orchestra.run.smithi099.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.83198.log.gz 2024-03-09T15:09:09.622 INFO:teuthology.orchestra.run.smithi099.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-09T15:09:09.632 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67613.log 2024-03-09T15:09:09.633 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47015.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.47015.log.gz 2024-03-09T15:09:09.636 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42785.log 2024-03-09T15:09:09.637 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.67613.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.67613.log.gz 2024-03-09T15:09:09.638 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31651.log 2024-03-09T15:09:09.638 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.42785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42785.log.gz 2024-03-09T15:09:09.649 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31451.log 2024-03-09T15:09:09.649 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31651.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31651.log.gz 2024-03-09T15:09:09.668 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116674.log 2024-03-09T15:09:09.668 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31451.log.gz 2024-03-09T15:09:09.676 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119364.log 2024-03-09T15:09:09.677 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.116674.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.116674.log.gz 2024-03-09T15:09:09.684 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135022.log 2024-03-09T15:09:09.684 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.119364.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.119364.log.gz 2024-03-09T15:09:09.692 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53555.log 2024-03-09T15:09:09.692 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135022.log.gz 2024-03-09T15:09:09.700 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48195.log 2024-03-09T15:09:09.701 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.53555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53555.log.gz 2024-03-09T15:09:09.708 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76708.log 2024-03-09T15:09:09.709 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.48195.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.48195.log.gz 2024-03-09T15:09:09.711 INFO:teuthology.orchestra.run.smithi099.stderr: 94.5% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-03-09T15:09:09.712 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73168.log 2024-03-09T15:09:09.713 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.76708.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.76708.log.gz 2024-03-09T15:09:09.713 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31907.log 2024-03-09T15:09:09.713 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.73168.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.73168.log.gz 2024-03-09T15:09:09.714 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79658.log 2024-03-09T15:09:09.714 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31907.log.gz 2024-03-09T15:09:09.715 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.130410.log 2024-03-09T15:09:09.715 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.79658.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.79658.log.gz 2024-03-09T15:09:09.716 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31253.log 2024-03-09T15:09:09.717 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.130410.log: 80.8% -- replaced with /var/log/ceph/ceph-client.0.130410.log.gz 2024-03-09T15:09:09.717 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31881.log 2024-03-09T15:09:09.717 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31253.log.gz 2024-03-09T15:09:09.718 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78478.log 2024-03-09T15:09:09.718 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31881.log.gz 2024-03-09T15:09:09.718 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88508.log 2024-03-09T15:09:09.720 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.78478.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.78478.log.gz 2024-03-09T15:09:09.720 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80838.log 2024-03-09T15:09:09.720 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.88508.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.88508.log.gz 2024-03-09T15:09:09.721 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68204.log 2024-03-09T15:09:09.721 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.80838.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80838.log.gz 2024-03-09T15:09:09.722 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54195.log 2024-03-09T15:09:09.722 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.68204.log: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.68204.log.gz 2024-03-09T15:09:09.723 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135230.log 2024-03-09T15:09:09.723 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.54195.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.54195.log.gz 2024-03-09T15:09:09.724 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31259.log 2024-03-09T15:09:09.724 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135230.log.gz 2024-03-09T15:09:09.724 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31459.log 2024-03-09T15:09:09.726 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31259.log.gz 2024-03-09T15:09:09.726 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135126.log 2024-03-09T15:09:09.726 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31459.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31459.log.gz 2024-03-09T15:09:09.726 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135464.log 2024-03-09T15:09:09.728 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135126.log.gz 2024-03-09T15:09:09.728 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.126280.log 2024-03-09T15:09:09.728 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135464.log.gz 2024-03-09T15:09:09.728 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135204.log 2024-03-09T15:09:09.729 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.126280.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.126280.log.gz 2024-03-09T15:09:09.729 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93231.log 2024-03-09T15:09:09.729 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135204.log.gz 2024-03-09T15:09:09.731 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20582.log 2024-03-09T15:09:09.731 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.93231.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.93231.log.gz 2024-03-09T15:09:09.731 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31246.log 2024-03-09T15:09:09.731 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph.tmp-client.admin.20582.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20582.log.gz 2024-03-09T15:09:09.733 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31655.log 2024-03-09T15:09:09.733 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31246.log.gz 2024-03-09T15:09:09.733 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37152.log 2024-03-09T15:09:09.733 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31655.log.gz 2024-03-09T15:09:09.734 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120669.log 2024-03-09T15:09:09.734 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.37152.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.37152.log.gz 2024-03-09T15:09:09.735 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25675.log 2024-03-09T15:09:09.736 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.120669.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.120669.log.gz 2024-03-09T15:09:09.736 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31255.log 2024-03-09T15:09:09.736 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.25675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25675.log.gz 2024-03-09T15:09:09.737 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39716.log 2024-03-09T15:09:09.737 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31255.log.gz 2024-03-09T15:09:09.737 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63076.log 2024-03-09T15:09:09.738 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.39716.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.39716.log.gz 2024-03-09T15:09:09.738 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86738.log 2024-03-09T15:09:09.740 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.63076.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.63076.log.gz 2024-03-09T15:09:09.740 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110365.log 2024-03-09T15:09:09.741 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.86738.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.86738.log.gz 2024-03-09T15:09:09.741 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47605.log 2024-03-09T15:09:09.741 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.110365.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.110365.log.gz 2024-03-09T15:09:09.742 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51195.log 2024-03-09T15:09:09.742 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.47605.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.47605.log.gz 2024-03-09T15:09:09.743 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114005.log 2024-03-09T15:09:09.743 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.51195.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.51195.log.gz 2024-03-09T15:09:09.744 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62433.log 2024-03-09T15:09:09.744 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.114005.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.114005.log.gz 2024-03-09T15:09:09.745 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111595.log 2024-03-09T15:09:09.747 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.62433.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.62433.log.gz 2024-03-09T15:09:09.748 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.126870.log 2024-03-09T15:09:09.748 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.111595.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.111595.log.gz 2024-03-09T15:09:09.749 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45195.log 2024-03-09T15:09:09.749 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.0.126870.log: 80.7% -- replaced with /var/log/ceph/ceph-client.0.126870.log.gz 2024-03-09T15:09:09.750 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102672.log 2024-03-09T15:09:09.750 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.45195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45195.log.gz 2024-03-09T15:09:09.751 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93821.log 2024-03-09T15:09:09.751 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.102672.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.102672.log.gz 2024-03-09T15:09:09.751 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100312.log 2024-03-09T15:09:09.752 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.93821.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.93821.log.gz 2024-03-09T15:09:09.752 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31127.log 2024-03-09T15:09:09.753 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.100312.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.100312.log.gz 2024-03-09T15:09:09.754 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92051.log 2024-03-09T15:09:09.754 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31127.log.gz 2024-03-09T15:09:09.755 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135386.log 2024-03-09T15:09:09.755 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.92051.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.92051.log.gz 2024-03-09T15:09:09.756 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100902.log 2024-03-09T15:09:09.756 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.135386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.135386.log.gz 2024-03-09T15:09:09.757 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134970.log 2024-03-09T15:09:09.757 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.100902.log: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.100902.log.gz 2024-03-09T15:09:09.758 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122729.log 2024-03-09T15:09:09.758 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.134970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.134970.log.gz 2024-03-09T15:09:09.758 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31688.log 2024-03-09T15:09:09.760 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.122729.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.122729.log.gz 2024-03-09T15:09:09.761 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56044.log 2024-03-09T15:09:09.761 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.31688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31688.log.gz 2024-03-09T15:09:09.762 INFO:teuthology.orchestra.run.smithi099.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71988.log 2024-03-09T15:09:09.768 INFO:teuthology.orchestra.run.smithi179.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-09T15:09:09.778 INFO:teuthology.orchestra.run.smithi099.stderr:/var/log/ceph/ceph-client.admin.56044.log: /var/log/ceph/ceph-client.admin.71988.log: 88.3% 81.9% -- replaced with /var/log/ceph/ceph-client.admin.71988.log.gz 2024-03-09T15:09:09.778 INFO:teuthology.orchestra.run.smithi099.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56044.log.gz 2024-03-09T15:09:10.083 INFO:teuthology.orchestra.run.smithi099.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-09T15:09:11.336 INFO:teuthology.orchestra.run.smithi099.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-09T15:09:12.765 INFO:teuthology.orchestra.run.smithi099.stderr: 93.6% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-03-09T15:09:17.826 INFO:teuthology.orchestra.run.smithi099.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-09T15:09:19.498 INFO:teuthology.orchestra.run.smithi099.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-09T15:09:19.976 INFO:teuthology.orchestra.run.smithi179.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-09T15:09:20.014 INFO:teuthology.orchestra.run.smithi179.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-09T15:09:20.374 INFO:teuthology.orchestra.run.smithi179.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-09T15:09:23.094 INFO:teuthology.orchestra.run.smithi179.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-09T15:09:23.095 INFO:teuthology.orchestra.run.smithi179.stderr: 2024-03-09T15:09:23.095 INFO:teuthology.orchestra.run.smithi179.stderr:real 0m13.876s 2024-03-09T15:09:23.095 INFO:teuthology.orchestra.run.smithi179.stderr:user 0m45.440s 2024-03-09T15:09:23.095 INFO:teuthology.orchestra.run.smithi179.stderr:sys 0m1.661s 2024-03-09T15:09:24.191 INFO:teuthology.orchestra.run.smithi099.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-09T15:09:29.445 INFO:teuthology.orchestra.run.smithi099.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-09T15:09:29.446 INFO:teuthology.orchestra.run.smithi099.stderr: 2024-03-09T15:09:29.446 INFO:teuthology.orchestra.run.smithi099.stderr:real 0m20.271s 2024-03-09T15:09:29.447 INFO:teuthology.orchestra.run.smithi099.stderr:user 0m58.993s 2024-03-09T15:09:29.447 INFO:teuthology.orchestra.run.smithi099.stderr:sys 0m2.235s 2024-03-09T15:09:29.448 INFO:tasks.ceph:Archiving logs... 2024-03-09T15:09:29.448 DEBUG:teuthology.misc:Transferring archived files from smithi099:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588483/remote/smithi099/log 2024-03-09T15:09:29.449 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-09T15:09:36.545 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588483/remote/smithi179/log 2024-03-09T15:09:36.546 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-09T15:09:42.140 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-09T15:09:42.153 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-09T15:09:42.153 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-09T15:09:42.156 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-09T15:09:42.234 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-09T15:09:42.246 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-09T15:09:42.246 DEBUG:teuthology.orchestra.run.smithi099:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-09T15:09:42.249 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-09T15:09:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: remote refid st t when poll reach delay offset jitter 2024-03-09T15:09:42.260 INFO:teuthology.orchestra.run.smithi099.stdout:============================================================================== 2024-03-09T15:09:42.260 INFO:teuthology.orchestra.run.smithi099.stdout:*hv01.front.sepi 44.4.53.2 2 u 49 64 377 0.080 -2.143 0.105 2024-03-09T15:09:42.260 INFO:teuthology.orchestra.run.smithi099.stdout:+hv02.front.sepi 96.245.170.99 3 u 41 64 377 0.074 -0.841 0.112 2024-03-09T15:09:42.260 INFO:teuthology.orchestra.run.smithi099.stdout:+hv03.front.sepi 74.6.168.72 3 u 59 64 377 0.093 -2.364 0.121 2024-03-09T15:09:42.260 INFO:teuthology.orchestra.run.smithi099.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-03-09T15:09:42.262 INFO:teuthology.orchestra.run.smithi179.stdout: remote refid st t when poll reach delay offset jitter 2024-03-09T15:09:42.262 INFO:teuthology.orchestra.run.smithi179.stdout:============================================================================== 2024-03-09T15:09:42.262 INFO:teuthology.orchestra.run.smithi179.stdout:*hv01.front.sepi 44.4.53.2 2 u 34 64 377 0.079 -3.975 0.441 2024-03-09T15:09:42.262 INFO:teuthology.orchestra.run.smithi179.stdout:+hv02.front.sepi 96.245.170.99 3 u 42 64 377 0.101 -3.094 0.791 2024-03-09T15:09:42.263 INFO:teuthology.orchestra.run.smithi179.stdout:+hv03.front.sepi 74.6.168.72 3 u 44 64 377 0.083 -4.148 0.464 2024-03-09T15:09:42.263 INFO:teuthology.orchestra.run.smithi179.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-03-09T15:09:42.263 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-09T15:09:42.273 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-09T15:09:42.274 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-09T15:09:42.285 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-09T15:09:42.297 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-09T15:09:42.308 INFO:teuthology.task.internal:Duration was 3094.676515 seconds 2024-03-09T15:09:42.308 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-09T15:09:42.320 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-09T15:09:42.320 DEBUG:teuthology.orchestra.run.smithi099:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-09T15:09:42.323 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-09T15:09:42.360 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-09T15:09:42.360 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi099.front.sepia.ceph.com 2024-03-09T15:09:42.360 DEBUG:teuthology.orchestra.run.smithi099:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-09T15:09:42.409 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2024-03-09T15:09:42.410 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-09T15:09:42.420 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-09T15:09:42.420 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-09T15:09:42.453 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-09T15:09:42.485 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-09T15:09:42.485 DEBUG:teuthology.orchestra.run.smithi099:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-09T15:09:42.521 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-09T15:09:42.582 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-09T15:09:42.595 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-09T15:09:42.595 DEBUG:teuthology.orchestra.run.smithi099:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-09T15:09:42.607 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-09T15:09:42.621 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-09T15:09:42.635 DEBUG:teuthology.orchestra.run.smithi099:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-09T15:09:42.649 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-09T15:09:42.658 INFO:teuthology.orchestra.run.smithi099.stdout:kernel.core_pattern = core 2024-03-09T15:09:42.675 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2024-03-09T15:09:42.970 DEBUG:teuthology.orchestra.run.smithi099:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-09T15:09:42.975 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T15:09:42.975 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-09T15:09:43.016 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-09T15:09:43.017 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-09T15:09:43.029 INFO:teuthology.task.internal:Transferring archived files... 2024-03-09T15:09:43.030 DEBUG:teuthology.misc:Transferring archived files from smithi099:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588483/remote/smithi099 2024-03-09T15:09:43.030 DEBUG:teuthology.orchestra.run.smithi099:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-09T15:09:43.056 DEBUG:teuthology.misc:Transferring archived files from smithi179:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588483/remote/smithi179 2024-03-09T15:09:43.056 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-09T15:09:43.080 INFO:teuthology.task.internal:Removing archive directory... 2024-03-09T15:09:43.080 DEBUG:teuthology.orchestra.run.smithi099:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-09T15:09:43.097 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-09T15:09:43.125 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-09T15:09:43.138 INFO:teuthology.task.internal:Not uploading archives. 2024-03-09T15:09:43.138 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-09T15:09:43.150 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-09T15:09:43.150 DEBUG:teuthology.orchestra.run.smithi099:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-09T15:09:43.153 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-09T15:09:43.156 INFO:teuthology.orchestra.run.smithi099.stdout: 658641 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 9 15:09 /home/ubuntu/cephtest 2024-03-09T15:09:43.174 INFO:teuthology.orchestra.run.smithi179.stdout: 658637 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 9 15:09 /home/ubuntu/cephtest 2024-03-09T15:09:43.175 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-09T15:09:43.187 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-09T15:09:43.212 INFO:teuthology.nuke:Checking targets against current locks 2024-03-09T15:09:43.236 DEBUG:teuthology.nuke:shortname: smithi099 2024-03-09T15:09:43.236 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-09T15:09:43.261 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi099.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-09 14:09:18.060897', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJvxb6Cx57k+Dk+mitefAnAU85CNp5VA/Ns5TtPcNylqPgdgH53lXV57Tp6MB+4UAAX5HtNWinI+yLWMEa45IKQ='} 2024-03-09T15:09:43.264 DEBUG:teuthology.nuke:shortname: smithi179 2024-03-09T15:09:43.264 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-09T15:09:43.291 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-03-09_13:26:09-rgw-wip-rgw-account-v3-distro-default-smithi/7588483', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-09 14:09:18.062315', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH5JVAmELeUh55pGkGtGa7EGX66r2w7RVpzb7HG3i0TSR9KbFAys0wgxHv/ahX5R6Yl49ACut6DEtH5SaYwLo4A='} 2024-03-09T15:09:43.320 INFO:teuthology.orchestra.console.smithi099:Power off 2024-03-09T15:09:43.320 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-09T15:09:43.346 DEBUG:teuthology.orchestra.console.smithi099:power off output: Chassis Power Control: Down/Off 2024-03-09T15:09:43.346 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:09:43.365 INFO:teuthology.orchestra.console.smithi179:Power off 2024-03-09T15:09:43.366 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-09T15:09:43.376 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-03-09T15:09:43.390 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2024-03-09T15:09:43.390 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:09:43.414 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-03-09T15:09:47.378 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:09:47.416 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:09:47.492 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-03-09T15:09:47.527 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-03-09T15:09:51.497 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:09:51.528 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:09:51.611 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is on 2024-03-09T15:09:51.641 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-03-09T15:09:51.741 INFO:teuthology.orchestra.console.smithi179:Power off completed 2024-03-09T15:09:55.619 DEBUG:teuthology.orchestra.console.smithi099:pexpect command: ipmitool -H smithi099.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-09T15:09:55.734 DEBUG:teuthology.orchestra.console.smithi099:check power output: Chassis Power is off 2024-03-09T15:09:55.834 INFO:teuthology.orchestra.console.smithi099:Power off completed 2024-03-09T15:09:55.940 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/rgw-datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-greater-than-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 3094.676515340805 failure_reason: 'Command failed (s3 tests against rgw) on smithi099 with status 1: "source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m ''not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3''"' flavor: default owner: scheduled_cbodley@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=5e5e2f2a1f2e464c9eb7403579015849 status: fail success: false 2024-03-09T15:09:55.941 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-09T15:09:56.017 INFO:teuthology.run:FAIL